Operations | Monitoring | ITSM | DevOps | Cloud

%term

Monitoring Apache Spark applications running on Amazon EMR

We recently implemented a Spark streaming application, which consumes data from from multiple Kafka topics. The data consumed from Kafka comprises different types of telemetry events generated by mobile devices. We decided to host the Spark cluster using the Amazon EMR service, which manages a fleet of EC2 instances to run our data-processing pipelines.

Could knowledge sharing transform your company culture?

When you take a step back and think about society’s big technological breakthroughs — the printing press, the television, the Internet — they were revolutionary because they completely disrupted the way that the world shares knowledge. If you haven’t heard of it, knowledge sharing is pretty much exactly what it sounds like: it’s the exchange of information between different people, teams, organizations, or communities.