Apache Kafka has come a long way since its initial development at LinkedIn in 2010 and its release as an open-source project the following year. Over the past decade, it has grown from a humble messaging bus used to power internal applications into the world's most popular streaming data platform. Its evolution is remarkable, and it has taken the industry by storm, quickly becoming a go-to solution for data streaming and processing.
How can you test an empty data pipeline? Well, you can't, really. Read on and let's walk you through creating pretend streaming data using Python and Faker.
Find out how Apache Kafka® and Apache Flink® allow you to move from batch processing to streaming, but keep using SQL in the data pipeline.
Meet your compliance goals using Aiven for OpenSearch®, S3 storage and Aiven for Apache Kafka®.
Learn how to produce and consume records with Apache Kafka Java client library
Let your data flow with the Apache Kafka®️ HTTP sink connector
Since its initial release in the fall of 2022, Klaw’s two minor releases have brought new features and simplified its workflows. Find out how much Klaw grew and improved in just two short months.
Terraform can orchestrate your infrastructure the same way every time, giving you confidence in your consistent platform. Idempotency for the win.