Confluent
Latest Confluent news, announcements & analysis
Infra
How Netflix Built a Map That Never Loses Data
Netflix redesigned its real-time service map to handle massive scale without losing data. The new system uses a multi-stage pipeline and clever backpressure techniques to ensure every event is processed, even under extreme load.
Ashish Kale ·
Data
Taming Your Growing Data Schemas
Managing numerous schemas in data pipelines like Kafka and Flink can become complex and costly. An InfoQ article explores this "schema proliferation" and suggests a consolidation strategy to simplify queries, reduce maintenance, and make systems more scalable and resilient.
Taranpreet Singh ·
Data
LivePerson Slashes GCP Data Costs
LivePerson significantly cut its Logstash processing costs on Google Cloud by over 50%. The company achieved this by systematically benchmarking GCP machine types, ultimately switching to AMD Milan-based instances. They also found that Kafka compression codec selection independently boosted throughput.
Taranpreet Singh ·
Infra
Apache Kafka's Cloud-Native Future
Apache Kafka is evolving into a cloud-native platform. This shift involves tiered storage for cost efficiency, better financial operations (FinOps) telemetry, and elastic scaling. Architects are also exploring a future where Kafka could operate without local disks, changing its core operational model.
Ashish Kale ·