Confluent
Latest Confluent news, announcements & analysis
Data
Taming Your Growing Data Schemas
Managing numerous schemas in data pipelines like Kafka and Flink can become complex and costly. An InfoQ article explores this "schema proliferation" and suggests a consolidation strategy to simplify queries, reduce maintenance, and make systems more scalable and resilient.
Taranpreet Singh ·
Data
LivePerson Slashes GCP Data Costs
LivePerson significantly cut its Logstash processing costs on Google Cloud by over 50%. The company achieved this by systematically benchmarking GCP machine types, ultimately switching to AMD Milan-based instances. They also found that Kafka compression codec selection independently boosted throughput.
Taranpreet Singh ·
Infra
Apache Kafka's Cloud-Native Future
Apache Kafka is evolving into a cloud-native platform. This shift involves tiered storage for cost efficiency, better financial operations (FinOps) telemetry, and elastic scaling. Architects are also exploring a future where Kafka could operate without local disks, changing its core operational model.
Ashish Kale ·