Kora: A Cloud-Native Event Streaming Platform for Kafka

Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings of the VLDB Endowment 2023-08, Vol.16 (12), p.3822-3834
Hauptverfasser: Povzner, Anna, Mahajan, Prince, Gustafson, Jason, Rao, Jun, Juma, Ismael, Min, Feng, Sridharan, Shriram, Bhatia, Nikhil, Attaluri, Gopi, Chandra, Adithya, Kozlovski, Stanislav, Sivaram, Rajini, Bradstreet, Lucas, Barrett, Bob, Shah, Dhruvil, Jacot, David, Arthur, David, Dagostino, Ron, McCabe, Colin, Obili, Manikumar Reddy, Prakasam, Kowshik, Sancio, Jose Garcia, Singh, Vikas, Nikhil, Alok, Gupta, Kamal
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces Kora , the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.
ISSN:2150-8097
2150-8097
DOI:10.14778/3611540.3611567