Kora: A Cloud-Native Event Streaming Platform for Kafka
Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions...
Gespeichert in:
| Veröffentlicht in: | Proceedings of the VLDB Endowment 2023-08, Vol.16 (12), p.3822-3834 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 3834 |
|---|---|
| container_issue | 12 |
| container_start_page | 3822 |
| container_title | Proceedings of the VLDB Endowment |
| container_volume | 16 |
| creator | Povzner, Anna Mahajan, Prince Gustafson, Jason Rao, Jun Juma, Ismael Min, Feng Sridharan, Shriram Bhatia, Nikhil Attaluri, Gopi Chandra, Adithya Kozlovski, Stanislav Sivaram, Rajini Bradstreet, Lucas Barrett, Bob Shah, Dhruvil Jacot, David Arthur, David Dagostino, Ron McCabe, Colin Obili, Manikumar Reddy Prakasam, Kowshik Sancio, Jose Garcia Singh, Vikas Nikhil, Alok Gupta, Kamal |
| description | Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces
Kora
, the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities. |
| doi_str_mv | 10.14778/3611540.3611567 |
| format | Article |
| fullrecord | <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_14778_3611540_3611567</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_14778_3611540_3611567</sourcerecordid><originalsourceid>FETCH-LOGICAL-c196t-25d2ba01875685eb08c756c0d03b64a0646bf5e1897213a650d8f662999d73533</originalsourceid><addsrcrecordid>eNpNj8FKw0AURQdRsFb3LucHUt_LZN7MuCuhWmlRQV2Hl2RGokkjk1jw7y01Czf3nNWFI8Q1wgIzY-yNIkSdweJIMidilqKGxIIzp__8XFwMwwcAWUI7E2bTR76VS5m3_XedPPLY7L1c7f1ulC9j9Nw1u3f53PIY-tjJw8gNh0--FGeB28FfTZyLt7vVa75Otk_3D_lym1ToaExSXaclA1qjyWpfgq0OVkENqqSMgTIqg_ZonUlRMWmobSBKnXO1UVqpuYC_3yr2wxB9KL5i03H8KRCKY3gxhRdTuPoFPfNIIw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Kora: A Cloud-Native Event Streaming Platform for Kafka</title><source>ACM Digital Library Complete</source><creator>Povzner, Anna ; Mahajan, Prince ; Gustafson, Jason ; Rao, Jun ; Juma, Ismael ; Min, Feng ; Sridharan, Shriram ; Bhatia, Nikhil ; Attaluri, Gopi ; Chandra, Adithya ; Kozlovski, Stanislav ; Sivaram, Rajini ; Bradstreet, Lucas ; Barrett, Bob ; Shah, Dhruvil ; Jacot, David ; Arthur, David ; Dagostino, Ron ; McCabe, Colin ; Obili, Manikumar Reddy ; Prakasam, Kowshik ; Sancio, Jose Garcia ; Singh, Vikas ; Nikhil, Alok ; Gupta, Kamal</creator><creatorcontrib>Povzner, Anna ; Mahajan, Prince ; Gustafson, Jason ; Rao, Jun ; Juma, Ismael ; Min, Feng ; Sridharan, Shriram ; Bhatia, Nikhil ; Attaluri, Gopi ; Chandra, Adithya ; Kozlovski, Stanislav ; Sivaram, Rajini ; Bradstreet, Lucas ; Barrett, Bob ; Shah, Dhruvil ; Jacot, David ; Arthur, David ; Dagostino, Ron ; McCabe, Colin ; Obili, Manikumar Reddy ; Prakasam, Kowshik ; Sancio, Jose Garcia ; Singh, Vikas ; Nikhil, Alok ; Gupta, Kamal</creatorcontrib><description>Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces
Kora
, the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.</description><identifier>ISSN: 2150-8097</identifier><identifier>EISSN: 2150-8097</identifier><identifier>DOI: 10.14778/3611540.3611567</identifier><language>eng</language><ispartof>Proceedings of the VLDB Endowment, 2023-08, Vol.16 (12), p.3822-3834</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c196t-25d2ba01875685eb08c756c0d03b64a0646bf5e1897213a650d8f662999d73533</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids></links><search><creatorcontrib>Povzner, Anna</creatorcontrib><creatorcontrib>Mahajan, Prince</creatorcontrib><creatorcontrib>Gustafson, Jason</creatorcontrib><creatorcontrib>Rao, Jun</creatorcontrib><creatorcontrib>Juma, Ismael</creatorcontrib><creatorcontrib>Min, Feng</creatorcontrib><creatorcontrib>Sridharan, Shriram</creatorcontrib><creatorcontrib>Bhatia, Nikhil</creatorcontrib><creatorcontrib>Attaluri, Gopi</creatorcontrib><creatorcontrib>Chandra, Adithya</creatorcontrib><creatorcontrib>Kozlovski, Stanislav</creatorcontrib><creatorcontrib>Sivaram, Rajini</creatorcontrib><creatorcontrib>Bradstreet, Lucas</creatorcontrib><creatorcontrib>Barrett, Bob</creatorcontrib><creatorcontrib>Shah, Dhruvil</creatorcontrib><creatorcontrib>Jacot, David</creatorcontrib><creatorcontrib>Arthur, David</creatorcontrib><creatorcontrib>Dagostino, Ron</creatorcontrib><creatorcontrib>McCabe, Colin</creatorcontrib><creatorcontrib>Obili, Manikumar Reddy</creatorcontrib><creatorcontrib>Prakasam, Kowshik</creatorcontrib><creatorcontrib>Sancio, Jose Garcia</creatorcontrib><creatorcontrib>Singh, Vikas</creatorcontrib><creatorcontrib>Nikhil, Alok</creatorcontrib><creatorcontrib>Gupta, Kamal</creatorcontrib><title>Kora: A Cloud-Native Event Streaming Platform for Kafka</title><title>Proceedings of the VLDB Endowment</title><description>Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces
Kora
, the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.</description><issn>2150-8097</issn><issn>2150-8097</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpNj8FKw0AURQdRsFb3LucHUt_LZN7MuCuhWmlRQV2Hl2RGokkjk1jw7y01Czf3nNWFI8Q1wgIzY-yNIkSdweJIMidilqKGxIIzp__8XFwMwwcAWUI7E2bTR76VS5m3_XedPPLY7L1c7f1ulC9j9Nw1u3f53PIY-tjJw8gNh0--FGeB28FfTZyLt7vVa75Otk_3D_lym1ToaExSXaclA1qjyWpfgq0OVkENqqSMgTIqg_ZonUlRMWmobSBKnXO1UVqpuYC_3yr2wxB9KL5i03H8KRCKY3gxhRdTuPoFPfNIIw</recordid><startdate>20230801</startdate><enddate>20230801</enddate><creator>Povzner, Anna</creator><creator>Mahajan, Prince</creator><creator>Gustafson, Jason</creator><creator>Rao, Jun</creator><creator>Juma, Ismael</creator><creator>Min, Feng</creator><creator>Sridharan, Shriram</creator><creator>Bhatia, Nikhil</creator><creator>Attaluri, Gopi</creator><creator>Chandra, Adithya</creator><creator>Kozlovski, Stanislav</creator><creator>Sivaram, Rajini</creator><creator>Bradstreet, Lucas</creator><creator>Barrett, Bob</creator><creator>Shah, Dhruvil</creator><creator>Jacot, David</creator><creator>Arthur, David</creator><creator>Dagostino, Ron</creator><creator>McCabe, Colin</creator><creator>Obili, Manikumar Reddy</creator><creator>Prakasam, Kowshik</creator><creator>Sancio, Jose Garcia</creator><creator>Singh, Vikas</creator><creator>Nikhil, Alok</creator><creator>Gupta, Kamal</creator><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20230801</creationdate><title>Kora: A Cloud-Native Event Streaming Platform for Kafka</title><author>Povzner, Anna ; Mahajan, Prince ; Gustafson, Jason ; Rao, Jun ; Juma, Ismael ; Min, Feng ; Sridharan, Shriram ; Bhatia, Nikhil ; Attaluri, Gopi ; Chandra, Adithya ; Kozlovski, Stanislav ; Sivaram, Rajini ; Bradstreet, Lucas ; Barrett, Bob ; Shah, Dhruvil ; Jacot, David ; Arthur, David ; Dagostino, Ron ; McCabe, Colin ; Obili, Manikumar Reddy ; Prakasam, Kowshik ; Sancio, Jose Garcia ; Singh, Vikas ; Nikhil, Alok ; Gupta, Kamal</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c196t-25d2ba01875685eb08c756c0d03b64a0646bf5e1897213a650d8f662999d73533</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Povzner, Anna</creatorcontrib><creatorcontrib>Mahajan, Prince</creatorcontrib><creatorcontrib>Gustafson, Jason</creatorcontrib><creatorcontrib>Rao, Jun</creatorcontrib><creatorcontrib>Juma, Ismael</creatorcontrib><creatorcontrib>Min, Feng</creatorcontrib><creatorcontrib>Sridharan, Shriram</creatorcontrib><creatorcontrib>Bhatia, Nikhil</creatorcontrib><creatorcontrib>Attaluri, Gopi</creatorcontrib><creatorcontrib>Chandra, Adithya</creatorcontrib><creatorcontrib>Kozlovski, Stanislav</creatorcontrib><creatorcontrib>Sivaram, Rajini</creatorcontrib><creatorcontrib>Bradstreet, Lucas</creatorcontrib><creatorcontrib>Barrett, Bob</creatorcontrib><creatorcontrib>Shah, Dhruvil</creatorcontrib><creatorcontrib>Jacot, David</creatorcontrib><creatorcontrib>Arthur, David</creatorcontrib><creatorcontrib>Dagostino, Ron</creatorcontrib><creatorcontrib>McCabe, Colin</creatorcontrib><creatorcontrib>Obili, Manikumar Reddy</creatorcontrib><creatorcontrib>Prakasam, Kowshik</creatorcontrib><creatorcontrib>Sancio, Jose Garcia</creatorcontrib><creatorcontrib>Singh, Vikas</creatorcontrib><creatorcontrib>Nikhil, Alok</creatorcontrib><creatorcontrib>Gupta, Kamal</creatorcontrib><collection>CrossRef</collection><jtitle>Proceedings of the VLDB Endowment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Povzner, Anna</au><au>Mahajan, Prince</au><au>Gustafson, Jason</au><au>Rao, Jun</au><au>Juma, Ismael</au><au>Min, Feng</au><au>Sridharan, Shriram</au><au>Bhatia, Nikhil</au><au>Attaluri, Gopi</au><au>Chandra, Adithya</au><au>Kozlovski, Stanislav</au><au>Sivaram, Rajini</au><au>Bradstreet, Lucas</au><au>Barrett, Bob</au><au>Shah, Dhruvil</au><au>Jacot, David</au><au>Arthur, David</au><au>Dagostino, Ron</au><au>McCabe, Colin</au><au>Obili, Manikumar Reddy</au><au>Prakasam, Kowshik</au><au>Sancio, Jose Garcia</au><au>Singh, Vikas</au><au>Nikhil, Alok</au><au>Gupta, Kamal</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Kora: A Cloud-Native Event Streaming Platform for Kafka</atitle><jtitle>Proceedings of the VLDB Endowment</jtitle><date>2023-08-01</date><risdate>2023</risdate><volume>16</volume><issue>12</issue><spage>3822</spage><epage>3834</epage><pages>3822-3834</pages><issn>2150-8097</issn><eissn>2150-8097</eissn><abstract>Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces
Kora
, the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.</abstract><doi>10.14778/3611540.3611567</doi><tpages>13</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 2150-8097 |
| ispartof | Proceedings of the VLDB Endowment, 2023-08, Vol.16 (12), p.3822-3834 |
| issn | 2150-8097 2150-8097 |
| language | eng |
| recordid | cdi_crossref_primary_10_14778_3611540_3611567 |
| source | ACM Digital Library Complete |
| title | Kora: A Cloud-Native Event Streaming Platform for Kafka |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T15%3A01%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Kora:%20A%20Cloud-Native%20Event%20Streaming%20Platform%20for%20Kafka&rft.jtitle=Proceedings%20of%20the%20VLDB%20Endowment&rft.au=Povzner,%20Anna&rft.date=2023-08-01&rft.volume=16&rft.issue=12&rft.spage=3822&rft.epage=3834&rft.pages=3822-3834&rft.issn=2150-8097&rft.eissn=2150-8097&rft_id=info:doi/10.14778/3611540.3611567&rft_dat=%3Ccrossref%3E10_14778_3611540_3611567%3C/crossref%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |