Joins on high-bandwidth memory: a new level in the memory hierarchy

High-bandwidth memory (HBM) gives an additional opportunity for hardware performance benefits. The high available bandwidth compared to regular DRAM allows execution of many threads in parallel, avoiding memory stalls through many concurrent memory accesses This is especially interesting considering...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The VLDB journal 2020-05, Vol.29 (2-3), p.797-817
Hauptverfasser: Pohl, Constantin, Sattler, Kai-Uwe, Graefe, Goetz
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 817
container_issue 2-3
container_start_page 797
container_title The VLDB journal
container_volume 29
creator Pohl, Constantin
Sattler, Kai-Uwe
Graefe, Goetz
description High-bandwidth memory (HBM) gives an additional opportunity for hardware performance benefits. The high available bandwidth compared to regular DRAM allows execution of many threads in parallel, avoiding memory stalls through many concurrent memory accesses This is especially interesting considering database join algorithms optimized for multicore CPUs, even more when running on a manycore processor like a Xeon Phi Knights Landing (KNL). The drawback of HBM, however, is its small capacity as well as under-utilization in random memory access patterns. In this paper, we analyze the impact of HBM on join processing on the KNL architecture. We evaluate main memory hash join and sort-merge join algorithms of relational DBMS as well as data stream joins, comparing execution times in different HBM configurations. Our results show performance gains up to 3 × for joins when HBM is used. Finally, we summarize our lessons learned, give additional advice for HBM utilization, and discuss generalizations for other levels of the memory hierarchy.
doi_str_mv 10.1007/s00778-019-00546-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2377702018</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2377702018</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-f5f161ff0c0c3622cfb12de76914d24427ea232d0d9fb405f1fc438c04288d963</originalsourceid><addsrcrecordid>eNp9kE1LAzEQhoMoWKt_wFPAc3Ty0U3WmxQ_KXhR8Ba2-ehuabM12Vq2v97oFrw5h5nDPM8MvAhdUrimAPIm5SYVAVoSgIkoyP4IjaAUJVFSfhyjEYWiICrXKTpLaQkAjLHJCE1f2iYk3AZcN4uazKtgd43tarx26zb2t7jCwe3wyn25FW4C7mp3WGXBxSqauj9HJ75aJXdxmGP0_nD_Nn0is9fH5-ndjBhOy474iacF9R4MGF4wZvycMutkUVJhmRBMuopxZsGWfi4g094IrgwIppQtCz5GV8PdTWw_ty51etluY8gvNeNSSmBAVabYQJnYphSd15vYrKvYawr6Jyw9hKVzWPo3LL3PEh-klOGwcPHv9D_WN1s8bGk</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2377702018</pqid></control><display><type>article</type><title>Joins on high-bandwidth memory: a new level in the memory hierarchy</title><source>Springer Nature - Complete Springer Journals</source><source>ACM Digital Library Complete</source><creator>Pohl, Constantin ; Sattler, Kai-Uwe ; Graefe, Goetz</creator><creatorcontrib>Pohl, Constantin ; Sattler, Kai-Uwe ; Graefe, Goetz</creatorcontrib><description>High-bandwidth memory (HBM) gives an additional opportunity for hardware performance benefits. The high available bandwidth compared to regular DRAM allows execution of many threads in parallel, avoiding memory stalls through many concurrent memory accesses This is especially interesting considering database join algorithms optimized for multicore CPUs, even more when running on a manycore processor like a Xeon Phi Knights Landing (KNL). The drawback of HBM, however, is its small capacity as well as under-utilization in random memory access patterns. In this paper, we analyze the impact of HBM on join processing on the KNL architecture. We evaluate main memory hash join and sort-merge join algorithms of relational DBMS as well as data stream joins, comparing execution times in different HBM configurations. Our results show performance gains up to 3 × for joins when HBM is used. Finally, we summarize our lessons learned, give additional advice for HBM utilization, and discuss generalizations for other levels of the memory hierarchy.</description><identifier>ISSN: 1066-8888</identifier><identifier>EISSN: 0949-877X</identifier><identifier>DOI: 10.1007/s00778-019-00546-z</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Algorithms ; Bandwidths ; Computer Science ; Concurrent processing ; Configuration management ; Data transmission ; Database Management ; Impact analysis ; Microprocessors ; Product development ; Special Issue Paper</subject><ispartof>The VLDB journal, 2020-05, Vol.29 (2-3), p.797-817</ispartof><rights>Springer-Verlag GmbH Germany, part of Springer Nature 2019</rights><rights>2019© Springer-Verlag GmbH Germany, part of Springer Nature 2019</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-f5f161ff0c0c3622cfb12de76914d24427ea232d0d9fb405f1fc438c04288d963</citedby><cites>FETCH-LOGICAL-c319t-f5f161ff0c0c3622cfb12de76914d24427ea232d0d9fb405f1fc438c04288d963</cites><orcidid>0000-0002-5965-4047 ; 0000-0003-1608-7721</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00778-019-00546-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00778-019-00546-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51298</link.rule.ids></links><search><creatorcontrib>Pohl, Constantin</creatorcontrib><creatorcontrib>Sattler, Kai-Uwe</creatorcontrib><creatorcontrib>Graefe, Goetz</creatorcontrib><title>Joins on high-bandwidth memory: a new level in the memory hierarchy</title><title>The VLDB journal</title><addtitle>The VLDB Journal</addtitle><description>High-bandwidth memory (HBM) gives an additional opportunity for hardware performance benefits. The high available bandwidth compared to regular DRAM allows execution of many threads in parallel, avoiding memory stalls through many concurrent memory accesses This is especially interesting considering database join algorithms optimized for multicore CPUs, even more when running on a manycore processor like a Xeon Phi Knights Landing (KNL). The drawback of HBM, however, is its small capacity as well as under-utilization in random memory access patterns. In this paper, we analyze the impact of HBM on join processing on the KNL architecture. We evaluate main memory hash join and sort-merge join algorithms of relational DBMS as well as data stream joins, comparing execution times in different HBM configurations. Our results show performance gains up to 3 × for joins when HBM is used. Finally, we summarize our lessons learned, give additional advice for HBM utilization, and discuss generalizations for other levels of the memory hierarchy.</description><subject>Algorithms</subject><subject>Bandwidths</subject><subject>Computer Science</subject><subject>Concurrent processing</subject><subject>Configuration management</subject><subject>Data transmission</subject><subject>Database Management</subject><subject>Impact analysis</subject><subject>Microprocessors</subject><subject>Product development</subject><subject>Special Issue Paper</subject><issn>1066-8888</issn><issn>0949-877X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQhoMoWKt_wFPAc3Ty0U3WmxQ_KXhR8Ba2-ehuabM12Vq2v97oFrw5h5nDPM8MvAhdUrimAPIm5SYVAVoSgIkoyP4IjaAUJVFSfhyjEYWiICrXKTpLaQkAjLHJCE1f2iYk3AZcN4uazKtgd43tarx26zb2t7jCwe3wyn25FW4C7mp3WGXBxSqauj9HJ75aJXdxmGP0_nD_Nn0is9fH5-ndjBhOy474iacF9R4MGF4wZvycMutkUVJhmRBMuopxZsGWfi4g094IrgwIppQtCz5GV8PdTWw_ty51etluY8gvNeNSSmBAVabYQJnYphSd15vYrKvYawr6Jyw9hKVzWPo3LL3PEh-klOGwcPHv9D_WN1s8bGk</recordid><startdate>20200501</startdate><enddate>20200501</enddate><creator>Pohl, Constantin</creator><creator>Sattler, Kai-Uwe</creator><creator>Graefe, Goetz</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-5965-4047</orcidid><orcidid>https://orcid.org/0000-0003-1608-7721</orcidid></search><sort><creationdate>20200501</creationdate><title>Joins on high-bandwidth memory: a new level in the memory hierarchy</title><author>Pohl, Constantin ; Sattler, Kai-Uwe ; Graefe, Goetz</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-f5f161ff0c0c3622cfb12de76914d24427ea232d0d9fb405f1fc438c04288d963</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Bandwidths</topic><topic>Computer Science</topic><topic>Concurrent processing</topic><topic>Configuration management</topic><topic>Data transmission</topic><topic>Database Management</topic><topic>Impact analysis</topic><topic>Microprocessors</topic><topic>Product development</topic><topic>Special Issue Paper</topic><toplevel>online_resources</toplevel><creatorcontrib>Pohl, Constantin</creatorcontrib><creatorcontrib>Sattler, Kai-Uwe</creatorcontrib><creatorcontrib>Graefe, Goetz</creatorcontrib><collection>CrossRef</collection><jtitle>The VLDB journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pohl, Constantin</au><au>Sattler, Kai-Uwe</au><au>Graefe, Goetz</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Joins on high-bandwidth memory: a new level in the memory hierarchy</atitle><jtitle>The VLDB journal</jtitle><stitle>The VLDB Journal</stitle><date>2020-05-01</date><risdate>2020</risdate><volume>29</volume><issue>2-3</issue><spage>797</spage><epage>817</epage><pages>797-817</pages><issn>1066-8888</issn><eissn>0949-877X</eissn><abstract>High-bandwidth memory (HBM) gives an additional opportunity for hardware performance benefits. The high available bandwidth compared to regular DRAM allows execution of many threads in parallel, avoiding memory stalls through many concurrent memory accesses This is especially interesting considering database join algorithms optimized for multicore CPUs, even more when running on a manycore processor like a Xeon Phi Knights Landing (KNL). The drawback of HBM, however, is its small capacity as well as under-utilization in random memory access patterns. In this paper, we analyze the impact of HBM on join processing on the KNL architecture. We evaluate main memory hash join and sort-merge join algorithms of relational DBMS as well as data stream joins, comparing execution times in different HBM configurations. Our results show performance gains up to 3 × for joins when HBM is used. Finally, we summarize our lessons learned, give additional advice for HBM utilization, and discuss generalizations for other levels of the memory hierarchy.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s00778-019-00546-z</doi><tpages>21</tpages><orcidid>https://orcid.org/0000-0002-5965-4047</orcidid><orcidid>https://orcid.org/0000-0003-1608-7721</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1066-8888
ispartof The VLDB journal, 2020-05, Vol.29 (2-3), p.797-817
issn 1066-8888
0949-877X
language eng
recordid cdi_proquest_journals_2377702018
source Springer Nature - Complete Springer Journals; ACM Digital Library Complete
subjects Algorithms
Bandwidths
Computer Science
Concurrent processing
Configuration management
Data transmission
Database Management
Impact analysis
Microprocessors
Product development
Special Issue Paper
title Joins on high-bandwidth memory: a new level in the memory hierarchy
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T10%3A03%3A27IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Joins%20on%20high-bandwidth%20memory:%20a%20new%20level%20in%20the%20memory%20hierarchy&rft.jtitle=The%20VLDB%20journal&rft.au=Pohl,%20Constantin&rft.date=2020-05-01&rft.volume=29&rft.issue=2-3&rft.spage=797&rft.epage=817&rft.pages=797-817&rft.issn=1066-8888&rft.eissn=0949-877X&rft_id=info:doi/10.1007/s00778-019-00546-z&rft_dat=%3Cproquest_cross%3E2377702018%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2377702018&rft_id=info:pmid/&rfr_iscdi=true