Status, challenges and trends of data-intensive supercomputing
Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 ye...
Gespeichert in:
| Veröffentlicht in: | CCF transactions on high performance computing (Online) 2022-06, Vol.4 (2), p.211-230 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 230 |
|---|---|
| container_issue | 2 |
| container_start_page | 211 |
| container_title | CCF transactions on high performance computing (Online) |
| container_volume | 4 |
| creator | Wei, Jia Chen, Mo Wang, Longxiang Ren, Pei Lei, Yujia Qu, Yuqi Jiang, Qiyu Dong, Xiaoshe Wu, Weiguo Wang, Qiang Zhang, Kaili Zhang, Xingjun |
| description | Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 years of development, supercomputing has progressed from being oriented towards computationally intensive tasks, to being oriented towards a hybrid of computationally and data-intensive tasks. Driven by the continuous development of high performance data analytics (HPDA) applications—such as big data, deep learning, and other intelligent tasks—supercomputing storage systems are facing challenges such as a sudden increase in data volume for computational processing tasks, increased and diversified computing power of supercomputing systems, and higher reliability and availability requirements. Based on this, data-intensive supercomputing, which is deeply integrated with data centers and smart computing centers, aims to solve the problems of complex data type optimization, mixed-load optimization, multi-protocol support, and interoperability on the storage system—thereby becoming the main protagonist of research and development today and for some time in the future. This paper first introduces key concepts in HPDA and data-intensive computing, and then illustrates the extent to which existing platforms support data-intensive applications by analyzing the most representative supercomputing platforms today (Fugaku, Summit, Sunway TaihuLight, and Tianhe 2A). This is followed by an illustration of the actual demand for data-intensive applications in today’s mainstream scientific and industrial communities from the perspectives of both scientific and commercial applications. Next, we provide an outlook on future trends and potential challenges data-intensive supercomputing is facing. In a word, this paper provides researchers and practitioners with a quick overview of the key concepts and developments in supercomputing, and captures the current and future data-intensive supercomputing research hotspots and key issues that need to be addressed. |
| doi_str_mv | 10.1007/s42514-022-00109-9 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2933499069</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2933499069</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-f1f24a6f9e4e32c3e71637567019ed35a91883f0aabc383d60c251b7607aab3a3</originalsourceid><addsrcrecordid>eNp9kE9LAzEQxYMoWGq_gKcFr0YnfzZpLoIUrULBg3oOaTapW9rsmmQFv72pK3rzNMPwe294D6FzAlcEQF4nTmvCMVCKAQgorI7QhNaUY64YHP_ulJ6iWUpbAKCSFFxM0M1zNnlIl5V9M7udCxuXKhOaKkcXmlR1vmpMNrgN2YXUfrgqDb2Lttv3Q27D5gydeLNLbvYzp-j1_u5l8YBXT8vHxe0KW0ZUxp54yo3wynHHqGVOEsFkLSQQ5RpWG0Xmc-bBmLVlc9YIsCXSWgqQ5cQMm6KL0beP3fvgUtbbboihvNRUMcaVAqEKRUfKxi6l6LzuY7s38VMT0Ieq9FiVLtn1d1X6IGKjKBW45I9_1v-ovgDKZ2rp</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2933499069</pqid></control><display><type>article</type><title>Status, challenges and trends of data-intensive supercomputing</title><source>SpringerLink Journals - AutoHoldings</source><source>ProQuest Central</source><creator>Wei, Jia ; Chen, Mo ; Wang, Longxiang ; Ren, Pei ; Lei, Yujia ; Qu, Yuqi ; Jiang, Qiyu ; Dong, Xiaoshe ; Wu, Weiguo ; Wang, Qiang ; Zhang, Kaili ; Zhang, Xingjun</creator><creatorcontrib>Wei, Jia ; Chen, Mo ; Wang, Longxiang ; Ren, Pei ; Lei, Yujia ; Qu, Yuqi ; Jiang, Qiyu ; Dong, Xiaoshe ; Wu, Weiguo ; Wang, Qiang ; Zhang, Kaili ; Zhang, Xingjun</creatorcontrib><description>Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 years of development, supercomputing has progressed from being oriented towards computationally intensive tasks, to being oriented towards a hybrid of computationally and data-intensive tasks. Driven by the continuous development of high performance data analytics (HPDA) applications—such as big data, deep learning, and other intelligent tasks—supercomputing storage systems are facing challenges such as a sudden increase in data volume for computational processing tasks, increased and diversified computing power of supercomputing systems, and higher reliability and availability requirements. Based on this, data-intensive supercomputing, which is deeply integrated with data centers and smart computing centers, aims to solve the problems of complex data type optimization, mixed-load optimization, multi-protocol support, and interoperability on the storage system—thereby becoming the main protagonist of research and development today and for some time in the future. This paper first introduces key concepts in HPDA and data-intensive computing, and then illustrates the extent to which existing platforms support data-intensive applications by analyzing the most representative supercomputing platforms today (Fugaku, Summit, Sunway TaihuLight, and Tianhe 2A). This is followed by an illustration of the actual demand for data-intensive applications in today’s mainstream scientific and industrial communities from the perspectives of both scientific and commercial applications. Next, we provide an outlook on future trends and potential challenges data-intensive supercomputing is facing. In a word, this paper provides researchers and practitioners with a quick overview of the key concepts and developments in supercomputing, and captures the current and future data-intensive supercomputing research hotspots and key issues that need to be addressed.</description><identifier>ISSN: 2524-4922</identifier><identifier>EISSN: 2524-4930</identifier><identifier>DOI: 10.1007/s42514-022-00109-9</identifier><language>eng</language><publisher>Singapore: Springer Nature Singapore</publisher><subject>Big Data ; Cloud computing ; Computation ; Computer Hardware ; Computer peripherals ; Computer Science ; Computer Systems Organization and Communication Networks ; Data analysis ; Data processing ; Deep learning ; Earthquakes ; High performance computing ; Optimization ; Platforms ; Power ; R&D ; Research & development ; Review Paper ; Software ; Storage systems ; Supercomputers ; System reliability ; Trends</subject><ispartof>CCF transactions on high performance computing (Online), 2022-06, Vol.4 (2), p.211-230</ispartof><rights>China Computer Federation (CCF) 2022</rights><rights>China Computer Federation (CCF) 2022.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-f1f24a6f9e4e32c3e71637567019ed35a91883f0aabc383d60c251b7607aab3a3</citedby><cites>FETCH-LOGICAL-c319t-f1f24a6f9e4e32c3e71637567019ed35a91883f0aabc383d60c251b7607aab3a3</cites><orcidid>0000-0003-2005-114X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s42514-022-00109-9$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2933499069?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,776,780,21367,27901,27902,33721,41464,42533,43781,51294</link.rule.ids></links><search><creatorcontrib>Wei, Jia</creatorcontrib><creatorcontrib>Chen, Mo</creatorcontrib><creatorcontrib>Wang, Longxiang</creatorcontrib><creatorcontrib>Ren, Pei</creatorcontrib><creatorcontrib>Lei, Yujia</creatorcontrib><creatorcontrib>Qu, Yuqi</creatorcontrib><creatorcontrib>Jiang, Qiyu</creatorcontrib><creatorcontrib>Dong, Xiaoshe</creatorcontrib><creatorcontrib>Wu, Weiguo</creatorcontrib><creatorcontrib>Wang, Qiang</creatorcontrib><creatorcontrib>Zhang, Kaili</creatorcontrib><creatorcontrib>Zhang, Xingjun</creatorcontrib><title>Status, challenges and trends of data-intensive supercomputing</title><title>CCF transactions on high performance computing (Online)</title><addtitle>CCF Trans. HPC</addtitle><description>Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 years of development, supercomputing has progressed from being oriented towards computationally intensive tasks, to being oriented towards a hybrid of computationally and data-intensive tasks. Driven by the continuous development of high performance data analytics (HPDA) applications—such as big data, deep learning, and other intelligent tasks—supercomputing storage systems are facing challenges such as a sudden increase in data volume for computational processing tasks, increased and diversified computing power of supercomputing systems, and higher reliability and availability requirements. Based on this, data-intensive supercomputing, which is deeply integrated with data centers and smart computing centers, aims to solve the problems of complex data type optimization, mixed-load optimization, multi-protocol support, and interoperability on the storage system—thereby becoming the main protagonist of research and development today and for some time in the future. This paper first introduces key concepts in HPDA and data-intensive computing, and then illustrates the extent to which existing platforms support data-intensive applications by analyzing the most representative supercomputing platforms today (Fugaku, Summit, Sunway TaihuLight, and Tianhe 2A). This is followed by an illustration of the actual demand for data-intensive applications in today’s mainstream scientific and industrial communities from the perspectives of both scientific and commercial applications. Next, we provide an outlook on future trends and potential challenges data-intensive supercomputing is facing. In a word, this paper provides researchers and practitioners with a quick overview of the key concepts and developments in supercomputing, and captures the current and future data-intensive supercomputing research hotspots and key issues that need to be addressed.</description><subject>Big Data</subject><subject>Cloud computing</subject><subject>Computation</subject><subject>Computer Hardware</subject><subject>Computer peripherals</subject><subject>Computer Science</subject><subject>Computer Systems Organization and Communication Networks</subject><subject>Data analysis</subject><subject>Data processing</subject><subject>Deep learning</subject><subject>Earthquakes</subject><subject>High performance computing</subject><subject>Optimization</subject><subject>Platforms</subject><subject>Power</subject><subject>R&D</subject><subject>Research & development</subject><subject>Review Paper</subject><subject>Software</subject><subject>Storage systems</subject><subject>Supercomputers</subject><subject>System reliability</subject><subject>Trends</subject><issn>2524-4922</issn><issn>2524-4930</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNp9kE9LAzEQxYMoWGq_gKcFr0YnfzZpLoIUrULBg3oOaTapW9rsmmQFv72pK3rzNMPwe294D6FzAlcEQF4nTmvCMVCKAQgorI7QhNaUY64YHP_ulJ6iWUpbAKCSFFxM0M1zNnlIl5V9M7udCxuXKhOaKkcXmlR1vmpMNrgN2YXUfrgqDb2Lttv3Q27D5gydeLNLbvYzp-j1_u5l8YBXT8vHxe0KW0ZUxp54yo3wynHHqGVOEsFkLSQQ5RpWG0Xmc-bBmLVlc9YIsCXSWgqQ5cQMm6KL0beP3fvgUtbbboihvNRUMcaVAqEKRUfKxi6l6LzuY7s38VMT0Ieq9FiVLtn1d1X6IGKjKBW45I9_1v-ovgDKZ2rp</recordid><startdate>20220601</startdate><enddate>20220601</enddate><creator>Wei, Jia</creator><creator>Chen, Mo</creator><creator>Wang, Longxiang</creator><creator>Ren, Pei</creator><creator>Lei, Yujia</creator><creator>Qu, Yuqi</creator><creator>Jiang, Qiyu</creator><creator>Dong, Xiaoshe</creator><creator>Wu, Weiguo</creator><creator>Wang, Qiang</creator><creator>Zhang, Kaili</creator><creator>Zhang, Xingjun</creator><general>Springer Nature Singapore</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><orcidid>https://orcid.org/0000-0003-2005-114X</orcidid></search><sort><creationdate>20220601</creationdate><title>Status, challenges and trends of data-intensive supercomputing</title><author>Wei, Jia ; Chen, Mo ; Wang, Longxiang ; Ren, Pei ; Lei, Yujia ; Qu, Yuqi ; Jiang, Qiyu ; Dong, Xiaoshe ; Wu, Weiguo ; Wang, Qiang ; Zhang, Kaili ; Zhang, Xingjun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-f1f24a6f9e4e32c3e71637567019ed35a91883f0aabc383d60c251b7607aab3a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Big Data</topic><topic>Cloud computing</topic><topic>Computation</topic><topic>Computer Hardware</topic><topic>Computer peripherals</topic><topic>Computer Science</topic><topic>Computer Systems Organization and Communication Networks</topic><topic>Data analysis</topic><topic>Data processing</topic><topic>Deep learning</topic><topic>Earthquakes</topic><topic>High performance computing</topic><topic>Optimization</topic><topic>Platforms</topic><topic>Power</topic><topic>R&D</topic><topic>Research & development</topic><topic>Review Paper</topic><topic>Software</topic><topic>Storage systems</topic><topic>Supercomputers</topic><topic>System reliability</topic><topic>Trends</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wei, Jia</creatorcontrib><creatorcontrib>Chen, Mo</creatorcontrib><creatorcontrib>Wang, Longxiang</creatorcontrib><creatorcontrib>Ren, Pei</creatorcontrib><creatorcontrib>Lei, Yujia</creatorcontrib><creatorcontrib>Qu, Yuqi</creatorcontrib><creatorcontrib>Jiang, Qiyu</creatorcontrib><creatorcontrib>Dong, Xiaoshe</creatorcontrib><creatorcontrib>Wu, Weiguo</creatorcontrib><creatorcontrib>Wang, Qiang</creatorcontrib><creatorcontrib>Zhang, Kaili</creatorcontrib><creatorcontrib>Zhang, Xingjun</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><jtitle>CCF transactions on high performance computing (Online)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wei, Jia</au><au>Chen, Mo</au><au>Wang, Longxiang</au><au>Ren, Pei</au><au>Lei, Yujia</au><au>Qu, Yuqi</au><au>Jiang, Qiyu</au><au>Dong, Xiaoshe</au><au>Wu, Weiguo</au><au>Wang, Qiang</au><au>Zhang, Kaili</au><au>Zhang, Xingjun</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Status, challenges and trends of data-intensive supercomputing</atitle><jtitle>CCF transactions on high performance computing (Online)</jtitle><stitle>CCF Trans. HPC</stitle><date>2022-06-01</date><risdate>2022</risdate><volume>4</volume><issue>2</issue><spage>211</spage><epage>230</epage><pages>211-230</pages><issn>2524-4922</issn><eissn>2524-4930</eissn><abstract>Supercomputing technology has been supporting the solution of cutting-edge scientific and complex engineering problems since its inception—serving as a comprehensive representation of the most advanced computer hardware and software technologies over a period of time. Over the course of nearly 80 years of development, supercomputing has progressed from being oriented towards computationally intensive tasks, to being oriented towards a hybrid of computationally and data-intensive tasks. Driven by the continuous development of high performance data analytics (HPDA) applications—such as big data, deep learning, and other intelligent tasks—supercomputing storage systems are facing challenges such as a sudden increase in data volume for computational processing tasks, increased and diversified computing power of supercomputing systems, and higher reliability and availability requirements. Based on this, data-intensive supercomputing, which is deeply integrated with data centers and smart computing centers, aims to solve the problems of complex data type optimization, mixed-load optimization, multi-protocol support, and interoperability on the storage system—thereby becoming the main protagonist of research and development today and for some time in the future. This paper first introduces key concepts in HPDA and data-intensive computing, and then illustrates the extent to which existing platforms support data-intensive applications by analyzing the most representative supercomputing platforms today (Fugaku, Summit, Sunway TaihuLight, and Tianhe 2A). This is followed by an illustration of the actual demand for data-intensive applications in today’s mainstream scientific and industrial communities from the perspectives of both scientific and commercial applications. Next, we provide an outlook on future trends and potential challenges data-intensive supercomputing is facing. In a word, this paper provides researchers and practitioners with a quick overview of the key concepts and developments in supercomputing, and captures the current and future data-intensive supercomputing research hotspots and key issues that need to be addressed.</abstract><cop>Singapore</cop><pub>Springer Nature Singapore</pub><doi>10.1007/s42514-022-00109-9</doi><tpages>20</tpages><orcidid>https://orcid.org/0000-0003-2005-114X</orcidid></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 2524-4922 |
| ispartof | CCF transactions on high performance computing (Online), 2022-06, Vol.4 (2), p.211-230 |
| issn | 2524-4922 2524-4930 |
| language | eng |
| recordid | cdi_proquest_journals_2933499069 |
| source | SpringerLink Journals - AutoHoldings; ProQuest Central |
| subjects | Big Data Cloud computing Computation Computer Hardware Computer peripherals Computer Science Computer Systems Organization and Communication Networks Data analysis Data processing Deep learning Earthquakes High performance computing Optimization Platforms Power R&D Research & development Review Paper Software Storage systems Supercomputers System reliability Trends |
| title | Status, challenges and trends of data-intensive supercomputing |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-06T18%3A51%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Status,%20challenges%20and%20trends%20of%20data-intensive%20supercomputing&rft.jtitle=CCF%20transactions%20on%20high%20performance%20computing%20(Online)&rft.au=Wei,%20Jia&rft.date=2022-06-01&rft.volume=4&rft.issue=2&rft.spage=211&rft.epage=230&rft.pages=211-230&rft.issn=2524-4922&rft.eissn=2524-4930&rft_id=info:doi/10.1007/s42514-022-00109-9&rft_dat=%3Cproquest_cross%3E2933499069%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2933499069&rft_id=info:pmid/&rfr_iscdi=true |