Dapper: An Adaptive Manager for Large-Capacity Persistent Memory

In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on computers 2019-07, Vol.68 (7), p.1019-1034
Hauptverfasser: Xue, Dongliang, Huang, Linpeng, Li, Chao, Wu, Chentao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1034
container_issue 7
container_start_page 1019
container_title IEEE transactions on computers
container_volume 68
creator Xue, Dongliang
Huang, Linpeng
Li, Chao
Wu, Chentao
description In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.
doi_str_mv 10.1109/TC.2019.2899836
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2237694962</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8642938</ieee_id><sourcerecordid>2237694962</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-c0000a0bd6d4a5a55bbe8202c2876daf343f551e5283b1bbc43819203c2c29923</originalsourceid><addsrcrecordid>eNo9kD1PwzAQhi0EEqUwM7BYYk57tmPXx0QVPqVWMJTZcpJLlYomwU6R-u9J1Yrphnvee08PY7cCJkIATlfZRILAibSIVpkzNhJazxJEbc7ZCEDYBFUKl-wqxg0AGAk4Yo9PvusoPPB5w-el7_r6l_jSN35NgVdt4Asf1pRkvvNF3e_5J4VYx56ani9p24b9Nbuo_Hekm9Mcs6-X51X2liw-Xt-z-SIphof6pBgawUNemjL12mud52QlyGE7M6WvVKoqrQVpaVUu8rxIlRUoQRUDgijVmN0f73ah_dlR7N2m3YVmqHRSqpnBFM2Bmh6pIrQxBqpcF-qtD3snwB00uVXmDprcSdOQuDsmaiL6p61JJSqr_gD4WGFF</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2237694962</pqid></control><display><type>article</type><title>Dapper: An Adaptive Manager for Large-Capacity Persistent Memory</title><source>IEEE Electronic Library (IEL)</source><creator>Xue, Dongliang ; Huang, Linpeng ; Li, Chao ; Wu, Chentao</creator><creatorcontrib>Xue, Dongliang ; Huang, Linpeng ; Li, Chao ; Wu, Chentao</creatorcontrib><description>In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.</description><identifier>ISSN: 0018-9340</identifier><identifier>EISSN: 1557-9956</identifier><identifier>DOI: 10.1109/TC.2019.2899836</identifier><identifier>CODEN: ITCOB4</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Adaptive systems ; Computer architecture ; Floating point arithmetic ; Floating structures ; Kernel ; main memory management ; Memory management ; NUMA ; Organizations ; Performance degradation ; Persistent memory ; Random access memory ; Servers ; Sockets ; Software</subject><ispartof>IEEE transactions on computers, 2019-07, Vol.68 (7), p.1019-1034</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-c0000a0bd6d4a5a55bbe8202c2876daf343f551e5283b1bbc43819203c2c29923</citedby><cites>FETCH-LOGICAL-c289t-c0000a0bd6d4a5a55bbe8202c2876daf343f551e5283b1bbc43819203c2c29923</cites><orcidid>0000-0002-1531-7962 ; 0000-0001-6218-4659 ; 0000-0003-0140-3074</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8642938$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8642938$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Xue, Dongliang</creatorcontrib><creatorcontrib>Huang, Linpeng</creatorcontrib><creatorcontrib>Li, Chao</creatorcontrib><creatorcontrib>Wu, Chentao</creatorcontrib><title>Dapper: An Adaptive Manager for Large-Capacity Persistent Memory</title><title>IEEE transactions on computers</title><addtitle>TC</addtitle><description>In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.</description><subject>Adaptive systems</subject><subject>Computer architecture</subject><subject>Floating point arithmetic</subject><subject>Floating structures</subject><subject>Kernel</subject><subject>main memory management</subject><subject>Memory management</subject><subject>NUMA</subject><subject>Organizations</subject><subject>Performance degradation</subject><subject>Persistent memory</subject><subject>Random access memory</subject><subject>Servers</subject><subject>Sockets</subject><subject>Software</subject><issn>0018-9340</issn><issn>1557-9956</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kD1PwzAQhi0EEqUwM7BYYk57tmPXx0QVPqVWMJTZcpJLlYomwU6R-u9J1Yrphnvee08PY7cCJkIATlfZRILAibSIVpkzNhJazxJEbc7ZCEDYBFUKl-wqxg0AGAk4Yo9PvusoPPB5w-el7_r6l_jSN35NgVdt4Asf1pRkvvNF3e_5J4VYx56ani9p24b9Nbuo_Hekm9Mcs6-X51X2liw-Xt-z-SIphof6pBgawUNemjL12mud52QlyGE7M6WvVKoqrQVpaVUu8rxIlRUoQRUDgijVmN0f73ah_dlR7N2m3YVmqHRSqpnBFM2Bmh6pIrQxBqpcF-qtD3snwB00uVXmDprcSdOQuDsmaiL6p61JJSqr_gD4WGFF</recordid><startdate>20190701</startdate><enddate>20190701</enddate><creator>Xue, Dongliang</creator><creator>Huang, Linpeng</creator><creator>Li, Chao</creator><creator>Wu, Chentao</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-1531-7962</orcidid><orcidid>https://orcid.org/0000-0001-6218-4659</orcidid><orcidid>https://orcid.org/0000-0003-0140-3074</orcidid></search><sort><creationdate>20190701</creationdate><title>Dapper: An Adaptive Manager for Large-Capacity Persistent Memory</title><author>Xue, Dongliang ; Huang, Linpeng ; Li, Chao ; Wu, Chentao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-c0000a0bd6d4a5a55bbe8202c2876daf343f551e5283b1bbc43819203c2c29923</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Adaptive systems</topic><topic>Computer architecture</topic><topic>Floating point arithmetic</topic><topic>Floating structures</topic><topic>Kernel</topic><topic>main memory management</topic><topic>Memory management</topic><topic>NUMA</topic><topic>Organizations</topic><topic>Performance degradation</topic><topic>Persistent memory</topic><topic>Random access memory</topic><topic>Servers</topic><topic>Sockets</topic><topic>Software</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Xue, Dongliang</creatorcontrib><creatorcontrib>Huang, Linpeng</creatorcontrib><creatorcontrib>Li, Chao</creatorcontrib><creatorcontrib>Wu, Chentao</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on computers</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Xue, Dongliang</au><au>Huang, Linpeng</au><au>Li, Chao</au><au>Wu, Chentao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dapper: An Adaptive Manager for Large-Capacity Persistent Memory</atitle><jtitle>IEEE transactions on computers</jtitle><stitle>TC</stitle><date>2019-07-01</date><risdate>2019</risdate><volume>68</volume><issue>7</issue><spage>1019</spage><epage>1034</epage><pages>1019-1034</pages><issn>0018-9340</issn><eissn>1557-9956</eissn><coden>ITCOB4</coden><abstract>In-memory computing has inspired researchers to consider integrating large-capacity persistent memory (PM) into the main memory subsystem. However, several challenges still remain for providing an integration approach for DRAM-comparable PM on existing enterprise servers. Current commercial servers tend to feature multiple sockets with shared-memory NUMA organizations. Simply constructing a hybrid main memory architecture for these NUMA organizations requires considerable modifications of the system software. Another significant problem in these designs is the high latency of accessing PM on a remote socket, which results in performance degradation. To address these problems, we integrated PM as a memory-based model and as a storage-based model simultaneously on one commercial server, which offers a short-cut approach for enterprises to build commercial NUMA machines with large-capacity PM. In the memory-based model, rather than focusing on the persistence attribute, we propose an architecture that benefits managing the integrated PM and DRAM space in a unified manner and that facilitates bypassing vast modifications to the system software. We also present an adaptive mechanism that can automatically introduce a moderate amount of PM into the local socket to hinder access of a remote socket by the degree of memory pressure. In the storage-based model, under the condition of taking full advantage of the PM's persistence, we abstract a PM volume device and overcome the torn sector problem. To demonstrate the effectiveness of the proposed scheme, we design and implement Dapper, an adaptive persistent memory manager prototype. The experimental results show that, compared to typical memory management approaches, Dapper achieves performance improvements of 13.1 percent to 34.0 percent on average on Graph500 BFS_SSSP benchmarks and SPEC CPU2006 floating point workloads, respectively. Moreover, when deploying F2FS on our PM volume, we find that Dapper outperforms existing methods by 5.8 percent on tar and by 11.9 percent on untar.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TC.2019.2899836</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-1531-7962</orcidid><orcidid>https://orcid.org/0000-0001-6218-4659</orcidid><orcidid>https://orcid.org/0000-0003-0140-3074</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9340
ispartof IEEE transactions on computers, 2019-07, Vol.68 (7), p.1019-1034
issn 0018-9340
1557-9956
language eng
recordid cdi_proquest_journals_2237694962
source IEEE Electronic Library (IEL)
subjects Adaptive systems
Computer architecture
Floating point arithmetic
Floating structures
Kernel
main memory management
Memory management
NUMA
Organizations
Performance degradation
Persistent memory
Random access memory
Servers
Sockets
Software
title Dapper: An Adaptive Manager for Large-Capacity Persistent Memory
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T22%3A24%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dapper:%20An%20Adaptive%20Manager%20for%20Large-Capacity%20Persistent%20Memory&rft.jtitle=IEEE%20transactions%20on%20computers&rft.au=Xue,%20Dongliang&rft.date=2019-07-01&rft.volume=68&rft.issue=7&rft.spage=1019&rft.epage=1034&rft.pages=1019-1034&rft.issn=0018-9340&rft.eissn=1557-9956&rft.coden=ITCOB4&rft_id=info:doi/10.1109/TC.2019.2899836&rft_dat=%3Cproquest_RIE%3E2237694962%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2237694962&rft_id=info:pmid/&rft_ieee_id=8642938&rfr_iscdi=true