Fast-path I/O architecture for high performance streaming server

In a disk-network scenario where expensive data transfers are the norm, such as in multimedia streaming applications, for example, a fast-path I/O architecture is generally considered to be “good practice.” Here, I/O performance can be improved through minimizing the number of in-memory data movemen...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Journal of supercomputing 2009-11, Vol.50 (2), p.99-120
Hauptverfasser: Lee, Yong-Ju, Park, Yoo-Hyun, Sok, Song-Woo, Kim, Hag-Young, Lee, Cheol-Hoon
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 120
container_issue 2
container_start_page 99
container_title The Journal of supercomputing
container_volume 50
creator Lee, Yong-Ju
Park, Yoo-Hyun
Sok, Song-Woo
Kim, Hag-Young
Lee, Cheol-Hoon
description In a disk-network scenario where expensive data transfers are the norm, such as in multimedia streaming applications, for example, a fast-path I/O architecture is generally considered to be “good practice.” Here, I/O performance can be improved through minimizing the number of in-memory data movements and context switches. In this paper, we report the results of the design and implementation of a high-performance streaming server using cheap hardware units assembled directly on a test card (i.e., NS card). The hardware part of our architecture is open to further reuse, extension, and integration with other applications even in the case of inexpensive and/or faster hardware. From the viewpoint of software-aided I/O, we offer Stream Disk Array (SDA) for scatter/gather-style block I/O, EXT3NS multimedia file system for large-scale file I/O, and interoperable streaming server for stream I/O.
doi_str_mv 10.1007/s11227-008-0254-5
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1671239895</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1671239895</sourcerecordid><originalsourceid>FETCH-LOGICAL-c351t-8808e3f85f91efb88ce3286bc27cc2f8eadb27e6e6b0910d1359ad5a230402863</originalsourceid><addsrcrecordid>eNp9kE1LAzEQhoMoWKs_wNteBC-xk2Szyd6UYrVQ6EXPIZtOulv2y2RX8N-7pcWjpxmY531hHkLuGTwxALWIjHGuKICmwGVK5QWZMakEhVSnl2QGOQeqZcqvyU2MBwBIhRIz8ryycaC9HcpkvdgmNriyGtANY8DEdyEpq32Z9BimvbGtwyQOAW1TtfskYvjGcEuuvK0j3p3nnHyuXj-W73SzfVsvXzbUCckGqjVoFF5LnzP0hdYOBddZ4bhyjnuNdldwhRlmBeQMdkzI3O6k5QJSmEAxJ4-n3j50XyPGwTRVdFjXtsVujIZlinGR61xOKDuhLnQxBvSmD1Vjw49hYI62zMmWmWyZoy1zzDyc6210tvZheraKf0HOmVJZDhPHT1ycTu0egzl0Y2inz_8p_wXxhnjw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1671239895</pqid></control><display><type>article</type><title>Fast-path I/O architecture for high performance streaming server</title><source>SpringerLink Journals - AutoHoldings</source><creator>Lee, Yong-Ju ; Park, Yoo-Hyun ; Sok, Song-Woo ; Kim, Hag-Young ; Lee, Cheol-Hoon</creator><creatorcontrib>Lee, Yong-Ju ; Park, Yoo-Hyun ; Sok, Song-Woo ; Kim, Hag-Young ; Lee, Cheol-Hoon</creatorcontrib><description>In a disk-network scenario where expensive data transfers are the norm, such as in multimedia streaming applications, for example, a fast-path I/O architecture is generally considered to be “good practice.” Here, I/O performance can be improved through minimizing the number of in-memory data movements and context switches. In this paper, we report the results of the design and implementation of a high-performance streaming server using cheap hardware units assembled directly on a test card (i.e., NS card). The hardware part of our architecture is open to further reuse, extension, and integration with other applications even in the case of inexpensive and/or faster hardware. From the viewpoint of software-aided I/O, we offer Stream Disk Array (SDA) for scatter/gather-style block I/O, EXT3NS multimedia file system for large-scale file I/O, and interoperable streaming server for stream I/O.</description><identifier>ISSN: 0920-8542</identifier><identifier>EISSN: 1573-0484</identifier><identifier>DOI: 10.1007/s11227-008-0254-5</identifier><identifier>CODEN: JOSUED</identifier><language>eng</language><publisher>Boston: Springer US</publisher><subject>Applied sciences ; Architecture ; Arrays ; Compilers ; Computer Science ; Computer science; control theory; systems ; Computer systems and distributed systems. User interface ; Disks ; Exact sciences and technology ; Hardware ; Interpreters ; Memory and file management (including protection and security) ; Memory organisation. Data processing ; Multimedia ; Processor Architectures ; Programming Languages ; Reuse ; Servers ; Software ; Streams</subject><ispartof>The Journal of supercomputing, 2009-11, Vol.50 (2), p.99-120</ispartof><rights>Springer Science+Business Media, LLC 2008</rights><rights>2015 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c351t-8808e3f85f91efb88ce3286bc27cc2f8eadb27e6e6b0910d1359ad5a230402863</citedby><cites>FETCH-LOGICAL-c351t-8808e3f85f91efb88ce3286bc27cc2f8eadb27e6e6b0910d1359ad5a230402863</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11227-008-0254-5$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11227-008-0254-5$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=22177690$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Lee, Yong-Ju</creatorcontrib><creatorcontrib>Park, Yoo-Hyun</creatorcontrib><creatorcontrib>Sok, Song-Woo</creatorcontrib><creatorcontrib>Kim, Hag-Young</creatorcontrib><creatorcontrib>Lee, Cheol-Hoon</creatorcontrib><title>Fast-path I/O architecture for high performance streaming server</title><title>The Journal of supercomputing</title><addtitle>J Supercomput</addtitle><description>In a disk-network scenario where expensive data transfers are the norm, such as in multimedia streaming applications, for example, a fast-path I/O architecture is generally considered to be “good practice.” Here, I/O performance can be improved through minimizing the number of in-memory data movements and context switches. In this paper, we report the results of the design and implementation of a high-performance streaming server using cheap hardware units assembled directly on a test card (i.e., NS card). The hardware part of our architecture is open to further reuse, extension, and integration with other applications even in the case of inexpensive and/or faster hardware. From the viewpoint of software-aided I/O, we offer Stream Disk Array (SDA) for scatter/gather-style block I/O, EXT3NS multimedia file system for large-scale file I/O, and interoperable streaming server for stream I/O.</description><subject>Applied sciences</subject><subject>Architecture</subject><subject>Arrays</subject><subject>Compilers</subject><subject>Computer Science</subject><subject>Computer science; control theory; systems</subject><subject>Computer systems and distributed systems. User interface</subject><subject>Disks</subject><subject>Exact sciences and technology</subject><subject>Hardware</subject><subject>Interpreters</subject><subject>Memory and file management (including protection and security)</subject><subject>Memory organisation. Data processing</subject><subject>Multimedia</subject><subject>Processor Architectures</subject><subject>Programming Languages</subject><subject>Reuse</subject><subject>Servers</subject><subject>Software</subject><subject>Streams</subject><issn>0920-8542</issn><issn>1573-0484</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2009</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQhoMoWKs_wNteBC-xk2Szyd6UYrVQ6EXPIZtOulv2y2RX8N-7pcWjpxmY531hHkLuGTwxALWIjHGuKICmwGVK5QWZMakEhVSnl2QGOQeqZcqvyU2MBwBIhRIz8ryycaC9HcpkvdgmNriyGtANY8DEdyEpq32Z9BimvbGtwyQOAW1TtfskYvjGcEuuvK0j3p3nnHyuXj-W73SzfVsvXzbUCckGqjVoFF5LnzP0hdYOBddZ4bhyjnuNdldwhRlmBeQMdkzI3O6k5QJSmEAxJ4-n3j50XyPGwTRVdFjXtsVujIZlinGR61xOKDuhLnQxBvSmD1Vjw49hYI62zMmWmWyZoy1zzDyc6210tvZheraKf0HOmVJZDhPHT1ycTu0egzl0Y2inz_8p_wXxhnjw</recordid><startdate>20091101</startdate><enddate>20091101</enddate><creator>Lee, Yong-Ju</creator><creator>Park, Yoo-Hyun</creator><creator>Sok, Song-Woo</creator><creator>Kim, Hag-Young</creator><creator>Lee, Cheol-Hoon</creator><general>Springer US</general><general>Springer</general><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20091101</creationdate><title>Fast-path I/O architecture for high performance streaming server</title><author>Lee, Yong-Ju ; Park, Yoo-Hyun ; Sok, Song-Woo ; Kim, Hag-Young ; Lee, Cheol-Hoon</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c351t-8808e3f85f91efb88ce3286bc27cc2f8eadb27e6e6b0910d1359ad5a230402863</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Applied sciences</topic><topic>Architecture</topic><topic>Arrays</topic><topic>Compilers</topic><topic>Computer Science</topic><topic>Computer science; control theory; systems</topic><topic>Computer systems and distributed systems. User interface</topic><topic>Disks</topic><topic>Exact sciences and technology</topic><topic>Hardware</topic><topic>Interpreters</topic><topic>Memory and file management (including protection and security)</topic><topic>Memory organisation. Data processing</topic><topic>Multimedia</topic><topic>Processor Architectures</topic><topic>Programming Languages</topic><topic>Reuse</topic><topic>Servers</topic><topic>Software</topic><topic>Streams</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Yong-Ju</creatorcontrib><creatorcontrib>Park, Yoo-Hyun</creatorcontrib><creatorcontrib>Sok, Song-Woo</creatorcontrib><creatorcontrib>Kim, Hag-Young</creatorcontrib><creatorcontrib>Lee, Cheol-Hoon</creatorcontrib><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>The Journal of supercomputing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Yong-Ju</au><au>Park, Yoo-Hyun</au><au>Sok, Song-Woo</au><au>Kim, Hag-Young</au><au>Lee, Cheol-Hoon</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Fast-path I/O architecture for high performance streaming server</atitle><jtitle>The Journal of supercomputing</jtitle><stitle>J Supercomput</stitle><date>2009-11-01</date><risdate>2009</risdate><volume>50</volume><issue>2</issue><spage>99</spage><epage>120</epage><pages>99-120</pages><issn>0920-8542</issn><eissn>1573-0484</eissn><coden>JOSUED</coden><abstract>In a disk-network scenario where expensive data transfers are the norm, such as in multimedia streaming applications, for example, a fast-path I/O architecture is generally considered to be “good practice.” Here, I/O performance can be improved through minimizing the number of in-memory data movements and context switches. In this paper, we report the results of the design and implementation of a high-performance streaming server using cheap hardware units assembled directly on a test card (i.e., NS card). The hardware part of our architecture is open to further reuse, extension, and integration with other applications even in the case of inexpensive and/or faster hardware. From the viewpoint of software-aided I/O, we offer Stream Disk Array (SDA) for scatter/gather-style block I/O, EXT3NS multimedia file system for large-scale file I/O, and interoperable streaming server for stream I/O.</abstract><cop>Boston</cop><pub>Springer US</pub><doi>10.1007/s11227-008-0254-5</doi><tpages>22</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0920-8542
ispartof The Journal of supercomputing, 2009-11, Vol.50 (2), p.99-120
issn 0920-8542
1573-0484
language eng
recordid cdi_proquest_miscellaneous_1671239895
source SpringerLink Journals - AutoHoldings
subjects Applied sciences
Architecture
Arrays
Compilers
Computer Science
Computer science
control theory
systems
Computer systems and distributed systems. User interface
Disks
Exact sciences and technology
Hardware
Interpreters
Memory and file management (including protection and security)
Memory organisation. Data processing
Multimedia
Processor Architectures
Programming Languages
Reuse
Servers
Software
Streams
title Fast-path I/O architecture for high performance streaming server
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T21%3A41%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Fast-path%20I/O%20architecture%20for%20high%20performance%20streaming%20server&rft.jtitle=The%20Journal%20of%20supercomputing&rft.au=Lee,%20Yong-Ju&rft.date=2009-11-01&rft.volume=50&rft.issue=2&rft.spage=99&rft.epage=120&rft.pages=99-120&rft.issn=0920-8542&rft.eissn=1573-0484&rft.coden=JOSUED&rft_id=info:doi/10.1007/s11227-008-0254-5&rft_dat=%3Cproquest_cross%3E1671239895%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1671239895&rft_id=info:pmid/&rfr_iscdi=true