Sparse Matrix-Based HPC Tomography
Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2020-04 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Marchesini, Stefano Trivedi, Anuradha Enfedaque, Pablo Perciano, Talita Parkinson, Dilworth |
description | Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide. |
doi_str_mv | 10.48550/arxiv.2003.12677 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2003_12677</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2384649532</sourcerecordid><originalsourceid>FETCH-LOGICAL-a522-fb966366b6a157b1b840a782270ee02a47f301ec0b82968ff115f8137a90d60c3</originalsourceid><addsrcrecordid>eNotj01Lw0AURQdBsNT-AFcGXSe-eW--stSiVqgomH14aWc0xZo400r7742tq7u4h8s9QlxIKJTTGm447tqfAgGokGisPREjJJK5U4hnYpLSCgCGArWmkbh66zkmnz3zJra7_I6TX2az12lWdevuPXL_sT8Xp4E_k5_851hUD_fVdJbPXx6fprfznDViHprSGDKmMSy1bWTjFLB1iBa8B2RlA4H0C2gclsaFIKUOTpLlEpYGFjQWl8fZg0Ddx3bNcV__idQHkYG4PhJ97L63Pm3qVbeNX8OnGskpo0pNSL_qmEgS</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2384649532</pqid></control><display><type>article</type><title>Sparse Matrix-Based HPC Tomography</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</creator><creatorcontrib>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</creatorcontrib><description>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2003.12677</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Computer Science - Distributed, Parallel, and Cluster Computing ; Hardware ; Matrix algebra ; Matrix methods ; Multiplication ; Operators (mathematics) ; Prototyping ; Reconstruction ; Software packages ; Sparse matrices ; Sparsity ; Supercomputers ; Tomography ; Workstations ; X ray sources</subject><ispartof>arXiv.org, 2020-04</ispartof><rights>2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.1007/978-3-030-50371-0_18$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2003.12677$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Marchesini, Stefano</creatorcontrib><creatorcontrib>Trivedi, Anuradha</creatorcontrib><creatorcontrib>Enfedaque, Pablo</creatorcontrib><creatorcontrib>Perciano, Talita</creatorcontrib><creatorcontrib>Parkinson, Dilworth</creatorcontrib><title>Sparse Matrix-Based HPC Tomography</title><title>arXiv.org</title><description>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</description><subject>Computer Science - Distributed, Parallel, and Cluster Computing</subject><subject>Hardware</subject><subject>Matrix algebra</subject><subject>Matrix methods</subject><subject>Multiplication</subject><subject>Operators (mathematics)</subject><subject>Prototyping</subject><subject>Reconstruction</subject><subject>Software packages</subject><subject>Sparse matrices</subject><subject>Sparsity</subject><subject>Supercomputers</subject><subject>Tomography</subject><subject>Workstations</subject><subject>X ray sources</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotj01Lw0AURQdBsNT-AFcGXSe-eW--stSiVqgomH14aWc0xZo400r7742tq7u4h8s9QlxIKJTTGm447tqfAgGokGisPREjJJK5U4hnYpLSCgCGArWmkbh66zkmnz3zJra7_I6TX2az12lWdevuPXL_sT8Xp4E_k5_851hUD_fVdJbPXx6fprfznDViHprSGDKmMSy1bWTjFLB1iBa8B2RlA4H0C2gclsaFIKUOTpLlEpYGFjQWl8fZg0Ddx3bNcV__idQHkYG4PhJ97L63Pm3qVbeNX8OnGskpo0pNSL_qmEgS</recordid><startdate>20200422</startdate><enddate>20200422</enddate><creator>Marchesini, Stefano</creator><creator>Trivedi, Anuradha</creator><creator>Enfedaque, Pablo</creator><creator>Perciano, Talita</creator><creator>Parkinson, Dilworth</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20200422</creationdate><title>Sparse Matrix-Based HPC Tomography</title><author>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a522-fb966366b6a157b1b840a782270ee02a47f301ec0b82968ff115f8137a90d60c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Distributed, Parallel, and Cluster Computing</topic><topic>Hardware</topic><topic>Matrix algebra</topic><topic>Matrix methods</topic><topic>Multiplication</topic><topic>Operators (mathematics)</topic><topic>Prototyping</topic><topic>Reconstruction</topic><topic>Software packages</topic><topic>Sparse matrices</topic><topic>Sparsity</topic><topic>Supercomputers</topic><topic>Tomography</topic><topic>Workstations</topic><topic>X ray sources</topic><toplevel>online_resources</toplevel><creatorcontrib>Marchesini, Stefano</creatorcontrib><creatorcontrib>Trivedi, Anuradha</creatorcontrib><creatorcontrib>Enfedaque, Pablo</creatorcontrib><creatorcontrib>Perciano, Talita</creatorcontrib><creatorcontrib>Parkinson, Dilworth</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Marchesini, Stefano</au><au>Trivedi, Anuradha</au><au>Enfedaque, Pablo</au><au>Perciano, Talita</au><au>Parkinson, Dilworth</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Sparse Matrix-Based HPC Tomography</atitle><jtitle>arXiv.org</jtitle><date>2020-04-22</date><risdate>2020</risdate><eissn>2331-8422</eissn><abstract>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2003.12677</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2020-04 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2003_12677 |
source | arXiv.org; Free E- Journals |
subjects | Computer Science - Distributed, Parallel, and Cluster Computing Hardware Matrix algebra Matrix methods Multiplication Operators (mathematics) Prototyping Reconstruction Software packages Sparse matrices Sparsity Supercomputers Tomography Workstations X ray sources |
title | Sparse Matrix-Based HPC Tomography |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T09%3A23%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Sparse%20Matrix-Based%20HPC%20Tomography&rft.jtitle=arXiv.org&rft.au=Marchesini,%20Stefano&rft.date=2020-04-22&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2003.12677&rft_dat=%3Cproquest_arxiv%3E2384649532%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2384649532&rft_id=info:pmid/&rfr_iscdi=true |