Sparse Matrix-Based HPC Tomography

Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2020-04
Hauptverfasser: Marchesini, Stefano, Trivedi, Anuradha, Enfedaque, Pablo, Perciano, Talita, Parkinson, Dilworth
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Marchesini, Stefano
Trivedi, Anuradha
Enfedaque, Pablo
Perciano, Talita
Parkinson, Dilworth
description Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.
doi_str_mv 10.48550/arxiv.2003.12677
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2003_12677</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2384649532</sourcerecordid><originalsourceid>FETCH-LOGICAL-a522-fb966366b6a157b1b840a782270ee02a47f301ec0b82968ff115f8137a90d60c3</originalsourceid><addsrcrecordid>eNotj01Lw0AURQdBsNT-AFcGXSe-eW--stSiVqgomH14aWc0xZo400r7742tq7u4h8s9QlxIKJTTGm447tqfAgGokGisPREjJJK5U4hnYpLSCgCGArWmkbh66zkmnz3zJra7_I6TX2az12lWdevuPXL_sT8Xp4E_k5_851hUD_fVdJbPXx6fprfznDViHprSGDKmMSy1bWTjFLB1iBa8B2RlA4H0C2gclsaFIKUOTpLlEpYGFjQWl8fZg0Ddx3bNcV__idQHkYG4PhJ97L63Pm3qVbeNX8OnGskpo0pNSL_qmEgS</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2384649532</pqid></control><display><type>article</type><title>Sparse Matrix-Based HPC Tomography</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</creator><creatorcontrib>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</creatorcontrib><description>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2003.12677</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Computer Science - Distributed, Parallel, and Cluster Computing ; Hardware ; Matrix algebra ; Matrix methods ; Multiplication ; Operators (mathematics) ; Prototyping ; Reconstruction ; Software packages ; Sparse matrices ; Sparsity ; Supercomputers ; Tomography ; Workstations ; X ray sources</subject><ispartof>arXiv.org, 2020-04</ispartof><rights>2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.1007/978-3-030-50371-0_18$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2003.12677$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Marchesini, Stefano</creatorcontrib><creatorcontrib>Trivedi, Anuradha</creatorcontrib><creatorcontrib>Enfedaque, Pablo</creatorcontrib><creatorcontrib>Perciano, Talita</creatorcontrib><creatorcontrib>Parkinson, Dilworth</creatorcontrib><title>Sparse Matrix-Based HPC Tomography</title><title>arXiv.org</title><description>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</description><subject>Computer Science - Distributed, Parallel, and Cluster Computing</subject><subject>Hardware</subject><subject>Matrix algebra</subject><subject>Matrix methods</subject><subject>Multiplication</subject><subject>Operators (mathematics)</subject><subject>Prototyping</subject><subject>Reconstruction</subject><subject>Software packages</subject><subject>Sparse matrices</subject><subject>Sparsity</subject><subject>Supercomputers</subject><subject>Tomography</subject><subject>Workstations</subject><subject>X ray sources</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotj01Lw0AURQdBsNT-AFcGXSe-eW--stSiVqgomH14aWc0xZo400r7742tq7u4h8s9QlxIKJTTGm447tqfAgGokGisPREjJJK5U4hnYpLSCgCGArWmkbh66zkmnz3zJra7_I6TX2az12lWdevuPXL_sT8Xp4E_k5_851hUD_fVdJbPXx6fprfznDViHprSGDKmMSy1bWTjFLB1iBa8B2RlA4H0C2gclsaFIKUOTpLlEpYGFjQWl8fZg0Ddx3bNcV__idQHkYG4PhJ97L63Pm3qVbeNX8OnGskpo0pNSL_qmEgS</recordid><startdate>20200422</startdate><enddate>20200422</enddate><creator>Marchesini, Stefano</creator><creator>Trivedi, Anuradha</creator><creator>Enfedaque, Pablo</creator><creator>Perciano, Talita</creator><creator>Parkinson, Dilworth</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20200422</creationdate><title>Sparse Matrix-Based HPC Tomography</title><author>Marchesini, Stefano ; Trivedi, Anuradha ; Enfedaque, Pablo ; Perciano, Talita ; Parkinson, Dilworth</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a522-fb966366b6a157b1b840a782270ee02a47f301ec0b82968ff115f8137a90d60c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Distributed, Parallel, and Cluster Computing</topic><topic>Hardware</topic><topic>Matrix algebra</topic><topic>Matrix methods</topic><topic>Multiplication</topic><topic>Operators (mathematics)</topic><topic>Prototyping</topic><topic>Reconstruction</topic><topic>Software packages</topic><topic>Sparse matrices</topic><topic>Sparsity</topic><topic>Supercomputers</topic><topic>Tomography</topic><topic>Workstations</topic><topic>X ray sources</topic><toplevel>online_resources</toplevel><creatorcontrib>Marchesini, Stefano</creatorcontrib><creatorcontrib>Trivedi, Anuradha</creatorcontrib><creatorcontrib>Enfedaque, Pablo</creatorcontrib><creatorcontrib>Perciano, Talita</creatorcontrib><creatorcontrib>Parkinson, Dilworth</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Marchesini, Stefano</au><au>Trivedi, Anuradha</au><au>Enfedaque, Pablo</au><au>Perciano, Talita</au><au>Parkinson, Dilworth</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Sparse Matrix-Based HPC Tomography</atitle><jtitle>arXiv.org</jtitle><date>2020-04-22</date><risdate>2020</risdate><eissn>2331-8422</eissn><abstract>Tomographic imaging has benefited from advances in X-ray sources, detectors and optics to enable novel observations in science, engineering and medicine. These advances have come with a dramatic increase of input data in the form of faster frame rates, larger fields of view or higher resolution, so high performance solutions are currently widely used for analysis. Tomographic instruments can vary significantly from one to another, including the hardware employed for reconstruction: from single CPU workstations to large scale hybrid CPU/GPU supercomputers. Flexibility on the software interfaces and reconstruction engines are also highly valued to allow for easy development and prototyping. This paper presents a novel software framework for tomographic analysis that tackles all aforementioned requirements. The proposed solution capitalizes on the increased performance of sparse matrix-vector multiplication and exploits multi-CPU and GPU reconstruction over MPI. The solution is implemented in Python and relies on CuPy for fast GPU operators and CUDA kernel integration, and on SciPy for CPU sparse matrix computation. As opposed to previous tomography solutions that are tailor-made for specific use cases or hardware, the proposed software is designed to provide flexible, portable and high-performance operators that can be used for continuous integration at different production environments, but also for prototyping new experimental settings or for algorithmic development. The experimental results demonstrate how our implementation can even outperform state-of-the-art software packages used at advanced X-ray sources worldwide.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2003.12677</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2020-04
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2003_12677
source arXiv.org; Free E- Journals
subjects Computer Science - Distributed, Parallel, and Cluster Computing
Hardware
Matrix algebra
Matrix methods
Multiplication
Operators (mathematics)
Prototyping
Reconstruction
Software packages
Sparse matrices
Sparsity
Supercomputers
Tomography
Workstations
X ray sources
title Sparse Matrix-Based HPC Tomography
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T09%3A23%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Sparse%20Matrix-Based%20HPC%20Tomography&rft.jtitle=arXiv.org&rft.au=Marchesini,%20Stefano&rft.date=2020-04-22&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2003.12677&rft_dat=%3Cproquest_arxiv%3E2384649532%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2384649532&rft_id=info:pmid/&rfr_iscdi=true