Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms

Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collec...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Dias, Gabriel, Berto, Rodrigo Pommot, Oliveira, Mateus, Ueda, Lucas, Dertkigil, Sergio, Costa, Paula D. P, Shamaei, Amirmohammad, Souza, Roberto, Harris, Ashley, Rittner, Leticia
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Dias, Gabriel
Berto, Rodrigo Pommot
Oliveira, Mateus
Ueda, Lucas
Dertkigil, Sergio
Costa, Paula D. P
Shamaei, Amirmohammad
Souza, Roberto
Harris, Ashley
Rittner, Leticia
description Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collected in GABA-edited MRS scans are pre-processed and converted to a spectrogram image representation using the Short-Time Fourier Transform (STFT). The image representation of the data allows the adaptation of a pre-trained ViT for reconstructing GABA-edited MRS spectra (Spectro-ViT). The Spectro-ViT is fine-tuned and then tested using \textit{in vivo} GABA-edited MRS data. The Spectro-ViT performance is compared against other models in the literature using spectral quality metrics and estimated metabolite concentration values. Results: The Spectro-ViT model significantly outperformed all other models in four out of five quantitative metrics (mean squared error, shape score, GABA+/water fit error, and full width at half maximum). The metabolite concentrations estimated (GABA+/water, GABA+/Cr, and Glx/water) were consistent with the metabolite concentrations estimated using typical GABA-edited MRS scans reconstructed with the full amount of typically collected transients. Conclusion: The proposed Spectro-ViT model achieved state-of-the-art results in reconstructing GABA-edited MRS, and the results indicate these scans could be up to four times faster.
doi_str_mv 10.48550/arxiv.2311.15386
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2311_15386</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2311_15386</sourcerecordid><originalsourceid>FETCH-LOGICAL-a676-8d9ff25b828d0fe4916109b1381607b0f66b5b72097b5bf83b907b22cec5f51d3</originalsourceid><addsrcrecordid>eNotj8tKAzEARbNxIdUPcGV-IGMeTSZxNxatQovQjt3JkGcJdCYlGUX_3mnt6nIv3AMHgDuCq7nkHD_o_BO_K8oIqQhnUlyDz-3R2zEntIvtI2zgLpaYBthmPZSQcu8zXCfnD3AqcNk8Nci7OHoH15st3HibhjLmLzueTh8lDnt4Ae6z7ssNuAr6UPztJWegfXluF69o9b58WzQrpEUtkHQqBMqNpNLh4OeKCIKVIUwSgWuDgxCGm5piVU8ZJDNqmim13vLAiWMzcP-PPft1xxx7nX-7k2d39mR_78pNJg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms</title><source>arXiv.org</source><creator>Dias, Gabriel ; Berto, Rodrigo Pommot ; Oliveira, Mateus ; Ueda, Lucas ; Dertkigil, Sergio ; Costa, Paula D. P ; Shamaei, Amirmohammad ; Souza, Roberto ; Harris, Ashley ; Rittner, Leticia</creator><creatorcontrib>Dias, Gabriel ; Berto, Rodrigo Pommot ; Oliveira, Mateus ; Ueda, Lucas ; Dertkigil, Sergio ; Costa, Paula D. P ; Shamaei, Amirmohammad ; Souza, Roberto ; Harris, Ashley ; Rittner, Leticia</creatorcontrib><description>Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collected in GABA-edited MRS scans are pre-processed and converted to a spectrogram image representation using the Short-Time Fourier Transform (STFT). The image representation of the data allows the adaptation of a pre-trained ViT for reconstructing GABA-edited MRS spectra (Spectro-ViT). The Spectro-ViT is fine-tuned and then tested using \textit{in vivo} GABA-edited MRS data. The Spectro-ViT performance is compared against other models in the literature using spectral quality metrics and estimated metabolite concentration values. Results: The Spectro-ViT model significantly outperformed all other models in four out of five quantitative metrics (mean squared error, shape score, GABA+/water fit error, and full width at half maximum). The metabolite concentrations estimated (GABA+/water, GABA+/Cr, and Glx/water) were consistent with the metabolite concentrations estimated using typical GABA-edited MRS scans reconstructed with the full amount of typically collected transients. Conclusion: The proposed Spectro-ViT model achieved state-of-the-art results in reconstructing GABA-edited MRS, and the results indicate these scans could be up to four times faster.</description><identifier>DOI: 10.48550/arxiv.2311.15386</identifier><language>eng</language><subject>Computer Science - Learning ; Physics - Medical Physics</subject><creationdate>2023-11</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2311.15386$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2311.15386$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Dias, Gabriel</creatorcontrib><creatorcontrib>Berto, Rodrigo Pommot</creatorcontrib><creatorcontrib>Oliveira, Mateus</creatorcontrib><creatorcontrib>Ueda, Lucas</creatorcontrib><creatorcontrib>Dertkigil, Sergio</creatorcontrib><creatorcontrib>Costa, Paula D. P</creatorcontrib><creatorcontrib>Shamaei, Amirmohammad</creatorcontrib><creatorcontrib>Souza, Roberto</creatorcontrib><creatorcontrib>Harris, Ashley</creatorcontrib><creatorcontrib>Rittner, Leticia</creatorcontrib><title>Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms</title><description>Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collected in GABA-edited MRS scans are pre-processed and converted to a spectrogram image representation using the Short-Time Fourier Transform (STFT). The image representation of the data allows the adaptation of a pre-trained ViT for reconstructing GABA-edited MRS spectra (Spectro-ViT). The Spectro-ViT is fine-tuned and then tested using \textit{in vivo} GABA-edited MRS data. The Spectro-ViT performance is compared against other models in the literature using spectral quality metrics and estimated metabolite concentration values. Results: The Spectro-ViT model significantly outperformed all other models in four out of five quantitative metrics (mean squared error, shape score, GABA+/water fit error, and full width at half maximum). The metabolite concentrations estimated (GABA+/water, GABA+/Cr, and Glx/water) were consistent with the metabolite concentrations estimated using typical GABA-edited MRS scans reconstructed with the full amount of typically collected transients. Conclusion: The proposed Spectro-ViT model achieved state-of-the-art results in reconstructing GABA-edited MRS, and the results indicate these scans could be up to four times faster.</description><subject>Computer Science - Learning</subject><subject>Physics - Medical Physics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj8tKAzEARbNxIdUPcGV-IGMeTSZxNxatQovQjt3JkGcJdCYlGUX_3mnt6nIv3AMHgDuCq7nkHD_o_BO_K8oIqQhnUlyDz-3R2zEntIvtI2zgLpaYBthmPZSQcu8zXCfnD3AqcNk8Nci7OHoH15st3HibhjLmLzueTh8lDnt4Ae6z7ssNuAr6UPztJWegfXluF69o9b58WzQrpEUtkHQqBMqNpNLh4OeKCIKVIUwSgWuDgxCGm5piVU8ZJDNqmim13vLAiWMzcP-PPft1xxx7nX-7k2d39mR_78pNJg</recordid><startdate>20231126</startdate><enddate>20231126</enddate><creator>Dias, Gabriel</creator><creator>Berto, Rodrigo Pommot</creator><creator>Oliveira, Mateus</creator><creator>Ueda, Lucas</creator><creator>Dertkigil, Sergio</creator><creator>Costa, Paula D. P</creator><creator>Shamaei, Amirmohammad</creator><creator>Souza, Roberto</creator><creator>Harris, Ashley</creator><creator>Rittner, Leticia</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20231126</creationdate><title>Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms</title><author>Dias, Gabriel ; Berto, Rodrigo Pommot ; Oliveira, Mateus ; Ueda, Lucas ; Dertkigil, Sergio ; Costa, Paula D. P ; Shamaei, Amirmohammad ; Souza, Roberto ; Harris, Ashley ; Rittner, Leticia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a676-8d9ff25b828d0fe4916109b1381607b0f66b5b72097b5bf83b907b22cec5f51d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Learning</topic><topic>Physics - Medical Physics</topic><toplevel>online_resources</toplevel><creatorcontrib>Dias, Gabriel</creatorcontrib><creatorcontrib>Berto, Rodrigo Pommot</creatorcontrib><creatorcontrib>Oliveira, Mateus</creatorcontrib><creatorcontrib>Ueda, Lucas</creatorcontrib><creatorcontrib>Dertkigil, Sergio</creatorcontrib><creatorcontrib>Costa, Paula D. P</creatorcontrib><creatorcontrib>Shamaei, Amirmohammad</creatorcontrib><creatorcontrib>Souza, Roberto</creatorcontrib><creatorcontrib>Harris, Ashley</creatorcontrib><creatorcontrib>Rittner, Leticia</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Dias, Gabriel</au><au>Berto, Rodrigo Pommot</au><au>Oliveira, Mateus</au><au>Ueda, Lucas</au><au>Dertkigil, Sergio</au><au>Costa, Paula D. P</au><au>Shamaei, Amirmohammad</au><au>Souza, Roberto</au><au>Harris, Ashley</au><au>Rittner, Leticia</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms</atitle><date>2023-11-26</date><risdate>2023</risdate><abstract>Purpose: To investigate the use of a Vision Transformer (ViT) to reconstruct/denoise GABA-edited magnetic resonance spectroscopy (MRS) from a quarter of the typically acquired number of transients using spectrograms. Theory and Methods: A quarter of the typically acquired number of transients collected in GABA-edited MRS scans are pre-processed and converted to a spectrogram image representation using the Short-Time Fourier Transform (STFT). The image representation of the data allows the adaptation of a pre-trained ViT for reconstructing GABA-edited MRS spectra (Spectro-ViT). The Spectro-ViT is fine-tuned and then tested using \textit{in vivo} GABA-edited MRS data. The Spectro-ViT performance is compared against other models in the literature using spectral quality metrics and estimated metabolite concentration values. Results: The Spectro-ViT model significantly outperformed all other models in four out of five quantitative metrics (mean squared error, shape score, GABA+/water fit error, and full width at half maximum). The metabolite concentrations estimated (GABA+/water, GABA+/Cr, and Glx/water) were consistent with the metabolite concentrations estimated using typical GABA-edited MRS scans reconstructed with the full amount of typically collected transients. Conclusion: The proposed Spectro-ViT model achieved state-of-the-art results in reconstructing GABA-edited MRS, and the results indicate these scans could be up to four times faster.</abstract><doi>10.48550/arxiv.2311.15386</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2311.15386
ispartof
issn
language eng
recordid cdi_arxiv_primary_2311_15386
source arXiv.org
subjects Computer Science - Learning
Physics - Medical Physics
title Spectro-ViT: A Vision Transformer Model for GABA-edited MRS Reconstruction Using Spectrograms
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T05%3A12%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Spectro-ViT:%20A%20Vision%20Transformer%20Model%20for%20GABA-edited%20MRS%20Reconstruction%20Using%20Spectrograms&rft.au=Dias,%20Gabriel&rft.date=2023-11-26&rft_id=info:doi/10.48550/arxiv.2311.15386&rft_dat=%3Carxiv_GOX%3E2311_15386%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true