Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment

In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is comp...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on haptics 2021-04, Vol.14 (2), p.291-296
Hauptverfasser: Muschter, Evelyn, Noll, Andreas, Zhao, Jinting, Hassen, Rania, Strese, Matti, Gulecyuz, Basak, Li, Shu-Chen, Steinbach, Eckehard
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 296
container_issue 2
container_start_page 291
container_title IEEE transactions on haptics
container_volume 14
creator Muschter, Evelyn
Noll, Andreas
Zhao, Jinting
Hassen, Rania
Strese, Matti
Gulecyuz, Basak
Li, Shu-Chen
Steinbach, Eckehard
description In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is compared to its original signal and rated on a numerical scale. For each signal tested, the hidden reference and two anchor signals are used to validate the results and provide assessor screening criteria. Differing from previous approaches, our method is hierarchically structured and strictly timed in a sequential manner to avoid experimental confounds and provide precise psychophysical assessments. We validated our method in an experiment with 20 human participants in which we compared two state-of-the-art lossy codecs. The results show that, with our approach, the performance of different codecs can be compared effectively. Furthermore, the method also provides a measure of subjective quality at different data compression rates. The proposed procedure can be easily adapted to evaluate other vibrotactile codecs.
doi_str_mv 10.1109/TOH.2021.3077191
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_miscellaneous_2522195101</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9422196</ieee_id><sourcerecordid>2522195101</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-1a842622e5428d3d3cf533ccb30666b64c87a175080acca7238e22eae5e497d23</originalsourceid><addsrcrecordid>eNpdkE1Lw0AQhhdRbK3eBUECXryk7uxHkj2WolYpVLF6k7DdTNuUpKm7idB_78bWHrzssMzzDjMPIZdA-wBU3U0noz6jDPqcxjEoOCJdxpkKBZVwTLqguApBAOuQM-dWlEYsVuKUdDj3nQhEl3y-oDW4qRtdBK_-yettMHAOnStxXQfVPBhW5cb6P2bBRz6zVa1NnRcYvOWLtS5cMF3aqlksfzltdZ1_Y_DcZIs2f05O5p7Bi33tkfeH--lwFI4nj0_DwTg0XMR1CDoRLGIMpWBJxjNu5pJzY2acRlE0i4RJYg2xpAnVxuiY8QQ9rVGiUHHGeI_c7uZubPXVoKvTMncGi0KvsWpcyiRjoCRQ8OjNP3RVNba9xFOCScq5lJ6iO8rYyjmL83Rj81LbbQo0bdWnXn3aqk_36n3kej-4mZWYHQJ_rj1wtQNyRDy0lWhXi_gPRv2HUA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2542503355</pqid></control><display><type>article</type><title>Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment</title><source>IEEE Electronic Library (IEL)</source><creator>Muschter, Evelyn ; Noll, Andreas ; Zhao, Jinting ; Hassen, Rania ; Strese, Matti ; Gulecyuz, Basak ; Li, Shu-Chen ; Steinbach, Eckehard</creator><creatorcontrib>Muschter, Evelyn ; Noll, Andreas ; Zhao, Jinting ; Hassen, Rania ; Strese, Matti ; Gulecyuz, Basak ; Li, Shu-Chen ; Steinbach, Eckehard</creatorcontrib><description>In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is compared to its original signal and rated on a numerical scale. For each signal tested, the hidden reference and two anchor signals are used to validate the results and provide assessor screening criteria. Differing from previous approaches, our method is hierarchically structured and strictly timed in a sequential manner to avoid experimental confounds and provide precise psychophysical assessments. We validated our method in an experiment with 20 human participants in which we compared two state-of-the-art lossy codecs. The results show that, with our approach, the performance of different codecs can be compared effectively. Furthermore, the method also provides a measure of subjective quality at different data compression rates. The proposed procedure can be easily adapted to evaluate other vibrotactile codecs.</description><identifier>ISSN: 1939-1412</identifier><identifier>EISSN: 2329-4051</identifier><identifier>DOI: 10.1109/TOH.2021.3077191</identifier><identifier>PMID: 33939614</identifier><identifier>CODEN: ITHEBX</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Codec ; Codecs ; Compression tests ; Data compression ; Discrete wavelet transforms ; Quality assessment ; Quantization (signal) ; Subjective quality assessment ; Tactile Internet ; tactile perception ; Timing ; Training ; vibrotactile compression ; vibrotactile quality assessment</subject><ispartof>IEEE transactions on haptics, 2021-04, Vol.14 (2), p.291-296</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-1a842622e5428d3d3cf533ccb30666b64c87a175080acca7238e22eae5e497d23</citedby><cites>FETCH-LOGICAL-c347t-1a842622e5428d3d3cf533ccb30666b64c87a175080acca7238e22eae5e497d23</cites><orcidid>0000-0001-8409-5390 ; 0000-0002-6755-0803 ; 0000-0001-5683-0968 ; 0000-0001-9280-5276 ; 0000-0001-6870-5224 ; 0000-0001-8853-2703 ; 0000-0003-2781-9895</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9422196$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,777,781,793,27905,27906,54739</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9422196$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33939614$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Muschter, Evelyn</creatorcontrib><creatorcontrib>Noll, Andreas</creatorcontrib><creatorcontrib>Zhao, Jinting</creatorcontrib><creatorcontrib>Hassen, Rania</creatorcontrib><creatorcontrib>Strese, Matti</creatorcontrib><creatorcontrib>Gulecyuz, Basak</creatorcontrib><creatorcontrib>Li, Shu-Chen</creatorcontrib><creatorcontrib>Steinbach, Eckehard</creatorcontrib><title>Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment</title><title>IEEE transactions on haptics</title><addtitle>TOH</addtitle><addtitle>IEEE Trans Haptics</addtitle><description>In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is compared to its original signal and rated on a numerical scale. For each signal tested, the hidden reference and two anchor signals are used to validate the results and provide assessor screening criteria. Differing from previous approaches, our method is hierarchically structured and strictly timed in a sequential manner to avoid experimental confounds and provide precise psychophysical assessments. We validated our method in an experiment with 20 human participants in which we compared two state-of-the-art lossy codecs. The results show that, with our approach, the performance of different codecs can be compared effectively. Furthermore, the method also provides a measure of subjective quality at different data compression rates. The proposed procedure can be easily adapted to evaluate other vibrotactile codecs.</description><subject>Codec</subject><subject>Codecs</subject><subject>Compression tests</subject><subject>Data compression</subject><subject>Discrete wavelet transforms</subject><subject>Quality assessment</subject><subject>Quantization (signal)</subject><subject>Subjective quality assessment</subject><subject>Tactile Internet</subject><subject>tactile perception</subject><subject>Timing</subject><subject>Training</subject><subject>vibrotactile compression</subject><subject>vibrotactile quality assessment</subject><issn>1939-1412</issn><issn>2329-4051</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkE1Lw0AQhhdRbK3eBUECXryk7uxHkj2WolYpVLF6k7DdTNuUpKm7idB_78bWHrzssMzzDjMPIZdA-wBU3U0noz6jDPqcxjEoOCJdxpkKBZVwTLqguApBAOuQM-dWlEYsVuKUdDj3nQhEl3y-oDW4qRtdBK_-yettMHAOnStxXQfVPBhW5cb6P2bBRz6zVa1NnRcYvOWLtS5cMF3aqlksfzltdZ1_Y_DcZIs2f05O5p7Bi33tkfeH--lwFI4nj0_DwTg0XMR1CDoRLGIMpWBJxjNu5pJzY2acRlE0i4RJYg2xpAnVxuiY8QQ9rVGiUHHGeI_c7uZubPXVoKvTMncGi0KvsWpcyiRjoCRQ8OjNP3RVNba9xFOCScq5lJ6iO8rYyjmL83Rj81LbbQo0bdWnXn3aqk_36n3kej-4mZWYHQJ_rj1wtQNyRDy0lWhXi_gPRv2HUA</recordid><startdate>20210401</startdate><enddate>20210401</enddate><creator>Muschter, Evelyn</creator><creator>Noll, Andreas</creator><creator>Zhao, Jinting</creator><creator>Hassen, Rania</creator><creator>Strese, Matti</creator><creator>Gulecyuz, Basak</creator><creator>Li, Shu-Chen</creator><creator>Steinbach, Eckehard</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0001-8409-5390</orcidid><orcidid>https://orcid.org/0000-0002-6755-0803</orcidid><orcidid>https://orcid.org/0000-0001-5683-0968</orcidid><orcidid>https://orcid.org/0000-0001-9280-5276</orcidid><orcidid>https://orcid.org/0000-0001-6870-5224</orcidid><orcidid>https://orcid.org/0000-0001-8853-2703</orcidid><orcidid>https://orcid.org/0000-0003-2781-9895</orcidid></search><sort><creationdate>20210401</creationdate><title>Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment</title><author>Muschter, Evelyn ; Noll, Andreas ; Zhao, Jinting ; Hassen, Rania ; Strese, Matti ; Gulecyuz, Basak ; Li, Shu-Chen ; Steinbach, Eckehard</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-1a842622e5428d3d3cf533ccb30666b64c87a175080acca7238e22eae5e497d23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Codec</topic><topic>Codecs</topic><topic>Compression tests</topic><topic>Data compression</topic><topic>Discrete wavelet transforms</topic><topic>Quality assessment</topic><topic>Quantization (signal)</topic><topic>Subjective quality assessment</topic><topic>Tactile Internet</topic><topic>tactile perception</topic><topic>Timing</topic><topic>Training</topic><topic>vibrotactile compression</topic><topic>vibrotactile quality assessment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Muschter, Evelyn</creatorcontrib><creatorcontrib>Noll, Andreas</creatorcontrib><creatorcontrib>Zhao, Jinting</creatorcontrib><creatorcontrib>Hassen, Rania</creatorcontrib><creatorcontrib>Strese, Matti</creatorcontrib><creatorcontrib>Gulecyuz, Basak</creatorcontrib><creatorcontrib>Li, Shu-Chen</creatorcontrib><creatorcontrib>Steinbach, Eckehard</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on haptics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Muschter, Evelyn</au><au>Noll, Andreas</au><au>Zhao, Jinting</au><au>Hassen, Rania</au><au>Strese, Matti</au><au>Gulecyuz, Basak</au><au>Li, Shu-Chen</au><au>Steinbach, Eckehard</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment</atitle><jtitle>IEEE transactions on haptics</jtitle><stitle>TOH</stitle><addtitle>IEEE Trans Haptics</addtitle><date>2021-04-01</date><risdate>2021</risdate><volume>14</volume><issue>2</issue><spage>291</spage><epage>296</epage><pages>291-296</pages><issn>1939-1412</issn><eissn>2329-4051</eissn><coden>ITHEBX</coden><abstract>In this article, we present a comprehensive scheme for the quality assessment of compressed vibrotactile signals with human assessors. Inspired by the multiple stimulus test with hidden reference and anchors (MUSHRA) from the audio domain, we designed a method in which each compressed signal is compared to its original signal and rated on a numerical scale. For each signal tested, the hidden reference and two anchor signals are used to validate the results and provide assessor screening criteria. Differing from previous approaches, our method is hierarchically structured and strictly timed in a sequential manner to avoid experimental confounds and provide precise psychophysical assessments. We validated our method in an experiment with 20 human participants in which we compared two state-of-the-art lossy codecs. The results show that, with our approach, the performance of different codecs can be compared effectively. Furthermore, the method also provides a measure of subjective quality at different data compression rates. The proposed procedure can be easily adapted to evaluate other vibrotactile codecs.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>33939614</pmid><doi>10.1109/TOH.2021.3077191</doi><tpages>6</tpages><orcidid>https://orcid.org/0000-0001-8409-5390</orcidid><orcidid>https://orcid.org/0000-0002-6755-0803</orcidid><orcidid>https://orcid.org/0000-0001-5683-0968</orcidid><orcidid>https://orcid.org/0000-0001-9280-5276</orcidid><orcidid>https://orcid.org/0000-0001-6870-5224</orcidid><orcidid>https://orcid.org/0000-0001-8853-2703</orcidid><orcidid>https://orcid.org/0000-0003-2781-9895</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1939-1412
ispartof IEEE transactions on haptics, 2021-04, Vol.14 (2), p.291-296
issn 1939-1412
2329-4051
language eng
recordid cdi_proquest_miscellaneous_2522195101
source IEEE Electronic Library (IEL)
subjects Codec
Codecs
Compression tests
Data compression
Discrete wavelet transforms
Quality assessment
Quantization (signal)
Subjective quality assessment
Tactile Internet
tactile perception
Timing
Training
vibrotactile compression
vibrotactile quality assessment
title Perceptual Quality Assessment of Compressed Vibrotactile Signals Through Comparative Judgment
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T14%3A57%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Perceptual%20Quality%20Assessment%20of%20Compressed%20Vibrotactile%20Signals%20Through%20Comparative%20Judgment&rft.jtitle=IEEE%20transactions%20on%20haptics&rft.au=Muschter,%20Evelyn&rft.date=2021-04-01&rft.volume=14&rft.issue=2&rft.spage=291&rft.epage=296&rft.pages=291-296&rft.issn=1939-1412&rft.eissn=2329-4051&rft.coden=ITHEBX&rft_id=info:doi/10.1109/TOH.2021.3077191&rft_dat=%3Cproquest_RIE%3E2522195101%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2542503355&rft_id=info:pmid/33939614&rft_ieee_id=9422196&rfr_iscdi=true