Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters

Speech Communication 101 (2018) 70-84 Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environ...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hendrikse, Maartje M. E, Llorach, Gerard, Grimm, Giso, Hohmann, Volker
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Hendrikse, Maartje M. E
Llorach, Gerard
Grimm, Giso
Hohmann, Volker
description Speech Communication 101 (2018) 70-84 Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and eye-movement behavior of subjects. Here, two listening tasks were carried out with a group of 14 young normal hearing subjects to investigate the influence of visual cues on head- and eye-movement behavior; on combined localization and speech intelligibility task performance; as well as on perceived speech intelligibility, perceived listening effort and the general impression of the audiovisual environments. Animated characters with different lip-syncing and gaze patterns were compared to an audio-only condition and to a video of real persons. Results show that movement behavior, task performance, and perception were all influenced by visual cues. The movement behavior of young normal hearing listeners in animation conditions with lip-syncing was similar to that in the video condition. These results in young normal hearing listeners are a first step towards using the animated characters to assess the influence of head movement behavior on hearing aid performance.
doi_str_mv 10.48550/arxiv.1812.02088
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1812_02088</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1812_02088</sourcerecordid><originalsourceid>FETCH-arxiv_primary_1812_020883</originalsourceid><addsrcrecordid>eNqFjjkOwkAQBDchQMADiJgPYGwOyTkCQU5ujbxjPPJ6Fu1h8Bv4NObIibqDrlYpNc_SZJvvdukK3YO7JMuzdZKu0zwfq-dZKhNJSgJbQcc-ooEykgcrUBNqQNFAPUFrO2pJggcdHcsVDPtA8m4BfeOBBdpoAi8DmoYcYNRsf48kHTsrX_7OoR5uucVAGsoaHZaBnJ-qUYXG0-yXE7U4Hi770_KjXdzcQLi-eOsXH_3N_8ULywJT6Q</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters</title><source>arXiv.org</source><creator>Hendrikse, Maartje M. E ; Llorach, Gerard ; Grimm, Giso ; Hohmann, Volker</creator><creatorcontrib>Hendrikse, Maartje M. E ; Llorach, Gerard ; Grimm, Giso ; Hohmann, Volker</creatorcontrib><description>Speech Communication 101 (2018) 70-84 Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and eye-movement behavior of subjects. Here, two listening tasks were carried out with a group of 14 young normal hearing subjects to investigate the influence of visual cues on head- and eye-movement behavior; on combined localization and speech intelligibility task performance; as well as on perceived speech intelligibility, perceived listening effort and the general impression of the audiovisual environments. Animated characters with different lip-syncing and gaze patterns were compared to an audio-only condition and to a video of real persons. Results show that movement behavior, task performance, and perception were all influenced by visual cues. The movement behavior of young normal hearing listeners in animation conditions with lip-syncing was similar to that in the video condition. These results in young normal hearing listeners are a first step towards using the animated characters to assess the influence of head movement behavior on hearing aid performance.</description><identifier>DOI: 10.48550/arxiv.1812.02088</identifier><language>eng</language><subject>Computer Science - Human-Computer Interaction ; Physics - Medical Physics</subject><creationdate>2018-11</creationdate><rights>http://creativecommons.org/licenses/by-nc-sa/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1812.02088$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1812.02088$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1016/j.specom.2018.05.008$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Hendrikse, Maartje M. E</creatorcontrib><creatorcontrib>Llorach, Gerard</creatorcontrib><creatorcontrib>Grimm, Giso</creatorcontrib><creatorcontrib>Hohmann, Volker</creatorcontrib><title>Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters</title><description>Speech Communication 101 (2018) 70-84 Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and eye-movement behavior of subjects. Here, two listening tasks were carried out with a group of 14 young normal hearing subjects to investigate the influence of visual cues on head- and eye-movement behavior; on combined localization and speech intelligibility task performance; as well as on perceived speech intelligibility, perceived listening effort and the general impression of the audiovisual environments. Animated characters with different lip-syncing and gaze patterns were compared to an audio-only condition and to a video of real persons. Results show that movement behavior, task performance, and perception were all influenced by visual cues. The movement behavior of young normal hearing listeners in animation conditions with lip-syncing was similar to that in the video condition. These results in young normal hearing listeners are a first step towards using the animated characters to assess the influence of head movement behavior on hearing aid performance.</description><subject>Computer Science - Human-Computer Interaction</subject><subject>Physics - Medical Physics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjjkOwkAQBDchQMADiJgPYGwOyTkCQU5ujbxjPPJ6Fu1h8Bv4NObIibqDrlYpNc_SZJvvdukK3YO7JMuzdZKu0zwfq-dZKhNJSgJbQcc-ooEykgcrUBNqQNFAPUFrO2pJggcdHcsVDPtA8m4BfeOBBdpoAi8DmoYcYNRsf48kHTsrX_7OoR5uucVAGsoaHZaBnJ-qUYXG0-yXE7U4Hi770_KjXdzcQLi-eOsXH_3N_8ULywJT6Q</recordid><startdate>20181116</startdate><enddate>20181116</enddate><creator>Hendrikse, Maartje M. E</creator><creator>Llorach, Gerard</creator><creator>Grimm, Giso</creator><creator>Hohmann, Volker</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20181116</creationdate><title>Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters</title><author>Hendrikse, Maartje M. E ; Llorach, Gerard ; Grimm, Giso ; Hohmann, Volker</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_1812_020883</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Computer Science - Human-Computer Interaction</topic><topic>Physics - Medical Physics</topic><toplevel>online_resources</toplevel><creatorcontrib>Hendrikse, Maartje M. E</creatorcontrib><creatorcontrib>Llorach, Gerard</creatorcontrib><creatorcontrib>Grimm, Giso</creatorcontrib><creatorcontrib>Hohmann, Volker</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Hendrikse, Maartje M. E</au><au>Llorach, Gerard</au><au>Grimm, Giso</au><au>Hohmann, Volker</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters</atitle><date>2018-11-16</date><risdate>2018</risdate><abstract>Speech Communication 101 (2018) 70-84 Recent studies of hearing aid benefits indicate that head movement behavior influences performance. To systematically assess these effects, movement behavior must be measured in realistic communication conditions. For this, the use of virtual audiovisual environments with animated characters as visual stimuli has been proposed. It is unclear, however, how these animations influence the head- and eye-movement behavior of subjects. Here, two listening tasks were carried out with a group of 14 young normal hearing subjects to investigate the influence of visual cues on head- and eye-movement behavior; on combined localization and speech intelligibility task performance; as well as on perceived speech intelligibility, perceived listening effort and the general impression of the audiovisual environments. Animated characters with different lip-syncing and gaze patterns were compared to an audio-only condition and to a video of real persons. Results show that movement behavior, task performance, and perception were all influenced by visual cues. The movement behavior of young normal hearing listeners in animation conditions with lip-syncing was similar to that in the video condition. These results in young normal hearing listeners are a first step towards using the animated characters to assess the influence of head movement behavior on hearing aid performance.</abstract><doi>10.48550/arxiv.1812.02088</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1812.02088
ispartof
issn
language eng
recordid cdi_arxiv_primary_1812_02088
source arXiv.org
subjects Computer Science - Human-Computer Interaction
Physics - Medical Physics
title Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-03T09%3A22%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Influence%20of%20visual%20cues%20on%20head%20and%20eye%20movements%20during%20listening%20tasks%20in%20multi-talker%20audiovisual%20environments%20with%20animated%20characters&rft.au=Hendrikse,%20Maartje%20M.%20E&rft.date=2018-11-16&rft_id=info:doi/10.48550/arxiv.1812.02088&rft_dat=%3Carxiv_GOX%3E1812_02088%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true