Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers
In social communication, the gaze direction of other persons provides important information to perceive and interpret their emotional response. Previous research investigated the influence of gaze by manipulating mutual eye contact. Therefore, gaze and body direction have been changed as a whole, re...
Gespeichert in:
| Veröffentlicht in: | International journal of psychophysiology 2015-08, Vol.97 (2), p.85-92 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 92 |
|---|---|
| container_issue | 2 |
| container_start_page | 85 |
| container_title | International journal of psychophysiology |
| container_volume | 97 |
| creator | Marschner, Linda Pannasch, Sebastian Schulz, Johannes Graupner, Sven-Thomas |
| description | In social communication, the gaze direction of other persons provides important information to perceive and interpret their emotional response. Previous research investigated the influence of gaze by manipulating mutual eye contact. Therefore, gaze and body direction have been changed as a whole, resulting in only congruent gaze and body directions (averted or directed) of another person. Here, we aimed to disentangle these effects by using short animated sequences of virtual agents posing with either direct or averted body or gaze. Attention allocation by means of eye movements, facial muscle response, and emotional experience to agents of different gender and facial expressions were investigated. Eye movement data revealed longer fixation durations, i.e., a stronger allocation of attention, when gaze and body direction were not congruent with each other or when both were directed towards the observer. This suggests that direct interaction as well as incongruous signals increase the demands of attentional resources in the observer. For the facial muscle response, only the reaction of muscle zygomaticus major revealed an effect of body direction, expressed by stronger activity in response to happy expressions for direct compared to averted gaze when the virtual character's body was directed towards the observer. Finally, body direction also influenced the emotional experience ratings towards happy expressions. While earlier findings suggested that mutual eye contact is the main source for increased emotional responding and attentional allocation, the present results indicate that direction of the virtual agent's body and head also plays a minor but significant role.
•Gaze and body direction of virtual agents displaying emotional expressions•Stronger allocation of attention when gaze and body were incongruent•Stronger zygomaticus major reaction to happy expressions for direct gaze and body•Body direction influenced emotional experience ratings towards happy expressions. |
| doi_str_mv | 10.1016/j.ijpsycho.2015.05.007 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1692752588</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0167876015001890</els_id><sourcerecordid>1692752588</sourcerecordid><originalsourceid>FETCH-LOGICAL-c368t-f65962920286890af0fba03bc9014635643f32e91c23478868da78299f7059073</originalsourceid><addsrcrecordid>eNqFkcuOEzEQRS0EYsLAL4y8ZNOh7E77wQo04iWNxIJhbbnd5cRRuh1sd1D4A_4aN5lhi3Ql26pz68pVhNwwWDNg4s1-HfbHfHa7uObAujVUgXxCVkxJ3kih5VOyqqBslBRwRV7kvIdKMK2fkysuADbA2Yr8_hZdsAfq4jjOU3C2hDjRn6Hs6CmkMteS3eJU8lt6v0OK3qMrmUZP-zicqZ0GurW_kA4h1cLirbKlVMvyWOo4xuVeOyXMxzgNYdrSMNHdPNqK9xnTCVN-SZ55e8j46uG8Jt8_fri__dzcff305fb9XeNaoUrjRacF1xy4EkqD9eB7C23vNLCNaDuxaX3LUTPH241UFRqsVFxrL6HTINtr8vrS95jijxlzMWPIDg8HO2Gcs2FCc9nxTqmKigvqUsw5oTfHFEabzoaBWdZg9uZxDWZZg4Gqvxk3DxlzP-Lwz_Y49wq8uwBYf3oKmEx2ASeHlzmaIYb_ZfwBXpmd-w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1692752588</pqid></control><display><type>article</type><title>Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals Complete</source><creator>Marschner, Linda ; Pannasch, Sebastian ; Schulz, Johannes ; Graupner, Sven-Thomas</creator><creatorcontrib>Marschner, Linda ; Pannasch, Sebastian ; Schulz, Johannes ; Graupner, Sven-Thomas</creatorcontrib><description>In social communication, the gaze direction of other persons provides important information to perceive and interpret their emotional response. Previous research investigated the influence of gaze by manipulating mutual eye contact. Therefore, gaze and body direction have been changed as a whole, resulting in only congruent gaze and body directions (averted or directed) of another person. Here, we aimed to disentangle these effects by using short animated sequences of virtual agents posing with either direct or averted body or gaze. Attention allocation by means of eye movements, facial muscle response, and emotional experience to agents of different gender and facial expressions were investigated. Eye movement data revealed longer fixation durations, i.e., a stronger allocation of attention, when gaze and body direction were not congruent with each other or when both were directed towards the observer. This suggests that direct interaction as well as incongruous signals increase the demands of attentional resources in the observer. For the facial muscle response, only the reaction of muscle zygomaticus major revealed an effect of body direction, expressed by stronger activity in response to happy expressions for direct compared to averted gaze when the virtual character's body was directed towards the observer. Finally, body direction also influenced the emotional experience ratings towards happy expressions. While earlier findings suggested that mutual eye contact is the main source for increased emotional responding and attentional allocation, the present results indicate that direction of the virtual agent's body and head also plays a minor but significant role.
•Gaze and body direction of virtual agents displaying emotional expressions•Stronger allocation of attention when gaze and body were incongruent•Stronger zygomaticus major reaction to happy expressions for direct gaze and body•Body direction influenced emotional experience ratings towards happy expressions.</description><identifier>ISSN: 0167-8760</identifier><identifier>EISSN: 1872-7697</identifier><identifier>DOI: 10.1016/j.ijpsycho.2015.05.007</identifier><identifier>PMID: 26004021</identifier><language>eng</language><publisher>Netherlands: Elsevier B.V</publisher><subject>Adult ; Analysis of Variance ; Attention - physiology ; Body direction ; Electromyography ; EMG ; Emotions ; Emotions - physiology ; Female ; Fixation duration ; Fixation, Ocular ; Gaze direction ; Humans ; Male ; Orientation - physiology ; Photic Stimulation ; Posture ; Rapid facial reaction ; Social Perception ; Subjective experience ; Virtual reality ; Visual attention ; Young Adult</subject><ispartof>International journal of psychophysiology, 2015-08, Vol.97 (2), p.85-92</ispartof><rights>2015 Elsevier B.V.</rights><rights>Copyright © 2015 Elsevier B.V. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c368t-f65962920286890af0fba03bc9014635643f32e91c23478868da78299f7059073</citedby><cites>FETCH-LOGICAL-c368t-f65962920286890af0fba03bc9014635643f32e91c23478868da78299f7059073</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.ijpsycho.2015.05.007$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/26004021$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Marschner, Linda</creatorcontrib><creatorcontrib>Pannasch, Sebastian</creatorcontrib><creatorcontrib>Schulz, Johannes</creatorcontrib><creatorcontrib>Graupner, Sven-Thomas</creatorcontrib><title>Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers</title><title>International journal of psychophysiology</title><addtitle>Int J Psychophysiol</addtitle><description>In social communication, the gaze direction of other persons provides important information to perceive and interpret their emotional response. Previous research investigated the influence of gaze by manipulating mutual eye contact. Therefore, gaze and body direction have been changed as a whole, resulting in only congruent gaze and body directions (averted or directed) of another person. Here, we aimed to disentangle these effects by using short animated sequences of virtual agents posing with either direct or averted body or gaze. Attention allocation by means of eye movements, facial muscle response, and emotional experience to agents of different gender and facial expressions were investigated. Eye movement data revealed longer fixation durations, i.e., a stronger allocation of attention, when gaze and body direction were not congruent with each other or when both were directed towards the observer. This suggests that direct interaction as well as incongruous signals increase the demands of attentional resources in the observer. For the facial muscle response, only the reaction of muscle zygomaticus major revealed an effect of body direction, expressed by stronger activity in response to happy expressions for direct compared to averted gaze when the virtual character's body was directed towards the observer. Finally, body direction also influenced the emotional experience ratings towards happy expressions. While earlier findings suggested that mutual eye contact is the main source for increased emotional responding and attentional allocation, the present results indicate that direction of the virtual agent's body and head also plays a minor but significant role.
•Gaze and body direction of virtual agents displaying emotional expressions•Stronger allocation of attention when gaze and body were incongruent•Stronger zygomaticus major reaction to happy expressions for direct gaze and body•Body direction influenced emotional experience ratings towards happy expressions.</description><subject>Adult</subject><subject>Analysis of Variance</subject><subject>Attention - physiology</subject><subject>Body direction</subject><subject>Electromyography</subject><subject>EMG</subject><subject>Emotions</subject><subject>Emotions - physiology</subject><subject>Female</subject><subject>Fixation duration</subject><subject>Fixation, Ocular</subject><subject>Gaze direction</subject><subject>Humans</subject><subject>Male</subject><subject>Orientation - physiology</subject><subject>Photic Stimulation</subject><subject>Posture</subject><subject>Rapid facial reaction</subject><subject>Social Perception</subject><subject>Subjective experience</subject><subject>Virtual reality</subject><subject>Visual attention</subject><subject>Young Adult</subject><issn>0167-8760</issn><issn>1872-7697</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkcuOEzEQRS0EYsLAL4y8ZNOh7E77wQo04iWNxIJhbbnd5cRRuh1sd1D4A_4aN5lhi3Ql26pz68pVhNwwWDNg4s1-HfbHfHa7uObAujVUgXxCVkxJ3kih5VOyqqBslBRwRV7kvIdKMK2fkysuADbA2Yr8_hZdsAfq4jjOU3C2hDjRn6Hs6CmkMteS3eJU8lt6v0OK3qMrmUZP-zicqZ0GurW_kA4h1cLirbKlVMvyWOo4xuVeOyXMxzgNYdrSMNHdPNqK9xnTCVN-SZ55e8j46uG8Jt8_fri__dzcff305fb9XeNaoUrjRacF1xy4EkqD9eB7C23vNLCNaDuxaX3LUTPH241UFRqsVFxrL6HTINtr8vrS95jijxlzMWPIDg8HO2Gcs2FCc9nxTqmKigvqUsw5oTfHFEabzoaBWdZg9uZxDWZZg4Gqvxk3DxlzP-Lwz_Y49wq8uwBYf3oKmEx2ASeHlzmaIYb_ZfwBXpmd-w</recordid><startdate>201508</startdate><enddate>201508</enddate><creator>Marschner, Linda</creator><creator>Pannasch, Sebastian</creator><creator>Schulz, Johannes</creator><creator>Graupner, Sven-Thomas</creator><general>Elsevier B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>201508</creationdate><title>Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers</title><author>Marschner, Linda ; Pannasch, Sebastian ; Schulz, Johannes ; Graupner, Sven-Thomas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c368t-f65962920286890af0fba03bc9014635643f32e91c23478868da78299f7059073</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Adult</topic><topic>Analysis of Variance</topic><topic>Attention - physiology</topic><topic>Body direction</topic><topic>Electromyography</topic><topic>EMG</topic><topic>Emotions</topic><topic>Emotions - physiology</topic><topic>Female</topic><topic>Fixation duration</topic><topic>Fixation, Ocular</topic><topic>Gaze direction</topic><topic>Humans</topic><topic>Male</topic><topic>Orientation - physiology</topic><topic>Photic Stimulation</topic><topic>Posture</topic><topic>Rapid facial reaction</topic><topic>Social Perception</topic><topic>Subjective experience</topic><topic>Virtual reality</topic><topic>Visual attention</topic><topic>Young Adult</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Marschner, Linda</creatorcontrib><creatorcontrib>Pannasch, Sebastian</creatorcontrib><creatorcontrib>Schulz, Johannes</creatorcontrib><creatorcontrib>Graupner, Sven-Thomas</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>International journal of psychophysiology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Marschner, Linda</au><au>Pannasch, Sebastian</au><au>Schulz, Johannes</au><au>Graupner, Sven-Thomas</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers</atitle><jtitle>International journal of psychophysiology</jtitle><addtitle>Int J Psychophysiol</addtitle><date>2015-08</date><risdate>2015</risdate><volume>97</volume><issue>2</issue><spage>85</spage><epage>92</epage><pages>85-92</pages><issn>0167-8760</issn><eissn>1872-7697</eissn><abstract>In social communication, the gaze direction of other persons provides important information to perceive and interpret their emotional response. Previous research investigated the influence of gaze by manipulating mutual eye contact. Therefore, gaze and body direction have been changed as a whole, resulting in only congruent gaze and body directions (averted or directed) of another person. Here, we aimed to disentangle these effects by using short animated sequences of virtual agents posing with either direct or averted body or gaze. Attention allocation by means of eye movements, facial muscle response, and emotional experience to agents of different gender and facial expressions were investigated. Eye movement data revealed longer fixation durations, i.e., a stronger allocation of attention, when gaze and body direction were not congruent with each other or when both were directed towards the observer. This suggests that direct interaction as well as incongruous signals increase the demands of attentional resources in the observer. For the facial muscle response, only the reaction of muscle zygomaticus major revealed an effect of body direction, expressed by stronger activity in response to happy expressions for direct compared to averted gaze when the virtual character's body was directed towards the observer. Finally, body direction also influenced the emotional experience ratings towards happy expressions. While earlier findings suggested that mutual eye contact is the main source for increased emotional responding and attentional allocation, the present results indicate that direction of the virtual agent's body and head also plays a minor but significant role.
•Gaze and body direction of virtual agents displaying emotional expressions•Stronger allocation of attention when gaze and body were incongruent•Stronger zygomaticus major reaction to happy expressions for direct gaze and body•Body direction influenced emotional experience ratings towards happy expressions.</abstract><cop>Netherlands</cop><pub>Elsevier B.V</pub><pmid>26004021</pmid><doi>10.1016/j.ijpsycho.2015.05.007</doi><tpages>8</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0167-8760 |
| ispartof | International journal of psychophysiology, 2015-08, Vol.97 (2), p.85-92 |
| issn | 0167-8760 1872-7697 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1692752588 |
| source | MEDLINE; Elsevier ScienceDirect Journals Complete |
| subjects | Adult Analysis of Variance Attention - physiology Body direction Electromyography EMG Emotions Emotions - physiology Female Fixation duration Fixation, Ocular Gaze direction Humans Male Orientation - physiology Photic Stimulation Posture Rapid facial reaction Social Perception Subjective experience Virtual reality Visual attention Young Adult |
| title | Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T06%3A15%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Social%20communication%20with%20virtual%20agents:%20The%20effects%20of%20body%20and%20gaze%20direction%20on%20attention%20and%20emotional%20responding%20in%20human%20observers&rft.jtitle=International%20journal%20of%20psychophysiology&rft.au=Marschner,%20Linda&rft.date=2015-08&rft.volume=97&rft.issue=2&rft.spage=85&rft.epage=92&rft.pages=85-92&rft.issn=0167-8760&rft.eissn=1872-7697&rft_id=info:doi/10.1016/j.ijpsycho.2015.05.007&rft_dat=%3Cproquest_cross%3E1692752588%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1692752588&rft_id=info:pmid/26004021&rft_els_id=S0167876015001890&rfr_iscdi=true |