Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks

The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared record...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Behavior research methods 2024-03, Vol.56 (3), p.2213-2226
Hauptverfasser: Bogdan, Paul C., Dolcos, Sanda, Buetti, Simona, Lleras, Alejandro, Dolcos, Florin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2226
container_issue 3
container_start_page 2213
container_title Behavior research methods
container_volume 56
creator Bogdan, Paul C.
Dolcos, Sanda
Buetti, Simona
Lleras, Alejandro
Dolcos, Florin
description The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.
doi_str_mv 10.3758/s13428-023-02143-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2828362627</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2828362627</sourcerecordid><originalsourceid>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</originalsourceid><addsrcrecordid>eNp9kU1uFDEQhS0EIiFwARbIEhs2DbbLPd3DDkUBIkViA2vLbZdnnHTbje0Omqy4A7fgWJwETyb8iAULy1XyV6-s9wh5ytlL6Nr-VeYgRd8wAfVwCc3NPXLM21Y20Ir-_l_1EXmU8yVj0FfuITmCDiQTkh2T7-fhGnPxG1182NCyRZoXX_TgR192NDoaw-gDUtwhLUmbqz3mYqJz3pltHOPGGz3ShBl1MtvX9OzaWwwGqUtxoiZOs04-x5DpF1-21IdmxlR7anXRdMl7PZxi8TH8-PpNl4JhX1ewYN13Wxedr_Jj8sDpMeOTu_uEfHp79vH0fXPx4d356ZuLxlRXSrO2g6m-cLBgJEO0HUfHhHVrBOM4R1wNzkC7BsadlU4MTPartWCt1tyihRPy4qA7p_h5qeaoyWeD46gDxiUr0YseVmIluoo-_we9jEsK9XcKGPAOoOtkpcSBMinmnNCpOflJp53iTO2TVIckVU1S3SapburQszvpZZjQ_h75FV0F4ADk-hQ2mP7s_o_sT-6SsEE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3031733774</pqid></control><display><type>article</type><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><source>MEDLINE</source><source>SpringerNature Journals</source><creator>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</creator><creatorcontrib>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</creatorcontrib><description>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</description><identifier>ISSN: 1554-3528</identifier><identifier>EISSN: 1554-3528</identifier><identifier>DOI: 10.3758/s13428-023-02143-z</identifier><identifier>PMID: 37340240</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Attention ; Behavioral Science and Psychology ; Cognitive Psychology ; Emotions ; Eye movements ; Eye-Tracking Technology ; Humans ; Internet ; Psychological research ; Psychology ; Webcams</subject><ispartof>Behavior research methods, 2024-03, Vol.56 (3), p.2213-2226</ispartof><rights>The Psychonomic Society, Inc. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><rights>2023. The Psychonomic Society, Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</citedby><cites>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</cites><orcidid>0000-0002-4362-6084</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.3758/s13428-023-02143-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.3758/s13428-023-02143-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37340240$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Bogdan, Paul C.</creatorcontrib><creatorcontrib>Dolcos, Sanda</creatorcontrib><creatorcontrib>Buetti, Simona</creatorcontrib><creatorcontrib>Lleras, Alejandro</creatorcontrib><creatorcontrib>Dolcos, Florin</creatorcontrib><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><title>Behavior research methods</title><addtitle>Behav Res</addtitle><addtitle>Behav Res Methods</addtitle><description>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</description><subject>Attention</subject><subject>Behavioral Science and Psychology</subject><subject>Cognitive Psychology</subject><subject>Emotions</subject><subject>Eye movements</subject><subject>Eye-Tracking Technology</subject><subject>Humans</subject><subject>Internet</subject><subject>Psychological research</subject><subject>Psychology</subject><subject>Webcams</subject><issn>1554-3528</issn><issn>1554-3528</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kU1uFDEQhS0EIiFwARbIEhs2DbbLPd3DDkUBIkViA2vLbZdnnHTbje0Omqy4A7fgWJwETyb8iAULy1XyV6-s9wh5ytlL6Nr-VeYgRd8wAfVwCc3NPXLM21Y20Ir-_l_1EXmU8yVj0FfuITmCDiQTkh2T7-fhGnPxG1182NCyRZoXX_TgR192NDoaw-gDUtwhLUmbqz3mYqJz3pltHOPGGz3ShBl1MtvX9OzaWwwGqUtxoiZOs04-x5DpF1-21IdmxlR7anXRdMl7PZxi8TH8-PpNl4JhX1ewYN13Wxedr_Jj8sDpMeOTu_uEfHp79vH0fXPx4d356ZuLxlRXSrO2g6m-cLBgJEO0HUfHhHVrBOM4R1wNzkC7BsadlU4MTPartWCt1tyihRPy4qA7p_h5qeaoyWeD46gDxiUr0YseVmIluoo-_we9jEsK9XcKGPAOoOtkpcSBMinmnNCpOflJp53iTO2TVIckVU1S3SapburQszvpZZjQ_h75FV0F4ADk-hQ2mP7s_o_sT-6SsEE</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Bogdan, Paul C.</creator><creator>Dolcos, Sanda</creator><creator>Buetti, Simona</creator><creator>Lleras, Alejandro</creator><creator>Dolcos, Florin</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>4T-</scope><scope>7TK</scope><scope>K9.</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-4362-6084</orcidid></search><sort><creationdate>20240301</creationdate><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><author>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Attention</topic><topic>Behavioral Science and Psychology</topic><topic>Cognitive Psychology</topic><topic>Emotions</topic><topic>Eye movements</topic><topic>Eye-Tracking Technology</topic><topic>Humans</topic><topic>Internet</topic><topic>Psychological research</topic><topic>Psychology</topic><topic>Webcams</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bogdan, Paul C.</creatorcontrib><creatorcontrib>Dolcos, Sanda</creatorcontrib><creatorcontrib>Buetti, Simona</creatorcontrib><creatorcontrib>Lleras, Alejandro</creatorcontrib><creatorcontrib>Dolcos, Florin</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Docstoc</collection><collection>Neurosciences Abstracts</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>MEDLINE - Academic</collection><jtitle>Behavior research methods</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bogdan, Paul C.</au><au>Dolcos, Sanda</au><au>Buetti, Simona</au><au>Lleras, Alejandro</au><au>Dolcos, Florin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</atitle><jtitle>Behavior research methods</jtitle><stitle>Behav Res</stitle><addtitle>Behav Res Methods</addtitle><date>2024-03-01</date><risdate>2024</risdate><volume>56</volume><issue>3</issue><spage>2213</spage><epage>2226</epage><pages>2213-2226</pages><issn>1554-3528</issn><eissn>1554-3528</eissn><abstract>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</abstract><cop>New York</cop><pub>Springer US</pub><pmid>37340240</pmid><doi>10.3758/s13428-023-02143-z</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0002-4362-6084</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1554-3528
ispartof Behavior research methods, 2024-03, Vol.56 (3), p.2213-2226
issn 1554-3528
1554-3528
language eng
recordid cdi_proquest_miscellaneous_2828362627
source MEDLINE; SpringerNature Journals
subjects Attention
Behavioral Science and Psychology
Cognitive Psychology
Emotions
Eye movements
Eye-Tracking Technology
Humans
Internet
Psychological research
Psychology
Webcams
title Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T10%3A22%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Investigating%20the%20suitability%20of%20online%20eye%20tracking%20for%20psychological%20research:%20Evidence%20from%20comparisons%20with%20in-person%20data%20using%20emotion%E2%80%93attention%20interaction%20tasks&rft.jtitle=Behavior%20research%20methods&rft.au=Bogdan,%20Paul%20C.&rft.date=2024-03-01&rft.volume=56&rft.issue=3&rft.spage=2213&rft.epage=2226&rft.pages=2213-2226&rft.issn=1554-3528&rft.eissn=1554-3528&rft_id=info:doi/10.3758/s13428-023-02143-z&rft_dat=%3Cproquest_cross%3E2828362627%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3031733774&rft_id=info:pmid/37340240&rfr_iscdi=true