Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks
The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared record...
Gespeichert in:
Veröffentlicht in: | Behavior research methods 2024-03, Vol.56 (3), p.2213-2226 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2226 |
---|---|
container_issue | 3 |
container_start_page | 2213 |
container_title | Behavior research methods |
container_volume | 56 |
creator | Bogdan, Paul C. Dolcos, Sanda Buetti, Simona Lleras, Alejandro Dolcos, Florin |
description | The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures. |
doi_str_mv | 10.3758/s13428-023-02143-z |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2828362627</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2828362627</sourcerecordid><originalsourceid>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</originalsourceid><addsrcrecordid>eNp9kU1uFDEQhS0EIiFwARbIEhs2DbbLPd3DDkUBIkViA2vLbZdnnHTbje0Omqy4A7fgWJwETyb8iAULy1XyV6-s9wh5ytlL6Nr-VeYgRd8wAfVwCc3NPXLM21Y20Ir-_l_1EXmU8yVj0FfuITmCDiQTkh2T7-fhGnPxG1182NCyRZoXX_TgR192NDoaw-gDUtwhLUmbqz3mYqJz3pltHOPGGz3ShBl1MtvX9OzaWwwGqUtxoiZOs04-x5DpF1-21IdmxlR7anXRdMl7PZxi8TH8-PpNl4JhX1ewYN13Wxedr_Jj8sDpMeOTu_uEfHp79vH0fXPx4d356ZuLxlRXSrO2g6m-cLBgJEO0HUfHhHVrBOM4R1wNzkC7BsadlU4MTPartWCt1tyihRPy4qA7p_h5qeaoyWeD46gDxiUr0YseVmIluoo-_we9jEsK9XcKGPAOoOtkpcSBMinmnNCpOflJp53iTO2TVIckVU1S3SapburQszvpZZjQ_h75FV0F4ADk-hQ2mP7s_o_sT-6SsEE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3031733774</pqid></control><display><type>article</type><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><source>MEDLINE</source><source>SpringerNature Journals</source><creator>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</creator><creatorcontrib>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</creatorcontrib><description>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</description><identifier>ISSN: 1554-3528</identifier><identifier>EISSN: 1554-3528</identifier><identifier>DOI: 10.3758/s13428-023-02143-z</identifier><identifier>PMID: 37340240</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Attention ; Behavioral Science and Psychology ; Cognitive Psychology ; Emotions ; Eye movements ; Eye-Tracking Technology ; Humans ; Internet ; Psychological research ; Psychology ; Webcams</subject><ispartof>Behavior research methods, 2024-03, Vol.56 (3), p.2213-2226</ispartof><rights>The Psychonomic Society, Inc. 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><rights>2023. The Psychonomic Society, Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</citedby><cites>FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</cites><orcidid>0000-0002-4362-6084</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.3758/s13428-023-02143-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.3758/s13428-023-02143-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37340240$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Bogdan, Paul C.</creatorcontrib><creatorcontrib>Dolcos, Sanda</creatorcontrib><creatorcontrib>Buetti, Simona</creatorcontrib><creatorcontrib>Lleras, Alejandro</creatorcontrib><creatorcontrib>Dolcos, Florin</creatorcontrib><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><title>Behavior research methods</title><addtitle>Behav Res</addtitle><addtitle>Behav Res Methods</addtitle><description>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</description><subject>Attention</subject><subject>Behavioral Science and Psychology</subject><subject>Cognitive Psychology</subject><subject>Emotions</subject><subject>Eye movements</subject><subject>Eye-Tracking Technology</subject><subject>Humans</subject><subject>Internet</subject><subject>Psychological research</subject><subject>Psychology</subject><subject>Webcams</subject><issn>1554-3528</issn><issn>1554-3528</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kU1uFDEQhS0EIiFwARbIEhs2DbbLPd3DDkUBIkViA2vLbZdnnHTbje0Omqy4A7fgWJwETyb8iAULy1XyV6-s9wh5ytlL6Nr-VeYgRd8wAfVwCc3NPXLM21Y20Ir-_l_1EXmU8yVj0FfuITmCDiQTkh2T7-fhGnPxG1182NCyRZoXX_TgR192NDoaw-gDUtwhLUmbqz3mYqJz3pltHOPGGz3ShBl1MtvX9OzaWwwGqUtxoiZOs04-x5DpF1-21IdmxlR7anXRdMl7PZxi8TH8-PpNl4JhX1ewYN13Wxedr_Jj8sDpMeOTu_uEfHp79vH0fXPx4d356ZuLxlRXSrO2g6m-cLBgJEO0HUfHhHVrBOM4R1wNzkC7BsadlU4MTPartWCt1tyihRPy4qA7p_h5qeaoyWeD46gDxiUr0YseVmIluoo-_we9jEsK9XcKGPAOoOtkpcSBMinmnNCpOflJp53iTO2TVIckVU1S3SapburQszvpZZjQ_h75FV0F4ADk-hQ2mP7s_o_sT-6SsEE</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Bogdan, Paul C.</creator><creator>Dolcos, Sanda</creator><creator>Buetti, Simona</creator><creator>Lleras, Alejandro</creator><creator>Dolcos, Florin</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>4T-</scope><scope>7TK</scope><scope>K9.</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-4362-6084</orcidid></search><sort><creationdate>20240301</creationdate><title>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</title><author>Bogdan, Paul C. ; Dolcos, Sanda ; Buetti, Simona ; Lleras, Alejandro ; Dolcos, Florin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c375t-9dbc34213d3c40eed71ef02df9e3cf11ee6bfc359301fd4f2b04869205aa1ded3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Attention</topic><topic>Behavioral Science and Psychology</topic><topic>Cognitive Psychology</topic><topic>Emotions</topic><topic>Eye movements</topic><topic>Eye-Tracking Technology</topic><topic>Humans</topic><topic>Internet</topic><topic>Psychological research</topic><topic>Psychology</topic><topic>Webcams</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bogdan, Paul C.</creatorcontrib><creatorcontrib>Dolcos, Sanda</creatorcontrib><creatorcontrib>Buetti, Simona</creatorcontrib><creatorcontrib>Lleras, Alejandro</creatorcontrib><creatorcontrib>Dolcos, Florin</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Docstoc</collection><collection>Neurosciences Abstracts</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>MEDLINE - Academic</collection><jtitle>Behavior research methods</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bogdan, Paul C.</au><au>Dolcos, Sanda</au><au>Buetti, Simona</au><au>Lleras, Alejandro</au><au>Dolcos, Florin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks</atitle><jtitle>Behavior research methods</jtitle><stitle>Behav Res</stitle><addtitle>Behav Res Methods</addtitle><date>2024-03-01</date><risdate>2024</risdate><volume>56</volume><issue>3</issue><spage>2213</spage><epage>2226</epage><pages>2213-2226</pages><issn>1554-3528</issn><eissn>1554-3528</eissn><abstract>The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.</abstract><cop>New York</cop><pub>Springer US</pub><pmid>37340240</pmid><doi>10.3758/s13428-023-02143-z</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0002-4362-6084</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1554-3528 |
ispartof | Behavior research methods, 2024-03, Vol.56 (3), p.2213-2226 |
issn | 1554-3528 1554-3528 |
language | eng |
recordid | cdi_proquest_miscellaneous_2828362627 |
source | MEDLINE; SpringerNature Journals |
subjects | Attention Behavioral Science and Psychology Cognitive Psychology Emotions Eye movements Eye-Tracking Technology Humans Internet Psychological research Psychology Webcams |
title | Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion–attention interaction tasks |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T10%3A22%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Investigating%20the%20suitability%20of%20online%20eye%20tracking%20for%20psychological%20research:%20Evidence%20from%20comparisons%20with%20in-person%20data%20using%20emotion%E2%80%93attention%20interaction%20tasks&rft.jtitle=Behavior%20research%20methods&rft.au=Bogdan,%20Paul%20C.&rft.date=2024-03-01&rft.volume=56&rft.issue=3&rft.spage=2213&rft.epage=2226&rft.pages=2213-2226&rft.issn=1554-3528&rft.eissn=1554-3528&rft_id=info:doi/10.3758/s13428-023-02143-z&rft_dat=%3Cproquest_cross%3E2828362627%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3031733774&rft_id=info:pmid/37340240&rfr_iscdi=true |