Measuring Cognitive Load in Virtual Reality Training via Pupillometry

Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on learning technologies 2024-01, Vol.17, p.1-7
Hauptverfasser: Lee, Joy Yeonjoo, de Jong, Nynke, Donkers, Jeroen, Jarodzka, Halszka, van Merrienboer, Jeroen J.G.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 7
container_issue
container_start_page 1
container_title IEEE transactions on learning technologies
container_volume 17
creator Lee, Joy Yeonjoo
de Jong, Nynke
Donkers, Jeroen
Jarodzka, Halszka
van Merrienboer, Jeroen J.G.
description Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display causes light reflexes that confound task-evoked pupillary responses (TEPRs), impairing cognitive load measures. Through this pilot study, we validated whether task difficulty can predict cognitive load as measured by TEPRs corrected for the light reflex and if these TEPRs correlate with cognitive load self-ratings and performance. 14 students in health sciences performed observation tasks in two conditions: difficult versus easy tasks, whilst watching a VR scenario in home health care. Then, a cognitive load self-rating ensued. We used a VR system with a built-in eye-tracker and a photosensor installed to assess pupil diameter and light intensity during the scenario. Employing a method from the human-computer interaction field, we determined TEPRs by modeling the pupil light reflexes using a baseline. As predicted, the difficult task caused significantly larger TEPRs than the easy task. Only in the difficult task condition did TEPRs positively correlate with the performance measure. These results suggest that TEPRs are valid measures of cognitive load in VR training when corrected for the light reflex. It opens up possibilities to use real-time cognitive load for assessment and instructional design for VR training. Future studies should test our findings with a larger sample size, in various domains, involving complex VR functions such as haptic interaction.
doi_str_mv 10.1109/TLT.2023.3326473
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_10292541</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10292541</ieee_id><sourcerecordid>2912942989</sourcerecordid><originalsourceid>FETCH-LOGICAL-c287t-4bc64925baea70db6d19491b3d3f24aaa22a7c196d8c77755747313cb67c41a43</originalsourceid><addsrcrecordid>eNpNkD1PwzAQhi0EEqWwMzBYYk6wz24cj6gqH1IQCAVW6-K4las0KXZSqf-eVO3Q6W543vt4CLnnLOWc6aeyKFNgIFIhIJNKXJAJ10InXORwedZfk5sY14xloDRMyOLDYRyCb1d03q1a3_udo0WHNfUt_fWhH7Ch3w4b3-9pGdC3B3TnkX4NW9803cb1YX9LrpbYRHd3qlPy87Io529J8fn6Pn8uEgu56hNZ2UxqmFXoULG6ymqupeaVqMUSJCICoLJcZ3VulVKzmRof4cJWmbKSoxRT8nicuw3d3-Bib9bdENpxpQHNQUvQuR4pdqRs6GIMbmm2wW8w7A1n5iDLjLLMQZY5yRojD8eId86d4TBeK7n4B6FQZQ8</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2912942989</pqid></control><display><type>article</type><title>Measuring Cognitive Load in Virtual Reality Training via Pupillometry</title><source>IEEE Electronic Library (IEL)</source><creator>Lee, Joy Yeonjoo ; de Jong, Nynke ; Donkers, Jeroen ; Jarodzka, Halszka ; van Merrienboer, Jeroen J.G.</creator><creatorcontrib>Lee, Joy Yeonjoo ; de Jong, Nynke ; Donkers, Jeroen ; Jarodzka, Halszka ; van Merrienboer, Jeroen J.G.</creatorcontrib><description>Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display causes light reflexes that confound task-evoked pupillary responses (TEPRs), impairing cognitive load measures. Through this pilot study, we validated whether task difficulty can predict cognitive load as measured by TEPRs corrected for the light reflex and if these TEPRs correlate with cognitive load self-ratings and performance. 14 students in health sciences performed observation tasks in two conditions: difficult versus easy tasks, whilst watching a VR scenario in home health care. Then, a cognitive load self-rating ensued. We used a VR system with a built-in eye-tracker and a photosensor installed to assess pupil diameter and light intensity during the scenario. Employing a method from the human-computer interaction field, we determined TEPRs by modeling the pupil light reflexes using a baseline. As predicted, the difficult task caused significantly larger TEPRs than the easy task. Only in the difficult task condition did TEPRs positively correlate with the performance measure. These results suggest that TEPRs are valid measures of cognitive load in VR training when corrected for the light reflex. It opens up possibilities to use real-time cognitive load for assessment and instructional design for VR training. Future studies should test our findings with a larger sample size, in various domains, involving complex VR functions such as haptic interaction.</description><identifier>ISSN: 1939-1382</identifier><identifier>EISSN: 1939-1382</identifier><identifier>EISSN: 2372-0050</identifier><identifier>DOI: 10.1109/TLT.2023.3326473</identifier><identifier>CODEN: ITLTAT</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Cognitive Ability ; Cognitive load ; Computer Assisted Instruction ; Computer Simulation ; Diameters ; educational simulations ; Headphones ; Instructional design ; Luminous intensity ; Medical services ; medical training ; mobile and personal devices ; New technology ; personalized e-learning ; Pupillometry ; Pupils ; Reflexes ; Resists ; Task analysis ; Training ; virtual and augmented reality ; Virtual reality</subject><ispartof>IEEE transactions on learning technologies, 2024-01, Vol.17, p.1-7</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c287t-4bc64925baea70db6d19491b3d3f24aaa22a7c196d8c77755747313cb67c41a43</cites><orcidid>0000-0002-6769-0355 ; 0000-0001-7498-0767 ; 0000-0002-5868-7031 ; 0000-0003-2312-4703 ; 0000-0001-7152-386X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10292541$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids></links><search><creatorcontrib>Lee, Joy Yeonjoo</creatorcontrib><creatorcontrib>de Jong, Nynke</creatorcontrib><creatorcontrib>Donkers, Jeroen</creatorcontrib><creatorcontrib>Jarodzka, Halszka</creatorcontrib><creatorcontrib>van Merrienboer, Jeroen J.G.</creatorcontrib><title>Measuring Cognitive Load in Virtual Reality Training via Pupillometry</title><title>IEEE transactions on learning technologies</title><addtitle>TLT</addtitle><description>Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display causes light reflexes that confound task-evoked pupillary responses (TEPRs), impairing cognitive load measures. Through this pilot study, we validated whether task difficulty can predict cognitive load as measured by TEPRs corrected for the light reflex and if these TEPRs correlate with cognitive load self-ratings and performance. 14 students in health sciences performed observation tasks in two conditions: difficult versus easy tasks, whilst watching a VR scenario in home health care. Then, a cognitive load self-rating ensued. We used a VR system with a built-in eye-tracker and a photosensor installed to assess pupil diameter and light intensity during the scenario. Employing a method from the human-computer interaction field, we determined TEPRs by modeling the pupil light reflexes using a baseline. As predicted, the difficult task caused significantly larger TEPRs than the easy task. Only in the difficult task condition did TEPRs positively correlate with the performance measure. These results suggest that TEPRs are valid measures of cognitive load in VR training when corrected for the light reflex. It opens up possibilities to use real-time cognitive load for assessment and instructional design for VR training. Future studies should test our findings with a larger sample size, in various domains, involving complex VR functions such as haptic interaction.</description><subject>Cognitive Ability</subject><subject>Cognitive load</subject><subject>Computer Assisted Instruction</subject><subject>Computer Simulation</subject><subject>Diameters</subject><subject>educational simulations</subject><subject>Headphones</subject><subject>Instructional design</subject><subject>Luminous intensity</subject><subject>Medical services</subject><subject>medical training</subject><subject>mobile and personal devices</subject><subject>New technology</subject><subject>personalized e-learning</subject><subject>Pupillometry</subject><subject>Pupils</subject><subject>Reflexes</subject><subject>Resists</subject><subject>Task analysis</subject><subject>Training</subject><subject>virtual and augmented reality</subject><subject>Virtual reality</subject><issn>1939-1382</issn><issn>1939-1382</issn><issn>2372-0050</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><recordid>eNpNkD1PwzAQhi0EEqWwMzBYYk6wz24cj6gqH1IQCAVW6-K4las0KXZSqf-eVO3Q6W543vt4CLnnLOWc6aeyKFNgIFIhIJNKXJAJ10InXORwedZfk5sY14xloDRMyOLDYRyCb1d03q1a3_udo0WHNfUt_fWhH7Ch3w4b3-9pGdC3B3TnkX4NW9803cb1YX9LrpbYRHd3qlPy87Io529J8fn6Pn8uEgu56hNZ2UxqmFXoULG6ymqupeaVqMUSJCICoLJcZ3VulVKzmRof4cJWmbKSoxRT8nicuw3d3-Bib9bdENpxpQHNQUvQuR4pdqRs6GIMbmm2wW8w7A1n5iDLjLLMQZY5yRojD8eId86d4TBeK7n4B6FQZQ8</recordid><startdate>20240101</startdate><enddate>20240101</enddate><creator>Lee, Joy Yeonjoo</creator><creator>de Jong, Nynke</creator><creator>Donkers, Jeroen</creator><creator>Jarodzka, Halszka</creator><creator>van Merrienboer, Jeroen J.G.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-6769-0355</orcidid><orcidid>https://orcid.org/0000-0001-7498-0767</orcidid><orcidid>https://orcid.org/0000-0002-5868-7031</orcidid><orcidid>https://orcid.org/0000-0003-2312-4703</orcidid><orcidid>https://orcid.org/0000-0001-7152-386X</orcidid></search><sort><creationdate>20240101</creationdate><title>Measuring Cognitive Load in Virtual Reality Training via Pupillometry</title><author>Lee, Joy Yeonjoo ; de Jong, Nynke ; Donkers, Jeroen ; Jarodzka, Halszka ; van Merrienboer, Jeroen J.G.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c287t-4bc64925baea70db6d19491b3d3f24aaa22a7c196d8c77755747313cb67c41a43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Cognitive Ability</topic><topic>Cognitive load</topic><topic>Computer Assisted Instruction</topic><topic>Computer Simulation</topic><topic>Diameters</topic><topic>educational simulations</topic><topic>Headphones</topic><topic>Instructional design</topic><topic>Luminous intensity</topic><topic>Medical services</topic><topic>medical training</topic><topic>mobile and personal devices</topic><topic>New technology</topic><topic>personalized e-learning</topic><topic>Pupillometry</topic><topic>Pupils</topic><topic>Reflexes</topic><topic>Resists</topic><topic>Task analysis</topic><topic>Training</topic><topic>virtual and augmented reality</topic><topic>Virtual reality</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Joy Yeonjoo</creatorcontrib><creatorcontrib>de Jong, Nynke</creatorcontrib><creatorcontrib>Donkers, Jeroen</creatorcontrib><creatorcontrib>Jarodzka, Halszka</creatorcontrib><creatorcontrib>van Merrienboer, Jeroen J.G.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE transactions on learning technologies</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Joy Yeonjoo</au><au>de Jong, Nynke</au><au>Donkers, Jeroen</au><au>Jarodzka, Halszka</au><au>van Merrienboer, Jeroen J.G.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Measuring Cognitive Load in Virtual Reality Training via Pupillometry</atitle><jtitle>IEEE transactions on learning technologies</jtitle><stitle>TLT</stitle><date>2024-01-01</date><risdate>2024</risdate><volume>17</volume><spage>1</spage><epage>7</epage><pages>1-7</pages><issn>1939-1382</issn><eissn>1939-1382</eissn><eissn>2372-0050</eissn><coden>ITLTAT</coden><abstract>Pupillometry is known as a reliable technique to measure cognitive load in learning and performance. However, its applicability to virtual reality (VR) environments, an emerging technology for simulation-based training, has not been well-verified in educational contexts. Specifically, the VR display causes light reflexes that confound task-evoked pupillary responses (TEPRs), impairing cognitive load measures. Through this pilot study, we validated whether task difficulty can predict cognitive load as measured by TEPRs corrected for the light reflex and if these TEPRs correlate with cognitive load self-ratings and performance. 14 students in health sciences performed observation tasks in two conditions: difficult versus easy tasks, whilst watching a VR scenario in home health care. Then, a cognitive load self-rating ensued. We used a VR system with a built-in eye-tracker and a photosensor installed to assess pupil diameter and light intensity during the scenario. Employing a method from the human-computer interaction field, we determined TEPRs by modeling the pupil light reflexes using a baseline. As predicted, the difficult task caused significantly larger TEPRs than the easy task. Only in the difficult task condition did TEPRs positively correlate with the performance measure. These results suggest that TEPRs are valid measures of cognitive load in VR training when corrected for the light reflex. It opens up possibilities to use real-time cognitive load for assessment and instructional design for VR training. Future studies should test our findings with a larger sample size, in various domains, involving complex VR functions such as haptic interaction.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TLT.2023.3326473</doi><tpages>7</tpages><orcidid>https://orcid.org/0000-0002-6769-0355</orcidid><orcidid>https://orcid.org/0000-0001-7498-0767</orcidid><orcidid>https://orcid.org/0000-0002-5868-7031</orcidid><orcidid>https://orcid.org/0000-0003-2312-4703</orcidid><orcidid>https://orcid.org/0000-0001-7152-386X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1939-1382
ispartof IEEE transactions on learning technologies, 2024-01, Vol.17, p.1-7
issn 1939-1382
1939-1382
2372-0050
language eng
recordid cdi_ieee_primary_10292541
source IEEE Electronic Library (IEL)
subjects Cognitive Ability
Cognitive load
Computer Assisted Instruction
Computer Simulation
Diameters
educational simulations
Headphones
Instructional design
Luminous intensity
Medical services
medical training
mobile and personal devices
New technology
personalized e-learning
Pupillometry
Pupils
Reflexes
Resists
Task analysis
Training
virtual and augmented reality
Virtual reality
title Measuring Cognitive Load in Virtual Reality Training via Pupillometry
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-18T13%3A34%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Measuring%20Cognitive%20Load%20in%20Virtual%20Reality%20Training%20via%20Pupillometry&rft.jtitle=IEEE%20transactions%20on%20learning%20technologies&rft.au=Lee,%20Joy%20Yeonjoo&rft.date=2024-01-01&rft.volume=17&rft.spage=1&rft.epage=7&rft.pages=1-7&rft.issn=1939-1382&rft.eissn=1939-1382&rft.coden=ITLTAT&rft_id=info:doi/10.1109/TLT.2023.3326473&rft_dat=%3Cproquest_ieee_%3E2912942989%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2912942989&rft_id=info:pmid/&rft_ieee_id=10292541&rfr_iscdi=true