Toward an Objective Measure of Developers’ Cognitive Activities

Understanding how developers carry out different computer science activities with objective measures can help to improve productivity and guide the use and development of supporting tools in software engineering. In this article, we present two controlled experiments involving 112 students to explor...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:ACM transactions on software engineering and methodology 2021-05, Vol.30 (3), p.1-40, Article 30
Hauptverfasser: Sharafi, Zohreh, Huang, Yu, Leach, Kevin, Weimer, Westley
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 40
container_issue 3
container_start_page 1
container_title ACM transactions on software engineering and methodology
container_volume 30
creator Sharafi, Zohreh
Huang, Yu
Leach, Kevin
Weimer, Westley
description Understanding how developers carry out different computer science activities with objective measures can help to improve productivity and guide the use and development of supporting tools in software engineering. In this article, we present two controlled experiments involving 112 students to explore multiple computing activities (code comprehension, code review, and data structure manipulations) using three different objective measures including neuroimaging (functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI)) and eye tracking. By examining code review and prose review using fMRI, we find that the neural representations of programming languages vs. natural languages are distinct. We can classify which task a participant is undertaking based solely on brain activity, and those task distinctions are modulated by expertise. We leverage insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations using fMRI, fNIRS, and eye tracking. We examine list, array, tree, and mental rotation tasks and find that data structure and spatial operations use the same focal regions of the brain but to different degrees: they are related but distinct neural tasks. We demonstrate best practices and describe the implication and tradeoffs between fMRI, fNIRS, eye tracking, and self-reporting for software engineering research.
doi_str_mv 10.1145/3434643
format Article
fullrecord <record><control><sourceid>acm_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1145_3434643</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3434643</sourcerecordid><originalsourceid>FETCH-LOGICAL-a244t-630b3b182c3dbe210d504525c822eee11f261cdde08dc27af7b9173d3d43c0d33</originalsourceid><addsrcrecordid>eNo9z81KAzEUBeAgCtYq7l1l52r03txkfpZl_IVKNxXcDZnkjkxpOyWpFXe-hq_nkzi11dU9cD8OHCHOEa4QtbkmTTrVdCAGaEyWZFSowz6DLhIifDkWJzHOAJBA6YEYTbt3G7y0SzmpZ-zW7YblE9v4Flh2jbzhDc-7FYf4_fkly-512f6S0Vb2keOpOGrsPPLZ_g7F893ttHxIxpP7x3I0TqzSep2kBDXVmCtHvmaF4A1oo4zLlWJmxEal6LxnyL1TmW2yusCMPHlNDjzRUFzuel3oYgzcVKvQLmz4qBCq7fJqv7yXFztp3eIf_T1_AOkwU5A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Toward an Objective Measure of Developers’ Cognitive Activities</title><source>ACM Digital Library</source><creator>Sharafi, Zohreh ; Huang, Yu ; Leach, Kevin ; Weimer, Westley</creator><creatorcontrib>Sharafi, Zohreh ; Huang, Yu ; Leach, Kevin ; Weimer, Westley</creatorcontrib><description>Understanding how developers carry out different computer science activities with objective measures can help to improve productivity and guide the use and development of supporting tools in software engineering. In this article, we present two controlled experiments involving 112 students to explore multiple computing activities (code comprehension, code review, and data structure manipulations) using three different objective measures including neuroimaging (functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI)) and eye tracking. By examining code review and prose review using fMRI, we find that the neural representations of programming languages vs. natural languages are distinct. We can classify which task a participant is undertaking based solely on brain activity, and those task distinctions are modulated by expertise. We leverage insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations using fMRI, fNIRS, and eye tracking. We examine list, array, tree, and mental rotation tasks and find that data structure and spatial operations use the same focal regions of the brain but to different degrees: they are related but distinct neural tasks. We demonstrate best practices and describe the implication and tradeoffs between fMRI, fNIRS, eye tracking, and self-reporting for software engineering research.</description><identifier>ISSN: 1049-331X</identifier><identifier>EISSN: 1557-7392</identifier><identifier>DOI: 10.1145/3434643</identifier><language>eng</language><publisher>New York, NY, USA: ACM</publisher><subject>Maintaining software ; Software and its engineering ; Software creation and management ; Software post-development issues</subject><ispartof>ACM transactions on software engineering and methodology, 2021-05, Vol.30 (3), p.1-40, Article 30</ispartof><rights>ACM</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a244t-630b3b182c3dbe210d504525c822eee11f261cdde08dc27af7b9173d3d43c0d33</citedby><cites>FETCH-LOGICAL-a244t-630b3b182c3dbe210d504525c822eee11f261cdde08dc27af7b9173d3d43c0d33</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://dl.acm.org/doi/pdf/10.1145/3434643$$EPDF$$P50$$Gacm$$H</linktopdf><link.rule.ids>314,780,784,2282,27924,27925,40196,76228</link.rule.ids></links><search><creatorcontrib>Sharafi, Zohreh</creatorcontrib><creatorcontrib>Huang, Yu</creatorcontrib><creatorcontrib>Leach, Kevin</creatorcontrib><creatorcontrib>Weimer, Westley</creatorcontrib><title>Toward an Objective Measure of Developers’ Cognitive Activities</title><title>ACM transactions on software engineering and methodology</title><addtitle>ACM TOSEM</addtitle><description>Understanding how developers carry out different computer science activities with objective measures can help to improve productivity and guide the use and development of supporting tools in software engineering. In this article, we present two controlled experiments involving 112 students to explore multiple computing activities (code comprehension, code review, and data structure manipulations) using three different objective measures including neuroimaging (functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI)) and eye tracking. By examining code review and prose review using fMRI, we find that the neural representations of programming languages vs. natural languages are distinct. We can classify which task a participant is undertaking based solely on brain activity, and those task distinctions are modulated by expertise. We leverage insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations using fMRI, fNIRS, and eye tracking. We examine list, array, tree, and mental rotation tasks and find that data structure and spatial operations use the same focal regions of the brain but to different degrees: they are related but distinct neural tasks. We demonstrate best practices and describe the implication and tradeoffs between fMRI, fNIRS, eye tracking, and self-reporting for software engineering research.</description><subject>Maintaining software</subject><subject>Software and its engineering</subject><subject>Software creation and management</subject><subject>Software post-development issues</subject><issn>1049-331X</issn><issn>1557-7392</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNo9z81KAzEUBeAgCtYq7l1l52r03txkfpZl_IVKNxXcDZnkjkxpOyWpFXe-hq_nkzi11dU9cD8OHCHOEa4QtbkmTTrVdCAGaEyWZFSowz6DLhIifDkWJzHOAJBA6YEYTbt3G7y0SzmpZ-zW7YblE9v4Flh2jbzhDc-7FYf4_fkly-512f6S0Vb2keOpOGrsPPLZ_g7F893ttHxIxpP7x3I0TqzSep2kBDXVmCtHvmaF4A1oo4zLlWJmxEal6LxnyL1TmW2yusCMPHlNDjzRUFzuel3oYgzcVKvQLmz4qBCq7fJqv7yXFztp3eIf_T1_AOkwU5A</recordid><startdate>20210501</startdate><enddate>20210501</enddate><creator>Sharafi, Zohreh</creator><creator>Huang, Yu</creator><creator>Leach, Kevin</creator><creator>Weimer, Westley</creator><general>ACM</general><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20210501</creationdate><title>Toward an Objective Measure of Developers’ Cognitive Activities</title><author>Sharafi, Zohreh ; Huang, Yu ; Leach, Kevin ; Weimer, Westley</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a244t-630b3b182c3dbe210d504525c822eee11f261cdde08dc27af7b9173d3d43c0d33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Maintaining software</topic><topic>Software and its engineering</topic><topic>Software creation and management</topic><topic>Software post-development issues</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sharafi, Zohreh</creatorcontrib><creatorcontrib>Huang, Yu</creatorcontrib><creatorcontrib>Leach, Kevin</creatorcontrib><creatorcontrib>Weimer, Westley</creatorcontrib><collection>CrossRef</collection><jtitle>ACM transactions on software engineering and methodology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sharafi, Zohreh</au><au>Huang, Yu</au><au>Leach, Kevin</au><au>Weimer, Westley</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Toward an Objective Measure of Developers’ Cognitive Activities</atitle><jtitle>ACM transactions on software engineering and methodology</jtitle><stitle>ACM TOSEM</stitle><date>2021-05-01</date><risdate>2021</risdate><volume>30</volume><issue>3</issue><spage>1</spage><epage>40</epage><pages>1-40</pages><artnum>30</artnum><issn>1049-331X</issn><eissn>1557-7392</eissn><abstract>Understanding how developers carry out different computer science activities with objective measures can help to improve productivity and guide the use and development of supporting tools in software engineering. In this article, we present two controlled experiments involving 112 students to explore multiple computing activities (code comprehension, code review, and data structure manipulations) using three different objective measures including neuroimaging (functional near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI)) and eye tracking. By examining code review and prose review using fMRI, we find that the neural representations of programming languages vs. natural languages are distinct. We can classify which task a participant is undertaking based solely on brain activity, and those task distinctions are modulated by expertise. We leverage insights from the psychological notion of spatial ability to decode the neural representations of several fundamental data structures and their manipulations using fMRI, fNIRS, and eye tracking. We examine list, array, tree, and mental rotation tasks and find that data structure and spatial operations use the same focal regions of the brain but to different degrees: they are related but distinct neural tasks. We demonstrate best practices and describe the implication and tradeoffs between fMRI, fNIRS, eye tracking, and self-reporting for software engineering research.</abstract><cop>New York, NY, USA</cop><pub>ACM</pub><doi>10.1145/3434643</doi><tpages>40</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1049-331X
ispartof ACM transactions on software engineering and methodology, 2021-05, Vol.30 (3), p.1-40, Article 30
issn 1049-331X
1557-7392
language eng
recordid cdi_crossref_primary_10_1145_3434643
source ACM Digital Library
subjects Maintaining software
Software and its engineering
Software creation and management
Software post-development issues
title Toward an Objective Measure of Developers’ Cognitive Activities
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-23T12%3A35%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-acm_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Toward%20an%20Objective%20Measure%20of%20Developers%E2%80%99%20Cognitive%20Activities&rft.jtitle=ACM%20transactions%20on%20software%20engineering%20and%20methodology&rft.au=Sharafi,%20Zohreh&rft.date=2021-05-01&rft.volume=30&rft.issue=3&rft.spage=1&rft.epage=40&rft.pages=1-40&rft.artnum=30&rft.issn=1049-331X&rft.eissn=1557-7392&rft_id=info:doi/10.1145/3434643&rft_dat=%3Cacm_cross%3E3434643%3C/acm_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true