Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood

Executive function (EF) assessments often involve the administration of multiple tasks. Although factor analytic methods are routinely used to summarize performance across multiple tasks, they may not be optimal for this purpose. We introduce reliable component analysis (RCA) as a strategy for summa...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Psychological assessment 2023-01, Vol.35 (1), p.32-41
Hauptverfasser: Willoughby, Michael T., Williams, Jason, Tueller, Stephen J., Lauff, Erich M., Hudson, Kesha
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 41
container_issue 1
container_start_page 32
container_title Psychological assessment
container_volume 35
creator Willoughby, Michael T.
Williams, Jason
Tueller, Stephen J.
Lauff, Erich M.
Hudson, Kesha
description Executive function (EF) assessments often involve the administration of multiple tasks. Although factor analytic methods are routinely used to summarize performance across multiple tasks, they may not be optimal for this purpose. We introduce reliable component analysis (RCA) as a strategy for summarizing EF task performance and demonstrate how it compares to traditional methods. Participants included 259 children (M = 4.5, SD = 0.6 years old; 55% female; 41% White, 35% Black, 14% Hispanic, 1% Asian, 1% American Indian, and 8% of more than one race) from the Kids Activity and Learning Study. Data collection occurred in center-based preschools and involved direct child assessments of EF, motor, and math skills. Principal components analysis (PCA), principal axis factor analysis (FA), and RCA methods were used to summarize children's performance across a battery of six EF tasks. Whereas PCA and FA indicated that a single composite or factor provided the best representation of EF task data, RCA indicated that three composites were justifiable. RCA composites were moderately to strongly correlated with PCA and FA scores (rs = .39-.79). Regression models indicated that all three approaches for combining EF task scores explained the same proportion of variance in motor and math skills outcomes, though the contributions of individual composite and factor scores varied. Results are discussed with respect to how RCA differs from more commonly used tools for data reduction. Public Significance Statement Executive function (EF) assessments involve the administration of multiple tasks to children or adults. It is not yet clear how best to summarize performance across tasks. We present a new statistical method for doing so.
doi_str_mv 10.1037/pas0001179
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2720431536</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2719051680</sourcerecordid><originalsourceid>FETCH-LOGICAL-a267t-23478b05f9f6d1f3975cb067d740b318c3037104760188b7ff80b48592e9c9f23</originalsourceid><addsrcrecordid>eNp90VFrFDEUBeAgiq3VF3-ABHwpwrT3TibJxLdl2apQEFoF30Imk7FZs5MxmSnuvzdraws--JRL-DhwOIS8RjhDYPJ8MhkAEKV6Qo5RMVUha749LTc0UDGu4Ii8yHlbTMNa_pwcMYGyQcGPyfbK9T7beOuSH7_TKxe86YKj67ib4ujGOdPVaMI--_y-XHQ1TcFbM_s40jnSzS9nl9nfOnqxjPbP7_UPH0KmfqQbk8Kerm986G9i7F-SZ4MJ2b26f0_I14vNl_XH6vLzh0_r1WVlaiHnqmaNbDvggxpEjwNTktsOhOxlAx3D1rLSuTSTArBtOzkMLXRNy1XtlFVDzU7I6V3ulOLPxeVZ70pDF4IZXVyyrmUNDUPORKFv_6HbuKTS96AER8BawP8VKuAo2oN6d6dsijknN-gp-Z1Je42gDzvpx50KfnMfuXQ71z_Qv8M8ppnJ6CnvrUmzt8Flu6RUZjmEacY1alaz34JsmtQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2719051680</pqid></control><display><type>article</type><title>Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood</title><source>MEDLINE</source><source>EBSCOhost APA PsycARTICLES</source><creator>Willoughby, Michael T. ; Williams, Jason ; Tueller, Stephen J. ; Lauff, Erich M. ; Hudson, Kesha</creator><contributor>Suhr, Julie A</contributor><creatorcontrib>Willoughby, Michael T. ; Williams, Jason ; Tueller, Stephen J. ; Lauff, Erich M. ; Hudson, Kesha ; Suhr, Julie A</creatorcontrib><description>Executive function (EF) assessments often involve the administration of multiple tasks. Although factor analytic methods are routinely used to summarize performance across multiple tasks, they may not be optimal for this purpose. We introduce reliable component analysis (RCA) as a strategy for summarizing EF task performance and demonstrate how it compares to traditional methods. Participants included 259 children (M = 4.5, SD = 0.6 years old; 55% female; 41% White, 35% Black, 14% Hispanic, 1% Asian, 1% American Indian, and 8% of more than one race) from the Kids Activity and Learning Study. Data collection occurred in center-based preschools and involved direct child assessments of EF, motor, and math skills. Principal components analysis (PCA), principal axis factor analysis (FA), and RCA methods were used to summarize children's performance across a battery of six EF tasks. Whereas PCA and FA indicated that a single composite or factor provided the best representation of EF task data, RCA indicated that three composites were justifiable. RCA composites were moderately to strongly correlated with PCA and FA scores (rs = .39-.79). Regression models indicated that all three approaches for combining EF task scores explained the same proportion of variance in motor and math skills outcomes, though the contributions of individual composite and factor scores varied. Results are discussed with respect to how RCA differs from more commonly used tools for data reduction. Public Significance Statement Executive function (EF) assessments involve the administration of multiple tasks to children or adults. It is not yet clear how best to summarize performance across tasks. We present a new statistical method for doing so.</description><identifier>ISSN: 1040-3590</identifier><identifier>EISSN: 1939-134X</identifier><identifier>DOI: 10.1037/pas0001179</identifier><identifier>PMID: 36174165</identifier><language>eng</language><publisher>United States: American Psychological Association</publisher><subject>American Indians ; Child ; Child, Preschool ; Children &amp; youth ; Cognitive Ability ; Composite materials ; Data analysis ; Early Childhood Development ; Educational Status ; Executive Function ; Factor Analysis ; Female ; Human ; Humans ; Infant ; Learning ; Male ; Mathematical Ability ; Memory, Short-Term ; Multitasking ; Principal Component Analysis ; Principal components analysis ; Regression analysis ; Task Performance and Analysis</subject><ispartof>Psychological assessment, 2023-01, Vol.35 (1), p.32-41</ispartof><rights>2022 American Psychological Association</rights><rights>2022, American Psychological Association</rights><rights>Copyright American Psychological Association Jan 2023</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0002-8470-3533 ; 0000-0002-2155-4040 ; 0000-0001-5417-0046 ; 0000-0002-3804-2594</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/36174165$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Suhr, Julie A</contributor><creatorcontrib>Willoughby, Michael T.</creatorcontrib><creatorcontrib>Williams, Jason</creatorcontrib><creatorcontrib>Tueller, Stephen J.</creatorcontrib><creatorcontrib>Lauff, Erich M.</creatorcontrib><creatorcontrib>Hudson, Kesha</creatorcontrib><title>Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood</title><title>Psychological assessment</title><addtitle>Psychol Assess</addtitle><description>Executive function (EF) assessments often involve the administration of multiple tasks. Although factor analytic methods are routinely used to summarize performance across multiple tasks, they may not be optimal for this purpose. We introduce reliable component analysis (RCA) as a strategy for summarizing EF task performance and demonstrate how it compares to traditional methods. Participants included 259 children (M = 4.5, SD = 0.6 years old; 55% female; 41% White, 35% Black, 14% Hispanic, 1% Asian, 1% American Indian, and 8% of more than one race) from the Kids Activity and Learning Study. Data collection occurred in center-based preschools and involved direct child assessments of EF, motor, and math skills. Principal components analysis (PCA), principal axis factor analysis (FA), and RCA methods were used to summarize children's performance across a battery of six EF tasks. Whereas PCA and FA indicated that a single composite or factor provided the best representation of EF task data, RCA indicated that three composites were justifiable. RCA composites were moderately to strongly correlated with PCA and FA scores (rs = .39-.79). Regression models indicated that all three approaches for combining EF task scores explained the same proportion of variance in motor and math skills outcomes, though the contributions of individual composite and factor scores varied. Results are discussed with respect to how RCA differs from more commonly used tools for data reduction. Public Significance Statement Executive function (EF) assessments involve the administration of multiple tasks to children or adults. It is not yet clear how best to summarize performance across tasks. We present a new statistical method for doing so.</description><subject>American Indians</subject><subject>Child</subject><subject>Child, Preschool</subject><subject>Children &amp; youth</subject><subject>Cognitive Ability</subject><subject>Composite materials</subject><subject>Data analysis</subject><subject>Early Childhood Development</subject><subject>Educational Status</subject><subject>Executive Function</subject><subject>Factor Analysis</subject><subject>Female</subject><subject>Human</subject><subject>Humans</subject><subject>Infant</subject><subject>Learning</subject><subject>Male</subject><subject>Mathematical Ability</subject><subject>Memory, Short-Term</subject><subject>Multitasking</subject><subject>Principal Component Analysis</subject><subject>Principal components analysis</subject><subject>Regression analysis</subject><subject>Task Performance and Analysis</subject><issn>1040-3590</issn><issn>1939-134X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp90VFrFDEUBeAgiq3VF3-ABHwpwrT3TibJxLdl2apQEFoF30Imk7FZs5MxmSnuvzdraws--JRL-DhwOIS8RjhDYPJ8MhkAEKV6Qo5RMVUha749LTc0UDGu4Ii8yHlbTMNa_pwcMYGyQcGPyfbK9T7beOuSH7_TKxe86YKj67ib4ujGOdPVaMI--_y-XHQ1TcFbM_s40jnSzS9nl9nfOnqxjPbP7_UPH0KmfqQbk8Kerm986G9i7F-SZ4MJ2b26f0_I14vNl_XH6vLzh0_r1WVlaiHnqmaNbDvggxpEjwNTktsOhOxlAx3D1rLSuTSTArBtOzkMLXRNy1XtlFVDzU7I6V3ulOLPxeVZ70pDF4IZXVyyrmUNDUPORKFv_6HbuKTS96AER8BawP8VKuAo2oN6d6dsijknN-gp-Z1Je42gDzvpx50KfnMfuXQ71z_Qv8M8ppnJ6CnvrUmzt8Flu6RUZjmEacY1alaz34JsmtQ</recordid><startdate>202301</startdate><enddate>202301</enddate><creator>Willoughby, Michael T.</creator><creator>Williams, Jason</creator><creator>Tueller, Stephen J.</creator><creator>Lauff, Erich M.</creator><creator>Hudson, Kesha</creator><general>American Psychological Association</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8470-3533</orcidid><orcidid>https://orcid.org/0000-0002-2155-4040</orcidid><orcidid>https://orcid.org/0000-0001-5417-0046</orcidid><orcidid>https://orcid.org/0000-0002-3804-2594</orcidid></search><sort><creationdate>202301</creationdate><title>Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood</title><author>Willoughby, Michael T. ; Williams, Jason ; Tueller, Stephen J. ; Lauff, Erich M. ; Hudson, Kesha</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a267t-23478b05f9f6d1f3975cb067d740b318c3037104760188b7ff80b48592e9c9f23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>American Indians</topic><topic>Child</topic><topic>Child, Preschool</topic><topic>Children &amp; youth</topic><topic>Cognitive Ability</topic><topic>Composite materials</topic><topic>Data analysis</topic><topic>Early Childhood Development</topic><topic>Educational Status</topic><topic>Executive Function</topic><topic>Factor Analysis</topic><topic>Female</topic><topic>Human</topic><topic>Humans</topic><topic>Infant</topic><topic>Learning</topic><topic>Male</topic><topic>Mathematical Ability</topic><topic>Memory, Short-Term</topic><topic>Multitasking</topic><topic>Principal Component Analysis</topic><topic>Principal components analysis</topic><topic>Regression analysis</topic><topic>Task Performance and Analysis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Willoughby, Michael T.</creatorcontrib><creatorcontrib>Williams, Jason</creatorcontrib><creatorcontrib>Tueller, Stephen J.</creatorcontrib><creatorcontrib>Lauff, Erich M.</creatorcontrib><creatorcontrib>Hudson, Kesha</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>MEDLINE - Academic</collection><jtitle>Psychological assessment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Willoughby, Michael T.</au><au>Williams, Jason</au><au>Tueller, Stephen J.</au><au>Lauff, Erich M.</au><au>Hudson, Kesha</au><au>Suhr, Julie A</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood</atitle><jtitle>Psychological assessment</jtitle><addtitle>Psychol Assess</addtitle><date>2023-01</date><risdate>2023</risdate><volume>35</volume><issue>1</issue><spage>32</spage><epage>41</epage><pages>32-41</pages><issn>1040-3590</issn><eissn>1939-134X</eissn><abstract>Executive function (EF) assessments often involve the administration of multiple tasks. Although factor analytic methods are routinely used to summarize performance across multiple tasks, they may not be optimal for this purpose. We introduce reliable component analysis (RCA) as a strategy for summarizing EF task performance and demonstrate how it compares to traditional methods. Participants included 259 children (M = 4.5, SD = 0.6 years old; 55% female; 41% White, 35% Black, 14% Hispanic, 1% Asian, 1% American Indian, and 8% of more than one race) from the Kids Activity and Learning Study. Data collection occurred in center-based preschools and involved direct child assessments of EF, motor, and math skills. Principal components analysis (PCA), principal axis factor analysis (FA), and RCA methods were used to summarize children's performance across a battery of six EF tasks. Whereas PCA and FA indicated that a single composite or factor provided the best representation of EF task data, RCA indicated that three composites were justifiable. RCA composites were moderately to strongly correlated with PCA and FA scores (rs = .39-.79). Regression models indicated that all three approaches for combining EF task scores explained the same proportion of variance in motor and math skills outcomes, though the contributions of individual composite and factor scores varied. Results are discussed with respect to how RCA differs from more commonly used tools for data reduction. Public Significance Statement Executive function (EF) assessments involve the administration of multiple tasks to children or adults. It is not yet clear how best to summarize performance across tasks. We present a new statistical method for doing so.</abstract><cop>United States</cop><pub>American Psychological Association</pub><pmid>36174165</pmid><doi>10.1037/pas0001179</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0002-8470-3533</orcidid><orcidid>https://orcid.org/0000-0002-2155-4040</orcidid><orcidid>https://orcid.org/0000-0001-5417-0046</orcidid><orcidid>https://orcid.org/0000-0002-3804-2594</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1040-3590
ispartof Psychological assessment, 2023-01, Vol.35 (1), p.32-41
issn 1040-3590
1939-134X
language eng
recordid cdi_proquest_miscellaneous_2720431536
source MEDLINE; EBSCOhost APA PsycARTICLES
subjects American Indians
Child
Child, Preschool
Children & youth
Cognitive Ability
Composite materials
Data analysis
Early Childhood Development
Educational Status
Executive Function
Factor Analysis
Female
Human
Humans
Infant
Learning
Male
Mathematical Ability
Memory, Short-Term
Multitasking
Principal Component Analysis
Principal components analysis
Regression analysis
Task Performance and Analysis
title Rediscovering Reliable Components Analysis: An Application to Executive Function Skills in Early Childhood
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T19%3A54%3A59IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Rediscovering%20Reliable%20Components%20Analysis:%20An%20Application%20to%20Executive%20Function%20Skills%20in%20Early%20Childhood&rft.jtitle=Psychological%20assessment&rft.au=Willoughby,%20Michael%20T.&rft.date=2023-01&rft.volume=35&rft.issue=1&rft.spage=32&rft.epage=41&rft.pages=32-41&rft.issn=1040-3590&rft.eissn=1939-134X&rft_id=info:doi/10.1037/pas0001179&rft_dat=%3Cproquest_cross%3E2719051680%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2719051680&rft_id=info:pmid/36174165&rfr_iscdi=true