Evaluating the metacognitive awareness inventory using empirical factor-structure evidence

Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice becaus...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Metacognition and learning 2018-04, Vol.13 (1), p.15-38
Hauptverfasser: Harrison, George M., Vallin, Lisa M.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 38
container_issue 1
container_start_page 15
container_title Metacognition and learning
container_volume 13
creator Harrison, George M.
Vallin, Lisa M.
description Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice because of their convenience. With the MAI, studies have varied in the way they calculate scores and in their adherence to the intended theory. In this study, we address these shortcomings and propose modifications in calculating MAI scores. Using confirmatory factor analysis (CFA) and multidimensional random coefficients multinomial logit (MRCML) item-response modeling, we examined how well the intended functioning of the MAI matched the data from 622 undergraduate students. The results support scoring the MAI as two dimensions, knowledge and regulation of cognition, but indicate that the 52-item instrument has poor fit. Using iterative CFA and MRCML models, we tested subsets of items that represent the theory and had good fit. We followed up with tests of between-group and time invariance. The results support the use of a 19-item subset for between-group comparisons, with provisional evidence for its use in longitudinal studies.
doi_str_mv 10.1007/s11409-017-9176-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2015589753</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1172608</ericid><sourcerecordid>2015589753</sourcerecordid><originalsourceid>FETCH-LOGICAL-c404t-9c9ad6ac1f2f31c9d1b6c85f01d38da56d88e53cdebbfeeee87354387a3f96c03</originalsourceid><addsrcrecordid>eNp1UE1LAzEQDaJgrf4AD8KC52hms5vNHqXULwQvevES0uykbmmzNclW2l9vyko9OZcZ5r03w3uEXAK7Acaq2wBQsJoyqGgNlaC7IzKCshQUBIfjw5zzU3IWwoKxoihEPiIf041e9jq2bp7FT8xWGLXp5q6N7QYz_a09Ogwha90GXez8NuvDnourdetbo5eZ1SbtaYi-N7H3mOGmbdAZPCcnVi8DXvz2MXm_n75NHunL68PT5O6FmoIVkdam1o3QBmxuOZi6gZkwsrQMGi4bXYpGSiy5aXA2s5hKVrwsuKw0t7UwjI_J9XB37buvHkNUi673Lr1UOUu-ZV2VPLFgYBnfheDRqrVvV9pvFTC1j1ANEaoUodpHqHZJczVoMFk98KfPAFUumEx4PuAhYW6O_u_z_0d_AMFkgPc</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2015589753</pqid></control><display><type>article</type><title>Evaluating the metacognitive awareness inventory using empirical factor-structure evidence</title><source>EBSCOhost Education Source</source><source>SpringerLink Journals - AutoHoldings</source><creator>Harrison, George M. ; Vallin, Lisa M.</creator><creatorcontrib>Harrison, George M. ; Vallin, Lisa M.</creatorcontrib><description>Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice because of their convenience. With the MAI, studies have varied in the way they calculate scores and in their adherence to the intended theory. In this study, we address these shortcomings and propose modifications in calculating MAI scores. Using confirmatory factor analysis (CFA) and multidimensional random coefficients multinomial logit (MRCML) item-response modeling, we examined how well the intended functioning of the MAI matched the data from 622 undergraduate students. The results support scoring the MAI as two dimensions, knowledge and regulation of cognition, but indicate that the 52-item instrument has poor fit. Using iterative CFA and MRCML models, we tested subsets of items that represent the theory and had good fit. We followed up with tests of between-group and time invariance. The results support the use of a 19-item subset for between-group comparisons, with provisional evidence for its use in longitudinal studies.</description><identifier>ISSN: 1556-1623</identifier><identifier>EISSN: 1556-1631</identifier><identifier>DOI: 10.1007/s11409-017-9176-z</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Discriminant analysis ; Education ; Factor Analysis ; Factor Structure ; Goodness of Fit ; Item Response Theory ; Learning and Instruction ; Longitudinal Studies ; Measures (Individuals) ; Metacognition ; Scores ; Self evaluation ; Self report ; Teaching and Teacher Education ; Undergraduate Students</subject><ispartof>Metacognition and learning, 2018-04, Vol.13 (1), p.15-38</ispartof><rights>Springer Science+Business Media, LLC 2017</rights><rights>Metacognition and Learning is a copyright of Springer, (2017). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c404t-9c9ad6ac1f2f31c9d1b6c85f01d38da56d88e53cdebbfeeee87354387a3f96c03</citedby><cites>FETCH-LOGICAL-c404t-9c9ad6ac1f2f31c9d1b6c85f01d38da56d88e53cdebbfeeee87354387a3f96c03</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11409-017-9176-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11409-017-9176-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27922,27923,41486,42555,51317</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1172608$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Harrison, George M.</creatorcontrib><creatorcontrib>Vallin, Lisa M.</creatorcontrib><title>Evaluating the metacognitive awareness inventory using empirical factor-structure evidence</title><title>Metacognition and learning</title><addtitle>Metacognition Learning</addtitle><description>Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice because of their convenience. With the MAI, studies have varied in the way they calculate scores and in their adherence to the intended theory. In this study, we address these shortcomings and propose modifications in calculating MAI scores. Using confirmatory factor analysis (CFA) and multidimensional random coefficients multinomial logit (MRCML) item-response modeling, we examined how well the intended functioning of the MAI matched the data from 622 undergraduate students. The results support scoring the MAI as two dimensions, knowledge and regulation of cognition, but indicate that the 52-item instrument has poor fit. Using iterative CFA and MRCML models, we tested subsets of items that represent the theory and had good fit. We followed up with tests of between-group and time invariance. The results support the use of a 19-item subset for between-group comparisons, with provisional evidence for its use in longitudinal studies.</description><subject>Discriminant analysis</subject><subject>Education</subject><subject>Factor Analysis</subject><subject>Factor Structure</subject><subject>Goodness of Fit</subject><subject>Item Response Theory</subject><subject>Learning and Instruction</subject><subject>Longitudinal Studies</subject><subject>Measures (Individuals)</subject><subject>Metacognition</subject><subject>Scores</subject><subject>Self evaluation</subject><subject>Self report</subject><subject>Teaching and Teacher Education</subject><subject>Undergraduate Students</subject><issn>1556-1623</issn><issn>1556-1631</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp1UE1LAzEQDaJgrf4AD8KC52hms5vNHqXULwQvevES0uykbmmzNclW2l9vyko9OZcZ5r03w3uEXAK7Acaq2wBQsJoyqGgNlaC7IzKCshQUBIfjw5zzU3IWwoKxoihEPiIf041e9jq2bp7FT8xWGLXp5q6N7QYz_a09Ogwha90GXez8NuvDnourdetbo5eZ1SbtaYi-N7H3mOGmbdAZPCcnVi8DXvz2MXm_n75NHunL68PT5O6FmoIVkdam1o3QBmxuOZi6gZkwsrQMGi4bXYpGSiy5aXA2s5hKVrwsuKw0t7UwjI_J9XB37buvHkNUi673Lr1UOUu-ZV2VPLFgYBnfheDRqrVvV9pvFTC1j1ANEaoUodpHqHZJczVoMFk98KfPAFUumEx4PuAhYW6O_u_z_0d_AMFkgPc</recordid><startdate>20180401</startdate><enddate>20180401</enddate><creator>Harrison, George M.</creator><creator>Vallin, Lisa M.</creator><general>Springer US</general><general>Springer</general><general>Springer Nature B.V</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7XB</scope><scope>88B</scope><scope>88G</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>M0P</scope><scope>M2M</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope></search><sort><creationdate>20180401</creationdate><title>Evaluating the metacognitive awareness inventory using empirical factor-structure evidence</title><author>Harrison, George M. ; Vallin, Lisa M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c404t-9c9ad6ac1f2f31c9d1b6c85f01d38da56d88e53cdebbfeeee87354387a3f96c03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Discriminant analysis</topic><topic>Education</topic><topic>Factor Analysis</topic><topic>Factor Structure</topic><topic>Goodness of Fit</topic><topic>Item Response Theory</topic><topic>Learning and Instruction</topic><topic>Longitudinal Studies</topic><topic>Measures (Individuals)</topic><topic>Metacognition</topic><topic>Scores</topic><topic>Self evaluation</topic><topic>Self report</topic><topic>Teaching and Teacher Education</topic><topic>Undergraduate Students</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Harrison, George M.</creatorcontrib><creatorcontrib>Vallin, Lisa M.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Education Database</collection><collection>Psychology Database</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><jtitle>Metacognition and learning</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Harrison, George M.</au><au>Vallin, Lisa M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1172608</ericid><atitle>Evaluating the metacognitive awareness inventory using empirical factor-structure evidence</atitle><jtitle>Metacognition and learning</jtitle><stitle>Metacognition Learning</stitle><date>2018-04-01</date><risdate>2018</risdate><volume>13</volume><issue>1</issue><spage>15</spage><epage>38</epage><pages>15-38</pages><issn>1556-1623</issn><eissn>1556-1631</eissn><abstract>Many scholars agree on the general theoretical structure of metacognition, which is what informed the development of the Metacognitive Awareness Inventory (MAI). Although self-report instruments such as the MAI suffer many threats to validity, they continue to be used in research and practice because of their convenience. With the MAI, studies have varied in the way they calculate scores and in their adherence to the intended theory. In this study, we address these shortcomings and propose modifications in calculating MAI scores. Using confirmatory factor analysis (CFA) and multidimensional random coefficients multinomial logit (MRCML) item-response modeling, we examined how well the intended functioning of the MAI matched the data from 622 undergraduate students. The results support scoring the MAI as two dimensions, knowledge and regulation of cognition, but indicate that the 52-item instrument has poor fit. Using iterative CFA and MRCML models, we tested subsets of items that represent the theory and had good fit. We followed up with tests of between-group and time invariance. The results support the use of a 19-item subset for between-group comparisons, with provisional evidence for its use in longitudinal studies.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11409-017-9176-z</doi><tpages>24</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1556-1623
ispartof Metacognition and learning, 2018-04, Vol.13 (1), p.15-38
issn 1556-1623
1556-1631
language eng
recordid cdi_proquest_journals_2015589753
source EBSCOhost Education Source; SpringerLink Journals - AutoHoldings
subjects Discriminant analysis
Education
Factor Analysis
Factor Structure
Goodness of Fit
Item Response Theory
Learning and Instruction
Longitudinal Studies
Measures (Individuals)
Metacognition
Scores
Self evaluation
Self report
Teaching and Teacher Education
Undergraduate Students
title Evaluating the metacognitive awareness inventory using empirical factor-structure evidence
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T23%3A48%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluating%20the%20metacognitive%20awareness%20inventory%20using%20empirical%20factor-structure%20evidence&rft.jtitle=Metacognition%20and%20learning&rft.au=Harrison,%20George%20M.&rft.date=2018-04-01&rft.volume=13&rft.issue=1&rft.spage=15&rft.epage=38&rft.pages=15-38&rft.issn=1556-1623&rft.eissn=1556-1631&rft_id=info:doi/10.1007/s11409-017-9176-z&rft_dat=%3Cproquest_cross%3E2015589753%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2015589753&rft_id=info:pmid/&rft_ericid=EJ1172608&rfr_iscdi=true