Multistage Adaptive Testing Design in International Large‐Scale Assessments
A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 8...
Gespeichert in:
| Veröffentlicht in: | Educational measurement, issues and practice issues and practice, 2018-12, Vol.37 (4), p.16-27 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 27 |
|---|---|
| container_issue | 4 |
| container_start_page | 16 |
| container_title | Educational measurement, issues and practice |
| container_volume | 37 |
| creator | Yamamoto, Kentaro Shin, Hyo Jeong Khorramdel, Lale |
| description | A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC, this article addresses the advantages and considerations of an MST design in the context of international large‐scale assessments (ILSAs). It illustrates and discusses the unique features of the implemented designs in PISA and PIAAC and the expected gains in test efficiency and accuracy, as well as limitations and challenges of MST designs for cross‐country surveys. Practical aspects and insights into utilizing MST to measure complex constructs in cross‐cultural surveys are provided. |
| doi_str_mv | 10.1111/emip.12226 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2160689470</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1200974</ericid><sourcerecordid>2160689470</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3236-33d279e14c1c0a6ea1d5bbbd9d07f4a1cbfe555fd9cb8fd879fd5e709b40ff163</originalsourceid><addsrcrecordid>eNp9kM1KAzEUhYMoWKsb98KAO2FqkvlJsyy1aqVFwboOmeRmSJnOjMlU6c5H8Bl9ElNHXHo3F-757uFwEDoneETCXMPGtiNCKc0P0ICwNIsTzukhGmCWkHh_OEYn3q8xJlnO2QAtl9uqs76TJUQTLdvOvkG0At_ZuoxuwNuyjmwdzesOXC0729SyihbSlfD18fmsZBXevAfvN1B3_hQdGVl5OPvdQ_RyO1tN7-PF4918OlnEKqFJHieJpowDSRVRWOYgic6KotBcY2ZSSVRhIMsyo7kqxkaPGTc6A4Z5kWJjSJ4M0WXv27rmdRvSinWzDfkqLyjJcT7mKcOBuuop5RrvHRjROruRbicIFvu6xL4u8VNXgC96GJxVf-DsgVCMOUuDTnr93Vaw-8dJzJbzp97zGxkZeHA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2160689470</pqid></control><display><type>article</type><title>Multistage Adaptive Testing Design in International Large‐Scale Assessments</title><source>Education Source</source><source>Wiley Online Library Journals Frontfile Complete</source><creator>Yamamoto, Kentaro ; Shin, Hyo Jeong ; Khorramdel, Lale</creator><creatorcontrib>Yamamoto, Kentaro ; Shin, Hyo Jeong ; Khorramdel, Lale</creatorcontrib><description>A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC, this article addresses the advantages and considerations of an MST design in the context of international large‐scale assessments (ILSAs). It illustrates and discusses the unique features of the implemented designs in PISA and PIAAC and the expected gains in test efficiency and accuracy, as well as limitations and challenges of MST designs for cross‐country surveys. Practical aspects and insights into utilizing MST to measure complex constructs in cross‐cultural surveys are provided.</description><identifier>ISSN: 0731-1745</identifier><identifier>EISSN: 1745-3992</identifier><identifier>DOI: 10.1111/emip.12226</identifier><language>eng</language><publisher>Washington: Wiley-Blackwell</publisher><subject>Achievement Tests ; Adaptive Testing ; Adults ; assessment designs ; Competence ; Computer Assisted Testing ; Cultural Influences ; Educational evaluation ; Educational tests & measurements ; Foreign Countries ; International Assessment ; International education ; item parameter estimation ; Measurement Techniques ; multistage adaptive testing ; Programme for International Student Assessment (PISA) ; Programme for the International Assessment of Adult Competencies (PIAAC) ; Test Validity</subject><ispartof>Educational measurement, issues and practice, 2018-12, Vol.37 (4), p.16-27</ispartof><rights>2018 by the National Council on Measurement in Education</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3236-33d279e14c1c0a6ea1d5bbbd9d07f4a1cbfe555fd9cb8fd879fd5e709b40ff163</citedby><cites>FETCH-LOGICAL-c3236-33d279e14c1c0a6ea1d5bbbd9d07f4a1cbfe555fd9cb8fd879fd5e709b40ff163</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Femip.12226$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Femip.12226$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,776,780,1411,27901,27902,45550,45551</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1200974$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Yamamoto, Kentaro</creatorcontrib><creatorcontrib>Shin, Hyo Jeong</creatorcontrib><creatorcontrib>Khorramdel, Lale</creatorcontrib><title>Multistage Adaptive Testing Design in International Large‐Scale Assessments</title><title>Educational measurement, issues and practice</title><description>A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC, this article addresses the advantages and considerations of an MST design in the context of international large‐scale assessments (ILSAs). It illustrates and discusses the unique features of the implemented designs in PISA and PIAAC and the expected gains in test efficiency and accuracy, as well as limitations and challenges of MST designs for cross‐country surveys. Practical aspects and insights into utilizing MST to measure complex constructs in cross‐cultural surveys are provided.</description><subject>Achievement Tests</subject><subject>Adaptive Testing</subject><subject>Adults</subject><subject>assessment designs</subject><subject>Competence</subject><subject>Computer Assisted Testing</subject><subject>Cultural Influences</subject><subject>Educational evaluation</subject><subject>Educational tests & measurements</subject><subject>Foreign Countries</subject><subject>International Assessment</subject><subject>International education</subject><subject>item parameter estimation</subject><subject>Measurement Techniques</subject><subject>multistage adaptive testing</subject><subject>Programme for International Student Assessment (PISA)</subject><subject>Programme for the International Assessment of Adult Competencies (PIAAC)</subject><subject>Test Validity</subject><issn>0731-1745</issn><issn>1745-3992</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><recordid>eNp9kM1KAzEUhYMoWKsb98KAO2FqkvlJsyy1aqVFwboOmeRmSJnOjMlU6c5H8Bl9ElNHXHo3F-757uFwEDoneETCXMPGtiNCKc0P0ICwNIsTzukhGmCWkHh_OEYn3q8xJlnO2QAtl9uqs76TJUQTLdvOvkG0At_ZuoxuwNuyjmwdzesOXC0729SyihbSlfD18fmsZBXevAfvN1B3_hQdGVl5OPvdQ_RyO1tN7-PF4918OlnEKqFJHieJpowDSRVRWOYgic6KotBcY2ZSSVRhIMsyo7kqxkaPGTc6A4Z5kWJjSJ4M0WXv27rmdRvSinWzDfkqLyjJcT7mKcOBuuop5RrvHRjROruRbicIFvu6xL4u8VNXgC96GJxVf-DsgVCMOUuDTnr93Vaw-8dJzJbzp97zGxkZeHA</recordid><startdate>20181201</startdate><enddate>20181201</enddate><creator>Yamamoto, Kentaro</creator><creator>Shin, Hyo Jeong</creator><creator>Khorramdel, Lale</creator><general>Wiley-Blackwell</general><general>Wiley Subscription Services, Inc</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20181201</creationdate><title>Multistage Adaptive Testing Design in International Large‐Scale Assessments</title><author>Yamamoto, Kentaro ; Shin, Hyo Jeong ; Khorramdel, Lale</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3236-33d279e14c1c0a6ea1d5bbbd9d07f4a1cbfe555fd9cb8fd879fd5e709b40ff163</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Achievement Tests</topic><topic>Adaptive Testing</topic><topic>Adults</topic><topic>assessment designs</topic><topic>Competence</topic><topic>Computer Assisted Testing</topic><topic>Cultural Influences</topic><topic>Educational evaluation</topic><topic>Educational tests & measurements</topic><topic>Foreign Countries</topic><topic>International Assessment</topic><topic>International education</topic><topic>item parameter estimation</topic><topic>Measurement Techniques</topic><topic>multistage adaptive testing</topic><topic>Programme for International Student Assessment (PISA)</topic><topic>Programme for the International Assessment of Adult Competencies (PIAAC)</topic><topic>Test Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yamamoto, Kentaro</creatorcontrib><creatorcontrib>Shin, Hyo Jeong</creatorcontrib><creatorcontrib>Khorramdel, Lale</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Educational measurement, issues and practice</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yamamoto, Kentaro</au><au>Shin, Hyo Jeong</au><au>Khorramdel, Lale</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1200974</ericid><atitle>Multistage Adaptive Testing Design in International Large‐Scale Assessments</atitle><jtitle>Educational measurement, issues and practice</jtitle><date>2018-12-01</date><risdate>2018</risdate><volume>37</volume><issue>4</issue><spage>16</spage><epage>27</epage><pages>16-27</pages><issn>0731-1745</issn><eissn>1745-3992</eissn><abstract>A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC, this article addresses the advantages and considerations of an MST design in the context of international large‐scale assessments (ILSAs). It illustrates and discusses the unique features of the implemented designs in PISA and PIAAC and the expected gains in test efficiency and accuracy, as well as limitations and challenges of MST designs for cross‐country surveys. Practical aspects and insights into utilizing MST to measure complex constructs in cross‐cultural surveys are provided.</abstract><cop>Washington</cop><pub>Wiley-Blackwell</pub><doi>10.1111/emip.12226</doi><tpages>12</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0731-1745 |
| ispartof | Educational measurement, issues and practice, 2018-12, Vol.37 (4), p.16-27 |
| issn | 0731-1745 1745-3992 |
| language | eng |
| recordid | cdi_proquest_journals_2160689470 |
| source | Education Source; Wiley Online Library Journals Frontfile Complete |
| subjects | Achievement Tests Adaptive Testing Adults assessment designs Competence Computer Assisted Testing Cultural Influences Educational evaluation Educational tests & measurements Foreign Countries International Assessment International education item parameter estimation Measurement Techniques multistage adaptive testing Programme for International Student Assessment (PISA) Programme for the International Assessment of Adult Competencies (PIAAC) Test Validity |
| title | Multistage Adaptive Testing Design in International Large‐Scale Assessments |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T16%3A20%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Multistage%20Adaptive%20Testing%20Design%20in%20International%20Large%E2%80%90Scale%20Assessments&rft.jtitle=Educational%20measurement,%20issues%20and%20practice&rft.au=Yamamoto,%20Kentaro&rft.date=2018-12-01&rft.volume=37&rft.issue=4&rft.spage=16&rft.epage=27&rft.pages=16-27&rft.issn=0731-1745&rft.eissn=1745-3992&rft_id=info:doi/10.1111/emip.12226&rft_dat=%3Cproquest_cross%3E2160689470%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2160689470&rft_id=info:pmid/&rft_ericid=EJ1200974&rfr_iscdi=true |