Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires

This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, f...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of educational measurement 2024-03, Vol.61 (1), p.125-149
Hauptverfasser: Fu, Jianbin, Tan, Xuan, Kyllonen, Patrick C.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 149
container_issue 1
container_start_page 125
container_title Journal of educational measurement
container_volume 61
creator Fu, Jianbin
Tan, Xuan
Kyllonen, Patrick C.
description This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.
doi_str_mv 10.1111/jedm.12379
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2933828003</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2933828003</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</originalsourceid><addsrcrecordid>eNp9kE1OwzAQhS0EEqWw4QSW2CGleOL4b4lKA0Wt-BGsLdd2REobF5sKdccROCMnISGsmc2MRt-bN3oInQIZQVsXS-_WI8ipUHtoAKJgGVWy2EcDQvI8I5yxQ3SU0pIQYILBAM2nTRXi2rzXocHltrHdkHCo8KNpXr8_v_L7GZ4H51cJtyAuQ7TetfvxS6itxw9bnzpJY-ro0zE6qMwq-ZO_PkTP5eRpfJPN7q6n48tZZnPFVSa9tJSDccJZzhZcKE8coUwKx4zznEkvwIAgQApvKSmAVw4WzBkhhFKMDtFZf3cTw1v3gV6GbWxaS50rSmUuCaEtdd5TNoaUoq_0JtZrE3caiO7i0l1c-jeuFoYe_qhXfvcPqW8nV_Ne8wP9zm3L</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2933828003</pqid></control><display><type>article</type><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><source>Wiley Online Library All Journals</source><creator>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</creator><creatorcontrib>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</creatorcontrib><description>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</description><identifier>ISSN: 0022-0655</identifier><identifier>EISSN: 1745-3984</identifier><identifier>DOI: 10.1111/jedm.12379</identifier><language>eng</language><publisher>Madison: Wiley Subscription Services, Inc</publisher><subject>Discrimination ; Maximum Likelihood Statistics ; Questionnaires ; Reliability ; Tests ; Triplets</subject><ispartof>Journal of educational measurement, 2024-03, Vol.61 (1), p.125-149</ispartof><rights>2023 by the National Council on Measurement in Education.</rights><rights>2024 by the National Council on Measurement in Education.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</cites><orcidid>0000-0002-8260-3504 ; 0000-0001-8026-242X ; 0000-0002-6517-4576</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fjedm.12379$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fjedm.12379$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1416,27922,27923,30997,45572,45573</link.rule.ids></links><search><creatorcontrib>Fu, Jianbin</creatorcontrib><creatorcontrib>Tan, Xuan</creatorcontrib><creatorcontrib>Kyllonen, Patrick C.</creatorcontrib><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><title>Journal of educational measurement</title><description>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</description><subject>Discrimination</subject><subject>Maximum Likelihood Statistics</subject><subject>Questionnaires</subject><subject>Reliability</subject><subject>Tests</subject><subject>Triplets</subject><issn>0022-0655</issn><issn>1745-3984</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp9kE1OwzAQhS0EEqWw4QSW2CGleOL4b4lKA0Wt-BGsLdd2REobF5sKdccROCMnISGsmc2MRt-bN3oInQIZQVsXS-_WI8ipUHtoAKJgGVWy2EcDQvI8I5yxQ3SU0pIQYILBAM2nTRXi2rzXocHltrHdkHCo8KNpXr8_v_L7GZ4H51cJtyAuQ7TetfvxS6itxw9bnzpJY-ro0zE6qMwq-ZO_PkTP5eRpfJPN7q6n48tZZnPFVSa9tJSDccJZzhZcKE8coUwKx4zznEkvwIAgQApvKSmAVw4WzBkhhFKMDtFZf3cTw1v3gV6GbWxaS50rSmUuCaEtdd5TNoaUoq_0JtZrE3caiO7i0l1c-jeuFoYe_qhXfvcPqW8nV_Ne8wP9zm3L</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Fu, Jianbin</creator><creator>Tan, Xuan</creator><creator>Kyllonen, Patrick C.</creator><general>Wiley Subscription Services, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><orcidid>https://orcid.org/0000-0002-8260-3504</orcidid><orcidid>https://orcid.org/0000-0001-8026-242X</orcidid><orcidid>https://orcid.org/0000-0002-6517-4576</orcidid></search><sort><creationdate>20240301</creationdate><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><author>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Discrimination</topic><topic>Maximum Likelihood Statistics</topic><topic>Questionnaires</topic><topic>Reliability</topic><topic>Tests</topic><topic>Triplets</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fu, Jianbin</creatorcontrib><creatorcontrib>Tan, Xuan</creatorcontrib><creatorcontrib>Kyllonen, Patrick C.</creatorcontrib><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><jtitle>Journal of educational measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fu, Jianbin</au><au>Tan, Xuan</au><au>Kyllonen, Patrick C.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</atitle><jtitle>Journal of educational measurement</jtitle><date>2024-03-01</date><risdate>2024</risdate><volume>61</volume><issue>1</issue><spage>125</spage><epage>149</epage><pages>125-149</pages><issn>0022-0655</issn><eissn>1745-3984</eissn><abstract>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</abstract><cop>Madison</cop><pub>Wiley Subscription Services, Inc</pub><doi>10.1111/jedm.12379</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0002-8260-3504</orcidid><orcidid>https://orcid.org/0000-0001-8026-242X</orcidid><orcidid>https://orcid.org/0000-0002-6517-4576</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0022-0655
ispartof Journal of educational measurement, 2024-03, Vol.61 (1), p.125-149
issn 0022-0655
1745-3984
language eng
recordid cdi_proquest_journals_2933828003
source Applied Social Sciences Index & Abstracts (ASSIA); Wiley Online Library All Journals
subjects Discrimination
Maximum Likelihood Statistics
Questionnaires
Reliability
Tests
Triplets
title Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T05%3A12%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Information%20Functions%20of%20Rank%E2%80%902PL%20Models%20for%20Forced%E2%80%90Choice%20Questionnaires&rft.jtitle=Journal%20of%20educational%20measurement&rft.au=Fu,%20Jianbin&rft.date=2024-03-01&rft.volume=61&rft.issue=1&rft.spage=125&rft.epage=149&rft.pages=125-149&rft.issn=0022-0655&rft.eissn=1745-3984&rft_id=info:doi/10.1111/jedm.12379&rft_dat=%3Cproquest_cross%3E2933828003%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2933828003&rft_id=info:pmid/&rfr_iscdi=true