Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires
This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, f...
Gespeichert in:
Veröffentlicht in: | Journal of educational measurement 2024-03, Vol.61 (1), p.125-149 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 149 |
---|---|
container_issue | 1 |
container_start_page | 125 |
container_title | Journal of educational measurement |
container_volume | 61 |
creator | Fu, Jianbin Tan, Xuan Kyllonen, Patrick C. |
description | This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided. |
doi_str_mv | 10.1111/jedm.12379 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2933828003</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2933828003</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</originalsourceid><addsrcrecordid>eNp9kE1OwzAQhS0EEqWw4QSW2CGleOL4b4lKA0Wt-BGsLdd2REobF5sKdccROCMnISGsmc2MRt-bN3oInQIZQVsXS-_WI8ipUHtoAKJgGVWy2EcDQvI8I5yxQ3SU0pIQYILBAM2nTRXi2rzXocHltrHdkHCo8KNpXr8_v_L7GZ4H51cJtyAuQ7TetfvxS6itxw9bnzpJY-ro0zE6qMwq-ZO_PkTP5eRpfJPN7q6n48tZZnPFVSa9tJSDccJZzhZcKE8coUwKx4zznEkvwIAgQApvKSmAVw4WzBkhhFKMDtFZf3cTw1v3gV6GbWxaS50rSmUuCaEtdd5TNoaUoq_0JtZrE3caiO7i0l1c-jeuFoYe_qhXfvcPqW8nV_Ne8wP9zm3L</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2933828003</pqid></control><display><type>article</type><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><source>Wiley Online Library All Journals</source><creator>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</creator><creatorcontrib>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</creatorcontrib><description>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</description><identifier>ISSN: 0022-0655</identifier><identifier>EISSN: 1745-3984</identifier><identifier>DOI: 10.1111/jedm.12379</identifier><language>eng</language><publisher>Madison: Wiley Subscription Services, Inc</publisher><subject>Discrimination ; Maximum Likelihood Statistics ; Questionnaires ; Reliability ; Tests ; Triplets</subject><ispartof>Journal of educational measurement, 2024-03, Vol.61 (1), p.125-149</ispartof><rights>2023 by the National Council on Measurement in Education.</rights><rights>2024 by the National Council on Measurement in Education.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</cites><orcidid>0000-0002-8260-3504 ; 0000-0001-8026-242X ; 0000-0002-6517-4576</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fjedm.12379$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fjedm.12379$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1416,27922,27923,30997,45572,45573</link.rule.ids></links><search><creatorcontrib>Fu, Jianbin</creatorcontrib><creatorcontrib>Tan, Xuan</creatorcontrib><creatorcontrib>Kyllonen, Patrick C.</creatorcontrib><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><title>Journal of educational measurement</title><description>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</description><subject>Discrimination</subject><subject>Maximum Likelihood Statistics</subject><subject>Questionnaires</subject><subject>Reliability</subject><subject>Tests</subject><subject>Triplets</subject><issn>0022-0655</issn><issn>1745-3984</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp9kE1OwzAQhS0EEqWw4QSW2CGleOL4b4lKA0Wt-BGsLdd2REobF5sKdccROCMnISGsmc2MRt-bN3oInQIZQVsXS-_WI8ipUHtoAKJgGVWy2EcDQvI8I5yxQ3SU0pIQYILBAM2nTRXi2rzXocHltrHdkHCo8KNpXr8_v_L7GZ4H51cJtyAuQ7TetfvxS6itxw9bnzpJY-ro0zE6qMwq-ZO_PkTP5eRpfJPN7q6n48tZZnPFVSa9tJSDccJZzhZcKE8coUwKx4zznEkvwIAgQApvKSmAVw4WzBkhhFKMDtFZf3cTw1v3gV6GbWxaS50rSmUuCaEtdd5TNoaUoq_0JtZrE3caiO7i0l1c-jeuFoYe_qhXfvcPqW8nV_Ne8wP9zm3L</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Fu, Jianbin</creator><creator>Tan, Xuan</creator><creator>Kyllonen, Patrick C.</creator><general>Wiley Subscription Services, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><orcidid>https://orcid.org/0000-0002-8260-3504</orcidid><orcidid>https://orcid.org/0000-0001-8026-242X</orcidid><orcidid>https://orcid.org/0000-0002-6517-4576</orcidid></search><sort><creationdate>20240301</creationdate><title>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</title><author>Fu, Jianbin ; Tan, Xuan ; Kyllonen, Patrick C.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2969-8e8c361ad7dc65b679e0d03587d5ade658e71a170104ec30416fd1b5da7779953</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Discrimination</topic><topic>Maximum Likelihood Statistics</topic><topic>Questionnaires</topic><topic>Reliability</topic><topic>Tests</topic><topic>Triplets</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fu, Jianbin</creatorcontrib><creatorcontrib>Tan, Xuan</creatorcontrib><creatorcontrib>Kyllonen, Patrick C.</creatorcontrib><collection>CrossRef</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><jtitle>Journal of educational measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fu, Jianbin</au><au>Tan, Xuan</au><au>Kyllonen, Patrick C.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires</atitle><jtitle>Journal of educational measurement</jtitle><date>2024-03-01</date><risdate>2024</risdate><volume>61</volume><issue>1</issue><spage>125</spage><epage>149</epage><pages>125-149</pages><issn>0022-0655</issn><eissn>1745-3984</eissn><abstract>This paper presents the item and test information functions of the Rank two‐parameter logistic models (Rank‐2PLM) for items with two (pair) and three (triplet) statements in forced‐choice questionnaires. The Rank‐2PLM model for pairs is the MUPP‐2PLM (Multi‐Unidimensional Pairwise Preference) and, for triplets, is the Triplet‐2PLM. Fisher's information and directional information are described, and the test information for Maximum Likelihood (ML), Maximum A Posterior (MAP), and Expected A Posterior (EAP) trait score estimates is distinguished. Expected item/test information indexes at various levels are proposed and plotted to provide diagnostic information on items and tests. The expected test information indexes for EAP scores may be difficult to compute due to a typical test's vast number of item response patterns. The relationships of item/test information with discrimination parameters of statements, standard error, and reliability estimates of trait score estimates are discussed and demonstrated using real data. Practical suggestions for checking the various expected item/test information indexes and plots are provided.</abstract><cop>Madison</cop><pub>Wiley Subscription Services, Inc</pub><doi>10.1111/jedm.12379</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0002-8260-3504</orcidid><orcidid>https://orcid.org/0000-0001-8026-242X</orcidid><orcidid>https://orcid.org/0000-0002-6517-4576</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0022-0655 |
ispartof | Journal of educational measurement, 2024-03, Vol.61 (1), p.125-149 |
issn | 0022-0655 1745-3984 |
language | eng |
recordid | cdi_proquest_journals_2933828003 |
source | Applied Social Sciences Index & Abstracts (ASSIA); Wiley Online Library All Journals |
subjects | Discrimination Maximum Likelihood Statistics Questionnaires Reliability Tests Triplets |
title | Information Functions of Rank‐2PL Models for Forced‐Choice Questionnaires |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T05%3A12%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Information%20Functions%20of%20Rank%E2%80%902PL%20Models%20for%20Forced%E2%80%90Choice%20Questionnaires&rft.jtitle=Journal%20of%20educational%20measurement&rft.au=Fu,%20Jianbin&rft.date=2024-03-01&rft.volume=61&rft.issue=1&rft.spage=125&rft.epage=149&rft.pages=125-149&rft.issn=0022-0655&rft.eissn=1745-3984&rft_id=info:doi/10.1111/jedm.12379&rft_dat=%3Cproquest_cross%3E2933828003%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2933828003&rft_id=info:pmid/&rfr_iscdi=true |