A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys
Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction o...
Gespeichert in:
| Veröffentlicht in: | Journal of educational and behavioral statistics 2023-06, Vol.48 (3), p.271-295 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 295 |
|---|---|
| container_issue | 3 |
| container_start_page | 271 |
| container_title | Journal of educational and behavioral statistics |
| container_volume | 48 |
| creator | Si, Yajuan Little, Roderick J. A. Mo, Ya Sedransk, Nell |
| description | Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software. |
| doi_str_mv | 10.3102/10769986221141074 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2808560997</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1376611</ericid><sage_id>10.3102_10769986221141074</sage_id><sourcerecordid>2808560997</sourcerecordid><originalsourceid>FETCH-LOGICAL-c334t-a24fe86b14e321d33f56a00c834de6b44b7287b0fd9b6e91a68c22be2c51c3733</originalsourceid><addsrcrecordid>eNp1UEtPwzAMjhBIjMcP4IAUiXNHnKRpexzTeE5wGJyrNHVRp60dcYvUf0-mIjggTra_ly0zdgFiqkDIaxCJybLUSAmgw6AP2AQyFUcgYn0Y-sBHe8ExOyFaCwFKajVhTzM-t4R81fXlwNuKP7eNR9q1TQBvakt81tjNQDXxuuGLsne2q9sA8RkREm2x6fiq95840Bk7quyG8Py7nrK328Xr_D5avtw9zGfLyCmlu8hKXWFqCtCoJJRKVbGxQrhU6RJNoXWRyDQpRFVmhcEMrEmdlAVKF4NTiVKn7GrM3fn2o0fq8nXb-3AT5TIVaWxEliVBBaPK-ZbIY5XvfL21fshB5Puf5X9-FjyXowd97X70i0dQiTEAgZ-OPNl3_N36f-AXfvJz7A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2808560997</pqid></control><display><type>article</type><title>A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys</title><source>SAGE Complete</source><source>Alma/SFX Local Collection</source><creator>Si, Yajuan ; Little, Roderick J. A. ; Mo, Ya ; Sedransk, Nell</creator><creatorcontrib>Si, Yajuan ; Little, Roderick J. A. ; Mo, Ya ; Sedransk, Nell</creatorcontrib><description>Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software.</description><identifier>ISSN: 1076-9986</identifier><identifier>EISSN: 1935-1054</identifier><identifier>DOI: 10.3102/10769986221141074</identifier><language>eng</language><publisher>Los Angeles, CA: SAGE Publications</publisher><subject>Bias ; Children ; Educational Assessment ; Educational evaluation ; Educational tests & measurements ; Longitudinal Studies ; Prediction ; Research Problems ; Response Rates (Questionnaires) ; Statistical Analysis ; Surveys</subject><ispartof>Journal of educational and behavioral statistics, 2023-06, Vol.48 (3), p.271-295</ispartof><rights>2022 AERA</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c334t-a24fe86b14e321d33f56a00c834de6b44b7287b0fd9b6e91a68c22be2c51c3733</citedby><cites>FETCH-LOGICAL-c334t-a24fe86b14e321d33f56a00c834de6b44b7287b0fd9b6e91a68c22be2c51c3733</cites><orcidid>0000-0001-8707-7374</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.3102/10769986221141074$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.3102/10769986221141074$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,776,780,21798,27901,27902,43597,43598</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1376611$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Si, Yajuan</creatorcontrib><creatorcontrib>Little, Roderick J. A.</creatorcontrib><creatorcontrib>Mo, Ya</creatorcontrib><creatorcontrib>Sedransk, Nell</creatorcontrib><title>A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys</title><title>Journal of educational and behavioral statistics</title><description>Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software.</description><subject>Bias</subject><subject>Children</subject><subject>Educational Assessment</subject><subject>Educational evaluation</subject><subject>Educational tests & measurements</subject><subject>Longitudinal Studies</subject><subject>Prediction</subject><subject>Research Problems</subject><subject>Response Rates (Questionnaires)</subject><subject>Statistical Analysis</subject><subject>Surveys</subject><issn>1076-9986</issn><issn>1935-1054</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp1UEtPwzAMjhBIjMcP4IAUiXNHnKRpexzTeE5wGJyrNHVRp60dcYvUf0-mIjggTra_ly0zdgFiqkDIaxCJybLUSAmgw6AP2AQyFUcgYn0Y-sBHe8ExOyFaCwFKajVhTzM-t4R81fXlwNuKP7eNR9q1TQBvakt81tjNQDXxuuGLsne2q9sA8RkREm2x6fiq95840Bk7quyG8Py7nrK328Xr_D5avtw9zGfLyCmlu8hKXWFqCtCoJJRKVbGxQrhU6RJNoXWRyDQpRFVmhcEMrEmdlAVKF4NTiVKn7GrM3fn2o0fq8nXb-3AT5TIVaWxEliVBBaPK-ZbIY5XvfL21fshB5Puf5X9-FjyXowd97X70i0dQiTEAgZ-OPNl3_N36f-AXfvJz7A</recordid><startdate>202306</startdate><enddate>202306</enddate><creator>Si, Yajuan</creator><creator>Little, Roderick J. A.</creator><creator>Mo, Ya</creator><creator>Sedransk, Nell</creator><general>SAGE Publications</general><general>American Educational Research Association</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-8707-7374</orcidid></search><sort><creationdate>202306</creationdate><title>A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys</title><author>Si, Yajuan ; Little, Roderick J. A. ; Mo, Ya ; Sedransk, Nell</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c334t-a24fe86b14e321d33f56a00c834de6b44b7287b0fd9b6e91a68c22be2c51c3733</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Bias</topic><topic>Children</topic><topic>Educational Assessment</topic><topic>Educational evaluation</topic><topic>Educational tests & measurements</topic><topic>Longitudinal Studies</topic><topic>Prediction</topic><topic>Research Problems</topic><topic>Response Rates (Questionnaires)</topic><topic>Statistical Analysis</topic><topic>Surveys</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Si, Yajuan</creatorcontrib><creatorcontrib>Little, Roderick J. A.</creatorcontrib><creatorcontrib>Mo, Ya</creatorcontrib><creatorcontrib>Sedransk, Nell</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Journal of educational and behavioral statistics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Si, Yajuan</au><au>Little, Roderick J. A.</au><au>Mo, Ya</au><au>Sedransk, Nell</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1376611</ericid><atitle>A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys</atitle><jtitle>Journal of educational and behavioral statistics</jtitle><date>2023-06</date><risdate>2023</risdate><volume>48</volume><issue>3</issue><spage>271</spage><epage>295</epage><pages>271-295</pages><issn>1076-9986</issn><eissn>1935-1054</eissn><abstract>Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software.</abstract><cop>Los Angeles, CA</cop><pub>SAGE Publications</pub><doi>10.3102/10769986221141074</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0001-8707-7374</orcidid></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1076-9986 |
| ispartof | Journal of educational and behavioral statistics, 2023-06, Vol.48 (3), p.271-295 |
| issn | 1076-9986 1935-1054 |
| language | eng |
| recordid | cdi_proquest_journals_2808560997 |
| source | SAGE Complete; Alma/SFX Local Collection |
| subjects | Bias Children Educational Assessment Educational evaluation Educational tests & measurements Longitudinal Studies Prediction Research Problems Response Rates (Questionnaires) Statistical Analysis Surveys |
| title | A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-18T23%3A14%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Case%20Study%20of%20Nonresponse%20Bias%20Analysis%20in%20Educational%20Assessment%20Surveys&rft.jtitle=Journal%20of%20educational%20and%20behavioral%20statistics&rft.au=Si,%20Yajuan&rft.date=2023-06&rft.volume=48&rft.issue=3&rft.spage=271&rft.epage=295&rft.pages=271-295&rft.issn=1076-9986&rft.eissn=1935-1054&rft_id=info:doi/10.3102/10769986221141074&rft_dat=%3Cproquest_cross%3E2808560997%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2808560997&rft_id=info:pmid/&rft_ericid=EJ1376611&rft_sage_id=10.3102_10769986221141074&rfr_iscdi=true |