Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener

The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% f...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:School psychology quarterly 2018-09, Vol.33 (3), p.399-407
Hauptverfasser: Lambert, Matthew C, January, Stacy-Ann A, Cress, Cynthia J, Epstein, Michael H, Cullinan, Douglas
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 407
container_issue 3
container_start_page 399
container_title School psychology quarterly
container_volume 33
creator Lambert, Matthew C
January, Stacy-Ann A
Cress, Cynthia J
Epstein, Michael H
Cullinan, Douglas
description The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds. Impact and Implications This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.
doi_str_mv 10.1037/spq0000224
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1934283511</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1191894</ericid><sourcerecordid>1933974772</sourcerecordid><originalsourceid>FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</originalsourceid><addsrcrecordid>eNp9kctrFTEUxoMo9qEb90rATVFG85wky9re2kpB8LEOmcwZb8q8mmQK979vxlsruDBZ5HF-50vO-RB6RckHSrj6mOZbUgZj4gk6pIabisqaPC17ImTFNScH6CilG0LKvTbP0QHTWiqp9SFy56HrIMKYg-vxVYYBXyyjz2Eaw_gLn_o4pYS_OQ_YjS3e5O0YfMg73E0R5y3gzTCtcEle459g6-7CFMvxu48AI8QX6Fnn-gQvH9Zj9PNi8-Pssrr--vnq7PS6cqJWufKirUFo3kjiCPdMMEV4oxvpvKRKeCmEaFntBK1Va5qmlCZaSkUjXKebmvBjdLLXneN0u0DKdgjJQ9-7EaYl2dIYwTSXlBb07T_ozbTEUkOyjFJjBKs1-x9VtLhRQqmVerenfncqQmfnGAYXd5YSu9pj_9pT4DcPkkszQPuI_vGjAK_3AMTgH8ObL-VXVJtV4P0-7mZn57TzLubge0h-iauJ62OWc1umMfweLYyhiA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1933974772</pqid></control><display><type>article</type><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><source>APA PsycARTICLES</source><creator>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas</creator><contributor>Gilman, Richard C</contributor><creatorcontrib>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas ; Gilman, Richard C</creatorcontrib><description>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds. Impact and Implications This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</description><identifier>ISSN: 1045-3830</identifier><identifier>ISSN: 2578-4218</identifier><identifier>EISSN: 1939-1560</identifier><identifier>EISSN: 2578-4226</identifier><identifier>DOI: 10.1037/spq0000224</identifier><identifier>PMID: 28857588</identifier><language>eng</language><publisher>United States: Educational Publishing Foundation</publisher><subject>African American Students ; African Americans ; At Risk Students ; Behavior Problems ; Behavioral Assessment ; Behavioral psychology ; Differential Item Functioning ; Elementary School Students ; Elementary School Teachers ; Emotional Disturbances ; Emotional Problems ; Emotions ; Ethnic Groups ; Ethnic Identity ; Ethnicity ; Female ; Gender Differences ; Grade 1 ; Hispanic American Students ; Human ; Item Analysis (Test) ; Item Response Theory ; Male ; Measurement Invariance ; Minority Group Students ; Race ; Racial and Ethnic Differences ; Racial and Ethnic Groups ; Scores ; Screening Tests ; Teachers ; Test Bias ; White Students</subject><ispartof>School psychology quarterly, 2018-09, Vol.33 (3), p.399-407</ispartof><rights>2017 American Psychological Association</rights><rights>(c) 2018 APA, all rights reserved).</rights><rights>2017, American Psychological Association</rights><rights>Copyright American Psychological Association Sep 2018</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</citedby><orcidid>0000-0001-9483-4214</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1191894$$DView record in ERIC$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28857588$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Gilman, Richard C</contributor><creatorcontrib>Lambert, Matthew C</creatorcontrib><creatorcontrib>January, Stacy-Ann A</creatorcontrib><creatorcontrib>Cress, Cynthia J</creatorcontrib><creatorcontrib>Epstein, Michael H</creatorcontrib><creatorcontrib>Cullinan, Douglas</creatorcontrib><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><title>School psychology quarterly</title><addtitle>Sch Psychol Q</addtitle><description>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds. Impact and Implications This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</description><subject>African American Students</subject><subject>African Americans</subject><subject>At Risk Students</subject><subject>Behavior Problems</subject><subject>Behavioral Assessment</subject><subject>Behavioral psychology</subject><subject>Differential Item Functioning</subject><subject>Elementary School Students</subject><subject>Elementary School Teachers</subject><subject>Emotional Disturbances</subject><subject>Emotional Problems</subject><subject>Emotions</subject><subject>Ethnic Groups</subject><subject>Ethnic Identity</subject><subject>Ethnicity</subject><subject>Female</subject><subject>Gender Differences</subject><subject>Grade 1</subject><subject>Hispanic American Students</subject><subject>Human</subject><subject>Item Analysis (Test)</subject><subject>Item Response Theory</subject><subject>Male</subject><subject>Measurement Invariance</subject><subject>Minority Group Students</subject><subject>Race</subject><subject>Racial and Ethnic Differences</subject><subject>Racial and Ethnic Groups</subject><subject>Scores</subject><subject>Screening Tests</subject><subject>Teachers</subject><subject>Test Bias</subject><subject>White Students</subject><issn>1045-3830</issn><issn>2578-4218</issn><issn>1939-1560</issn><issn>2578-4226</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><recordid>eNp9kctrFTEUxoMo9qEb90rATVFG85wky9re2kpB8LEOmcwZb8q8mmQK979vxlsruDBZ5HF-50vO-RB6RckHSrj6mOZbUgZj4gk6pIabisqaPC17ImTFNScH6CilG0LKvTbP0QHTWiqp9SFy56HrIMKYg-vxVYYBXyyjz2Eaw_gLn_o4pYS_OQ_YjS3e5O0YfMg73E0R5y3gzTCtcEle459g6-7CFMvxu48AI8QX6Fnn-gQvH9Zj9PNi8-Pssrr--vnq7PS6cqJWufKirUFo3kjiCPdMMEV4oxvpvKRKeCmEaFntBK1Va5qmlCZaSkUjXKebmvBjdLLXneN0u0DKdgjJQ9-7EaYl2dIYwTSXlBb07T_ozbTEUkOyjFJjBKs1-x9VtLhRQqmVerenfncqQmfnGAYXd5YSu9pj_9pT4DcPkkszQPuI_vGjAK_3AMTgH8ObL-VXVJtV4P0-7mZn57TzLubge0h-iauJ62OWc1umMfweLYyhiA</recordid><startdate>201809</startdate><enddate>201809</enddate><creator>Lambert, Matthew C</creator><creator>January, Stacy-Ann A</creator><creator>Cress, Cynthia J</creator><creator>Epstein, Michael H</creator><creator>Cullinan, Douglas</creator><general>Educational Publishing Foundation</general><general>American Psychological Association</general><general>Guilford Publications</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0001-9483-4214</orcidid></search><sort><creationdate>201809</creationdate><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><author>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>African American Students</topic><topic>African Americans</topic><topic>At Risk Students</topic><topic>Behavior Problems</topic><topic>Behavioral Assessment</topic><topic>Behavioral psychology</topic><topic>Differential Item Functioning</topic><topic>Elementary School Students</topic><topic>Elementary School Teachers</topic><topic>Emotional Disturbances</topic><topic>Emotional Problems</topic><topic>Emotions</topic><topic>Ethnic Groups</topic><topic>Ethnic Identity</topic><topic>Ethnicity</topic><topic>Female</topic><topic>Gender Differences</topic><topic>Grade 1</topic><topic>Hispanic American Students</topic><topic>Human</topic><topic>Item Analysis (Test)</topic><topic>Item Response Theory</topic><topic>Male</topic><topic>Measurement Invariance</topic><topic>Minority Group Students</topic><topic>Race</topic><topic>Racial and Ethnic Differences</topic><topic>Racial and Ethnic Groups</topic><topic>Scores</topic><topic>Screening Tests</topic><topic>Teachers</topic><topic>Test Bias</topic><topic>White Students</topic><toplevel>online_resources</toplevel><creatorcontrib>Lambert, Matthew C</creatorcontrib><creatorcontrib>January, Stacy-Ann A</creatorcontrib><creatorcontrib>Cress, Cynthia J</creatorcontrib><creatorcontrib>Epstein, Michael H</creatorcontrib><creatorcontrib>Cullinan, Douglas</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>PsycARTICLES (ProQuest)</collection><collection>ProQuest One Psychology</collection><collection>MEDLINE - Academic</collection><jtitle>School psychology quarterly</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lambert, Matthew C</au><au>January, Stacy-Ann A</au><au>Cress, Cynthia J</au><au>Epstein, Michael H</au><au>Cullinan, Douglas</au><au>Gilman, Richard C</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1191894</ericid><atitle>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</atitle><jtitle>School psychology quarterly</jtitle><addtitle>Sch Psychol Q</addtitle><date>2018-09</date><risdate>2018</risdate><volume>33</volume><issue>3</issue><spage>399</spage><epage>407</epage><pages>399-407</pages><issn>1045-3830</issn><issn>2578-4218</issn><eissn>1939-1560</eissn><eissn>2578-4226</eissn><abstract>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds. Impact and Implications This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</abstract><cop>United States</cop><pub>Educational Publishing Foundation</pub><pmid>28857588</pmid><doi>10.1037/spq0000224</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0001-9483-4214</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1045-3830
ispartof School psychology quarterly, 2018-09, Vol.33 (3), p.399-407
issn 1045-3830
2578-4218
1939-1560
2578-4226
language eng
recordid cdi_proquest_miscellaneous_1934283511
source APA PsycARTICLES
subjects African American Students
African Americans
At Risk Students
Behavior Problems
Behavioral Assessment
Behavioral psychology
Differential Item Functioning
Elementary School Students
Elementary School Teachers
Emotional Disturbances
Emotional Problems
Emotions
Ethnic Groups
Ethnic Identity
Ethnicity
Female
Gender Differences
Grade 1
Hispanic American Students
Human
Item Analysis (Test)
Item Response Theory
Male
Measurement Invariance
Minority Group Students
Race
Racial and Ethnic Differences
Racial and Ethnic Groups
Scores
Screening Tests
Teachers
Test Bias
White Students
title Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-25T03%3A25%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Differential%20Item%20Functioning%20Across%20Race%20and%20Ethnicity%20for%20the%20Emotional%20and%20Behavioral%20Screener&rft.jtitle=School%20psychology%20quarterly&rft.au=Lambert,%20Matthew%20C&rft.date=2018-09&rft.volume=33&rft.issue=3&rft.spage=399&rft.epage=407&rft.pages=399-407&rft.issn=1045-3830&rft.eissn=1939-1560&rft_id=info:doi/10.1037/spq0000224&rft_dat=%3Cproquest_cross%3E1933974772%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1933974772&rft_id=info:pmid/28857588&rft_ericid=EJ1191894&rfr_iscdi=true