Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener
The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% f...
Gespeichert in:
Veröffentlicht in: | School psychology quarterly 2018-09, Vol.33 (3), p.399-407 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 407 |
---|---|
container_issue | 3 |
container_start_page | 399 |
container_title | School psychology quarterly |
container_volume | 33 |
creator | Lambert, Matthew C January, Stacy-Ann A Cress, Cynthia J Epstein, Michael H Cullinan, Douglas |
description | The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.
Impact and Implications
This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal. |
doi_str_mv | 10.1037/spq0000224 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1934283511</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1191894</ericid><sourcerecordid>1933974772</sourcerecordid><originalsourceid>FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</originalsourceid><addsrcrecordid>eNp9kctrFTEUxoMo9qEb90rATVFG85wky9re2kpB8LEOmcwZb8q8mmQK979vxlsruDBZ5HF-50vO-RB6RckHSrj6mOZbUgZj4gk6pIabisqaPC17ImTFNScH6CilG0LKvTbP0QHTWiqp9SFy56HrIMKYg-vxVYYBXyyjz2Eaw_gLn_o4pYS_OQ_YjS3e5O0YfMg73E0R5y3gzTCtcEle459g6-7CFMvxu48AI8QX6Fnn-gQvH9Zj9PNi8-Pssrr--vnq7PS6cqJWufKirUFo3kjiCPdMMEV4oxvpvKRKeCmEaFntBK1Va5qmlCZaSkUjXKebmvBjdLLXneN0u0DKdgjJQ9-7EaYl2dIYwTSXlBb07T_ozbTEUkOyjFJjBKs1-x9VtLhRQqmVerenfncqQmfnGAYXd5YSu9pj_9pT4DcPkkszQPuI_vGjAK_3AMTgH8ObL-VXVJtV4P0-7mZn57TzLubge0h-iauJ62OWc1umMfweLYyhiA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1933974772</pqid></control><display><type>article</type><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><source>APA PsycARTICLES</source><creator>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas</creator><contributor>Gilman, Richard C</contributor><creatorcontrib>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas ; Gilman, Richard C</creatorcontrib><description>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.
Impact and Implications
This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</description><identifier>ISSN: 1045-3830</identifier><identifier>ISSN: 2578-4218</identifier><identifier>EISSN: 1939-1560</identifier><identifier>EISSN: 2578-4226</identifier><identifier>DOI: 10.1037/spq0000224</identifier><identifier>PMID: 28857588</identifier><language>eng</language><publisher>United States: Educational Publishing Foundation</publisher><subject>African American Students ; African Americans ; At Risk Students ; Behavior Problems ; Behavioral Assessment ; Behavioral psychology ; Differential Item Functioning ; Elementary School Students ; Elementary School Teachers ; Emotional Disturbances ; Emotional Problems ; Emotions ; Ethnic Groups ; Ethnic Identity ; Ethnicity ; Female ; Gender Differences ; Grade 1 ; Hispanic American Students ; Human ; Item Analysis (Test) ; Item Response Theory ; Male ; Measurement Invariance ; Minority Group Students ; Race ; Racial and Ethnic Differences ; Racial and Ethnic Groups ; Scores ; Screening Tests ; Teachers ; Test Bias ; White Students</subject><ispartof>School psychology quarterly, 2018-09, Vol.33 (3), p.399-407</ispartof><rights>2017 American Psychological Association</rights><rights>(c) 2018 APA, all rights reserved).</rights><rights>2017, American Psychological Association</rights><rights>Copyright American Psychological Association Sep 2018</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</citedby><orcidid>0000-0001-9483-4214</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1191894$$DView record in ERIC$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28857588$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Gilman, Richard C</contributor><creatorcontrib>Lambert, Matthew C</creatorcontrib><creatorcontrib>January, Stacy-Ann A</creatorcontrib><creatorcontrib>Cress, Cynthia J</creatorcontrib><creatorcontrib>Epstein, Michael H</creatorcontrib><creatorcontrib>Cullinan, Douglas</creatorcontrib><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><title>School psychology quarterly</title><addtitle>Sch Psychol Q</addtitle><description>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.
Impact and Implications
This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</description><subject>African American Students</subject><subject>African Americans</subject><subject>At Risk Students</subject><subject>Behavior Problems</subject><subject>Behavioral Assessment</subject><subject>Behavioral psychology</subject><subject>Differential Item Functioning</subject><subject>Elementary School Students</subject><subject>Elementary School Teachers</subject><subject>Emotional Disturbances</subject><subject>Emotional Problems</subject><subject>Emotions</subject><subject>Ethnic Groups</subject><subject>Ethnic Identity</subject><subject>Ethnicity</subject><subject>Female</subject><subject>Gender Differences</subject><subject>Grade 1</subject><subject>Hispanic American Students</subject><subject>Human</subject><subject>Item Analysis (Test)</subject><subject>Item Response Theory</subject><subject>Male</subject><subject>Measurement Invariance</subject><subject>Minority Group Students</subject><subject>Race</subject><subject>Racial and Ethnic Differences</subject><subject>Racial and Ethnic Groups</subject><subject>Scores</subject><subject>Screening Tests</subject><subject>Teachers</subject><subject>Test Bias</subject><subject>White Students</subject><issn>1045-3830</issn><issn>2578-4218</issn><issn>1939-1560</issn><issn>2578-4226</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><recordid>eNp9kctrFTEUxoMo9qEb90rATVFG85wky9re2kpB8LEOmcwZb8q8mmQK979vxlsruDBZ5HF-50vO-RB6RckHSrj6mOZbUgZj4gk6pIabisqaPC17ImTFNScH6CilG0LKvTbP0QHTWiqp9SFy56HrIMKYg-vxVYYBXyyjz2Eaw_gLn_o4pYS_OQ_YjS3e5O0YfMg73E0R5y3gzTCtcEle459g6-7CFMvxu48AI8QX6Fnn-gQvH9Zj9PNi8-Pssrr--vnq7PS6cqJWufKirUFo3kjiCPdMMEV4oxvpvKRKeCmEaFntBK1Va5qmlCZaSkUjXKebmvBjdLLXneN0u0DKdgjJQ9-7EaYl2dIYwTSXlBb07T_ozbTEUkOyjFJjBKs1-x9VtLhRQqmVerenfncqQmfnGAYXd5YSu9pj_9pT4DcPkkszQPuI_vGjAK_3AMTgH8ObL-VXVJtV4P0-7mZn57TzLubge0h-iauJ62OWc1umMfweLYyhiA</recordid><startdate>201809</startdate><enddate>201809</enddate><creator>Lambert, Matthew C</creator><creator>January, Stacy-Ann A</creator><creator>Cress, Cynthia J</creator><creator>Epstein, Michael H</creator><creator>Cullinan, Douglas</creator><general>Educational Publishing Foundation</general><general>American Psychological Association</general><general>Guilford Publications</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0001-9483-4214</orcidid></search><sort><creationdate>201809</creationdate><title>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</title><author>Lambert, Matthew C ; January, Stacy-Ann A ; Cress, Cynthia J ; Epstein, Michael H ; Cullinan, Douglas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a467t-c4d6e483b50a03c242703b8b5ac5174c5444d26a4167d9bb0454d114b4af8b603</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>African American Students</topic><topic>African Americans</topic><topic>At Risk Students</topic><topic>Behavior Problems</topic><topic>Behavioral Assessment</topic><topic>Behavioral psychology</topic><topic>Differential Item Functioning</topic><topic>Elementary School Students</topic><topic>Elementary School Teachers</topic><topic>Emotional Disturbances</topic><topic>Emotional Problems</topic><topic>Emotions</topic><topic>Ethnic Groups</topic><topic>Ethnic Identity</topic><topic>Ethnicity</topic><topic>Female</topic><topic>Gender Differences</topic><topic>Grade 1</topic><topic>Hispanic American Students</topic><topic>Human</topic><topic>Item Analysis (Test)</topic><topic>Item Response Theory</topic><topic>Male</topic><topic>Measurement Invariance</topic><topic>Minority Group Students</topic><topic>Race</topic><topic>Racial and Ethnic Differences</topic><topic>Racial and Ethnic Groups</topic><topic>Scores</topic><topic>Screening Tests</topic><topic>Teachers</topic><topic>Test Bias</topic><topic>White Students</topic><toplevel>online_resources</toplevel><creatorcontrib>Lambert, Matthew C</creatorcontrib><creatorcontrib>January, Stacy-Ann A</creatorcontrib><creatorcontrib>Cress, Cynthia J</creatorcontrib><creatorcontrib>Epstein, Michael H</creatorcontrib><creatorcontrib>Cullinan, Douglas</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>PsycARTICLES (ProQuest)</collection><collection>ProQuest One Psychology</collection><collection>MEDLINE - Academic</collection><jtitle>School psychology quarterly</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lambert, Matthew C</au><au>January, Stacy-Ann A</au><au>Cress, Cynthia J</au><au>Epstein, Michael H</au><au>Cullinan, Douglas</au><au>Gilman, Richard C</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1191894</ericid><atitle>Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener</atitle><jtitle>School psychology quarterly</jtitle><addtitle>Sch Psychol Q</addtitle><date>2018-09</date><risdate>2018</risdate><volume>33</volume><issue>3</issue><spage>399</spage><epage>407</epage><pages>399-407</pages><issn>1045-3830</issn><issn>2578-4218</issn><eissn>1939-1560</eissn><eissn>2578-4226</eissn><abstract>The objective of this study was to assess the measurement invariance of items from the Emotional and Behavioral Screener (EBS) across racial and ethnic groups and assess the impact of differential item functioning (DIF) on test scores from the EBS. Participants were 4,856 first-grade students (49% female) who were diverse with regard to race and ethnicity (45% African American, 41% Hispanic/Latino, and 14% Caucasian). Classroom teachers rated each student on the EBS during the fall semester screening window. Item response theory modeling was combined with ordinal regression to investigate the presence and impact of differential item functioning across 3 race and ethnicity groups. The findings suggest that items from the EBS exhibit small to negligible levels of DIF, and the limited DIF that was present does not significantly impact overall scores. Researchers and practitioners can have confidence that scores from the EBS are relatively unaffected by test bias when measuring the emotional and behavioral risk of young students from African American, Hispanic/Latino, or Caucasian backgrounds.
Impact and Implications
This study suggests that the scores from the Emotional and Behavioral Screener (EBS), a recently developed assessment tool, are reliable and relatively bias-free estimates of young students' risk for emotional disturbance. Although several EBS items demonstrated statistically significant differential functioning between Caucasian, African American and Hispanic students, the impact of item-level DIF on test scores was minimal.</abstract><cop>United States</cop><pub>Educational Publishing Foundation</pub><pmid>28857588</pmid><doi>10.1037/spq0000224</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0001-9483-4214</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1045-3830 |
ispartof | School psychology quarterly, 2018-09, Vol.33 (3), p.399-407 |
issn | 1045-3830 2578-4218 1939-1560 2578-4226 |
language | eng |
recordid | cdi_proquest_miscellaneous_1934283511 |
source | APA PsycARTICLES |
subjects | African American Students African Americans At Risk Students Behavior Problems Behavioral Assessment Behavioral psychology Differential Item Functioning Elementary School Students Elementary School Teachers Emotional Disturbances Emotional Problems Emotions Ethnic Groups Ethnic Identity Ethnicity Female Gender Differences Grade 1 Hispanic American Students Human Item Analysis (Test) Item Response Theory Male Measurement Invariance Minority Group Students Race Racial and Ethnic Differences Racial and Ethnic Groups Scores Screening Tests Teachers Test Bias White Students |
title | Differential Item Functioning Across Race and Ethnicity for the Emotional and Behavioral Screener |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-25T03%3A25%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Differential%20Item%20Functioning%20Across%20Race%20and%20Ethnicity%20for%20the%20Emotional%20and%20Behavioral%20Screener&rft.jtitle=School%20psychology%20quarterly&rft.au=Lambert,%20Matthew%20C&rft.date=2018-09&rft.volume=33&rft.issue=3&rft.spage=399&rft.epage=407&rft.pages=399-407&rft.issn=1045-3830&rft.eissn=1939-1560&rft_id=info:doi/10.1037/spq0000224&rft_dat=%3Cproquest_cross%3E1933974772%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1933974772&rft_id=info:pmid/28857588&rft_ericid=EJ1191894&rfr_iscdi=true |