Models for Value-Added Modeling of Teacher Effects

The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of educational and behavioral statistics 2004, Vol.29 (1), p.67-101
Hauptverfasser: McCaffrey, Daniel F., Lockwood, J. R., Koretz, Daniel, Louis, Thomas A., Hamilton, Laura
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 101
container_issue 1
container_start_page 67
container_title Journal of educational and behavioral statistics
container_volume 29
creator McCaffrey, Daniel F.
Lockwood, J. R.
Koretz, Daniel
Louis, Thomas A.
Hamilton, Laura
description The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures inherent to longitudinal student data linked to teachers. We summarize the principal existing modeling approaches, show how these approaches are special cases of the proposed model, and discuss possible extensions to model more complex data structures. We present simulation and analytical results that clarify the interplay between estimated teacher effects and repeated outcomes on students over time. We also explore the potential impact of model misspecifications, including missing student covariates and assumptions about the accumulation of teacher effects over time, on key inferences made from the models. We conclude that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations. However, student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.
doi_str_mv 10.3102/10769986029001067
format Article
fullrecord <record><control><sourceid>jstor_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_2743034</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ727500</ericid><jstor_id>3701307</jstor_id><sage_id>10.3102_10769986029001067</sage_id><sourcerecordid>3701307</sourcerecordid><originalsourceid>FETCH-LOGICAL-c505t-1658f4749f6ca678fef23057965d161b45b0baaa47110a885514de4a01ee9b7f3</originalsourceid><addsrcrecordid>eNp9kU1r3DAQhkVoSdK0PyBQiumpFycz-rQvhRC2X6TkkvYqZHu08eK1EskO9N9X2102aQM9jZj3mVczvIydIpwJBH6OYHRdVxp4DYCgzQE7xlqoEkHJF_md9XIDHLFXKa0yI7gUh-wIa6M0l9Ux499DR0MqfIjFTzfMVF50HXXFn3Y_Lovgixty7S3FYuE9tVN6zV56NyR6s6sn7Menxc3ll_Lq-vPXy4urslWgphK1qrw0sva6ddpUnjwXoEytVYcaG6kaaJxz0iCCqyqlUHYkHSBR3RgvTtjHre_d3Kypa2mcohvsXezXLv6ywfX2b2Xsb-0yPFhupAAhs8GHnUEM9zOlya771NIwuJHCnCxWQikpNdcZff8PugpzHPN5lqMWpjJiA-EWamNIKZLf74JgN4HYZ4HkmXdPj3ic2CWQgbdbgGLf7uXFN8ONAsjy2VZObkmPS_3vw53fKk0h7g2FyeGDEb8BIoqjOg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>216378736</pqid></control><display><type>article</type><title>Models for Value-Added Modeling of Teacher Effects</title><source>Access via SAGE</source><source>JSTOR Mathematics &amp; Statistics</source><source>JSTOR Archive Collection A-Z Listing</source><source>Alma/SFX Local Collection</source><creator>McCaffrey, Daniel F. ; Lockwood, J. R. ; Koretz, Daniel ; Louis, Thomas A. ; Hamilton, Laura</creator><creatorcontrib>McCaffrey, Daniel F. ; Lockwood, J. R. ; Koretz, Daniel ; Louis, Thomas A. ; Hamilton, Laura</creatorcontrib><description>The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures inherent to longitudinal student data linked to teachers. We summarize the principal existing modeling approaches, show how these approaches are special cases of the proposed model, and discuss possible extensions to model more complex data structures. We present simulation and analytical results that clarify the interplay between estimated teacher effects and repeated outcomes on students over time. We also explore the potential impact of model misspecifications, including missing student covariates and assumptions about the accumulation of teacher effects over time, on key inferences made from the models. We conclude that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations. However, student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.</description><identifier>ISSN: 1076-9986</identifier><identifier>EISSN: 1935-1054</identifier><identifier>DOI: 10.3102/10769986029001067</identifier><identifier>PMID: 19756248</identifier><language>eng</language><publisher>Los Angeles, CA: American Educational Research Association and American Statistical Association</publisher><subject>Charter schools ; Correlation ; Correlations ; Data models ; Effectiveness ; Elementary schools ; Estimates ; Learning ; Longitudinal Studies ; Mathematical Models ; Modeling ; Multilevel models ; Multivariate Analysis ; Outcomes of Education ; Parametric models ; School Effectiveness ; Statistical variance ; Student Characteristics ; Student Development ; Students ; Studies ; Teacher Effectiveness ; Teacher Evaluation ; Teacher Influence ; Teachers ; Test scores ; Value Added Models</subject><ispartof>Journal of educational and behavioral statistics, 2004, Vol.29 (1), p.67-101</ispartof><rights>Copyright 2003 American Educational Research Association and the American Statistical Association</rights><rights>Copyright American Educational Research Association Spring 2004</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c505t-1658f4749f6ca678fef23057965d161b45b0baaa47110a885514de4a01ee9b7f3</citedby><cites>FETCH-LOGICAL-c505t-1658f4749f6ca678fef23057965d161b45b0baaa47110a885514de4a01ee9b7f3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/3701307$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/3701307$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>230,314,780,784,803,832,885,4024,21819,27923,27924,27925,43621,43622,58017,58021,58250,58254</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ727500$$DView record in ERIC$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/19756248$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>McCaffrey, Daniel F.</creatorcontrib><creatorcontrib>Lockwood, J. R.</creatorcontrib><creatorcontrib>Koretz, Daniel</creatorcontrib><creatorcontrib>Louis, Thomas A.</creatorcontrib><creatorcontrib>Hamilton, Laura</creatorcontrib><title>Models for Value-Added Modeling of Teacher Effects</title><title>Journal of educational and behavioral statistics</title><addtitle>J Educ Behav Stat</addtitle><description>The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures inherent to longitudinal student data linked to teachers. We summarize the principal existing modeling approaches, show how these approaches are special cases of the proposed model, and discuss possible extensions to model more complex data structures. We present simulation and analytical results that clarify the interplay between estimated teacher effects and repeated outcomes on students over time. We also explore the potential impact of model misspecifications, including missing student covariates and assumptions about the accumulation of teacher effects over time, on key inferences made from the models. We conclude that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations. However, student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.</description><subject>Charter schools</subject><subject>Correlation</subject><subject>Correlations</subject><subject>Data models</subject><subject>Effectiveness</subject><subject>Elementary schools</subject><subject>Estimates</subject><subject>Learning</subject><subject>Longitudinal Studies</subject><subject>Mathematical Models</subject><subject>Modeling</subject><subject>Multilevel models</subject><subject>Multivariate Analysis</subject><subject>Outcomes of Education</subject><subject>Parametric models</subject><subject>School Effectiveness</subject><subject>Statistical variance</subject><subject>Student Characteristics</subject><subject>Student Development</subject><subject>Students</subject><subject>Studies</subject><subject>Teacher Effectiveness</subject><subject>Teacher Evaluation</subject><subject>Teacher Influence</subject><subject>Teachers</subject><subject>Test scores</subject><subject>Value Added Models</subject><issn>1076-9986</issn><issn>1935-1054</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2004</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9kU1r3DAQhkVoSdK0PyBQiumpFycz-rQvhRC2X6TkkvYqZHu08eK1EskO9N9X2102aQM9jZj3mVczvIydIpwJBH6OYHRdVxp4DYCgzQE7xlqoEkHJF_md9XIDHLFXKa0yI7gUh-wIa6M0l9Ux499DR0MqfIjFTzfMVF50HXXFn3Y_Lovgixty7S3FYuE9tVN6zV56NyR6s6sn7Menxc3ll_Lq-vPXy4urslWgphK1qrw0sva6ddpUnjwXoEytVYcaG6kaaJxz0iCCqyqlUHYkHSBR3RgvTtjHre_d3Kypa2mcohvsXezXLv6ywfX2b2Xsb-0yPFhupAAhs8GHnUEM9zOlya771NIwuJHCnCxWQikpNdcZff8PugpzHPN5lqMWpjJiA-EWamNIKZLf74JgN4HYZ4HkmXdPj3ic2CWQgbdbgGLf7uXFN8ONAsjy2VZObkmPS_3vw53fKk0h7g2FyeGDEb8BIoqjOg</recordid><startdate>2004</startdate><enddate>2004</enddate><creator>McCaffrey, Daniel F.</creator><creator>Lockwood, J. R.</creator><creator>Koretz, Daniel</creator><creator>Louis, Thomas A.</creator><creator>Hamilton, Laura</creator><general>American Educational Research Association and American Statistical Association</general><general>SAGE Publications</general><general>American Educational Research Association</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7XB</scope><scope>88B</scope><scope>88G</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>M0P</scope><scope>M2M</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>S0X</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>2004</creationdate><title>Models for Value-Added Modeling of Teacher Effects</title><author>McCaffrey, Daniel F. ; Lockwood, J. R. ; Koretz, Daniel ; Louis, Thomas A. ; Hamilton, Laura</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c505t-1658f4749f6ca678fef23057965d161b45b0baaa47110a885514de4a01ee9b7f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2004</creationdate><topic>Charter schools</topic><topic>Correlation</topic><topic>Correlations</topic><topic>Data models</topic><topic>Effectiveness</topic><topic>Elementary schools</topic><topic>Estimates</topic><topic>Learning</topic><topic>Longitudinal Studies</topic><topic>Mathematical Models</topic><topic>Modeling</topic><topic>Multilevel models</topic><topic>Multivariate Analysis</topic><topic>Outcomes of Education</topic><topic>Parametric models</topic><topic>School Effectiveness</topic><topic>Statistical variance</topic><topic>Student Characteristics</topic><topic>Student Development</topic><topic>Students</topic><topic>Studies</topic><topic>Teacher Effectiveness</topic><topic>Teacher Evaluation</topic><topic>Teacher Influence</topic><topic>Teachers</topic><topic>Test scores</topic><topic>Value Added Models</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>McCaffrey, Daniel F.</creatorcontrib><creatorcontrib>Lockwood, J. R.</creatorcontrib><creatorcontrib>Koretz, Daniel</creatorcontrib><creatorcontrib>Louis, Thomas A.</creatorcontrib><creatorcontrib>Hamilton, Laura</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Education Database</collection><collection>Psychology Database</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>SIRS Editorial</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Journal of educational and behavioral statistics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>McCaffrey, Daniel F.</au><au>Lockwood, J. R.</au><au>Koretz, Daniel</au><au>Louis, Thomas A.</au><au>Hamilton, Laura</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ727500</ericid><atitle>Models for Value-Added Modeling of Teacher Effects</atitle><jtitle>Journal of educational and behavioral statistics</jtitle><addtitle>J Educ Behav Stat</addtitle><date>2004</date><risdate>2004</risdate><volume>29</volume><issue>1</issue><spage>67</spage><epage>101</epage><pages>67-101</pages><issn>1076-9986</issn><eissn>1935-1054</eissn><abstract>The use of complex value-added models that attempt to isolate the contributions of teachers or schools to student development is increasing. Several variations on these models are being applied in the research literature, and policy makers have expressed interest in using these models for evaluating teachers and schools. In this article, we present a general multivariate, longitudinal mixed-model that incorporates the complex grouping structures inherent to longitudinal student data linked to teachers. We summarize the principal existing modeling approaches, show how these approaches are special cases of the proposed model, and discuss possible extensions to model more complex data structures. We present simulation and analytical results that clarify the interplay between estimated teacher effects and repeated outcomes on students over time. We also explore the potential impact of model misspecifications, including missing student covariates and assumptions about the accumulation of teacher effects over time, on key inferences made from the models. We conclude that mixed models that account for student correlation over time are reasonably robust to such misspecifications when all the schools in the sample serve similar student populations. However, student characteristics are likely to confound estimated teacher effects when schools serve distinctly different populations.</abstract><cop>Los Angeles, CA</cop><pub>American Educational Research Association and American Statistical Association</pub><pmid>19756248</pmid><doi>10.3102/10769986029001067</doi><tpages>35</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1076-9986
ispartof Journal of educational and behavioral statistics, 2004, Vol.29 (1), p.67-101
issn 1076-9986
1935-1054
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_2743034
source Access via SAGE; JSTOR Mathematics & Statistics; JSTOR Archive Collection A-Z Listing; Alma/SFX Local Collection
subjects Charter schools
Correlation
Correlations
Data models
Effectiveness
Elementary schools
Estimates
Learning
Longitudinal Studies
Mathematical Models
Modeling
Multilevel models
Multivariate Analysis
Outcomes of Education
Parametric models
School Effectiveness
Statistical variance
Student Characteristics
Student Development
Students
Studies
Teacher Effectiveness
Teacher Evaluation
Teacher Influence
Teachers
Test scores
Value Added Models
title Models for Value-Added Modeling of Teacher Effects
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-23T11%3A38%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Models%20for%20Value-Added%20Modeling%20of%20Teacher%20Effects&rft.jtitle=Journal%20of%20educational%20and%20behavioral%20statistics&rft.au=McCaffrey,%20Daniel%20F.&rft.date=2004&rft.volume=29&rft.issue=1&rft.spage=67&rft.epage=101&rft.pages=67-101&rft.issn=1076-9986&rft.eissn=1935-1054&rft_id=info:doi/10.3102/10769986029001067&rft_dat=%3Cjstor_pubme%3E3701307%3C/jstor_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=216378736&rft_id=info:pmid/19756248&rft_ericid=EJ727500&rft_jstor_id=3701307&rft_sage_id=10.3102_10769986029001067&rfr_iscdi=true