How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods

Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance as...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Zeitschrift für Erziehungswissenschaft 2023-06, Vol.26 (3), p.601-625
Hauptverfasser: Kulgemeyer, Christoph, Riese, Josef, Vogelsang, Christoph, Buschhüter, David, Borowski, Andreas, Weißbach, Anna, Jordans, Melanie, Reinhold, Peter, Schecker, Horst
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 625
container_issue 3
container_start_page 601
container_title Zeitschrift für Erziehungswissenschaft
container_volume 26
creator Kulgemeyer, Christoph
Riese, Josef
Vogelsang, Christoph
Buschhüter, David
Borowski, Andreas
Weißbach, Anna
Jordans, Melanie
Reinhold, Peter
Schecker, Horst
description Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.
doi_str_mv 10.1007/s11618-023-01154-y
format Article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10244832</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2830216750</sourcerecordid><originalsourceid>FETCH-LOGICAL-c447t-aea16a82cdb6312a9c7cbe7f8867d66969e5b167e1be7a97722f896900a34403</originalsourceid><addsrcrecordid>eNp9kc1u1TAQhS1ERUvhBVggL9kE_BcnYYNQ-WmlSt10wc6a60zudZXEwXZuua_CimfhyXBIqcqmK9vHc74ZzSHkFWdvOWPVu8i55nXBhCwY56UqDk_ICa-1KErBy6f5rqQqtJbfjsnzGG8YK4WQ7Bk5lpUsG16zE_Lz3N9SmNMOx-SsSwfqhglsinQPvWuz8J5-wj32fnLjlsLvX4Nvsae-ownB7jBQbGcLyfmRQowY45BRFMaW4o-p92GxZTzFrsOFuzjzs3Vbl1xcjVl74B0w7XwbX5CjDvqIL-_OU3L95fP12XlxefX14uzjZWGVqlIBCFxDLWy70ZILaGxlN1h1da2rVutGN1huuK6QZxWaqhKiq7PKGEilmDwlH1bsNG8GbG2eIEBvpuAGCAfjwZn_f0a3M1u_N5wJpWopMuHNHSH47zPGZAYXLfY9jOjnaEQtmcgTlEszsZba4GMM2N334cwsoZo1VJNDNX9DNYdsev1wwnvLvxRzgVwL4rSsG4O58XMY89Iew_4Bdxazvg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2830216750</pqid></control><display><type>article</type><title>How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods</title><source>SpringerNature Journals</source><creator>Kulgemeyer, Christoph ; Riese, Josef ; Vogelsang, Christoph ; Buschhüter, David ; Borowski, Andreas ; Weißbach, Anna ; Jordans, Melanie ; Reinhold, Peter ; Schecker, Horst</creator><creatorcontrib>Kulgemeyer, Christoph ; Riese, Josef ; Vogelsang, Christoph ; Buschhüter, David ; Borowski, Andreas ; Weißbach, Anna ; Jordans, Melanie ; Reinhold, Peter ; Schecker, Horst</creatorcontrib><description>Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.</description><identifier>ISSN: 1434-663X</identifier><identifier>EISSN: 1862-5215</identifier><identifier>DOI: 10.1007/s11618-023-01154-y</identifier><identifier>PMID: 37359180</identifier><language>eng</language><publisher>Wiesbaden: Springer Fachmedien Wiesbaden</publisher><subject>Education ; Educational Policy and Politics ; Pedagogic Psychology ; Schwerpunkt ; Sociology of Education</subject><ispartof>Zeitschrift für Erziehungswissenschaft, 2023-06, Vol.26 (3), p.601-625</ispartof><rights>The Author(s) 2023</rights><rights>The Author(s) 2023.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c447t-aea16a82cdb6312a9c7cbe7f8867d66969e5b167e1be7a97722f896900a34403</citedby><cites>FETCH-LOGICAL-c447t-aea16a82cdb6312a9c7cbe7f8867d66969e5b167e1be7a97722f896900a34403</cites><orcidid>0000-0003-2927-2619 ; 0000-0002-7622-7549 ; 0000-0003-0594-250X ; 0000-0001-6659-8170 ; 0000-0002-5804-1855</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11618-023-01154-y$$EPDF$$P50$$Gspringer$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11618-023-01154-y$$EHTML$$P50$$Gspringer$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,27924,27925,41488,42557,51319</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37359180$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Kulgemeyer, Christoph</creatorcontrib><creatorcontrib>Riese, Josef</creatorcontrib><creatorcontrib>Vogelsang, Christoph</creatorcontrib><creatorcontrib>Buschhüter, David</creatorcontrib><creatorcontrib>Borowski, Andreas</creatorcontrib><creatorcontrib>Weißbach, Anna</creatorcontrib><creatorcontrib>Jordans, Melanie</creatorcontrib><creatorcontrib>Reinhold, Peter</creatorcontrib><creatorcontrib>Schecker, Horst</creatorcontrib><title>How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods</title><title>Zeitschrift für Erziehungswissenschaft</title><addtitle>Z Erziehungswiss</addtitle><addtitle>Z Erziehwiss</addtitle><description>Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.</description><subject>Education</subject><subject>Educational Policy and Politics</subject><subject>Pedagogic Psychology</subject><subject>Schwerpunkt</subject><subject>Sociology of Education</subject><issn>1434-663X</issn><issn>1862-5215</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>C6C</sourceid><recordid>eNp9kc1u1TAQhS1ERUvhBVggL9kE_BcnYYNQ-WmlSt10wc6a60zudZXEwXZuua_CimfhyXBIqcqmK9vHc74ZzSHkFWdvOWPVu8i55nXBhCwY56UqDk_ICa-1KErBy6f5rqQqtJbfjsnzGG8YK4WQ7Bk5lpUsG16zE_Lz3N9SmNMOx-SsSwfqhglsinQPvWuz8J5-wj32fnLjlsLvX4Nvsae-ownB7jBQbGcLyfmRQowY45BRFMaW4o-p92GxZTzFrsOFuzjzs3Vbl1xcjVl74B0w7XwbX5CjDvqIL-_OU3L95fP12XlxefX14uzjZWGVqlIBCFxDLWy70ZILaGxlN1h1da2rVutGN1huuK6QZxWaqhKiq7PKGEilmDwlH1bsNG8GbG2eIEBvpuAGCAfjwZn_f0a3M1u_N5wJpWopMuHNHSH47zPGZAYXLfY9jOjnaEQtmcgTlEszsZba4GMM2N334cwsoZo1VJNDNX9DNYdsev1wwnvLvxRzgVwL4rSsG4O58XMY89Iew_4Bdxazvg</recordid><startdate>20230607</startdate><enddate>20230607</enddate><creator>Kulgemeyer, Christoph</creator><creator>Riese, Josef</creator><creator>Vogelsang, Christoph</creator><creator>Buschhüter, David</creator><creator>Borowski, Andreas</creator><creator>Weißbach, Anna</creator><creator>Jordans, Melanie</creator><creator>Reinhold, Peter</creator><creator>Schecker, Horst</creator><general>Springer Fachmedien Wiesbaden</general><scope>C6C</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0003-2927-2619</orcidid><orcidid>https://orcid.org/0000-0002-7622-7549</orcidid><orcidid>https://orcid.org/0000-0003-0594-250X</orcidid><orcidid>https://orcid.org/0000-0001-6659-8170</orcidid><orcidid>https://orcid.org/0000-0002-5804-1855</orcidid></search><sort><creationdate>20230607</creationdate><title>How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods</title><author>Kulgemeyer, Christoph ; Riese, Josef ; Vogelsang, Christoph ; Buschhüter, David ; Borowski, Andreas ; Weißbach, Anna ; Jordans, Melanie ; Reinhold, Peter ; Schecker, Horst</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c447t-aea16a82cdb6312a9c7cbe7f8867d66969e5b167e1be7a97722f896900a34403</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Education</topic><topic>Educational Policy and Politics</topic><topic>Pedagogic Psychology</topic><topic>Schwerpunkt</topic><topic>Sociology of Education</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kulgemeyer, Christoph</creatorcontrib><creatorcontrib>Riese, Josef</creatorcontrib><creatorcontrib>Vogelsang, Christoph</creatorcontrib><creatorcontrib>Buschhüter, David</creatorcontrib><creatorcontrib>Borowski, Andreas</creatorcontrib><creatorcontrib>Weißbach, Anna</creatorcontrib><creatorcontrib>Jordans, Melanie</creatorcontrib><creatorcontrib>Reinhold, Peter</creatorcontrib><creatorcontrib>Schecker, Horst</creatorcontrib><collection>Springer Nature OA Free Journals</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Zeitschrift für Erziehungswissenschaft</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kulgemeyer, Christoph</au><au>Riese, Josef</au><au>Vogelsang, Christoph</au><au>Buschhüter, David</au><au>Borowski, Andreas</au><au>Weißbach, Anna</au><au>Jordans, Melanie</au><au>Reinhold, Peter</au><au>Schecker, Horst</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods</atitle><jtitle>Zeitschrift für Erziehungswissenschaft</jtitle><stitle>Z Erziehungswiss</stitle><addtitle>Z Erziehwiss</addtitle><date>2023-06-07</date><risdate>2023</risdate><volume>26</volume><issue>3</issue><spage>601</spage><epage>625</epage><pages>601-625</pages><issn>1434-663X</issn><eissn>1862-5215</eissn><abstract>Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.</abstract><cop>Wiesbaden</cop><pub>Springer Fachmedien Wiesbaden</pub><pmid>37359180</pmid><doi>10.1007/s11618-023-01154-y</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0003-2927-2619</orcidid><orcidid>https://orcid.org/0000-0002-7622-7549</orcidid><orcidid>https://orcid.org/0000-0003-0594-250X</orcidid><orcidid>https://orcid.org/0000-0001-6659-8170</orcidid><orcidid>https://orcid.org/0000-0002-5804-1855</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1434-663X
ispartof Zeitschrift für Erziehungswissenschaft, 2023-06, Vol.26 (3), p.601-625
issn 1434-663X
1862-5215
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10244832
source SpringerNature Journals
subjects Education
Educational Policy and Politics
Pedagogic Psychology
Schwerpunkt
Sociology of Education
title How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T04%3A02%3A03IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=How%20authenticity%20impacts%20validity:%20Developing%20a%C2%A0model%20of%20teacher%20education%20assessment%20and%20exploring%20the%20effects%20of%20the%20digitisation%20of%20assessment%20methods&rft.jtitle=Zeitschrift%20f%C3%BCr%20Erziehungswissenschaft&rft.au=Kulgemeyer,%20Christoph&rft.date=2023-06-07&rft.volume=26&rft.issue=3&rft.spage=601&rft.epage=625&rft.pages=601-625&rft.issn=1434-663X&rft.eissn=1862-5215&rft_id=info:doi/10.1007/s11618-023-01154-y&rft_dat=%3Cproquest_pubme%3E2830216750%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2830216750&rft_id=info:pmid/37359180&rfr_iscdi=true