Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation

Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Language teaching 2020-01, Vol.53 (1), p.109-120
Hauptverfasser: Schmitt, Norbert, Nation, Paul, Kremmel, Benjamin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 120
container_issue 1
container_start_page 109
container_title Language teaching
container_volume 53
creator Schmitt, Norbert
Nation, Paul
Kremmel, Benjamin
description Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.
doi_str_mv 10.1017/S0261444819000326
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2361943530</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1250366</ericid><sourcerecordid>2361943530</sourcerecordid><originalsourceid>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</originalsourceid><addsrcrecordid>eNplkEtPwzAQhC0EEqXwAzggWeIc8DsNt6q0PNSCBKXXyI7XJVUaFzsp4t-TUsSF0x7mm92dQeickitKaHr9SpiiQogBzQghnKkD1KMilQknIjtEvZ2c7PRjdBLjihDKKZE9tJ75bVkvcfMOeFJCZbF3eOELbdpKhy88jBFiXEPd4IkPnzrYGzzv2CcAi50PeOYD4Jdy6YNvI55DbPAtbKHymx-Tri1e6Kq0uil9fYqOnK4inP3OPnqbjOej-2T6fPcwGk6TQkjWJGYgJTBinDKMs3RQUJq6gUuFTFlWqJQprZkxwgBRmmiurXVMOQ2isGAyw_vocr93E_xH2_2Ur3wb6u5kzriimeCSk46ie6oIPsYALt-Ect2lzinJd63m_1rtPBd7D4Sy-OPHj5RJwpXi395cc_g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2361943530</pqid></control><display><type>article</type><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><source>Cambridge Journals Online</source><creator>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</creator><creatorcontrib>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</creatorcontrib><description>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</description><identifier>ISSN: 0261-4448</identifier><identifier>EISSN: 1475-3049</identifier><identifier>DOI: 10.1017/S0261444819000326</identifier><language>eng</language><publisher>Cambridge: Cambridge University Press</publisher><subject>End users ; English for Special Purposes ; Guides ; Language Proficiency ; Language Tests ; Learning environment ; Literacy ; Researchers ; Scores ; Students ; Teachers ; Test Construction ; Test Use ; Test Validity ; Test validity and reliability ; Vocabulary development</subject><ispartof>Language teaching, 2020-01, Vol.53 (1), p.109-120</ispartof><rights>Copyright Cambridge University Press Jan 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</citedby><cites>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1250366$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Schmitt, Norbert</creatorcontrib><creatorcontrib>Nation, Paul</creatorcontrib><creatorcontrib>Kremmel, Benjamin</creatorcontrib><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><title>Language teaching</title><description>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</description><subject>End users</subject><subject>English for Special Purposes</subject><subject>Guides</subject><subject>Language Proficiency</subject><subject>Language Tests</subject><subject>Learning environment</subject><subject>Literacy</subject><subject>Researchers</subject><subject>Scores</subject><subject>Students</subject><subject>Teachers</subject><subject>Test Construction</subject><subject>Test Use</subject><subject>Test Validity</subject><subject>Test validity and reliability</subject><subject>Vocabulary development</subject><issn>0261-4448</issn><issn>1475-3049</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>AVQMV</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>K50</sourceid><sourceid>M1D</sourceid><sourceid>M2O</sourceid><recordid>eNplkEtPwzAQhC0EEqXwAzggWeIc8DsNt6q0PNSCBKXXyI7XJVUaFzsp4t-TUsSF0x7mm92dQeickitKaHr9SpiiQogBzQghnKkD1KMilQknIjtEvZ2c7PRjdBLjihDKKZE9tJ75bVkvcfMOeFJCZbF3eOELbdpKhy88jBFiXEPd4IkPnzrYGzzv2CcAi50PeOYD4Jdy6YNvI55DbPAtbKHymx-Tri1e6Kq0uil9fYqOnK4inP3OPnqbjOej-2T6fPcwGk6TQkjWJGYgJTBinDKMs3RQUJq6gUuFTFlWqJQprZkxwgBRmmiurXVMOQ2isGAyw_vocr93E_xH2_2Ur3wb6u5kzriimeCSk46ie6oIPsYALt-Ect2lzinJd63m_1rtPBd7D4Sy-OPHj5RJwpXi395cc_g</recordid><startdate>20200101</startdate><enddate>20200101</enddate><creator>Schmitt, Norbert</creator><creator>Nation, Paul</creator><creator>Kremmel, Benjamin</creator><general>Cambridge University Press</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7T9</scope><scope>7XB</scope><scope>88B</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AIMQZ</scope><scope>ALSLI</scope><scope>AVQMV</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>CPGLG</scope><scope>CRLPW</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>K50</scope><scope>LIQON</scope><scope>M0P</scope><scope>M1D</scope><scope>M2O</scope><scope>MBDVC</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope></search><sort><creationdate>20200101</creationdate><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><author>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>End users</topic><topic>English for Special Purposes</topic><topic>Guides</topic><topic>Language Proficiency</topic><topic>Language Tests</topic><topic>Learning environment</topic><topic>Literacy</topic><topic>Researchers</topic><topic>Scores</topic><topic>Students</topic><topic>Teachers</topic><topic>Test Construction</topic><topic>Test Use</topic><topic>Test Validity</topic><topic>Test validity and reliability</topic><topic>Vocabulary development</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schmitt, Norbert</creatorcontrib><creatorcontrib>Nation, Paul</creatorcontrib><creatorcontrib>Kremmel, Benjamin</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection【Remote access available】</collection><collection>ProQuest Central (Corporate)</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest One Literature</collection><collection>Social Science Premium Collection (Proquest) (PQ_SDU_P3)</collection><collection>Arts Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>Linguistics Collection</collection><collection>Linguistics Database</collection><collection>ProQuest Central</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>Art, Design and Architecture Collection</collection><collection>One Literature (ProQuest)</collection><collection>Education Database</collection><collection>ProQuest Arts &amp; Humanities Database</collection><collection>ProQuest research library</collection><collection>Research Library (Corporate)</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><jtitle>Language teaching</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schmitt, Norbert</au><au>Nation, Paul</au><au>Kremmel, Benjamin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1250366</ericid><atitle>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</atitle><jtitle>Language teaching</jtitle><date>2020-01-01</date><risdate>2020</risdate><volume>53</volume><issue>1</issue><spage>109</spage><epage>120</epage><pages>109-120</pages><issn>0261-4448</issn><eissn>1475-3049</eissn><abstract>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</abstract><cop>Cambridge</cop><pub>Cambridge University Press</pub><doi>10.1017/S0261444819000326</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0261-4448
ispartof Language teaching, 2020-01, Vol.53 (1), p.109-120
issn 0261-4448
1475-3049
language eng
recordid cdi_proquest_journals_2361943530
source Cambridge Journals Online
subjects End users
English for Special Purposes
Guides
Language Proficiency
Language Tests
Learning environment
Literacy
Researchers
Scores
Students
Teachers
Test Construction
Test Use
Test Validity
Test validity and reliability
Vocabulary development
title Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-11T16%3A27%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Moving%20the%20Field%20of%20Vocabulary%20Assessment%20Forward:%20The%20Need%20for%20More%20Rigorous%20Test%20Development%20and%20Validation&rft.jtitle=Language%20teaching&rft.au=Schmitt,%20Norbert&rft.date=2020-01-01&rft.volume=53&rft.issue=1&rft.spage=109&rft.epage=120&rft.pages=109-120&rft.issn=0261-4448&rft.eissn=1475-3049&rft_id=info:doi/10.1017/S0261444819000326&rft_dat=%3Cproquest_cross%3E2361943530%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2361943530&rft_id=info:pmid/&rft_ericid=EJ1250366&rfr_iscdi=true