Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation
Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation...
Gespeichert in:
Veröffentlicht in: | Language teaching 2020-01, Vol.53 (1), p.109-120 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 120 |
---|---|
container_issue | 1 |
container_start_page | 109 |
container_title | Language teaching |
container_volume | 53 |
creator | Schmitt, Norbert Nation, Paul Kremmel, Benjamin |
description | Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests. |
doi_str_mv | 10.1017/S0261444819000326 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2361943530</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1250366</ericid><sourcerecordid>2361943530</sourcerecordid><originalsourceid>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</originalsourceid><addsrcrecordid>eNplkEtPwzAQhC0EEqXwAzggWeIc8DsNt6q0PNSCBKXXyI7XJVUaFzsp4t-TUsSF0x7mm92dQeickitKaHr9SpiiQogBzQghnKkD1KMilQknIjtEvZ2c7PRjdBLjihDKKZE9tJ75bVkvcfMOeFJCZbF3eOELbdpKhy88jBFiXEPd4IkPnzrYGzzv2CcAi50PeOYD4Jdy6YNvI55DbPAtbKHymx-Tri1e6Kq0uil9fYqOnK4inP3OPnqbjOej-2T6fPcwGk6TQkjWJGYgJTBinDKMs3RQUJq6gUuFTFlWqJQprZkxwgBRmmiurXVMOQ2isGAyw_vocr93E_xH2_2Ur3wb6u5kzriimeCSk46ie6oIPsYALt-Ect2lzinJd63m_1rtPBd7D4Sy-OPHj5RJwpXi395cc_g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2361943530</pqid></control><display><type>article</type><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><source>Cambridge Journals Online</source><creator>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</creator><creatorcontrib>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</creatorcontrib><description>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</description><identifier>ISSN: 0261-4448</identifier><identifier>EISSN: 1475-3049</identifier><identifier>DOI: 10.1017/S0261444819000326</identifier><language>eng</language><publisher>Cambridge: Cambridge University Press</publisher><subject>End users ; English for Special Purposes ; Guides ; Language Proficiency ; Language Tests ; Learning environment ; Literacy ; Researchers ; Scores ; Students ; Teachers ; Test Construction ; Test Use ; Test Validity ; Test validity and reliability ; Vocabulary development</subject><ispartof>Language teaching, 2020-01, Vol.53 (1), p.109-120</ispartof><rights>Copyright Cambridge University Press Jan 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</citedby><cites>FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1250366$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Schmitt, Norbert</creatorcontrib><creatorcontrib>Nation, Paul</creatorcontrib><creatorcontrib>Kremmel, Benjamin</creatorcontrib><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><title>Language teaching</title><description>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</description><subject>End users</subject><subject>English for Special Purposes</subject><subject>Guides</subject><subject>Language Proficiency</subject><subject>Language Tests</subject><subject>Learning environment</subject><subject>Literacy</subject><subject>Researchers</subject><subject>Scores</subject><subject>Students</subject><subject>Teachers</subject><subject>Test Construction</subject><subject>Test Use</subject><subject>Test Validity</subject><subject>Test validity and reliability</subject><subject>Vocabulary development</subject><issn>0261-4448</issn><issn>1475-3049</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>AVQMV</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>K50</sourceid><sourceid>M1D</sourceid><sourceid>M2O</sourceid><recordid>eNplkEtPwzAQhC0EEqXwAzggWeIc8DsNt6q0PNSCBKXXyI7XJVUaFzsp4t-TUsSF0x7mm92dQeickitKaHr9SpiiQogBzQghnKkD1KMilQknIjtEvZ2c7PRjdBLjihDKKZE9tJ75bVkvcfMOeFJCZbF3eOELbdpKhy88jBFiXEPd4IkPnzrYGzzv2CcAi50PeOYD4Jdy6YNvI55DbPAtbKHymx-Tri1e6Kq0uil9fYqOnK4inP3OPnqbjOej-2T6fPcwGk6TQkjWJGYgJTBinDKMs3RQUJq6gUuFTFlWqJQprZkxwgBRmmiurXVMOQ2isGAyw_vocr93E_xH2_2Ur3wb6u5kzriimeCSk46ie6oIPsYALt-Ect2lzinJd63m_1rtPBd7D4Sy-OPHj5RJwpXi395cc_g</recordid><startdate>20200101</startdate><enddate>20200101</enddate><creator>Schmitt, Norbert</creator><creator>Nation, Paul</creator><creator>Kremmel, Benjamin</creator><general>Cambridge University Press</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7T9</scope><scope>7XB</scope><scope>88B</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AIMQZ</scope><scope>ALSLI</scope><scope>AVQMV</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>CPGLG</scope><scope>CRLPW</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>K50</scope><scope>LIQON</scope><scope>M0P</scope><scope>M1D</scope><scope>M2O</scope><scope>MBDVC</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope></search><sort><creationdate>20200101</creationdate><title>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</title><author>Schmitt, Norbert ; Nation, Paul ; Kremmel, Benjamin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c452t-b855e20bf6b23278c117f8f745729c6726aa2bb4be06a0a3addf26fae4cdeb9b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>End users</topic><topic>English for Special Purposes</topic><topic>Guides</topic><topic>Language Proficiency</topic><topic>Language Tests</topic><topic>Learning environment</topic><topic>Literacy</topic><topic>Researchers</topic><topic>Scores</topic><topic>Students</topic><topic>Teachers</topic><topic>Test Construction</topic><topic>Test Use</topic><topic>Test Validity</topic><topic>Test validity and reliability</topic><topic>Vocabulary development</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schmitt, Norbert</creatorcontrib><creatorcontrib>Nation, Paul</creatorcontrib><creatorcontrib>Kremmel, Benjamin</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection【Remote access available】</collection><collection>ProQuest Central (Corporate)</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest One Literature</collection><collection>Social Science Premium Collection (Proquest) (PQ_SDU_P3)</collection><collection>Arts Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>Linguistics Collection</collection><collection>Linguistics Database</collection><collection>ProQuest Central</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>Art, Design and Architecture Collection</collection><collection>One Literature (ProQuest)</collection><collection>Education Database</collection><collection>ProQuest Arts & Humanities Database</collection><collection>ProQuest research library</collection><collection>Research Library (Corporate)</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><jtitle>Language teaching</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schmitt, Norbert</au><au>Nation, Paul</au><au>Kremmel, Benjamin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1250366</ericid><atitle>Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation</atitle><jtitle>Language teaching</jtitle><date>2020-01-01</date><risdate>2020</risdate><volume>53</volume><issue>1</issue><spage>109</spage><epage>120</epage><pages>109-120</pages><issn>0261-4448</issn><eissn>1475-3049</eissn><abstract>Recently, a large number of vocabulary tests have been made available to language teachers, testers, and researchers. Unfortunately, most of them have been launched with inadequate validation evidence. The field of language testing has become increasingly more rigorous in the area of test validation, but developers of vocabulary tests have generally not given validation sufficient attention in the past. This paper argues for more rigorous and systematic procedures for test development, starting from a more precise specification of the test's purpose, intended testees and educational context, the particular aspects of vocabulary knowledge which are being measured, and the way in which the test scores should be interpreted. It also calls for greater assessment literacy among vocabulary test developers, and greater support for the end users of the tests, for instance, with the provision of detailed users' manuals. Overall, the authors present what they feel are the minimum requirements for vocabulary test development and validation. They argue that the field should self-police itself more rigorously to ensure that these requirements are met or exceeded, and made explicit for those using vocabulary tests.</abstract><cop>Cambridge</cop><pub>Cambridge University Press</pub><doi>10.1017/S0261444819000326</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0261-4448 |
ispartof | Language teaching, 2020-01, Vol.53 (1), p.109-120 |
issn | 0261-4448 1475-3049 |
language | eng |
recordid | cdi_proquest_journals_2361943530 |
source | Cambridge Journals Online |
subjects | End users English for Special Purposes Guides Language Proficiency Language Tests Learning environment Literacy Researchers Scores Students Teachers Test Construction Test Use Test Validity Test validity and reliability Vocabulary development |
title | Moving the Field of Vocabulary Assessment Forward: The Need for More Rigorous Test Development and Validation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-11T16%3A27%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Moving%20the%20Field%20of%20Vocabulary%20Assessment%20Forward:%20The%20Need%20for%20More%20Rigorous%20Test%20Development%20and%20Validation&rft.jtitle=Language%20teaching&rft.au=Schmitt,%20Norbert&rft.date=2020-01-01&rft.volume=53&rft.issue=1&rft.spage=109&rft.epage=120&rft.pages=109-120&rft.issn=0261-4448&rft.eissn=1475-3049&rft_id=info:doi/10.1017/S0261444819000326&rft_dat=%3Cproquest_cross%3E2361943530%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2361943530&rft_id=info:pmid/&rft_ericid=EJ1250366&rfr_iscdi=true |