Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays

► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degre...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Assessing writing 2013-04, Vol.18 (2), p.111-131
Hauptverfasser: Esfandiari, Rajab, Myford, Carol M.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 131
container_issue 2
container_start_page 111
container_title Assessing writing
container_volume 18
creator Esfandiari, Rajab
Myford, Carol M.
description ► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity. We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.
doi_str_mv 10.1016/j.asw.2012.12.002
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1550992324</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ998374</ericid><els_id>S1075293513000032</els_id><sourcerecordid>1550992324</sourcerecordid><originalsourceid>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</originalsourceid><addsrcrecordid>eNp9kEtLAzEUhQdRsFZ_gOBili6cmsdk0uBKpPVBwYW6DmlyoynTmZo7rfTfm6GluBIuJPfknAP5suySkhEltLpdjAz-jBihbJSGEHaUDehY8kIoWh2nO5GiYIqL0-wMcUEILQnng2z-BhuIodvmLngPERoLmJtl23zmCLUvDCIgthFv8hVA_LubxuUdGPsFMT_IeTRdSOHJdJYnxWzxPDvxpka42J_D7GM6eX94Kmavj88P97PCckG7ojTWu6qiUkhFKIckupJZxxUBKRkA8QYUqzzzxDgpaeXLuQJeWjcXFS35MLve9a5i-70G7PQyoIW6Ng20a9RUCKIU46y30p3VxhYxgterGJYmbjUluuepFzrx1D1PnSbxTJmrXSbhsgf_5EWpMZd95d3-OX1xEyBqtKGn6UIE22nXhn_KfwEAS4gY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1550992324</pqid></control><display><type>article</type><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><source>Elsevier ScienceDirect Journals</source><creator>Esfandiari, Rajab ; Myford, Carol M.</creator><creatorcontrib>Esfandiari, Rajab ; Myford, Carol M.</creatorcontrib><description>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity. We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</description><identifier>ISSN: 1075-2935</identifier><identifier>EISSN: 1873-5916</identifier><identifier>DOI: 10.1016/j.asw.2012.12.002</identifier><identifier>CODEN: ASWRFM</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Comparative Analysis ; English (Second Language) ; Essays ; Evaluation Criteria ; Foreign Countries ; Gender Differences ; Higher Education ; Iran ; Peer Evaluation ; Peer-assessment ; Rater effects ; Rating scales ; Self Evaluation (Individuals) ; Self-assessment ; Severity (of Disability) ; Teacher Evaluation ; Writing assessment</subject><ispartof>Assessing writing, 2013-04, Vol.18 (2), p.111-131</ispartof><rights>2013 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</citedby><cites>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S1075293513000032$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ998374$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Esfandiari, Rajab</creatorcontrib><creatorcontrib>Myford, Carol M.</creatorcontrib><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><title>Assessing writing</title><description>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity. We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</description><subject>Comparative Analysis</subject><subject>English (Second Language)</subject><subject>Essays</subject><subject>Evaluation Criteria</subject><subject>Foreign Countries</subject><subject>Gender Differences</subject><subject>Higher Education</subject><subject>Iran</subject><subject>Peer Evaluation</subject><subject>Peer-assessment</subject><subject>Rater effects</subject><subject>Rating scales</subject><subject>Self Evaluation (Individuals)</subject><subject>Self-assessment</subject><subject>Severity (of Disability)</subject><subject>Teacher Evaluation</subject><subject>Writing assessment</subject><issn>1075-2935</issn><issn>1873-5916</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNp9kEtLAzEUhQdRsFZ_gOBili6cmsdk0uBKpPVBwYW6DmlyoynTmZo7rfTfm6GluBIuJPfknAP5suySkhEltLpdjAz-jBihbJSGEHaUDehY8kIoWh2nO5GiYIqL0-wMcUEILQnng2z-BhuIodvmLngPERoLmJtl23zmCLUvDCIgthFv8hVA_LubxuUdGPsFMT_IeTRdSOHJdJYnxWzxPDvxpka42J_D7GM6eX94Kmavj88P97PCckG7ojTWu6qiUkhFKIckupJZxxUBKRkA8QYUqzzzxDgpaeXLuQJeWjcXFS35MLve9a5i-70G7PQyoIW6Ng20a9RUCKIU46y30p3VxhYxgterGJYmbjUluuepFzrx1D1PnSbxTJmrXSbhsgf_5EWpMZd95d3-OX1xEyBqtKGn6UIE22nXhn_KfwEAS4gY</recordid><startdate>201304</startdate><enddate>201304</enddate><creator>Esfandiari, Rajab</creator><creator>Myford, Carol M.</creator><general>Elsevier Inc</general><general>Elsevier</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7T9</scope></search><sort><creationdate>201304</creationdate><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><author>Esfandiari, Rajab ; Myford, Carol M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Comparative Analysis</topic><topic>English (Second Language)</topic><topic>Essays</topic><topic>Evaluation Criteria</topic><topic>Foreign Countries</topic><topic>Gender Differences</topic><topic>Higher Education</topic><topic>Iran</topic><topic>Peer Evaluation</topic><topic>Peer-assessment</topic><topic>Rater effects</topic><topic>Rating scales</topic><topic>Self Evaluation (Individuals)</topic><topic>Self-assessment</topic><topic>Severity (of Disability)</topic><topic>Teacher Evaluation</topic><topic>Writing assessment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Esfandiari, Rajab</creatorcontrib><creatorcontrib>Myford, Carol M.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><jtitle>Assessing writing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Esfandiari, Rajab</au><au>Myford, Carol M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ998374</ericid><atitle>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</atitle><jtitle>Assessing writing</jtitle><date>2013-04</date><risdate>2013</risdate><volume>18</volume><issue>2</issue><spage>111</spage><epage>131</epage><pages>111-131</pages><issn>1075-2935</issn><eissn>1873-5916</eissn><coden>ASWRFM</coden><abstract>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity. We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.asw.2012.12.002</doi><tpages>21</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1075-2935
ispartof Assessing writing, 2013-04, Vol.18 (2), p.111-131
issn 1075-2935
1873-5916
language eng
recordid cdi_proquest_miscellaneous_1550992324
source Elsevier ScienceDirect Journals
subjects Comparative Analysis
English (Second Language)
Essays
Evaluation Criteria
Foreign Countries
Gender Differences
Higher Education
Iran
Peer Evaluation
Peer-assessment
Rater effects
Rating scales
Self Evaluation (Individuals)
Self-assessment
Severity (of Disability)
Teacher Evaluation
Writing assessment
title Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T07%3A08%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Severity%20differences%20among%20self-assessors,%20peer-assessors,%20and%20teacher%20assessors%20rating%20EFL%20essays&rft.jtitle=Assessing%20writing&rft.au=Esfandiari,%20Rajab&rft.date=2013-04&rft.volume=18&rft.issue=2&rft.spage=111&rft.epage=131&rft.pages=111-131&rft.issn=1075-2935&rft.eissn=1873-5916&rft.coden=ASWRFM&rft_id=info:doi/10.1016/j.asw.2012.12.002&rft_dat=%3Cproquest_cross%3E1550992324%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1550992324&rft_id=info:pmid/&rft_ericid=EJ998374&rft_els_id=S1075293513000032&rfr_iscdi=true