Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays
► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degre...
Gespeichert in:
Veröffentlicht in: | Assessing writing 2013-04, Vol.18 (2), p.111-131 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 131 |
---|---|
container_issue | 2 |
container_start_page | 111 |
container_title | Assessing writing |
container_volume | 18 |
creator | Esfandiari, Rajab Myford, Carol M. |
description | ► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity.
We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised. |
doi_str_mv | 10.1016/j.asw.2012.12.002 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1550992324</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ998374</ericid><els_id>S1075293513000032</els_id><sourcerecordid>1550992324</sourcerecordid><originalsourceid>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</originalsourceid><addsrcrecordid>eNp9kEtLAzEUhQdRsFZ_gOBili6cmsdk0uBKpPVBwYW6DmlyoynTmZo7rfTfm6GluBIuJPfknAP5suySkhEltLpdjAz-jBihbJSGEHaUDehY8kIoWh2nO5GiYIqL0-wMcUEILQnng2z-BhuIodvmLngPERoLmJtl23zmCLUvDCIgthFv8hVA_LubxuUdGPsFMT_IeTRdSOHJdJYnxWzxPDvxpka42J_D7GM6eX94Kmavj88P97PCckG7ojTWu6qiUkhFKIckupJZxxUBKRkA8QYUqzzzxDgpaeXLuQJeWjcXFS35MLve9a5i-70G7PQyoIW6Ng20a9RUCKIU46y30p3VxhYxgterGJYmbjUluuepFzrx1D1PnSbxTJmrXSbhsgf_5EWpMZd95d3-OX1xEyBqtKGn6UIE22nXhn_KfwEAS4gY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1550992324</pqid></control><display><type>article</type><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><source>Elsevier ScienceDirect Journals</source><creator>Esfandiari, Rajab ; Myford, Carol M.</creator><creatorcontrib>Esfandiari, Rajab ; Myford, Carol M.</creatorcontrib><description>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity.
We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</description><identifier>ISSN: 1075-2935</identifier><identifier>EISSN: 1873-5916</identifier><identifier>DOI: 10.1016/j.asw.2012.12.002</identifier><identifier>CODEN: ASWRFM</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Comparative Analysis ; English (Second Language) ; Essays ; Evaluation Criteria ; Foreign Countries ; Gender Differences ; Higher Education ; Iran ; Peer Evaluation ; Peer-assessment ; Rater effects ; Rating scales ; Self Evaluation (Individuals) ; Self-assessment ; Severity (of Disability) ; Teacher Evaluation ; Writing assessment</subject><ispartof>Assessing writing, 2013-04, Vol.18 (2), p.111-131</ispartof><rights>2013 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</citedby><cites>FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S1075293513000032$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ998374$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Esfandiari, Rajab</creatorcontrib><creatorcontrib>Myford, Carol M.</creatorcontrib><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><title>Assessing writing</title><description>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity.
We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</description><subject>Comparative Analysis</subject><subject>English (Second Language)</subject><subject>Essays</subject><subject>Evaluation Criteria</subject><subject>Foreign Countries</subject><subject>Gender Differences</subject><subject>Higher Education</subject><subject>Iran</subject><subject>Peer Evaluation</subject><subject>Peer-assessment</subject><subject>Rater effects</subject><subject>Rating scales</subject><subject>Self Evaluation (Individuals)</subject><subject>Self-assessment</subject><subject>Severity (of Disability)</subject><subject>Teacher Evaluation</subject><subject>Writing assessment</subject><issn>1075-2935</issn><issn>1873-5916</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNp9kEtLAzEUhQdRsFZ_gOBili6cmsdk0uBKpPVBwYW6DmlyoynTmZo7rfTfm6GluBIuJPfknAP5suySkhEltLpdjAz-jBihbJSGEHaUDehY8kIoWh2nO5GiYIqL0-wMcUEILQnng2z-BhuIodvmLngPERoLmJtl23zmCLUvDCIgthFv8hVA_LubxuUdGPsFMT_IeTRdSOHJdJYnxWzxPDvxpka42J_D7GM6eX94Kmavj88P97PCckG7ojTWu6qiUkhFKIckupJZxxUBKRkA8QYUqzzzxDgpaeXLuQJeWjcXFS35MLve9a5i-70G7PQyoIW6Ng20a9RUCKIU46y30p3VxhYxgterGJYmbjUluuepFzrx1D1PnSbxTJmrXSbhsgf_5EWpMZd95d3-OX1xEyBqtKGn6UIE22nXhn_KfwEAS4gY</recordid><startdate>201304</startdate><enddate>201304</enddate><creator>Esfandiari, Rajab</creator><creator>Myford, Carol M.</creator><general>Elsevier Inc</general><general>Elsevier</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7T9</scope></search><sort><creationdate>201304</creationdate><title>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</title><author>Esfandiari, Rajab ; Myford, Carol M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c351t-4acfd6617579013e351d42cd390e772ee0fae926f2f0ad7716f4b9e34cdb56143</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Comparative Analysis</topic><topic>English (Second Language)</topic><topic>Essays</topic><topic>Evaluation Criteria</topic><topic>Foreign Countries</topic><topic>Gender Differences</topic><topic>Higher Education</topic><topic>Iran</topic><topic>Peer Evaluation</topic><topic>Peer-assessment</topic><topic>Rater effects</topic><topic>Rating scales</topic><topic>Self Evaluation (Individuals)</topic><topic>Self-assessment</topic><topic>Severity (of Disability)</topic><topic>Teacher Evaluation</topic><topic>Writing assessment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Esfandiari, Rajab</creatorcontrib><creatorcontrib>Myford, Carol M.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><jtitle>Assessing writing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Esfandiari, Rajab</au><au>Myford, Carol M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ998374</ericid><atitle>Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays</atitle><jtitle>Assessing writing</jtitle><date>2013-04</date><risdate>2013</risdate><volume>18</volume><issue>2</issue><spage>111</spage><epage>131</epage><pages>111-131</pages><issn>1075-2935</issn><eissn>1873-5916</eissn><coden>ASWRFM</coden><abstract>► We investigated the rating behavior of three assessor types. ► The assessors scored essays that English-as-a-Foreign-Language students wrote. ► Teacher assessors and peer-assessors tended to rate more harshly than self-assessors. ► However, within each assessor type, assessors showed varying degrees of severity.
We compared three assessor types (self-assessors, peer-assessors, and teacher assessors) to determine whether they differed in the levels of severity they exercised when rating essays. We analyzed the ratings of 194 assessors who evaluated 188 essays that students enrolled in two state-run universities in Iran wrote. The assessors employed a 6-point analytic scale to provide ratings on 15 assessment criteria. The results of our analysis showed that of the three assessor types, teacher assessors were the most severe while self-assessors were the most lenient, although there was a great deal of variability in the levels of severity that assessors within each type exercised.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.asw.2012.12.002</doi><tpages>21</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1075-2935 |
ispartof | Assessing writing, 2013-04, Vol.18 (2), p.111-131 |
issn | 1075-2935 1873-5916 |
language | eng |
recordid | cdi_proquest_miscellaneous_1550992324 |
source | Elsevier ScienceDirect Journals |
subjects | Comparative Analysis English (Second Language) Essays Evaluation Criteria Foreign Countries Gender Differences Higher Education Iran Peer Evaluation Peer-assessment Rater effects Rating scales Self Evaluation (Individuals) Self-assessment Severity (of Disability) Teacher Evaluation Writing assessment |
title | Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T07%3A08%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Severity%20differences%20among%20self-assessors,%20peer-assessors,%20and%20teacher%20assessors%20rating%20EFL%20essays&rft.jtitle=Assessing%20writing&rft.au=Esfandiari,%20Rajab&rft.date=2013-04&rft.volume=18&rft.issue=2&rft.spage=111&rft.epage=131&rft.pages=111-131&rft.issn=1075-2935&rft.eissn=1873-5916&rft.coden=ASWRFM&rft_id=info:doi/10.1016/j.asw.2012.12.002&rft_dat=%3Cproquest_cross%3E1550992324%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1550992324&rft_id=info:pmid/&rft_ericid=EJ998374&rft_els_id=S1075293513000032&rfr_iscdi=true |