A framework for the computerized assessment of university student essays
This paper presents an approach for automatic grading of essays. Student essays are compared against a model or key essay provided by the teacher. The similarity between a student essay and the model essay is measured by the cosine of their contained angle in an n-dimensional semantic space. The mod...
Gespeichert in:
| Veröffentlicht in: | Computers in human behavior 2006-05, Vol.22 (3), p.381-388 |
|---|---|
| 1. Verfasser: | |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 388 |
|---|---|
| container_issue | 3 |
| container_start_page | 381 |
| container_title | Computers in human behavior |
| container_volume | 22 |
| creator | Duwairi, Rehab M. |
| description | This paper presents an approach for automatic grading of essays. Student essays are compared against a model or key essay provided by the teacher. The similarity between a student essay and the model essay is measured by the cosine of their contained angle in an
n-dimensional semantic space. The model essay is preprocessed by removing stopwords, extracting keywords, assigning weights to keywords to reflect their importance and finally by linking every keyword to a subject-oriented synonym list. The student essay, by comparison, is preprocessed by removing stopwords and then by extracting keywords. The keywords extracted from the model essay and the keywords extracted from students essays together with weights provided by teacher are used to build feature vectors for teacher and students essays. The obtained grade depends on the similarity between these vectors (calculated by using the cosine formula). A simulator was implemented to test the viability of the proposed approach. It was fed with student essays (at the university level) gathered from database management course over three semesters. The results were very encouraging and the agreement between the auto-grader and human grader was as good as the agreement between human graders. |
| doi_str_mv | 10.1016/j.chb.2004.09.006 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_29275662</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S074756320400127X</els_id><sourcerecordid>29275662</sourcerecordid><originalsourceid>FETCH-LOGICAL-c358t-2164ff9f89fba1690ccce269631c40f00ed23e033717a7cb577cb444aefe35d23</originalsourceid><addsrcrecordid>eNp9kEFPwzAMhSMEEmPwA7j1ArcWp2mTVZymCRjSJC5wjrLU0TLWdsTt0Pj1ZNokblxsye89W_4Yu-WQceDyYZ3Z1TLLAYoMqgxAnrERnyiRKlnl52wEqlBpKUV-ya6I1gBQliBHbD5NXDANfnfhM3FdSPoVJrZrtkOPwf9gnRgiJGqw7ZPOJUPrdxjI9_uE-qE-TKNq9nTNLpzZEN6c-ph9PD-9z-bp4u3ldTZdpFaUkz7NuSycq9ykckvDZQXWWsxlJQW3BTgArHOBIITiyii7LFUsRVEYdCjKqI3Z_XHvNnRfA1KvG08WNxvTYjeQzqtclVIejPxotKEjCuj0NvjGhL3moA_M9FpHZvrATEOlI7OYuTstN2TNJpJprae_oCoLAUpF3-PRh_HTncegyXpsLdY-oO113fl_rvwC9oOCLA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>29275662</pqid></control><display><type>article</type><title>A framework for the computerized assessment of university student essays</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Duwairi, Rehab M.</creator><creatorcontrib>Duwairi, Rehab M.</creatorcontrib><description>This paper presents an approach for automatic grading of essays. Student essays are compared against a model or key essay provided by the teacher. The similarity between a student essay and the model essay is measured by the cosine of their contained angle in an
n-dimensional semantic space. The model essay is preprocessed by removing stopwords, extracting keywords, assigning weights to keywords to reflect their importance and finally by linking every keyword to a subject-oriented synonym list. The student essay, by comparison, is preprocessed by removing stopwords and then by extracting keywords. The keywords extracted from the model essay and the keywords extracted from students essays together with weights provided by teacher are used to build feature vectors for teacher and students essays. The obtained grade depends on the similarity between these vectors (calculated by using the cosine formula). A simulator was implemented to test the viability of the proposed approach. It was fed with student essays (at the university level) gathered from database management course over three semesters. The results were very encouraging and the agreement between the auto-grader and human grader was as good as the agreement between human graders.</description><identifier>ISSN: 0747-5632</identifier><identifier>EISSN: 1873-7692</identifier><identifier>DOI: 10.1016/j.chb.2004.09.006</identifier><identifier>CODEN: CHBEEQ</identifier><language>eng</language><publisher>Oxford: Elsevier Ltd</publisher><subject>Automatic grading ; Automatic-assessment ; Biological and medical sciences ; Computer based grading ; Computerized assessment ; Educational psychology ; Fundamental and applied biological sciences. Psychology ; On-line assessment ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychopedagogics. Didactics</subject><ispartof>Computers in human behavior, 2006-05, Vol.22 (3), p.381-388</ispartof><rights>2004 Elsevier Ltd</rights><rights>2007 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c358t-2164ff9f89fba1690ccce269631c40f00ed23e033717a7cb577cb444aefe35d23</citedby><cites>FETCH-LOGICAL-c358t-2164ff9f89fba1690ccce269631c40f00ed23e033717a7cb577cb444aefe35d23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.chb.2004.09.006$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=17543077$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Duwairi, Rehab M.</creatorcontrib><title>A framework for the computerized assessment of university student essays</title><title>Computers in human behavior</title><description>This paper presents an approach for automatic grading of essays. Student essays are compared against a model or key essay provided by the teacher. The similarity between a student essay and the model essay is measured by the cosine of their contained angle in an
n-dimensional semantic space. The model essay is preprocessed by removing stopwords, extracting keywords, assigning weights to keywords to reflect their importance and finally by linking every keyword to a subject-oriented synonym list. The student essay, by comparison, is preprocessed by removing stopwords and then by extracting keywords. The keywords extracted from the model essay and the keywords extracted from students essays together with weights provided by teacher are used to build feature vectors for teacher and students essays. The obtained grade depends on the similarity between these vectors (calculated by using the cosine formula). A simulator was implemented to test the viability of the proposed approach. It was fed with student essays (at the university level) gathered from database management course over three semesters. The results were very encouraging and the agreement between the auto-grader and human grader was as good as the agreement between human graders.</description><subject>Automatic grading</subject><subject>Automatic-assessment</subject><subject>Biological and medical sciences</subject><subject>Computer based grading</subject><subject>Computerized assessment</subject><subject>Educational psychology</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>On-line assessment</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychopedagogics. Didactics</subject><issn>0747-5632</issn><issn>1873-7692</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2006</creationdate><recordtype>article</recordtype><recordid>eNp9kEFPwzAMhSMEEmPwA7j1ArcWp2mTVZymCRjSJC5wjrLU0TLWdsTt0Pj1ZNokblxsye89W_4Yu-WQceDyYZ3Z1TLLAYoMqgxAnrERnyiRKlnl52wEqlBpKUV-ya6I1gBQliBHbD5NXDANfnfhM3FdSPoVJrZrtkOPwf9gnRgiJGqw7ZPOJUPrdxjI9_uE-qE-TKNq9nTNLpzZEN6c-ph9PD-9z-bp4u3ldTZdpFaUkz7NuSycq9ykckvDZQXWWsxlJQW3BTgArHOBIITiyii7LFUsRVEYdCjKqI3Z_XHvNnRfA1KvG08WNxvTYjeQzqtclVIejPxotKEjCuj0NvjGhL3moA_M9FpHZvrATEOlI7OYuTstN2TNJpJprae_oCoLAUpF3-PRh_HTncegyXpsLdY-oO113fl_rvwC9oOCLA</recordid><startdate>20060501</startdate><enddate>20060501</enddate><creator>Duwairi, Rehab M.</creator><general>Elsevier Ltd</general><general>Elsevier Science</general><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20060501</creationdate><title>A framework for the computerized assessment of university student essays</title><author>Duwairi, Rehab M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c358t-2164ff9f89fba1690ccce269631c40f00ed23e033717a7cb577cb444aefe35d23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Automatic grading</topic><topic>Automatic-assessment</topic><topic>Biological and medical sciences</topic><topic>Computer based grading</topic><topic>Computerized assessment</topic><topic>Educational psychology</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>On-line assessment</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychopedagogics. Didactics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Duwairi, Rehab M.</creatorcontrib><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers in human behavior</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Duwairi, Rehab M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A framework for the computerized assessment of university student essays</atitle><jtitle>Computers in human behavior</jtitle><date>2006-05-01</date><risdate>2006</risdate><volume>22</volume><issue>3</issue><spage>381</spage><epage>388</epage><pages>381-388</pages><issn>0747-5632</issn><eissn>1873-7692</eissn><coden>CHBEEQ</coden><abstract>This paper presents an approach for automatic grading of essays. Student essays are compared against a model or key essay provided by the teacher. The similarity between a student essay and the model essay is measured by the cosine of their contained angle in an
n-dimensional semantic space. The model essay is preprocessed by removing stopwords, extracting keywords, assigning weights to keywords to reflect their importance and finally by linking every keyword to a subject-oriented synonym list. The student essay, by comparison, is preprocessed by removing stopwords and then by extracting keywords. The keywords extracted from the model essay and the keywords extracted from students essays together with weights provided by teacher are used to build feature vectors for teacher and students essays. The obtained grade depends on the similarity between these vectors (calculated by using the cosine formula). A simulator was implemented to test the viability of the proposed approach. It was fed with student essays (at the university level) gathered from database management course over three semesters. The results were very encouraging and the agreement between the auto-grader and human grader was as good as the agreement between human graders.</abstract><cop>Oxford</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.chb.2004.09.006</doi><tpages>8</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0747-5632 |
| ispartof | Computers in human behavior, 2006-05, Vol.22 (3), p.381-388 |
| issn | 0747-5632 1873-7692 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_29275662 |
| source | Elsevier ScienceDirect Journals Complete |
| subjects | Automatic grading Automatic-assessment Biological and medical sciences Computer based grading Computerized assessment Educational psychology Fundamental and applied biological sciences. Psychology On-line assessment Psychology. Psychoanalysis. Psychiatry Psychology. Psychophysiology Psychopedagogics. Didactics |
| title | A framework for the computerized assessment of university student essays |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T09%3A21%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20framework%20for%20the%20computerized%20assessment%20of%20university%20student%20essays&rft.jtitle=Computers%20in%20human%20behavior&rft.au=Duwairi,%20Rehab%20M.&rft.date=2006-05-01&rft.volume=22&rft.issue=3&rft.spage=381&rft.epage=388&rft.pages=381-388&rft.issn=0747-5632&rft.eissn=1873-7692&rft.coden=CHBEEQ&rft_id=info:doi/10.1016/j.chb.2004.09.006&rft_dat=%3Cproquest_cross%3E29275662%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=29275662&rft_id=info:pmid/&rft_els_id=S074756320400127X&rfr_iscdi=true |