The automatic assessment of free text answers using a modified BLEU algorithm
e-Learning plays an undoubtedly important role in today’s education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student’s knowledge regarding the concepts related to learning objectives. In this paper, a new me...
Gespeichert in:
| Veröffentlicht in: | Computers and education 2011-02, Vol.56 (2), p.337-345 |
|---|---|
| Hauptverfasser: | , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 345 |
|---|---|
| container_issue | 2 |
| container_start_page | 337 |
| container_title | Computers and education |
| container_volume | 56 |
| creator | Noorbehbahani, F. Kardan, A.A. |
| description | e-Learning plays an undoubtedly important role in today’s education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student’s knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of students based on the BLEU algorithm is presented. We modify the BLEU algorithm so that it is suitable for assessing free text answers and call the new algorithm the modified BLEU (M-BLEU).
To perform an assessment, it is necessary to establish a repository of reference answers written by course instructors or related experts. Several reference answers are included for each question. The M-BLEU algorithm is used to identify the most similar reference answer to a student answer; a similarity score is calculated and applied to score the answers provided by students. Evaluation results show that the proposed method achieves the highest correlation with human expert scores compared to other assessment methods such as latent semantic analysis (LSA) and
n-gram co-occurrence. |
| doi_str_mv | 10.1016/j.compedu.2010.07.013 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_855685952</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ904351</ericid><els_id>S0360131510002058</els_id><sourcerecordid>855685952</sourcerecordid><originalsourceid>FETCH-LOGICAL-c362t-8f508252ea8294055a5871968c081895532e98002eff5fd9f94ec4cba4e8dd9b3</originalsourceid><addsrcrecordid>eNqFkEtPwzAQhC0EEuXxD0DyjVPK2okT-4QAlZeKuIDEzTLOGlw1cbEdHv-eoFZcOa20M7Or-Qg5ZjBlwOrTxdSGboXtMOUw7qCZAiu3yITJpiwayZ-3yQTKGgpWMrFL9lJaAEBVV2JC7h_fkJohh85kb6lJCVPqsM80OOoiIs34lanp0yfGRIfk-1dqaBda7zy29GI-e6Jm-Rqiz2_dAdlxZpnwcDP3ydPV7PHyppg_XN9ens8LW9Y8F9IJkFxwNJKrCoQwQjZM1dKCZFIJUXJUEoCjc8K1yqkKbWVfTIWybdVLuU9O1ndXMbwPmLLufLK4XJoew5C0FKKWQgk-OsXaaWNIKaLTq-g7E781A_1LTy_0hp7-paeh0SO9MXe0zmH09i8zu1NQlYKN8tlGHlt-eIw6WY-9xdZHtFm3wf_z4AfYhIQe</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>855685952</pqid></control><display><type>article</type><title>The automatic assessment of free text answers using a modified BLEU algorithm</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Noorbehbahani, F. ; Kardan, A.A.</creator><creatorcontrib>Noorbehbahani, F. ; Kardan, A.A.</creatorcontrib><description>e-Learning plays an undoubtedly important role in today’s education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student’s knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of students based on the BLEU algorithm is presented. We modify the BLEU algorithm so that it is suitable for assessing free text answers and call the new algorithm the modified BLEU (M-BLEU).
To perform an assessment, it is necessary to establish a repository of reference answers written by course instructors or related experts. Several reference answers are included for each question. The M-BLEU algorithm is used to identify the most similar reference answer to a student answer; a similarity score is calculated and applied to score the answers provided by students. Evaluation results show that the proposed method achieves the highest correlation with human expert scores compared to other assessment methods such as latent semantic analysis (LSA) and
n-gram co-occurrence.</description><identifier>ISSN: 0360-1315</identifier><identifier>EISSN: 1873-782X</identifier><identifier>DOI: 10.1016/j.compedu.2010.07.013</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Adult learning ; Algorithms ; Assessments ; Computer Assisted Testing ; Education ; Educational Assessment ; Educational Testing ; Electronic Learning ; Evaluation methodologies ; Evaluation Methods ; Learning ; Mathematical analysis ; Scoring ; Semantics ; Similarity ; Student Evaluation ; Students ; Texts</subject><ispartof>Computers and education, 2011-02, Vol.56 (2), p.337-345</ispartof><rights>2010 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c362t-8f508252ea8294055a5871968c081895532e98002eff5fd9f94ec4cba4e8dd9b3</citedby><cites>FETCH-LOGICAL-c362t-8f508252ea8294055a5871968c081895532e98002eff5fd9f94ec4cba4e8dd9b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compedu.2010.07.013$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ904351$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Noorbehbahani, F.</creatorcontrib><creatorcontrib>Kardan, A.A.</creatorcontrib><title>The automatic assessment of free text answers using a modified BLEU algorithm</title><title>Computers and education</title><description>e-Learning plays an undoubtedly important role in today’s education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student’s knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of students based on the BLEU algorithm is presented. We modify the BLEU algorithm so that it is suitable for assessing free text answers and call the new algorithm the modified BLEU (M-BLEU).
To perform an assessment, it is necessary to establish a repository of reference answers written by course instructors or related experts. Several reference answers are included for each question. The M-BLEU algorithm is used to identify the most similar reference answer to a student answer; a similarity score is calculated and applied to score the answers provided by students. Evaluation results show that the proposed method achieves the highest correlation with human expert scores compared to other assessment methods such as latent semantic analysis (LSA) and
n-gram co-occurrence.</description><subject>Adult learning</subject><subject>Algorithms</subject><subject>Assessments</subject><subject>Computer Assisted Testing</subject><subject>Education</subject><subject>Educational Assessment</subject><subject>Educational Testing</subject><subject>Electronic Learning</subject><subject>Evaluation methodologies</subject><subject>Evaluation Methods</subject><subject>Learning</subject><subject>Mathematical analysis</subject><subject>Scoring</subject><subject>Semantics</subject><subject>Similarity</subject><subject>Student Evaluation</subject><subject>Students</subject><subject>Texts</subject><issn>0360-1315</issn><issn>1873-782X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2011</creationdate><recordtype>article</recordtype><recordid>eNqFkEtPwzAQhC0EEuXxD0DyjVPK2okT-4QAlZeKuIDEzTLOGlw1cbEdHv-eoFZcOa20M7Or-Qg5ZjBlwOrTxdSGboXtMOUw7qCZAiu3yITJpiwayZ-3yQTKGgpWMrFL9lJaAEBVV2JC7h_fkJohh85kb6lJCVPqsM80OOoiIs34lanp0yfGRIfk-1dqaBda7zy29GI-e6Jm-Rqiz2_dAdlxZpnwcDP3ydPV7PHyppg_XN9ens8LW9Y8F9IJkFxwNJKrCoQwQjZM1dKCZFIJUXJUEoCjc8K1yqkKbWVfTIWybdVLuU9O1ndXMbwPmLLufLK4XJoew5C0FKKWQgk-OsXaaWNIKaLTq-g7E781A_1LTy_0hp7-paeh0SO9MXe0zmH09i8zu1NQlYKN8tlGHlt-eIw6WY-9xdZHtFm3wf_z4AfYhIQe</recordid><startdate>20110201</startdate><enddate>20110201</enddate><creator>Noorbehbahani, F.</creator><creator>Kardan, A.A.</creator><general>Elsevier Ltd</general><general>Elsevier</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20110201</creationdate><title>The automatic assessment of free text answers using a modified BLEU algorithm</title><author>Noorbehbahani, F. ; Kardan, A.A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c362t-8f508252ea8294055a5871968c081895532e98002eff5fd9f94ec4cba4e8dd9b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2011</creationdate><topic>Adult learning</topic><topic>Algorithms</topic><topic>Assessments</topic><topic>Computer Assisted Testing</topic><topic>Education</topic><topic>Educational Assessment</topic><topic>Educational Testing</topic><topic>Electronic Learning</topic><topic>Evaluation methodologies</topic><topic>Evaluation Methods</topic><topic>Learning</topic><topic>Mathematical analysis</topic><topic>Scoring</topic><topic>Semantics</topic><topic>Similarity</topic><topic>Student Evaluation</topic><topic>Students</topic><topic>Texts</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Noorbehbahani, F.</creatorcontrib><creatorcontrib>Kardan, A.A.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Computers and education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Noorbehbahani, F.</au><au>Kardan, A.A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ904351</ericid><atitle>The automatic assessment of free text answers using a modified BLEU algorithm</atitle><jtitle>Computers and education</jtitle><date>2011-02-01</date><risdate>2011</risdate><volume>56</volume><issue>2</issue><spage>337</spage><epage>345</epage><pages>337-345</pages><issn>0360-1315</issn><eissn>1873-782X</eissn><abstract>e-Learning plays an undoubtedly important role in today’s education and assessment is one of the most essential parts of any instruction-based learning process. Assessment is a common way to evaluate a student’s knowledge regarding the concepts related to learning objectives. In this paper, a new method for assessing the free text answers of students based on the BLEU algorithm is presented. We modify the BLEU algorithm so that it is suitable for assessing free text answers and call the new algorithm the modified BLEU (M-BLEU).
To perform an assessment, it is necessary to establish a repository of reference answers written by course instructors or related experts. Several reference answers are included for each question. The M-BLEU algorithm is used to identify the most similar reference answer to a student answer; a similarity score is calculated and applied to score the answers provided by students. Evaluation results show that the proposed method achieves the highest correlation with human expert scores compared to other assessment methods such as latent semantic analysis (LSA) and
n-gram co-occurrence.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.compedu.2010.07.013</doi><tpages>9</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0360-1315 |
| ispartof | Computers and education, 2011-02, Vol.56 (2), p.337-345 |
| issn | 0360-1315 1873-782X |
| language | eng |
| recordid | cdi_proquest_miscellaneous_855685952 |
| source | Elsevier ScienceDirect Journals Complete |
| subjects | Adult learning Algorithms Assessments Computer Assisted Testing Education Educational Assessment Educational Testing Electronic Learning Evaluation methodologies Evaluation Methods Learning Mathematical analysis Scoring Semantics Similarity Student Evaluation Students Texts |
| title | The automatic assessment of free text answers using a modified BLEU algorithm |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T20%3A24%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=The%20automatic%20assessment%20of%20free%20text%20answers%20using%20a%20modified%20BLEU%20algorithm&rft.jtitle=Computers%20and%20education&rft.au=Noorbehbahani,%20F.&rft.date=2011-02-01&rft.volume=56&rft.issue=2&rft.spage=337&rft.epage=345&rft.pages=337-345&rft.issn=0360-1315&rft.eissn=1873-782X&rft_id=info:doi/10.1016/j.compedu.2010.07.013&rft_dat=%3Cproquest_cross%3E855685952%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=855685952&rft_id=info:pmid/&rft_ericid=EJ904351&rft_els_id=S0360131510002058&rfr_iscdi=true |