Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences
To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly estab...
Gespeichert in:
Veröffentlicht in: | Pakistan journal of medical sciences 2014-01, Vol.30 (1), p.3-6 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 6 |
---|---|
container_issue | 1 |
container_start_page | 3 |
container_title | Pakistan journal of medical sciences |
container_volume | 30 |
creator | Baig, Mukhtiar Ali, Syeda Kauser Ali, Sobia Huda, Nighat |
description | To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods.
This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated.
A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%).
There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students. |
doi_str_mv | 10.12669/pjms.301.4458 |
format | Article |
fullrecord | <record><control><sourceid>gale_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3955531</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A377340979</galeid><sourcerecordid>A377340979</sourcerecordid><originalsourceid>FETCH-LOGICAL-g462t-e91daaa78f450a21f25ae0dc68068f7d97c630044abfb788a579dbc42c395f473</originalsourceid><addsrcrecordid>eNptkcuLFDEQxoMo7kOvHiUgiJcek3RefRHWYXzALiKrsremJp1MZ0gnY6d7Yf_7zayr7ojkUCH1-75KVSH0gpIFZVI2b3fbIS9qQhecC_0IHVOpaaWouHp8d2cVYfzqCJ3kvCWESy7YU3TEuKwbzcgx-rG6hjDD5FPEyeGLOUx-Fyxe9skbiyF2-LJP44RXOcMN_jrbfMf6yQ4Z-4jfQ_YGX9jOGwj40ngbjc3P0BMHIdvn9_EUff-w-rb8VJ1_-fh5eXZebbhkU2Ub2gGA0o4LAow6JsCSzkhNpHaqa5SRdfk2h7VbK61BqKZbG85M3QjHVX2K3v3y3c3rwXbGxmmE0O5GP8B40ybw7WEm-r7dpOu26IWoaTF4c28wpp_75trBZ2NDgGjTnFsqiJZKEbKv9eofdJvmMZb2ClXMtGKU_qU2EGzro0ulrtmbtme1UjUnjWoKtfgPVU5nB29StM6X9wPB6weC3kKY-pzCvF9GPgRfPpzIn1H8Xnl9C4sCrCY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1555387211</pqid></control><display><type>article</type><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><source>DOAJ Directory of Open Access Journals</source><source>PubMed Central</source><source>Alma/SFX Local Collection</source><source>PubMed Central Open Access</source><creator>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</creator><creatorcontrib>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</creatorcontrib><description>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods.
This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated.
A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%).
There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</description><identifier>ISSN: 1682-024X</identifier><identifier>EISSN: 1681-715X</identifier><identifier>DOI: 10.12669/pjms.301.4458</identifier><identifier>PMID: 24639820</identifier><language>eng</language><publisher>Pakistan: Knowledge Bylanes</publisher><subject>Medical colleges ; Original</subject><ispartof>Pakistan journal of medical sciences, 2014-01, Vol.30 (1), p.3-6</ispartof><rights>COPYRIGHT 2014 Knowledge Bylanes</rights><rights>Copyright AsiaNet Pakistan (Pvt) Ltd. 2014</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC3955531/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC3955531/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,723,776,780,860,881,27901,27902,53766,53768</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24639820$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Baig, Mukhtiar</creatorcontrib><creatorcontrib>Ali, Syeda Kauser</creatorcontrib><creatorcontrib>Ali, Sobia</creatorcontrib><creatorcontrib>Huda, Nighat</creatorcontrib><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><title>Pakistan journal of medical sciences</title><addtitle>Pak J Med Sci</addtitle><description>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods.
This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated.
A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%).
There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</description><subject>Medical colleges</subject><subject>Original</subject><issn>1682-024X</issn><issn>1681-715X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNptkcuLFDEQxoMo7kOvHiUgiJcek3RefRHWYXzALiKrsremJp1MZ0gnY6d7Yf_7zayr7ojkUCH1-75KVSH0gpIFZVI2b3fbIS9qQhecC_0IHVOpaaWouHp8d2cVYfzqCJ3kvCWESy7YU3TEuKwbzcgx-rG6hjDD5FPEyeGLOUx-Fyxe9skbiyF2-LJP44RXOcMN_jrbfMf6yQ4Z-4jfQ_YGX9jOGwj40ngbjc3P0BMHIdvn9_EUff-w-rb8VJ1_-fh5eXZebbhkU2Ub2gGA0o4LAow6JsCSzkhNpHaqa5SRdfk2h7VbK61BqKZbG85M3QjHVX2K3v3y3c3rwXbGxmmE0O5GP8B40ybw7WEm-r7dpOu26IWoaTF4c28wpp_75trBZ2NDgGjTnFsqiJZKEbKv9eofdJvmMZb2ClXMtGKU_qU2EGzro0ulrtmbtme1UjUnjWoKtfgPVU5nB29StM6X9wPB6weC3kKY-pzCvF9GPgRfPpzIn1H8Xnl9C4sCrCY</recordid><startdate>20140101</startdate><enddate>20140101</enddate><creator>Baig, Mukhtiar</creator><creator>Ali, Syeda Kauser</creator><creator>Ali, Sobia</creator><creator>Huda, Nighat</creator><general>Knowledge Bylanes</general><general>AsiaNet Pakistan (Pvt) Ltd</general><general>Professional Medical Publicaitons</general><scope>NPM</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>NAPCQ</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20140101</creationdate><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><author>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g462t-e91daaa78f450a21f25ae0dc68068f7d97c630044abfb788a579dbc42c395f473</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>Medical colleges</topic><topic>Original</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Baig, Mukhtiar</creatorcontrib><creatorcontrib>Ali, Syeda Kauser</creatorcontrib><creatorcontrib>Ali, Sobia</creatorcontrib><creatorcontrib>Huda, Nighat</creatorcontrib><collection>PubMed</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing & Allied Health Database</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Nursing & Allied Health Premium</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Pakistan journal of medical sciences</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Baig, Mukhtiar</au><au>Ali, Syeda Kauser</au><au>Ali, Sobia</au><au>Huda, Nighat</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</atitle><jtitle>Pakistan journal of medical sciences</jtitle><addtitle>Pak J Med Sci</addtitle><date>2014-01-01</date><risdate>2014</risdate><volume>30</volume><issue>1</issue><spage>3</spage><epage>6</epage><pages>3-6</pages><issn>1682-024X</issn><eissn>1681-715X</eissn><abstract>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods.
This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated.
A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%).
There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</abstract><cop>Pakistan</cop><pub>Knowledge Bylanes</pub><pmid>24639820</pmid><doi>10.12669/pjms.301.4458</doi><tpages>4</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1682-024X |
ispartof | Pakistan journal of medical sciences, 2014-01, Vol.30 (1), p.3-6 |
issn | 1682-024X 1681-715X |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3955531 |
source | DOAJ Directory of Open Access Journals; PubMed Central; Alma/SFX Local Collection; PubMed Central Open Access |
subjects | Medical colleges Original |
title | Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-29T01%3A46%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluation%20of%20Multiple%20Choice%20and%20Short%20Essay%20Question%20items%20in%20Basic%20Medical%20Sciences&rft.jtitle=Pakistan%20journal%20of%20medical%20sciences&rft.au=Baig,%20Mukhtiar&rft.date=2014-01-01&rft.volume=30&rft.issue=1&rft.spage=3&rft.epage=6&rft.pages=3-6&rft.issn=1682-024X&rft.eissn=1681-715X&rft_id=info:doi/10.12669/pjms.301.4458&rft_dat=%3Cgale_pubme%3EA377340979%3C/gale_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1555387211&rft_id=info:pmid/24639820&rft_galeid=A377340979&rfr_iscdi=true |