Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences

To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly estab...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Pakistan journal of medical sciences 2014-01, Vol.30 (1), p.3-6
Hauptverfasser: Baig, Mukhtiar, Ali, Syeda Kauser, Ali, Sobia, Huda, Nighat
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6
container_issue 1
container_start_page 3
container_title Pakistan journal of medical sciences
container_volume 30
creator Baig, Mukhtiar
Ali, Syeda Kauser
Ali, Sobia
Huda, Nighat
description To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated. A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%). There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.
doi_str_mv 10.12669/pjms.301.4458
format Article
fullrecord <record><control><sourceid>gale_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3955531</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A377340979</galeid><sourcerecordid>A377340979</sourcerecordid><originalsourceid>FETCH-LOGICAL-g462t-e91daaa78f450a21f25ae0dc68068f7d97c630044abfb788a579dbc42c395f473</originalsourceid><addsrcrecordid>eNptkcuLFDEQxoMo7kOvHiUgiJcek3RefRHWYXzALiKrsremJp1MZ0gnY6d7Yf_7zayr7ojkUCH1-75KVSH0gpIFZVI2b3fbIS9qQhecC_0IHVOpaaWouHp8d2cVYfzqCJ3kvCWESy7YU3TEuKwbzcgx-rG6hjDD5FPEyeGLOUx-Fyxe9skbiyF2-LJP44RXOcMN_jrbfMf6yQ4Z-4jfQ_YGX9jOGwj40ngbjc3P0BMHIdvn9_EUff-w-rb8VJ1_-fh5eXZebbhkU2Ub2gGA0o4LAow6JsCSzkhNpHaqa5SRdfk2h7VbK61BqKZbG85M3QjHVX2K3v3y3c3rwXbGxmmE0O5GP8B40ybw7WEm-r7dpOu26IWoaTF4c28wpp_75trBZ2NDgGjTnFsqiJZKEbKv9eofdJvmMZb2ClXMtGKU_qU2EGzro0ulrtmbtme1UjUnjWoKtfgPVU5nB29StM6X9wPB6weC3kKY-pzCvF9GPgRfPpzIn1H8Xnl9C4sCrCY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1555387211</pqid></control><display><type>article</type><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><source>DOAJ Directory of Open Access Journals</source><source>PubMed Central</source><source>Alma/SFX Local Collection</source><source>PubMed Central Open Access</source><creator>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</creator><creatorcontrib>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</creatorcontrib><description>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated. A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%). There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</description><identifier>ISSN: 1682-024X</identifier><identifier>EISSN: 1681-715X</identifier><identifier>DOI: 10.12669/pjms.301.4458</identifier><identifier>PMID: 24639820</identifier><language>eng</language><publisher>Pakistan: Knowledge Bylanes</publisher><subject>Medical colleges ; Original</subject><ispartof>Pakistan journal of medical sciences, 2014-01, Vol.30 (1), p.3-6</ispartof><rights>COPYRIGHT 2014 Knowledge Bylanes</rights><rights>Copyright AsiaNet Pakistan (Pvt) Ltd. 2014</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC3955531/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC3955531/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,723,776,780,860,881,27901,27902,53766,53768</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24639820$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Baig, Mukhtiar</creatorcontrib><creatorcontrib>Ali, Syeda Kauser</creatorcontrib><creatorcontrib>Ali, Sobia</creatorcontrib><creatorcontrib>Huda, Nighat</creatorcontrib><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><title>Pakistan journal of medical sciences</title><addtitle>Pak J Med Sci</addtitle><description>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated. A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%). There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</description><subject>Medical colleges</subject><subject>Original</subject><issn>1682-024X</issn><issn>1681-715X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2014</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNptkcuLFDEQxoMo7kOvHiUgiJcek3RefRHWYXzALiKrsremJp1MZ0gnY6d7Yf_7zayr7ojkUCH1-75KVSH0gpIFZVI2b3fbIS9qQhecC_0IHVOpaaWouHp8d2cVYfzqCJ3kvCWESy7YU3TEuKwbzcgx-rG6hjDD5FPEyeGLOUx-Fyxe9skbiyF2-LJP44RXOcMN_jrbfMf6yQ4Z-4jfQ_YGX9jOGwj40ngbjc3P0BMHIdvn9_EUff-w-rb8VJ1_-fh5eXZebbhkU2Ub2gGA0o4LAow6JsCSzkhNpHaqa5SRdfk2h7VbK61BqKZbG85M3QjHVX2K3v3y3c3rwXbGxmmE0O5GP8B40ybw7WEm-r7dpOu26IWoaTF4c28wpp_75trBZ2NDgGjTnFsqiJZKEbKv9eofdJvmMZb2ClXMtGKU_qU2EGzro0ulrtmbtme1UjUnjWoKtfgPVU5nB29StM6X9wPB6weC3kKY-pzCvF9GPgRfPpzIn1H8Xnl9C4sCrCY</recordid><startdate>20140101</startdate><enddate>20140101</enddate><creator>Baig, Mukhtiar</creator><creator>Ali, Syeda Kauser</creator><creator>Ali, Sobia</creator><creator>Huda, Nighat</creator><general>Knowledge Bylanes</general><general>AsiaNet Pakistan (Pvt) Ltd</general><general>Professional Medical Publicaitons</general><scope>NPM</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>NAPCQ</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20140101</creationdate><title>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</title><author>Baig, Mukhtiar ; Ali, Syeda Kauser ; Ali, Sobia ; Huda, Nighat</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g462t-e91daaa78f450a21f25ae0dc68068f7d97c630044abfb788a579dbc42c395f473</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2014</creationdate><topic>Medical colleges</topic><topic>Original</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Baig, Mukhtiar</creatorcontrib><creatorcontrib>Ali, Syeda Kauser</creatorcontrib><creatorcontrib>Ali, Sobia</creatorcontrib><creatorcontrib>Huda, Nighat</creatorcontrib><collection>PubMed</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing &amp; Allied Health Database</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Pakistan journal of medical sciences</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Baig, Mukhtiar</au><au>Ali, Syeda Kauser</au><au>Ali, Sobia</au><au>Huda, Nighat</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences</atitle><jtitle>Pakistan journal of medical sciences</jtitle><addtitle>Pak J Med Sci</addtitle><date>2014-01-01</date><risdate>2014</risdate><volume>30</volume><issue>1</issue><spage>3</spage><epage>6</epage><pages>3-6</pages><issn>1682-024X</issn><eissn>1681-715X</eissn><abstract>To evaluate Multiple Choice and Short Essay Question items in Basic Medical Sciences by determining item writing flaws (IWFs) of MCQs along with cognitive level of each item in both methods. This analytical study evaluated the quality of the assessment tools used for the first batch in a newly established medical college in Karachi, Pakistan. First and sixth module assessment tools in Biochemistry during 2009-2010 were analyzed. Cognitive level of MCQs and SEQs, were noted and MCQ item writing flaws were also evaluated. A total of 36 SEQs and 150 MCQs of four items were analyzed. The cognitive level of 83.33% of SEQs was at recall level while remaining 16.67% were assessing interpretation of data. Seventy six percent of the MCQs were at recall level while remaining 24% were at the interpretation. Regarding IWFs, 69 IWFs were found in 150 MCQs. The commonest among them were implausible distracters (30.43%), unfocused stem (27.54%) and unnecessary information in the stem (24.64%). There is a need to review the quality including the content of assessment tools. A structured faculty development program is recommended for developing improved assessment tools that align with learning outcomes and measure competency of medical students.</abstract><cop>Pakistan</cop><pub>Knowledge Bylanes</pub><pmid>24639820</pmid><doi>10.12669/pjms.301.4458</doi><tpages>4</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1682-024X
ispartof Pakistan journal of medical sciences, 2014-01, Vol.30 (1), p.3-6
issn 1682-024X
1681-715X
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_3955531
source DOAJ Directory of Open Access Journals; PubMed Central; Alma/SFX Local Collection; PubMed Central Open Access
subjects Medical colleges
Original
title Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-29T01%3A46%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluation%20of%20Multiple%20Choice%20and%20Short%20Essay%20Question%20items%20in%20Basic%20Medical%20Sciences&rft.jtitle=Pakistan%20journal%20of%20medical%20sciences&rft.au=Baig,%20Mukhtiar&rft.date=2014-01-01&rft.volume=30&rft.issue=1&rft.spage=3&rft.epage=6&rft.pages=3-6&rft.issn=1682-024X&rft.eissn=1681-715X&rft_id=info:doi/10.12669/pjms.301.4458&rft_dat=%3Cgale_pubme%3EA377340979%3C/gale_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1555387211&rft_id=info:pmid/24639820&rft_galeid=A377340979&rfr_iscdi=true