Demonstration of Portfolios to Assess Competency of Residents
Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychi...
Gespeichert in:
| Veröffentlicht in: | Advances in health sciences education : theory and practice 2004-01, Vol.9 (4), p.309-323 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 323 |
|---|---|
| container_issue | 4 |
| container_start_page | 309 |
| container_title | Advances in health sciences education : theory and practice |
| container_volume | 9 |
| creator | O'sullivan, Patricia S Reckase, Mark D McClain, Tina Savidge, Mildred A Clardy, James A |
| description | Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4 years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid. |
| doi_str_mv | 10.1007/s10459-004-0885-0 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_67152425</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ797089</ericid><sourcerecordid>67152425</sourcerecordid><originalsourceid>FETCH-LOGICAL-c504t-ea346cfa1afb818a47bc6cc58de470df70533eb17d38fec4fdfeb7abe0207a5b3</originalsourceid><addsrcrecordid>eNqF0U1r3DAQBmARUpLNNj8gEIIhJDe3I0uy5EMOyzb9ItBSmrOQ5RE42NZG4z3sv6_NLl3IJScN6JmBmZexKw6fOID-TBykqnIAmYMxKocTtuBKi5yXWp9OtTBFLquqPGcXRC8AILgxZ-ycK2WENOWCPXzBPg40Jje2cchiyH7HNIbYtZGyMWYrIiTK1rHf4IiD383kD1Lb4DDSR_YhuI7w8vAu2fPXx7_r7_nTr28_1qun3CuQY45OyNIHx12oDTdO6tqX3ivToNTQBA1KCKy5boQJ6GVoAtba1QgFaKdqsWT3-7mbFF-3SKPtW_LYdW7AuCVbaq4KWaj3Ia-4EeUMb9_Al7hNw7SELQpVcWWq6VpLxvfKp0iUMNhNanuXdpaDnSOw-wjsFIGdI7Bzz81h8rbusTl2HG4-gbsDcORdF5IbfEtHVwpljC4md713mFr___vxp640mEr8A2XZl6g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2259158900</pqid></control><display><type>article</type><title>Demonstration of Portfolios to Assess Competency of Residents</title><source>MEDLINE</source><source>Springer Nature - Complete Springer Journals</source><creator>O'sullivan, Patricia S ; Reckase, Mark D ; McClain, Tina ; Savidge, Mildred A ; Clardy, James A</creator><creatorcontrib>O'sullivan, Patricia S ; Reckase, Mark D ; McClain, Tina ; Savidge, Mildred A ; Clardy, James A</creatorcontrib><description>Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4 years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.</description><identifier>ISSN: 1382-4996</identifier><identifier>EISSN: 1573-1677</identifier><identifier>DOI: 10.1007/s10459-004-0885-0</identifier><identifier>PMID: 15583486</identifier><language>eng</language><publisher>Heidelberg: Springer</publisher><subject>Case Studies ; Clinical Competence ; Competence ; Cross-Sectional Studies ; Curriculum subjects: programmes and methods ; Educational Measurement - methods ; Educational sciences ; Humans ; Internship and Residency ; Medical and paramedical education ; Medical Care Evaluation ; Portfolio Assessment ; Psychiatry ; Reliability ; Reproducibility of Results ; Resident Advisers ; Residential Programs ; Teaching methods ; Validity</subject><ispartof>Advances in health sciences education : theory and practice, 2004-01, Vol.9 (4), p.309-323</ispartof><rights>2005 INIST-CNRS</rights><rights>Advances in Health Sciences Education is a copyright of Springer, (2004). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c504t-ea346cfa1afb818a47bc6cc58de470df70533eb17d38fec4fdfeb7abe0207a5b3</citedby><cites>FETCH-LOGICAL-c504t-ea346cfa1afb818a47bc6cc58de470df70533eb17d38fec4fdfeb7abe0207a5b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ797089$$DView record in ERIC$$Hfree_for_read</backlink><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=16358872$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/15583486$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>O'sullivan, Patricia S</creatorcontrib><creatorcontrib>Reckase, Mark D</creatorcontrib><creatorcontrib>McClain, Tina</creatorcontrib><creatorcontrib>Savidge, Mildred A</creatorcontrib><creatorcontrib>Clardy, James A</creatorcontrib><title>Demonstration of Portfolios to Assess Competency of Residents</title><title>Advances in health sciences education : theory and practice</title><addtitle>Adv Health Sci Educ Theory Pract</addtitle><description>Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4 years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.</description><subject>Case Studies</subject><subject>Clinical Competence</subject><subject>Competence</subject><subject>Cross-Sectional Studies</subject><subject>Curriculum subjects: programmes and methods</subject><subject>Educational Measurement - methods</subject><subject>Educational sciences</subject><subject>Humans</subject><subject>Internship and Residency</subject><subject>Medical and paramedical education</subject><subject>Medical Care Evaluation</subject><subject>Portfolio Assessment</subject><subject>Psychiatry</subject><subject>Reliability</subject><subject>Reproducibility of Results</subject><subject>Resident Advisers</subject><subject>Residential Programs</subject><subject>Teaching methods</subject><subject>Validity</subject><issn>1382-4996</issn><issn>1573-1677</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2004</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNqF0U1r3DAQBmARUpLNNj8gEIIhJDe3I0uy5EMOyzb9ItBSmrOQ5RE42NZG4z3sv6_NLl3IJScN6JmBmZexKw6fOID-TBykqnIAmYMxKocTtuBKi5yXWp9OtTBFLquqPGcXRC8AILgxZ-ycK2WENOWCPXzBPg40Jje2cchiyH7HNIbYtZGyMWYrIiTK1rHf4IiD383kD1Lb4DDSR_YhuI7w8vAu2fPXx7_r7_nTr28_1qun3CuQY45OyNIHx12oDTdO6tqX3ivToNTQBA1KCKy5boQJ6GVoAtba1QgFaKdqsWT3-7mbFF-3SKPtW_LYdW7AuCVbaq4KWaj3Ia-4EeUMb9_Al7hNw7SELQpVcWWq6VpLxvfKp0iUMNhNanuXdpaDnSOw-wjsFIGdI7Bzz81h8rbusTl2HG4-gbsDcORdF5IbfEtHVwpljC4md713mFr___vxp640mEr8A2XZl6g</recordid><startdate>20040101</startdate><enddate>20040101</enddate><creator>O'sullivan, Patricia S</creator><creator>Reckase, Mark D</creator><creator>McClain, Tina</creator><creator>Savidge, Mildred A</creator><creator>Clardy, James A</creator><general>Springer</general><general>Springer Nature B.V</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7X7</scope><scope>7XB</scope><scope>88B</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>K9.</scope><scope>M0P</scope><scope>M0S</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><scope>7X8</scope></search><sort><creationdate>20040101</creationdate><title>Demonstration of Portfolios to Assess Competency of Residents</title><author>O'sullivan, Patricia S ; Reckase, Mark D ; McClain, Tina ; Savidge, Mildred A ; Clardy, James A</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c504t-ea346cfa1afb818a47bc6cc58de470df70533eb17d38fec4fdfeb7abe0207a5b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2004</creationdate><topic>Case Studies</topic><topic>Clinical Competence</topic><topic>Competence</topic><topic>Cross-Sectional Studies</topic><topic>Curriculum subjects: programmes and methods</topic><topic>Educational Measurement - methods</topic><topic>Educational sciences</topic><topic>Humans</topic><topic>Internship and Residency</topic><topic>Medical and paramedical education</topic><topic>Medical Care Evaluation</topic><topic>Portfolio Assessment</topic><topic>Psychiatry</topic><topic>Reliability</topic><topic>Reproducibility of Results</topic><topic>Resident Advisers</topic><topic>Residential Programs</topic><topic>Teaching methods</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>O'sullivan, Patricia S</creatorcontrib><creatorcontrib>Reckase, Mark D</creatorcontrib><creatorcontrib>McClain, Tina</creatorcontrib><creatorcontrib>Savidge, Mildred A</creatorcontrib><creatorcontrib>Clardy, James A</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Education Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><jtitle>Advances in health sciences education : theory and practice</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>O'sullivan, Patricia S</au><au>Reckase, Mark D</au><au>McClain, Tina</au><au>Savidge, Mildred A</au><au>Clardy, James A</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ797089</ericid><atitle>Demonstration of Portfolios to Assess Competency of Residents</atitle><jtitle>Advances in health sciences education : theory and practice</jtitle><addtitle>Adv Health Sci Educ Theory Pract</addtitle><date>2004-01-01</date><risdate>2004</risdate><volume>9</volume><issue>4</issue><spage>309</spage><epage>323</epage><pages>309-323</pages><issn>1382-4996</issn><eissn>1573-1677</eissn><abstract>Residency educators are identifying approaches to measure resident competence. Portfolios are well suited since they require work already completed as part of patient care where competency must be demonstrated. This paper describes assessment of the reliability and validity of portfolios in a psychiatry residency program. This was a cross-sectional study across 4 years of residency education. Using guidelines, 18 residents assembled portfolios containing five entries chosen from 13 skills. Trained raters scored the portfolios. Residents and faculty were interviewed about their perceptions. Generalizability results indicated five entries and two raters were sufficient for relative decisions. Six entries or a third rater would be sufficient for absolute decisions. Portfolio scores tended to improve with years of training and correlated with psychiatric knowledge but not clinical performance. Residents and faculty identified benefits to assembling a portfolio. Portfolios incorporate tasks embedded in the residency to provide evidence of resident competency. The results support that the score is reliable and valid.</abstract><cop>Heidelberg</cop><pub>Springer</pub><pmid>15583486</pmid><doi>10.1007/s10459-004-0885-0</doi><tpages>15</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1382-4996 |
| ispartof | Advances in health sciences education : theory and practice, 2004-01, Vol.9 (4), p.309-323 |
| issn | 1382-4996 1573-1677 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_67152425 |
| source | MEDLINE; Springer Nature - Complete Springer Journals |
| subjects | Case Studies Clinical Competence Competence Cross-Sectional Studies Curriculum subjects: programmes and methods Educational Measurement - methods Educational sciences Humans Internship and Residency Medical and paramedical education Medical Care Evaluation Portfolio Assessment Psychiatry Reliability Reproducibility of Results Resident Advisers Residential Programs Teaching methods Validity |
| title | Demonstration of Portfolios to Assess Competency of Residents |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T04%3A26%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Demonstration%20of%20Portfolios%20to%20Assess%20Competency%20of%20Residents&rft.jtitle=Advances%20in%20health%20sciences%20education%20:%20theory%20and%20practice&rft.au=O'sullivan,%20Patricia%20S&rft.date=2004-01-01&rft.volume=9&rft.issue=4&rft.spage=309&rft.epage=323&rft.pages=309-323&rft.issn=1382-4996&rft.eissn=1573-1677&rft_id=info:doi/10.1007/s10459-004-0885-0&rft_dat=%3Cproquest_cross%3E67152425%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2259158900&rft_id=info:pmid/15583486&rft_ericid=EJ797089&rfr_iscdi=true |