An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets
In this article, we describe interrater reliability for the Comprehensive System (CS; Exner, 1993) in 8 relatively large samples, including (a) students, (b) experienced researchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in...
Gespeichert in:
| Veröffentlicht in: | Journal of personality assessment 2002-04, Vol.78 (2), p.219-274 |
|---|---|
| Hauptverfasser: | , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 274 |
|---|---|
| container_issue | 2 |
| container_start_page | 219 |
| container_title | Journal of personality assessment |
| container_volume | 78 |
| creator | Meyer, Gregory J. Hilsenroth, Mark J. Baxter, Dirk Exner, John E. Fowler, J. Christopher Piers, Craig C. Resnick, Justin |
| description | In this article, we describe interrater reliability for the Comprehensive System (CS; Exner, 1993) in 8 relatively large samples, including (a) students, (b) experienced researchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in which randomly generated erroneous scores were substituted for (f) 10%, (g) 20%, or (h) 30% of the original responses. Across samples, 133 to 143 statistically stable CS scores had excellent reliability, with median intraclass correlations of .85, .96, .97, .95, .93, .95, .89, and .82, respectively. We also demonstrate reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate. The CS can be scored reliably, but because scoring is the result of coder skills clinicians must conscientiously monitor their accuracy. |
| doi_str_mv | 10.1207/S15327752JPA7802_03 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_71823077</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>57726017</sourcerecordid><originalsourceid>FETCH-LOGICAL-c483t-a783fbba646a93e7cf172f061402e01c95040f35624d15b7de2cab8e10a743ae3</originalsourceid><addsrcrecordid>eNqFkUFvEzEQhS1ERUPhFyAhX-C27djeXW8uSFEotKhSUQPn1awz7rratYPtAPn3bJSgXhC9zEhP33sazWPsjYBzIUFfrESlpNaV_PJ1oRuQLahnbLYXi736nM0ApCxUMxen7GVKDwAgRClfsNPJX2sxlzP2sPD88jeOzmN2wfNg-bXPFCNOg9_R4LBzg8s7bkPkKxOi8_c898TvQkymR9PzZRg3kXryyf0kvtqlTCN3U6677zP_iBn5inJ6xU4sDoleH_cZ-_7p8tvyqri5_Xy9XNwUpmxULlA3ynYd1mWNc0XaWKGlhVqUIAmEmVdQglVVLcu1qDq9Jmmwa0gA6lIhqTP2_pC7ieHHllJuR5cMDQN6CtvUatFIBVo_CVZayxrEHlQH0MSQUiTbbqIbMe5aAe2-i_YfXUyut8f4bTfS-tFzfP4EvDsCmAwONqI3Lj1ySkNZA0zchwPn_FTCiL9CHNZtxt0Q4l-T-t8lfwDbtKWv</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>57726017</pqid></control><display><type>article</type><title>An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets</title><source>MEDLINE</source><source>EBSCO Business Source Complete</source><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><creator>Meyer, Gregory J. ; Hilsenroth, Mark J. ; Baxter, Dirk ; Exner, John E. ; Fowler, J. Christopher ; Piers, Craig C. ; Resnick, Justin</creator><creatorcontrib>Meyer, Gregory J. ; Hilsenroth, Mark J. ; Baxter, Dirk ; Exner, John E. ; Fowler, J. Christopher ; Piers, Craig C. ; Resnick, Justin</creatorcontrib><description>In this article, we describe interrater reliability for the Comprehensive System (CS; Exner, 1993) in 8 relatively large samples, including (a) students, (b) experienced researchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in which randomly generated erroneous scores were substituted for (f) 10%, (g) 20%, or (h) 30% of the original responses. Across samples, 133 to 143 statistically stable CS scores had excellent reliability, with median intraclass correlations of .85, .96, .97, .95, .93, .95, .89, and .82, respectively. We also demonstrate reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate. The CS can be scored reliably, but because scoring is the result of coder skills clinicians must conscientiously monitor their accuracy.</description><identifier>ISSN: 0022-3891</identifier><identifier>EISSN: 1532-7752</identifier><identifier>DOI: 10.1207/S15327752JPA7802_03</identifier><identifier>PMID: 12067192</identifier><identifier>CODEN: JNPABU</identifier><language>eng</language><publisher>Philadelphia, PA: Lawrence Erlbaum Associates, Inc</publisher><subject>Adult ; Biological and medical sciences ; Female ; Humans ; Interrater reliability ; Male ; Medical sciences ; Observer Variation ; Personality tests ; Psychology. Psychoanalysis. Psychiatry ; Psychometrics. Diagnostic aid systems ; Psychopathology. Psychiatry ; Reproducibility of Results ; Rorschach Test ; Sample Size ; Techniques and methods ; United States</subject><ispartof>Journal of personality assessment, 2002-04, Vol.78 (2), p.219-274</ispartof><rights>Copyright Taylor & Francis Group, LLC 2002</rights><rights>2002 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c483t-a783fbba646a93e7cf172f061402e01c95040f35624d15b7de2cab8e10a743ae3</citedby><cites>FETCH-LOGICAL-c483t-a783fbba646a93e7cf172f061402e01c95040f35624d15b7de2cab8e10a743ae3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27915,27916,30991</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=13704600$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/12067192$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Meyer, Gregory J.</creatorcontrib><creatorcontrib>Hilsenroth, Mark J.</creatorcontrib><creatorcontrib>Baxter, Dirk</creatorcontrib><creatorcontrib>Exner, John E.</creatorcontrib><creatorcontrib>Fowler, J. Christopher</creatorcontrib><creatorcontrib>Piers, Craig C.</creatorcontrib><creatorcontrib>Resnick, Justin</creatorcontrib><title>An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets</title><title>Journal of personality assessment</title><addtitle>J Pers Assess</addtitle><description>In this article, we describe interrater reliability for the Comprehensive System (CS; Exner, 1993) in 8 relatively large samples, including (a) students, (b) experienced researchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in which randomly generated erroneous scores were substituted for (f) 10%, (g) 20%, or (h) 30% of the original responses. Across samples, 133 to 143 statistically stable CS scores had excellent reliability, with median intraclass correlations of .85, .96, .97, .95, .93, .95, .89, and .82, respectively. We also demonstrate reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate. The CS can be scored reliably, but because scoring is the result of coder skills clinicians must conscientiously monitor their accuracy.</description><subject>Adult</subject><subject>Biological and medical sciences</subject><subject>Female</subject><subject>Humans</subject><subject>Interrater reliability</subject><subject>Male</subject><subject>Medical sciences</subject><subject>Observer Variation</subject><subject>Personality tests</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychometrics. Diagnostic aid systems</subject><subject>Psychopathology. Psychiatry</subject><subject>Reproducibility of Results</subject><subject>Rorschach Test</subject><subject>Sample Size</subject><subject>Techniques and methods</subject><subject>United States</subject><issn>0022-3891</issn><issn>1532-7752</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2002</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7QJ</sourceid><recordid>eNqFkUFvEzEQhS1ERUPhFyAhX-C27djeXW8uSFEotKhSUQPn1awz7rratYPtAPn3bJSgXhC9zEhP33sazWPsjYBzIUFfrESlpNaV_PJ1oRuQLahnbLYXi736nM0ApCxUMxen7GVKDwAgRClfsNPJX2sxlzP2sPD88jeOzmN2wfNg-bXPFCNOg9_R4LBzg8s7bkPkKxOi8_c898TvQkymR9PzZRg3kXryyf0kvtqlTCN3U6677zP_iBn5inJ6xU4sDoleH_cZ-_7p8tvyqri5_Xy9XNwUpmxULlA3ynYd1mWNc0XaWKGlhVqUIAmEmVdQglVVLcu1qDq9Jmmwa0gA6lIhqTP2_pC7ieHHllJuR5cMDQN6CtvUatFIBVo_CVZayxrEHlQH0MSQUiTbbqIbMe5aAe2-i_YfXUyut8f4bTfS-tFzfP4EvDsCmAwONqI3Lj1ySkNZA0zchwPn_FTCiL9CHNZtxt0Q4l-T-t8lfwDbtKWv</recordid><startdate>20020401</startdate><enddate>20020401</enddate><creator>Meyer, Gregory J.</creator><creator>Hilsenroth, Mark J.</creator><creator>Baxter, Dirk</creator><creator>Exner, John E.</creator><creator>Fowler, J. Christopher</creator><creator>Piers, Craig C.</creator><creator>Resnick, Justin</creator><general>Lawrence Erlbaum Associates, Inc</general><general>Taylor & Francis</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>7X8</scope></search><sort><creationdate>20020401</creationdate><title>An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets</title><author>Meyer, Gregory J. ; Hilsenroth, Mark J. ; Baxter, Dirk ; Exner, John E. ; Fowler, J. Christopher ; Piers, Craig C. ; Resnick, Justin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c483t-a783fbba646a93e7cf172f061402e01c95040f35624d15b7de2cab8e10a743ae3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2002</creationdate><topic>Adult</topic><topic>Biological and medical sciences</topic><topic>Female</topic><topic>Humans</topic><topic>Interrater reliability</topic><topic>Male</topic><topic>Medical sciences</topic><topic>Observer Variation</topic><topic>Personality tests</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychometrics. Diagnostic aid systems</topic><topic>Psychopathology. Psychiatry</topic><topic>Reproducibility of Results</topic><topic>Rorschach Test</topic><topic>Sample Size</topic><topic>Techniques and methods</topic><topic>United States</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Meyer, Gregory J.</creatorcontrib><creatorcontrib>Hilsenroth, Mark J.</creatorcontrib><creatorcontrib>Baxter, Dirk</creatorcontrib><creatorcontrib>Exner, John E.</creatorcontrib><creatorcontrib>Fowler, J. Christopher</creatorcontrib><creatorcontrib>Piers, Craig C.</creatorcontrib><creatorcontrib>Resnick, Justin</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of personality assessment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Meyer, Gregory J.</au><au>Hilsenroth, Mark J.</au><au>Baxter, Dirk</au><au>Exner, John E.</au><au>Fowler, J. Christopher</au><au>Piers, Craig C.</au><au>Resnick, Justin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets</atitle><jtitle>Journal of personality assessment</jtitle><addtitle>J Pers Assess</addtitle><date>2002-04-01</date><risdate>2002</risdate><volume>78</volume><issue>2</issue><spage>219</spage><epage>274</epage><pages>219-274</pages><issn>0022-3891</issn><eissn>1532-7752</eissn><coden>JNPABU</coden><abstract>In this article, we describe interrater reliability for the Comprehensive System (CS; Exner, 1993) in 8 relatively large samples, including (a) students, (b) experienced researchers, (c) clinicians, (d) clinicians and then researchers, (e) a composite clinical sample (i.e., a to d), and 3 samples in which randomly generated erroneous scores were substituted for (f) 10%, (g) 20%, or (h) 30% of the original responses. Across samples, 133 to 143 statistically stable CS scores had excellent reliability, with median intraclass correlations of .85, .96, .97, .95, .93, .95, .89, and .82, respectively. We also demonstrate reliability findings from this study closely match the results derived from a synthesis of prior research, CS summary scores are more reliable than scores assigned to individual responses, small samples are more likely to generate unstable and lower reliability estimates, and Meyer's (1997a) procedures for estimating response segment reliability were accurate. The CS can be scored reliably, but because scoring is the result of coder skills clinicians must conscientiously monitor their accuracy.</abstract><cop>Philadelphia, PA</cop><pub>Lawrence Erlbaum Associates, Inc</pub><pmid>12067192</pmid><doi>10.1207/S15327752JPA7802_03</doi><tpages>56</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0022-3891 |
| ispartof | Journal of personality assessment, 2002-04, Vol.78 (2), p.219-274 |
| issn | 0022-3891 1532-7752 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_71823077 |
| source | MEDLINE; EBSCO Business Source Complete; Applied Social Sciences Index & Abstracts (ASSIA) |
| subjects | Adult Biological and medical sciences Female Humans Interrater reliability Male Medical sciences Observer Variation Personality tests Psychology. Psychoanalysis. Psychiatry Psychometrics. Diagnostic aid systems Psychopathology. Psychiatry Reproducibility of Results Rorschach Test Sample Size Techniques and methods United States |
| title | An Examination of Interrater Reliability for Scoring the Rorschach Comprehensive System in Eight Data Sets |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T00%3A14%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Examination%20of%20Interrater%20Reliability%20for%20Scoring%20the%20Rorschach%20Comprehensive%20System%20in%20Eight%20Data%20Sets&rft.jtitle=Journal%20of%20personality%20assessment&rft.au=Meyer,%20Gregory%20J.&rft.date=2002-04-01&rft.volume=78&rft.issue=2&rft.spage=219&rft.epage=274&rft.pages=219-274&rft.issn=0022-3891&rft.eissn=1532-7752&rft.coden=JNPABU&rft_id=info:doi/10.1207/S15327752JPA7802_03&rft_dat=%3Cproquest_cross%3E57726017%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=57726017&rft_id=info:pmid/12067192&rfr_iscdi=true |