Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study
Objectives To assess intra‐ and inter‐institutional concordance and identify methods to increase precision in radiologic extranodal extension (rENE) ascertainment in HPV+ oropharyngeal carcinoma. Methods Six radiologists, blinded to clinical outcomes, from three centers assessed rENE in two phases:...
Gespeichert in:
| Veröffentlicht in: | Head & neck 2022-11, Vol.44 (11), p.2361-2369 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 2369 |
|---|---|
| container_issue | 11 |
| container_start_page | 2361 |
| container_title | Head & neck |
| container_volume | 44 |
| creator | Hoebers, Frank Yu, Eugene O'Sullivan, Brian Postma, Alida A. Palm, Walter M. Bartlett, Eric Lee, Jonathan Stock, Sarah Koyfman, Shlomo Su, Jie Xu, Wei Huang, Shao Hui |
| description | Objectives
To assess intra‐ and inter‐institutional concordance and identify methods to increase precision in radiologic extranodal extension (rENE) ascertainment in HPV+ oropharyngeal carcinoma.
Methods
Six radiologists, blinded to clinical outcomes, from three centers assessed rENE in two phases: Phase‐I (20 cases) utilized each individual's a priori appreciation of the literature. Phase‐II (30 additional cases) was performed after deliberating experience and consolidating operating definitions. Intra‐ and inter‐institutional Kappa were calculated at >50% and >75% certainty levels, respectively.
Results
The Phase‐I intra‐institutional kappa was 0.76, 0.32, and 0.44 at >50% certainty and improved to 0.89, 0.61, and 0.66 at >75% certainty. Inter‐institutional Fleiss' kappa also improved with higher certainty (from 0.40 to 0.57, p = 0.039). The Phase‐II inter‐rater kappa was significantly higher than Phase‐I at the same certainty level (both p |
| doi_str_mv | 10.1002/hed.27130 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2682260826</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2682260826</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3300-37aa13e71e55d8de0c092f5e47a7956fd9fe6b80d8d4498a5633d38c1d27fcc3</originalsourceid><addsrcrecordid>eNp10bFu2zAQBmAhaIG4SYe8AYEuzaD4SEqi1M1wnbhAgHQwuhIMeXIYSKRLSmm8deqcZ8yThKozBch0B_D7ySMuy84oXFAANr9Dc8EE5XCUzSg0IgdeiA9TX_CcgyiOs08x3gMArwo2y_4txm2PbrBuS6wbMDz_fQoqVaK90z4Y5TQS35KgjPWd31pN8HEIynmjuqlFF613KUzWP3-l9M5HO9iHFAp-d6fC3m0xSa2Cts736htZkH7sBqtxeo_EYTT70-xjq7qIn1_rSba5XG2W6_z65urHcnGda84Bci6UohwFxbI0tUHQ0LC2xEIo0ZRVa5oWq9sa0llRNLUqK84NrzU1TLRa85Ps6-HaXfC_R4yD7G3U2HXKoR-jZFXNWAU1qxL98obe-zG4NJxkIiHKEk3q_KB08DEGbOUu2D59WlKQ00JkWoj8v5Bk5wf7x3a4fx_K9er7IfECoFSQ-w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2722612822</pqid></control><display><type>article</type><title>Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study</title><source>Wiley Online Library Journals Frontfile Complete</source><creator>Hoebers, Frank ; Yu, Eugene ; O'Sullivan, Brian ; Postma, Alida A. ; Palm, Walter M. ; Bartlett, Eric ; Lee, Jonathan ; Stock, Sarah ; Koyfman, Shlomo ; Su, Jie ; Xu, Wei ; Huang, Shao Hui</creator><creatorcontrib>Hoebers, Frank ; Yu, Eugene ; O'Sullivan, Brian ; Postma, Alida A. ; Palm, Walter M. ; Bartlett, Eric ; Lee, Jonathan ; Stock, Sarah ; Koyfman, Shlomo ; Su, Jie ; Xu, Wei ; Huang, Shao Hui</creatorcontrib><description>Objectives
To assess intra‐ and inter‐institutional concordance and identify methods to increase precision in radiologic extranodal extension (rENE) ascertainment in HPV+ oropharyngeal carcinoma.
Methods
Six radiologists, blinded to clinical outcomes, from three centers assessed rENE in two phases: Phase‐I (20 cases) utilized each individual's a priori appreciation of the literature. Phase‐II (30 additional cases) was performed after deliberating experience and consolidating operating definitions. Intra‐ and inter‐institutional Kappa were calculated at >50% and >75% certainty levels, respectively.
Results
The Phase‐I intra‐institutional kappa was 0.76, 0.32, and 0.44 at >50% certainty and improved to 0.89, 0.61, and 0.66 at >75% certainty. Inter‐institutional Fleiss' kappa also improved with higher certainty (from 0.40 to 0.57, p = 0.039). The Phase‐II inter‐rater kappa was significantly higher than Phase‐I at the same certainty level (both p < 0.001).
Conclusion
A learning curve exists for rENE assessment. Strategies to augment reliability include high certainty for declaration, consolidated operating definitions, and sharing experience among radiologists.</description><identifier>ISSN: 1043-3074</identifier><identifier>EISSN: 1097-0347</identifier><identifier>DOI: 10.1002/hed.27130</identifier><language>eng</language><publisher>Hoboken, USA: John Wiley & Sons, Inc</publisher><subject>computed tomography ; extranodal extension ; Head & neck cancer ; interobserver agreement ; magnetic resonance imaging ; oropharyngeal carcinoma ; radiology ; Throat cancer</subject><ispartof>Head & neck, 2022-11, Vol.44 (11), p.2361-2369</ispartof><rights>2022 Wiley Periodicals LLC.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3300-37aa13e71e55d8de0c092f5e47a7956fd9fe6b80d8d4498a5633d38c1d27fcc3</citedby><cites>FETCH-LOGICAL-c3300-37aa13e71e55d8de0c092f5e47a7956fd9fe6b80d8d4498a5633d38c1d27fcc3</cites><orcidid>0000-0002-8072-4388</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fhed.27130$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fhed.27130$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,776,780,1411,27901,27902,45550,45551</link.rule.ids></links><search><creatorcontrib>Hoebers, Frank</creatorcontrib><creatorcontrib>Yu, Eugene</creatorcontrib><creatorcontrib>O'Sullivan, Brian</creatorcontrib><creatorcontrib>Postma, Alida A.</creatorcontrib><creatorcontrib>Palm, Walter M.</creatorcontrib><creatorcontrib>Bartlett, Eric</creatorcontrib><creatorcontrib>Lee, Jonathan</creatorcontrib><creatorcontrib>Stock, Sarah</creatorcontrib><creatorcontrib>Koyfman, Shlomo</creatorcontrib><creatorcontrib>Su, Jie</creatorcontrib><creatorcontrib>Xu, Wei</creatorcontrib><creatorcontrib>Huang, Shao Hui</creatorcontrib><title>Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study</title><title>Head & neck</title><description>Objectives
To assess intra‐ and inter‐institutional concordance and identify methods to increase precision in radiologic extranodal extension (rENE) ascertainment in HPV+ oropharyngeal carcinoma.
Methods
Six radiologists, blinded to clinical outcomes, from three centers assessed rENE in two phases: Phase‐I (20 cases) utilized each individual's a priori appreciation of the literature. Phase‐II (30 additional cases) was performed after deliberating experience and consolidating operating definitions. Intra‐ and inter‐institutional Kappa were calculated at >50% and >75% certainty levels, respectively.
Results
The Phase‐I intra‐institutional kappa was 0.76, 0.32, and 0.44 at >50% certainty and improved to 0.89, 0.61, and 0.66 at >75% certainty. Inter‐institutional Fleiss' kappa also improved with higher certainty (from 0.40 to 0.57, p = 0.039). The Phase‐II inter‐rater kappa was significantly higher than Phase‐I at the same certainty level (both p < 0.001).
Conclusion
A learning curve exists for rENE assessment. Strategies to augment reliability include high certainty for declaration, consolidated operating definitions, and sharing experience among radiologists.</description><subject>computed tomography</subject><subject>extranodal extension</subject><subject>Head & neck cancer</subject><subject>interobserver agreement</subject><subject>magnetic resonance imaging</subject><subject>oropharyngeal carcinoma</subject><subject>radiology</subject><subject>Throat cancer</subject><issn>1043-3074</issn><issn>1097-0347</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNp10bFu2zAQBmAhaIG4SYe8AYEuzaD4SEqi1M1wnbhAgHQwuhIMeXIYSKRLSmm8deqcZ8yThKozBch0B_D7ySMuy84oXFAANr9Dc8EE5XCUzSg0IgdeiA9TX_CcgyiOs08x3gMArwo2y_4txm2PbrBuS6wbMDz_fQoqVaK90z4Y5TQS35KgjPWd31pN8HEIynmjuqlFF613KUzWP3-l9M5HO9iHFAp-d6fC3m0xSa2Cts736htZkH7sBqtxeo_EYTT70-xjq7qIn1_rSba5XG2W6_z65urHcnGda84Bci6UohwFxbI0tUHQ0LC2xEIo0ZRVa5oWq9sa0llRNLUqK84NrzU1TLRa85Ps6-HaXfC_R4yD7G3U2HXKoR-jZFXNWAU1qxL98obe-zG4NJxkIiHKEk3q_KB08DEGbOUu2D59WlKQ00JkWoj8v5Bk5wf7x3a4fx_K9er7IfECoFSQ-w</recordid><startdate>202211</startdate><enddate>202211</enddate><creator>Hoebers, Frank</creator><creator>Yu, Eugene</creator><creator>O'Sullivan, Brian</creator><creator>Postma, Alida A.</creator><creator>Palm, Walter M.</creator><creator>Bartlett, Eric</creator><creator>Lee, Jonathan</creator><creator>Stock, Sarah</creator><creator>Koyfman, Shlomo</creator><creator>Su, Jie</creator><creator>Xu, Wei</creator><creator>Huang, Shao Hui</creator><general>John Wiley & Sons, Inc</general><general>Wiley Subscription Services, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7QP</scope><scope>7TK</scope><scope>K9.</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8072-4388</orcidid></search><sort><creationdate>202211</creationdate><title>Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study</title><author>Hoebers, Frank ; Yu, Eugene ; O'Sullivan, Brian ; Postma, Alida A. ; Palm, Walter M. ; Bartlett, Eric ; Lee, Jonathan ; Stock, Sarah ; Koyfman, Shlomo ; Su, Jie ; Xu, Wei ; Huang, Shao Hui</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3300-37aa13e71e55d8de0c092f5e47a7956fd9fe6b80d8d4498a5633d38c1d27fcc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>computed tomography</topic><topic>extranodal extension</topic><topic>Head & neck cancer</topic><topic>interobserver agreement</topic><topic>magnetic resonance imaging</topic><topic>oropharyngeal carcinoma</topic><topic>radiology</topic><topic>Throat cancer</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hoebers, Frank</creatorcontrib><creatorcontrib>Yu, Eugene</creatorcontrib><creatorcontrib>O'Sullivan, Brian</creatorcontrib><creatorcontrib>Postma, Alida A.</creatorcontrib><creatorcontrib>Palm, Walter M.</creatorcontrib><creatorcontrib>Bartlett, Eric</creatorcontrib><creatorcontrib>Lee, Jonathan</creatorcontrib><creatorcontrib>Stock, Sarah</creatorcontrib><creatorcontrib>Koyfman, Shlomo</creatorcontrib><creatorcontrib>Su, Jie</creatorcontrib><creatorcontrib>Xu, Wei</creatorcontrib><creatorcontrib>Huang, Shao Hui</creatorcontrib><collection>CrossRef</collection><collection>Calcium & Calcified Tissue Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>MEDLINE - Academic</collection><jtitle>Head & neck</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hoebers, Frank</au><au>Yu, Eugene</au><au>O'Sullivan, Brian</au><au>Postma, Alida A.</au><au>Palm, Walter M.</au><au>Bartlett, Eric</au><au>Lee, Jonathan</au><au>Stock, Sarah</au><au>Koyfman, Shlomo</au><au>Su, Jie</au><au>Xu, Wei</au><au>Huang, Shao Hui</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study</atitle><jtitle>Head & neck</jtitle><date>2022-11</date><risdate>2022</risdate><volume>44</volume><issue>11</issue><spage>2361</spage><epage>2369</epage><pages>2361-2369</pages><issn>1043-3074</issn><eissn>1097-0347</eissn><abstract>Objectives
To assess intra‐ and inter‐institutional concordance and identify methods to increase precision in radiologic extranodal extension (rENE) ascertainment in HPV+ oropharyngeal carcinoma.
Methods
Six radiologists, blinded to clinical outcomes, from three centers assessed rENE in two phases: Phase‐I (20 cases) utilized each individual's a priori appreciation of the literature. Phase‐II (30 additional cases) was performed after deliberating experience and consolidating operating definitions. Intra‐ and inter‐institutional Kappa were calculated at >50% and >75% certainty levels, respectively.
Results
The Phase‐I intra‐institutional kappa was 0.76, 0.32, and 0.44 at >50% certainty and improved to 0.89, 0.61, and 0.66 at >75% certainty. Inter‐institutional Fleiss' kappa also improved with higher certainty (from 0.40 to 0.57, p = 0.039). The Phase‐II inter‐rater kappa was significantly higher than Phase‐I at the same certainty level (both p < 0.001).
Conclusion
A learning curve exists for rENE assessment. Strategies to augment reliability include high certainty for declaration, consolidated operating definitions, and sharing experience among radiologists.</abstract><cop>Hoboken, USA</cop><pub>John Wiley & Sons, Inc</pub><doi>10.1002/hed.27130</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-8072-4388</orcidid></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1043-3074 |
| ispartof | Head & neck, 2022-11, Vol.44 (11), p.2361-2369 |
| issn | 1043-3074 1097-0347 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_2682260826 |
| source | Wiley Online Library Journals Frontfile Complete |
| subjects | computed tomography extranodal extension Head & neck cancer interobserver agreement magnetic resonance imaging oropharyngeal carcinoma radiology Throat cancer |
| title | Augmenting inter‐rater concordance of radiologic extranodal extension in HPV‐positive oropharyngeal carcinoma: A multicenter study |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T00%3A35%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Augmenting%20inter%E2%80%90rater%20concordance%20of%20radiologic%20extranodal%20extension%20in%20HPV%E2%80%90positive%20oropharyngeal%20carcinoma:%20A%20multicenter%20study&rft.jtitle=Head%20&%20neck&rft.au=Hoebers,%20Frank&rft.date=2022-11&rft.volume=44&rft.issue=11&rft.spage=2361&rft.epage=2369&rft.pages=2361-2369&rft.issn=1043-3074&rft.eissn=1097-0347&rft_id=info:doi/10.1002/hed.27130&rft_dat=%3Cproquest_cross%3E2682260826%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2722612822&rft_id=info:pmid/&rfr_iscdi=true |