An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma

Real‐world evidence can close the inferential gap between marketing authorization studies and clinical practice. However, the current standard for real‐world data extraction from electronic health records (EHRs) for treatment evaluation is manual review (MR), which is time‐consuming and laborious. C...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Clinical pharmacology and therapeutics 2020-09, Vol.108 (3), p.644-652
Hauptverfasser: Laar, Sylvia A., Gombert‐Handoko, Kim B., Guchelaar, Henk‐Jan, Zwaveling, Juliëtte
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 652
container_issue 3
container_start_page 644
container_title Clinical pharmacology and therapeutics
container_volume 108
creator Laar, Sylvia A.
Gombert‐Handoko, Kim B.
Guchelaar, Henk‐Jan
Zwaveling, Juliëtte
description Real‐world evidence can close the inferential gap between marketing authorization studies and clinical practice. However, the current standard for real‐world data extraction from electronic health records (EHRs) for treatment evaluation is manual review (MR), which is time‐consuming and laborious. Clinical Data Collector (CDC) is a novel natural language processing and text mining software tool for both structured and unstructured EHR data and only shows relevant EHR sections improving efficiency. We investigated CDC as a real‐world data (RWD) collection method, through application of CDC queries for patient inclusion and information extraction on a cohort of patients with metastatic renal cell carcinoma (RCC) receiving systemic drug treatment. Baseline patient characteristics, disease characteristics, and treatment outcomes were extracted and these were compared with MR for validation. One hundred patients receiving 175 treatments were included using CDC, which corresponded to 99% with MR. Calculated median overall survival was 21.7 months (95% confidence interval (CI) 18.7–24.8) vs. 21.7 months (95% CI 18.6–24.8) and progression‐free survival 8.9 months (95% CI 5.4–12.4) vs. 7.6 months (95% CI 5.7–9.4) for CDC vs. MR, respectively. Highest F1‐score was found for cancer‐related variables (88.1–100), followed by comorbidities (71.5–90.4) and adverse drug events (53.3–74.5), with most diverse scores on international metastatic RCC database criteria (51.4–100). Mean data collection time was 12 minutes (CDC) vs. 86 minutes (MR). In conclusion, CDC is a promising tool for retrieving RWD from EHRs because the correct patient population can be identified as well as relevant outcome data, such as overall survival and progression‐free survival.
doi_str_mv 10.1002/cpt.1966
format Article
fullrecord <record><control><sourceid>wiley_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7484987</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CPT1966</sourcerecordid><originalsourceid>FETCH-LOGICAL-c4106-7869a6fc5d245c7bf1702c37c2e73da9c31f821f731ce9c47a83960c7c77c8e13</originalsourceid><addsrcrecordid>eNp1kcFO3DAQhq2qqGxppT5BNcdeAnacxEkPSKtACxIIVJZytMzEAVeOvXK8tHvrI_AKvBpPgpcFVA692Jrx528s_4R8YnSbUZrv4Dxus6aq3pAJK3meVSUv35IJpbTJmpxXm-T9OP5KZdHU9TuyyfNSlKwQE3I3dbBvNcbgnUE40MrGa_ih0YcOZvpPhGPjjLuCmfcWoofW2xWeEGXv_95e-GA72AuLRASt4qBdhJNFRD_o8StM4aeyplPReAdncdEtwTg4TXXiRrgwadixjmqMqYVJ6pSFVtu0qIDG-UF9IBu9sqP--LRvkfNv-7P2IDs6-X7YTo8yLBitMlFXjap6LLu8KFFc9kzQHLnAXAveqQY56-uc9YIz1A0WQtW8qSgKFAJrzfgW2V1754vLQXeYHhiUlfNgBhWW0isjX584cy2v_I0URZ2-VSTBl7UAgx_HoPuXu4zKVUwyxSRXMSX087-zXsDnXBKQrYHfxurlf0WyPZ09Ch8ArAOgGw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma</title><source>Wiley-Blackwell Journals</source><creator>Laar, Sylvia A. ; Gombert‐Handoko, Kim B. ; Guchelaar, Henk‐Jan ; Zwaveling, Juliëtte</creator><creatorcontrib>Laar, Sylvia A. ; Gombert‐Handoko, Kim B. ; Guchelaar, Henk‐Jan ; Zwaveling, Juliëtte</creatorcontrib><description>Real‐world evidence can close the inferential gap between marketing authorization studies and clinical practice. However, the current standard for real‐world data extraction from electronic health records (EHRs) for treatment evaluation is manual review (MR), which is time‐consuming and laborious. Clinical Data Collector (CDC) is a novel natural language processing and text mining software tool for both structured and unstructured EHR data and only shows relevant EHR sections improving efficiency. We investigated CDC as a real‐world data (RWD) collection method, through application of CDC queries for patient inclusion and information extraction on a cohort of patients with metastatic renal cell carcinoma (RCC) receiving systemic drug treatment. Baseline patient characteristics, disease characteristics, and treatment outcomes were extracted and these were compared with MR for validation. One hundred patients receiving 175 treatments were included using CDC, which corresponded to 99% with MR. Calculated median overall survival was 21.7 months (95% confidence interval (CI) 18.7–24.8) vs. 21.7 months (95% CI 18.6–24.8) and progression‐free survival 8.9 months (95% CI 5.4–12.4) vs. 7.6 months (95% CI 5.7–9.4) for CDC vs. MR, respectively. Highest F1‐score was found for cancer‐related variables (88.1–100), followed by comorbidities (71.5–90.4) and adverse drug events (53.3–74.5), with most diverse scores on international metastatic RCC database criteria (51.4–100). Mean data collection time was 12 minutes (CDC) vs. 86 minutes (MR). In conclusion, CDC is a promising tool for retrieving RWD from EHRs because the correct patient population can be identified as well as relevant outcome data, such as overall survival and progression‐free survival.</description><identifier>ISSN: 0009-9236</identifier><identifier>EISSN: 1532-6535</identifier><identifier>DOI: 10.1002/cpt.1966</identifier><identifier>PMID: 32575147</identifier><language>eng</language><publisher>United States: John Wiley and Sons Inc</publisher><ispartof>Clinical pharmacology and therapeutics, 2020-09, Vol.108 (3), p.644-652</ispartof><rights>2020 The Authors. published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.</rights><rights>2020 The Authors. Clinical Pharmacology &amp; Therapeutics published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c4106-7869a6fc5d245c7bf1702c37c2e73da9c31f821f731ce9c47a83960c7c77c8e13</citedby><cites>FETCH-LOGICAL-c4106-7869a6fc5d245c7bf1702c37c2e73da9c31f821f731ce9c47a83960c7c77c8e13</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fcpt.1966$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fcpt.1966$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,1417,27924,27925,45574,45575</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/32575147$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Laar, Sylvia A.</creatorcontrib><creatorcontrib>Gombert‐Handoko, Kim B.</creatorcontrib><creatorcontrib>Guchelaar, Henk‐Jan</creatorcontrib><creatorcontrib>Zwaveling, Juliëtte</creatorcontrib><title>An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma</title><title>Clinical pharmacology and therapeutics</title><addtitle>Clin Pharmacol Ther</addtitle><description>Real‐world evidence can close the inferential gap between marketing authorization studies and clinical practice. However, the current standard for real‐world data extraction from electronic health records (EHRs) for treatment evaluation is manual review (MR), which is time‐consuming and laborious. Clinical Data Collector (CDC) is a novel natural language processing and text mining software tool for both structured and unstructured EHR data and only shows relevant EHR sections improving efficiency. We investigated CDC as a real‐world data (RWD) collection method, through application of CDC queries for patient inclusion and information extraction on a cohort of patients with metastatic renal cell carcinoma (RCC) receiving systemic drug treatment. Baseline patient characteristics, disease characteristics, and treatment outcomes were extracted and these were compared with MR for validation. One hundred patients receiving 175 treatments were included using CDC, which corresponded to 99% with MR. Calculated median overall survival was 21.7 months (95% confidence interval (CI) 18.7–24.8) vs. 21.7 months (95% CI 18.6–24.8) and progression‐free survival 8.9 months (95% CI 5.4–12.4) vs. 7.6 months (95% CI 5.7–9.4) for CDC vs. MR, respectively. Highest F1‐score was found for cancer‐related variables (88.1–100), followed by comorbidities (71.5–90.4) and adverse drug events (53.3–74.5), with most diverse scores on international metastatic RCC database criteria (51.4–100). Mean data collection time was 12 minutes (CDC) vs. 86 minutes (MR). In conclusion, CDC is a promising tool for retrieving RWD from EHRs because the correct patient population can be identified as well as relevant outcome data, such as overall survival and progression‐free survival.</description><issn>0009-9236</issn><issn>1532-6535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><sourceid>WIN</sourceid><recordid>eNp1kcFO3DAQhq2qqGxppT5BNcdeAnacxEkPSKtACxIIVJZytMzEAVeOvXK8tHvrI_AKvBpPgpcFVA692Jrx528s_4R8YnSbUZrv4Dxus6aq3pAJK3meVSUv35IJpbTJmpxXm-T9OP5KZdHU9TuyyfNSlKwQE3I3dbBvNcbgnUE40MrGa_ih0YcOZvpPhGPjjLuCmfcWoofW2xWeEGXv_95e-GA72AuLRASt4qBdhJNFRD_o8StM4aeyplPReAdncdEtwTg4TXXiRrgwadixjmqMqYVJ6pSFVtu0qIDG-UF9IBu9sqP--LRvkfNv-7P2IDs6-X7YTo8yLBitMlFXjap6LLu8KFFc9kzQHLnAXAveqQY56-uc9YIz1A0WQtW8qSgKFAJrzfgW2V1754vLQXeYHhiUlfNgBhWW0isjX584cy2v_I0URZ2-VSTBl7UAgx_HoPuXu4zKVUwyxSRXMSX087-zXsDnXBKQrYHfxurlf0WyPZ09Ch8ArAOgGw</recordid><startdate>202009</startdate><enddate>202009</enddate><creator>Laar, Sylvia A.</creator><creator>Gombert‐Handoko, Kim B.</creator><creator>Guchelaar, Henk‐Jan</creator><creator>Zwaveling, Juliëtte</creator><general>John Wiley and Sons Inc</general><scope>24P</scope><scope>WIN</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>5PM</scope></search><sort><creationdate>202009</creationdate><title>An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma</title><author>Laar, Sylvia A. ; Gombert‐Handoko, Kim B. ; Guchelaar, Henk‐Jan ; Zwaveling, Juliëtte</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c4106-7869a6fc5d245c7bf1702c37c2e73da9c31f821f731ce9c47a83960c7c77c8e13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Laar, Sylvia A.</creatorcontrib><creatorcontrib>Gombert‐Handoko, Kim B.</creatorcontrib><creatorcontrib>Guchelaar, Henk‐Jan</creatorcontrib><creatorcontrib>Zwaveling, Juliëtte</creatorcontrib><collection>Wiley_OA刊</collection><collection>Wiley-Blackwell Open Access Backfiles</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Clinical pharmacology and therapeutics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Laar, Sylvia A.</au><au>Gombert‐Handoko, Kim B.</au><au>Guchelaar, Henk‐Jan</au><au>Zwaveling, Juliëtte</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma</atitle><jtitle>Clinical pharmacology and therapeutics</jtitle><addtitle>Clin Pharmacol Ther</addtitle><date>2020-09</date><risdate>2020</risdate><volume>108</volume><issue>3</issue><spage>644</spage><epage>652</epage><pages>644-652</pages><issn>0009-9236</issn><eissn>1532-6535</eissn><abstract>Real‐world evidence can close the inferential gap between marketing authorization studies and clinical practice. However, the current standard for real‐world data extraction from electronic health records (EHRs) for treatment evaluation is manual review (MR), which is time‐consuming and laborious. Clinical Data Collector (CDC) is a novel natural language processing and text mining software tool for both structured and unstructured EHR data and only shows relevant EHR sections improving efficiency. We investigated CDC as a real‐world data (RWD) collection method, through application of CDC queries for patient inclusion and information extraction on a cohort of patients with metastatic renal cell carcinoma (RCC) receiving systemic drug treatment. Baseline patient characteristics, disease characteristics, and treatment outcomes were extracted and these were compared with MR for validation. One hundred patients receiving 175 treatments were included using CDC, which corresponded to 99% with MR. Calculated median overall survival was 21.7 months (95% confidence interval (CI) 18.7–24.8) vs. 21.7 months (95% CI 18.6–24.8) and progression‐free survival 8.9 months (95% CI 5.4–12.4) vs. 7.6 months (95% CI 5.7–9.4) for CDC vs. MR, respectively. Highest F1‐score was found for cancer‐related variables (88.1–100), followed by comorbidities (71.5–90.4) and adverse drug events (53.3–74.5), with most diverse scores on international metastatic RCC database criteria (51.4–100). Mean data collection time was 12 minutes (CDC) vs. 86 minutes (MR). In conclusion, CDC is a promising tool for retrieving RWD from EHRs because the correct patient population can be identified as well as relevant outcome data, such as overall survival and progression‐free survival.</abstract><cop>United States</cop><pub>John Wiley and Sons Inc</pub><pmid>32575147</pmid><doi>10.1002/cpt.1966</doi><tpages>9</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0009-9236
ispartof Clinical pharmacology and therapeutics, 2020-09, Vol.108 (3), p.644-652
issn 0009-9236
1532-6535
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_7484987
source Wiley-Blackwell Journals
title An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T09%3A41%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-wiley_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Electronic%20Health%20Record%20Text%20Mining%20Tool%20to%20Collect%20Real%E2%80%90World%20Drug%20Treatment%20Outcomes:%20A%20Validation%20Study%20in%20Patients%20With%20Metastatic%20Renal%20Cell%20Carcinoma&rft.jtitle=Clinical%20pharmacology%20and%20therapeutics&rft.au=Laar,%20Sylvia%20A.&rft.date=2020-09&rft.volume=108&rft.issue=3&rft.spage=644&rft.epage=652&rft.pages=644-652&rft.issn=0009-9236&rft.eissn=1532-6535&rft_id=info:doi/10.1002/cpt.1966&rft_dat=%3Cwiley_pubme%3ECPT1966%3C/wiley_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/32575147&rfr_iscdi=true