Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments
IMPORTANCE: Missed diagnosis can lead to preventable patient harm. OBJECTIVE: To develop and implement a portfolio of electronic triggers (e-triggers) and examine their performance for identifying missed opportunities in diagnosis (MODs) in emergency departments (EDs). DESIGN, SETTING, AND PARTICIPA...
Gespeichert in:
Veröffentlicht in: | JAMA internal medicine 2024-12 |
---|---|
Hauptverfasser: | , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | JAMA internal medicine |
container_volume | |
creator | Vaghani, Viralkumar Gupta, Ashish Mir, Usman Wei, Li Murphy, Daniel R Mushtaq, Umair Sittig, Dean F Zimolzak, Andrew J Singh, Hardeep |
description | IMPORTANCE: Missed diagnosis can lead to preventable patient harm. OBJECTIVE: To develop and implement a portfolio of electronic triggers (e-triggers) and examine their performance for identifying missed opportunities in diagnosis (MODs) in emergency departments (EDs). DESIGN, SETTING, AND PARTICIPANTS: In this retrospective medical record review study of ED visits at 1321 Veterans Affairs health care sites, rules-based e-triggers were developed and implemented using a national electronic health record repository. These e-triggers targeted 6 high-risk presentations for MODs in treat-and-release ED visits. A high-risk stroke e-trigger was applied to treat-and-release ED visits from January 1, 2016, to December 31, 2020. A symptom-disease dyad e-trigger was applied to visits from January 1, 2018, to December 31, 2019. High-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to visits from January 1, 2019, to December 31, 2019. At least 100 randomly selected flagged records were reviewed by physician reviewers for each e-trigger. Data were analyzed between January 2024 and April 2024. EXPOSURES: Treat-and-release ED visits involving high-risk stroke, symptom-disease dyads, high-risk abdominal pain, unexpected ED return, unexpected hospital return, and abnormal test results not followed up after initial ED visit. MAIN OUTCOMES AND MEASURES: Trained physician reviewers evaluated the presence/absence of MODs at ED visits and recorded data on patient and clinician characteristics, types of diagnostic process breakdowns, and potential harm from MODs. RESULTS: The high-risk stroke e-trigger was applied to 8 792 672 treat-and-release ED visits (4 967 283 unique patients); the symptom-disease dyad e-trigger was applied to 3 692 454 visits (2 070 979 patients); and high-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to 1 845 905 visits (1 032 969 patients), overall identifying 203, 1981, 170, 116 785, 14 879, and 2090 trigger-positive records, respectively. Review of 625 randomly selected patient records (mean [SD] age, 62.5 [15.2] years; 553 [88.5%] male) showed the following MOD counts and positive predictive values (PPVs) within each category: 47 MODs (PPV, 47.0%) for stroke, 31 MODs (PPV, 25.8%) for abdominal pain, 11 MODs (PPV, 11.0%) for ED returns, 23 MODs (PPV, 23.0%) for hospital returns, 18 MODs (PPV, 18.0%) for symptom-disease dyads, an |
doi_str_mv | 10.1001/jamainternmed.2024.6214 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_3140921795</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ama_id>2827341</ama_id><sourcerecordid>3140921795</sourcerecordid><originalsourceid>FETCH-LOGICAL-a208t-3b58aa5e53a84ebb1b2836f2b2e31d355dfcc76c28190546a9ea517a4837e68a3</originalsourceid><addsrcrecordid>eNpVkM1LwzAchoMoTub-AQ_ao5fOfLVNjzKrDgZe5k0oaftryWiTmmSH_fem7APMJYHnfd_Ag9ATwUuCMXnZyUEq7cHqAZolxZQvU0r4FbqjJBVxSgi_vrxxOkML53Y4HIExZ-wWzVgeCoxld-hnPYw9DKC99MroyLRR0UPtrdGqjrZWdR1YF3kTrZsQUu0helOy08b5wAtrTaBKR8UAtgNdBwyjtH5adPfoppW9g8XpnqPv92K7-ow3Xx_r1esmlhQLH7MqEVImkDApOFQVqahgaUsrCow0LEmatq6ztKaC5DjhqcxBJiSTXLAMUiHZHD0fd0drfvfgfDkoV0PfSw1m70pGOM4pyfIkRLNjtLbGOQttOVo1SHsoCS4nu-U_u-Vkt5zshubj6ZN9NZFz7-wyBB6OgTBwoVTQjHHC_gAbsoMe</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3140921795</pqid></control><display><type>article</type><title>Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments</title><source>American Medical Association Journals</source><creator>Vaghani, Viralkumar ; Gupta, Ashish ; Mir, Usman ; Wei, Li ; Murphy, Daniel R ; Mushtaq, Umair ; Sittig, Dean F ; Zimolzak, Andrew J ; Singh, Hardeep</creator><creatorcontrib>Vaghani, Viralkumar ; Gupta, Ashish ; Mir, Usman ; Wei, Li ; Murphy, Daniel R ; Mushtaq, Umair ; Sittig, Dean F ; Zimolzak, Andrew J ; Singh, Hardeep</creatorcontrib><description>IMPORTANCE: Missed diagnosis can lead to preventable patient harm. OBJECTIVE: To develop and implement a portfolio of electronic triggers (e-triggers) and examine their performance for identifying missed opportunities in diagnosis (MODs) in emergency departments (EDs). DESIGN, SETTING, AND PARTICIPANTS: In this retrospective medical record review study of ED visits at 1321 Veterans Affairs health care sites, rules-based e-triggers were developed and implemented using a national electronic health record repository. These e-triggers targeted 6 high-risk presentations for MODs in treat-and-release ED visits. A high-risk stroke e-trigger was applied to treat-and-release ED visits from January 1, 2016, to December 31, 2020. A symptom-disease dyad e-trigger was applied to visits from January 1, 2018, to December 31, 2019. High-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to visits from January 1, 2019, to December 31, 2019. At least 100 randomly selected flagged records were reviewed by physician reviewers for each e-trigger. Data were analyzed between January 2024 and April 2024. EXPOSURES: Treat-and-release ED visits involving high-risk stroke, symptom-disease dyads, high-risk abdominal pain, unexpected ED return, unexpected hospital return, and abnormal test results not followed up after initial ED visit. MAIN OUTCOMES AND MEASURES: Trained physician reviewers evaluated the presence/absence of MODs at ED visits and recorded data on patient and clinician characteristics, types of diagnostic process breakdowns, and potential harm from MODs. RESULTS: The high-risk stroke e-trigger was applied to 8 792 672 treat-and-release ED visits (4 967 283 unique patients); the symptom-disease dyad e-trigger was applied to 3 692 454 visits (2 070 979 patients); and high-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to 1 845 905 visits (1 032 969 patients), overall identifying 203, 1981, 170, 116 785, 14 879, and 2090 trigger-positive records, respectively. Review of 625 randomly selected patient records (mean [SD] age, 62.5 [15.2] years; 553 [88.5%] male) showed the following MOD counts and positive predictive values (PPVs) within each category: 47 MODs (PPV, 47.0%) for stroke, 31 MODs (PPV, 25.8%) for abdominal pain, 11 MODs (PPV, 11.0%) for ED returns, 23 MODs (PPV, 23.0%) for hospital returns, 18 MODs (PPV, 18.0%) for symptom-disease dyads, and 55 MODs (PPV, 52.4%) for test results. Patients with MODs were slightly older than those without (mean [SD] age, 65.6 [14.5] vs 61.2 [15.3] years; P < .001). Reviewer agreement was favorable (range, 72%-100%). In 108 of 130 MODs (83.1%; excluding MODs related to the test result e-trigger), the most common diagnostic process breakdown involved the patient-clinician encounter. In 185 total MODs, 20 patients experienced severe harm (10.8%), and 54 patients experienced moderate harm (29.2%). CONCLUSIONS AND RELEVANCE: In this retrospective medical record review study, rules-based e-triggers were useful for post hoc detection of MODs in ED visits. Interventions to target ED work system factors are urgently needed to support patient-clinician encounters and minimize harm from diagnostic errors.</description><identifier>ISSN: 2168-6106</identifier><identifier>ISSN: 2168-6114</identifier><identifier>EISSN: 2168-6114</identifier><identifier>DOI: 10.1001/jamainternmed.2024.6214</identifier><identifier>PMID: 39621337</identifier><language>eng</language><publisher>United States: American Medical Association</publisher><ispartof>JAMA internal medicine, 2024-12</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-a208t-3b58aa5e53a84ebb1b2836f2b2e31d355dfcc76c28190546a9ea517a4837e68a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://jamanetwork.com/journals/jamainternalmedicine/articlepdf/10.1001/jamainternmed.2024.6214$$EPDF$$P50$$Gama$$H</linktopdf><linktohtml>$$Uhttps://jamanetwork.com/journals/jamainternalmedicine/fullarticle/10.1001/jamainternmed.2024.6214$$EHTML$$P50$$Gama$$H</linktohtml><link.rule.ids>64,314,777,781,3327,27905,27906,76238,76241</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/39621337$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Vaghani, Viralkumar</creatorcontrib><creatorcontrib>Gupta, Ashish</creatorcontrib><creatorcontrib>Mir, Usman</creatorcontrib><creatorcontrib>Wei, Li</creatorcontrib><creatorcontrib>Murphy, Daniel R</creatorcontrib><creatorcontrib>Mushtaq, Umair</creatorcontrib><creatorcontrib>Sittig, Dean F</creatorcontrib><creatorcontrib>Zimolzak, Andrew J</creatorcontrib><creatorcontrib>Singh, Hardeep</creatorcontrib><title>Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments</title><title>JAMA internal medicine</title><addtitle>JAMA Intern Med</addtitle><description>IMPORTANCE: Missed diagnosis can lead to preventable patient harm. OBJECTIVE: To develop and implement a portfolio of electronic triggers (e-triggers) and examine their performance for identifying missed opportunities in diagnosis (MODs) in emergency departments (EDs). DESIGN, SETTING, AND PARTICIPANTS: In this retrospective medical record review study of ED visits at 1321 Veterans Affairs health care sites, rules-based e-triggers were developed and implemented using a national electronic health record repository. These e-triggers targeted 6 high-risk presentations for MODs in treat-and-release ED visits. A high-risk stroke e-trigger was applied to treat-and-release ED visits from January 1, 2016, to December 31, 2020. A symptom-disease dyad e-trigger was applied to visits from January 1, 2018, to December 31, 2019. High-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to visits from January 1, 2019, to December 31, 2019. At least 100 randomly selected flagged records were reviewed by physician reviewers for each e-trigger. Data were analyzed between January 2024 and April 2024. EXPOSURES: Treat-and-release ED visits involving high-risk stroke, symptom-disease dyads, high-risk abdominal pain, unexpected ED return, unexpected hospital return, and abnormal test results not followed up after initial ED visit. MAIN OUTCOMES AND MEASURES: Trained physician reviewers evaluated the presence/absence of MODs at ED visits and recorded data on patient and clinician characteristics, types of diagnostic process breakdowns, and potential harm from MODs. RESULTS: The high-risk stroke e-trigger was applied to 8 792 672 treat-and-release ED visits (4 967 283 unique patients); the symptom-disease dyad e-trigger was applied to 3 692 454 visits (2 070 979 patients); and high-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to 1 845 905 visits (1 032 969 patients), overall identifying 203, 1981, 170, 116 785, 14 879, and 2090 trigger-positive records, respectively. Review of 625 randomly selected patient records (mean [SD] age, 62.5 [15.2] years; 553 [88.5%] male) showed the following MOD counts and positive predictive values (PPVs) within each category: 47 MODs (PPV, 47.0%) for stroke, 31 MODs (PPV, 25.8%) for abdominal pain, 11 MODs (PPV, 11.0%) for ED returns, 23 MODs (PPV, 23.0%) for hospital returns, 18 MODs (PPV, 18.0%) for symptom-disease dyads, and 55 MODs (PPV, 52.4%) for test results. Patients with MODs were slightly older than those without (mean [SD] age, 65.6 [14.5] vs 61.2 [15.3] years; P < .001). Reviewer agreement was favorable (range, 72%-100%). In 108 of 130 MODs (83.1%; excluding MODs related to the test result e-trigger), the most common diagnostic process breakdown involved the patient-clinician encounter. In 185 total MODs, 20 patients experienced severe harm (10.8%), and 54 patients experienced moderate harm (29.2%). CONCLUSIONS AND RELEVANCE: In this retrospective medical record review study, rules-based e-triggers were useful for post hoc detection of MODs in ED visits. Interventions to target ED work system factors are urgently needed to support patient-clinician encounters and minimize harm from diagnostic errors.</description><issn>2168-6106</issn><issn>2168-6114</issn><issn>2168-6114</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpVkM1LwzAchoMoTub-AQ_ao5fOfLVNjzKrDgZe5k0oaftryWiTmmSH_fem7APMJYHnfd_Ag9ATwUuCMXnZyUEq7cHqAZolxZQvU0r4FbqjJBVxSgi_vrxxOkML53Y4HIExZ-wWzVgeCoxld-hnPYw9DKC99MroyLRR0UPtrdGqjrZWdR1YF3kTrZsQUu0helOy08b5wAtrTaBKR8UAtgNdBwyjtH5adPfoppW9g8XpnqPv92K7-ow3Xx_r1esmlhQLH7MqEVImkDApOFQVqahgaUsrCow0LEmatq6ztKaC5DjhqcxBJiSTXLAMUiHZHD0fd0drfvfgfDkoV0PfSw1m70pGOM4pyfIkRLNjtLbGOQttOVo1SHsoCS4nu-U_u-Vkt5zshubj6ZN9NZFz7-wyBB6OgTBwoVTQjHHC_gAbsoMe</recordid><startdate>20241202</startdate><enddate>20241202</enddate><creator>Vaghani, Viralkumar</creator><creator>Gupta, Ashish</creator><creator>Mir, Usman</creator><creator>Wei, Li</creator><creator>Murphy, Daniel R</creator><creator>Mushtaq, Umair</creator><creator>Sittig, Dean F</creator><creator>Zimolzak, Andrew J</creator><creator>Singh, Hardeep</creator><general>American Medical Association</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>20241202</creationdate><title>Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments</title><author>Vaghani, Viralkumar ; Gupta, Ashish ; Mir, Usman ; Wei, Li ; Murphy, Daniel R ; Mushtaq, Umair ; Sittig, Dean F ; Zimolzak, Andrew J ; Singh, Hardeep</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a208t-3b58aa5e53a84ebb1b2836f2b2e31d355dfcc76c28190546a9ea517a4837e68a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Vaghani, Viralkumar</creatorcontrib><creatorcontrib>Gupta, Ashish</creatorcontrib><creatorcontrib>Mir, Usman</creatorcontrib><creatorcontrib>Wei, Li</creatorcontrib><creatorcontrib>Murphy, Daniel R</creatorcontrib><creatorcontrib>Mushtaq, Umair</creatorcontrib><creatorcontrib>Sittig, Dean F</creatorcontrib><creatorcontrib>Zimolzak, Andrew J</creatorcontrib><creatorcontrib>Singh, Hardeep</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>JAMA internal medicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Vaghani, Viralkumar</au><au>Gupta, Ashish</au><au>Mir, Usman</au><au>Wei, Li</au><au>Murphy, Daniel R</au><au>Mushtaq, Umair</au><au>Sittig, Dean F</au><au>Zimolzak, Andrew J</au><au>Singh, Hardeep</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments</atitle><jtitle>JAMA internal medicine</jtitle><addtitle>JAMA Intern Med</addtitle><date>2024-12-02</date><risdate>2024</risdate><issn>2168-6106</issn><issn>2168-6114</issn><eissn>2168-6114</eissn><abstract>IMPORTANCE: Missed diagnosis can lead to preventable patient harm. OBJECTIVE: To develop and implement a portfolio of electronic triggers (e-triggers) and examine their performance for identifying missed opportunities in diagnosis (MODs) in emergency departments (EDs). DESIGN, SETTING, AND PARTICIPANTS: In this retrospective medical record review study of ED visits at 1321 Veterans Affairs health care sites, rules-based e-triggers were developed and implemented using a national electronic health record repository. These e-triggers targeted 6 high-risk presentations for MODs in treat-and-release ED visits. A high-risk stroke e-trigger was applied to treat-and-release ED visits from January 1, 2016, to December 31, 2020. A symptom-disease dyad e-trigger was applied to visits from January 1, 2018, to December 31, 2019. High-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to visits from January 1, 2019, to December 31, 2019. At least 100 randomly selected flagged records were reviewed by physician reviewers for each e-trigger. Data were analyzed between January 2024 and April 2024. EXPOSURES: Treat-and-release ED visits involving high-risk stroke, symptom-disease dyads, high-risk abdominal pain, unexpected ED return, unexpected hospital return, and abnormal test results not followed up after initial ED visit. MAIN OUTCOMES AND MEASURES: Trained physician reviewers evaluated the presence/absence of MODs at ED visits and recorded data on patient and clinician characteristics, types of diagnostic process breakdowns, and potential harm from MODs. RESULTS: The high-risk stroke e-trigger was applied to 8 792 672 treat-and-release ED visits (4 967 283 unique patients); the symptom-disease dyad e-trigger was applied to 3 692 454 visits (2 070 979 patients); and high-risk abdominal pain, unexpected ED return, unexpected hospital return, and test result e-triggers were applied to 1 845 905 visits (1 032 969 patients), overall identifying 203, 1981, 170, 116 785, 14 879, and 2090 trigger-positive records, respectively. Review of 625 randomly selected patient records (mean [SD] age, 62.5 [15.2] years; 553 [88.5%] male) showed the following MOD counts and positive predictive values (PPVs) within each category: 47 MODs (PPV, 47.0%) for stroke, 31 MODs (PPV, 25.8%) for abdominal pain, 11 MODs (PPV, 11.0%) for ED returns, 23 MODs (PPV, 23.0%) for hospital returns, 18 MODs (PPV, 18.0%) for symptom-disease dyads, and 55 MODs (PPV, 52.4%) for test results. Patients with MODs were slightly older than those without (mean [SD] age, 65.6 [14.5] vs 61.2 [15.3] years; P < .001). Reviewer agreement was favorable (range, 72%-100%). In 108 of 130 MODs (83.1%; excluding MODs related to the test result e-trigger), the most common diagnostic process breakdown involved the patient-clinician encounter. In 185 total MODs, 20 patients experienced severe harm (10.8%), and 54 patients experienced moderate harm (29.2%). CONCLUSIONS AND RELEVANCE: In this retrospective medical record review study, rules-based e-triggers were useful for post hoc detection of MODs in ED visits. Interventions to target ED work system factors are urgently needed to support patient-clinician encounters and minimize harm from diagnostic errors.</abstract><cop>United States</cop><pub>American Medical Association</pub><pmid>39621337</pmid><doi>10.1001/jamainternmed.2024.6214</doi></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2168-6106 |
ispartof | JAMA internal medicine, 2024-12 |
issn | 2168-6106 2168-6114 2168-6114 |
language | eng |
recordid | cdi_proquest_miscellaneous_3140921795 |
source | American Medical Association Journals |
title | Implementation of Electronic Triggers to Identify Diagnostic Errors in Emergency Departments |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-18T13%3A36%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Implementation%20of%20Electronic%20Triggers%20to%20Identify%20Diagnostic%20Errors%20in%20Emergency%20Departments&rft.jtitle=JAMA%20internal%20medicine&rft.au=Vaghani,%20Viralkumar&rft.date=2024-12-02&rft.issn=2168-6106&rft.eissn=2168-6114&rft_id=info:doi/10.1001/jamainternmed.2024.6214&rft_dat=%3Cproquest_cross%3E3140921795%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3140921795&rft_id=info:pmid/39621337&rft_ama_id=2827341&rfr_iscdi=true |