Discovering interpretable medical process models: A case study in trauma resuscitation

[Display omitted] •Introduced TAD Miner, a data-driven process model discovery approach for complex medical processes based on trace alignment.•TAD models feature a backbone process, concurrent activities, and uncommon-but-critical activities. Compared to the models discovered by the state-of-the-ar...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of biomedical informatics 2023-04, Vol.140, p.104344-104344, Article 104344
Hauptverfasser: Li, Keyi, Marsic, Ivan, Sarcevic, Aleksandra, Yang, Sen, Sullivan, Travis M., Tempel, Peyton E., Milestone, Zachary P., O'Connell, Karen J., Burd, Randall S.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 104344
container_issue
container_start_page 104344
container_title Journal of biomedical informatics
container_volume 140
creator Li, Keyi
Marsic, Ivan
Sarcevic, Aleksandra
Yang, Sen
Sullivan, Travis M.
Tempel, Peyton E.
Milestone, Zachary P.
O'Connell, Karen J.
Burd, Randall S.
description [Display omitted] •Introduced TAD Miner, a data-driven process model discovery approach for complex medical processes based on trace alignment.•TAD models feature a backbone process, concurrent activities, and uncommon-but-critical activities. Compared to the models discovered by the state-of-the-art methods, TAD models are more interpretable and achieve comparable accuracy.•Discovered process models using 308 real trauma resuscitation cases for five resuscitation goals. The models enhanced the understanding of complex medical processes.•Identified the errors and the best positions for the tentative steps in knowledge-driven process models. Understanding the actual work (i.e., “work-as-done”) rather than theorized work (i.e., “work-as-imagined”) during complex medical processes is critical for developing approaches that improve patient outcomes. Although process mining has been used to discover process models from medical activity logs, it often omits critical steps or produces cluttered and unreadable models. In this paper, we introduce a TraceAlignment-based ProcessDiscovery method called TAD Miner to build interpretable process models for complex medical processes. TAD Miner creates simple linear process models using a threshold metric that optimizes the consensus sequence to represent the backbone process, and then identifies both concurrent activities and uncommon-but-critical activities to represent the side branches. TAD Miner also identifies the locations of repeated activities, an essential feature for representing medical treatment steps. We conducted a study using activity logs of 308 pediatric trauma resuscitations to develop and evaluate TAD Miner. TAD Miner was used to discover process models for five resuscitation goals, including establishing intravenous (IV) access, administering non-invasive oxygenation, performing back assessment, administering blood transfusion, and performing intubation. We quantitively evaluated the process models with several complexity and accuracy metrics, and performed qualitative evaluation with four medical experts to assess the accuracy and interpretability of the discovered models. Through these evaluations, we compared the performance of our method to that of two state-of-the-art process discovery algorithms: Inductive Miner and Split Miner. The process models discovered by TAD Miner had lower complexity and better interpretability than the state-of-the-art methods, and the fitness and precision of the models
doi_str_mv 10.1016/j.jbi.2023.104344
format Article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10111432</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1532046423000655</els_id><sourcerecordid>2789234167</sourcerecordid><originalsourceid>FETCH-LOGICAL-c404t-ef8e1d76b36f351b88627041af34c8cbc565a5c874bb9d6c2241836aba17439e3</originalsourceid><addsrcrecordid>eNp9UU1LJDEUDLLi9w_wIjnuZWbz1em0HkTUXQXBi3oNSfq1ZujujEl6wH9vZHTQy55eHqmqV1QhdEzJnBIq_yzmC-vnjDBedsGF2EJ7tOJsRoQivzZvKXbRfkoLQiitKrmDdrlsBFGN3ENPVz65sILox2fsxwxxGSEb2wMeoPXO9HgZg4OU8BBa6NMpvsDOJMApT-1boeAczTQYHCFNyflssg_jIdruTJ_g6HMeoMe_1w-XN7O7-3-3lxd3MyeIyDPoFNC2lpbLjlfUKiVZTQQ1HRdOOesqWZnKqVpY27TSMSao4tJYQ2vBG-AH6Hytu5xs8etgLG56vYx-MPFNB-P1z5_Rv-jnsNIlP0oFZ0Xh96dCDK8TpKyHkgj0vRkhTEmzWjWMCyrrAqVrqIshpQjd5g4lH4JSL3QpRH8UoteFFM7Jd4MbxlcDBXC2BpRsYeUh6hIijK6EH8Fl3Qb_H_l3gm2dEw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2789234167</pqid></control><display><type>article</type><title>Discovering interpretable medical process models: A case study in trauma resuscitation</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Li, Keyi ; Marsic, Ivan ; Sarcevic, Aleksandra ; Yang, Sen ; Sullivan, Travis M. ; Tempel, Peyton E. ; Milestone, Zachary P. ; O'Connell, Karen J. ; Burd, Randall S.</creator><creatorcontrib>Li, Keyi ; Marsic, Ivan ; Sarcevic, Aleksandra ; Yang, Sen ; Sullivan, Travis M. ; Tempel, Peyton E. ; Milestone, Zachary P. ; O'Connell, Karen J. ; Burd, Randall S.</creatorcontrib><description>[Display omitted] •Introduced TAD Miner, a data-driven process model discovery approach for complex medical processes based on trace alignment.•TAD models feature a backbone process, concurrent activities, and uncommon-but-critical activities. Compared to the models discovered by the state-of-the-art methods, TAD models are more interpretable and achieve comparable accuracy.•Discovered process models using 308 real trauma resuscitation cases for five resuscitation goals. The models enhanced the understanding of complex medical processes.•Identified the errors and the best positions for the tentative steps in knowledge-driven process models. Understanding the actual work (i.e., “work-as-done”) rather than theorized work (i.e., “work-as-imagined”) during complex medical processes is critical for developing approaches that improve patient outcomes. Although process mining has been used to discover process models from medical activity logs, it often omits critical steps or produces cluttered and unreadable models. In this paper, we introduce a TraceAlignment-based ProcessDiscovery method called TAD Miner to build interpretable process models for complex medical processes. TAD Miner creates simple linear process models using a threshold metric that optimizes the consensus sequence to represent the backbone process, and then identifies both concurrent activities and uncommon-but-critical activities to represent the side branches. TAD Miner also identifies the locations of repeated activities, an essential feature for representing medical treatment steps. We conducted a study using activity logs of 308 pediatric trauma resuscitations to develop and evaluate TAD Miner. TAD Miner was used to discover process models for five resuscitation goals, including establishing intravenous (IV) access, administering non-invasive oxygenation, performing back assessment, administering blood transfusion, and performing intubation. We quantitively evaluated the process models with several complexity and accuracy metrics, and performed qualitative evaluation with four medical experts to assess the accuracy and interpretability of the discovered models. Through these evaluations, we compared the performance of our method to that of two state-of-the-art process discovery algorithms: Inductive Miner and Split Miner. The process models discovered by TAD Miner had lower complexity and better interpretability than the state-of-the-art methods, and the fitness and precision of the models were comparable. We used the TAD process models to identify (1) the errors and (2)the best locations for the tentative steps in knowledge-driven expert models. The knowledge-driven models were revised based on the modifications suggested by the discovered models. The improved modeling using TAD Miner may enhance understanding of complex medical processes.</description><identifier>ISSN: 1532-0464</identifier><identifier>EISSN: 1532-0480</identifier><identifier>DOI: 10.1016/j.jbi.2023.104344</identifier><identifier>PMID: 36940896</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Algorithms ; Child ; Consensus sequence ; Humans ; Knowledge discovery ; Process mining ; Records ; Resuscitation ; Resuscitation - methods</subject><ispartof>Journal of biomedical informatics, 2023-04, Vol.140, p.104344-104344, Article 104344</ispartof><rights>2023 Elsevier Inc.</rights><rights>Copyright © 2023 Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c404t-ef8e1d76b36f351b88627041af34c8cbc565a5c874bb9d6c2241836aba17439e3</cites><orcidid>0000-0002-4399-7037 ; 0000-0001-8493-2187</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S1532046423000655$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>230,314,776,780,881,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/36940896$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Li, Keyi</creatorcontrib><creatorcontrib>Marsic, Ivan</creatorcontrib><creatorcontrib>Sarcevic, Aleksandra</creatorcontrib><creatorcontrib>Yang, Sen</creatorcontrib><creatorcontrib>Sullivan, Travis M.</creatorcontrib><creatorcontrib>Tempel, Peyton E.</creatorcontrib><creatorcontrib>Milestone, Zachary P.</creatorcontrib><creatorcontrib>O'Connell, Karen J.</creatorcontrib><creatorcontrib>Burd, Randall S.</creatorcontrib><title>Discovering interpretable medical process models: A case study in trauma resuscitation</title><title>Journal of biomedical informatics</title><addtitle>J Biomed Inform</addtitle><description>[Display omitted] •Introduced TAD Miner, a data-driven process model discovery approach for complex medical processes based on trace alignment.•TAD models feature a backbone process, concurrent activities, and uncommon-but-critical activities. Compared to the models discovered by the state-of-the-art methods, TAD models are more interpretable and achieve comparable accuracy.•Discovered process models using 308 real trauma resuscitation cases for five resuscitation goals. The models enhanced the understanding of complex medical processes.•Identified the errors and the best positions for the tentative steps in knowledge-driven process models. Understanding the actual work (i.e., “work-as-done”) rather than theorized work (i.e., “work-as-imagined”) during complex medical processes is critical for developing approaches that improve patient outcomes. Although process mining has been used to discover process models from medical activity logs, it often omits critical steps or produces cluttered and unreadable models. In this paper, we introduce a TraceAlignment-based ProcessDiscovery method called TAD Miner to build interpretable process models for complex medical processes. TAD Miner creates simple linear process models using a threshold metric that optimizes the consensus sequence to represent the backbone process, and then identifies both concurrent activities and uncommon-but-critical activities to represent the side branches. TAD Miner also identifies the locations of repeated activities, an essential feature for representing medical treatment steps. We conducted a study using activity logs of 308 pediatric trauma resuscitations to develop and evaluate TAD Miner. TAD Miner was used to discover process models for five resuscitation goals, including establishing intravenous (IV) access, administering non-invasive oxygenation, performing back assessment, administering blood transfusion, and performing intubation. We quantitively evaluated the process models with several complexity and accuracy metrics, and performed qualitative evaluation with four medical experts to assess the accuracy and interpretability of the discovered models. Through these evaluations, we compared the performance of our method to that of two state-of-the-art process discovery algorithms: Inductive Miner and Split Miner. The process models discovered by TAD Miner had lower complexity and better interpretability than the state-of-the-art methods, and the fitness and precision of the models were comparable. We used the TAD process models to identify (1) the errors and (2)the best locations for the tentative steps in knowledge-driven expert models. The knowledge-driven models were revised based on the modifications suggested by the discovered models. The improved modeling using TAD Miner may enhance understanding of complex medical processes.</description><subject>Algorithms</subject><subject>Child</subject><subject>Consensus sequence</subject><subject>Humans</subject><subject>Knowledge discovery</subject><subject>Process mining</subject><subject>Records</subject><subject>Resuscitation</subject><subject>Resuscitation - methods</subject><issn>1532-0464</issn><issn>1532-0480</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9UU1LJDEUDLLi9w_wIjnuZWbz1em0HkTUXQXBi3oNSfq1ZujujEl6wH9vZHTQy55eHqmqV1QhdEzJnBIq_yzmC-vnjDBedsGF2EJ7tOJsRoQivzZvKXbRfkoLQiitKrmDdrlsBFGN3ENPVz65sILox2fsxwxxGSEb2wMeoPXO9HgZg4OU8BBa6NMpvsDOJMApT-1boeAczTQYHCFNyflssg_jIdruTJ_g6HMeoMe_1w-XN7O7-3-3lxd3MyeIyDPoFNC2lpbLjlfUKiVZTQQ1HRdOOesqWZnKqVpY27TSMSao4tJYQ2vBG-AH6Hytu5xs8etgLG56vYx-MPFNB-P1z5_Rv-jnsNIlP0oFZ0Xh96dCDK8TpKyHkgj0vRkhTEmzWjWMCyrrAqVrqIshpQjd5g4lH4JSL3QpRH8UoteFFM7Jd4MbxlcDBXC2BpRsYeUh6hIijK6EH8Fl3Qb_H_l3gm2dEw</recordid><startdate>20230401</startdate><enddate>20230401</enddate><creator>Li, Keyi</creator><creator>Marsic, Ivan</creator><creator>Sarcevic, Aleksandra</creator><creator>Yang, Sen</creator><creator>Sullivan, Travis M.</creator><creator>Tempel, Peyton E.</creator><creator>Milestone, Zachary P.</creator><creator>O'Connell, Karen J.</creator><creator>Burd, Randall S.</creator><general>Elsevier Inc</general><scope>6I.</scope><scope>AAFTH</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0002-4399-7037</orcidid><orcidid>https://orcid.org/0000-0001-8493-2187</orcidid></search><sort><creationdate>20230401</creationdate><title>Discovering interpretable medical process models: A case study in trauma resuscitation</title><author>Li, Keyi ; Marsic, Ivan ; Sarcevic, Aleksandra ; Yang, Sen ; Sullivan, Travis M. ; Tempel, Peyton E. ; Milestone, Zachary P. ; O'Connell, Karen J. ; Burd, Randall S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c404t-ef8e1d76b36f351b88627041af34c8cbc565a5c874bb9d6c2241836aba17439e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Child</topic><topic>Consensus sequence</topic><topic>Humans</topic><topic>Knowledge discovery</topic><topic>Process mining</topic><topic>Records</topic><topic>Resuscitation</topic><topic>Resuscitation - methods</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Keyi</creatorcontrib><creatorcontrib>Marsic, Ivan</creatorcontrib><creatorcontrib>Sarcevic, Aleksandra</creatorcontrib><creatorcontrib>Yang, Sen</creatorcontrib><creatorcontrib>Sullivan, Travis M.</creatorcontrib><creatorcontrib>Tempel, Peyton E.</creatorcontrib><creatorcontrib>Milestone, Zachary P.</creatorcontrib><creatorcontrib>O'Connell, Karen J.</creatorcontrib><creatorcontrib>Burd, Randall S.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Journal of biomedical informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Keyi</au><au>Marsic, Ivan</au><au>Sarcevic, Aleksandra</au><au>Yang, Sen</au><au>Sullivan, Travis M.</au><au>Tempel, Peyton E.</au><au>Milestone, Zachary P.</au><au>O'Connell, Karen J.</au><au>Burd, Randall S.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Discovering interpretable medical process models: A case study in trauma resuscitation</atitle><jtitle>Journal of biomedical informatics</jtitle><addtitle>J Biomed Inform</addtitle><date>2023-04-01</date><risdate>2023</risdate><volume>140</volume><spage>104344</spage><epage>104344</epage><pages>104344-104344</pages><artnum>104344</artnum><issn>1532-0464</issn><eissn>1532-0480</eissn><abstract>[Display omitted] •Introduced TAD Miner, a data-driven process model discovery approach for complex medical processes based on trace alignment.•TAD models feature a backbone process, concurrent activities, and uncommon-but-critical activities. Compared to the models discovered by the state-of-the-art methods, TAD models are more interpretable and achieve comparable accuracy.•Discovered process models using 308 real trauma resuscitation cases for five resuscitation goals. The models enhanced the understanding of complex medical processes.•Identified the errors and the best positions for the tentative steps in knowledge-driven process models. Understanding the actual work (i.e., “work-as-done”) rather than theorized work (i.e., “work-as-imagined”) during complex medical processes is critical for developing approaches that improve patient outcomes. Although process mining has been used to discover process models from medical activity logs, it often omits critical steps or produces cluttered and unreadable models. In this paper, we introduce a TraceAlignment-based ProcessDiscovery method called TAD Miner to build interpretable process models for complex medical processes. TAD Miner creates simple linear process models using a threshold metric that optimizes the consensus sequence to represent the backbone process, and then identifies both concurrent activities and uncommon-but-critical activities to represent the side branches. TAD Miner also identifies the locations of repeated activities, an essential feature for representing medical treatment steps. We conducted a study using activity logs of 308 pediatric trauma resuscitations to develop and evaluate TAD Miner. TAD Miner was used to discover process models for five resuscitation goals, including establishing intravenous (IV) access, administering non-invasive oxygenation, performing back assessment, administering blood transfusion, and performing intubation. We quantitively evaluated the process models with several complexity and accuracy metrics, and performed qualitative evaluation with four medical experts to assess the accuracy and interpretability of the discovered models. Through these evaluations, we compared the performance of our method to that of two state-of-the-art process discovery algorithms: Inductive Miner and Split Miner. The process models discovered by TAD Miner had lower complexity and better interpretability than the state-of-the-art methods, and the fitness and precision of the models were comparable. We used the TAD process models to identify (1) the errors and (2)the best locations for the tentative steps in knowledge-driven expert models. The knowledge-driven models were revised based on the modifications suggested by the discovered models. The improved modeling using TAD Miner may enhance understanding of complex medical processes.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>36940896</pmid><doi>10.1016/j.jbi.2023.104344</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-4399-7037</orcidid><orcidid>https://orcid.org/0000-0001-8493-2187</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1532-0464
ispartof Journal of biomedical informatics, 2023-04, Vol.140, p.104344-104344, Article 104344
issn 1532-0464
1532-0480
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10111432
source MEDLINE; Elsevier ScienceDirect Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals
subjects Algorithms
Child
Consensus sequence
Humans
Knowledge discovery
Process mining
Records
Resuscitation
Resuscitation - methods
title Discovering interpretable medical process models: A case study in trauma resuscitation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T03%3A11%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Discovering%20interpretable%20medical%20process%20models:%20A%20case%20study%20in%20trauma%20resuscitation&rft.jtitle=Journal%20of%20biomedical%20informatics&rft.au=Li,%20Keyi&rft.date=2023-04-01&rft.volume=140&rft.spage=104344&rft.epage=104344&rft.pages=104344-104344&rft.artnum=104344&rft.issn=1532-0464&rft.eissn=1532-0480&rft_id=info:doi/10.1016/j.jbi.2023.104344&rft_dat=%3Cproquest_pubme%3E2789234167%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2789234167&rft_id=info:pmid/36940896&rft_els_id=S1532046423000655&rfr_iscdi=true