Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists

Despite advances in business intelligence software and evidence that feedback to doctors can improve outcomes, objective feedback regarding patient outcomes for individual anaesthetists is hampered by lack of useful benchmarks. We aimed to address this issue by producing case-mix and risk-adjusted p...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:British journal of anaesthesia : BJA 2020-12, Vol.125 (6), p.1079-1087
Hauptverfasser: Schulz, Erich B., Phillips, Frank, Waterbright, Siall
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1087
container_issue 6
container_start_page 1079
container_title British journal of anaesthesia : BJA
container_volume 125
creator Schulz, Erich B.
Phillips, Frank
Waterbright, Siall
description Despite advances in business intelligence software and evidence that feedback to doctors can improve outcomes, objective feedback regarding patient outcomes for individual anaesthetists is hampered by lack of useful benchmarks. We aimed to address this issue by producing case-mix and risk-adjusted postanaesthesia care unit (PACU) length of stay (LOS) benchmarks for integration into modern reporting tools. We extended existing hospital information systems to calculate predicted PACU LOS using a neural network trained on patient age, surgery duration, sex, operating specialty, urgency, weekday, and insurance status (n=100 511). We then calculated the difference between observed mean and predicted PACU LOS for individual doctors, and compared the results with and without case-mix adjustment. We report practical implications of using visual analytics dashboards displaying the difference between observed and predicted PACU LOS to provide feedback to anaesthetic doctors. The neural network accounted for over half of observed variation in individual doctors' mean PACU LOS (mean predicted and mean actual LOS Spearman's r2=0.57). Account for case-mix reduced apparent spread, with 80% of individual doctors falling in a band of 4.3 min after case-mix adjusting, compared with a range of 24 min without adjustment. Case-mix adjusting also identified different individual doctors as outliers (Weighted Cohen's kappa [κ]=0.27). Finally, we demonstrated that we were able to integrate the adjusted metrics into routine reporting tools. With caution, case-mix adjustment of anaesthetic outcome measures such as PACU LOS potentially provides a useful continuous quality improvement tool. Unadjusted outcome measures are imprecise at best and misleading at worst.
doi_str_mv 10.1016/j.bja.2020.06.068
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2438994303</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0007091220306139</els_id><sourcerecordid>2438994303</sourcerecordid><originalsourceid>FETCH-LOGICAL-c396t-e08d11d7f88ae35b70e879cbf4ff43d6f3384164e4edc49ff1c82815a79e32ec3</originalsourceid><addsrcrecordid>eNp9kE1PGzEQhi1UBCntD-CCfOxlU3vtrL3ihCL6ISH1AmfLa4-Jl2QdPN6qHPjvdRTosdJIc3nmnZmHkEvOlpzx7uu4HEa7bFnLlqyrpU_IgkvFm04p_oEsGGOqYT1vz8lHxJExrtp-dUbORas7wfhqQV7XFqHZxT_U-nHGAp7uExY7WcCyAYyWOpuBzlMsdAvTY9nQFGglXqidPB1mjBMg0jgV2G7jI0wOqLe4GZLNHmlImQYAP1j3REui78klYsFP5DTYLcLnt35BHr7d3q9_NHe_vv9c39w1TvRdaYBpz7lXQWsLYjUoBlr1bggyBCl8F4TQkncSJHgn-xC4063mK6t6EC04cUG-HHP3OT3Pdb_ZRXT1XjtBmtG0Uui-l4KJivIj6nJCzBDMPsedzS-GM3OwbkZTrZuDdcO6WrrOXL3Fz8MO_L-Jd80VuD4CUJ_8HSEbdPFgyscMrhif4n_i_wKfRJVR</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2438994303</pqid></control><display><type>article</type><title>Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists</title><source>MEDLINE</source><source>EZB-FREE-00999 freely available EZB journals</source><source>Alma/SFX Local Collection</source><creator>Schulz, Erich B. ; Phillips, Frank ; Waterbright, Siall</creator><creatorcontrib>Schulz, Erich B. ; Phillips, Frank ; Waterbright, Siall</creatorcontrib><description>Despite advances in business intelligence software and evidence that feedback to doctors can improve outcomes, objective feedback regarding patient outcomes for individual anaesthetists is hampered by lack of useful benchmarks. We aimed to address this issue by producing case-mix and risk-adjusted postanaesthesia care unit (PACU) length of stay (LOS) benchmarks for integration into modern reporting tools. We extended existing hospital information systems to calculate predicted PACU LOS using a neural network trained on patient age, surgery duration, sex, operating specialty, urgency, weekday, and insurance status (n=100 511). We then calculated the difference between observed mean and predicted PACU LOS for individual doctors, and compared the results with and without case-mix adjustment. We report practical implications of using visual analytics dashboards displaying the difference between observed and predicted PACU LOS to provide feedback to anaesthetic doctors. The neural network accounted for over half of observed variation in individual doctors' mean PACU LOS (mean predicted and mean actual LOS Spearman's r2=0.57). Account for case-mix reduced apparent spread, with 80% of individual doctors falling in a band of 4.3 min after case-mix adjusting, compared with a range of 24 min without adjustment. Case-mix adjusting also identified different individual doctors as outliers (Weighted Cohen's kappa [κ]=0.27). Finally, we demonstrated that we were able to integrate the adjusted metrics into routine reporting tools. With caution, case-mix adjustment of anaesthetic outcome measures such as PACU LOS potentially provides a useful continuous quality improvement tool. Unadjusted outcome measures are imprecise at best and misleading at worst.</description><identifier>ISSN: 0007-0912</identifier><identifier>EISSN: 1471-6771</identifier><identifier>DOI: 10.1016/j.bja.2020.06.068</identifier><identifier>PMID: 32863015</identifier><language>eng</language><publisher>England: Elsevier Ltd</publisher><subject>Age Factors ; anaesthesia recovery ; Anesthesia Recovery Period ; Anesthetists ; business intelligence ; dashboards ; Feedback ; Humans ; Insurance, Health - statistics &amp; numerical data ; length of stay ; neural networks ; Neural Networks, Computer ; Operative Time ; postanaesthesia care unti ; postoperative care ; Postoperative Complications - diagnosis ; quality assurance ; Quality Improvement - statistics &amp; numerical data ; Severity of Illness Index ; Sex Factors</subject><ispartof>British journal of anaesthesia : BJA, 2020-12, Vol.125 (6), p.1079-1087</ispartof><rights>2020 British Journal of Anaesthesia</rights><rights>Copyright © 2020 British Journal of Anaesthesia. Published by Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c396t-e08d11d7f88ae35b70e879cbf4ff43d6f3384164e4edc49ff1c82815a79e32ec3</citedby><cites>FETCH-LOGICAL-c396t-e08d11d7f88ae35b70e879cbf4ff43d6f3384164e4edc49ff1c82815a79e32ec3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/32863015$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Schulz, Erich B.</creatorcontrib><creatorcontrib>Phillips, Frank</creatorcontrib><creatorcontrib>Waterbright, Siall</creatorcontrib><title>Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists</title><title>British journal of anaesthesia : BJA</title><addtitle>Br J Anaesth</addtitle><description>Despite advances in business intelligence software and evidence that feedback to doctors can improve outcomes, objective feedback regarding patient outcomes for individual anaesthetists is hampered by lack of useful benchmarks. We aimed to address this issue by producing case-mix and risk-adjusted postanaesthesia care unit (PACU) length of stay (LOS) benchmarks for integration into modern reporting tools. We extended existing hospital information systems to calculate predicted PACU LOS using a neural network trained on patient age, surgery duration, sex, operating specialty, urgency, weekday, and insurance status (n=100 511). We then calculated the difference between observed mean and predicted PACU LOS for individual doctors, and compared the results with and without case-mix adjustment. We report practical implications of using visual analytics dashboards displaying the difference between observed and predicted PACU LOS to provide feedback to anaesthetic doctors. The neural network accounted for over half of observed variation in individual doctors' mean PACU LOS (mean predicted and mean actual LOS Spearman's r2=0.57). Account for case-mix reduced apparent spread, with 80% of individual doctors falling in a band of 4.3 min after case-mix adjusting, compared with a range of 24 min without adjustment. Case-mix adjusting also identified different individual doctors as outliers (Weighted Cohen's kappa [κ]=0.27). Finally, we demonstrated that we were able to integrate the adjusted metrics into routine reporting tools. With caution, case-mix adjustment of anaesthetic outcome measures such as PACU LOS potentially provides a useful continuous quality improvement tool. Unadjusted outcome measures are imprecise at best and misleading at worst.</description><subject>Age Factors</subject><subject>anaesthesia recovery</subject><subject>Anesthesia Recovery Period</subject><subject>Anesthetists</subject><subject>business intelligence</subject><subject>dashboards</subject><subject>Feedback</subject><subject>Humans</subject><subject>Insurance, Health - statistics &amp; numerical data</subject><subject>length of stay</subject><subject>neural networks</subject><subject>Neural Networks, Computer</subject><subject>Operative Time</subject><subject>postanaesthesia care unti</subject><subject>postoperative care</subject><subject>Postoperative Complications - diagnosis</subject><subject>quality assurance</subject><subject>Quality Improvement - statistics &amp; numerical data</subject><subject>Severity of Illness Index</subject><subject>Sex Factors</subject><issn>0007-0912</issn><issn>1471-6771</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kE1PGzEQhi1UBCntD-CCfOxlU3vtrL3ihCL6ISH1AmfLa4-Jl2QdPN6qHPjvdRTosdJIc3nmnZmHkEvOlpzx7uu4HEa7bFnLlqyrpU_IgkvFm04p_oEsGGOqYT1vz8lHxJExrtp-dUbORas7wfhqQV7XFqHZxT_U-nHGAp7uExY7WcCyAYyWOpuBzlMsdAvTY9nQFGglXqidPB1mjBMg0jgV2G7jI0wOqLe4GZLNHmlImQYAP1j3REui78klYsFP5DTYLcLnt35BHr7d3q9_NHe_vv9c39w1TvRdaYBpz7lXQWsLYjUoBlr1bggyBCl8F4TQkncSJHgn-xC4063mK6t6EC04cUG-HHP3OT3Pdb_ZRXT1XjtBmtG0Uui-l4KJivIj6nJCzBDMPsedzS-GM3OwbkZTrZuDdcO6WrrOXL3Fz8MO_L-Jd80VuD4CUJ_8HSEbdPFgyscMrhif4n_i_wKfRJVR</recordid><startdate>202012</startdate><enddate>202012</enddate><creator>Schulz, Erich B.</creator><creator>Phillips, Frank</creator><creator>Waterbright, Siall</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>202012</creationdate><title>Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists</title><author>Schulz, Erich B. ; Phillips, Frank ; Waterbright, Siall</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c396t-e08d11d7f88ae35b70e879cbf4ff43d6f3384164e4edc49ff1c82815a79e32ec3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Age Factors</topic><topic>anaesthesia recovery</topic><topic>Anesthesia Recovery Period</topic><topic>Anesthetists</topic><topic>business intelligence</topic><topic>dashboards</topic><topic>Feedback</topic><topic>Humans</topic><topic>Insurance, Health - statistics &amp; numerical data</topic><topic>length of stay</topic><topic>neural networks</topic><topic>Neural Networks, Computer</topic><topic>Operative Time</topic><topic>postanaesthesia care unti</topic><topic>postoperative care</topic><topic>Postoperative Complications - diagnosis</topic><topic>quality assurance</topic><topic>Quality Improvement - statistics &amp; numerical data</topic><topic>Severity of Illness Index</topic><topic>Sex Factors</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schulz, Erich B.</creatorcontrib><creatorcontrib>Phillips, Frank</creatorcontrib><creatorcontrib>Waterbright, Siall</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>British journal of anaesthesia : BJA</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schulz, Erich B.</au><au>Phillips, Frank</au><au>Waterbright, Siall</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists</atitle><jtitle>British journal of anaesthesia : BJA</jtitle><addtitle>Br J Anaesth</addtitle><date>2020-12</date><risdate>2020</risdate><volume>125</volume><issue>6</issue><spage>1079</spage><epage>1087</epage><pages>1079-1087</pages><issn>0007-0912</issn><eissn>1471-6771</eissn><abstract>Despite advances in business intelligence software and evidence that feedback to doctors can improve outcomes, objective feedback regarding patient outcomes for individual anaesthetists is hampered by lack of useful benchmarks. We aimed to address this issue by producing case-mix and risk-adjusted postanaesthesia care unit (PACU) length of stay (LOS) benchmarks for integration into modern reporting tools. We extended existing hospital information systems to calculate predicted PACU LOS using a neural network trained on patient age, surgery duration, sex, operating specialty, urgency, weekday, and insurance status (n=100 511). We then calculated the difference between observed mean and predicted PACU LOS for individual doctors, and compared the results with and without case-mix adjustment. We report practical implications of using visual analytics dashboards displaying the difference between observed and predicted PACU LOS to provide feedback to anaesthetic doctors. The neural network accounted for over half of observed variation in individual doctors' mean PACU LOS (mean predicted and mean actual LOS Spearman's r2=0.57). Account for case-mix reduced apparent spread, with 80% of individual doctors falling in a band of 4.3 min after case-mix adjusting, compared with a range of 24 min without adjustment. Case-mix adjusting also identified different individual doctors as outliers (Weighted Cohen's kappa [κ]=0.27). Finally, we demonstrated that we were able to integrate the adjusted metrics into routine reporting tools. With caution, case-mix adjustment of anaesthetic outcome measures such as PACU LOS potentially provides a useful continuous quality improvement tool. Unadjusted outcome measures are imprecise at best and misleading at worst.</abstract><cop>England</cop><pub>Elsevier Ltd</pub><pmid>32863015</pmid><doi>10.1016/j.bja.2020.06.068</doi><tpages>9</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0007-0912
ispartof British journal of anaesthesia : BJA, 2020-12, Vol.125 (6), p.1079-1087
issn 0007-0912
1471-6771
language eng
recordid cdi_proquest_miscellaneous_2438994303
source MEDLINE; EZB-FREE-00999 freely available EZB journals; Alma/SFX Local Collection
subjects Age Factors
anaesthesia recovery
Anesthesia Recovery Period
Anesthetists
business intelligence
dashboards
Feedback
Humans
Insurance, Health - statistics & numerical data
length of stay
neural networks
Neural Networks, Computer
Operative Time
postanaesthesia care unti
postoperative care
Postoperative Complications - diagnosis
quality assurance
Quality Improvement - statistics & numerical data
Severity of Illness Index
Sex Factors
title Case-mix adjusted postanaesthesia care unit length of stay and business intelligence dashboards for feedback to anaesthetists
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T01%3A59%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Case-mix%20adjusted%20postanaesthesia%20care%20unit%20length%20of%20stay%20and%20business%20intelligence%20dashboards%20for%20feedback%20to%20anaesthetists&rft.jtitle=British%20journal%20of%20anaesthesia%20:%20BJA&rft.au=Schulz,%20Erich%20B.&rft.date=2020-12&rft.volume=125&rft.issue=6&rft.spage=1079&rft.epage=1087&rft.pages=1079-1087&rft.issn=0007-0912&rft.eissn=1471-6771&rft_id=info:doi/10.1016/j.bja.2020.06.068&rft_dat=%3Cproquest_cross%3E2438994303%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2438994303&rft_id=info:pmid/32863015&rft_els_id=S0007091220306139&rfr_iscdi=true