Reducing the question burden of patient reported outcome measures using Bayesian networks

[Display omitted] •Patient-Reported-Outcome-Measures are filled out by patients to assess their health.•We found it was possible to reduce the PROM question burden with Bayesian Networks.•We present a systematic approach for building PROM BNs that can be widely deployed.•Adaptive prioritization of q...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of biomedical informatics 2022-11, Vol.135, p.104230-104230, Article 104230
Hauptverfasser: Yücetürk, Hakan, Gülle, Halime, Şakar, Ceren Tuncer, Joyner, Christopher, Marsh, William, Ünal, Edibe, Morrissey, Dylan, Yet, Barbaros
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 104230
container_issue
container_start_page 104230
container_title Journal of biomedical informatics
container_volume 135
creator Yücetürk, Hakan
Gülle, Halime
Şakar, Ceren Tuncer
Joyner, Christopher
Marsh, William
Ünal, Edibe
Morrissey, Dylan
Yet, Barbaros
description [Display omitted] •Patient-Reported-Outcome-Measures are filled out by patients to assess their health.•We found it was possible to reduce the PROM question burden with Bayesian Networks.•We present a systematic approach for building PROM BNs that can be widely deployed.•Adaptive prioritization of questions from previous answers reduces question burden.•Using PROM BNs on multiple datasets demonstrate improved data collection efficacy. Patient Reported Outcome Measures (PROMs) are questionnaires completed by patients about aspects of their health status. They are a vital part of learning health systems as they are the primary source of information about important outcomes that are best assessed by patients such as pain, disability, anxiety and depression. The volume of questions can easily become burdensome. Previous techniques reduced this burden by dynamically selecting questions from question item banks which are specifically built for different latent constructs being measured. These techniques analyzed the information function between each question in the item bank and the measured construct based on item response theory then used this information function to dynamically select questions by computerized adaptive testing. Here we extend those ideas by using Bayesian Networks (BNs) to enable Computerized Adaptive Testing (CAT) for efficient and accurate question selection on widely-used existing PROMs. BNs offer more comprehensive probabilistic models of the connections between different PROM questions, allowing the use of information theoretic techniques to select the most informative questions. We tested our methods using five clinical PROM datasets, demonstrating that answering a small subset of questions selected with CAT has similar predictions and error to answering all questions in the PROM BN. Our results show that answering 30% − 75% questions selected with CAT had an average area under the receiver operating characteristic curve (AUC) of 0.92 (min: 0.8 – max: 0.98) for predicting the measured constructs. BNs outperformed alternative CAT approaches with a 5% (min: 0.01% – max: 9%) average increase in the accuracy of predicting the responses to unanswered question items.
doi_str_mv 10.1016/j.jbi.2022.104230
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2726409442</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1532046422002350</els_id><sourcerecordid>2726409442</sourcerecordid><originalsourceid>FETCH-LOGICAL-c396t-47c95f9cf04db0ff60bbdff54ce563d73bf2d6ec898de08487b8b540bdd62aae3</originalsourceid><addsrcrecordid>eNp9kEtPwzAQhC0EoqXwA7ggH7m0OI7jJOIEFS-pEhKCAyfLjzW4NHGxHVD_PSktPXLaXWlmtPMhdJqRSUYyfjGfzJWbUEJpfzOakz00zIqcjgmryP5u52yAjmKcE5JlRcEP0SDntChZRYfo9QlMp137htM74M8OYnK-xaoLBlrsLV7K5KBNOMDShwQG-y5p3wBuQMYuQMRdXNuv5Qqiky1uIX378BGP0YGViwgn2zlCL7c3z9P78ezx7mF6NRvrvOZpzEpdF7bWljCjiLWcKGWsLZiGguemzJWlhoOu6soAqVhVqkoVjChjOJUS8hE63-Qug__9XzQualgsZAu-i4KWlDNSs57PCGUbqQ4-xgBWLINrZFiJjIg1UTEXPVGxJio2RHvP2Ta-Uw2YneMPYS-43AigL_nlIIioe2IajAugkzDe_RP_Az3HiHo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2726409442</pqid></control><display><type>article</type><title>Reducing the question burden of patient reported outcome measures using Bayesian networks</title><source>MEDLINE</source><source>ScienceDirect Journals (5 years ago - present)</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Yücetürk, Hakan ; Gülle, Halime ; Şakar, Ceren Tuncer ; Joyner, Christopher ; Marsh, William ; Ünal, Edibe ; Morrissey, Dylan ; Yet, Barbaros</creator><creatorcontrib>Yücetürk, Hakan ; Gülle, Halime ; Şakar, Ceren Tuncer ; Joyner, Christopher ; Marsh, William ; Ünal, Edibe ; Morrissey, Dylan ; Yet, Barbaros</creatorcontrib><description>[Display omitted] •Patient-Reported-Outcome-Measures are filled out by patients to assess their health.•We found it was possible to reduce the PROM question burden with Bayesian Networks.•We present a systematic approach for building PROM BNs that can be widely deployed.•Adaptive prioritization of questions from previous answers reduces question burden.•Using PROM BNs on multiple datasets demonstrate improved data collection efficacy. Patient Reported Outcome Measures (PROMs) are questionnaires completed by patients about aspects of their health status. They are a vital part of learning health systems as they are the primary source of information about important outcomes that are best assessed by patients such as pain, disability, anxiety and depression. The volume of questions can easily become burdensome. Previous techniques reduced this burden by dynamically selecting questions from question item banks which are specifically built for different latent constructs being measured. These techniques analyzed the information function between each question in the item bank and the measured construct based on item response theory then used this information function to dynamically select questions by computerized adaptive testing. Here we extend those ideas by using Bayesian Networks (BNs) to enable Computerized Adaptive Testing (CAT) for efficient and accurate question selection on widely-used existing PROMs. BNs offer more comprehensive probabilistic models of the connections between different PROM questions, allowing the use of information theoretic techniques to select the most informative questions. We tested our methods using five clinical PROM datasets, demonstrating that answering a small subset of questions selected with CAT has similar predictions and error to answering all questions in the PROM BN. Our results show that answering 30% − 75% questions selected with CAT had an average area under the receiver operating characteristic curve (AUC) of 0.92 (min: 0.8 – max: 0.98) for predicting the measured constructs. BNs outperformed alternative CAT approaches with a 5% (min: 0.01% – max: 9%) average increase in the accuracy of predicting the responses to unanswered question items.</description><identifier>ISSN: 1532-0464</identifier><identifier>EISSN: 1532-0480</identifier><identifier>DOI: 10.1016/j.jbi.2022.104230</identifier><identifier>PMID: 36257482</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Bayes Theorem ; Bayesian networks ; Computerized adaptive testing ; Health Status ; Patient Reported Outcome Measures ; Questionnaire burden ; Reproducibility of Results ; Surveys and Questionnaires</subject><ispartof>Journal of biomedical informatics, 2022-11, Vol.135, p.104230-104230, Article 104230</ispartof><rights>2022 Elsevier Inc.</rights><rights>Copyright © 2022 Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c396t-47c95f9cf04db0ff60bbdff54ce563d73bf2d6ec898de08487b8b540bdd62aae3</citedby><cites>FETCH-LOGICAL-c396t-47c95f9cf04db0ff60bbdff54ce563d73bf2d6ec898de08487b8b540bdd62aae3</cites><orcidid>0000-0003-4058-2677 ; 0000-0003-3950-3935</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.jbi.2022.104230$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3548,27922,27923,45993</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/36257482$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Yücetürk, Hakan</creatorcontrib><creatorcontrib>Gülle, Halime</creatorcontrib><creatorcontrib>Şakar, Ceren Tuncer</creatorcontrib><creatorcontrib>Joyner, Christopher</creatorcontrib><creatorcontrib>Marsh, William</creatorcontrib><creatorcontrib>Ünal, Edibe</creatorcontrib><creatorcontrib>Morrissey, Dylan</creatorcontrib><creatorcontrib>Yet, Barbaros</creatorcontrib><title>Reducing the question burden of patient reported outcome measures using Bayesian networks</title><title>Journal of biomedical informatics</title><addtitle>J Biomed Inform</addtitle><description>[Display omitted] •Patient-Reported-Outcome-Measures are filled out by patients to assess their health.•We found it was possible to reduce the PROM question burden with Bayesian Networks.•We present a systematic approach for building PROM BNs that can be widely deployed.•Adaptive prioritization of questions from previous answers reduces question burden.•Using PROM BNs on multiple datasets demonstrate improved data collection efficacy. Patient Reported Outcome Measures (PROMs) are questionnaires completed by patients about aspects of their health status. They are a vital part of learning health systems as they are the primary source of information about important outcomes that are best assessed by patients such as pain, disability, anxiety and depression. The volume of questions can easily become burdensome. Previous techniques reduced this burden by dynamically selecting questions from question item banks which are specifically built for different latent constructs being measured. These techniques analyzed the information function between each question in the item bank and the measured construct based on item response theory then used this information function to dynamically select questions by computerized adaptive testing. Here we extend those ideas by using Bayesian Networks (BNs) to enable Computerized Adaptive Testing (CAT) for efficient and accurate question selection on widely-used existing PROMs. BNs offer more comprehensive probabilistic models of the connections between different PROM questions, allowing the use of information theoretic techniques to select the most informative questions. We tested our methods using five clinical PROM datasets, demonstrating that answering a small subset of questions selected with CAT has similar predictions and error to answering all questions in the PROM BN. Our results show that answering 30% − 75% questions selected with CAT had an average area under the receiver operating characteristic curve (AUC) of 0.92 (min: 0.8 – max: 0.98) for predicting the measured constructs. BNs outperformed alternative CAT approaches with a 5% (min: 0.01% – max: 9%) average increase in the accuracy of predicting the responses to unanswered question items.</description><subject>Bayes Theorem</subject><subject>Bayesian networks</subject><subject>Computerized adaptive testing</subject><subject>Health Status</subject><subject>Patient Reported Outcome Measures</subject><subject>Questionnaire burden</subject><subject>Reproducibility of Results</subject><subject>Surveys and Questionnaires</subject><issn>1532-0464</issn><issn>1532-0480</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kEtPwzAQhC0EoqXwA7ggH7m0OI7jJOIEFS-pEhKCAyfLjzW4NHGxHVD_PSktPXLaXWlmtPMhdJqRSUYyfjGfzJWbUEJpfzOakz00zIqcjgmryP5u52yAjmKcE5JlRcEP0SDntChZRYfo9QlMp137htM74M8OYnK-xaoLBlrsLV7K5KBNOMDShwQG-y5p3wBuQMYuQMRdXNuv5Qqiky1uIX378BGP0YGViwgn2zlCL7c3z9P78ezx7mF6NRvrvOZpzEpdF7bWljCjiLWcKGWsLZiGguemzJWlhoOu6soAqVhVqkoVjChjOJUS8hE63-Qug__9XzQualgsZAu-i4KWlDNSs57PCGUbqQ4-xgBWLINrZFiJjIg1UTEXPVGxJio2RHvP2Ta-Uw2YneMPYS-43AigL_nlIIioe2IajAugkzDe_RP_Az3HiHo</recordid><startdate>202211</startdate><enddate>202211</enddate><creator>Yücetürk, Hakan</creator><creator>Gülle, Halime</creator><creator>Şakar, Ceren Tuncer</creator><creator>Joyner, Christopher</creator><creator>Marsh, William</creator><creator>Ünal, Edibe</creator><creator>Morrissey, Dylan</creator><creator>Yet, Barbaros</creator><general>Elsevier Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-4058-2677</orcidid><orcidid>https://orcid.org/0000-0003-3950-3935</orcidid></search><sort><creationdate>202211</creationdate><title>Reducing the question burden of patient reported outcome measures using Bayesian networks</title><author>Yücetürk, Hakan ; Gülle, Halime ; Şakar, Ceren Tuncer ; Joyner, Christopher ; Marsh, William ; Ünal, Edibe ; Morrissey, Dylan ; Yet, Barbaros</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c396t-47c95f9cf04db0ff60bbdff54ce563d73bf2d6ec898de08487b8b540bdd62aae3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Bayes Theorem</topic><topic>Bayesian networks</topic><topic>Computerized adaptive testing</topic><topic>Health Status</topic><topic>Patient Reported Outcome Measures</topic><topic>Questionnaire burden</topic><topic>Reproducibility of Results</topic><topic>Surveys and Questionnaires</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yücetürk, Hakan</creatorcontrib><creatorcontrib>Gülle, Halime</creatorcontrib><creatorcontrib>Şakar, Ceren Tuncer</creatorcontrib><creatorcontrib>Joyner, Christopher</creatorcontrib><creatorcontrib>Marsh, William</creatorcontrib><creatorcontrib>Ünal, Edibe</creatorcontrib><creatorcontrib>Morrissey, Dylan</creatorcontrib><creatorcontrib>Yet, Barbaros</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of biomedical informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yücetürk, Hakan</au><au>Gülle, Halime</au><au>Şakar, Ceren Tuncer</au><au>Joyner, Christopher</au><au>Marsh, William</au><au>Ünal, Edibe</au><au>Morrissey, Dylan</au><au>Yet, Barbaros</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Reducing the question burden of patient reported outcome measures using Bayesian networks</atitle><jtitle>Journal of biomedical informatics</jtitle><addtitle>J Biomed Inform</addtitle><date>2022-11</date><risdate>2022</risdate><volume>135</volume><spage>104230</spage><epage>104230</epage><pages>104230-104230</pages><artnum>104230</artnum><issn>1532-0464</issn><eissn>1532-0480</eissn><abstract>[Display omitted] •Patient-Reported-Outcome-Measures are filled out by patients to assess their health.•We found it was possible to reduce the PROM question burden with Bayesian Networks.•We present a systematic approach for building PROM BNs that can be widely deployed.•Adaptive prioritization of questions from previous answers reduces question burden.•Using PROM BNs on multiple datasets demonstrate improved data collection efficacy. Patient Reported Outcome Measures (PROMs) are questionnaires completed by patients about aspects of their health status. They are a vital part of learning health systems as they are the primary source of information about important outcomes that are best assessed by patients such as pain, disability, anxiety and depression. The volume of questions can easily become burdensome. Previous techniques reduced this burden by dynamically selecting questions from question item banks which are specifically built for different latent constructs being measured. These techniques analyzed the information function between each question in the item bank and the measured construct based on item response theory then used this information function to dynamically select questions by computerized adaptive testing. Here we extend those ideas by using Bayesian Networks (BNs) to enable Computerized Adaptive Testing (CAT) for efficient and accurate question selection on widely-used existing PROMs. BNs offer more comprehensive probabilistic models of the connections between different PROM questions, allowing the use of information theoretic techniques to select the most informative questions. We tested our methods using five clinical PROM datasets, demonstrating that answering a small subset of questions selected with CAT has similar predictions and error to answering all questions in the PROM BN. Our results show that answering 30% − 75% questions selected with CAT had an average area under the receiver operating characteristic curve (AUC) of 0.92 (min: 0.8 – max: 0.98) for predicting the measured constructs. BNs outperformed alternative CAT approaches with a 5% (min: 0.01% – max: 9%) average increase in the accuracy of predicting the responses to unanswered question items.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>36257482</pmid><doi>10.1016/j.jbi.2022.104230</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-4058-2677</orcidid><orcidid>https://orcid.org/0000-0003-3950-3935</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1532-0464
ispartof Journal of biomedical informatics, 2022-11, Vol.135, p.104230-104230, Article 104230
issn 1532-0464
1532-0480
language eng
recordid cdi_proquest_miscellaneous_2726409442
source MEDLINE; ScienceDirect Journals (5 years ago - present); EZB-FREE-00999 freely available EZB journals
subjects Bayes Theorem
Bayesian networks
Computerized adaptive testing
Health Status
Patient Reported Outcome Measures
Questionnaire burden
Reproducibility of Results
Surveys and Questionnaires
title Reducing the question burden of patient reported outcome measures using Bayesian networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-14T05%3A11%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Reducing%20the%20question%20burden%20of%20patient%20reported%20outcome%20measures%20using%20Bayesian%20networks&rft.jtitle=Journal%20of%20biomedical%20informatics&rft.au=Y%C3%BCcet%C3%BCrk,%20Hakan&rft.date=2022-11&rft.volume=135&rft.spage=104230&rft.epage=104230&rft.pages=104230-104230&rft.artnum=104230&rft.issn=1532-0464&rft.eissn=1532-0480&rft_id=info:doi/10.1016/j.jbi.2022.104230&rft_dat=%3Cproquest_cross%3E2726409442%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2726409442&rft_id=info:pmid/36257482&rft_els_id=S1532046422002350&rfr_iscdi=true