Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting
Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learning models can assess each patient’s likelihood of becoming violent based on clinical notes. Yet, while machine learning...
Gespeichert in:
Veröffentlicht in: | Expert systems with applications 2022-08, Vol.199, p.116720, Article 116720 |
---|---|
Hauptverfasser: | , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 116720 |
container_title | Expert systems with applications |
container_volume | 199 |
creator | Borger, Thomas Mosteiro, Pablo Kaya, Heysem Rijcken, Emil Salah, Albert Ali Scheepers, Floortje Spruit, Marco |
description | Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learning models can assess each patient’s likelihood of becoming violent based on clinical notes. Yet, while machine learning models benefit from having more data, data availability is limited as hospitals typically do not share their data for privacy preservation. Federated Learning (FL) can overcome the problem of data limitation by training models in a decentralised manner, without disclosing data between collaborators. However, although several FL approaches exist, none of these train Natural Language Processing models on clinical notes. In this work, we investigate the application of Federated Learning to clinical Natural Language Processing, applied to the task of Violence Risk Assessment by simulating a cross-institutional psychiatric setting. We train and compare four models: two local models, a federated model and a data-centralised model. Our results indicate that the federated model outperforms the local models and has similar performance as the data-centralised model. These findings suggest that Federated Learning can be used successfully in a cross-institutional setting and is a step towards new applications of Federated Learning based on clinical notes.
•Federated Learning can increase clinical datasets.•Results seem not to be compromised.•This is the first proof-of-concept of a Federated Learning system for clinical NLP. |
doi_str_mv | 10.1016/j.eswa.2022.116720 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2675247590</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0957417422001944</els_id><sourcerecordid>2675247590</sourcerecordid><originalsourceid>FETCH-LOGICAL-c372t-ea973e562973045cdf01b3619d057bf07d8f475b0e1e61b427bfcb38be9ed2d23</originalsourceid><addsrcrecordid>eNp9kE1LxDAURYMoOI7-AVcB161J-pEpuJHBUWHAja5DmrzqK522JunI_HvTGdeuHjzuuVwOIbecpZzx8r5Nwf_oVDAhUs5LKdgZWfCVzJJSVtk5WbCqkEnOZX5JrrxvGeOSMbkg7QYsOB3A0g6067H_pM3g6B6HDnoDFHuDFvpARwcWTcChjz-qqcfd1B1B4wbvE-x9wDDNAd3R0R_MF-rg0FAPIcTea3LR6M7Dzd9dko_N0_v6Jdm-Pb-uH7eJyaQICehKZlCUIh6WF8Y2jNdZySvLClk3TNpVk8uiZsCh5HUu4tPU2aqGCqywIluSu1Pv6IbvCXxQ7TC5OMorUcpCRLhiMSVOqeN6B40aHe60OyjO1OxUtWp2qman6uQ0Qg8nCOL-PYJT3uCsyaIDE5Qd8D_8Fxq5giE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2675247590</pqid></control><display><type>article</type><title>Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Borger, Thomas ; Mosteiro, Pablo ; Kaya, Heysem ; Rijcken, Emil ; Salah, Albert Ali ; Scheepers, Floortje ; Spruit, Marco</creator><creatorcontrib>Borger, Thomas ; Mosteiro, Pablo ; Kaya, Heysem ; Rijcken, Emil ; Salah, Albert Ali ; Scheepers, Floortje ; Spruit, Marco</creatorcontrib><description>Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learning models can assess each patient’s likelihood of becoming violent based on clinical notes. Yet, while machine learning models benefit from having more data, data availability is limited as hospitals typically do not share their data for privacy preservation. Federated Learning (FL) can overcome the problem of data limitation by training models in a decentralised manner, without disclosing data between collaborators. However, although several FL approaches exist, none of these train Natural Language Processing models on clinical notes. In this work, we investigate the application of Federated Learning to clinical Natural Language Processing, applied to the task of Violence Risk Assessment by simulating a cross-institutional psychiatric setting. We train and compare four models: two local models, a federated model and a data-centralised model. Our results indicate that the federated model outperforms the local models and has similar performance as the data-centralised model. These findings suggest that Federated Learning can be used successfully in a cross-institutional setting and is a step towards new applications of Federated Learning based on clinical notes.
•Federated Learning can increase clinical datasets.•Results seem not to be compromised.•This is the first proof-of-concept of a Federated Learning system for clinical NLP.</description><identifier>ISSN: 0957-4174</identifier><identifier>EISSN: 1873-6793</identifier><identifier>DOI: 10.1016/j.eswa.2022.116720</identifier><language>eng</language><publisher>New York: Elsevier Ltd</publisher><subject>Clinical notes ; Federated learning ; Machine learning ; Natural language processing ; Neural networks ; Psychiatry ; Risk assessment ; Violence ; Violence prediction</subject><ispartof>Expert systems with applications, 2022-08, Vol.199, p.116720, Article 116720</ispartof><rights>2022 The Authors</rights><rights>Copyright Elsevier BV Aug 1, 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c372t-ea973e562973045cdf01b3619d057bf07d8f475b0e1e61b427bfcb38be9ed2d23</citedby><cites>FETCH-LOGICAL-c372t-ea973e562973045cdf01b3619d057bf07d8f475b0e1e61b427bfcb38be9ed2d23</cites><orcidid>0000-0002-9237-221X ; 0000-0001-6342-428X ; 0000-0001-7231-2773</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.eswa.2022.116720$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Borger, Thomas</creatorcontrib><creatorcontrib>Mosteiro, Pablo</creatorcontrib><creatorcontrib>Kaya, Heysem</creatorcontrib><creatorcontrib>Rijcken, Emil</creatorcontrib><creatorcontrib>Salah, Albert Ali</creatorcontrib><creatorcontrib>Scheepers, Floortje</creatorcontrib><creatorcontrib>Spruit, Marco</creatorcontrib><title>Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting</title><title>Expert systems with applications</title><description>Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learning models can assess each patient’s likelihood of becoming violent based on clinical notes. Yet, while machine learning models benefit from having more data, data availability is limited as hospitals typically do not share their data for privacy preservation. Federated Learning (FL) can overcome the problem of data limitation by training models in a decentralised manner, without disclosing data between collaborators. However, although several FL approaches exist, none of these train Natural Language Processing models on clinical notes. In this work, we investigate the application of Federated Learning to clinical Natural Language Processing, applied to the task of Violence Risk Assessment by simulating a cross-institutional psychiatric setting. We train and compare four models: two local models, a federated model and a data-centralised model. Our results indicate that the federated model outperforms the local models and has similar performance as the data-centralised model. These findings suggest that Federated Learning can be used successfully in a cross-institutional setting and is a step towards new applications of Federated Learning based on clinical notes.
•Federated Learning can increase clinical datasets.•Results seem not to be compromised.•This is the first proof-of-concept of a Federated Learning system for clinical NLP.</description><subject>Clinical notes</subject><subject>Federated learning</subject><subject>Machine learning</subject><subject>Natural language processing</subject><subject>Neural networks</subject><subject>Psychiatry</subject><subject>Risk assessment</subject><subject>Violence</subject><subject>Violence prediction</subject><issn>0957-4174</issn><issn>1873-6793</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LxDAURYMoOI7-AVcB161J-pEpuJHBUWHAja5DmrzqK522JunI_HvTGdeuHjzuuVwOIbecpZzx8r5Nwf_oVDAhUs5LKdgZWfCVzJJSVtk5WbCqkEnOZX5JrrxvGeOSMbkg7QYsOB3A0g6067H_pM3g6B6HDnoDFHuDFvpARwcWTcChjz-qqcfd1B1B4wbvE-x9wDDNAd3R0R_MF-rg0FAPIcTea3LR6M7Dzd9dko_N0_v6Jdm-Pb-uH7eJyaQICehKZlCUIh6WF8Y2jNdZySvLClk3TNpVk8uiZsCh5HUu4tPU2aqGCqywIluSu1Pv6IbvCXxQ7TC5OMorUcpCRLhiMSVOqeN6B40aHe60OyjO1OxUtWp2qman6uQ0Qg8nCOL-PYJT3uCsyaIDE5Qd8D_8Fxq5giE</recordid><startdate>20220801</startdate><enddate>20220801</enddate><creator>Borger, Thomas</creator><creator>Mosteiro, Pablo</creator><creator>Kaya, Heysem</creator><creator>Rijcken, Emil</creator><creator>Salah, Albert Ali</creator><creator>Scheepers, Floortje</creator><creator>Spruit, Marco</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-9237-221X</orcidid><orcidid>https://orcid.org/0000-0001-6342-428X</orcidid><orcidid>https://orcid.org/0000-0001-7231-2773</orcidid></search><sort><creationdate>20220801</creationdate><title>Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting</title><author>Borger, Thomas ; Mosteiro, Pablo ; Kaya, Heysem ; Rijcken, Emil ; Salah, Albert Ali ; Scheepers, Floortje ; Spruit, Marco</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c372t-ea973e562973045cdf01b3619d057bf07d8f475b0e1e61b427bfcb38be9ed2d23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Clinical notes</topic><topic>Federated learning</topic><topic>Machine learning</topic><topic>Natural language processing</topic><topic>Neural networks</topic><topic>Psychiatry</topic><topic>Risk assessment</topic><topic>Violence</topic><topic>Violence prediction</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Borger, Thomas</creatorcontrib><creatorcontrib>Mosteiro, Pablo</creatorcontrib><creatorcontrib>Kaya, Heysem</creatorcontrib><creatorcontrib>Rijcken, Emil</creatorcontrib><creatorcontrib>Salah, Albert Ali</creatorcontrib><creatorcontrib>Scheepers, Floortje</creatorcontrib><creatorcontrib>Spruit, Marco</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Expert systems with applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Borger, Thomas</au><au>Mosteiro, Pablo</au><au>Kaya, Heysem</au><au>Rijcken, Emil</au><au>Salah, Albert Ali</au><au>Scheepers, Floortje</au><au>Spruit, Marco</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting</atitle><jtitle>Expert systems with applications</jtitle><date>2022-08-01</date><risdate>2022</risdate><volume>199</volume><spage>116720</spage><pages>116720-</pages><artnum>116720</artnum><issn>0957-4174</issn><eissn>1873-6793</eissn><abstract>Inpatient violence is a common and severe problem within psychiatry. Knowing who might become violent can influence staffing levels and mitigate severity. Predictive machine learning models can assess each patient’s likelihood of becoming violent based on clinical notes. Yet, while machine learning models benefit from having more data, data availability is limited as hospitals typically do not share their data for privacy preservation. Federated Learning (FL) can overcome the problem of data limitation by training models in a decentralised manner, without disclosing data between collaborators. However, although several FL approaches exist, none of these train Natural Language Processing models on clinical notes. In this work, we investigate the application of Federated Learning to clinical Natural Language Processing, applied to the task of Violence Risk Assessment by simulating a cross-institutional psychiatric setting. We train and compare four models: two local models, a federated model and a data-centralised model. Our results indicate that the federated model outperforms the local models and has similar performance as the data-centralised model. These findings suggest that Federated Learning can be used successfully in a cross-institutional setting and is a step towards new applications of Federated Learning based on clinical notes.
•Federated Learning can increase clinical datasets.•Results seem not to be compromised.•This is the first proof-of-concept of a Federated Learning system for clinical NLP.</abstract><cop>New York</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.eswa.2022.116720</doi><orcidid>https://orcid.org/0000-0002-9237-221X</orcidid><orcidid>https://orcid.org/0000-0001-6342-428X</orcidid><orcidid>https://orcid.org/0000-0001-7231-2773</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0957-4174 |
ispartof | Expert systems with applications, 2022-08, Vol.199, p.116720, Article 116720 |
issn | 0957-4174 1873-6793 |
language | eng |
recordid | cdi_proquest_journals_2675247590 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Clinical notes Federated learning Machine learning Natural language processing Neural networks Psychiatry Risk assessment Violence Violence prediction |
title | Federated learning for violence incident prediction in a simulated cross-institutional psychiatric setting |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T20%3A33%3A29IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Federated%20learning%20for%20violence%20incident%20prediction%20in%20a%20simulated%20cross-institutional%20psychiatric%20setting&rft.jtitle=Expert%20systems%20with%20applications&rft.au=Borger,%20Thomas&rft.date=2022-08-01&rft.volume=199&rft.spage=116720&rft.pages=116720-&rft.artnum=116720&rft.issn=0957-4174&rft.eissn=1873-6793&rft_id=info:doi/10.1016/j.eswa.2022.116720&rft_dat=%3Cproquest_cross%3E2675247590%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2675247590&rft_id=info:pmid/&rft_els_id=S0957417422001944&rfr_iscdi=true |