Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty

The contemporary patient has access to numerous resources on common orthopaedic procedures before ever presenting for a clinical evaluation. Recently, artificial intelligence (AI)-driven chatbots have become mainstream, allowing patients to engage with interfaces that supply convincing, human-like r...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of bone and joint surgery. American volume 2023-10, Vol.105 (19), p.1519-1526
Hauptverfasser: Mika, Aleksander P., Martin, J. Ryan, Engstrom, Stephen M., Polkowski, Gregory G., Wilson, Jacob M.
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1526
container_issue 19
container_start_page 1519
container_title Journal of bone and joint surgery. American volume
container_volume 105
creator Mika, Aleksander P.
Martin, J. Ryan
Engstrom, Stephen M.
Polkowski, Gregory G.
Wilson, Jacob M.
description The contemporary patient has access to numerous resources on common orthopaedic procedures before ever presenting for a clinical evaluation. Recently, artificial intelligence (AI)-driven chatbots have become mainstream, allowing patients to engage with interfaces that supply convincing, human-like responses to prompts. ChatGPT (OpenAI), a recently developed AI-based chat technology, is one such application that has garnered rapid growth in popularity. Given the likelihood that patients may soon call on this technology for preoperative education, we sought to determine whether ChatGPT could appropriately answer frequently asked questions regarding total hip arthroplasty (THA). Ten frequently asked questions regarding total hip arthroplasty were posed to the chatbot during a conversation thread, with no follow-up questions or repetition. Each response was analyzed for accuracy with use of an evidence-based approach. Responses were rated as "excellent response not requiring clarification," "satisfactory requiring minimal clarification," "satisfactory requiring moderate clarification," or "unsatisfactory requiring substantial clarification." Of the responses given by the chatbot, only 1 received an "unsatisfactory" rating; 2 did not require any correction, and the majority required either minimal (4 of 10) or moderate (3 of 10) clarification. Although several responses required nuanced clarification, the chatbot's responses were generally unbiased and evidence-based, even for controversial topics. The chatbot effectively provided evidence-based responses to questions commonly asked by patients prior to THA. The chatbot presented information in a way that most patients would be able to understand. This resource may serve as a valuable clinical tool for patient education and understanding prior to orthopaedic consultation in the future.
doi_str_mv 10.2106/JBJS.23.00209
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2839253071</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2839253071</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3387-680d581078fb07d7dfc29a80f1e81fe84a4d27ace51db649c66fbcae1f80a3dc3</originalsourceid><addsrcrecordid>eNo9kE1PwzAMhiMEYmNw5Ip65NLhfLRJj2OCjQmJAUPiFmVtuhXapiSZpv17Mgb4Ysl-_Mp6ELrEMCQY0pvZ7ex1SOgQgEB2hPo4oUmMqUiPUT_McJzRJOmhM-c-AIAx4KeoRzlLMgakj95HzmnnqnYVjdfKT-aL6EW7zrRhGnkTjU3TmDaaK1_p1kfPG-18FbaBWilb7O8Wxqs6mlZdNLJ-bU1XK-d35-ikVLXTF799gN7u7xbjafz4NHkYjx7jnFLB41RAkQgMXJRL4AUvypxkSkCJtcClFkyxgnCV6wQXy5RleZqWy1xpXApQtMjpAF0fcjtrvvbfyaZyua5r1WqzcZIImpGEAscBjQ9obo1zVpeys1Wj7E5ikHuZci9TEip_ZAb-6jd6s2x08U__2QsAOwBbU3tt3We92Wor11rVfh1Cgu-U0DjL4FAxgGCcfgOMyX-1</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2839253071</pqid></control><display><type>article</type><title>Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty</title><source>Alma/SFX Local Collection</source><creator>Mika, Aleksander P. ; Martin, J. Ryan ; Engstrom, Stephen M. ; Polkowski, Gregory G. ; Wilson, Jacob M.</creator><creatorcontrib>Mika, Aleksander P. ; Martin, J. Ryan ; Engstrom, Stephen M. ; Polkowski, Gregory G. ; Wilson, Jacob M.</creatorcontrib><description>The contemporary patient has access to numerous resources on common orthopaedic procedures before ever presenting for a clinical evaluation. Recently, artificial intelligence (AI)-driven chatbots have become mainstream, allowing patients to engage with interfaces that supply convincing, human-like responses to prompts. ChatGPT (OpenAI), a recently developed AI-based chat technology, is one such application that has garnered rapid growth in popularity. Given the likelihood that patients may soon call on this technology for preoperative education, we sought to determine whether ChatGPT could appropriately answer frequently asked questions regarding total hip arthroplasty (THA). Ten frequently asked questions regarding total hip arthroplasty were posed to the chatbot during a conversation thread, with no follow-up questions or repetition. Each response was analyzed for accuracy with use of an evidence-based approach. Responses were rated as "excellent response not requiring clarification," "satisfactory requiring minimal clarification," "satisfactory requiring moderate clarification," or "unsatisfactory requiring substantial clarification." Of the responses given by the chatbot, only 1 received an "unsatisfactory" rating; 2 did not require any correction, and the majority required either minimal (4 of 10) or moderate (3 of 10) clarification. Although several responses required nuanced clarification, the chatbot's responses were generally unbiased and evidence-based, even for controversial topics. The chatbot effectively provided evidence-based responses to questions commonly asked by patients prior to THA. The chatbot presented information in a way that most patients would be able to understand. This resource may serve as a valuable clinical tool for patient education and understanding prior to orthopaedic consultation in the future.</description><identifier>ISSN: 0021-9355</identifier><identifier>EISSN: 1535-1386</identifier><identifier>DOI: 10.2106/JBJS.23.00209</identifier><identifier>PMID: 37459402</identifier><language>eng</language><publisher>United States: Journal of Bone and Joint Surgery, Inc</publisher><ispartof>Journal of bone and joint surgery. American volume, 2023-10, Vol.105 (19), p.1519-1526</ispartof><rights>Journal of Bone and Joint Surgery, Inc.</rights><rights>Copyright © 2023 by The Journal of Bone and Joint Surgery, Incorporated.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3387-680d581078fb07d7dfc29a80f1e81fe84a4d27ace51db649c66fbcae1f80a3dc3</citedby><cites>FETCH-LOGICAL-c3387-680d581078fb07d7dfc29a80f1e81fe84a4d27ace51db649c66fbcae1f80a3dc3</cites><orcidid>0000-0002-4125-2154 ; 0000-0001-6261-5236 ; 0000-0002-8990-7578 ; 0000-0002-5260-4506 ; 0000-0002-5044-7084</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,778,782,27907,27908</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37459402$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Mika, Aleksander P.</creatorcontrib><creatorcontrib>Martin, J. Ryan</creatorcontrib><creatorcontrib>Engstrom, Stephen M.</creatorcontrib><creatorcontrib>Polkowski, Gregory G.</creatorcontrib><creatorcontrib>Wilson, Jacob M.</creatorcontrib><title>Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty</title><title>Journal of bone and joint surgery. American volume</title><addtitle>J Bone Joint Surg Am</addtitle><description>The contemporary patient has access to numerous resources on common orthopaedic procedures before ever presenting for a clinical evaluation. Recently, artificial intelligence (AI)-driven chatbots have become mainstream, allowing patients to engage with interfaces that supply convincing, human-like responses to prompts. ChatGPT (OpenAI), a recently developed AI-based chat technology, is one such application that has garnered rapid growth in popularity. Given the likelihood that patients may soon call on this technology for preoperative education, we sought to determine whether ChatGPT could appropriately answer frequently asked questions regarding total hip arthroplasty (THA). Ten frequently asked questions regarding total hip arthroplasty were posed to the chatbot during a conversation thread, with no follow-up questions or repetition. Each response was analyzed for accuracy with use of an evidence-based approach. Responses were rated as "excellent response not requiring clarification," "satisfactory requiring minimal clarification," "satisfactory requiring moderate clarification," or "unsatisfactory requiring substantial clarification." Of the responses given by the chatbot, only 1 received an "unsatisfactory" rating; 2 did not require any correction, and the majority required either minimal (4 of 10) or moderate (3 of 10) clarification. Although several responses required nuanced clarification, the chatbot's responses were generally unbiased and evidence-based, even for controversial topics. The chatbot effectively provided evidence-based responses to questions commonly asked by patients prior to THA. The chatbot presented information in a way that most patients would be able to understand. This resource may serve as a valuable clinical tool for patient education and understanding prior to orthopaedic consultation in the future.</description><issn>0021-9355</issn><issn>1535-1386</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNo9kE1PwzAMhiMEYmNw5Ip65NLhfLRJj2OCjQmJAUPiFmVtuhXapiSZpv17Mgb4Ysl-_Mp6ELrEMCQY0pvZ7ex1SOgQgEB2hPo4oUmMqUiPUT_McJzRJOmhM-c-AIAx4KeoRzlLMgakj95HzmnnqnYVjdfKT-aL6EW7zrRhGnkTjU3TmDaaK1_p1kfPG-18FbaBWilb7O8Wxqs6mlZdNLJ-bU1XK-d35-ikVLXTF799gN7u7xbjafz4NHkYjx7jnFLB41RAkQgMXJRL4AUvypxkSkCJtcClFkyxgnCV6wQXy5RleZqWy1xpXApQtMjpAF0fcjtrvvbfyaZyua5r1WqzcZIImpGEAscBjQ9obo1zVpeys1Wj7E5ikHuZci9TEip_ZAb-6jd6s2x08U__2QsAOwBbU3tt3We92Wor11rVfh1Cgu-U0DjL4FAxgGCcfgOMyX-1</recordid><startdate>20231004</startdate><enddate>20231004</enddate><creator>Mika, Aleksander P.</creator><creator>Martin, J. Ryan</creator><creator>Engstrom, Stephen M.</creator><creator>Polkowski, Gregory G.</creator><creator>Wilson, Jacob M.</creator><general>Journal of Bone and Joint Surgery, Inc</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-4125-2154</orcidid><orcidid>https://orcid.org/0000-0001-6261-5236</orcidid><orcidid>https://orcid.org/0000-0002-8990-7578</orcidid><orcidid>https://orcid.org/0000-0002-5260-4506</orcidid><orcidid>https://orcid.org/0000-0002-5044-7084</orcidid></search><sort><creationdate>20231004</creationdate><title>Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty</title><author>Mika, Aleksander P. ; Martin, J. Ryan ; Engstrom, Stephen M. ; Polkowski, Gregory G. ; Wilson, Jacob M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3387-680d581078fb07d7dfc29a80f1e81fe84a4d27ace51db649c66fbcae1f80a3dc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mika, Aleksander P.</creatorcontrib><creatorcontrib>Martin, J. Ryan</creatorcontrib><creatorcontrib>Engstrom, Stephen M.</creatorcontrib><creatorcontrib>Polkowski, Gregory G.</creatorcontrib><creatorcontrib>Wilson, Jacob M.</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of bone and joint surgery. American volume</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mika, Aleksander P.</au><au>Martin, J. Ryan</au><au>Engstrom, Stephen M.</au><au>Polkowski, Gregory G.</au><au>Wilson, Jacob M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty</atitle><jtitle>Journal of bone and joint surgery. American volume</jtitle><addtitle>J Bone Joint Surg Am</addtitle><date>2023-10-04</date><risdate>2023</risdate><volume>105</volume><issue>19</issue><spage>1519</spage><epage>1526</epage><pages>1519-1526</pages><issn>0021-9355</issn><eissn>1535-1386</eissn><abstract>The contemporary patient has access to numerous resources on common orthopaedic procedures before ever presenting for a clinical evaluation. Recently, artificial intelligence (AI)-driven chatbots have become mainstream, allowing patients to engage with interfaces that supply convincing, human-like responses to prompts. ChatGPT (OpenAI), a recently developed AI-based chat technology, is one such application that has garnered rapid growth in popularity. Given the likelihood that patients may soon call on this technology for preoperative education, we sought to determine whether ChatGPT could appropriately answer frequently asked questions regarding total hip arthroplasty (THA). Ten frequently asked questions regarding total hip arthroplasty were posed to the chatbot during a conversation thread, with no follow-up questions or repetition. Each response was analyzed for accuracy with use of an evidence-based approach. Responses were rated as "excellent response not requiring clarification," "satisfactory requiring minimal clarification," "satisfactory requiring moderate clarification," or "unsatisfactory requiring substantial clarification." Of the responses given by the chatbot, only 1 received an "unsatisfactory" rating; 2 did not require any correction, and the majority required either minimal (4 of 10) or moderate (3 of 10) clarification. Although several responses required nuanced clarification, the chatbot's responses were generally unbiased and evidence-based, even for controversial topics. The chatbot effectively provided evidence-based responses to questions commonly asked by patients prior to THA. The chatbot presented information in a way that most patients would be able to understand. This resource may serve as a valuable clinical tool for patient education and understanding prior to orthopaedic consultation in the future.</abstract><cop>United States</cop><pub>Journal of Bone and Joint Surgery, Inc</pub><pmid>37459402</pmid><doi>10.2106/JBJS.23.00209</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0002-4125-2154</orcidid><orcidid>https://orcid.org/0000-0001-6261-5236</orcidid><orcidid>https://orcid.org/0000-0002-8990-7578</orcidid><orcidid>https://orcid.org/0000-0002-5260-4506</orcidid><orcidid>https://orcid.org/0000-0002-5044-7084</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0021-9355
ispartof Journal of bone and joint surgery. American volume, 2023-10, Vol.105 (19), p.1519-1526
issn 0021-9355
1535-1386
language eng
recordid cdi_proquest_miscellaneous_2839253071
source Alma/SFX Local Collection
title Assessing ChatGPT Responses to Common Patient Questions Regarding Total Hip Arthroplasty
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T17%3A27%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Assessing%20ChatGPT%20Responses%20to%20Common%20Patient%20Questions%20Regarding%20Total%20Hip%20Arthroplasty&rft.jtitle=Journal%20of%20bone%20and%20joint%20surgery.%20American%20volume&rft.au=Mika,%20Aleksander%20P.&rft.date=2023-10-04&rft.volume=105&rft.issue=19&rft.spage=1519&rft.epage=1526&rft.pages=1519-1526&rft.issn=0021-9355&rft.eissn=1535-1386&rft_id=info:doi/10.2106/JBJS.23.00209&rft_dat=%3Cproquest_cross%3E2839253071%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2839253071&rft_id=info:pmid/37459402&rfr_iscdi=true