Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology
To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians’ perception about utilizing artificial intelligence (AI) in ophthalmology practice. Six cases were presented to uveitis experts, ChatGPT (ve...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Dataset |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | |
| container_volume | |
| creator | Rojas-Carabali, William Sen, Alok Agarwal, Aniruddha Tan, Gavin Cheung, Carol Y. Rousselot, Andres Agrawal, Rajdeep Liu, Renee Cifuentes-González, Carlos Elze, Tobias Kempen, John H. Sobrin, Lucia Nguyen, Quan Dong de-la-Torre, Alejandra Lee, Bernett Gupta, Vishali Agrawal, Rupesh |
| description | To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians’ perception about utilizing artificial intelligence (AI) in ophthalmology practice. Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice. |
| doi_str_mv | 10.6084/m9.figshare.24307209 |
| format | Dataset |
| fullrecord | <record><control><sourceid>datacite_PQ8</sourceid><recordid>TN_cdi_datacite_primary_10_6084_m9_figshare_24307209</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_6084_m9_figshare_24307209</sourcerecordid><originalsourceid>FETCH-LOGICAL-d919-e5c47bfdde8f93e30288e3efd0774b160c65e51f1f29fbb75fbe3c9400edcc9d3</originalsourceid><addsrcrecordid>eNo9kL1ugzAURlk6VGnfoMN9AajB_LkborSJFCkd0q7I2NdgCTDCDmoeoW9doiadvm84OsPxvKeQBCnJ4-eBBUq3tuMzBlFMSRYRdu_9lB13jXEWvmwA29PAR6i-J5ydfYFq4f2JOz228Kp5OxrrtIAPnJWZV1AgGAX_Aj3C54LaaQt8lOA6vKB2QuH0ghbMCMUOCmkmp9e_4oepcx3vB9Ob9vzg3SneW3y87sY7vlXHcuvvD--7stj7koXMx0TEWaOkxFwxipREeY4UlSRZFjdhSkSaYBKqUEVMNU2WqAapYDEhKIVgkm68-E8rueNCO6ynWQ98PtchqS-h6oHVt1D1LRT9Be13aBE</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>dataset</recordtype></control><display><type>dataset</type><title>Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology</title><source>DataCite</source><creator>Rojas-Carabali, William ; Sen, Alok ; Agarwal, Aniruddha ; Tan, Gavin ; Cheung, Carol Y. ; Rousselot, Andres ; Agrawal, Rajdeep ; Liu, Renee ; Cifuentes-González, Carlos ; Elze, Tobias ; Kempen, John H. ; Sobrin, Lucia ; Nguyen, Quan Dong ; de-la-Torre, Alejandra ; Lee, Bernett ; Gupta, Vishali ; Agrawal, Rupesh</creator><creatorcontrib>Rojas-Carabali, William ; Sen, Alok ; Agarwal, Aniruddha ; Tan, Gavin ; Cheung, Carol Y. ; Rousselot, Andres ; Agrawal, Rajdeep ; Liu, Renee ; Cifuentes-González, Carlos ; Elze, Tobias ; Kempen, John H. ; Sobrin, Lucia ; Nguyen, Quan Dong ; de-la-Torre, Alejandra ; Lee, Bernett ; Gupta, Vishali ; Agrawal, Rupesh</creatorcontrib><description>To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians’ perception about utilizing artificial intelligence (AI) in ophthalmology practice. Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice.</description><identifier>DOI: 10.6084/m9.figshare.24307209</identifier><language>eng</language><publisher>Taylor & Francis</publisher><subject>Biological Sciences not elsewhere classified ; Biotechnology ; FOS: Sociology ; Medicine ; Sociology ; Space Science</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>781,1895</link.rule.ids><linktorsrc>$$Uhttps://commons.datacite.org/doi.org/10.6084/m9.figshare.24307209$$EView_record_in_DataCite.org$$FView_record_in_$$GDataCite.org$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>Rojas-Carabali, William</creatorcontrib><creatorcontrib>Sen, Alok</creatorcontrib><creatorcontrib>Agarwal, Aniruddha</creatorcontrib><creatorcontrib>Tan, Gavin</creatorcontrib><creatorcontrib>Cheung, Carol Y.</creatorcontrib><creatorcontrib>Rousselot, Andres</creatorcontrib><creatorcontrib>Agrawal, Rajdeep</creatorcontrib><creatorcontrib>Liu, Renee</creatorcontrib><creatorcontrib>Cifuentes-González, Carlos</creatorcontrib><creatorcontrib>Elze, Tobias</creatorcontrib><creatorcontrib>Kempen, John H.</creatorcontrib><creatorcontrib>Sobrin, Lucia</creatorcontrib><creatorcontrib>Nguyen, Quan Dong</creatorcontrib><creatorcontrib>de-la-Torre, Alejandra</creatorcontrib><creatorcontrib>Lee, Bernett</creatorcontrib><creatorcontrib>Gupta, Vishali</creatorcontrib><creatorcontrib>Agrawal, Rupesh</creatorcontrib><title>Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology</title><description>To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians’ perception about utilizing artificial intelligence (AI) in ophthalmology practice. Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice.</description><subject>Biological Sciences not elsewhere classified</subject><subject>Biotechnology</subject><subject>FOS: Sociology</subject><subject>Medicine</subject><subject>Sociology</subject><subject>Space Science</subject><fulltext>true</fulltext><rsrctype>dataset</rsrctype><creationdate>2023</creationdate><recordtype>dataset</recordtype><sourceid>PQ8</sourceid><recordid>eNo9kL1ugzAURlk6VGnfoMN9AajB_LkborSJFCkd0q7I2NdgCTDCDmoeoW9doiadvm84OsPxvKeQBCnJ4-eBBUq3tuMzBlFMSRYRdu_9lB13jXEWvmwA29PAR6i-J5ydfYFq4f2JOz228Kp5OxrrtIAPnJWZV1AgGAX_Aj3C54LaaQt8lOA6vKB2QuH0ghbMCMUOCmkmp9e_4oepcx3vB9Ob9vzg3SneW3y87sY7vlXHcuvvD--7stj7koXMx0TEWaOkxFwxipREeY4UlSRZFjdhSkSaYBKqUEVMNU2WqAapYDEhKIVgkm68-E8rueNCO6ynWQ98PtchqS-h6oHVt1D1LRT9Be13aBE</recordid><startdate>20231013</startdate><enddate>20231013</enddate><creator>Rojas-Carabali, William</creator><creator>Sen, Alok</creator><creator>Agarwal, Aniruddha</creator><creator>Tan, Gavin</creator><creator>Cheung, Carol Y.</creator><creator>Rousselot, Andres</creator><creator>Agrawal, Rajdeep</creator><creator>Liu, Renee</creator><creator>Cifuentes-González, Carlos</creator><creator>Elze, Tobias</creator><creator>Kempen, John H.</creator><creator>Sobrin, Lucia</creator><creator>Nguyen, Quan Dong</creator><creator>de-la-Torre, Alejandra</creator><creator>Lee, Bernett</creator><creator>Gupta, Vishali</creator><creator>Agrawal, Rupesh</creator><general>Taylor & Francis</general><scope>DYCCY</scope><scope>PQ8</scope></search><sort><creationdate>20231013</creationdate><title>Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology</title><author>Rojas-Carabali, William ; Sen, Alok ; Agarwal, Aniruddha ; Tan, Gavin ; Cheung, Carol Y. ; Rousselot, Andres ; Agrawal, Rajdeep ; Liu, Renee ; Cifuentes-González, Carlos ; Elze, Tobias ; Kempen, John H. ; Sobrin, Lucia ; Nguyen, Quan Dong ; de-la-Torre, Alejandra ; Lee, Bernett ; Gupta, Vishali ; Agrawal, Rupesh</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-d919-e5c47bfdde8f93e30288e3efd0774b160c65e51f1f29fbb75fbe3c9400edcc9d3</frbrgroupid><rsrctype>datasets</rsrctype><prefilter>datasets</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Biological Sciences not elsewhere classified</topic><topic>Biotechnology</topic><topic>FOS: Sociology</topic><topic>Medicine</topic><topic>Sociology</topic><topic>Space Science</topic><toplevel>online_resources</toplevel><creatorcontrib>Rojas-Carabali, William</creatorcontrib><creatorcontrib>Sen, Alok</creatorcontrib><creatorcontrib>Agarwal, Aniruddha</creatorcontrib><creatorcontrib>Tan, Gavin</creatorcontrib><creatorcontrib>Cheung, Carol Y.</creatorcontrib><creatorcontrib>Rousselot, Andres</creatorcontrib><creatorcontrib>Agrawal, Rajdeep</creatorcontrib><creatorcontrib>Liu, Renee</creatorcontrib><creatorcontrib>Cifuentes-González, Carlos</creatorcontrib><creatorcontrib>Elze, Tobias</creatorcontrib><creatorcontrib>Kempen, John H.</creatorcontrib><creatorcontrib>Sobrin, Lucia</creatorcontrib><creatorcontrib>Nguyen, Quan Dong</creatorcontrib><creatorcontrib>de-la-Torre, Alejandra</creatorcontrib><creatorcontrib>Lee, Bernett</creatorcontrib><creatorcontrib>Gupta, Vishali</creatorcontrib><creatorcontrib>Agrawal, Rupesh</creatorcontrib><collection>DataCite (Open Access)</collection><collection>DataCite</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Rojas-Carabali, William</au><au>Sen, Alok</au><au>Agarwal, Aniruddha</au><au>Tan, Gavin</au><au>Cheung, Carol Y.</au><au>Rousselot, Andres</au><au>Agrawal, Rajdeep</au><au>Liu, Renee</au><au>Cifuentes-González, Carlos</au><au>Elze, Tobias</au><au>Kempen, John H.</au><au>Sobrin, Lucia</au><au>Nguyen, Quan Dong</au><au>de-la-Torre, Alejandra</au><au>Lee, Bernett</au><au>Gupta, Vishali</au><au>Agrawal, Rupesh</au><format>book</format><genre>unknown</genre><ristype>DATA</ristype><title>Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology</title><date>2023-10-13</date><risdate>2023</risdate><abstract>To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians’ perception about utilizing artificial intelligence (AI) in ophthalmology practice. Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice.</abstract><pub>Taylor & Francis</pub><doi>10.6084/m9.figshare.24307209</doi><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | DOI: 10.6084/m9.figshare.24307209 |
| ispartof | |
| issn | |
| language | eng |
| recordid | cdi_datacite_primary_10_6084_m9_figshare_24307209 |
| source | DataCite |
| subjects | Biological Sciences not elsewhere classified Biotechnology FOS: Sociology Medicine Sociology Space Science |
| title | Chatbots Vs. Human Experts: Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-13T13%3A03%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-datacite_PQ8&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=unknown&rft.au=Rojas-Carabali,%20William&rft.date=2023-10-13&rft_id=info:doi/10.6084/m9.figshare.24307209&rft_dat=%3Cdatacite_PQ8%3E10_6084_m9_figshare_24307209%3C/datacite_PQ8%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |