Blinded, randomized trial of sonographer versus AI cardiac function assessment
Artificial intelligence (AI) has been developed for echocardiography 1 – 3 , although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer in...
Gespeichert in:
Veröffentlicht in: | Nature (London) 2023-04, Vol.616 (7957), p.520-524 |
---|---|
Hauptverfasser: | , , , , , , , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 524 |
---|---|
container_issue | 7957 |
container_start_page | 520 |
container_title | Nature (London) |
container_volume | 616 |
creator | He, Bryan Kwan, Alan C. Cho, Jae Hyung Yuan, Neal Pollick, Charles Shiota, Takahiro Ebinger, Joseph Bello, Natalie A. Wei, Janet Josan, Kiranbir Duffy, Grant Jujjavarapu, Melvin Siegel, Robert Cheng, Susan Zou, James Y. Ouyang, David |
description | Artificial intelligence (AI) has been developed for echocardiography
1
–
3
, although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of −10.4%, 95% confidence interval: −13.2% to −7.7%,
P
|
doi_str_mv | 10.1038/s41586-023-05947-3 |
format | Article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10115627</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2797144526</sourcerecordid><originalsourceid>FETCH-LOGICAL-c475t-9bc2c469c3925acc297ad98ac856bcf841390ab29eb05f96940f63b38b0a463f3</originalsourceid><addsrcrecordid>eNp9kbtuFTEURS0EIjeBH6BAlmgoMnD8tisUIh6RotBAbXk8nhtHM_bFnokEX4_hhpBQpHKx19nHRwuhFwTeEGD6beVEaNkBZR0Iw1XHHqEN4Up2XGr1GG0AqO5AM3mADmu9AgBBFH-KDpgC2kK1QRfvp5iGMBzj4tKQ5_gzDHgp0U04j7jmlLfF7S5Dwdeh1LXikzPsXRmi83hck19iTtjVGmqdQ1qeoSejm2p4fvMeoW8fP3w9_dydf_l0dnpy3nmuxNKZ3lPPpfHMUOG8p0a5wWjntZC9HzUnzIDrqQk9iNFIw2GUrGe6B8clG9kRerfv3a39HAbfVhc32V2Jsys_bHbR3k9SvLTbfG0JECIkVa3h9U1Dyd_XUBc7x-rDNLkU8lotVUYRzgWVDX31H3qV15LafZZqEMIQoKZRdE_5kmstYbz9DQH725fd-7LNl_3jy7I29PLuHbcjfwU1gO2B2qK0DeXf7gdqfwHIiaFB</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2805591029</pqid></control><display><type>article</type><title>Blinded, randomized trial of sonographer versus AI cardiac function assessment</title><source>MEDLINE</source><source>Nature Journals Online</source><source>SpringerLink Journals - AutoHoldings</source><creator>He, Bryan ; Kwan, Alan C. ; Cho, Jae Hyung ; Yuan, Neal ; Pollick, Charles ; Shiota, Takahiro ; Ebinger, Joseph ; Bello, Natalie A. ; Wei, Janet ; Josan, Kiranbir ; Duffy, Grant ; Jujjavarapu, Melvin ; Siegel, Robert ; Cheng, Susan ; Zou, James Y. ; Ouyang, David</creator><creatorcontrib>He, Bryan ; Kwan, Alan C. ; Cho, Jae Hyung ; Yuan, Neal ; Pollick, Charles ; Shiota, Takahiro ; Ebinger, Joseph ; Bello, Natalie A. ; Wei, Janet ; Josan, Kiranbir ; Duffy, Grant ; Jujjavarapu, Melvin ; Siegel, Robert ; Cheng, Susan ; Zou, James Y. ; Ouyang, David</creatorcontrib><description>Artificial intelligence (AI) has been developed for echocardiography
1
–
3
, although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of −10.4%, 95% confidence interval: −13.2% to −7.7%,
P
< 0.001 for non-inferiority,
P
< 0.001 for superiority). The mean absolute difference between final cardiologist assessment and independent previous cardiologist assessment was 6.29% in the AI group and 7.23% in the sonographer group (difference of −0.96%, 95% confidence interval: −1.34% to −0.54%,
P
< 0.001 for superiority). The AI-guided workflow saved time for both sonographers and cardiologists, and cardiologists were not able to distinguish between the initial assessments by AI versus the sonographer (blinding index of 0.088). For patients undergoing echocardiographic quantification of cardiac function, initial assessment of LVEF by AI was non-inferior to assessment by sonographers.
The impact of artificial intelligence in cardiac function assessment is evaluated by a blinded, randomized non-inferiority trial of artificial intelligence versus sonographer initial assessment of the left ventricular ejection fraction.</description><identifier>ISSN: 0028-0836</identifier><identifier>ISSN: 1476-4687</identifier><identifier>EISSN: 1476-4687</identifier><identifier>DOI: 10.1038/s41586-023-05947-3</identifier><identifier>PMID: 37020027</identifier><language>eng</language><publisher>London: Nature Publishing Group UK</publisher><subject>692/308/2779/777 ; 692/700/1421/1860/1445 ; Algorithms ; Artificial intelligence ; Artificial Intelligence - standards ; Cardiac function ; Cardiologists ; Cardiology ; Clinical medicine ; Clinical trials ; Confidence intervals ; Echocardiography - methods ; Echocardiography - standards ; Evaluation ; Heart ; Heart Function Tests - methods ; Heart Function Tests - standards ; Humanities and Social Sciences ; Humans ; Image quality ; multidisciplinary ; Randomization ; Reproducibility of Results ; Science ; Science (multidisciplinary) ; Single-Blind Method ; Stroke Volume ; Ultrasonic imaging ; Ventricle ; Ventricular Function, Left ; Workflow</subject><ispartof>Nature (London), 2023-04, Vol.616 (7957), p.520-524</ispartof><rights>The Author(s) 2023</rights><rights>2023. The Author(s).</rights><rights>Copyright Nature Publishing Group Apr 20, 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c475t-9bc2c469c3925acc297ad98ac856bcf841390ab29eb05f96940f63b38b0a463f3</citedby><cites>FETCH-LOGICAL-c475t-9bc2c469c3925acc297ad98ac856bcf841390ab29eb05f96940f63b38b0a463f3</cites><orcidid>0000-0002-4393-1011 ; 0000-0001-8880-4764 ; 0000-0001-5782-7437 ; 0000-0002-3813-7518 ; 0000-0002-6150-761X ; 0000-0002-4977-036X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1038/s41586-023-05947-3$$EPDF$$P50$$Gspringer$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1038/s41586-023-05947-3$$EHTML$$P50$$Gspringer$$Hfree_for_read</linktohtml><link.rule.ids>230,314,780,784,885,27924,27925,41488,42557,51319</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37020027$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>He, Bryan</creatorcontrib><creatorcontrib>Kwan, Alan C.</creatorcontrib><creatorcontrib>Cho, Jae Hyung</creatorcontrib><creatorcontrib>Yuan, Neal</creatorcontrib><creatorcontrib>Pollick, Charles</creatorcontrib><creatorcontrib>Shiota, Takahiro</creatorcontrib><creatorcontrib>Ebinger, Joseph</creatorcontrib><creatorcontrib>Bello, Natalie A.</creatorcontrib><creatorcontrib>Wei, Janet</creatorcontrib><creatorcontrib>Josan, Kiranbir</creatorcontrib><creatorcontrib>Duffy, Grant</creatorcontrib><creatorcontrib>Jujjavarapu, Melvin</creatorcontrib><creatorcontrib>Siegel, Robert</creatorcontrib><creatorcontrib>Cheng, Susan</creatorcontrib><creatorcontrib>Zou, James Y.</creatorcontrib><creatorcontrib>Ouyang, David</creatorcontrib><title>Blinded, randomized trial of sonographer versus AI cardiac function assessment</title><title>Nature (London)</title><addtitle>Nature</addtitle><addtitle>Nature</addtitle><description>Artificial intelligence (AI) has been developed for echocardiography
1
–
3
, although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of −10.4%, 95% confidence interval: −13.2% to −7.7%,
P
< 0.001 for non-inferiority,
P
< 0.001 for superiority). The mean absolute difference between final cardiologist assessment and independent previous cardiologist assessment was 6.29% in the AI group and 7.23% in the sonographer group (difference of −0.96%, 95% confidence interval: −1.34% to −0.54%,
P
< 0.001 for superiority). The AI-guided workflow saved time for both sonographers and cardiologists, and cardiologists were not able to distinguish between the initial assessments by AI versus the sonographer (blinding index of 0.088). For patients undergoing echocardiographic quantification of cardiac function, initial assessment of LVEF by AI was non-inferior to assessment by sonographers.
The impact of artificial intelligence in cardiac function assessment is evaluated by a blinded, randomized non-inferiority trial of artificial intelligence versus sonographer initial assessment of the left ventricular ejection fraction.</description><subject>692/308/2779/777</subject><subject>692/700/1421/1860/1445</subject><subject>Algorithms</subject><subject>Artificial intelligence</subject><subject>Artificial Intelligence - standards</subject><subject>Cardiac function</subject><subject>Cardiologists</subject><subject>Cardiology</subject><subject>Clinical medicine</subject><subject>Clinical trials</subject><subject>Confidence intervals</subject><subject>Echocardiography - methods</subject><subject>Echocardiography - standards</subject><subject>Evaluation</subject><subject>Heart</subject><subject>Heart Function Tests - methods</subject><subject>Heart Function Tests - standards</subject><subject>Humanities and Social Sciences</subject><subject>Humans</subject><subject>Image quality</subject><subject>multidisciplinary</subject><subject>Randomization</subject><subject>Reproducibility of Results</subject><subject>Science</subject><subject>Science (multidisciplinary)</subject><subject>Single-Blind Method</subject><subject>Stroke Volume</subject><subject>Ultrasonic imaging</subject><subject>Ventricle</subject><subject>Ventricular Function, Left</subject><subject>Workflow</subject><issn>0028-0836</issn><issn>1476-4687</issn><issn>1476-4687</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>C6C</sourceid><sourceid>EIF</sourceid><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp9kbtuFTEURS0EIjeBH6BAlmgoMnD8tisUIh6RotBAbXk8nhtHM_bFnokEX4_hhpBQpHKx19nHRwuhFwTeEGD6beVEaNkBZR0Iw1XHHqEN4Up2XGr1GG0AqO5AM3mADmu9AgBBFH-KDpgC2kK1QRfvp5iGMBzj4tKQ5_gzDHgp0U04j7jmlLfF7S5Dwdeh1LXikzPsXRmi83hck19iTtjVGmqdQ1qeoSejm2p4fvMeoW8fP3w9_dydf_l0dnpy3nmuxNKZ3lPPpfHMUOG8p0a5wWjntZC9HzUnzIDrqQk9iNFIw2GUrGe6B8clG9kRerfv3a39HAbfVhc32V2Jsys_bHbR3k9SvLTbfG0JECIkVa3h9U1Dyd_XUBc7x-rDNLkU8lotVUYRzgWVDX31H3qV15LafZZqEMIQoKZRdE_5kmstYbz9DQH725fd-7LNl_3jy7I29PLuHbcjfwU1gO2B2qK0DeXf7gdqfwHIiaFB</recordid><startdate>20230420</startdate><enddate>20230420</enddate><creator>He, Bryan</creator><creator>Kwan, Alan C.</creator><creator>Cho, Jae Hyung</creator><creator>Yuan, Neal</creator><creator>Pollick, Charles</creator><creator>Shiota, Takahiro</creator><creator>Ebinger, Joseph</creator><creator>Bello, Natalie A.</creator><creator>Wei, Janet</creator><creator>Josan, Kiranbir</creator><creator>Duffy, Grant</creator><creator>Jujjavarapu, Melvin</creator><creator>Siegel, Robert</creator><creator>Cheng, Susan</creator><creator>Zou, James Y.</creator><creator>Ouyang, David</creator><general>Nature Publishing Group UK</general><general>Nature Publishing Group</general><scope>C6C</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QP</scope><scope>7QR</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7ST</scope><scope>7T5</scope><scope>7TG</scope><scope>7TK</scope><scope>7TM</scope><scope>7TO</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88A</scope><scope>88E</scope><scope>88G</scope><scope>88I</scope><scope>8AF</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>BKSAR</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>M2O</scope><scope>M2P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PCBAR</scope><scope>PDBOC</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PSYQQ</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>Q9U</scope><scope>R05</scope><scope>RC3</scope><scope>S0X</scope><scope>SOI</scope><scope>7X8</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0002-4393-1011</orcidid><orcidid>https://orcid.org/0000-0001-8880-4764</orcidid><orcidid>https://orcid.org/0000-0001-5782-7437</orcidid><orcidid>https://orcid.org/0000-0002-3813-7518</orcidid><orcidid>https://orcid.org/0000-0002-6150-761X</orcidid><orcidid>https://orcid.org/0000-0002-4977-036X</orcidid></search><sort><creationdate>20230420</creationdate><title>Blinded, randomized trial of sonographer versus AI cardiac function assessment</title><author>He, Bryan ; Kwan, Alan C. ; Cho, Jae Hyung ; Yuan, Neal ; Pollick, Charles ; Shiota, Takahiro ; Ebinger, Joseph ; Bello, Natalie A. ; Wei, Janet ; Josan, Kiranbir ; Duffy, Grant ; Jujjavarapu, Melvin ; Siegel, Robert ; Cheng, Susan ; Zou, James Y. ; Ouyang, David</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c475t-9bc2c469c3925acc297ad98ac856bcf841390ab29eb05f96940f63b38b0a463f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>692/308/2779/777</topic><topic>692/700/1421/1860/1445</topic><topic>Algorithms</topic><topic>Artificial intelligence</topic><topic>Artificial Intelligence - standards</topic><topic>Cardiac function</topic><topic>Cardiologists</topic><topic>Cardiology</topic><topic>Clinical medicine</topic><topic>Clinical trials</topic><topic>Confidence intervals</topic><topic>Echocardiography - methods</topic><topic>Echocardiography - standards</topic><topic>Evaluation</topic><topic>Heart</topic><topic>Heart Function Tests - methods</topic><topic>Heart Function Tests - standards</topic><topic>Humanities and Social Sciences</topic><topic>Humans</topic><topic>Image quality</topic><topic>multidisciplinary</topic><topic>Randomization</topic><topic>Reproducibility of Results</topic><topic>Science</topic><topic>Science (multidisciplinary)</topic><topic>Single-Blind Method</topic><topic>Stroke Volume</topic><topic>Ultrasonic imaging</topic><topic>Ventricle</topic><topic>Ventricular Function, Left</topic><topic>Workflow</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>He, Bryan</creatorcontrib><creatorcontrib>Kwan, Alan C.</creatorcontrib><creatorcontrib>Cho, Jae Hyung</creatorcontrib><creatorcontrib>Yuan, Neal</creatorcontrib><creatorcontrib>Pollick, Charles</creatorcontrib><creatorcontrib>Shiota, Takahiro</creatorcontrib><creatorcontrib>Ebinger, Joseph</creatorcontrib><creatorcontrib>Bello, Natalie A.</creatorcontrib><creatorcontrib>Wei, Janet</creatorcontrib><creatorcontrib>Josan, Kiranbir</creatorcontrib><creatorcontrib>Duffy, Grant</creatorcontrib><creatorcontrib>Jujjavarapu, Melvin</creatorcontrib><creatorcontrib>Siegel, Robert</creatorcontrib><creatorcontrib>Cheng, Susan</creatorcontrib><creatorcontrib>Zou, James Y.</creatorcontrib><creatorcontrib>Ouyang, David</creatorcontrib><collection>Springer Nature OA Free Journals</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Calcium & Calcified Tissue Abstracts</collection><collection>Chemoreception Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Environment Abstracts</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Oncogenes and Growth Factors Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Biology Database (Alumni Edition)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Science Database (Alumni Edition)</collection><collection>STEM Database</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>eLibrary</collection><collection>ProQuest Central</collection><collection>Technology Collection (ProQuest)</collection><collection>Natural Science Collection (ProQuest)</collection><collection>Earth, Atmospheric & Aquatic Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Psychology Database</collection><collection>Research Library</collection><collection>Science Database (ProQuest)</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Research Library (Corporate)</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Earth, Atmospheric & Aquatic Science Database</collection><collection>Materials Science Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest One Psychology</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>ProQuest Central Basic</collection><collection>University of Michigan</collection><collection>Genetics Abstracts</collection><collection>SIRS Editorial</collection><collection>Environment Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Nature (London)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>He, Bryan</au><au>Kwan, Alan C.</au><au>Cho, Jae Hyung</au><au>Yuan, Neal</au><au>Pollick, Charles</au><au>Shiota, Takahiro</au><au>Ebinger, Joseph</au><au>Bello, Natalie A.</au><au>Wei, Janet</au><au>Josan, Kiranbir</au><au>Duffy, Grant</au><au>Jujjavarapu, Melvin</au><au>Siegel, Robert</au><au>Cheng, Susan</au><au>Zou, James Y.</au><au>Ouyang, David</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Blinded, randomized trial of sonographer versus AI cardiac function assessment</atitle><jtitle>Nature (London)</jtitle><stitle>Nature</stitle><addtitle>Nature</addtitle><date>2023-04-20</date><risdate>2023</risdate><volume>616</volume><issue>7957</issue><spage>520</spage><epage>524</epage><pages>520-524</pages><issn>0028-0836</issn><issn>1476-4687</issn><eissn>1476-4687</eissn><abstract>Artificial intelligence (AI) has been developed for echocardiography
1
–
3
, although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of −10.4%, 95% confidence interval: −13.2% to −7.7%,
P
< 0.001 for non-inferiority,
P
< 0.001 for superiority). The mean absolute difference between final cardiologist assessment and independent previous cardiologist assessment was 6.29% in the AI group and 7.23% in the sonographer group (difference of −0.96%, 95% confidence interval: −1.34% to −0.54%,
P
< 0.001 for superiority). The AI-guided workflow saved time for both sonographers and cardiologists, and cardiologists were not able to distinguish between the initial assessments by AI versus the sonographer (blinding index of 0.088). For patients undergoing echocardiographic quantification of cardiac function, initial assessment of LVEF by AI was non-inferior to assessment by sonographers.
The impact of artificial intelligence in cardiac function assessment is evaluated by a blinded, randomized non-inferiority trial of artificial intelligence versus sonographer initial assessment of the left ventricular ejection fraction.</abstract><cop>London</cop><pub>Nature Publishing Group UK</pub><pmid>37020027</pmid><doi>10.1038/s41586-023-05947-3</doi><tpages>5</tpages><orcidid>https://orcid.org/0000-0002-4393-1011</orcidid><orcidid>https://orcid.org/0000-0001-8880-4764</orcidid><orcidid>https://orcid.org/0000-0001-5782-7437</orcidid><orcidid>https://orcid.org/0000-0002-3813-7518</orcidid><orcidid>https://orcid.org/0000-0002-6150-761X</orcidid><orcidid>https://orcid.org/0000-0002-4977-036X</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0028-0836 |
ispartof | Nature (London), 2023-04, Vol.616 (7957), p.520-524 |
issn | 0028-0836 1476-4687 1476-4687 |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10115627 |
source | MEDLINE; Nature Journals Online; SpringerLink Journals - AutoHoldings |
subjects | 692/308/2779/777 692/700/1421/1860/1445 Algorithms Artificial intelligence Artificial Intelligence - standards Cardiac function Cardiologists Cardiology Clinical medicine Clinical trials Confidence intervals Echocardiography - methods Echocardiography - standards Evaluation Heart Heart Function Tests - methods Heart Function Tests - standards Humanities and Social Sciences Humans Image quality multidisciplinary Randomization Reproducibility of Results Science Science (multidisciplinary) Single-Blind Method Stroke Volume Ultrasonic imaging Ventricle Ventricular Function, Left Workflow |
title | Blinded, randomized trial of sonographer versus AI cardiac function assessment |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T13%3A29%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Blinded,%20randomized%20trial%20of%20sonographer%20versus%20AI%20cardiac%20function%20assessment&rft.jtitle=Nature%20(London)&rft.au=He,%20Bryan&rft.date=2023-04-20&rft.volume=616&rft.issue=7957&rft.spage=520&rft.epage=524&rft.pages=520-524&rft.issn=0028-0836&rft.eissn=1476-4687&rft_id=info:doi/10.1038/s41586-023-05947-3&rft_dat=%3Cproquest_pubme%3E2797144526%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2805591029&rft_id=info:pmid/37020027&rfr_iscdi=true |