Evaluating Chatbot Efficacy for Answering Frequently Asked Questions in Plastic Surgery: A ChatGPT Case Study Focused on Breast Augmentation

Abstract Background The integration of artificial intelligence (AI) and machine learning (ML) technologies into healthcare is transforming patient-practitioner interaction and could offer an additional platform for patient education and support. Objectives This study investigated whether ChatGPT-4 could provide safe and up-to-date medical information about breast augmentation that is comparable to other patient information sources. Methods ChatGPT-4 was asked to generate 6 commonly asked questions regarding breast augmentation and respond to them. Its responses were qualitatively evaluated by a panel of specialist plastic and reconstructive surgeons and reconciled with a literature search of 2 large medical databases for accuracy, informativeness, and accessibility. Results ChatGPT-4 provided well-structured, grammatically accurate, and comprehensive responses to the questions posed; however, it was limited in providing personalized advice and sometimes generated inappropriate or outdated references. ChatGPT consistently encouraged engagement with a specialist for specific information. Conclusions Although ChatGPT-4 showed promise as an adjunct tool in patient education regarding breast augmentation, there are areas requiring improvement. Additional advancements and software engineering are needed to enhance the reliability and applicability of AI-driven chatbots in patient education and support systems.