Assessing AI chatbots efficacy in ophthalmic triage and referrals: A comparative study

Abstract

To evaluate the efficacy of AI chatbots (OpenAI ChatGPT GPT-3.5, Google Bard, and WebMD) compared to human ophthalmology trainees in triage and referrals for common ophthalmic conditions. A single-center study was conducted at MKCG Medical College, Berhampur, Odisha, involving six ophthalmology trainees. The performance of AI chatbots was assessed based on diagnostic accuracy and triage categorization. Key performance indicators included the accuracy of the top three suggested diagnoses and concordance in recommendations for investigations and referrals. Physician respondents identified the correct diagnosis among the top three suggestions in 95% of cases. Google Bard achieved 90% accuracy, ChatGPT 85%, and WebMD 20%. High concordance was observed between physician and AI recommendations for investigations and referrals. AI chatbots demonstrate promising potential in supporting triage and referral decisions for ophthalmic conditions. While human expertise remains crucial, AI tools can augment diagnostic accuracy, improve efficiency, and enhance patient care. Future research should focus on refining AI algorithms, integrating clinical data, and exploring real-world implementation strategies.

Ähnliche Arbeiten