Evaluating the quality and empathy of responses to patient questions on the Korean Academy of Periodontology’s online question and answer section: a cross-sectional study comparing periodontists and an AI-powered chatbot

Abstract

PURPOSE: This study aimed to evaluate and compare the responses of an artificial intelligence (AI)-powered chatbot and professional periodontists to patient queries in periodontology and implantology, using the Korean Academy of Periodontology's (KAP) online question and answer (Q&A) section. METHODS: -test and Spearman correlation coefficients to compare response quality, empathy, consistency, and evaluator preferences. RESULTS: <0.001). Overall response consistency was deemed satisfactory at 64.2%, with no significant difference in consistency or preference between periodontist and lay evaluators. CONCLUSIONS: AI-powered chatbots can deliver more accurate and empathetic answers than human periodontists, suggesting their potential role as consultation assistants merits further investigation. The high intraclass correlation coefficient values (0.79-0.93) indicate a high level of agreement among evaluators in both the periodontist and lay evaluator groups, thus confirming the reliability and robustness of the study's assessment methodology.

Ähnliche Arbeiten