Comparative evaluation of ChatGPT, Gemini, and Grok in clinical decision-making and general knowledge assessment for impacted maxillary canines

Abstract

Objective: This study aimed to compare extraction versus orthodontic eruption decisions for impacted maxillary canines made by three artificial intelligence-based chatbots (ChatGPT, Gemini, and Grok) with those made by orthodontist raters, and to evaluate the overall accuracy of these artificial intelligence-generated recommendations. Methods: Thirty-three patients with impacted maxillary canines were selected, and standardized case scenarios incorporating key diagnostic parameters were presented to the three chatbots. Their treatment decisions were recorded and compared with orthodontists' consensus decisions. Additionally, 10 general queries regarding impacted maxillary canines were submitted to the chatbots. The responses were rated by three orthodontists using a modified 5-point Global Quality Score. Results: = 0.006). Conclusions: While Gemini showed lower clinical alignment with orthodontists for treatment decisions regarding impacted canines, ChatGPT and Grok demonstrated moderate agreement with orthodontists and produced relatively accurate responses. These findings highlight the potential of chatbots as supportive tools for orthodontic decision-making. However, their use requires careful supervision to avoid the risks associated with inaccurate or misleading recommendations.

Ähnliche Arbeiten