Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
Assessing the Effectiveness of ChatGPT as a Clinical Trainee: A Study on the Diagnostic Value of Large Language Models in a Complex Clinical Environment
0
Zitationen
2
Autoren
2023
Jahr
Abstract
Abstract We tested the performance of Chat Generative Pre-trained Transformer (ChatGPT) in the role of a trainee clinician (Specialist Registrar or Resident) undergoing direct assessment by a human supervising specialist clinician (Consultant or Attending). The session consisted of a hospital ward round scenario presented to three versions of ChatGPT, namely OpenAI ChatGPT-3.5, Bing ChatGPT-4 and OpenAI ChatGPT-4. A specific test of memory and context was included via an end-of-teaching educator feedback exercise. Only OpenAI ChatGPT-4 provided responses comparable to the standard a trainee might offer during progress towards completion of training and specialist accreditation. Bing ChatGPT-4 responded with several clinically dubious statements, often in a repetitive and detached way, and was unable to retain awareness of the purpose of the session and the identities of participants.
Ähnliche Arbeiten
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
2019 · 8.200 Zit.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
2019 · 8.051 Zit.
High-performance medicine: the convergence of human and artificial intelligence
2018 · 7.416 Zit.
Proceedings of the 19th International Joint Conference on Artificial Intelligence
2005 · 5.776 Zit.
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2018 · 5.410 Zit.