Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
Beyond the Pass Mark: the Accuracy of ChatGPT and Bing in the National Medical Licensure Examination in Japan
4
Zitationen
1
Autoren
2023
Jahr
Abstract
We evaluated the accuracy of ChatGPT, which was released in late 2022, and Bing, which was released in Feb 2023, in solving clinical questions. As a measurement tool, we used the questions National Medical Licensure Examination in Japan. Bing has an accuracy level to pass the national medical licensing exam in Japan. However, Bing has an error proportion of about 20%, and users could not determine the correctness of the answer based solely on the wording of the answers. Bing cannot be used for clinical decision-making in the current form.
Ähnliche Arbeiten
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
2019 · 8.380 Zit.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
2019 · 8.243 Zit.
High-performance medicine: the convergence of human and artificial intelligence
2018 · 7.671 Zit.
Proceedings of the 19th International Joint Conference on Artificial Intelligence
2005 · 5.776 Zit.
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2018 · 5.496 Zit.