Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
Generative AI and CEFR levels: Evaluating the accuracy of text generation with ChatGPT-4
4
Zitationen
1
Autoren
2025
Jahr
Abstract
Since its emergence, generative AI has significantly impacted various fields, including English language education. For example, numerous academic studies have investigated the accuracy of grammar correction, the evaluation of writing, and the dynamics of user interaction. However, there has been insufficient investigation into whether texts generated by such AI appropriately align with CEFR levels. This study addresses this gap by exploring the applicability of generative AI to CEFR levels. Multiple texts were generated using ChatGPT-4 with specified CEFR levels and analyzed using a vocabulary level analyzer (CVLA). The findings revealed discrepancies between AI-generated texts and textbook standards, significant divergences between levels below B1 and above B2, and a noticeable topic bias. Although the texts generated by the AI appear to differ by level on the surface, caution is warranted when applying them to CEFR levels.
Ähnliche Arbeiten
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
2019 · 8.250 Zit.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
2019 · 8.109 Zit.
High-performance medicine: the convergence of human and artificial intelligence
2018 · 7.482 Zit.
Proceedings of the 19th International Joint Conference on Artificial Intelligence
2005 · 5.776 Zit.
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2018 · 5.434 Zit.