Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
IELTS Writing Tasks Evaluation Using LLMs: A Comparative Study of ChatGPT, Claude, Copilot, and Google Gemini
0
Zitationen
5
Autoren
2024
Jahr
Abstract
IELTS writing tasks are considered one of the most challenging tests among the other three IELTS sections: speaking, reading, and listening. The IELTS Writing section requires significant improvement effort, and obtaining expert feedback can be costly. In recent years, large language models (LLMs), a type of artificial intelligence, have revolutionized and are used in various tasks such as text summarization, question answering, and many others. This paper explores the effectiveness of wellknown LLMs in estimating IELTS Writing band scores, offering a comparative analysis of several models, including ChatGPT, Claude, Copilot, and Google Gemini. The data used for this task were collected from IELTS practice test books, and the results were evaluated using the R-square and the average degree of bias. The findings indicate that ChatGPT-4 and ChatGPT-40 showed the closest results to the actual labels and outperformed the other models.
Ähnliche Arbeiten
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI
2019 · 8.231 Zit.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
2019 · 8.084 Zit.
High-performance medicine: the convergence of human and artificial intelligence
2018 · 7.444 Zit.
Proceedings of the 19th International Joint Conference on Artificial Intelligence
2005 · 5.776 Zit.
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
2018 · 5.423 Zit.