Dies ist eine Übersichtsseite mit Metadaten zu dieser wissenschaftlichen Arbeit. Der vollständige Artikel ist beim Verlag verfügbar.
Can ChatGPT pass a Theory of Computing Course?
7
Zitationen
3
Autoren
2024
Jahr
Abstract
Large Language Models (LLMs) have had considerable difficulty when prompted with mathematical and formal questions, especially those within theory of computing (ToC) courses. In this paper, we detail two experiments regarding our own ToC course and the ChatGPT LLM. For the first, we evaluated ChatGPT's ability to pass our own ToC course's exams. For the second, we created a database of sample ToC questions and responses to accommodate other ToC offerings' choices for topics and structure. We scored each of ChatGPT's outputs on these questions. Overall, we determined that ChatGPT can pass our ToC course, and is adequate at understanding common formal definitions and answering "simple''-style questions, e.g., true/false and multiple choice. However, ChatGPT often makes nonsensical claims in open-ended responses, such as proofs.
Ähnliche Arbeiten
Determining Sample Size for Research Activities
1970 · 17.666 Zit.
Scale Development : Theory and Applications
1991 · 14.736 Zit.
Online Learning: A Panacea in the Time of COVID-19 Crisis
2020 · 4.918 Zit.
Systematic review of research on artificial intelligence applications in higher education – where are the educators?
2019 · 4.442 Zit.
Blended learning: Uncovering its transformative potential in higher education
2004 · 4.406 Zit.