Generative Artificial Intelligence (GenAI) 24x7 Tutor: A simulation of the capability of ChatGPT, Wolfram GPT and Tutor Me GPT to accurately and effectively tutor engineering and math content

Abstract

This study investigates the potential of GenAI tools, specifically ChatGPT-4/4o, Wolfram GPT, and Tutor Me GPT, to function as accessible, on-demand 24/7 tutoring systems for engineering and mathematics education. With increasing interest in personalized learning, GenAI offers the promise of scalable and individualized academic support. However, concerns about hallucinations, erroneous or fabricated outputs common in GenAI, have hindered recommendations for unsupervised educational use. The application of GenAI in specialized tutoring contexts has not been rigorously evaluated for accuracy or pedagogical risk in engineering and mathematics. To address this gap, this research assesses the accuracy and instructional capability of GenAI through a human-led simulation involving three trained research assistants. This approach enables the systematic evaluation of how hallucinations may impact learning outcomes. The GenAI tools were tested across seven engineering and two mathematics subjects, encompassing 35 distinct topics. Results indicate that ChatGPT-4 and Wolfram GPT demonstrated strong performance in tutoring electrical engineering and mathematics, but exhibited limitations in mechanical engineering content. Minor inaccuracies were frequently observed, raising concerns about student reliance without oversight. Nevertheless, notable strengths include GenAI‟s adaptability to varying student proficiency levels and its structured, step-by-step problem-solving methodology. While GenAI shows promise as a supplementary learning tool, further research is required to improve accuracy and evaluate its long-term pedagogical impact in real-world educational settings. Based on current capabilities, GenAI is best regarded as a supportive aid rather than a replacement for human instruction. This study provides foundational insights for the future integration of GenAI into education, with potential to transform tutoring practices.

Ähnliche Arbeiten