Investigating the Effects of ChatGPT on Student Learning in Programming Courses

Abstract

One of the latest developments impacting computer science education is the availability of high-quality generative AI (Artificial Intelligence) tools like ChatGPT.These tools provide a range of functionalities, such as code creation, debugging assistance, and optimization.From the students' perspective, these systems can be virtual tutoring aids that complement the learning process.From the educators' perspective, the availability of AI tools necessitates adjustments to the course material and raises ethical concerns, primarily related to the potential for code plagiarism.Rather than disregarding or imposing prohibitive restrictions on these tools, our research group encouraged students to leverage AI tools to further their understanding of coursework.Instructors emphasized the importance of submitting original work and academic integrity to address ethical plagiarism concerns.To gauge the impact of AI tools on students' learning experiences, our group conducted a study to assess student perceptions and usage of ChatGPT utilizing a custom questionnaire among a sample size of 172 participants.Two research hypotheses and four research questions were targeted in this study.The results showed that about 35% of the students had used ChatGPT before the beginning of the fall 2023 semester.It is found that the effects of using ChatGPT on learning outcomes and the overall positive approach of students towards ChatGPT were significantly different in junior-level and freshman-level classes, with more positive outcomes in the junior class.A definite consensus however was not reached on questions concerning learning outcomes, material retention, and the impact on future job opportunities, as the responses did not favor any side of the Likert scale spectrum.On other aspects, there were significant agreements among all participant: ChatGPT cannot replace the need for in-person instruction and tutoring; Code generated by ChatGPT is not always accurate; Graded assignments should not be removed from the course assessment; and Students still need to learn programming despite AI platform capability to generate code.

Ähnliche Arbeiten