Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Who's Helping Who? When Students Use ChatGPT to Engage in Practice Lab Sessions
 
conference paper

Who's Helping Who? When Students Use ChatGPT to Engage in Practice Lab Sessions

Brender, Jérôme  
•
El-Hamamsy, Laila  
•
Mondada, Francesco  
Show more
Olney, Andrew M.
July 11, 2024
Artificial Intelligence in Education
25th International Conference on Artificial Intelligence in Education, AIED 2024

Little is understood about how chatbots powered by Large Language Models (LLMs) impact teaching and learning, and how to effectively integrate them into educational practices. This study examined whether and how using ChatGPT in a graduate-level robotics course impacts performance and learning with data from 64 students (40 Chat-GPT users and 24 non-users). Regression analyses revealed complex interactions between ChatGPT use, task performance, and learning of course-related concepts: using ChatGPT significantly improved task performance, but not necessarily learning outcomes. Task performance positively correlated with learning only for students with low and medium prior knowledge who did not use ChatGPT, suggesting that performance translated to learning only for non-ChatGPT users overall. Clustering ChatGPT-users' prompts helped identify three types of usage that differed in terms of learning and performance. Although all ChatGPT users had improved performance, Debuggers (who requested solutions and error fixes) outperformed the other clusters. In terms of learning, Conceptual Explorers (who sought to understand concepts, tasks or codes) had higher learning outcomes than Debuggers and Practical Developer (who exclusively asked for task solutions). The behaviors elicited by students in the Practical Developer and Debuggers clusters therefore were less likely to translate performance into conceptual understanding, while the Conceptual Explorers' behaviors were more conducive to learning. This empirical study helps improve our understanding of the complex dynamics between how ChatGPT is used, performance, and learning outcomes.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

WhosHelpingWhoWhenStudentsUseChatGPTtoEngage_in_PracticeLabSessions.pdf

Type

Main Document

Version

Published version

Access type

restricted

License Condition

N/A

Size

665.81 KB

Format

Adobe PDF

Checksum (MD5)

7d4637ed9c702609548bd975c478c6c8

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés