ClickSight: Interpreting Student Clickstreams to Reveal Insights on Learning Strategies via LLMs
Clickstream data from digital learning environments provide valuable insights into student behavior but are challenging to interpret due to their granularity. Prior methods mainly relied on handcrafted features, expert labeling, clustering, or supervised models, limiting generalizability and scalability. We present ClickSight, an in-context Large Language Model (LLM)-based pipeline that interprets student clickstreams given a list of learning strategies to generate textual interpretations of students’ behaviors during interaction. We evaluate four prompting strategies and assess the effect of self-refinement across two open-ended environments using domain-expert rubric-based evaluations. Results show that while LLMs can reasonably interpret learning strategies from clickstreams, interpretation quality varies by prompting strategy, and self-refinement offers limited improvement. ClickSight demonstrates the potential of LLMs to generate theory-driven insights from educational interaction data.
2-s2.0-105013027655
École Polytechnique Fédérale de Lausanne
École Polytechnique Fédérale de Lausanne
École Polytechnique Fédérale de Lausanne
Max Planck Institute for Software Systems
École Polytechnique Fédérale de Lausanne
2025-07-21
978-3-031-99267-4
Communications in Computer and Information Science; 2592
1865-0937
1865-0929
94
102
REVIEWED
EPFL
| Event name | Event acronym | Event place | Event date |
AIED 2025 | Palermo, Italy | 2025-07-22 - 2025-07-26 | |