Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. A systematic review of empirical studies using log data from open-ended learning environments to measure science and engineering practices
 
review article

A systematic review of empirical studies using log data from open-ended learning environments to measure science and engineering practices

Wang, Karen D.
•
Cock, Jade Maie
•
Kaeser, Tanja
Show more
2023
British Journal Of Educational Technology

Technology-based, open-ended learning environments (OELEs) can capture detailed information of students' interactions as they work through a task or solve a problem embedded in the environment. This information, in the form of log data, has the potential to provide important insights about the practices adopted by students for scientific inquiry and problem solving. How to parse and analyse the log data to reveal evidence of multifaceted constructs like inquiry and problem solving holds the key to making interactive learning environments useful for assessing students' higher-order competencies. In this paper, we present a systematic review of studies that used log data generated in OELEs to describe, model and assess scientific inquiry and problem solving. We identify and analyse 70 conference proceedings and journal papers published between 2012 and 2021. Our results reveal large variations in OELE and task characteristics, approaches used to extract features from log data and interpretation models used to link features to target constructs. While the educational data mining and learning analytics communities have made progress in leveraging log data to model inquiry and problem solving, multiple barriers still exist to hamper the production of representative, reproducible and generalizable results. Based on the trends identified, we lay out a set of recommendations pertaining to key aspects of the workflow that we believe will help the field develop more systematic approaches to designing and using OELEs for studying how students engage in inquiry and problem-solving practices.

  • Details
  • Metrics
Type
review article
DOI
10.1111/bjet.13289
Web of Science ID

WOS:000891715500001

Author(s)
Wang, Karen D.
Cock, Jade Maie
Kaeser, Tanja
Bumbacher, Engin  
Date Issued

2023

Publisher

WILEY

Published in
British Journal Of Educational Technology
Volume

54

Issue

1

Start page

192

End page

221

Subjects

Education & Educational Research

•

multiple-choice

•

free-response

•

students

•

inquiry

•

performance

•

strategies

•

efficiency

•

analytics

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LCN  
Available on Infoscience
January 2, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/193529
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés