Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. The Competent Computational Thinking Test (cCTt): A Valid, Reliable and Gender-Fair Test for Longitudinal CT Studies in Grades 3-6
 
research article

The Competent Computational Thinking Test (cCTt): A Valid, Reliable and Gender-Fair Test for Longitudinal CT Studies in Grades 3-6

El-Hamamsy, Laila  
•
Zapata-Caceres, Maria
•
Martin-Barroso, Estefania
Show more
January 25, 2025
Technology Knowledge And Learning

The introduction of computing education into curricula worldwide requires multi-year assessments to evaluate the long-term impact on learning. However, no single Computational Thinking (CT) assessment spans primary school, and no group of CT assessments provides a means of transitioning between instruments. This study therefore investigated whether the competent CT test (cCTt) could evaluate learning reliably from grades 3 to 6 (ages 7-11) using data from 2709 students. The psychometric analysis employed Classical Test Theory, Item Response Theory, Measurement Invariance analyses which include Differential Item Functioning, normalised z-scoring, and PISA's methodology to establish proficiency levels. The findings indicate that the cCTt is valid, reliable and gender-fair for grades 3-6, although more complex items would be beneficial for grades 5-6. Grade-specific proficiency levels are provided to help tailor interventions, with a normalised scoring system to compare students across and between grades, and help establish transitions between instruments. To improve the utility of CT assessments among researchers, educators and practitioners, the findings emphasise the importance of (i) developing and validating gender-fair, grade-specific, instruments aligned with students' cognitive maturation, and providing (ii) proficiency levels, and (iii) equivalency scales to transition between assessments. To conclude, the study provides insight into the design of longitudinal developmentally appropriate assessments and interventions.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1007/s10758-024-09777-8
Web of Science ID

WOS:001405514300001

Author(s)
El-Hamamsy, Laila  

École Polytechnique Fédérale de Lausanne

Zapata-Caceres, Maria

Universidad Rey Juan Carlos

Martin-Barroso, Estefania

Universidad Rey Juan Carlos

Mondada, Francesco  

École Polytechnique Fédérale de Lausanne

Zufferey, Jessica Dehler  

École Polytechnique Fédérale de Lausanne

Bruno, Barbara  

École Polytechnique Fédérale de Lausanne

Roman-Gonzalez, Marcos

Universidad Nacional de Educacion a Distancia (UNED)

Date Issued

2025-01-25

Publisher

SPRINGER

Published in
Technology Knowledge And Learning
Subjects

Computational thinking

•

Assessment

•

Primary school

•

validation

•

Developmental appropriateness

•

Psychometrics

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SCI-STI-FMO1  
AVP-E-LEARN  
FunderFunding(s)Grant NumberGrant URL

EPFL Lausanne

Swiss National Science Foundation (SNSF)

51NF40_185543

Madrid Regional Government

P2018/TCS-4307

Show more
RelationRelated workURL/DOI

IsSupplementedBy

Extended dataset for the validation the competent Computational Thinking test in grades 3-6

https://infoscience.epfl.ch/handle/20.500.14299/247313
Available on Infoscience
February 3, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/246469
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés