Peer Assessment Based on Ratings in a Social Media Course

• Presented at: The 4th International Conference on Learning Analytics and Knowledge LAK14, Indianapolis, Indiana, USA, March 24-28 2014
• Publication date: 2014

Peer assessment is seen as a powerful supporting tool to achieve scalability in the evaluation of complex assignments in large courses, possibly virtual ones, as in the context of massive open online courses (MOOCs). However, the adoption of peer assessment is slow due in part to the lack of ready-to-use systems. Furthermore, the validity of peer assessment is still under discussion. In this paper, in order to tackle some of these issues, we present as a proof-of-concept of a novel extension of Graasp, a social media platform, to setup a peer assessment activity. We then report a case study of peer assessment using Graasp in a Social Media course with 60 master's level university students and analyze the level of agreement between students and instructors in the evaluation of short individual reports. Finally, to see if both instructor and student evaluations were based on appearance of project reports rather than on content, we conducted a study with 40 kids who rated reports solely on their look. Our results convey the fact that unlike the kid evaluation, which shows a low level of agreement with instructors, student assessment is reliable since the level of agreement between instructors and students was high.

Keywords: Learning activities ; social media ; peer assessment ; inter-rater agreement ; ratings ; MOOCs

Reference

• EPFL-CONF-189957

Record created on 2013-10-22, modified on 2017-05-10