jekaterina rogaten
TRANSCRIPT
Learning analytics and learning gains: Multilevel modelling
of academic performance
Jekaterina Rogaten
TEF2016 14/07/2016
Open University Team
Dr Bart Rienties
Dr Jekaterina Rogaten
Prof Denise Whitelock
Dr Simon Cross
Prof Allison Littlejohn
Oxford Brooks University Team
Dr Ian ScottProf Rhona Sharpe
University of Surrey Team
Dr Simon Lygo-BakerProf Steven WarburtonProf Ian Kinchin
Learning Gains
• Learning gains has been defined as growth or change in knowledge, skills, and abilities over time that can be linked to the desired learning outcomes or learning goals of the course
ABC model of Learning Gains
ABC model of Learning Gains
ABC model of Learning Gains
• Web of Science core collection and ERIC
• The time frame of the search 2000 – 2016
• In total 231 studies were identified of which 51 studies were selected.
• All learning gains can be classified into ABC
• Learning gains are primarily used to examine the effect of any particular educational ‘intervention’
Literature Review
Literature Review
Cognitive Learning Gains 27
studies
Behaviour-Cognitive
Learning Gains
5 studies
Affective-Behaviour-
Cognitive Learning
Gains
8 studies
Affective-Cognitive
Learning Gains
11 studies
21%
10%
53%
16%
Cognitive Learning Gains: a Three-level Growth Curve Model
Level 1
Level 2
Level 3
TMA1
Student1
TMA3 TMA1 TMA2 TMA3 TMA1 TMA2 TMA3TMA2
Student2 Student3
Module1 Module2
TMA1 TMA2 TMA3
Student4
TMA1 TMA2 TMA3
Student5
Module3
Faculty of ArtsTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Business and Law
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Faculty of Education and Language Studies (FELS)
Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Faculty of Health and Social Care (HSC)Trellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Math, Computing and TechnologyTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
ScienceTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Social ScienceTrellis plot for student growth-curves Predicted student growth-curves Predicted module growth curve
Results
Faculty
Students
Variation in
students’ initial
achievements
Variation in
students’
subsequent
learning gain
Arts 5,066 31% -
Business & Law 11,154 16% 51%
FELS 7,015 54% 88%
HSC 4,055 65% 72%
Math, Computing & Technology 10,038 46% 77%
Science 5,791 33% 26%
Social Science 2,317 6% 19%
Learning analytics and learning gains: Multilevel modelling
of academic performance
Jekaterina Rogaten
TEF2016 14/07/2016