can data in a learning management system support student · suggestions about new or different…...
TRANSCRIPT
Can data in a Learning Management System support student success?
29 June 2016
2
31.6%
30.5%
35.9%
35.9%
24.7%
30.1%
34.8%
32.5%
36.7%
33.8%
37.8%
42.8%
33.1%
23.0%
34.9%
40.6%
38.8%
36.1%
0% 20% 40% 60% 80% 100%
Guidance about courses you might consider…
Alerts if it appears your progress in a course…
Suggestions for how to improve performance
Suggestions about new or different…
Automated tracking of your course…
Feedback about performance compared to…
Personalized support and information on…
Personalized quizzes or practice questions
Personalized visualizations and dashboards
Interested if provided with…
Don’t know Not at all interested Not very interested
Moderately interested Very interested Extremely interested
Role of LMS to achieve academic success?
2%0% 2%
9%
24%
63%
8%
2%
7%
18%
27%
38%
7%
2%5%
17%
29%
41%
0%
10%
20%
30%
40%
50%
60%
70%
Did not use in thepast year
Not at allimportant
Not veryimportant
Moderatelyimportant
Very important Extremelyimportant
University of Pretoria All non-US institutions All institutions
Percentage of UG modules use of LMS
30
3839
32
64 63
68
75 75
8284
20
30
40
50
60
70
80
90
2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Use of LMS
Rationale for integrating technology to support student engagement
Rationale for integration of LMS
Past:• International and National
trends
Present:• Growth of student numbers• Quality of education• Academic support • Student success
Technical Integration
Integration
PS
Bb
SOA
EnrolmentsLimited biographical dataGrades
Grade & Outcome Results
Course Attributes
Student Attributes
Final Grades
Student
Information
System
Performance Analyses
Best Practices Analyses
Trend Analyses
Instructor Attributes
User Activity
Data Course Item Data
Integration
Categories of LMS Data For Analysis
Grades
Student Course Summary
Grade Center
Course Design
Course Summary
Course Items
User Activity
Session Activity
Course Activity
Course
Item Activity
Submissions
Forum Submissions
Case studies
Are our studentsengaging actively online?
Do my course design impactstudent engagement?
Are students at risk in this module also at risk in others?
How can we further engage the students in the “middle”?
How can we further engage the at-risk students?
Faculty questions
Who are the students at risk based on LMS data?
Are we disadvantage any group of students?
Course design impact on engagement
Course design impact on engagement
Course design impact on engagement
Course design impact on engagement
Are our students engaging actively online?
Who are the students at risk?
Who are the students at risk?
Who are the students at risk?
Students at risk in this module also at risk in others?
Students at risk in this module also at risk in others?
Students at risk in this module also at risk in others?
Students at risk in this module also at risk in others?
Course reports: Submission report
Student report
Can data in a Learning Management System support student success?
Average final grade compared to course access per access quartile
Can data in a Learning Management System support student success?
Average final grade compared to student risk profile
Conclusion
• LMS data in isolation
• Impact of professional development / support
• Integration with other data sets
•Skills set needed
•Policies
•Context: Correlation does not equal causation
•Provide insights that might not be obvious
• LMS data can inform lecturers, students & advisors
•Guide actions such as learning design
Online with EI
ObjectiveAssessments
Use of QM Live forQuestUP
Pedagogical use ofclickUP & Turnitin
E-learning for academics
Web and mobile use
Help desk
Mediadevelopment
Basic use ofclickUP for adminstaff
Instructional Design support per Faculty
Student success projects support
Tutor & Just in TimeDepartmental training
EI
clickUP
Support
QuestUP
Training
Digital Lecture
LMS data
Analytics
Learning analytics is the measurement, collection, analysis and reporting of data about learners and their
contexts, for purposes of understanding and optimizing learning and the environments in which it
occurs
36
LMS Analytics
Reports & Dashboards
Data Warehouse
Analytics for Learn
Students
Lecturers
Advisors
Deans & HoDs
Instructional Technology
Staff
Institutional Leaders
Self Help (Peer Comparison)
• At-Risk Student Identification & Intervention
• Improve use of Learn (Best Practices)
• At-Risk Student Identification & Intervention
• Driving Best Practice Adoption• Measuring Results
• Data Analysis• Defining Best
Practices • Driving Learn
Adoption• Measuring Results
• Defining Goals & Policy
• Measuring Results