medu plenary session on analytics
TRANSCRIPT
Analytics in
Decision-Making:
Learners, Learning,
Life & Analytics
What Matters for Learning Analytics?
Janet Corral, PhD
University of Colorado School of Medicine
Analytics is a Hot Topic
2011Journal of Learning Analytics
2012Georgia State Univlaunches student data system
20131st international learning analytics conference
2014Two analytics presentations at AAMC LSL
20151st AAMC GIR DATA Symposium
2016EDUCAUSE Horizon report: Learning analytics 1 yr or less to adoption
20171st Ed Tech Working Group presentation on data standards
2010Purdue University Signals
Higher Education Med Schools
Defining analytics
Learning Analytics
Education Data
Mining
Academic Analytics
Corral, J. (2017) based on Siemens & Baker (2012)
Defining analytics
Learning Analytics
Education Data
Mining
Academic Analytics
Corral, J. (2017) based on Siemens & Baker (2012)
Reasoning forward
Investigating from the
data
Business intelligence
Need multiple data sources
To support quality learning outcomes, educational analytics…
Need multiple data sources Will impact the whole system of stakeholders
To support quality learning outcomes, educational analytics…
Analytics in
Decision-Making:
Learners, Learning,
Life & Analytics
What does this mean for Aquifer?
Continuum of Options
Feedback Prediction Coaching
FEEDBACK
With gratitude to NYU Educational Data Warehouse: [email protected]
Vanderbilt VSTAR
https://vstar.mc.vanderbilt.edu/
Vanderbilt VSTAR
https://vstar.mc.vanderbilt.edu/
Feedback
Feedback
Action is outside the digital system
Analytics is more than
buildingdashboards
Learning analytics
impact our
systemsof Education
Analytics in
Decision-Making:
Learners, Learning,
Life & Analytics
How would you enhance the feedback
on one Aquifer VP?
What data metrics are important?
Prediction
Who will complete?
Prediction of learning requires work
Pusic, V. et al (2015). Learning curves in health professions education.
Does feedback work?
Student Learning Pathways
Corral, J. (2012). Learning with Virtual Patients.
!
!
Nudging & Coaching
Nudging
NudgingIt’s been 7 days since you logged in.
Students who complete VPs 3x/week are 17% more successful in the clerkship.
Coaching
Credit: University of Michigan
Student Learning Pathways
Corral, J. (2012). Learning with Virtual Patients.
Students who had difficulty here, found it helpful to:
1. Read _____2. Do cases 1 & 5
Analytics in
Decision-Making:
Learners, Learning,
Life & Analytics
What analytics would you add to a
series of VPs?
What does that type of analytics look like across the VPs?
What data metrics are important?
Feedback Prediction Coaching
Other Considerations
UC Denver 81 dentistry students184 medical students180 pharmacy students
Denver Public Schools81,438 students
Facebook1.71 billion monthly active users
University of Phoenix400,000 students per
year
Twitter14 Pedabytes of Data
Netflix40 Pedabytes of Data
EDU Data ≠ not BIG Data
Impact is on the System
10.37%
100 Student Advisors or Coaches
increase in B or A awarded
“The students who get a red light almost all
contact me immediately to ask how
to raise their grades.”
-Tim Delworth, Mathematics
Impact is on the System
NEW faculty role ‘coach’
NEW curriculum
Learning is social
Network Awareness Tool of Social Learn Network (Teplov, 2012)
Learning analytics can detect when emotions impact achievement
Delight, Surprise
(Rare)
Frustration
(less associated with poorer
learning)
Confusion, Engaged Concentration
(Watch out for boredom!)
Baker, D’Mello, Rodrigo, & Graesser (2004, 2010)
Learning analytics can detect when emotions impact achievement
Delight, Surprise
(Rare)
Frustration
(less associated with poorer
learning)
Confusion, Engaged Concentration
(Watch out for boredom!)
Baker, D’Mello, Rodrigo, & Graesser (2004, 2010)
Need multiple data sources
To support quality learning outcomes, educational analytics…
Need multiple data sources Will impact the whole system of stakeholders
To support quality learning outcomes, educational analytics…
Aquiferis positioned for success
Discussion for the Aquifer Community
What type(s) of analytics are most
effective for Aquifer to engage?