developing a national support infrastructure for learning analytics at jisc
TRANSCRIPT
Niall Sclater Talis Insight, Birmingham, 15 Apr 2015
Developing a national support infrastructure for Learning
Analytics
Available from: http://analytics.jiscinvolve.org/Available from Effective learning analytics blog: analytics.jiscinvolve.org
Variety of institutions
University of Edinburgh
Bridgwater College
Variety of motivations» Enhancing the student learning
experience
» Improving retention
» Providing students with better information on their progress
» Providing data on foreign student attendance to UK government
» Improving National Student Survey scores
» Enhancing teaching
» Building better relationships between students and staff
» Providing additional support to under-achieving groups
Architecture
Student ID
Chem101, Phys102 …
A-Level Maths result: D
Brian viewed introductory videoHelen completed final quiz
James commented on Susan’s blog
Actor + Verb + Object
John visited library at 16:12Jenny borrowed book ISBN 978-1-47122
100101 100101 100101
100101100101
100101
100101
Dashboards
Thanks to: Mike Day, Nottingham Trent University
Developed by external company www.solutionpath.co.uk
Student engagement rating - cumulative
Nottingham Trent University
Student engagement rating – week-week
Nottingham Trent University
Tutor NotesArranged to see [student] as attendance was poor. We had an open and honest discussion about this and I explained to him the relationship between attendance and success! We talked about the barriers to his attendance, which related to too many late nights! Will meet again to review his attendance [tutor name]
Nottingham Trent University
100101
Student app
» How engaged am I?
» Compare my engagement
» How am I progressing?
» Compare my progress
» My assessments
» My career aspirations
» Plan my career path
» My competencies
» My emotional state
» Why I didn’t attend
» …etc
100101
100101
Ethical and legal issues
Available from: http://analytics.jiscinvolve.org/Available from Effective learning analytics blog: analytics.jiscinvolve.org
List of issues distilled to 86 separate issues in nine areas:
Taxonomy of ethical, legal and logistical issues
Area Example issue Question
1. Validity Validation of algorithms and metrics
How does an organisation validate its algorithms and metrics?
2. Ownership and control Control of analytics processes
Who in the institution decides how analytics are to be created and used?
3. Awareness Student awareness of data collection
What should students be told about the data that is being collected about them?
4. Consent and opting out Right to opt out Does a student have the right to opt out of data collection and analysis of their learning activities?
Jisc Effective Learning Analytics blog: analytics.jiscinvolve.org
Area Example issue Question
5. Student access Student access to their data To what extent should students be able to access the data held about them?
6. Privacy Access to employers Under what circumstances would it be appropriate to give employers access to analytics on students?
7. Action Triage How does an institution allocate resources for learning analytics appropriately for learners with different requirements?
8. Adverse impact Oversimplification How can institutions avoid overly simplistic metrics and decision making which ignore personal circumstances?
9. Stewardship Right to be forgotten Can all data regarding an individual except that necessary for statutory purposes be deleted?
100101100101
100101
UK Learning Analytics NetworkNext event: Edinburgh, 8th May
Effective learning analytics blog:analytics.jiscinvolve.org
Jiscmail list:[email protected]
@sclater sclater.com/blog