jisc learning analytics update-feb 2016

26
University of Exeter, 22 February 2017 9th UK Learning Analytics Network Meeting

Upload: paul-bailey

Post on 03-Mar-2017

48 views

Category:

Data & Analytics


1 download

TRANSCRIPT

Page 1: Jisc learning analytics update-feb 2016

University of Exeter, 22 February 20179th UK Learning Analytics Network Meeting

Page 2: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Programme10:15 – 10:25

Arrangements for the day & welcome to the University of Exeter

10:25 – 11:25

Learning analytics at Exeter, Professor Wendy Robinson, Academic Dean for Students

11:25 – 11:40

Tea/Coffee break

11:40 – 12:30

Update on Jisc’s learning analytics programme

12:30 – 13:30

Lunch

 13:30 – 14:15

Measuring Learning Gain: Big Data, Learning Analytics, Tests and Surveys Dr Camille B. Kandiko Howson, Senior Lecturer in Higher Education & Academic Head of Student Engagement, King’s College London

14:15 – 15:00

Learning analytics and learning gain: the experience at Oxford BrookesDr Ian Scott, Assoc Dean Student Experience

 15:00 – 15:15

Tea/Coffee break

15:15 – 15:55

Blackboard research into learning analyticsJohn Whitmer, Director of Analytics, Blackboard

15:55 – 16:00

Farewell

Page 3: Jisc learning analytics update-feb 2016

Paul Bailey, Senior Codesign Manager, Research and DevelopmentJisc learning analytics service

http://www.slideshare.net/paul.bailey/

Page 4: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Effective Learning Analytics ChallengeRationale»Organisations wanted help to get started and have access to

standard tools and technologies to monitor and intervene Priorities identified»Code of Practice on legal and ethical issues»Develop basic learning analytics service with app for students»Provide a network to share knowledge and experienceTimescale»2015-16—test and develop the tools and metrics»2016-17—transition to service »Sep 2017—launch, measure impact: retention and achievement

Page 5: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Jisc’s Learning Analytics ProjectThree core strands:

Learning Analytics Service

Toolkit Community

Jisc Learning Analytics

Page 6: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Community: Project Blog, mailing list and network eventsBlog: http://analytics.jiscinvolve.org ~ 40 blog postsMailing: [email protected] – 500+ members (190+ organisations)9th Network Meeting ~600+ participants

Page 7: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Code of Practice Code of Practicehttp://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

Literature Reviewhttp://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf

Template Learning Analytics Policyhttps://analytics.jiscinvolve.org/wp/2016/11/29/developing-an-institutional-learning-analytics-policy/

Guidance on consent for learning analytics

https://analytics.jiscinvolve.org/wp/2017/02/16/consent-for-learning-analytics-some-practical-guidance-for-institutions/

Page 8: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Accessibility and Learning AnalyticsBlog Post Accessibility considerations for learning analytics https://analytics.jiscinvolve.org/wp/2016/12/14/accessibility-considerations-for-learning-analytics/ Webinar: Data and disadvantaged students - using learning analytics for inclusionMonday 27 February 2017, 12:00-13:00Register: https://www.jisc.ac.uk/events/

Page 9: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Analytics LabsInvitation to join April – July analytics lab teamshttp://bit.ly/jisc_bi_team_application

Page 10: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Learning Analytics Service Architecture

Page 11: Jisc learning analytics update-feb 2016

Descriptive Analytics

Predictive Analytics

Prescriptive Analytics

AutomatedDiagnostic Analytics

Standardised Data

Learning Records Warehouse

xAPI Plugins

Data transformation tools

Data and API Standards

Jisc Services

Other ProviderServices

Basic dashboards

Student App

Analytics Labs

Benchmarking services

College Analytics

Basic predictive modelling and intervention management

Procurement frameworks

Integration tools

Services for researchers

Pilot projects

Services for researchers

Pilot projects

Institutional Dashboards

Data visualisation tools

Data exploration tools

Advanced predictive modelling

Integrated intervention management

??? ???

Page 12: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

working with…Look out for further announcements soon….

Dynamic purchasing agreement to make it easier for institutions…

Page 13: Jisc learning analytics update-feb 2016

Where are we now…

Page 14: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Learning analytics products and toolsLearning records warehouse – activeData Explorer – basic visualisations Student Unified Data Definition – version 1.3.0 and examples major SRS and validation tooVLE – xAPI recipe and plugins for Blackboard and MoodleAttendance tracking – xAPI recipe (being piloted)Study Goal – version 1.0 on IoS and Android pilots - (3)

Tribal Student Insights (14)Open Learning Analytics Processor (4)Further learning analytics product pilots (tbc)

Page 15: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

UDD Validator Tool• UDD data preparation tool for institutions• Will prepare all institutions for UDD historical/ live data loads into LA LRW• Links directly to UDD GitHub site (dynamic updates)• Covers current & future UDD - 1.2.7, 1.2.x, 1.3.0 etc• Basic validation (UDD structure, optional/ mandatory fields, field contents)• Relational entities – integrity checks between entities/ joins• Data quality and concentration/ coverage checks (working with Tribal/ Unicon

Marist)• Full Excel-based report pack provided to institutions, with backing audit/ tracking

data for errors/ warnings• Built-in field-level (AES) encryption, with output to JSON files (LRW load ready)• Agile approach to software functionality/ release• Internal version allows rapid validation for institutions – taking in JSON, XML & TSV formats• Customer-side UDD validation (web-based, secure access) – due Q1/2 2017• Gives control & flexibility to our members – rapidly quick data validation (Azure Cloud)

Page 16: Jisc learning analytics update-feb 2016

Learning from experience…

Page 17: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Initial Implementation Approach

Historic Data Model Live

Data

Analyse Results Analysi

s and Pilot

Choose full product

SuppliersInstitution Team End Users

Deploy Study Goal

Page 18: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Current Implementation Approach

Analyse and Pilot

Choose full Product

Historic Data

Analyse Results

Live Data

Deploy dashboards/other tools

SuppliersInstitution Team End Users

Model Build

Deploy Study Goal

Deploy DataX

Analyse and Pilot

Page 19: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Data Explorer Basic visualisation tool Purpose: to enable initial data exploration and assist

institutions to chose suitable commercial solutions and set a basic expectation

Being used by several pilot institutions Demo uses dummy data from University of Jisc

Page 20: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Page 21: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Page 22: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Page 23: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

Page 24: Jisc learning analytics update-feb 2016

Getting on-board…

https://analytics.jiscinvolve.org/wp/on-boarding/

Page 25: Jisc learning analytics update-feb 2016

Jisc Learning Analytics 2017

On-boarding Process

Stage 1: OrientationStage 2: DiscoveryStage 3: Culture and Organisation SetupStage 4: Data IntegrationStage 5: Implementation Planning

https://analytics.jiscinvolve.org/wp/on-boarding/

Page 26: Jisc learning analytics update-feb 2016

Contacts

Paul Bailey [email protected]

Further Information: http://www.analytics.jiscinvolve.org

Join: [email protected]

Jisc Learning Analytics 2017