analytics with splunk (open edx)

ANALYTICS WITH SPLUNK

Philippe Chiu | Managing Director | 2014.11.18

1st SPOC in January 2014

1st Flipped class in February 2014

1st MOOC in March 2014

Produced20 courses

(mostly self-paced)

ionisx.com

intra-Startup backed by IONIS Education Group

Delivering

French content

FAMILIAR WITH THESE?

FAMILIAR WITH THAT?

FAMILIAR WITH THAT?

IS THAT IT?

IS THAT IT?

HOW?

+Great platform Leading data-analysis

( can’t be wrong ! )

ARCHITECTURE OVERVIEW

Open edXUsers

Data

Analytics

Forward (ASAP)or

Buffer

Courses

InstructorsDiscussions

CAT | GREP | SED | EXCEL

PROCESS

Collect Transform Analysis Reporting

Videos

Problems

Login

Forum

Wiki

Lookups Jointures Time Charts

Visualisations

Maps

IP Location Transactions

Stats

COLLECTVideo

load, play, stoppause, seek, speed_change

Problem submit, check, grade

Discussioncreate, reply, favorite,

pin, vote, followLoginauth strategy, email domains,

time of day…

TRANSFORM{"username": "pchiu", "event_type": "play_video", "ip": "163.5.100.187", "agent": "Mozilla/5.0 (Linux; Android 4.4.2; GT-I9505 Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.122 Mobile

Safari/537.36", "host": "courses.ionisx.com", "session": "efe6b61c6935d30a6fb0e6d4ba589f4c", "event": "{\"id\":

\"i4x-eartsupX-017-001-001-video-4f1d0ed9633047fd90ea42d85b7a4939\",\"currentTime\":200,\"code\":\"fc5ypHCEDYA\"}",

"event_source": "browser", "context": {"username": "pchiu", "user_id": 2, "ip": "163.5.100.187", "org_id": "eartsupX",

"agent": "Mozilla/5.0 (Linux; Android 4.4.2; GT-I9505 Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.122 Mobile Safari/537.36", "host":

"courses.ionisx.com", "session": "efe6b61c6935d30a6fb0e6d4ba589f4c", "course_id":

"eartsupX/017-001-001/2014-SPRING", "path": "/event"}, "time": "2014-05-23T14:59:30.329084+00:00", "page":

"https://courses.ionisx.com/courses/eartsupX/017-001-001/2014-SPRING/courseware/803452e9b3324e35bbac984ffa467923/

b24681b324944bc2b120e0dda52a65a1/#"}

| lookup edxUser username OUTPUT user_email | iplocation ip

| lookup edxCourse context.course_id OUTPUT course_name

TRANSFORM (LOOKUP TABLES)

Static (csv) or Dynamic (script)

ANALYZE

Time spent(overall, videos)

Video events(unique, count,

speed changes…)

Detect learner profiles(active, passive, lurkers,

performers, rushers, steady…)

Problem answers breakdown

(correct, incorrect, ratio…)

REPORT (INSTRUCTIONAL)

pause_video events breakdown (30s range)

REPORT (MARKETING)Geolocation

Conversion rates per page

REPORT (OPS)

Activity per hour of day

Activity per day of week

REPORT (GLOBAL)

REPORT : FEATURES++

Mobile PivotsReal-time(yes, really)

Alerting Meta Data Time buckets

…

…

IT’S ONLY THE BEGINNING

(YOU KNOW THE STORY…)

INTRODUCING “ IONISX SCORE “

IONISX SCORE• the Active (discussion) • the Watcher (video, textbook) • the TA-tobe (problem efficiency) • the Lurker (courses browser)

Sample

IONISX SCORE

Forum exemple

Video exemple

MERCI !@IONISx

fb.me/ionisx

IONISx

IONISx

Join us @ 5PM Demos…

Discussions…