The Online Revolution:Education for Everyone

Daphne Koller & Andrew NgStanford University & Coursera

Courses from Top Universities

400400100 000100 000400400100,000100,000

Coursera

Coming from a middle class family from a ll t i I di N h d th l k dsmall town in India. Never had the luck and

guidance to reach Stanford for education. Guess what? God has sent the opportunityGuess what? God has sent the opportunity right across my door step! Heartfelt thanks to the great team and teachers who made this ghappen! (Akash Goswami)

I'm a single mom 39 years old with two collegeI m a single mom 39 years old with two college boys... I've been trying to get back to college for my masters and want to learn more about computers. Looking forward to this class! (Jenny Ramirez)

Education at Scale

33 U i iti33 Universities

198 courses 5 million enrollments

1 6 million students1.6 million students

es

on s

ite

100K

50K

Course Begins

Timeline# us

ers 50K

vv

Timeline

Real Course

VIDEO‐BASEDVIDEO BASED INSTRUCTIONINSTRUCTION

Coursera

Video-Based Instruction

Writing on tablet appears on monitor

Webcam to record instructor

Lecture Recording

M d G i

Basic Genetics Refresher (OPTIONAL)

Modern sequencing methods (9 min)

Modern GenomicsGenes and alleles (7 min)

M d li

Commercial Genomics (OPTIONAL)

History: The Human Genome Project (7 min)

Mendelianinheritance

(10 min) Genetic testing in the commercial world (8 min)

(OPTIONAL)

Genomic economics

(9 min)

What is DNA? (8 min)

Protecting privacy (10 min)

Personalized medicine (7 min) Case study: direct-

to-consumer Case study:

family planning genetics (9 min)

y p g(6 min)

Personalized Learning

ASSESSMENTSCoursera

Retrieval Practice Improves Learning"Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping." g y g p pp gJ. Karpicke, J. Blunt. Science (2011).

0.8

0.7

0.6

0.5

0.4

0.3

0.2

Study

0.1

0.0Repeated

St dRetrievalP ti

Practice is Critical

Study Practice

Interactive Video

Multiple choice

Short answer (regular expression)Short answer (regular expression)

Autograded Homeworks and Exercises

Autograded Homeworks and Exercises

Multiple choice

Short answer (regular expression) Math expressions( g p ) p

Autograded Homeworks and Exercises

SStructured data Computer programs

Autograded Homeworks and Exercises

Autograded Homeworks and Exercises

Colleen Lee, Ethan Fast, Alex Aiken

CourseraAutograded Homeworks and Exercises

In-Depth Exercises

Which of the following statements are true?  Check all that apply. Which of the following statements are true?   Check all that apply.

WWII started in 1939

Correct options: WWII started in 1939WWII lasted about 6 years

The allied troops landed in Normandy on D‐Day.Archduke Franz Ferdinand of Austria started WWII.Trench warfare was invented during WWII.  

WWII lasted about 6 yearsMany troops from the UK fought in WWII.The allied troops landed in Normandy on D‐Day.

Which of the following statements are true?   Check all that apply.Many troops from the UK fought in WWII. WWII d d i 1944

Incorrect options: WWII ended in 1944Many troops from Switzerland fought in WWII.

WWII ended in 1944The allied troops landed in Normandy on D‐Day.Trench warfare was invented during WWII.  

Many troops from Switzerland fought in WWII. Archduke Franz Ferdinand of Austria started WWII.Trench warfare was invented during WWII.  

Which of the following statements are true?   Check all that apply.Many troops from Switzerland fought in WWII. WWII started in 1939

CourseraRandomization and Mastery

WWII started in 1939WWII lasted about 6 yearsArchduke Franz Ferdinand of Austria started WWII.

Which of the following statements are true?   Check all that apply.Archduke Franz Ferdinand of Austria started WWII.Archduke Franz Ferdinand of Austria started WWII.The allied troops landed in Normandy on D‐Day.WWII started in 1939Trench warfare was invented during WWII.  g

CourseraMastery Learning

Which of the following statements are true?   Check all that apply.WWII started in 1939The allied troops landed in Normandy on D‐Day.Archduke Franz Ferdinand of Austria started WWII.Trench warfare was invented during WWII.  

Whi h f th f ll i t t t t ? Ch k ll th t lWhich of the following statements are true?   Check all that apply.Many troops from the UK fought in WWII. WWII ended in 1944The allied troops landed in Normandy on D DayThe allied troops landed in Normandy on D‐Day.Trench warfare was invented during WWII.  

Which of the following statements are true?   Check all that apply.Many troops from Switzerland fought in WWII. y p gWWII started in 1939WWII lasted about 6 yearsArchduke Franz Ferdinand of Austria started WWII.

CourseraRandomization and Mastery Learning

“The Impact of Self-and Peer-Grading on Student Learning”.P. Sadler, E. Good. Educational Assessment (2006).

8090100

506070

Gra

de

10203040

Stud

ent

Peer Grade

Self Grade010

0 10 20 30 40 50 60 70 80 90 100Teacher Grade

Open-Ended Work

Teacher Grade

Cf. Calibrated Peer Review™

Coursera

(Chapman, 2001)

Peer Grading Workflow

CourseraPeer Grading

60% within10% of score

Peer Grading Accuracy (HCI)

The Humanities, Sciences, Engineering, Business, ….

COMMUNITYCOMMUNITYCoursera

Sociology 101 Student Map

Global community of learners

Students

CourseraDiscussions

Community TAy

Community TAs

VietnamSan Francisco HCI-Class Study Group

MiamiNigeriaCzechoslovakia

San Francisco HCI-Class Study Group

MiamiNigeriaAustin, TexasRussian

G t lMinnesota

Arabic speaking students

speaking students

GuatemalaAthens KenyaNepalA multilingual universal

study group

Arabic speaking students y

Student Study Groups

Fi tFirst lecturesposted

STATISTICSSTATISTICS & ANALYTICS& ANALYTICS

Coursera

Identify the forum discussion thread which is most likely to cause a student to correct misconception.

Experimental setup:Final “correct” submission

“incorrect” submission

“incorrect” submission

Submission timeline

Forum visits[Jon Huang][Jon Huang]

New Window into Human Learning

Most helpful forum discussion thread: - Chance of correcting misconception if not viewed: 34%

Chance of correcting misconception if viewed: 64%- Chance of correcting misconception if viewed: 64%- Improvement by viewing: 30%

[Jon Huang]

CourseraWhat helped the most?

[Jon Huang]

W b itt dWrong answers submitted for machine learning class programming assignment

New Window into Human Learning

IndividualTutoring

Mastery Learning

Lecture

Achievement Score

"The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring " B Bloom Educational Researcher (1984)

The 2 Sigma Problem

One-to-One Tutoring. B. Bloom, Educational Researcher (1984).

C ll i l h f ’ l tCollege is a place where a professor’s lecture notes go straight to the students’ lecture notes, without passing through , p g gthe brains of either.

—Mark Twain

The mind is not a vessel that fneeds filling, but wood that

needs igniting.

—Plutarchfrom Ian Kidd's translation of Essays

The mind is not a vessel that The mind is not a vessel that needs filling, but wood that gneeds igniting.

—Plutarchfrom Ian Kidd's translation of Essays

85%90%

"Improved Learning in a Large-Enrollment Physics Class." L. Deslauriers, E. Schelew, and C. Wieman. Science (2011).

8%

81%85%

74%70%

80%

90%

58%50%

41%40%

50%

60%

20%

30%

40%

Lecture

0%

10%Active Learning

Attendance Engagement Learning

Igniting Minds

g g g

• Just‐in‐time teaching

• Small group problem• Small group problem solving

Using the flipped classroom

Universal Access to Education