peerwise - paul denny - edinburgh 2011 (part 1)
DESCRIPTION
Part 1 of Paul Denny's presentation at the LTKB workshop, Edinburgh 2011. PeerWise is a web-based repository of MCQs built by students. Students are given the responsibility of creating and moderating the resource. By leveraging the creativity and energy of a class, a large, diverse and rich resource can result.TRANSCRIPT
Paul Denny
PeerWisefamiliarity breeds content
Department of Computer Science
The University of Auckland
New Zealand
University of Edinburgh
Peer Feedback and Assessment for Science and Engineering
17th December, 2010
student-authored questions using PeerWise
Goals
• What is PeerWise?
– Motivations
• Demonstration
• Examples of use
– Auckland
– Otago
– Edinburgh
What is PeerWise?
• Web-based MCQ repository built by students
simple, student-driven
Motivations
Student familiarity
with Web 2.0
The energy and
creativity of a large class
Student generated
questions
Large classes
ENGGEN 131, 10am Stream
Semester Two, 2009• A powerful resource
Student familiarity with Web 2.0
• Characteristics
– user-generated content
– contributions by many users
– techniques for content discovery
Student generated questions
• Not a unique idea:
– Balajthy (1984), Yu et al. (2002), Fellenz (2004),
Barak and Rafaeli (2004), Chang et al. (2005),
Horgen (2007), ....
What is PeerWise?
• Web-based MCQ repository built by students
• Students:
– develop new questions with
associated explanations
– answer existing questions and rate
them for quality and difficulty
– take part in discussions
What is PeerWise?
• Reputation score, leader-boards and badges…
What is PeerWise?
PeerWise
• Demonstration
Examples of use
• The University of Auckland
• University of Otago
• The University of Edinburgh
Auckland
• COMPSCI 101, Semester 1, 2007
• n = 460
– 2% participation bonus
– 1 question, 10 answer requirement
Auckland
• Daily usage
Auckland
• Daily usage
participation deadline
Auckland
• Daily usage
final exam
57%
participation deadline
Otago
• Biology courses:
– CELS191 (Semester 1)
– HUBS191 (Semester 1)
– HUBS192 (Semester 2)
• Very large classes
• Student participation was voluntary
Otago
• Half the class was active, few authors, many
answerers
CELS 191 HUBS 191 HUBS 192
Otago
CELS 191 HUBS 191 HUBS 192 TOTAL
Students
enrolled
2146 2021 1738 -
Number of
authors
114 89 81 -
Number of
answerers
1159 974 802 -
Number of
questions
Number of
answers
Avg. answers
per student
-
Otago
CELS 191 HUBS 191 HUBS 192 TOTAL
Students
enrolled
2146 2021 1738 -
Number of
authors
114 89 81 -
Number of
answerers
1159 974 802 -
Number of
questions
753 702 895 2350
Number of
answers
Avg. answers
per student
-
Otago
CELS 191 HUBS 191 HUBS 192 TOTAL
Students
enrolled
2146 2021 1738 -
Number of
authors
114 89 81 -
Number of
answerers
1159 974 802 -
Number of
questions
753 702 895 2350
Number of
answers
163761 172289 167594 503644
Avg. answers
per student
-
Otago
CELS 191 HUBS 191 HUBS 192 TOTAL
Students
enrolled
2146 2021 1738 -
Number of
authors
114 89 81 -
Number of
answerers
1159 974 802 -
Number of
questions
753 702 895 2350
Number of
answers
163761 172289 167594 503644
Avg. answers
per student
141.3 176.9 209.0 -
Number of
answers per
day
CELS 191
HUBS 191
HUBS 192
Otago
• The top-scorer in CELS 191 was awarded a
prize, and sent the following email to teaching
staff
“PeerWise is a very good learning tool, especially for
revision after a lecture. I find that if I can explain the
concept, then I have grasped the ideas of the lecture,
and if there is something I am struggling to grasp
someone will have posted a question which once I
have worked my way through, makes the concept
clearer. So I am very grateful for the resource.”
Edinburgh
Edinburgh
• Physics 1A, Semester 1, 2010
• n ~ 200
– 3% participation mark
– author 1 question
– answer 5 questions
– comment on and rate 3 questions
Edinburgh
• PeerWise was introduced
in workshop sessions in
Week 5
• Students worked through a
structured example task
and devised their own
questions in groups
Edinburgh
Total:
350 questions
~3500 answers
30
Workshop
training
Live Due
Uptake towards exam:
No additional questions
~170 answers
31
Assessed
coursework
deadlineExam
Edinburgh
• A few example questions...
Coming up
• Your turn...
Thank you
• Any questions?
– Now
– Later
Paul Denny
Department of Computer Science
The University of Auckland
PeerWise
peerwise.cs.auckland.ac.nz