cu berkeley workshop #2: making it work, effective facilitation of clicker questions

50
FACILITATION TIPS AND TECHNIQUES Make Clickers Work for You Dr. Stephanie V. Chasteen Physics Department & Science Education Initiative Univ. of Colorado at Boulder http://colorado.edu/sei Web and blog: http://sciencegeekgirl.com Email: [email protected]

Upload: stephanie-chasteen

Post on 05-Dec-2014

701 views

Category:

Education


0 download

DESCRIPTION

So now you’ve got some great questions to use with clickers, but that’s no magic bullet. What might go wrong, and how do we avoid common pitfalls? How do we avoid just giving students the answer, or what if students are reluctant to discuss the questions? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of clickers and peer instruction. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions. Time-depending, participants will also get a chance to practice aspects of teaching through questioning.

TRANSCRIPT

Page 1: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

FACILITATION TIPS AND TECHNIQUES

Make Clickers Work for You

Dr. Stephanie V. Chasteen Physics Department

& Science Education InitiativeUniv. of Colorado at Boulder

http://colorado.edu/sei

Web and blog: http://sciencegeekgirl.com

Email: [email protected]

Page 2: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Short refresher course

Page 3: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

What do you teach?

A. ScienceB. Engineering or MathC. Social sciencesD. HumanitiesE. Administration / faculty supportF. Other

Show of hands

Page 4: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Have you used response systems (clickers) in your teaching?

A. Not at all, and I haven’t seen them usedB. Not at all, but I’ve observed their use

somewhatC. I’ve used them a littleD. I’ve used them a lotE. I could be (should be?) giving this workshop

Take a clicker & turn it on If the green light flashes,

your vote has been counted

Page 5: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

How familiar are you with Mazur’s “Peer Instruction”

A. Fairly familiar, and I like itB. Fairly familiar, but I’m not sure that I like itC. I’ve heard of it but only have a vague idea

what it isD. Not familiar at allE. Not sure

Colored cards

Page 6: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Introducing Me

Applying scientific principles to improve science education – What are students learning, and which instructional approaches improve learning?

Science Education Initiative

http://colorado.edu/SEI

Physics Education Research Group

One of largest PER groups in nation, studying technology, attitudes, classroom practice, & institutional change.

http://PER.colorado.edu

Blogger

http://blog.sciencegeekgirl.com

6

Page 7: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

U. Colorado clicker resources…7

Videos of effective use of clickers

http://STEMclickers.colorado.edu

Clicker resource page

http://STEMvideos.colorado.edu

2-5 mins long

• Instructor’s Guide• Question banks•Literature / Articles

PLUS past workshopsAnd all workshop materials

I can help you with your institution’s workshops too

Page 8: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Why question?

How many times have you given a lecture and found that students hadn’t followed you?

Can you rely on students to ask questions if they don’t understand something?

Can you rely on students to know if they don’t understand something?

What are the benefits of questioning?

whiteboardCredit: Rosie Piller

8

Page 9: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions
Page 10: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

The more things change…

2000 years ago

Today

Page 11: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

When can we ask questions?

Credit: Rosie Piller and Ian Beatty.

11

BEFORESetting up instruction

MotivateDiscoverPredict outcomeProvoke thinkingAssess prior knowledge

DURINGDeveloping knowledge

Check knowledgeApplicationAnalysisEvaluationSynthesisExercise skillElicit misconception

AFTER Assessing learning

Relate to big pictureDemonstrate successReview or recapExit poll

Page 12: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Some methods of asking questions

Ask rhetoricallyTarget the class (how?)Target someone in particular (in what order?)Wait and then… (call on whom?)Answer your own questionLeave the question unanswered

Or ask out of classBlogsDiscussion boardsHomework…Credit: Rosie Piller

12

Page 13: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Why use clickers to target the class? An outline of Peer Instruction.

13

Page 14: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

14

But not a magic bullet!

Clickers are a tool for questioning

Page 15: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

15

Ask Question

Peer Discussion

Vote

Class Discussion

…Lecture… (Maybe vote)

* See also: Peer Instruction, A User’s Manual. E. Mazur.

Anatomy of Peer Instruction

Page 16: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

How is a clicker question the same or different?*

Similar in terms of goalsMultiple choiceAnonymous (to peers)Every student has a voice –

the loud ones and the shy ones

Forced wait timeYou can withhold the answer

until everyone has had time to think (choose when to show the histogram)

16

* From other types of in-class questions

What does this tool help us to do?

Page 17: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Peer instruction helps students learn

Research shows that:Students can better answer a similar

question after talking to their peersPeer discussion + instructor explanation

works better than either one aloneStudents like peer instruction, from intro to

the junior levelStudents in courses using peer instruction

outperform those in traditional lecture courses on a common test

17

See http://STEMclickers.colorado.edu for various references

Page 18: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

U. Colorado clicker resources…18

Videos of effective use of clickers

http://STEMclickers.colorado.edu

Clicker resource page

http://STEMvideos.colorado.edu

2-5 mins long

• Instructor’s Guide• Question banks• Workshops• Literature / Articles

Page 19: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Which of these could be clicker questions?

Credit: Rosie Piller and Ian Beatty.

19

BEFORESetting up instruction

MotivateDiscoverPredict outcomeProvoke thinkingAssess prior knowledge

DURINGDeveloping knowledge

Check knowledgeApplicationAnalysisEvaluationSynthesisExercise skillElicit misconception

AFTER Assessing learning

Relate to big pictureDemonstrate successReview or recapExit poll

Page 20: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Let’s try it

A. Writing good questionsB. Getting students to really think about themC. Getting students to answer the questions /

Nobody respondsD. The same students always respond / Not

everybody respondsE. It takes too long / I have a lot of content to

cover

I think the toughest thing about using clickers and peer instruction in class will be:

Page 21: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

21

A science-content example

Which superpower would you rather have? The ability to…

A. Change the mass of thingsB. Change the charge of thingsC. Change the magnetization of thingsD. Change the boiling point of things

Question: Ian Beatty, UNC Greensboro Image: Thibault fr on Wikimedia

21

Page 22: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

22

Example question: Math

Your sister in law calls to say that she’s having twins. Which of the following is the most likely? (Assume she’s having fraternal, not identical, twins)

A.Twin boysB.Twin girlsC.One girl and one boyD.All are equally likely

Derek Bruff, Vanderbilt

Page 23: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Example Question: Survey

Which of the following are you least comfortable using to solve problems?

A. KinematicsB. Newton’s LawsC. Work-Energy TheoremD. Momentum-Impulse TheoremE. Angular Momentum-Angular Impulse Theorem

23

Ian Beatty, UMass Amherst

Page 24: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions
Page 25: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

FACILITATION TIPS AND TECHNIQUES

Make Clickers Work for You

Dr. Stephanie V. Chasteen Physics Department

& Science Education InitiativeUniv. of Colorado at Boulder

http://colorado.edu/sei

Web and blog: http://sciencegeekgirl.com

Email: [email protected]

Page 26: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Two way conversations with students are vital...26

...because students can misunderstand what we say

Page 27: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

27

Ask Question

Peer Discussion

Vote

Class Discussion

…Lecture… (Maybe vote)

* See also: Peer Instruction, A User’s Manual. E. Mazur.

Anatomy of Peer Instruction

Page 28: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Burning questions?

Page 29: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Let’s revisit the question from before

A. Writing good questionsB. Getting students to really think about themC. Getting students to answer the questions /

Nobody respondsD. The same students always respond / Not

everybody respondsE. It takes too long / I have a lot of content to

cover

I think the toughest thing about using clickers and peer instruction in class will be:

Page 30: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Another question

Honestly, I think that I’m most likely to modify this technique of peer instruction to suit me and my students. I know that there are at least ___ parts of the technique that I’ll be changing:

A. NoneB. OneC. Two-threeD. Four or more

Be prepared to explain your answer and defend!

Page 31: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Is there a problem with modifications?

I won’t tell you how to teach. You’re smart & you care about instruction.

Be strategic about modifications.

Page 32: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

% of physics faculty reporting to be familiar with RBIS

* Research-Based Instructional StrategyDancy & Henderson, Pedagogical practices and instructional change of faculty, Am. J. Phys., 78(10), Oct 2010.

“RBIS”= Research-Based Instructional Strategy

Page 33: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

% of faculty reporting as current user of RBIS

* Research-Based Instructional StrategyDancy & Henderson, Pedagogical practices and instructional change of faculty, Am. J. Phys., 78(10), Oct 2010.Web survey of 722 physics faculty at various institutions, initial sample of 2000.

~ 50%

“RBIS”= Research-Based Instructional Strategy

Of these, how many do you think use consistent with Mazur’s method?(A) <30% (B) 30-70% (C) >70%

Page 34: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

In particular:

Students discuss ideas in class* 27%

Students discuss qualitative/quantitative problems in class*

27%

Whole class voting* 38%

Conceptual questions* 64%

% of instructors who report using Peer Instruction and also report including the following elements of Peer Instruction:

Dancy & Henderson, Pedagogical practices and instructional change of faculty, Am. J. Phys., 78(10), Oct 2010.Web survey of 722 physics faculty at various institutions, initial sample of 2000.

* Every class

Is this a problem?It depends.

Page 35: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

35

Ask Question

Peer Discussion

Vote

Class Discussion

…Lecture… (Maybe vote)

* See also: Peer Instruction, A User’s Manual. E. Mazur.

Exercise #1: Core Philosophies

What are the underlying principles that make this work?

Page 36: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Some core philosophies of mine

Students learn by teaching each otherStudents learn by articulating their ideasIt’s important for me to hear student ideasI need to know what my students understand

during the course of instruction, before the test

I value and respect student ideasI want students to know that I value student

ideasI want students to feel safe sharing their

ideasClicker questions are an integral part of my

lecture

Page 37: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

What could possibly go wrong?

You ask students a question, and ask them to discuss.

You then ask them to share their answers and reasoning in a whole-class discussion

What could possibly go wrong?

37

In groups of 3-5 brainstorm some of the challenges you imagine in using this.

Brainstorm some solutions that are in line with your core philosophies

Write on your handout.

Exercise #2

10 mins

Page 38: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

38

38

1. Ask Question

What are some challenges/ philosophies / solutions related to asking the question?

Handout/worksheet / whiteboard

Best practices•Ask several times during lecture•Ask challenging, meaningful questions•Don’t post until ready & give time to read

Philosophies•Questions are integral to lecture•Students can learn by considering a question

Page 39: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

2. Peer Discussion39

What are core philosophies in peer discussion?

Philosophies: • Students learn through discussion• Students need to know that you value their ideas & that it’s safe to share

Solutions:•Make it clear why you’re doing this• Circulate and ask questions / model•Use questions they want to discuss•Allow enough time (2-5 mins)•Focus on reasoning in wrap-up

What are challenges / how can you help make it work?

Page 40: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Student buy-in is key!

Page 41: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

3. Wrap-Up Discussion41

Philosophies? Challenges? What might you do to facilitate an effective wrap-up discussion?

Solutions:•Establish culture of respect•Consider whether to show the histogram immediately• Ask multiple students to defend their answers• Emphasize reasoning: Why are wrong answers wrong and why right answer is right

Philosophies:•Student ideas are important•Students need to feel safe

Page 42: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

42

Giving the answer stops student thinking!

Page 43: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Effects of increased wait time

Changes in student behavior: More students respond More students respond without being asked (unsolicited) Student responses are longer More alternative explanations are offered Student confidence increases There are more speculative responses Students ask more questions

Other changes (on teacher!) Quantity of questions decreased Quality of questions increased Expectations of slower students were revised Teacher reactions to answers were more appropriate

43

Rowe, Mary Budd (1974)

All from a few more seconds!

Page 44: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Other things we haven’t talked about?

Other challenges / solutions / philosophies?

44

Page 45: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Let’s try it: Mock Class45

In a group of 3-5:1. Choose a question to use2. Assign roles to each member of the

group to split up the task of facilitating the question

10 minutes

Page 46: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Rules for Mock Class

1. You are a “Critical friend”2. Say PAUSE when we should discuss

something3. Have fun!

46

Page 47: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Action Plan

Take a few minutes to write down your action plan to implement ideas you heard about in the workshop

47

Page 48: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Many materials in this workshop (particularly the questioning cycle and the participant

exercises) were adapted from Rosie Piller, Making Students Think: The Art of Questioning. Short papers published in: Computer Training & Support Conference, 1995; ISPI International Conferences, 1991 and 1996; ASTD National Conference on Technical & Skills Training, 1990. Related workshop description at http://www.educationexperts.net/nstworkshop.html. Other materials (particularly

sample clicker questions and goals of clicker questions) adapted from Ian Beatty’s Technology Enhanced Formative Assessment (TEFA) program. http://ianbeatty.com/crs

Resource Page: http://STEMclickers.colorado.eduWeb and blog: http://sciencegeekgirl.comEmail: [email protected]

Thanks!

Got questions later? We can schedule a virtual follow-up

anytime.

Page 49: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

Learning Goals

Biology: Recognize the components of a cell and describe why each is necessary for the function of a cell

Physics: Identify the different ways that light can interact with an object (i.e., transmitted, absorbed, reflected).

Chemistry: Explain trends in boiling points in terms of intermolecular interactions

Earth science: Understand the formation of the three major types of rocks (igneous, sedimentary, and metamorphic) and the processes by which they form, relating them by the rock cycle.

Math: Solve a system of linear equations in two variables using algebra or graphing.

Page 50: CU Berkeley Workshop #2:  Making it work, Effective Facilitation of Clicker Questions

What Do I do if…?

What can you do if you ask questions and..There is no responseThe same people keep raising their handsThe answers are called out before everyone

has a chance to thinkThe answers take too longSomeone gives a wrong answerOnly some students are prepared?

50

We’ll discuss in Workshop #2.

For now: Many of these challenges are addressed by clickers