check it out at: webug.physics.uiuc/courses/ie.html

21
Cottrell Meeting (July/13/01): Pg 1 Check it out at: http://webug.physics.uiuc.edu/courses/ie.html Can Students Learn Concept-Based Problem Solving on the Web? Mats Selen July 13, 2001 Cottrell Scholars Meeting

Upload: zanta

Post on 05-Jan-2016

45 views

Category:

Documents


0 download

DESCRIPTION

Interactive Examples. Can Students Learn Concept-Based Problem Solving on the Web?. Check it out at: http://webug.physics.uiuc.edu/courses/ie.html. Mats Selen July 13, 2001. Cottrell Scholars Meeting. Overview. The Problem: - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 1

Check it out at: http://webug.physics.uiuc.edu/courses/ie.html

Can Students Learn Concept-Based Problem Solving on the Web?

Mats Selen

July 13, 2001Cottrell Scholars Meeting

Page 2: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 2

OverviewOverview The Problem:

When given a quantitative physics problem, most students immediately resort to an “equation manipulation” strategy to solve the problem.

Too many students see “concepts” and “calculations” as two totally separate and unrelated activities.» When given a quantitative question, most students will

NOT think about the CONCEPTS that are involved.» When given a qualitative question, most students will

never consider writing down an appropriate equation… math is NOT seen as a TOOL

Our Approach:Create web-based instructional materials that will promote

“concept-based” problem solving among our introductory students.» Interactive Examples (work by Gary Gladding) !

Page 3: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 3

Why we should stress concepts:Why we should stress concepts:

On this exam, the conceptual problems were worth about 30% of the total.

Physics 101 Midterm Exam 1, Spring 2000Physics 101 Midterm Exam 1, Spring 2000

Page 4: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 4

Traditional Homework:Traditional Homework:

Page 5: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 5

Limited help available…

Page 6: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 6

Interactive Examples (Socratic Interactive Examples (Socratic Dialogue)Dialogue)

when students click in “Help”…

Start by asking a numeric question(usually multi-step)

Page 7: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 7

…”Help” results in a discussion followed by some multiple-choice questions that lead them toward the answer…

Page 8: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 8

This dialogue can take several steps…

Page 9: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 9

…these steps are designed toteach students problem solvingapproaches as well as physics…

Page 10: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 10

Eventually they get another (simpler) numeric question whoseanswer is needed to solve the primary numeric question.

Page 11: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 11

Clicking on “Help” again results in asimilar dialogue as the first time,although one level “deeper”.

- Problems can be 4-5 levels deep

- Eventually they get enough info to solve the problem.

Page 12: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 12

Once they get right the answer

And somefollow-upquestions

They get arecap

Page 13: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 13

Structure:Structure:

Base question is a quantitative problem (multi-step).

Students can request help which comes in the form of more questions. Questions for which more help is always available. Questions that must be answered correctly to get more help.

Students can opt to answer the base question at any time.

Eventually, enough help is given to solve the problem.

Once base question is answered correctly: Full credit is given. A Recap is given (Conceptual, Strategic and Quantitative

Analyses). Follow-Up Questions (optional, i.e. no credit) are asked.

Page 14: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 14

REAL Data: Student LogsREAL Data: Student Logs We record all student submissions on IEs: (the conversation)

Page 15: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 15

These data are very useful These data are very useful for education research:for education research:

For example, some questions we might ask ourselves are: How “engaged” are students by the IE’s ?How, exactly, are they learning?

These can be investigated by analyzing the student logs:How much time do students spend on the IEs?

How well do the students do on their first response to M/C questions?

How deep into the IE do students go?

Page 16: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 16

How Much Time Do Students Spend on IEs?How Much Time Do Students Spend on IEs?

0

5

10

15

20

25

30

trig

vecto

r

cartra

in

catch

ball

arro

w

balloon

carpend

twostrin

gs

belt

inclin

e

bobsle

d

Av

era

ge

Tim

e S

pe

nt

(min

)

Physics 101

0

5

10

15

20

25

30

particle

beam

pendulum

capacito

r

threecharges

RCI

RCII

RCIII

copperwire

fields

wall

emf

flux

loop2

Physics 101 IE #

Av

era

ge

Tim

e S

pe

nt

(min

)

Physics 102

Page 17: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 17

How Well Do Students Do on their How Well Do Students Do on their First Response to M/C Questions?First Response to M/C Questions?

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

trig

vecto

r

cartra

in

catch

ball

arro

w

balloon

carpend

twostrin

gs

belt

inclin

e

bobsle

d

IE Question #

Av

g G

rad

e o

n R

ad

io Q

ue

sti

on

s

Physics 101

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

particle

beam

pendulum

capacito

r

threecharges

RCI

RCII

RCIII

copperwire

fields

wall

emf

flux

loop2

IE Question #A

vg

Gra

de

on

Ra

dio

Qu

es

tio

ns

Physics 102

Page 18: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 18

How Deep Do Students Go in IEs?How Deep Do Students Go in IEs?

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

trig

vecto

r

cartra

in

catch

ball

arro

w

balloon

carpend

twostrin

gs

belt

inclin

e

bobsle

d

IE Question #

Av

g D

ep

th I

nto

IE

Physics 101

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

particle

beam

pendulum

capacito

r

threecharges

RCI

RCII

RCIII

copperwire

fields

wall

emf

flux

loop2

IE Question #A

vg

De

pth

In

to I

E

Physics 102

Page 19: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 19

Does IE Performance Correlate Does IE Performance Correlate with Exam Performance?with Exam Performance?

Compare Physics 101 Hour Exam grade with Indicators of IE participation

0

5

10

15

20

25

0 20 40 60 80 100

Average Hour Exam 1 Score

Aver

age

No o

f Fol

low

ups

Done

0

10

20

30

40

50

60

70

80

0 20 40 60 80 100

Average Hour Exam 1 Score

Aver

age

Scor

e on

Firs

t Res

pons

e to

IE Q

uest

ions

• Observe some correlation between (unclear how to interpret this).

• Will probably advertise this to students to encourage participation.

Page 20: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 20

StatusStatus

Algebra-based Courses at Illinois (Physics 101 and 102).Approximately 60 IEs were used in these courses in Fall 00.Very popular!

Used heavily in Physics 100.Remedial class for at-risk students.I.E. form most of the homework for this class.Since Physics 100 has no lecture, IE’s are particularly useful

since they provide some “give & take” type dialogue.

Will implement in calculus based sequence next.

Page 21: Check it out at:  webug.physics.uiuc/courses/ie.html

Cottrell Meeting (July/13/01): Pg 21

What Do Students Think About IEs?What Do Students Think About IEs? Always Very Positive

Independent (OIR) Focus Group Study» 100% of students preferred IEs to the usual computer problems» The half that do the optional follow-ups felt they gained confidence

Our End of Term Surveys» 87% said that the interface was “very intuitive” or “reasonably

intuitive”» How effective were IEs at helping you to develop a problem solving

strategy? “very effective” (31%), “effective” (56%), “not very” (12%) Direct Comment Facility from IE itself:

» Low response, but 100% positive (very unusual for computer feedback)

» “the drawn out explainations are much like a one on one learning environment and are very helpful not only in the problem but in the concepts behind it”

» “if these interactive examples were not there to help me i would have gone insane trying to figure out these problems....and this makes me understand the problems much better than if i were to get help from someone in the class...i believe anyways...because this way i'm figuring it out basically on my own.…”