mps 3: self-assessment donald r. woods chemical engineering department mcmaster university hamilton,...

MPS 3: Self-assessmentMPS 3: Self-assessment

Donald R. WoodsChemical Engineering Department

McMaster UniversityHamilton, Ontario

Canada

1

MPS 3: Self-assessmentMPS 3: Self-assessment

2

MPS 3: Self-assessmentMPS 3: Self-assessmentWhy important? 1.Motivates us. 2.Develops self confidence.3.Helps us to see where we are.4.Skill needed throughout life.5.Guides us in modifying our life.6. Develops positive self image.7. Improves learning.

3

MPS 3: Self-assessmentMPS 3: Self-assessment

Pretest: Use an “x” to rate yourAwareness & Skill

Time 10 s Finish by _________

Objectives... Read over...

Time _____ Finish by _________

Pretest: Use an “x” to rate yourAwareness & Skill

Time 10 s Finish by _________

Objectives... Read over...

Time _____ Finish by _________

4

MPS 3: Self-assessmentMPS 3: Self-assessment

Where it fits in

5

MPS 3: Self-assessmentMPS 3: Self-assessment

Misconceptions about assessment

Is not freedom to give yourself 100%is not evil; not something to be avoidedis not an assessment about personal worth

is about performance

is based on evidence

6

MPS: Self-assessmentMPS: Self-assessmentWhy important for learning?Provides internal motivation for learning.

Gibbs says"Whoever owns the assessment, owns the learning.”

Novak and Schwab say “assessment is one of 5 key elements of effective

learning.”

7

MPS 3: Self-assessmentMPS 3: Self-assessment

8

Why important for life?

Your performance will be assessed by others; you should know what is expected in the assessment process.

You will assess the performance of others; you should know how to do it empathetically and correctly.

Self-assessment builds your self-confidence.

Self-assessment is a key part in personal goal setting.

Self-assessmentSelf-assessment

Research evidence that self-assessment is reliable and valid:

Teacher as standard: Brown and Pendlebury "Assessing Active Learning" 1992

within ± 10% underestimate -10% overestimate +10%

Self 76% 23 1Peer 80 6 14

9

Self-assessmentSelf-assessment

10

MPS 3: Self-assessmentMPS 3: Self-assessment

Activity:

11

MPS 3: Self-assessmentMPS 3: Self-assessment

I can do it!

12

MPS 3: Self-assessmentMPS 3: Self-assessment

Done!Looks goodScore it

13

MPS 3: Self-assessmentMPS 3: Self-assessment

14

MPS 3: Self-assessmentMPS 3: Self-assessment

15

MPS 3: Self-assessmentMPS 3: Self-assessment

What happened?

16

MPS 3: Self-assessmentMPS 3: Self-assessmentPrinciples, Assessment is1. based on performance - not personalities.2. based on evidence - not feelings.3. done for a purpose with clearly-defined performance

conditions.4. done in the context of published goals, measurable

criteria and pertinent, agreed-upon forms of evidence.

5. based on wide variety of different evidence.

17

MPS 3: Self-assessment MPS 3: Self-assessment

18

MPS 3: Self-assessmentMPS 3: Self-assessmentGeneral Guidelines1. Goals: What is being assessed? Who creates? Are the goals explicit and

published?2. Criteria: related to the goals? Can each criterion be measured? Who

creates ? Are the criteria explicit and published?3. Form of evidence: Consistent with the criteria? 4. Resources: Possible to achieve in the time and with the resources

available? 5. Assessment process: purpose? Under what conditions is the student’s

performance assessed? Who assesses? What feedback is given by the assessor? Form of feedback? Timing of feedback? Who delivers the feedback?

6. Training in the assessment process: Student and the assessor received training in assessment?

19

MPS 3: Self-assessmentMPS 3: Self-assessment

20

MPS 3: Self-assessmentMPS 3: Self-assessmentActivity:You want to show someone that you know how

to brush your teeth. The subgoal is “to put the toothpaste on the tooth brush.”

As individual write the goal in clear words so that there is no ambiguity in the task of “putting toothpaste on your tooth brush.”

TIME 4 min

Activity:You want to show someone that you know how

to brush your teeth. The subgoal is “to put the toothpaste on the tooth brush.”

As individual write the goal in clear words so that there is no ambiguity in the task of “putting toothpaste on your tooth brush.”

TIME 4 min

21

MPS 3: Self-assessmentMPS 3: Self-assessment

22

Demo

MPS 3: Self-assessmentMPS 3: Self-assessment

ObtainingNot observableYou should know

the difference between a circle & and ellipse.

At the end of this activity you will know atomic structure.

observable goals: ImprovedGiven a sketch of a variety of circles &

ellipses, you can point to the circles and be correct 90% of the time.

Given the name of an element, you will write out the state of the orbitals using spectroscopic notation...

23

MPS 3: Self-assessmentMPS 3: Self-assessmentDO NOT USE

knowfeelunderstandbe aware ofplaninterpretsolvesize

DO NOT USEknowfeelunderstandbe aware ofplaninterpretsolvesize

USEdescribepoint toconstructcalculatedeterminewrite outlistshow how to

24

MPS 3: Self-assessmentMPS 3: Self-assessment

Activity Obtaining well-stated Goals

As _______________________For Joe's goals, circle a response to show whether the stated goal is unambiguous and observable or not..Evidence sheet __________

TIME _____ **********************************************DISCUSSTIME _______

Activity Obtaining well-stated Goals

As _______________________For Joe's goals, circle a response to show whether the stated goal is unambiguous and observable or not..Evidence sheet __________

TIME _____ **********************************************DISCUSSTIME _______

25

MPS 3: Self-assessmentMPS 3: Self-assessment

Activity:Repeat the activity for "Brush your teeth"

Evidence sheet ______ and revise as needed.

TIME ____ FINISH BY _____

Activity:Repeat the activity for "Brush your teeth"

Evidence sheet ______ and revise as needed.

TIME ____ FINISH BY _____

26

MPS 3: Self-assessmentMPS 3: Self-assessmentCriteria

Def: measuring instrument used toassess merit, value, worth, acceptability, goal reached.

27

MPS 3: Self-assessmentMPS 3: Self-assessmentGoalTo operate a car safely on a 4-

lane road so that can stop in time if the car ahead stopped suddenly.

Be creative

Open car door with key

CriteriaSpeed of reflexes < 3 sDistance separating cars > 15 m

Generate 50 ideas in 5 minIdeas in > 7 classes

Select correct key in 2 attemptsInsert key the full depth in 2 attemptsRotate the key so that the lock pops up

& door can be opened in 2 attempts

28

MPS 3: Self-assessment

Make criterion measurable

Vague:

silentvaluablegoodworthyinexpensive

< 50 db at 3 m

< $50

29

MPS 3: Self-assessmentWhich is the longest string?

30

MPS 3: Self-assessmentLongest string?White string... If you can’t unravel the yellowYellow string... If you can unravel it.So What?Need to specify the “Given” conditionsGiven that you cannot unravel the strings, which

is the longest string?The Given condition is important to specify

31

MPS 3: Self-assessmentMPS 3: Self-assessmentActivity:Worksheet __________ as individualdo problem __fastest writer___

TIME ____ FINISH BY _____

Discuss with neighbour

Activity:Worksheet __________ as individualdo problem __fastest writer___

TIME ____ FINISH BY _____

Discuss with neighbour

32

MPS 3: Self-assessmentMPS 3: Self-assessmentActivity. Criteria, Toothpaste on the tooth brushAs _____________ for each well-stated subgoal identifya measurable criteria

Evidence sheet _______ and revise as needed.

TIME ____ FINISH BY _____

Activity. Criteria, Toothpaste on the tooth brushAs _____________ for each well-stated subgoal identifya measurable criteria

Evidence sheet _______ and revise as needed.

TIME ____ FINISH BY _____

33

MPS 3: Self-assessmentMPS 3: Self-assessmentActivity:As individual, Summarize for yourself what you

have learned about writing observable goals with measurable criteria

Use reflection sheets

TIME 5 min

Activity:As individual, Summarize for yourself what you

have learned about writing observable goals with measurable criteria

Use reflection sheets

TIME 5 min

34

MPS 3: Self-assessmentMPS 3: Self-assessmentEvidenceWe have Goals

- measurable criteria- sufficient resources to be able to achieve the goals in the time and with the resources available

We need to have/take opportunity to gather EVIDENCE

to support a claim that we have reached the goal!

35

MPS 3: Self-assessmentMPS 3: Self-assessmentWhat constitutes evidence? Some examples include: written reflections written activities videotaped activities peer and self-completed, standardized feedback forms.

• In assessment, focus on the evidence.

Journal writing integrates the evidence and helps you to make

claims; the journal becomes the evidence.

36

MPS 3: Self-assessmentEvidence, Example: written reflections

Importance of reflection: thinking about what you have experienced in the past, including knowledge, attitudes, feelings, surprises, reactions to what you did, what others did, felt and responded.

Research says.... Kimbell et al. (1991) “problem solving skill improved if written reflection was required throughout the problem solving process”

Schon (1987) “reflection is needed to educate the professional practitioner”

Harris (1993) “reflection develops our skill.”

37

MPS 3: Self-assessmentMPS 3: Self-assessmentEvidence Example: brush teeth Goals... so that both performer & assessor know what is expectedCriteria ... so that both performer & assessor know what is expectedEvidence:

● written reflections.. you write after the task● written activities.. written evidence of the different efforts to improve [form 300] plus related activities for Joe’s goals; and criteria activity● videotape of you brushing teeth.. OK but assess● written peer feedback

Then, look at the evidence and see the degree to which the goals have been achieved.

38

MPS 3: Self-assessmentMPS 3: Self-assessmentEvidence Example: Goals meeting activities in PBL Goals... so that both performer & assessor know what is

expected; see also MPS 36 goalsCriteria ... so that both performer & assessor know what is

expectedEvidence:● written reflections.. you write after the task● list of learning issues generated● tutor’s written response to your list● self assessment of progress toward target skills● group contract● reflective journal● agenda for the meeting

39

MPS 3: Self-assessmentMPS 3: Self-assessmentExample applications of self-assessment:1. Resume writing: self-assessment your skills that you bring to a

company2. Personal growth project: set goals, criteria and forms of

evidence for an activity you always wished you could do (learn a language, ball room dancing, gourmet cooking, lose weight, play the piano)

3. Reflective journal about your skill development from the MOS workshops.

4. Applications for PBL

Example applications of self-assessment:1. Resume writing: self-assessment your skills that you bring to a

company2. Personal growth project: set goals, criteria and forms of

evidence for an activity you always wished you could do (learn a language, ball room dancing, gourmet cooking, lose weight, play the piano)

3. Reflective journal about your skill development from the MOS workshops.

4. Applications for PBL

40

MPS 3: Self-assessmentMPS 3: Self-assessment

Application # 1: Resume writingAssess your skills for a resume

· be quantitative· initiative shown· commended for· communication/leadership

amount of supervision

Application # 1: Resume writingAssess your skills for a resume

· be quantitative· initiative shown· commended for· communication/leadership

amount of supervision

41

MPS 3: Self-assessmentMPS 3: Self-assessmentInitial effort• I play the piano.

• Swept the floors in hospital

• lifeguard at a pool

Revised• Grade 9 RCM; lead 10

sing songs per year; perform under pressure

42

MPS 3: Self-assessmentMPS 3: Self-assessment

Activity:As an individual complete one “Skills

Background” worksheet for work, spare time or school

add descriptorsTIME ___ FINISH BY _____Descriptors: Abstracting, administer, advise,

analyze, anticipate, appraise, arrange, assemble, budget, calculate, classify, etc.

Activity:As an individual complete one “Skills

Background” worksheet for work, spare time or school

add descriptorsTIME ___ FINISH BY _____Descriptors: Abstracting, administer, advise,

analyze, anticipate, appraise, arrange, assemble, budget, calculate, classify, etc.

43

MPS 3: Self-assessmentMPS 3: Self-assessmentExample: Store clerk

“handled over 20 customers/day; sales about $1000/day, managed complaints, commended for my poise with difficult customers., developed accountability, good interpersonal skills”

Quantitative: 20, $1000Identified skills developed here:

accountability, interpersonal skills, poise

Activity:Rewrite the description of

activity so as to include the descriptors, extent, responsibility, initiative

As Individual TIME _______

Discuss with neighbour:

44

MPS 3: Self-assessmentMPS 3: Self-assessmentEmployers are looking for your unique skills and how you know you have

these. Example skills: communication, leadership, maturity, take advantage of

life’s opportunities, have short and long term goals, have balance in lifeNaturally, we want to say “I’ve got them all!” but we need evidence.

Skills you bring: List 7 bits of evidence about where the skills were developed

For each listing of evidence:

be quantitative: how much? How many? make consistent with skills claiming

45

MPS 3: Self-assessmentActivity:Discuss with neighbour the resume of Mary

JaneTIME ______________________________________________Write reflections about assessment and about

resume writing as an application of self-assessment TIME ______

Activity:Discuss with neighbour the resume of Mary

JaneTIME ______________________________________________Write reflections about assessment and about

resume writing as an application of self-assessment TIME ______

46

MPS 3: Self-assessment“From my work at the hospital and the children’s camps, I can

work well with others, perform well under stress and show initiative.”

“Because I had a chance to travel widely and to live in different countries, I gained invaluable insight into people as races and as individuals. As a result I can adapt quickly to new surroundings and to people with different social values. “

Activity: Provide a resume, a covering letter for a summer job in the engineering department of Spruce Mills Pulp and Paper

47

U3: Self-assessment#2 Personal Growth ProjectActivityFor a personal goal: cook, dance, manage stress, time

management, lose weight, exercise program

create observable goals, measurable criteria, and types of evidence you will gather over the next two months

TIME ___ FINISH BY ____

48

U3: Self-assessment#3 Journal writing of skill Developed in MPS

49

MPS 3: Self-assessment

50

#3 Journal writing

U3: Self-assessment

#3 Journal writingMPS alumni response:

51

MPS 3: Self-assessment#4 PBL

52

MPS 3: Self-assessment#4 PBL

53

MPS 3: Self-assessment#4 PBL

54

MPS 3: Self-assessment#4 PBL

55

MPS 3: Self-assessmentMPS 3: Self-assessment

56

SummaryReturn to pretest: Use a circle to summarize your

rating of yourAwarenessSkillTime 10 s _________________________________________The Objectives are:...

SummaryReturn to pretest: Use a circle to summarize your

rating of yourAwarenessSkillTime 10 s _________________________________________The Objectives are:...

MPS 3: Self-assessmentMPS 3: Self-assessment

DISCOVERY

57

Assessment & student learning

Options

58