So you need to do an So you need to do an evaluation!evaluation!

Bob Hamblen, Colorado State UniversityBob Hamblen, Colorado State University

What outcomes do you want What outcomes do you want to measure?to measure?

How many people attendedHow many people attendedHow you improved your How you improved your

programprogramWhat people learnedWhat people learnedWhat practices were adoptedWhat practices were adoptedAny changes or impacts that Any changes or impacts that

occurred as a result of the occurred as a result of the programprogram

Who are you targeting Who are you targeting with your program?with your program?

Examples:Examples: Small-acreage ownersSmall-acreage owners RealtorsRealtors Decision makersDecision makers VolunteersVolunteers AgenciesAgencies

Things you need to do to Things you need to do to get desired outcomesget desired outcomes

Examples:Examples:WorkshopsWorkshopsClassesClassesOne-on-one trainingsOne-on-one trainingsNewslettersNewslettersQuestionnairesQuestionnairesTestingTesting

What resources do you need What resources do you need to make your program to make your program

happen?happen?

Examples:Examples:Staff timeStaff timeAudiovisual equipmentAudiovisual equipmentMeeting locationMeeting locationInstructional materialInstructional materialInstructorsInstructorsPartnershipsPartnershipsPossibly volunteersPossibly volunteers

Evaluation process reviewEvaluation process review

Start with what you want the Start with what you want the learner to do or learnlearner to do or learn

Steamboat Creek pre/post Steamboat Creek pre/post test datatest data

% Correct% Correct

Before Before (1996)(1996)

% Correct% Correct

After (1998)After (1998)

Program Program participantsparticipants 65%65% 76%76%

Non-Non-participantsparticipants 50%50% 49%49%

Washoe Valley pre/post Washoe Valley pre/post test datatest data

% Correct % Correct Before Before (1998)(1998)

% Correct % Correct After (2000)After (2000)

Random Random sample of sample of target target audienceaudience

63.8%63.8% 72.3%72.3%

Satisfaction with programSatisfaction with program

Steamboat Creek, 1998

Knowledge gainKnowledge gain

Steamboat Creek, 1998

Steamboat Creek, 1998

Behavior changeBehavior change

Septic system Septic system maintenancemaintenance

64% of respondents to a 64% of respondents to a survey (n=53) had pumped survey (n=53) had pumped their septic tanks within the their septic tanks within the past three yearspast three years

Water quality dataWater quality data

Before Before projectproject

After After diverting diverting

waterwater

Total Total phosphorusphosphorus 2.1 g/day2.1 g/day 0.5 g/day0.5 g/day

Suspended Suspended sedimentsediment 238.7 g/day238.7 g/day 11 g/day11 g/day

Example: A weed program Example: A weed program for for ssmallmall-a-acreage ownerscreage owners

You need resources such as:You need resources such as:InstructorsInstructorsAudiovisual equipmentAudiovisual equipmentWeed mountsWeed mountsHandoutsHandoutsMeeting facilityMeeting facilityAdvertising to get participantsAdvertising to get participantsPossibly volunteersPossibly volunteers

Action items:Action items:

Conduct the educational program Conduct the educational program (class, workshop, field (class, workshop, field demonstration, etc.)demonstration, etc.)

Teach weed curriculumTeach weed curriculumSupply weed identification books, Supply weed identification books,

mounts, etc.mounts, etc.Provide noxious weed samples for Provide noxious weed samples for

participants to identifyparticipants to identifyInvite participants to bring in their Invite participants to bring in their

own weed samplesown weed samplesPractice identification skillsPractice identification skills

• Short-term outcome: Be able Short-term outcome: Be able to correctly identify 8 of 10 to correctly identify 8 of 10 noxious weed samplesnoxious weed samples

• Medium-term outcome: Medium-term outcome: Change grazing practices to Change grazing practices to reduce weedsreduce weeds

• Long-term outcome: Reduce Long-term outcome: Reduce noxious weed population in the noxious weed population in the homeowner association by 90%homeowner association by 90%

Select the right evaluation Select the right evaluation tools to measure the desired tools to measure the desired outcomeoutcome

ReviewReview

Do the evaluation activityDo the evaluation activity

Evaluation processEvaluation process

Make the evaluation process the Make the evaluation process the first step in your program first step in your program planning!planning!