1 whattoevaluate-webinar1

8/6/2019 1 WHATtoEvaluate-Webinar1

1/25

Welcome to theReframing Webinar on

WHAT to Evaluate Please let us know if you cant hear the music

playing by chatting in the chat pod

Please type your email address in the Chat Pod


2/25

Designing anEvaluation Strategy

for a

Statewide ProgramWebinar Series

Nancy Ellen Kiernan


3/25

Evaluation Webinars 5 sessions: July 20- Sept 9, 2009

repeated live a few days later

followed with an Office Hour

try out ideas for your evaluation hear from other Liaisons ask for other resources give suggestions


4/25

The 7 STEPS in designing an evaluationstrategy

October 1st : State ProgramEvaluation Strategy Worksheeton Extension Reframing Websitehttp://sharepoint.ag.psu.edu/coext/ProposalPrep/default.aspx

Graphic: 7 stepshttp://extension.psu.edu/evaluation/pdf/TS83.pdf


5/25

What is program evaluation?What is program evaluation?

A systematic process to gather data aboutyour program to

1. improve or expand the program

2. provide accountability


6/25

Standards for evaluation?Standards for evaluation?useful*

accurate

feasible

propitious

http://www.eval.org/EvaluationDocuments/progeval.html


7/25

To create an Evaluation Strategy,To create an Evaluation Strategy,you, your Program Chairs andyou, your Program Chairs and

Team need to decide:Team need to decide:WHATto evaluate

HOW to evaluate

USE of results


8/25

Todays Webinar

WHAT to EvaluateWHAT to Evaluate


9/25

To Determine WHAT to EvaluateTo Determine WHAT to EvaluateStep 1. decide what evidence yourstakeholders want about yourprogram

Step 2. clarify/add program

objectives

see Evaluation Strategy Worksheet and Tipsheet #83


10/25

Decide: Who are thestakeholders for your

program?

External to Extension

Internal


11/25

Internal Stakeholders (continued)

Program Chairs*

Your Team*

Publicity Person on Team

IT Liaison


12/25

Internal Stakeholders (continued)

Instructors*

County Educators on Program Team*

community leaders, Co. Commissioners

extension committee/Board members

annual reports county level

dossier/promotion see PAEXAMPLEs #30 and #31

Specialists/ County Educators on Team

Professional presentations or articles


13/25

To Determine WHAT to Evaluate

identify

stakeholders of your program \

the kind of evidence they want


14/25

LEVELS OF EVIDENCE

IMPACTS

OUTPUTS

INPUTS

7. End Results

6. Behaviors (practice change)

5. KASI Change

4. Reactions (to implementation by T.A.)

3. People Involvement

2. Activities

1. Resources


15/25

Why doing this?

You want to evaluate

Onlywhat is useful to team


16/25

in Deciding WHAT to Evaluate

Step 1. decide what evidence your stakeholders wantabout your program

Step 2. add/clarify program objectives

Are they all there? Too vague?

Make them specific, measureable, objective, realistic

see Evaluation Strategy Worksheet and Tipsheet #83


17/25

Measureable Program Objectives

Youth participating

in community clubswill show gains insubject matterknowledge in

leadership andpersonaldevelopment.

Youth 10-12 yr. old in

community clubs willbe able todemonstrate 3 newleadership skills

related to meetingmanagement and 3communication skills.


18/25

From Objective to Evaluation

Participants will believethat the Marcellus ShaleNatural Gas Explorationand Development

will be very importantfor the local economy

raises 2 veryimportantenvironmentalconcerns

How important is theMarcellus Shale NaturalGas Exploration andDevelopment for the localeconomy?

1 Not too important

2 Somewhat important3 Moderately important

4 Very important


19/25

SUMMARYYou want the Evaluation of your

statewide program to beuseful*

accurate

feasible

propitious


20/25

Therefore, consider

WHATto evaluate

HOW to evaluate dont start here

USE of results


21/25

SUMMARYSUMMARY

In considering WHATto evaluate,1. You, Program Chair and Team should decide:

Who are your stakeholders

What level of evidence do theywant/need to know

program improvement/expansion

accountability

If objectives are complete, specific et al.

2. Complete Steps 1 and 2 in the Statewide

Program Evaluation Strategy Worksheet


22/25

Questions?

Comments?


23/25

CLICK URL


24/25

Upcoming Webinars Session 1: WHAT to evaluate?

Repeat (live) Monday Aug. 3rd, 10:30-11:30

Office Hour Wednesday, Aug 5th, 1:30-2:30

Session 2: How Can Extension Claim Credit?

Thursday, Aug. 6th, 1:30-2:30

Repeat (live) Monday Aug. 10th, 10:30-11:30

Office Hour Wednesday, Aug. 12th, 1:30-2:30

Nancy Ellen Kiernan [email protected] (814) 863 7621


25/25

"Penn State is committed to affirmative action, equalopportunity, and the diversity of its workforce."

College of Agricultural Sciences Cooperative Extension