using evaluation as a development tool anthony j. alberta, ph.d. president sonoran research group...

27
Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Upload: zoe-phillips

Post on 18-Dec-2015

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Using Evaluationas a

Development ToolAnthony J. Alberta, Ph.D.

President

Sonoran Research Group

Phoenix, Arizona

Page 2: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation

1. Diverts resources from our real work.

2. Increases staff workload.

3. Tells us things we don’t want to know, don’t care about, or nothing at all.

4. Jeopardizes our funding streams.

Page 3: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation diverts resources from our real work.

Increase available resources using effective evaluation activities to

demonstrate the value of your services.

Page 4: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation increases staff workload.

Integrate evaluation activities into operating processes.

Page 5: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation tells us things we don’t want to know, or don’t care about,

or nothing at all.

What would you like to know?

Or all of these things.

Page 6: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation jeopardizes our

funding streams.

No one ever lost funding because

2. They engaged in a formal effort toimprove the services provided by their organization.

1. They demonstrated that their organization achieved its’ goals in a cost effective manner.

Page 7: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Evaluation

A systematic process through whichwe gather information to either answeror form questions.

Page 8: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

What

Did

We

Do?

Outcome Evaluation

Summative Evaluation

Quantitative Evaluation

Page 9: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

HowDid

WeDo

It?

Process Evaluation

FormativeEvaluation

Qualitative Evaluation

Page 10: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Your Research Agenda

You already have a research agenda:

You provide a service to fill a need in your community, and

You believe this service works.

Page 11: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

1. We identified hunger as a problem in our community

2. We hypothesized that lack of access to food caused that hunger.

3. We provided food through the Tastes Good Food Bank to alleviate the hunger.

Your Research Agenda

Page 12: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

In other words, you have developed a research question, used that question to form a hypothesis, and are engaged in testing that hypothesis.

Your Research Agenda

Page 13: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

We can even state this hypothesis in testable form as a null hypothesis:

Providing food to people through the Tastes Good Food Bank will not reduce hunger in our community.

Your Research Agenda

Page 14: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Regardless of how we express the question or approach the delivery of the service, we are still distributing food.

Your Research Agenda

Page 15: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Additionally, you are already collecting some sort of data.

Your Research Agenda

Page 16: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

So, what’s the point?

Do something with the information you already have!

With a little bit of help, or a little bit of thought, you can use this information to demonstrate the value of your service to potential or existing supporters.

Page 17: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

So, what’s the point?

Last year, the Tastes Good Food Bank provided 400 food boxes to members of our community.

Please help us continue to provide this necessary service.

Page 18: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

So, what’s the point?Last year, the Tastes Good Food Bank provided 400 food boxes to members of our community.

- 200 of these food boxes went to households that included children under 5 years of age.

- 30% of the food boxes went to households that would otherwise not have eaten that day.

Page 19: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

So, what’s the point?

Please help the Tastes Good Food Bank meet this growing need in our community.

- 20% of these food boxes went to households that have not previously sought assistance.

Page 20: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Here’s the pointThe Tastes Good Food Bank enhanced their appeal by asking clients to answer three questions when they requested assistance:

1. How many people are in your household?

2. Have you been here before?

3. What would you eat tonight if we had not provided a food box?

Page 21: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Here’s the point

They can even say that there is evidence that the Good Taste Food Bank reduces hunger in the community it serves – they have tested their hypothesis.

Page 22: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Here’s the point

Additionally, based on the finding that half of the food boxes went to

households that included at least one child under five, food bank staff worked out an arrangement with a local used

book store and began including a children’s book in each box.

Page 23: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Build on what you currently do.

Most food banks do not wait until they can provide nutritionally complete food

boxes before they provide food.

Most ballet companies don’t wait until they can recruit famous Russian prima

donnas before they produce Swan Lake.

Page 24: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Build on what you currently do.

But most non-profit organizations think they need to wait until they can implement a Solomon 4-group

experimental design, complete with ANOVA statistical techniques, before they

start their evaluation activities.

Page 25: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Build on what you currently do.

Start simply, build your organization’s capacity to conduct evaluation.

Seek partners, seek help.

Build your data sets.

(Use your data longitudinally)

Page 26: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona

Use your findings externally to demonstrate the value of your

organization’s work to supporters and potential supporters.

Use your findings internally to enhance the quality of the services you deliver.

Page 27: Using Evaluation as a Development Tool Anthony J. Alberta, Ph.D. President Sonoran Research Group Phoenix, Arizona