beyond’volunteering:measuring’ thesocialimpact ... · beyond’volunteering:measuring’...

BEYOND VOLUNTEERING: MEASURING THE SOCIAL IMPACT

CASE STUDY -‐ VOLUNTEERING MATTERS

March 2018

Thaddaeus Douglas, Impact and Evalua<on Manager at Volunteering Ma?ers

Aims and objecBves

Aim: provide an overview of our impact and evalua<on framework

Objec<ves:

Volunteering Ma?ers

The steps taken to develop our framework

Making the case for evalua<on and impact

Statement of purpose

Introduc<on to the framework: data collec<on across three levels

Preliminary results

What next?

1.

2.

3.

4.

5.

1

6.

7.

Volunteering MaQers

2

Volunteering MaQers is a naBonal charity leading UK volunteering in policy and pracBce.

Vision: a society in which everyone can par<cipate in their community through volunteering.

Mission: to invest in people’s ability to volunteer, thereby reducing inequali<es and isola<on, improving health and wellbeing and building a stronger and more inclusive society.

Our values: Honest and transparent Collabora<ve Ambi<ous Innova<ve Inclusive

Volunteering MaQers

3

Volunteering MaQers

Strategic priori<es:

To increase our reach and impact

To provide the best possible experience for volunteers and ensure their voices are heard

To provide leadership on effec<ve volunteering, influencing public policy and public service design

4


5

Source: NPC – Four Pillars Approach

Strategic vision Leadership

Case for impact measurement

Map your theory of change

PrioriBse what you measure

Choose the level

of evidence

Select your source

and tools

EffecBve measurement framework developed Step 1 – Map your theory of

change

Step 2 – Priori<se what you measure

Step 3 – Choose your level of evidence

Step 4 – Select your sources and tools

THE RESOURCES

VOLUNTEER TIME

STAFF TIME AND SALARY

ADVERTISING AND RECRUITMENT MATERIALS

INDUCTION AND TRAINING MATERIALS

VOLUNTEER EXPENSES

THE THINGS YOU DO WITH RESOURCES

VOLUNTEER INDUCTION AND TRAINING

HOME VISITS

THE PRODUCTS OR SERVICES THAT A PROGRAMME DELIVERS

NUMBER OF VOLUNTEER SESSIONS

NUMBER OF FAMILIES VISITED

THE INTEMEDIARY CHANGES, BENEFITS AND OTHER RESULTS THAT A PROGRAMME BRINGS ABOUT

INCREASE IN SOCIAL CONTACT FOR PARENTS

INCREASED ACCESS TO LOCAL ACTIVITIES / SERVICES FOR FAMILIES

INCREASED CONFIDENCE AND SELF ESTEEM

THE BROAD LONG-‐TERM EFFECTS OF THE PROGRAMME OR PROJECT

REDUCED ISOLATION OF FAMILIES

IMPROVED LIFE CHANCES OF CHILDREN

GREATER AWARENESS OF VOLUNTEERING

INPUTS ACTIVITIES OUTPUTS OUTCOMES IMPACT

Source: Volunteer Impact Assessment Toolkit


6

Source: Volunteer Impact Assessment Toolkit

Human capital

People’s knowledge, skills and health

Economic capital

Benefits or costs with financial value

Social capital

More coopera:ve rela:onships between people

Cultural capital

A sense of one’s own iden:ty and understanding of others iden:ty

Volunteers •  Increased personal development, such as growth in confidence and self esteem •  Increased skills such as digital •  Improved health

•  Increased access to training •  Increased employment prospects •  Increased earning power

•  New friendships, contacts and networks •  Greater involvement in ac<vi<es •  Enhanced sense of trust in others

•  Be?er understanding of own’s own iden<ty •  Greater apprecia<on of other people’s cultures

OrganisaBons •  Increased personal development of staff •  Increased levels of skills for the organisa<on

•  Increase in financial value / increased costs to organisa<on for involving volunteers •  Greater income for the organisa<on

•  More volunteers and staff a?racted to the organisa<on •  Greater connec<on to community •  Enhanced reputa<on

•  Services are more reflec<ve of cultural diversity •  Greater diversity of organisa<on

Beneficiaries •  Increase personal development •  Increased skills •  Improved physical or mental health •  Greater sense of wellbeing among beneficiaries

•  Increase access to services that they would otherwise have to buy •  Increased employability •  Improved financial situa<on for beneficiaries through services and signpost provided

•  New friendships •  Enhanced trust in others •  Greater involvement in local ac<vi<es

•  Greater sense of belonging to a group and taking part in culture and expressing values •  Increased understanding of other people’s cultures

Community •  Greater health and wellbeing of ci<zens •  Improved skills – produc<ve workforce

•  Enhanced value for money in public services •  Increased employment •  Reduced an<-‐social behaviour

•  Increase social networks •  Enhanced trust and par<cipa<on •  More organisa<ons working together

•  Richer cultural life •  Greater tolerance of others

7

Source: NPC – A journey to greater impact – NPC approach to developing an impact measurement framework for an organisa<on

Get backing Develop systems Use data Review

1. Find senior champs

2. Make the case

for measure

3. Get external support

4. Designate an impact

lead

5. Develop a tailored system

6. Train frontline staff

7. Use results to improve

8. Publicise your results

9. Review and

improve your system


8

Making the case for data collecBon

To demonstrate our value

To showcase our achievements

To learn and improve

To facilitate income generaBon

opportuniBes

To show we are high performing

To screen and demonstrate need

To raise our profile in the sector

To increase effecBveness and beQer results

To ask difficult quesBons of ourselves

To make reliable assessment about expansion and scale

To understand what works and what

doesn’t

InformaBon readily available

To inform and influence policy

To assess progress towards targets

Useful informaBon to aid decision-‐

making

To allocate resources

To beQer allocate resources

To get the best results for

beneficiaries

To understand unintended benefits

and limitaBons

To determine success factors

To inform future prioriBes

To refine or make clear your mission

and purpose

Creates accountability and

transparency

To help funders make the right

decisions

9

We collect informaBon across three levels…

Level 1 – Universal StaBc demographic data and key outcomes for all volunteers and beneficiaries

Level 2 – Pillar specific Key outcomes we measure of our work in four strategic pillars (young people, disabled people, families and older people) meaning we are consistent with measures between groups.

Level 3 – Programme specific

Key outcomes we measure within a specific programme.

10

LEVEL 1 UNIVERSAL – 5 CORE ‘ASKS’ FOR ALL PROGRAMMES – WHAT WE EXPECT TO COLLECT FROM ALL VOLUNTEERS AND BENEFICIARIES

Gender Date of Birth (Age) Postcode Ethnicity Disability

Religion English as a second language Place of birth / na<onality Sexuality Economic ac<vity

LEVEL 1 UNIVERSAL – 2 CORE OUTCOMES FOR ALL PROGRAMMES – BASELINE AND FOLLOW-‐UP (BEFORE AND AFTER) – WHAT WE EXPECT TO COLLECT FROM ALL VOLUNTEERS AND BENEFICIARIES

Ci<zenship and involvement in the community

Wellbeing

Level 1 Universal

11

LEVEL 2 PILLAR SPECIFIC – WE EXPECT ALL PROGRAMMES TO MEASURE AT LEAST TWO OF THEM (NOT ALL OF THEM)

YOUNG PEOPLE ARE BETTER PREPARED FOR ADULTLIFE

DISABLED PEOPLE FULFILL THEIR POTENTIAL

FAMILIES ARE LESS ISOLATED AND BETTER SOCIALLY ENGAGED

OLDER PEOPLE HAVE IMPROVED HEALTH AND WELLBEING

(1)  Access to educa<on, employment and training / keeping in educa<on, employment or training / economic ac<vity

(2)  Be?er life and employability skills

(3)  Increased confidence and self esteem

(1)  Improved mental wellbeing

(2)  Be?er par<cipa<on and inclusion / greater involvement

(3)  Increased independence and independent living skills

(1)  Improved family mental health / family func<oning

(2)  Improved parental skills

(3)  Reduc<on in the number of children who come off a CPP / CiN plan reduced risk of being on a Child Protec<on Plan or moving into care

(1)  Reduced isola<on and loneliness

(2)  Increased sense of purpose

(3)  Maintained health

Level 2 Pillar Specific

12

LEVEL 3 PROGRAMME SPECIFIC – THE KEY OUTCOMES WE MEASURE WITHIN A SPECIFIC PROJECT

YOUNG PEOPLE ARE BETTER PREPARED FOR ADULTLIFE

DISABLED PEOPLE FULFILL THEIR POTENTIAL

FAMILIES ARE LESS ISOLATED AND BETTER SOCIALLY ENGAGED

OLDER PEOPLE HAVE IMPROVED HEALTH AND WELLBEING

Examples… (1)  Gain qualifica<ons

and accredita<on (2)  Be?er aspira<ons (3)  Be?er knowledge

about healthy rela<onships

Examples… (1)  Reduced reliance on

state services (2)  Less isolated (3)  Improved aitudes

or percep<ons towards disabled people

Examples… (1)  Economic ac<vity (2)  Health ea<ng –

reducing child obesity

(3)  Reducing domes<c violence

Examples… (1)  Improved physical

health and mobility (2)  Improved

independence (3)  Be?er quality of

life / ageing be?er

Level 3 Programme Specific

13

Preliminary results – Level 1 Gender

Age

Ethnicity

Male Female Totals

Grandmentors A 82 (50%) 83 (50%) 166

Local authority A 210 (60%) 140 (40%) 355

Grandmentors B 48 (60%) 32 (40%) 80

Local authority B 160 (58%) 120 (42%) 280

Grantmentors Totals 130 (53%) 115 (47%) 245

England 39,670 (56%) 30,780 (44%) 70,440

London 5,830 (59%) 4,030 (41%) 9,860

1%

5%

28%

57%

9%

1%

8%

35%

56%

0%

0%

0%

16%

59%

25%

26 and over

23 to 25

20 to 22

17 to 19

14 to 16

Asian or Asian Bri<sh 25%

Black or Black Bri<sh 25%

Mixed 4%

Other 3%

Other ethnic group 7%

White 36%

Asian or Asian Bri<sh

Black or Black Bri<sh

Mixed

Other

Other ethnic group

White

Area by Index of MulBple DeprivaBon % of LSOAa by Decile 1 = most deprived, 10= least deprived

1.49%

1.49%

1.49%

1.49%

1.49%

10.45%

10.45%

17.91%

40.30%

13.43%

10

9

8

7

6

5

4

3

2

1

14

Preliminary results – Level 2

Grandmentors Total Local authority A NaBonal rate*

Local authority A rate*

In educa<on employment and training / volunteering (EET)

95% 96% 49% 59%

Not in educa<on employment and training / volunteering (NEET)

5% 4% 40% 36%

Remained in educa<on, employment, training / volunteering**

50% 38% -‐ -‐

Moved from not in educa<on, employment or training / volunteering to educa<on, employment or training / volunteering (NEET to EET)

43% 58% -‐ -‐

Remained NEET 5% 4% -‐ -‐

Analysis based on the most recent 40 cases where follow-‐up data is available shows that 43% moved from being NEET to EET.

Data shows that Grandmentors have supported half (50%) of the mentees to remain in educaBon, employment or training.

As illustrated in the table above, the naBonal rate at which care leavers aged 19, 20 and 21 are in educaBon, employment or training is at 49% Compared to 95% of care leavers supported by Grandmentors.

*Source: HM Government & Office of Na<onal Sta<s<cs – ‘Children looked aoer in England including adop<on: 2015 to 2016, published Feb 2017

15

VOLUNTEERING MATTERS MODEL OF INTERVENTION – SPORTING CHANCE THEORY OF CHANGE (LEVEL 3 & 4)

Needs Ac<vi<es Intermediate Outcomes Impact & long term goals

Increased par<cipa<on, building strong and inclusive communi<es

Older men are less isolated and

lonely Older men engage in more physical, social and health ac<vi<es

Older men eat more healthily

Male life expectancy is

less than female

Health inequali<es and

health challenges

Older men are at risk of isola<on and loneliness

Older men have an increased sense of purpose

Older men have increased

connec<on to the community

Older men are more likely to maintain and improve social

networks

Older men aged 50 and over design and

deliver a range of inclusive physical ac<vi<es from walking football to armchair

exercise for the benefit of other

older me

Older men engage in social ac<vi<es such as reminiscence

sessions

Older men engage in informa<on sessions and

health promo<on

ac<vi<es in non-‐tradi<onal healthcare seings

All male environments are cri<cal to engaging

older men

Informal physical, social or health

related a ac<vi<es are best delivered

away from tradi<onal

‘healthcare’ or ‘sports / fitness’

facili<es

Ac<vi<es delivered at different <mes

of the day, par<cularly in the evening are best suited for older

men

Outcomes of the induc<on, training and support mean volunteers have sufficient skills, knowledge AND

confidence enabling them to

deliver the ac<vi<es

Older men feel reassured

Older men feel more valued

Older men feel more engaged

Older men more likely to engage with services early on

Assump<ons

KEY

Ac<vi<es

Assump<ons

Intermediate outcomes

Ul<mate goal

Evidence from Spor<ng Chance Sheffield in 2017

Older men have improved health and wellbeing

Older men are more physically

ac<ve

Older men feel empowered

Outcomes for the volunteers and beneficiaries

Older men make new friendships

Accountability line

Older men feel more confident

83% feel empowered to take control of their own lives

96 ac<vity sessions delivered in 2017, exceeding the target of 30

100% made new friends

67% are ea<ng a healthier diet

83% are more confident

100% agree that SporBng Chance has given them a new lease of life

100% said that SporBng Chance has helped them connect with the local community, with 83% agreeing a lot

Two thirds (67%) said that SporBng Chance has helped them to beQer manage their health condiBon

Wellbeing life saBsfacBon score increased from an average of 5.9 at the start to 6.6 arer six months; feeling worthwhile score increased from 6.3 to 7.3 and happiness score increased from 6.0 to 6.3

33% smoke less, 17% reduced their medicaBon, 50% drink less alcohol, 67% have been to the doctor less

83% can move more easily

On a scale range from 5 to 25 (where higher scores indicate higher levels of loneliness), SporBng Chance parBcipants average a score of 9.9 at the beginning, reducing to 6.8 arer six months.

At the beginning, 71% felt strong belonging to their immediate neighbourhood, rising to 83% arer. The average for people aged 75 and over is 85%. The average for people aged 50 and over is around 79%

16

What next?

17

Further informaBon

Thaddaeus Douglas – Impact and Evalua<on Manager at Volunteering Ma?ers thaddaeus.douglas@volunteeringma?ers.org.uk

18

beyond’volunteering:measuring’ thesocialimpact ... · beyond’volunteering:measuring’...

Documents