evaluating diy happiness: a guide · the evaluation framework accounts for the fact that courses...

21
1 Evaluating DIY Happiness: a guide Dan Robotham The McPin Foundation, May 2018

Upload: others

Post on 22-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

1

EvaluatingDIYHappiness:aguide

DanRobotham

TheMcPinFoundation,May2018

Page 2: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

2

IntroductionBackground to the Wheel of Wellbeing and DIY Happiness Course TheMentalHealthPromotionTeam(MHPT)atSouthLondonandMaudsleyNHSFoundationTrust(SLaM) developed a range of courses which use the Wheel of Wellbeing (WoW) framework toimprovepeople’sunderstandingofmentalhealthandwellbeing.TheWheelofWellbeingisavisualframeworkmadeupofsixthemesthatunderpinmental(andphysical)healthandwellbeing:body,mind,spirit,people,place,planet. It isasimpleapproachtopromotingpositivementalhealthandwellbeingbasedonresearchthatshowshowcertainpracticescanimprovemood,reducetheriskofdepression,strengthenourrelationshipsandkeepushealthy.

BoththeWheelofWellbeingandthefirstwaveofpromotionactivities(aseriesofeightworkshopsknown as ‘Do-It-Yourself Happiness’) were developed in 2009 as part of the Well LondonProgramme, a city-wide health improvement programme. Since then, WoW has grown into awebsitewithresourcesavailabletodownload,ahappinessgame,andaseriesofworkshopsrangingfromahalf-daytastertoafullDIYHappinessprogramme.

DIYHappinesshasbeenadaptedaroundtheworld increativenewways, fromavolunteer ledDIYHappiness coursedevelopedanddelivered in London, toa threeday studentwellbeing festival atWollongongUniversityinAustralia.Theevaluationframeworkaccountsforthefactthatcoursesareoccurringindifferentlocations(includingcountriesoutsidetheEuropeanEconomicArea).

What is evaluation? Anevaluation isaseriesofactivitieswhere information issystematicallycollectedandanalysedtogaininsightsabouttheimpactofaservice.Itlooksatquestionssuchas:

- Istheservicedeliveringitsaimsandobjectives?- Howisitachievingtheseaimsandobjectives?- Whatshouldwechangetoimprovetheexperienceofpeopleusingtheservice?

Datacollectedcanbequantitative(numbers)orqualitative(words).Mostofthedatacollectedherewill be done through surveys to gain quantitative andqualitative data. Evaluation should be builtintoprogramdelivery,socoursefacilitatorsandadministratorsshouldbeabletoconductevaluationtasks (such as administering surveys, storing and entering data, analysing data). Evaluation tasksshouldnotbecometootime-intensiveforthosecollectingthedata,orforcourseparticipantswhoarecompletingsurveys.Evaluationshouldfitintothecontextoftheservice.

One important aspect ofDIYHappiness is thepotential ‘ripple effect’. Peoplewhohave attendedcourses in the past may deliver courses or activities inspired by DIY Happiness elsewhere. Inevaluating the programme it is important to understand the impact beyond attending the courseitself,i.e.,whatdopeopledoaftertheyhavecompletedthecourse?

Background to this document The information in this guidance comes from previous experience of evaluating DIY Happinesscourses. It is based on a Theory of Change which was developed to inform the programme (seeFigure1).PilotsurveysweredevelopedusingtheTheoryofChangemap.Thesewereadministeredto course attendees, and this data was analysed. These surveys have formed the basis of futureevaluationofDIYHappinesscourses.Eightattendeeswerealsointerviewedabouttheirexperienceofattending the course.The interview includedaquestionabout their ideas forevaluating futurecourses.

Page 3: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

3

Figure1:TheoryofChangeforWheelofWellbeingactivities

Purpose of this document Thisdocumentprovidesevaluationguidance forpeople runningWheelofWellbeing courses. Thisguideincludesrevisedsurveysbasedonthosepilotedinphase2,alongwithinformationabouthowthese shouldbe implemented,adapted for thedifferent typesofnewactivitiesandcontexts (e.g.one-off workshops, condensed courses). It also includes information on how to collect furtherqualitativeinformation(andcasestudies)tosupplementthesurveydata.TheguidanceispotentiallyusefulforanyorganisationrunningcoursesusingtheWheelofWellbeingframework.

Page 4: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

4

AdministeringevaluationtoolsTherearetwotypesofcoursesbasedaroundtheWheelofWellbeingatpresent;theDIYHappinesscourse(offeredeitheraseighthalfdaysessionsovereightweeks,orcondensedoverfourdays),andonedayworkshopsbasedontheWheelofWellbeing.Theformatofevaluationdiffersdependingonthe type of course. The following describes the recommended approach for evaluating thesecourses.

Forthesakeofsimplicity, it isbettertorestrictdatacollectiontoonlineformatonly,andtoavoidcollectingpersonalinformationontheforms.Surveysshouldalsobeoptimisedinamobile-friendlyformat,sincemanycourseattendeeswillbeabletocomplete itontheirphones.Thisreducestheriskofstoringpaperdata,andreducestheadministrativeburdenoffacilitatorsenteringdataonlinefrompaperrecords.Analternativemethodofcollectingthedataisoverthephonewiththecourseadministrator (who enters the data directly). At present, most communication with courseparticipants happens through email and (potentially) via thewebsite. There is aminimal risk thatcourseparticipantswillbedigitallyexcludedbecauseofthenatureoftheparticipantgroups.

1. Fullcourse

Whenwilldatabecollected?

Courseattendeeswillbeaskedtocompleteasurveybeforebeginningthecourse,whichiscalledabaseline survey, (see appendix 1a). Theywill also be asked to complete a ‘followup’ survey (twoweeks after theendof the course, see appendix 1b). In addition, course attendeeswill be sent apost-coursesurvey three to sixmonthsafter theendof thecourse.Thiswillaskabout theextenttheyhaveusedtheirlearningfromthecourse(seeappendix1c).

Whatdatawillbecollected?

Thebaselineand follow-up surveys include14 ‘standardisedquestions’ tomeasurewellbeing (theWarwick EdinburghMentalWell-Being Scale;WEMWBS). It also includes questions on a person’sunderstanding of wellbeing, their engagement with the six Wheel of Wellbeing concepts (body,mind,spirit,people,place,planet),andsatisfactionwiththeirlifeinrelationtoWheelofWellbeingconcepts,anddemographicquestions(thesearequestionsaboutcharacteristics,suchassomeone’sgenderorage).Previousexperience tellsus that theconnectionspeoplemakewithotherson thecourseisalsoimportant,sowehaveaddedaquestiononthis.Finally,thereisa‘postcoursesurvey’.Theaimistofindoutwhatpeoplehavedoneafterattendingthecourseanditshouldbesentthreetosixmonthsaftertheyattendedthecourse,itcanbecompletedinlessthanfiveminutes.

Baselinesurvey

Course attendees are typically contacted a week in advance by the course facilitator oradministrator,welcomingthemandprovidingdetailsofthecourse.Abaselinequestionnaireshouldbe emailed at the same time and course attendees will be asked to complete the survey onlinebefore their first session. Completing the survey relies on the recipient understanding Wheel ofWellbeing concepts, sowe recommendalso sendinga link to theWheelofWellbeingwebsite, soparticipantscanwatchtheshort introductoryvideoaboutthewheelandlearnmoreaboutitfromthesite.Courseattendeeswhohavenotcompletedthesurveybeforethecoursestartswillbeaskedto complete it at the first session. This can be done on their mobile phone or on a computerprovidedbythetrainingvenueorcoursefacilitators.Wi-Fimaybeneededforclientscompletingthequestionnaireonline.

Page 5: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

5

Follow-upsurvey

Thefollow-upsurveywillbeemailedtoattendeestwoweeksaftertheirfinalsession.Thetwoweekperiodisimportantbecausesurveyquestionsaskparticipantstoreflectonthepasttwoweeks.Thesurveyisalmostidenticaltothebaselinesurvey.

Post-coursesurvey(threemonthslater)

Ashortonlinesurveywillbesenttocourseattendeesbetween3-6monthsafterthecourseends.This shouldonlybe sent to thoseattendeeswhoconsented tobeing contactedusing theconsentform(Appendix2a).Thisshouldalsobedoneonline.

Thequestionnairewillconsistoftwoquestionsandshouldtakelessthanfiveminutestocomplete,toensureahigher response rate.Wecannotassume thatpeoplewill remember thenameof thecourseorthecontent,soitmaybehelpfultoremindpeopleaboutthecourseintheemail.Theaimof the questionnaire is to understandwhat people have done since the course, and seewhethertheyhaveusedwhattheyhavelearnt.

Casestudies

Collectingcasestudiesforparticipantswouldbebeneficialwhenwantingtodemonstratethe‘rippleeffect’ of the course. The post-course survey provides an ideal opportunity for participants todescribewhattheyhavedoneafterattendingthecourse,andtoprovidefollow-upcontactdetailsfor theDIYHappiness team.Theaimshouldbe to find ‘success stories’, suchaspeoplewhohaveusedtheWheelofWellbeingframeworktodevelopworkshopsoftheirown,orhaveusedwhattheyhavelearntinotherways.

Casestudyinformationcouldbegeneratedthroughatelephoneconversationwithparticipants.Theaimoftheconversationistobuildapictureofwhatthepersonhasdoneasaresultofwhattheyhadlearnt. For example, questions could be asked about how someone has usedwhat they learnt intheirownlives.Iftheyhavesharedwhattheylearnt,thenitwouldbegoodtoknowdetailsofhowtheydidthis,theimpactthishadonothersandhowmanypeopletheysharedinformationwith.Duetolimitedcapacity,facilitatorsmaywishtolimitthenumberofcasestudiescollected.

2. Onedayworkshop

The one day workshops based on the Wheel of Wellbeing should be evaluated using simplermethods.Werecommenda shortenedversionof thesurveywhich is runon theday itself,askingparticipants to rate themselves on key attributes before and after the course. This survey has aseriesofquestionswhichpeoplecananswerandratetheirconfidenceorabilityatthebeginningandendoftheday(seeappendix1d).

Page 6: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

6

Ethics,dataprocessingandmanagement

Dataprotection

GeneralDataProtectionRegulation (GDPR) lawshavebeenenforceable from25thMay,2018.Thepremise is that no-one’s personal details should be stored, analysed or processed without theirexplicitconsent.Forthisreason,werecommendcollectinganonymousdataofcourseparticipants.Therisksofcollecting identifiabledataonsurveys(suchasnames,addressesandemailaddresses)outweighthebenefits.

That said, itwillbenecessary forproject facilitators tokeepemail addresses inorder tomaintaincontact with course attendees. Course facilitators should ask course attendees for permission tostore this data for the purpose of communicating about the course, or (potentially) for collectingcase study information. A sample consent form is given in appendix 2a. Consent to be contactedshouldbekeptsecurely,apartfromthesurveyresponses.

Whenseekingcasestudies, it isessentialtoexplaintopeoplehowtheirdatawillbeused,andareaware that that can use a false name if they wish. People should be reminded that they canwithdrawtheirdataatanytime,andgivenaninformationsheetwhichshowsthemhowtodothis(seeappendix2b).

Theeasiestwaytoensurecompliancewithdataprotectionlawistoaskcourseattendeestoopt-into sharing their contact details with course facilitators at the beginning. Course administratorsshould ask course participants if they are happy to retain contact information for evaluationpurposes, for example, for up to threemonths after the coursehasbeen completed. Participantswhowishtomaintaincontactwiththeteamaregiventhisoptionbyprovidingtheiremailaddressonthefinalsurvey(allowingthemtobefollowedupforpotentialcasestudies).

Datastorage

Evaluation data in this instance will be stored on the survey provider online. Data is enteredautomatically through the online survey provider (reducing theworkload forWheel ofWellbeingstaff).DatacanbeexportedintoanExcelfileandstoredinternallyonthehostorganisation’sserver,whichispasswordprotectedtothosestaffwhoneedaccess.Themethoddescribedabovedoesnotattempt tocollectpersonally identifiable information,andmakesnoattempt toanalyse individualparticipants’ data over time. The advantage is that this simplifies data storage in relation to dataprotection laws. The data collected and storedwill be anonymous. The disadvantage is that dataanalyses can only be done on aggregate (i.e., average) data, rather than individual-level datafollowedupatmultipletimepoints.

Dataispotentiallycollectedfromdifferentlocations(includingAustralia).Werecommendthathostorganisationsactascontrollersoftheirowndata.Datasharingagreementscanbedraftedbetweenhost organisations if there is a need to pool the data. The fact that no identifiable data is beingcollectedmakesthissimpler,minimisinganyriskofdatabreach.

Ethics

It is unlikely that people will become distressed due to completing these questionnaires.Nonetheless, the course facilitator should provide their contact details in case anyone wishes toraiseanyquestionsorconcernsaboutthesurveysandhowtheywillbeprocessed.

Page 7: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

7

DataAnalysisIt is important thatdataanalysisproceduresare simpleandmanageable, they shouldbedone in-houseandledbyamemberofstaffattheorganisation.

Baselineandfollow-updata

Anonlinedataplatformwillbeusedtocollectdata.Basicanalysescanbecompletedusingsuchawebsitewithout theneed forquantitativedataexpertise.Graphsand tables canbe createdusingsimplecommandsonsuchawebsite.Thesecanbeusedtoillustratepercentages(suchasnumberofpeople satisfied with the course, and basic before/after comparisons). If needed, data can beexportedintoanExcelformatforfurtheranalysesasrequired.Oneeconomicalwayofanalysingthisdatawillbetolinkwithalocaluniversity,advertisingforapostgraduate(orpossiblyundergraduate)studenttoanalysetheanonymousdatausingastatisticsprogramme.

Themostimportantanalysestorunarecomparisonsbetweenpre-courseandpost-coursescores:

- TotalWEMWBSscorestomeasurewellbeing(seeQ1,Appendix1a)- Understandingofwellbeing(seeQ2,Appendix1a)- EngagementwithWheelofWellbeingthemes(Q7,Appendix1a).- Lifesatisfaction(Q8,Appendix1a).

Using the approach recommended above, it is possible to calculate average scores for courseparticipants‘before’thecourseand‘after’thecourse.Calculatingthechangeinbefore/afterscoresfor individuals will not be possible because individuals’ baseline and follow-up data has beencollectedanonymously.Over time, theprogrammewill collectdata from largenumbersof courseparticipants.Combiningeveryone’sscoreswillprovideanindicationofwhetherthecourseishelpfulornot,particularlywhenalsousedwithcasestudies.

Data from ‘open-ended’questionswillneed tobeanalysedmanually.Agoodway todo this isbyreadingeachentryandcategorisingresponses.Duetothelikelytimeconstraints, it is justifiabletousequotesfromtheanswerstoopen-endedquestions,thesecanbeusedtoillustratewhatpeoplelikeabouttheserviceandwhattheywouldliketoimprove.

Page 8: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

8

Appendices

Appendix 1a – Full course (baseline survey) DearDIYHappinessParticipant,youcanhelpusbyansweringafewquestionsbeforeyoustartthecourse.Wewillaskyousomesimilarquestionsattheendofthecourse.

1. Belowaresomestatementsaboutyourfeelingsandthoughts.Pleaseticktheboxthatbestdescribesyourexperienceoverthepast2weeks.

STATEMENTS Noneofthetime Rarely Someof

thetime Often Allofthetime

I’vebeenfeelingoptimisticaboutthefuture

I’vebeenfeelinguseful

I’vebeenfeelingrelaxed

I’vebeenfeelinginterestedinotherpeople

I’vehadenergytospare

I’vebeendealingwithproblemswell

I’vebeenthinkingclearly

I’vebeenfeelinggoodaboutmyself

I’vebeenfeelingclosetootherpeople

I’vebeenfeelingconfident

I’vebeenabletomakeupmyownmindaboutthings

I’vebeenfeelingloved

I’vebeeninterestedinnewthings

I’vebeenfeelingcheerful

2. Howwouldyourateyourunderstandingofwhat‘wellbeing’means?

NounderstandingBasicAverageGoodVerygood

3. Howwouldyourateyourunderstandingofthescienceandtheorybehindtheconceptof

‘wellbeing’?

NounderstandingBasicAverageGoodVerygood

Page 9: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

9

4. Howoftendoyoutalktofamily,friendsorotherpeopleyouknowaboutwellbeing(outsideoftheworkplace)?

NeverRarelySometimesOftenVeryoften

5. Ifyouareworking(eitherinapaidorvoluntaryrole),howoftendoyoutalktocolleagues

orothers(clients,serviceusers,customers,etc.)aboutwellbeing?

NeverRarelySometimesOftenVeryoften

6. Howwouldyourateyourknowledgeofwhatyoucandotoimproveyourownwellbeing?

NoknowledgeBasicAverageGoodVerygood

Page 10: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

10

DuringtheDIYHappinesscourse,wewillintroducedifferentactionsthatcanhelpustolookafterour‘wellbeing’:beingactiveandhealthyeating(body);keeplearning(mind);helpingothersandpracticinggratitude(spirit);connecting(people);takingnoticeofyoursurroundingsandspendingtimeingreenspaces(place);caringfortheenvironment(planet).

7. Howoftendoyouthinkyouengageinthesedifferentactivities?

STATEMENTSRarelyor

never

Oncea

month

Onceaweek

Onceaday

Morethanonceaday

Being Active: anything that gets our bodymoving around counts as being active (e.g.,walking,dancing,doinghousework,jogging)

1 2 3 4 5

Healthyeating

1 2 3 4 5

Keep Learning: this includes any type oflearning(e.g., learningarecipe,asport,doingacreative activity, reading a book, attending acourse, learning some words in anotherlanguage,etc.)

1 2 3 4 5

Give:Helpingothersinanyway,whichincludessmallactsofkindness

1 2 3 4 5

PracticingGratitude:Thisisaboutwhenwenoticeandappreciatewhatwearegratefulforinlife(e.g.,thiscouldbebywritingitdown,talkingtosomeoneelseaboutit,orjustthinkingaboutit)

1 2 3 4 5

Connectingwithothers(e.g.,family,friends,neighbours,peopleinyourlocalcommunity,colleagues,etc.)

1 2 3 4 5

Takingnoticeofyoursurroundings.1 2 3 4 5

Spendingtimeinagreenspace(e.g.,agarden,park,forest,countryside)

1 2 3 4 5

Caringfortheenvironment:anyactionsyouaretakingtolookaftertheplanet(e.g.,recycling,usingthesameshoppingbag,walkinginsteadofdriving,lookingafteragarden,etc.)

1 2 3 4 5

Page 11: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

11

8. Howhappyareyouaboutthesedifferentaspectsofyourlife?

STATEMENTSVery

unhappyQuite

unhappy

Neitherhappynor

unhappy

Quitehappy

Veryhappy

BeingActive:anythingthatgetsourbodymovingaroundcountsasbeingactive(e.g.,walking,dancing,doinghousework,jogging)

1 2 3 4 5

Healthyeating

1 2 3 4 5

Keep Learning: this includes any type oflearning (e.g., learningarecipe,asport,doingacreativeactivity,,readingabook,attendingacourse, learning some words in anotherlanguage,etc.)

1 2 3 4 5

Give:Helpingothersinanyway,whichincludessmallactsofkindness

1 2 3 4 5

PracticingGratitude:Thisisaboutwhenwenoticeandappreciatewhatwearegratefulforinlife(e.g.,thiscouldbebywritingitdown,talkingtosomeoneelseaboutit,orjustthinkingaboutit)

1 2 3 4 5

Connectingwithothers(e.g.,family,friends,neighbours,peopleinyourlocalcommunity,colleagues,etc.)

1 2 3 4 5

Takingnoticeofyoursurroundings.1 2 3 4 5

Spendingtimeinagreenspace(e.g.,agarden,park,forest,countryside)

1 2 3 4 5

Caringfortheenvironment:anyactionsyouaretakingtolookaftertheplanet(e.g.,recycling,usingthesameshoppingbag,walkinginsteadofdriving,lookingafteragarden,etc.)

1 2 3 4 5

Howhappyareyouaboutyourlifeasawhole?

1 2 3 4 5

Page 12: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

12

9. Whatwasthenameofthecourseyouattended?___________________________

10. Inwhichlocation(i.e.,town/city)didyouattendthecourse?___________________

11. Whatisyourage?

24orunder25-3435-4950-6465orolderPrefernottosay

12. Whatisyourgender?

13. Whatisyourethnicity?

14. Doyouidentifyassomeonewithadisability?YNPrefernottosay

Pleasegivemoredetailifyoulike:

15. Doyouidentifyassomeonewithamentalhealthproblem?YNPrefernottosayPleasegivemoredetailifyoulike

Page 13: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

13

Appendix 1b – Ful l course (fol low-up survey) DearDIYHappinessParticipant,weaskedyousomequestionsatthestartofthecourse,andwewouldbegratefulifyoucouldtakeafewminutestoanswersomesimilarquestionsnowthatthecourseisover.Thankyouforyourhelp!

1. Belowaresomestatementsaboutyourfeelingsandthoughts.Pleaseticktheboxthatbestdescribesyourexperienceoverthepast2weeks.

STATEMENTS Noneofthetime Rarely Someof

thetime Often Allofthetime

I’vebeenfeelingoptimisticaboutthefuture

I’vebeenfeelinguseful

I’vebeenfeelingrelaxed

I’vebeenfeelinginterestedinotherpeople

I’vehadenergytospare

I’vebeendealingwithproblemswell

I’vebeenthinkingclearly

I’vebeenfeelinggoodaboutmyself

I’vebeenfeelingclosetootherpeople

I’vebeenfeelingconfident

I’vebeenabletomakeupmyownmindaboutthings

I’vebeenfeelingloved

I’vebeeninterestedinnewthings

I’vebeenfeelingcheerful

2. Howwouldyourateyourunderstandingofwhat‘wellbeing’means?

NounderstandingBasicAverageGoodVerygood

3. Howwouldyourateyourunderstandingofthescienceandtheorybehindtheconceptof

‘wellbeing’?

NounderstandingBasicAverageGoodVerygood

4. Howoftendoyoutalktofamily,friendsorotherpeopleyouknowaboutwellbeing?(outsideoftheworkplace)

NeverRarelySometimesOftenVeryoften

Page 14: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

14

5. Ifyouareworking(eitherinapaidorvoluntaryrole),howoftendoyoutalktocolleaguesorothers(clients,serviceusers,customers,etc.)aboutwellbeing?

NeverRarelySometimesOftenVeryoften

6. Howwouldyourateyourknowledgeofwhatyoucandotoimproveyourownwellbeing?

NoknowledgeBasicAverageGoodVerygood

Page 15: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

15

DuringtheDIYHappinesscourse,weintroduceddifferentactionsthatcanhelpustolookafterour‘wellbeing’:beingactiveandhealthyeating(body);keeplearning(mind);helpingothersandpracticinggratitude(spirit);connecting(people);takingnoticeofyoursurroundingsandspendingtimeingreenspaces(place);caringfortheenvironment(planet).

7. Howoftendoyouthinkyouengageinthesedifferentactivities?

STATEMENTSRarelyor

never

Oncea

month

Onceaweek

Onceaday

Morethanonceaday

BeingActive:anythingthatgetsourbodymovingaroundcountsasbeingactive(e.g.,walking,dancing,doinghousework,jogging)

1 2 3 4 5

Healthyeating

1 2 3 4 5

Keep Learning: this includes any type oflearning(e.g., learningarecipe,asport,doingacreative activity, , reading a book, attending acourse, learning some words in anotherlanguage,etc.)

1 2 3 4 5

Give:Helpingothersinanyway,whichincludessmallactsofkindness

1 2 3 4 5

PracticingGratitude:Thisisaboutwhenwenoticeandappreciatewhatwearegratefulforinlife(e.g.,thiscouldbebywritingitdown,talkingtosomeoneelseaboutit,orjustthinkingaboutit)

1 2 3 4 5

Connectingwithothers(e.g.,family,friends,neighbours,peopleinyourlocalcommunity,colleagues,etc.)

1 2 3 4 5

Takingnoticeofyoursurroundings.1 2 3 4 5

Spendingtimeinagreenspace(e.g.,agarden,park,forest,countryside)

1 2 3 4 5

Caringfortheenvironment:anyactionsyouaretakingtolookaftertheplanet(e.g.,recycling,usingthesameshoppingbag,walkinginsteadofdriving,lookingafteragarden,etc.)

1 2 3 4 5

Page 16: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

16

8. Howhappyareyouaboutthesedifferentaspectsofyourlife?

STATEMENTSVery

unhappyQuite

unhappy

Neitherhappynor

unhappy

Quitehappy

Veryhappy

BeingActive:anythingthatgetsourbodymovingaroundcountsasbeingactive(e.g.,walking,dancing,doinghousework,jogging)

1 2 3 4 5

Healthyeating

1 2 3 4 5

Keep Learning: this includes any type oflearning (e.g., learningarecipe,asport,doingacreativeactivity,,readingabook,attendingacourse, learning some words in anotherlanguage,etc.)

1 2 3 4 5

Give:Helpingothersinanyway,whichincludessmallactsofkindness

1 2 3 4 5

PracticingGratitude:Thisisaboutwhenwenoticeandappreciatewhatwearegratefulforinlife(e.g.,thiscouldbebywritingitdown,talkingtosomeoneelseaboutit,orjustthinkingaboutit)

1 2 3 4 5

Connectingwithothers(e.g.,family,friends,neighbours,peopleinyourlocalcommunity,colleagues,etc.)

1 2 3 4 5

Takingnoticeofyoursurroundings.1 2 3 4 5

Spendingtimeinagreenspace(e.g.,agarden,park,forest,countryside)

1 2 3 4 5

Caringfortheenvironment:anyactionsyouaretakingtolookaftertheplanet(e.g.,recycling,usingthesameshoppingbag,walkinginsteadofdriving,lookingafteragarden,etc.)

1 2 3 4 5

Howhappyareyouaboutyourlifeasawhole? 1 2 3 4 5

Page 17: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

17

9. Didyouenjoythesocialaspectofthiscourse(spendingtimewithotherparticipants)?

Notatall Somewhat Verymuchso

10. Whatwasthenameofthecourseyouattended?__________________________________

11. Inwhichlocation(i.e.,town/city)didyouattendthecourse?________________________

Page 18: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

18

Appendix 1c – Post course survey (three to six months)

DearDIYHappinessParticipant,severalmonthsagoyoucompletedaDIYHappinesscourse,wewouldliketoaskyoufourbriefquestionsaboutwhatyouhavedonesincethecoursefinished.Thissurveyshouldtakenolongerthanfiveminutestocomplete

1. Whatdoyouremembermostaboutthecourse?________________________________________________________________________

________________________________________________________________________

________________________________________________________________________

2. Haveyouusedanyoftheinformationyoulearntduringthecourse,ifsohow?________________________________________________________________________

________________________________________________________________________

________________________________________________________________________

________________________________________________________________________

3. Haveyousharedanyoftheinformationyoulearntonthecoursewithyourfamily,friendsorpeopleyouknowinyourlocalcommunity?Pleasegivemoredetailsaboutthis,suchaswhatyoushared,howyoudidthisandwhetheryouthinkthishashelpedothersinsomeway?

________________________________________________________________________________________________________________________________________________________________________________________________________________________

4. Ifyouareworking(eitherinapaidorvoluntaryrole),haveyousharedanyoftheinformationyoulearntonthecoursewithyourcolleaguesorothers(clients,serviceusers,customers,etc.)?Pleasegivemoredetailsaboutthis,suchaswhatyoushared,howyoudidthisandwhetheryouthinkthishashelpedothersinsomeway?

________________________________________________________________________________________________________________________________________________

________________________________________________________________________

________________________________________________________________________

Page 19: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

19

Appendix 1d – Short course evaluation form

1. Howwouldyourateyourunderstandingofthesciencebehindtheconceptof‘wellbeing’?

BEFORE 1 2 3 4 5 6 7 8 9 10

AFTER 1 2 3 4 5 6 7 8 9 10

2. Howwouldyourateyourknowledgeofwhatyoucandotoimproveyourownwellbeing?

BEFORE 1 2 3 4 5 6 7 8 9 10

AFTER 1 2 3 4 5 6 7 8 9 10

3. Howwouldyourateyourknowledgeofwhatyoucandotoimprovewellbeinginyourworkplace?(Pleaseignorethisquestionifyouarenotattendingacourserelatingtoworkplacewellbeing)

BEFORE 1 2 3 4 5 6 7 8 9 10

AFTER 1 2 3 4 5 6 7 8 9 10

4. Doyouhaveanyothercomments?

Page 20: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

20

5.Whatisyourage?

24orunder25-3435-4950-6465orolderPrefernottosay

6. Whatisyourgender?

7. Whatisyourethnicity?

8. Doyouidentifyassomeonewithadisability?YNPrefernottosay

Pleasegivemoredetailifyoulike:

9. Doyouidentifyassomeonewithamentalhealthproblem?YNPrefernottosay Pleasegivemoredetailifyoulike:

Page 21: Evaluating DIY Happiness: a guide · The evaluation framework accounts for the fact that courses are ... The interview included a question about their ideas for evaluating future

21

Appendix 2a – Sample consent form for data storage (GDPR compliant)

Instructions for use: This consent form, or a variantwith similarwording, should be gained fromcourseparticipantsatthebeginningofthecourse.Pleasecompletetheblanksasappropriate.

1. I amhappy formypersonal data (includingmynameand contactdetails) tobeprocessedby[XXXorganisation]forthefollowingpurposes:

a. Tocontactmeaboutdetailsofthecourseduringthecourseitself

Yes£ No£

b. To contactme up to three to sixmonths after the DIY Happiness course has finished (inordertocompleteafeedbackformaboutthecourse)Yes£ No£

c. Tosharemypersonaldatawith[XXXorganisation],ourpartnersindeliveringDIYHappinesscourses.Yes£ No£

d. Tosharemypersonaldatawith[XXXorganisation]…for[XXXreason]Yes£ No£

2. I amhappy to receive communicationsaboutother [XXXorganisation’s] events related to theDIYHappinesscourse.Yes£ No£

Appendix 2b – Sample consent form for care studies (GDPR compliant)

Instructions for use: This consent form, or a variantwith similarwording, should be gained fromcourseparticipantsduring/aftercompletionofthecourse, ifwantingtofollowupwiththemaboutgivingacasestudy.

1. I amhappy formypersonal data (includingmynameand contactdetails) tobeprocessedby[XXXorganisation]forthefollowingpurposes:

a. To contact me about providing a case study of my involvement in the DIY Happiness

programme

Yes£ No£

b. IwishtoremainanonymousinanypublishedcasestudyYes£ No£