logic models and evaluation

LogicModelsandEvaluationUNMEvaluationLabSummerInstitute

CharlaHenley,MA,[email protected] /evallab.unm.edu

Summer2019

22July2019 UNMEvaluationLabSummerInstitute- LogicModels 2

LearningobjectivesUnderstandwhatalogicmodelisandwhyit’ssousefulDistinguishbetweenoutputsandoutcomesIdentifyhowregularactivitiesdriveyourmissionTreatthelogicmodelasalivingdocumentDeterminetheassumptions/beliefsthatsupportyourlogicmodel


WhatisaLogicModel?

Alogicmodelisaone-pagedescriptionofyourprogramthatshowsthelogicalstepsfrominputstoactivitiestooutputsandoutcomes.Thelogicmodelcanbeachart,illustrationortable.

Note:Itisalivingdocument!


WhyisitsogreattohaveaLogicModel?

• Ifdevelopedorreviewedregularlybystakeholders,itgetseveryoneonthesamepage,andworkingtogether.

• Itprovidesaroadmapfordesigningevaluationactivitiesthatcanhelpyouassessyourprogressandsuccess,andprovideguidanceforbecoming(evenmore)effective.

• Ithelpsyoufigureoutifyourprogrammakessense!


LogicModelDefinitions

Alogicmodelwillhighlightandlink:• Shortandlongtermoutcomes• Outputs• Activities• Resourcesandinputs

• Assumptions– beliefs• ExternalFactors– barriers


LogicModelDefinitions,continued

Outcomes=Changesinparticipants’behavior,Knowledge,Skills,Leveloffunctioning,Outlook,Lifetrajectories.Outcomesaretheevidencethatyourprogramishavingthedesiredsuccessinmakingadifference.



Short-termOutcomes:Whatyouwanttoseeforaparticipantonthedayheorshecompletesyourprogram

Long-termOutcomes:Whatyouhopeparticipantstakewiththemintothefuture.



Outputs=theobservablethingsthattheactivitiesproduce:

#ofparticipants#ofeventsmealsservedOutputsaretheevidencethatyouaredoingwhatyouplannedtodo.



Activities=Whatyouaredoingwhenyourprogramishappening:• Classes• Counseling• Homevisits• Events• Etc.



Resources=Thethingsandpeoplethatyouneedtooperateyourprogram:• Space– forstaffmeetings,clientmeetings,storage,groupactivities,etc.

• Grantsanddonations– Fundingsources.• Dedicatedstaff– Administrative,operations,legal• Training– fornewstaff,certifications,licensing• Etc.



• Assumptions– Beliefs• Thesearethebeliefsyouhaveaboutwhatwillworkandwhy

• ExternalFactors– Barriers• Whatmightlimitorbeanobstacletosuccess?


LogicmodeltemplateInputs Activities Outputs Outcomes

Short Long

Assumptions External Factors22July2019 UNMEvaluationLabSummerInstitute- LogicModels 13

LogicModelExample1Inputs

HumanCapital

PB&JFamiliesLeadershipteamDirectservicestaff

SupportstaffBoardofDirectorsVolunteers&Interns

Professionaldevelopment

FinancialCapitalBraided&leveragedapproachtofinancial

sourcesPrivatedonations

Government&privategrants

SocialCapitalReputationincommunity,

Communitypartners&funders,Evaluation

Accreditation

PhysicalCapital

Physicalsitesembeddedincommunity,Furniture,

Medicalsupplies,Communicationequipment

Transportation,FacilitiesandMaintenance

Interactionswithothersaregenuinelyhopeful,welcoming,respectful,

nonjudgmental,positiveandvalidating

Responsiveness&adaptabilityallowsustomeetpeoplewheretheyare,helpthem

buildontheirstrengthsandsupportthe

capacitytocopeintheirjourneytohealpast

trauma

Heart-CenteredApproach

Program

ParentandchildrelationshipChilddevelopment

assessmentsChilddevelopment

curriculumEarlyinterventionservices

Pre-kindergartenHomevisiting

CasemanagementSocialworkCounseling

Speech,occupational,andphysicaltherapy

NursingTransportation

Meals

Activities

CoalitionbuildingPubliceducation

Politicalaction

Advocacy

IntermediateBenchmarks

Mutualtrust

Programinvestment

Participation Family

INTACTHealthy

attachment

Nurturing&SAFEENVIRONMENT

Hassocialnetwork

Familyresilience

Socialnetwork

Accesstoconcretesupports(food,housingemployment,childcare,

healthcare&education)

ParentPositiveparenting

skills

Socially&emotionallycompetent

Advocatesforself,childandfamily

Understandschilddevelopment

Outcomes

Child

OPTIMALDEVELOPMENT

Healthy,resilient,&socially&emotionallycompetent

Self-advocacyREADYFORSCHOOL

Policy

Statewidechildabusepreventionprogram

Publichealthapproachtoinfantandchildhoodhealth

Adequatesocialsupportforbasicfood,housing,

employment,healthcareandeducationneeds

Transparentandaccessibledata

Assumptions: Regardlessofbackgroundorhistoryeveryfamilyisworthyanddeservessupport,andthepreservationoffamilyserveschildrenandcommunity.Everyfamilyandculturehasstrengths,identifyingthemthroughearlysupportandcollaborativeeffortsmakesallthedifferenceandcreatesthegreatestchangeandimpact.Weallcanchange,everyindividualisworthwhileandeverychilddeservessupportwithoutlabelingorstigma,ourjusticecouldberestorativeandchildabusecanbeprevented.

Assets: Diversity,culture,climate,naturalbeauty,intergenerationalfamilies,creativeandprogressivecommunity,UNM,Medicaid.

External Factors: Poverty,intergenerationalviolence,inadequatefundingforsocialservices,isolation,inadequatetransportation,perceptionsofsingleparentfamilies,nocomprehensivestatewidechildabusepreventionplan,fragmentedhealthmentalhealthsystem,lackofaddictionservices,lackofaffordablehousing,oppressiontowardsmarginalizedgroupsbecauseofsystemicracism.Noaccesstostatedata.

Staffwithfamilies

Parentswithchildren

Allwithcommunity

ReflectiveParallelProcess

Perceptions

Publicawarenessabouttrauma,resilienceand

protectivefactorsandtheimportance

ofprevention

Growth

Awarenessofstrengths

Feelingprotected&supported

Increasedcapacitytocope

Ownershipforactions,accountability

ReducedImpulsivity

Parent&childresilience

Identifyingrealisticgoalsandstepstoreachthem

Connectiontosupports

Creatingowncommunity

SafetyPlanning

Providingprotection&supportforchildren

Fewertriggers,moreoptions

Improvednurturingandsignsofattachment

Action

PB&JLOGICMODEL

StrategyStartearly

MultigenerationalParentingskills&

knowledgeConcretesupportReferraltoservices

Engagesocialsupportnetwork

Children grow to full potential in

nurturing families and a supportive

community


Benefitstousingtemplate1

• Showsdirect connectionbetweeninput/activityandoutput,outcome• Helpsteamthinkthroughtruepurposeofalleffortsandactivities• Canhelpre-direct energy


LogicmodeltemplateResources/Inputs Activities Outputs Short-TermOutcomes Long-TermOutcomes


Assumptions: ExternalFactors:

CentroSávila LogicModel– ClinicalServicesExample2


Resources Activities Outputs Stepping Stones Outcomes-Circle of Security & Nurture Heart Training

-Staff support

-Reflective Supervision

-Clients’ commitment to grow & build resiliency

-Physical building, rooms

-Grants & other funding

-Art & crafts supplies

-Sensory items/tables

-Community support and engagement

-Volunteers

-Knowledge & experience both

-Events-fall festival

-Groups• Life skills• Jovencit@s• Parenting

Crianza 1 & 2• Women’s support group• Music class • Individual services

(Adults & kids)

-Nurtured Heart Approach

-Individual & family therapy Case management • Legal resources • Child Advocacy • Immigration Services • Educational Services• Housing • Financial Resources

- Number of adults and children attending program

- Number of sessions offered

- Number of participants in attendance

- Number of participants completing program

- Number completing assessments

-Number of stress events reduced

-Increased positive language used in children

-Reports of less violence in home

-Child reports doing better in school, behavior and/or grades

-Broader vocabulary of positive qualities and knowing how it applies to themselves

-Can make eye contact

-Straighter posture• Assertive

communication• More expressions

-Using relaxation techniques

Short

-Better coping skills• Emotionally healthy responses

to child’s stress/ hardship

-Taking care of themselves (parents)

-Self-esteem (children)

-Able to identify one positive thing about themselves (parents & children)

-Recognize responsibility as a parent

-Children know they are not at all at fault for difficult situations.

-Time-out for parents• How parents react with children • Increase self-awareness

(reason why they are doing certain things like raising their voices)

-Children can recognize tools & people to enhance their safety

Long

-Improved parent-child relationship

-Parent is emotionally supportive

-More attentive

-Able to handle difficult emotions better (parents and children)

-Able to recognize child’s emotional state easier

-Improved emotional quality of life• More positive feelings• Connection with

parent & child • Feeling of safety/

security

EnlaceComunitarioLogicModelExample3


Benefitstousingtemplate2

• Faster andsimpler thantemplate1• Greatstarting point• Getsteamonthesamepagewithprogramdirection


YourTurn

- Logicmodel- Startalogicmodel:focusonoutcomes- Reviewalogicmodel:areyourshort-termandlong-termoutcomesreasonable(areyouwillingtobeheldaccountableforthem)?


logic models and evaluation

Documents