session 6 identifying indicators 1. session objective apply an existing phe tool to select...
Post on 27-Dec-2015
219 Views
Preview:
TRANSCRIPT
Session 6
Identifying Indicators
1
Session Objective
• Apply an existing PHE tool to select standardized M&E indicator(s) for a proposed PHE project
• Formulate local, project-specific indicators.
2
Key Characteristics of Indicators
– PRECISE e.g., defined the same way by all people
– SENSITIVE e.g., Changes proportionately in response to actual changes in the condition being measured
– CONSISTENT e.g., Not changing over time so that it always measures the same thing
– MEASURABLE e.g., able to be recorded and analyzed in quantitative and qualitative terms
3
Key Considerations for
Indicator Selection
1. The intervention itself (e.g., set of activities/procedures)
2. “Target” or the anticipated result in quantifiable terms
3. Result Chain Factor
4
Result Chain FactorThe “if-then” linkage between boxes
SUCCESS = Sound Theory + Good Implementation
Accurate Results Chain
Well ExecutedProject
DesiredResults
used todesign
leads to
Inaccurate Results Chain
Well ExecutedProject
DesiredResults
used todesign
does notlead to
Accurate Results Chain
Poorly ExecutedProject
DesiredResults
used todesign
does notlead to
Inaccurate Results Chain
Poorly ExecutedProject
DesiredResults
used todesign
does notlead to
Adapted from Foundations for Success (2005). “WWF Standards of Conservation Project and Programme Management”
SUCCESS
THEORY FAILURE
PROGRAM FAILURE
TOTAL FAILURE!
5
Results Chain: CRM intervention to achieve a food security
outcomeMarine
ProtectedArea (MPA)
Established andManaged byCommunity
CoastalHabitatsProtected
Regenerationof coral reef
and associated
reef fish
Improved flow of
ecologicalgoods and
services to thecommunity
ImprovedFood
Security
Establishment and management of MPA by the community Coastal habitats protected
Coral and fish regenerated, improved flow of ecological goods and services to the community
Action /Intervention
Result Chain Factor
Additional Factors 6
PHE Operational Linkages – Assumptions
Results Chain #1 : Implementation Efficiencies to Achieve Health and Conservation Outcomes
Improvedefficiency
CoordinatedConservation &
Health/PopInterventions
Improvedhealth
Improvedconservation
Cost/effort share
IF coordinated, THEN conservation and health/population interventions will share the cost/effort leading to improved efficiency
Adapted from Foundations for Success (2005) Conventional Wisdom on Causal Linkages among Population, Health, and Environment Interventions and Targets 7
Pathway Through Which Projects Achieve Results
INPUT PROCESS OUTPUT OUTCOME IMPACT*Human, financial, and material resources including partner-ships and an enabling Environment
Example:
Supportive population or environment policies
Actions, procedures or activities being taken by the project to achieve objectives
Example:
CBD services established at the grassroots level
Products, effects or services that a project provides to the community (result of activities)
Example:
Expanded access to FP information and methods
Changes to the population, environment or health system (created by the outputs)
Example:
Use of modern FP methods increased among eligible couples
Ultimate result or long-term outcome
Example:
Reduction in fertility among women of reproductive age (15-49 yrs)
8
Type of Measurement
Program-based Measure
Population- based and Habitat- based
Measures
Adapted from Foundations for Success (2005). “WWF Standards of Conservation Project and Programme Management.”
Process Results
9
Data Collection MethodsLevel of Measurement
Methods Data Sources Time frame
InputsProgram-based Measures
1. Trend analysis 1. Service statistics records
2. Project records
Progress within six months of project start and routinely collected every one to three months throughout project cycle
ProcessProgram-basedmeasures
1. Trend analysis2. Rapid
appraisal (qualitative)
1. Focus group2. Key informant
interviews3. Facility surveys
First six months to one year of program implementation
OutputsProgram-basedMeasures
1. Trend analysis2. Transect
survey
1. Service statistics2. Project records3. Direct
observation
One to two years
Outcomes(short-term or long-term)Population-based or habitat-based measures
1. Population-based surveys
2. Transect survey
3. Mapping
1. Questionnaires2. Survey forms3. Global positioning
systems (GPS)4. Legal records5. Log books
Two to three years for short-term and three to five years or longer for long-term
10
Using “Standard” PHE Indicators
ObjectiveInterventio
n
Results ChainFactor
Potential Indicator(By level of measurement)
Process(program-
based)
Output(progra
m-based)
Outcomes(population-
or habit-based)
Improved RH outcomes among people living in coastal areas by 2004
CBD of contraceptives
Increase FP access and practice
? ? ?
Community capacitated to implement CRM by 2006
MPA established and managed with community involvement
Habitatsprotected
? ? ?
11
IPOPCORM IndicatorsObjective Interventi
onResult Chain Factor
Potential Indicator(By level of measurement)
Process(program-
based)
Output (program-
based)
Outcome(population-
or habit-based)
Improved RH outcomes among people living in coastal areas by 2004
Community Based Distribution (CBD) ofcontraceptives
Increase FP access and practice
# of CBD agents trained
% of trained CBD agents currently active
# of acceptors new to modern contraception
(pg 55)
Community capacitated to implement coastal resource management (CRM) by 2006
Marine protected area (MPA) established and managed with community involvement
Habitatsprotected
Number of community members trained in enforcement procedures (pg 81)
Hours of enforcement patrols logged (pg 83)
Number and area (km2) of MPAs under improved management (pg 95)
12
Integrated Indicators(Measures a linkage aspect of a PHE approach or
intervention)Process / Outputs (Program-Based)
1. Number of linked messages/materials created
2. Number and frequency of PHE educational sessions provided in the target community
3. Number of new PHE partnerships created that make linkages among organizations or institutions from different sectors
Outcomes / Impacts (Population-Based)
6. Percent of households knowledgeable about or aware of a specific PHE issue
7. Percent of communities in target/project area receiving all three PHE elements
8. Number of enabling local policies supporting PHE
13
Value Added Indicators(Measures value added in one sector as a result of work targeted in another
sector)Process / Outputs (Program-
Based)
1. Percent of leadership positions held by women on community-based natural resource management committees
2. Net dollar value of FP products socially marketed by CBD agents
3. Amount of money saved each month (firewood expenditure) among households that install and use improved cooking stoves (ICS)
Outcomes / Impacts (Population-Based)
1. Percentage of households that earn income from the sale of cooking oil processed from moringa seeds
2. Incidence of acute respiratory infections (ARI) among children under age five
3. Percent of young (15-24 yr) ecologist who report use of condom during last sexual intercourse 14
TASK - Selecting Indicators
1. Using the MEASURE guide and worksheet, select indicators for each of the sector objectives in your proposed PHE project framework. Select at least one standard indicator for each Intervention/Result Chain Factor (RCF). If you can not locate a suitable indicator, then formulate one.
2. If time permits, work on a second Intervention for one or more of your Sectoral Objectives. Alternatively you could work on an Integrated Indicator or one Value-Added Indicator.
Time: 45 minutes 15
Objective Intervention
Result ChainFactor
Potential Indicator(By level of measurement)
Process(program-
based)
Output(program-
based)
Outcome(population- or habit-based)
INDICATOR SELECTION WORKSHEET
Sector: __________________
16
Objective
Community capacitated to manage forest resources in sustainable fashion
Intervention
Result ChainFactor
Potential Indicator(By level of measurement)
Process(program-based)
Output(program-based)
Outcome(population- or habit-based)
Installation of Improved Cooking Stove (ICS)
Reduce consumption of firewood
# of households that install and use ICS on a regular basis
Amount of firewood saved each month from use of ICS
Forest coverage (hectares)
Reduce indoor air pollution
Reduce vulnerability to violence
# or HH with children <5 yrs that install and use ICS regularly
Average number of hours spent collecting fire wood (women and girls)
% of children <5 yrs that were treated for ARI in the past six months% women/girls reporting acts of violence while gathering firewood in the past six months
Incidence of ARI among children in the project area by source of household energy
Incidence of violence among women and girls who gather firewood
Example: Value Added InterventionSector: Environment
17
top related