session 9 monitoring gender impacts. to increase workshop participants’ understanding of: 1)...

SESSION 9MONITORING GENDER IMPACTS

To increase workshop participants’ understanding of:

1) Setting gender objectives

2) Identifying SMART gender-sensitive indicators

3) Setting targets

4) Monitoring throughout program/project lifecycle

SESSION GOALS

Strategic Goal 4: Promoting Economic Growth and Prosperity

“The U.S. Government’s goal is rapid, sustainable, and broad-based economic growth, both domestically and internationally. To address the development challenges of the future, we must ensure that we lay the groundwork for future growth and support sustainable use of natural resources.

We will work to ensure that our efforts effectively target women because growth will lag without the full participation of women.”

U.S. Department of State and U.S. Agency for International Development. Transformational Diplomacy. Strategic Plan Fiscal years 2007-20012. Revised May 7, 2007, p. 26.

MONITORING GENDER IMPACTS

What are Performance Indicators?

• Performance Indicators describe how well a program is achieving its objectives.


How are Performance Indicators used?

• Provide an indispensible management tool for making performance-based decisions about program strategies and activities.

• Orient and motivate operating unit staff toward achieving results

• Communicate USAID achievements (to host country counterparts, other partners, and customers)

• Report results achieved to USAID’s stakeholders (including U.S. Congress, OMB, and citizens)


Levels of Performance Monitoring

Joint State/USAID Performance Plan

Country Strategic Plan

Project/Implementing Partner


Levels of Performance Monitoring

Level 1: US Department of State-USAID Strategic Plan FY 2007-2012/PART• Focus on demonstrating performance through

common indicators • USAID/W focus on common indicators across

countries• “F” Bureau Joint Performance Plan and Performance

Report


Level 1: US Department of State-USAID Strategic Plan FY 2007-2012

Some Economic Growth Indicators:

• Time necessary to comply with all procedures required to export/import goods

• Number of people with increased access to modern energy and infrastructure services due to U.S. government assistance

• Number of rural households benefiting directly from U.S. Government interventions in agriculture

• Credit to private sector as percent of gross domestic product

• Percent change in value of international exports of targeted agricultural commodities due to U.S. government assistance


Level 1: Some indicators are disaggregated by “sex” or “sex of household head”

• Number of rural households benefiting directly from USG interventions (disaggregated by sex of claimed or presumed head)

• Number of people gaining employment or better employment as a result of participation in USG-funded workforce development programs (disaggregated by sex, age, new vs. improved)

• Number of borrowers from USG-assisted microfinance institutions (disaggregated by sex)

• Number of individuals who have received USG supported short-term agricultural sector productivity training (disaggregated by sex)

• Number of women’s organizations/associations assisted as a result of USG supported activities


Level 2: Country-level Strategic Plan/OP

• USAID mission (joint with Embassy) • report on Level 1 Indicators• “custom” indicators

• Agriculture-specific: IEHA Indicators (Initiative to End Hunger in Africa)

• USAID mechanisms for generating and reporting data• coordinates implementing partners inputs• funds activities to generate data for performance

reporting


Level 3: Implementing Partner

• Report data to USAID on Level 1 and 2 indicators

• Use performance monitoring plan for project management

→ We will focus on Monitoring Gender Impacts on Level 3


What is a gender-sensitive Indicator?

• Not just a disaggregation by sex

• Not just a disaggregation by sex of household head


“Gender-sensitive” indicators have the special function of pointing out how far and in what ways development programs and projects have met their gender objectives and achieved results related to gender equity.”


What is a gender-sensitive Indicator?

Why are Gender-sensitive Indicators Important?• To know if we have achieved gender

objectives• To communicate achievements toward

gender objectives• To know if we have created gender

differences


Integrating Gender into the Project Life Cycle

1. Project design & appraisal

3. Monitor & Evaluate

4. Assess needs &identify problems

2. Implement project start-up & undertake

activities


Project Life Cycle

Integrating Gender into Monitoring and Evaluation

3. Monitor & EvaluateStep 1: DEVELOP AND MONITOR INDICATORS that measure gender-specific outcomes


Step 2: MONITOR INDICATORS to determine progress toward gender objectivesStep 3: EVALUATE EFFECTIVENESS OF PROGRAM ELEMENTS designed to address gender issues and on program impact

Step 1: DEVELOP INDICATORS that measure gender-specific outcomes

• Develop Indicators

• Set baselines and targets


Steps to Develop Performance Indicators

Develop list of potential indicators


Assess potential indicators

Select best indicators

Document indicators in PMP

DirectObjectiveAdequatePracticalAttributableUsefulReflect progress


• Include important stakeholders in the development, e.g. local women’s organizations, NGOs, men and women project beneficiaries as appropriate

Develop list of potential indicators



‘Not everything that counts can be counted and not everything that can be counted counts.’

Albert Einstein


Three Types of Gender-Sensitive Indicators

1. Quantitative indicators - numerical measurements of changes – in the behaviors, attitudes and behaviors/practices of

targeted individuals, disaggregated by sex and/or other social variables

– # men/# women

2. Qualitative indicators - more subjective measures – that address perceptions and relative progress toward a

target such as reduction of gender impediments– can be measured using scales, ranking and indices– # men/# women ranking their satisfaction level with

government services

3. Process-oriented indicators – can be either – quantitative i.e., measuring the achievement of activity

deliverables such as training attendance (#men/#women) – qualitative (e.g. quality of participation of men and women in

workshops)


Example of Objective-level Indicator DevelopmentSteps 1 and

6Project

Objectives

Step 2Data

Collection

Step 3ID of Gender Constraints

Step 4 Actions to

reduce gender

constraints

Step 5: Indicators

Original project objective: Increase employment opportunities in horticultural production and processing plants


Employment in processing plantsEmployment in horticulture productionIncome increases due to employment

Example of Objective-level Indicator DevelopmentSteps 1 and

5Project

Objectives

Step 2Data

Collection

Step 3ID of Gender Constraints

Step 4 Actions to

reduce gender

constraints

Step 6: Indicators

Revised project objective: Increase employment opportunities in horticultural production and processing plants, especially in previously underrepresented positions

• In households women plant/ weed/harvest; men prepare land varying by crop• Most women have completed primary education • Women are hired into low-paying production & processing jobs; Men are hired as supervisors•Sexual harassment is common

Social conditions (attitudes, harassment, lack of training) restrict employment opportunities for women, particularly in moving from line jobs to supervisory positions in horticultural production and processing plants

• Publicize opportunities in supervisory and management positions to men and women•Provide management training to women•Provide trainings on sexual harassment to men and women


Sex-disaggregated data on employment

Number of women in supervisory and management positions

Percentage of women in supervisory and management positions

Example of Objective-level Indicator Development

General Indicators

Employment in processing plants

Employment in horticulture production

Gender-sensitive Indicators

Sex-disaggregated data on employment


Percentage of women in supervisory and management positions.


Setting Baseline and Targets for Gender-Sensitive Indicators

Identify potentia

l data sources


Generate data

collection options

Select data

collection

options

Develop data

collection tool

Baseline and Targets for Gender-Sensitive Indicators• Establish baselines – must know where you are in order to

know where you are going

• Establish realistic targets– Separate targets for women and men

• Check your assumptions– For example, does an increase in household income benefit all

household members equally? Instead of “increase farmers’ income by 25%” consider “increase income under women’s control by 25%”

• Clarify areas where more information is needed

• Determine how more information can be obtained– Have you interviewed both women and men?


Baseline and Targets for Gender-Sensitive Indicators• Avoid only counting bodies

• Indicators should capture quality and not just quantity– Attendance only or true participation and decision-making– Quality of jobs rather than numbers of employed

• Aim to measure changes in levels of inequality• Instead of “25 women joined the producer association”

“Proportion of women producer association members increased from 25% to 50%; for the first time, women hold 3 leadership positions in the association”

• If the indicator measures only volume of sales, it is not possible to determine if women’s proportion of sales have increased relative to men’s


Data Collection Issues for Gender-Sensitive Indicators

• Sex-disaggregated secondary sources are generally weak or unavailable

• Need interviews of individuals, not just household head

• Data collected using sex of household head as key differentiator does not capture gender-impacts:– Better proxy for poverty than gender– female-headed households not homogenous


Performance Indicator Reference Sheet

• Description of Indicator with definitions, units of measurement, disaggregation

• Plan for data acquisition with methods, data sources, timing, estimated costs

• Data quality issues with dates of initial and future quality assessments

• Plan for data analysis review and reporting


Performance Data Table


Objective Indicator Unit of Measure

Disaggregation Baseline Year

Baseline Value

2009 Target

2009 Actual

2010 Target

2010 Actual

Increase Employment Opportunities in underrepresented positions


Number of individuals

Men/Women 2008 43 56

Percentage of women in supervisory positions

Percentage

2008

23%

30%

Integrating Gender into Monitoring and Evaluation

3. Monitor & EvaluateStep 1: DEVELOP INDICATORS that measure gender-specific outcomes


Step 2: MONITOR INDICATORS to determine progress toward gender objectivesStep 3: EVALUATE EFFECTIVENESS OF PROGRAM ELEMENTS designed to address gender issues and on program impact

Step 2: MONITOR INDICATORS to determine progress toward gender objectives

• Track progress toward gender objectives by reviewing progress toward indicator targets on a regular (quarterly, biannual) basis

• Should be conducted along with review of all indicators


Step 3: EVALUATE EFFECTIVENESS OF PROGRAM ELEMENTS designed to address gender issues and on program impact

• Gender-objective Achievement Report

• An overall assessment of performance toward the achievement of gender objectives for the project

• At a minimum should have a Mid-term and Final Evaluation Report (or section in report) to assess performance toward gender objectives


Acting on Monitoring Results

4. Assess needs andidentify problems

Step 1: ADJUST DESIGN AND ACTIVITIES based on monitoring and evaluation results

Step 2: STRENGTHEN SUCCESSFUL ASPECTS of the program and rework aspects that do not adequately address project-related gender issues


4. Assess needs and identify problems

Step 1: ADJUST DESIGN AND ACTIVITIES based on monitoring and evaluation results

If project is not meeting gender-sensitive targets, then need to re-examine the assumptions underlying the activities

– Sufficient number of activities?– Sufficient resources behind activities?– Variables outside control of project?


4. Assess needs and identify problems

Step 2: STRENGTHEN SUCCESSFUL ASPECTS of the program

• Rework aspects that do not adequately address project-related gender issues

• Derive and share lessons that can useful for other projects/programs


37

GENDER INTEGRATION MATRIX

Project Objectives Data Collection Identify of Gender Constraints

Actions to gender reduce constraints

Original project objective: To raise rural household incomes through increased horticulture productivity

Revised project objective:

•Majority of membership criteria to producer associations (roughly 85 percent) is based on land ownership•Post-harvest income is deposited in a bank account in the name of the registered producer•Many women do not have access to income deposited in bank accounts•Evidence of some households that open joint bank accounts•Women operate roughly half of farm enterprises•Women receive technical information about crops from their husbands

•Married women lack incentives to increase productivity•Women have less access to inputs and technical assistance because membership to associations is based on formal land ownership

•Devise innovative payment schemes to allow control of income to flow more directly to women•Explore the feasibility in different associations of promoting joint association membership and/or joint bank accounts

Exercise on Gender-sensitive Indicators

Based on the Revised Objective identified in Session 8:

1. Identify potential indicators2. Identify potential data needed to specify

baselines and target


Gender Integration in USAID Programming

• How will gender relations affect the achievement of sustainable results?

• How will proposed results affect the relative status of men and women?

Identify gender relations at the start of the project through

gender analysis and establish an appropriate baseline

↓ (monitor changes)

Describe gender relations at the end of the project (results) and start of the next project (new

baseline)


session 9 monitoring gender impacts. to increase workshop participants’ understanding of: 1)...

Documents

performance indicators

monitoring gender impactswhat

monitoring gender impactsto

monitoring gender impactshow

economic growth indicators

setting gender objectives2

performancebased decisions

result of usg