Results-based Results-based ManagementManagement

An overviewAn overview

Results-based Management: Results-based Management: An OverviewAn Overview

• What is RBM? Why RBM?

• The Log Frame

• Indicators

Performance monitoring is a critical element• How well are results being achieved

• What measures are needed to improve the process

What is results based What is results based management?management?

A management approach aimed at ensuringthat activities achieve desired results

RBM in practice RBM in practice

What are the 2 main benefits/advantages and 2 limitations/challenges in using RBM?

(1 benefit / challenge per card)

10mn

Performance monitoring is a critical element• How well are results being achieved

• What measures are needed to improve the process

What is results based What is results based management?management?

A management approach aimed at ensuringthat activities achieve desired results

What is a Result ?What is a Result ?

A describable or measurable change resulting from a cause and

effect relationship

- UNDG agreed RBM terminology

General Challenges: Applying RBMGeneral Challenges: Applying RBM

• Difficult to apply causal logic

• Different definitions

• Difficult to integrate cross cutting issues

• Difficult to revise

• Difficult to measure

Why RBM?Why RBM?

Stated rationale/intended gains:

• Improved focus / clarity on results instead of activities

• Improved transparency & accountability

• Improved monitoring of programme achievements

Common elements of RBMCommon elements of RBM

• Use of causality and causal (if…then) logic and problem analysis

• Structuring of programmes/projects around a hierarchy of desired results

• Use of change language

• Costing of results (RBB) rather than isolated activity budgeting

• Regular monitoring & performance evaluation against planned results with use of indicators

1. Top strategic priority2. Potential high priority: use negotiation/consensus building to seek alignment 3. Potential high priority: draw on regional/global UN capacity where feasible4. Lower priority: does not meet major challenge

Strategic Priority Setting for UN Country Teams

UNCT Comparative Advantage

Alignment of key actors to support UNCT action

Major Challenge

13 4

2

MD/MDGs/International norms

Terminology ExerciseTerminology Exercise

• Match the RBM terms with their definitions.

• See if there’s any logical hierarchy

(per table, 10mn)

TerminologyTerminology

• Results: Changes in a state / condition which derive from a cause and effect relationship

• Impact: Positive and negative long term effects on identifiable population groups produced by a peacebuilding / development intervention

• Outcome: The intended or achieved short-term and medium-term effects of an intervention’s outputs, usually requiring the collective effort of partners.

Terminology cont.Terminology cont.

• Outputs: The products and services which result from the completion of activities within a development intervention.

• Activities: Actions taken or work performed through which inputs, such as funds, technical assistance and other types of resources are mobilised to produce specific outputs.

• Inputs:The financial, human, material, technological and information resources used for the development intervention.

A Typology for RBM: Poverty Reduction (2)A Typology for RBM: Poverty Reduction (2)

Outcome

Impact

Output

Activity

Poverty reduced

3000 new small enterprises developed in poorest provinces

7 model business incubators operational in poorest provinces

- Acquire facilities - Staff training- Micro-credit provision..

Results Like… Focus @

Timeframe

<1 yr

<5 yrs

5 yrs

5-10 yrs

more

less

Level of

control

Institutional/

Behavioural

Operational/ skills, abilities,

products & services

Human!

OutcomeEmployment and

income generation increased

Institutional/

Behavioural

5 yrs

then if

if

if

if

then

then

then

A Typology for RBM: Poverty Reduction (2)A Typology for RBM: Poverty Reduction (2)

Outcome

Impact

Output

Activity

Poverty reduced

3000 new small enterprises developed in poorest provinces

7 model business incubators operational in poorest provinces

- Acquire facilities - Staff training- Micro-credit provision..

Results Like… Focus @

Timeframe

<1 yr

<5 yrs

5 yrs

5-10 yrs

more

Institutional/

Behavioural

Operational/ skills, abilities,

products & services

Human!

OutcomeEmployment and

income generation increased

Institutional/

Behavioural

5 yrs

then if

if

if

if

then

then

thenmore

Collective Account-

ability

less

The Logical Framework Approach The Logical Framework Approach and the LogFrameand the LogFrame

• Process (LFA) and product (Logframe)• Starting point for all current RBM

systems• Each UN agencies moved to

independently modify the Logframe, related definitions and systems to meet their own needs

• Shows the intended paths we think are required to achieve desired results

National Goal

UNDAF Outcome

Agency-outcome 1

Outputs UN organization

Partners Activities Resources / timeframe

Agency-outcome 2

Agency- outcome 3

LogframeLogframe

UN Outcomes: typical pitfallsUN Outcomes: typical pitfalls• Wordy (..and no change language)

To promote equitable economic development and democratic governance in accordance with international norms by strengthening national capacities at all levels and empowering citizens and increasing their participation in decision-making processes

• Containing multiple resultsThe state improves its delivery of services and its protection of rights—with the involvement of civil society and in compliance with its international commitments

• Wishy-washy, not a result Support to institutional capacity building for improved governance

UN Outputs: typical pitfallsUN Outputs: typical pitfalls

• Confusing means and endsTrain 2,000 police officers by 2010

• Confusing output and indicatorProportion of under-five children accessing preventive health interventions at 50% by 2011

• Unclear link between output and outcome ( no “if/then”)

• Unfocused, unrealistic in terms of UN accountabilityEmergency preparedness plans are operationalized at national and district levelLaw is passed

National Goal: Enabling environment for sustaining agricultural development and food security

Outcome 1:

Enhanced production and productivity in the agricultural sector

Outputs:

1. GoI supported in rehabilitation and operationalization of irrigation infrastructure

2. Iraqi stakeholders have enhanced capacity to access and apply agricultural technology

LogframeLogframe

National Goal: Social sector reform and integration of vulnerable populations

Outcome 1:

Improved food security situation of vulnerable group

Outputs:

1. Improved and equitable food provided to vulnerable groups

2. Improved nutritional status of vulnerable groups

LogframeLogframe

HRBA HRBA RBM RBM

• Outcomes – A change in the performance of rights holders

and duty-bearers– What are RH and DB doing differently?

• Outputs – A change in the capacities of RH and DB?– What are the new services, products, authority,

responsibility, skills, resources that contribute to performance?

UNDAF OutcomesIn addition to ‘sectoral’ outcomes, the UNDAF can include outcomes that focus explicitly on root causes and / or address horizontal issues:

. By 2013, social cohesion and reconciliation is consolidated

. By 2013, conflict afflicted youth are empowered and effectively participate in the country’s political, economic and social development. By 2014, sustained community based recovery . Sustained capacity by government, civil society and private sector to effectively, and collectively design, implement and monitor equitable economic development policies

Can promote greater UN cohesion and intersectoral coordination

Group ActivityGroup ActivityUsing the set of cards provided, develop a results Using the set of cards provided, develop a results

framework…framework…

National Goal: Good Governance and Protection of Human Rights

UNDAF Outcome: By 2010, achieve effective participation of citizens, and government accountability and integratity

Agency outcome: Increased participation of civil society and citizens in decision

making

-Advocacy programmes conducted for accession to the UN convention against corruption-- Advocacy programmes conduction for the adoption of a national anti-corruption law

- Laws on public demonstration and freedom of association in accordance with IS-Strengthened community participation in the planning and implementation of local development activities-- Capacity of civil society strengthened through civic education and engagement with Parliament

-Government assisted to meet its obligation under the International Covenant on Economic, social and Cultural Rights- Capacities of communes for decentralized planning, manangement and delivery of public goods and services further strengthened

Agency outcome: Corruption in government management significantly

reduced

Agency outcome: Effectiveness of decentralized government structures improved to deliver basic services

Monitoring and Evaluation

What is an indicator?What is an indicator?

A tool to measure evidence of progress towards a result or that a result has been achieved

Baseline, Target and AchievementBaseline, Target and Achievement

Baseline

Commitment

CurrentLevel of

Achievement

Achievement

Performance

Achievement At end of period

Target

PlannedLevel of

Achievement

Indicators, Baseline, Target and Indicators, Baseline, Target and Source of DataSource of Data

Output:Teachers in

Belem Province can deliver the new curriculum

effectively

Outcome:By 2010, more girls in Belem

Province enjoy a quality, basic

education

Indicator: Net enrolment ratio

(M; F)Baseline: F:45%Target: F: 75%

- Improvement in school test scores

Source of Data-MICS (survey)-Annual school

test scores report

Indicator: # Teachers with new

certificationBaseline: 0Target: 800

-Teacher proficiency reports

-Improvement of school satisfaction ratings

Source of Data:- MECYS EMIS

-School satisfaction

surveys

Performance Indicator Selection CriteriaPerformance Indicator Selection Criteria

• Validity - Does it measure the result?

• Reliability - Is it a consistent measure over time and, if supplied externally, will it continue to be available?

• Sensitivity - When a change occurs will it be sensitive to those changes?

• Simplicity - Will it be easy to collect and analyze the information?

• Utility - Will the information be useful for decision-making and learning?

• Affordable – Do we have the resources to collect the information?

Indicators for different levels of results

Indicators can be used to measure impacts, outcomes, outputs and also programming processes:

1. Impact level: the realization of relevant human rights and sustained, positive changes in the life, dignity and wellbeing of individuals and peoples.

2. Outcome level: legal, policy, institutional and behavioural changes leading to a better performance of rights-holders to claim rights and duty-bearers to meet obligations

3. Output level: goods, services and deliverables produced to develop the capacities of duty-bearers and rights-holders

4. Programming processes: measuring ways in which programme processes are participatory, inclusive and transparent, especially for vulnerable groups

How to develop good indicators

…especially from a HRBA perspective

• Equality: Do your indicators capture the experience of vulnerable and marginalised groups? Can your indicators be disaggregated?

• Ownership: Have RHs and DBs contributed to the development of the indicators? Do they have confidence in the indicators chosen?

• Clarity: Are they clear and understandable to all audiences, including vulnerable and marginalised groups?

Table 1:UNDAF M & E FrameworkOutcomes Indicators

(w. baseline)Sources of verification

Risks & Assumptions

UNDAF Outcome 1

Agency Outcome 1.1

Major Outputs…

Agency Outcome 1.2

Major Outputs…

Indicator 1

Baseline:

Indicator 1.1

Baseline:

Indicator 1.2

Baseline:

Source 1

Agency resp.

Source 1.1 Agency resp.

Source 1.2

Agency resp.

Summary of risks and

assumptions for each UNDAF

and CP outcome

UNDAF Outcome 2

…

UNDAF Outcome 3

…