UNDP Strategic Plan 2014-2017

Streamlined Integrated Results and Resources Framework (IRRF)

Executive Board Informal Consultation, 30 January 2015

Bureau for Policy and Programme Support (BPPS) Development Impact Group

Contents Sources of evidence used by UNDP

Big picture: What is the IRRF?

Big picture: IRRF structure

IRRF: key principles

Producing the IRRF: timeline

Streamlining the IRRF: process and summary of changes made

Who does what to populate the IRRF?

UNDP “footprint”

Examples of indicators

Monitoring & Evaluation capacity in UNDP

Next steps

Sources of evidence used by UNDP 1

Performance and Results

SP Integrated Results and Resources

Framework (IRRF)

Programme Results

Frameworks

Results Oriented Annual Reports (ROAR)

Project Monitoring

Independent Evaluations

Decentralized Evaluations

Partner Assessments

Internal Data

Systems UNDP uses evidence derived from various sources for results-based management.

Using multiple sources of evidence is crucial to capture a comprehensive view of UNDP’s performance at global, regional and country levels.

Integrated Results and Resources Framework (IRRF)

The IRRF translates the

Strategic Plan into results

UNDP Strategic Plan 2014-2017 Integrated Results and Resources

Framework (IRRF)

The IRRF allows UNDP to…

Monitor and report on

performance and results Hold the organization accountable for the

results and resources entrusted to it.

Big picture: What is the IRRF?

Big picture: IRRF Structure

DEVELOPMENT IMPACT

Eradication of poverty and significant reduction of inequalities and exclusion

DEVELOPMENT OUTCOMES

7 development outcomes representing UNDP’s global development priorities

DEVELOPMENT OUTPUTS

39 development outputs representing results through specific support by UNDP

ORGANISATIONAL EFFECTIVENESS AND EFFICIENCY

9 results areas related to making UNDP more effective and efficient

Tier 1

Tier 2a

Tier 2b

Tier 3

Results Framework Integrated Budget

Impact

Programme Outcome

Output

Organizational Effectiveness and Efficiency

Development Effectiveness

UN Development Coordination

Management

Special Purpose

IRRF: Key Principles 1

Results in the IRRF are designed to capture development changes that are most relevant to UNDP’s contribution.

OUTCOMES

Development change in UNDP’s priority areas achieved as a result of all partners involved, i.e. not limited to UNDP.

OUTPUTS Results achieved by national partners for which UNDP has

provided specific and direct support, e.g. through the schemes, services, plans, actions etc.

Producing the IRRF: timeline

2nd Regular Session (Sep 2013)

IRRF submitted

EB Decision 2013/12: “UNDP to further develop the indicators, baselines, milestones and targets”.

1st Regular session (Jan 2015)

“Technical note on Streamlining the UNDP IRRF” for informal consultation, with baselines 2013, milestones 2014 and 2015, and targets 2017.

Annual session (Jun 2015)

Annual Report of the Administrator will be submitted with IRRF containing BMTs and 2014 results.

Annual session (Jun 2014)

• Populated IRRF submitted, with baselines 2013, milestones 2014 and targets 2017.

• EB Decision 2014/11 requested “UNDP to make any necessary adjustments to the IRRF” and “finalize the maximum number of first and second year milestones and 2017 targets” by the first regular session 2015.

Streamlining Process

Simplifying terminologies, disaggregation and rating scales.

Removing indicators for which methodologies are yet to be developed, or data collection is premature.

Editing indicators to reflect key thematic content of UNDP’s contributions, outlined in the Strategic Plan.

Ensuring that revised indicators continue to rely on the best available international knowledge, directives, guidance, standards and practices for measuring attributable contributions.

Merging indicators under different outputs to eliminate redundancy.

Breaking down a complex output indicator into separate indicators to increase robustness of data captured.

Streamlined IRRF: summary of changes

1 Tier 1

IMPACT

Statement No change

Indicators No change (maintained 4 indicators)

Tier 2a

OUTCOME

Statement No change

Indicators

Streamlined from 32 to 25 indicators

• Removed: 7

• Streamlined: 12

Tier 2b

OUTPUT

Statement

• 3.1 - Edited

• 3.6 – Moved to Outcome 7 as Output 7.8

• 4.5 – Removed

Indicators

Streamlined from 92 to 67 indicators

• Removed: 22

• Streamlined: 27

• Merged: 10 (into 5 indicators)

• Split: 1 (into 3 distinct indicators)

Tier 3

ORGANIZATIONAL Indicators

• Removed: 2

• Streamlined: 4

• Enhanced with sub indicator: 1

Total number of development indicators Before streamlining 128 After streamlining 96

Total number of organizational indicators Before streamlining 50 After streamlining 48

Content of the populated IRRF

Full development results chain includes impact, outcome and output levels.

An integrated framework includes development and organisational results to measure, monitor and report on the relationship between UNDP’s development results and organisational effectiveness and efficiency.

The results and resources framework sets out the indicative resource envelope and results for the four years of the Strategic Plan.

Harmonized indicators with other UN agencies at outcome and output levels, including 10 common QCPR indicators.

2013 baselines, 2014 and 2015 milestones, and 2017 targets are populated.

Priority has been given to data disaggregation by sex

1

Who does what to populate the IRRF?

Translate IRRF indicators into data components

Develop methodological notes for indicators

Develop corporate system to capture

data

Training, technical support, data analysis and quality assurance

Link country results with

the SP results

Identify indicators to

report

Set baselines, milestones and targets

(BMTs)

HQ Bureaux

with Regional

Hubs

Country Offices and HQ Bureaux

Populated IRRF

UNDP’s “footprint”

1,727

1,004

836

101

409 283 377

451

$1,176

$642

$1,705

$33

$244 $346

$172 $154

$-

$200

$400

$600

$800

$1,000

$1,200

$1,400

$1,600

$1,800

-

200

400

600

800

1,000

1,200

1,400

1,600

1,800

2,000

Outcome 1Inclusivegrowth

Outcome 2Voice

Outcome 3Public services

Outcome 4Gender

Outcome 5 Riskreduction

Outcome 6Early recovery

Outcome 7Thought

leadership

NON_APPLIES

Outputs and Resources per SP Outcomes

Number of Country Outputs (January 2015) 2014 Budget (USD million)

Number USD million

Data collected across 136 Country Offices and 154 programme countries.

Target Setting Principles: Outcome Level

TYPE 1: Indicators that track internationally-agreed development targets E.g. Indicator 4.4: Proportion of decision making positions (executive, legislative and judicial) occupied by women at national and sub-national levels - 30% by 2017 (based on ECOSOC target)

TYPE 2: Indicators that track expected direction of travel, based on past trends E.g. Indicator 6.4: Percentage of (monetary equivalent) benefits from temporary employment / productive livelihoods options in the context of early economic recovery programmes received by women and girls (UNSC 1325 - led by UNDP & UN Women) – 40% by 2017 (UNDP estimate)

TYPE 3: Indicators that are tracked but no targets are set, as it is not possible to set a credible target

E.g. Indicator 3.3: Access to justice services

Outcome indicators enable UNDP to analyse progress against the Theories of Change, in order to adjust planned UNDP contributions (outputs) as needed.

Monitoring Principles: Output Level

• Evidence is gathered through programme and project monitoring, and must be objectively verifiable and come from a credible data source.

• Monitoring: tracks only results that are specifically supported by UNDP based on national demand.

• Baselines, milestones and targets (BMTs) are generated from aggregate data provided by country offices for countries where results are expected, based on ongoing and planned projects/programmes, during the period of the Strategic Plan.

• BMTs evolve to reflect closing of existing projects/programmes and starting of new ones.

• Qualitative indicators use internal methodologies (objective rating scales) to track whether UNDP’s support is directly contributing to desired results.

• Results captured represent the sub-set of UNDP results that are being measured through indicators, and not the entire set of results achieved. Resources, on the other hand, are captured in totality.

Gender Equality in the IRRF Gender specific indicators (Outcome 4)

• 4 outcome indicators • 6 output indicators

Gender mainstreaming indicators (under other outcomes) • 11 gender sensitive indicators • 12 sex-disaggregated indicators • 2 gender sensitive institutional indicators

[VALUE]

[VALUE]

[VALUE]

[VALUE]

0

5000

10000

15000

20000

25000

30000

2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target

Example 4.4.2 Number of women benefitting from private and/or public measures to support women’s preparedness for leadership and decision-

making roles (22 linked countries with data reported)

tbc

Indicator 1.1.1 (jobs component) Number of

new jobs generated

Indicator 1.3.2 (jobs component) Number of new jobs created through management of natural resources, ecosystem services, chemicals and waste

Example of Indicators: Jobs and livelihoods

112 countries linked

For women

in 71 Countries 2,413,098

For men

in 69 Countries 4,765,749

For women

in 52 Countries 179,871

For men

in 53 Countries 85,516

For women

in 19 Countries 62,315

For men

in 19 Countries 100,603

104 countries linked 32 countries linked

Indicator 6.1.1 (jobs component) Number of people benefitting from emergency jobs and other livelihoods in crisis or post-crisis settings

The IRRF has three indicators that measure the number of jobs created and livelihoods strengthened with direct support from UNDP. Data below summarizes targets for one of the data components – number of jobs created – disaggregated by sex. (Baselines are set to zero to capture new jobs created from 2014 onwards.)

Overall: 2013 Baseline Overall: 2017 Targets

New jobs for women 0 2,655,284

New jobs for men 0 4,951,868

Total 0 7,607,152

Examples of Output Indicator BMTs Number of Countries

26

45

tbd

65

0

18

28

tbd

46

-

20

40

60

80

100

120

2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target

2.3.1 Number of countries with strengthened operationalinstitutions supporting the fulfillment of nationally andinternationally ratified human rights obligations

1.1.2 Number of countries with policies, systems and/orinstitutional measures in place at the national and sub-nationallevels to generate and strengthen employment and livelihoods

Output 2.3 - 66 countries linked

Output 1.1 - 112 countries linked

80 countries

46 countries

Examples of Output Indicator BMTs Number of new development partnerships

Output 2.3 - 66 countries linked

Output 1.1 - 112 countries linked

80 linked countries with data reported

46 linked countries with data reported

113

215

tbd

509

0 39

107 tbd

139

0

100

200

300

400

500

600

2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target

1.5.1 Number of new development partnerships with funding for improvedenergy efficiency and/or sustainable energy solutions targeting underservedcommunities/groups and women

7.6.1 Number of new public-private partnership mechanisms that provideinnovative solutions for development

67 countries

Output 1.5 - 85 countries linked

Output 7.6 - 25 countries linked

19 countries

1. Percentage of country programme outcomes that are reported as either on-track or achieved (cross checked with evaluation findings)

25. Percentage of all staff surveyed who feel empowered in their job

4. Percentage of CO annual results reports which meet or exceed expected organizational quality standards

36. Percentage of partners perceiving UNDP as a valued partner to their organization

Examples of BMTs Organizational Effectiveness and Efficiency Indicators

[VALUE] [VALUE] tbd

90%

[VALUE]

[VALUE]

[VALUE]

tbd

[VALUE]

57% 57% 60%

tbd 65%

50% 55% 57%

tbd

60%

50%

55%

60%

65%

70%

75%

80%

85%

90%

95%

2013 Baseline 2014 Milestone 2015 Milestone 2016 Milestone 2017 Target

Monitoring & Evaluation capacity in UNDP

Data Source: 2013 Annual Report on Evaluation, Independent Evaluations Office

Data Source: 2013 Results Oriented Annual Report (ROAR)

71

382

0

50

100

150

200

250

300

350

400

450

Number of dedicated M&E specialists atcountry level

Fulltime equivalent staff performing M&Efunctions

Next Steps Data extraction and data integrity checks to populate IRRF indicators

with 2014 actual results – mid-February

Aggregation and analysis of 2014 actual results from IRRF and other UNDP sources of evidence – end of February

Submission of the Annual Report of the Administrator – June 2015 Adjusted “footprint”

Streamlined indicators

Higher rate of data coverage

Milestones for 2014 and 2015

Targets for 2017 Actual Results for 2014

Setting of 2016 milestones – January 2016 Mid-term review of the Strategic Plan – June 2016

Thank you