UNDP IEO

EV

ALU

ATIO

N

NATIONALISING THE SDGS AND EVALUATIONS: CONTRIBUTION OF UNEG

Japan

December 2016

Indran A. Naidoo, DirectorIndependent Evaluation Office (IEO ) UNDP

Independent Evaluation Office

Architecture of the SDGs agenda

Nationalizing SDGs

Monitoring and evaluation of SDGs: Key challenges

Contribution of UNEG

2

Presentation outline

NATIONALISING THE SDGs

3

Independent Evaluation Office

Architecture of the 2030 Agenda

4

Vision & Principles Declaration in resolution A/RES/70/1

Results Framework

17 goals, 169 Targets, 230 indicators

Implementation

Global Partnership & Means of Implementation

Follow-up & review

Monitoring & Evaluation

“Follow-up and review processes

at all levels will be [...] informed

by country-led evaluations and

data which is high-quality,

accessible, timely, reliable and

disaggregated”.

Nationalizing the SDGs

5

Adjusting numerical targets

Adding new targets

Adjusting target date

Adding goals

Revising indicators

Disaggregating goalsM

DG

Exp

eri

en

ce

Identifying priority goals

Adapting targets and indicators

Integrating the SDGs in policy frameworks

Preparing for follow-up & review / monitoring and evaluation

Creating horizontal policy coherence (breaking the silos)

Nationalizing the SDGs

MONITORING AND EVALUATION OF SDGs:

KEY CHALLENGES

1

Independent Evaluation Office

8

Interrelatedness of SDGs & implications for monitoring

Goal 1End poverty in all its forms

Goal 11Make cities and human

settlements inclusive, safe,

resilient and sustainable

Target 1.5

Build the resilience of the

poor and reduce their

exposure and vulnerability

to climate-related extreme

events and other disasters

Target 11.5

By 2030, reduce the

number of deaths and of

people affected and

decrease the direct

economic losses … caused

by disasters…

Indicator 1.5.1 & 11.5.1 & 13.2

Number of deaths, missing

persons and persons affectedby disaster per 100,000 people

Goal 13Take urgent action to

combat climate change

and its impacts

Target 13.1

Strengthen resilience and

adaptive capacity to

climate-related hazards

and natural disasters in all

countries

Independent Evaluation Office

9

Goal 1

End poverty in all its forms

Goal 5

Achieve gender equality and empower all women and girls

Goal 11

Sustainable cities and communities

Indicator 1.4.2

% of adult population with secure tenure

rights to land… by sex and by type of tenure

Indicator 5.a.1

% of agricultural

population with

ownership or

secure rights

over agricultural

land, by sex

Indicator 11.1.1

% of urban population living

in slums or informal

settlements*

Target 1.4

By 2030, Ensure that all have … access to basic services, ownership and

control over land /property, … natural

resources, … new technology and financial

services

Target 5.a

Undertake reforms to give women equal rights to economic resources,

as well as access to ownership and control over land / property, financial services, inheritance and

natural resources

Target 11.1

By 2030, ensure access for all to adequate, safe and affordable housingand basic services and

upgrade slums

*Lacking at least one of

the following: access to

improved water, access

to improved sanitation

facilities, sufficient living

area, durable housing,

and security of tenure)

Interrelatedness of SDGs & implications for monitoring

Monitoring and evaluability of SDG 16 progress is

constrained by both definitional and data issues

TARGETS ARE BROAD IN SCOPE

Operationalization challenges Measurement challengesConceptual and definitional

challenges

National statistics has an uneven sectoral focus, and limitations in

collecting governance data

11

• National statistical systems are not geared to produce governance performance data

• Sparse data on functioning of the institutions and governance

• Greater reliance on international data and perception surveys

• One off governance risk assessments

Limited governance performance data

• More focus on high priority government reporting areas (MDG areas, for example)

• Coordination of the sectoral statistics is weak

Sectoral data capacities limited to a few areas

• Modernization of statistical systems evolving

• Yet to optimize on big data/real-time dataYet to optimize available

technology

There are many competing international development indicators and

databases

▪ International indicators and indices

while provide additional insights are

not always perceived to be useful to

monitor progress or inform public

policies

▪ Most countries contested results of

international composite indices

• Given the data time lag, the relevance of the global MPI as a global comparator is considered as limited

• Global MPI indicators when applied to some country contexts are considered flawed —disagreement in the use of deprivation indicators

Monitoring the SDGs

13

2030 Agenda

Entire section on follow-up and review

Rigorous, evidence based

processes

Targets

By 2020 … increase significantly the

availability of high-quality, timely and

reliable disaggregated data …

By 2030…develop measurements of

progress on sustainable development

Independent Evaluation Office

14

Interrelatedness of SDGs & implications for evaluation

Policies

Programmes

Data

Monitoring

Evaluation Goal

1

LaborSocial

protection

Land

Urban develop-

ment

FinanceTechnolog

y

Natural resources

Climate

Law

Independent Evaluation Office

Evaluation supports increasingly complex public policy

environment

15

• Evaluation helps effect change.

• Provides the basis for bringing about change that is

legitimate (independent, informed, credible and useful).

• Fosters democratic processes (transparency and

accountability).

• Professionalizes and modernizes government through its

networking ability – integrated function and largely

respected (UNDP – NEC series).

Independent Evaluation Office

UNDP role through IEO NEC signature events2

Global evaluation community enriched through UNDP

NEC

Istanbul NEC 5 breaks all records - +110 countries

+550 participants, 13 trainings sessions with 200

participants

+130 countries participated in series to date

Over 1000 on-site participants and global reach

through networks and UNTV

Materials used for teaching, directions and guidance

Independent Evaluation Office

17

18

7 contours of the NEC journey

NEC linked to development and

its governance

UNDP’s signature regional events

helped to sustain momentum

NEC for SDGs -Bangkok

Declaration

UN’s affirmation Evaluation is normative

Evaluation policy for accountable

institutions

Professionalization of evaluators

Sound evaluation and practices help understand

complexity

Political and administrative

interface is complex and dynamic –

variation occurs in terms of “which voice”

is heard

Global surge in evaluation and the

adoption of evaluation by government

recognizes the transformation power

of evaluation for ensuring government

relevance

19

CONTRIBUTION OF UNEG

3

Independent Evaluation Office

UNEG: a platform for knowledge sharing and lessons

An interagency professional network that brings together the evaluation units of the UN system and consists of 46 members.

Norms and standards.

Guidance.

Peer Reviews.

Professionalization.

21

UN Evaluation Group

Independent Evaluation Office

UNEG Strategy 2014-2019 – Areas of progress

22

Independent Evaluation Office

Adoption of the first stand-alone UN

General (A/RES/69/237)

Integration of evaluation in the new

2030 Agenda

Revised UNEG norms & standards (adopted

in 2016)

Peer reviews (ITC and UNODC completed, ICAO, WHO, UNFPA

and UNICEF in process)

Guidance notes for joint evaluations

developed

Partnerships with the international

evaluation communities on evaluation products

and initiatives

The Year of evaluation

UN General Assembly Resolution recognized

2015 as the International Year of Evaluation

(EvalYear) and highlighted the importance of

building national capacity for evaluation.

EvalYear promoted the demand for and use of

evaluation in public policy.

92 events took place globally.

23

UNEG Strategy 2014-2019 – Ongoing activities

24

Independent Evaluation Office

UNEG is preparing a roadmap that “sets out the

role of the UN Evaluation System in the follow-up

and review mechanism of the Agenda 2030, at

global, thematic, regional and national level”

In 2016, UNEG commissioned a working paper Evaluation in the SDG era: lessons, challenges and

opportunities for UNEG

Dissemination of updated UNEG Norms & Standards

Supporting efforts of UN members in the areas of

gender equality, human rights and humanitarian evaluation

Independent Evaluation Office

Consultations to clarify

➢ the role of UN organizations in the 2030 Agenda’s follow-up

and review process at different levels and

➢ the role of UNEG in contributing to that and what UNEG will

deliver.

Process

Online survey on UN Agencies’ Engagement in the 2030

Agenda Implementation (shared with UNEG heads).

3 Regional consultations on UNEG’s SDGs Roadmap.

25

SDGs roadmap

UNEG knowledge sharing

26

ERC: Publicly accessible repository of evaluations and

management responses

Independent Evaluation Office

UNDP accorded role and responsibility for SDGs

General Assembly Resolution

SDGs UNEG UNDP

27

Independent Evaluation Office

Independent Evaluation Office, UNDP

220 E 42nd St 20th floor

New York, NY 10017

www.undp.org/evaluation

Thank you !

/IEOUNDP

/UNDP Evaluation

/EvaluationOffice

Independent Evaluation Office

4