evaluation of the paris declaration phase 2 dac evaluation network 15 june 2009 niels dabelstein
TRANSCRIPT
Phase II ’Architecture’
Again based on the principles of the ParisDeclaration: a joint evaluation comprising:
• Country level evaluations assessing results/outcomes• Additional donor/agency HQ studies• Supplementary studies with focus on results• Synthesis report to be presented to 4th HLF
Phase II Evaluation Model
Two complementary foci: 1) Implementation focus (expanded Phase I):• More diverse set of countries + wider range of
stakeholders• More attention to capacity building and assess
donor support to analytic & advisory activities• HQ level studies by donors not included in Phase I2) Results focus: • Identify PD influence on development effectiveness
(outcomes & results)
Methodological IssuesChallenges to evaluate the results:
• Brief time span since PD endorsed (March 2005)• External influences make attribution difficult• Demanding data requirements• Complementary methodologies required
To handle these challenges the evaluation should:• Have a balanced & sufficient sample of countries• Have sufficient coverage of sectors and themes• Produce information of good quality• Offer possibility of explanation and attribution
Methodological Issues
Therefore methods should include:• Synthesis of existing evaluations, research and
indicators• Comparative in-depth case studies chosen to contain a
good cross-section of common themes/sectors• Longitudinal studies: backward looking to track PD-like
(longer established) policies and possibly forward looking (‘theory-based’ to map plausible directions of travel)
• Targeted comparative studies to ‘supplement’ country-based evaluations
Overseeing the evaluationInternational Reference Group, co-chaired by Sri Lankaand the Netherlands
• Members of the DAC Network on Development Evaluation (who actively support)
• Partner countries who conduct country-level evaluations
• Multilaterals and CSOs
Tasks:• Endorse overall Evaluation Framework and ToRs for
component & supplementary studies • Review draft reports for quality, credibility & clarity
Participants in Int. Ref. Group • Australia• Austria• Belgium• Canada• Denmark• Finland• France• Germany• Global Fund/GAVI• Ireland• Japan• The Netherlands• New Zealand• Norway• Spain• Sweden• Switzerland• United Kingdom• USA• UNDG/UNDP• OECD/DAC• CONCORD• World Bank/IEG
• Afghanistan• Bangladesh• Benin• Bolivia• Cambodia• Cameroun• Columbia• DRC• Indonesia• Ghana• Kyrgyz Republic• Malawi• Mali• Mozambique• Papua New Guinea• Samoa• Senegal• South Africa• Sri Lanka• Uganda• Viet Nam• Zambia• Reality of Aid
Managing the evaluation
Management Group responsible for:
• Developing the overall evaluation framework and ToR Core Evaluation Team• Coordinating and managing the evaluation process• Guiding the component studies • Developing and managing supplementary studies and synthesis of findings and recommendations.
Evaluation Secretariat at Danish Institute for International Studies
Managing the evaluation
National Reference Groups
Established in-country and with key government, development partners and NGO stakeholders
• Approve detailed design of country study
• Serve as resource for country evaluation teams
• Review draft evaluation products for quality, credibility and clarity
Euro USD @ 1,30
Country Level Studies (18) 1.440.000 1.872.000
Donor HQ Studies (4) 320.000 416.000
Reference Group meetings (4) 350.000 455.000
Management Group Meetings (8) 25.000 32.500
Regional workshops (8) 225.000 292.500
Core team 1.000.000 1.300.000
Special Studies 550.000 715.000
Dissemination 310.000 403.000
Secretariat DIIS 740.000 962.000
Contingencies 125.000 162.500
Total Estimated Cost 5.085.000 6.610.500
BUDGET
Contributions Euro Euro
Austria Norway *
Australia 100.000 Spain 240.000
Belgium 180.000 Sweden 580.000*
Canada 160.000* Switzerland 160.000
Denmark 200.000 UK 670.000
Finland 360.000 US 317.000
France * AfDB
Germany 410.000* AsDB 80.000
Ireland 80.000 EC
Japan 160.000 IDB
Luxemburg UN
Netherlands 740.000 World Bank In kind
New Zealand 45.000
TOTAL 4.482.000
Budget 5.085.000 Outstanding 603.000
Schedule of Events 2009• 11 – 13 Feb. 1st Meeting of the Reference Group for PD Evaluation Phase 2
Kick-off workshop - 1st draft Approach paper.• 15 May Approach Paper and TOR for Core Team approved.• 3 June Tender process initiated w. three bidders. (one has withdrawn)• 5 August Team Selection• 7 September Core Team operational• 1 October Draft Report on Untying of Aid to IRG for comments (by 11
October)• 26 – 28 Oct. Asia Pacific Regional Workshop in Cambodia• 1 November Final Report on Untying of Aid• 3 – 5 Nov. Latin America Regional Workshop in Colombia• 10 – 12 Nov. Anglophone Africa Regional Workshop in Malawi• 18 – 20 Nov. Francophone Africa Regional Workshop in Benin• 20 November Untying of Aid Report discussed in DAC• 30 November 2nd Meeting of the Reference Group for PD Evaluation Phase
2.1 December Country Level TOR; Work plan for 2010
• 2 – 3 Dec. WP-EFF, presentation of progress report and Untying of Aid Study