evaluating global and regional partnership programs (2011 evaluation week)
Post on 19-Oct-2014
629 views
DESCRIPTION
Presentation at the 2011 Evaluation WeekTRANSCRIPT
![Page 1: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/1.jpg)
Evaluating Global and Regional Partnership Programs
IEG Week 2011
© Universalia
![Page 2: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/2.jpg)
GRPP Evaluated
• Cities Alliance• Association for the Development of Education in
Africa (ADEA)• Global Facility for Disaster Reduction and Recovery• Water and Sanitation Program• Global Facility for Disaster Reduction and Recovery
(GFDRR)• The International Land Coalition• Global Road Safety Facility (GRSF)• Global Donor Platform for Rural Development• infoDev
October 2011 2
![Page 3: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/3.jpg)
ISSUES WITH TERMS OF REFERENCE
3October 2011
![Page 4: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/4.jpg)
Terms of Reference
• Scope and focus comparable: relevance, efficacy, efficiency, sustainability, Management.
• Limited links between evaluation questions and program maturity
• Strong focus of relevance of objectives – less on relevance of design
4October 2011
![Page 5: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/5.jpg)
Terms of Reference
• Efficacy– Clear questions and appropriate
resources allocated to evaluate inputs, progress of activities and outputs
– Questions on outcomes tend to downplay outcomes multiplier, downstream effects , unintended effects, boundaries of effects
– In general unsuficcient resources allocated to evaluating outcomes
5October 2011
![Page 6: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/6.jpg)
Terms of Reference
• GRPP include efficiency questions – they are difficult to answer– Changing scale and scope of GRPP– Absence of benchmark
• Cost-effectiveness questions more difficult to answer often due to an absence of alternatives
6October 2011
![Page 7: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/7.jpg)
ISSUES IN THE CONDUCT OF THE EVALUATION
![Page 8: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/8.jpg)
GRPP Members
• Diversity and multiplicity– More consultation, more participation,
increased time requirements – Diverse expectations about the deliverables
• Power shifts– Participation of large Foundations creates a
new dynamics amongst the membership– Need to ensure that actual inbalance is not
reflected in the evaluation• Effects of turnover
8October 2011
![Page 9: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/9.jpg)
GRPP Members
• Reporting evaluation results to members who are– Host– Member– Donor– Partner– Beneficiary
• Potential conflict of roles, or goal displacement?
9October 2011
![Page 10: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/10.jpg)
GOVERNANC E ISSUES: FRAMEWORKS UNDERLYING GRPP EVALUATIONS
10October 2011
![Page 11: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/11.jpg)
Structural Complexity of the GRPPs
• The GRPPs represent various forms of networks:– Association– Facility– Coalition– Platform– Program– Partnership
• Yet, evaluation of GRPPs draws significantly on organizational analysis literature
11October 2011
![Page 12: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/12.jpg)
What Do We Know About Network Evaluation?
• The literature on evaluation of networks and inter-organizational networking indicates that research has centered on the driving forces behind networks rather than on effectiveness of networks.
• Effective GRPP governance should perhaps be examined through variables and indicators from the network literature or the team literature
12October 2011
![Page 13: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/13.jpg)
• Assesses team effectiveness through several predictors of team performance – Cohesiveness– Size– Leadership– Motivation– Goal group– Composition
Team Literature
13October 2011
![Page 14: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/14.jpg)
• Assesses the effects of networks using several variables:– Social influence– Power– Social exchange– Knowledge Management– Social Capital
Social Network Analysis
14October 2011
![Page 15: Evaluating Global and Regional Partnership Programs (2011 Evaluation Week)](https://reader036.vdocuments.net/reader036/viewer/2022081907/544405b2afaf9fa8098b4743/html5/thumbnails/15.jpg)
Conclusions
• Additional tools are required for practitioners
• Evaluations of GRPP requires sector expertise and experts familiar with organization, teams and network dynamics
23-04-07 © Universalia 15