monitoring and evaluation - gsdrc
TRANSCRIPT
Foreword – How to use this guideTel: 0121 414 5037 Fax: 0121 414 7490
www.gsdrc.org
Published: September 2007
© International Development Department, University of Birmingham
About the GSDRC The Governance and Social Development Resource Centre (GSDRC) was established by the UK Department for International Development (DFID) in 2005 to provide access to high quality, timely information to support international development project and programme planning, policymaking, and other activities in the field How to use this guide
This topic guide provides an overview of current knowledge in monitoring and evaluation of development activities. It includes short summaries of key texts. Each short summary links to an extended version in the appendix, along with information on how to access the original text. Both the short and extended summaries are cross-referenced in the guide.
Key
This symbol, next to each short summary in the main text, indicates where the extended summary can be found in the appendix
1a p. 28
This symbol, next to each extended summary in the appendix, links back to the short summary in the main text
p. 5
This symbol, at the end of the extended summaries in the
appendix, indicates how to access the original text This topic guide can also be accessed on the GSDRC website: www.gsdrc.org. The online version includes guidance for DFID staff, evaluations of DFID’s aid instruments, and evaluations of cross-cutting issues.
Contact: [email protected]
1. Introduction 4
The Changing Context of M&E 4 Common Tools and Approaches 5 Terms and definitions 5 Where is a good place to start? 6 2. Monitoring poverty reduction strategies 7
Poverty Monitoring Systems 7 Lessons Learned in Design 7 Indicators 8 Institutions for PRS Monitoring 9 What Role for Donors? 10 Civil Society Participation 11 Strengthening National Statistical Capacity 11 3. Impact evaluation 12
Attribution and the Counterfactual: The Case for More and Better Impact 12 Evaluation Randomized Control Trials: The Gold Standard? 13 Adapting to Time, Budget and Data Constraints 13 Mixed-method Designs 14 Toolkits 15 4. Managing M&E 16
Steps in Planning and Design 16 Ensuring Evaluation Quality 17 Identifying Threats to the Validity of Evaluation Findings 17 Evaluating Multi-donor Programmes 18 The Politics of Evaluation 19 Promoting the use of Evaluation Findings 20 Strengthening National M&E Capacity 20
5. Participatory tools and approaches 21
The Case for Participatory M&E 21 Challenges in Using Participatory Approaches 22 Participatory Tools: Case Studies 23 Participatory Rural Appraisal 23 Key Informant Interviews 24 Most Significant Change Technique 24 Outcome Mapping 25 6. Gender & conflict sensitivity 25
Gender Analysis 26 M&E in Conflict and Fragile States 26 7. Appendix: Full summaries 28
3
Contents
3. Impact evaluation 12
5. Participatory tools and approaches 21
6. Gender & conflict sensitivity 25
7. Appendix: Full summaries 28
1. Introduction
1.2. Common Tools and Approaches
1.3. Terms and Definitions
2. Monitoring poverty reduction strategies
2.1 Poverty Monitoring Systems
2.3. Indicators
2.6. Civil Society Participation
3. Impact Evaluation
3.1. Attribution and the Counterfactual: The Case for More and Better Impact Evaluation
3.2. Randomized Control Trials: The Gold Standard?
3.4. Mixed-Method Designs
4.2. Ensuring Evaluation Quality
4.3. Evaluating Multi-donor Programmes
4.5. Promoting the Use of Evaluation Findings
4.6. Strengthening National M&E Capacity
5. Participatory tools and approaches
5.1. The Case for Participatory M&E
5.2. Challenges in Using Participatory Approaches
5.3. Participatory Tools: Case Studies
6. Gender and conflict sensitivity
6.1. Gender Analysis
7. Appendix: Full summaries
www.gsdrc.org
Published: September 2007
© International Development Department, University of Birmingham
About the GSDRC The Governance and Social Development Resource Centre (GSDRC) was established by the UK Department for International Development (DFID) in 2005 to provide access to high quality, timely information to support international development project and programme planning, policymaking, and other activities in the field How to use this guide
This topic guide provides an overview of current knowledge in monitoring and evaluation of development activities. It includes short summaries of key texts. Each short summary links to an extended version in the appendix, along with information on how to access the original text. Both the short and extended summaries are cross-referenced in the guide.
Key
This symbol, next to each short summary in the main text, indicates where the extended summary can be found in the appendix
1a p. 28
This symbol, next to each extended summary in the appendix, links back to the short summary in the main text
p. 5
This symbol, at the end of the extended summaries in the
appendix, indicates how to access the original text This topic guide can also be accessed on the GSDRC website: www.gsdrc.org. The online version includes guidance for DFID staff, evaluations of DFID’s aid instruments, and evaluations of cross-cutting issues.
Contact: [email protected]
1. Introduction 4
The Changing Context of M&E 4 Common Tools and Approaches 5 Terms and definitions 5 Where is a good place to start? 6 2. Monitoring poverty reduction strategies 7
Poverty Monitoring Systems 7 Lessons Learned in Design 7 Indicators 8 Institutions for PRS Monitoring 9 What Role for Donors? 10 Civil Society Participation 11 Strengthening National Statistical Capacity 11 3. Impact evaluation 12
Attribution and the Counterfactual: The Case for More and Better Impact 12 Evaluation Randomized Control Trials: The Gold Standard? 13 Adapting to Time, Budget and Data Constraints 13 Mixed-method Designs 14 Toolkits 15 4. Managing M&E 16
Steps in Planning and Design 16 Ensuring Evaluation Quality 17 Identifying Threats to the Validity of Evaluation Findings 17 Evaluating Multi-donor Programmes 18 The Politics of Evaluation 19 Promoting the use of Evaluation Findings 20 Strengthening National M&E Capacity 20
5. Participatory tools and approaches 21
The Case for Participatory M&E 21 Challenges in Using Participatory Approaches 22 Participatory Tools: Case Studies 23 Participatory Rural Appraisal 23 Key Informant Interviews 24 Most Significant Change Technique 24 Outcome Mapping 25 6. Gender & conflict sensitivity 25
Gender Analysis 26 M&E in Conflict and Fragile States 26 7. Appendix: Full summaries 28
3
Contents
3. Impact evaluation 12
5. Participatory tools and approaches 21
6. Gender & conflict sensitivity 25
7. Appendix: Full summaries 28
1. Introduction
1.2. Common Tools and Approaches
1.3. Terms and Definitions
2. Monitoring poverty reduction strategies
2.1 Poverty Monitoring Systems
2.3. Indicators
2.6. Civil Society Participation
3. Impact Evaluation
3.1. Attribution and the Counterfactual: The Case for More and Better Impact Evaluation
3.2. Randomized Control Trials: The Gold Standard?
3.4. Mixed-Method Designs
4.2. Ensuring Evaluation Quality
4.3. Evaluating Multi-donor Programmes
4.5. Promoting the Use of Evaluation Findings
4.6. Strengthening National M&E Capacity
5. Participatory tools and approaches
5.1. The Case for Participatory M&E
5.2. Challenges in Using Participatory Approaches
5.3. Participatory Tools: Case Studies
6. Gender and conflict sensitivity
6.1. Gender Analysis
7. Appendix: Full summaries