relevance and use of learning-oriented evaluative...
Post on 05-Jul-2020
2 Views
Preview:
TRANSCRIPT
Experience capitalization: relevance and use of learning-oriented evaluative
approaches to accelerate Africa´s development
Workshop
Mònica Lomeña-Gelis; Oumoul Khayri Ba Tall;
Jorge Chavez Tarfur; Esteban Tapella
AfrEA ConferenceProfessional development workshop
Abidjan, 13 March 2019
Workshop Objectives:
1. To introduce key concepts and main debates, recent
development and main tools to promote, facilitate and
support an experience capitalization process;
2. To explore the similarities and differences between
accountability- and learning-oriented evaluative
approaches;
3. To reflect about the role of a facilitator supporting an
experience capitalization process, building on practical
examples and cases
This workshop will be complemented by a panel during the
AfrEA Conference on Friday 15th (session at 8h30).
Excuse me, do you forget something?
Learning
Most
Significant
Change 1. What is your name?
2. Where do you come from?
3. What is your job?
4. What types of evaluation do you know?
Positivist, hypothetical
deduction and quantitative
approaches
Constructivist approaches,
interpretation-led, qualitative or
mixt.
Logic model, linear
cause-efect
Effort to understand complex
systems, dynamics, external
factors and interdependence
External experts Different perceptions accepted,
wide participation of actors
Emphasis on credible
results based on “rigorours”
methodsEmphasis on shared learning and
capacity strengthening
Aiming at demonstrating
accountability to external
authorities
Effort to understand what happened
on the basis of experience
Introduction about different evaluation schools
Project
Programme
Policy
Initial
Situation
Final
Situation
DesignOperations
ActivitiesProducts Results Impacts
Situational
AnalysisResults-
based
Evaluation Evaluation
ex AnteEvaluation
of EfficiencyEvaluation
Of Impact
Learning-
based
EvaluationEx-post and continuous evaluations focused on
learning, understanding, and lessons from
experience in order to inform future
interventions.
Evaluation of
Effectiveness
Continuous Evaluation / Monitoring
Different orientations/ focus of evaluation practice
• Capitalization
• Outcome harvesting
• Systemic Approach
• Theory of Programme
• Utilization-focused
Evaluation
Summative
/ Formative
It is « the passage from
experience to shareable
knowledge “.
(Pierre de Zutter, 1997)
What is
Capitalization?
Concepts and principles of experience capitalization
It is a process through which implicit (or
tacit) knowledge is made explicit and is
widely shared (FAO, 2013).
It is not just the evaluation of the
experience to extract lessons, but also
sharing and disseminating good practices
and promoting their adoption, adaptation
et application.
- Reconstitution and general analysis of the experience
with stakeholder to extract learning in a participatory
way (IED Afrique).
Concepts and principles of EC
- The capitalization is focused on the experience in
general, not only in good practices. Experience to be
capitalized is based on stakeholders’ lived experience
and the practice of their actions (Zutter).
- The products of capitalization are lessons and good
practices, its results are the induced changes in the
institutional practice (SDC). EC mut be integrated in
the organizational dynamic.
- Capitalization is linked to a diversity of approaches
which respond to different contexts.
Systematization is a
methodology originated in
Latin America for critical
reflection and learning
(Paulo Freire).
What is
Systematization?
Concepts and principles of systematization
It is a process to reflect about different
aspects of an intervention, from practice
and experience and with the active
participation of a variety of stakeholders.
• Some actors do not consider capitalization/systematization
as evaluation, because they only know accountability-based
evaluation.
• Theory and practice mix concepts around
«sistematización», capitalization and «lessons
learned papers».
• Systematization aims at ordering a knowledge system that
emerges from practice (experience) and from research.
Capitalization is only based on experience, without using a
pre-established framework (Zutter).
• Do you know other differences?
Some differences…
Approaches focused on
learning vs approaches
focused on accountability
Utility depending on the objectives of the evaluation.
Differences between Evaluation et Capitalization
It estimates effects and resultsof a project
Compares achieved results inrelation to planned objectives,baseline and end situations.
Determines expected orunexpected impacts
It is based on learning fromstakeholders’ experience
Joint-building of lessons toinfluence future interventions
Improve future interventionson the basis of previoussuccess and failures
EVALUATION FOCUSED
ON ACCOUNTABILITY
EVALUATION FOCUSED
ON LEARNING: CAPITALIZATION
What was the experience about? Who were thestakeholders? What is the relationship among them?
What was done, how, why, with which objective?
Why the project achieved that result? What are thereasons, the factors to obtain what was obtained?
How cultural, economic, institutional and political factorsinfluenced the experience?
What process emerged / happened during theintervention?
What were the hypotheses at the beginning? What havebeen the contradictions?
What lessons can we take from this experience? Whatshould be done differently, why?
How those lessons can be used to reinforce futureinterventions?
Q
U
E
S
T
I
O
N
S
(1) Identification of the
Object of capitalization
- Why?
- What Experience/s?
- What aspects?
- What axe of capitalization?
- Objective/utility (what is the
audience of the capitalization)
The Method of capitalization/systematization
(1) Identification of the
Object of EC
(2) Identification
Of key Actors
Most relevant (direct or
indirect) actors for the
experience.
Try to have multiple
perspectives about the
case.
La Méthode (II)
A multi-stakeholders approach is crucial if wewant to capitalize an experience to generateknowledge
The Method (III)
(1) Identification of the
object of EC
(2) Identification
Of actors
(3) The initial Situation
and the Context
Problem and departing
situation
Background, previous
experiences
Socio-economic and
political context
Goals and Objectives
Opportunities / Scope of
the experience
(1) Identification of Study
Object
(2) Identification
of Key Actors
(3) The Initial Situation
and the Context
(4) Intention and
Description of the
Experience
What is the main intervention strategy?
How was it conceived?
Development of the experience:
activities, participation and interaction of
stakeholders, etc.
Obstacles, changes, etc.
The Method (IV)
(1) Identification of the
object
(2) Identification
Of actors
(3) Initial Situation and
Context
(4) Intention and
Description of the
Experience
(5) Final or current
Situation
What are the most
important results?
What role did the
methodology play?
What are the influencing
factors?
The Method (V)
(2) Identification
of Key Actors
(3) The Initial Situation
and the Context
(4) Intention and
Description of the
Experience
(5) Final or current
Situation
(6) Achievements and
lessons learned
Critical reflection,
analysis and synthesis.
Why happened what it
happened? Various
perceptions accepted.
What did we learn? What
lessons could be
extracted?
Communicate the
lessons
The Method (VI)
(1) Identification of the
object of EC
(2) Identification
Of key actors
(3) Initial situation and
context
(4) Intention and
Description of the
Experience
(5) Final and current
Situation
(6) Achievements and
lessons learned
Participation of
people is at the core
of the process of
Capitalization
The Method (VII)
Community
meetings
Focus
groups
Interviews
Role play
Participatory
cartography
Workshops
Questionnaires
Simulation
games
Tools and techniques often used in capitalization
Narration /
storytelling
Transects
Rural
Radio
Exchange visits
among
communities
Power Point
Presentations
Short Film
http://www.iedafrique.o
rg/Les-conventions-
locales.html
CD
multimedia
Leaflets
Flip Chart
Cartoons
Photo exhibition
Stage play
Communication of capitalizations
1. Think about an experience where you participatedand that you think can be useful to be capitalizedbecause there are interesting lessons that youlearned, or because you do not understand totallyhow things happened, or for any other reason.
2. Define the object of the capitalization, what was the learning, etc
3. Identify the key stakeholders that were involved in this case and the links with the experience
Reflection about the development of a Plan of an EC
Why do we want to capitalize this experience?
Lessons that we expect obtain through this case
People who may be interested in this new
kwnoledge
Is this experience / project unpublished?
could it be replicated in other contexts?
What aspects of the experience are the most
important?
Limit the scope of the experience, focus on the main
aspects.
How are we going to do the EC?
Who will be involved? Why?
how are we planning to obtain the information?
How are we going to communicate the results?
Questions that
could be
helpful…
The role of the facilitator
FACILITATION: WHY IS IT
NECESSARY?
Many tasks
involved
Many people
involved
Different
interests,
different skills
Process may
take timeNeed to ensure
conditions
Need to be
efficient and
effective
“TO FACILITATE IS TO MAKE AN
ACTION OR PROCESS EASIER…”
– Keep the group on track
– So that results are met
within the given period of
time
– Support the process
–and ensure that the
expected results are met
1 2- Increase the group’s
effectiveness building on
the skills and expertise
available
3
DIFFERENT TASKS
Keep focus Encourage
participation
Manage time
Build trust Deal with
conflicts
Ask
questions
(and provide
answers)
Clarify Summaris
e findings
Listen and
react
WHOSE TASK?
– One of the team
–An internal job, one of
the “champions” or
managers
– Multiple individuals
–Sharing different
roles at different times
(especially in small
groups)
1 2- An external person
- Somebody neutral and
who will not be affected
by the results of the
discussions
3
DIFFERENT MOMENTS
Preparation
Gathering
and
organizing
information
Description
Analysis
Documen-
tation and
sharing
“Using” the
results
WHAT DO WE DO
Organise an
event
Build a
session on
what people
know
Share
information
Edit textsEncourage
participation
WHAT SKILLS DO WE NEED?
Time management Use of tools
Communications and
interpersonal skills
Subject matter / content
Editor
Capitalization contributes to improve the quality ofinterventions through the creation of an enabling environmentfor reflection and sharing
It also strengthens the capacities of actors through encouraging them to reflect about their own practice
It contributes to sharing advice and lessons learned with a wide public working in development programmes
It contributes to enrich the theory of change for future interventions on the field
What are your ideas??
Final remarks about the contribution of the EC
approach
EC Resources
1. In English :
•Eggens, L. and J. Chavez-Tafur. 2019. Facilitating experience capitalization: A
guidebook. Wageningen: CTA. https://hdl.handle.net/10568/99247
•Brunelli, Mareike. 2014. A Short Guide to Participatory Systematization.
Universitas Forum, Ciudad de la Habana
http://hdrnet.org/670/1/A_Short_Guide_to_Participatory_Systematization.pdf
• Tapella, E., & Rodriguez-Bilella, P. (2014). Shared learning and participatory
evaluation: The sistematizacion approach to assess development interventions.
Evaluation, 20(1), 115–133. doi:10.1177/1356389013516055
•Luger, Anton; Massing, Lilo, 2013. Learning from our experience: A guide to
participative systematisation. http://www.knowhow3000.org/wp/wp-
content/files/KM/KM%20public/Manuals%20%26%20Handbooks/ENG_MAN_Le
arning-From-Our-Experience-A-guide-to-participative-sistematisation_2015.pdf
• Nations, U. (2013). Good practices at FAO : Experience capitalization for
continuous learning, 13(September), 1–12.
http://www.fao.org/docrep/017/ap784e/ap784e.pdf
1. In English (continuation) :
• SDC. (2011). Experience Capitalization. An excellent opportunity to know what
you could know better. (pp. 1–8). www.sdc-learningandnetworking.ch
•Linden, Kristin, 2010. Learning from Experience and Sharing Knowledge: A
Capitalization Manual. ACF
https://www.actionagainsthunger.org/about/international-network
•Tapella, Esteban; 2009. Systematization: Basic concepts and methodological
considerations. ActionAid
https://sistematizandoexperiencias.files.wordpress.com/2012/04/isadvocacy-for-
change-chapter1-baja.pdf
• Chavez-tafur, J., Hampson, K., Ingevall, A., & Thijssen, R. (2007). Learning
from experience. http://www.ircwash.org/resources/learning-experience-manual-
organisinganalysing-and-documenting-field-based-information
• IFAD, G. and. (2009). Knowledge profiling. Promoting easy access to
knowledge and experience generated in projects and programmes.
http://www.ifad.org/english/water/manual/kp.pdf
1. In English (continuation 2) :
• Meij, B. Van Der, Hampson, K., & Chavez-tafur, J. (2008). Documentation,
Sistematización, Capitalisation. A compilation of methods and approaches.
http://subscriptions.leisa.info/index.php?url=getblob.php&o_id=236571&a_id=704
69&a_seq =0
• SDC. (2007). Experience capitalization. Accumulating experience capital to
prepare change processes (pp. 1–7). www.sdc-learningandnetworking.ch
• Selener, Daniel; Purdy, Christopher; Zapata, Gabriela. 1996.
Documenting,Evaluating and Learning from our Development Projects: A
Participatory Systematization Workbook. International Institute of Rural
Reconstruction.
http://repository.experience-capitalization.net/handle/123456789/57
FAO e-learning course: “Experience Capitalization for Continuous Learning”:
http://www.fao.org/elearning/#/elc/en/course/EXCAP
CTA repository on EC: http://repository.experience-capitalization.net/
2. En français :
• Didier, S. (2013). La démarche de capitalisation d’expérience: de la pratique à la
connaissance partageable. La Cible (AFITEP Association Francophone de
Management de Projet), 2ème trime(121), 44–47.
http://afitep.org/files/documentslies/lacible/tiresapart/cible121p44DOSSIERDemarch
eCapitalisation.pdf
• Mersadier, G. (2011). Bibliographie commentée sur la capitalisation d’expériences
dans le développement international. Knowledge Management for Development
Journal, 7(2), http://doc.mersadier.org/BiblioCommenteeCapitalisation.pdf
• Didier, S. (2010). La capitalisation d ’ expérience au service de la solidarité
internationale. http://www.cercoop.org/IMG/pdf/2010-
10capitalisationSabineDidier.pdf
• Fall, N. C. and Niang, T. (2010). Capitalisation d ’ expériences et innovations
institutionnelles en Afrique de l’Ouest.
journals.sfu.ca/iaald/index.php/aginfo/article/download/188/147
• Robert, S. and Olltitrault-Bernard, A. (2005). Le capital mémoire. Identifier,
analyser et valoriser l’expérience dans les institutions. (pp. 1–216).
www.ehesp.fr/wpcontent/uploads/.../Le-capital-mémoire-R.-Sylvie.pdf
2. En français (continuation):
• Zutter, P. de. (1997). Des histoires, des savoirs et des hommes : l’expérience est
un capital, réflexion sur la capitalisation d’expérience. http://base.d-p-
h.info/fr/dossiers/dossier-117.html
Manuels et guides
• Feuvrier, M-V., Balizet, O., Noury, A., 2014. La capitalisation des expériences - un
voyage au coueur de l'apprentissage. Les collections du F3E.
http://f3e.asso.fr/media/transfer/doc/guide_capitalisation.pdf
• FRAO-FIDA. (2009). Capitalisation et valorisation des expériences des projets et
programmes de développement financés par le FIDA en Afrique de l ’ Ouest et du
Centre. Guide méthodologique.
http://www.fidafrique.net/IMG/pdf/CAPITALISATION_FIDAfrique_FR.pdf
http://www.frao.info/index.php/programmes-activites/gestion-des-savoirs
• Afrique, I., & ILEIA, A. (2007). Du terrain au partage. Manuel pour la capitalisation
des expériences. http://www.iedafrique.org/IMG/pdf/du_terrain_au_partage.pdf
2. En français (continuation 2):
• Graugnard, G. (2006). Introduction a la capitalisation d’expériences. Formation et
note de synthèse réalisées par le CIEDEL.
http://f3e.asso.fr/IMG/pdf/Note_de_synthese_formation_capitalisation_2006.pdf
• Fall, N. C. and Ndiaye, A. A. (2005). Methodology for capitalisation and
enhancement of IFAD programmes in West and Central Africa (pp. 1–57).
www.fidafrique.net
• Villeval, P. and Delville, P. L. (2004). Capitalisation d’expériences... expérience de
capitalisations. Comment passer de la volonté à l'action? (No. 15).
http://www.groupeinitiatives.org/IMG/pdf/traverse_15.pdf
3. En espagnol :
• Martinic, S. (2010). El objeto de la sistematización y sus relaciones con la
evaluación y la investigación.
https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpb
nx0c3ByY Xhpc3Npc3RlbWF0aXphY2lvbnxneDoxZTIyMzFmYWE4MzVjYTk3,
2014
•Mosquera Echeverry, Erika Eliana; 2010. Descubriendo el poder de la
reflexión: Guía para la sistematización de experiencias. CIAT (Centro
Internacional para la Agricultura Tropical).
https://cgspace.cgiar.org/handle/10568/54652?show=full
•Eizaguirre, Marlen, Gorka Urrutia y Carlos Askunze. 2004. La sistematization,
una nueva mirada a nuestras prácticas. Guía para la sistematización de
experiencias de transformación social. ALBOAN
https://mitrabajoessocial.wordpress.com/2016/06/02/la-sistematizacion-una-
nueva-mirada-a-nuestras-practicas-guia-para-la-sistematizacion-de-
experiencias-de-transformacion-social/
•FAO. 2004. Guía Metodológica de Sistematización: Programa Especial para la
Seguridad Alimentaria PESA en Centroamérica. FAO.
http://repository.experience-capitalization.net/handle/123456789/68
3. En espagnol (continuation):
• Zutter, P. de. (1997). Historias , saberes y gentes. De la experiencia al
conocimiento. (E. Horizonte, Ed.) (Edicion Li.). Lima, Perú.
http://pzutter.net/mediapool/54/542579/data/1997_Historias_Saberes_y_gentes.pdf
• Selener, D. (1996). Aprendiendo de nuestros proyectos de desarrollo. Manual de
sistematización participativa.
https://repository.unm.edu/bitstream/handle/1928/11594/Manual%20sistematización
%20parti cipativa%20español.pdf?sequence=1
top related