Experience capitalization: relevance and use of learning-oriented evaluative

approaches to accelerate Africa´s development

Workshop

Mònica Lomeña-Gelis; Oumoul Khayri Ba Tall;

Jorge Chavez Tarfur; Esteban Tapella

AfrEA ConferenceProfessional development workshop

Abidjan, 13 March 2019

Workshop Objectives:

1. To introduce key concepts and main debates, recent

development and main tools to promote, facilitate and

support an experience capitalization process;

2. To explore the similarities and differences between

accountability- and learning-oriented evaluative

approaches;

3. To reflect about the role of a facilitator supporting an

experience capitalization process, building on practical

examples and cases

This workshop will be complemented by a panel during the

AfrEA Conference on Friday 15th (session at 8h30).

Excuse me, do you forget something?

Learning

Most

Significant

Change 1. What is your name?

2. Where do you come from?

3. What is your job?

4. What types of evaluation do you know?

Positivist, hypothetical

deduction and quantitative

approaches

Constructivist approaches,

interpretation-led, qualitative or

mixt.

Logic model, linear

cause-efect

Effort to understand complex

systems, dynamics, external

factors and interdependence

External experts Different perceptions accepted,

wide participation of actors

Emphasis on credible

results based on “rigorours”

methodsEmphasis on shared learning and

capacity strengthening

Aiming at demonstrating

accountability to external

authorities

Effort to understand what happened

on the basis of experience

Introduction about different evaluation schools

Project

Programme

Policy

Initial

Situation

Final

Situation

DesignOperations

ActivitiesProducts Results Impacts

Situational

AnalysisResults-

based

Evaluation Evaluation

ex AnteEvaluation

of EfficiencyEvaluation

Of Impact

Learning-

based

EvaluationEx-post and continuous evaluations focused on

learning, understanding, and lessons from

experience in order to inform future

interventions.

Evaluation of

Effectiveness

Continuous Evaluation / Monitoring

Different orientations/ focus of evaluation practice

• Capitalization

• Outcome harvesting

• Systemic Approach

• Theory of Programme

• Utilization-focused

Evaluation

Summative

/ Formative

It is « the passage from

experience to shareable

knowledge “.

(Pierre de Zutter, 1997)

What is

Capitalization?

Concepts and principles of experience capitalization

It is a process through which implicit (or

tacit) knowledge is made explicit and is

widely shared (FAO, 2013).

It is not just the evaluation of the

experience to extract lessons, but also

sharing and disseminating good practices

and promoting their adoption, adaptation

et application.

- Reconstitution and general analysis of the experience

with stakeholder to extract learning in a participatory

way (IED Afrique).

Concepts and principles of EC

- The capitalization is focused on the experience in

general, not only in good practices. Experience to be

capitalized is based on stakeholders’ lived experience

and the practice of their actions (Zutter).

- The products of capitalization are lessons and good

practices, its results are the induced changes in the

institutional practice (SDC). EC mut be integrated in

the organizational dynamic.

- Capitalization is linked to a diversity of approaches

which respond to different contexts.

Systematization is a

methodology originated in

Latin America for critical

reflection and learning

(Paulo Freire).

What is

Systematization?

Concepts and principles of systematization

It is a process to reflect about different

aspects of an intervention, from practice

and experience and with the active

participation of a variety of stakeholders.

• Some actors do not consider capitalization/systematization

as evaluation, because they only know accountability-based

evaluation.

• Theory and practice mix concepts around

«sistematización», capitalization and «lessons

learned papers».

• Systematization aims at ordering a knowledge system that

emerges from practice (experience) and from research.

Capitalization is only based on experience, without using a

pre-established framework (Zutter).

• Do you know other differences?

Some differences…

Approaches focused on

learning vs approaches

focused on accountability

Utility depending on the objectives of the evaluation.

Differences between Evaluation et Capitalization

It estimates effects and resultsof a project

Compares achieved results inrelation to planned objectives,baseline and end situations.

Determines expected orunexpected impacts

It is based on learning fromstakeholders’ experience

Joint-building of lessons toinfluence future interventions

Improve future interventionson the basis of previoussuccess and failures

EVALUATION FOCUSED

ON ACCOUNTABILITY

EVALUATION FOCUSED

ON LEARNING: CAPITALIZATION

What was the experience about? Who were thestakeholders? What is the relationship among them?

What was done, how, why, with which objective?

Why the project achieved that result? What are thereasons, the factors to obtain what was obtained?

How cultural, economic, institutional and political factorsinfluenced the experience?

What process emerged / happened during theintervention?

What were the hypotheses at the beginning? What havebeen the contradictions?

What lessons can we take from this experience? Whatshould be done differently, why?

How those lessons can be used to reinforce futureinterventions?

Q

U

E

S

T

I

O

N

S

(1) Identification of the

Object of capitalization

- Why?

- What Experience/s?

- What aspects?

- What axe of capitalization?

- Objective/utility (what is the

audience of the capitalization)

The Method of capitalization/systematization

(1) Identification of the

Object of EC

(2) Identification

Of key Actors

Most relevant (direct or

indirect) actors for the

experience.

Try to have multiple

perspectives about the

case.

La Méthode (II)

A multi-stakeholders approach is crucial if wewant to capitalize an experience to generateknowledge

The Method (III)

(1) Identification of the

object of EC

(2) Identification

Of actors

(3) The initial Situation

and the Context

Problem and departing

situation

Background, previous

experiences

Socio-economic and

political context

Goals and Objectives

Opportunities / Scope of

the experience

(1) Identification of Study

Object

(2) Identification

of Key Actors

(3) The Initial Situation

and the Context

(4) Intention and

Description of the

Experience

What is the main intervention strategy?

How was it conceived?

Development of the experience:

activities, participation and interaction of

stakeholders, etc.

Obstacles, changes, etc.

The Method (IV)

(1) Identification of the

object

(2) Identification

Of actors

(3) Initial Situation and

Context

(4) Intention and

Description of the

Experience

(5) Final or current

Situation

What are the most

important results?

What role did the

methodology play?

What are the influencing

factors?

The Method (V)

(2) Identification

of Key Actors

(3) The Initial Situation

and the Context

(4) Intention and

Description of the

Experience

(5) Final or current

Situation

(6) Achievements and

lessons learned

Critical reflection,

analysis and synthesis.

Why happened what it

happened? Various

perceptions accepted.

What did we learn? What

lessons could be

extracted?

Communicate the

lessons

The Method (VI)

(1) Identification of the

object of EC

(2) Identification

Of key actors

(3) Initial situation and

context

(4) Intention and

Description of the

Experience

(5) Final and current

Situation

(6) Achievements and

lessons learned

Participation of

people is at the core

of the process of

Capitalization

The Method (VII)

Community

meetings

Focus

groups

Interviews

Role play

Participatory

cartography

Workshops

Questionnaires

Simulation

games

Tools and techniques often used in capitalization

Narration /

storytelling

Transects

Rural

Radio

Exchange visits

among

communities

Power Point

Presentations

Short Film

http://www.iedafrique.o

rg/Les-conventions-

locales.html

CD

multimedia

Leaflets

Flip Chart

Cartoons

Photo exhibition

Stage play

Communication of capitalizations

1. Think about an experience where you participatedand that you think can be useful to be capitalizedbecause there are interesting lessons that youlearned, or because you do not understand totallyhow things happened, or for any other reason.

2. Define the object of the capitalization, what was the learning, etc

3. Identify the key stakeholders that were involved in this case and the links with the experience

Reflection about the development of a Plan of an EC

Why do we want to capitalize this experience?

Lessons that we expect obtain through this case

People who may be interested in this new

kwnoledge

Is this experience / project unpublished?

could it be replicated in other contexts?

What aspects of the experience are the most

important?

Limit the scope of the experience, focus on the main

aspects.

How are we going to do the EC?

Who will be involved? Why?

how are we planning to obtain the information?

How are we going to communicate the results?

Questions that

could be

helpful…

The role of the facilitator

FACILITATION: WHY IS IT

NECESSARY?

Many tasks

involved

Many people

involved

Different

interests,

different skills

Process may

take timeNeed to ensure

conditions

Need to be

efficient and

effective

“TO FACILITATE IS TO MAKE AN

ACTION OR PROCESS EASIER…”

– Keep the group on track

– So that results are met

within the given period of

time

– Support the process

–and ensure that the

expected results are met

1 2- Increase the group’s

effectiveness building on

the skills and expertise

available

3

DIFFERENT TASKS

Keep focus Encourage

participation

Manage time

Build trust Deal with

conflicts

Ask

questions

(and provide

answers)

Clarify Summaris

e findings

Listen and

react

WHOSE TASK?

– One of the team

–An internal job, one of

the “champions” or

managers

– Multiple individuals

–Sharing different

roles at different times

(especially in small

groups)

1 2- An external person

- Somebody neutral and

who will not be affected

by the results of the

discussions

3

DIFFERENT MOMENTS

Preparation

Gathering

and

organizing

information

Description

Analysis

Documen-

tation and

sharing

“Using” the

results

WHAT DO WE DO

Organise an

event

Build a

session on

what people

know

Share

information

Edit textsEncourage

participation

WHAT SKILLS DO WE NEED?

Time management Use of tools

Communications and

interpersonal skills

Subject matter / content

Editor

Capitalization contributes to improve the quality ofinterventions through the creation of an enabling environmentfor reflection and sharing

It also strengthens the capacities of actors through encouraging them to reflect about their own practice

It contributes to sharing advice and lessons learned with a wide public working in development programmes

It contributes to enrich the theory of change for future interventions on the field

What are your ideas??

Final remarks about the contribution of the EC

approach

EC Resources

1. In English :

•Eggens, L. and J. Chavez-Tafur. 2019. Facilitating experience capitalization: A

guidebook. Wageningen: CTA. https://hdl.handle.net/10568/99247

•Brunelli, Mareike. 2014. A Short Guide to Participatory Systematization.

Universitas Forum, Ciudad de la Habana

http://hdrnet.org/670/1/A_Short_Guide_to_Participatory_Systematization.pdf

• Tapella, E., & Rodriguez-Bilella, P. (2014). Shared learning and participatory

evaluation: The sistematizacion approach to assess development interventions.

Evaluation, 20(1), 115–133. doi:10.1177/1356389013516055

•Luger, Anton; Massing, Lilo, 2013. Learning from our experience: A guide to

participative systematisation. http://www.knowhow3000.org/wp/wp-

content/files/KM/KM%20public/Manuals%20%26%20Handbooks/ENG_MAN_Le

arning-From-Our-Experience-A-guide-to-participative-sistematisation_2015.pdf

• Nations, U. (2013). Good practices at FAO  : Experience capitalization for

continuous learning, 13(September), 1–12.

http://www.fao.org/docrep/017/ap784e/ap784e.pdf

1. In English (continuation) :

• SDC. (2011). Experience Capitalization. An excellent opportunity to know what

you could know better. (pp. 1–8). www.sdc-learningandnetworking.ch

•Linden, Kristin, 2010. Learning from Experience and Sharing Knowledge: A

Capitalization Manual. ACF

https://www.actionagainsthunger.org/about/international-network

•Tapella, Esteban; 2009. Systematization: Basic concepts and methodological

considerations. ActionAid

https://sistematizandoexperiencias.files.wordpress.com/2012/04/isadvocacy-for-

change-chapter1-baja.pdf

• Chavez-tafur, J., Hampson, K., Ingevall, A., & Thijssen, R. (2007). Learning

from experience. http://www.ircwash.org/resources/learning-experience-manual-

organisinganalysing-and-documenting-field-based-information

• IFAD, G. and. (2009). Knowledge profiling. Promoting easy access to

knowledge and experience generated in projects and programmes.

http://www.ifad.org/english/water/manual/kp.pdf

1. In English (continuation 2) :

• Meij, B. Van Der, Hampson, K., & Chavez-tafur, J. (2008). Documentation,

Sistematización, Capitalisation. A compilation of methods and approaches.

http://subscriptions.leisa.info/index.php?url=getblob.php&o_id=236571&a_id=704

69&a_seq =0

• SDC. (2007). Experience capitalization. Accumulating experience capital to

prepare change processes (pp. 1–7). www.sdc-learningandnetworking.ch

• Selener, Daniel; Purdy, Christopher; Zapata, Gabriela. 1996.

Documenting,Evaluating and Learning from our Development Projects: A

Participatory Systematization Workbook. International Institute of Rural

Reconstruction.

http://repository.experience-capitalization.net/handle/123456789/57

FAO e-learning course: “Experience Capitalization for Continuous Learning”:

http://www.fao.org/elearning/#/elc/en/course/EXCAP

CTA repository on EC: http://repository.experience-capitalization.net/

2. En français :

• Didier, S. (2013). La démarche de capitalisation d’expérience: de la pratique à la

connaissance partageable. La Cible (AFITEP Association Francophone de

Management de Projet), 2ème trime(121), 44–47.

http://afitep.org/files/documentslies/lacible/tiresapart/cible121p44DOSSIERDemarch

eCapitalisation.pdf

• Mersadier, G. (2011). Bibliographie commentée sur la capitalisation d’expériences

dans le développement international. Knowledge Management for Development

Journal, 7(2), http://doc.mersadier.org/BiblioCommenteeCapitalisation.pdf

• Didier, S. (2010). La capitalisation d ’ expérience au service de la solidarité

internationale. http://www.cercoop.org/IMG/pdf/2010-

10capitalisationSabineDidier.pdf

• Fall, N. C. and Niang, T. (2010). Capitalisation d ’ expériences et innovations

institutionnelles en Afrique de l’Ouest.

journals.sfu.ca/iaald/index.php/aginfo/article/download/188/147

• Robert, S. and Olltitrault-Bernard, A. (2005). Le capital mémoire. Identifier,

analyser et valoriser l’expérience dans les institutions. (pp. 1–216).

www.ehesp.fr/wpcontent/uploads/.../Le-capital-mémoire-R.-Sylvie.pdf

2. En français (continuation):

• Zutter, P. de. (1997). Des histoires, des savoirs et des hommes  : l’expérience est

un capital, réflexion sur la capitalisation d’expérience. http://base.d-p-

h.info/fr/dossiers/dossier-117.html

Manuels et guides

• Feuvrier, M-V., Balizet, O., Noury, A., 2014. La capitalisation des expériences - un

voyage au coueur de l'apprentissage. Les collections du F3E.

http://f3e.asso.fr/media/transfer/doc/guide_capitalisation.pdf

• FRAO-FIDA. (2009). Capitalisation et valorisation des expériences des projets et

programmes de développement financés par le FIDA en Afrique de l ’ Ouest et du

Centre. Guide méthodologique.

http://www.fidafrique.net/IMG/pdf/CAPITALISATION_FIDAfrique_FR.pdf

http://www.frao.info/index.php/programmes-activites/gestion-des-savoirs

• Afrique, I., & ILEIA, A. (2007). Du terrain au partage. Manuel pour la capitalisation

des expériences. http://www.iedafrique.org/IMG/pdf/du_terrain_au_partage.pdf

2. En français (continuation 2):

• Graugnard, G. (2006). Introduction a la capitalisation d’expériences. Formation et

note de synthèse réalisées par le CIEDEL.

http://f3e.asso.fr/IMG/pdf/Note_de_synthese_formation_capitalisation_2006.pdf

• Fall, N. C. and Ndiaye, A. A. (2005). Methodology for capitalisation and

enhancement of IFAD programmes in West and Central Africa (pp. 1–57).

www.fidafrique.net

• Villeval, P. and Delville, P. L. (2004). Capitalisation d’expériences... expérience de

capitalisations. Comment passer de la volonté à l'action? (No. 15).

http://www.groupeinitiatives.org/IMG/pdf/traverse_15.pdf

3. En espagnol :

• Martinic, S. (2010). El objeto de la sistematización y sus relaciones con la

evaluación y la investigación.

https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpb

nx0c3ByY Xhpc3Npc3RlbWF0aXphY2lvbnxneDoxZTIyMzFmYWE4MzVjYTk3,

2014

•Mosquera Echeverry, Erika Eliana; 2010. Descubriendo el poder de la

reflexión: Guía para la sistematización de experiencias. CIAT (Centro

Internacional para la Agricultura Tropical).

https://cgspace.cgiar.org/handle/10568/54652?show=full

•Eizaguirre, Marlen, Gorka Urrutia y Carlos Askunze. 2004. La sistematization,

una nueva mirada a nuestras prácticas. Guía para la sistematización de

experiencias de transformación social. ALBOAN

https://mitrabajoessocial.wordpress.com/2016/06/02/la-sistematizacion-una-

nueva-mirada-a-nuestras-practicas-guia-para-la-sistematizacion-de-

experiencias-de-transformacion-social/

•FAO. 2004. Guía Metodológica de Sistematización: Programa Especial para la

Seguridad Alimentaria PESA en Centroamérica. FAO.

http://repository.experience-capitalization.net/handle/123456789/68

3. En espagnol (continuation):

• Zutter, P. de. (1997). Historias , saberes y gentes. De la experiencia al

conocimiento. (E. Horizonte, Ed.) (Edicion Li.). Lima, Perú.

http://pzutter.net/mediapool/54/542579/data/1997_Historias_Saberes_y_gentes.pdf

• Selener, D. (1996). Aprendiendo de nuestros proyectos de desarrollo. Manual de

sistematización participativa.

https://repository.unm.edu/bitstream/handle/1928/11594/Manual%20sistematización

%20parti cipativa%20español.pdf?sequence=1

Thank you! Merci ! Gracias !