evaluation of the programme “strengthening of national...

162
Evaluation of the project “Strengthening of National Training Capabilities for better Local Governance and Urban Development” Final report June 2007

Upload: lequynh

Post on 22-May-2018

215 views

Category:

Documents


1 download

TRANSCRIPT

Evaluation of the project “Strengthening of National Training Capabilities for better Local Governance and Urban Development”

Final report June 2007

Executive summary

Forbes Davidson, Institute for Housing and Urban Development StudiesPaul G. de Nooijer, SPAN Consultants

2

Evaluation of the project “Strengthening of National Training Capabilities for better Local Governance and Urban Development”

Final report June 2007

Forbes DavidsonInstitute for Housing and Urban Development StudiesBur. Oudlaan 50 J Building3062 PA RotterdamThe NetherlandsRotterdam, The Netherlands+31 10 4021523www.ihs.nl

Paul de NooijerSPAN ConsultantsBezuidenhoutseweg 12594 AB The HagueNetherlandsThe Hague, The Netherlands+31 70 7504808www.span.nl

Contents

Contents

Contents..................................................................................................... iAcknowledgements....................................................................................vAcronyms and abbreviations.....................................................................viExecutive summary.................................................................................viii

Conclusions..........................................................................................viiiRelevance of the goals and strategy.................................................viiiEffectiveness....................................................................................... ixEffectiveness of the Tools...................................................................ixInstitutional Strengthening................................................................ixNetworking and development of new areas........................................xImpact..................................................................................................xSustainability......................................................................................xiEfficiency............................................................................................xi

Recommendations.................................................................................xiRecommendations: Goals and Strategy.............................................xiiRecommendations: Tools...................................................................xiiRecommendations: Institutional strengthening................................xiiRecommendations: Networks............................................................xiiRecommendations: Management.....................................................xii

Introduction...............................................................................................1The project.............................................................................................1Evaluation design & methodology..........................................................2

Relevance...........................................................................................3Efficiency...........................................................................................3Sustainability....................................................................................4

Structure of the report...........................................................................5Chapter 1: Relevance of the project goals and strategy...........................7

Relevance of Capacity Building as a focus area.....................................7Relevance of the approach of the project...............................................7

Relevance of focus on tools development and promotion...................8Relevance of subject areas and flexibility to adapt.............................8Relevance of the strategy of integration of capacity building into programmes and projects...................................................................9Appropriateness of the partnerships and institutional relationships..9

Assessment and recommendations........................................................9Chapter 2: Effectiveness..........................................................................11

Introduction..........................................................................................11Objective 1: To effectively respond to the constantly growing demand by local authorities and local development NGOs and CBOs for tools in a range of thematic areas covering local leadership and management, municipal finances and budgeting and combating corruption.............11Output 1.1 Manuals for elected leadership updated and published [7.1.1]...................................................................................................11Output 1.2 A guide for strategic planning and managing change of urban managers produced and disseminated [7.1.2]...........................13Output 1.3 Tool on participatory budgeting produced and disseminated [7.1.3]...................................................................................................15

i

Contents

Output 1.4: Tools on combating corruption at local level produced and disseminated [7.1.4].............................................................................17Output 1.5: A manual series on municipal financial management produced and disseminated [7.1.5]......................................................181.6 A select set of manuals translated to interactive multi-media [including Internet based] tools for wider outreach, individual applications and distance learning [7.1.6]...........................................20Output 1.7: A source book on tools design, ToTs and adaptations produced as part of the series on Guide for Designing Effective Human Settlements Training Programmes with the aim to facilitate sharing of experiences across regions and countries and harmonisation of approaches across Habitat programmes and organisational units [7.1.7]...................................................................................................201.8 Gender sensitivity and gender tools...............................................21

Assessment and recommendations...................................................22Objective 2: To support 30 training and capacity building institutions to effectively respond to the needs and demands of local authorities and local development NGOs and CBOs........................................................24

2.1 At least ten ToTs and adaptations for training in local leadership supported [7.2.1]..................................................................................24

Africa and the Middle East................................................................24Asia....................................................................................................28Latin America....................................................................................29Central and Eastern Europe..............................................................29Numbers….........................................................................................30

2.2 At least twenty ToTs and pilot workshops on the "Building bridges" , Local Economic Development and training needs assessment manuals completed [7.2.2]...................................................................31

Africa.................................................................................................31Asia....................................................................................................33Latin America....................................................................................34Central and Eastern Europe..............................................................35

2.3 Support to at least three training and capacity building institutions per region with the aim to involve them in capacity building activities [7.2.3]...................................................................................................35

Assessment and recommendations...................................................37Objective 3: To improve and strengthen linkages between demand and supply side players through partnership and networking.......................38

Output 3.1: Three regional strategy workshops implemented [7.3.1]. 38Capacity Building for Housing the Urban Poor - Asia.......................38Urban Planning and Design..............................................................39Transparency in Land Administration...............................................39Local Economic Development - Ecuador...........................................39

Output 3.2: Innovative demand responsive and successful experiences of anchoring institutions documented [7.3.2]......................................40

Training impact evaluation...............................................................40Output 3.3: Directory of relevant training and capacity building institutions, UMP and SCP anchoring institutions and senior trainers and resource persons prepared and put on the Internet [7.3.3]..........42Output 3.4: Habitat capacity building newsletter [print and electronic] launches to supplement systematic inputs into the existing newsletters and occasional circulation of key materials to relevant partners [7.3.4]..............................................................................................................42

ii

Contents

Output 3.5: A two-tier network of UN-HABITAT and partner institutions and centres of excellence in training and capacity building, including anchoring institutions of UMP and SCP established [7.3.5] 43

Other networking and collaboration.................................................44Assessment and recommendations...................................................44

Chapter 3 Efficiency................................................................................473.1 Finances general............................................................................473.2 Dutch project funding and expenditures........................................473.3 The issue of under-expenditure......................................................493.4 TCBB contribution..........................................................................503.5 Procedures and auditing................................................................503.6 Project management.......................................................................50

Assessment and Recommendations..................................................51Chapter 4: Outcomes & Impact...............................................................52

Introduction..........................................................................................524.1 Use of ToTs and UN-HABITAT training materials – some impressions...........................................................................................524.1.1 Arab states...................................................................................52

Egypt.................................................................................................524.1.2 Central and Eastern Europe........................................................534.1.3 Africa...........................................................................................54

Eastern and Southern Africa.............................................................54West Africa........................................................................................55

4.1.5 Asia and the Pacific.....................................................................55Assessment and recommendations...................................................57

Chapter 5: Sustainability issues..............................................................59Introduction..........................................................................................595.1 Demand for Tools and their Development and Use........................595.2 Ownership, manual adaptation and/or translation.........................605.3 Sustainability of partner organisations..........................................60Assessment and recommendations......................................................61

Chapter 6: Conclusions and Recommendations......................................63Conclusions..........................................................................................63

Relevance of goals and strategy........................................................63Effectiveness.....................................................................................63Effectiveness of the Tools..................................................................64Institutional Strengthening...............................................................64Networking and development of new areas......................................65Impact...............................................................................................65Sustainability.....................................................................................66Efficiency...........................................................................................66

Recommendations................................................................................67Recommendations: Goals and Strategy.............................................67Recommendations: Tools...................................................................67Recommendations: Institutional strengthening................................68Recommendations: Networks............................................................69Recommendations: Management.....................................................69Last words.........................................................................................69

1. Background information................................................................71Appendix 2: People met interviewed in the course of the evaluation... .79Appendix 3 Documentation.....................................................................81Appendix 4 Questionnaire.......................................................................84

Introduction..........................................................................................84Basics...................................................................................................84

iii

Contents

UN Habitat materials...........................................................................84Participation in Training of Trainers events.........................................86Own training and advisory provision....................................................86

Appendix 5: Timing of key events............................................................89

Rotterdam and The Hague, June 2007

iv

Acknowledgements

AcknowledgementsThe evaluators would like to thank UN-HABITAT for providing all necessary information for undertaking the evaluation, both during interviews and by making available the necessary documentation. Particularly thanks are due to Raf Tuts and the staff of UN-HABITAT’s Training and Capacity Building Branch who continuously supported our team whenever we had questions or particular requests for information and have provided constructive comments and ideas.

Furthermore, we would like to thank the desk officers of the various branches and divisions of UN-HABITAT, who have been of great help, allowing us access to relevant project and programme documentation and responding to all our questions. We also appreciated the information and views provided by representative of the Cultural Cooperation, Education and Research Department of the Netherlands Ministry of Foreign Affairs.

Many thanks also go to the different UN-HABITAT partner organisations that were consulted, either through country level missions or by phone. In particular ENDA ECOPOP, FPDL, HSMI, and UTI have been of assistance, providing help in facilitating our missions and taking care in setting up relevant appointments. In addition to the logistical support, they provided us with valuable insights from their country and from their regional experiences.

Most important was the openness demonstrated by those with whom we spoke, both at UN-HABITAT and in the countries that were visited. Conversations were marked by an atmosphere of enthusiastic perception of the project and the importance of the Dutch funding for the various initiatives it has been able to finance.

The opinions reflected in this document are those of the evaluators and do not necessarily reflect those of UN-HABITAT.

Forbes DavidsonPaul G. de Nooijer

v

Acronyms and abbreviations

Acronyms and abbreviationsAGEDECOL Agence d'Appui a la Gestion et au Développment des Collectivités Locales,

Burkina FasoAIILSG All India Institute for Local Self GovernmentALDA Association of Local Democracy AgenciesALGAK Association of Local Government Authorities of KenyaAPKASI Association of Indonesian Regency GovernmentAPLA Association of Palestinian Local AuthoritiesBB Building Bridges [UN-HABITAT manuals]CBO Community Based OrganisationCDS City Development StrategyCEFAM Centre de Formation pour l'administration municipale, CameroonCHSUD Centre for Human Settlements and Urban DevelopmentCLGF Commonwealth Local Government ForumDCG Development Consulting Group [Serbia]DPU Development Planning Unit, University College LondonEALGA East African Local Governments AssociationEC European CommissionEGM Expert Group MeetingENAM L'Ecole National Administration et de Magistrature, MadagascarEnda Environnement et Développement du Tiers Monde (Enda-tm), SenegalEOT Elected Officials TrainingFEICOM Fonds Spécial d'Equipement et d'Intervention Intercommunale [Cameroon]FOSIM Foundation Open Soiety Institution MacedoniaFPDL Partners for Local Development Foundation [Romania]GTI Government Training Institute [Kenya]GTZ Gesellschaft für Technische Zusammenarbeit [Germany]HPM Habitat Programme Manager [ ?]HSMI Human Settlement Management Institute [India]IBAM Brazilian Institute of Municipal AdministrationICRAF World Agroforestry CentreIDASA Institute for Democracy in South AfricaIHS Institute for Housing and Urban Development Studies, NetherlandsILO International Labour OfficeINAFED National Institute of Federalism and Municipal Development [Mexico]ISDTC Ismailia Sustainable Development Training Centre also referred to as simply

ITCISS Information Services Section [UN-HABITAT]ITC International Institute for Geo-information Science and Earth Observation [The

Netherlands]IULA International Union of Local AuthoritiesKILA Kerala Institute of Local AdminstrationKIM Kenya Institute of ManagementLA 21 Local Agenda 21LED Local Economic Development [series of manuals]LEL Local Elected Leadership [series of manuals] also used to refer to updated

series LGFM Local Government Financial ManagementLGI Local Government and Public Service Reform InitiativeLOGODI Local Government Development Institute [Korea]LOGOTRI Network of Local Government Training and Research Institutes in Asia PacificMAE Ministerio de Aministracao Estatal [Mozambique]M&E Monitoring and EvaluationMDGs Millennium Development GoalsNGO Non-Governmental OrganisationPAGEL Programme Régional d’Appui à la Gouvernance Participative et de

renforcement du Leadership LocalRDLS Regional and Local Development Studies, EthiopiaROAAS Regional Office for Africa and the Arab States [UN-HABITAT]RUSPS Rapid Urban Sector Profiling for SustainabilitySALGA South Africa Local Government AssociationSCP Sustainable Cities Programme [UN-HABITAT]SEDESOL Secretariat for Social Development [Mexico]SIRP Settlement and Integration of Refugees Programme, UN-HABITAT, SerbiaSNV Netherlands Organization for Development [originally: Stichting Nederlands

Vrijwilligers, Netherlands [Foundation of Netherlands Volunteers]SUDP Somali Urban Development ProgrammeTCBB Training and Capacity Building Branch [UN-HABITAT]ToR Terms of ReferenceToT Training of Trainers

vi

Acronyms and abbreviations

UCLAS University College of Lands and Architectural Studies, Muzumbu university, Tanzania

UMI Uganda Management InstituteUMP Urban Management ProgrammeUNDP United Nations Development ProgrammeUNEP United Nations Environment ProgrammeUNESCAP United Nations Economic and Social Commission for Asia and the PacificUNON United Nations Office at NairobiURDI Urban and Regional Development InstituteUTI Urban Training Institute [Egypt]VNG Vereniging Nederlandse Gemeenten [Association of Netherlands

Municipalities]WUF World Urban Forum

vii

Executive summary

Executive summary

This report reflects the outcome of the evaluation of the project “Strengthening National Training capabilities for Better Governance and Urban Development” that is implemented by UN-HABITAT with funding under the Netherlands Ministry of Foreign Affairs’ Cooperation International Institutions (SII) programme. SII, one of the Ministry’s education programmes, aims to “strengthen the higher education sector in developing countries by supporting organisations and cooperative initiatives which aim to improve the quality, relevance and accessibility of higher education; [and] to increase the opportunities open to people from developing countries to participate in higher education in their own region”.

With an approved budget of US$ 3,472,000, the project has the following immediate objectives:

“To effectively respond to the constantly growing demand by local authorities and local development NGOs and CBOs for tools in a range of thematic areas covering local leadership and management, municipal finance and budgeting and combating corruption

To support 30 training and capacity building institutions to effectively respond to the needs and demand of local authorities and local development NGOs and CBOs

To improve and strengthen linkages between demand and supply side players through partnerships and networking”1

The project is based on a long period of cooperation stretching back some 17 years, during which many training support materials were produced. The current project builds on this and seeks for much wider dissemination.

The evaluation was based on the following parameters: Effectiveness- performance linked to the outputs Efficiency – how well resources were used Impact – the difference made and the scale Sustainability – whether processes have been started which will

continue after the project

The evaluation methodology was based on review of materials, interviews in Nairobi and field visits to Senegal, Romania, Egypt and India. Additional interviews were held in Vietnam.

ConclusionsThe conclusions of the evaluation are described under the headings used to structure the evaluation.

1 Project Document, page 12 and 13.

viii

Executive summary

Relevance of the goals and strategyThe project’s aim is highly relevant. It addresses a subject area that is widely acknowledged to be critical in urban development and in urban- rural relationships. UN-HABITAT has an advantage in working in this area as it is able to draw on a wide range of collaborations and is able to link into relevant projects and to leverage these linkages to bring practise into learning. The linking of the project into ongoing operational programmes and projects has allowed it to be able to make useful inputs, to demonstrate the linking of capacity building into development and at the same time to leverage substantial resources.

EffectivenessThe evaluation team were very positive about the overall effectiveness of the project. An enormous amount has been achieved, and targets were mainly exceeded.

The evaluators were impressed by the flexibility of the response of the project and the funders to changing opportunities. There was a willingness to keep focus on the overall aims and to modify the details. The project design gave considerable flexibility, and for the most part, this was well used. The team was able to recovery from slow start and be able to have significant achievements.

Effectiveness of the ToolsThe tools, training and capacity building support materials were the major visible output of the project. Overall there was a significant achievement in both the production and dissemination.The major strong points of the project were:

Four major new and updated sets of materials were produced and disseminated.

Materials were produced with, in most cases, strong processes of testing and consultation and also with some support for adaptation and translation.

Strong efforts went into introducing and making the materials available.

Innovation has taken place with testing of distance learning. There was innovation also of the integration of the use of the

tools in to the development and implementation of projects and programmes

Materials are suitable to be used selectively, and have been widely used in this way

Materials have been updated to take on board gender and good governance issues.

The challenges faced by the project include: There is need for more support for translation, local adaptation

and use of local cases to support local training. Pricing of new materials inhibits access and use Access to some of the new materials is only available in hard copy,

whereas for training use if is more useful in soft copy

ix

Executive summary

For recently developed material there will need to be sufficient effort to introduce them, consolidate through training of trainers and adaptation and ensure adequate learning from the experience.

Adapted and translated materials cannot be properly reviewed for content and quality

Institutional StrengtheningIn terms of the second result area, of strengthening of training institutions, the project performed very well in terms of the numbers of trainers trained and countries touched. The perfomance was weaker in terms of the ability to strengthen institutions in a sustainable manner. Strong points of the project include:

In the main partner institutions a good critical mass of trainers developed new skills in participative training

A large number of trainers developed new skills and motivation Institutions networking opportunities increased The credibility of partners institutions was increased through

association with an international organisation Ability to train in new areas was enhanced though access to

materials and training of trainersThe project also faced a number of challenges:

The sustainability of the partner institutions in terms of management and finance was not supported

Many of the institutions worked with are themselves very small, and relatively weak

It was often only possible to train one person in an institution, giving a limited impact

Networking and development of new areasThe third result area deals with network strengthening, improving supply demand linkages and development of new areas such as land tools, housing (not new for UN-HABITAT but new related to training in the subject), planning and impact assessment. Strong points included:

Strong performance in East Africa, working together with training institutions and local government associations and senior decision makers.

Training of trainers workshops helped to build up wider support for the new training areas

Strategy workshops were used for the development of new areas including participatory budgeting, land, and housing, planning and training impact assessment.

At the same time the project faced challenges including The model used to develop local networks (in East Africa) was

recognised by TCBB as being too resource intensive to use elsewhere and the “first ring” institutions did not have the resources to do same thing directly in their local areas

The work on training impact evaluation is rather sophisticated for general application and there is a lack of a simple tool that is usable when capacity is limited.

x

Executive summary

ImpactThe question of impact was reviewed, but is was not possible in the context of the evaluation to carry out a full impact assessment Overall, the impact appears to have been significant in terms of the indicators of trainers trained, and in some cases very significant in terms of the numbers of trainees. The range of countries with some involvement in the project is impressive, but there is a great variety of levels of impact. We felt more could be done to address major language groups and large populations, though we feel it is correct to deal with both large and small countries.

Strong points include: A large number of countries had at least some exposure to the

project. Significant impact was achieved when adaptation and local

language versions were prepared. Materials appear to be widely used as inputs to regular courses as

well as special courses. Feedback from the limited interviews possible was very positive

and the learning appears to have been used in a practical and useful manner.

Integration in the design and implementation of projects and programmes has been appreciated by programme managers and has good potential for significant impact.

At the same time the challenges faced by the project include the following:

Capacity building lacks strong policy, institutional and financial support in many countries.

Access to materials by major language groups. Despite efforts of the project, limited translation has meant that large groups of people do not have access to the materials.

In terms of population the evaluators considered that although is it correct to deal with both large and small countries, greater impact could be achieved by giving increased weight to consideration of population size, especially linked to language groups;

Adaptation. Where there has not been local adaptation, materials were reported to have less impact, particularly at the local level;

There are barriers to access the new materials in terms of price, the bureaucratic difficulty of training institutions to purchase materials from overseas sources and in terms of the form of materials in that they are not available to download electronically – which would make them particularly useful for trainers.

SustainabilitySustainability refers to how initiatives introduced by the project can continue to be effective after the project funding ceases.

Strong points include: The project has worked with sustainable concepts of recycling and

improving existing materials;

xi

Executive summary

Strengthened and motivated trainers represent an important resource which can itself lead to further innovation and improvement.

The networks of supported institutions have been strengthened.

Major challenges include: Lack of strong policy, institutional and financial frameworks in

many countries area a problem for sustainability of the results of the project;

The sustainability of the institutions which have been supported is under pressure, both from the policy and institutional aspects mentioned above and from difficulty in adapting to increased market orientation;

networks which depend on funding as their main driving force are vulnerable to the ending of project funding;

The launching of new materials late in the project (the result of the slow start-up) means that there is not sufficient time for the proper consolidation activities such as field testing, training of trainers, local adaptation and translation to take place.

The project support to training institutions has not included support on how to manage the “business side” of the institutions.

The narrow external funding support base makes the activities of the project which need to be continued to be vulnerable.

EfficiencyStrong points:

Overall project management has been handled well by TCBB. Additional funds have been tapped through projects to get more

leverage from the project funds.Challenges

Financial management has been an issue, certainly at the early stages, when the project was confronted with considerable under-expenditure because of delays in implementation of activities and over optimistic forecasts.

Financial reporting has also been an issue – with UN-HABITAT instructed to use a reporting format that is different from its own.

Dutch funding has been vital for TCBB’s portfolio, representing the “lion’s share” of its operational budget. Some steps have been made in recent years to diversify funding; however, discontinuation of Dutch financing will constitute a major set-back.

Recommendations

Based on the conclusions summarised above, and described in greater detail in the main text, the evaluators make the following recommendations for consideration both by UN-HABITAT and by potential funders of any follow-on to the current project.

xii

Executive summary

Recommendations: Goals and StrategyOn the goals and strategy of the project the evaluators recommend the following main points:

More focus on influencing policy on capacity building More focus on impact through wider knowledge of and access to

tools This is discussed under “Tools” below. Continue move towards demand led support with integration of

capacity building concept and tools into programmes of Habitat, UN and others Monitor and evaluate process to ensure maximisation of the learning potential.

Explore additional partners including universities which are active in habitat issues relevant to local government and NGOs and to develop stronger links to existing networks

Recommendations: ToolsOn tools, mainly the training materials and guidelines developed, the evaluators would like to make the following recommendations:

Focus should be given to high quality generic materials with wide potential use

A stronger focus should be given to issues related to access to tools

Increased focus on language versions especially for large language groups and local adaptation The project has done well in encouraging local adaptation and translation, but this is an area where there are considerable potential benefits and the evaluators encourage an increase in attention to this area. This would be a suitable area for diversification of donor support.

Continue exploring e-learning, but with caution Consolidate the introduction of new and recent materials.

Recommendations: Institutional strengtheningAs discussed under the overall strategy, support at the policy level with national governments is very important. Specific recommendations on institutional strengthening include:

Stimulation and support of “business plans” for training institutions to help them respond to the increasing role of the market.

More focus on support to a smaller number of partners who show initiative, linked to more working with strong partners and the stimulation of project funding

Try to make more use of the Master Trainers developed and seek out more good local trainers to act as resource persons.

Recommendations: NetworksNetworks are important for sharing experience and for the provision of support. Broadly, the evaluators recommend making more use of existing networks, specifically:

xiii

Executive summary

Strengthen current efforts to work through existing networks such as UCLG

Continue the modest but useful support to networks such as Logotri , and try to find modalities to be able to work more with organizations like the East African Local Government Association.

Recommendations: ManagementManagement of the project has been flexible and successful. The recommendations are to:

Continue the flexible, entrepreneurial, output oriented approach which has been developed.

Try to keep staffing levels at an adequate level It is normal that there be a concern about over-staffing, but past levels of staffing were too low for the work to be done and it is important to keep a good core of staff. The staff should, however, focus on managing programmes and less be involved in direct inputs, keeping those to a level which allows them to understand what is happening, but not to be critical substantive inputs.

Seek funding for consolidation from the current donors The late launching of major products means that there is not enough time in the remainder of the current project to properly undertake the activities needed to promote and support the introduction of the materials and its adaptation. The evaluators would endorse a request for support for consolidation for a limited period.

Seek wider sources of project funding to replace current project funding The project has funded a large proportion of the external resources, It is recommended to structure future programmes in a form that facilitates wider donor funding in addition to increased funding from the general budget to reflect the greater integration of TCBB work in Habitat programmes

Overall, the project has exceeded its agreed performance targets, and has achieved significant results in an area which is critically important for development.It has shown flexibility in being able to respond to the continually changing external environment and has been entrepreneurial in seeking new ways of working.We encourage the existing donors and other potential donors to engage in dialogue with TCBB in developing and supporting continuation of the work undertaken in this project.

xiv

Introduction

Introduction

The project

This report reflects the outcome of the evaluation of the project “Strengthening National Training capabilities for Better Governance and Urban Development” that is implemented by UN-HABITAT’s Training and Capacity Building Branch [TCBB] with funding under the Netherlands Ministry of Foreign Affairs’ Cooperation International Institutions (SII) programme2. The project proposal was submitted to the Netherlands Ministry of Foreign Affairs by the UN-HABITAT Acting Deputy Executive Director on 6 December 2001. It was approved by the Ministry on 4 April 2002 [letter DCO/OO-172/02]; the project agreement was signed by both parties on 23 April 2002. Originally the project, for which the project document was prepared in December 2001, was designed to last from 30 April 2002 to March 2006. A budget neutral extension of the project’s lifetime to 30 September 2007 was approved by the Ministry [Education and Development Division, Cultural Cooperation, Education and Research Department [DCO/OO] on 14 December 2005 [letter DCO/OO -344/05] following a request submitted by UN-HABITAT on 3 November 2005.

Essentially, the project has built on the earlier work, but has tried to widen the geographic cover, introduce new subjects, improve quality and explore new modalities3. In particular, it built upon the outcomes of two earlier projects financed by the Netherlands Ministry of Foreign Affairs, i.e.: “Strengthening National Training Institutes in Africa and Asia in Local Government Management

and Finance” [starting date 01 August 1996, completion date 31 December 2001, with a budget of US$ 616,614] which aimed to “strengthen urban local authorities in East and Southern Africa and South Asia in their abilities to provide, maintain and improve basic infrastructure and essential services to the majority of their inhabitants, notably low-income groups and inhabitants of slum and squatter settlements” and

“Institution Building of African Municipal Training Institutions” [starting date 1 January 1994, completion date 31 December 2001, with a budget of US$ 361,517] that aimed to “strengthen African municipal training institutes in their ability to provide their client municipalities and

2 The SII Programme, one of the Ministry’s education programmes, aims to “strengthen the higher education sector in developing countries by supporting organisations and cooperative initiatives which aim to improve the quality, relevance and accessibility of higher education; [and] to increase the opportunities open to people from developing countries to participate in higher education in their own region” and is governed by Article 11 of the Netherlands’ foreign affairs/development cooperation international education policy, which focuses on sustainable capacity building and knowledge development to help reduce poverty in developing countries. 3 The brief description from the Project Document.of 2002 states in this respect: “Building on the successful collaboration of UN-HABITAT and the Netherlands Government in training and capacity building work, this project aims to consolidate and strengthen over 30 national training and capacity building (TCB) institutions through joint production of at least nine new tools/manuals, Training of Trainers (ToT), direct institutional support and networking. The project will maintain the momentum built up through the Local Leadership and Management Training Programme, and in this context, the immediate focus will be the initiation of a new stream of ToTs and training activities using the "Building Bridges between citizens and local governments" and "NGO/CBO Capacity Building" series of manuals, developed through the Dutch support. Support to TCB institutions will be deepened. Multi-media tools, distance learning, monitoring of impact of ToTs and training activities will be emphasized. The establishment of a new Training and Capacity Building Branch at UN-HABITAT and the link to the global campaigns as vehicle for capacity building work are new positive developments which are factored into the project design” [page 1].

1

Introduction

municipal associations with continuous demand driven and operations oriented training and advisory services”.

With an approved budget of US$ 3,472,000, the project’s overall objective reads as ““To enhance the contribution and role of local authorities and their partners in the private, non-governmental and community sectors in the fight against poverty and in the realization of improved local governance and sustainable human settlements by:

Building and strengthening their planning and management capacities through human resource and institutional development

Promoting good practices and effective management tools for better urban governance, sustainable local development and poverty reduction”4

Its immediate objectives are the following:

“To effectively respond to the constantly growing demand by local authorities and local development NGOs and CBOs for tools in a range of thematic areas covering local leadership and management, municipal finance and budgeting and combating corruption

To support 30 training and capacity building institutions to effectively respond to the needs and demand of local authorities and local development NGOs and CBOs

To improve and strengthen linkages between demand and supply side players through partnerships and networking”5.

As per the project document, the following outputs were formulated:Related to immediate objective 1

1.1 Manuals for elected leadership updated and published1.2 A guide for strategic planning and managing change for urban managers produced and

disseminated (this has later been modified to focus on Local Economic Development)1.3 Tool on participatory budgeting produced and disseminated 1.4 Tools on combating corruption at local level produced and disseminated1.5 A manual series on municipal financial management produced and disseminated1.6 A select set of manuals translated to interactive multi-media (including Internet based) tools for

wider outreach, individual applications and distance learning1.7 A source book on tools design, TOTs and adaptations produced as part of the series on Guide for

Designing Effective Human settlements Training Programmes with the aim to facilitate sharing of experiences across regions and countries and harmonisation of approaches across UN-HABITAT programmes and organizational units.

Related to immediate objective 26:

2.1 At least ten TOTs and adaptations for training in local leadership supported2.2 At least twenty TOTs and pilot workshops on the "Building Bridges", “Local Economic

development” and “ training needs assessment” manuals completed2.3 Support to at least three training and capacity building institutions per region arranged.

Related to immediate objective 3:

3.1 4 regional strategy workshops (later changed to “Three Regional strategy workshops implemented”)

3.2 Documented lessons of experiences of innovative demand responsive and anchoring institutions (later phrased as “Innovative demand responsive and successful experiences of anchoring institutions documented”; the output furthermore “includes the efforts on promoting the practice of training impact evaluation amongst training institutions7”)

3.3 Directory of training institutions and resource personas (later “Directory of relevant training and capacity building institutions and senior trainers and resource persons prepared and put on the internet”)

3.4 8 bi-annual news letter (later referred to as “UN-HABITAT capacity building newsletter (print and electronic) launched to supplement systematic inputs into the existing newsletters and occasional circulation of key materials to relevant partners”)

4 Project Document, 2002, page 115 Project Document, page 12 and 13.6 According to the fifth progress report “Output 2.2 has also been reviewed to include reporting on LED,and MDGs, besides the Building Bridges series whose demand has not been as high as earlier envisaged. The target number of ToTs still remains at 20 (twenty)”.7 5th Progress report page 11

2

Introduction

3.5 A two-tier network of demand and supply side institutions established (later “A two-tier network of UN-HABITAT and partner institutions and centres of excellence in training and capacity building established”.)

Evaluation design & methodology

The evaluation was undertaken by Forbes Davidson from the Institute for Housing and Urban Development Studies [IHS], Rotterdam, the Netherlands and Paul G. de Nooijer from SPAN Consultants, The Hague, the Netherlands on the basis of Terms of Reference provided by UN-HABITAT [see Appendix 1]. According to these Terms of Reference [ToR] “the evaluation ultimately seeks to gauge the overall result of the efforts invested in the three main focus areas of the Project, namely (1) development of capacity building tools, (2) training of trainers, adaptations and institutional support to training and capacity building institutions, as well as (3) fostering demand-supply linkages”. Key objectives of the evaluation, which was conducted in the period February – June 2007, were formulated as follows:

1. To assess the degree to which progress has been made towards achieving the Project objectives

2. To examine the relevance, effectiveness, efficiency and impact of the Project’s method and strategy, its institutional anchoring process and support networks, and identify challenges as well as opportunities

3. To propose priorities for further deepening the impact of the Project and for widening the range of capacity building approaches and packages developed by the Project.

Moreover, as stipulated, the “evaluation’s findings and recommendations are expected to be used in future planning and decision-making processes by UN-HABITAT, the Government of the Netherlands and other stakeholders”. As per the Terms of Reference, while the “main emphasis [was to] be placed on project results and impact” the evaluation was address the issues of relevance, effectiveness, efficiency, results and impact, institutional arrangements, sustainability, responsiveness to opportunity and finances.

In line with the ToR, the evaluation deals with a series of issues related to project implementation as mentioned above. Some explanation on how these key terms have been interpreted in the framework of this evaluation is provided below.

3

Introduction

Relevance8

Relevance in the context of this evaluation primarily focused on the relevance of training and capacity building on local governance issues for the different groups of beneficiaries, i.e. the training and capacity building institutions and, ultimately, the people that participate in and benefit from the training and other services provided by these institutions. The evaluation aims to assess whether the project has contributed to addressing their respective needs and priorities. Attention is paid to questions raised in the ToR concerning the validity of the “project’s adopted strategies”, its responsiveness to “opportunities and demands that arise from countries, regional or international sector bodies”, and the project’s “comparative advantage”. Finally, the chapter addresses the question formulated in the ToR: “How appropriate are the partnerships and other institutional relationships in which the Project is engaged in?”

Effectiveness

Effectiveness concerns the “extent to which the development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance”9. Within the framework of this evaluation, effectiveness thus primarily deals with the question of realisation of the three project objectives that are mentioned in the original project document of June 2002. Based on the project’s aims, the evaluation has analysed what specific project activities have been carried, the results obtained in terms of teaching and learning materials, trainers trained, other institutional development support provided, etc. and the quality thereof.

Efficiency

Efficiency generally concerns the question whether the results could have been accomplished with less resources or whether more results could have been realised with the same resources. The main focus has been on the efficiency of the approach taken by the project, project management and the utilisation of SII Programme funds. The evaluation in this respect address the questions raised in the ToR with respect to “cost-efficient and timely” implementation of project activities and the effectiveness and efficiency of the project’s financial management.

Sustainability

The issue of sustainability concerns the question: what are the indications that the benefits of the project will continue after the project has come to an end? The evaluation also looked at issues of ownership, establishment of a critical mass of trainers in the UN-HABITAT partner institutions.

Impact8 OECD has defined relevance as “[the] extent to which the objectives of a development intervention are consistent with beneficiaries’ requirements, country needs, global priorities and partners’ and donors’ policies”[ OECD, Glossary of Key Terms in Evaluation and Results Based Management, Paris, 2002, page 32].9 OECD, Glossary of Key Terms in Evaluation and Results Based Management, Paris, 2002, page 20.

4

Introduction

OECD’s Glossary of Key Terms in Evaluation and Results Based Management refers to impact as “positive and negative, primary and secondary long-term effects produced by a development intervention, directly or indirectly, intended or unintended”10. In line with this, the ToR, emphasising the issue of impact, include questions such as “What real difference has the project made to the beneficiaries? What is the extent to which the Project has contributed to positive changes? How did it influence the work of the implementing organization?”

Unfortunately, addressing the issue of impact of capacity building and training on the [performance of] final target groups of the project, i.e. elected officials, mayors, etc. and the consequences thereof for their constituencies turned out not to be possible. First of all, systematic and reliable data at this level is collected, neither by UN-HABITAT’s partners nor by UN-HABITAT itself. Secondly, the country visits undertaken in the course of the evaluation were too short to get any representative picture. Henceforth, any views reflected on the topic are more illustrative rather than back up by substantive evidence. For these reasons, the evaluation has looked more at outcomes and into issues such as: the extent to which training and capacity building organisations that have been supported by the project continue to provide training, how the UN-HABITAT manuals are being used in their training programmes, etc. and the factors that have influenced this.

For collecting data on the different evaluation topics, the following approaches were used:

A first basis for the evaluation was a desk study of project related documentation, including project document, financial reports, as well as project progress reports, project related correspondence, general UN-HABITAT documents, reports prepared by UN-HABITAT partner organisations as well as the Internet. In addition to these project related documents, a desk study was made of publications realised by the project, including training manuals, newsletters, etc. An overview of documents consulted is provided in Appendix 3.

Face to face interviews were held with staff from different units, sections and departments of UN-HABITAT, and staff of the Netherlands Ministry of Foreign Affairs [DCO/OO]. Interviews with UN-HABITAT were supplemented with requests for additional information in writing; response was readily provided. In addition, interviews were held with representatives of a selected number of organisations that have participated in and/or benefited from the various project components. Meetings were also held with representatives of organisations that directly worked with these organisations. An overview of people met, is provided in Appendix 2.

Focus group sessions, with discussions focusing on a limited number of relevant themes. Such sessions were held with representatives from Kenyan institutes in Nairobi, with counsellors in Senegal, and Kerala, India and with councillors and other participants in Egypt.

Telephone interviews were conducted with representatives of a series of organisations that could not be visited in the course of the assignment. The interviews aimed to provide a wider geographic cover than would have been possible with the limited number of visits and direct interviews. In selection, the list of key contacts provided by TCBB was used, supplemented by additional interviews where found appropriate. The people interviewed by phone are included in Appendix 2. Calls were also made with UN-HABITAT, particularly with respect to financial issues.

Questionnaires were developed in both English and French and sent to representatives from a range of organisations in the Pacific, India, Egypt and Africa as well as organisations working in Central and Eastern Europe. A copy of the questionnaire is included as Appendix 4. Though the questionnaire was sent out twice, with a reminder, the response obtained was,

10 OECD, Glossary of Key Terms in Evaluation and Results Based Management, Paris, 2002, page 24.

5

Introduction

unfortunately, small and not representative and did not permit to draw substantive conclusions. Nevertheless, the feedback that was received has provided some additional insight into the appreciation of the main outputs of the project [in terms of ToTs and teaching and learning materials], particularly in the institutions that could not be visited.

As part of the evaluation, field visits were to be conducted to four countries “to conduct interviews with relevant partner organisations, beneficiaries and other stakeholders” [ToR, page 3]. According to the ToR, the decision of which countries to visit was to be based on amongst others the following criteria: “regional balance, variety of activities, intensity of operations, partnership with national/regional training institutions, etc.” [Page 3].

A proposal for the selection of these countries and the selection criteria suggested was prepared at the end of the first mission to Nairobi and discussed with TCCB staff. The final selection of the four countries was based the following criteria: [a] the scope of activities with the organisations and involvement in various project initiatives; [b] geographical spreading; [c] initiatives taken by/from within the country as a result of the cooperation with TCBB; [d] length of cooperation/partnership between the organisations and TCBB and [e] the resources available for international travel. Based on these selection criteria, it was agreed that the following countries and organisations be visited in the course of the evaluation:

Countries Prime contacts Mission periodsEgypt Urban Training Institute; Ismailia Sustainable

Development Training Centre21-25 April 2007

India Human Settlements Management Institute 30 April – 4 May 2007Romania Partners for Local Development Foundation 30 March – 2 April 2007Senegal Environnement et Développement du Tiers

Monde 14-18 May 2007

An inception report, outlining the main evaluation questions and the proposed evaluation methodology was submitted to TCBB on 24 April 2007. It was approved on 26 April 2007. A first draft evaluation report was presented on 28 May 2007. The report was discussed in a plenary meeting with staff from various UN-HABITAT departments on 29 May 2007. More detailed talks were held with TCBB staff in the week of 28 May 2007; suggestions and recommendations have been incorporated into this final draft.

Structure of the report

The structure of the report is as follows:

Chapter 1 concerns the relevance of the project The question raised in the ToR with respect to responsiveness to opportunity [point G of the specific evaluation questions] is addressed here as this refers to the ability of the project to remain effective in a changing environment.

Chapter 2 concerns the issue of effectiveness. Project results will be assessed in relation to the realisation of project objectives and will hence appear in this chapter. The presentation in this chapter closely follows the different objectives and outputs formulated in the project document.

Chapter 3 concerns efficiency issues. Issues related finances [point H of the specific evaluation questions] will be addressed in this chapter since effective and efficient management of financial resources is indeed conceived as a precondition for ensuring cost effective project implementation. Institutional arrangements [point E of the specific evaluation questions] will be addressed under this heading as well.

Chapter 4 focuses on issues related to impact. In this chapter, an attempt is made to assess what partner training and capacity building institutions have done as a follow-up to the collaboration with TCBB either with their own resources or with other sources of funding.

6

Introduction

Chapter 5 is about sustainability and aims to address topics such as demand for training tools developed under the project, ownership and [co-] funding.

Chapter 6 presents the conclusions and recommendations of the evaluation

The appendices include:

the evaluation Terms of Reference [Appendix 1] an overview of people interviewed [Appendix 2] documents that have been consulted [Appendix 3] questionnaire [English][Appendix 4] chronology of main project events [Appendix 5]

7

Chapter 1: Relevance of the project goals and strategy

Chapter 1: Relevance of the project goals and strategyThis chapter aims to give a broad review of the relevance of the project in terms of its role in the development agenda. In this, there are important questions:

Is capacity building for development in the urban sector a relevant subject area?

Is the approach adopted relevant in terms of o Were the tools relevant and are the focus areas selected relevant

related to the overall aim?o Was the approach of integrating capacity building into development

project and programmes relevant? o Was the approach of working through strengthening a network of

training institutions relevant?

Has the project managed to maintain its relevance in the context of changing perceptions of what it important? Are its assumptions still valid?

Relevance of Capacity Building as a focus area

Capacity building as an approach emphasises that while training is important, capacity needs more than only training. It is concerned with the ability and willingness of institutions to use new capacities and of ensuring that the institutional and policy environment supports this.

Capacity-building has received considerable attention over the last 10 years. UN-HABITAT promoted a review of experience and was involved in major activities in the lead up to Habitat 2 in Istanbul11. That review found that there was a problem that capacity, particularly of local governments and of NGO and CBO partners was very low, that the mechanisms to link supply and potential demand were weak and that new support platforms and networks were necessary. Thus there was the need to develop programmes that could strengthen both capacity building institutions and these linkages.

The World Bank carried out research to underline the concept that Capacity Building is an investment, and went on to give significant loans for capacity building12. The Asian Development Bank has also provided significant funding, e.g. to Indonesia, and is currently working on major initiatives to link long-term infrastructure development with long term capacity building activities. In this context there is a need for a linking of experience into and out of these initiatives – a role the fits the mandate of UN-HABITAT well. Typically, these activities are well funded and give the potential of mobilising significant resources for capacity building.

11 Ref Capacity Building for Better Cities12 E.g. the government of Ethiopia has established a Ministry of Capacity building and is engaging in a major effort with the support of the World Bank and major donors. An important part of this is capacity to support urban development.

8

Chapter 1: Relevance of the project goals and strategy

Relevance of the approach of the projectThe approach has the following parts:

1. Focus on the use of tools based mainly on previously existing materials and training of trainers to support the strengthening of the institutions

2. The subject matter selected3. The strategy of support to intermediary training organisations which in

turn can support local training organisations4. the strategy of developing network support5. The strategy of integration of capacity building into programmes and

projects

Relevance of focus on tools development and promotionThe project started with a set of existing tools and a network of institutions that had been involved in developing and using them. This moulded the project design as it built on the existing base. The earlier outputs of the project have generally been considered to be successful and it was reasonable to focus on upgrading existing materials and introduction of new areas related to perceived needs.

The project has an important role to play as it addresses an area which is not well covered by the market system. Most of the client institutions could not afford to pay the market price for training materials and consequently there are very few materials available. Habitat has an advantage in working in this area as it is able to draw on a wide range of collaborations and is able to link into relevant projects and to leverage these linkages to bring practise into learning.

Relevance of subject areas and flexibility to adaptBoth the project and the clients it serves are working in a context of broad changes. Key changes influencing what is happening include changes in the external environment:

Urbanization at an unprecedented level Globalisation – of economy of concepts and of job opportunities Global embracing of the market but coupled with but slow adaptation of new

approaches to deal with the consequences including government employment conditions

Electronic communications, particularly role of Internet and cellular phones.

The project has responded flexibly to these changes and has worked on the introduction of new products in consultation with a wide range of stakeholders. Areas of increasing concern to UN_HABITAT and donors such as participation and gender issues have been incorporated.

There are constant changes or even cycles in what are seen as appropriate development responses. For the project to be relevant, its products have to address issues which are currently seen as relevant. There is a difference in what is seen as relevant by development agencies, who like to lead changes, and local organisations e.g. local government, who tend to be conservative and have limited capacity for change.

Linking to Millennium Development Goals Decentralisation linked to good governance and issues of transparency and corruption

9

Chapter 1: Relevance of the project goals and strategy

Participatory planning linked to local economic development Sustainable development in social and economic as well as environmental dimensions –

creating the need for more integrated planning The importance of municipal financial management Multi stakeholder working and the role of Partnerships Secure tenure and effective land management Role of ICT and e-governance

UN-HABITAT links its programmes into a framework that is based on the dynamics between the main partners in urban development (see figure below)13

A particularly important relationship here is between the market and government. This is affecting the way training institutions function and also the issue of payment for training and other services. The often very poor salaries in government conflict with a desire for more professional and more committed efforts. Many trainers working for government have to have second jobs or to get involved in projects in order to be able to survive, and this weakens the attention they can give to training activities.

Finally, relevance is dependent on ability to continuously modify the strategy in line with the changing environment. The overall flexibility of the project has facilitated this, but impact is affected strongly by the degree of importance given to the subject by different governments. Where there was a strong alignment of interests as was the case in Kerala in India, considerable impact was possible (see under Impact), but elsewhere proposed capacity building components have been cut, emphasising the need to work at the policy level, an area in which the project is not strong.

Relevance of the strategy of integration of capacity building into programmes and projectsThe approach of integrating capacity building into programmes and projects was a key element in recommendations at Habitat II. The project has increasingly adopted this approach, starting with work in Somalia with EC. It provides a link between supply and demand. Project managers report that it facilitates and speeds up projects and helps build capacity. It also helps to test materials in real-world situations and provides feedback to the project as well as bringing mobilising project resources.

Appropriateness of the partnerships and institutional relationshipsTCBB have two forms of partnerships, ones to develop materials and provide training in their use, and ones which on a regional basis organise training of trainers workshops and the adaptation of materials. On materials development, the long running link with FDPL in Romania and Fred Fisher as an author has been very productive, but it is good that there has recently been a widening of partners, for example including Ecoplan on local economic development. This should be further widened to bring in the energy and resources of more strong institutions.

The strategy of strengthening capacity building institutions is to work through a first “ring” of key institutions, for example HSMI in India and which can then act as partners to provide training of trainers programmes for a “second ring” of

13 From presentation by TCCB May 2006

10

Chapter 1: Relevance of the project goals and strategy

training and capacity building institutions, for example KILA in India. This approach is necessary to manage wider outreach, but is vulnerable to the strength and financial capacity of the intermediary organisations. This first ring cannot be supported only by TCBB.

Assessment and recommendationsThe overall strategy is sound, but requires modification to cater for areas of weakness. The main subject area of the project, capacity building for urban development, is one that is widely seen as critical in order to improve performance in development, however this view is not always held strongly by national and local governments and more effort is recommended to promote policy reform in this area.

The approach of making use of existing materials and developing and testing them is sound and has been developed over a considerable period.

The project is seen as very relevant in addressing important aspects in the development agenda. It is also seen as flexible in its response to the changing environment and changing focus on development approaches. It has been able to respond to opportunities to become involved structurally in programmes and projects and with good initial success.

A major challenge, however, is the up-scaling of access to tools and to support mechanisms – issues we will return to in the conclusions and recommendations.This is discussed in more detail under “effectiveness” and “impact”

The strategy of working through intermediary organizations is necessary, but is vulnerable to the strength of those organizations and the competing needs they have of earning income (see further under Chapter 2, objective 2.

The strong points are seen as: Focus on urban development capacity building widely seen as very

important. Building on the strength of past experience and development of tools,

building on work already done and working in partnership for development.

Developing positive means of working with projects and programmes inside and outside of UN-HABITAT to integrate capacity building thus increasing effectiveness and leveraging more resources.

However challenges are seen as: Working in an environment where capacity building is not always

appreciated as an important investment Having ambitious targets but working through institutions which

themselves often need support Working with heavy dependence on one major donor

On the basis of these conclusions the recommendations are that: More focus on influencing policy on capacity building. The difficulties in

many countries relate to how seriously government values capacity building which supports its development objectives. UN-HABITAT is an appropriate body to promote this, both at national level and through local government associations, at local government level.

More focus on impact through wider knowledge of and access to tools . Habitat in its capacity building activities, and especially with regard to its

11

Chapter 1: Relevance of the project goals and strategy

tools, should aim to complement the market and not join it. High prices can have a serious impact on accessibility to key target groups, especially in developing countries. This is discussed further under “Tools” below

Continue move towards demand led support with integration of capacity building concept and tools into programmes of Habitat, UN and others. The recent experience of integrating materials and related training into the development and implementation of projects is very encouraging. It reinforces the message of integration of capacity building strategies into development programmes and gives a strong potential for learning and innovation. It will be important to monitor and evaluate this process to ensure maximisation of the learning potential.

Explore additional partners including universities which are active in habitat issues relevant to local government and NGOs and stronger links to existing networks. The project should continue its approach of reviewing existing partnerships and trying to identify stronger partners at the “first ring” level who can play a stronger role in adaptation and promotion. This may need to be underpinned by, for example, seeking donor support for building stronger support at the regional level. Universities often have stronger institutional sustainability and more political strength than training centres. They can be brought in as additional partners to strengthen research underpinning of cases and this in turn can impact on the practise relevance of university staff and curricula, thus strengthening impact through education as well as training.

A broader base of funding is explored.

12

Chapter 2: Effectiveness

Chapter 2: Effectiveness

Introduction

This chapter concerns the issue of effectiveness and addresses the issues of activities carried out, results accomplished and whether, on the basis of these results, project objectives have been realised. The chapter is structured around the project’s three objectives and the outputs that were envisaged under each of them, with a brief assessment per objective. The chapter pays attention to the production of tools and the quality thereof, adaptation of these materials, their accessibility, the attention for themes such as gender, youth and HIV/AIDS, initiatives taken in the field of training of trainers and other capacity building initiatives, as well as efforts in the field of training impact evaluation and communication and networking.

Objective 1: To effectively respond to the constantly growing demand by local authorities and local development NGOs and CBOs for tools in a range of thematic areas covering local leadership and management, municipal finances and budgeting and combating corruption

Outpu

t 1.1 Manuals for elected leadership updated and published [7.1.1]A decision was made to revise and update the series of manuals on Local Elected Leadership [LEL] as it was felt that the existing manuals [dating back to 1994] did not pay sufficient attention to the issues of “governance” and gender. Basis for the revision were the outcomes of an Expert Group Meeting [EGM] that was convened from 8-11 October 2003 in Kenya and on the basis of the results of a questionnaire that was sent to persons who had been instrumental in adaptation and dissemination of the original series. In addition to responding the questionnaire, they were asked to organize a meeting in their institution, to solicit inputs and provide UN-HABITAT with consolidated feedback before participating in the EGM. It is understood that councillors were not involved themselves; actually there has been more involvement from the supply side than from the demand side in the development process. On the basis of the EGM, recommendations were formulated to "guide the design and content of the second edition of the series" [2003, page 10]. On the basis of these recommendations, Terms of Reference were prepared and preparatory work done to contract a consultancy firm to revise and update the series. A US$ 98,000-contract for updating of the series [CON/UNCHS/03/0057 (ICA 128)] was signed with the firm “IDIOM” of Mr Fred Fisher, author of the original series, in

According to the project document [page 13], the following was foreseen: “Capture lessons of experience and new developments from field applications and use of the 13 manuals gained since the first field rest in 1992; organise workshop for senior trainers to review and synthesize lessons and new developments; finalise updating; produce in print and electronic and disseminate”

13

Chapter 2: Effectiveness

May 2003. Total costs of the adaptation of the manual, including printing have been US$ 202,390 of which US$ 49,000 was co-funded by the Society Institute Zug Foundation.

Development of the second edition started in 2004. By the end of March 2004, seven competencies [Decision making, Facilitation, Communicating, Enabling, Using Power and Representation Role] were completed and ready for review. A Quick Guide was prepared and presented at UN-HABITAT's Governing Council of April 2005. The entire process of development, review, finalisation, graphic and design work and printing of the new edition [including a redesigned cover and box] was completed in 2005. Electronic versions of the series are available on the TCBB publications CD Rom; only contents pages are available on Internet, though this is not clear from the web-site. This is seemingly a consequence of the overall UN policy, which UN-HABITAT’s Information Services Section follows, to no longer provide such materials free of charge [even when these are developed with external funding as is the case]. Costs are US$ 40 for developed countries and it was reported in our interviews that the price was $20 for developing countries, but this is not clear from the website. Participants in LEL-related training sessions have received the set for free.

Despite these costs, the LEL series features as number 1 on the materials requested from UN-HABITAT, though these numbers are not large, with 206 hard copies ordered in 2006-7. A marketing strategy of LEL in Eastern Europe was developed in Slovakia and by FPDL. This was not done systematically in other places, with the exception of Somalia where a one-page flyer for each of the LEL roles was prepared (with easy to understand graphic symbols for each role) and disseminated. Further a one day sensitization and marketing workshop was conducted for candidate ToT participants, plus mayors and councillors, prior to the real training workshops themselves.

The new series was launched at regional events that were held in Romania [May 2005], India [January 2006], Fiji [March-April 2006] as well as South Africa [May 2006]. Some 200 trainees are reported to have been involved in these events. National events on the basis of the materials were organised as well e.g. in South Africa, Lesotho, Namibia, Myanmar and India.

Response to the new materials has been mixed. For example, FPDL, which has been involved in reviewing the draft considered the manual practical, simple and useful for “beginners”. In Egypt some respondents observed that LEL series did not get a favourable response anymore since the materials were considered too basic while there is a need for more concrete and specific issues to be addressed in addition to the generic ones tackled under LEL. Others in Egypt however suggested that the materials were well accepted, though they require development of local examples. According to the interviews held in Egypt. To date, the adapted translations of the original materials are still being used, though translation of some of the new materials is under way.

Key Competencies for improving local Governance (LEL series) Four Volumes 2005Criteria Strong points Weak pointsThe series consists of four volumes: Quick Guide, User Guide, Concepts and Strategies and Training and Governance Tools introducing the users to a broad range of competencies. The new set-up replaces the original 13 volumes of the LEL series. The new edition includes "gender responsive concepts and tools”, has a new competency area dealing with representation and has governance mainstreamed. It also has over 100 training exercises and tools. While the original edition was translated into 26 languages and adapted to different national settings14, this time there is no budget for official translation of the materials15, though significant work has taken place in India with translations to Hindi and Malayalam. The idea is to continue to

14

Chapter 2: Effectiveness

Key Competencies for improving local Governance (LEL series) Four Volumes 2005Criteria Strong points Weak pointsuse the existing materials that may have been translated and to incrementally add new elements from the adjusted manuals. If the materials are adapted, TCBB has little opportunity for quality control – if only for language reasons. Quality – content and form

The content is well written and updates the previous series by including the role of representative, including gender based issues and mainstreaming good governance. The new format includes a user guide to facilitate use by trainers.

Some interviewees found the previous version more accessible.

Relevance The materials are very relevant in supporting the strengthening of local elected leaders. A lot of the materials are also usable by officials as they cover important management competencies. Part of the new materials will also be a pilot case for distance learning [see further below].

It is not clear whether there is a strong added value in the new materials, and insufficient resources have been used to promote them as opposed to the cost of developing them.

Access and usability

The first version of the manual was adapted to quite a wide range of national/regional contexts and translated into many languages. This is unlikely to happen also with the new materials as a whole, though bits and pieces may be adapted and translated as may be needed.

The materials are relatively expensive for developing countries.As a result of UN-HABITAT’s publication policy, the new materials can only partly be downloaded (only the introduction and contents of each volume), though this is not made clear on the web-site.

Impact There was a good level of discussion during the development of the on the contents of the new materials, which gives a good base for wider use. . In Kerala, the new materials are being used,

Availability in local languages will affect the use of the new materials. In Egypt the old materials in Arabic are still being used, though there are now efforts to translate the new materials. In Vietnam, the old materials were translated and used. A new translation has been carried out with UNDP support, but has not yet been used. [ToT Romania 2005; S Asia Delhi Jan 2006; S Pacific Suva 2006].

Output 1.2 A guide for strategic planning and managing change of urban managers produced and disseminated [7.1.2]

Using existing materials and work in South American countries, UN Habitat together with EcoPlan International initiated the development of the Strategic Planning for Local Economic Development [LED]. Discussions on this issue started in February 2002; actual development started in the fall of the same year.

Potential partners such as the World Bank and ILO were contacted and a first draft of the series was completed in 2002-2003 and reviewed by some 20 persons from different organisations [including CIDA, World Bank, etc.] through Internet "as a virtual round table". The draft LED series was also presented at an ILO/ UN-HABITAT joint regional training workshop on "Improved environmental services through decent jobs" that was held in March 2004 in Lima, Peru.

14 Albanian, Amharic, Arabic, Azerbaijan, Belgian [F], Cameroonian [F], Canadian [F], Czech, Georgian, Hindi, Hungarian, Latvian, Lithuanian, Macedonian, Malayalam, Polish, Romanian, Russian, Senegalese [F], Serb, Slovakian, Spanish, Swahili, Telugu and Vietnamese. 15 Moreover, according to UN-HABITAT’s publication policy, “translation into non-UN languages should be approved by the Publication Board based on a cost-benefit analysis” [page 4].

According to the project document, the following was envisaged: “review existing work and tools; identify areas for more research and elaboration; prepare the guide; organise review workshop; finalise and produce in print and electronic and disseminate” [page 13]

15

Chapter 2: Effectiveness

In the reporting year 2004-2005, the draft LED series was field tested in Romania, the Philippines and Zambia, in the latter two cases with CIDA funding. In Romania this was done by FPDL together with the Urban Planning Faculty of the University of Bucharest. Testing took 6 months whereby participants went through the entire LED process. In the Philippines the materials were used in training and to see whether this training would result in any strategic plans. In Zambia it was used for training only. Field testing was also done in Mexico in Vera Cruz, using a Spanish translation of the draft manual.

The publication was realised together with Ecoplan International. Costs were shared, including field testing funded by CIDA, with the project funding including management and printing amounting to US$ 72,000 and disseminated at the UN-HABITAT Governing Council meeting of April 2005, an international book fair [Berlin], an international conference on "reinventing government" and a regional ToT workshop on Local Government and NGO/CBO collaboration on Participatory Planning, that was held from 20 to 23 May 2005 in Suwon City, Korea16. In addition, the new series was presented at two inter agency meetings held in Washington [Cities Alliance; May 2005] and Turin [ILO; July 2005] and at a Lake Victoria Regional Capacity Building Strategy workshop.

In conjunction with the 3rd World Urban Forum [WUF], a meeting entitled “Synergies, Opportunities, Collaboration: Enhancing Effectiveness in Local Economic Development” was held as a pre-event to the Forum on 16 and 17 June 2006 in Vancouver. The event, organised by UN-HABITAT together with EcoPlan International, Simon Frazer University Centre for Sustainable Development and Western Economic Diversification aimed “to promote a wider understanding of how a variety of groups, including donors, local government, private sector and civil society organisations are addressing LED” and to “promote networking, partnerships and collaboration around common LED opportunities and challenges”17

Together with the International Training Centre of ILO in Turin and UNDP/PPP-UE “a training workshop on Pro-Poor Public and Private Partnerships” was organised in June 2006. In this training, the LED training series was a component. The workshop brought together “Government representatives, PPP practitioners, local government capacity building experts, programme managers and private sector representatives”18. Furthermore, a workshop on Promoting Local Economic Development through Strategic Planning in the Arab States Region was organised in Cairo from 19 to 23 November 2006 together with EcoPlan International, ILO and UTI, with “financial support provided by UN Habitat”19. The meeting was attended by 27 participants from Egypt, Iraq, Yemen, Sudan, Palestine, and Jordan, including a series of Egyptian universities,

16 The event was attended by participants from 13 countries from Asia and the Pacific [Indonesia, Korea, Afghanistan, Bangladesh, China, Fiji, Mongolia, Maldives, Nepal, Papua New Guinea, Philippines, Sri Lanka, and Thailand] and aimed “to devise ways of localising the Millennium Development Goals”, thereby integrating local governments in national efforts to realise MDG targets. “Localising the MDGs is about giving local authorities the tools and knowledge needed to help them rise up to the challenges set forth in the Millennium declaration, to make them responsive to the local needs and realities and help them build strong partnerships with civil society actors in working locally towards a global solution” [Bringing the Millennium Development Goals Home, ToT Workshop on Local Government and NGO/CBO collaboration on participatory planning, May 20-23, 2005]17 Final conference report, page 3.18 Progress report 2006-2007, page 38.19 Report on Workshop Promoting Local Economic Development Through Strategic Planning in the Arab States Region, page 1.

16

Chapter 2: Effectiveness

and aimed to: “ [1] To enhance the political understanding and appreciation for LED strategies and to promote political support for LED activities; including improving the knowledge and capacity of the participants in strategic planning, local economic development, action implementation and monitoring and evaluation; [2] Exchange experiences of participants within the region and discuss case studies; [3]. Identify actions, both nationally and regionally, … to enhance LED in Arab States; [4] To give feed back to the UTI team for the translations of the manual series into Arabic”20. Amongst others, the workshop identified areas where capacity building is needed,…”21. Moreover, according to the Workshop report, “[there] is a clear need for greater understanding and capacity building of LED in the Arab States setting as countries either suffer from too much central control or lack of capacity at the local level”22. On the final day, “action plans were developed by the country teams”; the Egyptian participants paid particular attention to the potential role of universities and research centres in terms of e.g. through training and capacity building of NGOs, local administrative authorities, community representatives and others and to “.. involving faculty and students] in designing and assisting with LED projects’23.

It is understood that the “LED series is now translated in Arabic, Vietnamese and partially Portuguese. The latter two translations were done fully through partners own effort and resources”24 and that the series has been used in e.g. Vietnam, Romania and Serbia [see further chapter .. below], with the necessary adaptations and additions. Finally, according to the progress report on 2006-2007, “[the] theme of LED is now fully incorporated in the Rapid Urban Sector Profiling tool which UN-HABITAT is increasingly using”25

Strategic Planning for Local Economic Development (LED); Published UN Habitat 2006 ; 4 Volumes 580 pages Criteria Strong points Weak pointsThe materials are organised in a four volume set comprising Quick Guide, Manual, Toolkit and Action Guide. They present a strong and clear process linked with tools and good examples of potential actions. The set act as a guide and can also be used as the basis of training.Quality – content and form

The materials are clear, well organized and accessible. They build on existing materials which makes them more usable. Cases are relevant and give a good basis for adaptation.Materials are well illustrated by case studies, making them lively to use.

There are many process oriented actions and tools which are generic rather that LED specific – the difference could be made more specific. There could be more on prioritising actions.The institutional dimension could receive more attention. Some actions such as “buy local” campaigns are questionable.The materials are published only as books – which makes them less useful as teaching materials. Electronic versions not easily available and then only as Adobe files. This makes it more difficult for most users to extract sections that are useful in a particular context.

Relevance The subject is highly relevant and

20 Ibid, page 2.21 Ibid, page 7.22 Report on Workshop Promoting Local Economic Development Through Strategic Planning in the Arab States Region, page 16.23 Ibid, page 29.24 Progress report 2006-2007, page 13.25 Progress report 2006-2007, page 14.

17

Chapter 2: Effectiveness

Strategic Planning for Local Economic Development (LED); Published UN Habitat 2006 ; 4 Volumes 580 pages Criteria Strong points Weak points

fits well with current attention being given to the subject by governments and development partners

Access and usability The volumes are available for sale on the UN-HABITAT web site, have been made accessible to those attending training of trainers courses, and are distributed on CD ROMs of training materials.

The materials are very usable and got a good response from those interviewed. Materials have also been tested in university post graduate environments with success26 40.

There is not a developing country price mentioned on the website. The price of $40, and the process needed to order, was seen as a barrier by many interviewedOnly the introductory chapters of each volume are available on Internet, though this is not clear on the web site.

PDF versions are available on the TCBB CD Rom, but availability of this is not published on the web site. TCBB itself is very responsive to direct requests, but this is not publicised.Word versions would be more useful for trainers as they are easier to adapt for training needs.

Impact – Ownership, amount of use,

An extensive discussion process was undertaken to develop the materials including the World Bank and ILO. In addition, promotion seems to have been strong.

Access costs and lack of local versions

Output 1.3 Tool on participatory budgeting produced and disseminated [7.1.3]

From 2002 to 2003, inputs and "coordination support"[2003, page 12] were provided by TCBB for the production of a tool kit on participatory budgeting within the framework of UN-HABITAT's Global Campaign on Urban Governance and the Urban Management Programme, Latin America and the Caribbean [UMP-LAC]. With the toolkit, UN-HABITAT intended “to contribute to the promotion of inter-regional transfers of experience" [2005, 17]. Tool kit development, based on experiences from especially Latin America and to a lesser extent Europe, was completed by 2003/2004 and published as a CD-ROM. What remained was development of a "training interface tool that can be used both in conventional and distance learning" [2004, 14]. The publications “72 FAQs” and the “Conceptual Framework” were launched at the 2nd World Urban Forum that was held in Barcelona in September 2004. The CD-ROM with a collection of resources on Participatory Budgeting was completed beginning 2005. Parts of the original toolkit, comprising the Manual of FAQ, Concept paper, Digital library, set of technical and legal instruments, 14 City fact sheets and a resource directory of people can be downloaded from UN-HABITAT’s website.

In 2005/2006, a survey was done to "seek their views on a proposed Training Companion to the Participatory Budgeting Toolkit produced last year" [2006,

26 LED materials were used with reported success in IHS/ EUR Rotterdam, The Netherlands in June 2007 and in Simon Fraser University in Canada, alsol in June 2007

According to the project document, the following was planned [page 13]: “Involve key players in Latin America and the Caribbean …who have broad field experience on participatory budgeting; organise case studies workshop to validate and further develop the concept and to capture lessons of experience; prepare the tool; produce in print and electronic and disseminate”.

18

Chapter 2: Effectiveness

14]. The survey was disseminated amongst over 250 contacts in networks of TCBB, UDB (UGS & SCP), UMP and partners of RTCD. Responses were received mainly from local government staff, mayors and councillors, CSOs, Ministries of local government and training institutions. Because of the interest shown, an EGM meeting was held on participatory budgeting from 22 to 25 November 2005 in Kenya. This meeting was organised together with Municipal Development Partnership for Eastern and Southern Africa [MDP-ESA], Zimbabwe, the “Centro Internacional de Gestión Urbana” [International Centre for Urban Management, CIGU] from Ecuador and Enda ECOPOP from Senegal and attended by over 30 people from Cameroon, Senegal, Zimbabwe, Tanzania, Benin, Lesotho, Eritrea, Nigeria, Namibia, Uganda, Kenya, Zambia and Madagascar27. Objectives of the workshop were28:

“To review capacity building needs for initiating processes of participatory budgeting in the selected region

To reach an agreement on the content and format of a training companion for enhancing the practice of participatory budgeting in the selected region

To elaborate a roadmap for the development and dissemination of this roadmap”.

In summary, some of the key conclusions on the way forward were the following29:

Despite regional differences in the Africa region, “there exist common constraints, opportunities and trends .. that surpass the local contexts”, henceforth the suggestion to “proceed with a generic African Participatory Budgeting Training Companion”. Participants also agreed that “[many] of the existing tools related to PB are adequate for use in the African region and require little adaptation”

Existing capacity gaps require both “institutionalised and more informal capacity building approaches”. “It was suggested that the capacity building strategy for PB in Africa would benefit from the guidance of

UN-HABITAT partner training institutions [such as CIGU, Enda-ECOPOP, MDP-ESA]” It was agreed that “partners would benefit from the economy of scale in advocacy and capacity building

efforts”. Along these lines, UN-HABITAT “was requested to lead the process of compiling tools and case studies .. and serve as the coordinating body for training needs assessments in target countries”. At the same time, “partner training institutes would act as focal points .. and coordinate and collaborate with other organisations and experts in the sub-region” while “national and sub-national PB working groups ..should be established”.

On the issue of participatory budgeting, TCBB has concluded cooperation agreements with Enda – Ecopop, MDP-ESA and CIGU which is providing “methodological and conceptual coaching in the process”30. According to the 2006-2007 progress report, the cooperation concerns “[1] the development, testing and implementation of the Participatory Budgeting Companion that is suitable for the sub-Saharan context and [2] the establishment of a networking and backstopping facility to facilitate dialogue, the sharing of knowledge and experience and the mobilisation of resources for further promotion of PB in Africa”31. The objectives of the PB companion are: “[1] to introduce the PB process as a campaign tool for innovative local governance in Africa; [2] to prepare, design and initiate PB in African cities and [3] to build capacity of local actors [facilitators and decision-makers] to carry out the PB process in African cities and municipalities”. Moreover, according to the TCBB briefing note on PB referred to above, “[supported] and boosted by UN-HABITAT, sensitisation and

27 Participants included representatives of local government, local government associations, municipal reform programmes, and civil society as well as academic and training institutions with relevant experience in the field as well as UN-HABITAT.28 Report on Expert Group Meeting on participatory budgeting, UN-HABITAT, 2005, page 7.29 Report on Expert Group Meeting on participatory budgeting, UN-HABITAT, 2005, page 21 and 2230 Progress report 2006-2007, page 15.31 Progress report 2006-2007, page 15.

19

Chapter 2: Effectiveness

pilot training activities on participatory budgeting are being organised by Enda in Francophone Africa and MDP in Anglophone Africa”32.

End November 2006, Enda ECOPOP organised a national sensitisation workshop on PB in Dakar together with the “Association des Maires du Sénégal” [AMS]. The event offered an opportunity for the participating organisations “to agree on common action strategies towards a national initiative for participatory budgeting in Senegal”33. Similarly, as part of the collaboration between MDP-ESA and UN-HABITAT towards local government capacity in Sub-Saharan Africa for the introduction and application of PB as a way of realizing good governance, a regional workshop was held from 6 to 8 March 2007 in Harare. The workshop targeted at 40 mayors, councillors, government officials, city treasurers, etc. from Ethiopia, Kenya, Malawi, Mozambique, Senegal, South Africa, Tanzania, Uganda, Zambia and Zimbabwe. The workshop aimed to “review and exchange on emerging experiences and lessons in the application of participatory budgeting in a bid to effectively respond to the challenges of development and service provision at local levels and identify ways of strengthening the practice”34. The workshop, hosted by MDP-ESA with support from the Federation of Canadian Municipalities, also allowed soliciting views on the first draft of the training companion prepared by MDP-ESA35.

While the original ideas was that MDP-ESA and Enda ECOPOP would develop the companion together it was later decided, also for reasons of ownership, that each would develop a complete set, one in English and one in French. MDP-ESA has completed the 2nd draft of the companion in English, based on comments received from UN-HABITAT and CIGU. The draft comprises sections on e.g. budget and budgeting concepts, the PB cycle, cultural and gender dimensions, and guidelines, tools and case studies on putting PB into practice. The draft will go through a process of further review by CIGU, MDP-ESA and UN-HABITAT in the coming months in order to ensure that the materials are ready by the end of July 2007. Enda ECOPOP on the other hand is still in the process of preparing the francophone version of the manual, which is supposed to be ready by the end of May and to be piloted in five Senegalese cities in August/September 2007.

The materials will be available in electronic form only in view of the high costs of printing and in order to increase accessibility. Marketing of the materials needs further consideration; some interest in using the materials was already shown under the “Spanish project”, where local participatory budgeting [together with local participatory planning and gender mainstreaming] features 32 Examples given are the national sensitisation workshop organised by Enda with the Association of Mayors in November 2006 and the work of MDP-ESA in setting up a “Participatory Budgeting Knowledge and Action Support Facility” [PBKASF] together with the World Bank [Social Development Department (SDV), in collaboration with the World Bank Institute (WBI) through the Norwegian and Finish Trust Fund (TFESSD)] and UN-HABITAT. According to the Africa Social Accountability Action Forum [ASAAF] website, the specific objectives of the Facility are: “[1] To enhance awareness regarding the potentials of participatory budgeting in deepening democracy and strengthening decentralisation; [2] To share materials and experiences on participatory budgeting, translate materials into the other respective regional languages, and feed a quarter yearly newsletter; [3] Facilitate knowledge exchange between Regional Centres, other interested institutions, and virtual networks through a common web page or Virtual Learning Environment and a Global Virtual Help Desk; [4] To support capacity building and networking regarding participatory budgeting in areas of decision making, implementing, monitoring and evaluation”. A similar Facility has also been established for the Latin America and Caribbean Region at CIGU in Ecuador.33 Progress report 2006-2007, page 49.34 Progress report 2006-2007, page 49.35 Other events related to the PB initiative include a “networking event” at the third session of WUF [Vancouver 2006] and a special session on PB at the 4th session of Africities [Nairobi, September 2006]. Moreover, the World Bank has asked MDP-ESA to organise a regional conference on PB later in 2007.

20

Chapter 2: Effectiveness

in a new € 1.5 million capacity building programme [€ 500,000 per year over a 3-year period] that will be implemented in Mozambique, Senegal and DR Congo36.

Output 1.4: Tools on combating corruption at local level produced and disseminated [7.1.4]

The manual on "Developing and managing codes of ethics for professional associations", which according to the 2003-2004 progress report “is a flagship product of the Global Urban Governance Campaign and Transparency International" was printed in April 2003. It is the result of joint effort with the International City and Country Management Association [ICMA], FPDL and Transparency International. According to the same progress report, “[this] tool brings together a range of interventions at local and national level, necessary to ensure transparency.." [2004,14]. The next step would be to bring "these normative principles…to the realm of application in specific urban development and management sectors or areas" [2004, 14], for example in the area of land governance. In 2004-2005, a Spanish translation of the toolkit was made by UN-HABITAT’s regional bureau for Latin American and the Caribbean Office and a start was made with exploring possibility of using the toolkit in Land Governance as “an interface between the two global campaigns Security of Tenure and Good governance" [2005; 18].

A training manual on transparency was prepared, entitled "Restore the health of your organisation - a practical guide to curing and preventing corruption in local governments and communities” by FPDL with support from the Open Society Institute [OSI]; UN-HABITAT’s contribution has been limited to some funding for lay-out and editing. The manual consists of two volumes: volume 1 provides concepts and strategies, volume 2 process and facilitation tools. An EGM was held in October 2005 in Reykjavik to review the first draft and explore "application avenues". The manual was also discussed at the 9th Trainers and Partners meeting of the regional programme "Working together" of FPDL in Bucharest in March 2006.

The manual, which uses a "medical metaphor" to describe a "step by step strategic planning process" to address corruption and which includes "more than 30 practical tools to translate this process approach into action" [2006, 16], was printed in October 2006.

Restore the Health of your Organisation - A Practical Guide to Curing and Preventing Corruption in Local Government and Communities Tools on combating Corruption (output 1.4); Produced by FPDL Romania FPDL Romania with UN-HABITAT 006; 2 volumesCriteria Strong points Weak pointsThe materials are in two volumes, the first on concepts and the second on tools. They aim to provide an operational guide on the basis of the ideas of the book “Corrupt Cities - a practical guide to cure and prevent corruption", by Robert Klitgaard, Ronald Maclean-Abaroa, and H. Lindsey Parris,36 Objectives of the programme are: “[1] to strengthen institutional capacities/processes of municipalities, training institutions and key actors in local participatory planning, budgeting and gender mainstreaming; [2] to build the skills of selected municipal staff and elected leaders – women and men – to perform the new roles of undertaking participatory planning, budgeting and gender mainstreaming effectively and efficiently in order to improve governance and sustainability of urban interventions in the city; [3] to strengthen the linkages between municipalities and civil society through building the skills of NGOs and CBOs in undertaking participatory planning and budgeting in order to achieve good governance principles of inclusiveness. Particular attention will be given to training women’s groups”.

According to the project document [page 13], the following was planned: “link up with TI and other potential partners; determine scope and sources of materials and expertise; develop the tools; conduct review workshop; field test, finalise, produce in print and electronic and disseminate”.

21

Chapter 2: Effectiveness

Restore the Health of your Organisation - A Practical Guide to Curing and Preventing Corruption in Local Government and Communities Tools on combating Corruption (output 1.4); Produced by FPDL Romania FPDL Romania with UN-HABITAT 006; 2 volumesCriteria Strong points Weak points They are developed mainly by Fred Fischer and FPDL in Romania with support from Local Government Initiative of OSI and with limited support from the project.Quality – content and form The materials are well produced

in the same form as many of the other materials developed by Fred Fisher. The first volume deals with concepts and the second is a series of tools for use mainly in training or work situations.They are intended as a complement to other materials such as the “Toolkit to support Transparency”Objectives are clear and language is accessible. The case study approach is useful and the aim is very practical. Tools are comprehensive and well structured.

The link with the tools on transparency should be made more explicit. Analysis of the phenomenon of corruption would be useful. The focus of the strategy is rather narrow assuming it is driven only from the top levels. At times the guide is rather simplistic.

Relevance The subject of corruption and how to tackle it is recognised as a critical issue in promoting good governance.

Access and usability Available on Habitat publications website at $15 each volume Available to freely download from FPDL website

Not available to download from UN-HABITAT website.

Impact – Ownership, amount of use

Developed with feedback from and expert group meeting. No feedback so far on use

No feedback so far

Output 1.5: A manual series on municipal financial management produced and disseminated [7.1.5]

An EGM was held from 29 September to 4 October 2002 to review existing materials. A consensus reached on the need for major changes and additions into a UN-HABITAT second edition of the Slovak series. It was moreover agreed that a series of 14 manuals would be produced. Terms of Reference were prepared to employ an external consultancy company. In January 2003, UNON’s Contracts and Procurement Section was asked to organise the tender which involved 10 candidate institutions. An evaluation of the proposals received was done by UNON & TCBB; the company Spearman, Welch & Associates was selected on 4 August 2003. Moreover, a US$ 100,000 grant agreement was signed with the Open Society Institute [Soros Foundation].

Development of the manual was handled from 2003-2005; progress was slow because the lead author was away from her home base for an extended period of time. According to the 2003-2004 progress report, the first seven manuals were "being finalised" while drafts of the first eight manuals were submitted for review in 2004-2005. The final lay-out of the series was “in progress” during 2005-2006. Because of slow progress, the agreement with OSI was amended to "reflect the new schedule of delivery for this series" [2005, 19]. A "partnership agreement has been entered into with Earthscan." [2006, 17] to diversify and test new alternative channels for dissemination and distribution.

In the project document [page 13], the following was foreseen: “collate and review previous research work in which UN-HABITAT has taken active part; identify areas for further work and research; prepare the manuals; organise review workshop; produce in print and electronic and disseminate”.

22

Chapter 2: Effectiveness

Special arrangements will be made to ensure affordability for LDCs and "to monitor the effective of this approach compared with traditional in-housing printing/dissemination so as to help inform future publication strategies" [2006, 17]. The Financial Management for Local Government Series was finally launched by UN-HABITAT’s Executive Director at a conference that was held in Ghana in December 2006.

Municipal Financial Management 2007 co-published with Earthscan 4 volumes 1600 pages (output 1.5)Criteria Strong points Weak pointsA comprehensive set of materials on municipal financial management including training exercises and trainers guide. VOLUME 1: CREATING A FINANCIAL FOUNDATION Sections: Financial Policy Making • Financial Planning • Citizen Participation • Evaluating Financial Condition; VOLUME 2: MANAGING THE OPERATING BUDGET. Sections: Operating Budget • Financing the Operating Budget; VOLUME 3: MANAGING THE CAPITAL INVESTMENT PLAN Sections: Capital Investment Plan • Financing the Capital Investment Plan; VOLUME 4: MANAGING PERFORMANCE Sections: Accounting • Performance Measures • Asset Management • ProcurementQuality – content and form The content is genrally very good.

The material is well written and clearly organised. Trainers’ guides which are integrated are useful and help to use the contents as input to training. Material can be readily “mined” for content and is relevant to a wide range of training situations.The basic level is easy to understand.It forms a useful single source of material which has practical application.The material is professional in presentation

Financial systems vary globally and the materials may be too standardised to be directly applicable at a local level In all situations. However they can still offer a useful starting point.

For reference use the training sections can get in the way of finding information.

The form of the material – only available as a printed source – makes it difficult to extract materials needed for training support.

Relevance Municipal finance is considered a critical area and with decentralisation there is increasing demand. In a context of change, the materials can help influence the introduction of new approaches

It is difficult to be of equal relevance to all financial systems.

Access and usability Will be published at high quality and have commercial promotion.The concept of having both basic and advanced concepts helps to widen the usefulness The material can be used as a reference guide, while trainers’ guides in each volume make it suitable for use in training situations.Supplementary materials based on spreadsheets would greatly enhance its potential, at both basic and advanced levels.

World price Sterling 160 as special pre publication price till June 2007 (developing countries 120 sterling) ( after June, quoted as 200 sterling). No downloads available for three years.

Lack of availability of soft version limits the use of sections by trainers and also the adaptation (requires a Word version, rather than PDF).

Impact – Ownership The process of development has been good with a wide range of organizations and individuals asked to comment.

Too early to judge, as just published, but from interviews on the subject, the pricing may be expected to limit its access impact in developing countries.

1.6 A select set of manuals translated to interactive multi-media [including Internet based] tools for wider outreach, individual applications and distance learning [7.1.6]

In the project document [page 13-14], the following was foreseen: “Engage the UN Centre in Thessaloniki, and possibly other partners in the production of the electronic modules of the manuals for leadership and management training for local government elected officials; ensure quality through constant follow-up and inputs; test the modules; launch a distance learning programme; based on feedback and experience initiate similar multi-media tool development for other key manuals, including the Building Bridges series and the Urban Governance toolkits; support the translation of the evolving Urban Governance Tools Database to an interactive multi-media tool”.

23

Chapter 2: Effectiveness

Distance learning is seen as a complement to the current “synchronous training approach” and is expected to “generate a wider audience and a varied target group”. Moreover, supplementing regular face-to-face learning [the so-called blended approach], introduction of distance learning, partly through e-learning, partly by providing course and course materials on CD-ROM, is expected to reduce training costs and to generate a “wider training delivery impact”.

After a series of failed attempts to work with the UN Centre in Thessaloniki, activities under this heading started only in earnest in 2006 after a series of consultations with UNEP and ICREAF that already had some experience in E-learning and with companies Kenyan companies that provide “technology platforms and content development support on the required technologies”. Based on this inventory, Terms of Reference were prepared for an international tender for technology platform provision and content development. These tenders were launched mid 2006 according to UNON procurement guidelines; 10 companies were short-listed and 3 bids were received. The bids were evaluated by staff of TCBB, ISS and UNON’s Information & Communication Technology Services (ICTS), with the guidance of UNON Procurement, Travel and Shipping Section (PTTS). The tender evaluation report was submitted to UNON PTTS on 23 August 2006. The contract [US$ 103,560 for technical platform and learning contents development] with the selected tenderer, the Indian company Tata Interactive Systems, was signed on 19 October 2006. Contract implementation started in November 2006 with a first mission of the company to Nairobi.

The aim is to develop a total of 13 modules, based on the new LEL series; each module will take some 30 minutes to complete. The modules include scenarios, games, case studies, etc. and are concluded with a test [five questions that are partly multiple-choice, partly scenario based]. Development of the materials is done between UN-HABITAT and the contractor. The system designed allows UN-HABITAT to monitor the users [distinguishing males and females], time spent and the progress made, permits interaction among students, etc. There is a 12 month “hosting agreement” as part of the contract. The server for hosting the e-learning course is in the United States for bandwidth reasons. During the testing phase, there will be free access to the materials but user fees are expected to be introduced, certainly for the beginning. User fee policies remain to be discussed.

A first draft of the functional specifications for the system was prepared on 1 December 2006. Amended functional specifications were produced by 15 December 2006. The first Alpha version containing four modules (Course Introduction, Representation, Leadership and Communication) was delivered on 26 February 2007. The full Alpha version with all 13 modules was delivered on 16 March 2007. At the time of the last mission to Nairobi, a revision of the materials was accessible; the last version of the E-learning programme was with Tata Interactive Systems. Testing will take place until September 2007 in Kenya [UN-HABITAT Slum Upgrading offices in Kibera, Nairobi] and India [Kerala]. Marketing will be done through UN-HABITAT’s website [where it is already mentioned] and UN-HABITAT’s partner organisations.

24

Chapter 2: Effectiveness

Output 1.7: A source book on tools design, ToTs and adaptations produced as part of the series on Guide for Designing Effective Human Settlements Training Programmes with the aim to facilitate sharing of experiences across regions and countries and harmonisation of approaches across Habitat programmes and organisational units [7.1.7]

According to the 2002/2003 progress report, the experience "of adaptation and use of manuals in different local contexts was one of the topics discussed during the EGM on preparing the second edition of training with this particular output and therefore this output henceforth will be treated as part of output 1.1" [2003, 15].

1.8 Gender sensitivity and gender tools

The evaluation report “Forward Looking Evaluation of Gender Mainstreaming in UN-HABITAT” [Evaluation report 1/2003] makes reference to “fertile historical cooperation between the [Women and Habitat Programme] and the Training and Capacity Building Programme”37. According to the report, “[this] should continue to provide scope for full-fledged cooperation, to ensure that all training materials produced are consistently and systematically screened from a gender perspective”38. In line with this, according to the 2004-2005 progress report, “TCBB is continuing efforts to mainstream gender in all components of its work, namely the design of products, selection of trainers and participants for meeting, and recruitment of staff and consultants. The new “gendered” version of the Local Elected Leadership Series and the affirmative action for equally qualified female trainers are two examples of this mainstreaming policy” [page 52]. Similarly, according to TCBB, the LGFM and LEL manuals “highlight the unique role local governments and their leaders can play in promoting gender sensitive approaches to governance” [2004, page 3]. At the same time, the 2005-2006 report highlights that “[in] the area of gender mainstreaming, the Branch has faced challenges in monitoring and tracking the impact of gender and gender mainstreaming on training activities at the different stages of national capacity building interventions” [page 47].

In the first quarter of 2006, a gender consultant was recruited with project funding to develop a Gender Training Companion to enable the global integration of gender perspectives into TCBB training and capacity building tools and training events. Moreover, according to the 2005-2006 progress report, this companion “has the overall aim of strengthening the capacity of trainers and their institutions to mainstream gender perspectives into the design and implementation of training and capacity building activities for local government and civil society. This in turn will empower local government

37 Forward Looking Evaluation of Gender Mainstreaming in UN-HABITAT, April 2003, page 27.38 Forward Looking Evaluation of Gender Mainstreaming in UN-HABITAT, April 2003, page 27.

According to the project document [page 14], the following was planned: “Collate in-house and field experiences in the design and implementation of tools, ToTs and tool adaptations with the aim to crystallise generic approaches and methods and evaluate and synthesise lessons of experience; prepare, finalise, layout, produce in print and electronic and disseminate; as part of the exercise reflect and share lessons on the overall approaches, strengths and gas in past capacity building efforts”.

25

Chapter 2: Effectiveness

officials and civil society to integrate gender perspectives in policy and decision-making for human settlements management” [2006, page 47]. The sourcebook can “also be used as a stand-alone document for training on gender equity and local governance” and will complement all other TCBB training materials.

A second draft of the companion, entitled “Women’s Rights and Gender Equality: A Source Book for Local Government Training”, was prepared by a UN-HABITAT consultant by 22 April 2007. The draft covers a broad range of topics, in addition to generic gender related topics, as well as case studies and exercises39. According to the draft, the source book “covers subjects about women and gender that can be used in the work of UN-HABITAT in good governance, slum upgrading, land tenure and security, shelter, city development strategies, safer cities, etc. as well as with materials of the Training and Capacity Building Branch (TCBB) of UN-HABITAT such as: Local Elected Leadership Series; Local Economic Development Series; Financial Management for Local Government Series; Participatory Budgeting; Tools to Support Transparency and Corruption prevention; Building Bridges between Citizens and Local Government through Participatory Planning Series and through Managing Conflict and Differences Series; Building NGO/CBO Capacity for Organisational Capacity Series” [page 4].

The EGM on the draft was held from 15 to 19 May 2007 in Kampala, Uganda and attended by individual experts and representatives of institutions and countries40. The meeting resulted in a series of detailed recommendations for further adaptation of the manual in terms of structure, clearer focus on specific target groups, better explanation of core terminology and concepts, case studies, best practices, as well as “more introductions to issues such as water/sanitation, solid waste management, transport, lighting, etc.” The document is expected to be ready for editing by July 2007.

Assessment and recommendationsWith respect to the tools developed, the mission first of all observes that the subjects of LEL, LED, municipal financial management, participatory budgeting, corruption and gender are highly relevant. LEL is particularly relevant in a context where there is a strong role of local elected leaders, and particularly when there are new elections or new levels of decentralisation as is the case in e.g. India after the constitutional amendment giving new responsibilities to local government. Relevance of the corruption materials is e.g. evident in Africa, with 279 copies ordered in the last year – the most of any of the publications in the same period. At the same time it is underlined that materials such as LEL are sensitive politically, and that it is important to have strong government backing if large scale impact is to be achieved.

39 Chapter headings are Gender Inequality, Gender and Power, Gender Equality and Participation in Local Government, Gender Equality in Public Administration, Urban Planning, Women and Gender Equality, Gender Equality in Service Provision, Gender-Responsive Budget Initiatives in Local Governments, Local Government and Gender-based Violence, and LED – Opportunities for Reducing Women’s Poverty.40 Participants included representatives from FPDL, Enda Ecopop, the Department of Women and Gender Studies of Makerere University, UN-HABITAT Nairobi and Fukuoka, KZR Associates, Islamabad, Pakistan, UTI, the University of Zimbabwe, the Institute of Development studies; Department of Agrarian and Labour Studies, Faculty of Architecture and Urbanization, Santiago, Chile, UNDP Regional Service Centre, Johannesburg, HSMI, the African Centre for Gender and Social Development, the United Nations Economic Commission for Africa, DPU and a Gender and Youth Specialist from Mozambique..

26

Chapter 2: Effectiveness

Secondly, the mission observes that the new materials are well produced and in line with current thinking. However, from those interviewed, there is some nostalgia for the old LEL materials, particularly from those who have been using them, and translation of the new materials is not seen as a high priority. Moreover, more attention should be paid to producing manuals in the form of easily usable and adaptable training materials rather than books. At the same time, there is some overlap with new training material from the World Bank – but the UN-HABITAT material is seen as more accessible to a wider audience, and better integrated with wider development strategy issues, while the Bank materials are more focussed on Bank programmes. At the same time, the mission observes that there is considerable repetition between different sets of materials – perhaps not surprising as most have been originated from one and the same author. The development of generic materials that are common in terms of how they apply in a range of situations could therefore be a useful direction to go [see original output 1.7].

Thirdly, a key issue with respect to the new series of manuals is their accessibility as they can only purchased and not downloaded from Internet [for a period of three years] as is the case with older materials. Prices of the materials vary, with a high of some 160 pound sterling for the new manual on municipal financial management, and many respondents claimed that they would be unable to afford them at the prices advertised. It is recommended that efforts be made to improve the accessibility of the materials and that the policy of publishing and pricing of materials is re-assessed. In particular this is important as a) the development costs have all been met from the project budget and b) any revenues from sales go into a general account and are not earmarked for further dissemination and/or adaptation and translation.

Fourthly, translation and adaptation of materials to local conditions, e.g. modifying according to language and culture, linking to local regulations and using local examples and case studies, are crucial when working with councillors. This requires funds for research, thinking and testing as well as translation. A greater emphasis on making materials known and facilitating access to funds for adaptation is likely to be beneficial. Stimulus of adaptation including the use of local case materials from e.g. ILO and universities could strengthen the relevance. Attention should also be paid to impact through focussing on use of the materials in major language areas.

Fifthly, since the materials are too recently developed to be able to make recommendations on further development, a monitoring and assessment of their utilisation will be important. At the same time, existing experience of integration of e.g. the LED methodology in a number of programmes – Somalia, Egypt with GOPP, and Vietnam - suggests that this is practical and appreciated.

27

Chapter 2: Effectiveness

Sixthly, there have been good attempts to pay particular attention to “genderisation” of the teaching and learning materials41. The up-coming manual on Gender will supplement this.

Finally, materials in different language groups are difficult to check in terms of quality and even if the content is still in line with UN-HABITAT values. It is therefore recommended that the UN-HABITAT logo should only be used where there is the possibility of sound quality control.

With respect to E-learning, the modules appear well designed though the appropriateness of the starting page [scenery of a township] is somewhat debatable. In comparison with the version of the materials available early March 2007, more UN-HABITAT illustrations have been incorporated thought there are still many that depict a somewhat “corporate” image with white people in expensive suits. Computer system requirements for users appear reasonable [Pentium II and above, various Windows version]. Initial attempts to test the system ran up against teething problems of slow connection, lack of information on problems that could arise and demands for downloading of additional programmes. Accessibility in countries with limited Internet access is, however, likely to be a problem42 and further efforts are needed to reduce the size of animations. The intention is to go “live” by May 2007. Careful testing seems essential before indeed going “live”. Experience shows furthermore that development of E-learning requires quite substantial inputs, both in terms of financial resources and staff time. Before entering into major new initiatives, it is recommended to fully analyse the experiences gained, also in terms of access, and workload implications for TCBB. It will also be important to assess whether there is sufficient demand for additional e-learning courses, and if so, whether they can be developed jointly with other agencies to off-set the costs.

41 This has been less the case with HIV/AIDS. While according to the 2003-2004 progress report, “[particular] care has also been taken to identify workable strategies for combating the spread of HIV / AIDS” [page 3], finding a real “niche” for UN-HABITAT to deal with HIV/AIDS appears to have been problematic. On the issue of “youth”, thee various progress reports refer to specific youth-related activities[such as support given by TCBB to: [a] the UN-HABITAT Youth Forum of May 2003 whereby TCBB provided “a simulation training to a group of youth delegates on developing negotiation skills with local governments, using the newly developed Building Bridges manuals” [2004, page 28]; [b] “sister UN-HABITAT global programmes’ capacity building component” in the area of urban safety and youth-at-risk” [page 5; same in progress report 2003-2004, page 32]; [c] “the International Conference on Urban Youth at risk which was scheduled for October 2004”[Progress report 2004-2005, page 30] in Mexico; and [d] the development of training and capacity building activities of the Youth Empowerment (BKJ) Project in Afghanistan]. The relationship with the Dutch funded project is however not too obvious.42 The download problem explains the foreseen CD-ROM development for the materials.

28

Chapter 2: Effectiveness

Objective 2: To support 30 training and capacity building institutions to effectively respond to the needs and demands of local authorities and local development NGOs and CBOs

2.1 At least ten ToTs and adaptations for training in local leadership supported [7.2.1]

Afri

ca and the Middle EastIn Burkina Faso, TCBB has worked with the “Agence d'Appui a la Gestion et au Développment des Collectivités Locales” [AGEDECOL] to develop and implement a pilot capacity building programme “that targeted municipal leaders and technicians in Banfora, Bobo-Dioulasso and Ouahigouya” [2005, 22]. Support was provided with the framework of a technical cooperation project, implemented by UN-HABITAT Regional Office and the World Bank’s Cities Alliance Programme. Activities were done together with Enda Tiers Monde in terms of training needs analysis and training implementation. The event took place in October 2003; 14 master trainers and 60 councillors were trained as a result on the basis of adapted and contextualised UN-HABITAT training materials.

In Cameroon, TCBB has worked with the ”Fonds Spécial d'Equipement et d'Intervention Intercommunale”[FEICOM] and the “Centre de Formation pour l'Administration Municipale” [CEFAM]. Support was provided in 2002-2003 for the adaptation and translation of “Elected Officials Training” [EOT] manuals into French and training was conducted in two towns using the new materials. Seed funding was provided by the project for a “Review and Validation Workshop on the translated and adapted Elected Leadership Manuals" [2004, 19] that was held from 9 to 16 February 2003 in Yaoundé. A TCBB mission was conducted in April 2003 to assist the partner institutions in developing plan of action for a national training programme using the adapted manuals. In 2003, support was also given for the implementation of the 3rd stage of the Local Leadership Training programme. As of 2004-2005, the project has been providing "on-going technical and backstopping support" [2005, 23], although it is not entirely clear what this has meant, for the leadership capacity component of UN-HABITAT’s project "Support for Effective Urban Governance in Cameroon". Project support, given "within the decentralisation framework in Cameroon" [2005, 23], has furthermore resulted in the production of a series of 4 supplementary handbooks for mayors. According to the 2005-2006 progress report, 333 local elected officials were trained on local leadership roles and competencies. Staff of Enda ECOPOP has been involved in the activities in Cameroon with some funding from UN-HABITAT ROAAS. Political counterpart was the « Ministère de

According to the project document [page 14], the following activities were planned: “Identify countries based on demand, commitment and opportunities for continued training and use and also with the view to expand the geographic spread; identify counterpart institutions; undertake missions and prepare country specific activity briefs; prepare letters of agreement; implement ToT and pilot workshop; follow up implementation of action plans”.

29

Chapter 2: Effectiveness

l’Aménagement du Territoire et de la Décentralisation » and its « Direction des Collectivités Locales ».

Partners in Egypt have been the Ismailia Sustainable Development Training Centre [ISDTC] and the Urban Training Institute [UTI]. A cost-sharing agreement was reached with the Urban Management Programme for the Arab States region to "translate and print EOT manuals and the UN-HABITAT Toolkit to Support Participatory Urban Planning Decision Making" [2003, 17]. TA was provided for training design [gender mainstreaming, participatory planning and decision making...]. Together with ISDTC and UTI a sub-regional ToT on Governance, Local leadership and participatory urban planning and decision making was held from 26 May to 3 June 2003 using the Arabic version of the original LEL series manuals. This event was attended by 20 participants from the Urban Management Programme from Egypt, Jordan, Libya, Mauritania, Morocco, Sudan and Tunisia. According to the report on 2005-2006, within the framework of the slum upgrading initiative of Ismailia with ISDTC, a TNA was “conducted with TCBB technical support" [2006, 19] as a basis for developing a comprehensive training delivery plan. A ToT on local leadership and managing conflicts and differences took place in February 2007, involving 19 persons, “mainly from academia”. Participants also designed and delivered training modules as part of the El-Halous and El-Bakhimi informal settlements upgrading project.

The partner institution in Ethiopia has been the “Regional and Local Development Studies [RLDS] Programme” of Addis Ababa University where support was provided for coordinating the adaptation and translation of LEL manuals into Amharic. The initial work on the manuals was completed by December 2003 while participants from Ethiopia participated in the June 2003 sub-regional ToT. Support to complete the translation, adaptation and printing of the manuals continued well into 2005 with support from UN-HABITAT and GTZ. A validation workshop was held in 2004; the event was attended by a "wide spectrum of stakeholders" [2005; 24] who also “discussed and developed an "action plan and the way forward" [2005, 24]. According to the 2005-2006 progress report, a two-phased training programme was drafted and under discussion; the report observes in this respect that "[the] timing and pace of implementation however is uncertain" [2006, 20]. To date there has been no use of the materials reported. According to the 2006-2007 progress report, there are now links with the Urban Development Capacity Building Office and the Ethiopian Civil Service College but implementation of any activities has so far been delayed.

Key partners in Kenya have been the Government Training Institute [GIT] in Mombassa, one of four GTIs in the country and the Kenya Institute of Management [KIM] that was "engaged to provide substantive, organisation, logistical support and expertise to the Kenyan Stakeholders Consultative group in the preparation of a new 5-year capacity building national framework” as well as the Association of Local Government Authorities of Kenya [ALGAK]. Together with GTI, a sub-regional ToT and pilot workshop "using UN-HABITAT training manuals on elected leadership competencies" [2004, 20] was held from 27 May to 10 June 2003 for 24 trainers from 5 countries in Eastern and Southern Africa. These trainers conducted a one week seminar for 55 councillors from three Kenyan municipalities. A senior trainer from GTI participated in LEL regional workshop that was held in Romania, together with FPDL, from 15 to 22 May 2005.

30

Chapter 2: Effectiveness

In Madagascar, the project provided support for the design and implementation of a national training programme based on the French version of the manuals – this involved Enda ECOPOP. External financial support was identified [US$ 74,000] to initiate leadership competency training together with the “Ecole National Administration et de Magistrature à Madagascar” [ENAM] and Enda ECOPOP. Enda supported the national programme on leadership for local authorities based on adapted UN-HABITAT materials43 and a first ToT workshop on leadership roles and competencies was held in October 2005. With funding from UNDP and UN-HABITAT’s ROAAS, Enda worked with the Ministère du Territoire et de la Décentralisation and ENAM on teacher training. Problem has been the change in Government and replacement of the Minister responsible for local government. Enda supported the ToT of a first group of 18 teachers on adapted local leadership series and reported that some 390 élus have been trained to date.

In Mozambique, TCBB worked with the “Direccao Nacional, Ministerio de Aministracao Estatal” [MAE]. A mission was undertaken by TCBB in September 2002 [outside the project] to "identify potential partner capacity building institutions and to engage them to design and implement training and capacity building activities based on EOT manual" [2003, 18]. Collaboration was established with the Cities Alliance [CA] project for slum upgrading and flood vulnerability reduction. "The project intensified its assistance to partner .. Institutions to engage them to design and implement training…" [2004, 21] based on EOT manuals. Three representatives from Mozambican institutions participated in the ToT in Kenya of May-June 2003. It is understood that some elements from UN-HABITAT training manuals have been incorporated into training materials developed by the CA project and that there has been some interest in the use of training manuals from the new Local Government Association for Local Authorities [ANAMM]. The follow-up will now be taken up under the Spanish funded programme; as part of this project, the LEL series is being translated into Portuguese in collaboration with ROAAS.

From the National Institute of Housing and Urbanism in Morocco, seven trainers participated in a sub-regional ToT on Governance, Local Leadership and Participatory Urban planning and decision making that was held in Egypt in May-June 2003. The participants took part in a 2-day UNDP-supported workshop at the Institute focusing on adaptation of manuals and launch of training programmes for elected officials etc. According to the 2003-2004 progress report, three training programmes were planned for mid 2004 using 3 out of the 11 ELO manuals. In 2004/2005, Mekness, Marakech and Agadir benefited from training of elected officials based on TCBB manuals. This training took place under the LA 21 programme and received support from TCBB.

In Nigeria, a national ToT on the basis of the EOT manuals was done in June 2002 [30 trainers from all over Nigeria]. As a follow up, the Centre for Human Settlements and Urban Development [CHSUD] took the initiative to adapt the LEL manuals; this adaptation was completed together with UN-HABITAT. TCBB furthermore provided "substantive support and advice to CHSUD towards the design and implementation of a national programme to train local officials" [2005, 26] and a detailed training schedule has been elaborated. According to 43 Support was provided for the adaptation of 11 local leadership manuals [1) l'élaboration de politiques communales, 2) prise de décision, 3) la communication sociale, 4) la facilitation, 5) la mobilisation sociale, 6) la négociation, 7) la gestion financière municipale, 8) le contrôle de l'action municipale, 9) l'exercice du pouvoir, 10) le management de l'institution municipale, 11) le leader].

31

Chapter 2: Effectiveness

the 2005/2006 progress report, “arrangements are being made by CHSUD with local authorities for training”.

Enda ECOPOP has been TCBB’s key partner in Senegal [and francophone Africa]. According to the 2005-2006 progress report, Enda "has been supporting capacity building programmes in Senegal to reinforce the capacities of .. partners in designing and delivering programmes.." [2006, 21] using the LEL materials and incorporating “elements from the communication module of the LEL manuals.." [2006, 21].

Involving ISDTC from Egypt, and together with UN-HABITAT ROAAS, TCBB supported “the design and delivery of a training of trainers and pilot workshop for mayors on local leadership" [2005, 27] under the aegis of the Association of Palestinian Local Authorities [APLA]. The workshop took place in Egypt in May 2005, using UN-HABITAT manuals in Arabic and involving 12 trainers and 20 mayors and councillors. Adaptation was done by training participants, who, already before leaving, organized themselves in teams, appointed coordinators and took the task of adaptation. On their return to Palestine they prepared a draft adaptation based on the first English edition and the Ismailia Arabic edition; this was done during the first half of 2005. A follow-up mission to help finalize and engage on scaling up, was cancelled because of political and security reasons and is now scheduled for September 2007 using other resources.

In Somalia, the partners for training activities have been as follows in the different regions:

Somaliland: Academy for Peace and Development; Amoud University; University of Hergeisha; Puntland: women NGO Wawa; NGO Talawadak and East African University South: NGO Centre for Research and Dialogue and an organisation linked to Australia SAACID

Capacity building was provided in support of the EC/UN-HABITAT funded “Somalia Good Local Governance and Leadership Training Programme" and consisted of the following steps: adaptation and translation of materials by national training institutions [including the integration of case study materials from Somalia], followed by national ToT and subsequently the design and implementation of six regional training activities in the North-West, two in the North-East and 12 in the South. A Pilot Workshop on Leadership and Management skills for local leaders was held from 11 to 28 October 2003 in Hergeisha for 30 trainers. A pilot workshop for 22 councillors from Hergeisa municipality was held, followed by a pilot programme in December 2003 [24 people]. In summary, the main characteristics of the UN-HABITAT provided training was as follows:

Training modules Target groups Training materialsOrientation workshop Mayors -Module A: Local leadership, gender & governance index/ indicators

Governors, mayors, councillors, training institutions, women NGOs

Role of NGOs in local development; Training for LEL series; Women and urban governance; Urban governance indicators/index

Module B: NGO/CBO capacity building

NGOs, CBOs, training institutions

Role of NGOs in local development; Building Bridges between citizens and local governments; Building NGO/CBO capacity for organisational outreach

Module C: local governance and participatory planning

All relevant stakeholders Tools to support participatory urban decision making; Building Bridges between citizens and local governments

Municipal Finance Training of trainers [Puntland] [July 2006]

32

Chapter 2: Effectiveness

Advice was provided TCBB on the use of the materials and the training component – this is referred to as “on-going technical backstopping and methodological support to the Somalia Good Local Governance and Leadership Training Programme" [2005, 27-28]. In terms of training subjects, a start was made with the LEL series – with the first ToTs in the area of local elected leadership. This was followed by use of an adapted version of the TCBB gender manual and the Building Bridges materials on conflict resolution.

Moreover, in Somalia, “[Given] the particular challenges faced by women within Somalia, specific workshops were organised to create awareness on gender issues and identify specific approaches to integrating gender into decision-making and urban planning processes” [2003-2004 progress report, page 4]. According to the 2004-2005 progress report, “the translation and adaptation of LEL manuals into Somali and the production of gender/governance-specific manuals have resulted in the completion of LEL trainings in all three regions and the implementation of district-wide training sessions on gender and local governance” [page 28]. Also in Somalia, a Training of Trainers and Pilot Workshop on Leadership and Management Skills for Local Leaders was organized by ROAAS [11-28 October 2003] in Hargeisa, Somaliland; again, attention was paid to “the overarching themes of Urban Governance Indicators and Gender” [page 22].

Collaboration with South Africa dates back to 2005, when contacts were established with the Institute for Democracy in South Africa [IDASA], the South Africa Local Government Association [SALGA] and the Department for Provincial and Local Government. Together with these organisations, a regional LEL ToT covering Eastern and Southern Africa was held from 7 to 13 May 2006 in Pretoria. The workshop aimed to enable “participants to learn how to design and deliver an interactive training programme on leadership knowledge and skills for elected local leaders using the specialised UN-HABITAT training manuals on this topic”; “Facilitating participants to develop country specific or institutional training action plans for implementation and follow-up of training and capacity building activities at the national level”44. The workshop was held under the auspices of UN-HABITAT and supported by IDASA, SALGA, DPLG and DBSA and facilitated by trainers from UTI and GTI in Mombassa. The even was attended by “27 core participants” from Mozambique, Lesotho, Namibia, South Africa, Tanzania, Kenya, and Zambia as well as UN-HABITAT staff. As an outcome of the workshop, eight country specific action plans “for rolling out a similar training course in the participating countries” were prepared together with country profiles “highlighting the key challenges facing local governance”45.

In Tanzania, there have been contacts with the University College of Lands and Architectural Studies [UCLAS]. Plans for activities were prepared in 2003/2004. Contacts were also established with the Association of Local Authorities in Tanzania and other organisations, such as the President's office- Regional 44 Workshop report, page 3.45 Workshop report, page 8.

“Using UN-HABITAT training materials on “leadership and management”, “the role of women in local governance”, and “participatory planning”, the local governance structures are being redefined, taking into account the complexity mentioned earlier. Local leaders were given a chance to apply new concepts and skills gained during intense on-the-job training sessions elaborating and implementing priority action plans together with private sector and civil society actors. Firs steps were made towards more include decision-making processes through: the organisation of broad-based consultative for a.., defining a common vision, agreeing on priorities, and redefining the power relations between the authorities and the other groups in town” [Introducing [spatial] planning in post-conflict contexts – the case of Somali cities – Urban planning in a state of flux series, May 2006].

33

Chapter 2: Effectiveness

Administration and Local Government; Association of Local Authorities, UCLAS and Tanzania Gender Network Programme [TGNP]. According to the 2004-2005 progress report, TCBB staff undertook "substantive missions to Tanzania" to discuss potential of mainstreaming UN-HABITAT training materials and tools into the training activities of the Local Government Reform Programme in that project year. Apparently it was agreed that UN-HABITAT would jointly organise a ToT late 2005 in Tanzania; however, no further information is available. As is clear from the 2005-2006 progress report, the focus of attention shifted to the undertaking of a training impact evaluation of the Tanzania National Programme for Councillors Training [see further below]. According to the report, this activity "falls within TCBB's broader framework of strengthening its focus on training impact on performance" [2006, 22]. The outcome of the evaluation has fed into the E-forum on "operationalising TIP" established at the October 2005 meeting on "Making Learning Matter: Training impact on Performance" [see further below].

Three trainers from Uganda participated in the sub-regional workshop on leadership and management competencies and skills for elected officials. .

AsiaIn Asia, more substantial activities have taken place in the Pacific and India; initiatives elsewhere have been of a much more modest scale [see box]. As part of the 5-year capacity building programme of the Commonwealth Local Government Forum [CLGF], a ToT Workshop and Pilot Seminar based on LEL series was held in Fiji from 27 March to 8 April 2006 for 29 trainers from 8 island states [Fiji [7], Kiribati [4], Papua New Guinea [5], Samoa [2], Solomon Islands [4], Tonga [2], Tuvalua [2], and Vanuatu [3]]. The event was supported by 5 facilitators [2 from TCBB], 3 resource persons and 2 administrative staff. Objectives of the workshop were twofold: “Trainers will improve their knowledge and skills in the design and conduct of interactive, participatory training programmes in the field of leadership, using the UN-HABITAT revised series of manuals on Local Elected Leadership and Trainers will develop Action Plan in order to implement training programmes in their respective countries that improve the leadership competencies of public leaders and managers”46. In conjunction with the ToT a pilot training seminar was given for 40 councillors from surrounding Fiji municipalities. The event was co-financed by UN-HABITAT, CLGF, UNDP Pacific Sub-Regional Resource Centre, the UNDP Inter-Country Team and the UNDP Isabel Province Development Project [IPDP] [Solomon Islands]. As a

46 CLGF-UN-HABITAT, Report of Pacific Region Training of Trainers Workshop on Local Elected Leadership, 27 March – 7 April 2006, page 2.

Two trainers from the Rabia I Balkhi Advocacy and Skill Building Agency, National Solidarity Programme in Afghanistan participated in the regional ToT that was held at HSMI [January 2004]. Discussions were held with the NGO Capacity Building Initiative in Bhutan to plan for an LEL ToT in Bhutan in 2005/2006; however with no follow-up. A Memorandum of Understanding was signed with the National Mayors Training Centre in China "to translate and adapt the UN-HABITAT training manual on Urban Local Government Finance for South Asian Countries into Chinese" [2005, 30]. Technical support and a small grant were provided in 2005-2006 to adapt the training materials. Two trainers from the Urban and Regional Development Institute [URDI] and the Association of Indonesian Regency Government [APKASI] in Indonesia participated in a regional ToT that was held in 2003/2004. So far there has been no follow up in Indonesia. The reason given was the lack of funds to facilitate adaptation and translation. Trainers from the Urban Development Training Centre and the Local Development Training Academy in Nepal participated in a regional ToT in India held in 2003/2004. Some initial effort was also made to translate and adapt the training materials. A TCBB exploratory mission was conducted to three national institutions in the Philippines "to "gauge current training demands and explore possible areas of collaboration" [2003, 20]. From the Sri Lanka Institute of Development Administration, the Sir Lanka Institute of Local Governance and the Colombo Municipal Council in Sri Lanka, three staff members participated in ToT organised in India in 2003/2004. In Vietnam, together with UNDP, an updated version of LEL series in Vietnamese was prepared in 2005/2006. This followed earlier efforts together with UNDP in 2002 and 2004 [see also Chapter 5 on impact].

34

Chapter 2: Effectiveness

follow up, country representatives developed plans “on how they intend to take forward this training in leadership knowledge and skills for elected local leaders”47 [see the table below].

Fiji Kiribati Papua New Guinea

Samoa Solomon Islands

Tonga Tuvalu Vanuatu

Awareness raising to Fiji Local Government AssociationTraining needs analysis of all town/city councilsTrainingMonitoring and [outcome] Evaluation of the training

Preparation of a National ToT proposal Adaptation and awareness campaign with key stakeholdersImplementation of a national ToTReview and adaptation and translation of manuals followed by National training workshop for councillorsEvaluation and reporting on the training

Consolidation of national ToT groupTraining workshop for Town ManagersTraining of trainers Adaptation of training manualsTraining workshop on “post election”

Undertake training on leadership and roles and responsibilities of village mayors and councillors

Training on “Consultation and meeting with stakeholders”Adaptation of manualsPilot training on the basis of the adapted LEL manualsTraining evaluation

Awareness raising on LEL manuals among district and town officersTraining needs assessmentTraining programme development and implementationTraining evaluation

Prepare training proposalAssessment of training opportunities and needsAdaptation and translation of manualsNational training of trainers eventIsland-based training and training evaluation

Reporting on eventAdoption and adaptation of manualsDevelopment of draft training programmeImplementation of national ToT workshopTraining at provincial level

Key partner in India has been the Human Settlements Management Institute [HSMI]. According to the 2002/2003 progress report, "[during] this reporting period…, the 21 institutions plan to undertaken 105 training programmes ..[for 3,150 people]” using materials of UN-HABITAT/EOT and Government of India. Discussions were also with HSMI on a 2-year capacity building cooperation framework for 4 series of ToT in the region. In January-April 2003, a mission was carried out to Dr. MCR Human Resources Management Institute of Andhra Pradesh for "the field testing and adaptation" of Telugu training materials while the Kerala Institute of Local Administration was working on Malayalam translation and adaptation of LEL manuals. UN-HABITAT fielded a mission to Kerala state in September 2003 "which provided technical support to the pilot training on local government elected leadership and management competencies" [2004, 24] and training was provided for 30 Kerala councillors in order to fine-tune the draft materials48. From 11 to 22 January 2004, HSMI and UN-HABITAT implemented a regional ToT for South Asia on local government and leadership skills. Similarly, from 27 January to 2 February 2006, HSMI and UN-HABITAT organised "the Asia-Pacific launch of the Training of Trainers workshop on the Elected Leadership series" [2006, 23]. 22 senior representatives from nine countries attended the event that was designed to "provide an opportunity for the trainers to practice their acquired skills" [2006, 23]. As a follow-up, a 2-day pilot took place with people from Tamil Nadu and Haryana states.

Latin AmericaIn Ecuador, Chile, and Mexico, TCBB provided support to initiate “a potential multi-country, multi-stakeholder capacity building programme [based on EOT and IULA materials] for elected officials.."[2003, 20] of the Latin American chapter of IULA [IULA-CELCADEL]. An agreement was signed in April 2003 to support an overall capacity building framework and regional adaptation and for updating the Spanish tools that were developed earlier. In Mexico, links were established with the Secretariat for Social Development [SEDESOL] and the National Institute of Federalism and Municipal Development [INAFED].

47 CLGF-UN-HABITAT, Report of Pacific Region Training of Trainers Workshop on Local Elected Leadership, 27 March – 7 April 2006, page 9.48 As a result "KILA's institutional capacity as a training and capacity building institution has been strengthened in the areas of tools development and training design and delivery and its capacity to adapt generic training tools into the local context and language" [2004, 25].

35

Chapter 2: Effectiveness

Collaboration was established between IULA and INAFED for testing of the manual. Spanish version of the LED series was completed. A mission to Mexico was conducted in March 2004 to give inputs for a conference on Urban Youth at Risk. A cooperation agreement was concluded in February 2007 with a Peruvian organisation to develop a translation and adaptation of the manual “Counsellor as Guardian of the Environment” of 1997.

Since late 2006, UN-HABITAT has been supporting the “Ministère de l’Intérieur et des Collectivités Territoriales” [MICT] of Haiti to enhance leadership capacities of recently elected local leaders. A 10-day ToT, followed by a 4-day pilot training for representatives of seven Haitian municipalities 49 was done on LEL from 24 April to 7 May 2007 by the coordinator of Enda ECOPOP together with an assistant of the MICT. In addition, a start was made with preparing a plan for a national training programme on local elected leadership. A broad range of training institutions was present at the ToT50 as it was unclear with which institution the MICT would be collaborating in the future. The event was co-financed by UNDP, UN-HABITAT’s regular budget and the project [financing of training costs and transport].

Central and Eastern EuropeIn Central and Eastern Europe, there has been a long history of cooperation with Partners Romania for Local Development [FPDL] in Romania and its regional programme "Working Together". A series of sub-regional ToT events was carried out by FPDL based on the LEL manuals [Romania, Bosnia]. FPDL-staff participated in a LEL sub-regional training for South Asia at HSMI in India "thereby transferring the skills and knowledge of FPDL senior trainers to a core pool of South Asian trainers and resource persons on local governance" [2004, 27] as well as in a regional ToT on the new edition of the LEL held in May 200551.

Numbers….When looking at the number of people involved in the different training activities [excluding EGMs, conferences, training events at conferences, etc., but including training sessions for which apparently no project funding has been used] the following picture emerges:

The total number of participants has been 885 of which some 30% women [not all data appear accurate, the number of female participants could be higher]

Representatives from local government represented 31.4% of participants, Central Government officials for 7.7%, staff members of NGOs for 15.8%, staff from training institutions and universities 29.2%, and other organisations for 10.3%. UN-HABITAT staff accounted for 12.9% of the attending participants.

The number of training days per training session varied between 3 and more than 12 days. The costs of the training sessions varied considerably. In absolute terms, costs ranged between a low of

just over US$ 4,500 for a Municipal Planning and Service Delivery Training Course held in Israel in November 2006 and the Training Impact Evaluation event that was held in Manchester with a budget of over US$ 117,000. Costs per participant varied considerably as well.

The issue of “increasing the number of female participants” has been raised on several occasions by the Netherlands Ministry of Foreign Affairs, e.g. in a letter

49 Carrefour, Cité Soleil, Miragõane, Port de Paix, Mirebelais, Grand Gõave and Anse d’Hainault.50 Including the National Association for Decentralisation and Local Development [ANAPDDEL], the “Centre d’Etude et de Recherche sur le Dévelopmment Local” [CERDEL], the “Organisation Plaidoyer pour le Développement Communautaire” [PLADCOM] and the University Notre Dame d’Haiti.51 The event was attended by 19 participants, including trainers from regional and national institutions, NGOs and youth organisations, Local Government Association and "management consultants" from 8 countries such as Egypt, Kenya, Senegal and India.

36

Chapter 2: Effectiveness

from the Netherlands Ministry of Foreign Affairs52. In his letter to the Ministry of 24 November 2004, the response of the Director, Programme Support Division was as follows: “[TCBB] .. serves on the UN-HABITAT Gender Task Force and strives to achieve gender mainstreaming in its work. 2 out of 4 professionals who were working during year 2 of the project were women. Gender perspective has been incorporated in the second edition of the manual series on Elected Leadership Competencies and Roles. Recent training in Somalia and India [AIILSG] included modules, which brought gender aspects of our learning materials into sharp focus, using conceptual presentations, illustrations, individual reflections and group work. There is also discussion with partners in Tanzania to organise training fro women councillors [1/3 councillors are ought to be women by law] and thereby enhance their role in decision making. If successful, it will be replicated in other countries with similar context. Again, we shall include gender aspects in our future reporting”. In its reaction on the 2005-2006 progress report53, the Ministry54, once more questioned whether an increase was expected in the share of female participants [from 38 to 40%]. In reacting, the Director, Programme Support Division stated: “On the issue of gender balance of training course participants, considerable efforts have been made in ensuring balanced gender representation..[and] the current level of 38% women participants is already quite high. This is mainly because in some of our principal target groups .. women are still significantly underrepresented, particularly in regions such as the Arab States and Africa. While selected recent events have surpassed the above percentage, it will be particularly difficult to maintain that level and to raise the overall gender-balanced representation over the project duration to 40%. However, we shall continue to encourage our collaborating partners to aim as much as possible for balanced gender participation…”55.

2.2 At least twenty ToTs and pilot workshops on the "Building bridges" , Local Economic Development and training needs assessment manuals completed56 [7.2.2]

Africa Apart from preliminary discussions to organise a sub-regional ToT in relation to the Building Bridges manuals, little happened in the Africa region in 2002-2003. Activities stepped up in 2003-2004, when, together with FPDL, a sub-regional ToT workshop was organised for Eastern and Southern African countries using

52 Letter of H.O. Tempelman to Antoine King of 11 November 2004, ref. DCO/OO-307/04.53 On the subject, the reported stated that “TCBB in selecting nominations for participation in training events has mandated partner institutions to make nominations taking gender mainstreaming into account. Increasingly, the Branch has seen a global rise in the number of women participants selected by local and national governments as well as by training institutions to participate in training workshops. At the time of the writing of this report, 38% of participants attending training events are female. A direct result has been an increase in the number of qualified women trainers in all fields of training for local government capacity building programmes. This has especially been the case in Sub-regional Training of Trainers Workshops and other activities” [page 47]. 54 Mr Tempelman’s letter to Mr Antoine King of 9 August 2006 [ref. DCO/OO-229/06].55 Letter to Mr Tempelman of 4 September 2006.56 The output was modified during the project, the 4th year progress report , May 2006 states that the output has been reviewed to include reporting on LED, TNA, Code of Ethics, MDGs besides the Building of Bridges Series whose demand has not been as high as earlier envisaged.

According to the project document [page 14], the following was planned: “Identify countries based on demand, commitment and opportunities for continued training and use; identify counterpart institutions; undertake missions and prepare country specific activity briefs; prepare letters of agreement; implement ToT and pilot workshops; follow up implementation of action plans”.

37

Chapter 2: Effectiveness

the Building Bridges "through Managing Conflict and Differences; and Participatory Planning". The event was attended by 30 people from Ethiopia, Kenya, Somalia, Tanzania, Zimbabwe, and Senegal. A cooperation agreement was signed with Enda ECOPOP “to design and implement" a sub-regional programme for francophone west Africa and Madagascar. A one year programme on participatory planning and managing conflict and differences was developed; Benin, Burkina Faso, Cameroon, Madagascar, Mali, Mauritania, and Niger were "identified as beneficiary countries for this sub-regional training and capacity building programme for francophone West Africa and Madagascar on participatory planning and managing conflict and differences" [2005, 32-35]. ]. Enda linked the regional ToT with a round table of NGOs to stimulate debate by linking discussion of Millennium Development Goals to Building Bridges.

A sub-regional ToT on LED, based on the UN-HABITAT LED series was held in May 2006, involving 26 people from Kenya, Rwanda, Tanzania and Uganda [local authorities, training institutes, etc.]. The event was organised at the request of and together with ALGAK, EALGA and GTI and supported by the Centre for International Cooperation of Israel.

Since 2005-2006, partners in Benin have SNV and the Ministry of Local Government. Representatives of these organisations were supported by TCBB to participate in training on BB series on conflict management and participatory planning. As a follow up to this, a document "detailing the implementation of a national programme for the rolling out training programmes" [2006, 27] was prepared which was adopted by the Ministry in December 2005. A delegation of SNV, Ministry and Enda ECOPOP came to Nairobi to discuss the proposed programme [and funding requirements]; TCBB "provided substantive recommendations to strengthen and sharpen the strategic focus" [2006, 27] and for the development of a resource mobilisation strategy. According to the 2006/2007 progress report, “[a] ToT on conflict management was conducted within the framework of a support to the decentralisation and community development programme” with funding provided by GTZ,

Representatives from the AGEDECOL57 and the Ministry of Local Government of Burkina Faso attended the above-mentioned sub-regional ToT organised by Enda. However, developments were affected by uncertain political environment and follow-up was limited to some briefings that were given to appropriate ministries. At the same time, Enda "as part of a water aid initiative… has implemented a workshop in ..Ouagadougou [July 2005]..using modules from the BB manuals on participatory planning.." [2006, 28] – however, this activity is outside the scope of the project,

A representative from Burundi also participated in the Edna regional ToT. "However, in Burundi the absence of training and capacity building institutions…has negatively impacted the implementation of national follow-up activities.." [2006, 28].

Representatives from CEFAM and the Ministry of Territorial Administration and Decentralisation of Cameroon participated in the ToT event of June 2005. Since then, a two-day meeting was organised to brief Cameroon organisations [such as

57 In the meantime, AGEDECOL has been dissolved; a “Permanent Fund for the Development of Local Authorities” and a “Support Advice Agency” were apparently created; however, activities were suspended in view of the elections.

38

Chapter 2: Effectiveness

GTZ, SNV, etc.] and discuss idea of developing a national training programme. A second workshop was planned for October 2006; it is not clear whether this workshop materialised.

In 2004-2005, discussions with "key government agencies" in Egypt and UTI were “advanced to develop a national training programme to address the Government's recent initiative to decentralise urban planning and mainstreaming of environment management in urban planning" [2005, 33]. Detailed ToR were prepared and agreed upon and "awaits setting timing for a ToT suited to academic institutions taking part in it" [2005, 33]. According to the 2005-2006 progress report, a TNA was conducted within the framework of the slum upgrading initiative of Ismailia. In Ismailia materials from the Building Bridges series were translated to Arabic.

An agreement was reached between Enda and ENAM in Madagascar to reinforce ENAM’s institutional capacity, based on the BB manuals. ENAM also received support "to mobilise resources for national training programmes, resulting in the mobilisation of financial support from the French cooperation" [2006, 29].

Representatives from GTZ and the Ministry of Local Government from Mali participated in the regional ToT of June 2005. Progress slowed down due to the departure of key individuals and "weak institutional commitment and arrangements resulting from budgetary constraints and unstable management structures" [2006, 29]. As a follow-up, Enda conducted two missions to Mali for discussions with different institutions.

Two trainers from Cellule CEFE in Mauritania "benefited from UN-HABITAT/ENDA support to develop a national training programme based on BB manuals.." [2006, 29]. Progress however stagnated due to the "unstable socio-political environment" [2006, 29]. According to Enda, currently some activities are foreseen with the Ministry of Interior, Postal Services and Communication and its “Direction Générale des collectivités locales” and its “Programme de décentralisation pour le développement local et la démocratie participative”58.

According to the 2005-2006 progress report, Enda Maghreb [Morocco] also benefited from the ToT in June 2005 and "reported integrating modules from the BB manuals on participatory planning into the implementation of Edna Maghreb participatory planning process and programmes in Morocco" [2006, 30].

Representatives of Ministry of Interior and Local Development and UNDP in Niger participated in the regional BB-related ToT of June 2005. Similar to Mali, departure of key persons "has hampered progress in Niger" [2006, 30].

One staff member from the “Centre de Gestion des Conflits” of the “Université Nationale du Rwanda” participated in the above-mentioned regional training. "As in Burundi, the absence of true training and capacity building institutions.. has negatively impacted the implementation of national follow-up activities..." [2006, 30].

58 Within the framework of this programme there is a training component and Enda ECOPOP has been asked to contribute to component C of the programme which concerns the “démocratie participative, société civile”, again with GTZ money. They would be using the adapted version of local leadership series as well as the [traditional] Arabic materials.

39

Chapter 2: Effectiveness

According to the 2004-2005 progress report, in Senegal the project "continued to provide technical backstopping and methodological support" [2005, 35]. Intention is to "improve the capacities of local leaders and civil society in participating in city consultations towards the development of strategic local development action plans and policies" [2005, 35]. A ToT on participatory planning and city consultation process was in August 2004, using UN-HABITAT materials that had been translated and adapted in 2004. The 2005-2006 progress report observes that in Senegal "[institutional] support for the BB programme .. .has been anchored within Edna and the Division of Training and Communication of the Ministry of Local Government" [2006, 30]. Ministry, Edna and UNESCO moreover entered into an agreement to implement a programme on Human Rights, Citizenship and Democracy. Edna mobilised 50,000 US$ from UNESCO for this purpose. Enda has integrated the BB modules into training within its Water Aid initiative [see also Burkina FasoIn Somalia, support was given in 2003-2004 to the Academy for Development and Peace of Amoud University for a ToT workshop on the BB materials, which had been translated into Somali "and “adapted to meet the unique development challenges present in Somalia" [2004, 29]. The event, organised under the Somalia Good Local Governance and Leadership Programme, was held in Kenya [16 February to 5 March 2004] and attended by 30 participants from different organisations in Somaliland, Puntland and South Central Somalia. ToT training on Participatory planning etc. took place in November 2003 with participation of trainers from Somalia. Training activities in Somalia continued well into 2004-2005.

With the Dar es Salaam City Council in Tanzania a joint strategy workshop on local economic development was organised with Sustainable Cities Initiative of Industry Canada and EcoPlan International [2004-2005]. The event, which attracted some 30 participants, gave exposure to UN-HABITAT’s new LED manuals.

With respect to Uganda, the 2004-2005 progress report refers to relations with the Uganda Management Institute [UMI]. According to the report, TCBB "continued to engage UMI trainers who have participated in a ToT based on the Building Bridges Series.. to monitor the implementation of country specific ToT action plans" [2005, 37]. UMI reported the introduction of 2 new courses in 2004-2005: participatory planning approaches and stress and conflict management.

Asia A mission was undertaken to LOGOTRI, the Asia-Pacific network of local government training and research institutions in October 2003 to participate in a LOGOTRI regional seminar. As a follow-up, together with LOGOTRI, TCBB planned to organise a regional ToT in Nepal in April 2004. A formal agreement was signed with LOGOTRI in February 2004 "to undertake the forthcoming ToT on local conflict" [2004, 33]. Collaboration with LOGOTRI was considered important as it would provide better access to reliable organisations in the region and reduce costs of training due to LOGOTRI cost-sharing contributions. The LED series was presented at a 2-day training workshop for representatives of national training institutions in Asia. The event was organised together with the Shanghai Administrative Institute and LOGOTRI. The event aimed at "introducing the LED strategic planning process, reviewing local and regional initiatives and gauging their progress using the LED planning process and

40

Chapter 2: Effectiveness

exploring opportunities for collaboration" [2006, 34]. 13 Asian and Pacific countries attended a LOGODI meeting "to strategize on ways of increasing collaboration between local government and non-governmental organisations through improved participatory planning" [2006, 31]. Participants developed action plans for their organisations "using building bridges series as to how they would go about integrating the MDGs into participatory planning processes" [2006, 31]. A sub-regional ToT on Participatory Planning was held in New Delhi from 14 to 17 March 2005 together with the Society for Development Studies [SDS]. Staff from regional training institutions participated in this training:

From Nepal: the Urban Development Training Centre [UDTC]; Local Development Training Academy [LDTA]; Municipal Association of Nepal [MUAN]. One follow-up national ToT was held in September 2004; a second follow-up cancelled "as a result of the dissolution of the government in Nepal" [2005, 38].

From Pakistan: the Abdul Hamid Khan National Centre for Rural Development and Municipal Administration [AHK-NCRD]. According to the 2004-2005 progress report, after the training AHK "took steps to conduct national level training..." [2005, 37] and talks were held with TCBB "on the possible cooperation between the institutions and a possible delivery of a regional ToT in Pakistan" [2005, 37]

From the Philippines the Local Government Association [LGA}. According to the 2004-2005 progress report, the participant "taken measures to adopt and implement the PP Tools and training materials in Philippines.." [2005, 38]. LGA was subsequently contracted to develop “a specialised training toolkit which combined the Building Bridges Series within the context of MDGs"[2006, 31-32]. This toolkit was showcased in Korea during LOGODI workshop and "very well received" [2006, 32].

From Sri Lanka, the Sri Lanka Institute of Development Administration [SLIDA], the Sri Lanka Institute of Local Government [SLILG] and Colombo Municipality

In 2002-2003, discussions were held with the UN-HABITAT Afghanistan Training coordinator on "mutually exchanging manuals" [2003, 21]. However, no follow-up has been reported. Similarly, in Indonesia, the NGO TIFA expressed interest in adaptation/translation of Building Bridges series in 2002-2003; no follow-up has been reported. In India, discussions were held with HSMI on organisational aspects of organising ToTs on the Building Bridges manuals in 2002-2003 [Managing Conflicts and Differences and Participatory planning], but there was no follow up. BB Materials were sent to the NGO Capacity Building Initiative [CBI] in Myanmar which “now forms a substantial part of their resource centre" [2006, 31]. According the 2005-2006 progress report, preparations were "underway" to adapt three training manuals and hold a workshop to test new materials. Finally, in the Philippines, a 1-day training seminar was organised on LED for 14 cities, facilitated by the Canadian Urban Institute in connection with Habitat day celebration.

Latin AmericaUN-HABITAT "facilitated and sponsored" a trainer from Brazil, where the Brazilian Institute of Municipal Administration [IBAM} had indicated that it wanted to adapt and translate materials and looking for external funding for this purpose, to participate in a training workshop on BB organised by FPDL in Romania. As a follow-up, a joint IBAM/UN-HABITAT regional office for Latin America proposal was prepared "to seek financial resources to implement national training programmes in Brazil on local government-NGO/CBO collaboration" [2004, 30]. UN-HABITAT also facilitated participation of representative IULA office in Chile in the event held in Romania. According to the 2002-2003 progress report, the IULA office "has outlined practical and concrete measures towards replicating a similar ToT/BB in Hispanophone countries" [2003, 23].

An LED related workshop was furthermore held in Valparaiso in Chile together with EcoPlan International and with financial and planning support provided by Industry Canada through its Sustainable Cities Initiative (SCI). This event, which

41

Chapter 2: Effectiveness

took place from 29 to 31 March 2005, focused on "helping stakeholders prioritise strategic investment projects and building coherence and synergy among key actors in the region" [2005, 31]. The workshop was attended by people from Mexico, Honduras, Costa Rice, Argentina and Brazil. Its objectives were: “[1 ]To enhance the political understanding and appreciation for LED strategies and to promote political support for LED activities; [2] improve the knowledge and capacity of the participants in strategic planning, local economic development, action implementation and monitoring and evaluation; [3] Clarify next steps for potential local economic development pilot projects identified by participants. …; [4] Identify critical cross-sectoral opportunities and constraints to successful LED, including the need for inter-institutional coordination and cooperation – between local governments as well as between different levels of government”59. In its concluding remarks, the workshop report observed that “[there] is a clear demand for more and greater capacity building regarding the tool, and in particular in the decision analysis and negotiation elements of the tool to change political will. The participants felt that there is much to be gained from continuation of this process, and in particular enhancing the existing SCI network”60.

In 2004-2005, a training workshop on LED for 4 municipalities of the metropolitan area of Veracruz [Mexico] was held with EcoPlan International. As a follow-up, UN-HABITAT’s regional office "is now drafting a proposal for the Cities Alliance Programme" to expand the Veracruz pilot to more than 200 local development agencies and a "regional programme proposal to provide continuous support to municipalities in the region on LED tools, learning and knowledge management" [2005, 39]. According to an internal summary mission report, the cooperation with Veracruz “has concluded its first phase of preparing and conducting successfully the Participatory Strategic Planning workshops in Local Economic Development with the University of Veracruz”. A series of workshops has been organized with participants coming from municipalities, universities, and the private sector which have identified LED priority areas and prioritized a range of development projects. “The intention is that each project will be concluded by local multi-stakeholder working groups and presented by the Governor of the State of Veracruz to the elected mayors in September for public support and implementation”61.

In relation to the MDGs, a regional activity on "Training Needs Assessment of Local Authorities Role in implementing the MDGs” was initiated" [2006, 33] in order to identify training needs/demand "with an initial focus on local actions for the achievement of the MDGs. This was done together with UN-HABITAT’s regional bureau for Latin America, IBAM and FLACMA.

Finally, a regional training workshop cum conference on LED was held in October 2005 in Quito, Ecuador, for national municipal associations, training institutes, etc. According to the 2005-2006 progress report, participants agreed to use "LAC as a testing ground for establishing a technical facility to support LED within city development strategies.." [2006, 35].

59 Strategic Planning for Local Economic Development Capacity Building Conference and Workshop, Valparaíso and Viña del Mar, Chile, 29-31 March 2005, Final Report, page 4.60 Strategic Planning for Local Economic Development Capacity Building Conference and Workshop, Valparaíso and Viña del Mar, Chile, 29-31 March 2005, Final Report, page 9.61 Vittrup, Erik C., Summary mission report, Rio de Janeiro, 8 May 2007

42

Chapter 2: Effectiveness

Central and Eastern EuropeWith respect to the BB manuals, according to the progress reports for 2002-2003 and 2003-2004, FPDL from Romania has "successfully accomplished a series of sub-regional TOTs based on the UN-HABITAT Building Bridges manuals covering some 500 participants from NGOs, CBOs, etc.” National ToTs were held afterwards. In Lithuania, the School of Democracy and Administration has developed a Lithuanian version of the BB series in 2002-2003 and representatives from Youth NGOs were trained in pilot workshop. [Same in 2003-2004]. In Georgia, the NGO Civicus Georgia developed a Georgian version of the BB series, while in Italy the BB manuals were translated into Italian and, according to the reports, used in Veneto region. The LED series were used successfully by FPDL and Bucharest University in Horezu which supported application for EC funding and facilitated the university to link theory to practise (see also under “Impact”.

 2.3 Support to at least three training and capacity building institutions per region with the aim to involve them in capacity building activities [7.2.3]

According to the 2002-2003 and 2003-2004 progress reports, TCBB "has identified and is providing technical and financial support to a core group of institutions to strengthen their capacity to effectively meet training and capacity building needs, gaps and priority areas in their respective countries through the implementation of ToT, adaptations and other training activities" [2003, 24; 2004, 31]. According to the 2004-2005 report, this “[support] to capacity building institutions "primarily through assisting the institutions to take the lead role in national capacity building and training activities for local government and civil society" [2005, 41]. Support has been given in terms of e.g. better design of courses, adaptation of materials to national realities, integrating training materials into on-going curricular programmes, encouraging work with key demand sector players such as associations and Ministries, etc.

TCBB has worked through the networks of selected partners with a range of countries and institutions – and not directly [though staff from organisations may have participated in TCBB [co]organised [training] activities]. By 2005-2006, TCBB reported that through these networks it was working with over 60 organisations. By 2007, TCBB reported that it had expanded even further, working with over 90 institutions from across the globe since project inception62. At the same time, it is recognised that “the intensity of collaboration differs … with more stronger and sustained support to certain institutions in the different regions”63.

According to the progress reports, TCBB developed "a baseline survey questionnaire and collected base line information for about 20 .. Institutions"

62 For example, through Enda ECOPOP, there have been links with AGEDECOL in Burkina Faso, the Fonds special des équippements et d’intervention intercommuncale [FEICOM] and Centre de formation pour l’administration municipale (CEFAM) in Cameroon and the “Cabinet d’études de conseils et de réalisations” [CECOR] in Madagascar.Through FPDL, UN-HABITAT networked with inter alia Partners Polska and Foundation in support of local democracy in Poland; the Local government training institute of Latvia; the Centre for local government studies [Kleipeda, Lithuania]; the Russian Local government training centre and the Moscow public science foundation; the Local government assistance centre in Slovakia and in Civitas.63 Progress report 2006-2007, page 42.

43

Chapter 2: Effectiveness

[2003, 25] which was to be used for fine-tuning the collaboration and the type of institutional support that would be appropriate.

The core [historical] counterparts of TCBB under the project are the following – these are organisations which, in their respective regions, have played a key role in a range of project activities. Involving them has addressed one of the issues raised in the 1996 evaluation report, i.e. “the project management might well have to consider to adjust its approach and seek more involvement of the relatively mature partner institutions in the regions, which are able to adapt UNCHS’ training programmes to the relevant local/regional situation” [page 14].

In Eastern Europe, TCBB’s historical partner [relations going back to 1992] has been FPDL Staff of FPDL has been involved in a substantial number of EGMs, training of trainers events, reviews of draft training materials, etc. The author of a large number of UN-HABITAT manuals and the former head of TCBB are member of FPDL’s board. In addition to working internationally, FPDL has been working inside Romania, often using UN-HABITAT materials.

In Africa, TCBB’s main partner for several years has been Enda Tiers Monde, Senegal, which has functioned as a “hub” for working with other countries and organisations in francophone Africa [and Madagascar]. Enda was established in 1973 as NGO “Environnement, Développement et Action dans le Tiers Monde ». Its HQs are in Dakar, with several « équipes techniques » in the areas of environment, health, energy, desertification, youth and education, “urbaine”, rural development and good governance. Enda has offices in a series of developing countries in Latin America, Africa and Asia. Enda ECOPOP was established in 1990 and has a tradition of working in the urban informal sector. In the area of decentralisation and participatory governance, Enda ECOPOP implements the following programmes:: [a] « Programme régional d’Appui à la Gouvernance participative et de renforcement du Leadership Local (PAGEL)”  that is implemented in Burkina Faso, Burundi, Mali, Niger, Mauritanie, Cameroun, Madagascar, Maroc, Rwanda, Sénégal, Bénin); [b] “Projet d’Appui à la Planification Participative et au développement local durable, [c] Projet de formation aux Agendas Locaux 21, and the [d] « Projet de formation aux Droits Humains, à la Citoyenneté et à la Démocratie Locale », Enda ECOPOP has e.g. worked within the framework of UNHABITAT’s Local Agenda 21 in Senegal and on participatory budgeting for francophone Africa. Through Enda, TCBB has managed to reach amongst others the following countries and institutions:

For long, key partner in India has been the Human Settlement Management Institute [HSMI] in Delhi. HSMI is a training institution established by the Indian Government with Netherlands support. It is located within HUDCO, the major parastatal institution which provides finance for housing and urban infrastructure. HSMI aims to increase independence from HUDCO to allow operations flexibility and wants to develop a Masters level programme an urban management. HSMI provides training at national level. HUDCO has funded a series of “HUDCO Chairs” at state level administrative training institutions to provide urban sector content based focal points. HSMI became a nodal centre for UN-HABITAT training activities since 1998 It has collaborated particularly on training of trainers at a regional level and, through its HUDCO Chairs, was linked to the local translation of materials into Telegu (MCH Institute, Hyderabad) and Malayalam (KILA64, Karnataka). HSMI was involved in the organisation of ToTs in 2004 and 2006.

Along the same lines, TCBB has been working with two institutions in Egypt, i.e. the Sustainable development centre for training and capacity building or Ismailia Training Centre [ITC] and the Urban Training Institute [UTI] from Cairo. ITC is set up as an NGO with support form the Governorate and maintains relations with the Governorate Council and the University. It has had project funding related to sustainable cities and an Italian funded upgrading programme in Ismailia. The Centre organised the translation of the original LEL materials and has carried out training in Egypt and for an Arab Region audience. In the current project a ToT on Conflict Management and Local Leadership was carried out in January 2007. UTI is a semi autonomous institute established under the Housing Building and Planning Research Centre in Cairo. Its mission is to strengthen the institutional and human resource capacities of government and NGOs working on the improvement of living conditions in cities in Egypt and the Arab Region. It is self-funding and there is pressure that activities should be self

64 KILA, the Kerala Institute for Public Administration, is a Foundation supported mainly by State Government. It is free to undertake research and consultancy to generate funds but its annual calendar must be approved. . It has good, well equipped premises in a non distracting location. Staff in is Director and 4 faculty. Much work is done using outside staff. Since 1996 with the Indian constitutional amendment and decentralization has moved to large scale activities using a network of training centres. Work is driven very much by large state level programmes supporting reform. It has had funding from Swiss Government and support from Habitat that has allowed the use of LEL materials translated into Malayalam and Swiss funding has provded temporary staff support . They have run 39 batches of Training of Trainers, in each district developing 30-40 trainers – more than 900 in total. They use this extended network to be able to give large scale coverage to rural as well as urban areas.

44

Chapter 2: Effectiveness

financing. This gives a bias towards consultancy and project funded training. The Institute built up a strong group of trainers, but several of them have now been “borrowed” by the Ministry and one by UN-HABITAT itself. The main linkage with Habitat has been with the use of the Strategic Planning for Local Economic Development. An international training of trainers was held in November 2006. There is a strong link between this and a major UN-HABITAT programme to assist government in initiating integrated development planning.

A particular case is furthermore Kenya, where TCBB has developed direct working relations with the Government Training Institute [GTI] of Mombassa and ALGAK, the Association of Local Government Authorities of Kenya. In the beginning of 2007, Together with ALGAK, TCBB has prepared a US$ 75,000 proposal for the project “Preparatory phase for cities development strategy [CDS] and state of cities report [SCR] programme for Kenyan urban local authorities” for the World Bank’s Cities Alliance programme. The proposal is “the first of two stages in an overall programme to develop a State of the Cities Report and City Development Strategies for Kenya’s urban local authorities” [page 4]. The proposal is to employ two consultants to “put together a single terms of reference (ToR) which will guide the development of a proposal consisting of the key elements and objectives of the States of Cities Report, and City Development/LED Strategy, which are already outlined and discussed as stand alone products” [page4] . Through the project, it is furthermore expected to “lay the foundation for success by facilitating understanding, commitment and partnerships [and to..] to equip ALGAK and the participating local authorities with the knowledge and tools required to coordinate and manage the implementation of [a CDS/LED and SCR Programme for Kenya’s urban local authorities]” [page 6]. Other Kenyan partners include the Kenya Institute of Management [KIM] and the Kenya Institute of Administration. The proposal was approved in March 2007 and a kick-off meeting organised in the last week of May 2007.

Finally, activities have been undertaken with local training institutions through other UN-HABITAT projects and programmes. As observed in the 2003-2004 progress report, in Africa “[many] efforts are components of a larger Technical Cooperation project, based on ongoing collaboration with the Regional Office for Africa and the Arab States" [2004, 31]. A good example in this respect would be the indirect working relations with institutions and organisations in Somalia [see also … above]. Along the same lines, in Latin America, "technical and methodological support to sister UN-HABITAT global programmes' capacity building component is being provided" [2004, 32], together with some "small catalytic funds" to IULA CELCADEL.

Assessment and recommendationsAn active programme has been carried out to train trainers especially in Africa, Asia and the Arab States. The different regional and national ToT events that were organised seem have been important in introducing materials, changing orientation to training and building skills. They have also been used to promote and build support of client institutions. Though the number of trainers trained is substantial, the number of people trained per institution/country has generally been small. Ensuring a gender balance among the trainers has, for valid reasons, not been possible; about 30% of the participants in ToTs and other training events were female.

The overwhelming response from those interviewed concerning the ToTs was positive. Some respondents complained of the mix of ToT participants. This relates to some participants being selected on the basis of their being from funding or commissioning organisations or because they were considered “change agents”. The strategic selection of those attending ToTs is important for promoting wider use of materials, but may impede the focus on e.g. trainer skills. The roles of training of trainers and workshops to build support are both important but they need care when they are mixed. It is therefore recommended, if possible, to run separate sessions for training of trainers from those to build high level support, though some overlap can be desirable.

A number of potentially useful actions have been identified by participants at the end of workshops, but it will be important to try to provide more follow-up, both

45

Chapter 2: Effectiveness

in order to understand what has happened and in order to provide a stimulus to the trainees.

In the early years of the project, considerable support has been provided to the adaptation and translation of [previous versions of] UN-HABITAT training materials in e.g. Ethiopia, Cameroon, and Somalia. Many of these materials continue to be used.

Over the years, UN-HABITAT has managed to establish good relations with a limited number of key institutions such as FPDL, Enda ECOPOP, HSMI, as well as UTI and ITC. Strong relations also exist with various local government institutions and organisations in Kenya and East Africa, however maintenance of these involves considerable time input. These contacts have enhanced the roll-out and use of UN-HABITAT materials in the various regions. The projects presence in Latin America has been less strong.

Objective 3: To improve and strengthen linkages between demand and supply side players through

partnership and networkingOutput 3.1: Three regional strategy workshops implemented [7.3.1]

From 2002 to 2004, no regional workshops were organised; in 2002-2003 "because effort was concentrated on organising and holding two global expert group meetings, which in a way share some aspect of a strategy workshop" [2003, 28] in 2003-2004 because priority was given “to galvanize activities at the national level" [2004, 3565].

Capacity Building for Housing the Urban Poor - AsiaIn 2004-2005, initiatives were taken by TCCB together with the United Nations Economic and Social Commission for Asia and the Pacific [UNESCAP] and UN-HABITAT’s Shelter Branch to organise a regional “workshop for capacity building and secure tenure" [2005, 46] even though housing is not the core of the project. The 2-day Expert Group Meeting on "Capacity Building for Housing the Urban Poor" took place from 24 to 26 June 2005. The meeting attracted 20 participants from various Asian countries [Cambodia, Nepal, Mongolia, East

65 An example of such a national event is the national conference that was held in Kenya on local government capacity building which has resulted in a strategy paper [Strategy Planning Workshop for Training and Capacity Building for Local Authorities in Kenya, 9-10 December 2003, Gigiri, Nairobi].

According to the project document [page 15], the following was foreseen: “Identify demand and supply side interested parties in the different regions; organise and conduct regional strategy workshops in collaboration with global and regional partners; feed results and action plans into future programmes and initiatives; i.e. tool development, training and adaptation, direct institutional support, etc.”

46

Chapter 2: Effectiveness

Timor] that participate in the joint project “Housing the Poor in Urban Economies”. Following the meeting, UNESCAP and TCBB agreed to join forces on the development of training materials and to produce on seven issues related to low-income housing66:

“Quick Guides” that target policy makers who “need to acquire a basic knowledge of concepts and major approaches in low-income housing”67. They “will explain the key concepts and major approaches in each substantive area”, will be in English, and will be put into electronic format as part of the “online regional resource facility on housing the poor in urban economies”68.

Poster-size “At a Glance Reviews” that target “lay people, the media and politicians and primarily serve as advocacy tools”69. They will be printed in both English and the national languages of the participating countries.

“Concept Checks” that “will be designed as on-line self-administered exercises to see whether those reading the [Quick] Guides have understood the key messages”70.

A division of work has been agreed upon, whereby UNESCAP has assumed responsibility for substantive inputs and the preparation of the seven Quick Guides, website development, translation of materials and printing and UN-HABITAT for preparation of the At-a-Glance Reviews and Concept Checks as well as editing and lay-out, with inputs from TCBB and the Shelter Branch. Total costs of the undertaking, an estimated US$ 99,600, are shared between the organisations [UN-HABITAT: US$ 53,000]. The materials are planned to be ready before September 2007. This is later than originally envisaged, but by May 2007, 5 of the 7 volumes are at the final editing stage.

Urban Planning and Design A 3-day Expert Group Meeting on regional capacity building in Urban Planning and Design was held from 28-30 November 2005 in Nairobi. Participants included representatives from KU Leuven, UN-HABITAT’s Kosovo, Somalia and Local Agenda 21 Programme and others. It is understood that a series of project meetings on this topic of urban design and planning has been organised in 2006-2007 in Latin America, Africa, Asia and Europe, which have resulted in a capacity building strategy as detailed on page 48 of the 2006-2007 progress report. A draft project document for a “Regional Urban Planning & Design Programme”, has been prepared together with KU Leuven [May 2007]. The intention of the programme is to interlink a range of European training institutions and institutions, organisations and universities from Southeast Europe, East Africa, South Asia and Latin America with the primary objective of setting up “a long-term regionally based capacity building programme of urban planning and design that addresses the [urban development] issues [spatial challenges and changing development context] of each of the 4 included regions ..”71.

66 Urbanisation, urban development and housing policies [in the context of poverty and MDGs; rural-urban migration; rights based approach to housing, current and future housing needs, etc.]; approaches to low income housing [focus on those people living in slums and squatter settlements]; land for housing the urban poor [urban land management, security of land tenure]; evictions; housing finance [concepts of housing finance, community based savings and loan schemes for the urban poor]; community organisation and development; rental housing [public-private partnerships in rental housing, tenant management].67 Concept Note on Joint Training Publications on Housing the Urban Poor [Asia focus], page 168 Concept Note on Joint Training Publications on Housing the Urban Poor [Asia focus], page 169 Concept Note on Joint Training Publications on Housing the Urban Poor [Asia focus], page 270 Concept Note on Joint Training Publications on Housing the Urban Poor [Asia focus], page 271 Draft project document for a “Regional Urban Planning & Design Programme”, page 13.

47

Chapter 2: Effectiveness

Transparency in Land AdministrationAn EGM on “Transparency in Land Administration – A Capacity Building Agenda for Africa”, originally planned for late 2006, took place from 29 to 31 January 2007 in Kenya. The event was organised by UN-HABITAT and the Global Land Tool Network (GLTN), in cooperation with ITC. According to the 2006-2007 progress report, this meeting “validated the lack of … training programmes in this specific area and provided suggestions for programme content and target groups for the first training programme in Africa”72. It is foreseen that a 3-day curriculum will be developed and delivered in 2007-2008 in different African regions together with University College of Lands and Architectural Studies in Tanzania, the Polytechnic of Namibia, Enda ECOPOP and Kwame Nkrumah University of Science and Technology in Ghana.

Local Economic Development - EcuadorA regional training workshop/conference on LED was held from 4 to 6 October 2005 in Quito; "to map out the LED strategy for the LAC region" [2006, 42].

Presentation planned by a group of several organisations at a "Consultative Group Meeting of the Cities Alliance” in November 2006.

Together with the Latin American Federation of Cities, Municipalities and Associations [FLACMA], UCGL, ILO and others, a concept paper “Facility for Local Economic Development and Local Governments [FLEDGE]” was prepared for the Cities Alliance Programme. Envisaged components are the following: “[a] To establish a Regional facility for Local Economic Development and Local Governments in Latin America anchored within FLACMA, that provides support to national municipal associations and local governments through training, technical assistance, project development, brokering linkages to investors and markets, promotion of policy debate and knowledge management (tools, processes, web based resources, etc.); [b] Development of LED action-planning strategies for 10-15 cities in 3 countries to be selected through a selection from applications submitted to the Cities Alliance by National Municipal Associations and Federations and [c] Implementation of LED actions in the project cities to be funded through public-private partnerships (Private sector investors, private or public finance institutions, etc.)”. In this initiative, UN-HABITAT would be dealing with building capacity for LED Action planning and implementation and revision of regulatory instruments.

Output 3.2: Innovative demand responsive and successful experiences of anchoring institutions documented [7.3.2]

Already at an early stage of project implementation, UN-HABITAT proposed to refocus this output. According to the reports on 2002-2003 and 2003-2004, since UN-HABITAT global programmes are demanding TCBB inputs, "this particular input is being re-oriented towards TCBB’s substantive inputs to the global programmes capacity building agenda and that culminates in the development 72 Progress report 2006-2007, page 46.

According to the project document [page 15], the following was foreseen: “jointly with SCP and UMP commission case studies and organise workshop; conduct workshop; synthesise lessons of experience which transpired through the case studies; publish the result in print and electronic”.

48

Chapter 2: Effectiveness

of models and templates informed by lessons of experience" [2003, 28 and 2004, 36]. However, unfortunately a clear alternative output was apparently never formulated73.

Training impact evaluationAnother key activity undertaken under this heading concerns “training impact evaluation”. The attention for the subject goes back to the issue that “demonstrating the impact of training on organisational performance and service delivery has proven elusive” while trainers and managers “have been negligent when it comes to measuring the impact of training on performance” because of a variety of reasons [too costly, too time consuming, client not interested, etc.]. Hence, “the design of practical guidelines is critical to enable consistency in the evaluation of training’s impact, in promoting the value of training as a tool for enhancing performance and service delivery and in boosting practice in this much needed area”74.

There was a “call for proposals” on training impact evaluation, which was sent out to various institutions. The 2004-2005 progress report indicates that some 10 proposals on impact evaluation had been received. However, according to the same report, "[the] general response to the call was not as extensive as envisioned and also did not place sufficient emphasis and innovation on impact evaluation”75. TCBB subsequently decided to reformulate the strategy of the Training Impact on Performance [TIP] project and to convene a workshop on Training Impact Evaluation [TIE] to discuss common concerns regarding training impact evaluation which would lay the foundation for further development of TIE. This workshop, entitled "Making learning matter: training impact on performance" was held from 4 to 7 October 2005 in Manchester and hosted by the Institute for Development Policy and Management [IDPM] of the University of Manchester. The UK was selected because its “track record in local government performance management” while IDPM was selected, among various alternatives, because it was “most responsive to the hosting opportunity and they offered a good programme of lectures, visits and contacts with the University and local government to complement the UN-HABITAT workshop programme”.

The event was attended by “26 representatives of local government training institutions, local government associations, academic institutions and support agencies from …Afghanistan, Brazil, Canada, Cambodia, China, Ecuador, Egypt,

73 As a result, a mixture of other activities is reported under this heading. E.g. TCBB fielded staff to Bangkok to "conduct training for anchoring institutions of the Sustainable Cities Programme on Environmental Planning and Management" [2005, 47]. Training event involved several Asian partners such as AIT. "TCBB has played a lead role in the design and delivery of a week long seminar for newly appointed HABITAT programme managers in over 30 countries...The effort has brought together all programmes, campaigns and organisational units of UN-HABITAT in developing a training/information kit. The seminar was held in November 2004" [2005, 47].74 Making Learning Matter; Training Impact on Performance, workshop report, page 5. In fact, already the 1996 Evaluation report stressed: “[among] others, UNCHS should pursue its recent initiatives towards impact evaluation without any further delay, enabling project management to draw appropriate lessons for project implementation and strive for more regular interaction with the participating institutes”?. According to UN-HABITAT’s reaction on this report “[while] it is as true of ours as it is of all development projects that impact evaluation needs to be built to a greater degree into the planning process, it should be noted that we are currently in the process of developing a training impact evaluation tool to be employed in the Phase II of the Project” [page 3] and “the Training and Capacity-Building Section acknowledges that the systematic methodologies of impact evaluation of capacity building activities are still relatively little developed in all areas, not only human settlements, local government and local development” [page 5].75 Progress report 2004-2005, 2005, page 47.

49

Chapter 2: Effectiveness

India, Kenya, Kosovo, Philippines, Romania, Senegal, South Africa, The Netherlands, United Kingdom and Zimbabwe” 76.

The main objectives of the workshop were: “[a] to share experiences in what works and what does not work regarding impact evaluation of large government training programmes; [b] to review methods and tools to evaluate training’s impact on trainee, organisation and human settlements development outcomes; [c] to reach an agreement on a strategy to enhance practice in local government’s training impact evaluation”77.

In concluding, participants agreed to pursue different strategies as follow-up to the workshop, in particular “[the] creation of an interest group in which to brainstorm ideas on TIP, share experiences and outline follow-up plans… This interest group … in the first stages, would take the form of an e-mail discussion list…[While it] was agreed that participants would work and reflect on the question of development and testing within the work programme of their respective organisations [which would need] additional collaboration with colleagues and senior officials within the different organisations”78.

A cooperation agreement was concluded with the Development Planning Unit [DPU] of the University College of London. UN-HABITAT’s motivation was that DPU had a long track record of working with UN-HABITAT issues and partners. According to the Terms of Reference of the agreement [which has a value of US$ 54,750], envisaged outputs were the following: “[1] design and facilitation of an e-forum… [2] synthesis of experiences [including definitions, methodologies and tools] on training impact evaluation…[3] a framework and guidelines to enhance the practice of TIE [including operational definitions, methodologies and tool testing strategies] amongst human settlements training and capacity building institutions [e.g. local government training institutions, local government associations, NGOs, academic institutions, regional organisations, etc.]; [4] methodological input to and facilitation of feedback …of a TIE application of the National Programme for Councillors Training, assigned by the Government of Tanzania”79.

In line with this, TCBB introduced an Internet discussion forum on its website with the aim “[1] to systematically synthesize experiences on training impact evaluation, and [2] collaboratively gain skills and develop guidelines to enhance the participating organisations’ practice of training impact evaluation”80. TCBB’s Web-page also included a presentation of DPU’s approach to impact evaluation, which distinguishes four “spheres” in its so-called “web of institutionalisation” and thirteen elements, “each of which is regarded as a critical power in the process of change in the

76 Making Learning Matter; Training Impact on Performance, workshop report, page 477 Making Learning Matter; Training Impact on Performance, workshop report, page 5. Organisations represented were UN-HABITAT, Kerala Institute of Local Administration, CLGF, UNESCO-IHE, Leadership for Environment And Development [LEAD], Association for Development and Environment [ADE], UTI, IDPM, GTI, Women & Sustainability Network, SDS, IDASA, Latin American Federation of Cities, Municipalities and Association [FLACMA], FPDL, LGA, Rabia-e-Balkhi Advocacy and Skill Building, Enda-ecopop, MDP-ESA, Netherlands Ministry of Foreign Affairs, Administrative Centre for China’s Agenda 21. 78 Making Learning Matter; Training Impact on Performance, workshop report, page 22.79 Terms of Reference, page 3-480 Briefing Note Making Learning Matter, March 2007, page 1.

50

Chapter 2: Effectiveness

interactions between all stakeholders involved in capacity building in a given context”81. In addition, it provided a series of key questions or each of these spheres, “to get the discussion going and steer it in the right direction”. Unfortunately, use of the discussion forum has been rather limited, with several comments on the site barely touching the subject, partly because of what are referred to as “technical reasons” related to problems of access to the site82. Moreover, according to UN-HABITAT, “partners echoed that ongoing programmes limited the time they could allocate to this initiative they volunteered for” [this was e.g. the case with FPDL].

TCBB furthermore initiated the application of the “Web of institutionalisation” in Tanzania; see the report prepared by Emmanuel Mugalaasi Ssewankambo, Elijah Agevi and Deborah Mkemwa “Training Impact Evaluation of the Tanzania National Programme for Councillors Training” of May 2006. The evaluators were trained in the methodology. Based on this exercise, a document, “Applying the “web of institutionalisation” for training impact evaluation – case study of the Tanzania National Programme for Councillors Training” appeared in November 2006 as a joint production of the original authors, UN-HABITAT and DPU staff. Based on the latter document, a “Case Study Prepared for the Training Impact Evaluation E-Forum, Training and Capacity Building Branch (TCBB), UN-HABITAT, 2007 - Case Study Application of the Web to the TIE for the Tanzania Training Programme for Councillors Training” was forwarded to the evaluators on 15 May 2007. From the meetings in Nairobi it is understood that TCBB will seek opportunities to further test the TIE methodology through UN-HABITAT technical cooperation projects and that an application in Pakistan is foreseen for 2007/08.

At the time of the last mission to Nairobi, the outputs mentioned in the Cooperation Agreement had still not been realised, despite the fact that the lifetime of the Agreement [March-October 2006] has been extended twice to 31 May 2007. Two major outputs have not been realised to date, i.e. the “synthesis of experiences [including definitions, methodologies and tools] on training impact evaluation” and “the framework and guidelines to enhance the practice of TIE … amongst human settlements training and capacity building institutions” mentioned above.

Output 3.3: Directory of relevant training and capacity building institutions, UMP and SCP anchoring institutions and senior trainers and resource persons prepared and put on the Internet [7.3.3]

Setting up the directory has been a time-consuming undertaking, one reason being that rather "than contributing to this fragmentation, TCBB sought to create an integrated database…" [2005, 48] which would meet the needs of all UN-HABITAT programmes and provide TCBB with “access to key anchor institutions belonging to other programmes in order to capitalise upon potential

81 Briefing Note Making Learning Matter, March 2007, page 2.82 Problems of access were also highlighted in telephone conversations that were held with TCBB staff, with 9 out of 22 interviewees reporting “problematic access to the e-forum” .

The project document [page 15] mentions the following activities: “templates for database designed, reviewed and finalised with inputs from SCP and UMP; data and information collected and entered; database tested and finalised and put on the web; procedure and mechanism for updating put in place”.

51

Chapter 2: Effectiveness

synergies" [2005, 48], not simply those of TCBB. Compiling data started in 2002, when also talks were held with UN-HABITAT's Partners and Youth section on exchanging info on partner organisations, and continued well into 2003. In 2003-2004, TCBB recruited a consultant who, by the end of the reporting period, was “in the final stages of launching an Internet based solution for UN-HABITAT wide capacity building partner institutions in order to improve overall coordination with other programmes”[2004, 36].

Presently, TCBB has access to “a database that is integrated to the UN-HABITAT database"[2006, 44]. The partners list can be found at UN-HABITAT’s website [www.UN-HABITAT.org; programmes > strengthening training institutions> partners]. The partner profiling exercise is still on-going. An earlier institutional mapping exercise was expanded through the development of a database on training institutions, which includes the following information: factual information on each organization (size, mission and activities), “the nature of the relationship with TCBB, and comments on strengths and challenges”. This database will give a more in depth understanding of the current TCBB partner institutions. This work is to be finalized before the end of the project, with the intention to understanding the needs of the institutions and developing concrete criteria to guide institutional development support in the future. TCBB is responsible for updating the profiles of its own partner database.

Output 3.4: Habitat capacity building newsletter [print and electronic] launches to supplement systematic inputs into the existing newsletters and occasional circulation of key materials to relevant partners [7.3.4]

No special capacity building News Letters were produced until July 2005. Until then, TCBB regularly contributed articles to UN-HABITAT's overall electronic newsletter “Habitat in Action”. According to the progress report on 2003-2004, TCBB had “decided to provide regular editorial and content support to the UN-HABITAT DEBATE as a means of strengthening the overall corporate image, rather than have a stand alone product" [2004, 37].

Only in 2004-2005, was a decision made to follow the example of other branches that had "developed their first issues of a new generation of newsletters" - Global Campaign on Urban Governance, Urban Environment Section and Safer Cities Programme” and to issue two newsletters per year. The first newsletter, approved by UN-HABITAT Publications Board and available in English, French and Spanish, was produced in July 200583, the second in February 200684, and

83 Introducing the new LEL series, the LED series, and provides information on events held in Korea, Romania and India, upcoming training events and introducing the Local Government Academy of the Philippines.84 Providing information on the training impact evaluation that was held in Manchester in October 2005, the EGM of November 2005 on participatory budgeting, the ToT event on Building Bridges of June 2005, the negotiations with UNESCAP on housing for the urban poor, upcoming events and gives information on Enda Tiers Monde in Senegal.

The project document [page 16] mentions the following activities: “Content, template, style, frequency and audience designed and determined; mechanism for timely production and quality control put in place”.

52

Chapter 2: Effectiveness

the third in September 200685. A first newsletter for 2007 was foreseen for April; however, it was not yet featured on UN-HABITAT’s website.

A dissemination strategy has been developed for hard and electronic copies and e-mailing [with some 66 email addresses] and print [with some 250 addresses] mailing lists have been established. The lists include partners institutions, UN-HABITAT regional offices and individuals. The newsletter can be downloaded from UN-HABITAT’s website.

Output 3.5: A two-tier network of UN-HABITAT and partner institutions and centres of excellence in training and capacity building, including anchoring institutions of UMP and SCP established [7.3.5]

In May 2002, TCBB organised a Training Needs Assessment workshop [for more than 40 participants] "to identify key capacity building needs that pose obstacles to better housing and neighbourhoods" [2003, 30] followed by two networking events ‘Global Networks for Local Government Capacity Building" and "Local Economic Development" in 2004/2005.

During the TCBB staff retreat of January 2006, "the institutional strengthening role was discussed. It was agreed that an institutional mapping exercise be undertaken to understand the levels of strengths and weaknesses of those institutions that TCBB currently partners with” [2006; 45]. A preliminary exercise was done in 2006. However, according to the 2005/2006 progress report “this work is still in progress .. to understand the needs of the institutions and developing concrete criteria that should guide the emphasis and partnership for international development in the remaining project period" [2006, 45].

According to the 2006-2007 progress report, “[during] the TCBB staff retreat held in December 2006, the institutional strengthening achievements of the project were discussed. It was agreed that this component should be reviewed and that more in-depth work with national institutions on methodological and organisational development issues .. could become central pieces of future work”86. The report also refers to a series of “networking events” that took place during the WUF in Vancouver and a series of training activities that were held at the same event in collaboration with UNDP World Campus.

The LOGOTRI network has been supported with modest co-funding of events and sponsorship of a business plan that was used as the basis of the last AGM attended in Seoul, Korea. LOGOTRI is a valuable network of training institutions in Asia/ Pacific. Core funding was by UN-ESCAP, but this has now ended and the future organisation is being re-appraised.

85 With information on the attention for capacity building at the WUF of June 2006, regional training on promotion of local economic development as well as activities in the Pacific, Eastern and Southern Africa and a profile on IDASA in South Africa. 86 Progress report 2006-2007, page 54.

The project document [page 16] mentions the following activities: “the network concept, purpose and mechanisms developed; relevant centres of excellence, including UMP and SCP anchoring institutions, identified and approached; concept further refined based on feedback and inputs of potential partners in the network; the network established and operationalised”.

53

Chapter 2: Effectiveness

According to UN-HABITAT, contacts with a range of international [training and capacity building] organizations have been strengthened in a variety of ways and on various topics. All in all, “[these] strengthened relationships are geared towards enhanced collaboration, synergy and coherence of the global capacity building agenda and efforts in the field of human settlements and local governance” though the type of relationship varies from e.g. joint work on localizing the MDGs with the United Nations Institute for Training and Research (UNITAR), exchanges of tools and discussions on a capacity building programme for supporting City Development Strategies (CDS) with the World Bank, participation of staff of inter alia ITC, IHS and UNESCO-IHE in TCBB co-organized events [EGM, workshop on TIE] to exchanges on the introduction of the concept of UN-HABITAT partner universities with various European universities and the work on LEL in the South Pacific with CLGF.

Other networking and collaborationIn order to realise better cooperation, increasingly regular inter-branch meetings have been organised with other UN-HABITAT departments “to identify opportunities for increased coordination and synergy" [2004, 36]. Discussions with representatives of other departments and branches have confirmed this change and have applauded the increased preparedness to collaborate. Several examples [e.g. land, Somalia….] testify to increased cooperation with TCBB. Question remains, to what extent specific project funding should serve such internal collaboration and whether this should not be part of TCBB’s regular mandate and financed from UN-HABITAT’s core budget.

At the same time, collaboration with other UN agencies appears to have intensified, in particular with ILO…Together with UNDP and ILO Turin, an inter-regional workshop on “Public Private Partnership for Urban Poverty Reduction” was held in Turin (Italy) from 10 to 14 July 2006 which was co-financed by the Italian Ministry of Foreign Affairs, UN-HABITAT, UNDP and ILO87. Fourteen people participated in this workshop88 which “focused on partnership approaches applied at municipal level for improving the life of slum dwellers and other urban poor. It dealt with the differences and commonalities of the various approaches, and looked at some critical issues for establishing effective and sustainable partnerships. It allowed a rich exchange of experiences and produced ideas for future initiatives to the benefit of all urban residents”89. One of the workshop sessions dealt with PPP and local governance reviewing “the specific interests and the roles and responsibilities of the actors concerned, insisting on the complexities and difficulties of negotiating deals between multiple parties with each having different objectives”90. Another topic was Learning and Knowledge Sharing, addressing the question of “how to jointly improve effectiveness and achieve much larger outreach, considering that most agencies have developed pertinent working tools, practices, data bases and learning programmes. Existing networking and knowledge sharing opportunities

87 Its objectives were to: a. Increase mutual understanding of pro-poor public-private partnership; b. Discuss the benefits of and constraints on working in partnership to reach the poor; c. Share the experiences of different agencies and programmes which are promoting PPP in the urban setting; d. Learn from successful practices; e. Identify opportunities for networking and collaboration among the represented institutions and programmes” [Workshop report, page 5].88 Including representatives from Burundi, Lebanon, Lesotho, Nepal, Somalia, South Africa, Tanzania, Vietnam, and Zambia, as well staff from UN-HABITAT, the UNDP/PPPUE? Programme; and EMP/INVEST [ILO programme Employment Intensive Investment Programme] .89 Report on workshop Public Private Partnership for Urban Poverty Reduction, page 4.90 Report on workshop Public Private Partnership for Urban Poverty Reduction, page 6.

54

Chapter 2: Effectiveness

were presented .. and the possibilities to institutionalise capacity building programmes among local Government organizations and training providers were discussed”91. Cooperation with ILO was also important in Egypt in the area of LED. The cooperation was described as being very positive with each agency able to build on its own strengths in a complementary manner.

Assessment and recommendationsThe mission underscores the importance attached to training impact evaluation and is disappointed that DPU has not been able to deliver as originally agreed. TCBB should closely monitor finalisation of the current agreement. As regards DPU’s performance, rather than starting with what is there now in terms of experiences, approaches, etc. on TIE as per the Terms of Reference, DPU seems to have opted for a “top-down approach” [and was allowed to do so], introducing its web of institutionalisation without much consideration of the situation in many of TCBB’s partner organisations. The mission would like to underscore in this respect that, with few exceptions, the training institutions, both public and private, that are currently working with TCBB are small to very small, are frequently under-funded and often work with non-permanent trainers from outside. Several organisations are making attempts to get some feedback on the impact of their training efforts but few means, human and financial, are available for doing so. It is unrealistic to expect that they can introduce the approach that is advocated in the various documents – certainly if this is not accompanied by substantial training92. The complexity of the presentations in English is furthermore unlikely to create much understanding in the non-Anglophone UN-HABITAT member states.

A much more practical approach is recommended to TIE, which could proceed at two levels. The first should be a very simple and practical tool based on existing experiences, however rudimentary these may be, avoiding too much complexity in the beginning, focusing on concrete, and relatively easy to take steps that organisations can take in starting to build up their TIE capacity93. The second line would be to continue discussions on a more sophisticated approach, but to link this to Universities and situations where greater capacity and funding are available. Account needs to be taken in this respect of the following more technical observations if TCBB wishes to pursue the web of institutionalisation approach:

How to relate the web of institutionalisation approach to the logical

framework/project cycle management approach, that is currently “en vogue” and the evaluation methodology that is related to this approach, is not evident. How for example the web of institutionalisation approach can be used to respond to questions concerning relevance, effectiveness, efficiency, impact and sustainability, to name a few buzz words in evaluation terms of reference, is not evident and will need further explanation. Implications of using the web for reporting are not evident either.

91 Report on workshop Public Private Partnership for Urban Poverty Reduction, page 8.92 Hesitations are also clear from the TCCB telephone interviews held on the approach. While some interviewees considered the web of institutionalization a “valuable holistic methodology”, most apparently still have to make up their minds on their assessment. The same is true for the potential use of the web based framework in the interviewees’ own training and impact evaluation. 93 This is also recognised in the report on 2006-2007: “However, recognising that tracking impact of training is complex and time consuming, these guidelines need to be further clarified and simplified if they are to serve as a practical tool within reach of the majority of our partner training institutions” [page 59].

55

Chapter 2: Effectiveness

Moreover, if the log frame approach were to be applied to training [impact] evaluation it is very likely that many of the “elements” of the web of institutionalisation approach would be addressed as well.

The division in “spheres” and “elements” does not really help in grasping – in the end – the impact of the training provision. The Case Study of May 2007 for example provides under each element, one or more “impact indicators”, with some of the proposed indicators [e.g. “Impact of the training of councillors’ working practices” or “Evidence of methods for systematic monitoring of how the councillors are using the acquired skills and knowledge to impact on the performance of the LGAs and human settlements.”] not being very operational – and not particularly “SMART”.

It is not clear how useful the work on the directory has been. There appears to be only limited information on the institutions available on the UN-HABITAT’s website. The work being done on institutional assessment is important for guiding the work of UN-HABITAT, but it includes information that is rather sensitive to share.. The recommendation would be to try to make the information as simple as possible and to consider whether institutions could directly upload information with clear understanding that the material is hosted, but not approved by UN-HABITAT.

The newsletters are attractive and well produced and form a useful source of updating on the work of TCBB. It is an initiative which should be continued together with an integrated approach related to UN-HABITAT’s main publications.

Over the years, relations have been established with close to a 100 partner institutions and organizations. However, the levels of involvement have been highly variable but are mainly through ToTs and annual meetings. From the interviews held, some useful networking appeared to be taking place in Eastern Europe, mainly with NGOs, while in India; the network links to “HUDCO Chair” institutes appears to be useful. Similarly, links with the LOGOTRI network of Asia-Pacific local government training institutions appears promising as a means of widening networks and facilitating access to information. The modest support (some co-funding of workshops and funding of a business plan) have been appreciated and are seen to be useful contributions. LOGOTRI is in a process of reviewing of its status, using the business plan funded by the project, having lost its original core funding. Its potential suggests that the connection should be maintained.

Broadly, there are contacts within the network, but exactly what it entails and what the roles and responsibilities of the different tiers are, does not appear to be apparent to the institutions who were interviewed. This is an area that requires further thinking together with the strategy of how best to operate at a global level.

The strengthening of institutions, though the core of the project, judging by its title, has been a difficult area to influence. Apart from ToTs, provision and adaptation and translation of manuals, little has been done in terms of other institutional support [institutional management, marketing, etc.]. Several issues come up in this respect. First of all, most training institutions for the urban sector are governmental, and in many countries this means relatively low salaries, bureaucratic decision making systems and weaknesses in sustainable

56

Chapter 2: Effectiveness

staffing and institutional memory. When governmental organizations move towards the market, there is a danger that they cannot afford to carry out training (e.g. UTI, Cairo is facing this type of dilemma, and LED training is not at present on the regular course agenda). The other form of organization in the network is the NGOs. These are flexible and easy to work with, but are also small and have limited institutional sustainability.

Collaboration with UNESCAP progressed rather slowly, though now the “quick guides” on housing are nearing completion. These appear promising and it is useful to aim materials at decision makers. The drafts are so far rather repetitive and require more up to date references. This should improve with the final editing. The initiative on land administration looks promising – and is also one of the few occasions that an institution from the Netherlands actively participates. The situation with respect to FLEDGE in Latin America is unclear.

The mission underscores the importance of stepping up collaboration with other UN-HABITAT departments and divisions and appreciates the efforts in doing so. Similarly, the steps made to reinforce relations with other members of the UN family are applauded.

57

Chapter 3: Efficiency

Chapter 3 EfficiencyThis chapter looks at the efficiency with which the project has been implemented, with particular focus on the use of project funds. It is based on financial data provided by UN-HABITAT during the first mission to Nairobi and additional data furnished in early April 2007. As far as efficiency is concerned, the evaluation has particularly used issues of finance, UN-HABITAT’s contribution to the project, financial and project management and reporting, as well as procedural issues.

3.1 Finances general

Over the last five years, TCBB’s operational project portfolio was financed by three sources: the Dutch project with a budget of US$ 3,472,000, the Open Society Institute [OSI], contributing US$ 98,000 and a contribution of US$ 1,180,000 from the Province of Gangwon, Korea, to support them with setting

up an International Urban Training Centre (IUTC)94. Overall, the share of the Dutch project of this total project port folio is some 92% over the period 2002-2007. The importance of the project is shown in the following graph.

Financial reports presented to the Netherlands Ministry of Foreign Affairs are, at the Ministry’s request, related to the different types of activities. This

presentation differs from UN-HABITAT’s regular financial reporting and the categories of expenditure used in this reporting.

3.2 Dutch project funding and expenditures

Over the years, the Netherlands have been an important donor to UN-HABITAT, featuring among the organisation’s top three donors since 2000; its share of the organisation’s budget ranged between 8 and 19%. An overview of Netherlands’ earmarked and non-earmarked contributions over the project’s lifetime is provided in the table below. The project features among the earmarked contributions.

2002 2003 2004 2005 2006

Non-earmarked 454.2341.421.8

411.490.8

301.310.43

01.376.87

0EarmarkedCapacity building and technical support for Urban Planning and Management in Kosovo 1.079.251 793.716Crime prevention strategies at the city level; Safer Cities for Better Governance 289.224 358.269 310.017

Governance and Development Planning Programme, Kosovo 674.9991.324.48

41.033.99

2Training and Capacity Building Component of Water for African Cities Programme 997.983 283.065JPOs 294.692 34.000

94 The support mainly includes the development of a business plan, curriculum development, regional networking and the organization of training courses. The cooperation agreement was signed in December 2006; activities started in January 2007. There is no direct link with the Dutch project, except for the fact that TCBB materials will be used and referenced in the IUTC course curricula.

0100.000200.000300.000400.000500.000600.000700.000800.000900.000

Amount in US$

2002 2003 2004 2005 2006 2007

Year

TCBB portfolio funding by donor

Korea

OSI

Project

58

Chapter 3: Efficiency

2002 2003 2004 2005 2006Safer City Durban 22.364Preparations for First World Urban Forum 90.000 10.000

Sustainable Cities Programme II 1.600.0001.576.83

51.981.31

6 1.736.762

Partnership Programme4.020.38

9 880.319Lake Victoria Region Water and Sanitation under the Water and Sanitation Trust Fund

1.700.000

5.170.000 5.709.992

Water and Sanitation Trust Fund3.300.00

0 3.271.500Strengthening National Training Capabilities for Better Governance 576.411 500.000 750.000 750.000 800.000

4.949.925

6.674.438

6.541.655

12.235.308

11.518.254

Total5.404.15

98.096.2

798.032.4

8513.545.7

3812.895.1

24

Project funding accounted for between 6.1% [2005] and 11.6% [2002] of the total earmarked contribution.

Receipt of project funding totals US$ 3,376,411 thus leaving a balance of US$ 95,589. Receipt of project funding has been as follows over the period 2002-2006: 18 June 2002: US$ 350.000; 8 November 2002: US$ 226.411; 29 October 2002: US$ 500.000; 25 November 2004: US$ 500.000; 24 December 2004: US$ 250.000; 28 November 2005: US$ 750.000; 5 July 2006: US$ 400.000 and 29 November 2006: US$ 400.000.

The following table provides a summary of the composition of the original project budget and expenditures incurred per budget category

BudgetActual 2002

Actual 2003

Actual 2004

Actual 2005

Actual 2006 Total

Tools [manuals]Expertise 333.400 24.330 30.182 33.683 67.295 70.457 225.947Workshop and field test 143.500 13.559 6.639 11.078 7.375 35.809 74.460

Design, layout and printing 261.000205.36

2 -38.520 38.520 205.362Support in distance learning tool development 159.400 11.533 23.188 28.103 58.135 32.037 152.996

Sub-total 897.300 49.422265.3

71 72.864 94.285 176.823 658.765

ToT, adaptation and institutional support to TCB Institutions

ToTs and adaptations [30] 1.356.550 69.762139.00

8 74.164 326.120 441.5171.050.57

1Direct institutional support for downstream activities [12 inst.] 239.500 5.100 27.102 29.006 50.872 45.177 157.257Mission costs 157.400 24.376 23.188 48.819 57.947 32.037 186.367Logistical support 8.066 2.163 9.226 7.798 4.498 6.359 30.044

Sub-total 1.761.516101.40

1198.5

24 159.787 439.437 525.0901.424.2

39

Demand-supply linkagesRegional strategy workshops [4] 184.500 12.953 10.274 158.203 84.964 70.244 336.638Synthesis of innovative demand responsive case studies 0Directory and data base 0Newsletter [8] 26.500 12.259 16.003 19.213 11.421 4.710 63.606Network of UNHABITAT and centres of excellence 47.750 2.550 11.718 11.583 16.790 17.392 60.033

Sub-total 258.750 27.76237.99

5 188.999 113.175 92.346 460.277

Programme supportProgramme management assistant [48 pm] 80.000 1.347 51.693 67.190 120.230Evaluation and documentation of lessons 3.000 0UNV associate programme officer [36 pm] 72.000 60.000 846 60.846Sub-total 155.000 0 0 61.347 52.539 67.190 181.076

Total 3.072.566178.58

5501.8

90 482.997 699.436 861.4492.724.3

57Overhead 399.434 23.216 65.246 62.790 90.927 111.988 354.167

Total 3.472.000201.80

1567.1

36 545.787 790.363 973.4373.078.5

24

A comparison of the shares of the different components in the budget and actual expenditures is provided in the following two graphs.

Division of budget

25,8%

50,7%

7,5%

4,5%11,5%

Tools

ToT, adaptation,etc

Demand supply linkagesProgramme support

Overhead

Expenditures

24,2%

52,3%

16,9%

6,6%13,0%

Tools

ToT, adaptation,etc

Demand supply linkages

Programme support

Overhead 59

Chapter 3: Efficiency

The available data indicate that by April 2007 there has been over-expenditure, to a varying degree, on the following main budget elements [and for the reasons indicated below as per Mr Antoin King’s letter of 4 September 2006 responding to Mr Tempelman’s letter of 9 August 2006 [ref. DCO/OO-229/06]]:

Budget component Reasons for over-expenditure

Mission costs

“Initially, international consultants who received a contract with all the costs reflected within. More and more we are using TCBB staff and/or hire national consultants to ensure sustainability in our efforts and therefore have to absorb the mission costs directly in the project, increasing this particular budget item. This results in an increase of a mission costs and a decrease in expenditure on international consultants”95

Logistical support

“We have organised several Kenya based activities handled directly by TCBB as opposed to a partner institution.. This had led to over expenditure in logistical support and lower expenditure under ToTs” [so far, there have been 11 activities in Kenya from 2002 to 2006, whereby the logistical support is disconnected from the grant agreements].

Regional strategy workshops

There have been 8 rather than 4 workshops as originally foreseen. These workshops were necessary and “possible because of savings on the budget line “ToTs and adaptations”, which were made possible due to cost-sharing contributions.

Newsletter Three rather than one language versions were developed.

Programme management assistant

“UN-HABITAT agreed in 2004 to absorb the cost of the Programme Management Assistant…which allowed us to engage another human settlements officer” which involved “higher costs than anticipated”].

At the same time, the data indicate that under-expenditure, which is unlikely to be recuperated before the end of the project, has occurred in the following specific budget elements [and for the reasons indicated below]:

Budget component Reasons for under-expenditure

ExpertiseThe increase in mission costs mentioned above is directly related to the decrease in the use of funds for international consultants.

Workshop and field test

Expenditures are less than foreseen since expenditure for workshops and field testing are also included under other categories such as mission costs, regional strategy workshops, and tools.

Design, layout and printing

In some cases UN-HABITAT subcontracted institutions to write publications and do the design and layout. This again would reflect a lower “design, layout and printing” cost as this expenditure would show under another budget category.

ToTs and adaptationsSavings on the budget line “TOTs and adaptations” were made possible due to cost-sharing contributions of partners.

Direct institutional support

There was less than anticipated expenditure on direct” institutional support since such support was mainly channelled in a “learning by doing” fashion, through collaboration on tool adaptation and ToTs.

When using UN-HABITAT’s accounting methodology, based on revision K of the project budget that was signed in March 2007, the following financial data become apparent:

95 This argument does not appear entirely correct as only very few national consultants were indeed employed under the project.

60

Chapter 3: Efficiency

Per category of expenditure, the original budget and expenditures up to the end of 2005 were as follows96:

Expenditures

Category Budget ShareExpenditures 2002-2005

Share Semi actual expenditure in 2006

Budget 2007

Project personnel 919,53326.5%

457.288 21.7%293.036 169.210

Sub-contracting 890,39725.6%

456.496 21.7%354.440 79.461

Training 1,108,85631.9%

815.349 38.7%202.968 90.538

Equipment 70,408 2.0% 62.713 3.0% 4.696 3.000Miscellaneous 83,373 2.4% 71.065 3.4% 6.308 6.000

13% 399,43411.5%

242.179 11.5%111.988 45.267

Total 3,472,001 2.105.090 973.436 393.476

It is understood that tallying UN-HABITAT’s regular financial reporting with the reporting requirements of the Netherlands Ministry of Foreign Affairs has not always been easy and, at times, somewhat arbitrary as to under which component certain costs should be accounted for. It is furthermore understood that the equipment component referred to above served TCBB staff – and not the institutions with which UN-HABITAT has worked. This equipment was purchased outside the 13% overhead.

3.3 The issue of under-expenditure

Under expenditure of available resources has been a key feature of the project, especially in the period 2002-2004. This issue was also recognised in Mr Antoin King’s letter to the Netherlands Ministry of Foreign Affairs of 24 November 2004: “we acknowledge this and admit that our planning was perhaps a little over-optimistic, exacerbated by staff shortage following the departure of one staff member on retirement… and a temporary assignment of one professional staff on the preparation of the World Urban Forum 2004 …Additional focus …on results and impact [has] meant more time and effort on planning activities and engaging partner. Finally, we have also been successful in leveraging additional funds for the programme .. and parallel support … resulting in substantive delivery of outputs which are necessarily and fully mirrored in project financial expenditure”.

Further explanation for this phenomenon was given in the “Justification Note”, attached to Mr Antoine King’s letter of 3 November 2005 to the Netherlands Permanent Representative to UN-HABITAT with which an extension of the project’s lifetime with 18 months was requested. This budget neutral extension was approved on 14 December 2005 [ref. DCO/OO-344/05], stretching the project’s lifetime to 30 September 2007. According to the Note, “the discrepancy between planned and actual delivery is not caused by any structural problem but by [a] the consequences of staffing constraints during the first years of the project; and by [b] a cautious approach to expenditure with the view to maximize the project’s impact”[page 1]. Staff wise, the Note refers to a considerable increase in the number of staff in the course of 2005; in terms of impact, it refers to [a] increasing demands for TCBB services from other UN-

96 Project personnel includes the costs of international consultants, project personnel, UN Volunteer, staff travel and national consultants; Sub-contracting includes the budgets for sub-contracts and grants; The training budget includes the costs of training, newsletters and printing of training tools; While equipment includes costs of expendable and non-expendable equipment and stationary and miscellaneous mainly refers to miscellaneous and telephone costs.

61

Chapter 3: Efficiency

HABITAT branches and regional offices, “underscoring the value of the products developed by the project” [page 1]; [b] the time that is needed for building up “strong partnerships with good leveraging ratio” and for ensuring product quality and “hence the potential impact” of the UN-HABITAT tools. The Note concludes with observing that “[while] the delivery capacity of TCBB has significantly increased, the concern for maximisation of the project impact justifies maintaining the enhanced project delivery rate for the remaining part of the project outputs. This implies that an additional 18 months will be required to fully achieve the project objectives” [page 2].

3.4 TCBB contribution

According to the project document, an in-kind counterpart contribution of some US$ 200,000 per annum was envisaged. As is evident from the data below, this proved to be a conservative estimate. The average staff costs equalled some US$ 705,610 per year over the period 2002-2006 [calculated at 75% of total staff costs, based on estimated 75% of time devoted to the Dutch project]. Total staff costs, including the costs of a Belgian JPO at TCBB, were an estimated US$ 3,528,050 up to the end of 2006.

2002 2003 2004 2005 2006 Total

Staff core funded 595.675 662.275 559.600 763.050 836.4503.417.050

JPO [Belgian funded] 0 0 0 0 111.000 111.000

Total595.675 662.275 559.600 763.050 947.450

3.528.050

3.5 Procedures and auditing

When employing outside consultants, both individual consultants and consultancy firms, procedures of the United Nations Office in Nairobi [UNON] were followed. According to these procedures, both technical [i.e. quality of the proposal and/or proposed consultant] and financial aspects were considered. UNON procedures were also used for the procurement of services for printing of LEL and LED materials. For UN-HABITAT as a whole, audit reports have been prepared97.

3.6 Project management

As regards project management, the mission observes:

Timely submission of progress reports [within 1-2 months after the reporting period concerned] Timely submission of financial reports [within 1-2 months after the reporting period concerned]

The mission did not observe the problems that were experienced with respect to the project’s predecessors98. The file of correspondence between UN-HABITAT

97 According to the Financial report and audited financial statements for the biennium that ended 31 December 2005 and Report of the Board of Auditors of 2006, the Audit Opinion of 28 July 2006 reads as: “In our opinion, the financial statements present fairly, in all material respects, the financial position of the United Nations Human Settlements Programme as at 31 December 2005 and the results of its operations and its cash flows for the biennium then ended, in accordance with the United Nations system accounting standards. Furthermore, in our opinion, the transactions of the United Nations Human Settlements Programme that have come to our notice or which we have tested as part of our audit have in all significant respects been in accordance with the Financial Regulations of the United Nations and legislative authority’ [page 34].98 See e.g. the External Evaluation Report May/June 1996: “.. that both projects suffered from lengthy and repeated delays in obtaining project clearance from the Netherlands authorities as well as a very slow transfer of project monies..” [page 9].

62

Chapter 3: Efficiency

and the Netherlands Ministry of Foreign Affairs, represented by the Cultural Cooperation, Education and Research Department [DCO/OO] is exceptionally thin. Exchanges between the two institutions have to a large extend been limited to correspondence on [a] the approval of the project; [b] financial issues; and [c] the extension of the project’s lifetime.

UN-HABITAT considers management at the Ministry side flexible and understanding.. It is however not clear whether information on the project [and its outputs in terms of manuals, etc.] is circulated within the Ministry. From the Ministry side, there is appreciation for the way in which UN-HABITAT has run the project; the exception has been the management of the financial side of the project with too optimistic forecasting of expenditures by UN-HABITAT99.

Particularly in the early years of the project there was also the issue of financial reporting format, with the Ministry asking for a format and report timing that differ from the regular UN-HABITAT format and reporting cycle [“the calendar year, as followed by UN-HABITAT and not the project cycle which is April-March”, letter Antoine King to Messrs Bierma and Tempelman of the Netherlands Ministry of Foreign Affairs of 3 December 2004]. In 2003, this resulted in a request to UN-HABITAT to resubmit the financial report [letter Mr Tempelman of 12 September 2003, ref. DCO/OO-243/03]. This was done on 1 October 2003.

The issue of reporting format surfaced also in 2006 in relation to observed over-expenditure on certain budget lines. According to Mr King’s letter to Mr Tempelman of the Ministry of Foreign Affairs of 4 September 2006: “[since] the inception of the project there have been discussions regarding the challenges we face in translating our standard UN account codes into the requested accounting system [based on project outputs]. It has been our experience that for particular expenditures there can sometimes be two or more categories in which to record it, which makes the translation from one format to the other rather complex”.

Assessment and RecommendationsFunds appear to have been properly spent. Underspending early in the project has be compenstated in later stages. UN-HABITAT’s own input has exceded the original assumption.

Overall project management has been handled well by TCBB – this is also confirmed in talks at the Netherlands Ministry of Foreign Affairs. Financial management has been an issue, certainly at the early stages, when the project was confronted with considerable under-expenditure because of delays in implementation of activities and over optimistic forecasts. Financial reporting has been an issue – with UN-HABITAT instructed to use a reporting format that is different from its own. Dutch funding has been vital for TCBB’s portfolio, representing the “lion’s share” of its operational budget. Some steps have been

99 For example, in his letter of 15 December 2004 [ref. DCO/OO-380/04] to Mr Antoine King, Director, UN-HABITAT Programme Support Division, Mr Bierma of the Ministry observed: “You request for the transfer of an amount of USD 500,000. However, in view of the pattern of spending during the last years, I find this a very high and maybe unrealistic estimate. I have therefore decided to transfer an amount of only USD 250,000”. Similarly, Mr Tempelman in his letter to Mr Antoine King [10 October 2005, ref DCO/OO-263/05] stated: “ In our talks it was brought up that the programme lags behind the planning. This is substantiated by the report and has led to an amount of USD 662,939 in unsettled advanced funds in our administration”

63

Chapter 3: Efficiency

made in recent years to diversify funding; however, discontinuation of Dutch financing will constitute a major set-back.

64

Chapter 4: Outcomes and Impact

Chapter 4: Outcomes & Impact

Introduction

According to OECD’s “Glossary of Key Terms in Evaluation and Results Based Management”, impact is defined as “positive and negative, primary and secondary long-term effects produced by a development intervention, directly or indirectly, intended or unintended” [page 24]. As explained in the Introduction, the evaluation has primarily looked at what partner institutions have done as a follow-up to their, Dutch [co]funded, collaboration with TCBB [i.e. at the level of “outcomes”] and less so at what participants in training events organised by these institutions have learned and, most importantly, have been able to do with their new skills, knowledge and aptitudes [impact]. No systematic data is available: most partner organisations undertake training evaluation in a traditional manner, using training evaluation forms that provide feedback on the appreciation of the trainer, the programme and the premises. There are only few initiatives to undertake impact evaluation – examples are FPDL and its training in Romania in Horezu and surrounding communities and Enda ECOPOP and its Local Agenda 21 programme. This is, however, for reasons of funding and human resources, not yet standard practice. Unfortunately, also the questionnaire did not shed much light on and the issues at stake. As a result, the evaluation team is left with some anecdotic evidence and impressions of what has happened after ToTs and the introduction of the various UN-HABITAT materials and of what use was made of the training and the materials by the institutions. .

4.1 Use of ToTs and UN-HABITAT training materials – some impressions

4.1.1 Arab statesEgyptIsmailia Training Centre

Courses have been held on local elected leadership using materials translated into Arabic in 1998, 1999, 2000, 2004 and 2005 and 2006. Some 10 courses have been run per year both for Egyptian and the broader Arab world, though there was a gap of three years. The most recent ToT was on leadership and conflict management skills in February 2007. Participants interviewed on the impact of this course were from the local council and the Suez Canal University. From the local councillors, impact was described as improving the ability to communicate and deal with conflict situations. Female councillors claimed to be able to apply the skills learned and be more effective. Others mentioned improved abilities to be able to sit and negotiate with local people; e.g. the director of a new industrial area considered it helped resolve conflicts relating to promoting development.The Suez Canal University professors were very enthusiastic, but the use of the training was mainly for improving internal management. Only one proposed was to use material in teaching and that was not imminent. The participant from South Sinai Governorate stated that 5 courses have been run for local staff using the materials introduced on the course.

Urban Training Institute, UTI

UTI had a contract to translate the LED materials and to organise with UN-HABITAT a regional ToT that was held in Cairo in November 2006. As a follow up to this training, the General Organization for Physical Planning, GOPP, which is responsible to promote a major integrated urban planning programme with support of UN Habitat,

65

Chapter 4: Outcomes and Impact

has been using the LED materials for this programme in order to integrate LED to participatory strategic urban planning. The subject of participatory strategic planning is popular in Egypt, and Government wants to introduce it at a large scale. Since it is also a new concept in Egypt there is not a lot of expertise available. This has created a considerable potential demand for the training – though this not yet been linked to concrete funding. A further interesting aspect with long term potential impact is the involvement of university staff, which provides a link into higher education. GOPP and UN-HABITAT have also been integrating the RUSPS methodology including LED to profile the cities involved.

4.1.2 Central and Eastern Europe

Both FPDL and the members of its network of “Working Together” have been using the different UN-HABITAT materials in variety of contexts, such as:

FPDL FPDL conducted training on communication, negotiation and mediation using the LEL series within the framework of UNDP’s “Centre for Change and Conflict Management” [2004]. Within the framework of the EC financed “Supporting Romania's accession to EU through building capacity of local governments to enable the economic development of their communities by using EU enlargement process opportunities" FPDL together with Bucharest University has been working on local economic development issues in Horezu and surrounding communities [2006]. In the process of developing LED strategies, use was made of UN-HABITAT materials on LED as well as Local Government Financial Management training materials; training was provided on management and leadership skills. A guide for data collection for participatory LED was prepared as well and together with community representatives. An impact evaluation of FPDL’s involvement was carried out. This showed amongst others that the training had given Horezo a head start in applying for EU structural funds as the town could show that it had a coherent development strategy and was able to mobilise outside technical expertise. In addition, by managing a LGI Small Grants Programme, FPDL has provided support for “the translation, adaptation and/or multiplication of the Training Manuals used in the Regional Programme TOTs held in 1998-2003"100. A booklet on “What is Local Economic Development” is under preparation as well. FPDL considers the LED series useful; however to do it according to the book “you need teams of professionals; for larger participation, the manuals need to be adapted, in addition to organising training”. In several other countries in Central and Eastern Europe, FPDL has been using UN-HABITAT materials as well.

Association of Local Democracy Agencies [ALDA]

ALDA, which is part of FPDL’s network, has used the on-line materials in its own training activities in Serbia, Montenegro and other former Yugoslav republics as well as Georgia. Some of the UN-HABITAT materials have been translated for use in local capacity building activities and according to an ALDA representative, the manuals of TCBB “have become part of the methodology”. Using UN-HABITAT materials, ALDA trained between 2004 and 2007: 200 people using the LEL series; 300 on the basis of the BB series, 250 with the use of the participatory budgeting toolkit, 250 on building NGO and CBO capacities and 12 people using the training methods and techniques manuals. About 60% of the trainees were female.

Development Consulting Group [DCG]

DCG has been using the LED materials in its work inside Serbia [an electronic copy was obtained through informal links with TCBB]. For example, DCG has been involved in a Mercy Corps/Community Revitalization through Democratic Action Project in which it provided specialized training and technical assistance in developing LED offices in 12 Serbian municipalities. The manuals are not used as a whole but abstracts are used and adapted to Serbian realities [e.g. by paying more attention to public procurement and implementation issues]. Using the LED series, DCG has trained some 340 people in 2006 and 2007, 25 on LEL and 40 using the Building Bridges series. In addition, 35 people were trained using the UN-HABITAT materials on training methods and techniques.

Settlement and Integration of

Within the framework of SIRP [funded by the Italian Government], use was made of different UN-HABITAT training materials that were adapted and translated. Some 2,900 training days have been organized. As far as LED materials are concerned, these were e.g. used in an “integrated territorial development planning exercise”

100 FPDL’s Annual report 2004, page 44.

66

Chapter 4: Outcomes and Impact

Refugees Programme [SIRP]

that was done in e.g. Nis, which included attention for strategic planning and “territorial marketing” to attract investments to the town. Training combined theory and practice. As one of the outcomes of the training, a development council was set up in Nis to institutionalize the planning process. Other municipalities have been invited to attend training sessions; collaboration was initiated with the Serbian Standing Conference of cities […] to ensure a broader and more sustainable impact. Moreover, under the programme, FPDL was involved in a ToT on conflict management basic skills using Building Bridges [September-October 2005] and on participatory practices in planning and decision making processes [October - November 2005], using Building Bridges...],

An issue was observed with respect to the formal recognition of certificates of training provided by non-State training providers, such as the NGOs and private consultancy companies that are part of FPDL’s network in Central and Eastern Europe. If such certificates are not recognised by the relevant authorities, as is currently often the case, training will have no impact on careers of local officials – and demand for training is likely to dwindle.

4.1.3 AfricaEastern and Southern Africa101

South Africa

As a follow up to the LEL ToT of May 2006, IDASA prepared a proposal “Implementing the South African Local Elected Leadership Training as a Pilot” to test “the training material and customisation in line with the training programmes of the Government of South Africa’s development programmes of capacity building for municipalities”102. Madibeng municipality in North West Province was identified as pilot municipality. Training of councillors of this municipality was undertaken in October 2006 Involving staff from IDASA, SALGA, and the Department for Provincial and Local Government.

Namibia Following the LEL ToT of May 2006, Namibian participants103 in the event drafted an action plan to organise national leadership training for regional governors and councillors. As a prelude to this training, a 3-day training session for some 18 facilitators [from e.g. the University of Namibia, MRLGHRD, and private companies] was organised in August 2006. The event aimed inter alia “to explore possible integration/alignment of the some of the constructs under transformational leadership in the UN-HABITAT based good governance programme during the training of local elected leaders/councillors”104 and to prepare for the roll-out of the proposed training programme. Copies of the LEL manuals were provided by UN-HABITAT. The follow-up has taken place with the overall proposed “transformational leadership development programme” proposed by UNDP for reversing the HIV/AIDS epidemic at regional level. According to UNDP’s report on the “Transformational leadership and key competencies for improved local governance” report [August 2006]: “[the] ministry intends to roll out the transformational leadership programme for regional governors and councillors early next year on a back-to-back basis for two groups of 6 and 7 regions respectively with the active participation of the national facilitators” [page 2; see also the 2006-2007 progress report, page 25].

Lesotho As a follow up to the ToT that took place in Pretoria, a 5-day national ToT on LEL was held in Maseru, Lesotho from 28 April to 5 May 2007 involving 22 trainers from the Lesotho Institute of Public Administration, Maseru City Council [MCC] and the Ministry of Local Government and Chieftainship [MLGC] and CSO representatives. Training involved a trainer from GTI, Kenya and was preceded by adaptation and translation of training materials into Sesotho and followed by a “councillors training ..[to be] delivered by the trained trainers”105. As a follow-up, a training

101 Partners: IDASA, together with SALGA, the Department of Provincial and Local Government [DPLG] and the Development Bank of Southern Africa [DBSA]102 IDASA proposal, Implementing the South African Local Elected Leadership Training as a Pilot of August 2006.103 Partners: UNDP, National Polytechnic of Namibia, Ministry of Regional and Local Government, Housing and Rural Development [MRLGHRD]104 A Report on the Facilitators’ session on Integration of UN-HABITAT Local Elected Leadership competencies series into transformational leadership development programme in Windhoek, Namibia”. 105 Progrss report 2006-2007, pahe 23.

67

Chapter 4: Outcomes and Impact

programme for the MCC is planned for June 2007; the MLGC has planned a further roll-out to other parts of the country. Project finances were [and will be] used for the ToT, adaptation/translation of materials and the training of the MCC.

West AfricaSenegal Enda has been using several UN-HABITAT training materials within the framework of

the Local Agenda 21 programme and for the development of “Plans Locals de Développement” and “Plans d’Actions Prioritaires” in the communities of Guédiawaye, Tivaoune, Matan, Louga and St Louis. Within the framework of this initiative, Enda developed a manual for élus and civil society representatives on local leadership and the elaboration of Local Agenda 21 as well as a manual for training needs assessment among élus and local decision makers. Working with the “Ministère de l’Urbanisme et de l’Aménagement du Territoire », Enda, according to its Annual report on 2005 has trained: [a] 147 persons, including 110 elected officials on relevant legal texts; [b] 128 persons, including elected officials, “responsables des services d’Etat”, “agents municipaux” on budgeting issues in the communities of Tivaouane, Pout, Mbao and Dalifort; [c] 161 persons, of which 55 elected on local leadership and [d] 240 persons, including elected officials, “agents municipaux” and others were trained on human rights issues, citizenship and local democracy, in the communities of Yeumbeul Sud, Malika, Rufisque Est, Tivaouane, Louga, Mpal, Saint Louis, Pété and Matam. In terms of training impact, interviewees specifically referred to their actions in terms of:

Ensuring better information flows to their constituencies [e.g. as regards their right to attend council meetings]

Ensuring information to elected officials that had not participated in the training sessions

Their improved communication skills in dealings with citizenry and increased conflict management skills that they had required and had to use frequently [e.g. when dealing with urban planning issues]

Increased capacity to plead with the mayor as regards the utilisation of the municipal budget.

On its own account, Enda has produced several training manuals and tools for participatory governance, related to the HABITAT manuals, in the course of 2005106. Enda also used the BB toolkit for a training done on human rights with UNESCO and within the framework of a regional WaterAid project [ 20 participants in a ToT on “participatory planning in the framework of localising the MDGs”].

Benin In Benin, SNV has conducted training of some 125 people [20% women] using the module on conflict resolution in cooperation with GTZ.

Niger The ONG “Centre Afrika Obota” has used the LED materials to train over 70 women in 2006 and 2007 and has also used the conflict management and participatory planning materials [e.g. for training of more than 250 traditional chiefs, staff of local administrations, CBOs, etc.]

4.1.5 Asia and the Pacific

After the March-April training in 2006, in several countries in the Pacific, follow-up was given. This follow-up includes the following:

Fiji islands

Undertaking of a training needs analysis, followed by the implementation of seven sub-national training sessions [such as LEL Training Roll Out Programme [Ba, Lautoka and Tavua town councillors], 7 and 8 October 2006; LEL Training Roll Out Programme [Nadi, Sigatoka, Nausori town councillors], 27 and 28 October 2006; LEL Training Roll Out Programme [Suva city, Nasinu and Lami town councillors], 10 to 11 November 2006; and LEL Training Roll Out Programme [Labasa, Savusavu and Levuka town councillors], 24 and 25 November 2006].

Kiribati A National ToT on LEL series was held from 23 to 29 August 2006 and a Leadership training for Line and Phoenix Island Councillors, 19 to 24 October 2006

106 These are: Concepts et stratégies pour améliorer les relations entre élus et citoyens par la planification participative » ; Boite à outils pour améliorer les relations entre citoyens et autorités locales par la planification participative ; Concepts et stratégies pour améliorer les relations ‘élus – citoyens’ par la gestion des conflits ; Boite à outils pour améliorer les relations ‘élus – citoyens’ par la gestion des conflits

68

Chapter 4: Outcomes and Impact

Papua New Guinea

A pilot LEL training was held parallel to a City and Town Managers Conference [24-26 May 2006] together with the PNG Institute of Public Administration and the League of Local Government. Moreover, an Information/Buy-In workshop on LEL training series was held on 20 and 21 July 2006, an LEL training for lord Mayors and Mayors, from 30 August to 1 September 2006 and for Rabaul and Kokopo urban local level government councillors from 23 to 27 October 2006.

Samoa A Good Governance Seminar and Workshop was held from 15 to 18 August 2006 for 86 village mayors and some thirty Government development committee members [Partners: O le Siosiomaga Society [OLSSI], Foundation of the People of the South Pacific International [FSPI], Commonwealth Good Governance Pacific Programme, New Zealand Government [funding]]. The event “aimed at addressing good governance issues such as equitable sharing of resources and benefits, avoid favouritism and corruption, campaign against the loss of customary land ownership, the negative effect of outside assistance to the village communities”107.

Solomon Islands

In January 2007, the Solomon Islands team “undertook the first pilot training programme using the UN-HABITAT specialised LEL training materials, targeting the Honorary Municipal Authority and Isabel Provincial Government”108

Vanuatu In Port Vila: networking of the municipality funded with NZAID; “Roadmap of Reform” developedFinancial regulations and reporting systems reviewed1-week Orientation programme carried out in areas such as good governance, leadership, project management, leadership codeStrategic workshop for SHEFA provincial government to develop a corporate plan for 2006-2011

Vietnam Within the framework of the UNDP/UNCDF project “Strengthening Local Government Capacities for Planning, Budgeting and Managing Public Resources” (SLGP), implemented together with the Vietnamese Ministry of Planning and Investment - Department of Local and Regional Economy, the original LEL materials were and adapted substantially and translated into Vietnamese with support of UNDP and used in a national programme in 2002 to support newly elected deputies after the 2002 elections. In 2005 they were updated, and made more visually appealing. They are planned to be used at large scale in a national training programme, but so far this has not happened. The LED series has been introduced for training activities within the framework of the SLGP project109. The LED Manuals 1, 2 and 3 were translated (as close to verbatim as possible) into Vietnamese, modified in certain respects, thereby producing a “substantial amount of material to form the basis of a training workshop design and the development of some substantive workbooks for participants” 110. A first draft workbook of the modified material was prepared as well, and used for a one-day seminar for provincial leaders [4 August 2006] and with technical staff [mostly planning and finance staff] who would actually be in charge of the hands-on planning in their local government [7-11 August 2006]. Training was done together with UNDP and used input from EcoPlan International and a trainer from URDI (part of the LOGOTRI network)

India The new LEL materials were launched at an Asia-Pacific ToT that was held from 27 January to 3 February 2006 with support from LOGOTRI, “HUDCO Chairs”111 and the World Bank financed Tamil Nadu Urban Development Programme III. The training linked into a major USAID funded programme, Financial Institutions Reform and

107 Siosiomaga News, August 2006 issue.108 Progress report 2006-2007, page 28.109 This was done for several reasons: [a] though the package is LED focused, “at the core was a strategic planning approach and tool that was "no-nonsense”; [b] the ten-step model is .. not new or revolutionary - this means it potentially builds on all the other models/concepts that people may have seen in the past”, allowing them to build on what they know and to ingrate this “into a logical and systematic approach”; [c] “the ten-step model is based on common concepts which are used by many agencies and government institutions around the world”, while the concepts also could be integrated with the existing Vietnamese legal context. [Robert Mellor, Development and Presentation of Training Workshop on "Strategic Planning for Local Development", report 31 August 2006, page 2].110 Furthermore, “a local training company here in Vietnam [will be commissioned] to do some further improvement on the workbooks ..and to add any further information on Vietnamese case studies of "strategic planning for local development". Intentions are to develop “appropriate versions of the workshops for local government leaders at the three levels (Province, District and commune) and also for the technical staff from each of these levels” [see Robert Mellor, Development and Presentation of Training Workshop on "Strategic Planning for Local Development", report 31 August 2006, page 4-5]..111 A “HUDCO Chair” is a professor position at a number of State level Administrative Training Insititions which have a mandate to train local government. Th lack staff with an adequate professional background

69

Chapter 4: Outcomes and Impact

Expansion programme [FIRE], which involves a network of 18 training institutions that are coordinated by the National Institute of Urban Affairs [NIUA]. Through this network, training using adapted versions of the materials has been carried out in many parts of India. The numbers trained, however are difficult to assess, but are claimed to be substantial. Institutes involved in this programme include the All India Institute for Local Self Government (AIILSG) which itself has a national network of centres and has a large capacity (it was also the anchor institution for the Urban Management Programme).

A further large scale government programme in which LEL materials are used is the Swarna Jayanti Shahari Rojgar Yojana (SJSRY) programme that focuses on poverty alleviation. Modules from the LEL materials are used in special training programmes run by HSMI. At least one of these is scheduled for 2007.

According to HSMI “HSMI has been instrumental to decentralize the training under UN-Habitat using material on elected leadership series. We organized 3 ToTs, expanded training to 22 State/Regional level institutions by developing master trainers. These State institutions have further decentralized training to district level. We have also successfully translated and promoted translation to have vernacular delivery of training which covered languages spoken by almost 70% of Indian Population112.”

In addition, a major World Bank funded programme in Tamil Nadu had training developed and run over 36 programmes which incorporated materials from LEL. HUDCO, the parent body of HSMI has also funded 22 “HUDCO Chairs” in State training institutions allow them to have content input in the urban sector. The HUDCO Chairs are a link to HSMI. These institutions are also reported to be using the materials, though again we have found it difficult to obtain accurate numbers. The Kerala example however does illustrate a strong experience.

In Kerala, South India, with 1,200 urban and rural local governments and a total of 20,500 elected representatives, KILA is using materials adapted to the local situation and translated into Malayalam in support of the decentralisation programme that is linked to India’s Constitutional Amendment. New councillors first get a programme based on local governance and this is then followed up with 3 day training using adapted LEL materials. Training is given first to District Training Centres who then undertake the training. By this means a very large number can be trained in a timely manner.

Assessment and recommendationsAs indicated above, the evaluation team could not obtain precise figures on impact, and is left with impressions and anecdotal information. The available data indicates that:

The project has touched on many countries and has involved a considerable number of institutions but often without sufficient numbers in terms of e.g. trainers trained, or possibility of follow up to be able to impact strongly.

The project has been operating at a global scale, and responding to raising opportunities in particular regions, the Pacific being a good example. Countries with large populations, such as China and Indonesia, have hardly been touched for various reasons.

UN-HABITAT materials have indeed been used in training programmes of its partner organisations on a piecemeal basis. As was originally intended, the sets of materials are never used as a whole. Parts of the materials [e.g. a number of relevant competencies included in the LEL series] that were considered appropriate and useful were used and included in training. The linking to large scale programmes of National and State governments and to donor funded programmes has allowed considerable further utilisation of the materials. Similarly, potential impact via involvement/integration into other UNHABITAT projects, as is the case in Egypt with participatory

112 HSMI response to questionnaire May 2007

70

Chapter 4: Outcomes and Impact

planning and LED, within the framework of the Spanish funded project in D.R. Congo, Mozambique and Senegal looks promising

To ensure the use of the materials it is it is important that they are readily adaptable. The experience in for example Kerala suggests that there was considerable local ownership after adaptation, using local cases and translation. The same is true for Senegal and Romania. However, funding for translation and adaptation appears to be a barrier – e.g. in the case of LED in Senegal and LEL in Indonesia. The original series of LEL materials took many years to achieve the range of languages in which they are now available – the country visits confirmed that this original series continues to be used.

.

The evaluation findings confirm that, in order to enhance utilisation of the materials and increase potential impact:

More effort should go into supporting adaptation and translation to take advantage of the considerable investment that has been made in generic materials. Without this it is difficult for materials to reach beyond the level of educated professionals.

Integration of capacity building into project development, which is increasingly taking place, should be further encouraged. Working wider within UN-HABITAT and together with other members of the UN family [such as in Vietnam and Egypt] should also be intensified.

Similarly, continuing and intensifying working directly or indirectly with local government associations, as in East Africa, is also recommended. Possibilities of establishing closer links with similar associations in developed countries, which have often their own networks and access to donor funding, should be explored. At the same time, a more sustained effort at country level will require a review of the selection of countries to work with, thereby avoiding spreading of resources too thinly

Finally, the mission would like to underline, that for realising a “real” impact, it is necessary that there is engagement with government at the policy level so as to improve the institutional environment for local government and for training institutions. Without this it is difficult to build the capacity of institutions and ensure it is sustainable.

71

Chapter 5: Sustainability issues

Chapter 5: Sustainability issues

Introduction

Sustainability refers to the extent to which initiatives are able to continue to have impact without having to resort to a constant stream of the current project resources. For this to happen there needs to be a continuous input of human energy and finance. For example if materials developed through the project are incorporated into regular, locally funded programmes this would be a sign of sustainability. This chapter will look at the evidence for sustainability and pays attention to the following issues113:

Continued demand for tools developed with Netherlands funding Ownership of the materials developed Sustainability of partner organisations

5.1 Demand for Tools and their Development and Use

The main product for which TCBB is known is the training material. The original LEL series is still available on-line and is still being downloaded and used. The same is true for other publications, including those produced under the predecessors of the current project. Some data provided in the progress report of 2004-2005 and the most recent one on the number of hard copies of materials ordered is the following114:

Internet based and CD-ROM based materials plus lists of publications account for 83% of the items distributed. CDs themselves include many sets of materials, so are potentially very significant, and as files are electronic they can themselves be easily copied and sent further. Figures for copies sold are likely to represent only the “tip of the iceberg” of the number of copies in electronic circulation and used. Accessibility is an important issue. For older materials the Internet continues to be an important source which is not expensive to maintain. Full versions of the newly

113 The mission intended also to examine the number of training courses conducted by the partner institutions – using e.g. UN-HABITAT materials. However, we did not obtain the requisite data to make any sensible judgement. 114 Data on recent downloads of the available materials are not available as a result of major restructuring of UN-HABITAT’s website. In 2004-2005, the Local Elected leadership was the most popular downloaded document [456 hits], followed by the NGO materials [142 hits]. For others, interest was apparently non-existent.

April 2004 - March 2005

April 2006 - March 2007

Building Bridges 101 21Councillor’s Guide 5 0Code of Ethics 28 5Directory of Human Settlements 1 0Designing HS [Africa] 4 2Designing HS [Asia] 1 0Designing HS [Europe] 6 2Elected Leadership 73 1Guiding Designing Effective HS 5 1Guide to Managing Change 4 5Guide National Training Needs 5 0Guardian of the Environment 7 3Hai el Salam 3 0Case study Pakistan 5 0Manual Collaborative Organisational Assessment 5 0Housing Finance 4 0Revolving Funds 6 2NGO 20 10Fifteen years of TB 1 0Evaluation Training's Impact 13 26Training Local Government Finance [S. Asia] 6 0Finance [E&S Africa] 7 1Training Needs Assessment 1 0Total Quality Maintenance 6 1Local Economic Development [LED series] 136Local Elected Leadership Training Series 206Restore the Health of your organisation 294Total 317 716

72

Chapter 5: Sustainability issues

developed materials are, however, not available on Internet and this is likely to limit their use, at least in the short term.

Financial sustainability of the materials would mean that at least their printing costs are covered by sales so that they can be reprinted. This is not the case. Although recent materials such as the new LEL series and the Municipal Financial management are put up for sale at significant prices (especially Financial Management) the proceeds of sales go to a general UN Habitat account and are not earmarked for further production or support of localised versions. A commercial approach and techniques such as “print on demand” could ensure that some materials pay their own way, but only if this is linked directly to being able to reprint. However, there is a considerable risk that this approach would severely limit access to the target groups in developing countries, where cost and bureaucratic complexity makes if difficult to purchase materials internationally.

5.2 Ownership, manual adaptation and/or translation

Over the lifetime of the project, there has been a significant achievement in terms of adaptation and translation of materials. An important difference between the original materials and material that has been adapted for local use [with different [pictures, slogans, proverbs, legal texts and case studies] and translated is that there is significantly more local involvement and ownership. Such adaptation, as opposed to straight translation, increases a sense of ownership of materials and enhances the likelihood that they will continue to be used –with occasionally the training materials becoming part of the regular curriculum.

An issue in this respect arises with the new materials that have been or are being produced. These, will be in English only and will not be translated with the exception of participatory budgeting and LEL material which in Ismailia, were reported to be in the process of translation into Arabic. . This is likely to hamper their utilisation, adaptation and integration into other training programmes in non-English speaking countries where other official languages are spoken. The issue of limited adaptation and translation of new materials appears to arise from a combination of satisfaction with the existing materials and the fact that funding for updating is not readily available.

5.3 Sustainability of partner organisations

Though their size varies, many organisations that partner with UN-HABITAT are small, especially the NGOs [Enda ECOPOP with 9 staff, DCG with 8, FPDL with 7]. Many have few and often transient staff, with in countries such as Senegal and Burkina Faso most of the trainers coming from “outside”. Limited staff size and lack of continuity also applies to the major training institutions in India in Egypt.

The project has done little in changing this situation as efforts have not focussed on supporting broader institutional change and development, but rather have opened up some possibilities through funding of activities, making materials available and training of trainers. On this issue of ToT, the mission moreover observes that though there has been a substantial number of persons trained, resources have been spread rather thinly, certainly as far as regional

73

Chapter 5: Sustainability issues

ToTs are concerned with generally between 1 and 2 persons per country [sometimes per institution] attending [except for the host country/institution]. Moreover, many of those attending TOTs were not trainers themselves, but rather representatives of strategic funding organisations, Government or CSOs. These are important, especially when the training succeeds in involving key “change agents”, but the impact on trainers is likely to be less than would appear from the available figures. At the same time, in the interviews, trainers at an individual level expressed enthusiasm for the training they received and express that it has changed the way they work on a routine basis. This provides a good base for sustainability, especially if they are in turn responsible to train younger staff.

Financial data up to April 2007 furnished by UN-HABITAT on the co-funding [in terms of cash and in-kind contributions] provided by other UN-HABITAT departments and by the partner organisations in the various countries indicates [see also the table below] that the equivalent of a total of US$ 1,299,621 in co-funding was obtained, representing some 63.8% of the Dutch project contribution. Other UN-HABITAT departments contributed US$ 172,767 to the various project activities [equivalent to 13.3% of all co-funding]; partner contributions, in cash and in kind, accounted for some 86.7% of all co-funding with a total amount of US$ 1,126,854.

The financial commitment of the partner organisations is a clear indication of the interest shown.

Project fundingOther UN-HABITAT contribution

External partner contribution Total

2002 202.521 0 139.000 341.5212003 474.163 0 127.238 601.4012004 68.357 0 93.000 161.3572005 581.971 24.767 273.140 879.8782006 625.834 56.000 398.476 1.080.3102007 85.300 92.000 96.000 273.300Total 2.038.146 172.767 1.126.854 3.337.767

In terms of key financial partners, the following organisations clearly stand out:

FPDL in Romania, providing the equivalent of US$ 251,000 [which is equal to 22.2% of all external partner funding], mainly coming from finances it has obtained from the Local Government Initiative [LGI], the main source of funding of FPDL

Finances generated by Ecoplan International [US$ 130,000, including CIDA funding]

CLGF providing co-funding in the equivalent of US$ 126.976 Co-funding provided by and/or through UN-HABITAT regional offices in the

amount of US$ 86,000 and The Open Society Institute with US$ 85,238

The available data indicates that many organisations have been able to provide some co-funding to UN-HABITAT organised training. They generally obtain finances, often from the outside, on a project and/or programme basis only, with

74

Chapter 5: Sustainability issues

little, if any, regular State contribution. The importance of training is advocated in the political arena but not when departmental training budgets are discussed. Finding regular, longer-term funding has been a major concern for many of them – nevertheless many appear to have been able to interest sources of funding such as USAID, the European Commission, and others and have been able to do so for quite a number of years115. For most organisations, even those that have been working with UN-HABITAT for quite some time, resources obtained from UN-HABITAT are only a fraction of their funding. A complicating factor for sustainable funding outside of projects is that NGO provided training is often not certified.

Sustainability of training activities requires that there is an effective demand for training – in addition to training institutions being able to provide quality training in LEL, LED, participatory budgeting, etc.. This means that e.g. local government or national government or projects are willing to pay sufficiently to allow the supply side to function. The fundamental lack of appreciation of the importance of investment in capacity building is a problem in many countries – as well as donor funded projects and programmes. Only a few examples were found where priority attached to capacity building by Government was translated into regular budget allocations. One example is India, where large capacity building programmes that are linked to national and programme budgets have facilitated LEL training. Another example is South Africa, where local government must allocate resources to training.

Assessment and recommendations

The quality of the materials produced under the project is confirmed by continued demand for them. This brings into focus, once more, the issue of costs of the publications produced with Netherlands funding and the need for a UN-HABITAT policy which ensures that the materials can be accessed for those for which they are intended most: training institutions and local government authorities. Along the same lines, the evaluation confirmed the importance of adaptation and translation, ensuring that the generic materials are in line with national/local traditions, symbols, legal instruments, etc. and of the need for having the necessary funding that permits such adaptation and translation.

While the project focused on providing relevant quality teaching and learning materials and training of trainers, it has paid less attention to more generic institution building. Many of UN-HABITAT’s partner organisations have been able to contribute to funding of activities at national and regional level, and, despite their limited size, have been able to function for several years in an often volatile environment. Access to project and programme funding has been vital for their survival; at the same time, many of them are confronted with insufficient recognition of the importance of capacity building by national Governments. There is a role for UN-HABITAT, to increase its lobbying efforts vis-à-vis national governments on this issue.

115 This finding contradicts one of the conclusions of the 1996 evaluation, i.e. that “activities seem to have been largely concentrated on institutes…which were relatively dependent on UNCHS support and therefore inclined to endorse UNCHS’ activities. Institutes which were potential to act as a self-sustained national training institution…were much less conctacted by the project management. …the project management might well have to consider to adjust its approach and seek more involvement of the relatively mature partner institutions in the regions, which are able to adapt UNCHS’ training programmes to the relevant local/regional situation” [page 14].

75

Chapter 6: Conclusions and Recommendations

Chapter 6: Conclusions and RecommendationsThis chapter summarises the main conclusions from the evaluation and makes recommendations on future directions. It is structured on the basis of the main evaluation themes. For more detailed discussion the reader is referred to earlier chapters.

Conclusions

Relevance of goals and strategyThe project is highly relevant. It addresses a subject area that is widely acknowledged to be critical in urban development and in urban- rural relationships. The fast relative growth of the urban sector underlines that this is an important trend and one which can be expected to continue. The project has an important role to play as it addresses an area which is not well covered by the market system. Most of the client institutions could not afford to pay the market price for training materials and consequently there are very few materials available. Habitat has an advantage in working in this area as it is able to draw on a wide range of collaborations and is able to link into relevant projects and to leverage these linkages to bring practise into learning. The linking of the project into ongoing programmes and projects has allowed it to be able to contribute to projects and programmes and at the same time to leverage substantial resources.

The strong points are seen as: Focus on urban development capacity building is widely seen as very

important. Building on the strength of past experience with development of tools,

building on work already done and working on tools in partnership. Developing positive means of working with projects and programmes

inside and outside of UN-HABITAT to integrate capacity building thus increasing effectiveness and leveraging more resources.

Working in partnership with intermediary organizations

However challenges are seen as: Working in an environment where capacity building is not always

sufficiently appreciated as an important investment Having ambitious targets but working through institutions which

themselves face capacity problems Working with a heavy dependence on one major donor

EffectivenessThe evaluation team were very positive about the overall effectiveness of the project, an enormous amount has been achieved, and targets were mainly exceeded.

76

Chapter 6: Conclusions and Recommendations

The evaluators were impressed by the flexibility of the response of the project and the funders to changing opportunities. There was a willingness to keep focus on the overall aims and to modify the details. The project design gave considerable flexibility, and for the most part, this was well used. The team was able to recover from a slow start and be able to achieve significant results.

Effectiveness of the ToolsThe tools, training and capacity building support materials were the major visible output of the project. Overall there was a significant achievement in both the production and dissemination. Two major new tools were developed – Strategic Planning for Local Economic Development, and Municipal Financial Management. In addition tools for combating corruption (Improving the Health of your Organization) was supported by the project, but mainly funded outside, while the traditional flagship of the programme, the series of training materials to support local elected leadership, was substantially revised to integrate gender and good governance and to include the role of councillor as representative.

The major strong points were: Four major new and updated sets of materials were produced and

disseminated. Materials were produced with strong processes of testing and

consultation and some support for adaptation and translation. Strong efforts went into introducing and making the materials available. Innovation has taken place with testing of distance learning approach. There was innovation also of the integration of the use of the tools in to

the development and implementation of projects and programmes Materials are suitable to be used selectively, and have been widely used

in this way Materials have been updated to take on board gender and good

governance issues.

The challenges include:

There is need for more support for translation, local adaptation and use of local cases to support local training.

Access to some of the new materials is only available in hard copy, whereas for training use if is more useful in soft copy

Pricing of new materials inhibits access and use For recently developed material there will need to be sufficient efforst to

introduce them, consolidate through training of trainers and adaptation and ensure adequate learning from the experience.

Adapted and translated materials cannot be properly reviewed for content and quality

Institutional StrengtheningIn terms of the second result area, of strengthening of training institutions, the project performed very well in terms of the numbers of trainers trained and countries touched. The perfomance was weaker in terms of the ability to strengthen institutions in a sustainable manner.

77

Chapter 6: Conclusions and Recommendations

Strong points include: In the main partner institutions a good critical mass of trainers

developed new skills in participative training A large number of trainers developed new skills and motivation The credibility of partners institutions was increased through

association with an international organisation Institutions networking opportunities increased Ability to train in new areas was enhanced though access to materials

and training of trainersThe project also faced a number of challenges:

The sustainability of the partner institutions in terms of management and finance was not supported

Many of the institutions worked with are themselves very small, and relatively weak

It was often only possible to train one person in an institution, giving a limited impact

Although this area was the core of project, at least in name, the evaluators recognise that it is a very difficult area as much depends on situations beyond the project control- in particular issues of policy on capacity building and national employment conditions affecting governmental training institutions.

Networking and development of new areasThe third result area deals with network strengthening, improving supply demand linkages and development of new areas such as land tools, housing (not new for UN-Habitat but new related to training in the subject), planning and impact assessment. Most of the work on training of trainers was implemented jointly with partner institutions in the first “ring” of co operations. This targeted both the trainers in first ring institutions and also a wide spread group from 2nd ring institutions. The efforts seem to be well appreciated, though in the second ring there was a more mixed impact.Strong points included:

Strong performance in East Africa, working together with training institutions and local government associations and senior decision makers.

Training of trainers workshops helped to build up wider support for the new training areas

Strategy workshops were used for the development of new areas including participatory budgeting, land, housing, planning and training impact assessment.

At the same time the project faced challenges including: The model used to develop local networks (in East Africa) was too

resource intensive to use elsewhere and the “first ring” institutions did not have the resources and or motivation to do same thing directly in their local areas

The work on training impact evaluation is rather sophisticated for general application and there is a lack of a simple tool that is usable when capacity is limited.

In addition to the main result areas, the project has worked on the mainstreaming of important areas of gender, youth and HIV/ AIDS into

78

Chapter 6: Conclusions and Recommendations

training and capacity building. Useful progress has been made in terms of gender, where new materials have had gender issues mainstreamed, and also in governance. Initiatives are being undertaken to address youth issues with some success. Work on HIV/AIDS has been found more difficult to progress on.

ImpactThe question of impact was reviewed. It was not possible in the context of the evaluation to carry out a full impact assessment, rather we could review what was documented and carry out interviews which allowed us to check the reporting by the project. The range of countries with some involvement in the project is impressive, but there is a great variety of levels of impact. We felt more could be done to address major language groups and large populations, though we feel it is correct to deal with both large and small countries.

Overall, the impact appears to have been significant in terms of the indicators of trainers trained, and in some cases very significant in terms of the numbers of trainees, for example in Kerala, India. Impact on the institutions themselves was more limited as factors beyond the control of the project are very significant.

Strong points include: a large number of countries had at least some exposure to the project; significant impact was achieved when adaptation and local language

versions were prepared; materials appear to be widely used as inputs to regular courses as well

as special courses; feedback from the limited interviews possible was very positive and the

learning appears to have been used in a practical and useful manner; integration in the design and implementation of projects and

programmes has been appreciated by programme managers and has good potential for significant impact;

At the same time the challenges faced by the project include the following: Lack of strong policy together with institutional and funding support for

capacity building in many countries; Language access. Despite efforts of the project, limited translation has

meant that large groups do not have access to the materials; in terms of population the evaluators considered that although is it

correct to deal with both large and small countries, greater impact could be achieved by giving increased weight to consideration of population size, especially linked to language groups;

Adaptation. Where there has not been local adaptation, materials were reported to have less impact, particularly at the local level;

There are barriers to accessing the new materials in terms of price, the difficulty of training institutions to purchase materials from overseas sources and also in terms of the form of materials in that they are not available to download electronically – the form particularly useful for trainers.

79

Chapter 6: Conclusions and Recommendations

SustainabilitySustainability refers to how initiatives introduced by project can continue to be effective after the project funding ceases. Materials appear to be the most sustainable elements, followed by trainers who know how to use them. The launching of new products, as has been done recently, requires more effort to consolidate. They need to, introduce to training organizations, train trainers, and help make local adaptations, including translations of materials.

Strong points include: The project has worked with sustainable concepts of recycling and

improving existing materials. Strengthened and motivated trainers represent an important resource

which can itself lead to further innovation and improvement. Partner institutions are not dependent on the current project funding

However, there are a number of challenges including: Poor policy, institutional and financial frameworks in many countries

area a problem for sustainability of the results of the project. The sustainability of the institutions which have been supported is

under pressure, both from the lack of policy and institutional support mentioned above and from difficulty in adapting to increased market orientation.

The network links that depend on the project funding as their main driving force are vulnerable to the ending of the funding.

The project support to training institutions has not included support on how to manage the “business side” of the institutions.

The launching of new materials late in the project (the result of the slow start-up) means that there is not sufficient time for the proper consolidation activities such as field testing, training of trainers, local adaptation and translation to take place.

The narrow external funding support base makes vulnerable the activities of the project which need to be continued

EfficiencyStrong points:

Overall project management has been handled well by TCBB. Additonal funds have been tapped through projects to get more leverage

from the project funds.Challenges

Financial management has been an issue, certainly at the early stages, when the project was confronted with considerable under-expenditure because of delays in implementation of activities and over optimistic forecasts.

Financial reporting has also been an issue – with UN-HABITAT instructed to use a reporting format that is different from its own.

Dutch funding has been vital for TCBB’s portfolio, representing the “lion’s share” of its operational budget. Some steps have been made in recent years to diversify funding; however, discontinuation of Dutch financing will constitute a major set-back.

Recommendations

80

Chapter 6: Conclusions and Recommendations

Based on the conclusions summarised above, and described in greater detail in the main text, the evaluators make the following broad recommendations for consideration both by UN-HABITAT and by potential funders of follow on to the current project.

Recommendations: Goals and StrategyOn the goals and strategy of the project the evaluators recommend the following main points:

More focus on influencing policy on capacity building. The difficulties in many countries relate to how seriously government values capacity building which supports its development objectives. UN-HABITAT is an appropriate body to promote this, both at national level and through local government associations, at local government level.

More focus on impact through wider knowledge of and access to tools . Knowledge of the existence and availablity of tools is still limited, and more effort should go into increasing exposure, including for selected materials the potential for use in education as well as training. Habitat in its capacity building activities, and especially with regard to its tools, should aim to complement the market and not join it. High prices, can have a serious impact on accessibility to key target groups, especially in developing countries. This is discussed further under “Tools” below

Continue move towards demand led support with integration of capacity building concept and tools into programmes of Habitat, UN and others The recent experience of integrating materials and related training into the development and implementation of projects is very encouraging. It reinforces the message of integration of capacity building strategies into development programmes and gives a strong potential for learning and innovation. It will be important to monitor and evaluate this process to ensure maximisation of the learning potential.

Explore additional partners including universities which are active in habitat issues relevant to local government and NGOs and develop stronger links to existing networks. The project should continue its approach of reviewing existing partnerships and trying to identify stronger partners at the “first ring” level who can play a stronger role in adaptation and promotion. This may need to be underpinned by, for example, seeking donor support for building stronger support at the regional level. Universities often have stronger institutional sustainability and more political strength than training centres. They can be brought in as partners to strengthen research underpinning of cases and this in turn can impact on the practise relevance of university staff and curricula.

Recommendations: ToolsOn tools, mainly the training materials and guidelines developed, the evaluators make the following recommendations:

Focus on high quality generic materials with wide potential use At present there are a large number of publications, many with some overlap, as they were produced primarily by the same author. It would be useful to consider consolidating the generic tools in one accessible location – probably online, and to focus on short guides to using the tools in different situations, as is being done, for example with gender. Another

81

Chapter 6: Conclusions and Recommendations

area could be on integration of action areas e.g. between local economic development, poverty alleviation and shelter. This would also have the benefit of simplifying rather than making more complex the tasks of local government and its partners in development.

Stronger focus on the issues of access to tools The tools developed can have an impact far beyond that which can be directly introduced through workshops provided that a) their existence is known and b) they can be accessed. Although considerable efforts have gone in to “marketing” materials, they are still little known amongst urban development professionals, educators or decision makers. More attention here could greatly increase impact. The other side of this is to make sure that professionals, especially in developing countries, can access the materials. This calls for revision of pricing and access policy and greater efforts to encourage local adaptation and translation. It should be the aim to have all material accessible via Internet and CD. High quality printed materials can still be made available at commercial rates for developed countries, but this should not interfere with the basic objectives.

Increased focus on versions especially translated for large language groups and with local adaptation The project has done well in encouraging local adaptation and translation, but much more could be done. This is an area where there are considerable potential benefits and the evaluators encourage an increase in attention. This would be a suitable area for diversification of donor support. With adapted and translated materials, however, it is recommended that they should only use the UN_HABITAT logo and similar cover appearance when it is possible to properly check the quality and content.

Continue exploring e-learning, but with caution The initiative in making materials available through e-learning is good, but it is encouraged that this should be monitored and evaluated very carefully before deciding whether and when to expand the approach. This is because e-learning is resource intensive, both for production and for access (in terms of necessary infrastructure). Pricing policy must focus on accessibility to potential users.

Consolidate the introduction of new and recent materials. The recent introduction of materials near the end of the project means that there is very limited time to embed them in training institutions, to train trainers and to enssure proper evaluation and feedback. It is recommended that consideration be given by the current project funders to provide a period of support for this purpose.

Recommendations: Institutional strengtheningAs discussed under the overall strategy, support at the policy level with national governments is very important. Specific recommendations on institutional strengthening include:

Stimulation and support of “business plans” for training institutions to help them respond to the increasing role of the market. This is an area recognised by the project as needing more attention. Institutions often have to balance the demands of inputs in projects which pay attractive rates with training for local government which is often badly or not paid.

More focus on support to a smaller number of partners who show initiative, linked to more working with strong partners and the stimulation of project funding The staff of TCBB will always be very limited, and need

82

Chapter 6: Conclusions and Recommendations

better mechanisms to be able to increase impact. We encourage that they try to focus more on a supporting a limited number of institutions which show potential and to work more together with strong partners to do this. These partnerships will require funding, and this could be a focal area for widening the donor support base.

Try to make more use of the Master Trainers developed and seek out more good local trainers to act as resource persons. There is a considerable pool of potential local talent, including, but not limited to that developed by the project. These could be used in place of trainers from UN-HABITAT The evaluators consider that it is necessary to develop a model that depends less on direct input by UN-HABITAT staff. The cost of UN-HABITAT staff inputs being excluded from the costs of training activities makes for potentially inefficient use of UN-HABITAT resources and under-utilisation of local resources.

Recommendations: NetworksNetworks are important for sharing experience and for the provision of support. Broadly, the evaluators recommend making more use of existing networks, specifically:

Strengthen current efforts to work through existing networks such as UCLG The existing networks have very wide coverage and institutional and financial systems. Finding areas of synergy, as has been done in the Pacific and East Africa can be very effective, but does require a lot of energy. It should thus be linked to approaches which work more with strong partners.

Continue the modest but useful support to networks such as Logotri , and try to find modalities to be able to work more with organizations like the East African Local Government Association. The existing network supports should be continued and made as learning cases, but there should be a limit to the number of networks interfaced with directly – more use needs to be made of strong partners as intermediaries.

Recommendations: ManagementManagement of the project has been flexible and successful. The recommendations are to:

Continue the flexible, entrepreneurial, output oriented approach which has been developed The evaluators were impressed by the flexibility both from the project management side, and from the donor side. It is recommended that this approach be encouraged and maintained.

Try to keep staffing levels at an adequate level It is normal that there be a concern about over-staffing, but past levels of staffing were too low for the work to be done and it is important to keep a good core of staff. The staff should, however, focus on managing programmes and less be involved in direct inputs, keeping those to a level which allows them to understand what is happening, but not to be critical substantive inputs.

Seek funding for consolidation from the current donors The late launching of major products means that there is not enough time in the remainder of the current project to properly undertake the activities needed to promote and support the introduction of the materials and its adaptation. The evaluators would endorse a request for support for consolidation for a limited period.

83

Chapter 6: Conclusions and Recommendations

Seek wider sources of project funding to replace current project funding The project has funded a large proportion of the external resources, It is recommended to structure future programmes in a form that facilitates wider donor funding in addition to increased funding from the general budget to reflect the greater integration of TCBB work in Habitat programmes

Last wordsOverall, the project has exceeded its agreed performance targets, and has achieved significant results in an area which is critically important for development.It has shown flexibility in being able to respond to the continually changing external environment and has been entrepreneurial in seeking new ways of working.We encourage the existing donors and other potential donors to engage in dialogue with TCBB in developing and supporting continuation of the work undertaken in this project.

84

Appendix 1: Terms of Reference

Appendix 1: Terms of ReferenceTerms of Reference for External End-of Project Evaluation

Project Title: STRENGTHENING NATIONAL TRAINING CAPABILITIES FOR BETTER LOCAL GOVERNANCE AND URBAN DEVELOPMENT

Project Period: Original: April 2002 – March 2006Revised: April 2002 – September 2007

Funding Amount: US$ 3,472,000Funding Source: Ministry of Foreign Affairs of The Netherlands, Education

and Development DivisionImplementing Agency: United Nations Human Settlements Programme (UN-

HABITAT)Branch: Training and Capacity Building BranchDuration of Evaluation: 2.5 work months by 2 consultants Dates of Evaluation: Consultants time to be delivered between 26 February

and 15 June 2007Functional Titles: A) Team Leader / Urban Development and Local

Governance Expert (D1)B) Evaluation and Education Expert (P5)

1. Background information

The United Nations Human Settlements Programme (UN-HABITAT) is mandated by the United Nations General Assembly to promote, monitor and report on progress in the implementation of the Habitat Agenda, with the twin objectives of shelter for all and sustainable human settlements development. The Agency is also responsible for United Nations Millennium Declaration targets on slums, water and sanitation.

UN-HABITAT works and cooperates with governments, local authorities, non-governmental organizations, the private sector and other agencies in promoting sustainable urbanization and reduction of urban poverty. Its work involves norm setting, operational activities, capacity-building, monitoring, advocacy and partnership building; at global, regional, national and local levels. UN-HABITAT has four sub-programmes, which are congruent with the four main divisions of the programme.

The Training and Capacity Building Branch (TCBB) is located in the Shelter and Sustainable Human Settlements Development Division (Global Division). The main role of the Branch is to spearhead the development, testing and dissemination of innovative training and capacity building methods and tools which help member states and national capacity building institutions to pursue UN-HABITAT overall goal of adequate shelter and sustainable human settlements development. Annex 1 shows the organigram of UN-HABITAT. To achieve its objectives, TCBB collaborates with other branches and divisions of

08/05/2023 85

Appendix 1: Terms of Reference

UN-HABITAT as well as with partner organizations from within and outside the UN family.

“Building capacity to build capacity” is the cornerstone of the UN-HABITAT Training and Capacity Building Strategy. Based on this premise, UN-HABITAT offers technical support to national training institutions to build their capacity to effectively implement innovative national training programmes with significant multiplier effect that target local governments and development oriented NGO/CBOs. UN-HABITAT specifically provides them with training manuals and methodologies to enable these institutions to adapt internationally recognised tools to local contexts and language.

UN-HABITAT supports these national training institutions by: (1) organising regional workshops to develop capacity-building strategies (2) facilitating expert group meetings to analyse training need assessments (3) design new training manuals and other tools; (4) developing, jointly with partners, generic manuals and handbooks; (5) conducting training of trainers and action planning workshops; (6) supporting adaptation of these tools to national languages and context; and finally, (7) assisting selected institutions to design and implement national training programmes.

In terms of substantive themes within the broad field of local governance and urban development, the Project focuses on Local Elected Leadership, Municipal Finance, Participatory Planning and Budgeting, Transparency, Local Economic Development, and Conflict Management. In addition, the Training and Capacity Building Branch is working on other human settlements areas such as pro-poor housing, land administration and urban planning. Emerging areas of methodological interest of the Branch include training needs assessment, training impact evaluation and distance learning.

The objective of this Evaluation is to review project outputs, activities, results and impact of the “Strengthening National Training Capabilities for Better Local Governance and Urban Development Project” (hereafter called “the Project”), covering the period starting April 2002. This project is the principle vehicle of UN-HABITAT in the field of strengthening training institutions in local governance and urban development. The results have been made possible through the support from the Government of the Netherlands to UN-HABITAT.

2. Purpose of the Evaluation

The Evaluation of the “Strengthening National Training Capabilities for Better Local Governance and Urban Development Project” is being undertaken with the following key objectives in mind:

a) To assess the degree to which progress has been made towards achieving the Project objectives

b) To examine the relevance, effectiveness, efficiency and impact of the Project’s method and strategy, its institutional anchoring process and support networks, and identify challenges as well as opportunities

c) To propose priorities for further deepening the impact of the Project and for widening the range of capacity building approaches and packages developed by the Project.

08/05/2023 86

Appendix 1: Terms of Reference

The evaluation’s findings and recommendations are expected to be used in future planning and decision-making processes by UN-HABITAT, the Government of the Netherlands and other stakeholders.

3. Scope and Focus

The evaluation should focus on the three immediate objectives of the Project and their corresponding outputs in the areas of (1) development of capacity building tools, (2) training of trainers, adaptations and institutional support to training and capacity building institutions, as well as (3) fostering demand-supply linkages. For ease of reference, the overview project chart, which depicts the hierarchy of objectives and outputs is attached in Annex 2.

The project was originally designed to run from April 2002 till March 2006. In December 2005, a budget-neutral extension till September 2007 was approved. The evaluation should cover the period starting April 2002 through February 2007, acknowledging that seven months are left within the extended project period to consolidate results.

4. Evaluation Parameters The evaluation ultimately seeks to gauge the overall result of the efforts invested in the three main focus areas of the Project, namely (1) development of capacity building tools, (2) training of trainers, adaptations and institutional support to training and capacity building institutions, as well as (3) fostering demand-supply linkages. The following parameters are proposed to guide the design the review. The main emphasis should be placed on project results and impact.A: Relevance: Are the Project’s adopted strategies still valid? Did the Project

have a comparative advantage in the sector?B. Effectiveness: Did the activities contribute to the achievement of the

objectives? C. Efficiency: Were the activities implemented in a cost-efficient and timely

manner?D. Results and impact: What real difference has the project made to the

beneficiaries? What is the extent to which the Project has contributed to positive changes? How did it influence the work of the implementing organization?

E. Institutional Arrangements: How appropriate are the partnerships and other institutional relationships in which the operations of the Project is engaged in?

F. Sustainability: To what extent are the indications that the benefits of the Project will continue after the project comes to an end?

G. Responsiveness to Opportunity: How responsive is the Project to opportunities and demands that arise from countries, regional or international sector bodies?

H. Finances: Has the Project managed its finances effectively and efficiently?

5. Evaluation Process

08/05/2023 87

Appendix 1: Terms of Reference

The evaluation process will require a combination of multiple and complimentary methods and approaches. Approaches to be used will include: (i) Desk review of relevant documents, including work plans, progress

reports, cooperation agreements, activity reports, training reports and related action plans, training manuals, publications, minutes of branch meetings, financial reports, newsletter, etc. These documents will be provided by UN-HABITAT;

(ii) Desk review of prior internal and external assessments of the Project including data collected on performance indicators.

(iii) Writing of inception report;(iv) Visit to Nairobi to hold discussions with selected UN-HABITAT officers

based at its Headquarters in Nairobi, who are primarily involved in the different activities evaluated; A list of proposed names/titles of these officers will be provided by TCBB.

(v) Structured telephone interviews with selected partners, including organizations and individuals (list of contacts to be provided by TCBB); Decision on choice of countries for field visits;

(vi) Consultations with selected officers of the Dutch Ministry of Foreign Affairs; A list of these officers will be provided by the Netherlands.

(vii) Field visits to four countries to conduct interviews with relevant partner organizations, beneficiaries and other stakeholders. The criteria for selection of countries will include, amongst others, regional balance, variety of activities, intensity of operations, partnership with national/regional training institutions, etc.

(viii) Writing of the draft evaluation report.(ix) Presentation and discussion of the draft evaluation report during a second

mission to Nairobi, with additional discussions with UN-HABITAT staff on the tentative findings and recommendations of the evaluation.

(x) Writing of the final evaluation report.

6. Deliverables

Inception report, draft evaluation report and final evaluation report are the main expected deliverable from the consultants.

(a) Inception ReportThe inception report will contain, amongst others, a list of key documents and resource people for the evaluation development exercise; a work program for the evaluation development exercise including a program for regional visits and consultation meetings; and a list of specific questions and concerns relating to the evaluation to which the Project staff will respond.(b) Draft Evaluation ReportThe draft evaluation report will contain, amongst others, draft assessment of general performance of the Project; draft assessment of the general effectiveness, efficiency and impact of the Project. The draft report will be shared with the key stakeholders for comments.(c) Final Evaluation Report

08/05/2023 88

Appendix 1: Terms of Reference

The final report should as much as possible conform to the UN-HABITAT Evaluation Report Standard Format (see Annex 3). It should be provided in hard copy and electronic version, in Microsoft word.

7. Evaluation Team Composition The evaluation will be carried out by two consultants. The selection of the consultants will be based on professional expertise, competence, evaluation and review process knowledge and geographic scope of experience. The team of consultants will have complementary competencies, working experience and specialization. Both consultants will have a relevant academic degree, substantive knowledge of international urban issues, experience with local government capacity building, and institutional change management. Experience in developing countries, understanding of and experience with demand-driven processes and methodologies of capacity building will also be required. Significant prior experience in evaluation missions of this nature will be an added advantage. Working experience with the United Nations system will also be an asset. Strong qualitative and quantitative data collection and analysis skills are required and facilitation skills will be an added advantage. The consultants should not have been substantially involved in operations of the Project in the past.While both consultants should meet the above requirements, it would be desirable that one consultant would have extensive and in-depth experience in Urban Development and Local Governance Capacity Building, while the other consultant would have extensive and in-depth experience in Evaluation and Education. The most senior consultant will be designated team leader.

8. Timeline for the Assignment The following timeframe is proposed for the assignment of 2.5 work months for 2 consultants, to be delivered between 26 February and 15 June 2007. Specific dates of mission components are to be discussed in consultation with all actors involved.End February 2007: The consultants study background materials and produce inception report (2 weeks).Mid March 2007: The consultants come to Nairobi to meet with UN-HABITAT staff and study Project outputs and reports (1 week). End March 2007: Preparation of logistical arrangements for field visits.Early April - Mid May 2007: Three or four country visits take place, as well as telephone discussions and e-mail correspondence with selected Project partners, including the Ministry of Foreign Affairs of the Netherlands (3 weeks).Mid May 2007: The Consultants write a draft evaluation report (1 week) and send it to UN-HABITAT for comments.End May 2007: The consultants return to Nairobi to present and discuss the draft evaluation report with UN-HABITAT staff (1 week).Mid June 2007: The consultants produce the final evaluation report and submit it to the Government of the Netherlands and UN-HABITAT (2 weeks).

9. Budget for the Evaluation

08/05/2023 89

Appendix 1: Terms of Reference

The evaluation will be funded from the project budget. The evaluation budget includes the following items:

Fees for 2 consultants for 2.5 months each. Fees will be based on UNON consultancy remuneration scales. The Team Leader will be at D1 level. The other consultant at P5 level.

Travel (air fare and daily subsistence allowance) for 2 consultants: each 2 times to Nairobi and each to 2 selected countries, to be determined during the initial phase of the consultancy. Total travel will be maximum 30 days over 4 months.

Miscellaneous expenses including telecommunication expenses and printing costs.

10. Contacts

All correspondence related to this Terms of Reference should be directed to:

Mr. Rafael TutsChief, Training and Capacity Building BranchUnited Nations Human Settlements ProgrammeUN-HABITATP.O. Box 30030, Nairobi 00100, KenyaOffice: Room U-128Tel.: +254-20-7623726; Fax.: +254-20-7623092E-mail: [email protected]

08/05/2023 90

Appendix 1: Terms of Reference, Annex 1

Annex 1. Organigram of UN-HABITAT.

08/05/2023 91

Appendix 1: Terms of Reference, Annex 2

Annex 2. Framework of Project Objectives and Outputs

08/05/2023 92

Appendix 1: Terms of Reference, Annex 3

Annex 3 : Suggested Structure of Evaluation Report

(i) Table of contents

(ii) Acronyms

(iii) Executive Summary

1. Evaluation Background

2. Project description

3. Evaluation Methodology

4. Evaluation findings

5. Conclusions

6. Recommendations

7. Lessons learned

8. Annexes

08/05/2023 93

Appendix 2: People met

Appendix 2: People met interviewed in the course of the evaluationUN-HABITATAugustinus, Clarissa Chief, Land Administration and Property Management SectionBadiane, Alioune Director Regional Office for Africa & the Arab statesBarth, Bernhard Associate Human Settlements Officer, Training and Capacity

Building Branch, Global DivisionBarugahare, Martin Chief, Monitoring and Evaluation Unit, Office of the Executive

DirectorBjörk-Klevny, Inga Assistant Secretary General and Deputy Executive DirectorContreras, Liliana Programme Management OfficerDecorte, Filiep Project Manager, Somalia ProgrammeEl-Faramawy, Ali Human Settlements Officer, Regional Office for Africa and the

Arab StatesEl-Sioufi, Mohamed Senior Human Settlements Officer, RUSPS, Regional Office for

Africa and the Arab StatesGuiebo, Joseph Senior Human Settlements Advisor, Regional Office for Africa and

the Arab StatesHabils, Angelique TCBBHalfanin, Mohamed Officer in Charge, Urban Development Branch and Chief, Urban

Governance SectionHeuvel, Onno van den Somalia Programme Hogan, John TCBBJonsson, Asa TCBBKebede, Gulelat TCBBMuigai, Kibe Officer in Charge, Urban Environment SectionNyakairu, Jane Chief, Information Services Section, Office of the Executive

DirectorOballa, Bridget TCBBReutersward, Lars Director, Global DivisionSudra, Tomasz Former Chief, TCBBTibaijuka, Anna Kajumulo Executive DirectorTuts, Rafael Chief, TCBBKenyaGithaiga, Samuel Mukira Director, Government Training Institute [GTI], MatugaMboga, Hamisi Secretary General, Association of Local Government Authorities

of Kenya [ALGAK]Ndambo, Paul Ministry of Local Government, Head of the human resource

departmentOdipo, Augustine M.R. Secretary General, East African Local Governments Association

[EALGA]RomaniaFisher, Fred Director, IDIOM – International Development Institute for

Organisation and ManagementMarkovski, Aleksandar Project Administrator and Research Support Assessment of

Macedonia’s Good Governance Potential, Foundation Open Society Institute Macedonia

Rata, Nicole Deputy Director, FPDLStankovic, Mirjana President of the Managing Board, Development Consulting Group

[Serbia]Valmorbida, Antonelle Association of the Local Democracy Agencies [Italy]Vasilache, Ana Director, FPDLVietnamFriis, Pernille UNDP project manager Governance Programme, HanoiMontiel, Lenni Former Project Manager Governance Programme, Hanoi, now

New York Based.Schuttenbelt, Paul Consultant to UNDP, HanoiAnh, Vu Ngoc UNDP, HanoiEgyptEid, Habiba Director, Ismailia Training CentreEl-Hefnawi, Dr Ayman Secretary General

Urban Training and Studies Institute (UTI),El-Sherif, Ms Doaa Senior faculty UTIMadbouly, Dr Mostafa Former secretary general UTI, seconded to GOPPAbou El Ela , Prof Ashraf Mohamed

Faculty of Agriculture, Suez Canal University, Egypt.

Awad, Moustafa Mossad Decision Support Centre (IDSC), The Cabinet, Executive ManagerYehia, Dr. Azza Hassan Institute of National PlanningDesoukey, Dr. Mona Abd Institute of National Planning

08/05/2023 94

Appendix 2: People met

ElAal SayedFarahat, Mr. Ahmed Hassan Future FoundationAhmed, Eng. Ayman Rabei Social Fund for DevelopmentelEl-refaie, Dr. mohab Faculty of Engineering Ain Shams University, seconded to GOPPFaramawy, Dr Ali UN Habitat Human Settlements Officer, Regional Office for Africa

and the Arab StatesIndiaGeorge, Sunny HUDCO Chair, Kerala Institute for Local AdministrationIssar, Ranjit Chairman and Managing Director, HUDCOKrishnamurthy, A. N Chief, HSMILall, Vinay Director, Society for Development Studies (SDS)Mathur, Mukesh P Acting Director National Institute for Urban Affairs (NIUA)Pandey, K. K.Singh, Kulwant CTA Water for Asian Cities, former director

HSMISubrahmanyam, Dr Durvasula

Director, HSMI

Ekats Bhardwaj Assistant manager, Infrastructure Development Corporation LtdRamakantan, N Director, Kerala Institute of Local AdministrationGhosh, Debjani Senior Resesearch Officer, National Institute for Urban Affairs

SenegalAminata, Dja Enda ECOPOP, Chargée de ProgrammeCissé, Bathie Juriste/formateur, Chargé de projet, Enda Syspro IIDieng, Mamadou Assistant technique, Programme Agenda 21, Ville de GuédiawayeDiop, Dior Conseillée municipale, Ville de GuédiwayeKanouté, Mamadou El Bachir Enda ECOPOP, Coodinator Sene, Arame Ndoye Expert financier, ex Coordinateur of PAR [Programme d’Appui

aux Régions]Sy, Joséphine Lalyre Conseillé municipale, CA Golf SudTall, Serigne Mansour UN-HABITAT Programme Manager for Senegal and Cape VerdeThiau, Adji Aname Ex Chargé de Programmes at Enda ECOPOP  ; Formatrice des

formateurs sur la planification participative et la gestion des conflits

Yené, Moe Chargé de la formation, Agence Régionale de Developpement de Dakar

Zione, Olioane Conseillé municipale, CA Medina Other, InternationalTempelman, Hillard Netherlands Ministry of Foreign Affairs, DCO/OOViloria-Williams, Julie World Bank, formerly seconded to ILO Geneva on Local Economic

Development (telephone interview)\

08/05/2023 95

Appendix 3 Documentation… Briefing Note on UN-HABITAT urban planning activities, version 6

October 2006ALGAK Association of Local Government Authorities of Kenya; Strategic Plan

2007-2011, 2006Biau, Daniel, UHABITAT Acting Deputy Executive Director

Letter to Dr. A.K. Koekkoek, 6 December 2001

Bierma, P. Letter to UN-HABITAT, Mr. Antoine King, 14 December 2005 [ref. DCO/OO-344/05]

Bierma, P. Letter to UN-HABITAT, Mr. Antoine King, 15 December 2004 [ref. DCO/OO-380/04]

Commonwealth Local Government Forum – UN-HABITAT

Report of Pacific Region Training of Trainers Workshop on Local Elected Leadership, 27 March – 7 April 2006

Enda Rapport annuel 2005, 2006Enda Ecopop Programme régional d’appui à la gouvernance participative et de

renforcement du Leadership local [PAGEL], Suivi des actions post formation sur la gestion des conflits et la planification participative, Rapport final, Juin 2006

Enda Ecopop Rapport mission de cadrage de la formation des formateurs et de repérage des institutions nationales d’ancrage, 12 avril au 31 mai 2005, Dakar, juin 2006

Enda ECOPOP Revue des Activités 2005, January 2006Enda ECOPOP Revue 2006 des Activités, January 2007Enda ECOPOP Projet d’appui à l’élaboration d’Agendas 21 Locaux au Sénégal –

Formation des élus et des acteurs de la société civile sur le leadership local pour l’élaboration des Agendas 21 Locaux –Rapport de formation de la ville de Guédiawaye, 15-18 février 2005 », May 2005

Enda ECOPOP Projet d’appui à l’élaboration d’Agendas 21 Locaux au Sénégal – Formation des élus et des acteurs de la société civile sur le leadership local pour l’élaboration des Agendas 21 Locaux – Rapport d’évaluation de la formation des Villes Partenaires », January 2006

Enda ECOPOP Projet d’appui à l’élaboration d’Agendas 21 Locaux au Sénégal – Formation des élus et des acteurs de la société civile sur le leadership local pour l’élaboration des Agendas 21 Locaux – Rapport final de la formation des Villes partenaires, January 2006

Enda ECOPOP Note de Synthèse des travaux d’atelier d’information et de sensibilisation sur le budget participatif ; November 2006

Epi Ecoplan Int. Strategic Planning for Local Economic Development Capacity Building Conference and Workshop, Valparaíso and Viña del Mar, Chile, 29-31 March 2005, Final Report

Epi Ecoplan Int. Workshop on Promoting Local Economic Development Through Strategic Planning in the Arab States Region held in Cairo, Egypt November 19-23, 2006, Report.

FPDL Annual report 2004FPDL Annual report 2005FPDL Annual report 2006FPDL What is inter personal communication ?FPDL What is facilitation ?FPDL What is participatory planning ?FPDL What is decision-making ?FPDL What is conflict ?FPDL What is ethnic conflict ?IDASA Implementing the South African Local Elected Leadership Training as

a Pilot, August 2006ILO “Public Private Partnership for Urban Poverty Reduction”,

Interregional Training and Knowledge Sharing Workshop, Turin (Italy), 10-14 July 2006, Report

Jonsson, Asa Summary mission report on ToT in Lesotho 28 April – 5 May 2007Kanouté, Mamadou Bachir “Programme Leadership des Elus Locaux pour renforcer la

Gouvernance Locale en Haïti – Rapport de la session de formation des formateurs », 24 April – 7 May 2007, May 2007

Khosla, Prabha Women’s Rights and Gender Equality: A Source Book for Local Government Training, 2nd Draft, 22 April 2007

King, Antoine, Director Programme Support Division UN-HABITAT

Letter to Mr. Tempelman, Netherlands Ministry of Foreign Affairs, 4 September 2006

Appendix 3: Documentation

King, Antoine, Director Programme Support Division UN-HABITAT

Letter to Mr. Tempelman, Netherlands Ministry of Foreign Affairs, 3 November 2005

King, Antoine, Director Programme Support Division UN-HABITAT

Letter to Mr. Bierma, Netherlands Ministry of Foreign Affairs, 24 November 2004

King, Antoine, Director Programme Support Division UN-HABITAT

Letter to Mr. Tempelman, Netherlands Ministry of Foreign Affairs, 1 October 2003

Mellor, Robert Development and Presentation of Training Workshop on "Strategic Planning for Local Development", 31 August 2006

Municipal Development Partnership for Eastern & Southern Africa(MDP-ESA)

Regional Workshop on Participatory Budgeting in Africa, Harare, Zimbabwe, March 6-8, 2007, Workshop programme and related press release

Netherlands Ministry of Foreign Affairs

Agreement Arrangement between the Netherlands Minister for Development Cooperation and the United Nations Human Settlements Programme [UN-HABITAT], April 2002; ref DCO/OO-172/02

Nooijer, P.G. de Evaluation of the “Cooperation International Institutions” (SII) – Programme, Final report, March 2005

Petrescu, Claudia and Baboi, Adriana, Romanian Academy Research Institute for the Life Quality

Outputs and impact evaluation study of the project “Supporting Romania’s access to EU through building capacity of local governments to enable the economic development of their communities by using EU enlargement process opportunities, December 2006

Prime Minister’s Office, Regional Administration and Local Government of Tanzania and UN-HABITAT

Training Impact Evaluation of the Tanzania National Programme for Councillors Training, May 2006

TATA Interactive systems Functional specification document [FSD] for LMS for UN-HABITAT, 2006

TATA Interactive systems Key competencies for local elected leadership course – FSD, 2006Tempelman, H.O. Letter to UN-HABITAT, Mr. Raf Tuts, 10 October 2006 [ref. DCO/OO-

312/06]Tempelman, H.O. Letter to UN-HABITAT, Mr Antoine King, 9 August 2006 [ref. DCO/OO-

229/06]Tempelman, H.O. Letter to UN-HABITAT, Mr Antoine King, 10 October 2005 [ref.

DCO/OO-263/05]Tempelman, H.O. Letter to UN-HABITAT, Mr Antoine King, 11 November 2004 [ref.

DCO/OO-307/04]Tempelman, H.O. Letter to UN-HABITAT, Mr Antoine King, 12 September 2003 [ref.

DCO/OO-243/03]Timo Linkola, the Association of Finnish Local and Regional Authorities

Evaluation of the Good Local Governance and Leadership Training Programme [GLTP], Evaluation report, Final, 20 June 2005

UNDP Report on the “Transformational leadership and key competencies for improved local governance” [Namibia], August 2006

UNESCAP and UN-HABITAT Housing the urban poor; concept note on joint training publications on housing the urban poor [Asia focus]; undated

UN-HABITAT Manual for Evaluation Training’s Impact on Human Settlements, Training Materials Series

UN-HABITAT End of Project Report for DSO 1 Strengthening National Training Institutes for Africa and Asia in Local Government Management and Finance and DSO 2 Capacity Building of African Municipal Training and Development Institutes, April 2002

UN-HABITAT Strengthening National Training Capabilities for Better Local Governance and Urban Development [2002- 2005], Project document, June 2002

UN-HABITAT Forward Looking Evaluation of Gender Mainstreaming in UN-HABITAT, Evaluation report 1/2003

UN-HABITAT Strengthening National Training Capabilities for Better Local Governance and Urban Development [2002- 2005], First year progress report, April 2002 – March 2003, 30 April 2003

UN-HABITAT Manual for Project and Programme Cycle Management, June 2003UN-HABITAT Monitoring and Evaluation Guide, June 2003UN-HABITAT Strengthening National Training Capabilities for Better Local

Governance and Urban Development [2002- 2005], Second year progress report, April 2003 – March 2004, 31 March 2004

UN-HABITAT Strengthening National Training Capabilities for Better Local Governance and Urban Development [2002- 2005], Third year progress report, April 2004-March 2005, 9 May 2005

UN-HABITAT Evaluation of UN-HABITAT’s Global Campaigns for Secure Tenure and Urban Governance, Evaluation report 3/2005

97

Appendix 3: Documentation

UN-HABITAT Making Learning Matter – Training Impact on Performance, Report on Workshop for local government training institutions, Manchester, 4-7 October 2005

UN-HABITAT Expert Group Meeting on Participatory Budgeting, Towards the Design of a Training Companion for Sub-Saharan Africa, 22-25 November 2005

UN-HABITAT Strengthening National Training Capabilities for Better Local Governance and Urban Development [2002- 2005], Fourth year progress report, April 2005-March 2006, May 2006

UN-HABITAT Local Elected Leadership Training – Regional Training Workshop for Eastern and Southern Africa, Pretoria, 7-13 May, 2006, Workshop report

UN-HABITAT Expert group meeting on participatory budgeting – Towards the design of a training companion for sub-Saharan Africa, 22-25 November 2005, United Nations Complex, Gigiri, Nairobi, Kenya

UN-HABITAT Training and Capacity Building, Newsletter [July 2005, February 2006, September 2006,

UN-HABITAT Applying the Web of Institutionalisation for Training Impact Evaluation – case study of the Tanzania National Programme for Councillors Training, November 2006

UN-HABITAT LEL update [Africa], Vol.1, undatedUN-HABITAT Information folder on SUDP - Urban development programme for the

Somali region, undatedUN-HABITAT Financial report and audited financial statements for the biennium

ended 31 December 2005 and Report of the Board of Auditors, Generally Assembly Official records, sixty first session, Supplement No. 5H [A/61/5/Add.8], New York, 2006

UN-HABITAT Strengthening National Training Capabilities for Better Local Governance and Urban Development [2002-2007], Fifth year progress report, April 2006-March 2007, April 2007

UN-HABITAT Terms of Reference for Training Impact Evaluation for Human Settlements Training and Capacity Building Institutions, March 2006

UN-HABITAT African Participatory Budgeting Training Companion; UN-HABITAT comments on draft MDP [May 2007]

UN-HABITAT [et all] Harare communique on Participatory Budgeting in Africa, Harare, Zimbabwe, 6-8 March 2007

UN-HABITAT and ALGAK Project proposal for funding to prepare cities development development strategy [CDS] and state of cities report [SCR] programme for Kenyan urban local authorities, draft 24 March 2007

UN-HABITAT and Ecoplan International

Promoting Local Economic Development through Strategic Planning; Volumes 1-4, 2005

UN-HABITAT and FPDL Restore the health of your organisation – A practical guide to curing and preventing corruption in local governments and communities, Volume 1 and 2, 2006

UN-HABITAT and Katholieke Universiteit Leuven

[Draft] Project document Regional Urban Planning & Design Programme, May 2007

UN-HABITAT and Local Government and Public Service Reform Initiative

Financial Management for Local Government manual; volumes 1-4; 2007

UN-HABITAT/GLTN Expert group meeting Transparency in Land Administration; a capacity building agenda for Africa; Nairobi, 29-31 January 2007

UN-HABITAT/TCCB The World Urban Forum Embraces the capacity building agenda, September 2006

UN-HABITAT/TCCB Training and Capacity Building Branch, Opportunities and Challenges vis-à-vis MTSIP, 14 February 2007

UN-HABITAT/TCCB Update of LEL Action Plans – Local Elected Leadership – Regional training workshop for Eastern and Southern Africa [7-13 May 2006]

UN-HABITAT/TCCB Making Learning Matter – Training Impact Evaluation, note, March 2007

UN-HABITAT/TCCB Capacity Building for Local Participatory Planning, Budgeting and Gender Mainstreaming Programme in Mozambique, Senegal, and D.R. Congo, unofficial note, undated

UN-HABITAT/TCCB Participatory Budgeting – Good governance practice in Sub-Saharan Africa, note, March 2007

Vittrup, Erik C. Summary mission report, Rio de Janeiro, 8 May 2007

98

Appendix 4: Questionnaire

Appendix 4 Questionnaire

Introduction

This questionnaire was developed within the framework of the evaluation of the UN-HABITAT project “Strengthening National Training capabilities for Better Governance and Urban Development” that is financed by the Netherlands Ministry of Foreign Affairs under its Cooperation International Institutions (SII) programme. With the questionnaire, the evaluation team attempts to get some information on the organisations that have participated in this project, the activities they undertake, their views on and use made of UN-HABITAT materials, as well as their involvement in UN-HABITAT organised Training of Trainers events. The questionnaire will be handled with the necessary confidentiality and serves no other purpose than the project evaluation. Your cooperation in completing the questionnaire is very much appreciated.

Basics

Name of the organisation [including acronym]:Address:Country:Year of establishment:Number of permanent professional staff:Date of completion of questionnaire

UN Habitat materials

Strongly agree

Agree

Neutral

Disagree

Strongly disagree Observations

UN-HABITAT materials           Plse specify if needed which materials you base your assessment

99

Appendix 4: Questionnaire

Strongly agree

Agree

Neutral

Disagree

Strongly disagree Observations

on

I/my institute am/is fully familiar with the contents of the UN-HABITAT materials on:             Local Economic

Development [LED]             Local Elected Leadership

Series [LEL]             Building Bridges [BB]

series             Building NGO/CBO

Capacity series             Participatory budgeting

toolkit             Guide to curing and

preventing corruption (draft)            

Local Government Financial Management (draft)            

Training methods and techniques manuals            

Other UN habitat training support materials: please name            

Other UN habitat training methods and techniques: please name            

The UN-HABITAT materials are of good quality            The UNHBATITAT materials fill a vacuum that is not filled by other sources            

100

Appendix 4: Questionnaire

Strongly agree

Agree

Neutral

Disagree

Strongly disagree Observations

I download the UN-HABITAT materials easily from Internet            I buy UN-HABITAT materials            I/my institute can easily afford to buy the UN-HABITAT materials irrespective of the costs            UN-HABITAT materials should be available free of charge            The UN-HABITAT materials are ready for immediate use in my country            We have had to adapt the UN-HABITAT materials to suit our specific circumstances            We have had to adapt the UN-HABITAT by translating language            We have had to adapt the UN-HABITAT materials by modifying content            We prefer to access soft copies of materials as it facilitates adaptation            I/We received external funding for translation and/or adaptation of the UN-HABITAT materials            We published translated and/or adapted materials on our website            We regulalry use the UN-HABITAT materials in our training            We regularly use parts of the            

101

Appendix 4: Questionnaire

Strongly agree

Agree

Neutral

Disagree

Strongly disagree Observations

UN-HABITAT materials in our training

If you collaborated in the development of the materials or discussion on impact assessment:

which subject area[s]?:

    expert group meeting

on-line discussion email other

What was the method of participation?        

strongly agree agree neutral disagree

I had the possibility to make a useful contribution        

Participation in Training of Trainers events

Training of Trainers organised by UN-HABITAT Yes No

Number

Total number of staff

Staff from out institute participated in Training of Trainers organised by UN-HABITAT        

Staff from our institute participated in ToTs organised by [please click box]

FPDL   HSMI   Enda   UTI  

102

Appendix 4: Questionnaire

Yes NoNumber

Total number of staff

Staff participated in ToT related to:         Local Economic Development

[LED]         Local Elected Leadership Series

[LEL]         Building Bridges [BB] series         Building NGO/CBO Capacity

series         Participatory budgeting toolkit         Anti corruption         Municipal Financial

Management        

Strongly agree Agree

Neutral

Disagree

I learned a lot during the ToT        I learned a lot during the ToT in terms of training methodologies        I learned a lot during the ToT in terms of contents        I learned a lot from my colleagues from other training institutions        As a result of the training I have adapted my training approach in my own institution        As a result of the ToT I have adjusted the contents of our training programmes        

103

Appendix 4: Questionnaire

Own training and advisory provision

YesSometimes No

At our institute we provide training based on /using the UN-HABITAT manuals      We particularly use the following manuals       Local Economic Development [LED] Local Elected Leadership Series [LEL] Building Bridges [BB] series Participatory budgeting toolkit Anti corruption Building NGO/CBO Capacity series Participatory budgeting toolkit Guide to curing and preventing corruption

(draft) Local Government Financial Management

(draft) Training methods and techniques manuals Other UN habitat training support materials:

please name Other UN habitat training methods and

techniques: please name

2004 2005 2006 2007

Female MaleFemale

Male

Female

Male

Female Male

Using these manuals, we have provided training & capacity building to the following numbers of participants Local Economic

Development [LED]          104

Appendix 4: Questionnaire

2004 2005 2006 2007

Female MaleFemale

Male

Female

Male

Female Male

Local Elected Leadership Series [LEL]          

Building Bridges [BB] series          

Participatory budgeting toolkit          

Anti corruption           Building NGO/CBO

Capacity series           Participatory budgeting

toolkit           Guide to curing and

preventing corruption (draft)          

Local Government Financial Management (draft)          

Training methods and techniques manuals          

Other UN habitat training support materials- name:          

Other UN habitat training methods and techniques- name:

If you charged for training, who paid?

Central govt

state or provincial government

local government Project other

     

Where there was a charge more 100% 50- 1- non Not 105

Appendix 4: Questionnaire

what proportion of costs was covered? than full 99% 50% e known

       

Did you find the client who paid had clear demands for the training?

very clear demands

somewhat clear

no specific demands

     

Yes Sometimes No

In addition to training and capacity building we also provide consultancy services      Our main clients are       Local Governments       District/provincial authorities       National authorities       Associations of local authorities       NGOs and CBOs       UN organisations       Bilateral projects       Other      Our main areas of advice are Local Economic Development       Local Elected Leadership       NGO/CBO capacity building       Financial management       participatory planning       Participatory budgeting       Anti corruption       Training advice       Other

106

Appendix 4: Questionnaire

If you have any other observations you want to share, please provide these in the box below.

Thank you for your participation.

107

Appendix 5: Timing of key events

Appendix 5: Timing of key events  Regional

strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

1997

     

Sub-regional workshop and training of trainers for local government elected officials for Southern African countries, Zambia

Malawi, Namibia, Tanzania, Zambia

13 ToT Workshop on elected leadership Lesotho 12  

     Local government for elected officials in Southern Africa, training of councillors, Namibia

  37 National ToT on elected leadership Namibia 14  

1998

Regional workshop on decentralisation and local governance, Kenya

Kenya, Tanzania, Uganda

35

Sub-regional Training of Trainers workshop on leadership and management for local government elected officials in South East Asian countries, India

Bangladesh, India, Maldives, Nepal, Pakistan, Sri Lanka

21

ToT for local government councillors and technical officers and on strategic management skills for town clerks and treasurers

Uganda 46  

Regional workshop on education and training for local government, South Africa

Eastern African and other countries

80      National ToT on elected leadership [together with Localising Agenda 21 Programme]

Morocco 24  

Sub-regional capacity building strategy workshop Management and Leadership of NGOs/CBOs and on NGO/CBO local government collaboration in Sub-Saharan countries, Kenya

Cameroon, Ghana, Nigeria. Senegal, South Africa, Tanzania, Uganda, Zambia, Zimbabwe

47              

1999

Local government capacity building strategies 2000 workshop for South Asian countries, India

Bangladesh, Bhutan, India, Maldives, Nepal, Sri Lanka

47

Sub-regional ToT Workshop on the "Councillor as Guardian of the Environment" and elected leadership, Kenya

Kenya, Tanzania, Uganda

36National ToT on leadership and management for elected officials

Zambia 24  

            National training workshop on the Councillor as Guardian of the Environment

Kenya 22  

108

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

           National training workshop on the Councillor as Guardian of the Environment

Kenya 57  

           National ToT and pilot workshop for elected leadership

Tanzania 18  

           

National ToT and strategic planning workshop on local government leadership and management

Ethiopa 23  

2000                    

2001

Review and validation workshop on the NGO/CBO manuals Building organisational and outreach capacity

Kenya, Tanzania, Uganda

16

Atelier de formation des formateurs sur la governance et le leadership local et atelier pilote de sensibilisation des élus sur leadership, Senegal

Mauritania, Ivory Coast, Mali

19National ToT on elected leadership and Councillor as Guardian of the Environment

Kenya 15  

     Regional ToT Workshop on Training for Elected Leadership series, Senegal

Burkina Faso, Chad, Ivory Coast, Mali, Mauritania, Togo

14 National ToT on elected leadership Cameroon 15  

           Atelier pilot de sensibilisation des élus Camerounais au leadership local

Cameroon 21  

           Refresher ToT and adaptation workshop on elected leadership

Tanzania 14  

            National ToT on elected leadership

Madagascar 18  

2002

            National ToT and Pilot Workshop for Local Government Elected Officials in Nigeria, 10-21 Jun 2002 Abuja, Nigeria

Nigeria 24 Expert Group Meeting (LEL-EGM), 8-11 Oct 2002, Nyeri, Kenya [16 participants]

109

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

     Building NGO/CBO Capacity ToT 11-23 May, 2002 Sinaia, Romania

Albania, Armenia, Azerbaijan, Bosnia & Herxegovina, Croatia, Czech Republic, Georgia, Kenya, Kosovo, Kyrguzstan, Latvia, Lithuania, Moldova, Russian Federation, Serbia, Tajikistan, Turkey, Ukraine

21      (LGFM-EGM) Expert Group Meeting, 29Sep-04Oct, 2002 Naivasha, Kenya [21 participants]

     Building Bridges ToT Managing Conflicts and Differences, 5-11 Oct, 2002 Bucharest Romania

Albania, Azerbaijan, Brasil, Chile, Croatia, Czech Republic, Georgia, Kenya, Kosovo, Macedonia, Montenegro, Moldova, Serbia, Tajikistan, Ukraine

20        

2003

     

Regional Training of Trainers on Governance, Local Leadership and Participatory Urban Planning and Decision-Making, May 25-31, 2003, Ismailia, Egypt

Egypt, Jordan, Lebanon, Lybia, Mauritania, Morocco, Sudan

22

Strategy Planning Workshop for Training and Capacity Building for Local Authorities in Kenya, 9-10 Dec 2003, Gigiri, Nairobi, Kenya [76 participants]

Kenya 76

Expert Group Meeting on Local Government Financial Management Series, September 29-October 4 2003, Naivasha Kenya

      Training of Trainers on Elected Leadership for the East African Sub-Region, May 25-June 7, 2003, Mombasa, Kenya

Ethiopia, Kenya, Mozambique, Tanzania, Uganda

15        

110

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

     Building Bridges - through Participatory Planning, 23-29 Nov 2003 Nyeri, Kenya

Ethiopia, Kenya, Romania, Senegal, Somalia, Tanzania, Uganda, Zimbabwe

28        

     Building Bridges - through Conflict Management, 17-22 Nov 2003 Nyeri, Kenya

Ethiopia, Kenya, Romania, Senegal, Somalia, Tanzania, Uganda, Zimbabwe

27        

     

Regional Programme "Working Together", Building Bridges between Citizens and local Governments through Participatory Planning, 17-23 May 2003 Sinaia, Romania

Estonia, Georgia, Kenua, Latvia, Macedonia, Moldova, Romania, Russian Federation, Serbia, Montenegro, Turkey, Ukraine

20        

2004

Strategic Planning for Local Economic Development: Training of Trainers and Field Testing/Evaluation of Training Materials, 3-5 Nov 2004, Iloilo, Philippines

Canada, Philippines 60

Training of Trainers Workshop for South Asia on Local Government Leadership and Management Skills, 11-22 Jan 2004, New Delhi, India

Afghanistan, Bangladesh, India, Indonesia, Nepal, Sri Lanka

18

Training Course on Conflict Resolution (Interest based mediation), 1-5 Sept 2004 Pokhara, Nepal

Nepal 17  

Strategic Planning for Local Economic Development: Training of Trainers and Field Testing/ Evaluation of Training Materials, 14-19 June 2004 Lusaka, Zambia

Zambia 15 Regional Program for Capacity Building in Governance and Local Leadership for Central, East and Southeast European Countries (Testing of LED), 15-24 April 2004, Romania

Bosnia & Herzegovina, Bulgaria, Canada, Moldova, Romania

14        

111

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

     Regional ToT on Local Conflict Resolution, 24-30 April 2004 Kathmandu, Nepal

China, India, Indonesia, Korea, Malaysia, Nepal, Philippines, Sir Lanka

26        

2005

Making Learning Matter: Training Impact on Performance (TIP), 4-7 Oct 2005 Manchester, UK

Afghanistan, Brazil, Cambodia, Canada, China, Egypt, India, Kenya, Kosovo, Netherlands, Philippines, Romania, Senegal, South Africa, UK, Zimbabwe

29

Training and Capacity Building for Local Elected Leaders in Francophone West Africa and Madagascar, Senegal, 14-25 June, 2005

Benin, Burkina Faso, Burundi, Cameroon, Madagascar, Mali, Mauritania, Morocco, Niger, Nigeria, Rwanda, Senegal

27

Strategic Framework for Training and Capacity Building for Local Authorities in Kenya, 19 Jan 2005 Nairobi, Kenya

Kenya 28

Expert Group Meeting on Leadership and Management Skills Training Manuals for Local Government Elected Officials, October 8-11 2005, Nyeri Kenya

     

South-Asia Sub-Regional Training of Trainers on Local Government Leadership and Management Skills, January 11-22, 2005, New Delhi, India

         

Expert Group Meeting on Participatory Budgeting, 22-25 November 2005 in Nairobi, Kenya

     

Participatory Processes in Integrated Programme Development and Management Capacity Building Workshop {Society for Development Studies (SDS)} 14-17 Mar 2005 New Delhi, India

India, Nepal, Pakistan, Philippines, Sri Lanka

19        

      Training of Trainers on Local Government and NGO/CBO Collaboration on Participatory Planning, May 20-23, 2005, Suwon City, Korea

Afghanistan, Bangladesh, China, Fiji, Indonesia, Maldives, Mongolia, Nepal, Papua New Guinea, Philippines, Sri Lanka, Thailand

33 Local Elected Leadership Training of Trainers, May 15-22, 2005, Sinaia, Romania

Romania   EGM on Capacity Building for Housing the Urban Poor, 24-26 Jun 2005, Udo Thani, Thailand

112

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

     LAC LED Regional Conference, 4-6 Oct 2005 Quito, Ecuador

Argentina, Bolivia, Brazil, Canada, Chile, Colombia, Costa Rica, Ecuador, El Salvador, Guatemala, Honduras, Mexico, Nicaragua, Panama, Paraguay, Peru, USA, Uruguay, Venezuela

         

     Regional Programme "Working Together", Elected Leadership ToT (LEL) 15-22 May 2005 Sinaia, Romania

Albania, Armenia, Bosnia & herzegovia, Bulgaria, Croatia, Egyot, Coergia, Hungary, India, Kenya, Macedonia, Moldova, Nigeria, Poland, Romania, Senegal, Serbia & Montenegro

24        

      Strategic Planning for Local Economic Development Capacity Building Conference and Workshop, 29-31 Mar 2005 Valparaiso and Vina del Mar, Chile

Argentina, Brazil, Canada, Chile, Costa Rica, Honduras, Mexico

45        

113

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

     Participatory budgeting, 22-25 November 2005, Gigiri, Kenya

Benin, Cameroon, Ecuadir, Ethiopia, Kenya, Lesotho, Madagascar, Namibia, Nigeria, Senegal, Tanzania, Uganda, Zambia, Zimbabwe

33        

2006

Workshop on promoting local economic development through participatory planning, 21-22 March 2006

Australia, Bangladesh, China, India, Indonesia, Kenya, Malaysia, Nepal, Philippines, Sri Lanka, Thailand

25

Local Elected Leadership Training of Trainers workshop for South Asia, 27 January to 2 February 2006 New Delhi, India

Bangladesh, China, Fiji, India, Korea, Malaysia, Nepal, Philippines, Sri Lanka

38Local Elected Leadership Training for Madibeng Municipality, South Africa September 2006

South Africa  

Expert Group Meeting on Participatory Budgeting for Africa, 22-25 November, 2006 Nairobi, Kenya.

Workshop on LOGOTRI General Council Meeting (23-24 March 2006). 23-24 March 2006 China

Australia, Bangladesh, China, India, Indonesia, Kenya, Malaysia, Nepal, Philippines, Sri Lanka, Thailand

25

Local Elected Leadership Training of Trainers Workshop and Pilot Seminar for South Pacific, 27 March - 8 April 2006, Suva, Fiji

Fiji, Kiribati, Papua New Guinea, Samoa, Solomon Islands, Tonga, Tuvalu, Vanuatu

60

National Local Elected Leadership and transformational leadership Training ,Namibia, August 2006

Namibia    

LED Pre – WUF III event, Canada June 2006

Various 52 Training of Trainers Workshop on Local Elected Leadership (LEL) for Eastern and Southern Africa Region, 6-12 May 2006 Pretoria, South Africa.

Egypt, Ethiopia, Kenya, Lesotho, Mozambique, Namibia, South Africa, Sweden, Tanzania, Sweden

39 National training and adaptation on Local Economic Development – Vietnam, 2006

Vietnam    

114

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

Vancouver - Towards Inclusive Cities: How to walk the talk, 20 June 2006

Various 49

Regional Training workshop on Promoting Local Economic Development through Strategic Planning for Arab Region; 19 –23 November , 2006, Cairo, Egypt

Canada, Egypt, Iraq, Jordan, Lebanon, Palestine, Sudan, Switzerland, Syria, Yemen

39 LED strategy workshop, 1-4 August 2006, Horezu Romania    

     Municipal planning and service delivery course, 31 October - 24 November 2006,

Ethiopia, Kenya, Lesotho, Nepal, Rwanda, Tanzania, Uganda

23Network for Urban Design and Planning Seminars, Latin America, Asia and Europe

Brazil, Ecuador, Peru, Bangladesh, India, Pakistan, Kosovo, Macedonia, Romania, Serbia

   

     

Regional Training workshop on Promoting Local Economic Development through Strategic Planning for Eastern Africa; 22-25 May 2006, Nyeri , Kenya

Canada, Israel, Kenya, Rwanda, Tanzania, Uganda

30        

2007

Participants project meeting Urban Design and Planning Seminar, 9-10 February 2007

Belgium, Burundi, Rwanda

18Regional Workshop on Participatory Budgeting for Africa, 6 -8 March 2007, Harare, Zimbabwe

Ethiopia, Kenya, Malawi, Mozambique, Rwanda, Senehal, South Africa, Tanzania, Uganda, Zambia, Zimbabwe

41

Local Elected leadership national Training within the context of Slum upgrading programme, Ismailia, Egypt, February, 2007

Egypt  

Expert group meeting on Transparency in Land administration at the UN headquarters in Nairobi , Kenya on 29-31 January 2007

Urban design and planning seminar, 8 February 2007

Belgium, Kenya, Tanzania

23Regional TOT on Localizing. MDGs, Nepal - end March 2007

Bangladesh, India, Indonesia, Japan, Nepal, Netherlands, Philippines, Sri Lanka, Taiwan, Thailand, Tiber, Vietnam, USA

64Local Elected Leadership Training for Maseru City Council, Lesotho, May 2007

Lesotho  Expert group meeting on Gender, Kampala, Uganda, 15-19 May 2007

            CLGF Commonwealth Local Government meeting, 27-30 March 2007

Fiji    

115

Appendix 5: Timing of key events

  Regional strategy workshops

CountriesParticipant

Regional Training of Trainers workshops Countries

Participant

National ToT workshops Country

Participant

Expert group meetings

           Haiti National TOT on Local Elected leadership - 24 April to 7 May 2007

Haiti    

           

National Workshop on Managing conflicts and Differences within the context of Slum Upgrading programme, Ismailia , Egypt, 10-17 February 2007

Egypt    

116