ecshd projects

11

ECSHD ProjectsECSHD Projects

Governance and Accountability AgendaGovernance and Accountability Agenda

An Assessment of PADsAn Assessment of PADs

October 1, 2008October 1, 2008

22

Definition of Governance and AccountabilityDefinition of Governance and Accountability

Governance Defined:Governance Defined:

We (World Bank/WBI/Daniel Kaufmann) define governance asWe (World Bank/WBI/Daniel Kaufmann) define governance asThe traditions and institutions by which authority in a country is exercised for the The traditions and institutions by which authority in a country is exercised for the

common good. This includes:common good. This includes:(i)(i) the the processprocess by which those in authority are selected, monitored and replaced, by which those in authority are selected, monitored and replaced,(ii)(ii) the the capacitycapacity of the government to effectively manage its resources and of the government to effectively manage its resources and

implement sound policies; and (ojo!)implement sound policies; and (ojo!)(iii)(iii) the the respectrespect//trusttrust of citizens and the state for the institutions that govern of citizens and the state for the institutions that govern

economic and social interactions among them.economic and social interactions among them.

Accountability defined:Accountability defined:

i.i. LiableLiable to be called to account, or to answer for responsibilities and conduct; to be called to account, or to answer for responsibilities and conduct; answerable, responsible. (OED – Oxford English Dictionary)answerable, responsible. (OED – Oxford English Dictionary)

ii.ii. "A is accountable to B when A is "A is accountable to B when A is obliged to informobliged to inform B about A’s (past or future) B about A’s (past or future) actions and decisions, to justify them, and to suffer actions and decisions, to justify them, and to suffer punishmentpunishment in the case of in the case of eventual misconduct.“ (Andreas Schedler 1999).eventual misconduct.“ (Andreas Schedler 1999).

iii.iii. ““pro-active pro-active processprocess by which public officials inform about and justify their plans of by which public officials inform about and justify their plans of action, their behavior and results and are action, their behavior and results and are sanctioned sanctioned accordingly” and accordingly” and distinguishes it from similar concepts such as transparency, oversight, and distinguishes it from similar concepts such as transparency, oversight, and responsivenessresponsiveness (John M. Ackerman / WBI, 2005) (John M. Ackerman / WBI, 2005)

33

What is this exercise about?What is this exercise about?

This is a review and stocktaking of This is a review and stocktaking of Project Appraisal Documents (PADs) Project Appraisal Documents (PADs) for their discussion of GAC in for their discussion of GAC in enhancing service delivery in HD enhancing service delivery in HD sectors. sectors.

It is not a review or stocktaking of It is not a review or stocktaking of any activities in implementation.any activities in implementation.

44

The Process of This GAC AssessmentThe Process of This GAC Assessment

A questionnaire with key questions was designed A questionnaire with key questions was designed In order to answer the questionnaire, All 64 PADs In order to answer the questionnaire, All 64 PADs

or the total portfolio of ECSHD projects was or the total portfolio of ECSHD projects was reviewed (when projects were restructured, the reviewed (when projects were restructured, the restructuring documentation was examined too) restructuring documentation was examined too)

The questionnaire was filled out and sent to the The questionnaire was filled out and sent to the TTLs for commentsTTLs for comments

The questionnaire was in the form of a series of The questionnaire was in the form of a series of Yes or NoYes or No answers accompanied by explanations answers accompanied by explanations

There were no right or wrong answers as the There were no right or wrong answers as the situation in each country/sector differssituation in each country/sector differs

Results were then aggregated for all ECSHD Results were then aggregated for all ECSHD active projects active projects

55

The questionnaire includes three (GAC) The questionnaire includes three (GAC) sections about what was written in the PAD sections about what was written in the PAD

regardingregarding::

1.1. Changes in the processes and/or rules Changes in the processes and/or rules for service deliveryfor service delivery

2.2. Allocation of project Allocation of project resources/activities to key GAC areasresources/activities to key GAC areas

3.3. Ways to measure/track Governance Ways to measure/track Governance indicators indicators

66

The questionnaireThe questionnaire

Does the Project Include changes in the processes Does the Project Include changes in the processes and or Rules for Service Delivery in:and or Rules for Service Delivery in:

For Example:For Example:

Borrow institutions relevant to the projectBorrow institutions relevant to the project Russia: TB AIDs Min. of Health protocols for diagnostics, treatment, Russia: TB AIDs Min. of Health protocols for diagnostics, treatment, epidemiological and behavioral surveillance…epidemiological and behavioral surveillance…

The way service recipients provided feedback to the The way service recipients provided feedback to the authorities or relevant institutionsauthorities or relevant institutions

Bulgaria Health Sector Reforms: Bulgaria Health Sector Reforms: Hot lines at National Health Insurance Fund and 28 Regional Insurance Funds to Hot lines at National Health Insurance Fund and 28 Regional Insurance Funds to provide information and to receive complaintsprovide information and to receive complaints

The way the borrower institutions measures impact The way the borrower institutions measures impact and client satisfactionand client satisfaction

Montenegro Education Reform: The National Assessment Evaluation.Montenegro Education Reform: The National Assessment Evaluation.

Are Project resources/activities allocated to:Are Project resources/activities allocated to:

Building environment to comply with the rules in the Building environment to comply with the rules in the provision of servicesprovision of services

BiH Social Insurance TA-subcomponent would identify and implement mechanisms BiH Social Insurance TA-subcomponent would identify and implement mechanisms to consolidate social insurance revenue collection and enforcement system consistent to consolidate social insurance revenue collection and enforcement system consistent with tax admin. Reforms. Supported by development of a clearer framework for with tax admin. Reforms. Supported by development of a clearer framework for systems harmonization and data exchange across various institutions involved in the systems harmonization and data exchange across various institutions involved in the reporting and enforcement of taxes and social contributions and of implementing reporting and enforcement of taxes and social contributions and of implementing social insurance programssocial insurance programs

Monitor compliance in the provision of servicesMonitor compliance in the provision of services Kyrgyz Rural Education: Teach incentive system incorporates monitor compliance in Kyrgyz Rural Education: Teach incentive system incorporates monitor compliance in the provision of servicesthe provision of services

77

Questionaire (continued)Questionaire (continued)

Are Project resources/activities allocated to:Are Project resources/activities allocated to: ExamplesExamples

Provide incentives to follow the rules in the provision of Provide incentives to follow the rules in the provision of servicesservices

Albania Social Sector Development: Subcomponent 2: a sustainable Albania Social Sector Development: Subcomponent 2: a sustainable system for financing social services with incentives favoring system for financing social services with incentives favoring community based services rather then institutional care. community based services rather then institutional care. BiH Community Development: BiH Community Development: The system is build up in such a way The system is build up in such a way that is almost self-policing. “The incentive for performance would be that is almost self-policing. “The incentive for performance would be successive larger grants based on good performance or ineligibilitysuccessive larger grants based on good performance or ineligibility for further grants based on poor performance”for further grants based on poor performance” Romania Social Sector Development Component IV, ii states “(ii) Romania Social Sector Development Component IV, ii states “(ii) introducing national eligibility criteria and benefit levels. The MIG introducing national eligibility criteria and benefit levels. The MIG program would aim to reach the poorest households, approximately program would aim to reach the poorest households, approximately the bottom 10 percent of the population. The program incorporates the bottom 10 percent of the population. The program incorporates work incentives, by keeping benefit levels low and discounting a share work incentives, by keeping benefit levels low and discounting a share of earned income for households with income levels close to the of earned income for households with income levels close to the benefit threshold.”benefit threshold.”

Sanction violations in the provision of servicesSanction violations in the provision of services Romania Rural Education: Establishment of Romania Rural Education: Establishment of procedures/rules and regulations on the update and procedures/rules and regulations on the update and consultation of the NED with formal sanctions through consultation of the NED with formal sanctions through ministerial ordinance or higher level legislation.ministerial ordinance or higher level legislation.

Enhance Government’s and or the service providers’ Enhance Government’s and or the service providers’ capacity to implement sound policies for service provision capacity to implement sound policies for service provision

Ukraine Social Investment Fund. Component providing Ukraine Social Investment Fund. Component providing resources for training and institution building of local based resources for training and institution building of local based institutions.institutions.

Are there Indicators in the PAD to capture Governance Are there Indicators in the PAD to capture Governance contribution and how manycontribution and how many

Increased accountability as measured by citations of school Increased accountability as measured by citations of school report cards in local newspapersreport cards in local newspapers

88

ECSHD ProjectsECSHD Projects!!

64 active project PADs were 64 active project PADs were assessedassessed

They include:They include:– 22 Health Projects22 Health Projects– 19 Education Projects 19 Education Projects – 23 Social Protection Projects (Pensions, 23 Social Protection Projects (Pensions,

Social Protection, Employment, Social Social Protection, Employment, Social Funds, Community works)Funds, Community works)

99

Health (22)Health (22)

1010

Education (19)Education (19)

1111

Social Protection (23)Social Protection (23)

1212

Overall ResultsOverall Results

Does the project includes changes in the Does the project includes changes in the processes and/or rules for service delivery processes and/or rules for service delivery regarding:regarding:

YesYes%%

Borrower Borrower institutionsinstitutions relevant to this relevant to this projectproject

8787

The way service recipients provide The way service recipients provide feedbackfeedback to the authorities/relevant to the authorities/relevant institutions institutions

5959

The way the borrower institutions The way the borrower institutions measures impact/client satisfactionmeasures impact/client satisfaction 6262

1313

Overall ResultsOverall Results

Are there project Are there project resources/activities for: resources/activities for:

YesYes %%

Building environment to comply with the rules in Building environment to comply with the rules in the provision of services the provision of services 8787monitoring compliance in the provision of monitoring compliance in the provision of services services 9090providing incentives to follow the rules in the providing incentives to follow the rules in the provision of services provision of services 4242sanctioning violations in the provision of sanctioning violations in the provision of services services 33enhancing Government's and/or the service enhancing Government's and/or the service providers' capacity to implement sound policies for providers' capacity to implement sound policies for service provisionservice provision

9898

1414

Outcome and Process IndicatorsOutcome and Process Indicators

95% or 61 PADs included GAC indicators.95% or 61 PADs included GAC indicators.

A total of 441 GAC related indicators in the 64 projectsA total of 441 GAC related indicators in the 64 projects

On average there were 7 GAC related indicators per projectOn average there were 7 GAC related indicators per project

Most of the GAC indicators were process related intermediate indicatorsMost of the GAC indicators were process related intermediate indicators

156 or 35% were outcome indicators156 or 35% were outcome indicators

In some cases , the project is entirely focused on building and measuring In some cases , the project is entirely focused on building and measuring governance and accountability (15 to 19 GAC Indicators )governance and accountability (15 to 19 GAC Indicators )

In 3 projects, or about 5 %, no GAC indicators were identified In 3 projects, or about 5 %, no GAC indicators were identified

Sometimes, GAC indicators are too diffused and subsumed in broader indicatorsSometimes, GAC indicators are too diffused and subsumed in broader indicators

In most cases, indicators track progress in processes (Intermediate Indicators)In most cases, indicators track progress in processes (Intermediate Indicators)

GAC outcome indicators in most PADs (PDO Indicators)GAC outcome indicators in most PADs (PDO Indicators)

1515

GAC Related Outcome and Process IndicatorsGAC Related Outcome and Process Indicators

SectorsSectors Health (22)Health (22) Social Protection (23)Social Protection (23)Social Assistance/Cash Social Assistance/Cash Benefits: (18)Benefits: (18)

SIFS (5)SIFS (5)

Education (18)Education (18)

OutcomeOutcome 7474 6868Social Assistance/Cash Social Assistance/Cash Benefits: (59)Benefits: (59)

SIFS (10)SIFS (10)

3333

ProcessProcess 120120 8282Social Assistance/Cash Social Assistance/Cash Benefits: (72)Benefits: (72)

SIFs (10)SIFs (10)

7676

Average # of Average # of IndicatorsIndicators

99 66 66

Total GAC Total GAC IndicatorsIndicators

194194 150150Social Assistance/Cash Social Assistance/Cash Benefits: ( 130)Benefits: ( 130)

SIFs (20)SIFs (20)

109109

1616

Examples of Heath Projects and GAC IndicatorsExamples of Heath Projects and GAC Indicators

Uzbekistan Second Health Uzbekistan Second Health 1.1. (O) Rationalization of outpatient and hospital services extended to new regions; new payment (O) Rationalization of outpatient and hospital services extended to new regions; new payment

systems replicated for primary care and new payment systems piloted for specialty and hospital systems replicated for primary care and new payment systems piloted for specialty and hospital services. Facility type resource allocation formulae are refined.services. Facility type resource allocation formulae are refined.

2.2. Capitation formula simplified; decisions for input mix and allocation for services are decentralized to Capitation formula simplified; decisions for input mix and allocation for services are decentralized to regional and rayon levels; community organizations more involved in management of local facilities.regional and rayon levels; community organizations more involved in management of local facilities.

3.3. Primary care facilities obtain independent juridical status, establish bank accounts, have flexibility Primary care facilities obtain independent juridical status, establish bank accounts, have flexibility over management of input mix.over management of input mix.

4.4. (O) increase in SVP utilization; referral decreasing; admissions decreasing; beds and facilities (O) increase in SVP utilization; referral decreasing; admissions decreasing; beds and facilities consolidating/or decreasingconsolidating/or decreasing

5.5. (O) Functioning training programs for GPs and universal nurses, public health experts, health policy (O) Functioning training programs for GPs and universal nurses, public health experts, health policy experts and financial managers successfully established and in place.experts and financial managers successfully established and in place.

6.6. (O) Well functioning monitoring and evaluation process in place, utilizing both facility and surveys (O) Well functioning monitoring and evaluation process in place, utilizing both facility and surveys and household surveys on periodic basis.and household surveys on periodic basis.

7.7. (O) Measurable shift in allocations from impatient to outpatient care; improved allocative efficiency (O) Measurable shift in allocations from impatient to outpatient care; improved allocative efficiency in urban pilot centers; improved technical efficiency for hospitals (secondary level) services in in urban pilot centers; improved technical efficiency for hospitals (secondary level) services in hospital pilot regions.hospital pilot regions.

8.8. Improved share of expenditures for i) recurrent costs relative to fixed assets, and ii)cost effective Improved share of expenditures for i) recurrent costs relative to fixed assets, and ii)cost effective primary care services relative to secondary/tertiary care servicesprimary care services relative to secondary/tertiary care services

9.9. Introduction of a nation-wide provider payment system based on capitated financing for rural PHC Introduction of a nation-wide provider payment system based on capitated financing for rural PHC facilities.facilities.

10.10. Conversion of at least half of rural PHC facilities in Uzbekistan as independent legal entities with Conversion of at least half of rural PHC facilities in Uzbekistan as independent legal entities with sufficient financial and management autonomysufficient financial and management autonomy

11.11. Improved health information system for financing strategies/systems and use of HIS data at all Improved health information system for financing strategies/systems and use of HIS data at all levels of the financial system. levels of the financial system.

12.12. Introduction of hospital payment systems in 3 regions.Introduction of hospital payment systems in 3 regions.

1717


Macedonia Health Sector ManagementMacedonia Health Sector Management1.1. (O) Reduction in administrative costs and personnel input for the issuance of the health insurance cards.(O) Reduction in administrative costs and personnel input for the issuance of the health insurance cards.2.2. (O) Reduction in the number of drugs purchased in the non-HIF contracted pharmacies and reimbursed by (O) Reduction in the number of drugs purchased in the non-HIF contracted pharmacies and reimbursed by

HIFHIF3.3. (O) Decline in out of pocket payments for health care and drugs amongst groups eligible for co-payments (O) Decline in out of pocket payments for health care and drugs amongst groups eligible for co-payments

waiverswaivers4.4. (O) 15 guidelines developed according to international standards and distributed(O) 15 guidelines developed according to international standards and distributed5.5. (O)Yearly HIF audits acceptable(O)Yearly HIF audits acceptable6.6. (O)Average length of drugs registration reduced by 25%(O)Average length of drugs registration reduced by 25%7.7. (O) All practicing doctors, dentists and pharmacists licensed in accordance with the new procedures.(O) All practicing doctors, dentists and pharmacists licensed in accordance with the new procedures.8.8. (O) 30% of contracted health care providers complying with newly developed clinical guidelines(O) 30% of contracted health care providers complying with newly developed clinical guidelines9.9. Mid term MoH health sector strategy developed and approved. The strategy should specify MoH policies Mid term MoH health sector strategy developed and approved. The strategy should specify MoH policies

on: privatization of health care services; pharmaceutical regulations; licensing of primary health care on: privatization of health care services; pharmaceutical regulations; licensing of primary health care providers.providers.

10.10. Public information strategy for health reforms developed and applied to health sector policy development Public information strategy for health reforms developed and applied to health sector policy development in privatization of health care services and pharmaceutical regulations.in privatization of health care services and pharmaceutical regulations.

11.11. Public expenditure tracking survey (PETS) of funding for priority public health services completedPublic expenditure tracking survey (PETS) of funding for priority public health services completed12.12. HIF providing guidelines on budget developmentHIF providing guidelines on budget development13.13. Action plan for improving revenue collection based on external audit of HIF implementedAction plan for improving revenue collection based on external audit of HIF implemented14.14. HIF Board structure and operation revisedHIF Board structure and operation revised15.15. Internal audit unit functionalInternal audit unit functional16.16. Hospital contracts revised on the basis of evaluation study of first phase of hospital contract Hospital contracts revised on the basis of evaluation study of first phase of hospital contract

implementation.implementation.17.17. At least 75 percent of contracted primary health care providers and hospital are correctly collecting and At least 75 percent of contracted primary health care providers and hospital are correctly collecting and

analyzing data for contract compliance.analyzing data for contract compliance.18.18. Business plans for improving quality and efficiency developed and implemented in at least 20 percent of Business plans for improving quality and efficiency developed and implemented in at least 20 percent of

all hospitalsall hospitals19.19. Project deliverables are implemented and evaluated in an efficient manner and on a timely basisProject deliverables are implemented and evaluated in an efficient manner and on a timely basis

1818


Russia: Health Reform Implementation Project.Russia: Health Reform Implementation Project.1.1. Increase equity through geographical and financial accessibility of health servicesIncrease equity through geographical and financial accessibility of health services2.2. Reduced percentage of funding from out of pocket (informal plus formal) paymentsReduced percentage of funding from out of pocket (informal plus formal) payments3.3. Increased efficiency through deployment of resources for evidence based health Increased efficiency through deployment of resources for evidence based health

servicesservices4.4. Increased proportion of population and service providers satisfied with specified Increased proportion of population and service providers satisfied with specified

aspects of health care systemaspects of health care system5.5. (O) New evidence based clinical guidelines developed and issued by MOH(O) New evidence based clinical guidelines developed and issued by MOH6.6. (O) New criteria and procedures for unified licensing issued by MOH(O) New criteria and procedures for unified licensing issued by MOH7.7. (O) New strategy developed and approved for human resource development (O) New strategy developed and approved for human resource development

including recruiting, staff development and deployment (related to new clinical including recruiting, staff development and deployment (related to new clinical guidelines)guidelines)

8.8. (O)Health sector salary system is reformed(O)Health sector salary system is reformed9.9. (O)Hospitals and other health care services complying with clinical guidelines.(O)Hospitals and other health care services complying with clinical guidelines.10.10. (O)Degree of patient satisfaction with health services stratified by income strata.(O)Degree of patient satisfaction with health services stratified by income strata.11.11. Decrease in the number of re-admissions for the same conditions within a 3 month Decrease in the number of re-admissions for the same conditions within a 3 month

period.period.

1919

Examples of Social Protection GAC indicatorsExamples of Social Protection GAC indicators

Croatia Pension Systems InvestmentCroatia Pension Systems Investment

1.1. (O)Continued operation of unified reporting and collection of mandatory (O)Continued operation of unified reporting and collection of mandatory contributions and income tax.contributions and income tax.

2.2. (O)Reduced institutional overlap in reporting and collecting of mandatory (O)Reduced institutional overlap in reporting and collecting of mandatory contributions and income taxescontributions and income taxes

3.3. (O) Improved functioning of Pension institute as measured by timeliness of overall (O) Improved functioning of Pension institute as measured by timeliness of overall functionsfunctions

4.4. HAGENA and REGOS continue to function effectivelyHAGENA and REGOS continue to function effectively

5.5. Monthly flow of data exchange between FINA and REGOS and other institutions Monthly flow of data exchange between FINA and REGOS and other institutions done on timely and secure basisdone on timely and secure basis

6.6. Compliance rates in new revenue system including timeliness of reporting by Compliance rates in new revenue system including timeliness of reporting by employers and self employed.employers and self employed.

7.7. Fund managers investing in different classes of assets in accordance with portfolio Fund managers investing in different classes of assets in accordance with portfolio rulesrules

8.8. Data flows form HAGENA and REGOS flowing to fund managers on agreed time Data flows form HAGENA and REGOS flowing to fund managers on agreed time basis and on agreed levels of reliability.basis and on agreed levels of reliability.

2020


Macedonia Social Protection Macedonia Social Protection 1.1. (O) Evidence of improved solvency and improved effectiveness of the pension system following (O) Evidence of improved solvency and improved effectiveness of the pension system following

implementation of the reform program.implementation of the reform program.2.2. (O) Evidence of improved targeting and administration of cash benefits.(O) Evidence of improved targeting and administration of cash benefits.3.3. Regular monthly reporting on pension contributions paid on individual basis introduced and Regular monthly reporting on pension contributions paid on individual basis introduced and

individual accounts established.individual accounts established.4.4. Further pension reform measures identified and implemented to improve long term sustainability, Further pension reform measures identified and implemented to improve long term sustainability,

adequacy and transparency of the pension system.adequacy and transparency of the pension system.5.5. Actuarial models of the pension system developed and the MLSP, PDF and MAPAS staff trained in Actuarial models of the pension system developed and the MLSP, PDF and MAPAS staff trained in

using them and developing options for further policy changes.using them and developing options for further policy changes.6.6. Evidence of established business processes and practices within MAPASEvidence of established business processes and practices within MAPAS7.7. Regulatory framework established.Regulatory framework established.8.8. Pension fund custody rules and regulations developed and usedPension fund custody rules and regulations developed and used9.9. NBRM Custody staff trained in custody issuesNBRM Custody staff trained in custody issues10.10. Financial and management structures for coherent management of cash benefits and employment Financial and management structures for coherent management of cash benefits and employment

and labor market policies developed and implemented and staff skills and capacity enhanced.and labor market policies developed and implemented and staff skills and capacity enhanced.11.11. Monitoring and evaluation systems established information and data management system, budget, Monitoring and evaluation systems established information and data management system, budget,

accounting, audit and financial system and inspection and quality assurance function established.accounting, audit and financial system and inspection and quality assurance function established.12.12. Evidence that an improved MIS system is in place and is being used for its intended purpose.Evidence that an improved MIS system is in place and is being used for its intended purpose.13.13. Technical data management protocols and standards developed.Technical data management protocols and standards developed.14.14. Business process development and user requirements developedBusiness process development and user requirements developed15.15. Application software developed for finance/accounting payments eligibility and case management Application software developed for finance/accounting payments eligibility and case management

etc.etc.

2121


Azerbaijan Pension and Social AssistanceAzerbaijan Pension and Social Assistance1.1. (O) Improved financial viability (collection) of the social insurance system(O) Improved financial viability (collection) of the social insurance system2.2. (O)Significant increase in the number of participating system contributors (O)Significant increase in the number of participating system contributors

(compliance rate of 90 percent)(compliance rate of 90 percent)3.3. (O)eligible beneficiaries of pensions and social assistance receive proper (O)eligible beneficiaries of pensions and social assistance receive proper

payments, timely manner (absence of arrears).payments, timely manner (absence of arrears).4.4. (O) Improved user satisfaction (beneficiary surveys)(O) Improved user satisfaction (beneficiary surveys)5.5. Computerized record keeping in all social welfare officesComputerized record keeping in all social welfare offices6.6. Targeting errors are no more then 40%Targeting errors are no more then 40%7.7. MIS used to test eligibility and monitor targeting efficiencyMIS used to test eligibility and monitor targeting efficiency8.8. MLSPP uses M & E results for knowledge based policy formulationMLSPP uses M & E results for knowledge based policy formulation9.9. A centralized register provides comprehensive computerized record A centralized register provides comprehensive computerized record

keeping of participants and flow of fundskeeping of participants and flow of funds10.10. Internal administrative processes are functioning according to guidelines.Internal administrative processes are functioning according to guidelines.11.11. Actuarial analysis used for long term forecastingActuarial analysis used for long term forecasting12.12. Functioning public information system in placeFunctioning public information system in place

2222

Examples of Education Project GAC IndicatorsExamples of Education Project GAC Indicators

Ukraine Equal Access to Quality EducationUkraine Equal Access to Quality Education1.1. (O) New external assessment instruments (tests and exams) accepted by (O) New external assessment instruments (tests and exams) accepted by

education stakeholders.education stakeholders.2.2. (O) Student teacher ratios of rural schools in pilot Rayons increased to 12 to 15 (O) Student teacher ratios of rural schools in pilot Rayons increased to 12 to 15

students per teacher.students per teacher.3.3. 10% of school directors’ training in educational leadership piloted10% of school directors’ training in educational leadership piloted4.4. Management training conducted at all RITCCsManagement training conducted at all RITCCs5.5. New policy/system of certification (attestation) of teachers competence New policy/system of certification (attestation) of teachers competence

formulated and approvedformulated and approved6.6. Ukraine participating in PISA and TIMSSSUkraine participating in PISA and TIMSSS7.7. Framework document for new national curriculum agreed and disseminated with Framework document for new national curriculum agreed and disseminated with

all relevant stakeholdersall relevant stakeholders8.8. National external standardized exams taken by 70% of secondary school leaversNational external standardized exams taken by 70% of secondary school leavers9.9. Sustainable, transparent, efficient policy on textbooks approval, production, Sustainable, transparent, efficient policy on textbooks approval, production,

distribution and evaluation agreed with Bank and approved by MES.distribution and evaluation agreed with Bank and approved by MES.10.10. MES and Oblast education department training on planning, management and use MES and Oblast education department training on planning, management and use

of data for policy monitoring completed.of data for policy monitoring completed.11.11. Information system for general secondary education statistics processing in place.Information system for general secondary education statistics processing in place.12.12. Studies on issues of public finance and accountability conductedStudies on issues of public finance and accountability conducted13.13. General secondary education statistics are collected from all Oblasts and General secondary education statistics are collected from all Oblasts and

processedprocessed14.14. MES ready to use appropriate country systems and proceduresMES ready to use appropriate country systems and procedures

2323


Kosovo Institutional Development for EducationKosovo Institutional Development for Education1.1. (O) MEST established baseline of the student learning outcomes at Grade 5 and 9 by 2010.(O) MEST established baseline of the student learning outcomes at Grade 5 and 9 by 2010.2.2. (O) MEST/MFE monitors, analyzes and publishes capital and recurrent expenditures (by level of (O) MEST/MFE monitors, analyzes and publishes capital and recurrent expenditures (by level of

education by municipality, per student, by spending composition) each year. education by municipality, per student, by spending composition) each year. 3.3. 60 percent of schools supported under the project produce annual school improvement plans 60 percent of schools supported under the project produce annual school improvement plans

and monitoring reports by 2011and monitoring reports by 20114.4. (O) 70 percent of teachers are licensed as regular teachers by 2011(O) 70 percent of teachers are licensed as regular teachers by 20115.5. (O) A primary and secondary education law which clarifies roles and responsibilities for delivery (O) A primary and secondary education law which clarifies roles and responsibilities for delivery

of documentation among various levels of education system is developed and adopted by the of documentation among various levels of education system is developed and adopted by the parliament by December 2008.parliament by December 2008.

6.6. The number of municipalities which prepare and implement municipal education development The number of municipalities which prepare and implement municipal education development plans in accordance with procedures.plans in accordance with procedures.

7.7. The number of municipalities which allocate non-recurrent budget to schools according to The number of municipalities which allocate non-recurrent budget to schools according to funding formula. funding formula.

8.8. Council for Curriculum, Textbooks and Assessment (CCTA) and National Teacher Education Council for Curriculum, Textbooks and Assessment (CCTA) and National Teacher Education Board (NTEB) are established and functional. Board (NTEB) are established and functional.

9.9. The availability and quality of annual EMIS report, consisting of statistics and analysis of The availability and quality of annual EMIS report, consisting of statistics and analysis of education trends.education trends.

10.10. The Law on Higher Education is amended and adopted. The Law on Higher Education is amended and adopted. 11.11. The study on size and shape of higher education in Kosovo is used by MEST to develop a The study on size and shape of higher education in Kosovo is used by MEST to develop a

concrete strategy which proposes a cost effective expansion of the systemconcrete strategy which proposes a cost effective expansion of the system

2424


Kyrgyz: Rural EducationKyrgyz: Rural Education1.1. Publication of annual yearbook of education statisticsPublication of annual yearbook of education statistics2.2. Evaluation studies with peer review disseminated.Evaluation studies with peer review disseminated.3.3. School report cards developed and disseminatedSchool report cards developed and disseminated4.4. Community and parental involvement in the education process and support of pre-schooling Community and parental involvement in the education process and support of pre-schooling

initiatives.initiatives.5.5. Teacher and student satisfaction with learning conditions in the three target oblasts. Teacher and student satisfaction with learning conditions in the three target oblasts. 6.6. Kindergarten and school census implemented and results used in targeting the interventions to Kindergarten and school census implemented and results used in targeting the interventions to

most needy oblasts and schools.most needy oblasts and schools.

Uzbekistan Basic EducationUzbekistan Basic Education1.1. (O) Students performance on standardized student assessment (O) Students performance on standardized student assessment 2.2. (O) Percentage of school boards participating in school improvement activities(O) Percentage of school boards participating in school improvement activities3.3. (O) Student learning achievement as measured by a new standardized test of learning (O) Student learning achievement as measured by a new standardized test of learning

achievement to be administered to a sample of students in project and non project schoolsachievement to be administered to a sample of students in project and non project schools4.4. (O)More equitable distribution and increased efficiency in utilization of budget in general (O)More equitable distribution and increased efficiency in utilization of budget in general

secondary educationsecondary education5.5. (O) Information on baseline indicators is collected and analyzed at least once a year.(O) Information on baseline indicators is collected and analyzed at least once a year.6.6. (O) Active participation of school boards in needs assessment and selection of learning materials.(O) Active participation of school boards in needs assessment and selection of learning materials.7.7. (O)Student assessment piloted(O)Student assessment piloted8.8. and information used to inform decisions on teacher training and information used to inform decisions on teacher training

2525

Service Feedback in InstitutionsService Feedback in Institutions 59 % of the projects assist in building-up 59 % of the projects assist in building-up

institutions for service feedback. Break-institutions for service feedback. Break-down by sub-sector is :down by sub-sector is :– Education 56 %Education 56 %– Health 46 %Health 46 %– Social Protection 79 %Social Protection 79 %

BUT, in some cases, feedback institutions BUT, in some cases, feedback institutions may already exist in the country, even may already exist in the country, even associated to previous Bank projects. PADs associated to previous Bank projects. PADs sometimes referred to existing institutions sometimes referred to existing institutions that provide feedback that provide feedback

2626

Incentives to Follow RulesIncentives to Follow Rules

Most projects allocate resources for building up Most projects allocate resources for building up environment and monitoring compliance with the rules environment and monitoring compliance with the rules (about 90%)(about 90%)

However, less than half of the projects (42 %) spend However, less than half of the projects (42 %) spend resources to provide resources to provide incentivesincentives to follow the rules: to follow the rules: – Education 26 %Education 26 %– Health 50 %Health 50 %– Social Protection 48 %Social Protection 48 %

As we can see, in Education only 26 % of the projects spend As we can see, in Education only 26 % of the projects spend resources to provide incentives. Health and Social resources to provide incentives. Health and Social Protection are above the averageProtection are above the average

Other type of incentives (i.e. salaries) do not count as Other type of incentives (i.e. salaries) do not count as incentives to follow the rules incentives to follow the rules

2727

SanctionsSanctions

Only two projects, or 3 % of the portfolio, spend Only two projects, or 3 % of the portfolio, spend resources to create sanction mechanisms in the resources to create sanction mechanisms in the provision of services (excluding Bank Fiduciary provision of services (excluding Bank Fiduciary aspects). These projects are: Romania--Rural aspects). These projects are: Romania--Rural Education and Bosnia and Herzegovina--Education and Bosnia and Herzegovina--Employment 2 Employment 2

Some institutional changes may incorporate Some institutional changes may incorporate sanctions but PADs do not fully reflect themsanctions but PADs do not fully reflect them

Almost all projects, 98 %, spend resources to Almost all projects, 98 %, spend resources to enhance policy capacity: enhance policy capacity: – Education 100 %Education 100 %– Health 95 %Health 95 %– Social Protection 100 %Social Protection 100 %

2828

Main MessagesMain Messages ECSHD PADs prepared over the last decade or more do include ECSHD PADs prepared over the last decade or more do include

GAC activities and indicators. GAC agenda not new for us.GAC activities and indicators. GAC agenda not new for us. ECSHDECSHD PAD focus on GAC agenda on Borrower/ Government PAD focus on GAC agenda on Borrower/ Government

Policy and Borrower/ Government Service Providing institutions.Policy and Borrower/ Government Service Providing institutions. Average of 7 GAC indicators per PAD. As many as 19 indicators in Average of 7 GAC indicators per PAD. As many as 19 indicators in

some PADs. some PADs. Only 3 PADs without any GAC related indicators.Only 3 PADs without any GAC related indicators. Resources and Activities directed towards these GAC activities.Resources and Activities directed towards these GAC activities. Sanctions for breaking rules included in very few PADsSanctions for breaking rules included in very few PADs Incentives to follow rules included in less then half of the PADsIncentives to follow rules included in less then half of the PADs Governance and Accountability are the nuts and bolts of our Governance and Accountability are the nuts and bolts of our

lending operations (as evidenced by our indicators) which directly lending operations (as evidenced by our indicators) which directly and indirectly and perhaps, appropriately, given our World Bank and indirectly and perhaps, appropriately, given our World Bank mandate, Borrower relationship and authorizing environment mandate, Borrower relationship and authorizing environment address the anti corruption agenda.address the anti corruption agenda.

2929

For Further DiscussionFor Further Discussion

We plan to look at ISRs and ICRs for a subset of these projects to see if these We plan to look at ISRs and ICRs for a subset of these projects to see if these indicators were followed through in implementationindicators were followed through in implementation

How can identify fewer indicators, which are focused on (GAC) outcomes? How can identify fewer indicators, which are focused on (GAC) outcomes?

It should be recognized that, in some cases, indicators have been refined/improved It should be recognized that, in some cases, indicators have been refined/improved during project implementationduring project implementation

Looking forward to next steps we should look at what are projects Looking forward to next steps we should look at what are projects actually achievingactually achieving in terms of GAC? Are projects focusing on the most important GAC issues? What is in terms of GAC? Are projects focusing on the most important GAC issues? What is their contribution to the overall CAS (GAC) objectives?their contribution to the overall CAS (GAC) objectives?

Looking forward could projects do more to assist in building up Looking forward could projects do more to assist in building up recipient-feedbackrecipient-feedback mechanisms? By monitoring how these work if they already exist and then helping to mechanisms? By monitoring how these work if they already exist and then helping to strengthen them.strengthen them.

Looking forward, can we also recommend some regional ESWs - review of recipient Looking forward, can we also recommend some regional ESWs - review of recipient feedback mechanisms or incentive mechanisms that already exist in some countries feedback mechanisms or incentive mechanisms that already exist in some countries and how that could be used in other countries so there is some cross learning.and how that could be used in other countries so there is some cross learning.

Looking forward and back Should we undertake an analysis of rent capture by Looking forward and back Should we undertake an analysis of rent capture by parastatals to understand Governance issues in a region which has had the most parastatals to understand Governance issues in a region which has had the most rapid and severe demise of State institutions and transfer of assets to the private rapid and severe demise of State institutions and transfer of assets to the private sector. sector.

ECSHD is working on a video of Task Team members reflecting on Governance and ECSHD is working on a video of Task Team members reflecting on Governance and Accountability measures in their projects. (insert clip here.)Accountability measures in their projects. (insert clip here.)