national evaluation strategy

NATIONAL NATIONAL EVALUATION EVALUATION STRATEGYSTRATEGYMINISTRY OF PUBLIC FINANCEMINISTRY OF PUBLIC FINANCE

MANAGING AUTHORITY FORMANAGING AUTHORITY FORCOMMUNITY SUPPORT FRAMEWORKCOMMUNITY SUPPORT FRAMEWORK

Parliament Building, Bucharest, 2 November 2006Parliament Building, Bucharest, 2 November 2006

Why we need to Why we need to evaluate?evaluate?

It provides answers to worthwhile It provides answers to worthwhile questionsquestions

Evaluation can reduce uncertainty and Evaluation can reduce uncertainty and improve planning and implementationimprove planning and implementation

BUTBUT

if evaluation is to be useful and usable, it if evaluation is to be useful and usable, it needs to be seen as an integral part of needs to be seen as an integral part of decision making and management and decision making and management and indeed the entire process of democratic indeed the entire process of democratic accountability. accountability.

The role of evaluationThe role of evaluation To contribute to the design of To contribute to the design of

interventions, including providing input interventions, including providing input for setting political prioritiesfor setting political priorities

To assist in an efficient allocation of To assist in an efficient allocation of resourcesresources

To improve the quality of interventionTo improve the quality of intervention To report on the achievements of the To report on the achievements of the

intervention intervention To provide lessons for future interventionTo provide lessons for future intervention To provide answerabilityTo provide answerability

What is (not) the What is (not) the evaluation?evaluation?

Evaluation is a judgement of interventions Evaluation is a judgement of interventions according to the results, impacts and the according to the results, impacts and the needs they aim to satisfy.needs they aim to satisfy.

Evaluation is not monitoring, audit or control. Evaluation is not monitoring, audit or control. The evaluation’s results do not lead to The evaluation’s results do not lead to repercussions on intervention’s managers or repercussions on intervention’s managers or designers, but lead to changes in its design, designers, but lead to changes in its design, financial allocations or in the way of financial allocations or in the way of implementation. It is a policy and implementation. It is a policy and management tool, not a tool of control.management tool, not a tool of control.

Why we need Why we need a National Evaluation a National Evaluation

Strategy?Strategy? The purpose of evaluation is not well The purpose of evaluation is not well

understoodunderstood Confusion exists about the concept of Confusion exists about the concept of

evaluation evaluation Real demand for evaluation has come Real demand for evaluation has come

from outside the Romanian from outside the Romanian administration in the form of foreign administration in the form of foreign donorsdonors

The institution of government is poor The institution of government is poor when it comes to using evaluation as a when it comes to using evaluation as a management tool management tool

Why we need Why we need a National Evaluation a National Evaluation

Strategy?Strategy? There are already a significant number of There are already a significant number of

initiatives to improve policy making and the initiatives to improve policy making and the overall quality of managing, implementing overall quality of managing, implementing and evaluation of publicly-funded and evaluation of publicly-funded programmes. programmes.

If brought closer together, synergy could be If brought closer together, synergy could be obtained and thus the impact of the positive obtained and thus the impact of the positive trends could be much more significant. trends could be much more significant.

The National Evaluation Strategy (NES) is The National Evaluation Strategy (NES) is an important vehicle that could bring an important vehicle that could bring together all of the disparate strands together all of the disparate strands currently trying to drive evaluation and will currently trying to drive evaluation and will make the case stronger if stakeholders are make the case stronger if stakeholders are unified and in agreement. unified and in agreement.

Steps involved in drafting Steps involved in drafting the National Evaluation the National Evaluation

Strategy?Strategy? EC recommendation to extend to EU EC recommendation to extend to EU

funded programmes evaluation funded programmes evaluation practice to national funded practice to national funded interventionsinterventions

The Single Action PlanThe Single Action Plan

Review of the Romanian legal Review of the Romanian legal frameworkframework

Assessment of the evaluation culture Assessment of the evaluation culture in Romaniain Romania

The Single Action PlanThe Single Action Plan

Establishing the National Evaluation Establishing the National Evaluation System among 8 specific objectivesSystem among 8 specific objectives Elaboration of a National Evaluation System Elaboration of a National Evaluation System

and subsequent action plansand subsequent action plans Implementation of the Action Plan for taking Implementation of the Action Plan for taking

over the PHARE interim evaluationover the PHARE interim evaluation Implementation of the Action Plan for Implementation of the Action Plan for

establishing the National Evaluation Systemestablishing the National Evaluation System Implementation of the Action Plan for Implementation of the Action Plan for

raising awareness on evaluationraising awareness on evaluation Implementation of the Action Plan for Implementation of the Action Plan for

development of local evaluation capacity development of local evaluation capacity (within private market)(within private market)

Approved by the Government in 2005Approved by the Government in 2005

ReviewReviewthe Romanian legal the Romanian legal

frameworkframework Completed in February 2006Completed in February 2006 FindingsFindings

The Law on Public Finances no. 500/2002 does not The Law on Public Finances no. 500/2002 does not include explicit requirements to conduct evaluation include explicit requirements to conduct evaluation exercises as part of the financial management process. exercises as part of the financial management process. It is stipulated, however, that the institutions managing It is stipulated, however, that the institutions managing public funds have the obligation to prepare “annual public funds have the obligation to prepare “annual performance reports” that set out, for each programme, performance reports” that set out, for each programme, the objectives, the foreseen and the actual results the objectives, the foreseen and the actual results obtained, indicators and associated costs. These reports obtained, indicators and associated costs. These reports are to be attached to the annual financial reports.are to be attached to the annual financial reports.

The Government Emergency Ordinance 45/2003 for the The Government Emergency Ordinance 45/2003 for the management of local public funds does not include an management of local public funds does not include an explicit requirement to conduct evaluations. When explicit requirement to conduct evaluations. When defining the term "programme", however, it states that defining the term "programme", however, it states that "indicators should be established to allow the evaluation "indicators should be established to allow the evaluation of the results obtained..", but there is no explicit of the results obtained..", but there is no explicit requirement to carry out an evaluation of a programme requirement to carry out an evaluation of a programme or of other activities.or of other activities.


frameworkframework FindingsFindings

The Law for Internal Audit 672/2002, regulating The Law for Internal Audit 672/2002, regulating the audit activities for institutions that use the audit activities for institutions that use public funds defines internal auditing as "an public funds defines internal auditing as "an independent and objective activity…that helps independent and objective activity…that helps the public entity to fulfil their objectives the public entity to fulfil their objectives through a systematic and methodical approach, through a systematic and methodical approach, that evaluates and improves efficiency and that evaluates and improves efficiency and effectiveness of the management system based effectiveness of the management system based on risk management, control and administrative on risk management, control and administrative processes."processes."

The Regulatory Manual of Parliament The Regulatory Manual of Parliament operations do not explicitly include the right to operations do not explicitly include the right to perform evaluations of any type. It does, perform evaluations of any type. It does, however, foresee the right to initiate however, foresee the right to initiate parliamentary inquiries under certain parliamentary inquiries under certain conditions.conditions.


frameworkframework FindingsFindings

The report concludes that by comparison The report concludes that by comparison with EU evaluation regulations, Romanian with EU evaluation regulations, Romanian legislation has specific provisions that legislation has specific provisions that explicitly require evaluation only for the explicitly require evaluation only for the co-financing budgets for EU and other co-financing budgets for EU and other donor funding and for research donor funding and for research programmes. For the other types of programmes. For the other types of activities, even though mention is made of activities, even though mention is made of it, requirements to conduct evaluations it, requirements to conduct evaluations are either not clear enough or not are either not clear enough or not enforced properly.enforced properly.


frameworkframework RecommendationsRecommendations

Romanian legislation related to evaluation Romanian legislation related to evaluation needs to be upgraded in line with EU legislation needs to be upgraded in line with EU legislation and should address all of the areas and and should address all of the areas and institutions that are managing public funds, as institutions that are managing public funds, as a management tool for public administration. a management tool for public administration. New legislation should be supported by New legislation should be supported by methodological guidelines that explain how to methodological guidelines that explain how to apply the law.apply the law.

Moving from the current annual budgeting Moving from the current annual budgeting cycle to a multi-annual budget programming cycle to a multi-annual budget programming cycle would nurture the development of the cycle would nurture the development of the practice of evaluation. Furthermore, evaluation practice of evaluation. Furthermore, evaluation would be easier to conduct if budgets were would be easier to conduct if budgets were allocated on the basis of identified programmes allocated on the basis of identified programmes and projects, as opposed to an allocation by type and projects, as opposed to an allocation by type of expenditure only.of expenditure only.


frameworkframework RecommendationsRecommendations

The institutional capacity of public The institutional capacity of public administration to manage programmes administration to manage programmes and projects should be improvedand projects should be improved

There should be a clear distinction There should be a clear distinction between monitoring, audit, control and between monitoring, audit, control and evaluation.evaluation.

Assessment of the evaluation Assessment of the evaluation cultureculture

ConclusionsConclusions Evaluation has been a constantly developing Evaluation has been a constantly developing

practice for donor-funded programmes, but is practice for donor-funded programmes, but is still under-developed for the activities funded still under-developed for the activities funded by the Romanian national budget. However, by the Romanian national budget. However, there is clear evidence of growing interest and there is clear evidence of growing interest and evidence of actions taken at various levels to evidence of actions taken at various levels to improve the management of public policies improve the management of public policies and programmes, including evaluation.and programmes, including evaluation.

The legal base for evaluation is gradually The legal base for evaluation is gradually improving. It should be noted that equally improving. It should be noted that equally important to enacting new legislation is the important to enacting new legislation is the enforcement process, because past experience enforcement process, because past experience in Romania suggests that even when certain in Romania suggests that even when certain legal provisions existed, they were either not legal provisions existed, they were either not well understood or simply not enforced.well understood or simply not enforced.


ConclusionsConclusions Three main areas of further action can be identified: Three main areas of further action can be identified:

Further development of the legal framework; Further development of the legal framework; Preparing an adequate know-how base: methodologies, Preparing an adequate know-how base: methodologies,

guidelines, publications.guidelines, publications. Increasing the capacity of the public managers to Increasing the capacity of the public managers to

manage the evaluation processmanage the evaluation process On the first two areas there are already a significant On the first two areas there are already a significant

number of initiatives to improve policy making and number of initiatives to improve policy making and the overall quality of managing, implementing and the overall quality of managing, implementing and evaluation of publicly-funded programmes. If evaluation of publicly-funded programmes. If brought closer together, synergy could be obtained brought closer together, synergy could be obtained and thus the impact of the positive trends could be and thus the impact of the positive trends could be much more significant. It is encouraging to notice much more significant. It is encouraging to notice that already this process of co-operation between the that already this process of co-operation between the various initiatives has started and it is recommended various initiatives has started and it is recommended that this is maintained and increased. that this is maintained and increased.


ConclusionsConclusions The National Evaluation Strategy (NES) is an important The National Evaluation Strategy (NES) is an important

vehicle that could bring together all of the disparate vehicle that could bring together all of the disparate strands currently trying to drive evaluation and will make strands currently trying to drive evaluation and will make the case stronger if stakeholders are unified and in the case stronger if stakeholders are unified and in agreement. It is to Romania’s credit that it is taking this agreement. It is to Romania’s credit that it is taking this step and, given the current efforts, there is a great step and, given the current efforts, there is a great opportunity now to be taken in developing an evaluation opportunity now to be taken in developing an evaluation culture which will underpin more effective governance culture which will underpin more effective governance within the country.within the country.

Co-operation between the structures in charge of Co-operation between the structures in charge of managing evaluation for the NSRF process and the managing evaluation for the NSRF process and the structures that will manage the evaluation of nationally-structures that will manage the evaluation of nationally-funded activities is important for at least two reasons: a) funded activities is important for at least two reasons: a) the experience of evaluating the NSRF OPs will be a very the experience of evaluating the NSRF OPs will be a very valuable source of lessons; b) both structures should aim valuable source of lessons; b) both structures should aim to establish a unified approach to evaluation, applied for to establish a unified approach to evaluation, applied for European funds as well as for the national funds. To this European funds as well as for the national funds. To this end, it is important to clarify how evaluation units in MA’s end, it is important to clarify how evaluation units in MA’s and line Ministry PPU’s will work together.and line Ministry PPU’s will work together.


ConclusionsConclusions In terms of managing the evaluation process, it is In terms of managing the evaluation process, it is

the view of the authors that evaluation is an the view of the authors that evaluation is an integral part of management and as such it should integral part of management and as such it should be embedded in the everyday practice of public be embedded in the everyday practice of public managers. It is the public managers themselves managers. It is the public managers themselves who must either carry out internal self-evaluations who must either carry out internal self-evaluations or commission them to external contractors. This is or commission them to external contractors. This is the sole way to promote evaluation as a managerial the sole way to promote evaluation as a managerial tool.tool.

The other use of evaluation is that of control, for The other use of evaluation is that of control, for accountability reasons. This requires the accountability reasons. This requires the commissioning of evaluation exercises by someone commissioning of evaluation exercises by someone other than the entities under evaluation and other than the entities under evaluation and justifies the existence of independent entities in justifies the existence of independent entities in charge of managing evaluation processes, such as charge of managing evaluation processes, such as the Court of Accounts or independent units created the Court of Accounts or independent units created within the public administration apparatus.within the public administration apparatus.


ConclusionsConclusions Moving from a legalistic framework to a Moving from a legalistic framework to a

performance management framework is a performance management framework is a necessary step if evaluations are to move necessary step if evaluations are to move away from mere reporting and become a away from mere reporting and become a tool for improvement. Experience tool for improvement. Experience suggests that such a process may take up suggests that such a process may take up a considerable amount of time and it is a considerable amount of time and it is recommended that the managers of the recommended that the managers of the National Evaluation Strategy National Evaluation Strategy implementation bear this in mind and are implementation bear this in mind and are prepared for a long-term sustained effort.prepared for a long-term sustained effort.


RecommendationsRecommendations The National Evaluation Strategy should avoid The National Evaluation Strategy should avoid

over-ambitious objectives, particularly in the over-ambitious objectives, particularly in the short to medium term. Experience in other EU short to medium term. Experience in other EU Member States and as documented in the Member States and as documented in the Evalsed Guide has shown that a slow and steady Evalsed Guide has shown that a slow and steady burn has proved most effective in building an burn has proved most effective in building an evaluation culture in other Member States.evaluation culture in other Member States.

Create stronger links and maintain regular Create stronger links and maintain regular communication between the main actors who communication between the main actors who are promoting the new practices of evaluationare promoting the new practices of evaluation

If possible, agree that one of these actors takes If possible, agree that one of these actors takes a lead role in the implementation of the NES a lead role in the implementation of the NES and the overall promotion of the practice of and the overall promotion of the practice of evaluation in the country, while each actor can evaluation in the country, while each actor can retain leadership in their respective areas.retain leadership in their respective areas.


RecommendationsRecommendations Establish first, between these actors, a Establish first, between these actors, a

common understanding of the concepts common understanding of the concepts related to evaluation, of its scope for related to evaluation, of its scope for application and of its vocabulary. The application and of its vocabulary. The constant interchanging of terms and titles is constant interchanging of terms and titles is too confusing and if people at the top are too confusing and if people at the top are confused, there is no doubt this confusion will confused, there is no doubt this confusion will translate through the system.translate through the system.

Attempt to harmonise the methodologies and Attempt to harmonise the methodologies and manuals that are currently being prepared by manuals that are currently being prepared by the various actors.the various actors.

Once the NES has been agreed and approved, Once the NES has been agreed and approved, divide the tasks such that each of the actors divide the tasks such that each of the actors has clear responsibilities for a certain set of has clear responsibilities for a certain set of actions.actions.


RecommendationsRecommendations Each actor should conduct a few pilot Each actor should conduct a few pilot

evaluations in their respective areas and then evaluations in their respective areas and then should cross – reference the results between the should cross – reference the results between the actors. This could involve institutions which are actors. This could involve institutions which are most open to the idea so that a model of good most open to the idea so that a model of good practice is established at an early stage, that practice is established at an early stage, that people can see how it is done and how it is used people can see how it is done and how it is used to dispel any fears they might have. This will to dispel any fears they might have. This will assist in trying to move from a culture of assist in trying to move from a culture of control and reporting to a culture of learning control and reporting to a culture of learning and analysing. The pilot evaluations should be and analysing. The pilot evaluations should be followed by a number of subsequent exercise followed by a number of subsequent exercise aiming to improve the methodologies applied aiming to improve the methodologies applied until a satisfactory process is obtained, that can until a satisfactory process is obtained, that can be transposed into a model and a methodology be transposed into a model and a methodology manual.manual.


RecommendationsRecommendations

It is important to ensure that all It is important to ensure that all Ministries have some degree of ownership Ministries have some degree of ownership of the National Evaluation Strategy, and of the National Evaluation Strategy, and this means intensive consultation and this means intensive consultation and involvement of heads of departments involvement of heads of departments while preparing and rolling it out.while preparing and rolling it out.

At the same time as demand is being At the same time as demand is being stimulated, measures to increase supply stimulated, measures to increase supply and capacity should be put in place, and capacity should be put in place, concentrating on inside and outside the concentrating on inside and outside the public administration system.public administration system.

Principles ofPrinciples ofthe National Evaluation the National Evaluation

StrategyStrategy Co-operation Co-operation

close working between the structures in close working between the structures in charge of managing evaluation of the charge of managing evaluation of the ongoing, pre-accession instruments, the ongoing, pre-accession instruments, the NSRF process and the structures that will NSRF process and the structures that will manage the evaluation of nationally-funded manage the evaluation of nationally-funded activities is important for two reasons: a) activities is important for two reasons: a) the experience of evaluating the NSRF OPs the experience of evaluating the NSRF OPs will be a very valuable source of lessons; b) will be a very valuable source of lessons; b) both structures should aim to establish a both structures should aim to establish a unified approach to evaluation, applied for unified approach to evaluation, applied for European funds as well as for the national European funds as well as for the national funds. To this end, the evaluation units in funds. To this end, the evaluation units in MA’s and line Ministry PPU’s should MA’s and line Ministry PPU’s should participate in the evaluation networking participate in the evaluation networking activities.activities.


StrategyStrategy Co-operation Co-operation

Cooperation between the Ministry of Cooperation between the Ministry of Public Finance MACSF ECU and the Public Finance MACSF ECU and the Ministry of Administration and Interior’s Ministry of Administration and Interior’s MA for the Administrative Capacity MA for the Administrative Capacity Development OP is vital, as Development OP is vital, as implementation of the activity planned implementation of the activity planned under the evaluation Key Area of under the evaluation Key Area of Intervention in the Administrative Intervention in the Administrative Capacity Development OP will form a Capacity Development OP will form a central part of implementation of the central part of implementation of the Strategy.Strategy.


StrategyStrategy OwnershipOwnership

this Strategy can only be implemented if there this Strategy can only be implemented if there is clear ownership of and commitment to the is clear ownership of and commitment to the Strategy. Again this will necessitate ongoing Strategy. Again this will necessitate ongoing cooperation between the MACSF in the Ministry cooperation between the MACSF in the Ministry of Public Finance and the MA for the of Public Finance and the MA for the Administrative Capacity Development OP. The Administrative Capacity Development OP. The Strategy has a greater chance of being Strategy has a greater chance of being implemented if other line Ministries and the implemented if other line Ministries and the wider public administration also feel that they wider public administration also feel that they stand to benefit from its implementation. It is stand to benefit from its implementation. It is important to ensure that all Ministries and local important to ensure that all Ministries and local authorities have some degree of ownership of authorities have some degree of ownership of the National Evaluation Strategy, and this the National Evaluation Strategy, and this means intensive consultation and involvement means intensive consultation and involvement of heads of departments while preparing and of heads of departments while preparing and rolling it out.rolling it out.


StrategyStrategy IndependenceIndependence

Evaluations should be managed by someone other Evaluations should be managed by someone other than the entities under evaluation and this than the entities under evaluation and this explains the existence of independent entities in explains the existence of independent entities in charge of managing evaluation processes, such as charge of managing evaluation processes, such as the independent units created within the NSRF OP the independent units created within the NSRF OP Managing Authorities and the Public Policy Units.Managing Authorities and the Public Policy Units.

Long-term visionLong-term vision Moving to a performance management culture Moving to a performance management culture

involves understanding evaluations as a move involves understanding evaluations as a move away from mere reporting towards becoming a away from mere reporting towards becoming a tool for improvement. Experience suggests that tool for improvement. Experience suggests that this may take up a considerable amount of time this may take up a considerable amount of time and it is recommended that the managers of the and it is recommended that the managers of the National Evaluation Strategy implementation bear National Evaluation Strategy implementation bear this in mind and are prepared for a long-term this in mind and are prepared for a long-term sustained effort.sustained effort.


StrategyStrategy DevelopmentalDevelopmental

It is important to move in a planned and staged way from a It is important to move in a planned and staged way from a culture of control to a culture of learning and analysis. culture of control to a culture of learning and analysis. Institutions that are most open to this idea could conduct some Institutions that are most open to this idea could conduct some pilot evaluations (under the proposed “evidence-based pilot evaluations (under the proposed “evidence-based management” field of intervention), so that a model of good management” field of intervention), so that a model of good practice is established at an early stage. People could thus see practice is established at an early stage. People could thus see how evaluation as a means of learning is done and which may how evaluation as a means of learning is done and which may dispel any reservations they might have. Pilot evaluations dispel any reservations they might have. Pilot evaluations could be followed by a number of subsequent exercises aimed could be followed by a number of subsequent exercises aimed at improving the methodologies applied until a satisfactory at improving the methodologies applied until a satisfactory process is obtained, that can be transposed into a model and a process is obtained, that can be transposed into a model and a methodology manual.methodology manual.

Evaluation is an integral part of management and as such it Evaluation is an integral part of management and as such it should be embedded in the everyday practice of public should be embedded in the everyday practice of public managers. It is the public managers themselves who must managers. It is the public managers themselves who must either commission evaluations from external contractors, or, either commission evaluations from external contractors, or, when sufficient internal expertise exists, may even initiate self when sufficient internal expertise exists, may even initiate self evaluations. Taking a direct interest in the design and use of evaluations. Taking a direct interest in the design and use of evaluation is essential in order to promote evaluation as a evaluation is essential in order to promote evaluation as a managerial toolmanagerial tool


StrategyStrategy TransparencyTransparency

this Strategy has been drafted following a lengthy this Strategy has been drafted following a lengthy consultation process with key stakeholders in the consultation process with key stakeholders in the Romanian public administration, including Romanian public administration, including officials in the Ministries of Public Finance, officials in the Ministries of Public Finance, European Integration and Administration and European Integration and Administration and Interior, the General Secretariat of the Interior, the General Secretariat of the Government, the Romanian Parliament, the Government, the Romanian Parliament, the Delegation of the European Commission and Delegation of the European Commission and members of Romanian academia, civil society and members of Romanian academia, civil society and the policy research community. As such, this the policy research community. As such, this Strategy expresses the divergent views on the Strategy expresses the divergent views on the necessary future direction of evaluation of many necessary future direction of evaluation of many public and non-public stakeholders and is not the public and non-public stakeholders and is not the “voice” of either the MACSF in the MPF, or the MA “voice” of either the MACSF in the MPF, or the MA for the Administrative Capacity Development OP.for the Administrative Capacity Development OP.


StrategyStrategy AccountabilityAccountability

The Strategy assigns implementation tasks to The Strategy assigns implementation tasks to various public bodies. It is essential, in order for various public bodies. It is essential, in order for the Strategy to be implemented, that these public the Strategy to be implemented, that these public bodies are answerable for the implementation of bodies are answerable for the implementation of the tasks assigned to them. It is vital that both the tasks assigned to them. It is vital that both the MACSF in the MPF and the Administrative the MACSF in the MPF and the Administrative Capacity Development OP Managing Authority Capacity Development OP Managing Authority engage other line Ministries and local authorities engage other line Ministries and local authorities to take ownership of the Strategy’s to take ownership of the Strategy’s recommendations and action plan.recommendations and action plan.

General Objective ofGeneral Objective ofthe National Evaluation the National Evaluation

StrategyStrategy The overall aim of the National The overall aim of the National

Evaluation Strategy is that “there will Evaluation Strategy is that “there will be a functioning national evaluation be a functioning national evaluation system, the parts of which reinforce system, the parts of which reinforce each other; encompassing the public each other; encompassing the public and private sector and civil society; and private sector and civil society; and contributing to the effective and contributing to the effective management of public interventions management of public interventions and the accountability of policy and the accountability of policy makers and public managers. There makers and public managers. There shall be recognition of the importance shall be recognition of the importance of evidence based policy making.”of evidence based policy making.”

Operational Objectives ofOperational Objectives ofthe National Evaluation the National Evaluation

StrategyStrategy Evaluation training and HRD resources Evaluation training and HRD resources

are available from various sources (civil are available from various sources (civil service, private training providers, service, private training providers, universities) and open to participants universities) and open to participants from within and without the public from within and without the public sector sector – starting with 2007– starting with 2007

Professional networks are established to Professional networks are established to provide a medium for the exchange of provide a medium for the exchange of ideas/good practice, professional ideas/good practice, professional development, the development of development, the development of standards, etc. They will enjoy the standards, etc. They will enjoy the participation of civil society as well as participation of civil society as well as public service participants – starting public service participants – starting with 2007with 2007


StrategyStrategy A central government ‘resource’ will A central government ‘resource’ will

be created as a repository of be created as a repository of evaluation expertise. It will promote evaluation expertise. It will promote good practice by networking across all good practice by networking across all departments – starting with 2007departments – starting with 2007

There is capacity at all levels of There is capacity at all levels of government to commission or carry-government to commission or carry-out evaluations, and to know the right out evaluations, and to know the right evaluation questions to ask – 2010 for evaluation questions to ask – 2010 for Central Public Administration; 2011 Central Public Administration; 2011 for Local Public Administration for Local Public Administration


StrategyStrategy Quality and appropriate monitoring Quality and appropriate monitoring

systems are in place at all levels of systems are in place at all levels of government (local and central) and in government (local and central) and in any agency where public money is spent any agency where public money is spent – 2011 for Central Public Administration; – 2011 for Central Public Administration; 2012 for Local Public Administration 2012 for Local Public Administration

Evaluation is integrated into the Evaluation is integrated into the procedures for the formulation, delivery procedures for the formulation, delivery and follow-up of all public interventions, and follow-up of all public interventions, regardless of funding lines. Documented regardless of funding lines. Documented procedures will ensure diligent follow-up procedures will ensure diligent follow-up of evaluation results/recommendationsof evaluation results/recommendations - - 20132013

Funding sources ofFunding sources ofthe National Evaluation the National Evaluation

StrategyStrategy PHARE 2005 – 4 million EuroPHARE 2005 – 4 million Euro NSRF and Rural Development and NSRF and Rural Development and

Fisheries OPs Technical Assistance Fisheries OPs Technical Assistance priority axes– approximately 13 priority axes– approximately 13 million Euromillion Euro

Key area of intervention of the Key area of intervention of the Technical Assistance Operational Technical Assistance Operational Programme of NSRF – 8 million EuroProgramme of NSRF – 8 million Euro

Key area of intervention of Key area of intervention of Administrative Capacity Development Administrative Capacity Development OP – 30 million EuroOP – 30 million Euro

TOTAL approximately 55 million EuroTOTAL approximately 55 million Euro

Fields of intervention of Fields of intervention of the National Evaluation the National Evaluation

StrategyStrategy Effective evaluation of the EU funded Effective evaluation of the EU funded

programmesprogrammes Evaluation training for civil servants, Evaluation training for civil servants,

private, academic and civil societyprivate, academic and civil society Resource and network supportResource and network support Evaluation Facility aiming at Evaluation Facility aiming at

encouraging Public Administration to encouraging Public Administration to commission evaluationscommission evaluations

Obtaining evaluation relevant dataObtaining evaluation relevant data Embedding of evaluation in public Embedding of evaluation in public

interventions design and management interventions design and management through a normative actthrough a normative act

national evaluation strategy

Documents

evaluation culture

evaluation exercises

purpose of evaluation

management tool

financial management

design of interventions

tool of control

romanian administration