Slide 1

Monitoring and Evaluation - e-Governance projects

Thanzeer A PGDeG, IIITM-K Thiruvananthapuram

Monitoring and Evaluatione-Governance project achieving business benefits to the Government and citizens.

AIM to establish a clear vision, objectives and benefits expected to be delivered by the project to the target stakeholders.

Monitoring & Evaluation refers to tracking the outputs and outcomes, respectively, as defined for the project.

OutputsOutputs of e-Governance project are the deliverables generated by the government, consultants, implementation partners and associated stakeholders at various phases of an e-Governance initiative. e.g e-Governance vision & strategy, reengineered business processes, IT system, IT infrastructure, training etc. These outputs should be clearly stated in the scope of the project and based on the responsibilities allocated to various stakeholders.

Deliverable is a term used in project management to describe a tangible or intangible object produced as a result of the project that is intended to be delivered to a customer (either internal or external).

A deliverable could be a report, a document, a server upgrade or any other building block of an overall project.

OutcomesOutcomes refer to the desired result of an initiative undertaken to meet a need or solve a particular problem. e.g. reduction of passport delivery time to 3 days, improvement in literacy rate by 15%, to minimize leprosy from 15% to 5% etc.The outcomes relate to the business objectives and benefits defined for the project and are final results supported by intermediate outcomes (benefits milestones). Outputs are defined to measure programme performance and outcomes focus on business performance.

Goals

Examples of performance indicators Outputs

Outputs1. Reengineered processes2. New ICT systems3. Increased service coverage

1. Comparisons of old and new business processes2. Technical reviews of IT infrastructure, applications, and performance3. Variety of available services4. IT support capacity5. Service training

Goals

Examples of performance indicators Outputs

Outcomes1. Increased efficiency 2. Increased transparency and accountability 3.Higher-quality public services4. Better access to services

1. Financial and time savings in government activities2. Public perceptions, such as user satisfaction and score cards3. Financial and time savings for citizens 4. Increased public service timeliness and responsiveness5. Reduced errors 6. Financial saving per transaction

Monitoring and Evaluation Monitoring & Evaluation refers to tracking the outputs and outcomes, respectively, as defined for the project.

MonitoringMonitoring relates to tracking the project progress, outputs and deliverables as per the defined programme/project plan

Monitoring?Looking into the process, going towards the target, right selection of beneficiaries

Procedures are being followed according to the work plan

Meeting our target or not (target monitoring), activity monitoring

Continuous info collection/analysis/reporting for decision making

Program is going in right direction as planned in the project document

Monitoring Tools Staff meetings Weekly, Monthly, Annual

Partners meeting/Learning Forums (Surveys)

Participatory Reviews Stakeholders

Monitoring and Supervision Mission (Self/Donors/Joint)

Progress reports/Statistics

What is EvaluationEvaluation refers to assessment on achievement of business objectives and benefits defined for the project

An important goal of evaluation is to provide recommendations and lessons to the project managers and implementation teams that have worked on the projects and for the ones that will implement and work on similar projects.

Evaluation Provides InformationStrategy: Are the right things being done?Rational or justification impactOperations: Are things being right?Effectiveness in achieving expected outcomesEfficiency in optimizing resourcesClient satisfaction Learning: Are there better ways?AlternativesLessons learned

Formative evaluation Evaluation intended to improve performance, most often conducted during the design and/or implementation phases of projects or programs.

Summative evaluationA study conducted at the end of an intervention to determine the extent to which anticipated outcomes were produced.

Forms of Evaluation

Participatory evaluation

Process based evaluation

Outcome based evaluation

Self-evaluation

Goal-based evaluation Types of Evaluation

Participatory evaluation Evaluation in which representatives of agencies and stakeholders work together in designing, carrying out and interpreting an evaluation.

Process based evaluationAn evaluation of the internal dynamics of a project, its policy instruments, its service delivery mechanisms, its management practices, and the linkages among these.Types of Evaluation

Outcome based Evaluation it facilitates the asking if the organization is doing right activities to bring about the expected outcomes

Goal based evaluation Evaluating the extent to which projects are meeting predetermined goal / impactTypes of Evaluation cont.

Understanding Evaluation Types There are two types of evaluation in general 1. outcome evaluation 2. impact evaluation/assessment

Approach for Development of M & E Framework

THANK YOU