introduction to m-e july 24

8/17/2019 Introduction to M-E July 24

1/20

Introduction to

Monitoring and Evaluation


2/20

Objectives of session

Definitions: Monitoring and Evaluation

Rationale for M&E Review elements of an M&E plan

Steps toward constructing the M&E plan

Implementing the M&E plan


3/20

Monitoring - Evaluation

Monitoring is the

routine process of

data collection and

measurement ofprogress toward

program

objectives.

Evaluation is the use ofspecific stud designs andspecial studies to

measure the e!tent towhich changes in desiredhealth outcomes areattributable to a program"sinterventions.

OutcomeOutcomeInterventions


4/20

Rationale for M&E

M&E help to ma#e informed decisionsregarding ongoing programs

$he facilitate effective and efficient use of resources

$he determine whether a program is right on trac#and where changes need to be considered

M&E help sta#eholders conclude whether

the program is a success M&E preserve institutional memor


5/20

Three Primary Uses of Evaluation indings

Rendering judgments Summative evaluations of program"s overall

effectiveness

e.g.% audit% renewal% ualit control% accreditation

'acilitating improvements 'ormative evaluation to improve program

e.g.% program"s strengths(wea#nesses% progress

)enerating #nowledge *onceptual use of findings

e.g.% generali+ation% theor building


6/20

!hat is an M&E Plan"

,n M&E -lan is a document that describes

a sstem which lin#s strategic information

obtained from various data collection

sstems to decisions that will improve

health programs.

'undamental document to ensure: ,ccountabilit

Measure of success


7/20

unctions of an M&E Plan

State how the program is going to measurewhat it has achieved ensure accountabilit/

Document consensus encourage

transparenc and responsibilit/ )uide M&E implementation standardi+ation

and coordination/

-reserve institutional memor

M&E #lan is a living document and needs to be

adjusted $hen a #rogram is modified%


8/20

unctions of an M&E Plan

by level of the health system

'acilit primar data collection/:0 Manage patients(clients

0 Supervise providers

0 Manage logistics

0Report to district 1IS and vertical programs and communit

District:0 ,llocate resources

0 Report to provincial(national

2ational *omprehensive vs. 3ertical -rograms/0 ,llocate resources

0 *ollect national data

0 Report to international donors and other sta#eholders


9/20

Elements of M&E Plan

'% (rief #roject descri#tion)% Pur#ose*s+ of M&E #lan

,% (rief history of M&E #lan develo#ment

% Evaluation frame$or./% Indicator system

0% Information system *data sources+

1% Im#act evaluation design2% 3issemination and utili4ation #lan

5% 6djustments to M&E #lan


10/20

'% (rief #roject descri#tion

Include:

objectives(results

implementation responsibilit dates(duration

geographic focus

resources


11/20

)% Pur#ose*s+ of M&E #lan

Specif purpose for:

performance process/ monitoring

impact evaluation


12/20

,% (rief history of M&E #lan

develo#ment

1elps to define:

shared vision internal(e!ternal/

source and e!tent of

interest(commitment


13/20

% 3evelo# Evaluation rame$or.

4og 'rame% Results% *onceptual/

Show:

-rimar components 4evels and units of action

*ausal seuence

*omponent5related indicators/


14/20

/% 3evelo# Indicator system

6rgani+ed b framewor# component ,ttributes

0 2ame of indicator

0 Description(definition

0 7nit of measurement

0 Data source primar(secondar/

0 8aseline(target values/ b ears/

0 'reuenc of data collection

0 Responsibilit

0 Reporting plan and freuenc


15/20

0% Information 7ystems *3ata sources+

3evelo#

Information sstems for collecting data for

indicators Diagram data collection% processing%

analsis% and reporting sstem

Data collection tools routine vs. non5routine/0 patient records0 registers0 surve instruments


16/20

1% 7elect im#act evaluation design

Decide on design:

E!perimental vs. observational

9uasi5e!perimental post5test% pre5and post5test with no control/

Implementation plan

E!ecution responsibilit

internal(e!ternal/


17/20

2% 3issemination and utili4ation #lan

Decide on: Databases for information storage

*learl defined users

Schedule and timeliness Dissemination methods

0 Reports schedule and audience/

0 Media0 Spea#ing events

Information5utili+ation models


18/20

5% 6djustments to M&E #lan

-rogram changes can occur% affecting the

original M&E plan for both performance

monitoring and impact evaluation

M&E plan is a living document and needsto be adjusted when a program is modified.


19/20

7te#s to$ard constructing the M&E #lan

-reparing to build the plan

*onstructing the evaluation framewor#

Identifing potential data sources

Selecting and defining indicators and their

values

Designing the impact evaluation

Developing a reporting schedule and sstem

-lanning for mid5course adjustments


20/20

In im#lementing the M&E #lan

Utility 5 serve practical information needs ofintended users

easibility 5 be realistic% prudent% diplomatic

and economical

Pro#riety 5 conducted legall% ethicall% and withregard to those involved in and affected b the

evaluation

6ccuracy 5 reveal and conve technicallaccurate information

introduction to m-e july 24

Documents