module 8: monitoring and evaluation gap analysis and intervention plans

Module 8: Module 8: Monitoring and Evaluation Monitoring and Evaluation Gap Analysis and Gap Analysis and Intervention PlansIntervention Plans

Module 8: Module 8: Monitoring and Evaluation Monitoring and Evaluation Gap Analysis and Gap Analysis and Intervention PlansIntervention Plans

Learning ObjectivesLearning ObjectivesLearning ObjectivesLearning Objectives

• Perform M&E gap analysis by identifying current NDOH M&E challenges

• Develop M&E intervention plan to begin implementing M&E best practices within NDOH HIV/AIDS programs

• Identify lessons learned during the course

M&E ChallengesM&E ChallengesM&E ChallengesM&E Challenges

Illustrative Resources to Meet Illustrative Resources to Meet ChallengesChallenges

Illustrative Resources to Meet Illustrative Resources to Meet ChallengesChallenges

• Time!• Capacity-building• Technical quality and permanence of staff• Stakeholder commitment and participation• Collaborative exchange and dissemination of

M&E results with partners and others• Technical assistance where outsourcing is

cost-effective

Desired Performance

Actual Performance

Gap Cause Analysis

Intervention Implementation

Evaluation

Intervention Identification and Design

Performance and Quality Performance and Quality Improvement ModelImprovement Model

Performance and Quality Performance and Quality Improvement ModelImprovement Model

Model Adapted from the International Society for Performance Improvement

M&E Gap Analysis in NDOHM&E Gap Analysis in NDOHM&E Gap Analysis in NDOHM&E Gap Analysis in NDOH

• Goal• National implementation of best practices in M&E • Key HIV/AIDS program indicator data are available in

a timely manner on a routine basis

• Measurable Objectives• Monthly summary report data from each facility

matches totals calculated from logbooks• Monthly summary data are submitted from facilities to

sub-district or district by first week of following month• Monthly summary data entered into DHIS • Each facility receives a quarterly feedback report

Cause Analysis and Cause Analysis and Intervention DesignIntervention DesignCause Analysis and Cause Analysis and Intervention DesignIntervention Design

Types of Causes

Knowledge, Skills, Information

Resources, Capacity

Motivation

Appropriate Interventions

Incentives

Strengthening of Management Systems, Provision of Resources

Training, Communication

Intervention: IncentivesIntervention: IncentivesIntervention: IncentivesIntervention: Incentives

• How do we motivate:• Nurses to collect and enter accurate client

data into logbooks?• Data capturers to enter data properly and

on time?• HIV/AIDS program managers to provide

feedback to facilities?

Intervention: Strengthening of Intervention: Strengthening of Management Systems, Provision of Management Systems, Provision of

ResourcesResources

Intervention: Strengthening of Intervention: Strengthening of Management Systems, Provision of Management Systems, Provision of

ResourcesResources

• How do we address M&E resource and capacity-building challenges?• Clarify stakeholders’ M&E-related

reporting requirements• Put resources in place to assure data are

available and analyzed correctly (staff, computers, supervision)

• Develop Data Quality Assessment guidance and implement routine data audits

Intervention: Training, Intervention: Training, CommunicationCommunication

Intervention: Training, Intervention: Training, CommunicationCommunication

• How do we address deficits in knowledge, skills and information?• Facilitate meetings to gather

information about and document M&E quality gaps (completeness, timeliness, accuracy, dissemination and use of data)

• Build fundamental M&E human capacity among program staff (M&E basics)

• Build advanced M&E human capacity among program staff

• Train staff in qualitative data collection methods

M&E Gap and Intervention PlanDesired Performance

Actual Performance

M&E Gap Cause Analysis

Intervention Responsible Person(s)

Deadline

Data for each client are completely and accurately recorded in the VCT logbook

There are missing data in the logbook

VCT counselor and/or nurses are not recording complete and accurate data on all clients

Lack of knowledge of utility of data recorded and its use

Train VCT counselors and nurses on VCT indicator calculation, data presentation and interpretation

District Information Officer

April 15, 2005

Motivation Program implications of information reviewed and discussed at routine staff meetings

Program manager

May 1, 2005

Recognize staff for keeping complete and accurate data over time

Supervisors April 1, 2005

Lessons Learned During the Lessons Learned During the CourseCourse

Lessons Learned During the Lessons Learned During the CourseCourse

Keep Improving YourKeep Improving Your M&EM&E

The better your M&E System, • the less time / effort M&E will require• the more clearly you will understand your results • the less difficult it will be to identify and correct

problems in program implementation or activities• the more easily you will communicate your results• the more convincingly you will be able to demonstrate

your program’s impact• the more quickly and appropriately resources can be

directed to their most effective, efficient use • the simpler future strategic planning & program

implementation, scale-up, or redesign will be