continuous monitoring data as an evidence base for impact evaluation: practical and theoretical concerns

David Martyn & Keith Magee, Camara EducationDSAI Conference, 19th November 2015

DSAI Conference

Contents1.Objectives2.Background to Camara3.The Projects4.Solution, Information, Theory5.In Practice6.Challenges and Future Plans

DSAI Conference

Objectives of this presentation:1.Describe how Camara are approaching this issue;2.Describe how better quality information has influenced project decision-making.

DSAI Conference

Objectives of creating an ‘evidence base’1.Improved data quality;2.Results focus;3.Opportunity to learn and adapt approaches.

DSAI Conference

Background to Camara Education

International NGO

Educational Outcomes

21st Century Skills

Technology Enhanced Education Solutions

DSAI Conference

The ProjectsICT Programme for Junior

Secondary Education Project in Zambia (2015-2016)

•Funded by Irish Aid•Improve the learning environment in schools engaged in the new Computer Studies curriculum

iMlango project•Funded by DFID (Girls Education Challenge)•Improve the enrollment, retention, and learning outcomes for 55,000 girls

DSAI Conference

SolutionImprove the quality of impact-related evidence at activity and project level(Vaessen et al, 2014)

DSAI Conference

Information1.Information about the nature of the intervention;2.Information about the context of the intervention.(Perrin 2012)

DSAI Conference

Theory

DSAI Conference

In Practice

DSAI Conference

In Practice

DSAI Conference

Challenges

Zambia•Load shedding•Security

Kenya•Teachers on strike•Data overload

DSAI Conference

Future Plans•Combine the two approaches•Use Brcks to overcome internet problem•More curriculum aligned content•Data analysis skills