types of evaluation-reviewed

Upload: dmugalloy

Post on 07-Jul-2018

221 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/18/2019 Types of Evaluation-reviewed

    1/23

    LDP608: Project Monitoring and Evaluation

    UNIVERSITY OF NAIROBI

    COLLEGE OF EDUCATION AND EXTERNAL STUDIES

    SCHOOL OF CONTINUING AND DISTANCE EDUCATION

    DEPARTMENT OF EXTRA-MURAL STUDIES

    COURSE: MASTERS OF ARTS IN PROJECT PLANNING AND MANAGEMENT

    UNIT CODE: LDP 608

    UNIT NAME: PROJECT MONITORING AND EVALAUATION

    LECTURER: DR. FLORENCE ITEGI

    LIST OF GROUP MEMBERS

    NO.

    NAME REF: NO. SIGNATURE

    1. MWAHENDO OLL!N" H!#O L$0%8&'(0%)01)

    ). #AH!ND! #A*!"A MA"HA L$0%8))0)%)01)&. MM+ANO PA,*!# M-#!N! L$0%(0&1/%)011

    /. E,*-DE M-H-,"- L$0%6))61%)01)

    $. ADAM EDDLE MOHAMED L$0%80/6)%)01)

    6. L!L!AN NAEMA L$0%60/8&%)01&(. *E"L MA#ENA M-,-A L$0%61&8(%)01&8. WAM+-A !NEN, *E2.

    No.1)($6%)01&'. OM+OO MO"E" ODH!AM+O L$0%8/1'1%)01)

    10. M-#H-LE ON",ANE L$0%('&')%)01)

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 1

  • 8/18/2019 Types of Evaluation-reviewed

    2/23

    LDP608: Project Monitoring and Evaluation

    Table of Contents

    Cover page…………………………………………………………………………1

    Task/Assignment………………………………………………………………….3

    Introduction………………………………………………………………………4

    Types of valuation in !ro"ect #onitoring and valuation……………………$

    %ternal valuation………………………………………………………………$

    Internal valuation………………………………………………………………..&

    'orms of valuation………………………………………………………………(

    'ormative valuation……………………………………………………………..)

    *ummative valuation………………………………………………………….)

    +t,er 'orms of valuation………………………………………………………)

    -iImpact valuation……………………………………………………………...)

    -ii!rocess valuation……………………………………………………………1

    -iii 0aseline valuation…………………………………………………………11

    -iv Cost 0enefit and cost ffectiveness valuation…………………………...1

    !articipatory valuation Approac,……………………………………………1&

    Conclusion………………………………………………………………………..

    2eferences………………………………………………………………………...1

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page )

  • 8/18/2019 Types of Evaluation-reviewed

    3/23

    LDP608: Project Monitoring and Evaluation

    Term ork /Assignment/Task 

    Types of valuations in !ro"ect #onitoring and valuation

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page &

  • 8/18/2019 Types of Evaluation-reviewed

    4/23

    LDP608: Project Monitoring and Evaluation

    1. Introduction

    In the course of implementing a project, various types of information are gathered. Project

    managers often want to know how many individuals participated in an event, whether 

     participants were satisfied with the logistics, and whether staff members and volunteers feel

    confident in their ability to deliver a particular educational experience. Answers to these

    questions provide useful information. hey help managers monitor specific aspects of the

     project. !owever, in practice, this type of information gathering tends to be more sporadic and

     patchy than methodical and comprehensive. 

    1.1. efinition of valuation

    "valuation is an analytical process aimed at determining as systematically and objectively as

     possible the efficiency, effectiveness, significance and relevance of a project. "valuation can also

     be defined as the systematic collection of information about activities, characteristics, and

    outcomes of projects to make judgments about the project, improve effectiveness, and#or inform

    decisions about future programming $Patton, %&'(). "valuation is not merely the accumulation

    and summary of data and information about a project. Importantly, evaluation provides managers

    with well*documented and considered evidence to support the decision*making process.

    Project evaluation serves two general purposes. "valuation helps to determine the project+s merit

    $oes it work-) and its worth $do we need it-). "valuation helps decision*makers determine if a

     project should be continued and, if so, suggests ways to improve it. Additionally, evaluation

    documents project $and program) accomplishments $udda, /0%%). If the project has been

    designed properly with well*articulated objectives that specify what must be accomplished, to

    what degree, and within what time period, the evaluation can determine whether or not the

    objectives are being met. he evaluation can gather information as to why a project is or is not

    meeting its objectives. It is therefore important to understand the different types of evaluation

    that can be conducted over a program+s life*cycle and when they should be used.

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page /

  • 8/18/2019 Types of Evaluation-reviewed

    5/23

    LDP608: Project Monitoring and Evaluation

    .. Types of valuation in pro"ect #onitoring and valuation

     

    .1. %ternal valuation.

     his is evaluation that is carried out by someone who is $or was) not directly involved in the

    development or operation of the system being evaluated, i.e. by someone from out with the

     project team. 1learly, such an external evaluator has a number of advantages, bringing $it is to be

    hoped) objectivity, lack of vested interest, and the ability to look at matters from a fresh

     perspective. An external evaluator also has a number of disadvantages, however, most of which

    are related to relative value systems and to the lack of involvement the evaluator has had in

     project*related decisions. 2uch an evaluator may not, for example, fully appreciate why the

    development team chose to act in a particular way, or appreciate the thinking that lay behind

    certain decisions. he project team may also feel threatened by the evaluator, and feel that alienvalues or a negative, 3nit*picking3 approach are being adopted $4lank 5. %&&6)

    "xternal project evaluation is the classical form of evaluation. In this context 7external8 meansthat the evaluators are not project members, but experts from the 9orth, 2outh or "ast who,

    owing to their specific skills and in line with specifications, are called in for a period of one to

    three weeks to investigate the defined questions. "xternal evaluations are therefore suitable for factual issues, relatively complex situations, and overall appraisals. :ith their outsider+s view

    the external evaluators use appropriate methods to collect information on the project and its

    environment, in order to assess and answer the questions posed. he end product is a report

    which they submit to the commissioning party$ I;< =arch /0%6)

    he strengt,s of an external evaluation lie in its distance and its independence. uestions of sustainability, impact and

    effectiveness can be addressed through an external evaluation. he external evaluation is theonly possible form of evaluation for conducting a cross*sectoral analysis.

    he 5eaknesses of an external evaluation lie in the substantial effort required in its preparation

    and implementation, as well as its limited time frame.

  • 8/18/2019 Types of Evaluation-reviewed

    6/23

    LDP608: Project Monitoring and Evaluation

    Costs of an e%ternal evaluation6 he goal and tasks of an evaluation influence the budget indifferent ways. A prior self*evaluation can result in a shorter mandate for the external evaluation,

    thereby reducing external costs.

    .. Advantages of %ternal valuation

    •Provide supportive feedback for decision making

    • It provides for expertise knowledge to boost project performance

    • It provides assistance in development of new products or services

    • he evaluation are carefully elected and possess the relevant skills

    • he evaluation team have little or no interest on the project

    .3 isadvantage of %ternal valuation

    • here are dangers of external evaluators coming with preconceived ideas which influence

    the evaluation results.

    • It is expensive and time consuming, the external evaluators have to be paid well

    he context may not only be new but unfamiliar to the external evaluators and this mayaffect the evaluation results

    • =ay lack basic information about the project in progress

    3. Internal valuation.

     Internal evaluation is conducted and managed by project management, with little or no budget being

    required. he self*evaluation should include assessments of relevance, effectiveness, efficiency,

    impact and sustainability. 2ometimes considered a part of regular project reporting, a self*evaluation

    should address issues of project accountability to the extent possible, as well as offer insights into

    how future projects might benefit from knowledge gained through the self*evaluation $I;< =arch

    /0%6).

    his is evaluation that is carried out by someone from the actual project team. 1learly, such an

    evaluator has the advantage of understanding fully the thinking behind the development, together 

    with an appreciation of any problems that may have arisen, and should also command the trust

    and cooperation of the other members of the team.

  • 8/18/2019 Types of Evaluation-reviewed

    7/23

    LDP608: Project Monitoring and Evaluation

    he strengt,s of a self*evaluation lie in the evaluators+ detailed and specific knowledge of the project and

    the participating institutions in the partner country. It can be flexibly conducted with little effort on a

    regular basis, and facilitates rapid adjustments. It promises to be successful if those involved are

    sufficiently self*critical, and generally leads to stronger team building and cooperation.

    eaknesses result from the tendency not to see the forest for the trees and when there is no distance from

    daily operations. 2elf*evaluation is also less suitable for analy?ing issues of relevance in a broadercontext.

    3.1Advantages of Internal valuation in !ro"ect #anagement

    • It has the ability to get first*hand information

    • It involves internal parties who understand the project better 

    • It is easier to plan as insider 

    • It gives room for modification

    • It enhances commitment of those involved among others

     3. isadvantages of Internal valuation in pro"ect #anagement

    • It involves bias due to the tendency to defend or justify activities

    • It is ineffective especially in case of difficulties that may require external evaluators

    • It is limited to old project as internal evaluators not conversant with new project.

    • "valuators may lack objectivity in dealing with fellow staff 

    • here tend to be personal influence in collecting evidence data or information

    4. 'orms of valuation in #onitoring and valuation

  • 8/18/2019 Types of Evaluation-reviewed

    8/23

    LDP608: Project Monitoring and Evaluation

    he eventual form of the evaluation activity is determined by the focus of the evaluation and thescope. he scope refers to the boundaries of the evaluation activities, e.g. timeframe, discipline

    area$s), extent of measurement, etc,

    4.1. *ummative valuation

    his is done at the end of the project and involves considering the project as a whole, from

     beginning to 3end3. It is meant to summari?e and inform decisions about whether to continue the

     project $or parts of it), whether it is valuable to expand into other settings.

    It can also take place during and following the project implementation, and is associated with

    more objective, quantitative methods. he distinction between formative and summative

    evaluation can become blurred. enerally it is important to know both how an intervention

    works, as well as if it worked. It is therefore important to capture and assess both qualitative and

    quantitative data.

    At the completion of the program it may also be valuable to conduct summative evaluation. his

    considers the entire program cycle and assists in decisions such as@

    o you continue the program-

    If so, do you continue it in its entirety-

    Is it possible to implement the program in other settings- !ow sustainable is the program-

    :as the project effective in attaining the desired objectives or benefits- !ow did the

     project impact the intended audience$s)- :hat elements could have helped or hindered the program-

    :hat recommendations have evolved out of the program-

    :hat were the main benefits and disappointments-

    In retrospect, what could have strengthened it- 2omething similar-

    :hat aspects will be sustained and how-

    5esults of a summative evaluation are used to, inform stakeholders about the value of a project

    informs decision*makers about the value or worth of the project, helps provide the information

    necessary to make decisions about the continuation, revision, or  expansion of the project.

    4. 'ormative valuation

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 8

  • 8/18/2019 Types of Evaluation-reviewed

    9/23

    LDP608: Project Monitoring and Evaluation

    Cormative evaluation is conducted throughout the project, during project design, development,

    and implementation. =ost often, formative evaluation is used to test out methods and materials.

    At its best, formative evaluation can be an essential decision*making tool that will transform the

     project. Cormative evaluation often lends itself to qualitative methods of inquiry.

    Cormative evaluation@

    • athers information#data about an audience+s reaction to and learning from a project+s

     pilot or prototype products#materials. 1hanges may also be made as a result of formative

    evaluation.

    • athers information#data about problems with project delivery, and assesses progress

    towards outcomes of a project during implementation.

    • !elps provide information that can be used in making decisions about modification,• 1an lead to continuation, expansion or termination of the project

    7uestions t,at mig,t be addressed by formative evaluation include6

    • Is a particular project reaching its target audience-

    • Is the project being implemented well- Are the intended activities, products, or services

     being provided-

    • Is the project effective in attaining the desired objectives or benefits- 

    4.3. Impact valuation

    Impact evaluation involves judging the extent to which your project has had an effect on the

    changes you were seeking i.e. the extent to which your project has met its goals and objectives.

    Impact evaluation judges how well the objectives were achieved and outcome evaluation

    involves judging how well the goal has been achieved. It involves seeking answers to questions

    such as@

    !ow well has the project achieved its objectives $and sub*objectives)-

    • !ow well have the desired short term changes been achieved-

    • :hat progress has been made toward achieving the goal-

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page '

  • 8/18/2019 Types of Evaluation-reviewed

    10/23

    LDP608: Project Monitoring and Evaluation

    • o what extent has the project met its objectives-

    • !ow effective has the project been at producing changes-

    • Are there any factors outside of the project that have contributed to $or prevented) the

    desired change-

    • !as the project resulted in any unintended change-

    Cor example, one of the objectives of the 7=y*Peer project8 is to provide a safe space and

    learning environment for young people, without fear of judgment, misunderstanding, harassment

    or abuse. Impact evaluation will assess the attitudes of young people towards the learning

    environment and how they perceived it. It may also assess changes in participants+ self esteem,

    confidence and social connectedness.

    Impact evaluation measures the program effectiveness immediately after the completion of the

     program and up to six months after the completion of the program.

    4.4. !rocess valuation

    1luster evaluation of projects to assess the efficiency and effectiveness of a particular process

    and modality they have adopted. his involves judging the activities $or strategies) of your 

     project. Process evaluation is used to 7measure the activities of the program, program quality and

    who it is reaching. Process evaluation, as outlined by $!awe et al, %&&0) will help answer 

    questions about your program such as@

    • !as the project reached the target group-

    • Are all project activities reaching all parts of the target group-

    • Are participants and other key stakeholders satisfied with all aspects of the project-

    • Are all activities being implemented as intended- If not why-

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 10

  • 8/18/2019 Types of Evaluation-reviewed

    11/23

    LDP608: Project Monitoring and Evaluation

    • :hat if any changes have been made to intended activities-

    • Are all materials, information and presentations suitable for the target audience-

    4.$. 8oals based valuation

    "valuation has typically involved measuring whether predetermined targets have been met. Dou

    may be familiar with the term E2=A5+ $2pecific, =easurable, Attainable, 5elevant, and

    imely) targets. hese type of targets fall under the banner of goals*based evaluation.

    oals*based evaluations have ob"ectively9set targets usually determined by people responsible

    for the funding or implementation of the project. oals*based evaluation does not question

    whether the selected goals are valid, nor whether appropriate measures of effectiveness are being

    assessed. "valuation has typically involved measuring whether predetermined targets have been

    met. 5ecent behavior change and research and evaluation practice proposes the use of goals*free

    evaluation.

    4.&. 8oals9free valuation

    oals*free evaluation looks at emergence and unintended conse:uences  of a project, by

    looking at the actual effects without pre*empting what these may be. his type of evaluation

    focuses on the change process within the target group. he goals*free evaluation parallels a

    social learning approach to evaluation which can be desirable where the goal of a project seeks to

     build capacity of people to manage a complex issue. In such cases, relying solely on a goals*

     based evaluation may not be appropriate as it can be difficult to set targets and quantify a process

    of change, as well as capture change which one may not anticipate.

    A key point to consider in setting goals and indicators of success is the validity of the indicator.

    his is especially important when you are looking to measure a largely 7unobservable8 behavior 

    $for example, those that happen within the home, and cannot be readily objectively observed). In

    such cases, proxy indicators are often used $for example, household electricity use) but these

    indicators may be gross measures that consist of many varied behaviours, of which only one may

     be of interest. he question is how to establish meaningful indicators.

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 11

    http://evaluationtoolbox.net.au/index.php?option=com_content&view=article&id=67&Itemid=169http://evaluationtoolbox.net.au/index.php?option=com_content&view=article&id=67&Itemid=169

  • 8/18/2019 Types of Evaluation-reviewed

    12/23

    LDP608: Project Monitoring and Evaluation

    4.( %9ante valuation -;eeds assessment/ 0aseline *urvey

    As might be expected, a front*end evaluation or needs assessment takes place  prior to

    undertaking the project. Cront*end evaluation gathers information#data about the gap between the

    current and desired level of audience skills, knowledge, attitudes, and behaviors. It takes place

    before the project is designed. It helps confirm or negate assumptions of audience characteristics

    and appropriate content, define goals and objectives, and identify stakeholders and potential

    collaborators. It is carried out during the planning phase of the project.

     7uestions t,at mig,t be addressed by %9ante evaluation include6

    • :hat are the nature and scope of the problem- :here is the problem located, whom does

    it affect, and how does it affect them-

    • :hat is it about the problem or its effects that justifies new, expanded, or modified

     projects or programs-

    • :hat feasible actions are likely to significantly ameliorate the problem- 

    • :hat has the project set out to achieve-

    • :hat are the objectives of the project-

    • :ho are the intended beneficiaries and how are they to benefit-

    • :hat are the main intended inputs $financial, technical, manpower, materials, etc)-

    • :hat are the main intended outputs-

    • !ow do the outputs relate to the project objectives-

    • :hat is the project+s implementation plan-

    !ave the alternative methods of achieving project objectives considered-

    4.

  • 8/18/2019 Types of Evaluation-reviewed

    13/23

    LDP608: Project Monitoring and Evaluation

    hese analyses compare a program+s outputs or outcomes with the costs $resources expended) to

     produce them. :hen applied to existing programs, they are also considered a form of program

    evaluation. 1ost*effectiveness analysis assesses the cost of meeting a single goal or objective,

    and can be used to identify the least costly alternative to meet that goal. 1ost*benefit analysis

    aims to identify all relevant costs and benefits, usually expressed in dollar terms.

    4.1. *trategic evaluation

    2trategy "valuation is as significant as strategy formulation because it throws light on the efficiency and

    effectiveness of the comprehensive plans in achieving the desired results. he managers can also assess t

    appropriateness of the current strategy in today+s dynamic world with socio*economic, political and

    technological innovations. 2trategic "valuation is the final phase of strategic management.

    he significance of strategy evaluation lies in its capacity to co*ordinate the task performed by managers

    groups, departments etc, through control of performance. 2trategic "valuation is significant because of v

    factors such as * developing inputs for new strategic planning, the urge for feedback, appraisal and rewar

    development of the strategic management process, judging the validity of strategic choice etc.

    T,e process of *trategy valuation consists of follo5ing steps9

    • 'i%ing benc,mark of performance 9 :hile fixing the benchmark, strategists encounter 

    questions such as * what benchmarks to set, how to set them and how to express them. In

    order to determine the benchmark performance to be set, it is essential to discover the

    special requirements for performing the main task. he performance indicator that best

    identify and express the special requirements might then be determined to be used for 

    evaluation. he organi?ation can use both quantitative and qualitative criteria for 

    comprehensive assessment of performance. >uantitative criteria include determination of 

    net profit, 5ualitative factors are subjective evaluation of factors such as * skills and

    competencies, risk taking potential, flexibility etc.

    • #easurement of performance 9 he standard performance is a bench mark with which

    the actual performance is to be compared. he reporting and communication system help

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 1&

    http://www.managementstudyguide.com/strategic-management.htmhttp://www.managementstudyguide.com/strategic-management.htmhttp://www.managementstudyguide.com/strategic-management.htm

  • 8/18/2019 Types of Evaluation-reviewed

    14/23

    LDP608: Project Monitoring and Evaluation

    in measuring the performance. If appropriate means are available for measuring the

     performance and if the standards are set in the right manner, strategy evaluation becomes

    easier. 4ut various factors such as manager+s contribution are difficult to measure.

    2imilarly divisional performance is sometimes difficult to measure as compared to

    individual performance. hus, variable objectives must be created against which

    measurement of performance can be done. he measurement must be done at right time

    else evaluation will not meet its purpose. Cor measuring the performance, financial

    statements like * balance sheet, profit and loss account must be prepared on an annual

     basis.

    • Analy=ing >ariance 9 :hile measuring the actual performance and comparing it with

    standard performance there may be variances which must be analy?ed. he strategists

    must mention the degree of tolerance limits between which the variance between actualand standard performance may be accepted. he positive deviation indicates a better 

     performance but it is quite unusual exceeding the target always. he negative deviation is

    an issue of concern because it indicates a shortfall in performance. hus in this case the

    strategists must discover the causes of deviation and must take corrective action to

    overcome it.

    • Taking Corrective Action 9 

  • 8/18/2019 Types of Evaluation-reviewed

    15/23

    LDP608: Project Monitoring and Evaluation

    the programme will be the central focus.

    hese types of evaluation are often performed in combination. Cor example@

    • A thematic cross-programme evaluation could focus on innovation in several

     programmesF

    • An operational cross-programme evaluation would look at operational aspects of several

     programmes, such as the performance of the indicators in several programmes.

    4.1. valuation by *cope

    i. Project evaluation

    his is conducted for a single project. Cocus depends on the timing of the evaluation i.e.

    whether formative or summative

    ii. 2ectoral evaluations

    his is the cluster evaluation of project in a sector.

    It focuses on a comparison of the strengths and weaknesses of different approaches,

    modalities and# strategies to address sectoral issues, collective effects of the projects on

    sectoral objectives at the country, regional and#global level

    iii. hematic evaluation

    his is a cluster evaluation of projects addressing a particular theme that may cut across

    sectors or geographical boundaries.

    iv. Programme evaluation

    "valuation of programme $using the programme approach) and the portfolio of activities

    under the same management or fund.

    4.13. !olicy evaluation

    "valuation of a cluster of projects dealing with particular policy issues at the sectoral or thematic

    level.

    It aims at supporting policy making by recommending new policies or changes in the existing

    ones that are necessary to attain the sectoral#thematic objectives.

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 1$

  • 8/18/2019 Types of Evaluation-reviewed

    16/23

    LDP608: Project Monitoring and Evaluation

    It focuses on relevance, implications#impact of policies on directly and indirectly affected by

    them, costs and benefits, effectiveness of institutional arrangements to implement#enforce the

     policies.

    $.. #idterm and Terminal valuations

    i. =idterm

    =idterm evaluation is conducted at midpoint of the project implementation. It focuses on the

    relevance, performance $effectiveness, efficiency and timeliness), issues requiring decisions and

    actions, initial lessons learned about project design and implementation.

    ii. erminal

    his evaluation is conducted at the end of the project implementation. It focuses onF relevance,

     performance $effectiveness, efficiency and timeliness), issues requiring decisions and actions,

    initial lessons learned about project design and implementation.

    "arly signs of potential impact and sustainability of results, including the contribution to capacity

    development, recommendations for follow up activities and those proposed e.g. second phase of 

    a project.

    &.. !articipatory valuation Approac, to #onitoring and valuation

    ,at is participatory evaluation?

    7Participatory monitoring and evaluation is not just a matter of using participatory techniques

    within a conventional monitoring and evaluation setting. It is about radically rethinking who

    initiates and undertakes the process, and who learns or benefits from the findings.8

     GInstitute of evelopment 2tudies, %&&'

    Participatory evaluation is a partnership approach to evaluation in which stakeholders actively

    engage in developing the evaluation and all phases of its implementation. hose who have the

    most at stake in the program partners, program beneficiaries, funders and key decision makers

     play active roles. Participation occurs throughout the evaluation process including@

    • Identifying relevant questionsF

    •  planning the evaluation designF

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 16

  • 8/18/2019 Types of Evaluation-reviewed

    17/23

    LDP608: Project Monitoring and Evaluation

    • 2electing appropriate measures and data collection methodsF

    • athering and analy?ing dataF

    • 5eaching consensus about findings, conclusions and recommendationsF

    • isseminating results and preparing an action plan to improve program performance.

    Cundamentally, participatory evaluation is about sharing knowledge and building the evaluation

    skills of program beneficiaries and implementers, funders and others. he process seeks to honor 

    the perspectives, voices, preferences and decisions of the least powerful and most affected

    stakeholders and program beneficiaries. Ideally, through this process, participants determine the

    evaluation+s focus, design and outcomes within their own socioeconomic, cultural and political

    environments.

    ,y do participatory evaluation?

    Participatory approaches require the commitment and valuable time of many. Det, the benefits

    are far*reaching.

    Participatory evaluation allows groups to@

    Identify locally relevant evaluation :uestions

    Participatory evaluation ensures that the evaluation focuses on locally relevant questions that

    meet the needs of program planners and beneficiaries. Participatory approaches allow local

    stakeholders to determine the most important evaluation questions that will affect and improve

    their work.

    Improve program performance

    Participatory evaluation is reflective and action*oriented. It provides stakeholders, including

     beneficiaries, with the opportunity to reflect on project progress and generate knowledge that

    results in being able to apply the lessons learned. It provides opportunities for groups to take

    corrective action and make mid*course improvements.

    mpo5er participants

    A participatory approach is empowering because it claims the right for local people to control

    and own the process of making evaluation decisions and implementing them. Participating in an

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page 1(

  • 8/18/2019 Types of Evaluation-reviewed

    18/23

    LDP608: Project Monitoring and Evaluation

    evaluation from start to finish can give stakeholders a sense of ownership over the results.

    5ecogni?ing local talents and expertise builds confidence and pride in the community, and

    among participants.

    0uild capacity

    1onducting a participatory evaluation promotes participant learning and is an opportunity to

    introduce and strengthen evaluation skills. Active participation by stakeholders can result in new

    knowledge and a better understanding of their environment. his, in turn, enables groups to

    identify action steps and advocate for policy changes. It can provide participants with tools to

    transform their environments.

    evelop leaders and build teamsParticipatory evaluation builds teams and participant commitment through collaborative inquiry.

    Inviting a broad range of stakeholders to participate and lead different parts of the process can

    develop and celebrate local leadership skills. It can lead to stronger, more organi?ed groups,

    strengthening the community+s resources and networks.

    *ustain organi=ational learning and gro5t,

    Cinally, a participatory evaluation is not just interested in findingsF it is focused on creating a

    learning process. It creates a knowledge base among local people and organi?ations, which can

     be applied to other programs and projects. he techniques and skills acquired can lead to self*

    sustained action.

    &.1 8uiding !rinciples of !articipatory valuation

    • Participant focus and ownership H 2tructures and processes are created to include those

    most frequently powerless or voiceless in program design and implementation. he

     participatory process honors human contributions and cultural knowledge.

    •  9egotiation H Participants commit to work together to decide on the evaluation focus,

    how it should be conducted, how findings will be used and what action will result.

  • 8/18/2019 Types of Evaluation-reviewed

    19/23

    LDP608: Project Monitoring and Evaluation

    • Clexibility H ses creative methodologies to match the resources, needs and skills of 

     participants. 2ource@ .2. Agency for International evelopment, %&& and Institute of 

    evelopment 2tudies, %&&'

    &. *teps In planning for participatory valuation

    2ome of the key steps in the process of participatory monitoring and evaluation are as follows

    $www.unesco.org#ed, /0%6).

    i *etting +b"ectives6 'rames of reference

    "stablishing the frame of reference and  planning the details of the process, keeping in mind the

    concerns of the  stakeholders and ensuring their   participation is the first task in any P=J  "

    exercise. In this step you need to discuss about why evaluation is needed, to whom it is going to

     benefit, what  problems one might face and what should  be the objectives of evaluation exercise

    takes place.

  • 8/18/2019 Types of Evaluation-reviewed

    20/23

    LDP608: Project Monitoring and Evaluation

    involvement local population, people, likely to benefit from the programs, field level staff and

    organi?ers. :hen the emphasis is on development promoting organi?ations, open, critical and

    collective reflections on various organi?ational issues like people to people interactions,

    interpersonal interactions, issues of team building conflict management, tensions between the

    need for routine structure and spontaneity and flexibility can bring about a common and shared

    understanding of problems and collective efforts to solve them.

    iii eveloping met,ods to obtain t,at information and data collection 

    1hoice of methods becomes relevant here. :e can have open*ended interviews, questionnaires,

    structured interviews, group discussions, field observations study of records etc. Colk media,

    songs, role plays, dramas, art, drawing, have also been extensively used in getting information.

    iv Analy=ing data

    his is a stage of systemati?ation of information obtained. At this stage a collective process is

    supported and encouraged. P= and " involves at all levels all end users and stakeholders

    including the beneficiaries in data analysis. 2takeholders groups engage in critical reflection and

    thinking about the problems and constraints, success and outcomes of the activities undertaken.

    ata analysis primarily depends on the tools chosen for gathering data and on the information

    required by the participants.

    v ocumenting@ 2eporting and *,aring

    he collective analysis should be disseminated to all constituencies from where the information

    has been taken. his feedback is an important step. 2ome of the important criteria in

    documentation and reporting include@ clarity, simplicity, brevity, use of visuals, timeliness

    familiarity, and accessibility. 5esults should be communicated in different ways responding to

    end users+ needs.

    vi Creating 'uture *cenarios

    his step entails painting future scenarios on the basis of analysis developed and assessment of 

    outside environment for their work and programs etc.

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page )0

  • 8/18/2019 Types of Evaluation-reviewed

    21/23

    LDP608: Project Monitoring and Evaluation

    vii volving Action !lans

    hese action plans are broadly identified and not concretely planned in detail. =ultiple future

    scenarios are discussed, sorted out, integrated and the parties are encouraged to develop concrete

    action plans $www.unsesco.or#ed. /0%6)

    (. Conclusion

    he goal of evaluation is to determine the worth or merit of some procedure, project, process, or 

     product. :ell*designed evaluations also provide information that can help explain the findings

    that are observed. In these days of reform, educators are continually faced with the challenges of 

    evaluating their innovations and determining whether progress is being made or stated goals

    have, in fact, been reached. 4oth common sense and accepted professional practice would

    suggest a systematic approach to these evaluation challenges. he role that evaluation may play

    will vary depending on the timing, the specific questions to be addressed, and the resources

    available. It is best to think of evaluation not as an event, but as a process. he goal should be to

     provide an ongoing source of information that can aid decision making at various steps along the

    way.

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page )1

    http://www.unsesco.or/edhttp://www.unsesco.or/ed

  • 8/18/2019 Types of Evaluation-reviewed

    22/23

    LDP608: Project Monitoring and Evaluation

    ) 2eferences%. 4lank, 5. $%&&6) Developing a System of Education Indicators: Selecting, Implementing,

    and Reporting Indicators. "ducational "valuation and Policy Analysis, %B $%, 2pring)@/. 1hikati K $/00&).  Monitoring and Evaluation Handboo, ! regional "artnership for 

    resource development "ublication, signal press ltd, 9airobi

    6. Palton =.> $%&&0). #uality Evaluation and Research Methods, /nd "d. 9ew bury Park,

    sage

    L. A

  • 8/18/2019 Types of Evaluation-reviewed

    23/23

    LDP608: Project Monitoring and Evaluation

    %0. http@##www.unfpa.org#monitoring#toolkit#stakeholder.pdf  ate accessed@ th  Kune /0%6

    %%. http@##depts.washington.edu#ccph#pdfMfiles#"valuation.pdf read Kune /0%6 

    ate accessed@ th Kune, /0%6

    %/. http@##www.unesco.org#education#aladin#paldin#pdf#course0%#unitM0&.pdf  

    ate accessed@ th Kune, /0%6

     ,34e5 o Evaluation in Monitoring and Evaluation rou4 / A55ign7ent une )01&Page )&

    http://www.unfpa.org/monitoring/toolkit/stakeholder.pdfhttp://www.unfpa.org/monitoring/toolkit/stakeholder.pdfhttp://depts.washington.edu/ccph/pdf_files/Evaluation.pdf%20read%20June%202013http://www.unesco.org/education/aladin/paldin/pdf/course01/unit_09.pdfhttp://www.unfpa.org/monitoring/toolkit/stakeholder.pdfhttp://depts.washington.edu/ccph/pdf_files/Evaluation.pdf%20read%20June%202013http://www.unesco.org/education/aladin/paldin/pdf/course01/unit_09.pdf