copyright © 2008 delmar. all rights reserved. chapter 15 program development and evaluation
TRANSCRIPT
Copyright © 2008 Delmar. All rights reserved.
2
Program Development
• Program development is the alignment of activities to meet an intended purpose
Copyright © 2008 Delmar. All rights reserved.
3
Program Development
• Program planning– Concept of program development– Requires
• Assessment and identification of a need• Diagnosis of the need
Copyright © 2008 Delmar. All rights reserved.
4
Program Development
• Planning a strategic action plan– Implement the plan– Evaluate the plan
Copyright © 2008 Delmar. All rights reserved.
5
Program Development
• Frameworks in program development– Pollack (1994) pre-start up plan
• Mission statement clarification• Stakeholder analysis• Problem identification, strengths, weaknesses,
opportunities, threats
Copyright © 2008 Delmar. All rights reserved.
6
Framework for Planning Process in Program Development
• Nutt (1984) identified planning steps – Formulating– Conceptualizing– Detailing– Evaluating– Implementing
Copyright © 2008 Delmar. All rights reserved.
7
Framework for Planning Process in Program Development
• Witkin and Altschuld (1995) developed a three phase plan for assessing– Pre-assessment– Main assessment– Post-assessment
Copyright © 2008 Delmar. All rights reserved.
8
Role of Economic Analysis
• Informs decision makers
• Does not tell decision maker if increased expenditure is worthwhile
• Not always available
Copyright © 2008 Delmar. All rights reserved.
9
Economic Analysis
• Five types of economic analysis:1. Cost minimization analysis (CMA)
2. Cost consequence analysis (CCA)
3. Cost effectiveness analyses (CEA)
4. Cost utility analysis (CUA)
5. Cost benefit analysis (CBA)
Copyright © 2008 Delmar. All rights reserved.
10
Economic Analysis
• Three methods of valuation: 1. Discounting
2. Externalities
3. Intangibles
Copyright © 2008 Delmar. All rights reserved.
11
Program Evaluation
• Measures the implementation and outcomes of a program– Can be periodic assessment or on-going
• Program components– Program objectives– Program outputs– Program effects
Copyright © 2008 Delmar. All rights reserved.
12
Phases and Steps in Evaluation
• Identifying program objectives
• Selecting or creating measures of impacts
• Collecting data
• Interpreting data
• Disseminating the evaluation information
Copyright © 2008 Delmar. All rights reserved.
13
Evaluation and Program Manager
• Manager steps– Determine purpose of evaluation– Consider pros and cons
• Evaluator steps– Identify the purpose, objectives– Design rigorous evaluation
Copyright © 2008 Delmar. All rights reserved.
14
Planning/Implementing Practical Program Evaluation
• Six steps taken in any evaluation:1. Engage stakeholders
2. Describe public health program
3. Focus evaluation design
4. Gather credible evidence
5. Justify program evaluation conclusions
6. Ensure use of evaluation and share lessons learned
Copyright © 2008 Delmar. All rights reserved.
15
Theoretical Foundations
• Program Theory– Model I Logic models
• Program processes– Formative evaluation– Summative evaluation
Copyright © 2008 Delmar. All rights reserved.
16
Model II
• Precede-Proceed Framework– P-predisposing– R-reinforcing– E-enabling – Constructs in– Education/environment– Diagnosis– Evaluation
Copyright © 2008 Delmar. All rights reserved.
17
Model II
• Proceed– P-policy– R-regulatory– O-organizational– Constructs in – Educational– Environmental – Development
Copyright © 2008 Delmar. All rights reserved.
18
Model II
• Precede-Proceed Model– Integrates evaluation, planning, and program
planning