evidence-based public health tpha 2013 paul campbell erwin, md, drph professor and department head...
TRANSCRIPT
![Page 1: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/1.jpg)
1
Evidence-Based Public HealthTPHA 2013
Paul Campbell Erwin, MD, DrPHProfessor and Department Head
Department of Public Health, University of Tennessee
![Page 2: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/2.jpg)
2
Learner Objectives
1. Identify and describe the domains of EBPH;2. Understand the applicability of EBPH to
improving the efficiency, effectiveness, and accountabilities of public health practice;
3. Describe how EBPH concepts can provide the basis for stating the value of local public health to stakeholders.
![Page 3: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/3.jpg)
3
![Page 4: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/4.jpg)
4
Why do we do the things we do?
How do we decide what to do?
![Page 5: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/5.jpg)
5
How do we decide what to do?
![Page 6: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/6.jpg)
6
Why do we do the things at WORK the way that we do?
How do we decide what to do?
Among competing priorities, how do we decide what to do, and why?
![Page 7: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/7.jpg)
7
![Page 8: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/8.jpg)
8
![Page 9: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/9.jpg)
9
Evidence-Based Public Health the process of integrating science-
based interventions with community preferences to improve population health.
Dr. Ross Brownson
Acknowledgment: To Dr. Ross Brownson and team, for all EBPH Framework slides and general approach
![Page 10: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/10.jpg)
10
Retool
Discontinue
Disseminate widely
![Page 11: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/11.jpg)
What is “Evidence”?
11
![Page 12: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/12.jpg)
What is “Evidence”? Scientific literature in systematic reviews Scientific literature in one or more
journal articles Public health surveillance data Program evaluations Qualitative data
– Community members– Other stakeholders
Media/marketing data Word of mouth Personal experience
Objective
SubjectiveLike beauty, it’s in the eye of the beholder…
12
![Page 13: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/13.jpg)
Are we talking only of scientific evidence?
13
![Page 14: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/14.jpg)
Where am I?
You’re 30 yards above the
ground in a balloon
You must be a researcher
Yes. How did you know?
Because what you told me is
absolutely correct but completely
useless
You must be a practitioner
Yes, how did you know? Because you don’t know
where you are, you don’t know where you’re
going, and now you’re blaming meThe problem
14
![Page 15: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/15.jpg)
15
How much Evidence is enough?
“The best is the enemy of the good”
Voltaire
![Page 16: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/16.jpg)
The effectiveness of parachutes has not been subjected to rigorous evaluation by using randomised controlled trials…. We think that everyone might benefit if the most radical protagonists of evidence based medicine organised and participated in a double blind, randomised, placebo controlled, crossover trial of the parachute.Smith and Pell, BMJ, 2004
16
![Page 17: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/17.jpg)
How are decisions generally made in public health settings?
17
![Page 18: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/18.jpg)
How are decisions generally made in public health settings?
History/inertia Anecdote Pressure from policy makers or administrators Media driven Resources/funding availability (C-E) Peer reviewed literature/systematic reviews Expert opinions (e.g., academics, community
members)
OR Combined methods, based in sound science The challenge is in how to make the best use of
multiple sources of information & limited resources. 18
![Page 19: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/19.jpg)
Some Key Characteristics of EBPH1. Making decisions based on the best
available peer-reviewed evidence (both quantitative and qualitative research);
2. Using data and information systems systematically;
3. Applying program planning frameworks (that often have a foundation in behavioral science theory);
19
![Page 20: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/20.jpg)
Some Key Characteristics of EBPH
20
4. Engaging the community* in assessment and decision making;
5. Conducting sound evaluation; and
6. Disseminating what is learned to key stakeholders and decision makers.
* Community of fellow staff/employees, of workgroups, of neighborhoods, etc.
![Page 21: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/21.jpg)
21
Small Group Work
What was the most recent NEW thing you did at work?
Why did you do it? What was the Evidence-Base for
decision-making? Did it make a difference?
![Page 22: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/22.jpg)
22
EBPH is NOT Rocket Science **
What’s the problem? How big is it? What’s the cause? What do I do about it? Once I do something, how do I know
I’ve made a difference?
** But rocket science depends on the use of evidence
![Page 23: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/23.jpg)
23
EBPH begins with The Question
![Page 24: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/24.jpg)
24
What’s the issue?
![Page 25: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/25.jpg)
25
EBPH begins with The QuestionFor example…..
What are the most important health problems in our community?
Given the problems of Obesity, Chronic Disease, Child Health and Health Disparities, and Substance Use, what should we focus on? And once we decide, what should we do?
What’s the best way to reduce tobacco use in our community? In our health department?
How do we reduce no-show rates in Family Planning?
![Page 26: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/26.jpg)
26
What’s the issue?
![Page 27: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/27.jpg)
Community Assessment
• Decide what to assess• Decide the best methods to collect the
data to answer your questions• Develop a work plan that identifies
tasks to accomplish, partner roles and responsibilities, and a time frame for completion
• Organize information as it is collected so that it can be shared with all partners, community stakeholders, and community members.
27
![Page 28: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/28.jpg)
Community Assessment
• Present information gathered and summarized from the community assessment back to partners• Coalition/partnership• Community forum• Meetings with community groups
• Move to Action Planning – what do we do to create the desired changes?
28
![Page 29: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/29.jpg)
Community HealthIssues
Identify and discuss
problems and causal factors
Performance Improvement
Approach to Community Health Assessment, 2012-13
Phase 2 Focused
Assessment
Phase 1 Secondary Data
Assessment
Target yourCommunity
health Intervention
programs
Target your community
health intervention
programs
![Page 30: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/30.jpg)
30
What’s the issue?
How big is it?
![Page 31: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/31.jpg)
Quantifying the issue
• Disease/condition vs. Death
• Incidence/Prevalence vs. Mortality
• Problem of small numbers
• Types of rates
31
![Page 32: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/32.jpg)
Quantifying the issue
• Incidence = new cases; a measure of
risk
• Prevalence = existing cases; a
measure of the overall burden of
disease
• P = I x D
32
![Page 33: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/33.jpg)
Downloaded from: StudentConsult (on 4 September 2008 03:58 PM)© 2005 Elsevier
In a steady state: P = I x D
![Page 34: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/34.jpg)
Downloaded from: StudentConsult (on 4 September 2008 03:58 PM)© 2005 Elsevier
![Page 35: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/35.jpg)
Downloaded from: StudentConsult (on 4 September 2008 03:58 PM)© 2005 Elsevier
![Page 36: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/36.jpg)
Downloaded from: StudentConsult (on 4 September 2008 03:58 PM)© 2005 Elsevier
![Page 37: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/37.jpg)
Quantifying the issue
A program to address cardiovascular disease was put in place twenty years ago. An evaluation of the program showed that the prevalence of cardiovascular disease remained the same after twenty years. The program director was convinced this was a good program, but the evaluator retorted – “20 years and no improvement in prevalence?” How can you help this program director out – i.e., how could you explain that the program has indeed been successful despite a stable prevalence rate?
37
![Page 38: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/38.jpg)
P = I x DTime 1: __ = 10 x 550 = 10 x 5Time 2:__ = 5 x 1050 = 10 x 5
38
![Page 39: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/39.jpg)
39
![Page 40: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/40.jpg)
Where do we get good data on Disease/Condition
Population-based
Vital Statistics• Birth and death
Reportable diseases
Registries• Birth defects• Cancer• Immunizations• Trauma
Representative Samples
National Health Interview Survey (NHIS)
National Health and Nutrition Examination Survey (NHANES)
Behavioral Risk Factor Surveillance System (BRFSS)
Youth Risk Behavior Survey (YRBS)
Hospital/facility-based
TennCareTHA
40
![Page 41: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/41.jpg)
Quantifying the issue
The problem of small numbers: most challenging when expressed as rates, when the multiplier is large and the actual numerators and denominators are relatively small
41
![Page 42: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/42.jpg)
Quantifying the issue
The problem: in 1994 a call from central office to alert me that the female African-American mortality rate for diabetes was higher in Claiborne County than for any county in the state, including Shelby County.
http://hit.state.tn.us/index.shtml
42
![Page 43: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/43.jpg)
43
What’s the issue?
How big is it?
How important is it?
![Page 44: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/44.jpg)
Developing a concise statement of the issue through “Data Synthesis”
![Page 45: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/45.jpg)
![Page 46: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/46.jpg)
Data Synthesis in MAPP
What are we synthesizing?
![Page 47: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/47.jpg)
http://healthyknox.org/home.html
![Page 48: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/48.jpg)
How can we create a sustainable network of partnerships that effectively contributes to improved community health?
STRATEGICISSUES
www.healthyknox.org
![Page 49: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/49.jpg)
How can we achieve equitable health outcomes for all community members?
STRATEGICISSUES
www.healthyknox.org
![Page 50: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/50.jpg)
How can we position health as a consideration in community policy and planning decisions?
STRATEGICISSUES
www.healthyknox.org
![Page 51: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/51.jpg)
51
What’s the issue?
How big is it?
How important is it?
What is the cause?What should we do about it?
![Page 52: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/52.jpg)
Determining what is known using scientific literature
Do immunizations work? Does family planning work? Does WIC work? Does restaurant inspection work? Do County Health Councils work?
52
![Page 53: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/53.jpg)
Evidence-Based Public Health
http://www.thecommunityguide.org/index.html
http://prcstl.wustl.edu/training/Pages/Evidence-Based-Public-Health-Course.aspx
![Page 54: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/54.jpg)
Evidence-Based Public Health
For which of the following is there strong or sufficient evidence that the intervention is effective (“recommended”) in obesity prevention and control?:Provider remindersSchool-based programsWorksite programs
http://www.thecommunityguide.org/obesity/index.html
54
![Page 55: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/55.jpg)
Ok…Programs…but what about evidence for how we operate?
Fostering more effective public health by identifying administrative evidence-based practices. Brownson RC, Allen P, Duggan K, Stamatakis KA, Erwin PC. Am J Prev Med 43(3):309 –319, 2012
55
![Page 56: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/56.jpg)
Administrative Evidence-Based Practices
56
Domain Evidence-Based Practice
Workforce development Training
Access to technical assistance
Leadership Skills and background of leaders
Values and expectations of leaders
Participatory decision-making
Organizational climate and culture Access and free flow of information
Support of innovation and new methods
Learning orientation
Relationships and partnerships Interorganizational relationships
Vision and mission of partnerships
Financial Allocation and expenditure of resources
![Page 57: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/57.jpg)
![Page 58: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/58.jpg)
58
What’s the issue?
How big is it?
How important is it?
What is the cause?What should we do about it?
What are we going to do about it?
![Page 59: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/59.jpg)
Developing & Prioritizing Options
1. Multi-voting Technique2. Strategy Grids3. Nominal Group Technique4. The Hanlon Method5. Prioritization Matrix
59
![Page 60: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/60.jpg)
Developing & Prioritizing Options
60
![Page 61: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/61.jpg)
61
Developing & Prioritizing Options
![Page 62: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/62.jpg)
![Page 63: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/63.jpg)
![Page 64: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/64.jpg)
64
What’s the issue?
How big is it?
How important is it?
What is the cause?What should we do about it?
What are we going to do about it?
How are we going to do it, when, with what results?
![Page 65: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/65.jpg)
Developing an Action Plan and Implementing Interventions
Assessment should guide the development of programs
Community members should participate in the process
Program should be developed with key partners or as part of coalitions (builds infrastructure for change)
Participants should develop a comprehensive intervention strategy- but may implement one step at a time
Evaluation should emphasize feedback and program improvement
The community capacity for health promoting changes should be increased – skill transfer between community & academic/practice partners (two way)
65
![Page 66: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/66.jpg)
Program development and implementation
Source: http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
![Page 67: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/67.jpg)
67
What’s the issue?
How big is it?
How important is it?
What is the cause?What should we do about it?
What are we going to do about it?
How are we going to do it, when, with what results?
How will we know if we have made a difference?
![Page 68: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/68.jpg)
Why Evaluate?
68
What funders want:– Prove that their money is making a
big difference in outcomes of their choice.
What grantees/people who receive funds want: – Show that they should be given more
money to continue and expand the good work they are doing.
![Page 69: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/69.jpg)
The Evaluation Trap
69
If evaluation is conducted for these reasons only, the result, over time, may be to undermine both political support for funding and program quality.
Why? These motivations can lead to: – looking for wrong outcomes – looking for wrong effect sizes (how big a
difference your program makes)
![Page 70: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/70.jpg)
Logic models document your theory of change: how your program works
70
SpecifiedInterventionComponents
AndActivities
SpecifiedInterventionComponents
AndActivities
ChosenDeterminants
(Risk & ProtectiveFactors)
ChosenDeterminants
(Risk & ProtectiveFactors)
Outcomes
Interventions• Inputs• Activities
OutcomesProximalDeterminants• Behaviors• Outputs
![Page 71: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/71.jpg)
71
Early detection of breast cancer
Outcomes
Breast cancer screening by mammography
Determinants
Provider reminder and recall systems
Activities
Evaluation Strategy 1: Start with Outcomes
![Page 72: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/72.jpg)
We are used to thinking about activities first.
That’s OK! Build the model from left to right.
But you still need to think through why your activities “make a difference.”
72
Evaluation Strategy 2: Start Building the Model with Activities
![Page 73: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/73.jpg)
73
SpecifiedActivitiesSpecifiedActivities
Immediate or short-term outcomes
(Exactly the sameas proximaldeterminants)
SpecifiedOutcomesSpecifiedOutcomes
Evaluation Strategy 2: Start Building the Model with Activities
![Page 74: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/74.jpg)
Evaluation Words of Wisdom Don’t worry about the labels
– Determinants are often called outputs– Outcomes are sometimes called impacts– Sometimes logic models have separate columns
for inputs, activities, outputs, short-term outcomes, long-term outcomes, and impacts (whew!).
Focus instead on the causal mechanisms.– If you think through the logic of why your program
works, you can fill in any format the funder/evaluator requires of you.
– ….and actually benefit from the experience!
74
![Page 75: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/75.jpg)
75
Small Group Work
What was the most recent NEW thing you did at work?
Why did you do it? What was the Evidence-Base for
decision-making? Did it make a difference? –
create a logic model with inputs, activities (outputs), and outcomes to evaluate
![Page 76: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/76.jpg)
Contextual Factors(Individual Student Characteristics – Race, Special Needs, Language, achievement; Family Characteristics – Income, parental education, structure;School Characteristics- Average Test Scores, Mobility, %FRL, Attendance; Community – % Poverty, % Affluent, % Idle youth)
TCAP Staff
Administrative Buy-in/Support
Organizational Structure
INPUTS ACTIVITIES OUTPUTS OUTCOMES
Example of a Complex Logic Model: Turning the Corner on Achievement Program
June 1, 2006 Center for Adolescent Health, JHU
Relationship with Families
School-Level
TCAP-Level
Motivation toAchieve
New PossibleIdentities
Social Development
Intermediate Outcomes Improved
AcademicAchievement
Ultimate Outcomes
ImprovedAttendance
Access toCommunityResources
Academic•Integrated•Acceleration•Targeted
Arts & Culture
StudentAssessment
Lifestyles and Career
Reduced HealthRisk Behaviors
Improved Mental Health
Students Experience…Physical and Psychological SafetyAppropriate StructureSupportive RelationshipsOpportunities to BelongPositive Social NormsSupport for Efficacy and MatteringOpportunities for Skill BuildingIntegration of School, Family, and CommunityExposure to new opportunities
Staff Experience…Support Tools to perform
Families Experience…Engagement in EducationParenting SupportAccess to resources
Psychological and Emotional Development
Professional Development
Organizational Structure
Communication skills
Family Support Services
Community Service
Improved Social Relationships
Relationship with Teachers
Leadership skillsStudents and Families
Relationship w/ families
Relationship w/ school
Improved Civic Engagement
![Page 77: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/77.jpg)
Evidence-Based Decision Making
![Page 78: Evidence-Based Public Health TPHA 2013 Paul Campbell Erwin, MD, DrPH Professor and Department Head Department of Public Health, University of Tennessee](https://reader035.vdocuments.net/reader035/viewer/2022062801/56649e615503460f94b5c580/html5/thumbnails/78.jpg)
78
What’s the issue?
How big is it?
How important is it?
What is the cause?What should we do about it?
What are we going to do about it?
How are we going to do it, when, with what results?
How will we know if we have made a difference?