are blue states more evidence-based?...examples of state ebp policies and investments ebp policies...
TRANSCRIPT
![Page 1: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/1.jpg)
Are Blue States More Evidence-Based? Associations between State Context, Behavioral
Health Structures, and Use of Data and Evidence
Eric J. Bruns, Michael D. Pullmann, Spencer Hensley, Elizabeth M. Parker
University of Washington School of Medicine
Kimberly E. Hoagwood
New York University Langone Medical Center
31st Annual Research and Policy Conference on Children’s Behavioral Health
Tampa, FL
March 5, 2018
Acknowledgments: This research was partially supported by the National Institute of Mental Health (P30 MH090322; Hoagwood PI)
and by the Technical Assistance Network for Children’s Behavioral Health at the University of Maryland, Baltimore, School of Social Work
![Page 2: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/2.jpg)
2
Growth in Literature on Evidence Based
Treatment (EBT)
WOS Categories searched: = Psychiatry, Psychology, Social Work, Substance Abuse
Web of Science Search:
Evidence-based * treatment
![Page 3: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/3.jpg)
3
Proliferation of Reports on Health and
Behavioral Health Systems
![Page 4: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/4.jpg)
4
Emphasis on the Science of Implementing EBTs
![Page 5: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/5.jpg)
7
Growth in Literature on EBT, 2001-2012
versus trends in SMHA adoption/investment
0
100
200
300
400
500
600
700
800
900
Num
ber
of
Public
ations
per
year
% S
tate
s im
ple
ment
ing M
ST
% S
tate
s w
ith
bud
get
reque
sts
for
EBT
0%
50%
100%
![Page 6: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/6.jpg)
8
Continuing the Inquiry:What predicts states’ use of data and research?
1. What is the relationship between state
characteristics and fiscal and policy supports
to promote EBPs?
2. What is the relationship between state
characteristics, fiscal and policy supports, and
actual EBP adoption and penetration?
![Page 7: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/7.jpg)
9
Conceptual model of EBP implementation in
public sectors (Aarons et al., 2011)
![Page 8: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/8.jpg)
10
Focus on the “Outer Context”
The HPRC Dissemination FrameworkHarris JR, Cheadle A, Hannon PA, et al. A Framework for Disseminating Evidence-Based Health Promotion Practices. Preventing
Chronic Disease. 2012;9:E22.
![Page 9: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/9.jpg)
11
Research on state efforts to
“modify the outer context”
Magnabosco (2006):106 unique state activities
to support implementation of EBPs for adults
with SMI
State infrastructure building
Stakeholder relationship building
Financing
Continuous quality management
Services delivery practices and training
![Page 10: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/10.jpg)
12
Model guiding current research
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP funding (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of
information systems and
data reports is used to
promote the adoption of
EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 11: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/11.jpg)
13
Data sources
National Association for State Mental Health Program Directors Research
Institute (NRI):
State Profiles System (SPS)
Uniform Reporting System (URS)
U.S. Census Bureau
Total Adults and Children
Region
U.S. Department of Commerce
Per capita income
Kaiser Family Foundation
Medicaid Expansion Status
Carl Klarner’s Dataverse Project
Budget Surplus or Deficit
Modifiable outer context
Unmodifiable outer context
EBP adoption
![Page 12: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/12.jpg)
14
URS and SPS data
State Profiles System (SPS)
Asks about each State Mental Health Authority’s (SMHA)
Organization and structure
Service systems
Eligible populations
Emerging policy issues
Numbers of consumers served
Fiscal resources
Consumer issues
Information management structures, and
Research and evaluation initiatives
Uniform Reporting System (URS)
Use of EBPs (TFC, FFT, MST, SE, SH, ACT)
![Page 13: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/13.jpg)
15
URS and SPS data
Respondents are SMHA representatives in all 50
states, DC, Puerto Rico, and Virgin Islands.
Good response rates by states and territories over
the study period
Range = 86.6% (46 of 53) in 2001 to 98.1% (52 of 53) in
2005.
![Page 14: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/14.jpg)
16
Years examined
Analyses today include longitudinal data from
several years:
2002
2004
2005
2007
2009
2010
2012
![Page 15: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/15.jpg)
17
Key Variables
EBP Policy Index and Investment Index
Created through calculating the percent of items related to policy (5
items) or investment (12 items) that were endorsed
Possible range: 0 (no items endorsed) to 100 (all items endorsed)
Individual EBP variables
Dichotomous variable indicating availability/unavailability of 6 EBPs (3
adult, 3 child)
EBP count variable
Created by summing the number of different EBPs available
Possible range: 0 (no EBPs) to 6 (all 6 EBPs available)
![Page 16: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/16.jpg)
18
Examples of state EBP policies and investments
EBP Policies (examples) 2012 Frequency
Incorporation in contracts is used to promote the adoption of EBPs 57%
The SMHA has linked its client datasets with datasets from other agencies 47%
SMHA has initiatives to work with other state government agencies to
coordinate, reduce, or eliminate barriers between delivery systems and
funding streams?
86%
Provider-to-provider training used to provide ongoing training 57%
EBP Investments (examples) 2012 Frequency
Specific budget requests are used to promote the adoption of EBPs 24%
Financial incentives are used to promote the adoption of EBPs 29%
Modification of information systems and data reports is used to promote
the adoption of EBPs
43%
![Page 17: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/17.jpg)
19
Data analysis
Multilevel Models (MLM) used to examine
change over time
Population-average models with robust standard
errors, full MLE and randomly varying terms
Best-fitting, most parsimonious models reported
![Page 18: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/18.jpg)
Summary of Findings
![Page 19: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/19.jpg)
21
State characteristics (2012)
Characteristics (2012) Frequency
Region South 33%
West 25%
Midwest 24%
Northeast 9%
Per capita income (mean, SD) $42,492 ($7,605)
Budget surplus/deficit (mean, SD)* -$589,792 ($2,382,388)
Adopted Medicaid expansion 63%
Governor party affiliation Republican 58%
Democratic 40%
Independent 2%
Legislative branch affiliation Both Republican 55%
Both Democratic 31%
Split 8%* 2010
![Page 20: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/20.jpg)
22
Results: State characteristics & EBP investment
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 21: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/21.jpg)
23
Results: State characteristics & EBP investment
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 22: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/22.jpg)
24
Results: State characteristics & EBP investment
Predictors of EBP Investment Index Unstandardized Coefficient (p-value)
Research conducted outside SMHA 9.8 (0.002)
Medicaid expansion 9.3 (0.02)
Research conducted within SMHA 8.1 (0.01)
Per capita income (in thousands of dollars) 4.3 (0.04)
Control of legislative and executive branches 2.7 (0.03)
# of EBPs available 2.2 (0.04)
* Normal distribution MLM; linear time centered at 2002 and quadratic time included in the models as a covariates. Quadratic time only retained when significant.
State characteristics not significantly associated with the EBP investment index:
Budget surplus, SMHA funding structure, SMHA location (in another state agency or
independent), SMHA membership in governor’s cabinet, SMHA promotion of survivor
participation in resource allocation, consumer participation, SMHA involvement in
collaborative initiatives to eliminate barriers to treatment, government agency
representatives are members of the SMHA planning group, location of information
management functions, SMHA actively downsizing/being reconfigured, mental health per
capita expenditures
![Page 23: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/23.jpg)
25
Results: State characteristics & EBP policies
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 24: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/24.jpg)
26
Results: State characteristics & EBP policies
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 25: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/25.jpg)
27
Results: State characteristics & EBP policies
Predictors of EBP Policy Index Unstandardized Coefficient (p-value)
SMHA collaborates with other agencies 27.9 (0.00)
Reps from state government agencies are
members of the SMHA planning group
10.6 (0.05)
Research conducted outside SMHA 9.1 (0.02)
Research conducted within SMHA 8.9 (0.02)
# of EBPs available 2.2 (0.03)
SMHA is located within another state agency -8.7 (0.05)
* Normal distribution MLM; linear time centered at 2002 and quadratic time included in the models as a covariates. Quadratic time only retained when significant.
State characteristics not significantly associated with the EBP policy index: Control
of legislative and executive branches, budget surplus, per capita income, region,
Medicaid expansion, SMHA funding structure, SMHA membership in governor’s
cabinet, SMHA promotion of survivor participation in resource allocation, consumer
participation, location of information management functions, SMHA actively
downsizing/being reconfigured, mental health per capita expenditures
![Page 26: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/26.jpg)
28
Results: EBP investments/policies and EBP adoption
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 27: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/27.jpg)
29
Results: EBP investments/policies and EBP adoption
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 28: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/28.jpg)
30
Results: EBP investments/policies and EBP adoption
Outcome: MSTOdds Ratio
(p-value)
EBP Policy Index 1.01 (0.03)
Outcome: FFTOdds Ratio
(p-value)
EBP Policy Index 1.02 (0.001)
EBP Investment Index 1.01 (0.04)
Outcome: SEOdds Ratio
(p-value)
EBP Investment Index 1.03 (<0.001)
* Bernoulli distribution MLM; linear time centered at 2002 and quadratic time included in the models as a covariates.
Quadratic time only retained when significant.
![Page 29: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/29.jpg)
31
Results: State characteristics & EBP adoption
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 30: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/30.jpg)
32
Results: State characteristics & EBP adoption
• Region
• Per capita income
• State budget strength
• Controlling political party
• Medicaid expansion
• SMHA independence
• SMHA location
• SMHA per capita expenditure
• SMHA funding (state direct vs
local)
EBP policies (examples):
• Incorporation in contracts is used
to promote the adoption of
EBPs
• Link dataset with other agency
datasets
• Collaborate with other agencies
• Provider-to-provider training
used to provide ongoing
training
• MST
• FFT
• TFC
• ACT
• Supported
Employment
• Supported HousingEBP investment (examples):
• Specific budget requests
are used to promote the
adoption of EBPs
• Modification of information
systems and data reports is
used to promote the
adoption of EBPs
MODIFIABLE OUTER CONTEXT
UNMODIFIABLE OUTER CONTEXT: State Characteristics
EBP ADOPTION
![Page 31: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/31.jpg)
33
Results: State characteristics & EBP adoption
PredictorsEvent Rate Ratio
(p-value)
SMHA promotes survivor participation 1.2 (0.05)
Information management function located within the SMHA 0.75 (0.05)
SMHA directly operates community-based programs 1.3 (0.03)
State characteristics not significantly associated with EBP adoption:
Control of the legislative and executive branches, budget surplus, region, Medicaid
expansion, SMHA location (in another state agency or independent), SMHA
membership in governor’s cabinet, SMHA research location (within/outside), consumer
participation, SMHA involvement in collaborative initiatives to eliminate barriers to
treatment, government agency representatives are members of the SMHA planning
group, SMHA actively downsizing/being reconfigured, mental health per capita
expenditures
* Poisson distribution MLM; linear time centered at 2002 also included in the models as a covariate.
![Page 32: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/32.jpg)
34
Summary of findings
State EBP investments increase when:
Democrats control the legislative and executive branches
Per capita income increases
State has expanded Medicaid eligibility under the PPACA
Research is conducted within and outside the SMHA
More EBPs (adult and child) are being implemented
State EBP policies increase when:
Research is conducted within and outside the SMHA
SMHA collaborates with other agencies to ensure the provision of MH
services
Representatives from state government agencies are members of the
SMHA planning group
More EBPs (adult and child) are being implemented
![Page 33: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/33.jpg)
35
Summary of findings
Availability of specific adult and youth EBPs:
An increase in EBP policies is associated with an increased odds of
having MST available
An increase in EBP policies and investments is associated with an
increased odds of having FFT available
An increase in EBP investments is associated with an increased odds of
having SE available
States have a greater rate of EBP adoption when:
SMHAs directly operate community-based programs compared to
funding but not operating community-based programs
SMHAs promote survivor participation
![Page 34: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/34.jpg)
36
Limitations
Reliance on self-report from SMHA officials
SMHAs are not the only systems that may provide these EBPs – or oversee
investments and policies – in a state
SMHA respondents may not be fully informed
Selected EBPs provide a very limited picture
Surveys inquired only about EBPs designed for adults and children with serious
conditions, per MH Block Grant
Can only speculate about directionality of relationship
EBP adoption may promote research investments and policies as much as
vice versa
Other factors related to EBP implementation not examined, e.g. costs
associated with implementing EBPs, workforce
Small sample size precluded use of more complex statistical modeling
![Page 35: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/35.jpg)
37
Conclusions OTHERS’ THOUGHTS
State investment in EBPs, implementation, and use of data has
not kept pace with the volume of literature on these topics over
the same time period:
Recession of 2007 proposed to have a major role
However, other factors may be equally if not more important
than state fiscal outlook:
Relative affluence of the population
Political party in power
Direct funding of services by the state (rather than funding local
agencies)
Medicaid expansion
Interagency collaboration
Investment in research infrastructure
![Page 36: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/36.jpg)
38
Conclusions OTHERS’ THOUGHTS
State implementation of adult EBPs may be reliant on
fiscal investments, e.g.:
Financial
Fund research center
Awareness
Adoption and penetration of child EBPs may be
related to policy, e.g.:
Academia EBP curricula
Provider to provider
Contractual arrangements with providers
Internal staff
![Page 37: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/37.jpg)
39
Conclusions UPDATE
More research is needed on these dynamics
Examination of predictors
Reliable and valid measurement of implementation and
uptake – investment in more rigorous monitoring
Take advantage of the “natural experiments” presented by
the range of state strategies
How can the system of care philosophy and resources
provided (e.g., by SAMHSA grants, Technical
Assistance) promote better uptake and support to
EBP?
![Page 38: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/38.jpg)
40
Percentage of states using specific
evidence-based practices
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
2001 2002 2004 2005 2007 2008 2009 2010 2011 2012
TFC
MST
FFT
SH
SE
ACT
State Profiles Survey Uniform Reporting System
• Pre-2007 (SPS), SMHA reps were asked Yes or No about adopting selected EBTs
• Post-2007 (URS), states were asked for counts of clients served and were assumed to NOT be implementing if they
answered “0.”
• Piecewise linear time trends find significant increases from 2001-2005, followed by no change from 2007-2012
Perc
ent
of sta
tes
![Page 39: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/39.jpg)
41
Median numbers of people served by
specific evidence based practices
0.00
200.00
400.00
600.00
800.00
1000.00
1200.00
1400.00
1600.00
1800.00
2007 2008 2009 2010 2011 2012
TFC***
MST
FFT**
SH*
SE
ACT
*Sig. cubic change ( then flat); ** Sig. linear change ( );
***Sig quadratic change ( then ).
Me
dia
n n
um
be
r se
rve
d
![Page 40: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/40.jpg)
42
Initiatives to Support EBP
Implementation
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
90.0
100.0
2002 2004 2007 2009 2010 2012
What initiatives, if any, are you implementing to promote the adoption of EBTs?
Awareness/Training*
Consensus building among stakeholders**
Incorporation in contracts*
Monitoring of fidelity**
Financial incentives*
Modification of IT systems and data reports
Specific budget requests**
* p < .05 for a time trend ( )
** p < .05 for a quadratic time trend ( then )
Pe
rce
nt o
f sta
tes
![Page 41: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/41.jpg)
43
EBP Utilization
65-80% of states use selected adult EBPs
Median clients served in these states 400-700
Penetration rates = 1.5% - 3.0% of estimated adults with
SMI
25%-50% of states use selected child EBPs
Median clients served in these states 250-400
Penetration rates = 0.75% - 2.5% of all youths with SED
Several EBPs showed increases in early 2000s
followed by decreases or flattening from 2007-2012
![Page 42: Are Blue States More Evidence-Based?...Examples of state EBP policies and investments EBP Policies (examples) 2012 Frequency Incorporation in contracts is used to promote the adoption](https://reader036.vdocuments.net/reader036/viewer/2022071217/604a4dde31b2035fa866b4ca/html5/thumbnails/42.jpg)
44
For more information
Eric J. Bruns – [email protected]
IDEAS Center --
www.ideas4kidsmentalhealth.org
NASMHPD Research Iinstitute --
https://www.nri-inc.org/