EVIDENCE-BASED PRACTICE: RESOURCES AND STRATEGIES FOR CITIZEN REVIEW PANELS

Alicia Luckie, MSEdi Winkle, MSW

1

Evidence-Based Practices

Approaches to practice that are validated by some form of

documented scientific evidence. These practices can range from

supported to well-supported based on the strength of the research design.

2

Evidence-Based Programs

A program that uses a defined curriculum or set of services that, when

implemented with fidelity, have been validated by some form of documented

evidence. These can range from supported to well-supported based on

the strength of the evidence.

3

Evidence Informed Practices

Practices that use the best available research and practice knowledge to guide program design and implementation

within context.

4

EBP &EIPShared Components:

Commitment to CQI &Ongoing Evaluation

Logic ModelManual/Protocol

Not HarmfulAccepted Practice

Evidence-InformedEmerging

•Ongoing collection of pre/post Data•Peer Review•Document all implementation activities

Promising•All elements of emerging, plus:•1 study, quasi-experimental design with control or comparison group•model fidelity

Supported•All elements of promising, plus:•2 randomized trials or 2 between group studies (or comparable methodology)•one year sustained effect

Well Supported•All elements of supported, plus:•Multiple site replication

Evidence Informed Evidence-Based 5

The House

Practices VS. Programs

EB practices could be skills, techniques, and strategies that can be

used in various settings

EB programs consist of collections of practices

that are done within known parameters

6

Best Practices

Do the best practice and program design we can with the knowledge and information we have access to

Different term but same concept

Best Practices = Evidence-Informed Practices

7

Evidence-Based Limitations

Small body of research in our type

of work

Ethical issues in research design

Diversity of potential

target population

Cost

Cookie cutter fit

Feasibility of program

design

Staff available to deliver services

Core component availability

Other program

constraints

8

Stop, Need to Know

KNOW Needs of Community

Target Population

Targeted Outcomes

Then Consider…

Where do we find information on

EB/EI?

Who should we talk to?

How do you find detailed info on a specific model/practice?

What are the intervention

components?

What about adaptation and fit?

9

Getting Started in Exploring EB/EI

•Registries•Developer Materials•Journals•Other Lists

Where do we find

information about

them?10

RegistriesAssist the public in identifying approaches that have been scientifically tested

Information may be• R

igorously reviewed

• Only voluntary

• Independent and objective

11

Using Registries

Multiple Registries Available

They each use different criteria

Programs will be ranked differently between registries

A few to get you started with…

California Evidence-Based Clearinghouse for Child Welfare

SAMHSA Model Programs Guide (NREPP)

Promising Practices Network

Wisconsin Clearinghouse for Prevention Resources

A Few Favorites

12

Practice Examples

Parent Training

Incredible Years

Safe Care Circle of Security

13

PROGRAM

COM

PARISON

EXAMPLE

14

Sections Current Picture Potential Program

Program Outcomes

Target Population

Population Eligibility

Program Setting

Type of Service

Staff/Training Qualifications

Length of Program

Resources and Costs

Program Materials Availability and Support

Getting Started in Exploring EB/EI

•Registries•Developer Materials•Journals•Other Lists

Where do we find

information about

them?15

Other Resources

Child Welfare Information Gateway• Clearinghouse for a wealth of

information• Search feature that allows

user to narrow terms and time frames

• User friendly• Librarians on staff

www.childwelfare.gov

Understanding Evidence• Evidence based decision-making as

you think about ways to prevent violence in your community

• Offers local practitioners and others working to prevent violence knowledge and resources for using evidence in their decision making process

http://vetoviolence.cdc.gov/evidence/#&panel1-1

“The Matrix”• CBCAP Evidence-Based

Program and Practice Matrix• Ranks programs in the

CBCAP/PART continuum according to review by other registries

• Only a guide for reporting and identifying potential programs

www.friendsnrc.org

16

Challenges

Multi-Disciplinary Groups

• Diverse Systems • Educating across systems (definitions and language) • Fragmented System (services)

Focus/Planning

• Where to start? (w/limited resources, time, etc.)• Multiple programs• Determining levels of evidence• Educating Stakeholders

17

Strategies to Address Challenges1) Multi-disciplinary Group – consider who is at the table. (law enforcement, judges, doctors, mental health, etc.)

2) Use Registries/other resources to show programs that work. (CEBC, Child Trends, CDC)

3) Encourage Teams – Focus on a topic area such as infant mental heath/substance abuse/shaken baby.

4) Focus on 1 Evidence-Based Program each year.

5) Add prevention programs and other service providers to CRPs. They help teams to produce better outcomes.

6) Create a Learning to Action Network (ie. Strengthening Families/protective factors)

7) Advocate for Policy Changes – (ie. Home Visiting Legislation and Child Sexual Abuse Prevention)

8) Statewide Prevention Plan – include CBCAP Lead and other prevention partners.

18

19

Edi Winkle bb ewinkle@friendsnrc.org (918) 279-6682 Alicia Luckie aluckie@friendsnrc.org (334) 567-3291