Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

Lessons Learned from the PA DOC’s Recidivism Reduction Efforts:

Experiences in Implementing Evidence-Based, Research-Driven Practices

Jeffrey A. Beard, Ph.D.Secretary of Corrections

Pennsylvania Department of Corrections

American Society of Criminology Annual Meeting:“Criminology & Criminal Justice Policy”

November 6, 2009Marriott DowntownPhiladelphia, PA

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

Why Follow Evidence-Based Practice? Why Is Research Important?

Maintaining the safety of our communities requires smart, fiscally responsible public policy and effective practices

Traditionally, CJS policy has been fueled by subjective information

Public fear & emotion following isolated incidents, myths/distorted perceptions regarding crime rate, prevalence of certain problems, etc.

Common/traditional/preferred response – heavy reliance on incarceration

population growth in unrelenting - “1 in 31” (Pew)

fiscal impact has been tremendous - nearly $30 billion by 2011 (Pew)

creates roadblocks to reentry (stigma, job, housing, social ties, etc.)

recidivism - 68% arrested for new crime within 3 yrs of release (BJS)

Research informs objective policy-making & guides cost-effective practice

Provides objective evidence necessary to debunk myths/perceptions

Ensures limited resources are allocated wisely, most efficiently & effectively

Supports the rehabilitative ideal, “treatment works”…if done correctly

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

How Has Research Been Used In Our Agency? Active agenda for evaluating quality & effectiveness of programs

Employ “Program Evaluation Research System (PERS)” Model

Internally identify evaluation and research needs for a particular program

Partner with external (objective) evaluator (university) with interest & expertise in area

External evaluator seeks third party funding to support evaluation activities

Develop evaluation plan in cooperation with research partner

Conduct evaluation and utilize results to enhance programs

Results of PERS Model Over Past 11 Years (2008 Innovation Award, CSG):

leveraged $3.5 million in external funding (18 major grant awards)

provided high quality, objective, policy-relevant research on PA DOC programs

justify budget request, demonstrate fiscal accountability to taxpayers

meet legislative mandates, grant/funding requirements/stipulations

contributed to national consensus on effective treatment strategies

results of numerous process & outcome evaluations led to program improvements

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

Outcome Evaluations Process Evaluations

• Alcohol & Other Drug (AOD) Programs (5 TC’s)**

• Residential Substance Abuse Treatment (RSAT)

• Long Distance Dads (LDD) Program

• Educational/Vocational Programs

• Community Orientation Reintegration (COR)

• SCI Chester Therapeutic Community (TC)

• Young Adult Offender Program (YAO, Pine Grove)

• Community Corrections System

* Correctional Program Assessment Inventory

**5 TC study included CRE, GRA, HOU, HUN, WAM

• Alcohol & Other Drug (AOD) Programs

• Residential Substance Abuse Treatment (RSAT)

• Long Distance Dads (LDD) Program

• Educational/Vocational Programs

• Community Orientation Reintegration (COR)

• SCI Chester*

• Young Adult Offender Program (YAO, Pine Grove)*

• Community Corrections System

• Quehanna Boot Camp*

• Violence Prevention Program (SCIs CAM & FRA)*

• “Back on Track” (Kintock, SCI GRA, QUE)*

How Has Research Been Used In Our Agency? (continued)

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

What Has Research Told Us? Examples of Major Findings…

AOD Treatment/TC Study (Temple University/NIJ & PCCD)

11 percentage point reduction in reincarceration rates for TC participants

post-release employment improved outcomes

Long Distance Dads (Penn State/PCCD)

limited evidence program improved fathering knowledge, skills, attitude, behavior

finding 2

Education (Smith/Dept Educ)

6 percentage point reduction in rearrest rates as control group (random assign)

finding 2

Community Corrections (UC/PCCD)

finding 1

finding 2

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

How Have These Research Findings Enhanced Practice?

AOD Treatment/TC Study (Temple University/NIJ & PCCD)

expanded TC programming from 10 to 39

etc

Long Distance Dads (Penn State)

phased out program found to have no effect on success upon release

replaced program with parenting curriculum based on CBT model (pilot)

Education (smith/dept educ)

etc

etc

Community Corrections (UC/PCCD)

etc

etc

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

1. Keep it Simple

Select basic instrument short, easy to use, automate use, resources (training), method

Experience:

LSI-R

Centralize functions easier to train, modify, monitor QA, maintain consistency, & manage resources

Experience:

Initial plan development at 27 SCI’s (variation)

Offer fewer programs of better quality focus on “recidivism-reduction” programs (Principles) not other activities (prevent child abuse, improve health, better physical condition, etc.)

Experience:

What Works Project

(gut, feel good, popular)

Method: didactic or eclectic mix

What Are the Overall “Lessons Learned” From Implementing Research Into Practice?

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

2. Use Comprehensive Battery – select set of tools to identify:

Risk Level Experience:

RST

Crime-Producing Needs Experience:

Coping skills - PV Study

Responsivity Factors

(e.g., mental health/co-occurring)

Experience:

Burns/Roe (literacy), PAI (personality), MH Questionnaire

Overall Lessons Learned, continued…

3. Make it Clear & Specific – standardize to promote uniformity & accuracy:

Assessment Procedures/Protocol Experience:

Full battery for med & high risk only

Guidelines for Treatment Plan Development Experience:

27 SCI’s – gut, CYA, “may” prescribe

Core Menu of Program Offerings Experience:

Central approval for new programs

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

4. View Delivery as a Process

Dosage – deliver sufficient dosage to effect lasting change (not too brief)

Experience:

TC - 3,4,6,9 months & OP - intensive or standard

Re-assess – post-test to measure progress & identify unmet needs

Experience:

Re-administration of SAIT battery

Seamless – boosters, continuity of care planning & treatment follow-up

Experience:

COR, CCC services5. Develop & Support Infrastructure

Staffing resources, qualifications, supervision

Experience:

Separate counselor functions - less to train & re-train, better selection, buy-in

Advanced clinical training (skill development)

Support by leadership & community stakeholders

Experience:

Positions/Org Structure, Communicate Vision

Culture supports rehabilitative ideal Experience:

Reinforcing Positive Behavior (all staff)

Overall Lessons Learned, continued…

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

6. Research, Monitor, & Stay Open to Change

Continue to research effective change strategies

Experience:

DOC Collaborative Research Model (More than 20 outcome & 12 process evaluations)

Develop quality assurance protocols for regular monitoring

Experience:

Quality Improvement Division in PRSG

Program Evaluation Tool

Remain open to critique & prepared to modify as knowledge base increases

Experience:

What Works – eliminated programs

COR results – informed decision-making

7. Maintain Integrity – remain faithful to model & ensure adequate resources by:

Educate stakeholders relative to EBP to promote buy-in

Experience:

Communication - PBPP, Leg, Public, PPS, DA, Judges

Base policy decisions on clinically-relevant factors/EBP

Experience:

Need for RST overrides (public fear vs. evidence)

Overall Lessons Learned, continued…

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

Concluding Thoughts…

Although quality research is critical to achieving our intended outcomes throughout the CJS, many agencies and programs remain understudied

Suggestions for bridging gap between research & practice:

Practitioners – clearly identify research needs, adopt PERS model, etc…..

Academics – remain cognizant of practical challenges facing practitioners, etc……

Outstanding areas…What Are Our Research Needs In the Near Future?

research topic

research topic

research topic

Introduction

Research

Major Evaluation Findings

Enhanced Practices

Overall Lessons

Conclusion

Questions regarding this presentation may be addressed to:

Jeffrey A. Beard, Ph.D.Secretary of Corrections

Pennsylvania Department of CorrectionsP.O. Box 598

2520 Lisburn RoadCamp Hill, Pennsylvania 17001-0598

Phone: (717) 975-4918Fax: (717) 703-3621