Offender Reentry in Indian Country&

Native Communities Webinar Series

1

Principles of Evidence Based Practices &

Building an Evaluable ProgramTuesday, June 28, 20113:00 – 4:00 p.m. EDT

Now Recording…

We will be recording this training today so that others can access it in the future.

Please continue to watch the Bureau of Justice Assistance website for an announcement of the recorded web trainings.

2

Presenters• Tim Purdon, U.S. Attorney, District of North Dakota, U.S.

Department of Justice

• Phelan Wyrick, Ph.D., Office of the Assistant Attorney General, Office of Justice Programs, U.S. Department of Justice

• Mary Metcalf, A Women’s Reentry

• Christine Duclos, Ph.D., MPH, JSI Research

• Ada Melton, President, American Indian Development Associates (facilitator)

3

Guidelines For Today

Open your mind to learning something new.

Don’t be afraid to ask questions!

Participate! Interaction is key to good webinars.

4

Questions? We’ve Got Answers!

Locate the Chat Box!

Use the chat box to send a message to the chairperson about technical concerns or questions you would like to have the speaker address after the training.

Type here!5

Questions submitted through chat will be answered a the end of the web training

and sent to all participants.

To Mute, Or Not to Mute?

If you do not have computer speakers or experience issues with receiving the audio from your computer, you may use your telephone. You line is automatically muted for the entirety of the presentation.

Today’s presentation will use broadcast audio over your computer speakers. Please be sure your speakers are turned on and the volume is at an appropriate level. Feel free to use headphones, if you have them. Now, it is much easier for you to participate!

If you have questions, you may use the Chat with Presenters option in the lower left of your screen.

6

Office of Justice Programs

Phelan Wyrick Ph.D., Senior Policy Advisor,Office of the Assistant Attorney General, Office of Justice Programs, U.S. Department of Justice

phelan.wyrick@usdoj.gov

7

Evidence Integration Initiative (E2I)

• Improve the quantity and quality of evidence that OJP generates.

• Improve the integration of evidence to inform program and policy decisions within OJP and in the field.

•Improve the translation of evidence into practice.

8

Evidence Defined

Evidence Information about a question that is generated through systematic data collection, research, or program evaluation using accepted scientific methods that are documented and replicable.

www.CrimeSolutions.govE2I Goal: Translating evidence into practice

• A single, credible, online resource to inform practitioners and policymakers about what works in criminal justice, juvenile justice and crime victim services

• Launch announced June 22, 201110

What will CrimeSolutions.gov Users Find?

• Research on program effectiveness reviewed and rated by expert reviewers

• Easily understandable ratings based on the evidence that indicates whether a program achieves its goals • Effective • Promising • No Effects

• Key program information and research findings

11

Evidence RatingsEffective One study

More than one study

Programs have strong evidence indicating they achieve their intended outcomes when implemented with fidelity.

Promising One study More than one study

Programs have some evidence indicating they achieve their intended outcomes. Additional research is recommended.

No Effects

One study More than one study

Programs have strong evidence indicating that they did not achieve their intended outcomes when implemented with fidelity.

• A single study icon is used to identify programs that have been evaluated with only one study.

• A multiple studies icon is used to identify programs that have been evaluated with more than one study (confidence in evidence of effectiveness increases).

What can CrimeSolutions.gov Users Do?

• Find an effective or promising program to replicate (search by keyword, advanced search, or topic)

• Find a program to adapt (based on a community’s unique needs, population, etc.)

• Inform funding priorities and decisions

• Identify areas in need of further research

13

What will be the impacton the field?

• Increase the use of evidence-based programs in criminal justice, juvenile justice and victim services settings

• Inform practitioners and policy makers about what works using the best available evidence

• At a time of budget cutbacks and fiscal shortfalls, help state and local jurisdictions address crime effectively and efficiently

14

Justice-Related Programs Topics: • Corrections & Reentry• Courts• Crime & Crime Prevention• Drugs & Substance Abuse• Forensics & Technology• Juvenile Justice• Law Enforcement • Victims & Victimization

15

Over 145 Program RecordsUsers can “drill down” from brief summary

info to:

• Program description• Outcomes• Study methodology• Cost• Implementation information• Evidence reviewed • Additional references

16

American Indian / Alaska Native Programs

As of June 27, 2011 CrimeSolutions.gov includes 24 programs that serve American Indian/Alaska Native populations

• 14 programs are rated as Effective

• 9 programs are rated as Promising

• 1 program is rated as No Effects

17

CrimeSolutions.gov Future Plans

• Increase library of programs

• Expand to areas of practice (e.g., mentoring, drug courts, etc.)

• Accept program nominations from the public

• Disseminate information to the field about CrimeSolutions.gov, OJP research activities, and evidence-based programs and practices

18

Volunteers of America, DakotasSioux Falls, South Dakota

“A Mother’s Reentry”A Second Chance Mentor Program

Mary Metcalf, Directorm.metcalf@voa-dakotas.org

19

Program Mission & GoalsProgram Mission -To provide mentor services to mothers transitioning from prison or county jail back into our community.

Program Goals -  • Strengthening families• Increase successful reentry outcomes, and• Decrease recidivism.

20

Demographics & Statistics→ Sioux Falls is a city of over 154,000 residents

located in Minnehaha County. → Sioux Falls is the largest city is South Dakota,

representing nearly 20% of the state population.→ In one year South Dakota corrections released

425 women prisoners with an estimated 24% (102) returning to Minnehaha County.

→ During the first year of their release, 29.9% returned to prison.

→ By year three, this figure rose to 44%→ Native Americans experienced the highest

recidivism rate at 42.4%21

Target Population Incarcerated women in the state prison or county jail that:

• Will be returning or relocating to the Sioux Falls community

• Have at least one child under the age of 18 • Have a release date within 8-12 months• Express an interest in being mentored• Commit to the 12 month mentor program• Are willing to participate in both pre and post release

activities

Participants are recruited through flyers posted in the prison. An application sent to our program via prison case manager. Follow-up is a phone interview by staff, and an in-person interview is conducted during monthly program staff prison visits.

22

Native American Cultural Component

↓ In 2009, Native American women were over-represented in South Dakota’s women’s prison population totaling 28.6%, but only 9% of the state’s total population.

 ↓ Additional statistics from South Dakota corrections show Native

American women with an average education grade level of 10.2 while white inmates average 11.5

Since Native American women represent nearly 30% of the releases, a Native American cultural component has been implemented into the program.

 ↘ Native spirituality ceremonies are available to women who request those

services. Other events planned are honoring ceremonies for special achievements, talking circles, and Lakota/Dakota values teachings. Other cultural activities will be planned as identified by the Mentors and Participants.

23

Mentor Recruitment and Training

Staff recruits mentors through:

 ✶Presentations to organizations, churches and businesses

✶Phone calls, mailings, local media outlets, magazines, flyers and bulletin boards

✶Collaboration with other entities and interagency groups

✶Internet websites that post our program information

✶Interagency newsletters and emails 

Mentor Eligibility:✶18 years of age or older✶Able to drive or access public

transportation✶Undergo a criminal background

check✶If an ex offender, must be off

parole/supervised release for two years

✶Complete the application process✶Complete orientation and training ✶Have excellent listening and

communication skills✶Strong established community ties✶Solid professional networks – a

plus!✶Commit to the 12- month

mentoring program24

Training ►Training and presentations on mentoring and cultural

sharing will be available ongoing as a result of Mentor and Participant input and topics identified by staff.  

►The mentor training manual was developed through research, utilizing Public/Private Ventures – Mentoring Former Prisoners: A Guide for Prisoner Reentry Programs

 ►We also incorporated gender-responsive training materials from various programs researched nationwide including Volunteers of America Second Chance Mentoring Program in Texas.

25

Training TopicsTopics♦ The Impact of Mentoring

♦ Parole Questions

♦ What is Mentoring?♦ The Role of the Mentor♦ Developing the Relationship♦ Do’s and Don’ts for Successful

Mentoring♦ Realistic/Unrealistic Expectations

♦ Setting Boundaries♦ Prohibited Activities♦ Personal Information Sharing♦ Program Rules/Regulations

♦ Substance Abuse, Addiction, Recovery

♦ Working with Mental Health Diagnoses

Topics♦ Unique Challenges of Female Ex Offenders

♦ Reentry Issues and Obstacles♦ Mentor/Participant Eligibility Criteria

♦ Goals of the Mentor Relationship♦ Mentor Skills and Practices♦ How to Kill A Conversation ♦ Case Scenarios Mentors May Encounter

♦ Transportation/Travel Policies♦ Children, Families, Professionals♦ Personal Agendas♦ Emergencies♦ Strategies for Working w/People in Recovery

♦ Activities for Mentors and Participants

26

Other Planned Topics↘ Native American cultural competency↘ Native parenting, values and other related teachings↘ Suggestions for working with families and caregivers↘ Drug and alcohol issues↘ Other topics as identified by Mentors and Participants Once Mentors and Participants have completed their required orientation and introductory trainings, they will be asked to sign an agreement committing them to complying with the program’s rules and regulations and to spending at least eight hours per month with their assigned match partner for a period up to one year (six months pre-release and six months post release).

27

Interim Staff Mentoring Component

Interim staff mentoring is our innovative approach to filling an identified “gap” in services.

Who: Incarcerated women who have enrolled in Second Chance Mentor (SCM) program and are waiting to be matched with a mentor.

 Purpose: To provide support and educational information during the interim

when participants are waiting to be matched with a mentor, to prepare the participant for the mentoring relationship and to build a relationship with SCM staff.

 Mentoring: Interim staff mentoring will be in the form of letter writing, information distribution, phone calls and tele-conferencing (when available). Visits may be an option depending on program access to the prison.

 Information: Topics identified thus far: Mentor preparation, healthy relationships,

realistic transitioning expectations, preventive information on drugs, alcohol and relapse, employability, health care, domestic violence, sexual assault, Native American culture, housing, parenting, and budgeting. 28

Challenges• Mentor recruitment- As we reach out to the community

for mentors we are often faced with the stigma attached to ex offenders.

• The 12 month commitment- we have found that during presentations we need to explain in detail that the relationship building involves 6 months pre release and post release. This appears to alleviate initial concerns about meeting a stranger then building the relationship.

• Building a relationship with the prison in regards to program partnering for recruiting participants.

29

Successes• The components of the reentry team available to participants,

which includes:

– Look Up and Hope – a new, innovative, and family-focused prisoner reentry initiative.

– Breaking Free – offers support to “at risk” women by identifying resources for food, housing, personal care items, employment, education, child care, and health care.

• The cultural component and resources available in the area.

• Cultural competency of staff members through training and consultant services as needed to address the Native participant population.

• The Interim Staff Mentor component that addresses a critical gap in services and promotes building a program relationship with a participant while waiting to be matched with a Mentor. 30

Evaluation

Evaluation Possibilities For

“A Mother’s Reentry’’ Program

JSI Research & Training Institute, Inc.

Christine Duclos, PhD, MPHJSI Research & Training Institute

cduclos@jsi.com

31

First: Evaluability Assessment• Program goals/objectives & priority

information needs are well defined

• Program goals/objectives are plausible

• Relevant performance data can be obtained at reasonable cost

• Intended users of the evaluation results agreed on how they will use the information

32

Practical Methods for Evaluating Program Implementation

Descriptive – What is the program?

Formative – How do we make the program better?

Process – How was the program implemented?

Outcome/Impact – Did the program meet its objectives?

Performance Monitoring – ongoing system of Measurement & feedback of program operations & results

33

Go Back To Mission/Goals/Objectives

Program Mission: To provide mentor services to transitioning mothers

Goals:

• Strengthen families• Increase successful reentry

outcomes• Decrease recidivism

34

Basic Evaluation Logic Model

Resources

Funding

Mentor Match Specialist

Activities/Outputs

Mentor Recruitment

Mentor Training

Mentor Match

Mentoring

Cultural Activities

Expected Outcomes

Strengthened Families

Increased Successful Reentry Outcomes

Decreased Recidivism

Program DeliveredPROCESS EVALUATION

Results from ProgramOUTCOME EVALUATON

Process Evaluation

36

• Most effective when accounting for the needs, wants, & concerns of the users

• Create a prioritized inventory of process questions & objectives

• Identify indicators• Identify or create measurement tools• Assign person responsible for data collection• Collect, manage, clean, & analyze data• Create useful reports on process objectives• Feedback results to program staff for

refinement of intervention

Possible Process Evaluation Components

JSI Research & Training Institute, Inc.

Minimal Components ExplanationContext Reentry issues

Women’s livesProgram environment

Recruitment Description of proceduresDescription of resources usedReasons for nonparticipation

Reach Number of women recruited Number of women who participatedDescription of these women & children

Dose Delivered Number of mentoring activitiesDose Received Extent of women’s engagementFidelity Extent activities were delivered as

planned

Possible Process Assessment

38

Question: What was the level of mentor involvement?

Sample Objective: By June 30, 2011, the program will have recruited and trained 15 mentors.

Indicators: Number of recruited mentors Number of trained mentorsMeasurement Tools: Contact log

Recruited mentor roster Trained mentor roster

Question: What were the barriers & facilitators to mentor recruitment?

Indicators: Mentors perceptions of barriers & facilitators

Measurement Tool: Survey or interview questions of barriers and facilitators?

Critical: provide the best possible information under the

circumstance

Best evaluation: a comparison between what happens

after intervention & what happens or would happen after

no intervention or an alternative intervention

Two types of designs:

randomized experiments or quasi-experiments

Possible Outcome EvaluationsEstimating the Effect

39

Before-After Comparisons - Pre/Post Testing

Interrupted Time-Series - Extends Before/After

Nonequivalent Group Designs – Comparison of participants who receive different treatments including no treatment & were not randomized to groups

Regression-Discontinuity Design – Comparison of participants who are given type of intervention based on a cutoff score on an assignment variable

Typical Quasi-Experimental Designs

40

Expected Outcome: Increased successful reentry outcomes

Indicator: Self-esteem Measurement: Pre/Post 10 Item Self-Report Groups: Women in “A Mother’s Reentry Second Chance Mentor Program” & comparison group who do not participate

Expected Outcome: Decreased recidivism

Indicator: Number of arrests within a certain time periodMeasurement: Arrest report of that time periodGroups: Women in “A Mother’s Reentry Second Chance Mentor Program” & comparison group who do not participate

Before / After Comparisons

41

If the main goal of the program/treatment is helping womenbecome better mothers, you can use this design to assign to

groups:

Theory: Better mothers shows family strength and will motivate women to

stay out of trouble

Expected Outcomes: Increased family strength, successful reentry outcomes &

recidivism

Pre Assignment Indicator: Parenting capacity (indicator of need) Measurement: Standardized parenting capacity tool

Groups: Low score on a pretest recruited; high scorers not or later

Regression-Discontinuity Assignment

42

• Use agency records to the extent possible• Use focus groups to identify evaluation criteria, collect

evaluation data, & help interpret evaluation data• Use less powerful evaluation designs• Use smaller sample sizes• Resist collecting unnecessarily large amounts of data • Use mail or telephone surveys rather than in-person

interviews• Avoid excessive precision in sampling/statistical analysis

(95% confidence levels) may be too costly and not necessary

• Use technology where appropriate to save time & money in data collection entry, processing, and analysis

Compromises mean less certain validity of findings, however, it is better to be roughly right than to remain totally ignorant of program results.

Low Cost Evaluation Approaches

43

Questions?

Question & Answer Session

44

Give Us Your Feedback

At the conclusion of this web training, an evaluation will pop up in your Ready Talk window. Please take a moment to answer this short list of questions.

Please Don’t Go Just Yet!

45

Funding Resources

Available Applications:

• The Honest Opportunity Probation with Enforcement (HOPE) Demonstration Field Experiment (Closes June 28)

• Second Chance Act Adult Offender Reentry Program for Planning and Demonstration Projects (Closes June 30)

• Second Chance Act State, Local, and Tribal Reentry Courts (Closes June 30)

• Prison Rape Elimination Act: Demonstration Projects to Establish “Zero Tolerance” Cultures for Sexual Assault Program (Closes July 7)

• Second Chance Act Demonstration Field Experiment: Fostering Desistance through Effective Supervision (Closes July 11)

46

Other Resources

• Offender Reentry in Indian Country & Native Communities Webinar Series Sponsored by the U.S. Department of Justice, U.S. Department of Health & Human Services; Indian Country Steering Committee of the U.S. Probation and Pretrial Services.

• Tribal Probation: An Overview for Tribal Court Judges, American Probation and Parole Association

• Strategies for Creating Offender Reentry Programs in Indian Country, American Indian Development Associates

• Journal of Court Innovation, Special Issue on Tribal Justice, Center for Court Innovation

• National Reentry Resource Center – Council of State Governments Justice Center

• Justice Reinvestment Initiative• Resource Center for the Elimination of Prison

Rape (PREA Resource Center)47

InvitationOffender Reentry in Indian Country & Native Communities

Webinar Series3:00 p.m. – 4:00 p.m. EDT

• July 19: Information Sharing & Reentry• Aug 23: Jail Reentry• Sept 20: Sex Offender Management: Registration and

Community Notification• Oct 25: Health & Social Services Role in a

Multidisciplinary Approach To Reentry • Nov 15: The Role of Law Enforcement in Reentry

Topics and dates subject to change.

48

Sponsors of the Webinar Series• U.S. Department of Justice

Bureau of Justice Assistance, Community Capacity Development Office, Office on Sex Offender Sentencing, Monitoring, Apprehending, Registering, and Tracking, National Institute of Corrections, U.S. Attorney’s Office – District of Hawaii, and Office of Juvenile Justice and Delinquency Prevention

• Indian Health Services, U.S. Department of Health and Human Service

• Office of Native Hawaiian Affairs, U.S. Department of Interior• Indian Country Steering Committee, U.S. Probation and Pretrial

Services• Partners - American Indian Development Associates ,The National

Reentry Resource Center, The International Association of Chiefs of Police, and the America Probation and Parole Association

49

Last But Not Least…

Thank you for participating in this web training!

50