CREATING, MAGNIFYING, AND MEASURING YOUTH SUCCESS; QUALITATIVE STUDY OF ADVERSE CHILDHOOD EXPERIENCES Aaron Landrum Leonard Davis Institute of Health Economics SUMR Scholars June-August 2013

ROAD MAP Big Picture

Project Mission, Objectives, and Significance Methods

Youth Surveys Case Studies

Interviews

Findings Discovering “The Secret Sauce”

Conclusion Lessons Learned

BIG PICTURE Project Mission

Designed to improve and better understand the strategies of 5 Strength Based Youth Organizations’ (SBYOs) in Philadelphia and their ability to transform the lives of youth, particularly those dealing with adverse situations.

PROJECT MISSION

3 Funders 5 Organizations

1 Evaluation Team

SBYO: Learning Network

PROJECT OBJECTIVES Objective 1:

Describe the common attributes of these SBYOs

Objective 2: Develop a data collection system to evaluate SBYOs

outcomes

Objective 3: Evaluate the effects of financial investments in SBYOs

Objective 4:

Develop learning networks to help SBYOs disseminate best practices

BIG PICTURE Significance

A number of youth in the city go through difficult and adverse circumstances.

Need to provide ways for them to develop positive and empowering coping mechanisms to transverse these experiences and have a positive future.

“The program development was supported by the notion that kids can be experts in their own mind and only need support and help in getting that voice out.” - Quote from Funder

SBYO PROJECT MILESTONES

•Interview SBYO project donor team •Interview SBYO leadership, staff, youth & SBYO •Review SBYO available written material

May 2013 – July 2013: Objective 1 – Discovering

the Secret Sauce

•Create first version of survey •Revise survey and develop survey methodology •Pilot & adapt data collection system

May 2013 – August 2013: Objective 2 – Developing

the Data Collection System

•Complete program evaluation •Produce case study report & case

analysis/program evaluation report

Sept. 2013 – October 2014:

Objective 3 – Evaluating the Donor Investments

•Brief SBYOs on learning networks concept •Test feasibility of learning network concept •Conduct inaugural meeting of learning network

June 2014 – October 2014: Objective 4 –

Piloting the Learning Networks

METHODS Youth Surveys Case Studies

Interviews Donors Program Leaders Program Staff Youth Participants

SBYO DATA COLLECTION SYSTEM

•Create outcome measures

1st Survey

•Revise survey •Develop survey

methodology •Create logic model for

each SBYO

2nd Survey •Pilot test and adapt measurement system

•Evaluate the effects of financial investments of SBYO

DCS

METHODS: SBYO CASE STUDY REPORT

•Youth •Program

leaders & staff

• Donors • Trainer

•Mission, history, organizational structure

•Financials •Media Releases •Organization

reports/proposals

•Lerner •Communities

that Care •Search

Institute Literature

review of SBYO

Agency document

review

SBYO agency

interviews

Donor & trainer team interviews

SBYO PROJECT INTERVIEWS

Total Interviews = 48

SBYO program donors (3)

Funder 1 & Funder 2 Funder 3

SBYO leadership (20)

Executive Directors (5)

Program Staff (15)

SBYO program participants

(25)

Current participants Alumni

“SECRET SAUCE" OR THEORY OF CHANGE

Flourishing Y +P T

Productivity

Health

Lifelong Flourishing

Meaningful Relationships

YOUTH HOMELESS SHELTER Description: This Pennsylvania homeless shelter provides

assistance to homeless, runaway, and trafficked youth between the ages 18-21. The shelter helps youth secure stable housing, a solid educational foundation, medical services, and sustained employment.

Tag Line: “Opening Doors for Homeless Youth” Transformation/Theory of Change:

Provide for immediate needs and create a safe & stable environment

Build trusting relationships and exemplify loving and caring relationships Restoration

Allow youth to make personal choices in a constructive space Provide Encouragement, Empowerment Allow them to handle challenging task on there own with support from

the organization.

YOUTH HOMELESS SHELTER

Flourishing Y +P T

Independence/Agency

Vision/Goal Setting Confidence

Social Awareness

CONVERSATION FACILITATOR Description: This organization brings youth, educators and

parents/guardians together to promote a safe, non-threatening environment for individuals to share candidly about relevant issues.

Tag Line: “Providing a foundation for a lifetime of positive communication”

Transformation/Theory of Change: Creating a safe/non-threatening environment to dialogue openly. Teach participants to have respect for others and be aware of the

humanity and greatness in each of us. Core Values

3 R’s: Respect for Self…Respect for others…and Responsibility for Actions

LEARN: Listen…with Love Explore… with Love Acknowledge…with our Minds Respond…with Respect NOW

CONVERSATION FACILITATOR

Flourishing Y +P T

Building Relationships

Dialogue Skills

Awareness

Openness

ALTERNATIVE HIGH SCHOOL Description: This is an alternative high school

serving 200 over aged and under-credited youth who are looking for a new and different high school experience.

Tag Line: “Creating Opportunities Through Real-World Education”

Transformation/Theory of Change: Providing individualized learning experiences that

are supported by both real world training and application as well as a structured support team consisting of family and a mentor.

ALTERNATIVE HIGH SCHOOL

Flourishing Y +P T

Reasoning Skills

Dialogue Skills

Personal Awareness

Respect for Self & Others

RUNNING MENTORSHIP PROGRAM FOR YOUTH Description: This organization offers marathon

training to at risk-youth between the ages of 12-18 primarily in the Northern and Western Philadelphia area. By connecting students with passionate, running leaders who guide and mentor them throughout the training. The organization attempts to combat health related issues and violence while enabling students to develop self esteem, goal setting skills and discipline.

Tag Line: “Running to Promote Healthy Futures” Transformation/Theory of Change:

Frequency of contact with mentors Multi-Faceted Long-Term Goal

RUNNING MENTORSHIP PROGRAM FOR YOUTH

Flourishing Y +P T

Self-Esteem

Goal Setting

Discipline/Effort

Health Status

CHARTER HIGH SCHOOL Description: This organization helps young people between the ages of 18-20 years

rebuild their lives by providing the broadest range of tools, supports, & opportunities to become self-sufficient, responsible, contributing members and leaders in their communities.

Tag Line: “Caring about Students Being Successful” Transformation/Theory of Change:

Innovative Academic Curriculum With on job training Intense support based in love and care Empowerment – Support students accomplishing their dreams

Healthy Environment to Thrive Case Managers

Responsible for the whole student Acknowledge students’ strengths

Treat each youth as an individual and focus on supporting the whole student Demonstrate commitment to students

Help students set goals Provide them with opportunities to reach goals Service learning Collaboration Engagement

CHARTER HIGH SCHOOL

Flourishing Y +P T

Life Long Self- Sufficiency

Responsibility

Leaders in Community

Contributing Members of Community

CONCLUSIONS AND MOVING FORWARD Completion of the Case Studies Roll out of the Data Collection System Development of the Learning Network

LESSONS LEARNED Importance of developing quality measurements

for Strength Based Approaches The role of persistence and patience in research Value of collaboration between funders,

researchers, and practitioners

ACKNOWLEDGEMENTS

Roy Wade, MD, Ph.D, MPH

Christopher Forrest, MD, Ph.D

Katherine Bevans, Ph.D Jeanhee Moon, Ph.D Lucia Pattullo Ramya Pratiwadi Nkosi Jones

Joanne H. Levy, MBA, MCP

Shanae Johnson, MBA Safa Browne Lissy Madden Hoag Levins Megan Pellegrino Renee Zawacki 2013 SUMR Cohort The Leonard Davis

Institute

SBYO SUMR

QUESTIONS