© 2015 jenzabar, inc. increase your prediction accuracy and achieve maximum student success paul...

27
© 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier Burt Rubenstein Jenzabar burt.rubenstein@jenza bar.com

Upload: ophelia-colleen-blair

Post on 13-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Increase Your Prediction Accuracyand Achieve Maximum Student SuccessPaul Gore Xavier [email protected]

Burt [email protected]

Page 2: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Psychologist with background in K-20 student success, vocational psychology and higher education

Faculty for 17 years 3 years as Director of Career Transitions Research Dept. at ACT 7 years as Director of Institutional Research Director of graduate programs FYE Advisory Board, Journal Editor 2013-2014 ACE Leadership Fellow – Montana State University (higher

education financing and student success agenda) Active in secondary and higher education consulting for 14 years in the US

and 9 foreign countries Worked on development and implementation of 3 non-cognitive measures

of student success with dozens of institutions

Overview

Page 3: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Overview

The role of

Non-cognitive Factors 

In Student Success

Evidence of non-cognitives in academic success and retention

Assessment tool and use case models

Page 4: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Fail to Complete High School

Fail to Attend College

Fail to Complete collegeIs this what we want

to call Success?

STUDENT PROGRESSION

Page 5: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

PublicUniversities

PrivateUniversities

80%

70%

2-YearColleges

50%

Retention Rates

Student Progression

First Gen 30%

Page 6: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Risk Prediction and Mitigation

Grades, ACT, SAT, Course Placement Exams

Applicants

RiskMitigation

Page 7: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Risk Prediction and Mitigation

I just don’t know how to study

My friends were allgoing to college so I

went too

College is so much harder than high school – I was too stressed out

I don’t know what happened. I never paid

attention in my high school classes!

I didn’t feel welcomed or

involved on campus

Applicants

Grades, ACT, SAT, Course Placement Exams

Page 8: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Demographics (opportunity structure) Academic ability/aptitude (ACT/SAT/GPA) Finances Motivation Lack of direction Lack of knowledge Life demands Self confidence Campus and academic engagement

Predicting Student Success

Page 9: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc. © 2015 Jenzabar, Inc.

Predicting Student Success

‘In addition to content knowledge and academic skills, students must develop sets of behaviors, skills, attitudes and strategies that are crucial to academic performance in their classes…’

Page 10: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Predicting Student Success

CollegeSuccess

GPA

StandardizedAchievement

Non-cognitive Skills

15 – 20%

5 – 8%

10 – 15%

Leuwerke, Gore, Cole, & Reese, (2011)

Page 11: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Predicting Student SuccessCo

llege

Suc

cess

At risk

Outperforming

Grades, ACT, SAT, Course Placement Exams

Page 12: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Predicting Student SuccessCo

llege

Suc

cess

At risk

Outperforming

Grades, ACT, SAT, Course Placement Exams

High ResiliencyHigh Engagement

Low Educational Commitment

Page 13: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

If non-cognitive factors reliably predict student outcomes (and they do)

And you can reliably measure incoming student non-cognitive strengths and weaknesses (and you can)

And you already have the programs and services that can be mapped to those strengths and weaknesses (and you do)

Why wouldn’t you seek to align non-cognitive assessment and other predictive data with existing programs and services to promote student success?

Predicting Student Success

Page 14: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

College Readiness Inventory (CRI)

49 Items7 Scales

Psychometrically Sound

Predictive validity study

underway

Fall 2015 

• Predictive model enhancement

• FYE topic focus• Student advising

and goal setting• Targeted outreach

and intervention• Risk mitigation

Page 15: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Academic Engagement Academic Self-Efficacy Campus Engagement Educational

Commitment Institutional Valence Life Complexity/Roles Resilience

College Readiness Inventory (CRI)

Page 16: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Use institutional data to allocate resources across programs

Use data to inform classroom level teaching and interventions

Use data to inform cohort level needs

Use data to intervene with students: Make an ACTION PLAN

Non-cognitive Interventions

Page 17: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Private 4 Year Univ

Page 18: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Priv. Rel Afil. 4 Year

Page 19: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Public 2 Year

Page 20: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Priv. Rel Afil. 4 Year

Page 21: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Student Examples

Page 22: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Student Examples

Page 23: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI: Student Examples

Page 24: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Page 25: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Complete predictive modeling analysis

Scale institutional use• Institutional reports• Student level reports• Recommendations• Staff/advisor training

Consult with institutions to develop use-case models that take advantage of existing retention predictors as well as non-cognitive factors

Next Steps

Page 26: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

Thank You

Paul Gore Xavier [email protected]

Burt [email protected]

Page 27: © 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University gorep@xavier.edu Burt Rubenstein

 © 2015 Jenzabar, Inc.

CRI Scales