predicting early college success using indiana state data...

13
Predicting Early College Success Using Indiana State Data: Lessons Learned Elisabeth Davis, Ph.D. Matthew Soldner, Ph.D. July 2014 REL Midwest

Upload: others

Post on 24-Sep-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

Predicting Early College Success Using Indiana State Data:

Lessons Learned

Elisabeth Davis, Ph.D. Matthew Soldner, Ph.D.

July 2014

REL Midwest

Page 2: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

2

Why This Study?

Postsecondary degree: higher income, lower unemployment rate

0

2

4

6

8

10

12

0

200

400

600

800

1,000

1,200

1,400

1,600

1,800

Less than ahigh school

diploma

High Schooldiploma

Somecollege, no

degree

Associate'sdegree

Bachelor'sdegree

Master'sdegree

Professionaldegree

Doctoraldegree

ALLWORKERS

Perc

en

t U

nem

plo

yed

Do

lla

rs

Note: Data are for persons age 25 and older. Earnings for full-time wage and salary workers. Source: Current Population Survey, U.S. Bureau of Labor Statistics, U.S. Department of Labor.

Median weekly earnings ($)

Unemployment Rate (%)

http://edlabs.ed.gov/RELmidwest/

Page 3: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

3

Why This Study?

Workforce increasingly requires postsecondary

education.

32

10 11 10

40

34 30 28

12

19 17

17

8 10 12

9

19 21 23

7 10 11 10

0%

20%

40%

60%

80%

100%

1973 1992 2007 2018

Pe

rce

nt

of

Wo

rkfo

rce

Master's degree or better

Bachelor's degree

Associate's degree

Some college, no degree

High School diploma

Less than a high schooldiploma

Source: Carnevale, A. P., Smith, N., & Strohl, J. (2010). Help wanted: Projections of jobs and education requirements through 2018. Washington, DC: Georgetown University Center on Education and the Workforce.

http://edlabs.ed.gov/RELmidwest/

Page 4: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

4

Why This Study?

Postsecondary education is necessary for economic growth and upward mobility.

Gap between postsecondary plans and attainment

• Especially for those requiring remedial education

http://edlabs.ed.gov/RELmidwest/

Page 5: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

5

Why This Study?

College and career readiness is a major goal of education reform.

Indiana continues its efforts to improve readiness.

Indiana Commission for Higher Education (ICHE) seeks to better identify which students are likely to be successful in college.

http://edlabs.ed.gov/RELmidwest/

Page 6: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

6

Research Questions

1. What percentage of enrollees arrived at college ready to succeed?

2. Do the percentages vary by student, high school, or college characteristics?

3. Do the percentages vary by indicator of success?

http://edlabs.ed.gov/RELmidwest/

Page 7: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

7

Indicators of Early College Success

Student early college success is defined by:

• Taking only nonremedial classes

• Completing all attempted credits

• Persisting to a second year

• Success by all three indicators

http://edlabs.ed.gov/RELmidwest/

Page 8: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

8

Available Predictors

Student-level characteristics

• Academic

• Demographic

• Behavioral

High-school-level characteristics

• Locale

• Percentage eligible for free or reduced-price lunch

• Student achievement

College selectivity

http://edlabs.ed.gov/RELmidwest/

Page 9: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

9

Design Alternatives

Research Focus

Describe early college success of high school completers

Describe college and career readiness and success of high school completers

Describe ninth graders’ pathways through high school and to college and/or the workforce

Design

Longitudinal study of cohort of entering college students, focused on college outcomes

Longitudinal study of cohort of high school completers, focused on college and/or work outcomes

Longitudinal study of cohort of high school entrants, focused on high school, college, and/or work outcomes

http://edlabs.ed.gov/RELmidwest/

Page 10: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

10

Findings

A bit more suspense …

To be alerted when the report is released, sign up for IES Newsflash at ies.ed.gov

http://edlabs.ed.gov/RELmidwest/

Page 11: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

11

Implications for State Data Systems

Keen reminder that our models are only as strong as our underlying data

Here, high accuracy but constrained information

Might also have liked data representing:

• Noncognitive characteristics

• Accuplacer or Compass scores

• More complete GPA and ACT/SAT data

• Anything else?

http://edlabs.ed.gov/RELmidwest/

Page 12: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

12

Possible Actions by States

Inform usefulness of predictors collected by state data systems

Inform selection of measures for early warning systems

Inform future projects such as calculating readiness benchmarks

Investigate additional measures that states should consider collecting

http://edlabs.ed.gov/RELmidwest/

Page 13: Predicting Early College Success Using Indiana State Data ...nces.ed.gov/forum/pdf/S2014Soldner.pdf1973 1992 2007 2018 Percent of Workforce . Master's degree or better Bachelor's degree

13

Elisabeth Davis, Ph.D.

P: 312-288-7640 E-mail: [email protected]

Matthew Soldner, Ph.D.

P: 202-403-5404 E-mail: [email protected]

REL Midwest 1120 East Diehl Road, Suite 200 Naperville, IL 60563-1486 General Information: 866-730-6735

http://edlabs.ed.gov/RELmidwest/