ph. d. completion and attrition: analysis of baseline data nsf agep evaluation capacity meeting...

47
Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Upload: barbara-bertha-park

Post on 12-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ph. D. Completion and Attrition:

Analysis of Baseline DataNSF AGEP Evaluation Capacity

MeetingSeptember 19, 2008

Robert SowellCouncil of Graduate Schools

Page 2: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ph.D. Completion Project Guiding Principles:

• Students admitted to Ph.D. programs should be given every opportunity to complete their degrees.

• Understanding and improving student degree completion and attrition rates is key to increasing the effectiveness of doctoral programs.

• Graduate deans are in the best position to lead conversations about the best practices that will improve student completion rates.

Page 3: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ph.D. Completion Project Funding provided by Pfizer Inc

and the Ford Foundation• Phase I (2004-2007)• Phase II (2007-2010)

29 Research Partner institutions received grants

Additional (~25) Project Partner institutions are currently participating in various aspects of the project (unfunded)

Page 4: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ph.D. Completion Project

Goal - to improve Ph.D. student completion•Selected set of institutions

Implement new interventions Provide baseline completion and attrition data

Focus - underrepresented minorities and women

Page 5: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Requirements to Participate in the Ph.D. Completion Project

Engage in activities to increase Ph.D. completion in at least eight programs

Provide baseline completion and attrition data for each program for an initial twelve-year period followed by an additional four years

Implement at least six new interventions in an effort to increase completion

Page 6: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Baseline Data Requirements

Aggregate demographic completion data by broad field

Factor assessments for each institution and program

Student Exit Surveys (Completers and Non-Completers)

Completion and attrition data by program

Page 7: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Categories of Potential Interventions

Selection/Matching Mentoring and Advising Financial Support and Structure Program Environments Research Experiences Curricular and Administrative

Processes and Procedures

Page 8: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

CGS Ph.D. Completion ProjectQuantitative Data Submitted by

Institutions12 Years (1992-93 through 2003-04) Program

completion and attrition• 30 Institutions• 5 Broad Fields• 54 Disciplines• 330 Programs• ~49,000 Students

Broad field demographic completion• Gender (G)• Citizenship/Ethnicity

(CE)• 24 Institutions (G)• 23 Institutions (CE)• ~40,000 Students

Page 9: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Analysis:For Students Entering Ph.D.

Programs in1992-93 through 1994-95 (A

Cohorts) From Program Data•Completion: Overall, broad field

and discipline From Demographic Data

•Completion: Overall and broad field Gender Citizenship Ethnicity

Page 10: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Profile of Data (A-Cohorts) for Ten-Year Completion Analysis

Approximate distribution across fieldsProgram Data 12,135

Gender Data 9,683

Citizenship& Ethnicity Data 9,359

Page 11: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Overall Ten-Year Completion Rates

5

11

23

36

46

51 55

570

2040

60C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Source: Council of Graduate SchoolsCompletion and Attrition Program Data

Page 12: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Cumulative Completion Rates by Broad Field

010

2030

4050

6070

Co

mp

leti

on

Ra

te (

%)

3 4 5 6 7 8 9 10Year

Engineering Life Sciences

Mathematics & Physical Sciences Social Sciences

Humanities

57

54

48

41

29

6463

5655

49

Page 13: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates for Selected Disciplines

Engineering (64%) Life Science (63%)

Civil 78% Genetics 69%

Mechanical 66% Micro/Immunology 69%

Chemical 63% Neuroscience 65%

Biomedical 63% Mole/Cell Biology 64%

Electrical 56% Biology 59%

Mathematics and Physical Sciences (55%)

 

   

Chemistry 62%    

Physics 59%    

Mathematics 51%    

Computer Science 41%    

Page 14: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates for Selected Disciplines

Social Science (56%)

Psychology 65%

Economics 52%

Anthropology 46%

Sociology 45%

Political Science 44%

Humanities (49%)

English Language and Literature 52%

Philosophy 49%

Foreign Languages and Literatures 48%

History 47%

Page 15: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates for Students Entering from

1992-93 through 1994-95, by Institution Type and Broad Field

02

04

06

0

02

04

06

0

02

04

06

0

02

04

06

0

020

4060

2 4 6 8 10 2 4 6 8 10 2 4 6 8 10

2 4 6 8 10 2 4 6 8 10

Engineering Life Sciences Math & Physical Sciences

Social Sciences Humanities

Private Public

Cu

mu

lati

ve C

om

ple

tio

n R

ates

Year

Graphs by BFSource: Council of Graduate SchoolsCompletion and Attrition Program Data

Page 16: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Attrition Rates for Students Entering from

1992-93 through 1994-95, by Cohort Sizes and Broad Field

01

02

03

0

01

02

03

0

10

20

30

40

01

02

03

04

0

01

02

03

04

0

0 5 10 0 5 10 0 5 10

0 5 10 0 5 10

Engineering Life Sciences Mathematics & Physical Sciences

Social Sciences Humanities

Small Medium

Large

Cu

mu

lati

ve A

ttri

tio

n R

ate

s

Year

Graphs by BFSource: Council of Graduate SchoolsCompletion and Attrition Program Data

Small: 1-7Medium: 8-14Large: 15+

Page 17: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Gender DataMale Female

Engineering 1,606 277

Life Science 602 489

Math/Phys. Science

2,251 792

Social Science

914 1,101

Humanities 869 782

Total 6,242 3,441

85%

55%74%

15%

45%26%

55% 47%

53%45%

0%

20%

40%

60%

80%

100%

Male Female

Page 18: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates: Broad Field and Gender

56 56

52

57

52

65 64

59

53

47

40

50

60

70

En g in e e r in g Life Sc ie n ce s M ath &Ph ysica l

Sc ie n ce s

So cia lSc ie n ce s

Hu man itie s

Com

plet

ion

Rat

e (%

)

Fem ale Male

Page 19: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Gender in Engineering

010

2030

4050

60

Cu

mu

lati

ve C

om

ple

tio

n R

ate

(%)

3 4 5 6 7 8 9 10Year

Female Male

Page 20: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Annual Ph.D. Completion Rates by Gender in Engineering

04

81

21

62

0A

nn

ual

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 21: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Gender in Life Sciences

01

02

03

04

05

06

0C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 22: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Annual Ph.D. Completion Rates by Gender in Life Sciences

04

81

21

62

0A

nn

ual

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 23: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Gender in Mathematics &

Physical Sciences 0

10

20

30

40

50

60

Cu

mu

lati

ve C

om

ple

tio

n R

ate

(%)

3 4 5 6 7 8 9 10Year

Female Male

Page 24: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Annual Ph.D. Completion Rates by Gender in Mathematics & Physical Sciences

04

81

21

62

0A

nn

ual

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 25: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Gender in Social Sciences

010

2030

4050

60C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 26: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Annual Ph.D. Completion Rates by Gender in Social Sciences

04

81

2A

nn

ual

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female Male

Page 27: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ph.D. Completion Rates by Gender and Institution Type

010

2030

4050

60C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Female in Public Male in PublicFemale in Private Male in Private

Page 28: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Citizenship DataDomestic Intl.

Engineering 970 888

Life Science 811 212

Math/Phys. Science

2,100 941

Social Science

1,655 278

Humanities 1,390 114

Total 6,926 2,433

69%

48%21% 31%

14% 8%

79%

52%

86% 92%

0%

20%

40%

60%

80%

100%

Domestic International

Page 29: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates: Broad Field and Citizenship

59 58

51

56

50

70

6668

63

52

40

45

50

55

60

65

70

75

Engine e ring Life S cie nce s M a th &P hysica lS cie nce s

S ocia lS cie nce s

Hum a nitie s

Co

mp

leti

on

Ra

te (

%)

Do me stic In te rn atio n al

Page 30: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Race/Ethnicity Data

0%

20%

40%

60%

80%

100%

Hispanic American 20 24 38 85 41 208

White 700 671 1,629 1,272 1,156 5,428

Asian American 171 62 207 95 52 587

African American 38 25 85 157 98 403

Engineering Life ScienceMath &

Physical Science

Social Science Humanities Total

Page 31: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates: Broad Field and Ethnicity

47

60

37

47

5253

47

53

4446

55 54 5355

37

61 60

52

57

51

30

35

40

45

50

55

60

65

Engine e ring Life S cie nce s M a th & P hysica lS cie nce s

S ocia l S cie nce s Hum a nitie s

Com

plet

ion

Rat

e (%

)

African Am erican Asian H ispan ic W hite

Page 32: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Race/Ethnicity in Engineering

01

02

03

04

05

06

0C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Asian American White African AmericanHispanic American

Page 33: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Race/Ethnicity in Life Sciences

010

2030

4050

60C

um

ula

tive

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Asian American White African AmericanHispanic American

Page 34: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Race/Ethnicity in Mathematics &

Physical Sciences 0

1020

3040

5060

Cu

mu

lati

ve C

om

ple

tio

n R

ate

(%)

3 4 5 6 7 8 9 10Year

Asian American White African AmericanHispanic American

Page 35: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Race/Ethnicity in Social Sciences

010

2030

4050

60

Cu

mu

lati

ve C

om

ple

tio

n R

ate

(%)

3 4 5 6 7 8 9 10Year

Asian American White African AmericanHispanic American

Page 36: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Ten-Year Completion Rates: Ethnicity + Int’l and

Broad Field

47

5355

6160

47

54

60

37

53 53 52

47

44

5557

52

46

37

51

30

35

40

45

50

55

60

65

Afr ican Ame r ican Asian Hisp an ic W h ite

Co

mp

leti

on

Rat

e (%

)

E ngineering Life S c ienc es M ath & P hys ic al S c ienc es S oc ial S c ienc es Hum anit ies

Page 37: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative 10-Year Ph.D. Completion Rates by Broad Fields for African American

Students0

1020

3040

5060

Co

mp

leti

on

Rat

e (%

)

3 4 5 6 7 8 9 10Year

Engineering Life SciencesMath & Physical Sci Social SciencesHumanities

47

60

37

47

52

Page 38: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ph.D. Completion Rates by Broad Field for Hispanic American Students

010

2030

4050

60

Cu

mu

lati

ve C

om

ple

tio

n R

ate

(%)

3 4 5 6 7 8 9 10Year

Engineering Life SciencesMath & Physical Sci. Social SciencesHumanities

Page 39: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Ten-Year Ph.D. Completion Rates by Race/Ethnicity and Institution

Type

50

61

57 58 58

44

4749

5452

30

35

40

45

50

55

60

65

AfricanAmerican

AsianAmerican

HispanicAmerican

White All Domestic

Co

mp

leti

on

Rate

(%

)

Private Public

Page 40: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Comparison of Seven-Year Completion Rates For Students Entering Ph.D.

Programs in1992-93 through 1994-95 (A-Cohorts)

vs. 1996-97 through 1998-99 (B-Cohorts)

Completion: Overall and Broad Field

Gender Ethnicity

Page 41: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Seven-Year Ph.D. Completion Rates for A- versus B- Cohorts by Gender

49

48

43

41

0 10 20 30 40 50Cumulative Completion Rate (%)

Male

Female

A-Cohorts B-Cohorts

Page 42: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Cumulative Seven-Year Ph.D. Completion Rates for A- versus B- Cohorts by

Race/Ethnicity

34

33

35

34

46

43

40

39

0 10 20 30 40 50Cumulative Completion Rate (%)

Hispanic American

African American

White

Asian American

A-Cohorts B-cohorts

Page 43: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Interventions: Selection and Matching

Pre-admission visits to campus. Adapt best practices in recruiting for different

disciplines and demographics. Increase minority student recruitment activities

during the academic year with the efforts of the new Diversity Coordinator

Incorporate alumni into program recruitment strategies, in particular women and members of underrepresented groups.

Page 44: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Interventions: Mentoring and Advising

Require each first year student to have an advisor or advisory structure.

Monitor the process of advisor/mentor selection, especially for minorities and women.

Participate in peer-to-peer mentoring programs for new students, especially women and underrepresented groups.

Develop a graduate student supervision workshop for new faculty

Page 45: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Interventions: Program Environments

Monthly support group for minority students Initiate a seminar series to address the theme of

inclusion and diversity. Women’s Leadership Society that links prominent

professional and graduate women with current doctoral students.

Develop institution-wide policies on family and medical leave for graduate assistants.

Page 46: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Interventions: Other

Dissertation assistance workshops, “Dissertation Boot Camps.”

Web-based systems for tracking student progress to degree.

Study student data from the past ten years to assess patterns of attrition versus short-term enrollment gaps.

Inclusion of completion rates and time-to-degree in the program review process.

Page 47: Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools

Future Ph.D. Completion Project Activities & Reports

Student exit surveys Document promising interventions,

practices, policies and other activities Collect completion and attrition data

through data through the 2007-08 Final “Best Practices” report at the

conclusion of the project in 2010 documenting impact of new interventions on completion and attrition