1 are there alternative ways for early identification of at-risk freshmen? – transition to college...

48
1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs and Services, One Question at a Time Fall 2004

Upload: lillian-ellis

Post on 12-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

1

Are There Alternative Ways for Early Identification of At-Risk Freshmen? –

Transition to College Inventory

Virginia Assessment Group

Improving Our Programs and Services, One Question at a Time

Fall 2004

Page 2: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

2

Presenters

Worth Pickering

Jim Calliotte

Anthony Macera

Stephen Zerwas

Old Dominion University

Page 3: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

3

Background

• More than 50 % of all freshmen leave without a degree

• Greatest attrition occurs between freshmen and sophomore years

• Most freshmen who leave are in academic difficulty

• The first six weeks are critical to freshmen success

Page 4: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

4

Tinto (1988) Stages of Student Development

Our. . . actions should be concentrated on the very early stages of the students’ college career, rather than on later stages after serious problems have surfaced…

Page 5: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

5

Characteristics of Contemporary College

Students

Page 6: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

6

Newton (2000) described “Millennial

Students” as:

•more likely to be employed part-time

and less committed to school work

•ambitious in their career aspirations,

yet unrealistic about what it takes to

achieve their goals

Page 7: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

7

Raspberry (2004) citing a report by the

Wingspread Group suggested,

“between 40 percent and 60 percent of

all students (public schools) – urban,

suburban and rural – are ‘chronically

disengaged’ from school”

Page 8: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

8

Levine & Cureton (1998) found that many of today’s college students:

Reject the notion of “learning for learning’s sake”

Come to college less well prepared necessitating more remediation

Come to college more psychologically damaged

Page 9: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

9

Millennial students and those

chronically disengaged from learning

present higher education with a variety

of challenges, especially when faced

with the current mandate to improve

retention and graduation rates

Page 10: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

10

The Question for Institutions of Higher Education

How can we identify, as early as possible, which admitted first year students might experience academic difficulty and/or attrition in order to make the most timely intervention?

Page 11: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

11

Alexander AstinChronicle of Higher Education

October 2004

“…most institutions’ degree-completion rates are primarily a reflection of their entering-student characteristics, and…differences among institutions’ completion rates are primarily attributable to those differences… The obvious solution is for colleges to develop the habit of collecting relevant information on their students when they first enroll.”

Page 12: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

12

Cognitive PredictorsCognitive Predictors

•SAT

•High School Grade Point Average

(Traditionally used as admission’s criteria)

Page 13: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

13

Anderson (1999)

Historically, cognitive variables

have only explained approximately

15 to 20% of the variance in

student persistence.

Page 14: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

14

Once students are admitted using

cognitive predictors, we need

additional predictors to assist in

defining which of these students are

more likely to experience academic

difficulty.

Page 15: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

15

• Gender

• Race

• Family Socioeconmic Status

• Residence (on/off-campus)

• Etc.

• Gender

• Race

• Family Socioeconmic Status

• Residence (on/off-campus)

• Etc.

Demographic Predictors

Page 16: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

16

Noncognitive PredictorsNoncognitive Predictors

• Attitudes

• Characteristics

• Opinions

• Behaviors

• Attitudes

• Characteristics

• Opinions

• Behaviors

Page 17: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

17

Cognitive and demographic data are

usually available on the institutional

student data base.

Cognitive and demographic data are

usually available on the institutional

student data base.

Noncognitive data must be collected..…

Page 18: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

18

Transition to College

Inventory

Page 19: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

19

The Transition to College Inventory

(TCI) was developed to measure

noncognitive factors that might

contribute to freshman academic

difficulty and related attrition.

Page 20: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

20

Topic AreasTopic Areas

Reasons for Attending CollegeReasons for Choosing This CollegeExperiences During the Senior Year of High

SchoolSelf Ratings of Abilities and TraitsAttitudes About Being a College StudentPredictions About Academic Success at

CollegePredictions About Involvement in College

Reasons for Attending CollegeReasons for Choosing This CollegeExperiences During the Senior Year of High

SchoolSelf Ratings of Abilities and TraitsAttitudes About Being a College StudentPredictions About Academic Success at

CollegePredictions About Involvement in College

Page 21: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

21

The TCI Index was developed by

identifying those items related to

higher chances of academic difficulty

during the freshman year.

The TCI Index was developed by

identifying those items related to

higher chances of academic difficulty

during the freshman year.

TCI IndexTCI Index

Page 22: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

22

The higher the TCI Index, the greater

the chance for academic difficulty.

The TCI predicts academic difficulty

equal to or better than cognitive

factors.

The higher the TCI Index, the greater

the chance for academic difficulty.

The TCI predicts academic difficulty

equal to or better than cognitive

factors.

TCI IndexTCI Index

Page 23: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

23

Index Risk Categories

• 0-5 Low Risk for Academic Difficulty

and/or Attrition

• 6-8 Above Average Risk – Caution Range

• 9 + High Risk for Academic Difficulty

and/or Attrition. Early Intervention

Strongly Recommended

Page 24: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

24

First Semester Academic Difficulty Rate by TCI Index

Grouped by Risk Categories

42%

33%

18%

0% 10% 20% 30% 40% 50%

LowRisk

AboveAvgRisk

HighRisk

Page 25: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

25

Students with high TCI Indexes

are more than twice as likely as

those with low Indexes to

experience academic difficulty

(GPA < 2.00) and attrition at the

end of their freshman year.

Students with high TCI Indexes

are more than twice as likely as

those with low Indexes to

experience academic difficulty

(GPA < 2.00) and attrition at the

end of their freshman year.

Page 26: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

26

Freshman to Sophomore Attrition by TCI Index

Grouped by Risk Categories

35%

28%

18%

36%

27%

20%

0% 10% 20% 30% 40%

2001

2002

LowRisk

AboveAvgRisk

HighRisk

Page 27: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

27

6-Year Graduation Rates by TCI Index Grouped by Risk Categories

32%

39%

50%

0% 10% 20% 30% 40% 50%

LowRisk

AboveAvgRisk

HighRisk

Page 28: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

28

Based on the TCI Index, advisors can recommend:

• Participation in curricular

interventions such as U101 courses

or Learning Communities.

• Follow-up advising/counseling at the

beginning of the Fall Semester.

Page 29: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

29

Interpreting and Using the Individual

TCI Student Profile

Page 30: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

30

Page 31: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

31

Factor Analysis of the TCI

Page 32: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

32

Factors

• College Involvement

• Influences on College Choice

• Student Role Commitment

• Athletic Orientation• Personal /

Academic Concerns

• Self Confidence• Institutional

Commitment• Socializing

Orientation• Independent Activity

Focus

Page 33: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

33

Results of Logistic Regression Analysis

Predicting Academic Difficulty at the End of the First Semester

Page 34: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

34

Factors Related to Freshmen Academic Difficulty at the End of the First Semester

1. Socializing Orientation (+)

2. Self Confidence (-)

3. Independent Activity Focus (+)

4. Student Role Commitment (-)

5. Athletic Orientation (+)

Page 35: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

35

Results of Logistic Regression Analysis Predicting Academic Difficulty at the End of the First Semester

Factor X2 p

Socializing Orientation

70.41 0.0001

Self Confidence 44.57 0.0001

Independent Activity focus

14.30 0.0002

Student Role Commitment

8.17 0.0043

Athletic Orientation 6.37 0.0116

Page 36: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

36

Sample Items for Each Factor

Significantly Related to

Academic Difficulty

Page 37: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

37

Socializing Orientation

“Partying”

“To participate in college social life”

“Drank alcoholic beverages”

Page 38: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

38

Self Confidence

“General academic ability”

“Drive to achieve”

“Interpersonal communication skills”

“Study skills”

Page 39: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

39

Independent Activity Focus

“Playing computer / video games”

“Watching TV”

“Doing hobbies”

Page 40: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

40

Student Role Commitment

“I expect to work hard at studying in college”

“It is important to me to be a good student”

“I will be proud to do well academically in

college”

Page 41: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

41

Athletic Orientation

“Participate in varsity sports”

“Use campus athletic facilities for individual or

group recreational activities”

“Exercising on my own”

Page 42: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

42

Sample Items for Each Additional

Factor

Page 43: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

43

Personal / Academic Concerns

“Time management skills”

“Failed to complete homework assignments

on time”

“Had difficulty concentrating on assignments”

“Feel overwhelmed occasionally by all I have

to do”

Page 44: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

44

College Involvement

“Participate in campus clubs and organizations”

“Talk with faculty informally outside of class”

“Have serious discussions with students whose

beliefs and opinions are different from yours”

“Participate in cultural events (art, music,

theater) on campus”

Page 45: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

45

“Open House / Visitation Days”

“The college’s good social reputation”

“The college’s good academic reputation”

“This college’s graduates get good jobs”

Influences on College Choice

Page 46: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

46

Institutional Commitment

“Transfer to another college at the end of my freshmen year”

“I was not accepted by my higher choice college(s)”

“Be satisfied with this college”

Page 47: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

47

TCI Freshman Class Profile

In addition to the early identification of potentially at-risk students, the TCI can be used to develop a profile of each year’s incoming freshmen class based on their salient noncognitive characteristics.

Page 48: 1 Are There Alternative Ways for Early Identification of At-Risk Freshmen? – Transition to College Inventory Virginia Assessment Group Improving Our Programs

48

For Further Information on the TCI

Please go to:

http://www.odu.edu/tci