evaluating college readiness for english language learners ... · evaluating college readiness for...

27
Evaluating College Readiness for English Language Learners and Hispanic and Asian Students ITP Research Series Min Wang Keyu Chen Catherine Welch ITP Research Series 2012.1

Upload: others

Post on 13-Jun-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Evaluating College Readiness for English Language Learners

and Hispanic and Asian Students

ITP Research Series

Min WangKeyu ChenCatherine Welch

ITP Research Series

2012.1

Page 2: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Running head: EVALUATING COLLEGE READINESS      1 

Abstract

Group differences in growth trajectories are of interest when a common growth model

and developmental scale are used for all students. Parallelism of growth trajectories found in this

study provides validity evidence for measuring growth and readiness of not only culturally but

also linguistically diverse groups using the Iowa Assessments.

Page 3: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    2 

Evaluating College Readiness for English Language Learners and Hispanic and Asian Students

Objectives

In a global economy, countries are competing for top talent and resources in order to stay

ahead. For each individual, higher education or professional training is necessary to succeed in

this competitive world. According to a U.S. Bureau of Labor Statistics report, nearly half of all

new jobs through 2018 will require at least some form of postsecondary education or training

(U.S. Bureau of Labor Statistics, 2009). However, scores from 2011 ACT tests indicated that

only about 25% of recent U.S. high school graduates meet College Readiness Benchmarks

(CRBs) (ACT, 2011).

Since the announcement of the Race to the Top program in 2009, college and career

readiness (CCR) has become another measure of quality of K-12 education. Various studies

have been conducted to define, implement and assess it. Among them, some research has

focused on the CCR information of diverse populations (Bustamante, Slate, Edmonson, Combs,

Moore, & Onwuegbuzie, 2010). To better understand the performance and college readiness in

culturally and linguistically diverse groups, long-term analyses are needed to monitor the growth

trends of these students in reaching CCR targets. In order to address this issue, the present study

aims to establish validity evidence in using the developmentally scaled Iowa Assessments for

measuring growth and CCR of English language learners (ELLs), Hispanic, and Asian students.

We propose to:

1. Examine the average performance of groups of interest for coincident patterns of

growth along a vertical scale;

2. Assess the percentages of students meeting CCR targets in different groups;

Page 4: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    3 

3. Explore the achievement gaps between diverse groups and all students based on CCR

targets in Reading, Language, Mathematics, and Science.

Theoretical Framework

In recent years, the enrollment of students who are ELLs, Hispanic and Asian have been

increasing. From the statistics provided by U.S. Department of Education, among the 49.9

million students who were enrolled in public school system in the 2007-2008 academic year,

10.7 percent were ELLs (Aud, Hussar, Planty, Snyder, etc., 2010), 22% were Hispanic, and 3.7%

were Asian (National Policy institute, 2010). In the state of Iowa, the percentage of ELL

students in the 2009-2010 academic year more than doubled from that reported 10 years earlier.

The percentage of Hispanic students increased from 2.6% in the 1997-1998 academic year to 8%

in the 2009-2010 academic year, and from 2.1% to 5.9% for Asian students (Iowa Department of

Education, 2010).

Under such circumstances, a better understanding of group results on growth and CCR is

indispensible to policy makers, educators, and test developers. Both ACT (2009, 2010a, and

2011) and SAT (College Board, 2011) have periodically reported national and state statistics on

the college and career readiness for the graduating class. However, the information was

categorized by racial or ethnic groups (i.e., Africa American Black, Caucasian American White,

Hispanic, and Asian American), while information about ELLs as a separated group is scarce.

Measuring growth is important in evaluating ELLs because many ELLs may have the same

ability as their peers, but might not perform as well as their peers due to lack of sufficient

academic English proficiency and cultural background knowledge (Miller-Whitehead, 2005).

Supporting this, the Test Standards have emphasized the effect of language proficiency in uses

and interpretations of test scores and encourage test developers to collect validity evidence

Page 5: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    4 

concerning whether scores differ in meanings for test takers with linguistically diverse

backgrounds from scores of the population of all examinees as a whole (AERA, APA, NCME,

1999). In this study, we provide validity evidence for measuring the growth and readiness of not

only culturally but also linguistically diverse groups using the Iowa Assessments.

Of specific interest in this study is the developmental pattern (a trajectory) of average

student scores relative to progress toward a college readiness benchmark. Group differences in

these trajectories would call into question the use of a common growth model and developmental

scale for all students. Similarity on parallelism of growth trajectories would support the validity

of scale scores for making “on track” interpretations of growth relative to college readiness,

regardless of student background and educational experiences.

Design and Methods

Vertical Scale

To assess students’ progress and growth, the use of tests with vertical scales is necessary.

A vertical scale is developed when special assessments that are appropriate for students of

different developmental levels are administered across grades. Performance on each of the test

levels is related to a single numerical scale that reflects the growth patterns of students (Kolen &

Brennan, 2004). The Iowa Standard Score Growth Model used in the Iowa Assessments related

to this study is such a metric and is capable of tracking students’ growth over years.

College and Career Readiness Track for the Iowa Assessments

ACT’s College Readiness Benchmarks (CRBs) were empirically derived and relate to the

minimum scores needed for students to have a high probability to success in the first-year credit-

bearing college courses, such as English Composition, College Algebra, and Biology (ACT,

2010b). Because career readiness demands the same level of knowledge and skills as college

Page 6: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUAT

readines

setting a

I

identifie

Assessm

establish

& Welc

grade le

properti

College

Assessm

identifie

be abov

result, b

See the

toward a

Instrum

I

Basics S

conduct

subtests

ACT, an

Assessm

TING COLLEG

ss (ACT, 20

and working

In a previou

ed scale sco

ments that co

hed CRBs f

ch, 2011), an

evels were th

ies of the ve

and Career

ments. The

ed SSs for a

ve the grade

by looking a

above figur

a college re

ments

In this study

Skills and gr

t the analyse

s were chose

nd were used

ments (Furgo

GE READINES

008), CRBs

g world.

us study, res

res (SS) on

orrespond to

for the 11th g

nd comparab

hen derived

ertical scale.

r Readiness

underlining

a specific co

11 cut scor

at the SSs fo

re for an exa

adiness targ

y, scores on

rade 9-11 on

es. The sub

en because t

d to carry ou

ol, Fina & W

SS 

could be us

searchers ha

the Iowa

o the ACT

grade (Furgo

ble SSs for

d through the

. Therefore

(CCR) track

g assumption

ontent area o

e associated

or a student,

ample of ho

get (Welch &

subtests of

n the Iowa T

tests are Re

the tests for

ut a linking

Welch, 2011

sed to gauge

ad

ol, Fina

earlier

e

, a

k is able to b

n is that, if s

on the corres

d with the pr

one can jud

w SSs can b

& Dunbar, 2

f the Iowa A

Tests of Edu

eading, Lang

grade 11 ha

study to est

1).

e the readine

be created f

students con

sponding ea

redicted col

dge whether

be used to m

2011).

Assessments

ucational De

guage, Math

ave similar

tablish CCR

ess of studen

from grade 6

nsistently sc

arlier grade l

llege readine

r this studen

monitor grow

(grade 6-8

evelopment

hematics and

content spe

R targets for

nts on both

6-11 for the

core above th

level test, th

ess scale sco

nt is on the C

wth and pro

on the Iowa

t) were used

d Science.

cifications a

r the Iowa

5

academic

e Iowa

he

hey will

ore. As a

CCR track.

gress

a Tests of

d to

These

as the

Page 7: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    6 

The Iowa Assessments represent samples of items on an achievement continuum that

measure student growth from kindergarten to twelfth grade in core academic areas important for

success in college (Welch & Dunbar, 2011). The most recent forms of the assessments have

been carefully aligned to the Common Core State Standards (CCSS) and The Iowa Core, and are

“developed in collaboration with teachers, school administrators, and experts, to provide a clear

and consistent framework to prepare our children for college and the workforce” (Common Core

State Standards, 2010).

Samples

The dataset used in this study is a matched cohort of students enrolled in public and

private schools in Iowa in the 2002-2003 school year, who have a grade 6 test score in at least

one of four subjects of interest and who may or may not have grade 7-11 test scores in

subsequent school years until 2007-2008, provided the enrollment status. Depending whether a

student took the ACT test or not, this cohort was partitioned into two subsets: “ACT takers” and

“non-ACT takers”. See Table 1 presented below for a demographic breakdown of the sample.

Because complete census data were not available for the year of 2006-2007, the scale score for

grade 10 was calculated using the average of scale score of grade 9 and 11.

Table 1

Total Numbers for Students with or without ACT Scores in the 2002-2003 Academic Year

All studentsNon-ACT

takersACT

takersPercentage of

ACT takers ELLs 449 307 142 31.63 Hispanic 937 615 322 34.36 Asian 415 137 278 66.99 Other* 25886 11549 14337 55.38 Total 27687 12608 15079 54.46

* Students identified as other racial, demographical, or linguistically backgrounds.

Page 8: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    7 

Design and Data Analysis

Descriptive statistics were calculated so that the research questions could be addressed.

In addition, specific analyses are described that focus on similarities of growth trajectories and

differences between proportions of students “on track” for CCR.

Split-plot MANOVA.

In order to evaluate parallelism of average performance growth curves and group

differences among growth curves, a series of 2×6 split-plot multivariate analyses of variance

(MANOVAs) were conducted, one for each subgroup of interest from one sub-sample for one

subject area (e.g., ELLs from ACT takers in math, or Asian students from non-ACT takers in

Reading, etc.). The within-subjects factor was the repeated measure of the Iowa Assessments

scale score for one group of students from one subset in one subject area over six years (e.g.,

scale score for ELLs from subset of ACT takers in Mathematics grade 6-11, or scale score for

Asian students from subset of non-ACT takers in Reading grade 6-11, etc.). The between-

subjects factor was the subgroup students of interest versus the remaining students in the sample,

such as ELLs compared to remainder of ACT takers. In order to establish independent groups for

each comparison, the remaining students in each subset were used as a reference group for all the

statistical analysis, instead of using group of all students. Patterns in growth trajectories for

demographic groups were calculated with effect sizes based on standard multivariate tests (e.g.

Johnson & Wichern, 2008). Only observations with complete data on all variables were included

in the calculation of effect sizes for parallel slopes and achievement gaps.

Standardized proportion differences.

To investigate the college readiness status and gaps between groups, firstly, proportions

of students reaching CCR targets were examined for the above thirty-six combinations. Then

Page 9: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    8 

taking the complement to a given focal group as a reference, standardized proportion differences

between each subgroup and the reference group were calculated using pooled within-groups

standard error estimates.

Results

The correlations between the four subject areas of the grade 11 Iowa Assessments and the

corresponding ACT tests were calculated for ELLs, Hispanic and Asian students. The modest to

strong relationship found in previous study (Furgol, Fina & Welch, 2011) holds for grades 5-10.

On average, the correlations are most close to all students for Hispanic and Asian students, but

are about 0.1 lower for the ELLs. These results are reported in Table 2.

Table 2

Average Correlation between the Iowa Assessments and ACT over Six Years

Reading Language Mathematics Science

ELLs 0.67 0.65 0.65 0.54

Hispanic 0.72 0.74 0.70 0.61

Asian 0.77 0.76 0.77 0.64

All students 0.73 0.74 0.74 0.62

Average Performance Trends

Similar growth trend between subgroups and all students can be clearly seen in Figures 1-

4 in Appendix A. Occasional small interactions between groups and average SSs were observed

in certain subjects, subgroups or datasets. To summarize the patterns in all of the Figures given

in Appendix A, a multivariate effect size was calculated. This statistic range between 0 and 1.0

and takes on values close to 0 when the hypothesis of parallel profiles is supported by the data.

The results are reported in Table 3. The consistently trivial effect sizes in Table 3 for departure

from parallel trajectories indicate that the developmental trends of ELLs, Hispanic and Asian

Page 10: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    9 

students are very similar to the trends of all students. There is little, if any, evidence in these

effect sizes to suggest group differences in growth trajectories.  

Table 3

Effect Size* for Departure from Parallel Trajectories

Subject Dataset ELLs Hispanic Asian

Reading

All 0.01 0.01 0.01

ACT takers 0.01 0.01 0.01 

Non-ACT takers 0.01 0.01 0.01 

Language

All 0 01 0 01 0 01

ACT takers 0.01 0.01 0.01

Non-ACT takers 0.01 0.01 0.01

Mathematics

All 0.01 0.01 0.01

ACT takers 0.01 0.01 0.01

Non-ACT takers 0.01 0.01 0.01

Science

All 0.01 0.01 0.01

ACT takers 0.01 0.01 0.01

Non-ACT takers 0.01 0.01 0.01

*Effect Size = 1 - Wilks' Lambda (Johnson & Wichern, 2007 )

To better illustrate the results in Table 3, Figure 1 presents the average performance for

subgroups in Reading as well as for all students as an example of the parallel trajectories

observed. Although from the graph the profile for Asian students overlaps the profile of all

students, the effect size of 0.01 even for this comparison indicates no practical significance.

Hence, parallel growth trajectories seem to be true for the three datasets, four subject areas, and

three demographic groups of interest in this study.

In addition, the achievement gaps observed in the graphs were investigated as well. The

standardized mean difference between one subgroup and the reference group were tabulated and

are presented in Table 4.

Page 11: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUAT

Figure 1

Growth

Table 4

Effect S

Subj

Read

Langu

Mathem

Scie

*Effect

TING COLLEG

1

Trends for

4

Size* for Ac

ject

ding

All

AC

No

uage

All

AC

No

matics

All

AC

No

ence

All

AC

No

Size = Cohe

GE READINES

ELLs, Hisp

chievement G

Dataset

l

CT takers

n-ACT take

l

CT takers

n-ACT take

l

CT takers

n-ACT take

l

CT takers

n-ACT take

en's d, positiv

SS 

panic and As

Gaps

t

ers

ers

ers

ers

ve effect size

sian Student

ELLs

0. 35

0. 37

0. 24

0. 32

0. 30

0. 22

0. 35

0. 36

0. 25

0. 35

0. 37

0. 26

e favors the re

ts in Readin

Hispanic

0. 23

0. 21

0. 15

0. 24

0. 21

0. 16

0. 27

0. 24

0. 20

0. 26

0. 24

0. 18

eference grou

ng in All Stu

Asian

0. 00

0. 05

0. 04

-0. 08

-0. 05

-0. 04

-0. 02

0. 00

0. 09

0. 02

0. 04

0. 14

up

udents Datas

0

5

4

8

5

4

2

0

9

2

4

4

10

set.

Page 12: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUAT

W

students

as well a

achievem

between

size was

datasets

and all s

dataset w

gaps bet

takers p

scale sc

study.

Figure 2

Average

TING COLLEG

With respec

s, no effect w

as all studen

ment gap be

n ELLs and

s observed i

s. This dispa

students are

with all stud

tween the su

performed ab

ores better t

2

e Performan

GE READINES

ct to standar

was observe

nts. An effe

etween Hisp

the referenc

in the subse

arity is clea

e smaller for

dents and th

ubgroups an

bout 14 Iow

than non-AC

nce Profile f

SS 

rdized perfo

ed for Asian

ect size arou

panics and t

ce group. O

t of non-AC

arly illustrate

r the dataset

he dataset w

nd all studen

wa scale scor

CT takers ac

for ACT Tak

rmance diff

n students, w

und 0.2 for H

the reference

One noticeab

CT takers, w

ed in Figure

t with only n

ith only AC

nts stay simi

re points bet

cross all sub

kers and no

ferences bet

which mean

Hispanic stu

e group, but

ble pattern i

when the effe

e 2 below, th

non-ACT tak

CT takers. Fu

ilar across a

tter than all

bjects and ov

n-ACT Take

tween divers

s that Asian

udents indic

t the gap is s

s that, a rela

ect sizes wer

hat the gaps

kers, and ar

urthermore,

all subjects.

students an

ver the six y

ers in Readi

se groups an

n students pe

cates that the

smaller than

atively smal

re compared

s between su

e very simil

, the abovem

On averag

nd about 32

years includ

ing

11

nd all

erformed

ere is an

n the gap

ller effect

d across

ubgroups

lar for the

mentioned

e, ACT

Iowa

ded in this

Page 13: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    12 

Thus, in terms of improvement of growth over time, our first finding that the parallelism

of growth trajectories between special population and their peers, confirms efforts made by

educators and parents to promote learning for all students. It indicates that all students are

actually obtaining growth at the same rate under well-developed educational plans. However,

special interventions are needed to help these diverse learners grow at a faster rate so that they

could be as ready as their peers for future education and careers.

Percentage on CCR Track

The parallelism pattern found above also provides strong evidence on the equitability of

applying the CCR track from the Iowa Assessments to all students including the diverse groups

of students considered in this study (Furgol, Fina & Welch, 2011). Comparisons between

different groups of students were conducted with respect to the percentage of students on the

CCR track. Overall, 31% of the ACT takers, 20% of all students, and 7% of the non-ACT takers

are on track base on their scores from the Iowa Assessments, which is defined as being on track

for all four subjects (ACT, 2010). Notable in all the datasets, the percentage of Asian students

that is on track in all four subject areas is the highest among subgroups of interest, with about

34%, 27% and 13% for ACT takers, all students, and non-ACT takers, respectively.

Nevertheless, ELLs and Hispanic students are much farther behind their classmates. Since the

continuous population increases of Hispanic students and ELLs, imagine what the CCR status

graphs would look like had they been as ready as their peers. Graphs of the percentages

described above are given in Figure 3 and in Appendix B.

Page 14: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUAT

Figure 3

Percent

A

areas ac

groups o

T

proporti

presente

standard

differen

markedl

differen

in Scien

Figure 4

TING COLLEG

3

tage of Stude

Although th

cross dataset

of interest, s

To further e

ion differen

ed to provid

dized propor

nces between

ly larger for

nces observe

nce for all su

4.

GE READINES

dents Meetin

he developm

ts and over y

subjects and

examine the

ces were ca

de a better st

rtion differe

n subgroup

r Hispanic s

ed are in Rea

ubgroups ac

SS 

ng CCR Targ

mental trends

years, the p

d datasets.

percentage

alculated. T

tatistical me

ences betwe

and all stud

tudents and

ading for no

cross all data

gets across

s for the div

ercentages o

s of student

These are sim

etric for eval

een subgroup

dents are ver

d ELLs. As

on-ACT take

asets. Grap

Datasets

verse groups

of students

ts reaching C

milar to stud

luating achi

ps and the r

ry small for

for subject

ers, while th

hs displayin

s are very si

reaching CC

CCR targets

dent’s t stati

ievement ga

reference gr

Asian stude

areas, the sm

he largest ob

ng these stat

imilar in sub

CR targets v

s, standardiz

stics and are

aps. In term

oup, the per

ents, but are

mallest prop

bserved diff

tistics are gi

13

bject

vary by

zed

e

ms of

rcentage

e

portion

ference is

iven in

Page 15: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUAT

Figure 4Standar

TING COLLEG

4 rdized Propo

GE READINES

ortion Diffe

SS 

erences on CCCR Track bbetween Subbgroups andd Others

14

Page 16: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    15 

In terms of CCR proportion gaps, as illustrated in Figure 4 above, Asian students and the

reference group were most close. The percentage of Asian students reaching CCR targets is

more than that of reference group in Reading, but is much less in Science for non-ACT takers.

For Asian students who are ACT takers, the standardized proportion difference with the reference

group is positive in Language for both ACT and non-ACT takers, which indicates that more

Asian students reach the targets than students in the reference group. However, as previously

mentioned, the reference group had fewer than half its students above the CCR targets.

For Hispanic students and ELLs, the standardized proportion differences for reaching

CCR targets are quite similar among ACT takers for every subject area. But for non-ACT takers,

the readiness gaps vary across subjects. The largest standardized proportion difference for

Hispanic students shows up in Science, which is similar for Asian students, and the smallest is in

Reading in non-ACT taker group. For ELLs, the differences are consistent and are all negative

across datasets. Interestingly, the biggest and the smallest gaps observed for ELLs were both in

Reading, and were for ACT takers and non-ACT takers, respectively. This phenomenon indicates

that the predicted CCR condition of ELLs who did not take ACT is much closer to their peers

than ELLs who took ACT on perhaps the most language-dependent test — Reading.

Significance

The preparation for college and career readiness is a continuous process throughout

elementary and secondary education, which requires long-term monitoring and a high quality

assessment system. Different models may be developed to specify how students’ progress and

how the CCR status to be assessed. However, the model presented here may provide some ideas

of how an assessment system can use a vertical scale, strong content alignment to the Common

Core Standards, statistical linkage with an admission test and longitudinal data to provide

Page 17: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    16 

validity evidence on growth and in applying the CCR track to all students, including these

special populations, regardless of college aspirations.

With this long-term monitoring information, parents and educators would determine that

whether a group is on track to college and career readiness, begin reacting early to help younger

students achieve their goals, and help teachers provide support strategies and intervention at the

right moment. Moreover, it helps educators in identifying the strengths and weaknesses of

different groups, which would be helpful for educational administrators in improving outcomes

for their students, especially for students from minority groups, and in closing achievement gaps

among students. As a result, we would be closer to the goal of identifying and preparing every

student for college and career by 2020 (U.S. Department of Education, 2010).

Page 18: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    17 

References

ACT. (2008). ACT’s College Readiness System. Retrieved November 15, 2011 from

http://www.act.org/research/policymakers/pdf/crs.pdf

ACT. (2009). The condition of college and career readiness 2009. Retrieved July 15, 2011 from

http://www.act.org/research/policymakers/pdf/TheConditionofCollegeReadiness.pdf

ACT. (2010a).The condition of college and career readiness 2010. Retrieved July 15, 2011 from

http://www.act.org/research/policymakers/cccr10/pdf/ConditionofCollegeandCareerRead

iness2010.pdf

ACT. (2010b). What are ACT’s college readiness benchmarks? Retrieved July 15, 2011 from

http://www.act.org/research/policymakers/pdf/benchmarks.pdf

ACT. (2011). The condition of college and career readiness 2011. Retrieved September 12, 2011

from

http://www.act.org/research/policymakers/cccr11/pdf/ConditionofCollegeandCareerRead

iness2011.pdf

American Educational Research Association, American Psychological Association, & National

Council on Measurement in Education. (1999). Standards for educational and

psychological testing. Washington, DC: American Educational Research Association.

Aud, S., Hussar, W., Planty, M., Snyder, T., Bianco, K., Fox, M., Frohlich, L., Kemp, J., &

Drake, L. (2010). The condition of education 2010 (NCES 2010-028). National Center

for Education Statistics, Institute of Education Sciences, U. S. Department of Education.

Washington, DC.

Page 19: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    18 

Bustamante, R., Slate, J., Edmonson, S., Combs, J., Moore, G., & Onwuegbuzie, A. (2010).

College-readiness for English language learners and students with special learning needs.

International Journal of Educational Leadership Preparation, 5(4).

College Board. (2011). SAT benchmarks. College Board Research Report No. 2011-5.

Retrieved August 23, 2011, from

http://professionals.collegeboard.com/profdownload/pdf/RR2011-5.pdf

Common Core State Standards. (2010). About the Standards. Retrieved July 20, 2011, from

http://www.corestandards.org/about-the-standards

Furgol, K., Fina, A., & Welch, C. (2011). Establishing validity evidence to assess college

readiness through a vertical scale. Paper presented at the Annual Meeting of American

Educational Research Association, New Orleans, LA.

Iowa Department of Education. (2010). The annual condition of education report. Retrieved

June 23, 2011 from

http://educateiowa.gov/index.php?option=com_docman&task=cat_view&gid=646&Itemi

d=1563

Welch, C. & Dunbar, S. B. (2011). K-12 assessments and college readiness: necessary validity

evidence for educators, teachers and parents. Paper presented at the Annual Meeting of

American Educational Research Association, New Orleans, LA.

Johnson, R. A., & Wichern, D. W. (2008). Applied multivariate statistical analysis (2nd ed.).

Upper Saddle River, NJ: Pearson.

Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and

practices (2nd ed). New York, NY: Springer.

Page 20: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

EVALUATING COLLEGE READINESS    19 

Miller-Whitehead, M. (2005). Why measuring growth is especially important in evaluation of

English language learners. Paper presented at the Annual Meeting of Alabama-

Mississippi Teachers of English to Speakers of Other Languages, Florence, AL.

National Policy institute. (2010). ELL facts. Retrieved May 15, 2011 from

http://www.migrationinformation. org/ellinfo/FactSheet_ELL1.pdf

U. S. Bureau of Labor Statistics. (2009). Employment projection 2008-18. Retrieved June 11,

2011 from http://www.bls.gov/news. release/pdf/ecopro.pdf

U. S. Department of Education. (2010). A Blueprint for Reform. The Reauthorization of the

Elementary and Secondary Education Act. Retrieved July 26, 2011 from

http://www2.ed.gov/policy/elsec/leg/blueprint/blueprint.pdf

Page 21: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 1

Average

1

e Performannce Trend foor All Stude

Appendix B

nts

B 20

Page 22: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 2

Average

2

e Performannce Trend foor ACT Take

Appendix B

ers

B 21

Page 23: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 3

Average

3

e Performannce Trend foor non-ACT

Appendix B

T Takers

B 22

Page 24: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 1

Percent

1

tage on CCRR Track for

All Four Su

Appendix B

ubject Areas

s

23

Page 25: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 2

Percent

2

tage on CCRR Track for All Students

Appendix B

s

B 24

Page 26: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 3

Percent

3

tage on CCRR Track for ACT Takers

Appendix B

s

B 25

Page 27: Evaluating College Readiness for English Language Learners ... · Evaluating College Readiness for English Language Learners and Hispanic and Asian Students Objectives In a global

Figure 4

Percent

4

tage on CCRR Track for non-ACT Ta

Appendix B

Takers

B 26