Jack BuckleyCommissioner

National Center for Education Statistics

October 3, 2013

• 50 U.S. states, the District of Columbia, and the Department of Defense schools participated

• Results for each state based on approximately

2011 Assessments: NAEP Mathematics and Science at Grade 8

2

– 3,200 students from 50 to 230 schools for mathematics

– 2,300 students from 50 to 220 schools for science

Overview

National Center for Education Statistics: 2011 Linking Study at Grade 8

• 47 education systems (38 countries and 9 subnational entities) • Results for each education system based on no fewer than

•Nine U.S. states participated

2011 Assessment: TIMSS Mathematics and Science at Grade 8

3

– Alabama, California, Colorado, Connecticut, Florida, Indiana, Massachusetts, Minnesota, and North Carolina

– 4,000 students from at least 150 schools

Overview

National Center for Education Statistics: 2011 Linking Study at Grade 8

47 education systems assessed 8th-graders in TIMSS 2011

4

Overview

National Center for Education Statistics: 2011 Linking Study at Grade 8

5

Overview

U.S. states that participated in TIMSS 2011

National Center for Education Statistics: 2011 Linking Study at Grade 8

6

2011 NAEP and TIMSS Programs

National Center for Education Statistics: 2011 Linking Study at Grade 8

7

2011 NAEP and TIMSS Assessments

National Center for Education Statistics: 2011 Linking Study at Grade 8

• Reported predicted TIMSS scores for the 43 states that participated only in NAEP.

• Applied three statistical linking methods: o Calibration,o Statistical projection, and o Statistical moderation

• Selected statistical moderation method, the simplest of the three, in predicting TIMSS scores.

8

2011 NAEP-TIMSS Linking Study

National Center for Education Statistics: 2011 Linking Study at Grade 8

•Accuracy of prediction was evaluated using scores for the nine states that participated in both NAEP and TIMSS.

•All three methods yielded essentially the same predicted TIMSS results.

•In predicting TIMSS scores, additional adjustments were made to make NAEP and TIMSS assessed populations more comparable.

•The differences between actual and predicted TIMSS scores for the nine states were not statistically different, except in two cases in one subject.

9

2011 NAEP-TIMSS Linking Study

National Center for Education Statistics: 2011 Linking Study at Grade 8

Compared to the TIMSS average of 500, average scores for

111 Department of Defense Education Activity (overseas and domestic schools).

36 states were higher

10 states were comparable

6 states were lower

National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching Advanced benchmark (≥ 625)

12

• Massachusetts has highest U.S state percentage

• Chinese Taipei, Singapore, and the Republic of Korea have highest education system percentages

National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching High benchmark (≥ 550)

13

• Massachusetts has highest U.S. state percentage

• Singapore and the Republic of Korea have highest education system percentages

National Center for Education Statistics: 2011 Linking Study at Grade 8

151 Department of Defense Education Activity (overseas and domestic schools).

47 states were higher

2 states were comparable

3 states were lower

Compared to the TIMSS average of 500, average scores for

National Center for Education Statistics: 2011 Linking Study at Grade 8

16

Percentages of students reaching Advanced benchmark (≥ 625)

• Massachusetts has highest U.S. state percentage

• Singapore has highest education system percentage

National Center for Education Statistics: 2011 Linking Study at Grade 8

Percentages of students reaching High benchmark (≥ 550)

• Massachusetts and Vermont have highest U.S. state percentages

• Singapore has highest education system percentage

17

National Center for Education Statistics: 2011 Linking Study at Grade 8

18

Resources

Download the following documents:

• A highlights report to learn about the NAEP-TIMSS linking results

• A paper to understand the methodology applied in linking

• Papers to find how two assessments, NAEP and TIMSS, compare in what is assessed, and how TIMSS items map onto the NAEP assessment frameworks

• Frequently Asked Questions

National Center for Education Statistics: 2011 Linking Study at Grade 8

19

Photo Credits: © DNY59/iStockphoto #1966820 © PhotoAlto/Michele Constantini/Getty Images, Inc. #103057941 © Datacraft Co. Ltd./Getty Images, Inc. #122688704

http://nces.ed.gov/nationsreportcard/

For more information

Image will be updated