national assessment of educational progress (naep) in north carolina

Future Ready Schools

National Assessment of Educational Progress

(NAEP) in North Carolina

Wednesday, February 13, 2008Auditorium III8:30 – 9:30 a.m.


2

National Assessment of Educational Progress (NAEP)

•The National Assessment of Educational Progress (NAEP), also known as "the Nation's Report Card," is the only nationally representative and continuing assessment of what America's students know and can do in various subject areas.

•NAEP is authorized by Congress and administered by the National Center for Education Statistics in the U.S. Department of Education.


3


• Since 1969, assessments have been conducted periodically in reading, mathematics, science, writing, U.S. history, civics, geography, and the arts.

• Starting in 1990, NAEP assessments have also been conducted to give results for participating states. Those that chose to participate received assessment results that report on the performance of students in that state.

• North Carolina has participated in the state-level assessments of NAEP since 1990.


4


• State-level NAEP is only given in reading, mathematics, science, and writing.

• NAEP does not provide scores for individual students or schools; instead it offers results at the national and state-level regarding subject-matter achievement, instructional experiences, and school environment for populations of students.

• It provides results for subgroups of the population (e.g., race/ethnicity, gender, eligibility for free/reduced lunch, etc.).


5


• "No Child Left Behind" legislation stipulates that states, districts, and schools within districts that receive Title I funds must participate in NAEP if selected.

• Reading and mathematics must be administered every two years in grades 4 and 8.

• Students and schools that are selected to participate are kept confidential.


6


State Board of Education Policy HSP-A-001 (16 NCAC 6D .0302):

“To ensure adequate representation and generalizability of the data used to develop tests and to conduct evaluation studies, selected LEAs and schools, determined through stratified random samples, shall participate in field testing and other sample testing such as NAEP and other national or international assessments as designated by the department or the State Board of Education.”


7

NAEP Results

•NAEP Results are reported using three different statistics.– Average Scale Score

• Math & Reading Scale is 0-500

– Achievement Levels• Below Basic, Basic, Proficient & Advanced

– Percentiles• 10th, 25th, 50th, 75th and 90th


8

NAEP 2007 Average Scale ScoreMathematics Results

North Carolina & Nation (Public) Grades 4 & 8 Mathematics NAEP Results1990-2007 Average Scale Scores

242241242

230*224*

213*

219*

222* 224*

234* 237* 239

284282281276*

268*

258*250*

262*267*

271*

272*276* 278*

280

170

180

190

200

210

220

230

240

250

260

270

280

290

300

310

320

1990** 1992** 1996** 2000 2003 2005 2007

Ave

rag

e S

cale

Sco

re

Nation Grade 4

NC Grade 4

Nation Grade 8

NC Grade 8

*Value is signifi cantly diff erent f r om the value in 2007.

**Accommodations wer e not permitted f or this assessment.

NOTE: The NAEP Mathematics scale ranges f r om 0 to 500. Obser ved diff erences ar e not necessar i ly statistical ly signifi cant. Detail may not sum to totals because of r ounding.

SOURCE: U.S. Depar tment of Education, Institute of Education Sciences, National Center f or Education Statistics, National Assessment of Educational P rogress (NAEP ), 1990, 1992, 1996, 2000,


9

NAEP 2007 MathematicsGrade 4 State Comparisons


10

NAEP 2007 MathematicsGrade 8 State Comparisons


11

NAEP 2007 Average Scale ScoreReading Results

North Carolina & Nation (Public) Grades 4 & 8 Reading NAEP Results1992-2007 Average Scale Scores

221*217

218

222*213*214*

212*

220

217*216*217*213*212*

215*

262* 265* 262

258 259

261

261 263* 261

260*

170

180

190

200

210

220

230

240

250

260

270

280

290

300

310

320

1992** 1994** 1998 2002 2003 2005 2007

Ave

rag

e S

cale

Sco

re

Nation Grade 4

NC Grade 4

Nation Grade 8

NC Grade 8

*Value is signifi cantly diff erent f r om the value in 2007.

**Accommodations were not permitted f or this assessment.

NOTE: The NAEP Mathematics scale ranges f r om 0 to 500. Observed diff erences are not necessar i ly statistical ly signifi cant. Detail may not sum to totals because of r ounding.

SOURCE: U.S. Depar tment of Education, Institute of Education Sciences, National Center f or Education Statistics, National Assessment of Educational P rogress (NAEP ), 1992, 1996, 2000, 2003,


12

NAEP 2007 ReadingGrade 4 State Comparisons


13

NAEP 2007 ReadingGrade 8 State Comparisons


14

NAEP 2007 Percentiles Mathematics Grade 4 Results

North Carolina NAEP Grade 4 MathematicsAverage Scale Scores by Percentiles

206205207

195*

184*

170*

224223224

212*

204*

190*

243242243

231*

225*

214*

261260261

249*245*

235*

275276276

265*263*

253*

160

170

180

190

200

210

220

230

240

250

260

270

280

290

1992¹ 1996¹ 2000 2003 2005 2007

Ave

rag

e S

cale

Sco

re

10th Percentile 25th Percentile 50th Percentile 75th Percentile 90th Percentile

Basic Cut Score 214

Proficient Cut Score 249

Advanced Cut Score 282


15

NAEP 2007 PercentilesMathematics Grade 8 Results

North Carolina NAEP Grade 8 MathematicsAverage Scale Score by Percentiles

239235

232*229*

222*

213*

204*

260259258253*

244*

235*

225*

285283283278*

268*

259*

251*

308306306

302*

293*

283*

275*

329327327322*

314*

303*

296*

200

210

220

230

240

250

260

270

280

290

300

310

320

330

340

1990¹ 1992¹ 1996¹ 2000 2003 2005 2007

Ave

rag

e S

cale

Sco

re




BasicCut Score 262


16

NAEP 2007 PercentilesReading Grade 4 Results

North Carolina NAEP Grade 4 ReadingAverage Scale Scores by Percentiles

163* 162* 161*

180*175

170 173

187* 188* 190*

200 198193 196

214*217 216

222 223219 220

238243

240244 246

242 242

258263 259 263 265*

261 260

150

160

170

180

190

200

210

220

230

240

250

260

270

280

1992¹ 1994¹ 1998 2002 2003 2005 2007

Ave

rag

e S

cale

Sco

re


Basic Cut Score 208




17

NAEP 2007 PercentilesReading Grade 8 Results

North Carolina NAEP Grade 8 ReadingAverage Scale Scores by Percentiles

212212

218

224*218

238236240242 245*

263261263267265

284283285287286

301301303304303

200

210

220

230

240

250

260

270

280

290

300

310

320

330

1998 2002 2003 2005 2007

Ave

rag

e S

cale

Sco

re




Basic Cut Score 243


18

NAEP:Importance to North Carolina

• Since NC fell behind the nation on the grade 8 reading NAEP assessment in 2005, the state board of education proposed literacy coaches at the middle grades.

• The governor’s office picked this up in their budget and we now have literacy coaches in the middle grades at several NC public schools.

• Literacy coaches have been in place since the 2006-07 school year.


19


• In the 2005-06 school year, the state board of education increased the standard for proficient on the new edition of the EOG Mathematics assessments.

• The following is a quote from the press release:

– “The State Board of Education made good on months of discussion regarding the need to raise standards for student performance to more closely align with proficiency standards of the National Assessment of Educational Progress (NAEP) and to be more challenging in preparing students for 21st century skills and learning.”


20


• There is a new edition of the Reading Comprehension EOG tests this school year.

• Thus, new standards for the proficient cut score will be set.

• If the state board of education follows a similar pattern, the standard for proficient on the Reading Comprehension EOG tests will be more rigorous.


21


Comparison of Achievement Levels onthe North Carolina EOGs and NAEP

2006-07 School Year

Percent at or Above Each Achievement Level

AssessmentGrade 4Reading

Grade 8Reading

Grade 4Math

Grade 8Math

NC EOGAt or Above

Level III85% 88% 68% 65%

NAEPAt or Above

Proficient29% 28% 41% 34%

NAEPAt or Above

Basic64% 71% 85% 73%


22

2005 Mapping State Proficiency Standards onto the NAEP Scale

•This study was released in June 2007.

•Purpose of the study was to put all states’ AYP proficiency standards onto a common scale.

– NAEP happens to be that scale

•Based on state and NAEP results from the 2004-05 school year.


23


•Methodology for the study:

– Find the percent of students scoring proficient or higher on the state assessment.

– Find the same percent on the state’s NAEP distribution.

– Locate the NAEP Score Equivalent.


24


•North Carolina was at the bottom for all four areas:

– Grade 4 Reading

– Grade 8 Reading

– Grade 4 Mathematics

– Grade 8 Mathematics


25



26


•You can access the report at:

– http://nces.ed.gov/nationsreportcard/pubs/studies/2007482.asp

•This study will be repeated with the state and NAEP results for 2007.

– Scheduled for release summer 2008


27

Upcoming NAEP Releases

• NAEP 2007 Grade 8 Writing– March 2008 (state and national results)

• National Indian Education Study – Spring 2008

• 2007 Inclusion Study– Spring/Summer 2008

• 2007 Mapping State Proficiency Standards onto the NAEP Scale– Summer 2008


28

NAEP 2008 Activities

•Science Interactive Computer Task (SICT) Pilot (Grades 4, 8 & 12)

•Long-Term Trend Assessment for Reading and Mathematics (Ages 9, 13 & 17)

•Arts Assessment (Grade 8)

•Field Tests in Reading, Mathematics and Science (Grades 4, 8 & 12)


29

Questions and Comments


National Assessment of Educational Progress

(NAEP) in North Carolina

Marcie HickmanNAEP State [email protected]

national assessment of educational progress (naep) in north carolina

Documents