understanding and improving your school grade. how is my school doing? ٭ compared to standards ٭...

Understanding and Improving Your School Grade

How is my school doing?

Compared to٭STANDARDS

Compared to SELF ٭

Compared to OTHERS ٭

Angle #1: The School Accountability Report

Compared to Standards

Angle # 2: Gold Report

Compared to Self

Angle # 3: School Comparison Graphs

Compared to Others

Angle # 4: FCAT 2003 SSS State

Report of School Results

Compared to Others

Four Different Reports/Four Different Angles

Understanding FCAT ReportsUnderstanding FCAT Reports

PART APART A

What is the purpose of FCAT?•Assess student achievement of

the Sunshine State Standards (SSS) benchmarks in Reading, Writing, Science, and Mathematics

•Compare the performance of Florida students with students across the nation using a norm-referenced test (NRT) in reading comprehension and mathematics problem solving

What kinds and how many FCAT Student Reports do schools receive?1. SSS - Reading and Mathematics (Grades 3-10)

2. NRT - Reading and Mathematics (Grades 3 – 10)

3. SSS - Writing (Grades 4, 8, & 10)

4. SSS - Science (Grades 5, 8, & 11)

5. SSS - Performance Task Questions (Grades 4, 5, 8, 10 & 11)

Which students are tested?

Most students, including limited English proficient (LEP) and exceptional student education (ESE) students, enrolled in the tested grade levels participate in the FCAT administration.

Special accommodations are available and provided to eligible ESE and LEP students.

What types of questions are on the FCAT?

• Students choose the best answer out

of four answer choices

• SSS and NRT

• All grades (3 - 11)

• 1 point each

• Scored by the computer

Multiple-choice questions

Gridded-response

• Students figure out a numeric answer and bubble it on a grid

• SSS Mathematics (Grades 5 – 10)

• SSS Science (Grades 8 and 11)

• 1 point each

• Scored by the computer

What types of questions are on the FCAT?

Performance Tasks•Students answer questions in their own words in reading

and show their solutions to mathematics questions or respond to science questions

Two Types:

˜ Short response: 5 min. (0, 1,or 2 pts.)

˜ Extended response: 10- 15 min. (0, 1, 2, 3, or 4 pts.)

•FCAT SSS

•Grades 4 (reading), 5 (mathematics), 8 (reading and mathematics) , 10 (reading and mathematics) and 11 (science)

•Scored by at least two people

What types of question are on the FCAT?

• Essay for an assigned topic (prompt)

• Grades 4, 8, and 10

• Expository or Narrative (Grade 4)

• Expository or Persuasive (Grades 8 and 10)

• The highest score is 6 points.

• Score reported is the average of two trained scorers’ scores.

What types of questions are on FCAT Writing?

• Note: Items are classified on the cognitive demand inherent in the test item, not on assumptions about the student’s approach to the item.

How are test questions classified on FCAT?

• Can be used to interpret trends in student performance

• Are used to report student scores so the scores reported from year to year can be compared

• Range from 100 – 500

What are scale scores?

100 Points 500 Points

What are the FCAT achievement levels?• Describe the success a student has achieved

on the Florida SSS Reading or Mathematics portion of the test

• Range from 1 to 5 with Level 1 the lowest and Level 5 the highest

• Are based on scale scores that range from 100 to 500

Level 1

Level 2

Level 3

Level 4

Level 5

Note: FCAT SSS Science Levels for grades 5, 8, and 11 will be reported beginning March 2006.

The FCAT Writing scoring is based on POINTS that range from 1 to 6.

15

16

• A type of scale score

• Used to determine a student’s annual progress from grade to grade

• Range from 86 - 3008

What are Developmental Scale Scores (DSS)?

On the Student Report the Developmental Scale Score is called the FCAT Score.

Grade Level 1 Level 2 Level 3 Level 4 Level 5

3 86-1045 1046-1197 1198-1488 1489-1865 1866-2514

4 295-1314 1315-1455 1456-1689 1690-1964 1965-2638

5 474-1341 1342-1509 1510-1761 1762-2058 2059-2713

6 539-1449 1450-1621 1622-1859 1860-2125 2126-2758

7 671-1541 1542-1714 1715-1944 1945-2180 2181-2767

8 886-1695 1696-1881 1882-2072 2073-2281 2282-2790

9 772-1771 1772-1971 1972-2145 2146-2297 2298-2943

10 844-1851 1852-2067 2068-2218 2219-2310 2311-3008

FCAT Achievement Levels and Developmental Scores

Reading

Grade Level 1 Level 2 Level 3 Level 4 Level 5

3 375-1078 1079-1268 1269-1508 1509-1749 1750-2225

4 581-1276 1277-1443 1444-1657 1658-1862 1863-2330

5 569-1451 1452-1631 1632-1768 1769-1956 1957-2456

6 770-1553 1554-1691 1692-1859 1860-2018 2019-2492

7 958-1660 1661-1785 1786-1938 1939-2079 2080-2572

8 1025-1732 1733-1850 1851-1997 1998-2091 2092-2605

9 1238-1781 1782-1900 1901-2022 2023-2141 2142-2596

10 1068-1831 1832-1946 1947-2049 2050-2192 2193-2709

FCAT Achievement Levels and Developmental Scores

Mathematics

What kind of information is included on the FCAT

SSS Reading and Mathematics Student

Report?

Year 2001 2002 2003Grade Tested 8 9 10

Achievement Level 3 3 4FCAT Score (DSS) 1924 1988 2218

Year 2001 2002 2003Grade Tested 8 9 10

Achievement Level 3 3 4FCAT Score (DSS) 1924 1988 2218

Content Area Points Possible Points EarnedWords/Phrases 9 8

Main Idea/Purpose 14 12Comparisons 13 10

Reference/Research 16 14

2003 Reading Content ScoresContent Area Points Possible Points Earned

Words/Phrases 9 8Main Idea/Purpose 14 12

Comparisons 13 10Reference/Research 16 14

2003 Reading Content Scores2003 Mathematics Content Scores

Content Areas Points Possible Points Earned

Number Sense 11 9

Measurement 10 7

Geometry 14 12

Algebraic Thinking

14 11

Data Analysis 11 10

FCAT SSS Content Scores Report

Note: This student passed the Reading section and scored above the state’s mean score for three years in a row.

What kind of information is included on the FCAT

NRT Reading and Mathematics Student

Report?

Scale Score National Percentile Rank StanineReading

Comprehension 732 78 7Mathematics

Problem Solving 762 96 9

Subject Scores

The NRT scores describe the student performance in relation to the performance of students throughout the nation.

•The National Percentile Rank indicates the percent of all students in the national sample who scored equal to or below the student’s score. They range from 1 to 99.

•Stanine scores divide the distribution of scores into nine equal parts (1 – 9) and are not as variable as percentile ranks.

Content Areas Report

What kind of information is included

on the FCAT SSS Science Student

Report?

Note: The score is a number between 100 and 500 (NO DSS)

Content Areas Points Possible Points Earned

Lowest Middle HighPhysical and Chemical 12 4 XEarth and Space 13 9 XLife and Environmental 13 11 XScientific Thinking 13 9 X

State ComparisonContent Areas Points Possible Points Earned

Lowest Middle HighPhysical and Chemical 12 4 XEarth and Space 13 9 XLife and Environmental 13 11 XScientific Thinking 13 9 X

State Comparison

FCAT Science Content Score334

HighestMiddleLowest

State ComparisonScore

100

150

200

250

300

350

400

450

500

Student's Score State Score

FCAT Science Score

FCAT SSS Science Student Report

What kind of information is included

on FCAT Writing Student Report?

29

PART BPART BUsing FCAT Reports to Improve Your School GradeUsing FCAT Reports to Improve Your School Grade

How are students’ FCAT scores used to calculate

schools’ performance grades?

Which students’ FCAT scores are used Which students’ FCAT scores are used to calculate the school performance to calculate the school performance grade?grade?

For High Standards

Standard curriculum (ESOL students more than 2 years and ESE students in hospital/homebound, gifted or speech impaired)

For Learning Gains

All students with current and prior FCAT scores (includes all LEP and ESE)

Grades 3 – 10

Enrolled in the same school, October and February

Sunshine Elementary School

School Accountability Report

How many points are How many points are needed for each school needed for each school performance grade?performance grade?

0 - 2790 - 279FF

280 - 319280 - 319DD

320 - 379320 - 379CC

380 - 409380 - 409BB

410 +410 +AA

3/6 - 50 % from Reading

2/6 - 33 % from Mathematics

1/6 - 17 % from Writing

R R R

M M

W

High Standards Learning Gains

M

R

R

W

M

R

3/6 - 50% 3/6 - 50%

Which FCAT scores count toward High Standards?

In Reading and MathematicsPercent scoring FCAT Levels 3

and above

In WritingPercent scoring “3.5” or higher

How can students demonstrate annual learning gains?

Improved FCAT Achievement Levels from one year to the next (i.e., 1-2, 2-3, 3-4, 4-5)

Maintained “satisfactory” Achievement Levels from one year to the next

(i.e., 3-3, 4-4, 5-5)

Remained within Levels 1 or 2 and demonstrated more than one year’s growth on the FCAT developmental scale

Note: Retained students in Levels 1 and 2 must improve by at least one level to demonstrate learning gains (i.e., 1-2, 2-3).

What are Developmental Scale Scores (DSS)?

• Range from 86 to 3008

• Are based on FCAT SSS student scale scores which range from 100 to 500

• Provide information whether a student has made year-to-year progress

• Are used to determine if students who remained within Level 1 or 2 had more than one year’s growth

Note: Retained students must move up a Level.

How much is more than one year’s growth on

the FCAT Developmental scale?

41

Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54

9 to 10 77 48

Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.

Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54

9 to 10 77 48

Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.

+ 1

42

Level 1

Level 1

Please, don’t panic!!!

The student report is showing learning gains.

44

Level 1Level 1

1376 –1238 =138 and 138> 48

Note:This 10th grade student stayed within Level 1, below the state mean, but demonstrated more than a year’s growth on the FCAT DSS.

Find the difference between the last two

DSS

Mathematics Passing Score is 300 or above/ DSS 1926 or above

45

Level 2Level 2Level 2

Level 2Level 2Level 2

Passed the Math testPassed the Math test

Did NOT pass the Reading testDid NOT pass

the Reading test

46

Reading Passing Score: 300 or above/ DSS 1926 or above

1856 – 1776 = 80 DSS; 80 > 77

This student stayed within Level 2, below the state’s mean, had more than a year’s growth from 9th to 10th; but, did NOT pass the Reading section).

Level 2Level 2 Level 2

Find the difference between the last two

DSS

47

Mathematics Passing Score: 300 or above/ DSS 1889 or above

1930 – 1883 = 47; 47 < 49This student stayed within Level 2, below the state’s mean in 8th and 10th (above in 8th) , DID NOT have a year’s growth from 9th to 10th; but, passed the Mathematics section.

Level 2Level 2 Level 2

Find the difference between the last two

DSS

48

Level 1 Level 2

49

3rd to 4th : 1291 - 996 = 295; 295 > 230 (YES)

4th to 5th : 1341 – 1291 = 50; 50 < 167 (NO)

This student stayed within Level 1, scored below the state’s means, made more than ONE year’s growth from 3rd to 4th grade, but NOT from 4th to 5th grade.

50

3rd to 4th : 1303 – 1083 = 220; 220 > 162 (YES)

4th to 5th : 1456 – 1303 = 153; 153 > 119 (YES)

This student stayed within Level 2, scored below the state’s means, made more than a year’s growth from 3rd to 4th and from 4th to 5th grade.

Grade Level

DSS Level Y/N

3 100 1 N/A

4 331 1 Y

5 498 1 Y

6 632 1 Y

7 743 1 Y

8 836 1 Y

9 914 1 Y

10 992 1 Y 10TH Passing Score:1926

Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54

9 to 10 77 48

Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.

Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54

9 to 10 77 48

Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.

+ 1

Is demonstrating more than a year’s growth on the FCAT developmental scale for SEVEN years enough to pass the test in 10th grade?

Angle # 1:

School Accountability Report

Compared to Standards

53

High Standards 50% of School Grade

Learning Gains 50% of School Grade

46 – 44 = +2

53 – 35 = +20

89 – 79 = +10

+32

53 - 61= - 8

77 - 72 = +5

44 - 53 = - 9

- 12

2004 School Accountability Report2004 School Accountability Report

NO Learning Gains in Third Grade

Angle # 2:

Gold Report

Compared to Self

1. Are your school’s demographic changing?

2. If yes, in what way(s) are they changing?

3. Is the percent of students in Level 1 decreasing or increasing ?

4. Is the percent of students at Level 3 and above decreasing or increasing?

From 47 to 29

From 35 to 25

From 36 to 28

52

66

48

20

12

23

2015

24

86

40

21

0 20 40 60 80 100

Third

Fourth

Fifth

Level 1 Level 2 Level 3 Level 4 Level 5

FCAT SSS Reading

Why?

52

64

46

27

20

34

1712

13

33

61

11

0 10 20 30 40 50 60 70 80 90 100

Third

Fourth

Fifth

Level 1 Level 2 Level 3 Level 4 Level 5

FCAT SSS Mathematics

Why?

Angle # 3:

School Comparison Graphs

Compared to Others

Previous Year Comparison Graphs

80% or higher

1. How many schools similar to your school earned more points meeting High Standards in Reading?

2. How many schools similar to your school earned more points meeting High Standards in Mathematics?

3. How many schools similar to your school earned more points meeting High Standards in Writing?

4. How many schools similar to your school earned more points making Learning Gains in Reading?

5. How many schools similar to your school earned more points making Learning Gains in in Mathematics?

6. How many schools similar to your school earned more points making Learning Gains with their Lowest 25% in Reading?

7. How many schools similar to your school earned more points than your school?

Angle # 4:

FCAT State Report of School Results

Compared to Others

73

1. How does your school percent of students at each FCAT level compare to the state and to other similar schools for each grade level?

Mean DSS Change

2. How does your school average DSS change compare to the state and to other similar schools for each grade level?

The nation is in “desperate” need of educators who have:

• A knowledgeable mind,

• A caring heart, and

• The ability to communicate.

What can teachers do in class to improve students performance on the FCAT?

1. Use questions that require students to explain their answers.

2. Have students apply their Reading and Mathematics skills using challenging content from all subjects

3. Use open-ended question formats that are similar to FCAT.

What can teachers do in class to improve students performance on the FCAT?

4. Rate and grade students’ work using FCAT rubrics so students can become familiar with WHAT IS EXPECTED OF THEM ON THE FCAT.

5. Use and develop questions for class discussions and tests that are the same cognitive rigor as those on the FCAT.

79

Final Activity: Fill in each of the above SIX area boxes with the points you expect your school to earn .

1. How many total points will your school earn ?

2. What performance school grade will your school receive?

Department of Research, Evaluation, and Accountability

Dr. Marc Baron, Chief of Performance Accountability

Nancy Brito, Instructional Specialist

561-357-7521, PX47521

briton@mail.palmbeach.k12.fl.us