understanding and improving your school grade. how is my school doing? ٭ compared to standards ٭...
TRANSCRIPT
Understanding and Improving Your School Grade
How is my school doing?
Compared to٭STANDARDS
Compared to SELF ٭
Compared to OTHERS ٭
Angle #1: The School Accountability Report
Compared to Standards
Angle # 2: Gold Report
Compared to Self
Angle # 3: School Comparison Graphs
Compared to Others
Angle # 4: FCAT 2003 SSS State
Report of School Results
Compared to Others
Four Different Reports/Four Different Angles
Understanding FCAT ReportsUnderstanding FCAT Reports
PART APART A
What is the purpose of FCAT?•Assess student achievement of
the Sunshine State Standards (SSS) benchmarks in Reading, Writing, Science, and Mathematics
•Compare the performance of Florida students with students across the nation using a norm-referenced test (NRT) in reading comprehension and mathematics problem solving
What kinds and how many FCAT Student Reports do schools receive?1. SSS - Reading and Mathematics (Grades 3-10)
2. NRT - Reading and Mathematics (Grades 3 – 10)
3. SSS - Writing (Grades 4, 8, & 10)
4. SSS - Science (Grades 5, 8, & 11)
5. SSS - Performance Task Questions (Grades 4, 5, 8, 10 & 11)
Which students are tested?
Most students, including limited English proficient (LEP) and exceptional student education (ESE) students, enrolled in the tested grade levels participate in the FCAT administration.
Special accommodations are available and provided to eligible ESE and LEP students.
What types of questions are on the FCAT?
• Students choose the best answer out
of four answer choices
• SSS and NRT
• All grades (3 - 11)
• 1 point each
• Scored by the computer
Multiple-choice questions
Gridded-response
• Students figure out a numeric answer and bubble it on a grid
• SSS Mathematics (Grades 5 – 10)
• SSS Science (Grades 8 and 11)
• 1 point each
• Scored by the computer
What types of questions are on the FCAT?
Performance Tasks•Students answer questions in their own words in reading
and show their solutions to mathematics questions or respond to science questions
Two Types:
˜ Short response: 5 min. (0, 1,or 2 pts.)
˜ Extended response: 10- 15 min. (0, 1, 2, 3, or 4 pts.)
•FCAT SSS
•Grades 4 (reading), 5 (mathematics), 8 (reading and mathematics) , 10 (reading and mathematics) and 11 (science)
•Scored by at least two people
What types of question are on the FCAT?
• Essay for an assigned topic (prompt)
• Grades 4, 8, and 10
• Expository or Narrative (Grade 4)
• Expository or Persuasive (Grades 8 and 10)
• The highest score is 6 points.
• Score reported is the average of two trained scorers’ scores.
What types of questions are on FCAT Writing?
• Note: Items are classified on the cognitive demand inherent in the test item, not on assumptions about the student’s approach to the item.
How are test questions classified on FCAT?
• Can be used to interpret trends in student performance
• Are used to report student scores so the scores reported from year to year can be compared
• Range from 100 – 500
What are scale scores?
100 Points 500 Points
What are the FCAT achievement levels?• Describe the success a student has achieved
on the Florida SSS Reading or Mathematics portion of the test
• Range from 1 to 5 with Level 1 the lowest and Level 5 the highest
• Are based on scale scores that range from 100 to 500
Level 1
Level 2
Level 3
Level 4
Level 5
Note: FCAT SSS Science Levels for grades 5, 8, and 11 will be reported beginning March 2006.
The FCAT Writing scoring is based on POINTS that range from 1 to 6.
15
16
• A type of scale score
• Used to determine a student’s annual progress from grade to grade
• Range from 86 - 3008
What are Developmental Scale Scores (DSS)?
On the Student Report the Developmental Scale Score is called the FCAT Score.
Grade Level 1 Level 2 Level 3 Level 4 Level 5
3 86-1045 1046-1197 1198-1488 1489-1865 1866-2514
4 295-1314 1315-1455 1456-1689 1690-1964 1965-2638
5 474-1341 1342-1509 1510-1761 1762-2058 2059-2713
6 539-1449 1450-1621 1622-1859 1860-2125 2126-2758
7 671-1541 1542-1714 1715-1944 1945-2180 2181-2767
8 886-1695 1696-1881 1882-2072 2073-2281 2282-2790
9 772-1771 1772-1971 1972-2145 2146-2297 2298-2943
10 844-1851 1852-2067 2068-2218 2219-2310 2311-3008
FCAT Achievement Levels and Developmental Scores
Reading
Grade Level 1 Level 2 Level 3 Level 4 Level 5
3 375-1078 1079-1268 1269-1508 1509-1749 1750-2225
4 581-1276 1277-1443 1444-1657 1658-1862 1863-2330
5 569-1451 1452-1631 1632-1768 1769-1956 1957-2456
6 770-1553 1554-1691 1692-1859 1860-2018 2019-2492
7 958-1660 1661-1785 1786-1938 1939-2079 2080-2572
8 1025-1732 1733-1850 1851-1997 1998-2091 2092-2605
9 1238-1781 1782-1900 1901-2022 2023-2141 2142-2596
10 1068-1831 1832-1946 1947-2049 2050-2192 2193-2709
FCAT Achievement Levels and Developmental Scores
Mathematics
What kind of information is included on the FCAT
SSS Reading and Mathematics Student
Report?
Year 2001 2002 2003Grade Tested 8 9 10
Achievement Level 3 3 4FCAT Score (DSS) 1924 1988 2218
Year 2001 2002 2003Grade Tested 8 9 10
Achievement Level 3 3 4FCAT Score (DSS) 1924 1988 2218
Content Area Points Possible Points EarnedWords/Phrases 9 8
Main Idea/Purpose 14 12Comparisons 13 10
Reference/Research 16 14
2003 Reading Content ScoresContent Area Points Possible Points Earned
Words/Phrases 9 8Main Idea/Purpose 14 12
Comparisons 13 10Reference/Research 16 14
2003 Reading Content Scores2003 Mathematics Content Scores
Content Areas Points Possible Points Earned
Number Sense 11 9
Measurement 10 7
Geometry 14 12
Algebraic Thinking
14 11
Data Analysis 11 10
FCAT SSS Content Scores Report
Note: This student passed the Reading section and scored above the state’s mean score for three years in a row.
What kind of information is included on the FCAT
NRT Reading and Mathematics Student
Report?
Scale Score National Percentile Rank StanineReading
Comprehension 732 78 7Mathematics
Problem Solving 762 96 9
Subject Scores
The NRT scores describe the student performance in relation to the performance of students throughout the nation.
•The National Percentile Rank indicates the percent of all students in the national sample who scored equal to or below the student’s score. They range from 1 to 99.
•Stanine scores divide the distribution of scores into nine equal parts (1 – 9) and are not as variable as percentile ranks.
Content Areas Report
What kind of information is included
on the FCAT SSS Science Student
Report?
Note: The score is a number between 100 and 500 (NO DSS)
Content Areas Points Possible Points Earned
Lowest Middle HighPhysical and Chemical 12 4 XEarth and Space 13 9 XLife and Environmental 13 11 XScientific Thinking 13 9 X
State ComparisonContent Areas Points Possible Points Earned
Lowest Middle HighPhysical and Chemical 12 4 XEarth and Space 13 9 XLife and Environmental 13 11 XScientific Thinking 13 9 X
State Comparison
FCAT Science Content Score334
HighestMiddleLowest
State ComparisonScore
100
150
200
250
300
350
400
450
500
Student's Score State Score
FCAT Science Score
FCAT SSS Science Student Report
What kind of information is included
on FCAT Writing Student Report?
29
PART BPART BUsing FCAT Reports to Improve Your School GradeUsing FCAT Reports to Improve Your School Grade
How are students’ FCAT scores used to calculate
schools’ performance grades?
Which students’ FCAT scores are used Which students’ FCAT scores are used to calculate the school performance to calculate the school performance grade?grade?
For High Standards
Standard curriculum (ESOL students more than 2 years and ESE students in hospital/homebound, gifted or speech impaired)
For Learning Gains
All students with current and prior FCAT scores (includes all LEP and ESE)
Grades 3 – 10
Enrolled in the same school, October and February
Sunshine Elementary School
School Accountability Report
How many points are How many points are needed for each school needed for each school performance grade?performance grade?
0 - 2790 - 279FF
280 - 319280 - 319DD
320 - 379320 - 379CC
380 - 409380 - 409BB
410 +410 +AA
3/6 - 50 % from Reading
2/6 - 33 % from Mathematics
1/6 - 17 % from Writing
R R R
M M
W
High Standards Learning Gains
M
R
R
W
M
R
3/6 - 50% 3/6 - 50%
Which FCAT scores count toward High Standards?
In Reading and MathematicsPercent scoring FCAT Levels 3
and above
In WritingPercent scoring “3.5” or higher
How can students demonstrate annual learning gains?
Improved FCAT Achievement Levels from one year to the next (i.e., 1-2, 2-3, 3-4, 4-5)
Maintained “satisfactory” Achievement Levels from one year to the next
(i.e., 3-3, 4-4, 5-5)
Remained within Levels 1 or 2 and demonstrated more than one year’s growth on the FCAT developmental scale
Note: Retained students in Levels 1 and 2 must improve by at least one level to demonstrate learning gains (i.e., 1-2, 2-3).
What are Developmental Scale Scores (DSS)?
• Range from 86 to 3008
• Are based on FCAT SSS student scale scores which range from 100 to 500
• Provide information whether a student has made year-to-year progress
• Are used to determine if students who remained within Level 1 or 2 had more than one year’s growth
Note: Retained students must move up a Level.
How much is more than one year’s growth on
the FCAT Developmental scale?
41
Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54
9 to 10 77 48
Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.
Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54
9 to 10 77 48
Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.
+ 1
42
Level 1
Level 1
Please, don’t panic!!!
The student report is showing learning gains.
44
Level 1Level 1
1376 –1238 =138 and 138> 48
Note:This 10th grade student stayed within Level 1, below the state mean, but demonstrated more than a year’s growth on the FCAT DSS.
Find the difference between the last two
DSS
Mathematics Passing Score is 300 or above/ DSS 1926 or above
45
Level 2Level 2Level 2
Level 2Level 2Level 2
Passed the Math testPassed the Math test
Did NOT pass the Reading testDid NOT pass
the Reading test
46
Reading Passing Score: 300 or above/ DSS 1926 or above
1856 – 1776 = 80 DSS; 80 > 77
This student stayed within Level 2, below the state’s mean, had more than a year’s growth from 9th to 10th; but, did NOT pass the Reading section).
Level 2Level 2 Level 2
Find the difference between the last two
DSS
47
Mathematics Passing Score: 300 or above/ DSS 1889 or above
1930 – 1883 = 47; 47 < 49This student stayed within Level 2, below the state’s mean in 8th and 10th (above in 8th) , DID NOT have a year’s growth from 9th to 10th; but, passed the Mathematics section.
Level 2Level 2 Level 2
Find the difference between the last two
DSS
48
Level 1 Level 2
49
3rd to 4th : 1291 - 996 = 295; 295 > 230 (YES)
4th to 5th : 1341 – 1291 = 50; 50 < 167 (NO)
This student stayed within Level 1, scored below the state’s means, made more than ONE year’s growth from 3rd to 4th grade, but NOT from 4th to 5th grade.
50
3rd to 4th : 1303 – 1083 = 220; 220 > 162 (YES)
4th to 5th : 1456 – 1303 = 153; 153 > 119 (YES)
This student stayed within Level 2, scored below the state’s means, made more than a year’s growth from 3rd to 4th and from 4th to 5th grade.
Grade Level
DSS Level Y/N
3 100 1 N/A
4 331 1 Y
5 498 1 Y
6 632 1 Y
7 743 1 Y
8 836 1 Y
9 914 1 Y
10 992 1 Y 10TH Passing Score:1926
Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54
9 to 10 77 48
Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.
Grade Level Change Reading Mathematics3 to 4 230 1624 to 5 166 1195 to 6 133 956 to 7 110 787 to 8 92 648 to 9 77 54
9 to 10 77 48
Students achieving within Level 1 (or within Level 2) for two consecutive years must gain at least one point more than those listed in this table in order to satisfy the "making annual learning gains" component of the school accountability system.
+ 1
Is demonstrating more than a year’s growth on the FCAT developmental scale for SEVEN years enough to pass the test in 10th grade?
Angle # 1:
School Accountability Report
Compared to Standards
53
High Standards 50% of School Grade
Learning Gains 50% of School Grade
46 – 44 = +2
53 – 35 = +20
89 – 79 = +10
+32
53 - 61= - 8
77 - 72 = +5
44 - 53 = - 9
- 12
2004 School Accountability Report2004 School Accountability Report
NO Learning Gains in Third Grade
Angle # 2:
Gold Report
Compared to Self
1. Are your school’s demographic changing?
2. If yes, in what way(s) are they changing?
3. Is the percent of students in Level 1 decreasing or increasing ?
4. Is the percent of students at Level 3 and above decreasing or increasing?
From 47 to 29
From 35 to 25
From 36 to 28
52
66
48
20
12
23
2015
24
86
40
21
0 20 40 60 80 100
Third
Fourth
Fifth
Level 1 Level 2 Level 3 Level 4 Level 5
FCAT SSS Reading
Why?
52
64
46
27
20
34
1712
13
33
61
11
0 10 20 30 40 50 60 70 80 90 100
Third
Fourth
Fifth
Level 1 Level 2 Level 3 Level 4 Level 5
FCAT SSS Mathematics
Why?
Angle # 3:
School Comparison Graphs
Compared to Others
Previous Year Comparison Graphs
80% or higher
1. How many schools similar to your school earned more points meeting High Standards in Reading?
2. How many schools similar to your school earned more points meeting High Standards in Mathematics?
3. How many schools similar to your school earned more points meeting High Standards in Writing?
4. How many schools similar to your school earned more points making Learning Gains in Reading?
5. How many schools similar to your school earned more points making Learning Gains in in Mathematics?
6. How many schools similar to your school earned more points making Learning Gains with their Lowest 25% in Reading?
7. How many schools similar to your school earned more points than your school?
Angle # 4:
FCAT State Report of School Results
Compared to Others
73
1. How does your school percent of students at each FCAT level compare to the state and to other similar schools for each grade level?
Mean DSS Change
2. How does your school average DSS change compare to the state and to other similar schools for each grade level?
The nation is in “desperate” need of educators who have:
• A knowledgeable mind,
• A caring heart, and
• The ability to communicate.
What can teachers do in class to improve students performance on the FCAT?
1. Use questions that require students to explain their answers.
2. Have students apply their Reading and Mathematics skills using challenging content from all subjects
3. Use open-ended question formats that are similar to FCAT.
What can teachers do in class to improve students performance on the FCAT?
4. Rate and grade students’ work using FCAT rubrics so students can become familiar with WHAT IS EXPECTED OF THEM ON THE FCAT.
5. Use and develop questions for class discussions and tests that are the same cognitive rigor as those on the FCAT.
79
Final Activity: Fill in each of the above SIX area boxes with the points you expect your school to earn .
1. How many total points will your school earn ?
2. What performance school grade will your school receive?
Department of Research, Evaluation, and Accountability
Dr. Marc Baron, Chief of Performance Accountability
Nancy Brito, Instructional Specialist
561-357-7521, PX47521