Post on 01-Jan-2016
Embed Size (px)
DESCRIPTIONReflective Assessments. Value-Added Reports. Diagnostic Reports – the whiskers. Diagnostic Reports Looking for Patterns. School Diagnostic Shed Pattern. School Diagnostic Reverse Shed Pattern. School Diagnostic Tent Pattern. School Diagnostic V Pattern. - PowerPoint PPT Presentation
Reflective AssessmentsParticipants should go to the EVAAS wiki. Under the agenda section have users click on the reflective assessments link. Files to support this portion of the presentation can be found there.1Value-Added Reports
Use to evaluate the overall effectiveness of a school on student progress. Compares each school to the average school in the state. Comparisons are made for each subject tested in the given year and indicate how a school influences student progress in those subjects.
Has to be more than -1.8 to be below; more than 2 standard errors to be above.
(Provide definition of value-added.)
Some things to note are that like students are in a subgroup.Show how to read the report. Explain that 0 is the equivalent of one year of growth. Looking at the bottom of the page at the green, yellow, and red descriptors. Explain that there is a blue descriptor when there is not enough data to make a distinction.
If your LEA uses DIBELS, the reports have similarities in design with the colors.
Have the participants look at the data and talk about how you can see here.Look at trends in the same grade.Look at the students that moved from 6th grade in 2011 to 7th grade in 2012 and to 8th grade in 2012. Talk about what you can take a way from this report.2Diagnostic Reports the whiskers
In this diagram, the two bars have the same height, but the whiskers extend to different lengths. On the left, the whiskers lie completely below the green line, so the group represented by the bar made less than average progress (). On the right, the whiskers contain the green line, so the group represented by the bar made average progress (-). The red whisker represents the confidence interval due to the standard error for the mean. There is a high probability that the actual mean falls somewhere within the Whiskers. The size of the confidence interval is determined by the sample size. The larger number of data points the smaller the standard error, smaller the whisker, and therefore the confidence interval. If the whisker passes over the green line (reference line),the data shows expected growth since there is a chance the mean is actually on the other side of the green line. It is not certain that the teacher is exclusively above or below the reference line, if the whisker crosses the green reference line. 3Diagnostic Reports Looking for Patterns
In this school, some subgroups of students are not making sufficient gain. Students in the lowest subgroups have not made sufficient progress while high achieving students are making excellent gain. The lack of appropriate progress among low achieving students is a pattern that has been repeated from previous years, indicating a persistent lack of effectiveness with lower achieving students.
This is one of the most intriguing components of EVAAS.
Common Diagnostic Patterns activity
*Pattern Slides are on wiki4School DiagnosticShed Pattern
In this example, the lowest achieving students are making sufficient progress. Students at an average achievement level are making expected progress.However, the highest achieving students appear to be losing ground. Teachers and administrators will want to find ways to create more progress opportunities for high achieving students.
5School DiagnosticReverse Shed Pattern
In this example, high achieving students are making excellent progress.Students who are average in achievement also are making sufficient progress. In contrast, the lowest achieving students are not making as much progress as they should. A pattern like this one will widen the achievement gap. Teachers and administrators should consider how to help lower achieving students gain more ground. 6School DiagnosticTent Pattern
In this example, the students in the middle of the achievement distribution are making sufficient progress, but both lower achieving and higher achieving students are falling behind their peers.In this case, teachers and administrators will want to consider both how to support low-achieving students and how to challenge high-achieving students.
7School DiagnosticV Pattern
In this example, the opposite of the Tent Pattern, only the lowest and the highest achieving students are making good progress. Students in between have not had enough opportunities for academic growth.
8School DiagnosticOpportunity Gap Pattern
In this example, the students in every achievement group are making sufficient progress in the most recent year, except for the second group. Teachers and administrators will want to consider how to adjust the classroom instruction to meet these students needs. In addition, what approaches that are successful with the lowest achieving students could be expanded to include students in the second achievement group?
9What would an ideal pattern on a Diagnostic Report look like for closing the achievement gap?
Have participants draw an ideal pattern
On index card, make a box with 1-5 at bottom. Draw the ideal diagnostic report; discuss
Ideal to narrow the achievement gap: 1 is highest, descending to 5
Common Diagnostic Patterns activity look at common patterns; taking turns, explain the pattern to your partner10Diagnostic Reports Desirable Pattern
Print and handout this slide for the next activity on drawing a desirable pattern or have participants use plain paper. 11Diagnostic Report Desirable Pattern
In this example, all bars above the green line indicating the district was highly effective with students in all achievement groups. Additionally, students in the lowest quintile made more progress than students in the other quintiles. Effectively, these students are starting to catch up with their peers; the gap is closing because they are increasing their performance more than a years worth of growth. 12Diagnostic & Performance Diagnostic Reports (Part 2)Overview of School Effects (sample data)
Place activity instructions on the wiki.
Use the Value-Added and Diagnostic reports to complete the table. Navigate to a Value-Added Report and enter the Tested Subject/Grade name in the Overview of School Effectiveness table below. Locate the color for the most recent year. If the color is RED, place an X in the Overall Results column. Use a separate row for each grade for EOG reporting.If your school tests in both EOG and EOC subjects, record the EOG subjects and grades and then choose EOC from the Tests tab.For each test, subject, and/or grade, note the color for the most recent year. If the color is RED, place an X in the Overall Results column.
14Overview of School Effects (sample data)
Drill down to the Diagnostic Report for each Tested Subject/Grade. Locate the blue bars on the graph for each of the 5 Achievement Groups. Also note the red whiskers. For any blue bars above the green line (where the whiskers are also completely above), place an up arrow () in the appropriate cell of the Overview of School Effectiveness table. For any blue bars below the green line (where the whiskers are also completely below), place a down arrow () in the table. For any blue bars at or near the green line (the whiskers cross the green line), place a horizontal dash () in the table. 15Overview of School Effects (sample data)
These documents will be uploaded to the wikiAn extra set of sample data has been loaded on the wiki if participants cant log into EVAAS 16Overview of School Effects (sample data)
These documents will be uploaded to the wiki17Overview of School Effects (sample data)
These documents will be uploaded to the wiki
18Overview of School Effects (sample data)
Double check for correct answers19
1. Go to the websitewww.ncdpi.sas.comCopyright 2010, SAS Institute Inc. All rights reserved.20
1. Go to the website ncdpi.sas.comCopyright 2010, SAS Institute Inc. All rights reserved.21
1. Go to ncdpi.sas.com2. BOOKMARK IT!3. Secure & ConvenientOnline LoginCopyright 2010, SAS Institute Inc. All rights reserved.22Do you see this?
Then Sit Tight!
Copyright 2010, SAS Institute Inc. All rights reserved.23Overview of School EffectsIts Your Turn!Find the blank table.
Do this by yourself.Using sample dataFill in your table.
Participants will examine sample data located on wiki site to complete this activity.Locate the blue bars on the graph for each of the 5 Achievement Groups. Also note the red whiskers. For any blue bars above the green line (where the whiskers are also completely above), place an up arrow () in the appropriate cell of the Overview of School Effectiveness table. For any blue bars below the green line (where the whiskers are also completely below), place a down arrow () in the table. For any blue bars at or near the green line (the whiskers cross the green line), place a horizontal dash () in the table.
24Overview of School EffectsWhat did you find?Interesting PatternsInsightsAreas of ConcernAreas of CelebrationThis is a sharing activity Think-Pair-Share, TTP, Tea Party, etc.25
1. Go to the website ncdpi.sas.comLog back in.Copyright 2010, SAS Institute Inc. All rights reserved.26
Finding Your Patterns
Have participants find their school or a school in their district.Identify the patterns for your subjects and grade levelsPatterns and explanations can be located on the wiki in the Reflective Assessments portion of the agenda.
27Interpreting Your Results
Complete the Interpreting Your Results downloadable take home form on the Wiki.Have participants go to the Reflective Assessments section of the wiki and download the Interpreting Your Results documents.