PowerPoint Presentation

Standardized AssessmentsSPE 501-Class 4Jaime Zurheide

TopicsBasics of standardized assessments, comparing different typesEvaluating standardized assessmentsreliability and validityAdministering standardized assessmentsScoring standardized assessmentsreporting scores, normal distributionAccommodations for standardized assessments

Important TermsStandardized assessmentNorm-referenced testCriterion referenced testRaw scoreStandard scoreStaninePercentilePercentile rankMeanMedianModeStandard deviationConfidence intervalGrade/age equivalentStandard error of measurement

What are standardized assessments?Also known as Formal AssessmentsDesigned by people who are experts in test construction and distributed by companiesTest administration kept consistent ObjectiveStrict standards for scoringOften multiple choice

Formal vs. Informal AssessmentsFormal (standardized) assessments compare student performance with others who took the same test. Informal assessments used to evaluate student performance related to classroom instruction.

Types of Formal assessmentsAptitudeused to predict performance in the future (ex. ACT, IQ tests)Achievementused to evaluate academic skills (ex. ISAT) Reasons for administering achievement tests:Determine eligibility for special educationIdentify students in need of supportCompare students across schools, districts, etc.Evaluate schools, teachers, curriculum, etc.

Norm vs. Criterion ReferencedNorm-referenced assessments compare students with others who took the test. This group is called the norm or reference group.Criterion-referenced assessments compare students with a pre-determined set of skills. These tests do not compare students with each other but focus on describing a individual students academic performance.

Evaluating Standardized TestsAll forms of assessment should be reliable and valid.Reliability refers to the consistency of the test results, or how likely it is that a person will get the same score each time the test is taken.Validity refers to the extent of which a test measures what it is intended to measure.

It is also important to consider who is the in the norming group. How do the characteristics (i.e. race, gender, geographic region) of the population used as the norming sample compare with your population of students

ReliabilityHow reliability is judged:Test-retest: give a the same test at two different timesAlternate form: give two versions of the testSplit-half: break test into two sections Interrater: have two different people score a test (only works for tests that involve ratings of performance, i.e. not multiple choice)A test can be reliable w/out being valid, but not valid w/out being reliable.

ValidityContent validity How well a tests items reflect a particular body of knowledge and skillEx. Does the math section on the 3rd grade ISAT reflect what is covered in 3rd grade math?Predictive validity How well a test predicts a students future behaviorEx. How well does the ACT predict college success?Construct validity How well a test measures some internal attribute of a person Ex. If a test is measuring student verbal reasoning, how is that term defined/measured?

Administering Formal AssessmentsConsiderationsWhat type of test should be used? What is the goal of testing?How will the test be administered? In a group or individually? Room/desk set up?Who will administer the test? Qualifications or training needed?How will you evaluate the students test behavior?

*see book for more info

Basal and Ceiling LevelsUsed to determine difficulty level appropriate for studentsBasal levelcorrect responses needed at one level to move to the next (ex. Need to get a least three words correct on the 4th grade list before moving to the 5th.)Ceiling levelincorrect responses needed to stop the test (ex. Once a student gets 3 words in a row incorrect, stop testing.)

Reporting ScoresWays to report scores on standardized tests:Raw scoreStandard/scale scorePercentileStanineConfidence intervalsCut scores

Helpful TermsMeanaverage score (*used the most)Medianthe middle scoreModethe score the occurs the most oftenStandard deviationhow far each score deviates from the mean

Ex: Given scores of 60, 78, 80, 80, 85, 92, 96Mean = 81.6Median = 80Mode = 80

The Normal CurveThe normal distribution is a distribution of scores that are distributed evenly around the mean score. It describes many naturally occurring physical and social phenomena. Many scores will cluster around the mean. Fewer scores fall at the end points or at the higher and lower occurrences.Sometimes referred to as a bell curve

Properties of the Normal DistributionThe mean is the midpoint of the distribution.The mean, the median, and the mode are all at the same point.68% of all scores are located in the area of plus or minus one standard deviation from the mean.About 16% of the scores are higher or lower than one standard deviation above the mean.Only 2% of the scores are more than two standard deviations above or below the mean.

Example: If you scored 700 on the SAT math test, you did well, because only about 2% of the people who take the test make that score.

The Normal Distribution

Raw ScoreThe number of questions answered correctly Always reference the Number of Items (questions) when interpreting the raw scoreNever try to interpret raw scores across subtests or between tests because the subtests & tests differ in difficulty and in the number of questions askedExample: The CPS reading benchmark gives raw scores out of 45

Standard ScoreAlso sometimes called a scaled scoreWay of converting raw scores to a number that makes more sense (i.e. does not take into account the number of items)Uses the mean and standard deviation to convert scoresMany tests use standard scores with a mean of 100 and a SD of 15 (ex. IQ tests100 is average)

Percentile RankThese scores show the percentage of students in a normed sample who score at, below, or above a particular raw score.A student scoring better than three-fourths of the students in the normed sample would be at the 75th percentile or have a percentile rank of 75. A percentile rank of 50 means the student scored as well, or better than, 50% of the students in the normed sample.Different from % correct. Percents are only used with raw scores.

Normal Curve

StanineDivides the normal curve into 9 sections. Range from stanine 1 (lowest) to stanine 9 (highest)

Grade Equivalent Scores (GE)GE scores are obtained from separately normed samples for each grade level.They are reported in numbers such as 3.8, 5.4, 11.2. The whole number equals the grade and the decimal the month. GE scores are often misleading and misinterpreted. For example, if a 7th grade student has a GE of 10, should he be promoted to the 10th grade? Certainly not. This score means that the 7th grade student scored similar to what a 10th grade student would have scored on that same test. Different forms of the test are used at different grade levels, so this student may not have had to answer all of the items given to the 10th grader. The high scores may simply represent superior mastery of material at the 7th grade level. Most educators and psychologist prefer not to use GE scores in reporting scores.

Confidence IntervalThis is a standard error band within which a students score can fall.It is based on the standard error of measurement, and is an estimation made by test developers who take into consideration how much a students score would vary over repeated testing sessions.You might see this as a shaded area surrounding a graph of scores

Cut ScoresSome tests use cut scores to divide students into classification groupsCut scores are normally use the standard/scale score instead of percentilesFor example, on the 3rd grade ISAT for reading:120-155 = Academic warning156-190 = Below Standards191-226 = Meets Standards227-329 = Exceeds Standards

Accommodations for TestingAccommodation is defined as: any change in testing materials or procedures that enables students to participate in assessments so that their abilities, rather than their disabilities, are assessed. -Salvia & Ysseldyke (2007)

Types of Accommodations5 general types:Presentation (repeat directions, read aloud)Response (mark answers in book, point to answers)Setting (study carrel, separate room)Timing (extended time, frequent breaks)Scheduling (2 sessions, multiple days)

Accommodations for Standardized TestsMay not be the same as accommodations used for classroom assessments. Different accommodations are allowed for different tests.For a student to receive accommodations on standardized tests they must be listed in the IEP and have been used previously by the student (Ex. You cant create new accommodations just for the ISAT if a student hasnt used them in classroom assessments)

For more informationISBE info on standardized tests: http://www.isbe.state.il.us/assessment/ Iowa Testing Program, interpreting scores: http://www.education.uiowa.edu/itp/itbs/itbs_interp_score.aspxInformation about tests for parents (good review of info): http://www.pbs.org/wgbh/pages/frontline/shows/schools/etc/guide.html