introduction to nonbiased assessment of multicultural students with language impairment

42
•INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Upload: jett

Post on 06-Jan-2016

37 views

Category:

Documents


3 download

DESCRIPTION

INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT. I. DIAGNOSTIC PIE**. Language is a system of symbols used to represent concepts formed through exposure and experience Students’ experiences may differ from mainstream school expectations - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Page 2: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• There are a lot of demonstrations on my youtube channel

• Just go to youtube and type in Celeste Roseberry—demo videos are there

Page 3: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

I. DIAGNOSTIC PIE**• Language is a system of symbols used to

represent concepts formed through exposure and experience

• Students’ experiences may differ from mainstream school expectations

• If teachers refer ELL students for testing, there may be a difference, not disorder, because of experiential differences

• LI=disorder in both L1 and English!!

Page 4: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

4 quadrants in the “Diagnostic Pie”** (p. 248)

• Quadrant 1==normal ability, adequate background

• Quadrant 2==normal ability, limitations of linguistic experience, environmental exposure

• Quadrant 3==LI, adequate background

• Quadrant 4==LI, limitations of linguistic experience, environmental exposure

Page 5: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Dr. Ron Gillam (CSHA)

Page 6: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

II. INDICATORS OF LI

Page 7: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 8: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

III. LEGISLATION: IDEA 2004**

• We must evaluate in a nondiscriminatory manner

• Tests must be administered in most proficient communication mode

• Testing cannot reflect limited English; must reflect child’s ability in area tested

Page 9: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• The IDEA does not require that standardized measures are used**

• Traditionally, many special educators have used standardized tests because they believe that a quantitative score is mandated by federal law; however, the law does not exclude subjective or qualitative measures. It leaves the choice of measurement tools and criteria to the educator.

Page 10: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 11: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 12: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

IV. PRE-EVALUATION PROCESS**

• Before doing formal testing, it is extremely important to carry out the following:

– 1. Language proficiency testing– 2. Ethnographic interviewing and case history– 3. Teacher evaluation of student’s classroom

performance

Page 13: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Language Proficiency Testing**

• Primary language?

• Dominant language?

• Interview parents, teachers, interpreters who have worked with the student

Page 14: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 15: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Be careful of the label “English Proficient”

Page 16: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Youtube video: **

• Channel Celeste Roseberry

• Assessment of ELLs with Language Impairment: Gathering Case History Through Interviews

• http://www.youtube.com/watch?v=X2myRI8XZ0g

Page 17: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

V. TESTING IN THE PRIMARY LANGUAGE**

• Problem: great heterogeneity within languages (dialects)

• Problem: Limited data on normal development in other languages

• Problem: Differences in vocabulary and linguistic knowledge bases of students who immigrate vs. those born and raised in U.S.

Page 18: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 19: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

NEVER Translate an English test into the child’s L1 and use the norms:

Page 20: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VI. SELECTING ASSESSMENT INSTRUMENTS

• A. Appropriateness of Test Content

• *Many potentially unfamiliar items

Page 21: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• B. Adequacy of norms

• C. Possible Examiner Bias

Page 22: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

D. Possible Situational Bias

Page 23: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

E. Possible Format Bias (types of test items)

Page 24: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 25: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

F. Possible Value Bias**

• Example: Test of Problem-Solving Skills-Revised—”What should she do now?”

• Preschool Language Scale—”Why do you brush your teeth?” African American children in some communities “Because my momma told me to.” (scored as incorrect; correct answer is “because you get cavities if you don’t”)

Page 26: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VII. NONBIASED ASSESSMENT: CONSIDERATIONS IN STANDARDIZED

TESTING**• A. Introduction

• Standardized, formal tests are commonly used with ELL students

• Many speech-language pathologists and other special educators operate from the belief that we must always obtain quantitative data such as percentile ranks and standard deviations

• However, the IDEA permits the use of qualitative, subjective measures which we will discuss more in the next section

Page 27: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

**The Native Americans have a

saying: When you are riding a horse and it dies, dismount--and find a new one. But

many of us keep wanting to revive the

old horse of standardized testing with ELL students.

Page 28: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Typical referral and assessment procedures** (p. 255)

Page 29: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

B. Pitfalls of using Standardized Tests with ELL Students—Formal Test Assumptions**

• There are very few standardized tests in most languages

• Most standardized tests are developed from a Western, literate, middle class framework

Page 30: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

These tests assume that students will:

Page 31: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

They also assume that students will:

Page 32: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Bias in Standardized Testing: Potentially Unfamiliar Items**

• Household objects• Vehicles• Sports• Musical instruments • Types of clothing• Professions/occupations• Historically related events and people• Foods• American nursery rhymes• Geography• Games

Page 33: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

An ELL student may not recognize things like American fruits and vegetables**

Page 34: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

In many countries, soccer is called football**

Page 35: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Holidays and seasons differ from country to country**

Page 36: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

Many immigrant and refugee students are unfamiliar with items

involving snow…**

Page 37: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

VIII. Modifying Standardized Tests

Page 38: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

• Give the student extra time to respond**

• If the student gives a “wrong” answer, ask her to explain it and record her explanation; score it as correct if it would be correct in her culture

• Repeat items when necessary

Page 39: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

I will often have 2 columns: **• First attempt Second attempt

–- +–- +–- -–- +–- --–-- +

Page 40: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

What I don’t want to see: **• First attempt Second attempt

- - -- - -- - -- - -- - -

Page 41: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT
Page 42: INTRODUCTION TO NONBIASED ASSESSMENT OF MULTICULTURAL STUDENTS WITH LANGUAGE IMPAIRMENT

IX. CONSIDERATIONS IN TEST INTERPRETATION**

Don’t identify a student based solely on formal test scores

Ascertain if the student’s errors are typical of other students with similar backgrounds

Interpret overall results as a team

In assessment reports, include disclaimers about departure from standard testing procedures