overview assessment consultant [email protected] overview tammy l. stephens, ph.d....

49
Overview Overview Tammy L. Stephens, Ph.D. Assessment Consultant Assessment Consultant [email protected] [email protected]

Upload: jeffrey-dalton

Post on 23-Dec-2015

229 views

Category:

Documents


0 download

TRANSCRIPT

OverviewOverview

Tammy L. Stephens, Ph.D.Assessment ConsultantAssessment Consultant

[email protected]@pearson.com

2 | Copyright © 2012. All rights reserved.

ObjectivesObjectives

• Revision Goals

• Discuss the structural changes from the WPPSI-III to the WPPSI-IV

• Review New and Revised Subtests

• Score Generation & Interpretation

3 | Copyright © 2012. All rights reserved.

WPPSI: A Historical WPPSI: A Historical PerspectivePerspective

WPPSI WPPSI 19671967

WPPSI-RWPPSI-R 19891989

WPPSI-III WPPSI-III 20032003

WPPSI-IV WPPSI-IV 20122012

4 | Copyright © 2012. All rights reserved.

WPPSI-III to WPPSI-IVWPPSI-III to WPPSI-IVRevision GoalsRevision Goals

• Update theoretical foundations

• Increase developmental appropriateness

• Increase user friendliness

• Improve psychometric properties

• Enhance clinical utility

5 | Copyright © 2012. All rights reserved.

5

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Update Theoretical Update Theoretical FoundationsFoundations• Increase breadth of construct coverage

– Develop new working memory subtests– Develop new inhibitory control subtest

• Revise composite terminology– Replace VIQ, PIQ, & PSQ with index scores – Add Working Memory Index (WMI)– Evaluate Fluid Reasoning Index (FRI)– Evaluate General Ability Index (GAI)

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

6 | Copyright © 2012. All rights reserved.

Processing Speed SubtestsProcessing Speed Subtests

Subtest Changes from WPPSI-III

7 | Copyright © 2012. All rights reserved.

On the new Processing Speed subtest,

Bug Search, the child marks the bug in

the search group that matches the

target bug.

What does the child use to mark the

bug?

8 | Copyright © 2012. All rights reserved.

8

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Enhance Clinical UtilityEnhance Clinical Utility• Extend age range upward to 7:7

• Update validity studies– Update clinical validity/special group studies– Add NEPSY-2 validity study– Appropriate concurrent validity measures

• Score difference comparisons more specific

• Decreased expressive language requirements

9 | Copyright © 2012. All rights reserved.

Special Group StudiesSpecial Group StudiesIntellectually Gifted

Intellectual Disability-Mild Severity

Intellectual Disability-Moderate Severity

Developmental Delay-Cognitive

Developmental Risk Factors

Attention-Deficit/Hyperactivity Disorder

Disruptive Behavior

Expressive Language Disorder

Mixed Receptive-Expressive Language Disorder

Emergent Pre-Literacy Concerns

9 | Copyright © 2012. All rights reserved.

10 | Copyright © 2012. All rights reserved.

10

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Improve Psychometric Improve Psychometric PropertiesProperties• Update normative information

• Extend subtest floors & ceilings• Evaluate item bias

– Iterative psychometric analyses– Qualitative reviews by experts

• Test structure changes• More options for significance levels

– Enhances S/W analysis

11 | Copyright © 2012. All rights reserved.

Total n = 1,700− n = 600 for ages 2:6-3:11− n = 1,100 for ages 4:0-

7:7

WPPSI-IV Normative SampleWPPSI-IV Normative Sample

Nationally stratified sample− Age− Sex/Gender− Race/Ethnicity − Parent education level (5 levels) − Geographic Region (NE, S, MW,

W)

12 | Copyright © 2012. All rights reserved.

Internal Consistency ReliabilityInternal Consistency Reliability

Average Reliability Coefficient

Composite

2:6-3:114:0-7:7

VCI .94 .94

VSI .89 .89

FRI -- .93

WMI .93 .91

PSI -- .86

FSIQFSIQ .96.96 .96.96

VAI .94 .93

NVI .94 .95

GAI .95 .95

CPI -- .92

13 | Copyright © 2012. All rights reserved.

Average Administration Times Average Administration Times by Age – Primary Index Scores by Age – Primary Index Scores

and FSIQand FSIQ

13

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

2:6 to 2:11

3:0 to 3:11

4:0 to 4:11

5:0 to 5:11

6:0 to 6:11 7:0 to 7:7

PIndex 29 35 60 62 60 58

FSIQ 24 29 31 32 31 31

14 | Copyright © 2012. All rights reserved.

14

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Increase User FriendlinessIncrease User Friendliness• Simplify instructions to

child– Reduce verbosity &

vocabulary level – Demonstrate, practice,

and teach the task • Replace plastic puzzle

box– Similar to block box– Separate box holds

animal cards and dauber• Provide post publication

training

Structure®

16 | Copyright © 2012. All rights reserved.

WPPSI-III WPPSI-III (2003)(2003)• Two batteries:

– Ages 2:6−3:11

– Ages 4:0−7:3

• Composite scores:

– Full Scale IQ (FSIQ)

– Verbal IQ (VIQ)

– Performance IQ (PIQ)

– Processing Speed Quotient (PSQ)

– General Language Composite (GLC)

17 | Copyright © 2012. All rights reserved.

WPPSI-IV WPPSI-IV (2012)(2012)

Core SubtestsCore Subtests

Supplemental Supplemental SubtestsSubtests

Optional SubtestsOptional Subtests

18 | Copyright © 2012. All rights reserved.

19 | Copyright © 2012. All rights reserved.

20 | Copyright © 2012. All rights reserved.

Subtest Changes from WPPSI-Subtest Changes from WPPSI-IIIIII

• Dropped Word Reasoning & Picture Completion

• Revised retained subtests

– New items include picture items on Similarities and Comprehension, and a new puzzle for Object Assembly

• Replaced Processing Speed subtests Processing Speed Subtests

– Bug Search & Animal Coding

– Added Cancellation

• New Working Memory subtests

– Picture Memory

– Zoo Locations

21 | Copyright © 2012. All rights reserved.

21

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Subtest Modifications Subtest Modifications

Subtest New AdministrationRecording & Scoring

New Items

Vocabulary Information Similarities Comprehension Receptive Vocabulary Picture Naming Block Design Object Assembly

22 | Copyright © 2012. All rights reserved.

22

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.

Subtest Modifications Subtest Modifications (continued)(continued)

Subtest New AdministrationRecording & Scoring

New Items

Matrix Reasoning Picture Concepts Bug Search Animal Coding Cancellation

23 | Copyright © 2012. All rights reserved.

WPPSI-IV KitWPPSI-IV Kit

24 | Copyright © 2012. All rights reserved.

SubtestsSubtests

25 | Copyright © 2012. All rights reserved.

Subtest Substitution*Subtest Substitution*Age Band

Composite Score

Core Subtest Allowable Substitution

2:6-3:11

FSIQ

Receptive VocabularyInformationBlock DesignObject AssemblyPicture Memory

Picture Naming———

Zoo Locations

NVI

Block DesignObject AssemblyPicture MemoryZoo Locations

————

GAI

Receptive VocabularyInformationBlock DesignObject Assembly

Picture Naming———

*Only one substitution is allowed for each listed composite score.

26 | Copyright © 2012. All rights reserved.

Subtest Substitution*Subtest Substitution*Age Band

Composite Score

Core Subtest Allowable Substitution

4:0-7:7

FSIQ

Information

Similarities

Block Design

Matrix

Reasoning

Picture Memory

Bug Search

Vocabulary or

Comprehension

Vocabulary or

Comprehension

Object Assembly

Picture Concepts

Zoo Locations

Cancellation or Animal

Coding

NVI

Block Design

Matrix

Reasoning

Picture

Concepts

Picture Memory

Bug Search

Object Assembly

Zoo Locations

Cancellation or Animal

Coding

*Only one substitution is allowed for each listed composite score.

27 | Copyright © 2012. All rights reserved.

Subtest Substitution*Subtest Substitution*Age Band

Composite Score

Core Subtest Allowable Substitution

4:0-7:7

GAI

Information

Similarities

Block Design

Matrix

Reasoning

Vocabulary or

Comprehension

Vocabulary or

Comprehension

Object Assembly

Picture Concepts

CPI

Picture

Memory

Zoo Locations

Bug Search

Cancellation

Animal Coding

Animal Coding*Therefore, only one substitution is allowed for each listed composite score.

28 | Copyright © 2012. All rights reserved.

General Testing GuidanceGeneral Testing Guidance

• Teaching items

• Demonstration items

• Sample Items

28

29 | Copyright © 2012. All rights reserved.

Verbal SubtestsVerbal Subtests

SubtestSubtest Ages Ages 2:6-3:112:6-3:11

Ages Ages 4:0-7:74:0-7:7

Information C C Receptive Vocabulary

C O

Picture Naming S O

Similarities C

Vocabulary S

Comprehension S

30 | Copyright © 2012. All rights reserved.

Information (IN)Information (IN)• Core Verbal Comprehension subtest

for ages 2:6–7:7. • Consists of 29 items: 4 picture items

and 25 verbal items. • All 4 picture items are retained, and

12 verbal items are retained with little or no change in wording. There are 13 new verbal items.

• Scoring criteria for all retained verbal items were revised.

31 | Copyright © 2012. All rights reserved.

IN: DescriptionIN: Description

Picture Items Verbal Items

The child selects the pictures that best answer questions about general-knowledge topics.

The child verbally answers questions about a broad range of general-knowledge topics.

The Information subtest measures ability to acquire, retain, and retrieve general factual knowledge.

32 | Copyright © 2012. All rights reserved.

Receptive Vocabulary (RV)Receptive Vocabulary (RV)• Receptive Vocabulary is a Verbal

Comprehension subtest for ages 2:6–7:7.

• Receptive Vocabulary has 31 items.

• A total of 23 items are retained from WPPSI-III, and 8 are new.

33 | Copyright © 2012. All rights reserved.

RV: DescriptionRV: Description

The child selects the picture that best represents the word the examiner reads aloud.

RV measures receptive language ability and language development.

34 | Copyright © 2012. All rights reserved.

Picture Naming (PN)Picture Naming (PN)• Verbal Comprehension subtest for

ages 2:6–7:7.

• Picture Naming has 24 items.

• A total of 20 items are retained from WPPSI-III, and 4 are new.

35 | Copyright © 2012. All rights reserved.

PN: DescriptionPN: Description

The child names depicted objects.

The Picture Naming subtest measures expressive language ability and language development.

36 | Copyright © 2012. All rights reserved.

Similarities (SI)Similarities (SI)• Core Verbal Comprehension subtest for

ages 4:0–7:7.

• Consists of 23 items: 4 picture items and 19 verbal items.

• All 19 verbal items are retained. All 4 picture items and the sample picture item are new.

• Scoring criteria for all retained items were revised.

37 | Copyright © 2012. All rights reserved.

SI: DescriptionSI: Description

Picture Items Verbal Items

The child selects

the response option

that is from the

same category as

two other depicted

objects.

The child is read two

words that

represent common

objects or concepts

and describes how

they are similar.

The Similarities subtest measures verbal concept formation and reasoning.

38 | Copyright © 2012. All rights reserved.

Vocabulary (VC)Vocabulary (VC)• Verbal Comprehension subtest for ages

4:0–7:7.

• Consists of 23 items: 3 picture items and 20 verbal items.

• Ten items were retained (1 picture item and 9 verbal items) and 13 items are new (2 picture items and 11 verbal items).

• Scoring criteria for all retained items were revised.

39 | Copyright © 2012. All rights reserved.

VC: DescriptionVC: Description

Picture Items Verbal Items

The child names depicted objects.

The child defines words that are read aloud.

The Vocabulary subtest measures word knowledge and verbal concept formation.

40 | Copyright © 2012. All rights reserved.

Comprehension (CO)Comprehension (CO)• Verbal Comprehension subtest for

ages 4:0–7:7. • Comprehension has 22 items: 4

picture items and 18 verbal items. – All 4 picture items are new. – Of the verbal items, 17 are retained and

1 is new.

• Scoring criteria for all retained items were revised.

41 | Copyright © 2012. All rights reserved.

CO: DescriptionCO: DescriptionPicture Items Verbal Items

The child selects the picture that represents the best response to a general principle or social situation.

The child answers questions based on his or her understanding of general principles and social situations.

The Comprehension subtest measures verbal reasoning and conceptualization, verbal comprehension and expression, the ability to evaluate and use past experience, and the ability to demonstrate practical knowledge and judgment.

42 | Copyright © 2012. All rights reserved.

Visual-Spatial SubtestsVisual-Spatial Subtests

SubtestAges

2:6-3:11Ages

4:0-7:7

Block Design C C

Object Assembly C S

43 | Copyright © 2012. All rights reserved.

Block Design (BD)Block Design (BD)• Visual Spatial subtest for ages 2:6–7:7.

• BD has 17 items: 13 retained; 4 new.

• One of the new items is a diamond-shaped item with four blocks to extend the ceiling of the subtest.

• A new sample item was added to Part B to familiarize the child with the solid color sides of two-color blocks, and the other sample item is retained.

44 | Copyright © 2012. All rights reserved.

BD: DescriptionBD: Description

Working within a specified time limit, the child views a model and/or a picture in a Stimulus Book and uses one- or two-color blocks to re-create the design.

The Block Design subtest measures

ability to analyze and synthesize abstract

visual stimuli.

45 | Copyright © 2012. All rights reserved.

BD: Description of TaskBD: Description of Task

• Block Design is divided into two parts − A and B.

• Part A (Items 1–8) is primarily designed for ages 2:6–3:11 and utilizes one-color blocks.

• No degree of rotation, even complete 180°reversals, is penalized in Part A.

46 | Copyright © 2012. All rights reserved.

BD: Description of TaskBD: Description of Task

• Two-color blocks are used on Part B (Items 9–17), and only pronounced rotations of 30° or more are penalized.

• Modifications to administration procedures were made for some items to smooth the transition from model to stimulus book presentation.

47 | Copyright © 2012. All rights reserved.

BD: Description of TaskBD: Description of Task

As on the WPPSI–III, no time bonuses are utilized due to the relative unfamiliarity of preschoolers with performance under time constraints.

48 | Copyright © 2012. All rights reserved.

Object Assembly (OA)Object Assembly (OA)• Object Assembly is a Visual Spatial

subtest for ages 2:6–7:7.

• Object Assembly has a total of 13 items.

• Eleven items are retained from WPPSI-III.

• Two new items were added to improve the floor and ceiling of the subtest.

49 | Copyright © 2012. All rights reserved.

OA: DescriptionOA: Description

Working within a specified time limit, the child assembles the pieces of a puzzle to create a representation of an identified object.

The OA subtest measures visual-perceptual organization, integration and synthesis of part-whole relationships, nonverbal reasoning, and trial-and-error learning.