#APSummit15

Discussion on Predictive Validity of Standardized Tests and How Washington State University Examined it

Debbie Major and Cheryl Oliver

Date: April 28, 2015

WSU Study

Assumptions surrounding the use of standardized examinations

Predictive Validity of GMAT & GRE

Limitations of GMAT & GRE

Dis

cuss

ion

Po

ints

Assumptions

Predictive validity for success in graduate programs

& Predictive validity for overall career success

Predictive Validity The GMAT and GRE have demonstrated predictive validity for just one factor which is students’ first-year graduate school GPA.

Does the GMAT and GRE demonstrate the ability to differentiate?

Limitations

Does the GMAT or GRE demonstrate predictive validity for program completion or career success?

Limitations

Does test preparation distort exam results?

Limitations

Are the GMAT and GRE systematically biased against low socio-economic students - females and minorities?

Limitations

Competitive Landscape

Thirty two (32) public universities offering low-residency, fully

online and hybrid MBA programs with varying admissions criteria.

Many do not require GMAT or GRE.

“The quality of the educational program should

not be judged by the test scores of the entering

students but rather by the knowledge, skills and

abilities of it’s outgoing (graduating) students.”

Barr, R and Tagg, J.

Entrance Examination Case

The Carson College of Business At Washington State University One MBA degree

• Face:Face • Main campus: ”emerging leaders” • Urban Campuses: working professionals

• Online • Online MBA: Working professionals • Executive MBA: Working professionals w/

10 years progressive leadership experience

The Challenge

• Executive MBA Online – Resistant to taking Exam – GMAC validity data excludes this audience

• Online MBA – Resistant to taking Exam – GMAC validity data excludes some of this – audience

Adjustment 1

Review of literature and adjustment to requirement for Executives

• Retained rigorous standards • Enabled waivers in specific circumstances

Result of Adjustment 1

• Conversions from EMBA inquires

• EMBA qualified candidates convert to EMBA

• Consistently high quality performance by students

Adjustment 2

Review of literature and adjustment to requirement for Executives and Online MBAs

• Retained rigorous standards • Enabled waivers in specific circumstances

Result of Adjustment 2

• Further consideration of changes to GMAT requirement

• Increased focus on undergraduate courses

• Increased focus on undergraduate or other graduate GPA

#APSummit15

Debbie Major, Consultant Pearson Embanet Cheryl Oliver, Assistant Dean Online and Graduate Programs Carson College of Business Washington State University

Slide Number 1Slide Number 2Slide Number 3AssumptionsPredictive ValidityLimitationsLimitationsLimitationsLimitationsSlide Number 10Slide Number 11Entrance Examination CaseThe ChallengeAdjustment 1Result of Adjustment 1Adjustment 2Result of Adjustment 2Slide Number 18