prep2test - a foundation for student success

8/13/2019 Prep2Test - A Foundation For Student Success

1/40

A FOUNDATION FOR STUDENT SUCCESS ASSESSMENTCENTER

www.smc.edu/assessment

310-434-8040

DEVELOPMENTTEAM

ESAUTOVAR

JOSHCASILLAS

KIERSTENELLIOTT

ROBERTGONZALEZ

JIMSERIKAWA


2/40

Prep2Test

A Foundation for Student Success

WHO ARE WE?1

2

3

OVERVIEW

THE NEED TO PREPARE STUDENTS: PREP2TEST

PREP2TEST OUTCOMES

4 NEXT STEPS


3/40

WHO ARE WE?1


4/40

Prep2Test


DEMOG

RAPHICS

Fall 2012 Student Demographic Profile

34,165 Students


5/40

Prep2Test


ASSESS

MENTATSM

C

Placement Policy & Testing: Mandatory assessment for first-time

college students

ACT COMPASS (Math) Accuplacer (English and ESL)

California Chemistry Diagnostic Test


6/40

ASSESS

MENTATSM

C

Assessment Center statistics: 33,717 student contacts

Administered 15,521 math, 11,787 English, and

3,381 ESL tests in 2012

Freshmen Students testing before 1stterm:

English: 74%

Math: 89%

99% compliance by second semester

Prep2Test



7/40

ASSESS

MENTATSM

C

Freshmen English Placement & Enrollment

0

10

20

30

40

50

60

70

80

"A" Level:

Transfer

"B" Level "C" Level

Placement

Enroll 1st TermPercenta

ge

Prep2Test



8/40

Prep2Test


ASSESS

MENTATSM

C

Freshmen Math Placement & Enrollment

0

10

20

30

40

50

60

70

80

Transfer

level

-1 level

(AA;

IA/Geo)

-2 levels

(ElemAlg)

-3 levels

(PreAlg)

-4 levels

(Arith)

Placement

Enroll 1st Term

Percenta

ge


9/40

Prep2Test


ASSESS

MENTATSM

C

What brought us to Prep2Test?

Placement trends Low percentages of students preparing

Perception that placement tests were aligned to

StandardsNot!

Provide students with more current ways (and

materials) to prepare

Placement testing = HIGH STAKES!

(WestEdsOne Shot Deal)

We share responsibility for preparation

Students/families need to be informed and willingparticipants
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


10/40

Prep2Test


ASSESS

MENTATSM

C

What brought us to Prep2Test? SLOs

Assessment Center Unit Outcomes

UO 1: Students will recognize the importance and

impact of assessment in language and computational

skills prior to testing. UO 2: Based on assessment results, students will demonstrate their understanding

of the number and type of courses in English, ESL, and mathematics they will need

to take to accomplish their educational objective.

UO 3: Students will demonstrate an understanding of, and adherence to, the SMC

Honor Code and the Assessment Center's Academic Integrity and Conduct Notice by

behaving honorably and adhering to proctor instructions while in the Center.

UO4: Students interested in retesting will spend

adequate time preparing as demonstrated in anincreased placement level.
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


11/40

Prep2Test


ASSESS

MENTATSM

C

The Need to Prepare for Placement Testing

(versus Reality)

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2010:

Math

2011:

Math

2010:

English

2011:

English

Understood Why

Prepared in Some Way

Accessed Resources

Pre-Test Perception

Post-Test Perception

Gap

Percenta

ge


12/40


13/40

FOCUS GROUP INSIGHTS

Reasons for Not Studying/Preparing

Prep2Test


ASSESS

MENTATSM

C

Testing Natural Skills:

Id be concerned about students who

study and score high, like into ENGL 1,

but they cant handle it in real life.

Studying for the test might make them

do better on the test than their true

level!

Not Planning to Attend SMC:

I wasnt planning on going

here so I signed up late. I

had to take the test likethe next day. I had no time

to study!
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


14/40

IS BORN2


15/40

Prep2Test


PREP2TESTINCEPTION

The NEEDOur GOALS

Need to: Improve the testing experience

WestEdsOne Shot Deal

Decrease degree of inaccurate placement

Reduce retesting statistics Reduce high percentage of students

placing into remedial courses

Develop more/better prep materials
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


16/40

Prep2Test


PREP2TESTINCEPTION

Our PARTNERSHIPS

Setting things in motion: The brainstorm

Assessment Center Faculty Leader, Dean of Enrollment Services, Director of

Student Success Initiatives (Basic Skills), Associate Dean of School Relations

Listening to our School DistrictSMMUSD-SMCCD Collaborative

The initial workDeveloping Prep2Test Orientation

Developing Prep2Test intro video

Outreach and Recruitment CounselorsCarrying the message
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


17/40

Prep2Test


PREP2TESTINCEPTION

Our PARTNERSHIPS

Setting things in motion: Outreach and Recruitment Counselors

Carrying the message at the high schools

Conducting Prep2Test workshops

Enrollment ServicesImprove your Enrollment Day campaignOrientation + Assessment = Earlier Date

Welcome CenterRetestingPrepare before retesting

Assessment Center staff


18/40

Prep2Test


PREP2TESTINCEPTION

The Program

Prep2Test Program Components Prep2Test orientation to

assessment guide

Prep2Test intro video

Prep2Test Challenge Quiz

Availability of test review

guides, sample tests

Infomercials

Website: www.smc.edu/prep2test
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


19/40

Prep2Test


PREP2TESTINCEPTION

The Program

Prep2Test Program Components Prep2Test intro video

Prep2Test orientation to

assessment guide




Infomercials



20/40

Prep2Test


PREP2TESTINCEPTION

The Program

Prep2Test Program Components Prep2Test intro video


assessment guide




Infomercials

http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


21/40

Prep2Test


PREP2TESTINCEPTION

The Program

Prep2Test Program Components

Prep2Test intro video


assessment guide




Infomercials

http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


22/40

Prep2Test


PREP2TESTINCEPTION

The Program

How long did it take? Prep2Test Orientation: @ 80 hours

Writing content

PowerPoint Show (interactive, menu driven, animations

coinciding to voiceover)

Prep2Test Intro Video: @ 4 months Writing script: @ 2 weeks

Video shooting: 1 day

Video editing: 3 months

Prep2Test Infomercials: @ 4 months Shooting videos: 1 day using SMC student actors and film crew

Video editing: 3 months using student editors
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


23/40

Prep2Test


PREP2TESTINCEPTION


24/40

OUTCOMES3


25/40

Prep2Test


PREP2TESTOUTCOMES

Outcomes

How do we assess? Examine video playbacks

Pre-placement testing Prep2Test Challenge Quiz

During placement testing Collect self-reported data on preparation (English, ESL, math tests) Includes pre-test and post test measures (but during same experience)

Impact of Prep2Test in confidence-building

Examine placement statistics
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


26/40

Prep2Test


ASSESS

MENTATSM

C

Video Playbacks

Numbe

r

5628

1048611977

0

9846

20949

24054

0

5000

10000

15000

20000

25000

30000

2011* Jun-12 Jun-13 Oct-13

Orientation Intro Video

*April 2011 *July 2011


27/40

Prep2Test


PREP2TESTOUTCOMES

Video DemographicsIntro Video


28/40

Prep2Test


PREP2TESTOUTCOMES

Video DemographicsOrientation Video


29/40

Prep2Test


PREP2TESTOUTCOMES

Prep2Test Challenge Quiz Results

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Took Quiz 2+

Times

Identified Key

Outcomes

Identified

Mandatory

Assessment

Policy

Identified All

Aspects of

Adaptive

Testing

Identified All,

but One Aspect

of Adaptive

Testing

Identified

Strategies to

Improve

Placement

Obtained 80%+

Score

Percent


30/40

Prep2Test


PREP2TESTOUTCOMES

Preparation for Math Placement Test

53%57%

63% 64%

34%

41%46%

49%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2010 2011 2012 2013


Accessed Our Resources

Pre-Test Perception


Gap

Percenta

ge


31/40

Prep2Test


PREP2TESTOUTCOM

ES

Preparation for English Placement Test

53%58%

61% 62%

30%

39%44%

49%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2010 2011 2012 2013


Accessed Our Resources

Pre-Test Perception


Gap

Percenta

ge


32/40

Prep2Test


PREP2TESTOUTCOM

ES

Prep2Test increased my confidence in performing better in the math

test (N=16,585)

6%

22%

67%

5%

Percent

Strongly disagree

Disagree

Agree

Strongly agree


33/40

Prep2Test


PREP2TESTOUTCOM

ES

Trends in Math Placement Levels

66%

60%56%

25%29%

33%

0%

10%

20%

30%

40%

50%

60%

70%

2011 2012 2013

Basic Skills

AA Applicable

College

Percenta

ge


34/40

Prep2Test


PREP2TESTOUTCOM

ES

Trends in English Placement Levels

30%

31% 32%

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

2011 2012 2013

College

2 Levels below

3 to 4 levels below

Percenta

ge


35/40

Prep2Test


PREP2TESTOUTCOM

ES

Lessons Learned

Learn from our experience Anticipate challenges

Communicate your vision/elicit support

Get Faculty buy-in early on

Work with key faculty whenever possible

How much are you willing to push or let go?

Who is you core development team? What if someone leaves?

Budget Sources and Expenses Leveraging funding sources (District funding and grant funding)

Faculty Stipends to develop subject area questions

Special training for MIS on App development

Software and equipment

Core team involvement (no additional funds, but part of their work)
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


36/40

NEXT STEPS4


37/40

Prep2Test


PREP2TEST2.0

Prep2Test 2.0

Prep2Test Version 2.0 The App

Prep2Test Microsite: The Basics, English, ESL, Math

Platform independentHTML 5 based

Section 508 compliant

Integrated with our student portal

Featuring revamped Prep2Test intro video and

content (review questions and practice quizzes)

Ability to track students place in the app

Heavy on the metrics (behind the scenes)

Integration of Khan Academy video skills
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


38/40

Prep2Test


PREP2TESTOUTCOM

ES

App Storyboard

Shots

Prep2Test Version 2.0-
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


39/40

Prep2Test


PREP2TESTOUTCOM

ES

Special Thanks to

A very special THANK YOU to:

Josh Casillas, Assessment Center Student Services Specialist

Jim Serikawa, Media Specialist

Lee Johnston, Director, MIS

Jeff Gordon, CounselorOutreach Counselors

Teresita Rodriguez, Vice President

Jeff Shimizu, Vice President

Mike Tuitasi, Vice President

Jocelyn Chong, Dean, MIS

SMC Academic Senate Presidents Janet Harclerode and Eve Adler
http://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivershttp://www.smc.edu/waivers


40/40

QUESTIONS?

CONTACT US!

Dr. Esau Tovar

Faculty Lead, Assessment [email protected]

Dr. Roberto Gonzalez

Dean, Student Success Initiatives

[email protected]

Kiersten Elliott

Dean, Enrollment Services

[email protected]

prep2test - a foundation for student success

Documents