getting the most from your act explore and act plan reporting package

1

Getting the Most from your ACT Explore and ACT Plan Reporting Package

22

O U R M I S S I O NHelping people achieve education and workplace success

O U R V A L U E SExcellenceDiversity

LeadershipEmpowerment

LearningSustainability

33

ACT Learning Insights TeamWhat We Do

LIT-designed

Professional Learning

Experiences

Insights fromACT Research

Insights from ACT Data

Insights from Professional

Practice

Raise Academic Standards and Increase Achievement to Ensure All Students Are

College and Career Ready (CCR)

44

Workshop ObjectivesIntroduction

Describe ACT’s definition of college and career readiness

Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit

Find key data points in the ACT Explore/ACT Plan Student and Summary Profile Reports

Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels

55

Workshop Agenda

College and Career Readiness Student Score Report

Break Profile Summary Report Item Response Summary Report Early Intervention Rosters Reflections

6

Workshop Materials

Workbook

Road Map

7

What does College and Career Readiness mean to you?

7

IntroductionCollege and Career Readiness

88p. 5

√❑

99

ACT’s Definition of College Readiness

College Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.

www.act.org/commoncorep. 7

1010

ACT’s College and Career Readiness SystemComponents

p. 8

1111

The Core Practice Framework

www.act.org/products/additional-products-assessments/act-core-practice-framework/

1212

http://www.act.org/research-policy/national-curriculum-survey

ACT National Curriculum Survey®

The Foundation of ACT’s College and Career Readiness System

Conducted every three to five years

Nationwide survey of educational practices and expectations– College instructors– High school teachers– Middle school teachers– Elementary teachers

1313

ACT National Curriculum Survey®

The Foundation of ACT’s College and Career Readiness System

Identifies the skills and knowledge postsecondary institutions expect of students

Guides the development of ACT’s assessments that measure college-ready skills

Informs efforts to develop, refine, and update academic standards

Inform policymakers and educators

1414

Curriculum-based assessments in English, math, reading, and science

Career planning component

1515

25

3632

Longitudinal AssessmentsCommon Score Scale Relationship

1616

ACT’s College Readiness Benchmarks

Test College Course 8th Grade 9th Grade

English English Composition 13 14 15 18

Math College Algebra 17 18 19 22

Reading Social Sciences 15 16 17 21

Science Biology 20 20 21 24

Empirically derived 50% likelihood of achieving a B or higher or about a 75%

likelihood of achieving a C or higher in the corresponding credit-bearing college course

22

23

p. 6

17

Condition of College and Career Readiness, 2012National Results

Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2012

http://www.act.org/research/policymakers/cccr12/readiness4.html

18

Condition of College and Career Readiness, 2013National Results

Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2013

http://www.act.org/research/policymakers/cccr13/readiness4.html

19

2012-2013 Hawaii ResultsACT Explore − 8th Grade Students

English Math Reading Science0

10

20

30

40

50

60

70

80

90

100

55

37 38

15

72

4150

19

HawaiiNational

Percent of 8th Grade Students in Hawaii At or Above Benchmark on ACT Explore, 2013

20

2012-2013 Hawaii ResultsACT Explore − 9th Grade Students

English Math Reading Science0

10

20

30

40

50

60

70

80

90

100

52

2835

22

67

33

45

21

HawaiiNational

Percent of 9th Grade Students in Hawaii At or Above Benchmark on ACT Explore, 2013

21

2013 Hawaii ResultsACT Plan

English Math Reading Science0

10

20

30

40

50

60

70

80

90

100

59

25

35

18

66

39

50

22

HawaiiNational

Percent of 10th Grade Students in Hawaii At or Above Benchmark on ACT Plan, 2013

2222

College and Career ReadinessReflections

What insights have you gained from learning about ACT’s definition of College and Career Readiness?

Record your insights on the Readiness section of your Road Map.

2323

Preparing to Unpack the Box

www.act.org/learningevents/resources

p. 13

2424p. 15

2525

Student Score Report

p. 16/20

2626

Student Score ReportsIntroduction

Components– College readiness indicators– Academic strengths and weaknesses– Suggestions for improvement– Career and postsecondary aspirations

Foundation of all aggregate reporting

27

Student Score Report

Header

3. Career Exploration

1. Academic Achievement & Education Planning

2. Intervention Planning

p. 16/20

28

Report HeaderStudent Information

Student’s Name

Student’s Grade Level

Student’s School

Test FormTest Date

p. 16/20

29

1. Academic Achievement and Education Planning: Your ScoresStudent Scores and Norms

p. 16/20

30

1. Academic Achievement and Education Planning: Your ScoresEstimated Scores on ACT Plan or The ACT

p. 16/20

31

1. Academic Achievement and Education Planning: Your PlansHigh School Course Plans

p. 16/20

32

1. Academic Achievement and Education Planning: Your PlansReported Needs

p. 16/20

33

1. Academic Achievement and Education Planning: Your PlansCollege Readiness

p. 16/20

34

1. Academic Achievement and Education Planning: Your PlansAdditional Information

p. 16/20

35

2. Intervention Planning: Your SkillsItem Response Summary and Suggestions for Improvement

p. 18/22

36

3. Career Exploration: Your Career PossibilitiesWorld of Work

p. 17/21

37

You and the World of Work Your Interests Exploring Career

Options

3. Career Exploration: Your Career PossibilitiesWorld of Work

p. 17/21

3838p. 17/21

39

3. Career Exploration: Your Career PossibilitiesWorld of Work

p. 17/21

4040

Student Score ReportDissemination

What happens next?– Teachers/counselors learn to interpret

individual student results– School administrators should be aware of

individual student results– Teachers/counselors review results with

students– Teachers/counselors review results with

parents

41

Student Resources

www.explorestudent.org www.planstudent.org

4242

Student Score ReportReflections

What insights have you gained from examining your Student Score Reports?

What implications does this report have for counseling students about:– Curriculum and Course Selection– Intervention and Student Support– Career Possibilities

Record your thoughts on the Student Score Report section of your Road Map.

43

Break(15 minutes)

4444p. 25

4545

Profile Summary ReportIntroduction

What is the Profile Summary Report? Aggregates the data from Student Score Reports Identifies if students are on target to be college

and career ready when they graduate from high school

Shows if their coursework aligns with their career interests and educational plans

p. 25

4646

Frequency Distribution TableProfile Summary Report: Table 1a

ACT Explore: Page 2 in Profile Summary Report

ACT Plan: Page 2 in Profile Summary Report

p. 37/47

47

Students on target to be college ready

38 (20%) Students Below Benchmark

53 (28%) Students Above Benchmark

100 (52%) Students on the Cusp

44 in danger of slipping41 within 2 points of benchmark

Benchmark

Students on the cusp

191 Total Students

Students in need of real intervention

Frequency Distribution TableProfile Summary Report

4848

Application ExerciseFrequency Distribution Table

Use either your ACT Explore or ACT Plan data

Complete the activity on p. 27. 10 minutes Answer questions 1-8

p. 37/47

4949

ACT’s College Readiness Standards

Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test.

Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean.

Direct link between what students have learned and what they are ready to learn next.

http://act.org/standard/

50

And statements thatprovide suggestions to

progress to a higher levelof achievement

Statements that describe what students are likely to know and be able to do...

5151

College Readiness Standard Score RangesProfile Summary Report: Table 1c

ACT Explore: Page 4 in Profile Summary Report

ACT Plan: Page 4 in Profile Summary Report

9%

48%

p. 39/49

5252

Profile Summary ReportLocal Items

12 multiple choice items added by Hawaii Dept. of Education to ACT Explore & ACT Plan

Topics covered:– Post-high school plans– Parental education level– Parental involvement in education– Experiences with bullying– Co-curricular activities– Academic behaviors

5353

Profile Summary ReportLocal Item Report: Table 6

p.44/55/

5454

Profile Summary ReportAdditional information

Profile Summary Report also includes:– National comparisons– Differences by ethnic & gender groups– Relation between scores & coursework– Relation between scores and

career/educational plans and interests

5555

Profile Summary ReportReflections

What insights have you gained from examining your Profile Summary Report?

What implications do the data reveal for:– Curriculum– Staff Development– Instruction– Intervention/Student Support

Record your thoughts on the Profile Summary Report section of your Road Map.

5656p. 56/62

5757

Item Response Summary ReportIntroduction

Provides data on the item-by-item performance of your students.

Is a very useful tool for curriculum review when used along with the test booklet.

Test Form

58

Item Response Summary Report

p. 59/64

5959

Application ExerciseItem Response Summary Report

Pick 1 content area. Circle the *asterisked numbers (correct answers)

for each question. Use your highlighters to mark only the circled

numbers:

No Mark 75%+

Green 50-74%

Yellow 25-49%

Pink 0-24%p. 56/62

60

Application ExerciseItem Response Summary Report

No color 75-100% Correct

Green 50-74% Correct

Yellow 25-49% Correct

Pink 0-24% Correct

61

Replace image with what is in the workbook and fix the color coding key to match

Color-Code No Mark 75%+ Green 50-74% Yellow 25-

49% Pink 0-24%

6262

Application ExerciseAnalysis

Look for the following patterns:

Dramatic differences from the reference group High percentages clustered around a wrong

answer High percentages of omitted questions High percentages clustered around a correct

answer

Do any of these situations occur more frequently for some domains than others?

63

Clustered on wrong answer

Dramatic Difference from

Reference GroupHigh

Perc

entag

e Omitte

d

Cluster

ed ar

ound

corre

ct an

swer

6464

Item Summary ReportReflections

What insights have you gained from examining your Item Response Summary Report?

What implications do the data reveal for:– Curriculum– Staff Development– Instruction– Intervention/Student Support

Record your thoughts on the Item Response Summary Report section of your Road Map.

65

EARLY INTERVENTION ROSTERS

p. 68/71

6666

Early Intervention RosterIntroduction

School-level reports that identify students who fall into three categories: – Roster 1: Students indicating they do not plan to

finish high school or have no post-high school educational plans

6767

ACT Plan Early Intervention RostersRoster 1: Early Identification

6868

ACT Plan Early Intervention RostersRoster 2: Coursework Intervention

– Roster 2: ACT Explore: Students scoring below the national 10th

percentile

ACT Plan: students with 2a) composite score of 16 or higher who reported

they have no plans to go to college 2b) reported that they plan to attend college but

earned a composite score of 15 or less, or reported that they do not plan to take college core coursework.

6969

ACT Plan Early Intervention RostersRoster 2a: Coursework Intervention

7070

ACT Plan Early Intervention RostersRoster 2b: Coursework Intervention

Which of our students plan to go on to post secondary but lack the necessary skills or don’t plan to take college prep courses?

7171

Early Intervention RosterRoster 3: Need for Assistance

– Roster 3: Students who expressed a need for help in a particular area

This roster can help you identify instructional needs, design intervention strategies, and assist students with reaching their

academic and career goals.

7272

ACT Plan Early Intervention RostersRoster 3: Need for Assistance

Are we providing programs or services to meet our students’ needs?

7373

Reflections

What might you add to your intervention program based on these rosters?

What have you added to your understanding of College and Career Readiness at your school?

7474

ConclusionWorkshop Objectives

Describe ACT’s definition of college and career readiness

Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit

Find key data points in the ACT Explore/ACT Plan Student and School Reports

Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels.

7575

Additional Resources

Future events shown at www.act.org/learningevents

Additional questions?

Contact Customer Service:

877-789-2925

7676

Mahalo

Mahalofor all you do for Hawaii’s students!

Have a great school year!