ISLO # 1--Communication

Where do we go from here?

Goals for Today

Own the information that will be presented

so that we can make data-driven decisions

Continue the dialogue on the direction the

college should take to ensure students’

success

Commitment to advocate for the best

practices that lead to student success

Commitment to advocate for the

completion of meaningful and authentic

assessment

Process 2010/2011

1. Early Fall: Prompts and rubric

reviewed by Assessment Committee

2. 2nd Half: Essays collected in classes

3. Jan. 2011: Essays scored

4. April 2011: Review results and

suggest instructional changes

Here we are!

Essays rated on Six Competencies

1. Topic

2. Thesis/specific purpose.

3. Supporting material (Scored by

instructor)

4. Organizational pattern

5. Language

6. Grammar

GENDER

37.7%

62.3%

41.8%

58.2%

Male Female

Post-Test Sample All Students

Basic Demographics

Is the Sample Representative?

ETHNICITY

12.4% 15.4%

47.5%

7.3%

17.4% 14.6% 13.7%

48.4%

6.8%

16.6%

Afr Amer Asian Hispanic Multi/Other White

Post-Test Sample All Students

Basic Demographics

Is the Sample Representative?

Basic Demographics

Is the Sample Representative? AGE

45.4%

21.5% 22.0%

10.2%

1.0%

28.8%

34.9%

21.2%

12.7%

2.5%

Under 20 20 - 24 25 - 34 35 - 54 55 and above

Post-Test Sample All Students

Inter-Rater Reliability

Cronbach's Alpha of .84

.7 is considered the minimum

Raters did agree with each other

Indirect Indicators of Positive Outcomes

Correlation -

GPA, Units Completed, Total Score

Total

Units Completed

Through Fall

2011

GPA Through Fall 2011

Pearson

Correlation 1 0.264 0.071

Sig. (2-tailed) 0.000 0.000

N 615 615 615

**. Correlation is significant at the 0.01 level (2-tailed).

Indirect Indicators of Positive Outcomes

Pre and Post Test Comparison -

Average Total Score by Class

POST-TEST Total Units Completed

Through Fall 2011 GPA Through Fall 2011

Pearson Correlation 1 0.264 0.071

Sig. (2-tailed) 0.000 0.000

N 615 615 615

*. Correlation is significant at the 0.05 level (2-tailed).

**. Correlation is significant at the 0.01 level (2-tailed).

PRE-TEST Total Units Completed

Through Fall 2011 GPA Through Fall 2011

Pearson Correlation 1 0.092 0.322

Sig. (2-tailed) 0.024 0.000

N 610 607 607

Indirect Indicators of Positive Outcomes

Average Total Score by Class

32.0

27.3 27.3

25.0 24.9 24.8 23.4 22.9 22.8

22.1 22.1 21.7 21.3 21.2

Nrsg 343 Hist 87 Eng 101 Bus 06 Acctg 1 Acctg 3 AJ 1 AJ 319 Hist 52 Psych 41 Bus 01 Psych 1 PoliSci 1 CD 65

Indirect Indicators of Positive Outcomes

Pre and Post Test Comparison -

Average Total Score by Class

31.2

20.3 21.1 20.9

29.7

23.5

19.5

24.4

20.1

18.3

32.0

27.3

25.0 24.9 24.8

23.4 22.8

22.1 21.7 21.3

Nrsg 343 Eng 101 Bus 06 Acctg 1 Acctg 3 AJ 1 Hist 52 Psych 41 Psych 1 PoliSci 1

Pre-Test Avg Post-Test Avg

Indirect Indicators of Positive Outcomes

Average Score

by Highest English Class Completed

21.3

23.6 23.6

25.7

English 21 English 28 English 101 English 102

Indirect Indicators of Positive Outcomes

Pre and Post Test Comparison

Average Score by Highest English Completed

17.09

19.43

22.74 23.02 21.11

23.62 23.74 25.44

English 21 English 28 English 101 English 102

Pre Test Post Test

17.1

19.4

22.7 23.0 21.3

23.6 23.6

25.7

English 21 English 28 English 101 English 102

Pre Test Post Test

49.4%

38.4%

10.6%

1.4% 0.2%

Less than 10% 10-25% 26-50% 51-75% More than 75%

Plagiarism

Turnitin Percentages Were Generally Low

Plagiarism

Pre and Post Test Comparison

Turnitin Percentages

59.1%

28.4%

7.9% 3.9%

0.8%

49.4%

38.4%

10.6%

1.4% 0.2%

Less than 10% 10-25% 26-50% 51-75% More than 75%

Pre Test Post Test

Breakdown by Competency

Average Score by Competency

4.3

4.1 4.1

3.9

3.8 3.7

Supportingmaterial (scored

by instructor)

Language Topic Organizationalpattern

Thesis/specificpurpose

Grammar

Breakdown by Competency

Pre and Post Test Comparison –

Average Score by Competency

4.1

3.6 3.8

3.4 3.3 3.5

4.3 4.1 4.1

3.9 3.8 3.7

Supportingmaterial

Language Topic Organizationalpattern

Thesis/specificpurpose

Grammar

Pre-Test Post-Test

The Context

Average Reading Scores for Spring 2011:

73.95 (76 and above = 12th grade reading level)

Average Reading Scores for Fall 2011:

72.60 (76 and above = 12th grade reading level)

Post-test Sample Breakdown by English Class:

ENG 21 4.5%

28 21.3%

101 45.7%

102 28.5%

Implications

Expectation of college level work

Invest in success proven strategies: Writing is a process, thus, practice, practice, practice

Writing throughout the curriculum

Program Review and Program Assessment These data need to be integrated

College planning These data should be taken into account for all

planning