christine case. methodsmethods looked at instructional objectives in course outlines

Christine Case

MethodsMethodsMethodsMethods

• Looked at Instructional Objectives in course outlines

ResultsResultsResultsResults

• SLOs for all courses• SLOs for all

programs

ResultsResultsResultsResults

• SLOs for all courses• SLOs for all

programs• www.smccd.edu/

accounts/skybio

ProgramsProgramsProgramsPrograms

• General Education (100s)

• Majors (215, 230)

• Allied Health Sciences (240, 250, 260)

• Biotechnology (400s)

• Honors (675)

BIOL 101BIOL 101BIOL 101BIOL 101

BIOL 101 StudentsBIOL 101 StudentsBIOL 101 StudentsBIOL 101 Students

• 4 semester units– 3 lecture hr/wk– 3 lab hr/wk

BIOL 101 StudentsBIOL 101 StudentsBIOL 101 StudentsBIOL 101 Students

• 72% plan to transfer

• 22% BUS majors• 20% undecided• 37 college units– Range: 0-120

BIOL 101BIOL 101BIOL 101BIOL 101

• Mission: To provide students with the knowledge, experiences, & skills needed to make decisions regarding personal and environmental health.

DefinitionsDefinitionsDefinitionsDefinitions

• Evaluation– to make a conclusion about student

learning

• Assessment– is ongoing.– To continually evaluate student learning

against outcomes to improve programs.– To reflect on what we do for our students

and what we should do.

SLO Assessment PlanSLO Assessment PlanSLO Assessment PlanSLO Assessment Plan

SLO Assessment Method and

Criteria

Term Outcome

Results

Analysis

Action &

Objective Outcome1. Provide non-biology majors with a

solid ground of biological principles.

1. Demonstrate … knowledge.

2. Create an awareness in students about dynamic interactions in the ecosystem.

2. Apply … knowledge.

3. Afford an opportunity for students to understand the significance of biological, chemical, and physical principles in our world.

3. Use … knowledge to assess personal and environmental health.

4. Foster the student’s awareness and concern as members of the community, world, and ecosystem.

4. Use … knowledge for active citizenship.


SLO Assessment Method and Criteria

Term Outcome

Results

Analysis

Action &

SLOAC MethodsSLOAC MethodsSLOAC MethodsSLOAC Methods

• Direct: – Require students to demonstrate

their knowledge, skills and/or abilities.

• Indirect: – Students reflect on their learning

rather than demonstrate it.


SLO Assessment Method and Criteria

Term Outcome

Results

Analysis

Action &

CriteriaCriteriaCriteriaCriteria

• Are all students expected to achieve a certain proficiency level for an outcome?

• Would the program be satisfied if only a certain percentage of students achieve a certain level of proficiency? – What should this percentage and level be?

• Consider the “criterion point” at which the program would want to initiate curriculum changes.

M. Zieky and M. Perie. A Primer on Setting Cut Scores on Tests of Educational Achievement. Educational Testing Service, 2006. http://www.ets.org

The criteria areThe criteria areThe criteria areThe criteria are

• “…subjective; it is important not to assume that criteria values accurately reflect student performance.”

C. Horn et al. Cut Scores: Results May Vary. NBETPP Monographs 1(1). eScholarship@BC, 2000.

0

10

20

30

40

50

60

70

A B C D FPerentage of students by

major

Undeclared Declared

Cohort StudyCohort StudyCohort StudyCohort Study

SLO Assessment Criterion Results Action

1. Scientific method

Weekly lab quiz

15-pt M/C

80% score

≥ 87%

Outcome ResultsOutcome ResultsOutcome ResultsOutcome ResultsDirect



Weekly lab quiz

15-pt M/C

80% score

≥ 87%

Fall 2006 10%

Outcome ResultsOutcome ResultsOutcome ResultsOutcome Results



Weekly lab quiz

15-pt M/C

80% score

≥ 87%

Fall 2006 10% Modify lab instrux to emphasize lab attendance & participation


Practice graphingPractice graphingPractice graphingPractice graphing

0.0

0.5

1.0

1.5

2.0

2.5

3.0

A B C D F

Final Grade

Lab hr/wk

0.0

3.0

6.0

9.0

12.0

15.0

A B C

Final Grade

Post test ave.



Weekly lab quiz

15-pt M/C

80% score

≥ 87%

Fall 2006 10% Modify lab instrux to emphasize studying AND attendance

Fall 2008 23%



4. Use the scientific knowledge and skills necessary for active citizenship.

Biology Attitude Survey

Pre-Post-coursesurvey

70% positive change in attitude

Outcome ResultsOutcome ResultsOutcome ResultsOutcome ResultsIndirect

For example:For example:For example:For example:

• I enjoy studying Biology.– Strongly agree Agree Disagree Strongly

disagree

• Semantic differential– Biology is: Clean | | | | Dirty

• Citizenship– I plan to vote in the upcoming election.

C. L. Case. American Biology Teacher 42(2):121-123, 1980.

J. E. Roueche et al. Assessing Student Opinions of the Learning Experience. Machaca TX: Sterling Swift, 1976.

-10 -8 -6 -4 -2 0 2 4 6

I don't like Biology, and it scares me

Biology makes me feel secure

I have a good feeling about Biology

Biology makes me feel uncomfortable

When I hear the word Biology, I have a feeling of dislike

I enjoy studying Biology

It makes me nervous to even think about doing a Biologyexperiment

I feel at ease in Biology and like it very much

Change


0

20

40

60

2006

% change

Outcome ResultsOutcome ResultsOutcome ResultsOutcome ResultsWhen I hear Biology, I have a feeling of dislike

0

20

40

60

2006 2001

% change

Year Over YearYear Over YearYear Over YearYear Over YearWhen I hear Biology, I have a feeling of dislike


0 20 40 60 80 100

2006

Percent

Post Pre

Not frightened by performing an experiment in lab

Year Over YearYear Over YearYear Over YearYear Over Year

0 20 40 60 80 100

2001

2006

Percent

Post Pre


Year Over YearYear Over YearYear Over YearYear Over Year

0 20 40 60 80 100

1993

2001

2006

Percent

Post Pre


CitizenshipCitizenshipCitizenshipCitizenshipNovember 2006 Election

0 20 40 60 80 100

I plan tovote

%

November 2006 Election

0 20 40 60 80 100

I voted

I plan tovote

%

Nonvoters:•56% not citizens•26% not registered

CitizenshipCitizenshipCitizenshipCitizenship


4. Use the scientific knowledge and skills necessary for active citizenship.

Science Attitude Survey

Pre-

Post-

course

survey

70% positive change in attitude

Change criterion:90% show a positive attitude

Fall 1993 156%

Fall 2001 20%

Fall 200642%


christine case. methodsmethods looked at instructional objectives in course outlines

Documents

scientific knowledge

lab instrux

students awareness

use knowledge

certain percentage of

certain proficiency

certain level of proficiency

environmental health