mus assessment workshops r. w. larsen, 2014 program assessment plans step by step this presentation...
Post on 01-Apr-2015
217 Views
Preview:
TRANSCRIPT
MUS ASSESSMENT WORKSHOPS
R. W. Larsen , 2014
Program Assessment Plans Step by Step
This presentation and handouts are available at:http://www.montana.edu/provost/assessment.html
Overview
1. Create program learning outcomes2. Identify where each outcome is included in your
curriculum3. Determine where you can gather evidence of
student performance for each outcome4. Set an expected performance threshold for each
outcome5. Create a schedule for assessing each outcome6. Describe your process for using the assessment
data7. Submit your assessment plan
1. Create Program Learning Outcomes
What do you want your students to know, to be able to do, and (sometimes) to be when they graduate from your program?
The answers to this question are the list of learning outcomes for your degree program.
1. Create Program Learning Outcomes
Program learning outcomes are generally written in the form of statements starting with “Our graduates will…”
Note: Many professional organizations have developed lists of expected competencies or student leaning outcomes.
Typical Program Learning Outcomes
1. Our graduates will have the knowledge required to be successful in their field.
2. Our graduates will be able to function in a professional manner in their field.
3. Our graduates will be able to analyze problems in their field and develop solutions or strategies to solve those problems.
4. Our graduates will be able to communicate effectively.
1. Create Program Learning Outcomes
1. Develop a list of learning outcomes for your degree program.
2. Assign every outcome a number or letter so that it can be easily identified.
2. Find Each Outcome in Your Curriculum
1. List all required courses2. Remove courses outside of the faculty’s control
(optional)3. Create a grid showing remaining courses (rows)
and learning outcomes (columns)4. Use a highlighter to indicate where in the
courses each outcome is addressed5. Add a code indicating cognitive skill level to the
highlighted cells, for example:
I = introductory , D = developing, M = mastery
2. Find Each Outcome in Your Curriculum
1. List all required courses2. Remove courses outside of the faculty’s control
(optional)3. Create a grid showing remaining courses (rows)
and learning outcomes (columns)4. Use a highlighter to indicate where in the
courses each outcome is addressed5. Add a code indicating cognitive skill level to the
highlighted cells, for example:
I = introductory , D = developing, M = mastery
You are creating a curriculum
map.
2.1 List All Required Courses
ARCH 151--Design Fundamentals I BIOB 170IN--Principles of Biological
Diversity CHMY 121IN--Intro to General
Chemistry WRIT 101W--College Writing I M 145--Math for Liberal Arts BIOB 110CS--Introduction to Plant
Biology HORT 131--Landscape Design,
Hist/Theory HORT 105--Miracle Growing ENSC 245IN--Soils HORT 231--Woody Ornamentals HORT 232--Herbaceous Ornamentals EGEN 115--Engineering Graphics EGEN 116-- Engineering Graphics
Lab
HORT 225--Landscape Graphics I HORT 226--Landscape Graphics II Communication Electives HORT 310--Turfgrass Management HORT 331--Planting Design HORT 335--Site Development HORT 336--Landscape Construction Business Electives HORT 431--Tough Plants in Tough
Places HORT 432--Advanced Landscape
Design Technical Electives Horticulture Electives Core Electives
Courses outside of department shown in color
2.3 Create a Grid of Courses and Outcomes
Outcomes 1 2 3 4BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432
2.4 Highlight Courses that Include Outcome
Outcomes 1 2 3 4BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432
Note: Example shown here is pure fiction!
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
This outcome is not supported
by the curriculum.
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
HORT 431 is not asking enough
from the students, and students are
never asked to demonstrate mastery in outcome 1.
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
Students are going to have a lot of difficulty in this outcome because of the
inverted cognitive skill development.
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
We expect mastery in
communications, but only have the students write in
one course!
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
Two Possibilities:
This course contributes
nothing towards the program
learning outcomes,
- or -
This course is contributing
towards a learning outcome than has not been
identified.
3. Where Can You Gather Data?
The grid (curriculum map) shows where each outcome is covered.
The courses with higher cognitive skill levels are typically good sources for assessment data.
Notes: You can save faculty time by gathering data from
courses taken by students in multiple programs.Knowledge of the discipline can also be demonstrated
using a discipline-based proficiency exam.
3. Data Source Identification
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I I HORT 105 I ENSC 245IN I I HORT 231 I I HORT 232 I I HORT 225 I I HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D DHORT 336 D M HORT 431 M HORT 432 M D M
4. Set Performance Thresholds
As long as students can “squeak by” and graduate with an overall GPA of 2.001, it is unreasonable to expect every student to demonstrate mastery in every outcome.
Faculty need to decide what constitutes an acceptable performance threshold for each outcome.
Example: At least 80% of students will be rated “Acceptable” or higher on every category of the scoring rubrics.
Example Scoring Rubric
Graduates will have an ability to design a system that meets stated needs.Outcome Category
Unacceptable Marginal Acceptable Exceptional
Clearly articulated need that is to be addressed by the design.
No need is indicated.
Need stated incompletely or ambiguously.
Statement of need is made, but some improvement is possible.
Clearly articulated statement of need.
Does the proposed design meet the need?
No evidence that the proposed design will meet the stated need.
Reader must infer how the design will meet the need.
It is apparent that the design will meet the stated need, but some improve-ments are possible.
The utility of the design in meeting the stated need is well communicated as part of the presentation.
Has the group assembled a logical and practical sequence of integrated unit operations?
The proposed design cannot achieve the intended result.
The proposed design will likely work, but design has significant shortcomings.
The proposed design appears to be a reasonable approach to accomplishing the intended task.
The proposed design exhibits a high degree of innovation.
5. Schedule for Assessing Each Outcome
Outcome
Year2014
2015 2016 2017 2018 2019
1 X X
2 X X
3 X X
4 X X
6. Process for Using Assessment Data
1. Data is collected from identified courses.2. Samples are scored by two faculty members
using prepared scoring rubrics.3. The assessment coordinator tabulates the scores.4. The scores are presented to the faculty for
assessment.5. The faculty reviews the assessment results, and
makes decisions on how to respond.6. A report summarizing the year’s assessment
activities and faculty decisions is submitted to the Provost’s Office.
7. Submit Assessment Plan
Once you have an assessment plan with essential elements:
Program learning outcomesIdentified data sourcesSchedule for assessing each outcomeProcess for using assessment data
then submit your completed plan to the Provost’s Office – and start working the plan.
top related