mus assessment workshops r. w. larsen, 2014 program assessment plans step by step this presentation...
TRANSCRIPT
![Page 1: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/1.jpg)
MUS ASSESSMENT WORKSHOPS
R. W. Larsen , 2014
Program Assessment Plans Step by Step
This presentation and handouts are available at:http://www.montana.edu/provost/assessment.html
![Page 2: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/2.jpg)
Overview
1. Create program learning outcomes2. Identify where each outcome is included in your
curriculum3. Determine where you can gather evidence of
student performance for each outcome4. Set an expected performance threshold for each
outcome5. Create a schedule for assessing each outcome6. Describe your process for using the assessment
data7. Submit your assessment plan
![Page 3: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/3.jpg)
1. Create Program Learning Outcomes
What do you want your students to know, to be able to do, and (sometimes) to be when they graduate from your program?
The answers to this question are the list of learning outcomes for your degree program.
![Page 4: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/4.jpg)
1. Create Program Learning Outcomes
Program learning outcomes are generally written in the form of statements starting with “Our graduates will…”
Note: Many professional organizations have developed lists of expected competencies or student leaning outcomes.
![Page 5: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/5.jpg)
Typical Program Learning Outcomes
1. Our graduates will have the knowledge required to be successful in their field.
2. Our graduates will be able to function in a professional manner in their field.
3. Our graduates will be able to analyze problems in their field and develop solutions or strategies to solve those problems.
4. Our graduates will be able to communicate effectively.
![Page 6: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/6.jpg)
1. Create Program Learning Outcomes
1. Develop a list of learning outcomes for your degree program.
2. Assign every outcome a number or letter so that it can be easily identified.
![Page 7: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/7.jpg)
2. Find Each Outcome in Your Curriculum
1. List all required courses2. Remove courses outside of the faculty’s control
(optional)3. Create a grid showing remaining courses (rows)
and learning outcomes (columns)4. Use a highlighter to indicate where in the
courses each outcome is addressed5. Add a code indicating cognitive skill level to the
highlighted cells, for example:
I = introductory , D = developing, M = mastery
![Page 8: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/8.jpg)
2. Find Each Outcome in Your Curriculum
1. List all required courses2. Remove courses outside of the faculty’s control
(optional)3. Create a grid showing remaining courses (rows)
and learning outcomes (columns)4. Use a highlighter to indicate where in the
courses each outcome is addressed5. Add a code indicating cognitive skill level to the
highlighted cells, for example:
I = introductory , D = developing, M = mastery
You are creating a curriculum
map.
![Page 9: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/9.jpg)
2.1 List All Required Courses
ARCH 151--Design Fundamentals I BIOB 170IN--Principles of Biological
Diversity CHMY 121IN--Intro to General
Chemistry WRIT 101W--College Writing I M 145--Math for Liberal Arts BIOB 110CS--Introduction to Plant
Biology HORT 131--Landscape Design,
Hist/Theory HORT 105--Miracle Growing ENSC 245IN--Soils HORT 231--Woody Ornamentals HORT 232--Herbaceous Ornamentals EGEN 115--Engineering Graphics EGEN 116-- Engineering Graphics
Lab
HORT 225--Landscape Graphics I HORT 226--Landscape Graphics II Communication Electives HORT 310--Turfgrass Management HORT 331--Planting Design HORT 335--Site Development HORT 336--Landscape Construction Business Electives HORT 431--Tough Plants in Tough
Places HORT 432--Advanced Landscape
Design Technical Electives Horticulture Electives Core Electives
Courses outside of department shown in color
![Page 10: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/10.jpg)
2.3 Create a Grid of Courses and Outcomes
Outcomes 1 2 3 4BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432
![Page 11: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/11.jpg)
2.4 Highlight Courses that Include Outcome
Outcomes 1 2 3 4BIOB 170IN BIOB 110CS HORT 131 HORT 105 ENSC 245IN HORT 231 HORT 232 HORT 225 HORT 226 HORT 310 HORT 331 HORT 335 HORT 336 HORT 431 HORT 432
Note: Example shown here is pure fiction!
![Page 12: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/12.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
![Page 13: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/13.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
This outcome is not supported
by the curriculum.
![Page 14: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/14.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
HORT 431 is not asking enough
from the students, and students are
never asked to demonstrate mastery in outcome 1.
![Page 15: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/15.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
Students are going to have a lot of difficulty in this outcome because of the
inverted cognitive skill development.
![Page 16: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/16.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
We expect mastery in
communications, but only have the students write in
one course!
![Page 17: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/17.jpg)
2.5 Add Code for Cognitive Skill Level
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I HORT 105 I ENSC 245IN I M HORT 231 I HORT 232 I HORT 225 I D HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D HORT 336 D I HORT 431 I HORT 432 I M
Two Possibilities:
This course contributes
nothing towards the program
learning outcomes,
- or -
This course is contributing
towards a learning outcome than has not been
identified.
![Page 18: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/18.jpg)
3. Where Can You Gather Data?
The grid (curriculum map) shows where each outcome is covered.
The courses with higher cognitive skill levels are typically good sources for assessment data.
Notes: You can save faculty time by gathering data from
courses taken by students in multiple programs.Knowledge of the discipline can also be demonstrated
using a discipline-based proficiency exam.
![Page 19: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/19.jpg)
3. Data Source Identification
Outcomes 1 2 3 4BIOB 170IN I BIOB 110CS I HORT 131 I I HORT 105 I ENSC 245IN I I HORT 231 I I HORT 232 I I HORT 225 I I HORT 226 D D HORT 310 HORT 331 D D HORT 335 D D DHORT 336 D M HORT 431 M HORT 432 M D M
![Page 20: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/20.jpg)
4. Set Performance Thresholds
As long as students can “squeak by” and graduate with an overall GPA of 2.001, it is unreasonable to expect every student to demonstrate mastery in every outcome.
Faculty need to decide what constitutes an acceptable performance threshold for each outcome.
Example: At least 80% of students will be rated “Acceptable” or higher on every category of the scoring rubrics.
![Page 21: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/21.jpg)
Example Scoring Rubric
Graduates will have an ability to design a system that meets stated needs.Outcome Category
Unacceptable Marginal Acceptable Exceptional
Clearly articulated need that is to be addressed by the design.
No need is indicated.
Need stated incompletely or ambiguously.
Statement of need is made, but some improvement is possible.
Clearly articulated statement of need.
Does the proposed design meet the need?
No evidence that the proposed design will meet the stated need.
Reader must infer how the design will meet the need.
It is apparent that the design will meet the stated need, but some improve-ments are possible.
The utility of the design in meeting the stated need is well communicated as part of the presentation.
Has the group assembled a logical and practical sequence of integrated unit operations?
The proposed design cannot achieve the intended result.
The proposed design will likely work, but design has significant shortcomings.
The proposed design appears to be a reasonable approach to accomplishing the intended task.
The proposed design exhibits a high degree of innovation.
![Page 22: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/22.jpg)
5. Schedule for Assessing Each Outcome
Outcome
Year2014
2015 2016 2017 2018 2019
1 X X
2 X X
3 X X
4 X X
![Page 23: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/23.jpg)
6. Process for Using Assessment Data
1. Data is collected from identified courses.2. Samples are scored by two faculty members
using prepared scoring rubrics.3. The assessment coordinator tabulates the scores.4. The scores are presented to the faculty for
assessment.5. The faculty reviews the assessment results, and
makes decisions on how to respond.6. A report summarizing the year’s assessment
activities and faculty decisions is submitted to the Provost’s Office.
![Page 24: MUS ASSESSMENT WORKSHOPS R. W. Larsen, 2014 Program Assessment Plans Step by Step This presentation and handouts are available at:](https://reader036.vdocuments.net/reader036/viewer/2022081602/551bf5f85503469e4f8b4688/html5/thumbnails/24.jpg)
7. Submit Assessment Plan
Once you have an assessment plan with essential elements:
Program learning outcomesIdentified data sourcesSchedule for assessing each outcomeProcess for using assessment data
then submit your completed plan to the Provost’s Office – and start working the plan.