help! we have assessment data october 2009
DESCRIPTION
The focus of assessment has permeated our lives and, in that, we have been on a mission to collect data to demonstrate students are learning. So now what? Was the data collected as useful as you thought it would be? Did you or your faculty change their courses, programs, or teaching strategies based on the data? Join us to discuss if what we collect is chaos or making a difference. Presenters: Gil Linne, Dean, College of Social Sciences, University of Phoenix (AZ), and Beth Patton, Associate Dean, College of Natural Sciences, University of Phoenix (AZ).TRANSCRIPT
HELP!WE HAVE ASSESSMENT DATA
Beth Patton, Associate DeanCollege of Natural Science
Gil Linne, DeanCollege of Social Science
PROGRAM EXAMPLES
HEALTH
ADMINISTRATION
MASTER OF SCIENCE IN COUNSELING DEGREE
HEALTH ADMINISTRATION
PROGRAM OUTCOMES
ASSESSMENT DATA
CURRICULUM CHANGE
ASSESSMENT DATA MEASURES
Identified six program outcomes and specific performance criteria for each outcome
Three measures were selected to assess each program outcome
GRADESGRADES
ASSIGNMENTSASSIGNMENTS
STUDENT/ALUMNI SURVEYSTUDENT/ALUMNI SURVEY
COURSE GRADES
Six courses best aligned to program outcomes
Course grades reflect the faculty perspective of student performance and learning
Course grades are a quasi-direct measure of learning
COURSE GRADE SCORES
COURSE ASSIGNMENTS
Six specific assignments were identified as closely aligning with each program outcome
Assignment grades also reflect the faculty perspective of student learning
Assignment grades are considered a direct measure of learning
COURSE ASSIGNMENT SCORES
STUDENT OUTCOMES SURVEY
Survey provides information on the student perception of program effectiveness
Survey reflected the performance criteria for each outcome
Survey initially sent to 267 recent MHA graduates
Response rate of 20.6 % Survey will also be embedded in the
capstone course
STUDENT SURVEY DATA
COUNSELING ASSESSMENT
COGNITIVE MEASURES.
Counselor Preparation Comprehensive Examination (CPCE)
Measures a student’s knowledge of counseling content
Program Benchmark – 75
125.00100.0075.0050.0025.00
120
100
80
60
40
20
0
Fre
qu
ency
14
61
124
34
2
Mean =72.9867Std. Dev. =13.52643
N =226
Counselor Preparation Comprehensive Examination Scores
AFFECTIVE MEASURES
Academic Alignment Review Process (AARP) Student Survey
Students respond to questions related to – Alignment of objectives Effectives of learning content Effectiveness of Instruction
5.004.003.002.001.00
500
400
300
200
100
0
Fre
qu
en
cy
496
89192
Mean =4.4035Std. Dev. =0.62257
N =606
Student Academic Quality Survey - Curriculum Effectiveness Composite Item
Six Item Composite - Rating of Effectiveness: 5 = Completely
to 1 = Not At All
PERFORMANCE MEASURES
Measurement of clinical performance determined by-
Site supervision evaluations of practicum
Internship performance evaluations
1
5
24
8
2
5.004.003.002.001.00
25
20
15
10
5
0
Fre
qu
en
cy
Mean =4.3828Std. Dev. =0.52683
N =40
Internship Evaluations by Site Supervisors
ASSESSMENT DATA
SO NOW WE HAVE DATA – WHAT NEXT?
DISCUSSION
POINT OF ASSESSMENT IS TO BEGIN DISCUSSING THE FINDINGS………….What should we be looking at?What needs further review?