ross mcmillan vps assessment snapshot
DESCRIPTION
Presentation by Ross McMillan based on a survey of senior leadership in Division of Students at York University. Along with findings, survey points to future direcTRANSCRIPT
1
VPS AssessmentSnapshot of Aptitude, Attitude and Future Direction
March 15, 2012 – Divisional Directors Meeting
2
Self Assessment is Key
3
Overview
• Purpose was to have an outline of current assessment activities as well as help determine barriers and priorities
• Survey of senior leadership in Division of Students
• 26 respondents
4
Support for Assessment and Data
Strongly Agree Somewhat Agree
Neither Agree Nor Disagree
Somewhat Disagree
Strongly Disagree
0.00%
5.00%
10.00%
15.00%
20.00%
25.00%
30.00%
35.00%
40.00%
45.00%
50.00%
Assessment is supported within the DivisionDepartment regularly uses data for planning and de-cision-makingDivision uses data for planning and decision making
5
Please rate the quality of your own assessment work
Excellent Good Average Below Average Poor0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
6
Please Rate Your Level of Proficiency - Conducting
Extremely Very Moderately Slightly Not at all0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
Q8- Creating Survey Ques-tions
Q9- Conducting focus groups
Q10 - Conducting statistical analyses
Q14 - Writing learning outcomes
7
Please Rate Your Level of Proficiency - Using
Extremely Very Moderately Slightly Not at all0.00%
5.00%
10.00%
15.00%
20.00%
25.00%
30.00%
35.00%
40.00%
45.00%
Q11 - Interpreting results
Q12 - Explaining results
Q13 - Using results to improve programs and services
8
Please Rate Your Level of Proficiency – StudentVoice Assessment Tools & Resources
Extremely Very Moderately Slightly Not at all0.00%
5.00%
10.00%
15.00%
20.00%
25.00%
30.00%
35.00%
40.00%
45.00%
9
Top 5 Barriers or Challenges
Self (Directors) Department Staff
1 Limited Time Limited Staff
2 Limited Staff Limited Time
3 Limited Financial Resources Limited Assessment Expertise
4 Limited Assessment Expertise Limited Financial Resources
5 Not knowing what types of data to collect
Not knowing what types of data to collect
10
Training Priorities
• Benchmarking
• Basic Assessment Overview
• Choosing Appropriate Methods for Data Collection
• Developing learning outcomes and objectives
• Effective Reporting
• Survey Design and Implementation
11
Survey Conclusions
• Overall, respondents believe assessment activity is valued as as a department and division
• Moderate ability to conduct assessment activities
• Stronger ability to understand and interpret data for decision making
• Big gap in knowledge and use of Student Voice
• Barriers are similar amongst directors and staff
• Training, comfort and staff resources are key
12
Next Steps – Future Direction 1. Support
• Met with most Directors on possible top tier projects
• Model of direct assistance versus passive persuasion
• Assessment project template complete
• Alignment of assessment projects to IRP and White Paper priorities
2. Training
• Dedicated Webinars with Vennessa from Campus Labs focused on on Baseline 101 and Benchmarking
• Additional dedicated webinars on identified areas of need
13
Next Steps – Future Direction 3. Communications
• VPS Assessment website in development
• Sharing of assessment projects at Divisional Directors meetings
• Monthly Brown Bag series showcasing assessment work that is being done in Division (special invite based on content)
• You Said It, We Did It, We’re Listening campaign
4. Learning Outcomes
• Process to identify, develop &map outcomes