he course and module evaluation conference - shaun mcgall & marie salter
TRANSCRIPT
Responding to our students: Integrating the VLE and student records system to improve the course and module evaluation experience
Aims of the workshop
• Understand the institutional drivers for
the development of an integrated online
unit evaluation tool at the University of
Bath
• Understand how data from unit
evaluation on individual academic staff
members informs academic staff
development and promotions
• Understand the importance placed on
closing the feedback loop at the
University of Bath and how this reflects
on and enhances our wider student
experience
University of Bath
Background – How we got here
University of Bath
• Pre-2006/7: Mixed economy
• Paper
• Scanning
• ad hoc
• Teaching Development Fund bid
2006/7
• Pilot with two departments
• Based on our SITS student
record system
• Initial tool developed
• Four core questions with
optional questions at
programme / department
level
• Pilot results
• Increase in open comments
but perceived decline in
response rates
• Rolled out across all departments
University of Bath
Background – How we got here
• Lack of standardisation across
Departments and Faculties
• Similar questions
• Duplication
• Patchy feedback loop
• Response Rates
• Further guidance developed
by LTEO (e-Learning and
Student Learning
Experience and Quality)
• Concerns raised through Annual
Monitoring Reports about currency
of the four core questions, and lack
of closure on feedback loop (via
Faculty LTQCs)
University of Bath
Students’ Union led review of OUE in 2010/11
• Undertaken by the Learning and
Teaching Enhancement Office
• Supported by Students’ Union
• Integrate with VLE (Moodle)
• Expand Core questions (additional
open comments)
• Include named, individual members of
staff (linked to academic promotion)
• Improve closing of the feedback loop
• Approved through committee system
• ULTQC
• Senate
University of Bath
Review of Unit Evaluation 2011/12
How did we do this?
• Project team set up
• Comprising Computing
Services and LTEO
• Looked at alternative solutions
• Ran focus groups (students /
professional services /
academics)
• Feedback received
• Good idea
• Moodle link (and single sign-
on)
• Mobile friendly
• Closure of Feedback loop
• Reduce multiple / ‘spam’
reminder emails
University of Bath
Project team outputs
• Linked SAMIS with Moodle through
new block
• Personalised
• Highlighted current evaluations and
those completed
• Provided link to feedback from
previous years and Better@Bath
• Incentivised completion of
evaluations
• Merged emails to remove multiple /
‘spam’ reminders
University of Bath
University of Bath
University of Bath
Project team outputs
University of Bath
• Increased core questions from four to
ten
• Where multiple staff involved, each
member of staff is evaluated on their
teaching (required for promotion on
teaching track)
However development of mobile friendly /
responsive pages didn’t happen
Results of changes on Response Rates in 2013/14
• Semester One Units
• 12% increase to 49%
• Semester Two Units
• 11% increase to 41%
• All-year long Units
• 10% increase to 39%
• Range and variation by both Department
and Programmes
University of Bath
Subsequent developments
• Move to Mobile
• Evaluation area used as pilot
for improving mobile
friendliness of SAMIS on the
Web
• Live in October 2014
• 2014/15 Semester One Units
• Partial results in
University of Bath
Next steps
• Develop Core question sets for different
types of units
• Work Placements / study Year
Abroad
• Distance learning
• Potentially other types e.g.
seminars / lectures
University of Bath
Conclusion
• Seen why and how we did it
• Why it's important for our staff
• Student access to feedback much
improved
• Developed KPI to meet indictor within
QAA UK Quality Code Chapter B5
Student Engagement
• University highlights those
Units not complying to
students via VLE
• Monitoring by new Student
Engagement Sub-committee
University of Bath
Contact details:
Marie Salter,
E-Developments Manager,
E-Learning, LTEO
t: +44 (0)1225 386146 @marie_s
Shaun McGall,
Student Engagement and Quality
Enhancement Officer,
Student Learning Experience and
Quality, LTEO
t: +44 (0)1225 383848 @shaunmcgall
www.tinyurl.com/uob-evaluation
University of Bath
Any questions?