multi source feedback. an essential tool for enhancing
TRANSCRIPT
Multi Source Feedback. An Essential Tool for Enhancing Student Learning and Enriching Future
Education
Presentation to Bluenote EMEA Conference 2018
6-7 November 2018
Esam Agamy
Dean, QA, IE and Accreditation
Hiba Jadallah
Data Analyst
Contents
UoS at a glance
Multi Source Feedback. Concepts and Importance
MSF Implementation at UoS
Lessons Learnt and Recommendations
Contents
UoS at a glance
Multi Source Feedback. Concepts and Importance
MSF Implementation at UoS
Lessons Learnt and Recommendations
0
2
4
6
8
10
12
14
16
97-98 98-99 99-00 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10
1. Shari’a & Law
2. Arts & Sciences
3. Business Admin.
4. Engineering
6. Fine Arts
12. Community
13. Graduate Studies &
Scientific Research
Launching
Khorfakkan
Campus
9. Medicine
10. Dentistry
11. Pharmacy 14. Sciences
Development of University Campuses and Colleges
5. Health Sciences
Launching
Kalba Campus7. Communication
8. Law
University of Sharjah Campuses
Main campusFine Arts & Design
CampusMedical Campus
Community College
Community College
Community College
Community College
Univ. Branch
Community College
Kalba
Diba
Khor Fakkan
Al Malaiha
Sharjah
160 km
Al Dhaid
Academic Programs Offered at the University
Program Level Number
Bachelor 52Undergraduate Diploma 14
Graduate Diploma 01
Masters 21Doctorate 11
Total 99
8
86979199
9694
1083311513
1244813300
1381114325
1507315301
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17 17-18 18-19
Total Enrolled Students
255
448542
693807
1349
11201281
13991464
1837
2050
1753
2041
2285
27082700
0
500
1000
1500
2000
2500
3000
00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17
Graduated Students
The University graduated 26,900 students by the end of 2017/2018
64.4%
39.4%
41.1%
8.3%
10.8%
10.7%
20.3%
40.1%
38.8%
6.9%
9.6%
9.4%
Graduate
Undergraduate
University Total
Enrolled Students by Nationality
UAE GCC Other Arabs Others
University students come from 98
different nationalities10
Medical & Health
Sciences Sector
Fine Arts &
Design Sector
Community College
Sector
Subject Based
Programs Sector
UoS Education Systems according to Curriculum
Structure and Main Delivery Methods
Integrated curricula
PBL/TBL
Clinical rotation
Modules
Creative work
Hands on
experience
Vocational training
Subject based
lectures and
practicals
Almost one
instructor per
subject
Semester wise
Multi instructor
modules
May lat for more
than a year
3 phases program
PBL/TBL weekly
sessions
10 week rotations
Workshops and
practical sessions
Field work
11
Contents
UoS at a glance
Multi Source Feedback. Concepts and Importance
MSF Implementation at UoS
Lessons Learnt and Recommendations
13
(1) formative decisions and feedback
about teaching improvement;
(2) summative decisions and feedback
for merit pay and contract renewal;
and
(3) formative decisions and feedback
about professional behaviors in the
academic setting.
MSF models allow:
14
can be configured for faculty to obtain feedback for
formative and summative decisions on teaching
performance
can be adapted to provide feedback on
professional behaviors of faculty in the academic
as well as clinical setting.
can provide more accurate, reliable, fair, and
equitable decisions than the one based on just a
single source.
15
Multisource ratings Quality feedback
Action plan to Improve Improved
performance
Timely standardized
administration, processing,
interpretation, and feedback the.
Most significant practical concerns
Contents
UoS at a glance
Multi Source Feedback. Concepts and Importance
MSF Implementation at UoS
Lessons Learnt and Recommendations
18
Student senior exit survey
Student satisfaction survey
Alumni survey
Employer survey
Faculty feedback
Accreditation bodies feedback
Advisory boards
External evaluators
Feedback tools
Portfolios used at UoS
Course e-portfolio
Program e-portfolio
Faculty e-portfolio
Field Placement/Practical training/Internship e-portfolio
20
Program e-portfolio
21
22
23
24
Course e-portfolio
25
26
27
28
29
SIS
(Banner)
Course delivery
platform
(Blackboard)
HR
System
(Logsis)
Survey
system
(Blue)
Assessment
Management
System
Administration
(Chancellor, VCs,
Deans, etc.)
Faculty
Staff
StudentsIR tools
(crystal report,
templates,
forms, etc.)
Inte
gra
tion
, re
port
ing,
etc
.
Institutional Effectiveness System
Public
Using IT to stimulate:
• Engagement
• Transparency
• E-portfolios
• Communication
• Effectiveness
• Quality culture
31
Semester 1
Sem. 2
Sem. 3
Sem. 4
Sem. 5
Sem. 6
Sem. 7
Sem. 8
Program Advisory Board
Alumni
Employers
An
aly
sis of o
utco
me a
chiev
emen
t (Institu
tion
al
Resea
rch)
Dev
elo
pm
ent
of
ob
ject
ives
, cu
rric
ulu
m,
tea
chin
g &
learn
ing
to
ols
& m
eth
od
s
Survey
Survey
Consultation
Summative Test
Formative Test
Element
Graduation Project
External Evaluation Reports
Student Exit Survey
Chart for Program Outcomes Assessment
(8 Semester Model)
Internship
Student Portfolio
Course Evaluation by faculty
Course Evaluation by Students
Midterm exam
Quizzes
Project
Report and Essay
Presentation
Tools of Assess/Evaluation
• Artificial
Intelligence
• Computing
• Advanced skills
• Innovation
• Entrepreneurship
• Health care
• Space
UAE National Agenda
CHOICE
INTEG-
RATION
APPLICATION
SYNTHESIS
ANALYSIS
COMMUNICATION
INFORMATION DATA KNOWLEDGE
OUTCOMES
• creativity
• research
• problem solving
• problem identification
• teaching / training
• self learning
• team work
• leadership
INPUTS
• community needs
• user expectations
• experience
• culture
• value
• ethics
• autonomous learning
• team work
• critical approach
ELEMENTS OF HIGHER EDUCATION
ENABLING SKILLS• logic / analysis
• interpersonal
• technical / physical
Integration of:
- Research into curricula
- Teaching/learning/assessment
into curricula
- Information Technology into
curricula and services
- Entrepreneurship and
Innovation into education
Current and Future Education
Interdisciplinary
- Research
- Programs
- Activities
Alumni relations
Supporting Policies and
Procedures
Logistic support services
Current and Future Education
Integration
THANK YOU
39
Characteristics of a good Assessment System
• Linked to student learning outcomes
• Ongoing (Continuous)
• Formative vs. summative balance
• Assessment drives learning/Assessment for learning
• Transparent to all parties concerned
• Engage faculty
• Engage students
• Immediate feedback
• Lead to closing the loop
40
41
Declared
Curriculum
Delivered
Curriculum
Learned
Curriculum
Gap in curriculum design/delivery/learning
What we assume/claim student learn What is actually presented
What student actually learn
42
Declared
Curriculum
Delivered
Curriculum
Learned
Curriculum
More overlap is needed
What we assume/claim student learn What is actually presented
What student actually learn