oira / it november 2014 instructor course evaluation (ice) instructors’ manual
TRANSCRIPT
OIRA / IT
November 2014
Instructor Course Evaluation
(ICE)Instructors’ Manual
The Blue Experience• Assesses the students’ evaluations of the instructor, the
course, and learning outcomes.• OIRA in collaboration with IT implemented a new ICE
application (Blue Evaluations) , acquired from
• “eXplorance is a leading provider of Learning Experience
Management (LEM) solutions for higher education, corporate training and organization management”
• “eXplorance develops enterprise-Course web-based software that helps educational institutions achieve a competitive advantage through effective collection mechanisms of critical organizational information, flexible departmental processes, as well as enhanced enterprise communication” – source: eXplorance
• All AUB requirements, and in particular the Confidentiality, were respected
Blue Highlights (source: eXplorance)
• Blue is: A web based information gathering, sharing and analysis software, and reporting tool for: Blue/ Course Evaluations Blue/360 Performance Appraisal Blue/Surveys Blue/Tests
• Blue is 100% Web-based, allowing: Security. Ensure privacy and confidentiality of all data Ease of access for every authorized user (any browser, any input device) Integration with existing data sources and IT
infrastructure Synchronization with authentication infrastructure (i.e.
Login access via your existing employee/ student portal) Branding needs (example: Logos, customized reports
headers)3
Blue Highlights
• Blue enables instructors to add a pool of optional questions (restricting to a maximum of 3, now)
• Supports team taught courses, cross listed courses, etc.
• Can be leveraged to power mid-term reviews, i.e. provide formative evaluation
• Provides live access to response rate information
• Text Analytics option for open-ended comments (to be implemented at a later stage)
4
Overview of Definitions - (source: eXplorance)
5
Question Personalize (QPs)
• Instructor(s) are given the option of adding personalized evaluation questions (up to 3 for the time being)
• The personalized questions will be added by Instructors at the end of the standard ICE
• The evaluation scales will follow the ICE scales.
• For the time being no additional open ended (no comments) questions will be added by Instructors
https://oirablue.aub.edu.lb/Blue/sqvg-eng.aspx?lang=eng&pid=e820314b-44dc-44fa-bac3-3fc898c42767&tid=f07cbedb70a246d9f3f91795fd0650bb&uid=2cf216dda0201b2a8d5091d42ac8e74f®l=en-us
6
Reports & Analysis• Provides permanent report repository• Report Types
Individual instructor report Aggregate reports based on existing instructor
demographics Comparative reports at individual or aggregate levels
• Report Blocks Analysis block on response
Frequency, Score, Aggregate frequency Graphics, tables, statistics Norms, averages Summary, gap analysis, response rates.
Analysis block on demographics Cross tabulation
Response to Demographic7
Text Analytics• Text Analytics report blocks are designed
to produce a clear and concise visualization of freeform open ended feedback Uses powerful algorithms that examine the
content of freeform comments provided by raters and based upon the assigned dictionary it attempts to place the comments into predefined themes established in the dictionary
The themes with the highest number of comments are added to the report
Can be reported as frequencies, charts, clouds, and trends. 8
9
10
11
Timelineo Faculty Presentation November 5.o Faculty add items (max of 5), November 5-
14.o Student Presentation, November 11.o Go Live Date – Fall 2014-15
(November 17)o User Manuals and Guidelines are
availableo Access is through AUB NetDB, and fully
securedo System closed Midnight of December
9-10.o Grade Hold for students who have not
completed their evaluations.o Reports will be released early January,
2015.
12
Project Timeline
13
Initiating email instructing Faculty Members to add additional questions
14
From: Blue Srvc <[email protected]>Date: October 31, 2014 at 22:18:47 GMT+2To: Karma El-Hassan <[email protected]>Subject: Fall 2014-15 On-Line Instructor Course Evaluation (ICE) - Personalized Additional QuestionsReply-To: Oira Oira <[email protected]>
Dear Faculty member,
OIRA is in the process of launching the Fall 2014-15 on-line ICE evaluations, kindly review the ICE questionnaire and feel free to add up to three additional questions if you feel the need to do so.
To add the additional questions you can go to the following link. and then follow the instructions.
Kind regards,Dr. Karma El Hassan, DirectorOffice of Institutional Research & Assessment (OIRA)
15
Form reviewing the Personalized Questions update
Click ‘Preview’ to view ICE Items and ‘Edit’ to add, edit, or review the personalized questions
16
17
Once Entered the Additional Items, Update
QP Deadline Expiry
18
Responses (and Reports)
• To access the Response Rates and Reports
• Access the Blue Application using AUB username and password
http://oirablue.aub.edu.lb/blue• Select Dash Board
19
User Sign-On(http://oirablue.aub.edu.lb/blue)
20
21
Select the required CRN (if multi courses for the term)
22
Response Rate Summary
23
