Utilizing Multiple Grader Rubrics for Practical
Assessment of Student Performance
Sherry Jimenez, Ed.D.Assistant Dean for Educational Development
Sarah Zahl, Ph.D.Director of Educational Assessment
Agenda• Audience Response• MUCOM Brief Overview • Multiple Grader Rubrics
o Assessment Types and Exampleso Tracking outcomes in rubrics
• Recommendations• Q&A
Poll Question 1
• Indicate the discipline in which you are or will be utilizing ExamSoft– Dental– PA– Pharmacy– Nursing– Medicine– Podiatry– Other
Poll Question 2
MU-COM Overview• Competency Based Curricular Design• Systems based/integrated curriculum
o Course Director, multiple internal faculty and external clinicians
o e.g. Cardiovascular course + OSCE• iPad exclusive• Building a culture of evidence among
faculty/students/administrators
Tracking Student Performance
• Competencies• COMLEX blueprint• System• Discipline• Learning Domains• Course specific outcomes
National Board of Osteopathic Medical Examiners
Fundamental Osteopathic Medical Competencies
COMLEX Blueprint
Use of Rubrics• Lab Practicals: Osteopathic Manipulative Medicine
(OMM) Lab • Simulations• Objective Structured Clinical Examinations (OSCE)• Small Group Evaluations: Clinical Medicine
Small Group Evaluations
Small Group Evaluations – Grading
Process
Small Group Evaluations – Grading
Process
• Complete the administrative planning process externally before using ExamSoft
• Pre-assign faculty graders and students• Pre-assign assessment area (region)• Prepare extra materials and guides• Communication
OSCE• Humanistic rubric, SOAP note, SP evaluation, self-
assessment
Lab Practicals• Paper Very complex online process
streamlined process in ExamSoft
Old process: multiple stations, partner flip, multiple regions, multiple graders and students at each station
New process: one station, partner flip only, one region (pre-determined but surprise to student)
Outcomes• Culture shift –modifying structure • Positive feedback – ease of evaluation• Immediate faculty feedback – inter-rater • Timeliness of student feedback• Pairing rubric data with written exam data to
develop longitudinal reports • Continuous refinement
Parting Thoughts• How are you currently assessing student
performance in practical settings?
• How could you incorporate multiple grader rubrics in your curriculum?
Q&A• Questions?
• Discussion
Click to edit Master title style
Click to edit Master subtitle styleFor More Information:
Call: 1.866.429.8889
Email: [email protected]
Visit: learn.examsoft.com