resident selection · 2019-10-08 · resident selection sharing experiences from using selection...
TRANSCRIPT
Resident SelectionSharing experiences from using selection science to find the best
surgical trainees
Brian J. Dunkin, MD, FACS
TSDA General Session
Disclosure
• Not a selection scientist
Disclosure
• I found someone with whom to collaborate!
Aimee Gardner, PhD
Assistant Dean of Evaluation & Research
School of Health Professions
Associate Professor, Health Professions & Surgery
Baylor College of Medicine
Houston, Texas
Disclosure
• Ownership interest in SurgWise
Let me tell you a story …
Typical file
• USMLE
• ABSITE
• MIS Case Numbers
• Unstructured letters of recommendation
• Unstructured personal statements
• Unstructured CV
Assessment Tools
USMLE / ABSITE / GRADES
Assessment Tools
We do lots of interviews
Assessment Tools
How could we do this better?
Job Analysis
Job Requirements Competencies
Competencies Assessments
Situational Judgment Tests (SJTs)
Personality Profile
• Agreeableness
• Extraversion
• Emotional Stability
• Openness to new experiences
• Conscientiousness
Gardner AK, Dunkin BJ. JAMA Surgery 2017
Course Topic Delivery Method
DidacticsCase-based
Review
Small Group
DiscussionRole Play
Other Active
Learning
Strategies
Part I: Background
Structured Interview Basics x x
Question Development x x
Biases in Interviews x x
Part II: Asking Questions
Getting Complete Responses x x
Types of Interviewing Questions x x
Unacceptable & Illegal Questions x x x x
Taking Notes x x
Part III: Assessment
Assigning Ratings x x x x
Motivational Fit x x
Integrating Data x x
Part IV: Putting it All Together
Interview Day Basics x
Review x x
Technical Skills
• Fast-paced program
• High complexity
• Time-compressed environment
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Could Fit But …
Great Fit
Not A Good Fit
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Structured Interviews Skills Testing
Information on MIS Candidates for Ranking
• SJT• 26 questions
• 130 unique data points
• Personality profile
• 9 competencies interviews
• 3 competencies group
• Technical skills
Results
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Gardner AK, Dunkin BJ. Annals of Surgery 2018
Gardner AK, Dunkin BJ. Annals of Surgery 2018
55 applicants invited to take
online assessment
50 (91%) completed
42 minutes
80%improved
agreement among
interviewers
45%increase in
knowledge of how to conduct
structured interviews
45%higher in how to avoid illegal
questions
Over 50% less interviews
Success!
Competency-based SelectionAimee K. Gardner, PhD