implementing milestones: historical context, competency based medical education, and outcomes
DESCRIPTION
Implementing Milestones: Historical context, competency based medical education, and outcomes. August 6, 2013 Felix Ankel, MD. http://www.youtube.com/watch?v=Qy1dpLmJTrY&feature=related. All, - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/1.jpg)
Implementing Milestones:Historical context, competency based medical
education, and outcomes
August 6, 2013Felix Ankel, MD
![Page 3: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/3.jpg)
![Page 4: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/4.jpg)
http://www.youtube.com/watch?v=Qy1dpLmJTrY&feature=related
![Page 5: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/5.jpg)
All,We recently had a case where an intern, when asked by the nurse taking care of a patient with a NSTEMI, said it was okay for the patient to go to the bathroom off monitor. You guessed it; the patient subsequently was found in arrest in the bathroom. In our reactionary culture, some of our faculty are advocating for all decisions to go through the 3rd year resident and to make sure the intern doesn’t make decisions that adversly affect patient care. So, the questions for the collective:
• Do you have a formal statement about what interns are allowed to do?
• If not formally, do you have a process of what interns are allowed to do?
• Are the nurses the “determiners” of who to go to?
![Page 6: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/6.jpg)
www.wordle.net
![Page 7: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/7.jpg)
Macrotrends
Hierarachies
Story
Function
Individual Experts
Design
Autonomy, Mastery, Purpose
Competency
Wisdom of crowds
Networks
Argument
Carrots and Sticks
Knowledge
![Page 8: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/8.jpg)
MilestonesPC1: Emergency StabilizationPC2: Performance of Focused History & Physical ExamPC3: Diagnostic StudiesPC4: DiagnosisPC5: PharmacotherapyPC6: Observation and ReassessmentPC7: DispositionPC8: Multi-tasking (Task-switching)
![Page 9: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/9.jpg)
MilestonesPC9: General Approach to Procedures
PC10: Airway Management
PC11: Anesthesia and Acute Pain Management
PC12: Other Procedures: Ultrasound (Diagnostic / Procedural)
PC13: Other Procedures: Wound Management
PC14: Other Procedures: Vascular Access
![Page 10: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/10.jpg)
Milestones• MK - Medical Knowledge• PROF1 - Professional values• PROF2 - Accountability• ICS1 - Patient Centered Communication• ICS2 - Team Management • PBLI - Practice Based Performance Improvement• SBP1 - Patient Safety• SBP2 - Systems-based Management• SBP3 - Technology
![Page 11: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/11.jpg)
![Page 12: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/12.jpg)
![Page 13: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/13.jpg)
Dreyfus model of skill acquisition
![Page 14: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/14.jpg)
Dreyfus model of skill acquisition
![Page 15: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/15.jpg)
Dreyfus model of skill acquisition
![Page 16: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/16.jpg)
Next Accreditation System
16
Continuous Oversight &
Improvement Emphasis
Milestone Reporting
(semi-annually)
Case LogsResident &
Faculty OpinionsProgram &
Institutional Information
![Page 17: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/17.jpg)
Overall Milestone Project Goal
17
Obtain outcome measures (i.e., milestones of competency
development) to use as evidence of programs’ educational effectiveness
![Page 18: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/18.jpg)
“Early Adopters”
Emergency Medicine
Internal Medicine
NeurosurgeryOrthop
edics
Pediatrics
Radiology
Urology
![Page 19: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/19.jpg)
Emergency Medicine Firsts• Developed and completed Milestones in 5 months
– Approved by ABEM BOD 1/2012, and by RRC-EM 2/2012
• Based on Milestone progress, EM invited into NAS trial rollout July 2013
• Milestones are truly along a continuum of end of medical school to certification standards– Only specialty to take ABMS certification standards and apply to Milestones
• Milestones are based on extensive survey data related to ABEM certification standards
• Only specialty allowed to make revisions in program requirements– Only specialty to integrate the Milestones into proposed program requirement
changes
![Page 20: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/20.jpg)
Uniformity of Milestone Reporting• 5 levels of proficiency
– Novice, Beginner, Competent, Proficient, Expert• Level 4 - The ABEM certification standard
– By definition where an individual should be at time of graduation
• Level 5 - Attained after practice• Narrative anchors• Based on knowledge, skills and abilities (KSAs)• Balance between
– Deconstruction (microtasks)– Integration (complex performance)
![Page 21: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/21.jpg)
What are the characteristics of a highly functioning CBME system?
![Page 22: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/22.jpg)
Carraccio C, Wolfshtal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from Flexner to competencies. Acad Med 77(5):361-367. p 362.
Structure- and process-based
Competency-Based
Driving Force: Curriculum Content Outcome
Driving Force: Process Teacher Learner
Path of learning Hierarchical Non-hierarchical
Responsibility for content Teacher Student and teacher
Goal for educational encounter Knowledge acquisition Knowledge application
Program completion Fixed time Variable time
![Page 23: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/23.jpg)
![Page 24: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/24.jpg)
Carraccio C, Wolfshtal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from Flexner to competencies. Acad Med 77(5):361-367. p 362.
Structure- and process-based
Competency-Based
Driving Force: Curriculum Content Outcome
Driving Force: Process Teacher Learner
Path of learning Hierarchical Non-hierarchical
Responsibility for content Teacher Student and teacher
Goal for educational encounter Knowledge acquisition Knowledge application
Program completion Fixed time Variable time
![Page 25: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/25.jpg)
![Page 26: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/26.jpg)
Carraccio C, Wolfshtal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from Flexner to competencies. Acad Med 77(5):361-367. p 362.
Structure- and process-based
Competency-Based
Driving Force: Curriculum Content Outcome
Driving Force: Process Teacher Learner
Path of learning Hierarchical Non-hierarchical
Responsibility for content Teacher Student and teacher
Goal for educational encounter Knowledge acquisition Knowledge application
Program completion Fixed time Variable time
![Page 27: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/27.jpg)
![Page 28: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/28.jpg)
Carraccio C, Wolfshtal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from Flexner to competencies. Acad Med 77(5):361-367. p 362.
Structure- and process-based
Competency-Based
Driving Force: Curriculum Content Outcome
Driving Force: Process Teacher Learner
Path of learning Hierarchical Non-hierarchical
Responsibility for content Teacher Student and teacher
Goal for educational encounter Knowledge acquisition Knowledge application
Program completion Fixed time Variable time
![Page 29: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/29.jpg)
![Page 30: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/30.jpg)
Microsystem success and assessment system correlates
Microsystem success characteristic
Assessment system correlates
Information and information technology
Portfolio, preferably electronic
Leadership of microsystem Clerkship and program directorsMacrosystem support of microsystem
Support and resources from department chair and institution
Patient focus Appropriate clinical experiences; measuring patient experience
Staff focus Faculty development in assessment; involvement of non-physicians in assessment
Interdependence of care team Working in interdisciplinary teams; teamwork competence
Process improvement Continuous quality improvement of assessment methods and training tools
Education and training Competency-based; developmental clinical experiences; milestones and benchmarks
Performance results Outcomes of training; at minimum, competence needed to advance to next stage
![Page 31: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/31.jpg)
![Page 32: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/32.jpg)
![Page 33: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/33.jpg)
![Page 34: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/34.jpg)
![Page 35: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/35.jpg)
![Page 36: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/36.jpg)
![Page 37: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/37.jpg)
![Page 38: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/38.jpg)
![Page 39: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/39.jpg)
![Page 40: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/40.jpg)
![Page 41: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/41.jpg)
![Page 42: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/42.jpg)
![Page 43: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/43.jpg)
![Page 44: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/44.jpg)
![Page 45: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/45.jpg)
![Page 46: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/46.jpg)
![Page 47: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/47.jpg)
![Page 48: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/48.jpg)
• EM used as pilot specialty in NAS– Began July, 2013
• Integration of Milestones into EM Program Requirements– A first!
• Development of assessment methodology– Specialty-wide implementation of assessment methods?
JMTF?
Next Steps
![Page 49: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/49.jpg)
![Page 50: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/50.jpg)
50
Next Accreditation System
![Page 51: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/51.jpg)
![Page 52: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/52.jpg)
Reliabilities across methodsslide created by Cees van der Vleuten 2012
TestingTime inHours
1
2
4
8
MCQ1
0.62
0.76
0.93
0.93
Case-BasedShort
Essay2
0.68
0.73
0.84
0.82
PMP1
0.36
0.53
0.69
0.82
OralExam3
0.50
0.69
0.82
0.90
LongCase4
0.60
0.75
0.86
0.90
OSCE5
0.47
0.64
0.78
0.88
1Norcini et al., 19852Stalenhoef-Halling et al., 19903Swanson, 1987
4Wass et al., 20015Petrusa, 2002
![Page 53: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/53.jpg)
![Page 54: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/54.jpg)
![Page 55: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/55.jpg)
![Page 56: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/56.jpg)
![Page 57: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/57.jpg)
![Page 58: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/58.jpg)
![Page 59: Implementing Milestones: Historical context, competency based medical education, and outcomes](https://reader035.vdocuments.net/reader035/viewer/2022081520/568168b3550346895ddf81b3/html5/thumbnails/59.jpg)
Macrotrends• From hierarchies to networks (CoP)• From individual experts to wisdom of crowds (CCC)• From knowledge to competency (CBME)• From carrots and sticks to autonomy, mastery, and
purpose (Dreyfus and Dreyfus)• From function to design (CLER visit)• From argument to story (narrative anchor)