Download - Use of Simulation in MOC
![Page 1: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/1.jpg)
Use of Simulation in MOC: NOT Ready for Prime TIME
Dr Kevin Lachapelle Adair Chair in Surgical Education
9th Annual Meeting of the ACS-AEI Consortium
![Page 2: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/2.jpg)
![Page 3: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/3.jpg)
![Page 4: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/4.jpg)
High Stakes Simulation for MOC: Not Ready for Prime Time
• 1) What problem?
• 2) Little Data on Simulation for MOC
• 3) Simulation good for Formative Assessment, less for Summative Assessment
• 4) Needs to be aligned with Scope of practice/patient outcomes
• 5) Mandatory does not equal Buy in
• 6) Logistics and Cost
![Page 5: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/5.jpg)
Problem?
![Page 6: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/6.jpg)
![Page 7: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/7.jpg)
STS Database
• 1 500 000 patients subjected to CABG 2000-2009
• predicted mortality 2.4%
• Observed mortality 2.4% to 1.9%
• Reduction in
• Stroke
• haemorrhage
• sternal wound infection
![Page 8: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/8.jpg)
• 2000 complaints
• 200 physician interviews
• 3% of files result in disciplinary action
• communication
• sexual
![Page 9: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/9.jpg)
Data on Simulation in MOC
![Page 10: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/10.jpg)
• Association Between Licensure Examination Scores and Practice in Primary Care
R Tamblyn JAMA 288(23) 2002
• Association Between MOC Examination and Quality of Care for Medicare Beneficiaries
E Holmboe Archives Internal Medicine 168 (3) 2008
![Page 11: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/11.jpg)
• American Association of Anesthesiology
• American Board of Internal Medicine
• Interventional Cardiology
Experience with Mandatory Simulation
![Page 12: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/12.jpg)
• Learner outcome of Anesthesiologist SBE for MOC
• 8 studies
• Most Kirkpatrick 1, no comparison to other methodologies
![Page 13: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/13.jpg)
“There is a paucity of empirical data that support the use of simulation for certification of trainees and practicing surgeons”
![Page 14: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/14.jpg)
Simulation, Learning and Assessment
• What do we know ( we think)
![Page 15: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/15.jpg)
JAMA. 2011;306(9):978-988
• Screen 10903 articles • 609 articles • Pre-test, intervention, post-test with a
comparison group • 35 000 participants. • Knowledge, skills, behaviour, ? Patient
outcome
![Page 16: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/16.jpg)
Meta-analysis
• Majority in SimCentre • Majority Novice/beginner
• Students 27% • Residents 24.7% • Nursing 11.8% • Physicians 16.2%
• Technical skills 67%
![Page 17: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/17.jpg)
17
![Page 18: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/18.jpg)
![Page 19: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/19.jpg)
![Page 20: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/20.jpg)
![Page 21: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/21.jpg)
FLS + FLS - Surgeon Age 38.2 50.4 Rate of BDI 0.47% 0.14%
![Page 22: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/22.jpg)
• Simulator For Assessment
• Specifically validated for purposes of assessment
• Distinguish Beginner, Intermediate, Fully trained, Expert
• Correlate with actual clinical outcome
![Page 23: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/23.jpg)
Impact of New Technologies ?
• Virtual reality
• 3D printing
• Live Tissue
![Page 24: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/24.jpg)
Scope of Practice
• Changes during career
• Narrows, more specific
• Focus on Patient outcomes
• Work-based Assessment
• Shows competency, performance gaps
![Page 25: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/25.jpg)
![Page 26: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/26.jpg)
![Page 27: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/27.jpg)
Tyranny of Mandatory
• Buy in equals success
• build on successful projects
![Page 28: Use of Simulation in MOC](https://reader031.vdocuments.net/reader031/viewer/2022012012/6157dac1ce5a9d02d46fdba5/html5/thumbnails/28.jpg)
Logistics and Cost
• 77 000 Canadian Physicians
• Impact? ( one sim activity /year)
• Capacity? ( Sim Centre across Canada)
• Cost $156 000 000!