uso de osces en evaluación - unam · uso de osces en evaluación john (jack) r. boulet, ph.d....
TRANSCRIPT
![Page 1: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/1.jpg)
Uso de OSCEs en Evaluación
John (Jack) R. Boulet, Ph.D.Foundation for Advancement of International Medical Education and
Research
Jornadas de Educación Médica 2010“Educación por Competencias: Cambio de Paradigma”
FAIMER®
“Educación por Competencias: Cambio de Paradigma”
Universidad Nacional Autónoma de MéxicoFacultad de Medicina UNAM
February 2010
![Page 2: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/2.jpg)
Objective Structured Clinical Examination
� Series of short stations� Candidate assessed on � Candidate assessed on
same content� Multiple evaluators� Standardization
� Conditions
FAIMER®
� Conditions� Scoring tools
![Page 3: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/3.jpg)
OSCE� Objective
� All candidates assessed with same content and marking schememarking scheme
� Structured� Stations have a specific task or tasks� Detailed scripts for standardized patients� Candidate instructions
FAIMER®
� Clinical Examination� Measures applied clinical and theoretical
knowledge� Post-encounter exercises
![Page 4: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/4.jpg)
OSCE Content?
� Standardized or “real” patients
� Mannequin� Part-task trainer
� Haptic models
� Computer-based
FAIMER®
� Computer-based case simulation
� Hybrid models
![Page 5: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/5.jpg)
Assessment OSCEs in Medicine� United States Medical Licensing Examination (USMLE™)
� Step 2 CS (ECFMG Clinical Skills Assessment)� Step 3
� National Board of Osteopathic Medical Examiners� National Board of Osteopathic Medical Examiners� Medical Council of Canada� General Medical Council (UK)
� Professional Linguistics and Assessment Board� Various specialty board examinations
� American Board of Emergency Medicine� American Board of Internal Medicine
� Royal College of Physicians and Surgeons of Canada
FAIMER®
� Royal College of Physicians and Surgeons of Canada
� Dillon, G.F., Boulet, J.R., Hawkins, R.E. & Swanson, D.B. (2004). Simulations in the United States Medical Licensing Examination™(USMLE™). Quality & Safety in Health Care, 13(Suppl 1), i41-i45.
![Page 6: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/6.jpg)
Standardized (Simulated) Patients Examinations
� Performance-based� “Standardized”� “Standardized”
� Same conditions for all test takers
� Individuals trained to portray patients with specific conditions
FAIMER®
specific conditions� Chest pain� Depression� Shortness of breath
![Page 7: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/7.jpg)
Performance Measures� Link measures to scenario
events� Focus on observable � Focus on observable
behaviors� Incorporate multiple
measures from different sources
� Capture performance
FAIMER®
� Capture performance processes in addition to outcomes
![Page 8: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/8.jpg)
Types of Scores� Explicit Process
� Checklists� Key actions� Key actions
� Implicit Process� Rating scales
� Timing� Sequencing
� Explicit outcome
FAIMER®
� Explicit outcome� Patient status� Complications, etc.
![Page 9: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/9.jpg)
Why are OSCEs Important for Assessment?
� Assessment drives learning� Efficient� Efficient
� large numbers of ‘examinees’
� Provides clinical exposure� Clinical skills assessment
� Practice-based learning� Tailored feedback
FAIMER®
� Tailored feedback
� Quickly identify curricular problems
� Patient safety
![Page 10: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/10.jpg)
Competencies Assessed with OSCEs
� Knowledge� Communication�� Counseling� Crisis management� Procedures� Physical examination� Medical decision making
FAIMER®
� Medical decision making� Leadership� Teamwork� Interviewing
![Page 11: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/11.jpg)
Important OSCE Issues� Standardization of
conditions an content�� Choice of tasks
� Generalization
� Training� Raters, SPs
� Scoring
FAIMER®
� Scoring� QA
� Standards
![Page 12: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/12.jpg)
Content Under-representation� Some conditions cannot be simulated very well
� Not as important for basic skills� Programming for mannequins is imperfect� Programming for mannequins is imperfect� “Real” patients can vary over time
FAIMER®
![Page 13: Uso de OSCEs en Evaluación - UNAM · Uso de OSCEs en Evaluación John (Jack) R. Boulet, Ph.D. Foundation for Advancement of International Medical Education and Research Jornadas](https://reader030.vdocuments.net/reader030/viewer/2022011802/5b5315d37f8b9ab2698b5884/html5/thumbnails/13.jpg)
Consequences of Testing� Candidate self-selection / preparation
� want to learn� specialized preparation courses� specialized preparation courses
� Changes in curriculum� Development of training centers
FAIMER®