acgme milestones; putting cbme into context

25
Douglas Char, MD FACEP FAAEM CORD Academic Assembly March 2013

Upload: vivi

Post on 19-Jan-2016

129 views

Category:

Documents


0 download

DESCRIPTION

ACGME Milestones; putting CBME into context. Douglas Char, MD FACEP FAAEM CORD Academic Assembly March 2013. A Brave new world…. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: ACGME Milestones; putting CBME into context

Douglas Char, MD FACEP FAAEMCORD Academic Assembly

March 2013

Page 2: ACGME Milestones; putting CBME into context

We are at a tipping point in competency-based medical education (CBME) — and it’s only taken 40 years since the competency conversation first appeared in the medical literature!

In case you were not aboard the CBME train as it left the station, this concept is an integrated framework for education, in which specific behavioral outcomes (competencies) drive both medical school curricula and individual advancement, rather than the current driving forces of time (four years of medical school) and process (clerkships of specific length). Carol Aschenbrener – Chief Medical Officer, AAMC

http://wingofzock.org/2012/09/25/competency-based-medical-education-the-time-is-now/

Page 3: ACGME Milestones; putting CBME into context

Traditional medical education presumes that all students are ready to graduate once they have completed a set number of years of study and passed the required assessments, There is a growing interest in tailoring the length

as well as the content of medical education to individual aptitudes.

“People learn in different ways and at different speeds,”

“As early as 1932, reports emerged saying that it is not enough to stuff students’ heads with information

https://www.aamc.org/newsroom/reporter/april11/184286/competency-based_medical_education.html

Page 4: ACGME Milestones; putting CBME into context

• No longer accepting them (residents) as independent actors, they expect physicians to function as leaders and participants in team-oriented care.

• Patients, payers, and the public demand information-technology literacy, sensitivity to cost-effectiveness, the ability to involve patients in their own care, and the use of health information technology to improve care for individuals and populations

• Expect that GME will help to develop practitioners who possess these skills along with the requisite clinical and professional attributes

Nasca TJ. NEJM 2012, 366;11:1051-1056

Page 5: ACGME Milestones; putting CBME into context

It is a curricular concept designed to provide the skills physicians need, rather than solely a large, prefabricated collection of knowledge.

A medical school or residency program using competency-based medical education defines a set of skills or competencies based on societal and patient needs, such as medical knowledge, patient care, or communications approaches, and then develops ways to teach that content across a range of courses and settings.

https://www.aamc.org/newsroom/reporter/april11/184286/competency-based_medical_education.html

The competency-based approach still includes scientific knowledge, but in the broader context of a physician’s

tasks as a healer.

Page 6: ACGME Milestones; putting CBME into context

• Educational milestones (developmentally based, specialty specific achievements that residents are expected to demonstrate at established intervals as they progress through training)

• NAS moves the ACGME from an episodic “biopsy” model to annual data collection. • Each review committee will perform an annual

evaluation of trends in key performance measurements and will extend the period between scheduled accreditation visits to10 years

• NAS is more than just Milestones!!Nasca TJ. NEJM 2012, 366;11:1051-1056

Page 7: ACGME Milestones; putting CBME into context
Page 8: ACGME Milestones; putting CBME into context

We are wrestling with it just like everyone else. The challenge is not so much accepting the concept, which we think is great, but figuring out how to make it work. Where do we teach? How do we evaluate performance? How do we remediate students who have not met requirements?” Thomas Pellegrino - EVMS

How to define competencies, and how to assess performance are perhaps the two most significant concerns about competency-based medical education. Peter Katsufrakis – NBME

“we’ve been wrestling with this question for decades,” M. Brownell Anderson - AAMC

Page 9: ACGME Milestones; putting CBME into context

• A competency-based approach to medical education relies on continuous, comprehensive, and elaborate assessment and feedback systems.• Ideally, a major portion of the assessments should be performed in the context of the clinical workplace and should be criterion-referenced.• Assessment facilitates the developmental progression of•competence.• A number of useful assessment methods already exist; work should focus on helping training programs use such methods more effectively.

• New assessment tools and approaches will need to be developed for ‘‘new’’ competencies such as teamwork, systems, and quality improvement, among others, to fully realize the promise of CBME

Holmboe E., Med Teach 2010, 32(8):676-682

Page 10: ACGME Milestones; putting CBME into context

Implementing competency-based training in postgraduate medical education poses many challenges. Making this transition requires change at virtually all levels of postgraduate training.

Key components of this change include; Development of valid and reliable assessment tools

such as work-based assessment using direct observation,

Frequent formative feedbackLearner self-directed assessment; Active involvement of the learner in the educational

process; Intensive faculty development that addresses

curricular design and the assessment of competencyIobst. Teach Med 2010; 32: 651–656

Page 11: ACGME Milestones; putting CBME into context

• Measurement and reporting of outcomes through the educational milestones, which is a natural progression of the work on the six competencies

• Aim is to create a logical trajectory of professional development in essential elements of competency and meet criteria for effective assessment, including feasibility, demonstration of beneficial effect on learning, and acceptability in the community

• Data represent the consensus of the assessment committee on the educational achievements of residents, informed by evaluations the program has performedNasca TJ. NEJM 2012, 366;11:1051-1056

Page 12: ACGME Milestones; putting CBME into context
Page 13: ACGME Milestones; putting CBME into context

Bloom’s Taxonomy 1956 Anderson’s revision 2000

Remembering: can the student recall or remember the information?

define, duplicate, list, memorize, recall, repeat, reproduce state

Understanding: can the student explain ideas or concepts?

classify, describe, discuss, explain, identify, locate, recognize, report, select, translate, paraphrase

Applying: can the student use the information in a new way?

choose, demonstrate, dramatize, employ, illustrate, interpret, operate, schedule, sketch, solve, use, write.

Analyzing: can the student distinguish between the different parts?

appraise, compare, contrast, criticize, differentiate, discriminate, distinguish, examine, experiment, question, test.

Evaluating: can the student justify a stand or decision?

appraise, argue, defend, judge, select, support, value, evaluate

Creating: can the student create new product or point of view?

assemble, construct, create, design, develop, formulate, write

Cognitive (Knowledge) Affective (Attitude)

Psychomotor (Skills)

Page 14: ACGME Milestones; putting CBME into context

It’s was never expected to be simple or straightforward

Page 15: ACGME Milestones; putting CBME into context

• Final milestones will provide meaningful data on the performance that graduates must achieve before entering unsupervised practice (graduate)

• Initial milestones for entering residents will add a performance- based vocabulary to conversations with medical schools about graduates’ preparedness for supervised practice (residency)

Page 16: ACGME Milestones; putting CBME into context

Norcini BMJ 2003:326(5):753-755Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990:S63-7.

Page 17: ACGME Milestones; putting CBME into context
Page 18: ACGME Milestones; putting CBME into context

Many people argue that this statement is incorrect and that the curriculum is the key in any clinical course.

In reality, students feel overloaded by work and respond by studying only for the parts of the course that are assessed.

To promote learning, assessment should be educational and formative—students should learn from tests and receive feedback on which to build their knowledge and skills

Pragmatically, assessment is the most appropriate engine on which to harness the curriculum.

V Wass. Lancet 2001; 357: 945–49

Page 19: ACGME Milestones; putting CBME into context

Trained ObserversCommon understanding of expectationsSensitive “eye” to key elementsConsistent evaluation of a given level of

performanceMinimum number of quality observations

Assessment based on 6 observations felt to be valid and reliable

Interpreter/Synthesizer ExpertsClinical Competency Committee

Page 20: ACGME Milestones; putting CBME into context

Numbers produce range restrictionNarratives are easily understood by faculty

and produce data without range restriction Natural to how we teach and provide feedback

Goalis to create verbal pictures 4 cm laceration right arm vs

Page 21: ACGME Milestones; putting CBME into context
Page 22: ACGME Milestones; putting CBME into context

1990s The Royal College developed an innovative, competency-based framework that describes the core knowledge, skills and abilities of specialist physicians. formally adopted by the Royal College in 1996

CanMEDS Springboards Mobile App - The first in a series of specialty-specific teaching resources, the CanMEDS Springboards mobile app for Emergency Medicine is designed to help busy clinicians teach around the CanMEDS Roles during patient care. For iPhone, iTouch and iPad only.

Page 23: ACGME Milestones; putting CBME into context

Danger here is that rather than engaging a total practicum to which other forms of learning discourse bring their insights, a limited professional education is based upon an inappropriate epistemology of competency

Tendency to limit the reflection, intuition, experience and higher order competence necessary for expert, holistic or well developed practice

Martin Talbot, Med Educ 2004; 38: 587–592

Page 24: ACGME Milestones; putting CBME into context

If your are feeling overwhelmed and confused by all this new jargon – you are not aloneYour faculty are looking to you for answers!

Nobody has all the answers so stop waiting for the Holy Grail?Better to join the legion of PDs working to define it

There is no way to sort out the milestones without getting “dirty” – expect to make mistakesAssessment is suppose to drive curriculum (this is a

game changer)Resistance if futile, give in and drink the kool aid

Reduce your stress, it’s going to happen!

Page 25: ACGME Milestones; putting CBME into context