PowerPoint Presentation

The ACGME Annual Educational Conference

After just one MargaritaBe sure you can trust those you ask for help back to your roomA long night, a few drinks, all you want to do is go to sleep, then this startshttp://med.stanford.edu/gme/GME_Community.html Millstones

What Should a CCC Do First? Understand their specialty Milestones (Posted on acgme.org)Decide how to assess the Milestones Program Evaluation StrategyIf necessary, identify new evaluation tools from program director associations, societies, colleges

3NAS and Milestones and YOUThe program coordinator will play a crucial role in developing, implementing and collecting data on x and reporting of milestone evaluation tools to the CCC

You are a big part of the equation in how you are able to support your programs mission at all levels many balls to juggles requires many hands, many minds. You are the coordinator of it all!!!4Managing it all

U - R - IT!Understanding RRC program requirementsRequirements applied to evaluation methods/processImplementing new evaluation system 2+2=4 (2+2)*4=16Tracking completion and accuracy (outliers) for data aggregation

Implementing Assessment Tools to validate MilestonesEvaluation systemsMilestone-based/EPAs (Entrustable Professional Activities)Rotation-specificPatient handoversDefine evaluator groups (faculty, staff, patients)Set up and timing of delivery systems74. Tracking and ReportingStart with the end in mind:CCC biannual reporting windows to ACGMENovember 1- December 31 / May 1 - June 15Back track and set calendar events for:Periodic monitoring of evaluation completionRunning aggregate reports and reviewing milestone evaluation dataReviewing case logs, learning portfolios, duty hours

Pulling the Data TogetherClinical Competency CommitteeEnd-of-Rotation EvaluationsSafety Incident ReportsCase LogsPatient/ Family EvaluationsClinical Skills AssessmentNursing and Staff / Techs EvaluationsProgress on MilestonesSimLabIn-service training examsQuality Improvement ActivitiesA milestone from General Surgery

Pulling the Data TogetherClinical Competency CommitteeEnd-of-Rotation EvaluationsSafety Incident ReportsCase LogsPatient/ Family EvaluationsClinical Skills AssessmentNursing and Staff / Techs EvaluationsProgress on MilestonesSimLabIn-service training examsQuality Improvement ActivitiesA milestone from General Surgery

Managing it all:How will I pull this off?

The Toolbox

Creating a Resident Performance Profile Goals to support your CCCResident performance data that is:ComprehensiveConsolidated / Aggregated Easy for CCC to identify strengths, areas for improvement, opportunities for advancement

Creating a Resident Performance ProfileStep 1 Defining what to trackMore tools

Leveraging Resident Management System (RMS)Tools, if AvailableRMSs becoming more feature richCurriculumGoals and Objectives and learning outcomes by rotationTeaching and Assessment methodologiesEvaluation tool development Sharing between programs and institutions

He was so lonely he needed his comfort blanketLinks to other sessions slides I attended

Katies Presentation Slides http://www.acgme.org/acgmeweb/Portals/0/PDFs/2014AEC-Presentations/BR11.pdf https://quickstart.quickmobile.com/cms/resources/render/3698/1/122 *****https://quickstart.quickmobile.com/cms/resources/render/3698/1/187 ****https://quickstart.quickmobile.com/cms/resources/render/3698/1/215https://quickstart.quickmobile.com/cms/resources/render/3698/1/216 https://quickstart.quickmobile.com/cms/resources/render/3698/1/119https://quickstart.quickmobile.com/cms/resources/render/3698/1/217hthttps://quickstart.quickmobile.com/cms/resources/render/3698/1/131https://quickstart.quickmobile.com/cms/resources/render/3698/1/184https://quickstart.quickmobile.com/cms/resources/render/3698/1/247https://quickstart.quickmobile.com/cms/resources/render/3698/1/248https://quickstart.quickmobile.com/cms/resources/render/3698/1/53https://quickstart.quickmobile.com/cms/resources/render/3698/1/54http://med.stanford.edu/gme/GME_Community.html ******

FirstYearLast, First (PGY2)1st Qtr2nd QtrSemi Aggregate3rd Qtr4th QtrYear SummaryStandardDate Completed9/30/1412/31/1412/31/143/31/146/30/156/30/15EvaluationsMilestonesMilestone End of Rotation (Total)241.62.01.8Medical KnowledgeMK A11.51.91.7Patient CarePC A1-102.12.52.3CommunicationICS A1-22.52.02.3ProfessionalismPROF 1-51.92.52.2Systems-Based PracticeSBP A1-20.81.00.9Practice-Based LearningPBLI A1-40.72.01.3

In-service Assessments (MK; PC)Routine procedure technical skills assessment: Level 2-3PC A1-10201Complex procedure technical skills assessment: Level 3-4PC A1-10Medical Knowledge Assessments657780

Case Logs / Clinical Experience (PC)Min ReqtsVAGINAL DELIVERY405CESAREAN SECTION207PEDIATRICS10023PEDIATRICS UNDER 3201CARDIAC204ENDOVASCULAR200NON-CARDIAC INTRATHORACIC200INTRACEREBRAL200SURGICAL PROCEDURES; EPIDURAL4012COMPLEX; LIFE THREATENING202SPINAL ANESTHESTICS409PERIPHERAL NERVE BLOCKS4015CANCER RELATED PAIN200

Quality Improvement/Patient SafetyQI ProjectPBLI1-2NoneQI Committee ParticipationPBLI1-2NoneQI Course Work (e.g., IHI)PBLI1-2CompleteSAFE Report / Adverse Event ReviewPROF1/2; SBP101Reviewedb1Patient Handover EvaluationsSBP1; ICS111Competent

Practice-Based LearningPatient outcomes / Case Study PresentationPBLI1Scholarly Activity: Research studyPBLI2Scholarly Activity: PublicationsPBLI2Presentation at Internal and National MeetingPBLI2

CommunicationPatient Feedback ICS1; PROF 1Staff EvaluationICS2; PROF1-4

&"-,Bold"&16AnesthesiaResident Progress Profile

SecondYearLast, First (PGY2)1st Qtr2nd QtrSemi Aggregate3rd Qtr4th QtrYear SummaryStandardDate Completed9/30/1412/31/1412/31/143/31/146/30/156/30/15EvaluationsMilestonesMilestone End of Rotation (Total)24Medical KnowledgeMK A1Patient CarePC A1-10Interpersonal & Communication SkillsICS A1-2ProfessionalismPROF 1-5Systems-Based PracticeSBP A1-2Practice-Based Learning & ImprovementPBLI A1-4

In-service Assessments (MK; PC)Routine procedure technical skills assessment: Level 2-3PC A1-10Complex procedure technical skills assessment: Level 3-4PC A1-10Medical Knowledge Assessments

Case Logs / Clinical Experience (PC)Min ReqtsVAGINAL DELIVERY40CAESAREAN SECTION20PEDIATRICS100PEDIATRICS UNDER 320CARDIAC20ENDOVASCULAR20NON-CARDIAC INTRATHORACIC20INTRACEREBRAL20SURGICAL PROCEDURES; EPIDURAL40COMPLEX; LIFE THREATENING20SPINAL ANESTHESTICS40PERIPHERAL NERVE BLOCKS40CANCER RELATED PAIN20

Quality Improvement/Patient SafetyQI ProjectPBLI1-2QI Committee ParticipationPBLI1-2QI Course Work (e.g., IHI)PBLI1-2SAFE Report / Adverse Event ReviewPROF1/2; SBP1b1Patient Handover EvaluationsSBP1; ICS1

Practice-Based LearningPatient outcomes / Case Study PresentationPBLI1Scholarly Activity: Research studyPBLI2Scholarly Activity: PublicationsPBLI2Presentation at Internal and National MeetingPBLI2

CommunicationPatient Feedback ICS1; PROF 1Staff EvaluationICS2; PROF1-4

ThirdYearLast, First (PGY2)1st Qtr2nd QtrSemi Aggregate3rd Qtr4th QtrYear SummaryStandardDate Completed9/30/1412/31/1412/31/143/31/146/30/156/30/15EvaluationsMilestonesMilestone End of Rotation (Total)24Medical KnowledgeMK A1Patient CarePC A1-10CommunicationICS A1-2ProfessionalismPROF 1-5Systems-Based PracticeSBP A1-2Practice-Based LearningPBLI A1-4

In-service Assessments (MK; PC)Routine procedure technical skills assessment: Level 2-3PC A1-10Complex procedure technical skills assessment: Level 3-4PC A1-10Medical Knowledge Assessments

Case Logs / Clinical Experience (PC)Min ReqtsVAGINAL DELIVERY40CESAREAN SECTION20PEDIATRICS100PEDIATRICS UNDER 320CARDIAC20ENDOVASCULAR20NON-CARDIAC INTRATHORACIC20INTRACEREBRAL20SURGICAL PROCEDURES; EPIDURAL40COMPLEX; LIFE THREATENING20SPINAL ANESTHESTICS40PERIPHERAL NERVE BLOCKS40CANCER RELATED PAIN20

Quality Improvement/Patient SafetyQI ProjectPBLI1-2QI Committee ParticipationPBLI1-2QI Course Work (e.g., IHI)PBLI1-2SAFE Report / Adverse Event ReviewPROF1/2; SBP1b1Patient Handover EvaluationsSBP1; ICS1

Practice-Based LearningPatient outcomes / Case Study PresentationPBLI1Scholarly Activity: Research studyPBLI2Scholarly Activity: PublicationsPBLI2Presentation at Internal and National MeetingPBLI2

CommunicationPatient Feedback ICS1; PROF 1Staff EvaluationICS2; PROF1-4

Sheet1