APPD UPDATES Member Driven – Mission Focused Fall Meeting 2015

PEDIATRICS MILESTONES ASSESSMENT COLLABORATIVE (PMAC) UPDATE – FALL 2015 APPD MEETING

Patricia Hicks, MD, MHPE PMAC Director

APPD COLLABORATION

TIMELINE

2009 ACGME

Milestones

2010 Pediatrics

Milestones Working Group

2011 Pediatrics

Milestones Assessment Pilot NBME and APPD

(begins)

2012 Pediatrics

Milestones Pilot (ends)

2013 Pediatrics

Milestones Assessment

Collaborative PMAC

(begins)

2014 PMAC Module 1 Data Collection I

2015 PMAC Module 1

Data Collection II

PMAC GOALS

Build an Assessment System Feasible Workplace-based Reports that serve a number of purposes

Flexible Responsive to needs of programs Builds on APPD’s community Scholarship and leadership opportunities

KEY AREAS FOR DECISIONS AND FEEDBACK When can I trust a trainee to be an intern on the

inpatient team? When is an intern ready to be left without their

supervisory resident? When is a resident ready to supervise others?

Procedural competence Consultation Handovers EBM QI

Refine the question Select content (mapping content to PM’s) Design items: context and role based Refine items Instrument development; report design Data collection Feedback/ evaluation Revision of items/instruments/technology

INSIDE LOOK AT THE PROCESS

Beatrice Boateng Kim Boland Ann Burke Carol Carraccio Alan Chin Kathleen Donnelly Kim Gifford Su-Ting Li

Sara Multerer Amanda Osta Sue Poynter Dan Schumacher Julia Shelburne Teri Turner Anna Weiss

CONTENT EXPERTS

Institution: Contact Person: Boston Combined Residency Program Dan Schumacher, Ariel Winn

Children's Hospital of Philadelphia Anna Weiss, Rebecca Tenney-Soeiro, Jeanine Ronan

University of Illionis-Chicago Amanda Osta, Katie Mena, Jennifer Vu University of Michigan Pediatric Residency Program Hilary Haftel University of Louisville Kimberly Boland, Sara Multerer UCLA Alan Chin, Jessica Lloyd University of Chicago Pediatric Training Program Nicola Orlov Cincinnati Children's Sue Poynter Dartmouth - Hitchcock Medical Center Kim Giffords, Samantha House University of Utah Bruce Herman, Jaime Bruse

DATA COLLECTION I SITES & LEADS

Single URL for SCO-Rounds and MSF Authentication with password, context (name of

rotation) and date range of rotation Once authentication is complete:

The system knows who you are… Your role (role-based instruments you can see) What learners you are eligible to assess

The system will tell you how many instruments of that type have been completed – by you and by all (that rotation)

A LOOK AT THE INSTRUMENTS:

FEEDBACK REPORT

Dates (rotation or 6 month summative) Context(s) Competency – numeric score (single month or

summative) Competency – associated narrative comments Global score (based on the question)

AGGREGATE REPORT

AGGREGATE REPORT

AGGREGATE REPORT

THE PEOPLE SUPPORTING PMAC

Next data collection beginning on October 1, 2015 We would love to have your program involved!!!!

Want to explore? Contact:

Alan Schwartz- email LEARN@APPD.org Erin Ernst – email eernst@nbme.org Patty Hicks – email phicks.pmac@nbme.org

LOOK FOR A INFORMATIONAL WEBINAR COMING SOON!!!

MODULE 1, DATA COLLECTION II

APPD LEARN Alan Schwartz, PhD LEARN Director

Your educational research network!

APPD LEARN IS… Educational research network focused on

Pediatrics education (An AHRQ-registered PBRN)

130+ participating programs Enterprise-quality data repository Longitudinal identifier codes for learners to permit

studies over time and across projects Open to your program!

Characteristics of Clinical Competency Committee (CCC) Member Milestone Level Assignments and Recommended Advancement Decisions PI: Dan Schumacher, MD, MEd (Cincinnati)

Scholarly activity during residency: A national study of pediatric residents and program directors PI: Erika Abramson, MD (Cornell)

MEMBER-INITIATED STUDIES ONGOING

Pediatrics Milestones Assessment Collaborative (PMAC) - Module 1 (DC2) Collaborators: ABP, NBME

Assessing the Association between Entrustable Professional Activities (EPAs), Competencies, and Milestones in the Pediatric Subspecialties Collaborators: CoPS, ABP

How trainees perform on general pediatric EPAs using a rating scale of level of supervision leading up to entrustment Collaborators: ABP

Education in Pediatrics Across the Curriculum (EPAC) data stewardship Collaborators: AAMC, UCSF, U Colorado, U Minnesota, U Utah

COLLABORATIVE STUDIES

Beth King, MPP Project Manager

NEW AND FAMILIAR FACES

Marina Seyon Program Assistant

Join us! Keep in touch with us: http://learn.appd.org Details on how to propose new studies Information about training opportunities How to obtain access to archived data

Email us at: learn@appd.org

APPD LEARN: CONNECTIONS

APPD LEAD Susan Bostwick, MD LEAD Council Chair

To deliver a nationally recognized program that provides pediatric

residency and fellowship educators the knowledge and

skills to become leaders in graduate medical education.

New call for applications - Winter 2016

Structure

• 10 month program • 3 educational

conferences • Peer group activities

and support • Mentored

educational project • Certificate of

completion

Curriculum

• Organizational Leadership

• Competency-based Curriculum Development

• Faculty Development

• Residency & Fellowship Program Administration

• Scholarship and Career Development

How to Apply • New call for applications Winter • Member of APPD • ≥3 years of educational leadership experience

• PD, FD, APD, AFD • LEAD year not overlap with 1st year in new role • Department support • Commitment to attend all meetings and complete

assignments and project

•Cohort 1 18 members •Cohort 2 17 members •Cohort 3 15 members •Cohort 4 16 members

Cohorts

•Multiple members in APPD leadership roles, e.g., Fellowship Director’s Committee, Program Planning Committee, SIG Leaders

•Multiple posters, workshops at APPD, PAS and other meetings •Multiple articles published

Accomplishments

•Susan Bostwick, MD New York Presbyterian – Weill Cornell •Hilary Haftel, MD, MHPE University of Michigan •Grace Caputo, MD, MPH Phoenix Children’s Hospital •Su-Ting Li, MD, MPH University of California-Davis •John Frohna, MD, MPH University of Wisconsin •Richard Shugerman, MD University of Seattle •Linda Waggoner-Fountain, MD, MEd University of Virginia

Council

Call for New Council Members •Went out September 2015 •Application Due October 2015 •New Council Member announced

November 2015

COHORT 4

REUNION 2015

APPD UPDATES VIEW FROM THE APPD PAGES

BOB VINCI, MD

BOB.VINCI@BMC.ORG

Member Driven – Mission Focused Fall Meeting 2015

VIEW FROM THE APPD PAGES FALL MEETING 2015

ACADEMIC PEDIATRICS – APA Journal “VIEW” is a monthly section in the Journal

Brief report (2000 words) that highlights the work you are doing in curriculum development, assessments, educational leadership, etc.

Goal is dissemination of your work Journal now going to 8 editions per year

Willingness to work with you to take an idea, outline, draft and move it towards publication

VIEW FROM THE APPD PAGES FALL MEETING 2015

Recent Publications: APPD LEAD – Franklin Trimm Competency Based Assessments – Jake Robson Resident Vaccine Project – Jen Shepard Fellows College – Judith Campbell

Think about: Innovation in your program/region Approaches to curriculum development APPD LEAD APA Educational Scholars Program

APPD Website had links to: APPD Spring Abstracts Collection of Previous APPD “VIEWS”

APPD SHARE WAREHOUSE EDITORIAL TEAM APPD Fall Meeting 2015 – Atlanta

SHARE WAREHOUSE EDITORIAL TEAM

Alan Chin, MD Robert Lee, MD Sydney Primis, MD

Platform Redesign

Michele Miner, MD Ashweena Gonuguntla, MD Brad Olson, MD Tara McKinley

Editorial

Ann Burke, MD Javier Gonzales Del Rey, MD Matt McCrae

Consultation

Abhay Dandekar, MD Redesign Project Leader

Purpose: To redesign the APPD Share Warehouse

Objective: Define what is present Refine what is needed Apply resources and team talent/effort to produce a

Share Warehouse version that is a practical, user-friendly, member-driven resource and a signature of our collaborative APPD innovation

SHARE WAREHOUSE EDITORIAL TEAM

Our progress (Spring 2015- present) Monthly conference calls (April, May, July, August) to:

Initiate the redesign process by refining our vision and our deliverable product

New preliminary version with homepage and submission updates live now!

Updated searching/browsing function projected for October 15, 2015 roll out!

SHARE WAREHOUSE EDITORIAL TEAM

Next Steps: Details on “go-live” and communication to membership Member driven contribution and input Member driven editorial process (ongoing and formalized in

Spring 2016) Collaboration and member/user-driven design for ongoing

improvement

SHARE WAREHOUSE EDITORIAL TEAM

APPD STRATEGIC PLAN MISSION/VISION/VALUES Dena Hofkosh, MD, MEd, APPD President

MISSION STATEMENT

VISION

The Association of Pediatric Program Directors serves pediatric programs by leading the advancement of education to ensure the health and well-being of children.

Exemplary pediatric education

Leadership Innovation Collaboration Scholarship Engagement

VALUES

STRATEGIC PLAN GOALS

GOALS Development of Programs and Members – Foster program

development through supporting members in their professional development, academic advancement, career satisfaction and administrative activity.

Organizational Excellence - Maintain a dynamic organization with efficient and effective leadership that is responsive to its members.

Leadership and Collaboration – Advance graduate medical

education through engagement and collaboration.

Research and Scholarship – Optimize the quality of future general and subspecialty pediatricians through participation in rigorous research, application, then broad dissemination of best practices in graduate medical education.

Q&A