Program Evaluationin the

Queen’s PGME Transition

Designing Competency At Queen’s WorkshopFebruary 23-25 2015

Denise Stockley, PhDProvost’s Office (Teaching and Learning Portfolio) and Faculty of

Health Sciences

Elaine Van Melle PhD, Education Scientist, RCPSC

Outline

1. Program Evaluation Overview2. 3 year plan 3. Getting started . . .

Program Evaluation Team

InternalQueen’s University

Program Evaluation Lead

Denise Stockley

ExternalRoyal College

Program Evaluator Consultant

Elaine Van Melle

InternalFaculty of Health Science

Academic Lead Damon Dagnone

CBME Program Evaluation is Guided By:

1. How do we prepare programs for the adoption of CBME?

2. Are we implementing CBME as intended? 3. What strategies are required to sustain the

adoption of CBME across the institution?4. How has (or is) CBME contributing to

changes in behaviours (e.g., relationships, actions, activities, policies or practices) across all levels of the institution?

Conceptual Framework - Concerns-Based Adoption Model

Three Year Project

Year 1 - Building the FoundationYear 2 - Implementing the Change Year 3 - Ensuring Sustainability

Program Evaluation Year 1

Building the Foundation • Collection of baseline data • Distribute the Stages of Concern

Questionnaire• Create an Innovation Configuration Map

Innovation Configuration Map

Specific descriptions of what CBME looks like in practice• Program Leadership• Faculty (as teachers, as assessors)• Residents

On a continuum . . . Ideal Transitioning Preparing Business as Usual

Core Components of CBME – First Step

What does this figure tell you about CBME?

How would you (or would you?) use it?

Core Components of CBME – First Step

What does this figure tell you about CBME?

How would you (or would you?) use it?

CBME . . . Has a strong theoretical foundation Is made up of many components Components need to work together

For More Information:

For more information or to engage in the process, contact:

Denise Stockley – stockley@queensu.ca