fall directors meeting 2014: program quality - developing key performance indicators (kpis)

24
Bonner Fall Directors & Coordinators Meeting November 10-14, 2014 • Ariane Hoy, Bonner Foundation Program Quality: Developing Key Performance Indicators (KPIs)

Upload: bonner-foundation

Post on 05-Jul-2015

633 views

Category:

Education


0 download

DESCRIPTION

This is from a session and discussion at the Bonner Foundation's Fall Directors Meeting 2014. Staff and faculty in the network will be involved in creating Key Performance Indicators (KPIs) that can be utilized by Bonner Programs around the country to reinforce and document program quality and impacts.

TRANSCRIPT

Page 1: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Bonner Fall Directors & Coordinators Meeting

November 10-14, 2014 • Ariane Hoy, Bonner Foundation

Program Quality:Developing Key

Performance Indicators (KPIs)

Page 2: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Background & Purpose

A tool for aligning a program with broader institutional and strategic aims

Provides a dashboard or easy-to-monitor set of indicators

Page 3: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

DefinitionsKey Performance Indicators (KPIs) are often utilized by institutions of higher education as a tool to assess performance and monitor quality. A dashboard displays critical information in a succinct, easily understood, and visually appealing format yet helps to communicate the current health of an organization or program and its progress toward strategic objectives (Seybert, 2012).

Page 4: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

PurposesTo provide information to assist in evaluation of organizational performanceTo communicate current information about major indices of organizational performance to primary stakeholders To provide a comprehensive analysis of how the organization’s achievement of its strategic objectives leads to effectively carrying out its mission and vision To provide information about organizational performance compared to appropriate benchmarks

(Seybert, 2012)

Page 5: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

ComponentsA limited set of measures—usually referred to as “Key Performance Indicators” (or KPIs)An integrated data structure for that set of measures A source of comparative benchmarks for the measures Graphics for displaying the measures

(Seybert, 2012)

Page 6: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Common in Higher EdEnrollment– Fall headcount enrollment– % of area high school grads enrolling in fallStudent progress– Fall-to-fall persistence– Term-to-term persistence Student success– Graduation rate– Transfer rate– Workforce placement rate

Page 7: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Examples

Page 8: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

•Color indicates measure (direction)

•Note that indicators include some that are “hard” and others that are more subjective

Page 9: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)
Page 10: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

1. Have a definition or calculation to find the KPI (i.e., average cost per meal)2. Set a target for the year (i.e., number of new and sustained volunteers)3. Set the target according to issue/industry benchmarks (i.e., instructor to child ratio)

Non-Profit KPIs

Page 11: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

1. Program Efficiency RatioThis ratio is calculated as program service expenses (or money directly spent to further the nonprofit mission of the organization) divided by the NPOs total expenses.

2. Operational Efficiency RatioThis ratio is calculated as unrestricted program revenue (or inflows from operations that can be spent at the discretion of the NPO) divided by total expenses.

3. Fundraising Efficiency RatioThis final ratio is calculated as unrestricted contributions (or incomes from donors who do not specify where it must be used) divided by unrestricted fundraising expenses (or how much money was spent by the NPO to collect those contributions).

Page 13: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

• Some are developed by consortia/3rd parties

Page 14: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

•Tied to strategic plan

• Integrates Balanced Scorecard

Page 15: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Why Would We Do This...Support and manage for program qualityTie to Self-Assessment Tool, but more streamlined and more quantitativeMake the case for engagementHelp collect and track information on performance that aligns with institutional and foundation aimsFor stakeholders like institutional leadership, community partners, and funders

Page 16: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

CharacteristicsOperationally focusedTied to mission and strategic plan Timely Accurate Easy to understand Represents the current state (vis-a-vis aspirations)Straightforward summary of performance

(Seybert, 2012)

Page 17: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

How it might work...Be reviewed and utilized by campus staff (program/center) and foundation staff togetherSynchronized with other reporting (i.e., streamlined expectation by Foundation)Be a resource for campus staff year-round (as a tool for program management and communicating results)

Page 18: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Self-Assessment Tool vs. KPIs

Rubric with levels

Developmental

Roadmap (planning purposes)

Subjective

Once a year

Countable but also still some that are subjective

Maintain and track

Signal successes

Flag priorities

Ongoing (not necessarily asked for)

Page 19: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

The Process...Get input (TODAY AND BEYOND)Start with some potential examplesConsider viability (ease of getting data)Look for models and refineSynchronize with other reporting and processes (i.e., Annual Report, campus visits)

Page 20: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Input...What do you think? What measures?Graphical interface?Process for campus alignment?

Page 21: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Examples...STUDENT SUCCESSSTUDENT SUCCESSSTUDENT SUCCESSSTUDENT SUCCESS

Percentage (%) of Bonner Enrollment Goals Met

Retention Rate (%) of Bonners First to Second Year

Completion Rate (%) of Bonners Four Year Program

Completion Rate of AmeriCorps Members (if applicable)

80% 80-90% 90-100%

Average GPA of Bonners (compared to institution)

Lower than institutional GPA

On par with to institutional GPA

Above institutional GPA

Should measures be always grounded in institutional or could we aim for a standard?

Page 22: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Examples...

Some measures could be tied to reviews of data in BWBRS or from other surveys

COMMUNITY PARTNERSHIPS & IMPACTCOMMUNITY PARTNERSHIPS & IMPACTCOMMUNITY PARTNERSHIPS & IMPACTCOMMUNITY PARTNERSHIPS & IMPACT

Percentage (%) of partners with sustained, multi-year developmental relationships and positions

Percentage (%) of partners that are connected to faculty member

Percentage (%) of committed partners (as coded CB) that report capacity-building accomplishments

Percentage (%) of partners indicating satisfaction

Less than 70% 70%-85% 85%+

Percentage (%) of partners that report greater resources or leverage

Page 23: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Examples...

With more subjective areas, what are the right things to look for and measure?

CAMPUS-WIDE ENGAGEMENT & INFRASTRUCTURECAMPUS-WIDE ENGAGEMENT & INFRASTRUCTURECAMPUS-WIDE ENGAGEMENT & INFRASTRUCTURECAMPUS-WIDE ENGAGEMENT & INFRASTRUCTURE

Constituent voice in direction and decision-making

No formalized structures for these constituents

Some formalized structures for these constituents

Formalized structures (i.e., Advisory Board) for all key constituents

Structured, ongoing engagement of faculty, departments, and/or academic programs

Budgetary Support (or relationship with Financial Aid/Development that results in clear budget)

Clear support and leadership of CSAO, CAO and President for Bonner Program and Center

Lack of structured connections

Regular meetings Network / initiative participation

Staffing level for Bonner Program

Page 24: Fall Directors Meeting 2014: Program Quality - Developing Key Performance Indicators (KPIs)

Input...Process/discuss measuresCreate possible levelsRecommend others?Top 3