Performance – What is it? (and how do I manage it)

Bec Jackson September 17th 2010ACE National Senior Policy Officer

Terry ThomsonBusiness Analyst - APM

Once upon a time….

4%6%

9%11%

14%

21%

18%

12%

5%

0%

5%

10%

15%

20%

25%

1.0 1.5 2.0 2.5 3.0 3.5 4.0 4.5 5.0

Star Rating

In a program far far away…

KPI 1: EfficiencyRetention between DPI and 12 months (5%)Retention between 12 and 18 months where no outcome

(5%)KPI 2: Effectiveness

13 week employment outcome (30%)26 week employment outcome (40%)

(5%)VET 13 week outcome(5%)

Average weekly wage from work (higher better) (5%)12 month employment status (5%)

Employment assistance(NB: weightings are separate)

KPI 1: Effectiveness/EfficiencyRemain in employment and leave maintenanceKPI 2: Effectiveness

(10%)

Remain in employment – same or better earnings (30%)Remain in employment (60%)

Workers in Maintenance(NB: weightings are cumulative)

Average hours per week in work (higher better)

KPI 3: Quality of Disability Open Employment services (pass/fail)

The New Framework

KPI Performance Measure

DMS Weighting

ESS Weighting

Efficiency 1.1 Responsive 5 5

1.2 Time taken to achieve employment outcome

5 5

Effectiveness 2.1 Job Placements 5 5

2.2 13 week Full Outcome 25 20

2.3 13 week Pathway Outcome

5 5

2.4 13 week Bonus Outcome

5 5

2.5 26 week Full Outcome 35 30

2.6 26 week Pathway Outcome

5 5

2.7 26 week Bonus Outcome

5 5

2.8 Ongoing Support 5 15

The New Framework

KPI Performance Measure

DMS Weighting

ESS Weighting

Efficiency 1.1 Responsive 5 5

1.2 Time taken to achieve employment outcome

5 5

Effectiveness 2.1 Job Placements 5 5

2.2 13 week Full Outcome 25 20

2.3 13 week Pathway Outcome

5 5

2.4 13 week Bonus Outcome

5 5

2.5 26 week Full Outcome 35 30

2.6 26 week Pathway Outcome

5 5

2.7 26 week Bonus Outcome

5 5

2.8 Ongoing Support 5 15

So how do we turn that into a star rating…..

Simple!!!!

Just like this…..INTERIM = C(1) + C(2)*PREV + C(3)*INDIG + C(4)*MALE + C(5)*AGE + C(6)*AGE*AGE + C(7)*ALST1 + C(8)*ALST2 + C(9)*ALST3 + C(10)*ALST4 + C(11)*ALST5 + C(12)*ALST6 + C(13)*DIS + C(14)*EDU1 + C(15)*EDU2 + C(16)*EDU4 + C(17)*EDU5 + C(18)*NESB1 + C(19)*NESB2 + C(20)*NESB3 + C(21)*METRO + C(22)*BIGSLA + C(23)*DAYAVIS1*DAYAVIS1 + C(24)*DAYAVIS1 + C(25)*UEDUR1 + C(26)*UEDUR1*UEDUR1 + C(27)*EMGROW + C(28)*I1 + C(29)*I2 + C(30)*I3 + C(31)*I4 + C(32)*I5 + C(33)*I6 + C(34)*I7 + C(35)*I8 + C(36)*I9 + C(37)*I10 + C(38)*I11 + C(39)*I12 + C(40)*I13 + C(41)*I14 + C(42)*I15 + C(43)*I16 + C(44)*UERATE + C(45)*METROIND

The Formula• Outcomes are the most crucial component of performance

• Focus on Job Placement and Outcome

• Playing around the edges isn’t the key – address that last, never first

Understanding KPI’s

Numerator

Denominator

*important to note that you must have minimum numbers of 20 in the denominator for rating

Understanding KPI’s1.1 Responsiveness

A count of participants in the denominator who have a valid commencement date

A count of participants who were referred between 1 March 2010 and last day of the month preceding the end of the performance period (excluding referrals that were exited for the reasons detailed in Attachment D of the Star Rating Guidelines)

Understanding KPI’s1.2 Time taken to achieve employment outcome

The sum of total days between commencement date and the employment anchor date for an approved 13 week full employment outcome (excluding time spent on suspensions, in qualifying training and whilst in the Productivity Places Program (or equivalent in VIC).

Count of participants who have an approved claim for a 13 wk full employment outcome

Understanding KPI’s2.1 Job Placements

Count of participants in the denominator who have an approved claim for a job placement

Count of participants who have commenced in DES from 1 March 2010 to the last day of the performance period

Understanding KPI’s2.2 13 Week Full Outcome

Count of participants in the denominator who have an approved claim for a 13 week full outcome

Count of participants who have commenced in DES and duration in assistance is at least 13 weeks (excluding all periods of suspension)

Understanding KPI’s2.6 26 Week Full Outcome

Count of participants in the denominator with an approved claim for a 26 week full outcome

Count of participants who have commenced in DES and duration in assistance is at least 26 weeks (excluding all periods of suspension)

Understanding KPI’s2.8 Ongoing Support Flexible Ongoing Support

Count of participants included in the denominator who are still current in ongoing support phase + those who have exited ongoing support as independent worker

Count of participants with an approved claim for at least one instance of flexible ongoing support

Understanding KPI’s2.8 Ongoing Support Moderate or High Ongoing Support

Count of participants included in the denominator who are still current in ongoing support phase + those who have exited ongoing support as independent worker

Count of participants who have a valid commencement date in the ongoing support phase of assistance

Understanding KPI’s2.8 Bonuses

Count of participants included in the denominator who are still Count of participants in the denominator for which there is an approved claim for a bonus 13 week full or pathway outcome plus a count of Indigenous participants who achieve an approved claim for a 13/26 week full or pathway outcome Count of participants for which there is an approved claim for a 13 week full or pathway outcome

The Bands

Toto – I don’t think we’re in Kansas anymore

-50% - 20% +20% +40%

TimelinesFirst performance feedback (informal) Nov/Dec 2010• Six monthly follow stars release

First star ratings to 31 December 2010 Feb 2011• To providers for internal use

Interim stars to 31 March 2011 May 2011• End March , end September

First Published Stars to 30th June Aug 2011

So how do we track it?Tools at your disposal:

DES Reports – EA Reporting• DES Caseload • DES Jobseeker• DES Appointment & Session Availability• DES Claims• DES Market Share

So how do we track it?Tools at your disposal:

DES Reports – Health Checks

Provider administrative and performance data• Modeled on star rating performance measures• No regression applied• Site level + ESA level• Comparative data to National & ESA

ReportsCaseload DES Caseload DES Job Seeker

Diary DES Appointment DES Session Availability

Payments DES Adjustment Note DES Claims Current DES Remittance advice

Referral DES Provider Market Share

VacancyEmployer BDFVacancy Report

Make sure this isn’t you in June 2012!