performance measurement in the coc apr · pdf fileperformance measurement in the coc apr march...

Performance Measurement in

the CoC APR

March 27, 2012

Revised May 22, 2012

Presenters:

William Snow

Natalie Matthews

Resource Advisors:

Louise Rothschild

Revised Content

• Content on slides 19-21 and 25-27 is revised to

reflect the correct income measures for

questions 36b (Transitional Housing) and 36d

(Supportive Services Only). All changes are

marked in red.

• These changes correspond with how HMIS

vendors were previously instructed on how to

program these questions in the APR.

2

Webinar Format

• Webinar will last approximately an hour

• Recording of webinar will be posted on the HUD’s Homelessness Resource Exchange

• Materials will be posted within one week of today

• Audience members are “muted” due to the high number of participants

3

4

Audio Issues During the Webinar

• For audio, please use the telephone, not your computer

• If you have technical difficulty with the audio or video portions of this webcast, try:

– Logging off, then logging in again

– Requesting help through the “questions” function in the “Go To Webinar” toolbar

Submitting Questions

• If you have an HMIS question that is not answered during the webinar, submit it to HUD’s Virtual Help Desk

• Reference this presentation Performance Measurement in the CoC APR in your question

5

Objectives of the Webinar

Webinar participants will be able to:

• Identify the key components of Performance

Measurement

• Complete the Performance Measurement

questions on the CoC APR

• Understand how best to monitor the performance

of their program throughout the year

6

Performance Measurement

7

Performance Measurement

• What is Performance Measurement?

“A process that systematically evaluates

whether your program is making the intended

impact on the clients you serve and helps

guide efforts to improve results.”

8

Key Parts of Performance Measures

1. Goals

2. Data

3. Follow-Up

9

Questions for your Program

1. What do our funders expect of us?

2. What additional measures do we want to

set?

3. Are there relevant, existing Performance

Measures in my community for programs

similar to mine?

4. Am I collecting the necessary data to

track my performance?

10

Quiz #1

11

Grantees and their stakeholders should only review their

Performance Measures when it’s time to submit their APR.

True False

Performance Measurement in

the CoC APR

12

Importance of Exhibit 2

• Each year, HUD-funded projects apply for

new or renewal funding by completing an

Exhibit 2 project application.

• On the Exhibit 2 project application,

grantees set targets they will work to

accomplish during their operating year.

13

Performance Measures

2010

Project Application

Set Performance Measures

2011

Operate Project

2012

APR is due

Report on Performance Measures

14

Question 36: Standard Performance

Measures

• Separated out into the following parts:

a. Permanent Housing

b. Transitional Housing

c. Services Only (Street Outreach)

d. Services Only (with Housing Goal)

e. Safe Haven

15

36a. Permanent Housing

Three measures for Permanent Housing

1- Housing Stability: Maintained or exited to

new permanent housing (All persons served)

2a-Total Income Measure: Maintained or

increased total income (All adults served)

2b- Earned Income Measure: Maintained or

increased earned income (Adults aged 18-61)

16

36a: Permanent Housing

17

36a. Client Universe

Measure Actual # of Persons Served

by the Program, as

Applicable to Measure

Actual # of Persons Who

Accomplished Measure

Housing Stability All clients All clients who remained in the

permanent housing program

(stayers) or exited to any type of

permanent housing (leavers)

Total Income Measure All adults All adults who maintained or

increased their total income,

excluding clients who

maintained zero (“0”) income

Earned Income Measure All adults aged 18-61 All adults aged 18-61 who

maintained or increased their

earned income, excluding

clients who maintained zero

(“0”) income

18

36b. Transitional Housing

Three measures for Transitional Housing

1- Housing Stability: Exited to permanent

housing (All leavers)

2a-Total Income Measure: Maintained or

Increased total income (All adults served)

2b- Earned Income Measure: Maintained or

Increased earned income (Adults aged 18-61)

19

36b: Transitional Housing

20

36b. Client Universe

Measure Actual # of Persons Served

by the Program, as

Applicable to Measure

Actual # of Persons Who

Accomplished Measure

Housing Stability All leavers All clients who exited to any

type of permanent housing

(leavers)

Total Income Measure All adults All adults who maintained or

increased their total income,

excluding clients who

maintained zero (“0”) income

Earned Income Measure All adults aged 18-61 All adults aged 18-61 who

maintained or increased their

earned income, excluding

clients who maintained zero

(“0”) income

21

36c. Supportive Services Only

(Outreach)

Two types for Outreach programs

1- Housing Stability: Placed into housing (ES,

TH, SH, or PSH) (Leavers)

2a-2f Service Linkages: Received a service

for an identified physical or mental health

condition that they were not receiving at

program entry (Leavers)

22

36c: Supportive Services Only (Outreach)

23

36c. Client Universe

Measure Actual # of Persons Served

by the Program, as

Applicable to Measure

Actual # of Persons Who

Accomplished Measure

Housing Stability All leavers All clients who were placed into

any type of housing (leavers)

Service Linkages All leavers Received a services for an

identified physical or mental

health condition that they were

not receiving services for at

program entry (leavers)

24

36d. Supportive Services Only (with a

Housing Goal)

Three measures for SSO with a Housing Goal

1- Housing Stability: Exited to permanent

housing (All leavers)

2a-Total Income Measure: Maintained or

Increased total income (All adults served)

2b- Earned Income Measure: Maintained or

Increased earned income (Adults aged 18-61)

25

36d: Supportive Services Only (with

Housing Goal)

26

36d. Client Universe

Measure Actual # of Persons Served

by the Program, as

Applicable to Measure

Actual # of Persons Who

Accomplished Measure

Housing Stability All clients All clients who exited to any

type of permanent housing

(leavers)

Total Income Measure All adults All adults who maintained or

increased their total income,

excluding clients who

maintained zero (“0”) income

Earned Income Measure All adults aged 18-61 All adults aged 18-61 who

maintained or increased their

earned income, excluding

clients who maintained zero

(“0”) income

27

36e. Safe Havens

Two measures for Safe Havens:

1a- Housing Stability: Remained in Safe

Havens or exited to new permanent housing

(All persons served)

1b-Total Income Measure: Maintained or

increased total income (All adults served)

28

36e: Safe Havens

29

36e. Client Universe

Measure Actual # of Persons Served

by the Program, as

Applicable to Measure

Actual # of Persons Who

Accomplished Measure

Housing Stability All clients All clients who remained in the

Safe Haven (stayers) or exited

to any type of permanent

housing (leavers)

Total Income Measure All adults All adults who maintained or

increased their total income,

excluding clients who

maintained zero (“0”) income

30

Question 36: Narrative

31

Question 36 v. Question 37

Question 36 Question 37

Includes narrative

Measures are set by

HUD

Grantees pick targets

in Exhibit 2

HMIS vendors were

provided with

specifications for this

question

32

Question 37: Program Defined Measures

• Required for SSO grantees who are not:

– SHP-SSO and Street Outreach; OR

– SHP-SSO with a housing related goal

• Also required if a grantee selected a

measure in their Exhibit 2 project

application.

33

Question 37

• Data is not required to be programmed

into your HMIS.

• Identified in Exhibit 2 project application

the method that would be used to

measure this—must use that when

answering question 37 on your APR.

34

Question 37: Program Defined

35

Question 37: Narrative

36

Quiz #2

37

In which application year did HUD first request that grantees

provide performance measures in their Exhibit 2?

a. 2009

b. 2010

c. 2011

d. 2012

Quiz #3

38

For Question 36a (Permanent Housing), both Stayers and

Leavers are included in all three measures.

a. True

b. False

Monitoring Performance

During the Operating Year

39

Communicate!

40

Grantee

CoC

HMIS System Administrator

Programs

(TH, PSH, SH, and SSO)

Review your Past Performance

• Renewal Grants: Start with what you

already know about your program (APRs)

• New Grants: Talk to programs like yours

in your CoC

• Don’t recreate the wheel

• Be realistic, but don’t be afraid to

challenge yourself

41

Collect the Data

• Know that you have the capacity to track

the data that you want, before you set the

target

• If trying to track changes in income, ask

yourself:

– Do I collect income amounts and types at

both entry and exit for clients?

– Is the quality of this data good?

42

Get the Data Out

• Talk to your HMIS System Administrator

• Ask him or her:

– Can I get the Standard Performance

Measures (question 36) out of my HMIS?

– Can you help me know the quality and

completeness of the data that I am

collecting?

– If I set a measure for question 37, can I get

this out of HMIS? 43

Review Reports Regularly

• If you don’t review your data, you will not

be able to identify issues.

• Think about ways to integrate monitoring

of your Performance Measures into

existing work

– Staff Meetings

– CoC Meetings

– Monthly or Quarterly HMIS Reports

44

Next Steps

45

Next Steps

• Review HUD resources on the APR,

including the CoC APR Guidebook

• Locate your Exhibit 2 project application

for this grant

• Run your APR out of HMIS or a

comparable database

• Monitor your progress in achieving

performance measures—don’t wait for

your APR due date! 46

For More Information

Use the www.HUDHRE.info to download

additional information on the APR 47

HUD Virtual Help Desk

48

Webinar Evaluation

• You should now be able to:

– Identify the key components of Performance

Measurement

– Complete the Performance Measurement questions

on the CoC APR

– Understand how best to monitor the performance of

their program throughout the year

• Please complete the on-line survey to rate how

well this webinar met its objectives

49

49

Answers to Quiz Questions

50

Answers and Explanations for Quiz

• Quiz 1:

False.

Although HUD only requires grantees to report on their performance

once a year in the APR, it is important to review these measures on a

regular basis.

• Quiz 2:

The correct answer is B, 2010.

Grantees had one year to operate their programs and collect the

needed data to track their progress for the performance measures,

and then starting this year, in 2012, they have to report on their

performance.

51

Answers and Explanations for Quiz

• Quiz 3:

True. Both stayers and leavers are a part of the client universe for

question 36a. It is important to note that only adult stayers and

leavers report on the Total Income Measure, and that only adult

stayers and leavers between the ages of 18-61 report on the

Earned Income Measure.

• Quiz 4:

False. It is critical that the review of Performance Measures is part

of an ongoing, year-round process to monitor the effectiveness of

your program. You must know the quality and completeness of

the data that you are collecting to measure your performance, and

you must regularly review results so that potential program

adjustments can be made.

52