What’s Happening with Performance Accountability  – WIA to WIOA

California Workforce Association Spring Conference

Denise DombekETA Region 6, San Francisco, CA

May 12, 2015

Workforce Innovation and Opportunity Act - WIOA

2

Federal Register Notice

• Workforce Innovation and Opportunity Act; Joint Rule for Unified and Combined State Plans, Performance Accountability, and the One-Stop System Joint Provisions; Notice of Proposed Rulemaking• Pages 20573 - 20687 (115 pages) [FR DOC #:

2015-05528] • Published on April 16, 2015• Written Comments must be received by no

later than June 15, 2015 3

WIOA Performance Accountability – System Alignment• Performance Accountability – System Alignment• Ensuring that federal investments in

employment and training programs are evidence-based, data-driven, and accountable to participants and taxpayers by establishing a common performance accountability system for the core programs and requiring other authorized programs to report on the common performance indicators.

4

Data Collection

• For the most part, most of the performance data required by WIOA is already being collected. However, the primary indicators of performance specify outcomes with respect to quarters after exit that are different from WIA. There are also some additional data elements that will be required such as credentials attainment, measurable skills gain, training-related costs and information regarding employer engagement.

5

Policies/Procedures and Training• Data management and the resultant quality of

reported data are derived from and influenced by the policies, procedures and protocols utilized at the state and/or local levels• Grantees should develop guidance for staff and

sub-grantees involved in the collection of data: Definitions of data elements Sources of information Participant record and documentation requirements Procedures for collecting, entering and reporting data and

associated “business rules” that cover timeliness and completeness

Procedures for entering data into an automated database Procedures for correcting data

6

Training and Monitoring

• Data collection and data entry:• Routine training should be provided for data

management guidance• All staff involved in the collection or entry of

data should be trained in the procedures• The data entry process should include steps for

verifying entered data against original sources on a sample basis or for entire population of records

7

REPORTING

• If Data is not collected and reported, it didn’t happen!!

8

WIOA Identified Programs – Common Performance Accountability measures

• Core Programs• WIA (Title I)• Adult, Dislocated Worker, Youth

• Wagner-Peyser (Title III)• Vocational Rehabilitation (Title IV)• Adult Education (Title II)

• Additional Programs• Job Corps• Native American • Migrant and Seasonal Farmworker • YouthBuild

9

WIA Notable Changes - Performance

Additional Measures – Employer, Skills Tracking of “Efficiency” Outputs Common Reporting/Tracking: Core Programs UI Wage Record Access for Core Programs Sanctions for “Failure” – Reporting, Outcomes ETPL Reporting Changes – incl. scope of trainees Regression Models - Negotiations, Measurement Pay-for-Performance Contracting Allowability Dissemination of Effective Practices

10

10

Pay for Performance• Local Areas may use up to 10% of Adult and Dislocated Worker

funds for pay-for-performance contract strategies.• Based on the achievement of specified levels of performance on the

core program’s performance measures (primary indicators of performance)

• Further provisions included in Notice of Proposed Rulemaking (NPRM) and additional guidance planned on the appropriate use of pay-for-performance contract strategies.

11

Performance Accountability*unless State ‘early implementer’

WIA (Workforce Investment Act) effective through PY15

‘Services’ based Participation and Exit

Data Validation requiredReporting Cohort primarily

1st to 3rd Qtr after ExitNine Common MeasuresReporting Participant

InformationSequence of Services –

Core, Intensive, Training

WIOA (Workforce Investment and Opportunity Act) effective PY16*

‘Services’ based Participation and Exit

Data Validation codifiedReporting Cohort extended

2nd to 4th Qtr after ExitTwelve Primary Indicators

of PerformanceExpanded Reporting

Participant Information‘Career Services’ and

Training12

WIA Participant

• An individual determined eligible to participate in the program who receives a service funded by the program in either a physical location (e.g., One-Stop Center) or remotely through electronic technologies.• Three Components• Determined eligible to participate in the program• Receives a funded service• In either a physical location or through electronic

technologies

13

WIOA “Participant”

•When does participation begin?•What services commence participation

and inclusion in performance accountability?•What is impact of self service?• Reported across Core Programs?

14

WIA Exiter

• A participant who hasn’t received a program or partner-funded service for 90 consecutive days and no future services are scheduled

• Three components• Hasn’t received a service• For 90 consecutive days• No future services scheduled

15

WIOA “Exit”

•When is it appropriate to Exit?• Same for all Programs?• Youth participants?• Common or Program Exit?

16

A WIA Service Is:

Any core, intensive or training activitymade available to eligible participants that allows them to benefit from specific programs in the workforce system.

17

WIOA “Service”

• No longer ‘sequence of services’• Core and Intensive = Career Services •What commences and continues

participation?

18

WIA Entered Employment RateOf those who are not employed at the date of participation:

Number of adult participants who are employed in the 1st quarter after the exit

quarter

Number of adult participants who exit during the quarter

19

WIA Employment Retention RateOf those who are employed in the first quarter after the exit quarter:

Number of adult participants who are employed in both the second and third

quarters after the exit quarter

Number of adult participants who exit during the quarter

20

WIA Average Six-Month Earnings Of those adult participants who are employed in the first, second and third quarters after the exit quarter:

Total earnings in the second quarter plus total earnings in the third quarter after the

exit quarter

Number of adult participants who exit during the quarter

21

WIA PLACEMENT IN EMPLOYMENT OR EDUCATION• Of those not employed, in the military or in post-secondary

education at participation:

Number of youth employed, in the military or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1st quarter after exit

Number of exiters

22

WIA ATTAINMENT OF DEGREE OR CERTIFICATE

Of those enrolled in education at participation or any time during the program:

Number of Youth who attained a diploma, GED or certificate by the end of the 3rd quarter after exit

Number of Exiters

23

23

WIA LITERACY/NUMERACY GAINSOf those out-of-school youth who are basic skills deficient:

Number of Youth participants who increase one or more educational functioning levels

Number of youth who completed a year of participation (based on date of 1st youth service) PLUS Number of youth who exit before completing a year of participation

24

24

Core Programs’ Performance Measures (except WIOA Youth)

1. Employment• 2nd quarter after exit

2. Employment • 4th quarter after exit

3. Earnings• New; Median earnings 2nd quarter after exit

4. Credential Rate• New; Up to one year after exit; Doesn’t apply to WP

5. In-Program Skills Gain• New; Achieving measurable skills gains, Doesn’t apply to WP

6. Employer Effectiveness• New; before PY16

25

WIOA Youth Performance Measures • Education/Employment• 2nd quarter after exit

• Education/Employment• 4th quarter after exit

• Earnings• Median earnings 2nd quarter after exit

• Credential Rate• Up to one year after exit• If HS Dip/GED, must include Employment/Postsecondary

• In-Program Skills Gain• Achieving measurable skills gains

• Employer Effectiveness• before PY16

26

Employment Measure - WIA to WIOA Reporting Time Periods

For the Quarter ending Sept 2014

2013 2014

Jan-Mar

Apr-June

July-Sept

Oct-Dec

Jan-Mar

Apr-June

July-Sept

Oct-Dec

Exit Cohort        

  Employment/Education Qtr      

      2 Qtr Wage Delay  

             

Nov 15th

2015

Jan-Mar

Feb 14th

27

WIOA – What’s Eliminated

• Literacy/Numeracy indicator for youth

• Although utilized in development of Skills Gain measure

• Customer Satisfaction as statutory measure

• State Incentive Funds

• But Governor’s reserve may be used for local incentives 28

WIOA Youth Program Design• Focus on Out of School Youth• 75% of formula youth funds minimum

• Work Experience Expenditure• 20% of local area funds minimum

• Eligible Out-of-School Youth Age• 16-24 year olds

• In-School Youth Age• 14-21 year olds

• New Program Elements• 5 new elements

29

WIOA Youth Program Transition

• Youth PY 2015 Funding• April 1, 2015•WIOA Implementation• July 1, 2015

TEGL 23-14. While WIOA is effective July 1, 2015 and the Youth funds allotments are provided April 1, 2015, and it will take some time to transition, States and Local Areas must begin to incorporate strategies for recruiting and serving more OSY with the receipt of PY 2015 funds. Progress must be documented, including plans to achieve 75% expenditure rate with future funds.

30

Additional Provisions

• State Targets• Must use statistical adjustment model—use now

codified (Sec. 116(b)(3)(A)(viii))• Targets for first two years included in State Plans

• Additional Information required in Annual Reports• Example: Amount of funds spent on each type of

service• Data Validation now codified (Sec. 116(d)(5)) 31

Additional Provisions

• Sanctions• State Level• If a state fails performance a first year, TA will be

provided (used to say will provide TA upon request)• If a state fails performance a 2nd consecutive year or fails

to submit an Annual Report for any year, it can lead to a 5% reduction in statewide funds (stronger language)

• Local Level• If failure continues for a 3rd consecutive year, the

Governor must take corrective action which shall include development of a reorganization plan (and new local board)

32

WIOA State ReportingState Performance Reports will include:• Information specifying levels of performance for the

primary indicators• State adjusted levels of performance for each program• Performance information aggregated by individuals

with:•Barriers to employment •Subpopulation of these individuals according to

race, ethnicity, sex and age•Total participants served by each program•The percentage of the State’s annual allotment

spent on administrative costs33

WIOA State Reporting (cont)•Information on participants in career and training services during the program year and the 2 preceding programs years: •The number of participants enrolled•The number of participants who exited•The total amount of funding expenditures•The average cost/participant•The number of participants enrolled in more than 1 program•The number of participants with barriers to employment•Administrative costs

34

WIOA State Reporting-Pay for Performance• Pay-for-performance contracts for program

strategies:• The performance of the service providers

measured against contract-specified performance measures• An evaluation of the design of the programs and

performance of the strategies • Where possible, levels of satisfaction among

employers and participants• Other information that facilitates comparisons

with programs in other states. 35

WIOA Local Reporting

Local Performance Reports will include everything in the State reports in addition to the following:•The percentage of the Local’s annual allotment spent on administrative costs; and•Other information that facilitates comparisons of programs in other local areas

36

WIOA Eligible Training Providers (ETP) ReportingETPs provide student performance outcome data in State reports, which must include:▪The Total number of individuals exiting a

program (WIOA-funded and non-WIOA-funded)▪Elements relating to the number of WIOA

participants receiving & exiting training▪Average cost ▪Number of special populations served.

37

Timeline for WIOA Performance Transition

Date

• April 16, 2015• June 15, 2015• July 22, 2015

• March 3, 2016

• June 30, 2016

• July 1, 2016

Action

• Proposed regulations published• Comment Period Ends• Templates for state, local, and

ETP performance reports• PY2016 Performance Targets

negotiated• Employer Effectiveness measure

developed• Full implementation of WIOA

performance measures 38

WWW.DOLETA.GOV/WIOAWIOA Resource Page

• Fact Sheets• NPRM Webcast• Notice of Proposed Rulemaking Updates • Guidance• WIOA Technical Assistance Tools and

Resources

39

39

Questions

• Final Questions or Comments

40