the work readiness indicator measuring progress of wia youth
DESCRIPTION
The Work Readiness Indicator Measuring Progress of WIA Youth. November 17-18, 2009 – Chicago, Illinois. Presenters. Charles Modiano, Division of Youth Services, Employment and Training Administration, DOL [email protected] ; 202-693-2679 Jill Meseke, Bureau of Workforce Development - PowerPoint PPT PresentationTRANSCRIPT
1
The Work Readiness IndicatorThe Work Readiness Indicator
Measuring Progress of WIA Measuring Progress of WIA YouthYouth
November 17-18, 2009 – Chicago, Illinois
Webinar on Work Readiness Indicator ARRA Summer Employment Program 2
PresentersPresenters
Charles Modiano, Division of Youth Services, Employment and Training Administration, [email protected]; 202-693-2679
Jill Meseke, Bureau of Workforce Bureau of Workforce
DevelopmentDevelopmentIllinois Dept. of Commerce and Economic Illinois Dept. of Commerce and Economic OpportunityOpportunity
Oana Amaria, Bureau of Workforce Bureau of Workforce DevelopmentDevelopmentIllinois Dept. of Commerce and Economic Illinois Dept. of Commerce and Economic OpportunityOpportunity
Webinar on Work Readiness Indicator ARRA Summer Employment Program 3
Today’s AgendaToday’s Agenda
The Work Readiness Indicator (WRI)The Work Readiness Indicator (WRI)
A) What happened this summer?
B) How did we measure work readiness?
C) Examples of WRI Tools Used
D) Where Do We Go From Here?
E) Your Turn: Informing the System
Webinar on Work Readiness Indicator ARRA Summer Employment Program 4
RECAP: Defining Work ReadinessRECAP: Defining Work Readiness
The Work Readiness Skills Goal, as specified in TEGL No. 17-05 includes a measurable increase in work readiness skills including:
– World-of-work awareness, labor market knowledge, occupational information, career planning and decision making, and job search skills
– Independent living skills, positive work habits, attitudes and behaviors, showing initiative and reliability, and assuming the responsibilities involved in maintaining a job
– The definition of a Work Readiness Skills Goal, as specified in TEGL No. 17-05, Attachment B Definition of Key Terms found at http://wdr.doleta.gov/directives/attach/TEGL17-05_AttachB.pdf
Webinar on Work Readiness Indicator ARRA Summer Employment Program 5
RECAP: RECAP: Work Readiness under ARRAWork Readiness under ARRA
Any youth in summer employment funded by the Recovery Act were included in the work readiness indicator, even if a youth receives services beyond summer or before summer
The work readiness portion of the WIA skill attainment rate was the primary indicator used for youth who participate in “summer employment” only and are only being served with Recovery Act funds
Webinar on Work Readiness Indicator ARRA Summer Employment Program 6
Preliminary Work Readiness DataPreliminary Work Readiness Data Unofficial Thru Sept. 2009 Unofficial Thru Sept. 2009
347,782 total youth served
306,466 in summer employment
71%* Summer Employment Completion Rate
63%* Work Readiness Attainment Rate(67 % median)
*In this preliminary data some states report lag in data that accounts for lower rates than expected
Webinar on Work Readiness Indicator ARRA Summer Employment Program 7
Work Readiness Attainment RateWork Readiness Attainment RateUnofficial State Data thru Sept. 2009*Unofficial State Data thru Sept. 2009*
State Range: High: 95%; Low: 3%*
Over 90%: Florida, New Hampshire, & Rhode Island
Over 80%: 12 states
Over 60%: 30 states
40 - 60%: 11 states
Under 40%: Nine states
*In this preliminary data some states report lag in data that accounts for lower rates than expected
Webinar on Work Readiness Indicator ARRA Summer Employment Program 8
GAO Report Findings GAO Report Findings Work Readiness under ARRAWork Readiness under ARRA
Observational Success, But Difficult to Measure “While many program officials, employers, and participants we spoke with believe the summer youth activities have been successful, measuring actual outcomes has proven challenging and may reveal little about what the summer activities achieved.”
More Consistency = More Comparability: “the methodologies used to measure work readiness varied widely, calling into question the comparability and the usefulness of the indicator when rolled up at the national level. Of the 10 states, only Illinois established a single approach to be used statewide in measuring work readiness gains.”
Webinar on Work Readiness Indicator ARRA Summer Employment Program 9
GAO Report Findings GAO Report Findings Work Readiness under ARRAWork Readiness under ARRA
Cited Local Example: “youth… were given a 20-question true-false survey that included questions such as “I understand the importance of demonstrating a positive attitude in the workplace.’”
Outcomes Beyond Work Readiness Indicator: “Seven of our 10 states reported they plan to track long-term outcomes, such as job placement and employment retention, for at least some of the youth they served this summer”
Webinar on Work Readiness Indicator ARRA Summer Employment Program 10
The Department of Labor The Department of Labor Response to the GAO ReportResponse to the GAO Report
DOL’s Future Plans: “The Department plans to further refine the work readiness indicator and determine a more effective way of measuring work readiness.”
Further Guidance: “In the event that a significant number of local areas have Recovery Act funds available for summer employment in 2010, or if the Dept. receives funds for future summer employment activities…, the dept. will issue further guidance for measuring work readiness that allows for the reporting of more consistent and meaningful data.”
Future Technical Assistance: “In either case, the Dept. will provide technical assistance to states and local areas on effective ways to measure work readiness based on the information learned this summer and further research on best practices.”
Webinar on Work Readiness Indicator ARRA Summer Employment Program 11
Future of the Future of the Work Readiness IndicatorWork Readiness Indicator
More RIGOR – while maintaining an efficient process
More CONSISTENCY – while respecting diversity of program models
More MEANINGFUL – in measuring impact of summer program experience– based on dual customer approach of employers and youth
WRI: Where do we go from here?WRI: Where do we go from here?
Webinar on Work Readiness Indicator ARRA Summer Employment Program 12
What Employers Want What Employers Want Most from Young WorkersMost from Young Workers
Skill Group Specific Work Readiness Goals
1) WORK ETHIC/ PROFESSIONALISM
• Attendance and punctuality• Workplace appearance• Accepting direction and constructive
criticism• Positive attitude, motivation, and
initiative• Demonstrating personal accountability
2) TEAMWORK/ COLLABORATION
• Build relationships with colleagues/customers
• Work with diverse teams• Manage and negotiate conflicts
3) COMMUNICATION
• Oral: effectively articulate thoughts & ideas
• Non-Verbal Communication• Written Communication
4) PROBLEM-SOLVING /CRITICAL THINKING
• Exercise sound reasoning • Communicate new ideas to others• Demonstrate creativity and innovation
Source: CommCorp
Webinar on Work Readiness Indicator ARRA Summer Employment Program 13
Work Readiness Indicators 2009Work Readiness Indicators 2009Most Common Measurement AreasMost Common Measurement Areas
2) BEHAVIOR
1) KNOWLEDGE & MINDSET
3) PORTFOLIO & TOOLS
What We MeasuredWhat We Measured
Mostly ObservationalTraining Evaluations
Work Supervisor Evaluations
Pre/mid/post Assessments
Work Readiness Checklists
Portfolio AssessmentsPortfolio Checklists
How We Measured ItHow We Measured It
Webinar on Work Readiness Indicator ARRA Summer Employment Program 14
1) 1) Measuring Measuring KNOWLEDGE/MINDSETKNOWLEDGE/MINDSET
Enrollment
Pre-Assessment
Completion
Post-A
sses
smen
t
Summer Work Experience
Mid-Point
Mid
-Ass
essm
ent
Webinar on Work Readiness Indicator ARRA Summer Employment Program 15
1)1) Measuring KNOWLEDGE/MINDSETMeasuring KNOWLEDGE/MINDSETIllinois Statewide ExampleIllinois Statewide Example
Example from Bureau of Workforce Development Illinois Dept. of Commerce and Economic Opportunity
How can we best measure KNOWLEDGE/MINDSET?
What are some sample questions?
Paper or Computer?
Webinar on Work Readiness Indicator ARRA Summer Employment Program 16
How can we best measure BEHAVIOR in training?
How can we make the subjective more objective?
Example can be used in work readiness training or work-site: Participants receive a supervisor evaluation following their work experience. Those with satisfactory/high rating are awarded a work readiness attainment.
2A) Measuring BEHAVIOR 2A) Measuring BEHAVIOR In Work Readiness TrainingIn Work Readiness Training
Example: The Learning Employability Profile (LEP) from Seattle King County is an example of a tool used by local providers to monitor work-readiness
Webinar on Work Readiness Indicator ARRA Summer Employment Program 17
2A) Measuring BEHAVIOR in 2A) Measuring BEHAVIOR in Work Readiness Training ExampleWork Readiness Training Example
Webinar on Work Readiness Indicator ARRA Summer Employment Program 18
Example: A youth’s Individual Service Strategy must include at least one specific skill goal from any of the three skill groups:
(1) Career Readiness Skills, (2) Work Ethic and Professionalism, and (3) Communication and Interpersonal Skills.
2B) Measuring BEHAVIOR 2B) Measuring BEHAVIOR at the Work Siteat the Work Site
Example: The Massachusetts Work-based Learning Plan is a tool for assessing (1) Work Ethic and Professionalism, and (2) Communication and Interpersonal Skills, the MWBLP can be downloaded from: http://www.skillslibrary.com/wbl.htm
Webinar on Work Readiness Indicator ARRA Summer Employment Program 19
2B) Measuring BEHAVIOR 2B) Measuring BEHAVIOR Work-Site Evaluation Example (Handout) Work-Site Evaluation Example (Handout)
Webinar on Work Readiness Indicator ARRA Summer Employment Program 20
3) PORTFOLIO & TOOLS3) PORTFOLIO & TOOLS
Prepares RESUME
Completion of Cover Letters
Completion of Sample Master Application
Sample Follow-up Letter
Employer Reference (s)
Informational Interviews with Employers
Opening of Bank account
Etc.
Webinar on Work Readiness Indicator ARRA Summer Employment Program 21
Work-readiness tool rates 12 different personal competency areas. Six are pre-employment tasks and six are job-specific
The State of Arizona requires 5 pre-employment goals be met
Employers assess youth at completion of work experience; Youth must receive a supervisor rating of at least 80% to be considered successful
3) PORTFOLIO Building 3) PORTFOLIO Building An Integrated ExampleAn Integrated Example
Example: The Skill Attainment Record - Work ReadinessAttainment Skills at Tuscon Youth Development is a tool thatmeasures portfolio along with other work competency areas.
Webinar on Work Readiness Indicator ARRA Summer Employment Program 22
3) PORTFOLIO Building 3) PORTFOLIO Building An Integrated ExampleAn Integrated Example
Webinar on Work Readiness Indicator ARRA Summer Employment Program 23
Future of the Future of the Work Readiness IndicatorWork Readiness Indicator
More RIGOR – while maintaining an efficient process
More CONSISTENCY – while respecting diversity of program models
More MEANINGFUL – in measuring impact of summer program experience– based on dual customer approach of employers and youth
WRI: Where do we go from here?WRI: Where do we go from here?
Webinar on Work Readiness Indicator ARRA Summer Employment Program 24
Future of Performance OutcomesFuture of Performance Outcomes
To Education (Secondary, Post-Sec., GED)
To Continued Employment
To Occupational Skills Training
TRANSITION RATE (Beyond Summer)TRANSITION RATE (Beyond Summer)
Webinar on Work Readiness Indicator ARRA Summer Employment Program 25
Question and Answer Question and Answer PeriodPeriod
What kind of work-readiness assessment tool did you use?
What did you like and dislike?
What are your general thoughts or concerns about DOL providing guidance around a more consistent and rigorous work readiness indicator in the future?
What would you do if you were DOL?
Webinar on Work Readiness Indicator ARRA Summer Employment Program 26
Stay Informed, Get Connected!Stay Informed, Get Connected!
Workforce3 One: Communities of practice Live web-based events Register for updates!
For more information about the workforce investment system: Visit www.careeronestop.org Call 1-877-US2-JOBS