eligible training provider list (etpl)...assistance program. he attended the first day of training...
TRANSCRIPT
Eligible
Training
Provider
List
(ETPL)
Session Two
ETPL Provider
Performance Measures
Performance Measures
Accountability and Tracking
Identifying the Measures
Ver. 09/13/2017 MMJ
Accountability Measures
Program Enrollment
Successful Completion
Credential Attainment – @ Exit
Entered Employment [Any Field] – @ Exit
Ver. 09/13/2017 MMJ
Tracking Measures
Entered Employment [Training Related Field] – @ Exit
Median Earnings
Ver. 09/13/2017 MMJ
Definitions
Completed Training
Exit
Exclusionary Exits
O*Net-SOC Code
Ver. 09/13/2017 MMJ
Completed TrainingCase Examples:
“Of those participants who completed training…”
“Participants who completed training successfully…”
The training program that the participant was enrolled in
has either ended or they have dropped out of the activity.
At completion of training, the participant’s status is
recorded in CalJOBS as one of the following:
- Successfully Completed
- Unsuccessfully Completed
- Dropped Out of Activity
- Unknown Status
Ver. 09/13/2017 MMJ
Completed Training
Example:
John Smith attends ABC Education Institute’s Dental
Assistance Program.
He attended the first day of training on May 1, 2017.
The program was scheduled to end on August 31, 2017.
John dropped out of the program early on August 1, 2017.
John completed training on August 1, 2017, however his
status is that he completed unsuccessfully.
Ver. 09/13/2017 MMJ
ExitCase Examples:
“Exit from WIOA”
“Exit from program”
The date of exit is determined to on the 91st calendar day
since the participant last received Workforce Innovation
and Opportunity Act (WIOA), Trade Adjustment Assistance
(TAA), or Wagner-Peyser (WP) staff assisted services.
At that point, the date of exit is applied retroactively to the
last date of service.
Ver. 09/13/2017 MMJ
Exit
Example:
Jackie Smith completed training successfully on February
15, 2017.
Jackie continued to receive staff-assisted services from her
AJCC case manager through March 2017 and secured
employment on April 1, 2017. The last service Jackie
received from the AJCC was on April 10, 2017.
Jackie’s WIOA profile is then closed by the AJCC case
manager and put in a waiting period which should result in
an exit on July 9, 2017.
On July 9, 2017, Jackie’s profile status is now considered
exited.Ver. 09/13/2017 MMJ
Circumstances beyond the control of the participant do
not allow for the participant to continue receiving
services. It is unknown or not possible for the
participant to return to their WIOA program.
Types of Exclusionary Exits:
1. Institutionalized
2. Health/Medical
3. Deceased
4. Reservist called to Active Duty
*Disqualifies participants from being included in Credential Attainment and
Entered Employment Accountability Measure calculations.Ver. 09/13/2017 MMJ
Exclusionary ExitCase Example:
“That participant has an exclusionary exit. They won’t be counted in
performance.”
O*NET-SOC CodeCase Examples:
“The SOC code for training is…”
“The participant is employed in this SOC code field.”
O*NET - Occupational Information Network
SOC - Standard Occupational Classification
These codes are used to associate a training program to
the type of occupation the training program can lead to.
EXAMPLE: 31-9091.00 – Dental Assistants
Resource: https://www.onetonline.org/find/
Ver. 09/13/2017 MMJ
Accountability
Measures
Definitions & Methodology
Ver. 09/13/2017 MMJ
Accountability Measures
Program Enrollment
Successful Completion
Credential Attainment – @ Exit
Entered Employment [Any Field] – @ Exit
Ver. 09/13/2017 MMJ
Program Enrollment
The total actual number of participants still
enrolled in a training program after the designated
“last day to withdrawal” date during the reporting
period.
Accountability Measure
Definition
Annual Target: 5 enrollments
Ver. 09/13/2017 MMJ
[Real-Time Calculation]
Successful Completion
Definition
Number of participants who have a successful completion status as recorded in CalJOBS divided by number of participants who completed training during the year, as recorded in CalJOBS.
Methodology
Numerator# of participants who have a
Successfully Completed status during the reporting period
DenominatorTotal # of participants whose training
completed during the reporting period
Annual Target Rate: 80%
Ver. 09/13/2017 MMJ
Accountability Measure
[Real-Time Calculation]
Credential Attainment
Definition
Number of participants who have a credential recorded in CalJOBS at exit from WIOA divided by number of participants who completed training and exited WIOA during the year, as recorded in CalJOBS.
Methodology
Numerator# of participants who obtained a
credential/diploma/license and were exited during the reporting period
DenominatorTotal # of participants whose training
ended and were exited from WIOA during the reporting period
Target Rate: 80%
Ver. 09/13/2017 MMJ
Accountability Measure
[At time of Exit Calculation]
Credential Attainment
Example:
Jackie Smith completed training successfully on February
15, 2017.
Jackie continued to receive staff-assisted services from her
AJCC case manager through March 2017 and secured
employment on April 1, 2017. The last service Jackie
received from the AJCC was on April 10, 2017.
Jackie’s WIOA profile is then closed by the AJCC case
manager and put in a waiting period which should result in
an exit on July 9, 2017.
On July 9, 2017, Jackie’s profile status is now considered
exited.Ver. 09/13/2017 MMJ
Credential Attainment
Definition
Number of participants who have a credential recorded in CalJOBS at exit from WIOA divided by number of participants who completed training and exited WIOA during the year, as recorded in CalJOBS.
Methodology
Numerator# of participants who obtained a
credential/diploma/license and were exited during the reporting period
DenominatorTotal # of participants whose training
ended and were exited from WIOA during the reporting period
Target Rate: 80%
Ver. 09/13/2017 MMJ
Accountability Measure
[At time of Exit Calculation]
Entered Employment [Any Occupation]
Definition
Number of participants who have employment recorded in CalJOBS at exit from WIOA divided by number of participants who completed training and exited WIOA during the year, as recorded in CalJOBS. Participants are counted in the measure regardless of type of employment; employment does not have to be directly tied to training.
Methodology
Numerator# of participants employed at exit
DenominatorTotal # of participants whose training
ended and were exited from WIOA during the reporting period
Annual Target Rate: 75%
Ver. 09/13/2017 MMJ
Accountability Measure
[At time of Exit Calculation]
Questions?
Accountability Measures
Enrollment
Successful Completion
Credential Attainment
Entered Employment [Any Occupation]
Ver. 09/13/2017 MMJ
Tracking
Measures
Definitions & Methodology
Ver. 09/13/2017 MMJ
Tracking Measures
Entered Employment [Training Related Field] – @ Exit
Median Earnings
Ver. 09/13/2017 MMJ
Entered Employment [Training Related]
Definition
Number of participants who have employment recorded in CalJOBS at exit from WIOA divided by number of participants who completed training and exited WIOA during the year, as recorded in CalJOBS. Participants are only counted in the numerator if they are employed in the occupation for which they were trained by the program (as determined by SOC code).
Methodology
Numerator# of participants employed at exit in an
occupation indicated in CalJOBS as related to training
DenominatorTotal # of participants whose training
ended and were exited from WIOA during the reporting period
Tracking Measure
Ver. 09/13/2017 MMJ
[At time of Exit Calculation]
Median Earnings
For those participants who:
- Completed Training
- Exited WIOA
- Employed
The quarterly earnings of each participant will be arranged from least to greatest, the midpoint earnings is then selected as the median earnings.
Tracking Measure
Definition
Ver. 09/13/2017 MMJ
Median Earnings
Example:
CompTIA Certification Program:
3 Successful Program Completions, each participant has
exited from WIOA and is employed.
James Jones’s quarterly earnings is $8,000.
Sally Lee’s quarterly earnings is $6,000.
Kelly Jackson’s quarterly earnings is $10,000.
Median Earnings: $8,000
Ver. 09/13/2017 MMJ
Questions?
Tracking Measures
Ver. 09/13/2017 MMJ
Entered Employment [Training Related]
Median Earnings
Documentation Assistance
forAmerica’s Job Center of California
(AJCC)
Credential Attainment
Measurable Skills Gain (MSG)
Ver. 09/13/2017 MMJ
AJCC Performance Measures
Credential Attainment
AJCCs are required to obtain proof of credential/diploma/license of participants who enroll and complete their training program.
Measurable Skill Gain [MSG]
AJCCs are required to track progress of participants during their training program. To meet this measure both the participant and training provider will be required to assist with documentation.
Ver. 09/13/2017 MMJ
We will be requiring students provide their AJCC Case Manager with documentation of their progress in their training program. Such documentation includes:
1. Progress Report
Test Scores, or
Printout from Blackboard or similar tool, or
Syllabus or maybe Scoring Rubric, or
2. Customer Progress Report Form
3. Telephone Verification [Last Resort]
When students sign paperwork to enroll in class, training provider must remind students they need to provide documentation and show them how to access their Blackboard or similar tool to do so.
Ver. 09/13/2017 MMJ
Measurable Skills Gain
Documentation
We will be requiring students provide their AJCC Case Manager with documentation of their progress in their training program. Such documentation includes:
1. Progress Report
Test Scores, or
Printout from Blackboard or similar tool, or
Syllabus or maybe Scoring Rubric, or
2. Customer Progress Report Form
3. Telephone Verification [Last Resort]
When students sign paperwork to enroll in class, training provider must remind students they need to provide documentation and show them how to access their Blackboard or similar tool to do so.
Ver. 09/13/2017 MMJ
Measurable Skills Gain
Documentation
ETPL Dashboard
32
Next Training:
⁻ October 2017: ETPL Dashboard First Look
ETPL Coordinator
⁻ Email: [email protected]
⁻ Subject Line: ETPL Question [insert agency name]
33
Additional Assistance