joint ils manager tools course development t.r. “randy” pilling program director, acquisition...

Joint ILS Manager ToolsCourse Development

T.R. “Randy” PillingProgram Director, Acquisition Logistics(703) 805-2277 [email protected]

September 12, 2005

Joint ILS Manager ToolsCourse Development

• DAU contacted by LOGSA (Bill Edwards) seeking endorsement, partnership, co-teaching in course development and delivery

• DAU also aware of LMI support to Navy regarding development and delivery of ILS courses

• First coordination meeting 4 Aug 05:- Consensus on need, requirements and content - Assignment specific, level 200 course- Agreed to share coordination & control in course development- Level of commitment to get it done- Course objectives and development timelines in work—

potential deployment 1Q FY 07- Manpower and funding provided by LOGSA

ILS Manager Tools CoursePreliminary Schedule

Metrics-That-Matter (MtM)Logistics & Sustainment Course Metrics

T.R. “Randy” PillingProgram Director, Acquisition Logistics(703) 805-2277 [email protected]

September 12, 2005

DAU Metrics-That-Matter (MtM)

• Metrics that Matter (MTM) Survey System serves as the standard application DAU-Wide for recording of customer support for both students

and special customer requested projects.• Data is collected at the end of or immediately

following each course• Survey questions cover areas relating to:

- Instructor- Courseware- Learning Effectiveness/On-Line Learning- Job Impact- Environment

Report Card Grading

Other includes: • Courseware• Learning Effectiveness• Environment• Job impact • Online Delivery (where applicable)

MtM 7 Point Scale

HighlySatisfied

HighlySatisfiedDissatisfied

HighlyDissatisfied

HighlyDissatisfied Neutral

1 2 3 4 5 6 7

6.0: DAU Instructor rating5.2: DAU Instructor rating

5.6: DAU other category ratings

5.2: DAU other category ratings

Satisfied

Instructor

Courseware

Environment

Online Delivery

Learning

Effectiveness

Job Impact

All Courses: 2nd Quarter Summary

48 0 0

64 7 0

41 4 3

16 7 0

65 6 0

31 29 11

71 courses: 48 residence, 23 DL

Instructor

Courseware

Environment or Online Delivery

Learning

Effectiveness

Job Impact

101 102 201A 201B 203 204

LOG: 2nd Quarter Summary

Instructor

Courseware


Learning

Effectiveness

Job Impact

235A 235B 304

LOG: 2nd Quarter Summary

Program Mgmt CurriculumRatings by Course

Instructor

Courseware


Learning

Effectiveness

Job Impact

ACQ ACQ ACQ PMT PMT PMT FE101 201A 201B 250 352A 352B 201

PMT/ACQ/FE: 2nd Quarter Summary

Engineering & Technology Curriculum

Ratings by Course

Instructor

Courseware


Learning

Effectiveness

Job Impact

IRM IRM IRM SAM SAM SAM PQM101 201 301 101 201 301 101

E&T: 2nd Quarter Summary

Instructor

Courseware


Learning

Effectiveness

Job Impact

PQM PQM PQM PQM PQM PQM STM104 201A 201B 202 212 301 201


Instructor

Courseware


Learning

Effectiveness

Job Impact

STM SYS SYS SYS TST TST TST302 201A 201B 301 101 202 301


DAU Strategy

• Identify issues/inconsistencies with MtM results• Review survey questions • Determine applicable data filters• Review processes for data collection/allocation

• Develop standardized procedures for collecting, filtering and reporting accurate data

• Continue to review MtM results/progress at executive level and incorporate data into faculty/staff assessment reports

• Implement “Data Mart” tool for fusion of MtM, travel, timekeeping and financial data systems

BACKUP

LOGISTICS CURRICULUMRatings by Course

MTM LOG 101 Report Card2nd Qtr

Category Current Qtr Rating

Cumulative FY Rating

Courseware n=795 n=1,705

Online Delivery n=794 n=1,696

Learning Effectiveness n=768 n=1,654

Job Impact n=801 n=1,681

5.855.89

5.695.70

5.895.90

5.385.36




Courseware n=1,043 n=1,594

Online Delivery n=1,039 n=1,588

Learning Effectiveness n=1,009 n=1,541

Job Impact n=1,019 n=1,567

5.855.84

5.755.73

5.905.81

5.335.31

MTM LOG 201A Report Card2nd Qtr



Courseware n=261 n=688

Online Delivery n=261 n=683

Learning Effectiveness n=249 n=654

Job Impact n=255 n=678

5.925.86

5.935.86

5.905.90

5.315.17

MTM LOG 201B Report Card2nd Qtr



Instructor n=343 n=630

Environment n=341 n=622




6.616.64

6.056.12

5.975.97

6.026.02

5.505.48








6.146.15

6.076.25

6.046.02

5.505.55

MTM LOG 235A Report Card2nd Qtr







5.975.85

5.885.72

5.955.82

5.365.26

MTM LOG 235B Report Card2nd Qtr








6.606.68

6.046.05

6.046.20

6.096.13

5.475.55









6.666.74

5.835.41

6.156.24

6.136.19

5.936.11









6.736.75

6.166.08

6.276.20

6.266.18

5.885.88

Program Mgmt CurriculumRatings by Course

MTM ACQ 101 Report Card2nd Qtr







5.94

5.86

6.07

5.12

6.09

5.95

5.88

5.45

MTM ACQ 201A Report Card2nd Qtr







5.75

5.54

5.85

5.25

5.84

5.74

5.53

5.24

MTM ACQ 201B Report Card2nd Qtr








6.68

5.82

6.12

6.21

5.53

6.67

5.77

6.10

6.17

5.58

MTM PMT 250 Report Card2nd Qtr









6.536.69

5.14

5.935.79

5.595.62

5.735.57

5.735.29

Engineering & Technology Curriculum

Ratings by Course

MTM STM 201 Report Card2nd Qtr








6.31

4.91

5.46

5.52

5.35

6.33

4.81

5.42

5.41

5.33

MTM STM 302 Report Card2nd Qtr








6.40

5.35

5.62

5.81

5.44

6.34

5.63

5.50

5.83

5.32

MTM SYS 201A Report Card2nd Qtr







5.59

5.33

5.49

5.10

5.52

5.32

5.52

5.09

MTM SYS 201B Report Card2nd Qtr








6.46

5.79

5.69

5.62

5.23

6.39

5.74

5.57

5.50

5.11

MTM SYS 301 Report Card2nd Qtr








6.43

5.60

5.65

5.62

6.40

5.66

5.62

5.60

5.29 5.34

Report Card Grading (survey questions)

7 6 5 4 3 2 1 n/aThe content was divided into small enough units to allow for sufficient learning.

7 6 5 4 3 2 1 n/aThe electronic user interface was friendly and easy to navigate.

7 6 5 4 3 2 1 n/aThe online delivery had the right level of user interaction/involvement.

7 6 5 4 3 2 1 n/aThe graphics and illustrations used were meaningful and within context.

7 6 5 4 3 2 1 n/aThe instructor was helpful. (web-based only)

7 6 5 4 3 2 1 n/aThis delivery method was an effective way for me to learn the material.

7 6 5 4 3 2 1 n/aThe online help desk was beneficial.

7 6 5 4 3 2 1 n/aThe exercises or knowledge reviews added value to my learning. (facilitated online courses only

On-line Survey Questions

joint ils manager tools course development t.r. “randy” pilling program director, acquisition...

Documents