AMTEC Certification&

Assessments

C BA

DF

One-to-One

TutoringMastery

Learning

Mastery LearningCompetency-Based Learning

Unit 1Formative

Test A

Formative

Test B

Corrective

activities

Corrective cannot be...

Mastery Learning

Unit 1

Enrichment

Activities

Formative

Test A

Unit 2

Formative

Test B

Corrective

activities

Multi-Skilled Maintenance

• 19 duties

• 110 tasks

Phase 1: AMTEC Occupational

Standards

• 13 courses

• 57 modules

Phase 2: AMTEC Training Standards

& Curriculum

• 1 comprehensive assessments

• 13 diagnostic assessments

• 57 pre- and post-test assessments

Phase 3: AMTEC Test and

Certification

6

DesignDACUM

2

Troubleshoot/repair/replace

gears

a

Perform visual inspection:

alignment, worn/missing teeth,

cracked teeth, etc.

b

Inspect gear to shafts for fitting

(looseness, etc.)

c Replace gear

d Set clearances

e Set backlash

f Check oil level

g Check grease lines for function

h

Apply predictive technology

(vibration analysis, ultrasonic, oil

analysis)

i Select and use correct lubrication

61 Student Learning OutcomesAMT 1086—Gears and Cams

A Gear and cam maintenance safety.

BDescribe the purpose and function of gears and gear drives.

C Open gears.

D Enclosed gears.

E Seals, breathers, and lubrication.

F Gear ratings and application and selection.

GIndustrial cam follower functions, uses, and terms.

HIndustrial cam follower bushing types and operating clearances.

I Gear identification.

J Assemble a parallel shaft gear drive.K Assemble an angle shaft gear drive.L Assemble a worm and wheel gearbox drive unit.

MIdentify the common types of cam followers and rod ends.

NReplace, install, and adjust cam followers and rod ends.

Assessment Goals

110 Standards

• 2 versions of Comprehensive Test –

• 19 topic areas and 110 standards

13 courses

• 13 Diagnostic (topic level) Assessments

57 modules

• 57 pre- and 57 post- tests

Assessment Plan Details110 Standards

• Aligned to Standards

• 2 versions

• Developed by Industry

• NOCTI Business Solutions

13 Diagnostic (topics)

• Aligned to Subset of Standards

• 13 tests

• Developed by Industry

• NOCTI Business Solutions

57 modules

• Aligned to Student Learning Outcomes

• 57 pre- and 57 post-tests

• Developed by Faculty

• Offered in LMS

Comprehensive Assessment

Currently

1 version of a validated comprehensive assessment with passing score

Administered to thousands of incumbent workers

Comprehensive Assessment

DACUM—

• September, 2007

Delphi--three

rounds

Core Standards Identified—

• August, 2008

Item collection

and writing

Pilot Testing

Validation and Cut Score—

• May 28, 2010

Test Specification for Core (Duty)

Fundamental Percent

200

Items

Grand

Mean

N=52

A MECHANICAL EQUIPMENT x 6% 11 3.08

B PNEUMATIC/HYDRAULIC EQUIPMENT x 5% 11 3.04

D. PREDICTIVE/CORRECTIVE MAINTENANCE Knowledge 5% 10 2.77

E BLUEPRINT READING/SCHEMATICS x 6% 12 3.28

F EQUIPMENT CONTROLS AND SENSORS x 6% 12 3.38

G ELECTRICAL EQUIPMENT x 6% 13 3.57

H ELECTRONIC EQUIPMENT Intro 4% 8 2.35

I NETWORKING Intro 4% 8 2.34

J PLC EQUIPMENT x 6% 13 3.56

L. ROBOTS x 5% 11 3.03

M RESISTANCE WELDING x 3% 7 1.92

O FABRICATE x 4% 9 2.47

P COMPUTER LITERACY x 6% 12 3.43

Q PREVENTATIVE MAINTENANCE x 6% 12 3.40

U SPECIALIZED MACHINERY x 5% 10 2.82

V METROLOGY x 5% 9 2.56

W SAFETY AND DOCUMENTATION x 7% 13 3.67

X LASER ETCHER Intro 3% 5 1.43

Y AUTOMATIC WELDER x 3% 7 1.84

Z SPECIALIZED EQUIPMENT x 3% 5 1.44

100% 200

13

Test Specification by Task

Fundamental

Items

Needed

Items

Have

Grand

Mean

N=52

E BLUEPRINT READING/SCHEMATICS

41 Interpret mechanical drawings x 3 0 3.60

42

Interpret pneumatic and hydraulic

drawings x 3 32

3.48

43 Interpret electrical schematics x 3 49 3.73

44

Interpret piping and instrumentation

diagram (P&ID) x 2 0

2.96

45

Operate basic drafting software

(AutoCAD or Visio) Introduction 2 0

2.62

14

Passing ScoreTest Category Number of

Test Questions

Percent Required

for Passing

A: Mechanical Equipment 13 76.9%

B: Pneumatic/Hydraulic Equipment 14 78.6%

D: Predictive/Corrective Maintenance 8 87.5%

E: Blueprint Reading/Schematics 13 76.9%

F: Equipment Controls and Sensors 12 83.3%

G: Electrical Equipment 11 81.8%

H: Electronic Equipment 8 75.0%

I: Networking 8 75.0%

J: PLC 13 92.3%

L: Robots 10 90.0%

M: Resistance Welding 7 85.7%

O: Fabricate 8 87.5%

P: Computer Literacy 11 100.0%

Q: Preventative Maintenance 12 75.0%

U: Specialty Equipment 10 80.0%

V: Metrology 7 85.7%

W: Safety and Documentation 13 76.9%

X: Laser Etcher 5 80.0%

Y: Automatic Welder 4 75.0%

Total Number of Items Deemed Essential 187 154

Total Number of Items 187

Percent Required for Passing 82.4%

Pilot Test DataTest Category Number of Test

Questions

Recalculated

Average Score

Passing Score

Established by

Panel

Percent of Pilot

Group that would

have passed Basic

level by section

N=228

A: Mechanical Equipment 13 69.7% 76.9% 49%

B: Pneumatic/Hydraulic Equipment 14 65.7% 78.6% 35%

D: Predictive/Corrective Maintenance 8 44.8% 87.5% 2%

E: Blueprint Reading/Schematics 13 48.4% 76.9% 5%

F: Equipment Controls and Sensors 12 61.8% 83.3% 14%

G: Electrical Equipment 11 57.9% 81.8% 17%

H: Electronic Equipment 8 57.9% 75.0% 33%

I: Networking 8 40.7% 75.0% 11%

J: PLC 13 60.8% 92.3% 7%

L: Robots 10 75.8% 90.0% 38%

M: Resistance Welding 7 60.8% 85.7% 21%

O: Fabricate 8 63.5% 87.5% 20%

P: Computer Literacy 11 70.2% 100.0% 9%

Q: Preventative Maintenance 12 67.8% 75.0% 50%

U: Specialty Equipment 10 70.8% 80.0% 49%

V: Metrology 7 52.6% 85.7% 5%

W: Safety and Documentation 13 64.6% 76.9% 31%

X: Laser Etcher 5 33.4% 80.0% 7%

Y: Automatic Welder 4 52.5% 75.0% 40%

Total Number of Items Deemed Essential 187 60.7% 82.4% 1%

Cut Score

• “Is it essential that a candidate answer this item correctly in order to be certified as a Multi-Skilled Automotive Maintenance Technician by AMTEC”?

Comprehensive Test• Cuyahoga Community College

• Lorain Community College

• Lakeland Community CollegeMAGNET (Ohio)

•TMMI—Ivy Tech

•TMMK—Bluegrass Community & Technical CollegeToyota•Pune, India

•Flint—Mott Community College

•Orion Plant—Oakland Community college

•UzDaewooAuto

General Motors

•Spartanburg Community CollegeBMW

•Henry Ford Community CollegeSeverstal

•Smyrna-Tennessee Technology Center—MurfreesboroNissan

•Industrial Maintenance CompletersSomerset Community

College

<2012 Comprehensive Test

1,627 tests

7 passed with 82.4%

•3 incumbent workers from TMMK

•4 Nissan North America--Smyrna

Since New VendorOctober, 2013-to current

150 Business and Industry

• Elizabethtown CTC-Workforce Solutions-AMTEC

• Ivy Tech Community College, Columbus-AMTEC

• Lansing Community College-AMTEC

• MAGNET-AMTEC

• Murakami Manufacturing USA, Inc.-AMTEC

• Murakami Mfg USA

• TG Kentucky, LLC. - AMTEC

• Williamston Products, Inc. - AMTEC

54 Postsecondary Students

• Owensboro Community and Tech-AMTEC

• Elizabethtown Community and Tech College-AMTEC

• Bluegrass Community and Technical College-AMTEC

• Somerset Community College-AMTEC

• Big Sandy Community & Technical College - AMTEC

• Jefferson Community and Technical College-AMTEC

• Somerset Community College-AMTEC

• Big Sandy Community & Technical College-AMTEC

Recent Test Results

MECHANICAL

EQUIPMENT

PNEUMATIC/HYDRA

ULICEQUIPME

NT

PREDICTIVE/CORREC

TIVEMAINTEN

ANCE

BLUEPRINT

READING/SCHEMATI

CS

EQUIPMENT

CONTROLSAND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPME

NTROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVE

MAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATION

LASERETCHER

AUTOMATIC

WELDERTotal

B&I (150) 68.6% 71.4% 46.0% 44.8% 62.2% 56.4% 62.7% 45.3% 49.8% 73.1% 58.7% 68.8% 77.9% 70.9% 75.1% 47.3% 70.8% 35.1% 57.8% 61.7%

PS (54) 57.8% 61.8% 45.4% 44.0% 50.0% 48.0% 56.0% 41.2% 38.0% 53.0% 44.7% 68.5% 76.6% 62.2% 65.0% 44.7% 60.7% 25.2% 46.3% 53.4%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

Cut ScoreGap >35%

MECHANICA

LEQUIPMENT

PNEUMATIC/HYDRAULICEQUIPMENT

PREDICTIVE/CORRECTIVE

MAINTENANC

E

BLUEPRINT

READING/SCHEMATICS

EQUIPMENTCONTR

OLSAND

SENSORS

ELECTRICALEQUIPMENT

ELECTRONICEQUIPMENT

NETWORKIN

G

PLCEQUIPMENT

ROBOTS

RESISTANCEWELDI

NG

FABRICATE

COMPUTER

LITERACY

PREVENTATI

VEMAINTENANC

E

SPECIALIZED

MACHINERY

METROLOGY

SAFETY ANDDOCUMENTATION

LASERETCHE

R

AUTOMATICWELDE

R

Total

Cut Score 76.9% 78.6% 87.5% 76.9% 83.3% 81.8% 75.0% 75.0% 92.3% 90.0% 85.7% 87.5% 100.0% 75.0% 80.0% 85.7% 76.9% 80.0% 75.0% 82.4%

Overall (204) 65.8% 68.9% 45.8% 44.6% 59.0% 54.2% 60.9% 44.2% 46.7% 67.7% 55.0% 68.8% 77.5% 68.6% 72.5% 46.6% 68.1% 32.5% 54.8% 59.5%

B&I (150) 68.6% 71.4% 46.0% 44.8% 62.2% 56.4% 62.7% 45.3% 49.8% 73.1% 58.7% 68.8% 77.9% 70.9% 75.1% 47.3% 70.8% 35.1% 57.8% 61.7%

PS (54) 57.8% 61.8% 45.4% 44.0% 50.0% 48.0% 56.0% 41.2% 38.0% 53.0% 44.7% 68.5% 76.6% 62.2% 65.0% 44.7% 60.7% 25.2% 46.3% 53.4%

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

120.0%

Percent Passing by Duty

MECHANICALEQUIPMENT

PNEUMATIC/HYDRAUL

ICEQUIPMENT

PREDICTIVE/C

ORRECTIVE

MAINTENANCE

BLUEPRINT

READING/SCHEMATICS

EQUIPMENTCONTR

OLSAND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPMENT

ROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVEMAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATI

ON

LASERETCHER

AUTOMATIC

WELDER

Total

Overall (204) 37% 25% 1% 4% 15% 10% 40% 10% 2% 24% 16% 24% 11% 51% 48% 3% 38% 6% 39% 0%

B&I (150) 42% 30% 1% 4% 20% 13% 42% 12% 3% 32% 20% 23% 10% 55% 56% 3% 45% 7% 45% 0%

PS (54) 24% 9% 0% 4% 2% 4% 33% 4% 0% 2% 6% 26% 15% 39% 26% 4% 17% 4% 24% 0%

0%

10%

20%

30%

40%

50%

60%

Overall (204)

B&I (150)

PS (54)

Participant FeedbackDuty Level

Number of Items

Your % Correct Comment

A MECHANICAL EQUIPMENT 13 69.2% N.I.B PNEUMATIC/HYDRAULIC EQUIPMENT 14 78.6% N.I.

D PREDICTIVE/CORRECTIVE MAINTENANCE 8 37.5% N.I.E BLUEPRINT READING/SCHEMATICS 13 69.2% N.I.

F EQUIPMENT CONTROLS AND SENSORS 12 83.3% passG ELECTRICAL EQUIPMENT 11 63.6% N.I.H ELECTRONIC EQUIPMENT 8 75.0% pass

I NETWORKING 8 37.5% N.I.J PLC EQUIPMENT 13 76.9% N.I.

L ROBOTS 10 90.0% passM RESISTANCE WELDING 7 100.0% passO FABRICATE 8 75.0% N.I.

P COMPUTER LITERACY 11 90.9% N.I.

Q PREVENTATIVE MAINTENANCE 12 75.0% pass

U SPECIALIZED MACHINERY 10 80.0% passV METROLOGY 7 71.4% N.I.W SAFETY AND DOCUMENTATION 13 76.9% pass

X LASER ETCHER 5 40.0% N.I.Y AUTOMATIC WELDER 4 100.0% pass

187 73.8% N.I.

Participant FeedbackTask Level

J PLC EQUIPMENT # Items Your % Correct

70 Create/modify/monitor PLC programs 2 100.0%

71 Program/maintain operator interface software 2 100.0%

72 Troubleshoot communication systems in PLC 2 50.0%

73 Replace PLC processor 2 100.0%

74 Perform backups of PLC software programs 2 50.0%

75 Install/maintain PCL hardware 2 100.0%

76 Edit/Program PLC 1 100.0%

L. ROBOTS # Items

83 Install/Maintain robot systems 6 50.0%

84 Program/edit robot software 4 75.0%

M RESISTANCE WELDING # Items

85

Perform visual inspection of resistance welding equipment

operation 1 100.0%

86 Align components in resistance welding equipment 1 100.0%

87 Repair/replace failed components in resistance welding equipment 1 100.0%

89

Perform parameter adjustments (weld conditions) on resistance

and stud welding 1 0.0%

90 Troubleshoot/repair/replace location pins and datum surfaces 1 100.0%

91 Maintain cooling system in resistance welding equipment 1 0.0%

92

Perform resistance checks (resistance of cable and condition of

insulators) 1 100.0%O FABRICATE # Items

97 Perform pipefitting tasks 2 100.0%

98 Operate machining equipment 3 66.7%

99 Operate welding equipment for fabrication 3 66.7%

Program FeedbackBy Task

E BLUEPRINT READING/SCHEMATICS # Items % of Group Correct

41 Interpret mechanical drawings 3 68.7%

42 Interpret pneumatic and hydraulic drawings 3 24.9%

43 Interpret electrical schematics 3 53.1%

44

Interpret piping and instrumentation diagram

(P&ID) 2 72.7%

45

Operate basic drafting software (AutoCAD or

Visio) 2 30.8%

F EQUIPMENT CONTROLS AND SENSORS # Items % of Group Correct

46 Troubleshoot/replace/install circuit boards 1 74.3%

47 Install/maintain/troubleshoot photo eyes 1 9.3%

48 Install/maintain/troubleshoot servo motors 2 59.3%

49

Install/maintain/troubleshoot VFD drives

(Variable Frequency Drive) 2 45.6%

50

Install/maintain/troubleshoot limit and

proximity switches 2 96.0%

51

Troubleshoot/calibrate/adjust and replace

sensors and input devices 2 84.1%

52 Calibrate process control loop (PID) 1 63.6%

53 Troubleshoot/replace transducers 1 48.6%

Nissan

Source of Training

MECHANICAL

EQUIPMENT

PNEUMATIC/HYDRAULIC

EQUIPMENT

PREDICTIVE/CORR

ECTIVEMAINTENANCE

BLUEPRINT

READING/SCHEM

ATICS

EQUIPMENT

CONTROLS AND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPM

ENTROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVE

MAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATION

LASERETCHER

AUTOMATIC

WELDERTotal

Trade school/career technical center (88) 65.8% 69.0% 47.3% 46.4% 59.3% 56.6% 62.6% 44.7% 49.1% 68.5% 53.7% 71.0% 78.8% 69.6% 72.6% 45.9% 68.2% 31.1% 57.1% 60.3%

Comprehensive high school (41) 64.5% 63.8% 45.1% 47.7% 57.9% 56.1% 56.7% 46.0% 47.3% 65.6% 50.2% 70.4% 73.4% 68.5% 71.0% 43.6% 67.2% 30.2% 49.4% 58.3%

Military (MOS) training (13) 76.3% 74.2% 42.3% 55.6% 67.9% 60.8% 65.4% 51.9% 59.8% 70.8% 60.4% 72.1% 88.1% 78.2% 79.2% 45.1% 72.8% 32.3% 69.2% 66.3%

Apprenticeship/on-the-job training (74) 66.6% 69.1% 46.3% 46.2% 58.9% 55.0% 62.0% 47.3% 47.8% 68.2% 55.2% 73.3% 75.9% 69.8% 74.6% 46.5% 70.7% 29.7% 57.8% 60.5%

External/specialized trianing programs (42) 70.1% 73.8% 44.9% 46.3% 62.7% 56.7% 62.8% 46.4% 55.3% 74.0% 60.2% 70.8% 78.1% 71.8% 75.2% 48.0% 72.7% 32.4% 58.9% 62.9%

community/junior technical college (82) 65.5% 68.6% 44.8% 47.3% 58.8% 57.4% 62.7% 45.0% 48.5% 66.2% 52.3% 71.3% 81.3% 67.7% 71.8% 46.5% 67.3% 30.0% 56.7% 60.0%

four-year college/university (7) 54.9% 76.5% 48.2% 49.5% 57.1% 53.2% 60.7% 44.6% 48.4% 68.6% 69.4% 64.3% 75.3% 69.0% 72.9% 44.9% 70.3% 40.0% 42.9% 60.0%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Education Level

MECHANICAL

EQUIPMENT

PNEUMATIC/HYDRAULI

CEQUIPM

ENT

PREDICTIVE/CORRECTIVEMAINTENANCE

BLUEPRINT

READING/SCHEMATICS

EQUIPMENT

CONTROLSAND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPM

ENTROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVEMAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATI

ON

LASERETCHER

AUTOMATIC

WELDERTotal

HS (50) 58.0% 58.4% 44.0% 38.3% 47.3% 44.5% 52.5% 38.5% 36.6% 58.8% 45.4% 66.3% 67.3% 62.0% 65.8% 42.0% 63.2% 24.8% 43.5% 51.7%

HS+ (52) 67.6% 72.0% 45.9% 45.6% 61.7% 59.3% 64.2% 48.6% 49.6% 71.2% 59.6% 72.4% 79.5% 71.6% 75.6% 50.3% 71.6% 35.0% 63.0% 62.5%

Assoc (42) 67.0% 72.4% 46.1% 47.8% 61.7% 57.8% 67.0% 43.2% 50.7% 68.6% 50.3% 67.9% 84.2% 70.2% 74.0% 46.6% 69.4% 30.0% 57.1% 61.4%

Bach (4) 63.5% 73.2% 56.3% 42.3% 64.6% 61.4% 62.5% 53.1% 48.1% 80.0% 64.3% 62.5% 84.1% 70.8% 80.0% 32.1% 78.8% 40.0% 37.5% 63.0%

MS (1) 73.1% 67.9% 62.5% 46.2% 70.8% 68.2% 56.3% 62.5% 65.4% 80.0% 64.3% 62.5% 86.4% 75.0% 85.0% 35.7% 65.4% 40.0% 87.5% 66.8%

0.0%10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%

100.0%

Years of Experience

MECHANICAL

EQUIPMENT

PNEUMATIC/HYDRA

ULICEQUIPME

NT

PREDICTIVE/CORREC

TIVEMAINTEN

ANCE

BLUEPRINT

READING/SCHEMATI

CS

EQUIPMENT

CONTROLS AND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPME

NTROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVE

MAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATION

LASERETCHER

AUTOMATIC

WELDERTotal

1 to 3 years 58.6% 64.5% 47.3% 41.7% 50.8% 51.4% 57.2% 38.1% 40.8% 62.0% 43.9% 67.8% 78.5% 64.0% 68.0% 43.5% 64.1% 28.5% 49.6% 55.2%

4 to 6 years 70.9% 68.9% 50.9% 53.3% 61.3% 55.8% 67.0% 51.8% 47.3% 70.0% 61.2% 63.4% 77.9% 68.5% 75.7% 46.9% 67.6% 34.3% 55.4% 61.9%

7 to 9 years 62.5% 62.5% 40.6% 40.4% 55.2% 47.7% 57.8% 46.9% 41.3% 60.0% 41.1% 70.3% 69.3% 66.7% 73.8% 44.6% 69.2% 17.5% 46.9% 55.3%

10 to 12 years 67.2% 68.1% 42.5% 41.5% 61.1% 52.7% 66.7% 43.3% 47.2% 68.7% 55.2% 68.3% 78.2% 67.8% 76.7% 50.5% 75.9% 30.7% 63.3% 60.5%

13 to 15 years 69.2% 70.0% 43.8% 43.1% 62.5% 54.5% 66.3% 38.8% 59.2% 80.0% 68.6% 77.5% 76.4% 76.7% 79.0% 50.0% 75.4% 30.0% 60.0% 63.7%

16 to 20 years 68.1% 67.9% 50.9% 45.1% 56.0% 55.2% 55.4% 55.4% 46.2% 70.7% 65.3% 75.0% 70.8% 76.8% 75.7% 45.9% 73.1% 34.3% 60.7% 61.5%

21 or more years 74.2% 82.7% 42.0% 47.3% 69.6% 69.5% 67.9% 53.6% 58.2% 80.0% 68.4% 72.3% 81.2% 79.8% 77.1% 48.0% 73.1% 37.1% 64.3% 67.4%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

Job Title

MECHANICAL

EQUIPMENT

PNEUMATIC/HYDR

AULICEQUIPME

NT

PREDICTIVE/CORR

ECTIVEMAINTEN

ANCE

BLUEPRINT

READING/SCHEMAT

ICS

EQUIPMENT

CONTROLS AND

SENSORS

ELECTRICAL

EQUIPMENT

ELECTRONIC

EQUIPMENT

NETWORKING

PLCEQUIPME

NTROBOTS

RESISTANCE

WELDING

FABRICATE

COMPUTER

LITERACY

PREVENTATIVE

MAINTENANCE

SPECIALIZED

MACHINERY

METROLOGY

SAFETYAND

DOCUMENTATION

LASERETCHER

AUTOMATIC

WELDERTotal

Maintenance technician (73) 67.3% 70.5% 44.2% 40.6% 58.0% 55.9% 62.0% 43.5% 46.8% 69.6% 54.0% 68.3% 75.2% 70.0% 74.5% 47.9% 69.9% 32.3% 55.1% 59.7%

Electrician (3) 69.2% 69.0% 58.3% 53.8% 52.8% 57.6% 58.3% 37.5% 61.5% 66.7% 52.4% 66.7% 93.9% 66.7% 76.7% 57.1% 64.1% 33.3% 58.3% 62.4%

Mechanic (3) 51.3% 52.4% 50.0% 38.5% 47.2% 42.4% 41.7% 45.8% 33.3% 56.7% 33.3% 70.8% 51.5% 69.4% 63.3% 47.6% 74.4% 6.7% 41.7% 50.1%

Die Maker (2) 73.1% 75.0% 37.5% 42.3% 54.2% 50.0% 50.0% 31.3% 50.0% 75.0% 50.0% 87.5% 59.1% 75.0% 90.0% 42.9% 69.2% 20.0% 50.0% 59.4%

Machinist (1) 61.5% 35.7% 50.0% 61.5% 50.0% 54.5% 62.5% 37.5% 23.1% 70.0% 42.9% 87.5% 81.8% 83.3% 90.0% 57.1% 69.2% 20.0% 25.0% 57.8%

Supervisor (6) 70.5% 77.4% 47.9% 47.4% 68.1% 56.1% 64.6% 50.0% 55.1% 81.7% 66.7% 64.6% 86.4% 79.2% 76.7% 54.8% 73.1% 20.0% 70.8% 65.5%

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Future Plan

Review and Update Current Comprehensive Test

Develop at least one additional version

Diagnostic Assessments

13 Topic Tests

Computer Literacy

Fluid Power and Electro-hydraulics/ pneumatics

General PM and

Predictive Maintenance

PLC (Siemens)

PLC (Allen Bradley/Rock

well)

Blueprint reading/

schematics

Robotics Controls & Instrumentation

Basic Electricity

and Electronics

Mechanical Systems/

Mechanical Drives/Power Transmission

Safety

Welding and Fabrication

Plan to Complete Diagnostic Tests

Finish Pilot Testing

• May, 2013

Industry SME’s establish cut

score by module

Release for Purchase

Industries in Diagnostics Test Development

• Toyota West Virginia

• Toyota Texas

• Toyota Indiana

• Nissan

• Ford

• BMW

12 tests

Number of

Sections/Modules

Number of Test

Items

1Fluid Power and

Electrohydraulics/pneumatics

7 149

2 General PM and Predictive Maintenance 5 100

3 PLC [ALLEN BRADLEY/ROCKWELL] 4 161

4 Blueprint Reading/Schematics 2 151

5 Robotics--Fanuc 5 83

6 Controls & Instrumentation 4 152

7 Basic Electricity and Electronics 4 150

8Mechanical Systems/Mechanical

Drives/Power Transmissions

6 152

9 Safety 4 137

10 Computer Literacy 4 116

11 Welding and Fabrication 4 169

12 Machine Tool Operations 7 179

Test Spec

A AMT1071: Introduction to Basic Electricity # items1 Demonstrate knowledge of basic electrical principles 11

2 Interpret electrical schematics 14

3 Install/replace wire 13

B AMT 1072: Instruments # items

4 Demonstrate knowledge of instruments 145 Operate electrical/electronic test equipment 19

C AMT 1073: Component & Circuits # items

6 Demonstrate knowledge of components and circuits 137 Install/maintain relays 12

8 Install/replace fuses and circuit breakers 14

D AMT 1074: Solid State Drives # items

9 Demonstrate knowledge of solid state drives 18

10 Maintain/install fiber optics 6

11 Troubleshoot/repair/replace vision systems 4

12 Install/maintain/troubleshoot bar code readers 413 Perform startup and shut down of laser etcher 8

150

Pilot Test

• The pilot test is free to industry and candidates

• Industry will receive diagnostic feedback on the results once the test is finalized

• Pilot test candidates will receive feedback on the results

Ready for Validation• Fluid Power and

Electrohydraulics/pneumatics

• General PM and Predictive Maintenance

• PLC (Allen Bradley)

• Blueprint Reading/Schematics

• Controls & Instrumentation

• Basic Electricity and Electronics

• Mechanical Systems/Mechanical Drives/Power Transmissions

• Machine Tool Operations

Need more Pilot Test Takers

• Safety

• Computer Literacy

• Welding and Fabrication

• Robotics--Fanuc

Need To Be Developed

• Siemens PLC

Validation

• Establish Cut ScoreIndustry Pilot Test

• Industry and Schools

• Diagnose to the module level

Uses

Future Plans

Develop PLC Siemens

Validate tests and establish cut scores

Develop performance (hands on) tests

Pre- and Post Module Assessments

CurriculumDACUM

2

Troubleshoot/repair/replace

gears

a

Perform visual inspection:

alignment, worn/missing teeth,

cracked teeth, etc.

b

Inspect gear to shafts for fitting

(looseness, etc.)

c Replace gear

d Set clearances

e Set backlash

f Check oil level

g Check grease lines for function

h

Apply predictive technology

(vibration analysis, ultrasonic, oil

analysis)

i Select and use correct lubrication

61 Student Learning OutcomesAMT 1086—Gears and Cams

A Gear and cam maintenance safety.

BDescribe the purpose and function of gears and gear drives.

C Open gears.

D Enclosed gears.

E Seals, breathers, and lubrication.

F Gear ratings and application and selection.

GIndustrial cam follower functions, uses, and terms.

HIndustrial cam follower bushing types and operating clearances.

I Gear identification.

J Assemble a parallel shaft gear drive.K Assemble an angle shaft gear drive.L Assemble a worm and wheel gearbox drive unit.

MIdentify the common types of cam followers and rod ends.

NReplace, install, and adjust cam followers and rod ends.

2011 Pre- and Post-Test Development Sessions

• recorded “how-to” webinarMay 25, 2011

• Lansing Community College (pilot test)July 18

• Danville Community CollegeJuly 27-28

• San Antonio Community College DistrictAugust 8-9

• Henry Ford Community CollegeAugust 22-23

AMT 1071Introduction to Basic Electricity

• Lab 1: Electrical Safety

• Lab 2: Sources of Electricity

• Lab 3: Ohmeter Lab Project

• Lab 4: Open & Closed Circuits

• Lab 5: Components & Schematic Symbols

• Lab 6: Voltage & Current Meter Measurements

• Lab 7: Ohm's Law

• Lab 8: Watt's Law

• Lab 9: Resistance in Series Circuits

• Lab 10: Current in Series Circuits

• Lab 11: Voltage in Series Circuits

• Lab 12: Effects of an Open in Series Circuits

• Lab 13: Effects of a Short in Series Circuits

• Lab 14: Variable Resistors

• Lab 15: Equivalent Resistance of a Parallel Circuit

• Lab 16: Voltage in Parallel Circuits

• Lab 17: Current in Parallel Circuits

• Lab 18: Effects of an Open in Parallel Circuits

• Lab 19: AC Sine Wave Generation

• Lab 20: Magnetism

• Lab 21: Magnetism --Electromagnetism (Relay)

Faults

Rubric

Tool

Selection

and Use

Highly Proficient

A Competent

B

Partially

Competent/

Developing

C

Limited

D

Major

Improvement

Required

E

3 Selection of

equipment

25 Correctly and efficiently

selected equipment

Incorrect

selection of

equipment

4 Correct set

up

25 Correctly set up the

equipment for readings

Somewhat

correct

Incorrect set

up

5 Use of Meter 25 Correctly and efficiently

connected meter to device

Somewhat

efficiently

Had to have

assistance in

connecting

the meter to

device

6 Care and use

of tools

15 Handled tools carefully

and respectfully

Mishandled one

or more of the

tools

Showed

disrespect for

the tools

Troubleshooting

Skills Highly

Proficient

A

Competent

B

Partially

Competent/

Developing

C

Limited

D

Major

Improvement

Required

E

7 Sequence of

diagnosing problem

20 Used a logical

sequence to

locate the

problem

Used a trial

and error

approach but

was able to

locate the

problem

Was unable to

locate the

problem

8 Efficient use of time 15 Finished tasks

on or ahead of

time

Barely

finished task

in allocated

time

Did not

complete task

9 Accurately

diagnosed condition

of component

25 Correctly

diagnosed

condition of all

8 components

With

assistance was

able to

diagnose

condition of at

least 6

components

Could not

diagnose

condition of 4

or more of the

components

Work Habits

Highly Proficient

A

Competent

B

Partially

Competent/

Developing

C

Limited

D

Major Improvement

Required

E

10 Work Attitude 15 Alert to finding and

correcting problem

Honestly

attempted to find

and correct

problems

Showed frustration

in finding and

correctly problem

11 Work Procedure 25 Always followed standard

procedures; demonstrated

planning and organization

skills in correcting the

problem

Complied with

standard

procedures;

Showed some plan

and organization

in working

Did not follow

standard procedures;

Disorganized and

slipshod methods;

12 Professionalism 20 Work showed pride in

accomplishment

Tried hard and

shows promise

Work lacks

praiseworthy factors

13 Self-confidence 15 Appeared comfortable and

posed when performing

tasks

Fairly self-

confident;

occasionally

disconnected

Hesitant, timid,

uncertainty

14 Knowledge of job 25 Has an exceptionally

thorough knowledge of the

job

Has good

knowledge but

needed coaching

Has inadequate

knowledge of job

Plan

During Industry Curriculum Review and Revision

•Lab Rubrics being reviewed

•Test items being reviewed

Learning Analytics

AMTEC Data

Pre and post test scores

Lab Rubrics

Diagnostic tests

Comprehensive tests

College and Industry Survey

Measures

• Numbers receiving training, number of degrees and certificates, and student engagementInputs

• Cost of training and assessmentsEfficiency

• Participants Rating of Training QualityReaction

• Percent reporting increased knowledge and skillsLearning

• Percent of employees using the skillsApplication

• Training programs driving business measures (productivity, less downtime, promotions, employer satisfaction, etc.)Impact

• Learning and development program has won awardsAwards

Career Path EntrantsSecondary students articulated through community college

Postsecondary students entering college first time

Postsecondary students seeking retraining

Dislocated/unemployed workers

Incumbent workers skill enhancement by mfg. in general, auto industry, tier supplier

12–13

40%

50%

60%

70%

80%

90%

100%

11–12 13–14 14–15 15–16 16–17 17–18 18–19 19–20

Is it possible?

98%

97%

96.8%

95.6%

92.2%

Incumbent

79%

Overall

65%

Postsecondary

58%

Dislocated

54%

High School

50%

Learning Analysis

What is the difference in scores on the various AMTEC assessments and labs for

• Those that use the AMTEC curriculum and those that are using other curriculum models

• Sources of training or academic degrees/experiences

• Years experience

• Learning Delivery (traditional college classroom, apprenticeship, online, real flipped classroom)

Test Item-level analysis

• Specific questions that were missed more often than others

• Specific student learning outcomes (not taught/covered or poorly taught)

• Specific occupational standards (not taught/covered or poorly taught)

• Faculty member occupational experience or background

Is there anything that would indicate technical issues prevented a successful outcome?

• Those programs that implement open entry/open exit, competency based models

• Those programs that are using the flipped classroom model

• The LMS platform being used

• The use of the AMTEC trainer or alternative simulation equipment

Panel Members

Nissan

• Kevin Smith/Paul Williams

Bluegrass CTC

• Mary Maggard

Somerset Community College

• Nick Tomlinson

By Nick Tomlinson

November 12, 2013

Somerset Community College and the ATMEC Assessment

Brief History of KCTCS and the AMTEC Assessment

• Fall 2010 semester,

– Dr. Annette Parker, former AMTEC director and liaison to the statewide curriculum

– KCTCS Industrial Maintenance Technology (IMT) curriculum committee,

– new Perkins IV assessment legislation for Fall 2012

• October, 2010,

– the IMT committee chose to use the AMTEC General Mechatronics assessment

Brief History of KCTCS and the AMTEC Assessment

• KCTCS involved in the AMTEC DACUM and creation of the AMTEC comprehensive assessment

• Cost benefit of using AMTEC test

SCC and the AMTEC Assessment• Spring 2011

– The Somerset Community College (SCC) Industrial Maintenance Technology (IMT) program began offering the AMTEC General Mechatronics assessment to students

– the SCC IMT faculty, which consists of Butch Tincher, Danny Lester, and Nick Tomlinson agreed to pre-test all incoming students and post-test all graduating students.

– SCC felt that better data concerning student learning could be obtained from comparing pre-test scores to post-test scores.

SCC and the AMTEC Assessment• Butch Tincher was appointed

AMTEC test coordinator.

– ensures that all incoming freshmen and graduates are tested.

– works with the SCC Assessment Center to procure a date for the exams and

– coordinates with all of the other instructors to find release time for the students to take the exam.

SCC and the AMTEC Assessment• April 1, 2011.

– Thirteen (13) students were tested.

– Six of them were pre-tests and seven were post-tests.

• Since that time,

– 51 students have been pre-tested and

– 27 have been post-tested. – The discrepancy between pre-tests and post-tests is due to non-

completers and students who are currently within their 2 years of

study and are not prepared for the post-assessment.

SCC Results

•currently 48.5.The cumulative

average pre-test score for SCC IMT students

•currently 58.2.The cumulative

average post-test score for SCC IMT students

•9.7 points.SCC students are increasing, on average,

SCC Results

•69.5 on 9-6-13.The highest pre-test score ever recorded

•30.5 on 9-6-13.The lowest pre-test

score ever recorded at SCC

•78 on 11-4-11.The highest post-test

score ever recorded at SCC

•28.9 on 11-16-12.The lowest post-test

score ever recorded at SCC

SCC ResultsSCC Student Distribution on Pre-Test

Pre-Test Scores

Score Number %

0-9 0 0

10-19 0 0

20-29 0 0

30-39 7 13.725

40-49 21 41.176

50-59 17 33.333

60-69 6 11.765

70-79 0 0

80-89 0 0

90-100 0 0

Totals: 51 100

SCC Student Distribution on Post-Test

Post-Test Scores

Score Number %

0-9 0 0

10-19 0 0

20-29 1 3.7037

30-39 1 3.7037

40-49 3 11.1111

50-59 10 37.037

60-69 10 37.037

70-79 2 7.4074

80-89 0 0

90-100 0 0

Totals: 27 100

Three Qualifying Factors

• There is a trio of factors that one must consider when looking at the assessment results from SCC.

1. Students did not take the exam seriously

– Example a bright 4.0 G.P.A. student scored a 53 on the pre-test and received the worst score in SCC history with a 28.9. He admitted to not giving the effort needed to score well, because “you just had to take it, not pass it.”

Qualifying Factors2. Sequence of SCC IMT curriculum.

– Content courses involving electricity, motor controls, PLCs, blueprint reading, fluid power, mechanics, welding, and machine tool.

– worst sub-scores on student assessments are generally in those topics that were taken at the beginning of their program.

– best sub-scores on student assessments are generally in those topics that were taken in the last semester of their program.

Qualifying Factors

3. SCC does not use the AMTEC curriculum.

– SCC is using the state approved KCTCS curriculum.

– If SCC used the AMTEC curriculum, the scores would most likely increase.

The Future of SCC and AMTEC• Two critical factors

– Concern of the high cut-score on the AMTEC exam

– Time eroding student memory

• Conclusion

– creating a cumulative course known as IMT 289 Industrial Maintenance Capstone.

The Future of SCC and AMTEC• Fall, 2013

– all incoming students graduating with a diploma or degree will take this 1 credit hour capstone course

– The purpose of this course is to refresh the students’ memory of all of the main ideas in their previous IMT courses.

– At the completion of the course, students are required to take the AMTEC assessment as their final exam.

The Future of SCC and AMTEC

• Perkins IV– Along with this capstone course, Perkins V legislation

requires 70% of all graduates to achieve an approved cut-off score on the end of program assessment.

• On September 6, 2013, – the KCTCS IMT Curriculum Committee met in

Versailles, KY to established a cut-off score for the AMTEC test of 50.8.

– This score is for KCTCS use only in reporting results to the federal government in fulfillment of the Perkins V legislation. It does not supplant the official AMTEC cut-off score of 82.4%.

The Future of SCC and AMTEC

• SCC students will be required to pass the AMTEC test IMT 289 course.

– SCC students who do not meet the 50.8% will be required to retake the IMT 289 course.