© 2010-2011 kirkpatrick partners, llc. all rights reserved. trademark and copyright warning ©...
TRANSCRIPT
![Page 1: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/1.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Trademark and Copyright Warning
© Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights reserved.
This presentation remains the exclusive property of Kirkpatrick Partners, LLC. Distribution or duplication of these slides and content, in whole or in part, in any way is strictly prohibited. These are for the personal use of program attendees only.
The following marks are the property of Kirkpatrick Partners, LLC as related to educational / training materials, programs and books: Kirkpatrick®
Kirkpatrick Four LevelsTM
The One and Only Kirkpatrick®
![Page 2: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/2.jpg)
Marching Orders for U.S. Military Training: 2012 and Beyond
Part 1: Jim Kirkpatrick, Ph.D. and Wendy Kayser Kirkpatrick
![Page 3: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/3.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Audience Poll
What brings you to the webinar?
![Page 4: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/4.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Session Objectives
• Identify the levels currently being utilized in your training initiatives
• Describe how to cost-effectively measure training at all four Kirkpatrick levels
• Set specific goals for increasing the organizational value of training
![Page 5: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/5.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Dr. Don Kirkpatrick
1944 1998
![Page 6: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/6.jpg)
![Page 7: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/7.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Quick Pre-test
In sequence from 1-4, what are the names of the Kirkpatrick levels?
A. Reactions, Transfer, Knowledge, Impact
B. Reaction, Knowledge, Behavior, Result
C. Response, Learning, Transfer, Impact
D. Reaction, Learning, Behavior, Results
![Page 8: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/8.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 1: REACTION To what degree participants react
favorably to the training
The Kirkpatrick Model
![Page 9: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/9.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 2: LEARNINGTo what degree the participants acquire
the intended knowledge, skills, and attitudes
The Kirkpatrick Model
![Page 10: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/10.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 3: BEHAVIOR To what degree participants apply what they learned during training when they
are back on the job
The Kirkpatrick Model
![Page 11: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/11.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 4: RESULTS To what degree targeted outcomes occur
as a result of the learning event(s) and subsequent reinforcement
The Kirkpatrick Model
![Page 12: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/12.jpg)
Audience Poll
What is the highest level to which you have ever measured a program or initiative?
A. Level 1 Reaction
B. Level 2 Learning
C. Level 3 Behavior
D. Level 4 Results
![Page 13: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/13.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Why Evaluate?
![Page 14: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/14.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
![Page 15: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/15.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
![Page 16: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/16.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 4: Results
Return on Expectations (ROE)
What a successful training initiative delivers to key business stakeholders, demonstrating the degree to which their expectations have been satisfied
![Page 17: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/17.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Planning ExecutionDemonstration
of Value
![Page 18: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/18.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
The End is the Beginning
Reaction
Behavior
Results
Learning
![Page 19: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/19.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
The End is the Beginning
Level 1: Reaction
Level 3: Behavior
Level 4: Results
Level 2: Learning
![Page 20: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/20.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Audience Poll
What is the highest level result / mission of the U.S. military, in general?
![Page 21: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/21.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Your Marching Orders
• Cost-effective training, reinforcement and evaluation
• Utilize current resources as much as possible
• Demonstrate mission value
![Page 22: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/22.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Planning ExecutionDemonstration
of Value
![Page 23: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/23.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
MONITOR & ADJUST
THE NEW WORLD KIRKPATRICK MODEL
LEVEL 1
LEARNING
• Engagement
• Relevance
• Customer
• Knowledge
• Skills
• Attitude
• Confidence
• Commitment
satisfaction
LEVEL 2
REACTION
LEVEL 3BEHAVIOR
LEVEL 4RESULTS
• Leading • Desiredindicators outcomes
![Page 24: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/24.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 3: Behavior
Required Drivers
Processes and systems that reinforce, monitor, encourage, and reward performance of critical behaviors on the job
![Page 25: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/25.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 3: Behavior
Methods, tools and techniques (Required Drivers)
![Page 26: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/26.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Level 4: Results
Leading Indicators
Short term observations and measurements that suggest that critical behaviors are on track to create a positive impact on desired results
![Page 27: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/27.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Kirkpatrick Evaluation Plan Background:
U.S. Navy Yeoman A. School
•Trained to run Navy offices, both on ship and shore
•Plans for them to take on more responsibility in coming years
•History of varied training approaches, none sufficient. A new approach is required.
![Page 28: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/28.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
U.S. Navy Yeoman A School
Stakeholder ExpectationsTo efficiently run a Navy office to meet the mission of the assigned command (including but not limited to correspondence, leave, security, legal matters, and reports)
Level 4 Results Cost reduction while accomplishing specific mission objectives
Level 3 Behavior1. Follow respective procedures for completing written
documentation2. Maintain confidentiality and integrity in dealing with personnel
issues3. Present positive customer service-oriented attitudes at all times
![Page 29: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/29.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Audience Poll
Identify a leading indicator that would affirm that the critical behavior is on track to
contribute to the targeted results:
“Follow respective procedures for completing written documents”
![Page 30: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/30.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
U.S. Navy Yeoman A School New World AdditionsLevel 4 Results
Cost reduction while accomplishing specific mission objectives
Leading Indicators
• Decreased errors in written documentation
• Reduced number of critical incidents
• Reduced number of kicked back reports
• Fewer complaints from executive office
Level 3 Behavior1. Follow respective procedures for completing written documentation2. Maintain confidentiality and integrity in dealing with personnel
issues3. Present positive customer service-oriented attitudes at all times
![Page 31: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/31.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
U.S. Navy Yeoman A School New World AdditionsLevel 3 Behavior / Required Drivers1. Follow respective procedures for completing written documents
Monitoring: Spot checks, observation, self- and peer-audits, formal inspections
Reinforcing: On-going training, self-directed learning, job aids
2. Maintain confidentiality and integrity in dealing with personnel issues
Monitoring: Tracking security breaches, desk audits, checklist audits
Encouraging: Coaching by commanders and peers, mentoring (each Yeoman has one)
![Page 32: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/32.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
U.S. Navy Yeoman A School
New World AdditionsLevel 2 LearningLevel 2 Learning
Attitude (Will this be worthwhile?)Evaluation methods: Post-training interviews with trainers and
mentors
Confidence (I can do this on the job) Evaluation methods: ‘Formative discussion, hybrid survey,
immediate post training interview with mentor
Commitment (I intend to do this on the job)Evaluation methods: Action planning, hybrid survey, immediate
post training interview with mentor
![Page 33: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/33.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
U.S. Navy Yeoman A School
New World AdditionsLevel 1 Reaction
EngagementEvaluation methods: Pulse checks during training, trainer
observation, hybrid course evaluation
RelevanceEvaluation methods: Group discussion, hybrid course
evaluation
![Page 34: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/34.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Planning ExecutionDemonstration
of Value
![Page 35: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/35.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
A compelling chain of evidence demonstrates your bottom line value.
![Page 36: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/36.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Chain of Evidence
![Page 37: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/37.jpg)
Audience Poll
Please provide one specific example of how you will apply these principles in your work.
![Page 38: © 2010-2011 Kirkpatrick Partners, LLC. All rights reserved. Trademark and Copyright Warning © Copyright 2010-2012, Kirkpatrick Partners, LLC. All rights](https://reader036.vdocuments.net/reader036/viewer/2022062322/56649e5c5503460f94b54d3d/html5/thumbnails/38.jpg)
© 2010-2011 Kirkpatrick Partners, LLC. All rights reserved.
Register for FREE Resources
Links to:• Online resource library with 50+ items• White paper and article• LinkedIn Kirkpatrick Evaluation discussion group
Subscription to:• Weekly e-newsletter
– Kirkpatrick Quick Tips– Articles– News, specials and events
Kirkpatrickpartners.com