WatershedLRS.com#TinCanAPI
How AT&T is Using Tin Can in Their Learning Program
WatershedLRS.com#TinCanAPI
Larla Bogle
Lead Training Manager – Design, AT&T
WatershedLRS.com#TinCanAPI
James Merrill
Technology Operations Learning Architect, AT&T
WatershedLRS.com#TinCanAPI
Susan Bounds
Director – Corporate Compliance at AT&T
WatershedLRS.com#TinCanAPI
Poll
What’s your attitude towards compliance training?
WatershedLRS.com#TinCanAPI
What is
?
WatershedLRS.com#TinCanAPI
WatershedLRS.com#TinCanAPI
Participation
WatershedLRS.com#TinCanAPI
Tracking Milestones/Badging
WatershedLRS.com#TinCanAPI
Performance Observation
WatershedLRS.com#TinCanAPI
Consolidation of Systems
WatershedLRS.com#TinCanAPI
Analyze Competencies
WatershedLRS.com#TinCanAPI
Population Comparison
WatershedLRS.com#TinCanAPI
Learning Path Analysis
WatershedLRS.com#TinCanAPI
Impact Analysis
WatershedLRS.com#TinCanAPI
Assessment
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
How AT&T is Using Tin Can to Enhance Compliance Training
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Code
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Question
How do I provide effective, efficient, and engaging Compliance Training for…
3,934 different job titles243,000 employees
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Compliance Training Attitudes
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Code Course
670,562 Production Hours saved = 76.5 years © 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks contained
herein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Compliance versus Ethics
Legal FocusCompliance – The act or process of doing what you have been asked or ordered to do.
Learner FocusEthical behavior – Doing what is right because of the belief that your decisions and actions are important.
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Code Challenge Vision
• Experiential Design• Engaged intellectually and emotionally.• Freedom to explore.• Voluntary.• Prescriptive.
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Tin Can
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Rustici
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Implementation Process Hypothesis
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Implementation ProcessScientific Evaluation Methods
High Fidelity Simulation
Low FidelitySimulation
Donation 40% 20%
No Donation 20% 20%(control group)
Figure 1: Research Conditions and Target Audiences
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Implementation ProcessThe Partnerships
Rustici
NexLearn
IT Team
Platforms, Content,Participants
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Technology Selection Principles
• Informal/Non-mandatory• Accessible• Simple• Integrated User Flow• Exploratory• Data Rich
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Accessible• Hosted outside of the
LMS• User information stored• Non-mandatory
• One click + login access
Informal
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Simple & Integrated Welcome Page
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Exploratory- Branching
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Exploratory- Video Based
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Exploratory- Tracked Scenarios
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Exploratory- Time Machine
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Scenario Summary
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Data Rich- Tracked Reference Documents
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Data Rich
• Tracked Progress• Tracked All Interactions
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Reports
40
• Real Time Updates
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Why Watershed
• Track and Manage issuer progress• Send User interactions and completions• Analyze data into reports• Provide visual or graphical reports
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Surprise Benefit
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Knowledge Check
• Multiple Response Question.• Wrong answer – too lenient.• Correct answer.
• Wrong answer – more restrictive.• Correct answer.
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
What Did We Gain?
• Almost 100% did not select the lenient answer.• Video outperformed text.• Business Units breakdown.• Passionate about restrictive answer.
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Ethics Measured!!!!!!!
Ethical behavior – Doing what is right because of the belief that your decisions and actions are important.
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Largest Lesson Learned
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
The Future
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
What’s Next?
How do I provide effective, efficient, and engaging Compliance Training for 243,000 employees with 3,934 different job titles?
Leverage Tin Can!
WatershedLRS.com#TinCanAPI
Key Takeaways
• Data richness: every click, sim, external links• Yes, it does work as promised• Takes a while• Real-time data integration• No LMS, single-click launch• Experiment-based analysis with statistical rigor• Real knowledge gained, but just the tip of the iceberg
• Unexpected: troubleshooting is easier with a detailed activity stream (content analytics)
• Incorrectness was on the “too ethical” side
AT&T Proprietary Only for use by authorized individuals or any designated team(s) within the AT&T companies and not for general distribution.
Contact Us• James Merrill• [email protected]• www.linkedin.com/in/jamestmerrill/
• Larla Bogle• [email protected]• www.linkedin.com/pub/larla-bogle/46/491/631/
• Mike Rustici• [email protected]• www.linkedin.com/in/mikerustici• @mike_rustici
• Susan Bounds• [email protected]• www.linkedin.com/pub/susan-bounds/5/896/54b/
© 2014 AT&T Intellectual Property. All rights reserved. AT&T, the AT&T logo and all other AT&T marks containedherein are trademarks of AT&T Intellectual Property and/or AT&T affiliated companies. AT&T 36USC220506
WatershedLRS.com#TinCanAPI
We love to talk.
http://tincanapi.com/talk
WatershedLRS.com#TinCanAPI
Next Webinar
Join us to learn how the National Health Service (UK), the world’s 5th largest employer, is using Tin Can and Watershed LRS to learn things they never could before.
Register:http://tincanapi.com/webinar
WatershedLRS.com#TinCanAPI
Thank you!
TinCanAPI.comWatershedLRS.com
TinCanAPI.com/talk