the business impact of learning
TRANSCRIPT
a world of exponential change
page
01
“Scalable learning is the new reason for large
organizations to exist.”
John HagelFounder
Deloitte Center for the Edge Innovation
use thedata
page
02
“Without data you’re just another person with an
opinion.”
W. Edwards DemingManagement and Systems Legend
make a big impact
page
03
“L&D is responsible for improving our most
important asset, our people. If we can improve
L&D, we can improve the world.”
me, I said that
right attituderight strategy
page
04
It’s learning’s turn
today.
Today we have a long road
ahead of us.
Data from Brandon Hall
confirms results of the LEO,
Watershed, iVentiv survey.
http://www.brandonhall.com/blogs/measurement-and-analytics-magic/
getting started
page
06
The Watershed Method makes it easy to understand
and get started with learning analytics.
Watershed Method
understanding learning analytics: levels
page
07
measuremen
tThe simple act of tracking
things and recording
values. Can be passively
or actively collected.
evaluation
The process of trying to
make meaning from the
data we’ve measured.
Descriptive analytics.
Does the data mean
something good or bad?
advanced
evaluation
When data sets get large
enough, use advanced
evaluation techniques to
discover powerful
insights. Data mining, AI,
machine learning, etc.
predictive &
prescriptive
Make predictions and
decisions based on data
and advanced algorithms.
Recommendations
engines are the best
example in learning.
understanding learning analytics:categories
page
08
Understand more about a
specific learning activity.
Maximize effectiveness and
spot problems.
learning
experience Understand a learner or group of
learners. Ensure organizational
readiness and compliance.
learner
Understand an overall learning
program. Is this initiative helping
to meet our organization’s
business objectives?
learning program
getstarted
page
09
the future in practice
example #1analyze informal learning
page
011
What they learned:
• How do people choose to learn?
• Search:
• What are people searching for?
• What are they not finding?
• What resources are most popular?
• What resources are not being used (scrap learning)?
example #2monitor cross-platform training
page
012
What they accomplished:
• Deliver compliance training across devices (e.g.,
mobile, desktop)
• Tracked without using an LMS (i.e., learners could
access from anywhere)
• Detailed understanding of how learners were using the
content
• Spotting troublesome areas and fixed problems before
too many users were affected
Watershed
LMS
Field Sales Mobile App
POS System
Data
HR Data
Measure Content Utilization and Its Impact on Sales
Customer Service Training
• Track activity across LMS
and support/ticketing
platform.
• Monitor customer satisfation.
• Identify how KPI trends
are impacted by other
activity.
xAPI &learning analytics platform
page
015
all data
Learning is so much bigger than the
LMS. Track informal and experiential
activities.
xAPI and the LRS present a transformative
technology for learning analytics. Seamlessly
bring all your data together in one platform and
perform real-time analytics tailor made for L&D.
business
impact
Include data about behaviors and
performance in your learning analytics real-time
Create, view, and distribute reports
seamlessly in real-time.
new
ecosystem
A next-generation learning
ecosystem brings this all
together.
This example from Visa
shows that the LMS is just
one small part of a modern
learning ecosystem.
getting startedyes you can!
page
017
01Gather your dataJust start collecting data in a common
format in a central location. Make it low
friction and ensure you have access.04
Explore your dataStarting to understand not just what is
happening, but why. Form questions and
see if your data answers them. Often, the
best answers lead to other questions. Can
you see impacts on the larger business?
02Get to know your dataUnderstand what you have. What’s out
there, what’s reliable, and what’s missing?
Do some simple evaluations and create
baselines.
05Experiment with your dataStart a new learning program with analytics
in mind. Set up well-controlled experiments
and A/B tests to validate a hypothesis.
Create a culture of continuous
improvement.
03Operationalize your dataAutomate your way out of “Excel hell.”
Define some interesting metrics and KPIs,
and start monitoring them routinely. What
trends do you notice?
06Show off your dataWe’ve long known that learning is vital,
not we can prove it. Go forth and show the
world!
ourcontacts
page
018
watershed
210 Gothic Ct
Franklin, TN 37067
+1-844-220-0822
http://watershedlrs.com
@watershedlrs
me
Mike Rustici
Founder and CEO
@mikerustici