Training Industry Magazine - July/August 2019 - 29

JUST GET GOING!

Andrew Joly, Director of Strategic Design, LEO Learning
For the past three years, we've asked L&D professionals to share
their perspectives and progress on learning data and analytics in
our annual measurement survey. Examining the top barriers to
success provides interesting insights into the first steps toward
accurate measurement analysis:
1. Get stakeholder buy-in |
Early on in the process, engage senior stakeholders in benefitsfocused conversations.
2. Build team capabilities |
Buy, build or borrow data and analytics skills, and begin to build
the skill change across your team.
3. Start small |
A "narrow-but-deep" approach is a useful focus to implement
when creating your chain of evidence.

GRANULAR LEARNING DATA
Christopher Cameron, Valamis

"Feel-good" statistics, like completion metrics, are dead.
Training teams need to look at granular learning data, like
learner behavior, in conjunction with business metrics to
understand the true efficacy of their training. Data science
allows companies to analyze huge swaths of learning data
and key business metrics to see the behavioral influences
on learning. If you can influence a desired behavior to meet
a business goal and accurately measure the impact learning
had on that outcome, management teams will be armed
with the information necessary to make strategic decisions
regarding training and their business.

MEASUREMENT FROM THE OUTSET

Edward Trolley, Senior Vice President of Managed Training
Services, NIIT
The measurement of training value can be elusive, but it is
important. Begin with establishing a measurement methodology.
Next, have a measurement discussion at the outset, not at the
end. It is not necessary to measure everything, but it is important
to measure what matters (i.e., large projects, high visibility
projects, business issue driven projects, etc.). With the advent of
analytics and integrated systems, we can tie the measurement of
L&D to various metrics, like employee performance. The objective
of measurement should be to consistently build confidence in
your customers, so they know they will get an acceptable ROI.
To reinforce this, develop a results contract at the beginning of
customer discussions to define the scope of the work, the results
expected, the metrics to determine the results, what needs to be
done to ensure the results and any other external factors that
could impact the results of training.

4. Understand what tools are needed |
The key tool in this area is a learning record store (LRS). This
will collect experience API (xAPI) statements from different
learning events and connect to business data from elsewhere
in your business.
Short and sharp. Our advice: just get going!

UNDERSTANDING FIRST
Raytheon Professional Services

For L&D professionals, improving business outcome comes
down to improving the outcome or work output of individual
employees. This upfront analysis needs to take the whole
performance system into account. It is not only about learning
management system (LMS) data but rather about collecting
and analyzing learning, workforce and performance measures
to extract valuable insights that will guide the solution design.
L&D professionals need to adopt a consultative approach
combined with an analytical mindset:
* Ask the right questions with a good dose of critical thinking
in order to unveil the real issues.
* Collect and analyze new types of data that will highlight the
most difficult and most frequent tasks that have the greatest
impact on business outcomes.
Let's call it, "Understanding First." This approach not only provides
insights to inform the learning strategy but also establishes the
baseline measures to prove the value of our solutions.

T R A I N I N G I N DUSTR Y MAGAZ INE -LEARNING ANALYTICS 20 19 I WWW. T RAININGINDU S T RY . C OM/ MAGAZ I NE

| 29


https://www.trainingindustry.com/glossary/learning-record-store-lrs/ https://www.trainingindustry.com/glossary/experience-api-xapi/ https://www.trainingindustry.com/glossary/learning-management-system-lms/ https://www.trainingindustry.com/glossary/learning-management-system-lms/ http://rpsblog.raytr.com/learning-analytics/ https://www.trainingindustry.com/magazine

Training Industry Magazine - July/August 2019

Table of Contents for the Digital Edition of Training Industry Magazine - July/August 2019

Learning Analytics: Table Stakes for Business Success
Table of Contents
Let's Build a Measurement Practice for L&D
Brain-Based Learning Analytics and Evaluation Practices
Who [Else] Cares About Learning Impact Data
Justifying the Investment in Leadership Training
Is Training Analytics Smoke and Mirrors?
Leveraging Analytical Tools to Transform L&D
Levearging Learning Analytics to Improve Business Outcomes: Where to Start
Was It Worth It? Measuring the Impact and ROI of Leadership Training
How to Make the Transition to a Data-Driven Learning Culture
How Personal Skills AI Assistants Might Disrupt Corporate Training
Machines Are the Future of Training: How Data-Driven Feedback Is Fostering Improvement and Enhancing Human Relationships
Improving Instructor Impact on Learning with Analytics
A Year in the Life: Evolving L&D Metrics From a Reporting Managed Service to Business Insight Partner
Localizing E-Learning Programs for an International Audience
Learning Analytics Is More Than Data Collection
Using Business Data to Drive Training Objectives
Quality versus Quantity: How Analytics Can Improve Training Effectiveness
Coursera Reaches Unicorn Status and Accelerates Enterprise Product Innovation
Company News
Training Industry Magazine - July/August 2019 - Cover1
Training Industry Magazine - July/August 2019 - 2
Training Industry Magazine - July/August 2019 - 3
Training Industry Magazine - July/August 2019 - 4
Training Industry Magazine - July/August 2019 - Learning Analytics: Table Stakes for Business Success
Training Industry Magazine - July/August 2019 - Table of Contents
Training Industry Magazine - July/August 2019 - 7
Training Industry Magazine - July/August 2019 - 8
Training Industry Magazine - July/August 2019 - 9
Training Industry Magazine - July/August 2019 - 10
Training Industry Magazine - July/August 2019 - Let's Build a Measurement Practice for L&D
Training Industry Magazine - July/August 2019 - 12
Training Industry Magazine - July/August 2019 - Brain-Based Learning Analytics and Evaluation Practices
Training Industry Magazine - July/August 2019 - 14
Training Industry Magazine - July/August 2019 - Who [Else] Cares About Learning Impact Data
Training Industry Magazine - July/August 2019 - 16
Training Industry Magazine - July/August 2019 - Justifying the Investment in Leadership Training
Training Industry Magazine - July/August 2019 - Is Training Analytics Smoke and Mirrors?
Training Industry Magazine - July/August 2019 - 19
Training Industry Magazine - July/August 2019 - 20
Training Industry Magazine - July/August 2019 - 21
Training Industry Magazine - July/August 2019 - Leveraging Analytical Tools to Transform L&D
Training Industry Magazine - July/August 2019 - 23
Training Industry Magazine - July/August 2019 - 24
Training Industry Magazine - July/August 2019 - 25
Training Industry Magazine - July/August 2019 - Levearging Learning Analytics to Improve Business Outcomes: Where to Start
Training Industry Magazine - July/August 2019 - 27
Training Industry Magazine - July/August 2019 - 28
Training Industry Magazine - July/August 2019 - 29
Training Industry Magazine - July/August 2019 - 30
Training Industry Magazine - July/August 2019 - 31
Training Industry Magazine - July/August 2019 - 32
Training Industry Magazine - July/August 2019 - Was It Worth It? Measuring the Impact and ROI of Leadership Training
Training Industry Magazine - July/August 2019 - 34
Training Industry Magazine - July/August 2019 - 35
Training Industry Magazine - July/August 2019 - How to Make the Transition to a Data-Driven Learning Culture
Training Industry Magazine - July/August 2019 - 37
Training Industry Magazine - July/August 2019 - How Personal Skills AI Assistants Might Disrupt Corporate Training
Training Industry Magazine - July/August 2019 - 39
Training Industry Magazine - July/August 2019 - 40
Training Industry Magazine - July/August 2019 - 41
Training Industry Magazine - July/August 2019 - Machines Are the Future of Training: How Data-Driven Feedback Is Fostering Improvement and Enhancing Human Relationships
Training Industry Magazine - July/August 2019 - 43
Training Industry Magazine - July/August 2019 - 44
Training Industry Magazine - July/August 2019 - 45
Training Industry Magazine - July/August 2019 - 46
Training Industry Magazine - July/August 2019 - Improving Instructor Impact on Learning with Analytics
Training Industry Magazine - July/August 2019 - 48
Training Industry Magazine - July/August 2019 - 49
Training Industry Magazine - July/August 2019 - A Year in the Life: Evolving L&D Metrics From a Reporting Managed Service to Business Insight Partner
Training Industry Magazine - July/August 2019 - 51
Training Industry Magazine - July/August 2019 - Localizing E-Learning Programs for an International Audience
Training Industry Magazine - July/August 2019 - 53
Training Industry Magazine - July/August 2019 - 54
Training Industry Magazine - July/August 2019 - Learning Analytics Is More Than Data Collection
Training Industry Magazine - July/August 2019 - 56
Training Industry Magazine - July/August 2019 - Using Business Data to Drive Training Objectives
Training Industry Magazine - July/August 2019 - 58
Training Industry Magazine - July/August 2019 - Quality versus Quantity: How Analytics Can Improve Training Effectiveness
Training Industry Magazine - July/August 2019 - Coursera Reaches Unicorn Status and Accelerates Enterprise Product Innovation
Training Industry Magazine - July/August 2019 - Company News
Training Industry Magazine - July/August 2019 - Cover4
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20201112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20191112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20181112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112_se
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20161112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016sales
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015outsourcing
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015leadership
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008spring
https://www.nxtbookmedia.com