Training Industry Magazine - November/December 2020 - 38

behavior that makes us perform better
on the job (Level 3). That behavior then
needs to benefit the business and its
goals (Level 4), and that benefit needs
to be weighed against the cost of the
training to see if it was all worth it (Level
5). Because the outcomes of Levels 1
through 3 are uniquely human and the
outcomes of Levels 4 and 5 are crucial
to the business, they make an excellent
measuring stick for any training initiative.
However, learning leaders must elevate
their measurement strategy from simply
reporting results to making quantitative
predictions of how they can improve
training results in the future. If we're
going to live in a world where we're
constantly looking for the next best
thing, then we must not only report
the impact of today's training, but also
report how we get greater impact from
tomorrow's training. This is where what
I call "Level 6" comes in. Level 6 is a
quantitative analysis that identifies the
critical "climate" factors back on the job
that either help or hinder the impact of
the training. In essence, it recognizes
that all participants go back to different
environments or "climates" after the
training, and it quantitatively tells you
what climate factors will maximize the
participants' behavior change, business
impact and ultimate ROI.
For instance, one recent case study
showed that immediate manager
support and follow up after the training
(a strong climate factor) increased the
business impact and ROI of participants
by an average of 240%. That's the
same training content with the same
training delivery, but with vastly different
climates after the training. Imagine being
able to go back to your business leaders
with these results and telling them, "It's
not just what we do in L&D that predicts
training impact and effectiveness - it's

what you do when participants are
back on the job every day." This next
level of measurement means taking all
the data you gather from the traditional
Kirkpatrick and Phillip's Levels 1 through
5, and using it to add another layer to the
story - one that tells your organization
how to maximize the impact of all training
solutions in the future. See Figure 1.

CONCLUSION
The Fourth Industrial Revolution is ripe
for measurement. In fact, it demands
measurement! To keep up with the
constant change in the modern business
environment, learning leaders must
constantly assess whether they can
replace old, traditional potions with new,
disruptive notions. And there's no way to
make these assessments valid and reliable
without measurement; every industry
will need to measure and show results.
In the training industry, we can continue
measuring and reporting our story of
impact using the five levels of evaluation,
but we need to add a sixth level to prove
and improve impact in the future.
The next few decades of human
work will not be based on traditional
positions and processes but rather on
results and impact. Our only question
will be: "Is the end result more efficient
from a business perspective and more
generous from a human perspective?"
In fact, we're in the midst of answering
this question as much of the workforce
continues to work from their homes. Is
working from home more productive
and enjoyable? We'll have to get data
and prove it. If it's more efficient to
have employees work from home, and
it makes them happier - do you need
a traditional office building? Sure,
you loved your morning commute,

figure 1.

Six Levels of Evaluation
REACTION

1

LEARNING

2

BEHAVIOR

3

RESULTS

4

Did they like it?

Did they learn anything?

Did they improve key
behaviors?

Did they impact the
business?

RETURN ON INVESTMENT

5

TRANSFER CLIMATE

6

Was it worth it?

What factors will maximize ROI?

but perhaps you'll mourn it and move
on. And the rows of cubicles and
fluorescent lighting was intimate and
elegant, but maybe you'll get over it.
For the Fourth Industrial Revolution,
keep your mind on change, and your
eyes on impact. And if the change works
- prove it!
Dr. Paul Leone is an industrial and
organizational psychologist and expert
at evaluating the impact and ROI of
training initiatives. He is the founder
and principal consultant for MeasureUp
Consulting, where he helps training
providers and internal L&D leaders
tell the valuable story of how training
impacts the business bottom line. Dr.
Leone is also the instructor for Training
Industry's Measuring the Impact of L&D
Certificate. Email Paul.

The next few decades of human
work will not be based on traditional
positions and processes but rather
on results and impact.
| 38


http://www.measureupconsulting.com http://www.measureupconsulting.com https://www.trainingindustry.com/continuing-professional-development/certificates/measuring-the-impact-of-training-certificate/ https://www.trainingindustry.com/continuing-professional-development/certificates/measuring-the-impact-of-training-certificate/

Training Industry Magazine - November/December 2020

Table of Contents for the Digital Edition of Training Industry Magazine - November/December 2020

L&D's Role in Change Management
Table of Contents
3 Critical Components to Create a High-impact Learning Culture
eLearning Takes Center Stage: How L&D Can Impact Change
Recognizing, Regrouping and Responding to Change
L&D's Role in Revolutionizing Diversity and Inclusion Initiatives
Building Resilience: L&D's Evolving Role in Business Continuity Planning
Consider the White Room: Curating Meaningful Learner Experiences
Cost-estimating Learning Initiatives and Infrastructure Requirements
Trends 2021: Planning for the Future of Learning
Prove It! Measuring Training Impact for the Fourth Industrial Revolution
Critical Leadership Skills in Times of Crisis
Beyond Service: How Defining Moments Impact Culture
LinkedIn’s Business Leadership Program: Finding, Developing and Supporting Early-Career Talent 
Managing Digital Relationships: What Brain Science Can Teach L&D About Biostyles
Beyond Pivotal: The Pivoting Role of Learning and Development
Skillsoft and Global Knowledge Consolidate, Creating a Multimodal Training Giant
Company News
Training Industry Magazine - November/December 2020 - Intro
Training Industry Magazine - November/December 2020 - 1
Training Industry Magazine - November/December 2020 - 2
Training Industry Magazine - November/December 2020 - 3
Training Industry Magazine - November/December 2020 - 4
Training Industry Magazine - November/December 2020 - L&D's Role in Change Management
Training Industry Magazine - November/December 2020 - Table of Contents
Training Industry Magazine - November/December 2020 - 7
Training Industry Magazine - November/December 2020 - 8
Training Industry Magazine - November/December 2020 - 9
Training Industry Magazine - November/December 2020 - 10
Training Industry Magazine - November/December 2020 - 3 Critical Components to Create a High-impact Learning Culture
Training Industry Magazine - November/December 2020 - 12
Training Industry Magazine - November/December 2020 - eLearning Takes Center Stage: How L&D Can Impact Change
Training Industry Magazine - November/December 2020 - 14
Training Industry Magazine - November/December 2020 - Recognizing, Regrouping and Responding to Change
Training Industry Magazine - November/December 2020 - 16
Training Industry Magazine - November/December 2020 - L&D's Role in Revolutionizing Diversity and Inclusion Initiatives
Training Industry Magazine - November/December 2020 - Building Resilience: L&D's Evolving Role in Business Continuity Planning
Training Industry Magazine - November/December 2020 - 19
Training Industry Magazine - November/December 2020 - 20
Training Industry Magazine - November/December 2020 - 21
Training Industry Magazine - November/December 2020 - Consider the White Room: Curating Meaningful Learner Experiences
Training Industry Magazine - November/December 2020 - 23
Training Industry Magazine - November/December 2020 - 24
Training Industry Magazine - November/December 2020 - 25
Training Industry Magazine - November/December 2020 - Cost-estimating Learning Initiatives and Infrastructure Requirements
Training Industry Magazine - November/December 2020 - 27
Training Industry Magazine - November/December 2020 - 28
Training Industry Magazine - November/December 2020 - 29
Training Industry Magazine - November/December 2020 - Trends 2021: Planning for the Future of Learning
Training Industry Magazine - November/December 2020 - 31
Training Industry Magazine - November/December 2020 - 32
Training Industry Magazine - November/December 2020 - 33
Training Industry Magazine - November/December 2020 - 34
Training Industry Magazine - November/December 2020 - 35
Training Industry Magazine - November/December 2020 - Prove It! Measuring Training Impact for the Fourth Industrial Revolution
Training Industry Magazine - November/December 2020 - 37
Training Industry Magazine - November/December 2020 - 38
Training Industry Magazine - November/December 2020 - 39
Training Industry Magazine - November/December 2020 - Critical Leadership Skills in Times of Crisis
Training Industry Magazine - November/December 2020 - 41
Training Industry Magazine - November/December 2020 - 42
Training Industry Magazine - November/December 2020 - 43
Training Industry Magazine - November/December 2020 - Beyond Service: How Defining Moments Impact Culture
Training Industry Magazine - November/December 2020 - 45
Training Industry Magazine - November/December 2020 - 46
Training Industry Magazine - November/December 2020 - 47
Training Industry Magazine - November/December 2020 - LinkedIn’s Business Leadership Program: Finding, Developing and Supporting Early-Career Talent 
Training Industry Magazine - November/December 2020 - 49
Training Industry Magazine - November/December 2020 - 50
Training Industry Magazine - November/December 2020 - Managing Digital Relationships: What Brain Science Can Teach L&D About Biostyles
Training Industry Magazine - November/December 2020 - 52
Training Industry Magazine - November/December 2020 - Beyond Pivotal: The Pivoting Role of Learning and Development
Training Industry Magazine - November/December 2020 - Skillsoft and Global Knowledge Consolidate, Creating a Multimodal Training Giant
Training Industry Magazine - November/December 2020 - Company News
Training Industry Magazine - November/December 2020 - 56
Training Industry Magazine - November/December 2020 - 57
Training Industry Magazine - November/December 2020 - 58
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20201112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20191112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20181112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112_se
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20161112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016sales
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015outsourcing
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015leadership
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008spring
https://www.nxtbookmedia.com