Training Industry Magazine - Winter 2022 - 27

directed web-based training, classroom
training and VR training. Table 2 shows a
short summary of the findings.
As you can see from the table, as the
ratings go up for Level 1, so too do the
scores for Level 3. The online training
scored the lowest on Level 1 and also
the lowest on Level 3. Classroom
faired considerably better than online
for Level 1 and 3. And finally, VR scored
the highest on both Level 1 and Level
3. So at least from these findings, it
appears that you may at least be able
to predict which delivery mode will
yield more employee improvement
on the job (Level 3) by looking at their
initial Level 1 scores.
Conclusion
Don't stop measuring Level 1. If you're
asking the right questions, your smile
sheets can at least give you a little
positive indicator as to which training
programs hold the highest potential
for manifesting more effects back on
the job. However, this Level 1 data is
nowhere near enough to convince
your stakeholders it was " worth it "
because it doesn't capture the real
story of impact, which is how much
was actually learned, how employee
behaviors
have changed
months
after the training, how much business
benefit was realized, how much ROI
was achieved and how to improve that
impact and ROI in the future.
After all my research over the years,
I've come to consider Level 1 as the
first baby step in a journey across a
very long and hazardous bridge. On
one side, the training event where you
begin your first steps, and all the way
on the other side, across a very dark
and scary abyss - lies the business
results and the ROI destination you are
trying to reach. And all along the bridge
are potential pitfalls where you can lose
your footing, slip through the cracks
TRAINING INDUSTRY MAGAZINE - WINTER 2022 I WWW.TRAININGINDUSTRY.COM/MAGAZINE
and plummet to a dismal training failure.
There's no way of truly determining for
sure who's going to make it across this
treacherous bridge by rating those very
first baby steps, and there's no way of
predicting exactly how long it might take
them to get there, or how strong they
will be when they arrive. But there's no
denying that the ones who start with
the strongest steps and the sturdiest
footing will certainly inspire the most
confidence, and probably have a better
chance of making it all the way across
to a positive ROI.
Dr. Paul Leone is an industrial/
organizational psychologist, author and
leading expert at evaluating the impact
of training initiatives. He is the founder
and principal consultant for MeasureUp
Consulting, where he helps training
providers and internal L&D leaders tell the
valuable story of how training impacts the
bottom line. He is also the instructor for
Training Industry's Measuring the Impact
of L&D Certificate. Email Paul.
| 27

https://www.measureupconsulting.com/ https://www.measureupconsulting.com/ https://www.trainingindustry.com/continuing-professional-development/certificates/measuring-the-impact-of-training-certificate/ https://www.trainingindustry.com/continuing-professional-development/certificates/measuring-the-impact-of-training-certificate/ https://www.trainingindustry.com/magazine

Training Industry Magazine - Winter 2022

Table of Contents for the Digital Edition of Training Industry Magazine - Winter 2022