Training Industry Magazine - Summer 2022 - 51

The world loves data. That includes
those of us in learning and development
(L&D):
● Stakeholders want evidence their
training investments are being
handled wisely and learners' time is
being used productively.
● L&D leaders want to connect learning
experiences to performance and
ensure they deliver the right training
to the right people efficiently, at scale.
● Learning designers want to understand
the impact of their user experience (UX)
design choices, so each new project
isn't yet another first-best-guess at
what to teach and how.
The Kirkpatrick Model provides a useful
model for learning analytics. It posits
four levels of measurement: reaction,
learning, behavior and results.
Let's focus on Kirkpatrick's Level 1,
reaction: the degree to which the
participants find the training favorable,
engaging and relevant to their jobs.
How do you gain Level 1 data? Typically,
it's collected via surveys of participants
after the training is complete (often
called a " smile sheet " ).
Smile Sheets Can
Be Useful
A smile sheet is a survey provided to
learners following a learning experience,
typically containing questions like:
● " Was the training engaging? "
● " Can you apply what you learned to
your job? "
● " Did you like the style or method
of training? "
● " Would
you
recommend
the
training to a colleague/friend? " (Net
Promoter Score)
If learners actually fill out smile sheets
(typically it's a small fraction), they can
be useful. What learners think about the
training is an important data point for
stakeholders, leaders and designers alike.
Smile Sheet Data
Is Limited
Are people who complete the survey
disproportionately haters or fanboys?
Do their responses represent the
many others who took the training but
remained silent? Unless you demanded
an answer, there's no way to tell -it's
not a random sample.
Finding out that learners loved or hated
the training, overall, tells us very little
about what specific improvements
are warranted, and improvement is
inevitably warranted. How did they feel
about the video setup? How about the
general approach? Where was coaching
useful, and where not?
If they had
trouble completing the training, where
did our learner experience (LX) structure
go wrong?
Smile
sheets
alone
don't
provide
sufficient visibility into learners' actual
engagement. Learners may give a high
score to a microlearning module only
because it was short, or to an animation
only because it was cool, even if neither
led to any change of behavior. Or they
may give a low score to something that
was difficult or uncomfortable (breakout
group, stretch assignment, team project),
which in hindsight became a pivotal
learning moment in their development.
Our Timing Is Off
Smile sheet data tells us little about how to
improve a learning experience at the time
TRAINING INDUSTRY MAGAZINE - SUMMER 2022 I WWW.TRAININGINDUSTRY.COM/MAGAZINE
| 51
https://trainingindustry.com/wiki/measurement-and-analytics/the-kirkpatrick-model/ https://www.trainingindustry.com/magazine

Training Industry Magazine - Summer 2022

Table of Contents for the Digital Edition of Training Industry Magazine - Summer 2022

Harnessing Curiousity in Today's Workplace
Table of Contents
Optimize Your Performance With These Sport Psychology Tactics
Learning Management Systems Need to Go Beyond "Management"
Designing Training for Behavior Change is Like Fine Dining
Diversify Your Leadership With an Inclusive Succession Plan
The Science of Building a More Creative and Innovative Workplace
Digital Solutions to Improve the Assessment Experience
The Power of Personal Presence
Coconut Pie and Succession Planning
Multiplying Experts and Expertise in an Enterprise
Using Empathy to Better Understand Your Customer
Designing Training Programs for Behavior Change
Creating the Virtual Watercooler Experience
Chaos Is Here to Stay: Why Building GRIT is Vital for Executive Success
Beyond the Smile Sheet: Measuring Level 1 to Improve Learning Design
Disruption Is Your Friend
Recalibrating Careers
Why Aren't Mental Health Offerings Helping Our Workforce?
Cornerstone and Edcast Consolidate to Reimagine People Development
Company News
Training Industry Magazine - Summer 2022 - Intro
Training Industry Magazine - Summer 2022 - Cover1
Training Industry Magazine - Summer 2022 - Cover2
Training Industry Magazine - Summer 2022 - CT1
Training Industry Magazine - Summer 2022 - CT2
Training Industry Magazine - Summer 2022 - Harnessing Curiousity in Today's Workplace
Training Industry Magazine - Summer 2022 - 4
Training Industry Magazine - Summer 2022 - 5
Training Industry Magazine - Summer 2022 - Table of Contents
Training Industry Magazine - Summer 2022 - 7
Training Industry Magazine - Summer 2022 - 8
Training Industry Magazine - Summer 2022 - Optimize Your Performance With These Sport Psychology Tactics
Training Industry Magazine - Summer 2022 - 10
Training Industry Magazine - Summer 2022 - Learning Management Systems Need to Go Beyond "Management"
Training Industry Magazine - Summer 2022 - 12
Training Industry Magazine - Summer 2022 - Designing Training for Behavior Change is Like Fine Dining
Training Industry Magazine - Summer 2022 - 14
Training Industry Magazine - Summer 2022 - Diversify Your Leadership With an Inclusive Succession Plan
Training Industry Magazine - Summer 2022 - The Science of Building a More Creative and Innovative Workplace
Training Industry Magazine - Summer 2022 - 17
Training Industry Magazine - Summer 2022 - 18
Training Industry Magazine - Summer 2022 - 19
Training Industry Magazine - Summer 2022 - Digital Solutions to Improve the Assessment Experience
Training Industry Magazine - Summer 2022 - 21
Training Industry Magazine - Summer 2022 - The Power of Personal Presence
Training Industry Magazine - Summer 2022 - 23
Training Industry Magazine - Summer 2022 - 24
Training Industry Magazine - Summer 2022 - 25
Training Industry Magazine - Summer 2022 - Coconut Pie and Succession Planning
Training Industry Magazine - Summer 2022 - 27
Training Industry Magazine - Summer 2022 - 28
Training Industry Magazine - Summer 2022 - 29
Training Industry Magazine - Summer 2022 - Multiplying Experts and Expertise in an Enterprise
Training Industry Magazine - Summer 2022 - 31
Training Industry Magazine - Summer 2022 - 32
Training Industry Magazine - Summer 2022 - 33
Training Industry Magazine - Summer 2022 - 34
Training Industry Magazine - Summer 2022 - Using Empathy to Better Understand Your Customer
Training Industry Magazine - Summer 2022 - 36
Training Industry Magazine - Summer 2022 - 37
Training Industry Magazine - Summer 2022 - Designing Training Programs for Behavior Change
Training Industry Magazine - Summer 2022 - 39
Training Industry Magazine - Summer 2022 - 40
Training Industry Magazine - Summer 2022 - 41
Training Industry Magazine - Summer 2022 - Creating the Virtual Watercooler Experience
Training Industry Magazine - Summer 2022 - 43
Training Industry Magazine - Summer 2022 - 44
Training Industry Magazine - Summer 2022 - 45
Training Industry Magazine - Summer 2022 - Chaos Is Here to Stay: Why Building GRIT is Vital for Executive Success
Training Industry Magazine - Summer 2022 - 47
Training Industry Magazine - Summer 2022 - 48
Training Industry Magazine - Summer 2022 - 49
Training Industry Magazine - Summer 2022 - Beyond the Smile Sheet: Measuring Level 1 to Improve Learning Design
Training Industry Magazine - Summer 2022 - 51
Training Industry Magazine - Summer 2022 - 52
Training Industry Magazine - Summer 2022 - 53
Training Industry Magazine - Summer 2022 - 54
Training Industry Magazine - Summer 2022 - Disruption Is Your Friend
Training Industry Magazine - Summer 2022 - 56
Training Industry Magazine - Summer 2022 - 57
Training Industry Magazine - Summer 2022 - 58
Training Industry Magazine - Summer 2022 - Recalibrating Careers
Training Industry Magazine - Summer 2022 - 60
Training Industry Magazine - Summer 2022 - Why Aren't Mental Health Offerings Helping Our Workforce?
Training Industry Magazine - Summer 2022 - Cornerstone and Edcast Consolidate to Reimagine People Development
Training Industry Magazine - Summer 2022 - Cover3
Training Industry Magazine - Summer 2022 - Cover4
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2024
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2023
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_fall2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_summer2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_spring2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_winter2022
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20210102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20201112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20200102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20191112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20190102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20181112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20180102
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170910
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170708
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170506
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20170304
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20171112_se
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_20161112
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016sales
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2016winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015outsourcing
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015leadership
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2015winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2014winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2013winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2012winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2011winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2010winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009spring
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2009winter
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008fall
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008summer
https://www.nxtbook.com/nxtbooks/trainingindustry/tiq_2008spring
https://www.nxtbookmedia.com