Elearning - April/May 2008 - (Page 24)

Measuring the Learning Experience BIGGEST CHALLENGE: GETTING LEARNERS TO COMPLETE THE ASSESSMENTS AND CONTENT BY NICHOLAS IGNERI Over the past 18 months or so, the American Management Association (AMA) has been actively expanding its ability to measure the effectiveness of its learning solutions. The AMA used the widely known and accepted Kirkpatrick model as the foundation of its approach. As a result, it can now offer clients the option to measure the effectiveness of the learning solution on the individual and organization. This was somewhat tricky, because the AMA provides both public seminar solutions and corporate, customized solutions — the former presenting more of a challenge than the latter. The AMA has traditionally measured Level I successfully. Level I evaluation measures the learner’s reactions of the learning event. AMA gathers data from learners on their perceptions of the facilitator, learning design, materials, facility, hotel accommodations and registration process. We want data from customers on the whole learning experience so we can analyze customer perceptions and take specific actions. Over the many years, the AMA has been collecting Level I data so we can identify trends and see where customers’ needs are strongest. 24 April / May 2008 Elearning! ON TO HIGHER LEVELS Newer to the AMA measurement push is a solution for Level II evaluation, which is focused on determining learning transfer. Tackling Level II measurement meant that we needed new systems, content and processes, including: >>valid and reliable assessment tools >>Web-based content >>a delivery mechanism (LMS and LCMS technology) >>reporting capabilities >>a refined marketing and customer communication process Our level II evaluation approach did offer one break: we did not need to develop separate solutions for our public seminar and corporate businesses. Learning is learning — it does not really matter if that learning was delivered in a public seminar room or a corporate training facility. Level II is about creating a baseline measurement before any learning takes place and then assessing what was learned after the learning experience. So that’s what we did: we created assessments, continuously measured assessment reliability and validity, delivered the assessments through LMS technology, distributed postseminar assessments, and reported data to communicate learning transfer. We also took the next logical step: identifying learning gaps and then delivering targeted Web-based content to close those gaps. AMA was determined not to simply report on learning transfer, but to also report on learning gaps identified by Measurement requires that learners, managers and leaders take ownership and responsibility for each level of evaluation.

Table of Contents Feed for the Digital Edition of Elearning - April/May 2008

Elearning - April/May 2008 Editor's Note Contents News Targeting Africa Locating Courseware People in the News Upcoming Events Deals Trendlines Web Services Building a Learning Culture Measuring the Learning Experience Making Learning Fun and Social LMS's 2008: What You Need To Know Learning Leader: CA Case Study: AVI Case Study: IBM Case Study: QualComm WBS Case Study: National Center for State Courts Case Study: Grundfos Pumps Case Study: Virginia Tech Pop Quiz Last Word

Elearning - April/May 2008

For optimal viewing of this digital publication, please enable JavaScript and then refresh the page. If you would like to try to load the digital publication without using Flash Player detection, please click here.