Chief Learning Officer - August 2008 - (Page 12) BUSINESS IMPACT Obstacles to Demonstrating Business Impact Learning leaders must be willing to take risks and experiment • BY MICHAEL E. ECHOLS, PH.D. O Michael E. Echols, Ph.D., is the vice president of strategic initiatives at Bellevue University. He is the author of ROI on Human Capital Investment. He can be reached at editor@clomedia.com. verwhelmingly, surveys of learning leaders identify the measurement of learning’s business impact as a high priority for the learning profession. Yet, those same surveys consistently show that few companies actually do the measurements. This incongruity probably is one reason that few chief executives state that learning has a strategic impact for their organizations. The bottom line is that we talk about the seat at the table, but the honest truth is that we don’t walk the talk. Our senior management is saying, “Where’s the beef?” We know the questions are appropriate; yet, little progress is being made. What stops us from reaching what we ourselves say is needed in the profession: the measurement of business impact? I am going to be so bold as to suggest that what stops us has little to do with our internal learning community discussion and more to do with bigger cultural issues related to innovation and risk taking. In the end, what stops us has little to do with the tired internal debate about levels and ROI and lots to do with the fact that we and our management are stuck. What we need is less talk and more experimentation. We need to experiment with various measurement approaches. In the face of severe scrutiny on quarterly earnings, our senior management has been reluctant to volunteer funds to experiment. At the same time, those same leaders are demanding more innovation from all parts of the organization. Lest we become too smug in the conclusion that measuring business impact is all about “them” and not about those of us in the learning profession, I want to point out that we are not being strong advocates for innovation and experimentation. The onus is on learning professionals to become advocates for innovation, to champion the change that has the potential to CLO EVENTS Share your thoughts on the business impact of learning at Chief Learning Officer magazine’s Breakfast Club series, where a panel of industry experts will lead conversations about learning’s value to the enterprise. For a schedule, visit www.clomedia.com/events. get us out of the current rut. The list of things that block us from measuring business impact actually is relatively short. An eLearning Guild survey identified two factors of importance. The first is the expertise required to conduct good scientific experimentation. This expertise involves access to business data and the messiness of our information structures, control groups for comparison of results and sophisticated statistical analysis methods to separate the influence of other factors from the impact of the learning on the business outcomes. Few in our profession have the expertise to do this type of work. That does not mean the profession cannot obtain it; it merely means it does not currently have it. The other blocking factor revealed by the eLearning Guild survey is the lack of resources — the budget required to design and conduct quality experiments. It is important to recognize this budget is not the cash required to actually develop and deploy the learning intervention. This is the budget needed to design the experiment, to capture and analyze the data, to do the statistical analysis and, from the results, create the management reports that senior management can understand. When it comes to budgets for experimentation, we are not talking about a lot of money. In a recent business impact study conducted under the guidance of Bellevue University’s Human Capital Lab, the resources required to analyze the impact of Chrysler’s sales consulting training program amounted to a mere 1.6 percent of the total cost to deploy the training to 49 percent of the Chrysler dealer network. Chrysler is not alone in this effort to innovate. Learning leaders in several large organizations are looking to deploy these methods in their operations. The issue is more about innovation and risk management, both on the part of the learning executives, as well as the legal staff, than it is about the actual cash required to do the work. The resources required to measure the business impact is peanuts when compared to the potential impact on the organization. What’s missing is not the available capital to do the work, but the will to strongly advocate the innovation that experimentation and evaluation represents. CLO 12 Chief Learning Officer • August 2008 • www.clomedia.com http://www.clomedia.com/events http://www.clomedia.com
Table of Contents Feed for the Digital Edition of Chief Learning Officer - August 2008 Chief Learning Officer - August 2008 Editor's Letter Contents Connections Business Impact Trends Best Practices Effectiveness High-Octane Leadership Development Leadership and Personality CLO Profile Discussion Groups: Harvesting Value from Real-World Experiences Kimpton 2.0: Discussion on the Web Learning Olympics: Development Through Competition Bypassing the Obstacles to Change Listen Up: A How-To-Guide for Podcasting University of Toyota: A Success Story in Podcast Implementation What Stinks About Webinars? Webinars for Learning Professionals Case Study Business Intelligence Advertisers' Index Editorial Resources In Conclusion Chief Learning Officer - August 2008 Chief Learning Officer - August 2008 - (Page Intro) Chief Learning Officer - August 2008 - Chief Learning Officer - August 2008 (Page Cover1) Chief Learning Officer - August 2008 - Chief Learning Officer - August 2008 (Page Cover2) Chief Learning Officer - August 2008 - Chief Learning Officer - August 2008 (Page 3) Chief Learning Officer - August 2008 - Editor's Letter (Page 4) Chief Learning Officer - August 2008 - Editor's Letter (Page 5) Chief Learning Officer - August 2008 - Editor's Letter (Page 6) Chief Learning Officer - August 2008 - Editor's Letter (Page 7) Chief Learning Officer - August 2008 - Contents (Page 8) Chief Learning Officer - August 2008 - Contents (Page 9) Chief Learning Officer - August 2008 - Connections (Page 10) Chief Learning Officer - August 2008 - Connections (Page 11) Chief Learning Officer - August 2008 - Business Impact (Page 12) Chief Learning Officer - August 2008 - Business Impact (Page 13) Chief Learning Officer - August 2008 - Trends (Page 14) Chief Learning Officer - August 2008 - Trends (Page 15) Chief Learning Officer - August 2008 - Best Practices (Page 16) Chief Learning Officer - August 2008 - Best Practices (Page 17) Chief Learning Officer - August 2008 - Effectiveness (Page 18) Chief Learning Officer - August 2008 - Effectiveness (Page 19) Chief Learning Officer - August 2008 - High-Octane Leadership Development (Page 20) Chief Learning Officer - August 2008 - High-Octane Leadership Development (Page 21) Chief Learning Officer - August 2008 - Leadership and Personality (Page 22) Chief Learning Officer - August 2008 - Leadership and Personality (Page 23) Chief Learning Officer - August 2008 - Leadership and Personality (Page 24) Chief Learning Officer - August 2008 - Leadership and Personality (Page 25) Chief Learning Officer - August 2008 - CLO Profile (Page 26) Chief Learning Officer - August 2008 - CLO Profile (Page 27) Chief Learning Officer - August 2008 - CLO Profile (Page 28) Chief Learning Officer - August 2008 - CLO Profile (Page 29) Chief Learning Officer - August 2008 - Discussion Groups: Harvesting Value from Real-World Experiences (Page 30) Chief Learning Officer - August 2008 - Discussion Groups: Harvesting Value from Real-World Experiences (Page 31) Chief Learning Officer - August 2008 - Kimpton 2.0: Discussion on the Web (Page 32) Chief Learning Officer - August 2008 - Kimpton 2.0: Discussion on the Web (Page 33) Chief Learning Officer - August 2008 - Learning Olympics: Development Through Competition (Page 34) Chief Learning Officer - August 2008 - Learning Olympics: Development Through Competition (Page 35) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 36) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 37) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 38) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 39) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 40) Chief Learning Officer - August 2008 - Bypassing the Obstacles to Change (Page 41) Chief Learning Officer - August 2008 - Listen Up: A How-To-Guide for Podcasting (Page 42) Chief Learning Officer - August 2008 - Listen Up: A How-To-Guide for Podcasting (Page 43) Chief Learning Officer - August 2008 - Listen Up: A How-To-Guide for Podcasting (Page 44) Chief Learning Officer - August 2008 - University of Toyota: A Success Story in Podcast Implementation (Page 45) Chief Learning Officer - August 2008 - What Stinks About Webinars? (Page 46) Chief Learning Officer - August 2008 - What Stinks About Webinars? (Page 47) Chief Learning Officer - August 2008 - Webinars for Learning Professionals (Page 48) Chief Learning Officer - August 2008 - Webinars for Learning Professionals (Page 49) Chief Learning Officer - August 2008 - Case Study (Page 50) Chief Learning Officer - August 2008 - Case Study (Page 51) Chief Learning Officer - August 2008 - Case Study (Page 52) Chief Learning Officer - August 2008 - Case Study (Page 53) Chief Learning Officer - August 2008 - Business Intelligence (Page 54) Chief Learning Officer - August 2008 - Business Intelligence (Page 55) Chief Learning Officer - August 2008 - Business Intelligence (Page 56) Chief Learning Officer - August 2008 - Editorial Resources (Page 57) Chief Learning Officer - August 2008 - In Conclusion (Page 58) Chief Learning Officer - August 2008 - In Conclusion (Page Cover3) Chief Learning Officer - August 2008 - In Conclusion (Page Cover4)
For optimal viewing of this digital publication, please enable JavaScript and then refresh the page. If you would like to try to load the digital publication without using Flash Player detection, please click here.