Modern Measurement

Despite the many models available — Kirkpatrick, Phillips ROI, Success Case Method, Bersin IMPACT Framework and others — companies continuously struggle to build comprehensive measurement solutions for the many types of learning in their organizations.

The most common measures companies track continue to be learner satisfaction, course completions and course hours. Bersin & Associates research shows fewer than 7 percent of organizations regularly measure the impact of their learning programs. Even worse, this number hasn’t risen in the past five years.

But we know the way learning occurs has changed dramatically. Today, learning involves myriad formal and informal experiences, all types of content, strong managerial involvement and a focus on long-term development and talent management.

I’m excited to say learning measurement concepts and principles are changing too. Here are three important changes taking place and what they mean to a learning and development leader.

Measuring informal learning is now easy. If you have an informal, social or collaborative component to your learning program, there are a lot of new tools and approaches available. We have found three major components to measure here: activity — the percentage of learners contributing and how frequently they are contributing; contribution — the percentage of learners offering new content and how frequently they do so; and feedback — how well users like content, what content they read and view the most, which authors are the most highly rated, and who is accessing which content most frequently.

Most new collaboration tools and websites have standard features such as rating scales, feedback links, leader boards — lists of authors who are the highest in ratings or contributions like most emailed and most downloaded by date range — tools that let you view all contributions by a single author or expert authors.

Nearly all new collaboration systems have analytics tools that let you look at usage patterns and analyze activity by division, group, manager and employee. Most LMS systems have yet to implement all these features, but if you use Jive, SharePoint, Lotus, Telligent or nearly any other collaboration system, this type of reporting is readily available. New sharing tools like those available in Blackboard, Jambok, Saba and many other learning systems have these built in.