ROI

By Patti P. Phillips, Ph.D., and Jack J. Phillips, Ph.D.

Have you ever asked top executives or a chief financial officer about the value they would like to see from talent development? How many discussions have you had about the value of learning with the C-Suite?

We have had many of those conversations routinely over the past 25 years and we know clearly what they need. Their responses have been documented quite well, dating back to a major study that we conducted with ATD nearly a decade ago. That study, involving Fortune 500 CEOs, indicated that 96 percent of executives wanted to see a business connection to learning. Yet, at that time, only 8 percent of them had that type of data. This is their No. 1 desired data category. Further, 74 percent of the executives wanted to see the ROI from learning investments, but only 4 percent said they have it now. This is their No. 2 measure. The No. 1 measure provided to executives from L&D was reaction data, but only 28 percent wanted to see this category of data.

This study, first published in our book with ATD, Measuring for Success, was a wake-up call for many CLOs and others involved in talent development.¹ Collectively, they said “we must do better.” The good news is that was 10 years ago. We are well on the way.

More recent data from the Business Intelligence Council of Chief Learning Officer Magazine showed that improvements are happening. When asked about how the learning organization shows its contribution to the broader enterprise, 36 percent said they use business data for the request, and 22 percent say they use ROI. When asked if they plan to implement ROI, 49.6 percent said they planned to implement ROI in the future. All totaled, 71.2 percent of respondents said they were either using ROI or planning to implement it. We think that is a little ambitious, although it came from 335 CLOs.

Fast forward to 2017, and we noticed a major benchmarking report from Training Magazine. This report examined the organizations that were “Hall of Famers” in their awards system. These are the organizations that are consistently at the top of their 125 best learning organizations lists. These “Hall of Famers” are very important for benchmarking because others want to know what makes them so successful. The opening statement in the report states, “Ultimately, the success of any program is based on whether it improves business results.” —Training Top 10 Hall of Fame, May 2017.

These top learning organizations advise that you must connect learning to the business to capture executive attention. This benchmarking report is generated every year. In the following year, 2018, this report contained three best practice case studies: onboarding, an ROI calculation on a follow-up basis, and an ROI forecast. You can see that we are making progress to meet the request from top executives.

What can you do if you are not showing the business value of learning? You can take five very important steps:

1. Be proactive. Don’t wait for the request to show business value. Start delivering business value on a major program now. Take charge and drive the evaluation initiative. Keep ROI on your agenda, not your executive’s agenda.
2. Be selective on which programs you evaluate at the business impact and ROI levels. Use ROI for programs that are very expensive, strategic, important to organizations, and yes, those that attract executive attention. That will usually be about 10-20 percent of the programs each year at the impact level and approximately 5-10 percent at the ROI level.
3. Change the thinking of the complete learning cycle. Start with why for your programs; connect it to the business measure at the beginning. Then make sure you have the right solution. Next, expect success with very specific objectives through to impact and share them with the team. With this approach, you are designing for the results you need. With the business data clearly defined in the beginning, you will have the desired results at the end.
4. Share the joy. Make sure that the entire team is involved in designing, developing, and implementing learning and development to deliver impact. Designers, developers, facilitators, participants, and managers of participants are critical to achieving impact success. Each stakeholder has a role, not just the evaluator. This approach makes a world of difference.
5. Think about all the benefits. While business data will convince executives to continue to fund your programs, connecting to the business will help you build partnerships with business leaders, obtain needed support to make programs more effective, and secure the commitment you need to be successful.

Collectively, the team can make a difference.

Reference

1. Phillips, Jack J., and Patti P. Phillips. Measuring for Success. Alexandria, VA: ASTD Press. (2009) Paperback

By Patti P. Phillips, Ph.D. and Jack J. Phillips, Ph.D.

There are five reasons why you should consider measuring the impact and ROI of your programs. However, there are situations where maybe you shouldn’t measure the ROI—but we will come back to that. First, let’s review what is involved when measuring ROI.

Essentially, an ROI evaluation requires evaluating the success of a learning program on five levels of outcomes. The first level is the reaction to the program in terms of relevance, importance, and intent to use. The second level is learning the knowledge and skills required to make the program successful. The third level, application, is tracking how the content has been used and how much success participants have had with its use, along with any barriers and enablers.

The fourth level is impact—the connection of the program to key business measures. At this outcome level, steps must be taken to isolate the effects of the program on those measures and then convert the business measure to money and calculate the ROI. The fifth level, ROI, is the comparison of the monetary benefits of the program to the costs of the program.

Now that you know what’s involved in an ROI study, let’s discuss why you should measure the ROI of your programs:

1. 1. To make the programs better. This has always been our preferred reason for pursuing the impact and ROI analysis. In the past, most of our efforts have been aimed at evaluating level 1—(reaction) and level 2 (learning). However, executives who provide the support and funds would prefer to see the impact of the program. Of course, impact won’t develop unless there is application. The challenge is to improve level 3 and 4 (application and impact) results. An ROI evaluation will indicate if a program is successful or not. If it’s not, the evaluation will show what should be done to make the program better. If it is working, the analysis will give insight for how to make the program even more successful.

1. 1. To satisfy key stakeholders. Programs have many stakeholders, but no one is more important than those who sponsor, support, or provide the budget for programs. These individuals want to see the business connections. Even in governments or nonprofits, alignment to business measures is still something stakeholders want to see. Dozens of studies have shown this is needed, and it is not debatable. Just ask your top executives.

1. 1. To please your team. When we first used this methodology many years ago, we were involved in managing learning and development teams. We wanted to know that our work was connected to the business. There is a sense of satisfaction in knowing that you are making a difference and the difference is not just having people attend programs and provide good ratings. It is the realization that the participants are using what they have learned on the job and are having an impact in their work and in the organization. That’s a great feeling.

1. 1. To maintain or enhance your budget. This is the No. 1 reason we see ROI implemented now. Globally, economies are in a state of uncertainty. When that happens, organizations must be lean and agile to sustain what is next to come. To do so, budgets are trimmed—eliminating anything perceived as a cost or otherwise not absolutely necessary. Unfortunately, this almost always affects the L&D budget. One of the best ways to convince an executive that your program is not a cost (that should be cut), but rather an investment, is to determine the return on investment, using the same calculation that a chief financial officer would use.

1. To change the perception of the L&D function. Sometimes learning and talent development programs are considered a “necessary evil” or compulsory. Many executives agree with this comment: “We know we have to fund training for compliance and to teach people how to do their jobs, but beyond that, we don’t like to provide courses unless there’s extra money.” This is not a positive statement. We have hundreds of studies that show that the highest ROIs come from soft skills programs, such as team building and leadership development, and it is now the time to invest heavily in these areas. But it’s difficult to invest more unless executives see the value. Having consistency within your L&D function routinely—showing the value and the connection to the business for major programs—is the best way to change the perception from a necessary process to a business driver. This will lead to more support, better partnerships, and yes, a seat at the table.

So there you have it, five reasons to measure ROI. But, as we stated in the beginning, maybe you shouldn’t measure your program. This process is not intended for every program. Only programs that are important to the organization, expensive, strategic, or those that attract the interest of top executives should be evaluated at this level.

Our benchmarking studies show that this should not be more than 5 to 10 percent of programs each year. Consider the advantages of and reasons to evaluate a program, and then decide—is it worth it? For more information, email Info@roiinstitute.net.