Recent surveys and reports suggest that learning and talent development professionals are not showing the value of what they do in terms that sponsors, supporters, and funders can appreciate. They don’t fully connect their programs, projects, and initiatives to key business measures, yet they confess that this is needed. Perhaps the more significant challenge is the concern that talent development programs might not be adding value at this level. If evaluation results are disappointing, not many talent professionals will want to measure it or report it. Essentially, this is a fear of disappointing results, including a negative ROI. To tackle this challenge, talent development professionals need to reframe their approach to evaluation. Evaluation must be seen as a proactive process and not as a process applied only after a program is complete. This post describes how a proactive approach to evaluation would design, measure, and deliver the desired impact and ROI of various programs.
The Concern
There is much confusion about what evaluation adds to the organization because many evaluation systems are more reactive than proactive. They function like an auditing system. They check to see what has or has not happened then categorize the results as either “ it worked” or “ it didn’t work.” When the evaluation results are distributed, those who own the “ it didn’t work” efforts and those who funded those programs are not so happy. This approach to evaluation must change because the number one reason that programs are not evaluated at the impact and ROI levels is the fear of negative results. We all understand this concern: If your programs are not working, why publish a report and tell everyone? With a proactive approach to program evaluation, this issue essentially goes away.The Needed Approach
A proactive approach is a logical extension of some evaluation systems. After all, when you evaluate a program, you are doing it for the organization or the client who wants the program to be successful. Why not structure an evaluation model that helps you achieve this success? This requires a change in thinking and a determination to share the roles and responsibilities with the entire team. The key is to design for the results you want, and the evaluation system will influence design and outcomes. When everyone has a part in the process, achieving the desired results is not that difficult. Talent development professionals can do this by implementing five straightforward steps.Five Steps to a Proactive Evaluation: Designing for the Results You Want
1. Start With Why: As you start to plan the evaluation, explore why you are implementing the program. This is determining the business impact or business needs. As our partner in Australia proclaims, “Start where you want to finish.” With this as your first step, you are focusing on impact through all the steps in the process. This proactive approach ensures, in the beginning, that the program connects to the business. Too many programs do not connect to business measures. In fact, most learning programs do not connect to the business. They are often based on something that participants need to know (learning) or need to do (application, behavior).In a recent conversation with a talent development professional, we discussed a new agile management program that was being implemented in their organization. The program’s funder was asking for the impact and ROI of this program. We asked, “Why are you implementing this program?” Our colleague answered, “Our management wants us to obtain the six skills of agile management.” We then asked, “Why do managers need these skills?” This question led to an uncomfortable conversation for some because just having the skills in place is behavior, not the business need. For most funders, the behavior is not enough.
If you begin with the behavior, you will end up with behavior, as highlighted in Stephen Covey’s Habit #2 “Begin with the end in mind.” The individuals who initiate programs must change their thinking and realize their roles are to ensure the programs have an impact. The executives’ perspectives are well known, and research shows executives want to see the business connection of learning. They want to see the impact of learning and talent development programs.
2. Select the Right Solution: Sometimes the suggested solution may not be the right solution. It happens. You must take steps to ensure the solution drives the business measure. This may require you to have performance discussions or conduct some analysis. The analysis may involve interviews, focus groups, examining organizational records, or using diagnostic tools. Taking these necessary steps ensure the solution will improve the business measure.
3. Plan for the Results: An evaluation system must help the organization be successful. You expect success by having specific objectives. When a new solution is implemented, objectives need to be developed. These objectives should include, not just routine learning objectives, but objectives for application (using the learning), and impact (the consequences of application). Objectives are set at each level—Level 1 (Reaction), Level 2 (Learning), Level 3 (Application), and Level 4 (Impact)—then provided to the different stakeholders (designers, developers, facilitators, managers of participants, and even the participants).
4. Ensure That Stakeholders Are Designing for the Desired Outcome: Challenge the stakeholders to design the program to achieve the objectives, including the impact objectives. This can be accomplished with tools, templates, processes, encouragement, and suggestions aimed at not only learning but the use of the learning and the impact from it. This pushes the success of learning from just acquiring knowledge and skills to applying the learning and ultimately delivering the impact. This is what executives and funders want to see and what the program’s sponsor’s supporters need to see—the business connection. Taking this step ensures that each stakeholder clearly understands their role in delivering the success that is needed.
5. Measure Results: With a proactive evaluation process in place, you can apply the classic evaluation strategies of collecting and analyzing data to examine the program’s results. When things are not going well, the data will show what changes need to be made to improve the results. And if things are going well, the data will show how to make the program results even more successful.
The Payoff
When you take these five steps, your program is almost guaranteed to deliver positive business results because you have ensured it is connected to the business, it’s the right solution, everyone knows what is expected, and everyone has designed for the results. This places you and your organization on the path to success. This proactive approach shifts the evaluation process from reporting to driving the results you want and need.For some, this may be fundamentally in conflict with evaluation, but this should not be the case. What you want from an evaluation system is process improvement. You want to make improvements if the program is not working. Why not have processes in place to avoid barriers, breakdowns, and stumbling points along the way? Removing those barriers paves the path to success. A proactive approach to evaluation creates a significant shift in the way programs are developed and implemented. For more detail on this approach and a case study showing how a proactive evaluation works, please contact ROI Institute.
