ATD Blog
Making Training Measurement and Evaluation Work
Content
Use this checklist to assess whether your current M&E practice is sound, sustainable, and aligned with business goals.
Use this checklist to assess whether your current M&E practice is sound, sustainable, and aligned with business goals.
Mon Jun 09 2025
Content
Every organization invests in programs, projects, and initiatives—training sessions, leadership development, change projects, employee engagement, and more. How do we know these efforts are achieving the desired results?
Every organization invests in programs, projects, and initiatives—training sessions, leadership development, change projects, employee engagement, and more. How do we know these efforts are achieving the desired results?
Content
That’s where measurement and evaluation come in.
That’s where measurement and evaluation come in.
Benefits of Measurement and Evaluation
Content
Done well, an evaluation doesn’t just show whether something was successful; it helps to make it successful. It offers feedback, guides improvements, delivers results that matter, and helps leaders make better decisions about where to spend time, energy, and resources.
Done well, an evaluation doesn’t just show whether something was successful; it helps to make it successful. It offers feedback, guides improvements, delivers results that matter, and helps leaders make better decisions about where to spend time, energy, and resources.
Content
Good evaluation ensures stakeholders that talent development professionals:
Good evaluation ensures stakeholders that talent development professionals:
Content
Hold themselves accountable for the resources bestowed upon them.
Hold themselves accountable for the resources bestowed upon them.
Content
Use resources efficiently .
Use resources efficiently.
Content
Focus on program improvement , which leads to outcome improvement .
Focus on program improvement, which leads to outcome improvement.
Content
Create and deliver value that matters most.
Create and deliver value that matters most.
Content
Yet, many talent development practitioners are satisfied with out-of-the-box end-of-course participant feedback surveys and quizzes that deliver little evidence that participants can apply what they learn. The question is “why?” Why does complacency prevail over vigilance, even after decades of research and practice demonstrating that good evaluation exists and the investment in it pays off?
Yet, many talent development practitioners are satisfied with out-of-the-box end-of-course participant feedback surveys and quizzes that deliver little evidence that participants can apply what they learn. The question is “why?” Why does complacency prevail over vigilance, even after decades of research and practice demonstrating that good evaluation exists and the investment in it pays off?
Reasons Given for Not Measuring and Evaluating Training
Content
Reasons talent development professionals give for not doing more than they could (or should) center around:
Reasons talent development professionals give for not doing more than they could (or should) center around:
Content
Fear of the outcome
Fear of the outcome
Content
Difficulty of the process
Difficulty of the process
Content
Cost constraints
Cost constraints
Content
Time constraints
Time constraints
Content
Some talent development professionals are just waiting for senior leaders to ask for more.
Some talent development professionals are just waiting for senior leaders to ask for more.
Feel the Fear and Do It Anyway*
Content
While good evaluation may reveal flaws in training design, delivery, and implementation, and it may be difficult, costly, and timely if you don’t know how to do it, what we know with relative certainty is: When the boss asks for meaningful results today, they will want to see those results tomorrow. So, while the “stay away” rhetoric may encourage delaying the pursuit of sound measurement and evaluation, the time to make measurement and evaluation work is now.
While good evaluation may reveal flaws in training design, delivery, and implementation, and it may be difficult, costly, and timely if you don’t know how to do it, what we know with relative certainty is: When the boss asks for meaningful results today, they will want to see those results tomorrow. So, while the “stay away” rhetoric may encourage delaying the pursuit of sound measurement and evaluation, the time to make measurement and evaluation work is now.
Making Measurement and Evaluation Work
Content
So, what does it take to make measurement and evaluation work? There are five components that come together to create sound measurement and evaluation:
So, what does it take to make measurement and evaluation work? There are five components that come together to create sound measurement and evaluation:
Content
Framework of measures
Framework of measures
Content
Process model
Process model
Content
Standards or guiding principles
Standards or guiding principles
Content
Case application and practice
Case application and practice
Content
Implementation strategy
Implementation strategy
Content
The framework is a categorization scheme that ensures measures that matter to all stakeholders are defined. Phillips' five-level evaluation framework is the most widely used; it includes measures important to designers, developers, and facilitators as well as the immediate supervisors, senior leaders, and board directors. Measures of participant reaction, learning, application, impact, and ROI are grounded in psychology, sociology, and economics, and when reported together, they allow for a holistic understanding of talent development value. In fact, this framework is applied beyond talent development, making it scalable across the organization.
The framework is a categorization scheme that ensures measures that matter to all stakeholders are defined. Phillips' five-level evaluation framework is the most widely used; it includes measures important to designers, developers, and facilitators as well as the immediate supervisors, senior leaders, and board directors. Measures of participant reaction, learning, application, impact, and ROI are grounded in psychology, sociology, and economics, and when reported together, they allow for a holistic understanding of talent development value. In fact, this framework is applied beyond talent development, making it scalable across the organization.
Content
Process models are important in that they show the steps required to ensure consistent implementation. W. Edwards Deming, recognized as the father of Total Quality Management, is known to have said, “If you can’t explain what you do as a process, you don’t know what you are doing.” Process models ensure talent development professionals can explain what they need to do, what they are doing, and what they did to get the results they report.
Process models are important in that they show the steps required to ensure consistent implementation. W. Edwards Deming, recognized as the father of Total Quality Management, is known to have said, “If you can’t explain what you do as a process, you don’t know what you are doing.” Process models ensure talent development professionals can explain what they need to do, what they are doing, and what they did to get the results they report.
Content
As Michael A. Lawson describes in ATD’s Handbook for Measuring and Evaluating Training, 2nd edition, professional standards provide a set of guideposts and guardrails. They ensure consistency in the implementation of a process. The process, coupled with the standards, ensures reliability in the data categorized in the framework.
As Michael A. Lawson describes in ATD’s Handbook for Measuring and Evaluating Training, 2nd edition, professional standards provide a set of guideposts and guardrails. They ensure consistency in the implementation of a process. The process, coupled with the standards, ensures reliability in the data categorized in the framework.
Content
While a framework, process model, and standards are important, they are only theoretical until they are put into practice. This is the fourth component—case application and practice. Here is where measurement and evaluation do their jobs. But, to make these processes work for the long-term requires a sustainable implementation strategy—the fifth component. This strategy includes a common way of working, a capable team, senior leader buy-in, a scalable approach, and a plan that balances the level of measurement with the importance, cost, and intent of talent development programs.
While a framework, process model, and standards are important, they are only theoretical until they are put into practice. This is the fourth component—case application and practice. Here is where measurement and evaluation do their jobs. But, to make these processes work for the long-term requires a sustainable implementation strategy—the fifth component. This strategy includes a common way of working, a capable team, senior leader buy-in, a scalable approach, and a plan that balances the level of measurement with the importance, cost, and intent of talent development programs.
Content
While senior executives, including CEOs, want to see impact and ROI data, it is not necessary to evaluate all programs at all levels. The table below provides the minimum percentage of programs to be evaluated to each level based on the types of programs offered through the typical large organizations. Programs that are costly, strategic, and operationally aligned are candidates for evaluation to impact and ROI.
While senior executives, including CEOs, want to see impact and ROI data, it is not necessary to evaluate all programs at all levels. The table below provides the minimum percentage of programs to be evaluated to each level based on the types of programs offered through the typical large organizations. Programs that are costly, strategic, and operationally aligned are candidates for evaluation to impact and ROI.
Content Level Level | Content Measurement Category Measurement Category | Content Recommended Minimum Recommended Minimum |
Content 0 0 | Content Input/Indicators: Measures the number of programs, participants, audience, costs, and efficiencies Input/Indicators: Measures the number of programs, participants, audience, costs, and efficiencies | Content 100% 100% |
Content 1 1 | Content Reaction and Planned Action: Measures reaction to, and satisfaction with, the experience, contents, and value of the program Reaction and Planned Action: Measures reaction to, and satisfaction with, the experience, contents, and value of the program | Content 100% 100% |
Content 2 2 | Content Learning: Measures what participants learned in the program–information, knowledge, skills, and contacts (takeaways) Learning: Measures what participants learned in the program–information, knowledge, skills, and contacts (takeaways) | Content 80–90% 80–90% |
Content 3 3 | Content Application: Measures progress after the program–the use of information, knowledge, skills, and contacts Application: Measures progress after the program–the use of information, knowledge, skills, and contacts | Content 30–40% 30–40% |
Content 4 4 | Content Business Impact: Measures changes in business impact variables such as output, quality, time, and costs linked to the program Business Impact: Measures changes in business impact variables such as output, quality, time, and costs linked to the program | Content 10–20% 10–20% |
Content 5 5 | Content ROI: Compares the monetary benefits of the business impact measures to the costs of the program ROI: Compares the monetary benefits of the business impact measures to the costs of the program | Content 5–10% 5–10% |
Content
Source: ROI Institute, Inc.
Source: ROI Institute, Inc.
Your Measurement and Evaluation Practice
Content
Sound measurement and evaluation need not be difficult, costly, or time-consuming. In fact, a good measurement and evaluation practice should only cost 3–5 percent of the total training budget. For that small amount, talent development professionals can reap all the benefits measurement and evaluation have to offer.
Sound measurement and evaluation need not be difficult, costly, or time-consuming. In fact, a good measurement and evaluation practice should only cost 3–5 percent of the total training budget. For that small amount, talent development professionals can reap all the benefits measurement and evaluation have to offer.
Content
Use this checklist to assess whether your current M&E practice is sound, sustainable, and aligned with business goals. Mark each bulleted item you confidently meet.
Use this checklist to assess whether your current M&E practice is sound, sustainable, and aligned with business goals. Mark each bulleted item you confidently meet.
Content
Readiness and Mindset
Readiness and Mindset
Content
We recognize that evaluation is essential for proving and improving training value.
We recognize that evaluation is essential for proving and improving training value.
Content
We have moved beyond basic end-of-course surveys and quizzes as our only evaluation tools.
We have moved beyond basic end-of-course surveys and quizzes as our only evaluation tools.
Content
We are not deterred by fear of negative outcomes—we use evaluation to drive program and process improvement.
We are not deterred by fear of negative outcomes—we use evaluation to drive program and process improvement.
Content
We do not wait for executives to request impact or ROI data—we lead with it.
We do not wait for executives to request impact or ROI data—we lead with it.
Content
Evaluation Framework
Evaluation Framework
Content
We use a structured evaluation framework (e.g., Phillips’s Five Levels).
We use a structured evaluation framework (e.g., Phillips’s Five Levels).
Content
We track Level 0 (Input) data for 100 percent of programs (e.g., attendance, cost).
We track Level 0 (Input) data for 100 percent of programs (e.g., attendance, cost).
Content
We measure Level 1 (Reaction & Planned Action) for all programs.
We measure Level 1 (Reaction & Planned Action) for all programs.
Content
We assess Level 2 (Learning) for at least 80–90 percent of our programs.
We assess Level 2 (Learning) for at least 80–90 percent of our programs.
Content
We measure Level 3 (Application) for 30–40 percent of our programs.
We measure Level 3 (Application) for 30–40 percent of our programs.
Content
We assess Level 4 (Business Impact) for 10–20 percent of strategic programs.
We assess Level 4 (Business Impact) for 10–20 percent of strategic programs.
Content
We calculate Level 5 (ROI) for 5–10 percent of high-cost or mission-critical programs.
We calculate Level 5 (ROI) for 5–10 percent of high-cost or mission-critical programs.
Content
Process Model
Process Model
Content
We follow a documented step-by-step process to plan, collect, analyze, and report evaluation data.
We follow a documented step-by-step process to plan, collect, analyze, and report evaluation data.
Content
Everyone on our team understands the process and can explain how it works.
Everyone on our team understands the process and can explain how it works.
Content
The process is applied consistently across programs and teams.
The process is applied consistently across programs and teams.
Content
Standards or Guiding Principles
Standards or Guiding Principles
Content
We follow internal or industry evaluation standards (e.g., ROI Institute, AEA, ISO).
We follow internal or industry evaluation standards (e.g., ROI Institute, AEA, ISO).
Content
Our evaluation methods are consistent, credible, and defensible.
Our evaluation methods are consistent, credible, and defensible.
Content
We apply conservative assumptions and credible data sources in analysis.
We apply conservative assumptions and credible data sources in analysis.
Content
Case Application and Practice
Case Application and Practice
Content
We regularly apply the framework, process, and standards in real-world projects.
We regularly apply the framework, process, and standards in real-world projects.
Content
We share case studies or internal reports that illustrate successful evaluation in action.
We share case studies or internal reports that illustrate successful evaluation in action.
Content
Our team learns from experience and evolves our practice over time.
Our team learns from experience and evolves our practice over time.
Content
Implementation Strategy
Implementation Strategy
Content
We have a sustainable strategy to grow and maintain measurement and evaluation.
We have a sustainable strategy to grow and maintain measurement and evaluation.
Content
Our approach is embedded in the organization’s way of working.
Our approach is embedded in the organization’s way of working.
Content
Our team is trained and capable of executing sound measurement and evaluation.
Our team is trained and capable of executing sound measurement and evaluation.
Content
We have senior leadership support for our evaluation efforts.
We have senior leadership support for our evaluation efforts.
Content
We balance the level of measurement with the cost, visibility, and strategic importance of each program.
We balance the level of measurement with the cost, visibility, and strategic importance of each program.
Content
We invest 3-5 percent of the training budget in measurement and evaluation activities.
We invest 3-5 percent of the training budget in measurement and evaluation activities.
Content
Continuous Improvement and Communication
Continuous Improvement and Communication
Content
We use evaluation results to improve program design and delivery.
We use evaluation results to improve program design and delivery.
Content
We communicate evaluation results in a compelling and actionable format.
We communicate evaluation results in a compelling and actionable format.
Content
We report both tangible (e.g., cost savings) and intangible (e.g., morale) benefits.
We report both tangible (e.g., cost savings) and intangible (e.g., morale) benefits.
Content
We use evaluation insights to guide future investments and decision making.
We use evaluation insights to guide future investments and decision making.
Content
Did you find there is an opportunity to improve?
Did you find there is an opportunity to improve?
Content
Check out ATD’s Handbook for Measuring and Evaluating Training, 2nd edition . This go-to resource offers how-to tips, practical advice, real-world examples, and tools you can use right away.
Check out ATD’s Handbook for Measuring and Evaluating Training, 2nd edition. This go-to resource offers how-to tips, practical advice, real-world examples, and tools you can use right away.
Content
*Quote by Susan Jeffers; https://susanjeffers.com
*Quote by Susan Jeffers; https://susanjeffers.com
Content