Stumped on How to Measure DEI Training?

Content

Diversity, equity, and inclusion constitute a process and system of integrating new metrics and practices into how your organization does its work. For simplicity, we'll reference this process as a program or initiative throughout this article, but that does not mean DEI is a one-and-done effort.

Diversity, equity, and inclusion constitute a process and system of integrating new metrics and practices into how your organization does its work. For simplicity, we'll reference this process as a program or initiative throughout this article, but that does not mean DEI is a one-and-done effort.

Content

"The key is to recognize that DEI is a long-term journey and that we cannot cram all our goals into one program. Then we become more prepared and confident to affect change because we can focus on this program and the impact it will seek to have," says Crystal Kadakia, an organizational change consultant and author.

"The key is to recognize that DEI is a long-term journey and that we cannot cram all our goals into one program. Then we become more prepared and confident to affect change because we can focus on this program and the impact it will seek to have," says Crystal Kadakia, an organizational change consultant and author.

Content

To position your efforts to deliver predictable, measurable results, your DEI initiative should have aligned goals, desired workplace behaviors, and learning objectives.

To position your efforts to deliver predictable, measurable results, your DEI initiative should have aligned goals, desired workplace behaviors, and learning objectives.

Results first

Content

The initial step in designing a DEI program that works is to clearly define the desired program results. Rather than putting the weight of this important task on one individual and to reduce biased designs, create a committee that is representative of the company's departments, levels, and employee backgrounds.

The initial step in designing a DEI program that works is to clearly define the desired program results. Rather than putting the weight of this important task on one individual and to reduce biased designs, create a committee that is representative of the company's departments, levels, and employee backgrounds.

Content

"No one person in an organization should own DEI, and it can't just be punted to human resources, although HR plays a critical role in helping the organization achieve strategic DEI goals," explains DEI consultant and author Maria Morukian. "DEI efforts require active and visible support from leadership, engagement from across the organization, and accountability at all levels."

"No one person in an organization should own DEI, and it can't just be punted to human resources, although HR plays a critical role in helping the organization achieve strategic DEI goals," explains DEI consultant and author Maria Morukian. "DEI efforts require active and visible support from leadership, engagement from across the organization, and accountability at all levels."

Content

The committee's first task is to create the vision of what success will look like. "A vision of success for the DEI team moves beyond high-level organizational values to naming specific systemic and cultural changes that newly developed programs will support," says Kadakia.

The committee's first task is to create the vision of what success will look like. "A vision of success for the DEI team moves beyond high-level organizational values to naming specific systemic and cultural changes that newly developed programs will support," says Kadakia.

Content

For example, a general organizational vision statement could read: "We are diverse in our staffing and inclusive in the way we operate through all job functions and levels. We actively seek out diverse approaches and points of view because we believe that drives innovation. We foster both a top-down and grassroots approach to our work to equitably hear voices at all levels to ensure accountability for fostering an equitable culture at all levels of the organization."

For example, a general organizational vision statement could read: "We are diverse in our staffing and inclusive in the way we operate through all job functions and levels. We actively seek out diverse approaches and points of view because we believe that drives innovation. We foster both a top-down and grassroots approach to our work to equitably hear voices at all levels to ensure accountability for fostering an equitable culture at all levels of the organization."

Content

Once the vision is clear, it is critical to identify specific, observable, measurable results for DEI.

Once the vision is clear, it is critical to identify specific, observable, measurable results for DEI.

Content

Setting diversity goals. Diversity is the practice of including people from different backgrounds including race, ethnicity, gender, gender identity, sexual orientation, age, social class, physical ability or attributes, religious or ethical values system, national origin, and political beliefs. Most employers find defining desired results for diversity easy. Examples include:

Setting diversity goals. Diversity is the practice of including people from different backgrounds including race, ethnicity, gender, gender identity, sexual orientation, age, social class, physical ability or attributes, religious or ethical values system, national origin, and political beliefs. Most employers find defining desired results for diversity easy. Examples include:

• Content

  Percentage of diverse candidates who apply, interview, or are hired for a position

  Percentage of diverse candidates who apply, interview, or are hired for a position

• Content

  Percentage of diverse employees at each level

  Percentage of diverse employees at each level

• Content

  Diversity of employees promoted to higher-level or advanced positions

  Diversity of employees promoted to higher-level or advanced positions

• Content

  Retention of diverse employees

  Retention of diverse employees

• Content

  Employee engagement among diverse workers

  Employee engagement among diverse workers

• Content

  Diversity of executive board members

  Diversity of executive board members

Content

Setting equity goals. Defining equity is important because it is not the same as equality, which means everyone is given the same resources or opportunities. Equity recognizes that each person has different circumstances and allocates the resources and opportunities needed to reach an equal outcome. Equity helps to achieve diversity goals by making it equally likely for minority groups to achieve the same level of success.

Setting equity goals. Defining equity is important because it is not the same as equality, which means everyone is given the same resources or opportunities. Equity recognizes that each person has different circumstances and allocates the resources and opportunities needed to reach an equal outcome. Equity helps to achieve diversity goals by making it equally likely for minority groups to achieve the same level of success.

Content

Set equity goals by making an honest and comprehensive assessment of the systemic factors contributing to barriers to success for marginalized or underrepresented identities. Examples of equity goals include:

Set equity goals by making an honest and comprehensive assessment of the systemic factors contributing to barriers to success for marginalized or underrepresented identities. Examples of equity goals include:

• Content

  Salary parity for diverse employees at the same level

  Salary parity for diverse employees at the same level

• Content

  Equal opportunities available for all employees

  Equal opportunities available for all employees

• Content

  Equitable performance management and succession planning practices

  Equitable performance management and succession planning practices

Content

Setting inclusion goals. Inclusion is a culture expressed through implicit actions and underlying beliefs that ensure everyone feels a deep sense of belonging, is valued for their unique skills and characteristics, and can contribute fully to organizational life.

Setting inclusion goals. Inclusion is a culture expressed through implicit actions and underlying beliefs that ensure everyone feels a deep sense of belonging, is valued for their unique skills and characteristics, and can contribute fully to organizational life.

Content

In a workplace environment, inclusion also has a more literal meaning of having people at different levels of the company heard as much as those in positions of power. Examples of inclusion goals include:

In a workplace environment, inclusion also has a more literal meaning of having people at different levels of the company heard as much as those in positions of power. Examples of inclusion goals include:

• Content

  All voices heard equally during committee meetings

  All voices heard equally during committee meetings

• Content

  Frequency and types of opportunities for employees to provide input on decisions that affect them directly

  Frequency and types of opportunities for employees to provide input on decisions that affect them directly

• Content

  Positive employee survey results on questions related to feeling respected and valued for their contributions

  Positive employee survey results on questions related to feeling respected and valued for their contributions

• Content

  Developing communication systems that connect frontline employees to top-level leaders

  Developing communication systems that connect frontline employees to top-level leaders

• Content

  Building organizational capability for behaviors that foster psychological safety

  Building organizational capability for behaviors that foster psychological safety

Actions speak louder than words

Content

Companies often do a good job of sharing their DEI vision and goals in public statements, internal documents, and training programs. Those are only symbolic actions and are unlikely to create any change unless employers define the critical behaviors individuals must perform on the job and set up a system of support and accountability to ensure those actions occur.

Companies often do a good job of sharing their DEI vision and goals in public statements, internal documents, and training programs. Those are only symbolic actions and are unlikely to create any change unless employers define the critical behaviors individuals must perform on the job and set up a system of support and accountability to ensure those actions occur.

Content

Defining and implementing a Level 3 behavior plan is the biggest requirement for organizational DEI success, and it's traditionally the item companies most frequently overlook in general. What that means is if you want people to do something and have positive, measurable change occur, you need a multifaceted Level 3 plan. As represented in the 70-20-10 model, on-the-job experiences are the biggest source of learning for employees.

Defining and implementing a Level 3 behavior plan is the biggest requirement for organizational DEI success, and it's traditionally the item companies most frequently overlook in general. What that means is if you want people to do something and have positive, measurable change occur, you need a multifaceted Level 3 plan. As represented in the 70-20-10 model, on-the-job experiences are the biggest source of learning for employees.

Content

DEI includes complex, sensitive, and longstanding cultural issues. And while programs may not have the power to change what every employee thinks or feels, they can define acceptable behavioral standards and consistent implementation of them.

DEI includes complex, sensitive, and longstanding cultural issues. And while programs may not have the power to change what every employee thinks or feels, they can define acceptable behavioral standards and consistent implementation of them.

Content

Critical behaviors are the few, key ones that employees will have to consistently perform on the job to bring about the targeted outcomes. Such behaviors convert abstract concepts like DEI into observable and measurable actions that employers can track, coach, and reward.

Critical behaviors are the few, key ones that employees will have to consistently perform on the job to bring about the targeted outcomes. Such behaviors convert abstract concepts like DEI into observable and measurable actions that employers can track, coach, and reward.

Content

For example, to make committee meetings equitable by having all voices heard, a critical behavior could be to require the use of a structured meeting agenda that gives each meeting participant the same number of minutes to voice their views on a topic. Another critical behavior could be to have committee decisions made by popular vote. If pressures to align with senior committee members are strong, conduct votes anonymously.

For example, to make committee meetings equitable by having all voices heard, a critical behavior could be to require the use of a structured meeting agenda that gives each meeting participant the same number of minutes to voice their views on a topic. Another critical behavior could be to have committee decisions made by popular vote. If pressures to align with senior committee members are strong, conduct votes anonymously.

Content

Employees should have their own set of no more than three critical behaviors defined for the DEI initiative or a specific DEI-related project that are specific to their job function (if they differ from job to job). If people cannot remember the behaviors, they will not perform them. That may sound limiting, but the same critical behavior may address more than one DEI goal, and they can differ from department to department or job to job.

Employees should have their own set of no more than three critical behaviors defined for the DEI initiative or a specific DEI-related project that are specific to their job function (if they differ from job to job). If people cannot remember the behaviors, they will not perform them. That may sound limiting, but the same critical behavior may address more than one DEI goal, and they can differ from department to department or job to job.

Content

After defining the critical behaviors for the people most directly involved in creating the desired DEI results, the next step is to set up required drivers to ensure they happen consistently.

After defining the critical behaviors for the people most directly involved in creating the desired DEI results, the next step is to set up required drivers to ensure they happen consistently.

A blended approach yields maximum results

Content

Required drivers are processes and systems that monitor, reinforce, encourage, and reward performance of critical behaviors on the job. If there is a secret weapon to program success, this is it. Even when people know what to do, chances of them doing it are much more likely if others support their efforts and hold them accountable.

Required drivers are processes and systems that monitor, reinforce, encourage, and reward performance of critical behaviors on the job. If there is a secret weapon to program success, this is it. Even when people know what to do, chances of them doing it are much more likely if others support their efforts and hold them accountable.

Content

Performance support and accountability is where to invest the largest share of resources to maximize program outcomes and success. Each critical behavior or group of behaviors for a given group of employees should have a corresponding set of required drivers. The good news is that required drivers are not mutually exclusive; the same driver could support multiple behaviors, and the same driver may also cover multiple purposes.

Performance support and accountability is where to invest the largest share of resources to maximize program outcomes and success. Each critical behavior or group of behaviors for a given group of employees should have a corresponding set of required drivers. The good news is that required drivers are not mutually exclusive; the same driver could support multiple behaviors, and the same driver may also cover multiple purposes.

Content

Use an instructional design approach that includes a holistic view of learning and performance with a broad view of what constitutes learning and a focus on what happens in the on-the-job environment.

Use an instructional design approach that includes a holistic view of learning and performance with a broad view of what constitutes learning and a focus on what happens in the on-the-job environment.

Content

In the example of making committee meetings equitable, required drivers could include:

In the example of making committee meetings equitable, required drivers could include:

• Content

  Providing a meeting agenda job aid (reinforcing)

  Providing a meeting agenda job aid (reinforcing)

• Content

  Assigning a committee member to work with meeting leaders if they need help (encouraging)

  Assigning a committee member to work with meeting leaders if they need help (encouraging)

• Content

  Publicizing equitable meetings in company news (rewarding)

  Publicizing equitable meetings in company news (rewarding)

• Content

  Requiring meeting minutes for meetings related to company objectives and having a committee member review them for compliance (monitoring)

  Requiring meeting minutes for meetings related to company objectives and having a committee member review them for compliance (monitoring)

Content

Notice how one driver can cross over into multiple categories. For example, a meeting agenda job aid that reinforces equitable time for each person to speak also serves as a monitoring tool and encourages people to conduct their meetings in the prescribed way. Publicly recognizing teams that are conducting their meetings to standard rewards them and provides encouragement for others to follow suit. Make sure the required drivers package covers all four categories—monitoring, reinforcing, encouraging, and rewarding—for mission-critical initiatives, but that does not mean you need four separate and exclusive buckets.

Notice how one driver can cross over into multiple categories. For example, a meeting agenda job aid that reinforces equitable time for each person to speak also serves as a monitoring tool and encourages people to conduct their meetings in the prescribed way. Publicly recognizing teams that are conducting their meetings to standard rewards them and provides encouragement for others to follow suit. Make sure the required drivers package covers all four categories—monitoring, reinforcing, encouraging, and rewarding—for mission-critical initiatives, but that does not mean you need four separate and exclusive buckets.

Content

DEI initiatives are important and therefore warrant a required drivers package with all four categories. The DEI committee can suggest a universal set of required drivers, and subject matter experts in each area can review them and add or customize items for each group. Setting up a required drivers package is not difficult; however, the bigger challenges are to ensure implementing it is realistic and to assign the indicated roles and responsibilities.

DEI initiatives are important and therefore warrant a required drivers package with all four categories. The DEI committee can suggest a universal set of required drivers, and subject matter experts in each area can review them and add or customize items for each group. Setting up a required drivers package is not difficult; however, the bigger challenges are to ensure implementing it is realistic and to assign the indicated roles and responsibilities.

Content

A big reason DEI initiatives will not be successful with one individual at the helm is because the required drivers package needs support in all areas. Companies cannot hold one person responsible for every employee doing the right thing on the job. And by the same token, one person cannot support and hold accountable every employee either.

A big reason DEI initiatives will not be successful with one individual at the helm is because the required drivers package needs support in all areas. Companies cannot hold one person responsible for every employee doing the right thing on the job. And by the same token, one person cannot support and hold accountable every employee either.

Content

Accountability for DEI can be challenging. Many people dislike confrontation and tend to avoid giving feedback. DEI often feels amorphous and brings an emotional charge that can seem daunting. Build an environment where feedback is well practiced and perceived as a supporting tool, not a punishment. That directly relates to inclusion goals about making all voices heard and establishing comfortable communication channels.

Accountability for DEI can be challenging. Many people dislike confrontation and tend to avoid giving feedback. DEI often feels amorphous and brings an emotional charge that can seem daunting. Build an environment where feedback is well practiced and perceived as a supporting tool, not a punishment. That directly relates to inclusion goals about making all voices heard and establishing comfortable communication channels.

Now design the training

Content

When you receive a request for a new training program, you may instinctively open your laptop and start outlining and compiling slides. However, resist that temptation until you have clear definitions of the desired outcomes and, more importantly, the critical behaviors and required drivers package.

When you receive a request for a new training program, you may instinctively open your laptop and start outlining and compiling slides. However, resist that temptation until you have clear definitions of the desired outcomes and, more importantly, the critical behaviors and required drivers package.

Content

Defining critical behaviors up front creates the framework for your learning objectives and the instructional design plan. Starting with what you want people to do on the job establishes the outline for the training content.

Defining critical behaviors up front creates the framework for your learning objectives and the instructional design plan. Starting with what you want people to do on the job establishes the outline for the training content.

Content

During training, make behavioral expectations clear and explain how the company will support people afterward and hold them accountable. Design activities around practicing the behaviors and using the job aids.

During training, make behavioral expectations clear and explain how the company will support people afterward and hold them accountable. Design activities around practicing the behaviors and using the job aids.

Content

For a sensitive topic such as DEI, provide an opportunity for discussion and voicing of concerns. If the training solution is self-paced, provide a way for people to get answers to their questions or discuss concerns with someone in real time.

For a sensitive topic such as DEI, provide an opportunity for discussion and voicing of concerns. If the training solution is self-paced, provide a way for people to get answers to their questions or discuss concerns with someone in real time.

Content

Some employers are likely feeling great pressure to launch a DEI program quickly, but skipping over defining the outcomes and the Level 3 package will not work for this initiative—or any initiative. Invest the time now to make sure the resources you invest create outcomes and true organizational value.

Some employers are likely feeling great pressure to launch a DEI program quickly, but skipping over defining the outcomes and the Level 3 package will not work for this initiative—or any initiative. Invest the time now to make sure the resources you invest create outcomes and true organizational value.

Your finest hour

Content

In the movie Apollo 13, flight director Gene Kranz overhears two NASA directors discussing the low survival chances for the crippled spacecraft. "I know what the problems are, Henry," one of them says. "This could be the worst disaster NASA has ever experienced."

In the movie Apollo 13, flight director Gene Kranz overhears two NASA directors discussing the low survival chances for the crippled spacecraft. "I know what the problems are, Henry," one of them says. "This could be the worst disaster NASA has ever experienced."

Content

"With all due respect, sir," Kranz intervenes, "I believe this is going to be our finest hour."

"With all due respect, sir," Kranz intervenes, "I believe this is going to be our finest hour."

Content

The approach you and your organization take to creating true DEI is a blueprint for the success of anything important. There must be positive, inclusive, accountable actions that will bring about improved performance, contribute to your company's mission, and fulfill the initiative's intent.

The approach you and your organization take to creating true DEI is a blueprint for the success of anything important. There must be positive, inclusive, accountable actions that will bring about improved performance, contribute to your company's mission, and fulfill the initiative's intent.

The Current State of DEI&B Education

Content

Does your organization have formal goals or outcomes for its diversity, equity, inclusion, and belonging efforts, including DEI&B education?

Does your organization have formal goals or outcomes for its diversity, equity, inclusion, and belonging efforts, including DEI&B education?

Content

No:

No: 

Content

21%

21%

Content

Yes, tied to measurable key performance indicators:

Yes, tied to measurable key performance indicators:

Content

36%

36%

Content

Yes, but not tied to measurable KPIs:

Yes, but not tied to measurable KPIs:

Content

43%

43%

SOURCE: DEI&B EDUCATION FOR EMPLOYEES, ASSOCIATION FOR TALENT DEVELOPMENT, 2021

Sample DEI Goals and Associated Critical Behaviors

Content

Diversity goal: Diversity of workforce matches area demographics at all levels.

Diversity goal: Diversity of workforce matches area demographics at all levels.

Content

Equity goal: There is salary parity for employees at the same level.

Equity goal: There is salary parity for employees at the same level.

Content

Critical behaviors:

Critical behaviors:

• Content

  Conduct annual audit of employee diversity and salary parity in all pay grades.

  Conduct annual audit of employee diversity and salary parity in all pay grades.

• Content

  When multiple job candidates are qualified for a job and the employee cohort within the position's pay grade is not as diverse as the community, hire the minority group candidate to fill the open position.

  When multiple job candidates are qualified for a job and the employee cohort within the position's pay grade is not as diverse as the community, hire the minority group candidate to fill the open position.

• Content

  Conduct semiannual employee engagement and equal opportunity surveys (including identifying demographic questions).

  Conduct semiannual employee engagement and equal opportunity surveys (including identifying demographic questions).

Content

Inclusion goal: Committee meetings have equitable contributions from all participants.

Inclusion goal: Committee meetings have equitable contributions from all participants.

Content

Critical behaviors:

Critical behaviors:

• Content

  Mandate a structured meeting agenda with equal time allotted to each participant to speak on the topic.

  Mandate a structured meeting agenda with equal time allotted to each participant to speak on the topic.

• Content

  Make committee decisions by popular, anonymous vote.

  Make committee decisions by popular, anonymous vote.