ATD Blog
The New L&D Bottleneck: Why AI Quality Assurance Is Your Most Critical Capability
Content
To build a pipeline that filters out the slop, instructional designers can apply the H-AI-H framework.
To build a pipeline that filters out the slop, instructional designers can apply the H-AI-H framework.
Wed Aug 05 2026
Content
We have officially entered the era of the friction-free draft.
We have officially entered the era of the friction-free draft.
Content
Not long ago, instructional designers spent weeks staring at blank pages, organizing subject matter expert (SME) transcripts, and mapping out learning objectives. Today, generative AI can spit out a course outline, a storyboard, or a module script in seconds. Production is no longer where we get stuck.
Not long ago, instructional designers spent weeks staring at blank pages, organizing subject matter expert (SME) transcripts, and mapping out learning objectives. Today, generative AI can spit out a course outline, a storyboard, or a module script in seconds. Production is no longer where we get stuck.
Content
Checking is.
Checking is.
Content
By lowering the barrier to creation, AI has unlocked a less welcome superpower: the ability to flood our learning management systems and company portals with what the tech world now calls AI slop.
By lowering the barrier to creation, AI has unlocked a less welcome superpower: the ability to flood our learning management systems and company portals with what the tech world now calls AI slop.
Content
In the wild, slop is the endless stream of generic, low-effort web content and weirdly proportioned AI images. But in corporate learning, L&D slop is far more insidious. It is the learning asset that looks instructionally sound, features beautiful formatting, and includes a neat 10-question quiz, but is hollow, superficial, or subtly incorrect. It is active listening training that merely tells learners to "nod and maintain eye contact" without addressing any real-world behavioral nuance.
In the wild, slop is the endless stream of generic, low-effort web content and weirdly proportioned AI images. But in corporate learning, L&D slop is far more insidious. It is the learning asset that looks instructionally sound, features beautiful formatting, and includes a neat 10-question quiz, but is hollow, superficial, or subtly incorrect. It is active listening training that merely tells learners to "nod and maintain eye contact" without addressing any real-world behavioral nuance.
Content
If we aren't careful, L&D departments risk becoming high-speed engines of slop, churning out unteachable, non-compliant, or wildly off-brand material faster than we ever could before.
If we aren't careful, L&D departments risk becoming high-speed engines of slop, churning out unteachable, non-compliant, or wildly off-brand material faster than we ever could before.
Content
To survive this shift, we must change the conversation. We need to stop asking if AI can write our training and start teaching our teams how to police what goes in, verify what comes out, and hold the line on quality.
To survive this shift, we must change the conversation. We need to stop asking if AI can write our training and start teaching our teams how to police what goes in, verify what comes out, and hold the line on quality.
The "Eager Intern" and the Slot Machine Mindset
Content
As we integrate AI into our daily workflows, we are making a fundamental management error. We are treating the tool like an oracle. We should be treating it like an eager, hyper-fast, but deeply unreliable intern.
As we integrate AI into our daily workflows, we are making a fundamental management error. We are treating the tool like an oracle. We should be treating it like an eager, hyper-fast, but deeply unreliable intern.
Content
Imagine hiring an intern who can draft a 10,000-word training manual in three seconds but has a known habit of confidently making up company policies when they get tired. You wouldn’t ship their draft directly to your learners without reading it. Yet this is exactly what happens when L&D teams adopt a slot machine mindset.
Imagine hiring an intern who can draft a 10,000-word training manual in three seconds but has a known habit of confidently making up company policies when they get tired. You wouldn’t ship their draft directly to your learners without reading it. Yet this is exactly what happens when L&D teams adopt a slot machine mindset.
Content
We pull the prompt lever, glance at the output, and if we don’t like it, we pull the lever again, hoping for a better result.
We pull the prompt lever, glance at the output, and if we don’t like it, we pull the lever again, hoping for a better result.
Content
This trial-and-error approach guarantees slop. Because AI is a mirror of its inputs, a loose prompt or an unverified source guarantees a superficial learning experience. If we treat AI as a magic box that delivers finished work, we surrender our editorial standards. We must treat whatever the AI produces as a raw, highly unverified first draft, one that nobody on the team lets through to the next stage without rigorous inspection.
This trial-and-error approach guarantees slop. Because AI is a mirror of its inputs, a loose prompt or an unverified source guarantees a superficial learning experience. If we treat AI as a magic box that delivers finished work, we surrender our editorial standards. We must treat whatever the AI produces as a raw, highly unverified first draft, one that nobody on the team lets through to the next stage without rigorous inspection.
The Human-AI-Human (H-AI-H) Loop
Content
To break the slot machine habit, we must redesign how we work. The solution is not to lock AI out, but to wrap it in a strict Human-AI-Human (H-AI-H) loop.
To break the slot machine habit, we must redesign how we work. The solution is not to lock AI out, but to wrap it in a strict Human-AI-Human (H-AI-H) loop.
Content
This workflow establishes a non-negotiable boundary: the process must always begin with human expertise and must always end with human accountability.
This workflow establishes a non-negotiable boundary: the process must always begin with human expertise and must always end with human accountability.
Content
In an H-AI-H model, the human designer sets the target, curates the raw source material, and writes the prompts. The AI occupies only the middle layer of the workflow, acting as an engine of translation and speed. Then, the process immediately loops back to the human designer, who acts as the editor, fact-checker, and final arbiter of quality.
In an H-AI-H model, the human designer sets the target, curates the raw source material, and writes the prompts. The AI occupies only the middle layer of the workflow, acting as an engine of translation and speed. Then, the process immediately loops back to the human designer, who acts as the editor, fact-checker, and final arbiter of quality.
Content
True quality assurance in an AI-assisted workflow does not start at the end of the process. It is baked into this loop as a repeatable system. To build a pipeline that filters out the slop, we must train our instructional designers to guard three distinct editorial gates within this H-AI-H framework.
True quality assurance in an AI-assisted workflow does not start at the end of the process. It is baked into this loop as a repeatable system. To build a pipeline that filters out the slop, we must train our instructional designers to guard three distinct editorial gates within this H-AI-H framework.
Gate 1: Input Control (Garbage In, Slop Out)
Content
Quality output requires pristine source material and rigid constraints. This is the first "Human" stage of the loop. Instead of letting AI hallucinate based on its general web training, designers must anchor the tool to verified, proprietary source material, such as SME interview transcripts, internal playbooks, or actual policy documents. Controlling the input means establishing:
Quality output requires pristine source material and rigid constraints. This is the first "Human" stage of the loop. Instead of letting AI hallucinate based on its general web training, designers must anchor the tool to verified, proprietary source material, such as SME interview transcripts, internal playbooks, or actual policy documents. Controlling the input means establishing:
Content
Strict boundaries: "Only use the provided PDF; do not assume external facts."
Strict boundaries: "Only use the provided PDF; do not assume external facts."
Content
Defined personas: "Write from the perspective of a veteran operations manager, not an academic."
Defined personas: "Write from the perspective of a veteran operations manager, not an academic."
Content
Explicit constraints: "Do not use passive voice or generic corporate jargon."
Explicit constraints: "Do not use passive voice or generic corporate jargon."
Gate 2: The Structural Audit (Is It Actually Learning?)
Content
Once the AI draft is generated, the designer must transition from creator to editor-in-chief. This gate is where we screen for structural slop. We run the draft against an objective rubric:
Once the AI draft is generated, the designer must transition from creator to editor-in-chief. This gate is where we screen for structural slop. We run the draft against an objective rubric:
Content
The Medium Check: Is a traditional course even what the business needs here, or should this AI-generated output be packaged as real-time performance support embedded directly in the workflow?
The Medium Check: Is a traditional course even what the business needs here, or should this AI-generated output be packaged as real-time performance support embedded directly in the workflow?
Content
The Pedagogical Flow: Is the sequencing pedagogically sound, or is this just a fancy, AI-generated bulleted list?
The Pedagogical Flow: Is the sequencing pedagogically sound, or is this just a fancy, AI-generated bulleted list?
Content
The Scenario Test: Are the scenarios realistic, or are they cartoonish caricatures of workplace conflict?
The Scenario Test: Are the scenarios realistic, or are they cartoonish caricatures of workplace conflict?
Content
The Evaluation Check: Does the assessment test true decision-making, or just low-level memorization?
The Evaluation Check: Does the assessment test true decision-making, or just low-level memorization?
Gate 3: Ground-Truth Verification (Confirming Every Fact)
Content
AI is confidently wrong. It can invent case studies, misquote policies, or hallucinate technical safety steps with absolute, persuasive authority. Before any asset ships, every single claim, step, metric, and compliance reference must be manually verified by a human eye. This is the final "Human" anchor of the loop. If the AI claims "Section 4.2 of the manual states X," the designer must physically open the manual and verify Section 4.2.
AI is confidently wrong. It can invent case studies, misquote policies, or hallucinate technical safety steps with absolute, persuasive authority. Before any asset ships, every single claim, step, metric, and compliance reference must be manually verified by a human eye. This is the final "Human" anchor of the loop. If the AI claims "Section 4.2 of the manual states X," the designer must physically open the manual and verify Section 4.2.
Operational Consistency Over Individual "Prompt Hacks"
Content
To scale this across an enterprise L&D organization, we must move past teaching prompt engineering as an isolated trick. Individual prompt hacks do not build world-class departments.
To scale this across an enterprise L&D organization, we must move past teaching prompt engineering as an isolated trick. Individual prompt hacks do not build world-class departments.
Content
Instead, our teams need a repeatable, standardized system.
Instead, our teams need a repeatable, standardized system.
Content
Whether a designer is working on leadership development in New York or safety compliance in Munich, they should follow a shared operational pipeline. They must know how to take raw, messy source data and shepherd it through an H-AI-H workflow that produces content that:
Whether a designer is working on leadership development in New York or safety compliance in Munich, they should follow a shared operational pipeline. They must know how to take raw, messy source data and shepherd it through an H-AI-H workflow that produces content that:
Content
A reviewer can easily inspect because the lineage of the raw source data is clear.
A reviewer can easily inspect because the lineage of the raw source data is clear.
Content
A compliance colleague can trust because every factual claim is mapped back to its primary source.
A compliance colleague can trust because every factual claim is mapped back to its primary source.
Content
The next designer can pick up without guesswork because the prompts, context, and system instructions are fully documented.
The next designer can pick up without guesswork because the prompts, context, and system instructions are fully documented.
Content
When everyone uses the same quality standards and shared tools, consistency holds, even when different designers are working on completely different projects.
When everyone uses the same quality standards and shared tools, consistency holds, even when different designers are working on completely different projects.
From Content Creators to Enterprise AI Coaches
Content
We cannot keep this H-AI-H methodology locked inside the L&D department.
We cannot keep this H-AI-H methodology locked inside the L&D department.
Content
Right now, every single business unit in your organization is pulling the generative AI slot machine. Sales teams are churning out AI-generated customer pitch decks, marketing is flooding the internal intranet, and operations is drafting questionable technical manuals. Everyone is drowning in their own version of slop.
Right now, every single business unit in your organization is pulling the generative AI slot machine. Sales teams are churning out AI-generated customer pitch decks, marketing is flooding the internal intranet, and operations is drafting questionable technical manuals. Everyone is drowning in their own version of slop.
Content
This is L&D's moment to lead. Our mandate is not just to build better training assets, but to build organizational capability and digital literacy.
This is L&D's moment to lead. Our mandate is not just to build better training assets, but to build organizational capability and digital literacy.
Content
By teaching the H-AI-H framework to the rest of the business, we teach our organizations how to build critical thinking and quality control into their everyday AI usage. We step out of the traditional "course order-taker" role and become the strategic partner that guides the enterprise through the AI workforce transition.
By teaching the H-AI-H framework to the rest of the business, we teach our organizations how to build critical thinking and quality control into their everyday AI usage. We step out of the traditional "course order-taker" role and become the strategic partner that guides the enterprise through the AI workforce transition.
Efficiency Is a Side Effect, Not the Strategy
Content
Many business leaders approach AI integration looking strictly at speed metrics. They want to know if we can build training modules 50 percent faster.
Many business leaders approach AI integration looking strictly at speed metrics. They want to know if we can build training modules 50 percent faster.
Content
But if you optimize purely for speed, you end up fast-tracking garbage.
But if you optimize purely for speed, you end up fast-tracking garbage.
Content
The efficiency gains we see from AI are a welcome side effect of doing the work properly. They are not the primary goal. When we train our people to be rigorous editors and critical inspectors first, the speed naturally follows. Why? Because we spend far less time fixing broken, off-brand, and hallucinated learning experiences downstream.
The efficiency gains we see from AI are a welcome side effect of doing the work properly. They are not the primary goal. When we train our people to be rigorous editors and critical inspectors first, the speed naturally follows. Why? Because we spend far less time fixing broken, off-brand, and hallucinated learning experiences downstream.
The Final Signature Stays With You
Content
Generative AI is a powerful assistant, but it is entirely devoid of professional accountability. It cannot be held responsible for a compliance failure, an ineffective learning experience, or a reputational mistake.
Generative AI is a powerful assistant, but it is entirely devoid of professional accountability. It cannot be held responsible for a compliance failure, an ineffective learning experience, or a reputational mistake.
Content
The final signature must always belong to a person.
The final signature must always belong to a person.
Content
By upgrading our teams from simple content creators to rigorous content curators, QA leads, and organizational AI coaches, we protect our organizational standards. We ensure that our learners still receive world-class performance support, and that we control the technology, rather than letting its limitations control us.
By upgrading our teams from simple content creators to rigorous content curators, QA leads, and organizational AI coaches, we protect our organizational standards. We ensure that our learners still receive world-class performance support, and that we control the technology, rather than letting its limitations control us.
View Courses Recommended for You