Test Design and Delivery Certificate

Planning the Test
Addressing Legal Considerations
Employment Laws
Best Practices
Developing the Testing Plan
Establishing Validity
Methods of Establishing Validity
Identifying Content Areas to Test
Determining the Number of Test Items
Time Examinees Need to Respond to Items
Weighting the Test Content Areas
Identifying Benefits and Challenges of Delivery Methods
Categories of Item Types
Pros and Cons of Item Formats

Creating the Test Items
Anatomy of a Multiple-Choice Item
General Guidelines for Item Construction
Constructing the Item Stem
Constructing the Options
Practice Reviewing Items
Visuals
Additional Ideas
Reviewing for Good Item-Writing Principles
Using Item Shells
Increasing the Cognitive Level
Verbs Associated with Cognitive Levels
What Level is Required?
Avoiding Bias
Avoiding Stereotyping
Providing Rationales for Items
Justifying the Answer Key
Linking the Item Content to the Test Content Outline

Creating the Test Form
Developing Test Directions
Test Directions Checklist
Writing Administrator Directions
Test Administrator Directions Checklist
Complying with the Americans with Disabilities Act
Avoiding National Origin Discrimination
Allocating Sufficient Time
Using an Item Bank
Using Item Banks for Test Assembly
Item Formatting, Sequencing, and Page Layout
Setting Passing Standards
Using the Angoff Method

Delivering the Test
Ensuring Test Security
Establishing Test–Retest Policies
Controlling Item Exposure
Limiting Opportunities for Cheating

Evaluating the Test
Using Item-Level Data to Improve Item Quality
Item Analysis
Interpreting Item-Analysis Data
Practice Interpreting Item-Analysis Data
Using Test-Level Data to Improve Test Quality
Types of Reliability
Developing Rater Training
Conducting Rater Training
Calculating Reliability Using KR-20
Calculating Reliability through Mastery Classification Consistency
Validity of Test Scores
Documenting the Test Development and Design Process
Communicating the Test Results
Instructions for Interpretation

• Develop a test content outline and understand its value to the testing process.

• Identify the hallmarks of a good test question, and apply them to developing and evaluating test questions.

• Develop test forms including writing directions for examinees, page layout, and item sequencing.

• Use item analysis to identify and correct problem items.

• Use professionally accepted methods for setting a passing score for a test.

• Determine the appropriate mode of delivery, what score reports are needed, and who should have access to score reports.

• Evaluate a test to determine if the individual items and the overall test are functioning properly.

• Gain a systematic approach for developing and administering tests that will meet your organization’s needs and follow professional standards.

• Develop tests that do not put your organization in legal jeopardy.

• Become knowledgeable in testing best practices to increase your credibility within your organization.

This program is designed for learning professionals who want a systematic approach for developing tests.

ATD Education programs are designed primarily for learning professionals—trainers, instructional designers, and organizational development practitioners—but also greatly benefit anyone within an organization who is responsible for developing others, from managers to human resources specialists.

Additional information to help you prepare for your program:

• Completion Requirements: Review the attendance policy before your course begins to ensure your successful completion.

• Technical Requirements: Ensure your tech is ready for the first day of your program.

• Enrolled in a program? To check your course status and enrollment details, launch your course, or download your certificate, go to MyATD.

• Terms and Privacy: Review our cancellation policy, health protocols for in-person courses, and more.

• Have additional questions about ATD courses? Visit our ATD Education FAQ for answers.