Two weeks ago we shared with you an article by Jim Kirkpatrick about your "training defaults". He defines these as hard-wired behaviors that have become habits, but may not lead to the highest level of results. These are things we do automatically without considering if they are outdated or less effective than other options.

During workshops, we frequently ask participants, "What is the most common way to conduct Level 1 evaluation?" Invariably the response is, "Give the participants a smile sheet immediately after the program."

Indeed, a written survey is the most common, nearly exclusive Level 1 evaluation practice. Unfortunately it is also often inadequate to obtain the most useful Level 1 information.

Consider these other options to measure Level 1:

• Have your "fingers on the pulse" (formative evaluation) during the course, in addition to afterwards. Be aware of participant body language and level of involvement to see if people are with you. If they are not, you can do something about it right away and hopefully correct the problem. For online programs, ask polling questions within or at the end of each module to maintain participant attention.

• Use a trained observer in class to note how participants are reacting to various modules and activities. This is a costly option best reserved for pilots and major initiatives.

• Have a colleague conduct a focus group or one-on-one interviews after the program to gather important information that will likely not surface with even the best survey questions. Strongly consider this with pilot programs and when survey data indicates potential problems.

Read the original article.