Capture Elusive Level 3 Data: The Secrets of Survey Design

Session 5A: Breakout
Ken Phililps
22 Feb 2018
10:30 am - 11:30 am
TBD

Capture Elusive Level 3 Data: The Secrets of Survey Design

To establish real credibility and prove value, L&D professionals need to measure whether or not participants actually applied what they learned in a training program back on the job (Level 3 evaluation). Unfortunately, measuring on-the-job behavior change is not something many L&D professionals have much experience with nor do very well.

Join Ken in this session and examine some Level 3 evaluation facts taken from a recent ATD research study that show while Level 3 evaluations are not used extensively, organizations that do use them regard the data they collect to have either high or very high value. Ken also will point out the common mistakes made by many L&D professionals when creating Level 3 participant surveys, and will share with you 12 tips and best practices for overcoming these mistakes. The mistakes fall into three areas: content – the survey items themselves, format—the way the survey is laid out, and measurement – the measurement scale used with the survey items.

In this session, you will learn:

  • Key statistics you can use to gain insight and benchmark what your organization is doing regarding Level 3 evaluations compared with other organizations
  • The most common mistakes made by many L&D professionals when creating Level 3 participant surveys which result in the collection of misleading or invalid data
  • Practical tips and techniques for overcoming mistakes and capturing data that demonstrates whether or not participants are actually apply what they learned in a training program back on the job