A new industry white paper by Luma demonstrates how to evaluate and improve driver training.Luma “Brighter Learning,” an instructional design company, has published an industry white paper that delineates a proven method to assess the effectiveness of driver training programs.
The white paper is based on Kirkpatrick’s Four Levels of Evaluation, a model used in teaching and learning fields to show the business value and worth of training. The four levels of the model in ascending order are Reaction, Learning, Behavior and Results.
Luma advises motor carriers to start with the end in mind, at Level 4, and establish goals for training such as making it be more efficient and relevant to their drivers. Moving to Level 3, a carrier decides what behaviors it wants to change and how it wants drivers to perform back on the job.
These decisions inform the learning objectives of Level 2, where training content is aligned with the desired results. Subsequently, the learning preferences of drivers are considered in Level 1 to tailor the training content and media to their likes.
“Most evaluation happens once the training is over, but it is important to keep in mind that you can gather information from beginning to end on all four levels to help provide a comprehensive picture of your training results,” said Gina Anderson, Ed.D., chief executive officer of Luma.
Evaluating DRIVE FIRST
The white paper concludes with an in-depth case study of the Kirkpatrick model applied to assess Luma’s DRIVE FIRST online driver orientation training platform. DRIVE FIRST is a learning management system with a collection of eNugget learning modules on relevant training topics for new hire orientation.
Luma develops the eNugget modules using the proprietary E2A Instructional Model. “E2A” stands for Engagement, Efficiency and Authenticity. The learning principles of E2A are grounded in peer-reviewed research and have been used by Luma during the past 20 years for its products and clients in trucking and other industries.
To download the free white paper, click on the link at the end of the article.With DRIVE FIRST’s real-time analytics, feedback loops and ongoing surveys, Luma and its clients are able to evaluate and customize the training content to achieve desired results in all levels of the Kirkpatrick model.
The white paper includes feedback data received by more than 25,000 drivers that completed eNugget training. The white paper demonstrates how Luma and its motor carrier clients use real-time analytics and feedback to evaluate, improve and customize the training based on the E2A model. Key points are summarized below:
Engagement:
The training content of DRIVE FIRST is informed by user and client feedback and relevant industry topics. Additionally, DRIVE FIRST uses rewards and other gamification features to increase engagement. To date, more than 126,200 rewards have been issued. Motor carriers are using the rewards to provide gift cards and internal awards to drivers based on the points users earn.
“Our data show users are engaged, and the format helps improve retention of content over an expanded amount of time with repeated exposure to the eNuggets,” Anderson said.
Efficiency:
The eNugget modules are designed to be completed quickly and maximize learning. The average max time to complete a module is 9.43 minutes. Successful completion requires more interaction than passively watching a video. The time is spent reading, listening, playing, and clicking. Users generally score excellent or good on the assessments the first time.
Drivers also use the DRIVE FIRST platform as a reference tool after orientation. The data show 79% percent of drivers return to the platform and 58% come back four or more times.
Authenticity:
The DRIVE FIRST platform allows motor carriers to customize training content for an authentic learning experience. Administrators can also break up content and deliver it to different user groups with specific roles and job functions.
Authenticity also comes from a variety of content types that include text, audio, images, games, animations, video and interactive drag-and-drop features.
On average, drivers give the eNuggets a 4.41 rating out of a 5-point scale.
To download a free copy of the whitepaper, “Modernize Your Orientation and See Results: A Framework for Assessing Training Effectiveness,” click here.
The latest white paper is a follow-up to Luma’s 2018 publication, “One-Size Orientation Fits All? Our Brain Doesn’t Say So!” that provides guidelines for motor carriers to implement E2A methods in their organizations for driver orientations and trainings. To download this white paper, click here.
