FMCSA: Independent evaluation shows CSA works better, needs tweaks

user-gravatar Headshot

The Federal Motor Carrier Safety Administration on Wednesday, Aug. 31, announced that an independent evaluation of the agency’s Compliance Safety Accountability program’s operational model test confirm that CSA substantially improves the agency’s enforcement and compliance model.

FMCSA says the results of the University of Michigan Transportation Research Institute’s findings confirm that the CSA model enables the agency and its state partners to contact more commercial motor carriers earlier to correct safety problems and ensure compliance with safety regulations in order to reduce crashes, injuries and fatalities related to commercial motor vehicles. However, FMCSA says the evaluator also identified some areas that require improvement and that it is committed to a continuous improvement process for the program.

Launched in 2008, the CSA op-model test divided motor carriers from four test states – Colorado, Georgia, Missouri and New Jersey – between test and control groups. FMCSA says UMTRI evaluated the effectiveness of the new Safety Measurement System and CSA interventions, compared the cost and efficiency of the CSA compliance and enforcement model to the previous model, and found effectiveness and efficiency gains that fully support the ongoing national implementation of CSA.

FMCSA added additional states – Delaware, Kansas, Maryland, Minnesota and Montana – to the test to demonstrate full implementation challenges and to provide a validation dataset for evaluation purposes. FMCSA says that according to UMTRI’s study, CSA’s SMS better identifies motor carriers for safety interventions than the previous SafeStat system:
• The results showed that the SMS is an improvement over the SafeStat system in identifying unsafe carriers;
• Crash rates were higher for motor carriers identified with safety problems in the SMS’s seven Behavior Analysis and Safety Improvement Categories (BASICs) than for motor carriers that were not identified with safety problems in the seven BASICs; and
• The crash rate for motor carriers that were identified with safety problems by the SMS in the Unsafe Driving BASIC was more than three times greater than the crash rate for motor carriers not identified with any safety problems by SMS.

Partner Insights
Information to advance your business from industry suppliers

FMCSA says UMTRI’s study also determined that CSA interventions are effective in improving motor carriers’ safety behavior:
• The effect of the warning letter intervention is likely one of the most significant findings in this evaluation. Twelve months after receiving a warning letter, SMS results showed that 83 percent of test carriers had resolved identified safety problems, and only 17 percent continued to have safety problems; and
• The new CSA Onsite Focused Investigations proved to be effective. Almost 20 percent fewer motor carriers continued to show safety problems 12 months after an onsite focused investigation, as compared with those receiving traditional compliance reviews.

FMCSA says UMTRI’s study also determined that CSA interventions use enforcement resources efficiently:
• More intensive interventions were used on carriers that exhibited higher crash risk, confirming that the rules guiding intervention selection are operating to ensure effective and efficient safety interventions;
• Warning letters, which were found to be effective in improving safety behavior, had only a nominal cost;
• CSA Onsite Focused Investigations cost about 53 percent less than CRs and were effective in producing compliance; and
• The average cost of CSA interventions was $754 per motor carrier as compared to $1,438 for motor carriers receiving CRs.

FMCSA says that according to UMTRI’s study, CSA reaches more carriers to improve safety compliance:
• CSA interventions contact about three times the number of motor carriers contacted using the previous model which relied primarily on CRs; and
• Among the CSA test group, the annual percentage of motor carriers contacted was 9.9 percent, compared with the 3.2 percent of motor carriers that received full CRs in 2009.

However, UMTRI’s study found that SMS’s BASICs are significantly related to underlying motor carrier safety, although the Cargo-Related and Driver Fitness BASICs show a weaker relationship to crash risk:
• The evaluator’s findings are in line with FMCSA’s effectiveness findings, and as a result, at the end of the op-model test, FMCSA adjusted how it identifies motor carriers for intervention to ensure BASICs with the strongest relationship to future crashes receive the most emphasis. However, FMCSA continues to address motor carriers with patterns of noncompliance in the Cargo-Related and Driver Fitness BASICs, which include carrier requirements for being properly licensed, carrying medical cards to allow verification that a driver meets the medical qualification standards, adequately securing cargo and properly packaging and handling hazardous materials; and
• As part of its ongoing commitment to continually assess and improve the SMS, FMCSA has a study under way that may result in improvements to some BASICs, with particular effect on the Cargo-Related BASIC.

UMTRI’s study also found lag time in measureable safety performance improvement after CSA investigations, and for carriers with the most serious safety problems, improvement rates were similar to those of the control group:
• FMCSA expects the upcoming safety fitness determination rulemaking to accelerate return to compliance or removal from service for motor carriers with the worst safety problems; and
• Based on lessons learned in the op-model test, FMCSA improved the CSA investigative process and training in the safety management cycle for its federal and state partner investigators. The agency says the enhanced investigative process allows investigators to systematically identify motor carriers’ safety problems and to recommend remedies to help carriers to quickly become safer.