Recommendation: To improve the awareness of how risk-significant radioactive sources are transported within the United States and to better determine whether Nuclear Regulatory Commission (NRC) is meeting its goal of providing reasonable assurance for preventing the theft or diversion of these dangerous materials, the Chairman of NRC should take actions to collect information from licensees on the number of shipments and mode of transport for such sources--for example, by identifying the extent to which an existing NRC database (e.g., the National Source Tracking System) may be used to capture this information.

Agency: Nuclear Regulatory Commission
Status: Open

Comments: In its February 26, 2018 report to Congress on actions NRC has taken in response to GAO recommendations, NRC continued to disagree with the recommendation to expand its existing data collection requirements or to transition such information from its existing NRC databases to the NSTS. NRC stated that, as required by 10 CFR Part 37, "Physical Protection of Category 1 and Category 2 Quantities of Radioactive Material," the NRC currently collects the number of shipments and mode of transport for domestic transfers, and the import and export of Category 1 quantities of radioactive material. Additionally, under the provisions of 10 CFR Part 110, "Export and Import of Nuclear Material," the NRC stated that it collects the number of shipments and mode of transport for the import and export of shipments containing Category 2 or higher quantities of radioactive material. The NRC stated that it is the agency's position that the current information collected provides the NRC with an understanding of the potential modes of transport for Category 1 and 2 quantities of radioactive material and existing regulatory requirements provide robust protection for all such modes. The NRC stated that it does not consider the proposed additional information collection activity to be of sufficient safety or security benefit to justify the associated regulatory actions it would require. In August 2019, and again in August 2020, the NRC reaffirmed its disagreement with this recommendation and that it did not intend to take action to implement it. Despite its disagreement with this recommendation, we will continue to monitor whether NRC takes any actions that would result in addressing the concern GAO raised.

Recommendation: To determine whether CSA interventions influence motor carrier safety performance, the Secretary of Transportation should direct the FMCSA Administrator to identify and implement, as appropriate, methods to evaluate the effectiveness of individual intervention types or common intervention patterns to obtain more complete, appropriate, and accurate information on the effectiveness of interventions in improving motor carrier safety performance. In identifying and implementing appropriate methods, FMCSA should incorporate accepted practices for designing program effectiveness evaluations, including practices that would enable FMCSA to more confidently attribute changes in carriers' safety behavior to CSA interventions.

Agency: Department of Transportation
Status: Open

Comments: FMCSA has reviewed the methodology for its effectiveness model and identified many of the same limitations GAO discussed in its report. FMCSA also identified several approaches to address these limitations, including modifying its model to measure individual intervention types. However, as of July 2020, FMCSA had not implemented any of its proposed approaches.

Recommendation: To enable FMCSA management to monitor the agency's progress in achieving its effectiveness and efficiency outcomes for CSA interventions and balance priorities, the Secretary of Transportation should direct the FMCSA Administrator to establish and use performance measures to regularly monitor progress toward both FMCSA's effectiveness outcome and its efficiency outcome.

Agency: Department of Transportation
Status: Open

Comments: The Federal Motor Carrier Safety Administration (FMCSA) plans to establish an inventory of effectiveness and efficiency measures and monitor performance on an ongoing basis. FMCSA is working to modify its model to measure the effectiveness of individual intervention types. However, as of July 2020, it had not implemented any of its proposed modifications.

Recommendation: Congress may wish to consider directing DOT to study and provide a report to Congress identifying approaches for extracting, storing, and analyzing electronically collected motor carrier drivers' schedule data, including the potential benefits, privacy, and cost concerns, and options for how such concerns could be mitigated.

Agency: Congress
Status: Open

Comments: As of March 2020, Congress has taken no action to direct DOT to study this matter.

Recommendation: To improve the CSA program, the Secretary of Transportation should direct the FMCSA Administrator to revise the SMS methodology to better account for limitations in drawing comparisons of safety performance information across carriers; in doing so, the Secretary of Transportation should direct the FMCSA Administrator to conduct a formal analysis that specifically identifies: (1) limitations in the data used to calculate SMS scores including variability in the carrier population and the quality and quantity of data available for carrier safety performance assessments, and (2) limitations in the resulting SMS scores including their precision, confidence, and reliability for the purposes for which they are used.

Agency: Department of Transportation
Status: Open
Priority recommendation

Comments: FMCSA did not agree with our recommendation, disputing the methodology and conclusions in our report. However, we continue to believe that addressing Safety Measurement System (SMS) methodology limitations has merit and could help the agency better target FMCSA's resources to the carriers that pose the highest risk of crashing. For example, we found FMCSA requires a minimum level of information for a carrier to receive an SMS score; however, this requirement is not strong enough to produce sufficiently reliable scores. As a result, FMCSA identified many carriers as high risk that were not later involved in a crash, potentially causing FMCSA to miss opportunities to intervene with higher risk carriers. To fully implement this recommendation, FMCSA should revise SMS methodology to account for data limitations that limit comparisons so that the FMCSA is better positioned to identify and mitigate carriers that pose the greatest safety risks. FMCSA has recently developed and tested a new methodological approach that could potentially account for the limitations we identified. While FMCSA has not yet committed to deploying the new methodology, they hope to do so some time in 2020.

Recommendation: To improve the CSA program, the Secretary of Transportation should direct the FMCSA Administrator to ensure that any determination of a carrier's fitness to operate properly accounts for limitations we have identified regarding safety performance information.

Agency: Department of Transportation
Status: Open

Comments: The Federal Motor Carrier Safety Administration (FMCSA) agreed with the basic principles that GAO addressed in this area, but disagreed with GAO's characterization of FMCSA's proposed Safety Fitness Determination (SFD) rule. In January 2016, FMCSA issued a notice of proposed rulemaking (NPRM), which proposed a revised methodology for issuance of a safety fitness determination for motor carriers. Specifically, the new methodology would have determined when a motor carrier is not fit to operate commercial motor vehicles in or affecting interstate commerce based on the carrier's on-road safety data; an investigation; or a combination of both. However, in July 2018, in part due to a review of SMS by the National Academies of Science congressionally mandated evaluation of SMS, FMCSA announced that the enhancements previously proposed will not be completed.