Agencies Included Key Elements of Cost-Benefit Analysis, but Explanations of Regulations' Significance Could Be More Transparent [Reissued on September 12, 2014]
GAO-14-714: Published: Sep 11, 2014. Publicly Released: Sep 11, 2014.
- Highlights Page:
- Full Report:
- Accessible Text:
What GAO Found
How often and to what extent agencies included selected key elements of cost-benefit analysis varied by rule type. The selected key elements in GAO's review are a statement of purpose; monetized or quantified costs and benefits or a qualitative discussion of them; and a discussion of alternatives. The 203 rules GAO reviewed are categorized into three broad, nonmutually exclusive categories—major, economically significant, and significant rules—based in part on their likely economic effects. Between July 1, 2011, and June 30, 2013, agencies included the selected key elements in the majority of the economically significant and major rules and less often in significant rules. Agencies sometimes included these key elements even when they may not have been required to do so. The results of GAO's review of agencies' regulatory cost-benefit analyses for these rules are as follows:
Statement of purpose : A statement of purpose provides the underlying reason for the rule. Agencies included this element in all rules.
Costs and benefits : Monetizing costs and benefits allows decision makers to evaluate different regulatory options using a common measure. Agencies included a mix of monetized and quantified costs and benefits and qualitative discussions of costs and benefits in most economically significant and major rules, but less often in significant rules. Almost all economically significant rules contained some monetized costs, as did most major rules and some significant rules. Many agency officials said they try to monetize costs and benefits whenever possible, regardless of rule type; however, monetizing benefits can be more difficult than monetizing costs. For example, officials said it is challenging to estimate the value of enhancing national security. Agency officials said that obtaining sufficient or quality data is a primary challenge to cost-benefit analysis.
Alternatives : Analyzing alternatives helps agencies to decide on the best regulatory approach. Agencies identified alternatives in most economically significant and major rules and in some significant rules. Agencies said they sometimes do not identify alternatives because the statute requiring the rule is so specific that considering alternatives is not a practical use of resources.
Agencies included a discussion of how they assessed the data quality more often in economically significant rules than in significant or major rules. Agencies used various methods to assess the data, depending on the type and use of the data. For example, agencies used the peer review process to help ensure science-driven data were the most current and appropriate data available. Only three of the seventeen agencies that participated in GAO's roundtables reported reevaluating cost-benefit analyses once a rule had been issued.
GAO's review also found that for the majority of the 109 significant rules reviewed, the rulemaking process is not as transparent as it could be. This is because 72 percent of these rules included no language to explain why the rule was designated as significant. Some agency officials indicated that the Office of Management and Budget's Office of Information and Regulatory Affairs did not always provide a reason for changing a rule's designation to significant. The rulemaking process could be more transparent if significance designations were explained and communicated.
Why GAO Did This Study
Federal agencies issue thousands of regulations each year to achieve national goals. For the few hundred of these rules deemed to be significant, agencies are required to assess expected costs and benefits. For the subset of these rules estimated to have the greatest economic impact, agencies must also include an assessment of alternatives.
GAO was asked to review agencies' compliance with broadly applicable directives and guidance related to significant federal rulemaking. This report addresses (1) how often and to what extent significant, economically significant, and major rules include key elements for assessing or analyzing benefits and costs; and (2) how and to what extent agencies assess the quality of the scientific, technical, and other types of data they use to consider benefits and costs. To answer these objectives, GAO reviewed a generalizable sample of 109 significant and 57 economically significant rules issued by executive agencies and all 37 major rules issued by independent agencies and published in the Federal Register from July 1, 2011, to June 30, 2013. GAO also conducted roundtable discussions with the 17 executive and independent agencies with the largest number of rules in GAO's sample.
What GAO Recommends
To improve the transparency of the rulemaking process, GAO recommends the Office of Management and Budget (OMB) work with agencies to clearly communicate why certain rules are designated as significant. OMB staff did not state whether they agreed or disagreed with the recommendation.
For more information, contact Michelle Sager at (202) 512-6806 or firstname.lastname@example.org.
Recommendations for Executive Action
Comments: In a May 14, 2015 letter to the Chairman of the Senate Committee on Homeland Security and Governmental Affairs, the Director of OMB stated that nothing in the Executive Order 12866 prevents agencies from identifying the particular relevant definition of significance in rules, and that some rules do contain this information. The letter also stated that OMB believes it is appropriate to leave agencies flexibility in how they comply with Executive Order 12866, since such specific procedures for including such information is not a requirement of the Executive Order itself. However, in written comments submitted to GAO in March 2020, OMB stated that there are numerous examples from the past few years of agencies clearly identifying in the preambles of significant regulations the applicable section(s) of EO 12866's significance definition. OMB further stated that it encourages agencies to continue and expand this practice, especially where doing so has been found to improve agency planning for the regulatory process or to otherwise enhance decision-making. However, as of March 1, 2021, OMB has not provided documentation of its efforts. When we can further confirm that OMB has taken steps to encourage agencies to include this information in rules, we will provide an update.
Recommendation: To improve transparency in the rulemaking process, provide agencies and the public with information on why regulations are considered to be significant regulatory actions, and promote consistency in the designation of rules as significant regulatory actions, the Director of the Office of Management and Budget should work with agencies to clearly communicate the reasons for designating a regulation as a significant regulatory action. Specifically, OMB should encourage agencies to clearly state in the preamble of final significant regulations the section of Executive Order 12866's definition of a significant regulatory action that applies to the regulation.
Agency Affected: Executive Office of the President: Office of Management and Budget
Status: Closed - Implemented
Comments: On May 6, 2015, the Deputy Administrator of OIRA issued a memo to all OIRA staff, directing staff to always clearly explain the reasons why OIRA has determined a particular rule is to be categorized as significant. The memo further stated that doing so is especially important when the rulemaking agency has suggested that the rule is not significant under the relevant Executive Order, but OIRA determines the rule to be significant and subject to interagency review.
Recommendation: To improve transparency in the rulemaking process, provide agencies and the public with information on why regulations are considered to be significant regulatory actions, and promote consistency in the designation of rules as significant regulatory actions, the Director of the Office of Management and Budget should work with agencies to clearly communicate the reasons for designating a regulation as a significant regulatory action. Specifically, OMB should explain its reason for any changes to an agency's initial assessment of a regulation as non-significant.
Agency Affected: Executive Office of the President: Office of Management and Budget