Organizational Transformation:

Enterprise Architecture Value Needs to Be Measured and Reported

GAO-12-791: Published: Sep 26, 2012. Publicly Released: Sep 26, 2012.

Additional Materials:

Contact:

Carol Cha
(202) 512-3000
melvinv@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

Among the 27 agencies that GAO studied, all have fully or partially defined goals or purposes for their architectures, 11 have fully or partially established a method or metrics for measuring outcomes resulting from the use of their architectures, while 5 have fully or partially measured and reported outcomes and benefits.

Agencies cited a lack of guidance as a key reason why they have not established methods and metrics for measuring outcomes and benefits. Although the Office of Management and Budget (OMB) has issued recent enterprise architecture guidance to agencies, OMB has not yet provided sufficient details on the method and metrics that could be used to measure architecture program outcomes.

Why GAO Did This Study

According to OMB, the federal executive branch plans to spend at least $75 billion on information technology (IT) investments in fiscal year 2012. In response to a statute which mandates that GAO identify duplicative activities within federal agencies, GAO previously identified enterprise architecture as a mechanism for reducing duplication and overlap in investments. An architecture is a "blueprint" that describes how an organization operates in terms of business processes and technology, how it intends to operate in the future, and how it plans to transition to the future state. Knowing whether architecture outcomes are being achieved requires defining the architecture's goals, establishing a method and metrics to measure architecture outcomes, and periodically measuring and reporting these outcomes. To assess agencies' use of architecture as a mechanism for reducing duplication and overlap, GAO committed to determine the extent to which agencies are measuring and reporting architecture outcomes and benefits. To do this, GAO reviewed relevant documentation from 27 major federal agencies, reviewed the results of a GAO survey on the benefits of using architecture, and interviewed agency officials.

What GAO Recommends

GAO is making recommendations to the agencies and OMB to improve measurement and reporting of architecture outcomes. In commenting on a draft of this report, OMB and most of the agencies generally agreed with the findings and recommendations.

For more information, contact Valerie C. Melvin at (202) 512-6304 or melvinv@gao.gov.

Recommendations for Executive Action

  1. Status: Closed - Implemented

    Comments: The Department of Homeland Security has implemented this recommendation. Specifically, in March 2014 and May 2015, the Department submitted its Enterprise Roadmap to the Office of Management and Budget, which included outcome metrics to measure cost savings/avoidance gained from system consolidation and consolidating and sharing services through use of its architecture. In addition, in August 2016, it documented a method for measuring the cost savings.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Homeland Security

  2. Status: Open

    Comments: The Department of Agriculture has not implemented this recommendation. In January 2017, the department provided an action plan that indicated it would address the recommendation by November 2017.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Agriculture

  3. Status: Closed - Implemented

    Comments: The Department of Education has implemented this recommendation. We reported in September 2012 that the department had established a metric to measure the extent to which the ratio of spending on development, modernization, and enhancement increased relative to steady-state spending, through use of its enterprise architecture activities; however, we also reported that it had yet to establish a method to measure this metric. Since then, in its May 2014 Enterprise Modernization Roadmap, the Department documented the method used for measuring this metric.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Education

  4. Status: Open

    Comments: The Department of Commerce has not implemented this recommendation. We reported in September 2012 that the department had established metrics to measure and report outcomes associated with its enterprise architecture program, such as information technology cost savings, but it had yet to establish a method (i.e. steps to be followed) for measuring such outcomes. In April 2017, a department liaison reported that the Office of the Chief Information Officer had developed an initial draft of an enterprise architecture value measurement plan. However, as of August 2017, the department had not demonstrated that the plan had been finalized.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Commerce

  5. Status: Open

    Comments: As of August 2017, the Department of Defense had not addressed our recommendation for either of the department's enterprise architectures we reviewed in 2012. With respect to the DOD enterprise architecture, we reported in 2012 that, according to officials, DOD's approach to establishing a method and metrics for measuring enterprise architecture strategic mission value (outcomes and benefits) would be accomplished through the development and publication of a DOD instruction and an enterprise architecture management plan. In particular, DOD's June 2012 draft instruction on enterprise architecture called for establishing metrics for assessing the effectiveness of the enterprise architecture to provide information that contributes to mission effectiveness and efficiency. In addition, the draft Enterprise Architecture Management Plan called for the development of metrics to assess the use of enterprise architecture, provided examples of potential metrics, including reduction in redundancies in DOD's portfolio, and called for the development of baseline and target threshold values for each selected metric. The plan also stated that the DOD CIO and architecture organization were to determine the final set of metrics and threshold values based on the resources available to assess the metrics. However, according to a March 2016 memo from the Deputy Chief Information Officer for Information Enterprise to the DOD Inspector General, the department no longer planned to publish an instruction related to enterprise architecture and considered our recommendation closed. The memo also described structures and processes for developing, managing, and applying DOD's architecture that it said fulfilled what would have been the intent of a DOD instruction on enterprise architecture, including governance, requirements, acquisition, portfolio management, and budgeting. However, the memo did not discuss measuring architecture outcomes. With respect to its business enterprise architecture, in August 2016, the department stated that it did not have a systematic methodology for measuring the business value of its business enterprise architecture. Department officials noted that our July 2015 report "DOD Business Systems Modernization: Additional Action Needed to Achieve Intended Outcomes" (GAO-15-627) concluded that the business enterprise architecture has yielded limited value. The officials stated that internal department management assessments and component feedback supported these determinations. The department also stated that it used our report as a key method for measuring enterprise architecture outcomes and is acting on the results. Specifically, the department stated that senior management has directed changes to the department's Business Enterprise Architecture program. However, as of August 2017, the department had not provided documentation indicating that it planned to establish an approach for measuring business enterprise architecture outcomes. We will continue to follow up on the department's efforts to address this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense

  6. Status: Open

    Comments: As of August 2017, the Department of the Air Force had not implemented this recommendation. As of September 2016, the department reported architecture-related outcomes, to top agency officials, including the numbers of defense business systems decommissioned. However, the department did not demonstrate that it had established an approach, including metrics and a documented method, to measure enterprise architecture outcomes. We will continue to monitor the Air Force's efforts to implement this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Air Force

  7. Status: Open

    Comments: The Department of the Navy has partially implemented this recommendation. Specifically, the department demonstrated that it had established a metric to measure the percentage of server-based systems and applications that are virtualized annually. However, the department has yet to demonstrate that it documented the steps to be followed for measuring this virtualization. In October 2015, Navy developed a plan of actions and milestones to address elements in GAO's Enterprise Architecture Management Maturity Framework, including the element focused on measuring and reporting enterprise architecture outcomes, by September 2017. We will continue to monitor the Navy's efforts to implement this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Navy

  8. Status: Open

    Comments: The Department of the Army has taken steps to address this recommendation, but much more remains to be done. Specifically, since we reported in September 2012 that one of the department's three segment architectures had established a metric and a method to measure architecture outcomes, one of the remaining segments had established metrics, but it had not documented the steps to measure the metrics. The other remaining segment had yet to establish metrics and a method to measure architecture outcomes. Specifically, in December 2013, the Generating Force segment (now known as the Business Mission Area) developed an Army Business Management Strategy, which included metrics to measure the number of business systems retired over five years and cost savings and avoidance through use of the Army's business enterprise architecture. However, the department had not demonstrated that it had documented the steps to measure the metrics. In addition, the Operating Force segment has not demonstrated that it had established metrics and a method to measure architecture outcomes. In September 2015, the Army developed a plan of actions and milestones to address elements of GAO's Enterprise Architecture Management Maturity Framework, including the element focused on measuring and reporting enterprise architecture outcomes, by September 2017. We will continue to monitor the Army's efforts to implement this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Defense: Department of the Army

  9. Status: Open

    Comments: The Department of Energy has not implemented our recommendation. In March 2017, the department's Office of the Chief Information Officer reported that the department was evaluating actions to better integrate enterprise architecture practices into the department's information technology strategic planning, capital planning and investment control, and program management processes. The Office of the Chief Information Officer further reported that the department expected to develop a plan to measure and report architecture outcomes by the end of fiscal year 2017.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Energy

  10. Status: Closed - Implemented

    Comments: The Social Security Administration has implemented this recommendation. In November 2012, the agency established an approach, including a documented method and metric to measure information technology procurement cost savings attributed to enterprise architecture. Specifically, the agency documented its approach for measuring fiscal year 2012 architecture outcomes, which it used to measure fiscal year 2013 outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Social Security Administration

  11. Status: Closed - Implemented

    Comments: The Department of the Interior has addressed our recommendation. In February 2014, the Department submitted to the Office of Management and Budget its Enterprise Roadmap, which established architecture outcome metrics. For example, the roadmap included a metric associated with measuring the cost savings or avoidance achieved through the use of architecture planning and analysis. The department also provided its methodology for measuring this outcome.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of the Interior

  12. Status: Open

    Comments: The Department of Justice has not taken sufficient steps to implement our recommendation. In June 2014, the department established metrics associated with the department's enterprise architecture (e.g., cost savings/avoidance gained through consolidated systems). However, as of August 2017, the department had not provided evidence that it had documented a method for measuring the metrics, or that it plans to do so. We will continue to monitor the department's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Justice

  13. Status: Closed - Implemented

    Comments: The Department of Transportation has implemented our recommendation to establish an approach for measuring enterprise architecture outcomes. The department's April 2013 Enterprise Architecture Value Measurement Plan described enterprise architecture metrics that it planned to adopt, such as how the architecture program contributes to cost savings or avoidance. The department approved the metrics in September 2014. In November 2015, the department subsequently identified its method of measuring how the enterprise architecture program has contributed to cost savings or avoidance from consolidating or sharing services.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Transportation

  14. Status: Open

    Comments: The Department of Labor has not implemented this recommendation. In July 2017, the department stated that, by the end of fiscal year 2018, it would include the adoption and implementation of measurable enterprise architecture outcomes as part of upcoming information technology strategic planning efforts. We will continue to monitor the department's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Labor

  15. Status: Open

    Comments: As of August 2017, the Department of the Treasury had not implemented our recommendation. We reported in September 2012 that the department had established enterprise architecture metrics, but that it had not established a methodology for measuring its architecture outcomes. In June 2016, the department reported that it did not plan to establish an approach to measure architecture outcomes. Specifically, the department stated that it measured cost, schedule, and operational outcomes, but it did not attribute these measures to any practice, such as architecture. Nonetheless, we continue to believe that it is important to measure the value of its enterprise architecture and we will continue to monitor the department's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of the Treasury

  16. Status: Closed - Implemented

    Comments: The Department of Veterans Affairs has addressed the intent of this recommendation. In July 2015, it developed an Enterprise Architecture Value Measurement Methodology and Implementation Plan. The plan includes a process for identifying, approving, monitoring, and evaluating architecture measures, and is based on a four-level performance measurement framework that takes into consideration the maturity of the enterprise architecture. For example, level 1 is focused on architecture completeness measures, while level 4 is focused on measuring the contribution of enterprise architecture to outcomes related to the department's strategic goals and objectives. As of July 2016, the department had yet to reach the fourth level of its performance measurement framework; however, department officials reported that as the enterprise architecture matures, it plans to measure architecture contributions to outcomes related to strategic goals and objectives.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of Veterans Affairs

  17. Status: Open

    Comments: The Department of State has yet to implement this recommendation. In June 2017, the department's Information Resource Management GAO liaison stated that the department was in the process of developing an enterprise architecture plan. According to the liaison, the plan is to include a structured approach to capturing, evaluating, and assessing relevant performance related data. The liaison also that the target completion date for the plan is June 2018.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Department of State

  18. Status: Open

    Comments: As of August 2017, the Environmental Protection Agency had not implemented this recommendation and did not have a specific plan to do so. In March 2014, the agency submitted its Enterprise Roadmap to the Office of Management and Budget, which included metrics associated with potential outcomes related to its enterprise architecture efforts, such as cost savings gained from consolidating and sharing services. However, the agency had not established steps to be followed for measuring architecture outcomes. More recently, according to its May 2015 Enterprise Roadmap, the agency no longer planned to measure architecture-related outcomes. We will continue to monitor the agency's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Environmental Protection Agency

  19. Status: Closed - Implemented

    Comments: The General Services Administration has implemented this recommendation. Specifically, its February 2014 Enterprise Roadmap included a metric to measure cost savings and avoidance related to application rationalization. The agency also documented its method for measuring this metric.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: General Services Administration

  20. Status: Open

    Comments: The National Aeronautics and Space Administration (NASA) has taken steps to implement this recommendation, but more remains to be done. In December 2013, NASA issued Enterprise Architecture Procedures, which stated that key enterprise architecture metrics, such as cost savings and reduction of duplication, would be established. The procedures also stated that NASA's Chief Architect was to work with internal and external stakeholders to develop and mature metrics that provide information on enterprise architecture benefits and clearly illustrate progress or deficiencies in key areas. In January 2017, an official from NASA's Office of the Chief Information Officer described steps that NASA was taking to establish an approach for measuring architecture outcomes. However, as of August 2017, NASA had not demonstrated that it has documented a method and metrics for measuring outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: National Aeronautics and Space Administration

  21. Status: Open

    Comments: As of March 2017, the National Science Foundation had not implemented this recommendation. The agency stated that it is committed to measuring and reporting enterprise architecture results and outcomes and that it continues to adopt the Office of Management and Budget's recommended approach to enterprise architecture measurement. However, the agency did not provide supporting documentation. We will continue to monitor its efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: National Science Foundation

  22. Status: Open

    Comments: The Small Business Administration (SBA) has not implemented our recommendation or established a plan to do so. In April 2014 and May 2015, SBA submitted to the Office of Management and Budget its Enterprise Roadmap, which included metrics associated with the agency's enterprise architecture, such as cost savings gained from consolidating systems. However, as of August 2017, the agency had yet to document the steps to be followed for measuring architecture outcomes. In July 2016, a Program Manager from the SBA Office of Congressional and Legislative Affairs stated that, going forward, progress for the SBA enterprise architecture program was expected to be limited because of limited labor resources. Nevertheless, we will continue to monitor the agency's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Small Business Administration

  23. Status: Closed - Implemented

    Comments: The Nuclear Regulatory Commission (NRC) implemented our recommendation. NRC issued an Information Technology/Information Management Enterprise Roadmap in May 2015, which included metrics to measure enterprise architecture benefits. Specifically, the roadmap included a metric to measure the level at which investments are meeting or are expected to meet intended benefits as a result of using enterprise architecture. The agency also demonstrated that it has established a documented methodology to measure this metric.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Nuclear Regulatory Commission

  24. Status: Open

    Comments: The Office of Personnel Management has not implemented this recommendation. In September 2016, the agency's Office of Internal Oversight and Compliance reported that it planned to develop an enterprise architecture strategic plan in the third quarter of fiscal year 2017. The plan was to include application rationalization metrics and a method for measurement. However, as of August 2017, the agency had not demonstrated that it had addressed the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

    Agency Affected: Office of Personnel Management

  25. Status: Closed - Implemented

    Comments: The Department of Homeland Security has implemented this recommendation. The department has periodically measured and reported to the Office of Management and Budget outcomes attributed to its enterprise architecture, including cost savings gained from consolidating and sharing services.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Homeland Security

  26. Status: Open

    Comments: The Department of Agriculture has not yet implemented this recommendation. In January 2017, the department provided its action plan to address the recommendation by November 2017.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Agriculture

  27. Status: Closed - Implemented

    Comments: The Department of Education has implemented this recommendation. We reported in September 2012 that the department had reported an architecture outcome in its October 2011 Office of the Chief Information Officer Organization Performance report. Specifically, the department had reported that the ratio of development, modernization and enhancement (DME)spending to steady state spending had increased from 10 percent of total information technology (IT) spending in fiscal year 2011 to 13 percent of total IT spending in fiscal year 2012 as a result of its architecture activities. However, we also reported that the department had yet to periodically (i.e., repeatedly) measure and report the metric. Since then, the department reported to top agency officials at an August 2013 Investment Review Board meeting and in its May 2013 draft Enterprise Roadmap submission to the Office of Management and Budget that the department had achieved its DME spending target of 17 percent.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Education

  28. Status: Open

    Comments: The Department of Commerce has not implemented this recommendation. In November 2012, the department reported architecture outcomes, such as information technology cost savings, to top agency officials. However, the department has not reported architecture outcomes again to top agency officials or to the Office of Management and Budget. In April 2017, a department liaison reported that the Office of the Chief Information Officer had developed an initial draft enterprise architecture value measurement plan, which the department expected to complete by May 2017. In addition, the official reported that the department was in the process of developing a communication plan, by May 2017, to brief executive leadership on architecture value measurement on a regular basis. However, as of August 2017, the department had not demonstrated that these plans had been finalized.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Commerce

  29. Status: Open

    Comments: As of August 2017, the Department of Defense (DOD) had not implemented this recommendation for either of the department's enterprise architectures we reviewed in 2012. With respect to the DOD enterprise architecture, the department had not measured and reported architecture outcomes and benefits. We reported in 2012 that, according to DOD officials, the implementation of an instruction on enterprise architecture and an enterprise architecture management plan would allow the benefits of architecture to be measured and reported. However, according to a March 2016 memo from the Deputy Chief Information Officer for Information Enterprise to the DOD Inspector General, the department no longer planned to publish an instruction related to enterprise architecture and considered our recommendation closed. The memo also described structures and processes for developing, managing, and applying DOD's architecture, including governance, requirements, acquisition, portfolio management, and budgeting. However, the memo did not discuss measuring and reporting enterprise architecture outcomes. With respect to its business enterprise architecture, in August 2016, the department stated that it did not have a systematic methodology for measuring the business value of its business enterprise architecture. Department officials further stated that our July 2015 report "DOD Business Systems Modernization: Additional Action Needed to Achieve Intended Outcomes" (GAO-15-627) concluded that the business enterprise architecture had yielded limited value. As a result of our report, the department stated that senior management had directed changes to the department's Business Enterprise Architecture program. However, as of August 2017, the department had not provided documentation indicating that it planned to establish an approach for measuring and reporting business enterprise architecture outcomes. We will continue to follow up on the department's efforts to address this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense

  30. Status: Closed - Implemented

    Comments: The Department of the Air Force implemented a key element of this recommendation. Although the Air Force's method to ensure consistency was not fully documented, it did start reporting outcomes. Specifically, the department began periodically reporting architecture-related outcomes, including the numbers of defense business systems decommissioned, to top agency officials.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Air Force

  31. Status: Open

    Comments: The Department of the Navy has not implemented this recommendation. Specifically, the department has not demonstrated that it has measured and reported enterprise architecture outcomes and benefits to top agency officials. In October 2015, the department developed a plan of actions and milestones to address elements in GAO's Enterprise Architecture Management Maturity Framework, including the element focused on measuring and reporting enterprise architecture results and outcomes by September 2017. We will continue to monitor the Navy's efforts to implement this recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Navy

  32. Status: Closed - Implemented

    Comments: The Department of the Army implemented a key element of this recommendation. Although the department had not fully documented a method to consistently measure outcomes, it did start reporting critically important information. Specifically, regarding the Generating Force segment (now known as the Business Mission Area), in December 2013, the Under Secretary of the Army issued an Army Business Management Strategy, which reported that 59 systems were retired in 2013 through use of enterprise architecture. In its May 2014 briefing to the Defense Business Council, the Army reported the number of business systems that were retired using enterprise architecture during 2014, and the cost savings associated with the retirements, demonstrating that the Business Mission Area had periodically reported architecture benefits to top agency officials.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Defense: Department of the Army

  33. Status: Open

    Comments: The Department of Energy has not yet implemented the recommendation. In March 2017, the department's Office of the Chief Information Officer reported that the department is evaluating actions to better integrate enterprise architecture practices into the department's information technology strategic planning, capital planning and investment control, and program management processes. The Office of the Chief Information Officer also reported that the department expects to develop a plan to measure and report architecture outcomes by the end of fiscal year 2017 and to have routine measures and reporting in place during fiscal year 2018.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Energy

  34. Status: Closed - Implemented

    Comments: The Social Security Administration has implemented this recommendation. In November 2012, the agency issued a report on fiscal year 2012 architecture outcomes and benefits, and again in November 2013 on fiscal year 2013 architecture outcomes and benefits, to its Chief Information Officer. The outcomes were associated with consolidating hardware requirements and bundling purchases. In the agency's March 2014 Enterprise Roadmap submitted to the Office of Management and Budget, the agency's Chief Information Officer reported cost savings associated with its architecture efforts.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Social Security Administration

  35. Status: Closed - Implemented

    Comments: The Department of the Interior has addressed this recommendation. Specifically, the department's Chief Financial Officer submitted the department's February 2014 Enterprise Roadmap to the Office of Management and Budget (OMB), which reported $8.7 million in fiscal year 2013 cost savings as a result of enterprise architecture efforts. In addition, the department measured and reported on four key metrics, including the number of legacy investments identified for retirement resulting from architecture planning and analysis. Specifically, the department measured and reported these metrics in December 2014 and May 2015, relative to baseline and targets, and reported them in its May 2015 Enterprise Roadmap, submitted to OMB. The Director of IT Planning and Portfolio Management stated that the department's Chief Information Officer has authority to commit resources and make changes to the architecture program, and reviewed the measurements before they were delivered to OMB.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of the Interior

  36. Status: Open

    Comments: The Department of Justice has not sufficiently implemented our recommendation. Although the department reported cost savings through use of its enterprise architecture, as of August 2017, it has not provided documentation to support that the cost savings have been reliably measured.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Justice

  37. Status: Closed - Implemented

    Comments: The Department of Transportation has met the intent of our recommendation based on recent and planned future actions. In November 2015, the department measured how the architecture program has contributed to cost savings. Specifically, the Department's Chief Information Officer and Chief Technology Officer approved a November 2015 Enterprise Architecture Metrics Report that reported architecture-related cost savings by measuring the cost of operating or maintaining applications, systems, or infrastructure components that were removed from service. The report also stated that the metric will be used as a baseline for measurement in future years.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Transportation

  38. Status: Open

    Comments: The Department of Labor has not implemented this recommendation. In July 2017, the department stated that it planned to include, by the end of fiscal year 2018, the adoption and implementation of measurable enterprise architecture outcomes as part of upcoming information technology strategic planning efforts. We will continue to monitor the department's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Labor

  39. Status: Open

    Comments: As of August 2017, the Department of the Treasury had not measured and reported enterprise architecture outcomes in accordance with our recommendation. Moreover, in June 2016, the department reported that it does not plan to do so. In September 2012, we reported that the department had reported architecture outcomes; however the metrics had not been periodically measured and reported. Subsequently, in its February 2014 Information Technology Enterprise Roadmap, the department reported a reduction in infrastructure spending as a percentage of its information technology budget from fiscal year 2010 through fiscal year 2013 and attributed the results to enterprise architecture. However, the department did not demonstrate that it had reliably measured the outcome. Specifically, it did not provide supporting documentation. In June 2016, the department reported that it did not plan to establish an approach to measure and report architecture outcomes. Nonetheless, we continue to believe our recommendation is warranted and will monitor the department's efforts to implement it.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of the Treasury

  40. Status: Open

    Comments: The Department of Veterans Affairs has not implemented this recommendation. In July 2017, the department stated that in the fall of 2016, the Chief Information Officer instituted a new information technology governance framework and established the Architecture Board that is responsible for overseeing all aspects of the department's architecture. According to the department, as of July 2017, the board was formulating enterprise architecture priorities, including the measurement and reporting of architecture outcomes and benefits. The department anticipated that priority enterprise architecture measures and reporting requirements would be established by the end of fiscal year 2017, and that actual reporting to the board will begin by December 2017.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of Veterans Affairs

  41. Status: Open

    Comments: The Department of State has not implemented our recommendation. According to the department's Information Resource Management GAO liaison, the department will complete an updated enterprise architecture plan and establish desired performance outcomes by December 2017.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Department of State

  42. Status: Open

    Comments: The Environmental Protection Agency has not implemented this recommendation. In March 2014, the agency submitted to the Office of Management and Budget its Enterprise Roadmap, which identified outcomes associated with its enterprise architecture efforts. For example, the agency reported cost savings achieved in fiscal year 2013 related to consolidating and sharing services. However, the agency did not demonstrate that it reliably measured the outcome (i.e., it did not provide supporting documentation). More recently, according to its May 2015 Enterprise Roadmap, the agency no longer planned to measure architecture-related outcomes. As of August 2017, the agency had not demonstrated that it had taken additional actions to address this recommendation. Nonetheless, we continue to believe that it is important that the agency measure the value of its enterprise architecture and will monitor its efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Environmental Protection Agency

  43. Status: Closed - Implemented

    Comments: The General Services Administration (GSA) has implemented key aspects of this recommendation. Specifically, the agency reported cost avoidance through the use of architecture analysis to identify and eliminate applications. In addition, GSA periodically reported these results to GSA review boards. For example, it reported these results in July 2014 and in February 2015. GSA also reported fiscal year 2015 cost savings/avoidance related to eliminating applications to the Office of Management and Budget.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: General Services Administration

  44. Status: Open

    Comments: The National Aeronautics and Space Administration (NASA) has not implemented this recommendation. In February 2017, the agency reported that enterprise architecture performance outcomes were being refined for incorporation into its 2017 Information Resource Management Strategic Plan. However, as of August 2017, NASA had not demonstrated that it has measured and reported architecture outcomes.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: National Aeronautics and Space Administration

  45. Status: Open

    Comments: As of March 2017, the National Science Foundation had not implemented this recommendation. The agency stated that it is committed to measuring and reporting enterprise architecture results and outcomes and that it continues to adopt the Office of Management and Budget's recommended approach to enterprise architecture measurement. However, the agency did not provide supporting documentation. We will continue to monitor its efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: National Science Foundation

  46. Status: Open

    Comments: As of August 2017, the Small Business Administration had not implemented this recommendation. Specifically, it had not demonstrated that it has measured architecture outcomes. In July 2016, the agency reported that, going forward, desired progress for its enterprise architecture program was expected to be limited because of limited labor resources. Nevertheless, we will continue to monitor the agency's efforts to implement the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Small Business Administration

  47. Status: Closed - Implemented

    Comments: The Nuclear Regulatory Commission (NRC) has taken steps to address the intent of our recommendation. Specifically, in May 2015, it issued an Information Technology/Information Management Enterprise Roadmap which identified NRC enterprise architecture outcomes and benefits. The roadmap reported this information to NRC top agency officials and the Office of Management and Budget.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Nuclear Regulatory Commission

  48. Status: Open

    Comments: The Office of Personnel Management (OPM) has not implemented this recommendation. In September 2016, OPM's Office of Internal Oversight and Compliance reported that the agency planned to develop an enterprise architecture strategic plan in the third quarter of fiscal year 2017, which was to include measuring and reporting application rationalization metrics to OPM senior executives and the Office of Management and Budget. However, as of August 2017, the agency had not demonstrated that it had addressed the recommendation.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

    Agency Affected: Office of Personnel Management

  49. Status: Closed - Implemented

    Comments: The Department of Housing and Urban Development has fully implemented our recommendation. Specifically, since it reported outcomes for 2011, the department has measured architecture outcomes and reported them again to an agency executive committee, as well as to the Office of Management and Budget. For example, it reported progress in reducing the number of technology products that duplicate existing capabilities through use of its architecture. According to agency officials, the department's Chief Information Officer reviewed and approved the report in April 2013 and an executive committee reviewed the architecture outcomes before they were submitted to the Office of Management and Budget in May 2013.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Health and Human Services and Housing and Urban Development should ensure that enterprise architecture outcomes are periodically measured and reported to top agency officials.

    Agency Affected: Department of Housing and Urban Development

  50. Status: Open

    Comments: The Department of Health and Human Services has not implemented this recommendation, or provided a plan to do so. As of August 2017, it had not demonstrated that it had measured architecture metrics that it had established in its April 2014 Enterprise Roadmap. We will continue to monitor the department's efforts to implement the recommendation

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Health and Human Services and Housing and Urban Development should ensure that enterprise architecture outcomes are periodically measured and reported to top agency officials.

    Agency Affected: Department of Health and Human Services

  51. Status: Open

    Comments: As of July 2017, the Office of Management and Budget (OMB) had not fully addressed our recommendation. In March 2013, the office required agencies to submit annually an Enterprise Roadmap, which was to include an appendix on enterprise architecture outcomes. To prepare the appendix, the office provided agencies with a template to document architecture metrics and measurement methods. The template included examples of outcome metrics and a field where agencies were to document measurement methods. However, OMB did not provide details on the methods that agencies could use to measure architecture outcomes or require that agencies include the steps to be followed for measuring outcomes. Furthermore, as of July 2016, OMB no longer required agencies to submit a report of enterprise architecture outcomes. According to OMB's Integrated Data Collection guidance, the Office of the Federal Chief Information Officer reviewed the information requested from agencies and reduced it in an effort to reduce the reporting burden on agencies. Nonetheless, we continue to believe that it is important that OMB assist agencies in measuring outcomes achieved through enterprise architecture and require that outcomes be reported, in order to enhance agencies' ability to realize enterprise architecture benefits.

    Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, and to assist agencies in measuring and reporting outcomes achieved through enterprise architecture, the Director of OMB should ensure that the planned December 2012 guidance for enterprise architecture value measurement and reporting includes (1) sufficient details on the method and metrics that agencies could use to measure their architecture program's value and (2) a requirement for agencies to include in their April 2013 enterprise roadmap submissions a measurement method (i.e., steps to be followed) and metrics, and report on the outcomes and benefits achieved through enterprise architecture.

    Agency Affected: Executive Office of the President: Office of Management and Budget

 

Explore the full database of GAO's Open Recommendations »

Nov 15, 2017

Nov 7, 2017

Oct 4, 2017

Sep 18, 2017

Sep 6, 2017

Jul 13, 2017

Jun 21, 2017

Jun 13, 2017

May 18, 2017

Looking for more? Browse all our products here