Recommendation: The Director of BLM should establish outcome-oriented performance measures to assess the effectiveness of the reorganization. (Recommendation 1)

Agency: Department of the Interior: Bureau of Land Management
Status: Open

Comments: The department neither agreed nor disagreed with our recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of BLM should develop an implementation plan for the reorganization that includes milestones and deliverables to track and communicate implementation progress. (Recommendation 2)

Agency: Department of the Interior: Bureau of Land Management
Status: Open

Comments: The department neither agreed nor disagreed with our recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of BLM should complete a strategic workforce plan that addresses how it will recruit for and fill vacant positions resulting from the relocations. (Recommendation 3)

Agency: Department of the Interior: Bureau of Land Management
Status: Open

Comments: The department neither agreed nor disagreed with our recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of the Interior should ensure its bureau leadership incorporates key practices for effective agency reforms prior to implementing reorganization activities at other Interior bureaus. (Recommendation 4)

Agency: Department of the Interior: Office of the Secretary
Status: Open

Comments: The department neither agreed nor disagreed with our recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense should ensure that the Chief Management Officer identify and document specific implementation steps to advance a collaborative culture, consistent with our leading practices for mergers and organizational transformations.

Agency: Department of Defense: Office of the Secretary of Defense
Status: Open

Comments: DOD concurred with this recommendation. In its concurrence, DOD stated that it intended to identify and document specific implementation steps to advance a collaborative culture through, among other things, the Chief Management Officer's forthcoming detailed implementing guidance on Secretary of Defense-empowered cross-functional teams and revisions to the DOD issuance regarding senior governance forums that are intended to advance a collaborative culture. As of July 2020, these efforts were still in progress, according to an OCMO official. We will continue to monitor DOD's efforts to address this recommendation.

Recommendation: The Administrator of USAID should establish outcome-oriented performance measures to assess the effectiveness of USAID's reform projects. (Recommendation 1)

Agency: United States Agency for International Development
Status: Open
Priority recommendation

Comments: USAID concurs with this recommendation, and indicates it will establish a performance-monitoring plan.

Recommendation: The Administrator of USAID should ensure that the agency completes a strategic workforce plan necessary to support its reform efforts. (Recommendation 2)

Agency: United States Agency for International Development
Status: Open

Comments: USAID concurs with this recommendation. It affirmed is in the process of finalizing the strategic workforce plan that it will complete by September 30, 2019 and will submit the plan to Congress as directed. USAID stated it will also provide a framework to meet Congressionally-directed staffing levels across the Foreign Service and Civil Service.

Recommendation: The Secretary of Defense should ensure that the CMO meets DOD's September 2019 deadline for review and approval of DOD's training curriculum for cross-functional team members and their supervisors. (Recommendation 3)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. According to an OCMO official, as of April 2020, DOD's training curriculum for cross-functional team members and their supervisors had been approved. However, as of September 2020, DOD has not provided documentation of that approval.

Recommendation: The Secretary of Defense should ensure that the CMO meets DOD's September 2019 deadline for review and approval of DOD's training curriculum for presidential appointees. (Recommendation 4)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. According to an OCMO official, as of April 2020, DOD's training curriculum for cross-functional team members and their supervisors had been approved, and the training had been provided to presidential appointees and their staffs. However, as of September 2020, DOD has not provided documentation of that approval or training.

Recommendation: The Secretary of Defense should ensure that the CMO meets DOD's November 2019 deadline for drafting, review, and approval of DOD's report on the success and failures of cross-functional teams and final submission to the Secretary for review and approval. (Recommendation 5)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. According to an OCMO official, as of April 2020, work on the report on the successes and failures of cross-functional teams was ongoing. We will continue to monitor DOD's process of developing its report; as of September 2020, DOD has not provided documentation of the report being drafted, reviewed, or approved.

Recommendation: The Secretary of Defense should ensure that the CMO and the electromagnetic spectrum operations cross-functional team clarify roles and responsibilities for providing administrative support and funding for the team beyond fiscal year 2019 in accordance with the memorandum establishing the team. (Recommendation 6)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. In its comments on a subsequent report on the department's implementation of section 911, the department stated that funding for all Secretary of Defense-empowered cross functional teams, including the electromagnetic spectrum operations cross-functional team, was in place through fiscal year 2020, and that they were exploring options for dedicated funding for cross-functional teams in future years. As of April 2020, according to an OCMO official, these dedicated funding sources had not been established. DOD has not provided evidence of their funding as of September 2020.

Recommendation: The Secretary of the Army should ensure that the Commanding General of Army Futures Command applies leading practices as they relate to technology development, particularly that of demonstrating technology in an operational environment prior to starting system development. (Recommendation 1)

Agency: Department of Defense: Department of the Army
Status: Open
Priority recommendation

Comments: The Army concurred with this recommendation. Army officials acknowledged the importance of demonstrating technology in an operation environment prior to starting system development and stated that they have taken steps to assist in the identification and removal of infeasible or immature technologies. For example, development of the Integrated Visual Augmentation System includes a series of user engagements where soldiers interact with the system in a field environment and provide feedback to guide development and design. To fully implement this recommendation the Army will need to demonstrate that all of the technologies it is developing are matured in accordance with leading practices. Including soldier engagement in the development of the Integrated Visual Augmentation System is a positive step in that it uses operational experience to determine the utility of technologies on the battlefield. However, demonstrating that those technologies function as expected in an operational environment is equally important. Our past work has shown that demonstrations in an operational environment reduce the risk that technologies will not operate as intended or desired. It is important that the Army continue and expand its efforts to eliminate infeasible, or immature technologies across all of its development programs.

Recommendation: The Secretary of the Army should ensure that the Commanding General of Army Futures Command takes steps to incorporate the experiences of the cross-functional teams in applying leading practices for effective cross-functional teams. (Recommendation 2)

Agency: Department of Defense: Department of the Army
Status: Open

Comments: The Army concurred with this recommendation. According to Army officials, cross-functional teams routinely meet to discuss both successes and challenges. Additionally, senior Army leadership hosts weekly meetings with cross-functional teams to discuss decision points and concerns. Army Futures Command plans to include leadership from all cross-functional teams at future meetings to enhance knowledge sharing and ensure leadership viewpoints are communicated across the enterprise. These actions do incorporate elements of leading practices for cross-functional teams such as open and regular communication and senior management support. To fully implement this recommendation the Army should continue and expand this knowledge sharing as planned as well as ensure other elements of leading practices for effective cross-functional teams are implemented. These include the establishment of well-defined team operations with project-specific rules and procedures as well as appropriate training and learning environments for all cross-functional team members.

Recommendation: The Secretary of the Army should ensure that the Commanding General of Army Futures Command executes a process for identifying and incorporating lessons learned from cross-functional team pilots into the new command. (Recommendation 3)

Agency: Department of Defense: Department of the Army
Status: Open

Comments: The Army concurred with this recommendation. According to Army officials an analyst from the Center for Army Lessons Learned has embedded a permanent analyst at Army Futures Command who is capturing lessons learned and best practices from across the cross-functional teams. The results of this analysis are provided across Army Futures Command and to other stakeholders. Additionally, Army Futures Command has established the Directorate of Systems Integration to act as a repository and action office for lessons learned. This office hosts recurring coordination events to further the communication of lessons learned .

Recommendation: The Secretary of the Army should ensure that the Commanding General of Army Futures Command fully applies leading practices for mergers and organizational transformations as roles, responsibilities, policies and procedures are finalized for the new command. (Recommendation 4)

Agency: Department of Defense: Department of the Army
Status: Open

Comments: The Army concurred with this recommendation. According to Army officials Army Futures Command is applying leading practices for mergers and organizational transformations as it continues to establish the command. These practices include total employee involvement in the transformation process with senior leadership championing the overarching transformation. In addition, the command has worked to identify processes that need improvement as it incorporates the organizations transferred from other commands. It also continues to evolve its staff and functions as needs are identified. According to officials, Army Futures Command continues to select high-performing team members to guide its transformation through selective recruitment and talent management as well as augmenting its growing staff with other Army personnel selected for temporary assignments. The command is also involving employees to obtain their ideas and gain their ownership for the transformation by encouraging them to share their thoughts and ideas. Importantly, according to officials, the command recognizes the need to have an enduring change model to consistently reassess and reorganize the command to consistently deliver products in relevant timeframes. These actions do demonstrate elements of leading practices for mergers and organizational transformations. However, to fully implement this recommendation, Army Futures Command should formalize and institutionalize its authorities, responsibilities, policies and procedures as they relate to these leading practices, especially as leadership within the command and the Army change.

Recommendation: The Secretary of Defense should ensure that the Chief Management Officer establishes a process for identifying and prioritizing available funding to develop and implement initiatives from the cross-functional reform teams. (Recommendation 1)

Agency: Department of Defense
Status: Open
Priority recommendation

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense should ensure that the Under Secretary of Defense for Acquisition and Sustainment assesses whether DLA Document Services' single manager role for printing and reproduction provides the best value to the government--as determined by quality, price, and delivery time and in light of DLA Document Services' transformation plan--and whether any additional efficiencies are possible, and use the results of that assessment to inform the revision of DOD Instruction 5330.03. (Recommendation 1)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense (DOD) concurred with GAO's October 2018 recommendation. By July 2019, DOD had completed a study of printing and reproduction services to determine the best value to the department. As of December 2019, according to a DOD official, the Office of the Under Secretary of Defense for Acquisition and Sustainment plans to develop steps toward achieving the best value to the government based on the study results, and update DOD Instruction 5330.03, which describes the mission, responsibilities, functions, and relationships of DLA Document Services by July 2020. Completion of these actions would allow DOD to determine if further efficiencies in its document services are possible.

Recommendation: The Secretary of Defense should ensure that the Under Secretary of Defense for Acquisition and Sustainment assesses whether DOD's current approach to obtaining print devices represents the best value to the government or whether other approaches, such as further consolidations under DLA Document Services as a proposed single manager for print device procurement, would be more cost effective. (Recommendation 2)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense (DOD) concurred with GAO's October 2018 recommendation. In July 2019, DOD had completed a study of printing and reproduction services to determine the best value to the department. As of December 2019, according to a DOD official, the Office of the Under Secretary of Defense for Acquisition and Sustainment plans to develop steps toward achieving the best value to the government based on the study results, and update DOD Instruction 5330.03, which describes the mission, responsibilities, functions, and relationships of DLA Document Services by July 2020. Completion of these actions would allow DOD to determine if further efficiencies in its document services are possible.

Recommendation: The Secretary of Defense should ensure that the DOD Chief Information Officer (CIO) implements controls, such as reporting procedures, to routinely monitor actions to reduce the number of print devices, consistent with department-wide goals for reducing the number of print devices that are included in the CIO's 2012 memorandum. (Recommendation 3)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense (DOD) concurred with GAO's October 2018 recommendation. As of December 2019, DOD had ongoing actions intended to address the recommendation. For example, according to a DOD official, the DOD Chief Information Officer (CIO) will collaborate with the Under Secretary of Defense for Acquisition and Sustainment to define the necessary responsibilities, policy, and procedures in the planned revision of DOD Instruction 5330.03, which describes the mission, responsibilities, functions, and relationships of DLA Document Services. DOD plans to update the instruction by July 2020. Implementing controls, such as clarifying responsibilities, policy, and procedures would better enable DOD to achieve department-wide goals for reducing print devices it established in the CIO's 2012 memorandum.

Recommendation: The Secretary of Defense should ensure that the DOD CIO assigns responsibility for implementing the CIO's 2012 memorandum on optimizing the use of employee information technology devices. (Recommendation 4)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense (DOD) concurred with GAO's October 2018 recommendation. As of December 2019, DOD had ongoing actions intended to address the recommendation. For example, according to a DOD official, the DOD Chief Information Officer (CIO) will collaborate with the Under Secretary of Defense for Acquisition and Sustainment to define the necessary responsibilities, policy, and procedures in the planned revision of DOD Instruction 5330.03, which describes the mission, responsibilities, functions, and relationships of DLA Document Services. DOD plans to update the instruction by July 2020. Implementing controls, such as clarifying responsibilities, policy, and procedures would better enable DOD to achieve department-wide goals for reducing print devices it established in the CIO's 2012 memorandum.

Recommendation: The Secretary of Defense should ensure that the Under Secretary of Defense (Comptroller), in consultation with the military services and DLA, evaluates options to report more accurate funding information and takes steps to improve the accuracy of its budgetary and financial information reporting on document services internally and to Congress, including making distinctions between printing and non-printing-related costs and information on device procurement and electronic content management. This information could be provided as part of DOD's annual Operation and Maintenance budget justification materials. (Recommendation 6)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense (DOD) partially concurred with this recommendation. As of July 2019, DOD had ongoing actions intended to address the recommendation. For example, according to DOD documentation, the offices of the Under Secretary of Defense for Acquisition and Sustainment and Under Secretary of Defense (Comptroller) planned to examine the Service-related definitions of printing and reproduction for potential process improvements. DOD anticipated completing this action by July 2020. Examining opportunities to improve the definitions of printing and reproduction services would better position DOD to report more accurate funding information for document services, as GAO recommended in October 2018

Recommendation: The Secretary of Defense should ensure that the Under Secretary of Defense for Acquisition and Sustainment clarifies the categories of threats within JIDO's counter-improvised threat mission. (Recommendation 1)

Agency: Department of Defense
Status: Open

Comments: DOD agreed with this recommendation. As of October 2019, DOD indicated that is has begun taking action to implement it. We will update the status of this recommendation once we confirm the actions DOD has taken.

Recommendation: The Secretary of Defense should ensure that the Under Secretary of Defense for Acquisition and Sustainment clarifies JIDO's authorities for countering improvised threats, including the degree to which JIDO is to focus (lead, advocate, and coordinate) departmental efforts in key areas such as research and rapid fielding. (Recommendation 2)

Agency: Department of Defense
Status: Open

Comments: DOD agreed with this recommendation. As of October 2019, DOD indicated that is has begun taking action to implement it. We will update the status of this recommendation once we confirm the actions DOD has taken.

Recommendation: The Secretary of Defense should ensure the DTRA Director establishes a process to routinely obtain permission to release applicable information from organizations connected to JIDO research projects so that JIDO can send the information to Defense Technical Information Center (DTIC). (Recommendation 3)

Agency: Department of Defense
Status: Open

Comments: DOD agreed with this recommendation. As of October 2019, DOD indicated that is has begun taking action to implement it. We will update the status of this recommendation once we confirm the actions DOD has taken.

Recommendation: The Secretary of Defense should ensure the DTRA Director establishes a process to submit information on JIDO's research projects to DTIC. (Recommendation 4)

Agency: Department of Defense
Status: Open

Comments: DOD agreed with this recommendation. As of October 2019, DOD indicated that is has begun taking action to implement it. We will update the status of this recommendation once we confirm the actions DOD has taken.

Recommendation: The Secretary of Defense should ensure that the CMO fully address all requirements in section 911 of the NDAA for Fiscal Year 2017 and incorporate leading practices for effective cross-functional teams in guidance on Secretary of Defense-empowered cross-functional teams. (Recommendation 3)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. In December 2019, the Secretary of Defense approved DOD's guidance on cross-functional teams. We found that this two-page guidance addresses most, but not all, of the 911 requirements and leading practices for cross-functional teams. Specifically, it addresses in whole or in part six of the seven section 911 requirements and six of the eight leading practices. The Secretary-approved guidance also directs the Chief Management Officer (CMO) to develop more detailed implementing guidance. According to an Office of the CMO (OCMO) official, OCMO plans to use previously drafted terms of reference as the basis for the CMO's more detailed implementing guidance. Based on our review, when the Secretary of Defense approved guidance is considered along with the draft terms of reference expected to serve as detailed implementing guidance, both documents will fully address all section 911 requirements and leading practices for effective cross-functional teams. To fully implement this recommendation, the CMO will need to develop and issue this detailed implementing guidance to fully address section 911 requirements and our leading practices for effective cross-functional teams. According to an OCMO official, as of April 2020, OCMO was still in the process of developing the detailed implementing guidance.

Recommendation: The Secretary of Defense should ensure that the CMO either: (a) provide training for presidentially-appointed, Senate-confirmed individuals in the Office of the Secretary of Defense that includes the required elements--leadership, modern organizational practice, and collaboration--in section 911 of the NDAA for Fiscal Year 2017, or (b) develop criteria for obtaining a waiver and have the Secretary of Defense request such a waiver from the President for these required elements if the individual possesses--through training and experience--the skill and knowledge otherwise to be provided through a course of instruction. (Recommendation 4)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation. In October 2018, an official from the Office of the Chief Management Officer (OCMO) stated that OCMO had revised the draft training curriculum for individuals filling presidentially-appointed, Senate-confirmed positions in the Office of the Secretary of Defense to include all of the required elements in section 911. According to an OCMO official, as of April 2020, the curriculum had been approved and the training had been provided, but as of July 2020, the department had not provided documentation of the updated curriculum or of the training being provided. To fully implement this recommendation, we will need to review the revised training curriculum to determine if it contains all of the required elements in section 911 and obtain documentation that presidential appointees in the Office of the Secretary of Defense have received the training or were granted training waivers.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce has not implemented this recommendation. Since we reported in 2012 that the department had established metrics for measuring enterprise architecture outcomes but not a method for measuring the metrics, the department issued an Enterprise Architecture Value Measurement Plan in April 2018. This plan included outcome metrics; however, the department had not documented a method for measuring the metrics. In January 2020, the department's Office of the Chief Information Officer (CIO) stated that the department recently appointed a new CIO (acting) and was in the process of revisiting strategic planning initiatives and implementation to ensure they are congruent with the IT strategic vision and objectives. The Office of the CIO also said it was hiring a new Chief Enterprise Architect, which would impact previous initiatives and strategies. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Defense
Status: Open

Comments: In December 2019, the Department of Defense Office of the Chief Information Officer stated that it would establish an approach to measuring enterprise architecture outcomes defined in the DOD Digital Modernization Strategy, by September 2020.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Defense: Department of the Navy
Status: Open

Comments: The Department of the Navy has not demonstrated that it has implemented our recommendation. In November 2017, the department described steps it had taken to address the recommendation. However, as of January 2020, the department had not provided documentation demonstrating that it had established metrics and a method for measuring enterprise architecture outcomes. We will continue to monitor the department's efforts to address the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Defense: Department of the Army
Status: Open

Comments: As of January 2020, the Department of the Army had taken steps to address this recommendation, but much more remains to be done. Specifically, in December 2013, the department developed its Army Business Management Strategy, which included metrics to measure the number of business systems retired over five years and cost savings and avoidance through use of the Army's business enterprise architecture. However, as of January 2020, the department had not demonstrated that it had documented the steps to measure the metrics. In January 2020, the department's chief architect stated that the department was in the process of establishing a baseline architecture. We will continue to monitor the Army's efforts to establish an architecture and an approach for measuring architecture outcomes in accordance with our recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Energy
Status: Open

Comments: In August 2020, the Department of Energy demonstrated that it had taken steps to implement the recommendation. Specifically, in March 2020, the department developed a draft plan to measure business architecture performance. We will monitor the department's efforts to finalize and implement its plan.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Labor
Status: Open

Comments: The Department of Labor has not addressed the recommendation. In August 2020, the department stated that it was continuing to evaluate processes for reviewing and assessing enterprise architecture value.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of State
Status: Open

Comments: In February 2020, the Department of State developed an enterprise architecture plan, which identified several benefits that may be achieved by executing the plan. These benefits included, for example, lower support and acquisition costs and reuse of technology and investments. However, the department did not demonstrate that it had established an approach for measuring the potential benefits in the plan. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Environmental Protection Agency
Status: Open

Comments: The Environmental Protection Agency has not implemented this recommendation. In December 2019, the agency stated that its chief architect and technical architecture staff were working to reformulate the enterprise architecture program and described several goals and activities that were underway. The agency also stated that the program was examining industry best practices on architecture metrics to determine which would be best for EPA's enterprise architecture program. As metrics are adopted to assess the value of the architecture program, the program will work them into the agency-wide process for performance metrics. We will continue to monitor the agency's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: National Aeronautics and Space Administration
Status: Open

Comments: The National Aeronautics and Space Administration (NASA) has not yet implemented this recommendation. In July 2019, NASA's Associate Chief Information Officer for Enterprise Service and Integration said the agency was in the process of developing an enterprise architecture policy directive and procedural requirements. He anticipated that they would be completed in October 2020.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Small Business Administration
Status: Open

Comments: As of June 2020, the Small Business Administration had not implemented this recommendation. In August 2019, SBA developed an enterprise architecture program performance guide and value measurement plan. According to the plan, the agency plans to measure cost savings/avoidance and reduction of duplication. However, the agency has not demonstrated that it has documented the steps to be followed to measure the outcomes. Specifically, it did not demonstrate that it had established a method to measure the cost savings/avoidance or the number of duplicate investments reduced.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Office of Personnel Management
Status: Open

Comments: In February 2020, a Senior Analyst in the Office of Personnel Management's (OPM) Office of Internal Oversight and Compliance stated that, as of January 2020, OPM's Office of the Chief Information Officer (CIO) had established an approach for developing an enterprise architecture. The liaison also stated that, since May 2019, the office of the CIO had established bi-weekly checkpoints with leadership and stakeholders to monitor and report progress and to document established metrics. However, the agency has not demonstrated that it has established a documented method and metrics for measuring enterprise architecture outcomes.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Agriculture
Status: Open

Comments: In August 2020, the Department of Agriculture demonstrated that it had established an approach to measuring enterprise architecture outcomes; however, it had not yet measured and reported them. The department conducted a survey in February 2020 that collected information such as the number of legacy systems that were identified and subsequently decommissioned, and the number of applications that have been eliminated as a result of application rationalization through use of enterprise architecture. The department stated that it will release the second survey in the first quarter of fiscal year 2021, and the differences in the responses between the first and second surveys will be presented to the CIO Council to show the impact of enterprise architecture. The department did not state when it plans to report the results. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce has not implemented this recommendation. In April 2018, the department issued an Enterprise Architecture Value Measurement Plan; however, the department has not demonstrated that it has measured and reported enterprise architecture outcomes. In January 2020, the department's Office of the Chief Information Officer (CIO) stated that the department recently appointed a new CIO (acting) and was in the process of revisiting all strategic planning initiatives and implementation to ensure they are congruent with the IT strategic vision and objectives. The Office of the CIO also said it was hiring a new Chief Enterprise Architect, which would impact previous initiatives and strategies. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Defense
Status: Open

Comments: In December 2019, the Department of Defense Office of the Chief Information Officer stated that it would establish a documented approach to measuring enterprise architecture outcomes defined in the DOD Digital Modernization Strategy by September 2020, and report outcomes by December 2021.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Defense: Department of the Navy
Status: Open

Comments: The Department of the Navy has not demonstrated that it has implemented our recommendation. In November 2017, the department described steps it had taken to address the recommendation. However, as of January 2020, it had not provided documentation demonstrating that it has measured and reported enterprise architecture outcomes. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Energy
Status: Open

Comments: As of August 2020, the Department of Energy had not implemented the recommendation. In May 2020, the department described steps it had taken to develop its enterprise architecture. For example, it said that the department had established a Technical Reference Model, which supports processes and criteria for selecting and reviewing software across the department's headquarters. The department said it used the reference model to identify software products that could be eliminated or consolidated to achieve cost savings. However, as of August 2020, the department had not provided documents demonstrating that it had measured and reported architecture outcomes. We will continue to monitor the status of the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Labor
Status: Open

Comments: The Department of Labor has not addressed the recommendation. In August 2020, the department stated that it was evaluating processes for reviewing and assessing enterprise architecture value.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Veterans Affairs
Status: Open

Comments: In January 2020, the Department of Veterans Affairs stated that it plans to measure enterprise architecture performance by the end of March 2020. We will continue to monitor the department's efforts to address the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of State
Status: Open

Comments: In February 2020, the Department of State developed an enterprise architecture plan, which identified several benefits that may be achieved by executing the plan. These benefits included, for example, lower support and acquisition costs and reuse of technology and investments. However, the department did not demonstrate that it had measured and reported outcomes attributed to its architecture. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Environmental Protection Agency
Status: Open

Comments: The Environmental Protection Agency has not implemented this recommendation. In December 2019, the agency stated that its chief architect and technical architecture staff were working to reformulate the enterprise architecture program and described several goals and activities that were underway. The agency also stated that the program was examining industry best practices on architecture metrics to determine which would be best for EPA's enterprise architecture program. As metrics are adopted to assess the value of the architecture program, the program will work them into the agency-wide process for performance metrics. We will continue to monitor the agency's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: National Aeronautics and Space Administration
Status: Open

Comments: The National Aeronautics and Space Administration (NASA) has not implemented this recommendation. In July 2019, NASA's Associate Chief Information Officer for Enterprise Service and Integration said the agency was in the process of developing an enterprise architecture policy directive and procedural requirements. He anticipated that they would be completed in October 2020.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Small Business Administration
Status: Open

Comments: As of June 2020, the Small Business Administration (SBA) had not implemented this recommendation. SBA's Office of the CIO stated that it achieved IT cost savings and avoidance as a result of IT infrastructure service and support reduction and data center optimization in fiscal years 2014 through the third quarter of fiscal year 2019. In a March 2020 memo to GAO, the Chief Information Officer explained that the agency's enterprise architecture team reviewed IT acquisition requests, which led to reducing duplicative IT investments and resulted in the cost savings and avoidance. However, the agency did not demonstrate that it had reliably measured the cost savings and avoidance. Specifically, it did not provide documentation demonstrating how it calculated most of the savings it reported.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Office of Personnel Management
Status: Open

Comments: In February 2020, a Senior Analyst in the Office of Personnel Management's (OPM) Office of Internal Oversight and Compliance stated that, as of January 2020, OPM's Office of the Chief Information Officer (CIO) had established an approach for developing an enterprise architecture. The liaison also stated that, since May 2019, the office of the CIO had established bi-weekly checkpoints with leadership and stakeholders to monitor and report progress and to document established metrics. However, the agency has not provided documentation demonstrating that it has measured and reported enterprise architecture outcomes.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Health and Human Services and Housing and Urban Development should ensure that enterprise architecture outcomes are periodically measured and reported to top agency officials.

Agency: Department of Health and Human Services
Status: Open

Comments: As of January 2020, the Department of Health and Human Services had not implemented this recommendation. Specifically, it had not demonstrated that it had measured architecture metrics that it had established in its April 2014 Enterprise Roadmap. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, and to assist agencies in measuring and reporting outcomes achieved through enterprise architecture, the Director of OMB should ensure that the planned December 2012 guidance for enterprise architecture value measurement and reporting includes (1) sufficient details on the method and metrics that agencies could use to measure their architecture program's value and (2) a requirement for agencies to include in their April 2013 enterprise roadmap submissions a measurement method (i.e., steps to be followed) and metrics, and report on the outcomes and benefits achieved through enterprise architecture.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: As of December 2019, the Office of Management and Budget (OMB) had not fully addressed our recommendation. In March 2013, the office required agencies to submit annually an Enterprise Roadmap, which was to include an appendix on enterprise architecture outcomes. To prepare the appendix, the office provided agencies with a template to document architecture metrics and measurement methods. The template included examples of outcome metrics and a field where agencies were to document measurement methods. However, OMB did not provide details on the methods that agencies could use to measure architecture outcomes or require that agencies include the steps to be followed for measuring outcomes. In March 2019, OMB said that it was working with agencies to determine approaches for measuring and reporting outcomes achieved through enterprise architecture. However, as of December 2019, OMB had not demonstrated that it had fully addressed the recommendation. We will continue to follow up with OMB on its efforts to implement the recommendation.