Reports & Testimonies

  • GAO’s recommendations database contains report recommendations that still need to be addressed.

    GAO’s recommendations help congressional and agency leaders prepare for appropriations and oversight activities, as well as help improve government operations. Recommendations remain open until they are designated as Closed-implemented or Closed-not implemented. You can explore open recommendations by searching or browsing.

    GAO's priority recommendations are those that we believe warrant priority attention. We sent letters to the heads of key departments and agencies, urging them to continue focusing on these issues. These recommendations are labeled as such. You can find priority recommendations by searching or browsing our open recommendations below, or through our mobile app.

  • Browse Open Recommendations

    Explore priority recommendations by subject terms or browse by federal agency

    Search Open Recommendations

    Search for a specific priority recommendation by word or phrase



  • Governing on the go?

    Our Priorities for Policy Makers app makes it easier for leaders to search our recommendations on the go.

    See the November 10th Press Release


  • Have a Question about a Recommendation?

    • For questions about a specific recommendation, contact the person or office listed with the recommendation.
    • For general information about recommendations, contact GAO's Audit Policy and Quality Assurance office at (202) 512-6100 or apqa@gao.gov.
  • « Back to Results List Sort by   

    Results:

    Subject Term: "Military departments"

    26 publications with a total of 60 open recommendations including 12 priority recommendations
    Director: Marie A. Mak
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To help increase efficiency when defining FMS requirements to be placed on contract, the Secretary of Defense should issue department-wide guidance for the military departments and DOD components to expand the use of requirements checklists to develop more comprehensive letters of request for FMS cases.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Andrew J Von Ah
    Phone: (213) 830-1011

    1 open recommendations
    Recommendation: To minimize unnecessary overlap and duplication and more efficiently use DOD's U.S. distribution centers, the Secretary of Defense should direct the Under Secretary of Defense for Acquisition, Technology, and Logistics (or the subsequent Under Secretary for Acquisition and Sustainment), in conjunction with the Director of DLA, and the Secretaries of the Army, the Air Force, and the Navy, to assess and direct the implementation of actions, as appropriate, that can be taken using existing authorities to close, realign, or dispose of existing infrastructure.

    Agency: Department of Defense
    Status: Open

    Comments: We are awaiting confirmation from the agency on what actions have been taken in response to this recommendation. Once received, we will provide the updated information.
    Director: Brian J. Lepore
    Phone: (202) 512-4523

    2 open recommendations
    Recommendation: To assist DOD and Congress in their oversight of DOD's alternatively financed energy projects, the Secretary of Defense should direct the military services to collect complete and accurate data on their alternatively financed energy projects, including data on the services' financial obligations and cost savings, and provide the data to DOD at least annually to aid departmental oversight.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred with our recommendation that the Secretary of Defense direct the military services to collect complete and accurate data on their alternatively financed energy projects and provide the data to DOD at least annually. On July 21, 2017, DOD confirmed that its response had not changed.
    Recommendation: To help ensure that the military departments conduct the level of assessment required to assure the performance of their UESC projects over the life of the contract, the Secretary of Defense should direct the Office of the Assistant Secretary of Defense (Energy, Installations and Environment) to update its guidance to clarify the requirements for the verification of savings for UESC projects.

    Agency: Department of Defense
    Status: Open

    Comments: DOD nonconcurred with our recommendation. We continue to believe that the recommendation is valid because, in the absence of updated and clear guidance, the military services will likely continue to take inconsistent approaches to assuring the performance of UESC projects, which could limit DOD's visibility over projects that commit the departments to long-term payments. On July 21, 2017, DOD confirmed that its response had not changed.
    Director: Brian J. Lepore
    Phone: (202) 512-4523

    3 open recommendations
    Recommendation: In order to help ensure that DOD and the military departments are providing timely and consistent information on privately financed construction projects to Congress under DOD Instruction 7700.18, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness--in collaboration with any other relevant DOD stakeholders--to identify the categories of privately financed construction projects, including gifts of major construction, that should be reported through the process outlined in DOD Instruction 7700.18; revise DOD Instruction 7700.18 and any other related policies, as appropriate, to clarify which project types are to be included in and excluded from this reporting process; and require that the military departments update their relevant policies to incorporate the revised policy.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: In order to ensure that Congress receives all desired information on all gifts of major construction in a timely manner, the Secretary of Defense--in collaboration with any other relevant DOD stakeholders--should identify the lead organization(s) within DOD that will be responsible for developing DOD-wide policy for reporting gifts of major construction that are not reported through the process outlined in DOD Instruction 7700.18, as appropriate.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: In order to ensure that Congress receives all desired information on all gifts of major construction in a timely manner, the Secretary of Defense--in collaboration with any other relevant DOD stakeholders--should establish DOD-wide policy, as appropriate, on congressional notification of gifts of major construction to cover all such gifts that are not to be reported to Congress through the process outlined in DOD Instruction 7700.18, and require that the military departments update their gift acceptance policies--and any other relevant policies--to incorporate procedures to support DOD's notification requirements.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Zina D. Merritt
    Phone: (202) 512-5257

    3 open recommendations
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and as part of DOD's strategic planning process, should define a role for the military department CMOs or DCMOs in developing department-wide goals and objectives for business transformation.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and as part of DOD's strategic planning process, should coordinate with the military department CMOs or DCMOs to align the military departments' goals and objectives for business transformation with department-wide goals and objectives, including in DOD's Agency Strategic Plan.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and in coordination with the DOD DCMO, should take action, as appropriate and necessary, to improve the monitoring of the military departments' performance on business transformation efforts. This could be done by revising the Defense Business Council's charter to make the council responsible for monitoring such performance to reflect the responsibilities of the DOD DCMO to monitor performance across the entire department.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Merritt, Zina Dache
    Phone: (202) 512-5257

    2 open recommendations
    Recommendation: To implement DOD guidance requiring the military departments to prepare readiness and Operation and Maintenance (O&M) budget impact assessments during drawdown planning, the Secretary of Defense should direct the Secretaries of the military departments to develop guidance that assigns responsibility for the preparation of impact assessments and includes direction on how such assessments should be conducted as part of drawdown planning.

    Agency: Department of Defense
    Status: Open

    Comments: In commenting on the draft report, DOD concurred with the recommendation.
    Recommendation: To implement DOD guidance requiring the military departments to prepare readiness and O&M budget impact assessments during drawdown planning, the Secretary of Defense should direct the Director, DSCA, to develop an internal control mechanism to determine whether the military departments have completed the required impact assessments before moving forward with drawdown planning and execution.

    Agency: Department of Defense
    Status: Open

    Comments: In commenting on the draft report, DOD concurred with the recommendation.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    1 open recommendations
    Recommendation: To help support DOD management of its FECA responsibilities, the Secretary of Defense should direct the Office of the Under Secretary of Defense for Personnel and Readiness, in collaboration with the Secretaries of the military departments and other defense agency leaders, to monitor timelines associated with significant FECA claims-management actions in order to identify the extent to which delays or inefficiencies may be occurring and at what points in the process; to identify any known reasons for the delays; and to communicate this information to DOL as appropriate for consideration and action.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: John H. Pendleton
    Phone: (202) 512-3489

    2 open recommendations
    including 1 priority recommendation
    Recommendation: To further DOD's efforts to identify opportunities for more efficient use of headquarters-related resources, the Secretary of Defense should direct the Deputy Chief Management Officer, in coordination with the Under Secretary of Defense for Personnel and Readiness, the Chairman of the Joint Chiefs of Staff, the Secretaries of the military departments, and the heads of the defense agencies and DOD field activities, to align DOD's data on department-wide military and civilian positions that have headquarters-related DOD function codes with the revised definition of major DOD headquarters activities in order to provide the department with reliable data to accurately assess headquarters functions and identify opportunities for streamlining or further analysis.

    Agency: Department of Defense
    Status: Open

    Comments: On August 16, 2016, DOD stated that it confirms the written comments it had provided in the report. In its response, DOD stated that it is currently updating civilian and military manpower and total obligation authority baselines for major DOD headquarters activities to align with the new headquarters-related definition and framework. The department stated that this effort includes updating data architecture for coding major DOD headquarters activities, by program element code, in the Future Years Defense Program, and noted that this data architecture will serve as the authoritative methodology to account for headquarters manpower and resources in the future. Further, DOD stated that, once those efforts are complete and the new framework is codified in an update to DOD Instruction 5100.73, the department will determine how best to align the function code taxonomy, which is the source of data for the IGCA Inventory, with the revised framework and definitions. We agree that determining how to align the data set from the IGCA Inventory with the revised framework and definitions is an important first step and, if implemented, would address the intent of our first recommendation.
    Recommendation: To further DOD's efforts to identify opportunities for more efficient use of headquarters-related resources, the Secretary of Defense should direct the Deputy Chief Management Officer, in coordination with the Under Secretary of Defense for Personnel and Readiness, the Chairman of the Joint Chiefs of Staff, the Secretaries of the military departments, and the heads of the defense agencies and DOD field activities, to, once this definition is published in DOD guidance, collect reliable information on the costs associated with functions within headquarters organizations--through revisions to the Inherently Governmental / Commercial Activities Inventory or another method--in order to provide the department with detailed information for use in estimating resources associated with specific headquarters functions, and in making decisions, monitoring performance, and allocating resources.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: As of June 2017, DOD had not completed action on this recommendation. DOD concurred with our recommendation, stating that once it has completed efforts to update data architecture for coding major DOD headquarters activities in the Future Years Defense Program, and codifies the new framework in an update to DOD Instruction 5100.73, the department will determine how best to align the function code taxonomy, which is the source of data for the Inherently Governmental Commercial Activities Inventory, with the revised framework.
    Director: Timothy J. DiNapoli
    Phone: (202) 512-4841

    4 open recommendations
    including 3 priority recommendations
    Recommendation: Given that the intent of section 235 of Title 10 United States Code was to provide both DOD and Congress with increased oversight of the procurement of services, Congress should consider revising the section to require that DOD report on its projected spending beyond the budget year and consistent with the time period covered by the future year defense program.

    Agency: Congress
    Status: Open

    Comments: Congress has not revised section 235 of Title 10 United States Code. GAO will continue to monitor this matter for Congressional consideration.
    Recommendation: To ensure that senior leadership within the Office of the Secretary of Defense and the military departments are better positioned to make informed decisions regarding the volume and type of services that should be acquired over the future year defense program, the Secretaries of the Army, Navy, and Air Force should revise their programming guidance to collect information on how contracted services will be used to meet requirements beyond the budget year.

    Agency: Department of Defense: Department of the Air Force
    Status: Open
    Priority recommendation

    Comments: As of July 2017, DOD staff from the programming and budgeting communities have initiated discussions on how to improve consideration of services beyond the budget year. The Air Force, however, has not identified any specific steps to modify their programming guidance.
    Recommendation: To ensure that senior leadership within the Office of the Secretary of Defense and the military departments are better positioned to make informed decisions regarding the volume and type of services that should be acquired over the future year defense program, the Secretaries of the Army, Navy, and Air Force should revise their programming guidance to collect information on how contracted services will be used to meet requirements beyond the budget year.

    Agency: Department of Defense: Department of the Navy
    Status: Open
    Priority recommendation

    Comments: As of July 2017, DOD staff from the programming and budgeting communities have initiated discussions on how to improve consideration of services beyond the budget year. The Air Force, however, has not identified any specific steps to modify their programming guidance.
    Recommendation: To ensure the military departments' efforts to integrate services into the programming process and senior service managers efforts to develop forecasts on service contract spending provide the department with consistent data, the Secretary of Defense should establish a mechanism, such as a working group of key stakeholders--which could include officials from the programming, budgeting and requirements communities as well as the senior services managers--to coordinate these efforts.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: As of July 2017, DOD has not taken specific action(s) to address the recommendation. We will continue to monitor this recommendation.
    Director: Brian J. Lepore
    Phone: (202) 512-4523

    4 open recommendations
    including 1 priority recommendation
    Recommendation: To make further progress toward taking full advantage of the opportunity of consolidating training in order to increase jointness following the implementation of the BRAC 2005 recommendations, for the training functions that did not consolidate training beyond colocation, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness and the Secretaries of the military departments to provide guidance to the program managers on consolidating training, if DOD decides that taking advantage of an opportunity to increase jointness is still appropriate.

    Agency: Department of Defense
    Status: Open

    Comments: DOD did not concur with our first recommendation, to provide guidance to the program managers of the training functions created under BRAC 2005 on consolidating training. As of October 2017, DOD has not completed any actions to implement this recommendation.
    Recommendation: To improve the ability of the military departments to take advantage of any opportunities provided by recommendations to develop joint training capabilities in a future BRAC round, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness--in consultation with the Assistant Secretary of Defense for Energy, Installations, and Environment--to develop and provide specific guidance for the military departments to use in implementing recommendations designed to consolidate training to increase jointness.

    Agency: Department of Defense
    Status: Open

    Comments: DOD did not concur with our second recommendation to develop and provide specific guidance for the military departments to use in implementing recommendations designed to consolidate training to increase jointness in the event of future BRAC rounds. As of October 2017, DOD has not completed any actions to implement this recommendation.
    Recommendation: To improve DOD's ability to estimate savings, if any, from future consolidation of training--including any consolidation resulting from a future BRAC round--the Secretary of Defense should direct the military departments to develop baseline cost data.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: DOD did not concur with the recommendation to develop baseline cost data in the event of any future consolidation of training. As of October 2017, DOD has not completed any actions to implement this recommendation.
    Recommendation: To improve the accounting of any future BRAC rounds, the Secretary of Defense should direct the Assistant Secretary of Defense for Energy, Installations, and Environment to issue guidance clarifying what costs should be included in final BRAC accounting.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with our fourth recommendation, to issue clarifying guidance regarding what costs should be included in final BRAC accounting. As of October 2017, DOD has not completed any actions to implement this recommendation. A DOD official stated that any action will be dependent on a future BRAC round and an oversight process similar to the 2005 BRAC round.
    Director: Timothy J. DiNapoli
    Phone: (202) 512-4841

    3 open recommendations
    Recommendation: To ensure proposed contract activities, as reflected in the statement of work and other contract documents, are assessed against the criteria provided by the Federal Acquisition Regulation (FAR) and Office of Federal Procurement Policy (OFPP) policy, the Under Secretary for Defense for Acquisition, Technology, and Logistics should ensure that the Director of the Office of Defense Procurement and Acquisition Policy provide clear instructions, in a timely manner, on how the service requirement review boards are to identify whether contract activities include closely associated with inherently governmental functions.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: DOD Instruction 5000.74, issued in January 2016, discusses processes for the services requirements review boards, but does not mention closely associated with inherently governmental functions in that context. As new policy or guidance is issued, we will continue to evaluate its responsiveness to this recommendation.
    Recommendation: To ensure proposed contract activities, as reflected in the statement of work and other contract documents, are assessed against the criteria provided by the FAR and OFPP policy, the Under Secretary for Defense for Acquisition, Technology, and Logistics should ensure that the Director of the Office of Defense Procurement and Acquisition Policy require acquisition officials to document, prior to contract award, whether the proposed contract action includes activities that are closely associated with inherently governmental functions.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: According to DOD officials, a template is being developed for components to use in assessing a service contract to determine whether activities are closely associated with inherently governmental functions. However, this template has not yet been finalized or disseminated to the components.
    Recommendation: To help facilitate the collection and use of inventory data in decision-making processes, the Under Secretary of Defense for Personnel and Readiness should clearly identify the longer term relationships between the support office, military departments, and other stakeholders.

    Agency: Department of Defense: Office of the Under Secretary for Personnel and Readiness
    Status: Open

    Comments: As of June 2017, these longer term relationships have not been fully identified. Officials stated that a memorandum of understanding issued in January 2017 provided some clarity regarding these relationships, but that additional steps are needed.
    Director: Timothy J. DiNapoli
    Phone: (202) 512-4841

    13 open recommendations
    including 6 priority recommendations
    Recommendation: To improve efforts to strategically source IT services within the Army, the Secretary of the Army should direct its strategic sourcing accountable official to conduct a comprehensive analysis of Army IT services spending to determine the extent to which requirements can be addressed by Computer Hardware, Enterprise Software and Solutions (CHESS) or other strategic sourcing approaches, and based on this analysis, consider opportunities to reduce duplicative contracts.

    Agency: Department of Defense: Department of the Army
    Status: Open
    Priority recommendation

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Army, the Secretary of the Army should direct its strategic sourcing accountable official to implement utilization metrics and mandatory use or consideration policies.

    Agency: Department of Defense: Department of the Army
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Army, the Secretary of the Army should direct its strategic sourcing accountable official to develop guidance and overarching goals and metrics for savings.

    Agency: Department of Defense: Department of the Army
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Army, the Secretary of the Army should direct its strategic sourcing accountable official to conduct a review of the benefits and disadvantages of standardized labor categories for CHESS or future contracts.

    Agency: Department of Defense: Department of the Army
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Navy, the Secretary of the Navy should direct its strategic sourcing accountable official to conduct a comprehensive analysis of IT services spending to determine the extent to which requirements can be addressed by the existing contracts or other strategic sourcing approaches and based on this analysis, reduce duplicative contracts.

    Agency: Department of Defense: Department of the Navy
    Status: Open
    Priority recommendation

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Navy, the Secretary of the Navy should direct its strategic sourcing accountable official to implement utilization metrics and monitor agency efforts to comply with the Navy's existing use policies for IT services.

    Agency: Department of Defense: Department of the Navy
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Air Force, the Secretary of the Air Force should direct its strategic sourcing accountable to conduct a comprehensive analysis of IT services spending to determine the extent to which requirements can be addressed by Network-Centric Solutions (NETCENTS) or other strategic sourcing approaches, and based on this analysis, reduce duplicative contracts.

    Agency: Department of Defense: Department of the Air Force
    Status: Open
    Priority recommendation

    Comments: DOD concurred with our three recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Air Force, the Secretary of the Air Force should direct its strategic sourcing accountable to implement utilization metrics.

    Agency: Department of Defense: Department of the Air Force
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Air Force, the Secretary of the Air Force should direct its strategic sourcing accountable to develop guidance and overarching goals and metrics for savings.

    Agency: Department of Defense: Department of the Air Force
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within the Air Force, the Secretary of the Air Force should direct its strategic sourcing accountable to conduct a review of the benefits and disadvantages of standardized labor categories for primary strategic sourcing vehicles such as NETCENTS.

    Agency: Department of Defense: Department of the Air Force
    Status: Open

    Comments: DOD concurred with our recommendations. To fully implement these recommendations, DOD should complete analyses of information technology services spending, reduce duplicative contracts where appropriate, and establish metrics to monitor progress and assess compliance with existing IT services use policies.
    Recommendation: To improve efforts to strategically source IT services within NASA, the Administrator of NASA should direct its strategic sourcing accountable official to use its 2014 spend analysis to determine the extent to which requirements can be addressed by the IT Infrastructure Integration Program or other strategic sourcing approaches, and based on this analysis, reduce duplicative contracts.

    Agency: National Aeronautics and Space Administration
    Status: Open
    Priority recommendation

    Comments: NASA agreed with this recommendation. To fully implement it, NASA needs to successfully implement its planned actions, including (1) implement new strategic sourcing policies in the NASA federal acquisition regulation supplement, (2) revise the 2014 spend analysis by December 14, 2017, and (3) require strategic sourcing of IT services by December 2018 for services such as mobile communications, telecommunications, cloud computing, and seat management.
    Recommendation: To improve efforts to strategically source IT services within NASA, the Administrator of NASA should direct its strategic sourcing accountable official to implement utilization metrics and mandatory use policies.

    Agency: National Aeronautics and Space Administration
    Status: Open
    Priority recommendation

    Comments: NASA partially agreed with this recommendation. Specifically, NASA agreed to establish metrics, but sought to employ mandatory consideration policies, where applicable, instead of mandatory use policies. We agreed that the proposed approach would meet the intent of our recommendation. To fully implement this recommendation, NASA needs to successfully implement its planned actions, including (1) revising the NASA strategic sourcing guide to include establishment of utilization metrics, and (2) issuing updated strategic sourcing policies in the NASA federal acquisition regulation supplement to include mandatory use policies.
    Recommendation: To improve efforts to strategically source IT services within NASA, the Administrator of NASA should direct its strategic sourcing accountable official to develop guidance and overarching goals and metrics for savings.

    Agency: National Aeronautics and Space Administration
    Status: Open
    Priority recommendation

    Comments: NASA agreed with this recommendation. To fully implement this recommendation, NASA needs to successfully implement its planned actions, including (1) issuing updated strategic sourcing policies in the NASA federal acquisition regulation supplement, (2) updating its strategic sourcing website, and (3) updating the NASA strategic sourcing guide to include the setting of goals or baselines as a method of evaluating the strategic sourcing approach.
    Director: Timothy J. DiNapoli
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To maximize the potential value of the MPNDI pilot program, the Under Secretary of Defense for Acquisition, Technology and Logistics should identify whether there are opportunities to test flexibilities or streamlined procedures that are not otherwise available under existing authorities.

    Agency: Department of Defense: Office of the Under Secretary of Defense for Acquisition, Technology and Logistics
    Status: Open

    Comments: Congress expanded the applicability of the pilot program in Section 892 of the National Defense Authorization Act for Fiscal Year 2016. DOD has not yet identified if opportunities exist to test flexibilities or streamlined procedures that are not otherwise available under existing authorities, including under the expanded pilot program.
    Director: Marie A. Mak
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To ensure the management of the required portfolio of contract services and that required reductions are achieved the Secretary of Defense should evaluate fiscal controls used by the military departments to identify effective practices and ensure they are consistently implemented to improve the management of contract services spending.

    Agency: Department of Defense
    Status: Open

    Comments: In commenting on this report DOD concurred with this recommendation but has not yet provided information necessary to demonstrate its implementation.
    Director: Timothy J.DiNapoli
    Phone: (202) 512-4841

    4 open recommendations
    Recommendation: To help facilitate the department's stated intent to develop a common data collection system to fully collect statutorily required data, the Under Secretary of Defense for Personnel and Readiness should approve a plan of action, with timeframes and milestones, for rolling out and supporting a department-wide data collection system as soon as practicable after December 1, 2014. Should a decision be made to use or develop a system other than the Enterprise-wide Contractor Manpower Reporting Application system currently being fielded, the Under Secretary of Defense for Personnel and Readiness should document the rationale for doing so and ensure that the new approach will provide data that satisfies the statutory requirements for the inventory.

    Agency: Department of Defense: Office of the Under Secretary for Personnel and Readiness
    Status: Open

    Comments: The Department has taken initial steps toward supporting the Enterprise-wide Contractor Manpower Reporting Application (ECMRA) by signing a Memorandum of Agreement that, in part, outlines responsibilities related to hosting, operating, and maintaining the ECMRA system, as well as by hiring key staff. However, it has not fully developed a plan of action, with timeframes and milestones, for supporting the system. We will continue to monitor the Department's progress.
    Recommendation: To help ensure that the inventory of contracted services is integrated into key management decisions as statutorily required, the Secretaries of the Army, Navy, and Air Force should identify an accountable official within their departments with responsibility for leading and coordinating efforts across their manpower, budgeting, and acquisition functional communities and, as appropriate, revise guidance, develop plans and enforcement mechanisms, and establish processes.

    Agency: Department of Defense: Department of the Air Force
    Status: Open

    Comments: As of March 2016, DOD guidance on the inventory of contracted services requires the designation of an accountable official. As of the summer of 2017, the Department of the Air Force has not yet designated an accountable official.
    Recommendation: To help ensure that the inventory of contracted services is integrated into key management decisions as statutorily required, the Secretaries of the Army, Navy, and Air Force should identify an accountable official within their departments with responsibility for leading and coordinating efforts across their manpower, budgeting, and acquisition functional communities and, as appropriate, revise guidance, develop plans and enforcement mechanisms, and establish processes.

    Agency: Department of Defense: Department of the Navy
    Status: Open

    Comments: As of March 2016, DOD guidance on the inventory of contracted services requires the designation of an accountable official. As of the summer of 2017, the Department of the Navy has not yet designated an accountable official.
    Recommendation: To help ensure that the inventory of contracted services is integrated into key management decisions as statutorily required, the Secretaries of the Army, Navy, and Air Force should identify an accountable official within their departments with responsibility for leading and coordinating efforts across their manpower, budgeting, and acquisition functional communities and, as appropriate, revise guidance, develop plans and enforcement mechanisms, and establish processes.

    Agency: Department of Defense: Department of the Army
    Status: Open

    Comments: As of March 2016, DOD guidance on the inventory of contracted services requires the designation of an accountable official. As of the summer of 2017, the Department of the Army has not yet designated an accountable official.
    Director: Zina Merritt
    Phone: (202) 512-5257

    2 open recommendations
    Recommendation: To enhance DOD's ability to make consistent and informed decisions in its management of the TCC program in accordance with internal control standards, the Under Secretary of Defense for Acquisition, Technology and Logistics should require the Director, Corrosion Policy and Oversight Office, to track and maintain accurate records that include amounts of funds used for the TCC program, and have them readily available for examination to ensure that funding data will be accurately accounted for and reported in future reports, such as the annual budget report to Congress.

    Agency: Department of Defense: Office of the Under Secretary of Defense for Acquisition, Technology and Logistics
    Status: Open

    Comments: DOD's Corrosion Office has consistently maintained that there was initially some inconsistency in financial reporting. The office plans to implement internal controls to identify and document budget categories for each financial transaction executed which will improve timeliness of reporting.
    Recommendation: To enhance DOD's ability to make consistent and informed decisions in its management of the TCC program in accordance with internal control standards, the Under Secretary of Defense for Acquisition, Technology and Logistics should require the Director, Corrosion Policy and Oversight Office, to document the procedures for selecting and approving military research labs supporting civilian and military institutions in conducting projects within the TCC program.

    Agency: Department of Defense: Office of the Under Secretary of Defense for Acquisition, Technology and Logistics
    Status: Open

    Comments: DOD's Corrosion Office has consistently maintained that its existing process is adequately documented in the DOD Corrosion Prevention and Mitigation Strategic Plan and the Technical Corrosion Collaboration (TCC) Definitions Document. However, DOD plans to update the Appendix C "Technical Corrosion Collaboration" of the DOD Corrosion Prevention and Mitigation Strategic Plan to add additional details regarding the procedures for selecting and approving military research labs supporting civilian and military institutions in conducting projects.
    Director: Pendleton, John H
    Phone: 202-512-3489

    1 open recommendations
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to revise its guidance on imminent danger pay area designations to include specific time frames for completing periodic reviews of imminent danger pay area designations.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Sullivan, Michael J
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To improve tracking and reporting of technology transition outcomes for SBIR projects, the Secretary of Defense should direct the Office of Small Business Programs to establish a common definition of technology transition for all SBIR projects to support annual reporting requirements.

    Agency: Department of Defense
    Status: Open

    Comments: DOD Small Business Innovation Research (SBIR) officials stated they have come up with a standard definition of technology transition as the production and delivery (whether by the originating party or by others) of products, processes, technologies, or services for sale to or use by the Federal Government or a Contractor in support of a Government requirement. Despite repeated attempted at obtaining documentary evidence of this action, we have not received any response from DOD and until documentation is provided this recommendation will remain open.
    Director: Dinapoli, Timothy J
    Phone: (202) 512-4841

    3 open recommendations
    Recommendation: To better position DOD to determine whether its actions have improved service acquisition, the Principal Deputy Under Secretary of Defense for Acquisition, Technology, and Logistics, in consultation with the military departments' senior services managers, should identify baseline data on the status of service acquisition, in part, by using budget and spending data and leveraging its ongoing efforts to gauge the effects of its actions to improve service acquisition.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: DOD concurred with our recommendation and is in the process of developing baseline data on the current status of its service acquisitions. In July 2014, DOD issued its annual Performance of the Defense Acquisition report. For the first time, this report included information on its contracted services, such obligations for each service portfolio group, competition rates, and small business participation information. DOD expects to develop service acquisition related goals and metrics in 2017 from which it can develop additional baseline data.
    Recommendation: To better position DOD to determine whether its actions have improved service acquisition, the Principal Deputy Under Secretary of Defense for Acquisition, Technology, and Logistics, in consultation with the military departments' senior services managers, should develop specific goals associated with their actions to improve service acquisition.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: DOD concurred with our recommendation and is in the process of developing service acquisition goals and metrics as well as an action plan for improving service acquisition. As of February 2017, DOD began a review of internal guidance that will include an analysis of the roles, responsibilities, authorities, goals, metrics, and structure associated with managing service acquisitions.
    Recommendation: To better position DOD to determine whether its actions have improved service acquisition, the Principal Deputy Under Secretary of Defense for Acquisition, Technology, and Logistics, in consultation with the military departments' senior services managers, should establish metrics to assess progress in meeting these goals.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: DOD concurred with our recommendation and is in the process of developing service acquisition goals and metrics as well as an action plan for improving service acquisition. As of February 2017, DOD began a review of internal guidance that will include an analysis of the roles, responsibilities, authorities, goals, metrics, and structure associated with managing service acquisitions.
    Director: Mctigue, James R Jr
    Phone: (202) 512-7968

    1 open recommendations
    Recommendation: Further, to provide greater assurance that the military departments will meet reporting milestones for future projects, the Under Secretary of Defense for Acquisition, Technology, and Logistics--in coordination with the Director of the Office of Corrosion Policy and Oversight-- should revise corrosion-related guidance to clearly define a role for the military departments' Corrosion Control and Prevention Executives to assist the Office of Corrosion Policy and Oversight in holding their departments' project management offices accountable for submitting infrastructure-related reports in accordance with the DOD Corrosion Prevention and Mitigation Strategic Plan.

    Agency: Department of Defense: Office of the Secretary of Defense: Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics
    Status: Open

    Comments: On July 24, 2013, DOD reported that it non-concurred with our recommendation. DOD reported that the Military Department Corrosion Control and Prevention Executives are given the freedom to manage their programs in the most efficient and effective manner for their respective departments. Additionally, DOD reported that the Corrosion Control and Prevention Executives know the reporting requirements and are working closely with the Corrosion Policy and Oversight Office and the project managers to ensure reports are submitted in accordance with the DoD Corrosion Prevention and Mitigation Strategic Plan. Therefore, DOD reported that further guidance is not necessary as the requirements are already clearly stated in the DoD Corrosion Prevention and Mitigation Strategic Plan. Our audit work showed that DOD's strategic plan and guidance do not define a role for the Corrosion Executives in assisting the Corrosion Office in the project reporting process. Our recommendation was intended to fortify the role of Corrosion Executives in ensuring that project management offices within the Corrosion Executives' respective military departments submit project reports as required in the strategic plan. We continue to believe that the Corrosion Executives could provide the additional management oversight necessary to strengthen corrosion project reporting. In May 2016, the Senate Armed Services Committee informed us that it have included language in its National Defense Authorization Act Bill for fiscal year 2017. Specifically, the language reads: SEC. 312. REVISION OF GUIDANCE RELATED TO CORROSION CONTROL AND PREVENTION EXECUTIVES. Not later than 90 days after the date of the enactment of this Act, the Under Secretary of Defense for Acquisition, Technology, and Logistics, in coordination with the Director of Corrosion Policy and Oversight, shall revise corrosion-related guidance to clearly define the role of the corrosion control and prevention executives of the military departments in assisting the Office of Corrosion Policy and Oversight in holding the appropriate project management office in each military department accountable for submitting the report required under section 903(b)(5) of the Duncan Hunter National Defense Authorization Act for Fiscal Year 2009 (Public Law 110-417; 10 U.S.C. 2228 note) with an expanded emphasis on infrastructure, as required in the long-term strategy of the Department of Defense under section 2228(d) of title 10, United States Code. As of October 2016, legislation was not passed.
    Director: Sullivan, Michael J
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To improve visibility and management of the department's efforts to transition technologies to support the needs of the warfighter, the Secretary of Defense should require that all technology transition programs track and measure project outcomes, to include not only whether technologies transitioned to an intended user but also the longer-term impact of whether the technologies benefitted acquisition programs or military users in the field.

    Agency: Department of Defense
    Status: Open

    Comments: In commenting on GAO's recommendation, DOD indicated it would continue to anecdotally measure the results of technology investments for 3, 5, or even 10 years after investment and highlight the long-term benefits, as needed, to validate the investment levels associated with the research and development programs. However, the department did not plan to formally require its technology transition programs to track and measure project outcomes, noting concern that tracking and measuring outcomes for hundreds of technology projects would be a labor-intensive and very time-consuming process. DOD's own tracking of its response to this recommendation indicates no planned action and considers the recommendation closed. Nevertheless, GAO continues to monitor the department's activities related to technology transition, as several ongoing DOD efforts may eventually sufficiently address the intent of this recommendation. For example, DOD continues to pursue improvement to technology transition as part of its Better Buying Power 3.0 initiative. This includes a best practices handbook that is expected to address ways to increase collaboration between DOD and commercial industry and, among other things, support technology transition. In August 2017, the Defense Laboratory Office within the Office of the Assistant Secretary of Defense for Research and Engineering confirmed that the handbook, which was stated in summer 2016 to be nearly finalized, stalled out in its completion for an unknown reason and remains on hold. Interest remains in completing it but no definitive plans exist for when that may occur. We will continue to monitor DOD's efforts to track and measure technology transition outcomes, particularly as they relate to completing the handbook, as previous indications were that the handbook could potentially fulfill the intent of our recommendation.
    Director: Russell, Cary B
    Phone: (202)512-5431

    1 open recommendations
    Recommendation: To better ensure camouflage uniforms being developed by the military services meet mission requirements, the Secretary of Defense should direct the Under Secretary of Defense for Acquisition, Technology, and Logistics to ensure that the services have and consistently use clear policies and procedures and a knowledge-based approach to produce successful outcomes.

    Agency: Department of Defense
    Status: Open

    Comments: In response to our recommendation, the Deputy Assistant Secretary of a Defense for Supply Chain Integration (DASD (SCI)) stated that the Under Secretary of Defense for Acquisition, Technology and Logistics will place additional emphasis on the importance of following existing policies and procedures through oversight by the Joint Clothing and Textile Governance Board. The (DASD (SCI)) stated that existing guidance and the joint criteria, developed by the JCTGB, are sufficient and provide the policy and procedures necessary to ensure uniforms produce successful outcomes. The guidance on joint criteria states that future ground combat uniforms will use these criteria as the minimum standards during development and initial fielding. The official told us that they do not plan to develop any additional guidance to address our recommendation. However, based on review of DOD's actions thus far, it is not clear that the joint criteria and guidance alone will ensure that the services 1) consistently use existing policies and procedures to change their varying, fragmented processes, which in the past have not consistently ensured the development of effective camouflage uniforms, or 2) adopt a knowledge-based approach to manage uniform acquisition activities.
    Director: Farrell, Brenda S
    Phone: (202)512-3604

    1 open recommendations
    Recommendation: To help ensure that Congress has the necessary information to provide effective oversight over all of DOD's civilian senior leader workforces, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness and the Under Secretary of Defense for Intelligence to conduct assessments of the skills, competencies, and gaps within all five career civilian senior leader workforces and report them in DOD's future strategic workforce plans.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials with the Office of the Under Secretary of Defense (Intelligence) Human Capital Management Office stated that development of criteria for assessing the skills, competencies, and gaps of the department's Defense Intelligence Senior Executive Service and Defense Intelligence Senior Level workforces had been completed. According to the officials, the criteria will be included in the department's senior leader management policies and fully implemented once the Office of the Under Secretary of Defense (Personnel and Readiness) completes development, revision, and publication of other DOD related civilian senior leader management policies that the revised Defense Intelligence civilian senior leader policy references. Update 9/2016: Officials from the Strategic Human Capital Planning Division indicated that a future strategic plan will address GAO's recommendation. Officials indicated that the plan is expected to be released in Fall 2016.
    Director: Martin, Belva M
    Phone: (202)512-3000

    1 open recommendations
    Recommendation: To help inform DOD's use of long-term maintenance contracts, the Secretary of Defense should direct the Under Secretary of Defense for Acquisition, Technology, and Logistics, in coordination with cognizant offices within each of the military departments, to collect and analyze information on the use of long-term maintenance contracts by major weapon system programs.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, DOD concurred with this recommendation and has since taken actions which may support the collection and analysis of long-term maintenance contracts. In January 2017, DOD's Office of Cost Assessment and Program Evaluation (CAPE) issued a memorandum stating its intent to update existing policies and systems to prescribe policies and procedures for the conduct of cost estimation and cost analysis for acquisition programs. Among the initiatives discussed in the memorandum is an updated approach to collect sustainment data through Contractor Cost Data Reporting (CCDR) in order to provide better information to support competing sustainment alternatives and approaches. According to officials from the Office of the Deputy Assistant Secretary of Defense for Materiel Readiness (MR), this step will expand the data collected from contractors on maintenance contracts and will include reporting on the use of award terms and other incentives for their maintenance contracts in the CCDR system. Data item descriptions for these reports have been developed by the department but have not yet been implemented to support maintenance contract data collection. This guidance is expected to approved by the end of 2017.
    Director: Pendleton, John H
    Phone: (404) 679-1816

    1 open recommendations
    including 1 priority recommendation
    Recommendation: To improve DOD's ability to identify how many headquarters personnel it has, including military, civilian and contractor personnel, and improve the information Congress and DOD need to ensure that headquarters organizations are appropriately sized and overhead positions are reduced to the extent possible, the Secretary of Defense should direct the Director of Administration and Management, in consultation with the Under Secretary of Defense for Personnel and Readiness, to revise DOD Instruction 5100.73, Major DOD Headquarters Activities, to (1) include all major DOD headquarters activity organizations, (2) specify how contractors performing major DOD headquarters activity functions will be identified and included in headquarters reporting, (3) clarify how components are to compile the major DOD headquarters activities information needed to respond to the reporting requirements in section 1109 of the fiscal year 2010 National Defense Authorization Act, and (4) establish time frames for implementing the actions above to improve tracking and reporting headquarters resources.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: DOD partially concurred with this recommendation based on their understanding of the instruction. As of July 2017, DOD has not completed actions to address three of the four parts of this recommendation. (1) In August 2015, DOD stated that it has established a comprehensive definition of major DOD headquarters activities and will update the DOD Instruction defining major headquarters. According to DOD officials, this will include efforts to accurately and completely report all major DOD headquarters activity organizations. As of July 2017, DOD had not updated the instruction, DOD Instruction 5100.73.(2) DOD has made some progress toward better accounting for contractors but has not identified an approach to include contractors as part of its major DOD headquarters reporting, as GAO recommended in March 2012. In December 2011, DOD issued guidance on how components should account for contracted services. The guidance requires DOD to account for contracted services by the activity requiring the service rather than by the contracting activity, which would allow DOD to identify contractor full-time equivalents supporting major DOD headquarters activities. To implement its guidance, DOD established a single application, the Enterprise-wide Contractor Manpower Reporting Application (ECMRA), which is intended to facilitate overall management oversight of contracted services reporting and reviews. Officials stated that in October 2012, the Air Force and Navy took steps to establish ECMRA systems, modeled after the Army?s system, to collect data on contracted services by requiring activity, and that in August 2013, the Air Force made its system available for use by other defense agencies and DOD field activities. According to DOD officials, as data on contracted services are collected and reported through ECMRA systems, the department?s ability to report on contracted services by requiring activity should continue to improve. DOD officials further stated that as progress is made toward establishing ECMRA across the department, they plan to consider how to account for contractors performing headquarters functions as part of headquarters reporting. However, as of March 2017, DOD had not resolved issues with implementing ECMRA. For example, DOD had not outlined the relationships between a management support office, military departments, and other stakeholders to facilitate the collection and use of data from DOD?s inventory of contracted services in decision-making processes. In addition, DOD is in the process of defining the roles and responsibilities of the support office that is intended to help manage the inventory of contracted services reporting processes, and the department continues to explore options for an enhanced reporting system that may better meet user needs, in accordance with changes directed in The National Defense Authorization Act for Fiscal Year 2017. Until the department resolves the issues affecting the implementation of a common data system and identifies an approach to include contractors as part of its major DOD headquarters reporting, the department will not have complete information on headquarters staffing, which will likely hinder its ability to make informed management decisions about its headquarters resources. (3) DOD clarified how it would respond to section 1109 of the fiscal year 2010 National Defense Authorization Act to satisfy this part of the recommendation. (4) DOD has taken some steps to revise DOD Instruction 5100.73 but it does not expect to update the Instruction until this effort is complete. DOD has also not yet established time frames for determining how contractors are to be included in major DOD headquarters activity. As noted above, this instruction has not been updated as of July 2017.
    Director: Pickup, Sharon L
    Phone: (202)512-9619

    2 open recommendations
    Recommendation: To establish ongoing accountability and better leverage the unique positions of the CMO and DCMO to provide the leadership necessary to follow up the Secretary's recent efficiency initiative for the long term, the Secretary of Defense should assign specific roles and responsibilities to the CMO and DCMO for integrating the Secretary's efficiency initiative with ongoing reform efforts, overseeing its implementation, and otherwise institutionalizing the effort for the long term.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred with this recommendation, but did not specify the action it planned to take to implement the recommendation. Based on a review of all the memos related to the efficiencies and recent discussions with the Deputy Chief Management Officer and Under Secretary of Defense (Comptroller) offices, there is currently no guidance that formally assigns the DCMO and Comptroller responsibility for tracking and overseeing the implementation of the efficiency initiatives. However, during a March 2011 testimony before the Senate Armed Services Committee, the Comptroller stated that the Deputy Chief Management Officer (DCMO) and the Under Secretary of Defense (Comptroller) were assigned the task of monitoring the implementation of the efficiency initiative and report successes and problems to the Deputy Secretary of Defense, DOD's Chief Management Officer (CMO). Given the responsibilities, under statute and department guidance, related to improving the efficiency and effectiveness of business operations, the DCMO,in conjunction with the Under Secretary of Defense (Comptroller), is positioned to monitor, integrate, and otherwise institutionalize the Secretary of Defense's ongoing efficiency initiative. The recommendation remains unimplemented in the absence of formal guidance that institutionalizes the responsibilities of the CMO and DCMO. As of early September 2015, DOD has not yet issued formal guidance that assigns the CMO and DCMO these specific roles and responsibilities.
    Recommendation: To enhance DOD's ability to set strategic direction for its business transformation efforts, and better align and institutionalize its efforts to develop and implement plans and measure progress against established goals, the Secretary of Defense should direct the CMO to issue guidance to establish a strategic planning process with mechanisms---such as procedures and milestones---for routinely updating the SMP and military department business transformation plans. In particular, this guidance should include elements such as how DOD and the military departments---including the CMO, DCMO, and military department CMOs---will reach consensus on business priorities, coordinate review and approval of updates to plans, synchronize the development of plans with the budget process, and monitor the implementation of reform initiatives, and report progress, on a periodic basis, towards achieving established goals.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation. As of July 2013, DOD has not issued guidance to establish a strategic planning process with mechanisms, such as procedures and milestones, for routinely updating the Strategic Management Plan and the business transformation plans of the military departments. As of early September 2015, DOD has not yet issued guidance to establish a strategic planning process to update related business transformation plans.