Defense Acquisitions:

Senior Leaders Should Emphasize Key Practices to Improve Weapon System Reliability

GAO-20-151: Published: Jan 14, 2020. Publicly Released: Jan 14, 2020.

Additional Materials:

Contact:

Michele Mackin
(202) 512-4841
mackinm@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

DOD invests billions of dollars in its weapons systems and expects them to be reliable.

We spoke with commercial companies known for creating reliable products to find out how they achieve reliability, and found that they often focus on four key practices—such as involving reliability experts early in development. We looked at 7 DOD programs and found that they didn’t consistently follow these practices. Instead, they often prioritized producing systems faster.

We recommended that the Air Force, Army, and Navy emphasize key reliability practices when developing weapons systems.

F-35 Aircraft

Four F-35 aircraft in flight

Four F-35 aircraft in flight

Additional Materials:

Contact:

Michele Mackin
(202) 512-4841
mackinm@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

The commercial companies GAO reviewed proactively address reliability. They strive to identify reliability issues at the component level early in the development process to avoid expensive rework after producing an entire system. GAO found these companies focus on the following key practices:

1. Leveraging reliability engineers early and often

2. Establishing realistic reliability requirements

3. Emphasizing reliability with their suppliers

4. Employing reliability engineering activities to improve a system's design throughout development

GAO found that the seven Department of Defense (DOD) acquisition programs it reviewed did not consistently adhere to these key practices (see figure). These programs often prioritized schedule and cost over incorporating the key reliability practices, and these systems generally were not as reliable as promised.

Key Characteristics of Selected Acquisition Programs' Approach to Reliability

U:\Work in Process\Teams\FY20 Reports\CNSA\102948_151\Graphics\HL_v3-102948-laf.tif

In 2019, DOD highlighted in a policy memorandum the importance of emphasizing reliability with contractors. However, the other three key practices have not been similarly highlighted. DOD has taken steps to accelerate weapon system development, and decision-making authority has been delegated to the military services. In an environment emphasizing speed, without senior leadership focus on a broader range of key reliability practices, DOD runs the risk of delivering less reliable systems than promised to the warfighter and spending more than anticipated on rework and maintenance of major weapon systems.

Why GAO Did This Study

DOD invests tens of billions of dollars each year in major defense acquisition programs, designing and developing technologically advanced weapon systems that warfighters expect will meet specific performance requirements, including reliability requirements. Systems that are not reliable make it more difficult for warfighters to perform their missions.

GAO was asked to examine DOD weapon system reliability. This report addresses (1) how selected companies in the commercial sector address reliability, (2) how selected DOD acquisition programs addressed reliability, and (3) the extent to which DOD leadership has highlighted key reliability practices.

GAO collected information on leading commercial practices at the 2019 Reliability and Maintainability Symposium and from four commercial companies known for delivering reliable products. GAO also assessed how seven DOD acquisition programs—both older and newer, and representing all the military services—addressed reliability; reviewed key documents and interviewed knowledgeable officials; and reviewed reliability-related guidance and policy from senior DOD leaders.

What GAO Recommends

GAO recommends the Secretaries of the Air Force, Army, and Navy highlight the importance of three key reliability practices: leveraging reliability engineers, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. DOD agreed with GAO's recommendations.

For more information, contact Michele Mackin at (202) 512-4841 or mackinm@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Comments: The Air Force agreed with this recommendation and told us they will be updating Air Force Instruction AFI63-101/20-101 to ensure the inclusion of key practices to improve weapon system reliability, including leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. The Air Force said it plans to complete this effort by December 31, 2020.

    Recommendation: We recommend the Secretary of the Air Force issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 1)

    Agency Affected: Department of Defense: Department of the Air Force: Office of the Secretary of the Air Force

  2. Status: Closed - Implemented

    Comments: The Army agreed with this recommendation and in March 2020, the Assistant Secretary of the Army (Acquisition, Logistics, and Technology) (ASA (ALT)) signed a memorandum directing Program Executive Officers to emphasize the three key practices GAO had identified: leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development.

    Recommendation: We recommend the Secretary of the Army issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 2)

    Agency Affected: Department of Defense: Department of the Army: Office of the Secretary

  3. Status: Open

    Comments: The Navy agreed with this recommendation and told us they plan to address GAO's recommendation in two ways. First, they are developing a guidebook for program managers and leadership to emphasize the importance of leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. The Navy anticipates the guidebook will be completed by the end of fiscal year 2021. Second, the Navy plans to update the SECNAV 5000.2 when it is open for changes. They noted, this is dependent on the Office of the Secretary of Defense (OSD) completing its ongoing update to DOD-wide acquisition guidance. The Navy anticipates OSD's efforts will be completed by end of calendar year 2020.

    Recommendation: We recommend the Secretary of the Navy issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 3)

    Agency Affected: Department of Defense: Department of the Navy: Office of the Secretary

 

Explore the full database of GAO's Open Recommendations »

Feb 24, 2021

Feb 22, 2021

Jan 21, 2021

Jan 19, 2021

Jan 14, 2021

Jan 12, 2021

Dec 10, 2020

Dec 2, 2020

Looking for more? Browse all our products here