Defense Acquisitions:
Senior Leaders Should Emphasize Key Practices to Improve Weapon System Reliability
GAO-20-151: Published: Jan 14, 2020. Publicly Released: Jan 14, 2020.
Additional Materials:
- Highlights Page:
- Full Report:
- Accessible Version:
Contact:
(202) 512-4841
mackinm@gao.gov
Office of Public Affairs
(202) 512-4800
youngc1@gao.gov
DOD invests billions of dollars in its weapons systems and expects them to be reliable.
We spoke with commercial companies known for creating reliable products to find out how they achieve reliability, and found that they often focus on four key practices—such as involving reliability experts early in development. We looked at 7 DOD programs and found that they didn’t consistently follow these practices. Instead, they often prioritized producing systems faster.
We recommended that the Air Force, Army, and Navy emphasize key reliability practices when developing weapons systems.
F-35 Aircraft
Four F-35 aircraft in flight
Additional Materials:
- Highlights Page:
- Full Report:
- Accessible Version:
Contact:
(202) 512-4841
mackinm@gao.gov
Office of Public Affairs
(202) 512-4800
youngc1@gao.gov
What GAO Found
The commercial companies GAO reviewed proactively address reliability. They strive to identify reliability issues at the component level early in the development process to avoid expensive rework after producing an entire system. GAO found these companies focus on the following key practices:
1. Leveraging reliability engineers early and often
2. Establishing realistic reliability requirements
3. Emphasizing reliability with their suppliers
4. Employing reliability engineering activities to improve a system's design throughout development
GAO found that the seven Department of Defense (DOD) acquisition programs it reviewed did not consistently adhere to these key practices (see figure). These programs often prioritized schedule and cost over incorporating the key reliability practices, and these systems generally were not as reliable as promised.
Key Characteristics of Selected Acquisition Programs' Approach to Reliability
In 2019, DOD highlighted in a policy memorandum the importance of emphasizing reliability with contractors. However, the other three key practices have not been similarly highlighted. DOD has taken steps to accelerate weapon system development, and decision-making authority has been delegated to the military services. In an environment emphasizing speed, without senior leadership focus on a broader range of key reliability practices, DOD runs the risk of delivering less reliable systems than promised to the warfighter and spending more than anticipated on rework and maintenance of major weapon systems.
Why GAO Did This Study
DOD invests tens of billions of dollars each year in major defense acquisition programs, designing and developing technologically advanced weapon systems that warfighters expect will meet specific performance requirements, including reliability requirements. Systems that are not reliable make it more difficult for warfighters to perform their missions.
GAO was asked to examine DOD weapon system reliability. This report addresses (1) how selected companies in the commercial sector address reliability, (2) how selected DOD acquisition programs addressed reliability, and (3) the extent to which DOD leadership has highlighted key reliability practices.
GAO collected information on leading commercial practices at the 2019 Reliability and Maintainability Symposium and from four commercial companies known for delivering reliable products. GAO also assessed how seven DOD acquisition programs—both older and newer, and representing all the military services—addressed reliability; reviewed key documents and interviewed knowledgeable officials; and reviewed reliability-related guidance and policy from senior DOD leaders.
What GAO Recommends
GAO recommends the Secretaries of the Air Force, Army, and Navy highlight the importance of three key reliability practices: leveraging reliability engineers, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. DOD agreed with GAO's recommendations.
For more information, contact Michele Mackin at (202) 512-4841 or mackinm@gao.gov.
Recommendations for Executive Action
Status: Open
Comments: The Air Force agreed with this recommendation and told us they will be updating Air Force Instruction AFI63-101/20-101 to ensure the inclusion of key practices to improve weapon system reliability, including leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. The Air Force said it plans to complete this effort by December 31, 2020.
Recommendation: We recommend the Secretary of the Air Force issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 1)
Agency Affected: Department of Defense: Department of the Air Force: Office of the Secretary of the Air Force
Status: Closed - Implemented
Comments: The Army agreed with this recommendation and in March 2020, the Assistant Secretary of the Army (Acquisition, Logistics, and Technology) (ASA (ALT)) signed a memorandum directing Program Executive Officers to emphasize the three key practices GAO had identified: leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development.
Recommendation: We recommend the Secretary of the Army issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 2)
Agency Affected: Department of Defense: Department of the Army: Office of the Secretary
Status: Open
Comments: The Navy agreed with this recommendation and told us they plan to address GAO's recommendation in two ways. First, they are developing a guidebook for program managers and leadership to emphasize the importance of leveraging reliability engineers early and often, establishing realistic reliability requirements, and employing reliability engineering activities to improve a system's design throughout development. The Navy anticipates the guidebook will be completed by the end of fiscal year 2021. Second, the Navy plans to update the SECNAV 5000.2 when it is open for changes. They noted, this is dependent on the Office of the Secretary of Defense (OSD) completing its ongoing update to DOD-wide acquisition guidance. The Navy anticipates OSD's efforts will be completed by end of calendar year 2020.
Recommendation: We recommend the Secretary of the Navy issue policy emphasizing the following three key reliability practices when planning and executing acquisition programs: (1) leveraging reliability engineers early and often, (2) establishing realistic reliability requirements, and (3) employing reliability engineering activities to improve a system's design throughout development. (Recommendation 3)
Agency Affected: Department of Defense: Department of the Navy: Office of the Secretary
Explore the full database of GAO's Open Recommendations
»
Feb 24, 2021
-
Defense Budget:
Opportunities Exist to Improve DOD's Management of Defense SpendingGAO-21-415T: Published: Feb 24, 2021. Publicly Released: Feb 24, 2021.
Feb 22, 2021
-
Service Acquisitions:
DOD's Report to Congress Identifies Steps Taken to Improve Management, But Does Not Address Some Key Planning IssuesGAO-21-267R: Published: Feb 22, 2021. Publicly Released: Feb 22, 2021.
Jan 21, 2021
-
Close Air Support:
Actions Needed to Enhance Friendly Force Tracking Capabilities and Fully Evaluate TrainingGAO-21-99: Published: Jan 21, 2021. Publicly Released: Jan 21, 2021.
Jan 19, 2021
-
GPS Modernization:
DOD Continuing to Develop New Jam-Resistant Capability, But Widespread Use Remains Years AwayGAO-21-145: Published: Jan 19, 2021. Publicly Released: Jan 19, 2021.
Jan 14, 2021
-
Columbia Class Submarine:
Delivery Hinges on Timely and Quality Materials from an Atrophied Supplier BaseGAO-21-257: Published: Jan 14, 2021. Publicly Released: Jan 14, 2021. -
Department of Defense:
Actions Needed to Improve Accounting of Intradepartmental TransactionsGAO-21-84: Published: Jan 14, 2021. Publicly Released: Jan 14, 2021.
Jan 12, 2021
-
DOD Critical Technologies:
Plans for Communicating, Assessing, and Overseeing Protection Efforts Should Be CompletedGAO-21-158: Published: Jan 12, 2021. Publicly Released: Jan 12, 2021.
Dec 10, 2020
-
Climate Resilience:
DOD Coordinates with Communities, but Needs to Assess the Performance of Related Grant ProgramsGAO-21-46: Published: Dec 10, 2020. Publicly Released: Dec 10, 2020. -
Electromagnetic Spectrum Operations:
DOD Needs to Address Governance and Oversight Issues to Help Ensure SuperiorityGAO-21-64: Published: Dec 10, 2020. Publicly Released: Dec 10, 2020.
Dec 2, 2020
-
Navy and Marine Corps:
Services Continue Efforts to Rebuild Readiness, but Recovery Will Take Years and Sustained Management AttentionGAO-21-225T: Published: Dec 2, 2020. Publicly Released: Dec 2, 2020.
Looking for more? Browse all our products here