Defense Management:
DOD Needs to Demonstrate That Performance-Based Logistics Contracts Are Achieving Expected Benefits
GAO-05-966: Published: Sep 9, 2005. Publicly Released: Sep 9, 2005.
Additional Materials:
- Highlights Page:
- Full Report:
- Accessible Text:
Contact:
(202) 512-8365
contact@gao.gov
Office of Public Affairs
(202) 512-4800
youngc1@gao.gov
The Department of Defense (DOD) contracts with private sector companies to perform depot maintenance of weapon systems using performance-based logistics--that is, purchasing a defined level of performance over a defined time period at a fixed cost to the government. After implementing such contracts, program offices are to validate their efficacy using cost and performance data; DOD cannot otherwise ensure cost savings and improved performance are being achieved through the use of performance-based logistics. GAO was asked to review the implementation of performance-based logistics to determine whether DOD could demonstrate cost savings and improved responsiveness from these arrangements. In conducting its review, GAO analyzed the implementation of performance-based logistics arrangements for 15 weapon system programs.
DOD program offices could not demonstrate that they have achieved cost savings or performance improvements through the use of performance-based logistics arrangements. Although DOD guidance on implementing these arrangements states program offices should update their business case analysis based on actual cost and performance data, only 1 of the 15 program offices included in GAO's review had performed such an update consistent with DOD guidance. In the single case where the program office had updated its business case analysis, it determined that the performance-based logistics contract did not result in expected cost savings and the weapon system did not meet established performance requirements. In general, program offices had not updated their business case analysis after entering into a performance-based logistics contract because they assumed that the costs for weapon system maintenance incurred under a fixed-price performance-based logistics contract would always be lower than costs under a more traditional contracting approach and because they lacked reliable cost and performance data needed to validate assumptions used. Furthermore, the Office of the Secretary of Defense has not established procedures to monitor program offices to ensure they follow guidance and update the business case analysis. Additionally, program officials said because of limitations in their own information systems, they typically relied on cost and performance data generated by the contractors' information systems to monitor performance-based logistics contracts. The program offices, however, had not determined whether contractor-provided data were sufficiently reliable to update their business case analysis. Although the Defense Contract Management Agency and the Defense Contract Audit Agency are most commonly used to monitor higher risk contracts, such as cost plus contracts, they are potential resources available to assist program offices in monitoring fixed-price performance-based contracts. In doing so, these DOD agencies have the capability to verify the reliability of contractors' information systems and collect cost and performance data needed to update their business case analysis. Until program offices follow DOD's guidance and update their business case analysis based on reliable cost and performance data, DOD cannot evaluate the extent to which performance-based logistics arrangements are achieving expected benefits and being effectively implemented within DOD.
Recommendations for Executive Action
Status: Closed - Not Implemented
Comments: DOD concurred with this recommendation and agreed to work with the military services to develop tracking procedures. While DOD took steps to improve sustainment metrics, which could produce improved performance and cost data for updating business case analyses following implementation of a performance-based logistics arrangement, the department did not develop procedures to track whether program offices that enter into these arrangements validate their business case decisions consistent with DOD guidance. During audit work performed for a follow-up review, we found that only the Army had developed a tracking system and a centralized oversight process to monitor the status of PBL arrangements, including dates for initial and subsequent business case analyses. The remaining services had not established oversight responsibilities to ensure that business case decisions were validated. As a result, in December 2008 we again reported that many of the performance-based logistics arrangements we reviewed had not updated their business case analyses to validate the approach taken and to support future plans in accordance with DOD and service policies and guidance (GAO-09-41). The report included recommendations for DOD to issue guidance clarifying when business case analyses should be updated and for the services to revise guidance to implement internal controls to ensure that business case analyses are prepared and updated.
Recommendation: To demonstrate that performance-based logistics arrangements are resulting in reduced costs and increased performance, and to improve oversight of performance-based logistics contracts, the Secretary of Defense should direct the Under Secretary of Defense (Acquisition, Technology and Logistics) to reaffirm DOD guidance that program offices update their business case analyses following implementation of a performance-based logistics arrangement and develop procedures, in conjunction with the military services, to track whether program offices that enter into these arrangements validate their business case decisions consistent with DOD guidance.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: DOD issued new guidance and requirements to address this recommendation. First, DOD revised chapter 5 of the Defense Acquisition Guidebook, which now states that the reliability of contractor cost and performance data should be verified during monitoring of performance-based logistics arrangements. The new guidance also states that increased use of the Defense Contract Management Agency and Defense Contract Audit Agency in overseeing these arrangements may be considered. Second, DOD took steps to improve life-cycle sustainment metrics. DOD expects these metrics will be used in monitoring system performance in terms of availability and reliability and ownership costs. Specifically, in May 2007, DOD revised its JCIDS instruction and manual (CJCSI 3170-.01F and CJCSM 3170.01C) establishing a mandatory sustainment key performance parameter and ownership cost key system attribute as metrics to drive future sustainment decisions, including business case analyses.
Recommendation: To demonstrate that performance-based logistics arrangements are resulting in reduced costs and increased performance, and to improve oversight of performance-based logistics contracts, the Secretary of Defense should direct the Under Secretary of Defense (Acquisition, Technology and Logistics) to direct program offices to improve their monitoring of performance-based logistics arrangements by verifying the reliability of contractor cost and performance data. The program offices may wish to increase the role of the Defense Contract Management Agency and the Defense Contract Audit Agency in overseeing performance-based logistics contracts.
Agency Affected: Department of Defense
Explore the full database of GAO's Open Recommendations
»
Dec 4, 2019
-
Navy Maintenance:
Persistent and Substantial Ship and Submarine Maintenance Delays Hinder Efforts to Rebuild ReadinessGAO-20-257T: Published: Dec 4, 2019. Publicly Released: Dec 4, 2019.
Dec 3, 2019
-
Military Housing Privatization:
Preliminary Observations on DOD's Oversight of the Condition of Privatized Military HousingGAO-20-280T: Published: Dec 3, 2019. Publicly Released: Dec 3, 2019.
Nov 27, 2019
-
Water Scarcity:
DOD Has Not Always Followed Leading Practices to Identify At-Risk InstallationsGAO-20-98: Published: Nov 27, 2019. Publicly Released: Nov 27, 2019.
Nov 25, 2019
-
Naval Shipyards:
Key Actions Remain to Improve Infrastructure to Better Support Navy OperationsGAO-20-64: Published: Nov 25, 2019. Publicly Released: Nov 25, 2019.
Nov 18, 2019
-
Afghanistan Security Forces Fund:
DOD Has Processes for Identifying Training Needs and Maintaining Visibility over ContractsGAO-20-99: Published: Nov 18, 2019. Publicly Released: Nov 18, 2019. -
Army Marketing:
The Army Has Taken Recent Actions That Could Improve Program Oversight, Effectiveness, and Workforce PracticesGAO-20-93: Published: Nov 18, 2019. Publicly Released: Nov 18, 2019.
Nov 14, 2019
-
Navy Readiness:
Actions Needed to Evaluate the Effectiveness of Changes to Surface Warfare Officer TrainingGAO-20-154: Published: Nov 14, 2019. Publicly Released: Nov 14, 2019.
Nov 13, 2019
-
F-35 Aircraft Sustainment:
DOD Faces Challenges in Sustaining a Growing FleetGAO-20-234T: Published: Nov 13, 2019. Publicly Released: Nov 13, 2019.
Nov 7, 2019
-
Nuclear Weapons Sustainment:
Improvements Made to Budget Estimates in Fiscal Year 2019 Joint Report, but Opportunities Remain to Enhance CompletenessGAO-20-37R: Published: Nov 7, 2019. Publicly Released: Nov 7, 2019.
Nov 1, 2019
-
Defense Management:
Defense-Wide Working Capital Fund Agencies Apply Most Key Operating Principles but Should Improve Pricing TransparencyGAO-20-65: Published: Nov 1, 2019. Publicly Released: Nov 1, 2019.
Looking for more? Browse all our products here