Reports & Testimonies

  • GAO’s recommendations database contains report recommendations that still need to be addressed.

    GAO’s recommendations help congressional and agency leaders prepare for appropriations and oversight activities, as well as help improve government operations. Recommendations remain open until they are designated as Closed-implemented or Closed-not implemented. You can explore open recommendations by searching or browsing.

    GAO's priority recommendations are those that we believe warrant priority attention. We sent letters to the heads of key departments and agencies, urging them to continue focusing on these issues. These recommendations are labeled as such. You can find priority recommendations by searching or browsing our open recommendations below, or through our mobile app.

  • Browse Open Recommendations

    Explore priority recommendations by subject terms or browse by federal agency

    Search Open Recommendations

    Search for a specific priority recommendation by word or phrase



  • Governing on the go?

    Our Priorities for Policy Makers app makes it easier for leaders to search our recommendations on the go.

    See the November 10th Press Release


  • Have a Question about a Recommendation?

    • For questions about a specific recommendation, contact the person or office listed with the recommendation.
    • For general information about recommendations, contact GAO's Audit Policy and Quality Assurance office at (202) 512-6100 or apqa@gao.gov.
  • « Back to Results List Sort by   

    Results:

    Subject Term: "Developmental testing"

    15 publications with a total of 27 open recommendations including 5 priority recommendations
    Director: Michael J. Sullivan
    Phone: (202) 512-4841

    3 open recommendations
    Recommendation: To ensure that DOD adequately prioritizes its resources to finish F-35 baseline development and delivers all of the promised warfighting capabilities and that Congress is fully informed when making fiscal year 2018 budget decisions, the Secretary of Defense should reassess the additional cost and time needed to complete developmental testing using historical program data.

    Agency: Department of Defense
    Status: Open

    Comments: The agency has not taken any action to implement this recommendation.
    Recommendation: To ensure that DOD adequately prioritizes its resources to finish F-35 baseline development and delivers all of the promised warfighting capabilities and that Congress is fully informed when making fiscal year 2018 budget decisions, the Secretary of Defense should delay the issuance of the Block 4 development request for proposals at least until developmental testing is complete and all associated capabilities have been verified to work as intended.

    Agency: Department of Defense
    Status: Open

    Comments: The agency has not taken any action to implement this recommendation.
    Recommendation: To ensure that DOD adequately prioritizes its resources to finish F-35 baseline development and delivers all of the promised warfighting capabilities and that Congress is fully informed when making fiscal year 2018 budget decisions, the Secretary of Defense should finalize the details of DOD and contractor investments associated with an economic order quantities (EOQ) purchase in fiscal year 2018, and submit a report to Congress with the fiscal year 2018 budget request that clearly identifies the details, including costs and benefits of the finalized EOQ approach.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, the agency partially concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Director: Marie A. Mak
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: The Secretary of Defense should direct the Secretary of the Navy to adjust the number of AAVs used in calculating AAV operations and support costs in the SAR to reflect a more realistic comparison to the 204 ACV 1.1s being procured.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred with our recommendation to update this assumption, and made a partial update to the December 2016 ACV SAR in an effort to address it. In the updated SAR, DOD changed the number of AAVs being replaced from 204 to 180 as we recommended, but did not fully update the total AAV O&S cost figure based on that updated number. Therefore, this recommendation remains open.
    Recommendation: The Secretary of Defense should direct the Secretary of the Navy to postpone the ACV 1.1 program's production decision until early fiscal year 2019 to reduce concurrency between testing and production.

    Agency: Department of Defense
    Status: Open

    Comments: In its written comments, DOD contended that delaying the production decision could delay the ACV fielding schedule and impact the affordability and sequencing of the Marine Corps' overarching Vehicle Replacement Strategy. Although DOD does not plan to take action on our recommendation, Congress has yet to fund the start of ACV production in fiscal year 2018. Therefore, this recommendation remains open.
    Director: Cristina Chaplain
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: In the event that operational test results for PDB-8 and PDB-8.1 reveal performance shortfalls that require additional development of the near and mid-term upgrades tested, the Secretary of Defense should direct the Secretary of the Army to establish mechanisms for overseeing those upgrades commensurate with other major defense acquisition programs, to include an initial report--similar to a Selected Acquisition Report--as soon as practical following operational testing for both PDB-8 and PDB-8.1, on the near and mid-term upgrades evaluated during these tests, including: (1) cost, schedule, and performance estimates for any additional development that is needed; and (2) an estimate of the amount of development costs it has incurred since 2013 for near- and mid-term Patriot upgrades operationally tested along with PDB-8 and PDB-8.1.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation, however, it is too early to determine what, if any, actions the agency will take until the results of operational testing for PDB-8 are made available following its planned completion in late summer 2017.
    Recommendation: In the event that operational test results for PDB-8 and PDB-8.1 reveal performance shortfalls that require additional development of the near and mid-term upgrades tested, the Secretary of Defense should direct the Secretary of the Army to establish mechanisms for overseeing those upgrades commensurate with other major defense acquisition programs, to include annual updates to Congress comparing the latest cost and schedule estimates against the initial estimates and providing explanations for any major deviations until development is complete.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation, however, it is too early to determine what, if any, actions the agency will take until the results of operational testing for PDB-8 are made available following its planned completion in late summer 2017.
    Director: Michele Mackin
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: To ensure a more accurate estimate of the expected cost savings under the fiscal year 2013-2017 multiyear procurement, Congress should consider requiring the Navy to update its estimate of savings, which currently reflects only Flight IIA ships, to increase transparency for costs and savings for Congress and the taxpayers, as well as provide improved information to support future multiyear procurement savings estimates.

    Agency: Congress
    Status: Open

    Comments: To ensure a more accurate estimate of the expected cost savings under the fiscal year 2013-2017 multiyear procurement, we asked Congress to consider requiring the Navy to update its estimate of savings, which currently reflects only Flight IIA ships, to increase transparency for costs and savings for Congress and the taxpayers, as well as provide improved information to support future multi-year procurement savings estimates. Neither the Senate nor House National Defense Authorization Act (NDAA) reports for fiscal year 2018 direct the Navy to update its savings and both reports include language authorizing the Navy to pursue a DDG 51 Flight III multi-year procurement contract for fiscal years 2018-2022. We will continue to monitor the status of this matter at least until the NDAA for fiscal year 2018 is enacted, at which time we will close the matter as not implemented if the multi-year procurement is authorized and no savings update requirement is included.
    Recommendation: To better support DDG 51 Flight III oversight, the Secretary of Defense should designate the Flight III configuration as a major subprogram of the DDG 51 program in order to increase the transparency, via Selected Acquisition Reports, of Flight III cost, schedule, and performance baselines within the broader context of the DDG 51 program.

    Agency: Department of Defense
    Status: Open

    Comments: DOD agreed that visibility into DDG 51 Flight III cost, schedule, and performance is important for oversight, but does not plan to designate Flight III as a major subprogram. No further DOD action has been taken on this recommendation and congressional reports supporting the National Defense Authorization Act for Fiscal Year 2018--yet to be finalized and enacted--do not include any direction for the department to do so. Nevertheless, with construction of the lead Flight III ship only recently awarded (June 2017), we will continue to monitor any action taken to designate Flight III as a major subprogram.
    Director: Michael J. Sullivan
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: In order to ensure that proper statutory and regulatory oversight mechanisms are in place and to increase transparency into a major new investment in the F-35 program, the Secretary of Defense should hold a Milestone B review and manage F-35 Block 4 as a separate and distinct Major Defense Acquisition Program with its own acquisition program baseline and regular cost, schedule, and performance reports to the Congress.

    Agency: Department of Defense
    Status: Open

    Comments: DOD did not concur with GAO's recommendation and the agency has not taken any action to implement this recommendation. However, Congress passed the National Defense Authorization Act for Fiscal Year 2017 which mandated that the Secretary of Defense may not award any follow-on modernization development contracts for the F-35 until the Secretary has submitted a report that contains the basic elements of an acquisition program baseline for Block 4 modernization. This report should include elements such as cost estimates, schedule estimates, technical performance parameters and technology readiness levels that are typical of an acquisition program baseline. The Secretary is also required to update this report annually for the congressional defense committees. DOD currently plans to issue the Block 4 modernization report in late calendar year 2017.
    Director: Michele Mackin
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: To enhance DHS leadership's ongoing efforts to improve the affordability of the department's major acquisition portfolio, and to ensure adequate communication with Congress, the Secretary of the Department of Homeland Security should ensure that the fiscal year 2017 Future Years Homeland Security Program report, which DHS must submit to Congress at or about the same time as the President's fiscal year 2018 budget request, reflects the results of any tradeoffs stemming from the acquisition affordability reviews recommended above.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that the fiscal year 2017 Future Years Homeland Security Program (FYHSP) report would reflect decisions made in response to our second recommendation. DHS expected to release the FYHSP report shortly after the President's fiscal year 2018 budget request in May 2017. However, the transition to a new administration delayed the release of the FYHSP report. Once available, GAO will evaluate the FYHSP report to determine whether DHS has met the intent of this recommendation.
    Recommendation: To enhance DHS leadership's ongoing efforts to improve the affordability of the department's major acquisition portfolio, and to help ensure programs secure stable funding that matches resources to requirements, the Secretary of the Department of Homeland Security should require components to establish formal, repeatable processes for addressing major acquisition affordability issues, similar to the process the Transportation Security Administration has established.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that DHS headquarters would ensure all components are updating their cost estimates each year to inform the annual resource allocation process by March 31, 2017. However, DHS did not establish a requirement that components do so through formal, repeatable processes for addressing major acquisition affordability issues, similar to the process the Transportation Security Administration has established. As of August 2017, seven of DHS's components were in the process of establishing formal, repeatable processes for addressing affordability issues, but had not completed these efforts. GAO will continue to review the components' progress to determine whether the components' actions meet the intent of this recommendation.
    Director: Wilshusen, Gregory C
    Phone: (202) 512-6244

    2 open recommendations
    Recommendation: In addition to implementing our previous recommendations, to more effectively implement security-related policies and plans, the Commissioner of Internal Revenue should update system and application audit plans based on the current version of referenced policies and guidelines and when significant changes are made to a system or application.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: The IRS concurred with the recommendation and stated that it plans to implement it. Subsequent to IRS informing us that it has taken action on this recommendation, we plan to evaluate their implementation of this recommendation as part of the audit of IRS's FY 2017 financial statements.
    Recommendation: In addition to implementing our previous recommendations, to more effectively implement security-related policies and plans, the Commissioner of Internal Revenue should update the security plan for systems that provide network infrastructure services to IRS personnel and information systems to reflect changes to the operating environment.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: On March 28, 2017, IRS officials informed us of the actions they were taking to address this recommendation. Upon receiving information from IRS, we plan to evaluate IRS's implementation of this recommendation as part of the audit of IRS's FY 2017 financial statements.
    Director: Michele Mackin
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To help ensure that actions taken to improve the test and evaluation process address identified challenges, the Administrator of TSA should finalize all aspects of the third party testing strategy before implementing further third party testing requirements for vendors to enter testing.

    Agency: Department of Homeland Security: Transportation Security Administration
    Status: Open

    Comments: In its response to this recommendation, the Department of Homeland Security concurred and identified initial planned actions to implement the finalize third party strategy. Subsequently, in the Spring of 2016, the TSA Office of Security Capabilities finalized its third party tester application and approval process; established quality conformance standards for potential third party testers; and gathered and considered industry feedback on potential third party test strategy consequences among other actions. Collectively, TSA established and published program requirements and procedures for the third party test strategy. In late 2016, TSA formally delayed its planned implementation of the third-party testing program by a calendar year to now be completed by December 31, 2017. TSA cited a need to conduct additional assessments, coordination challenges, and larger TSA security equipment related initiatives as the reasons for the delay. As part of its regular recommendation status reporting to GAO, TSA in the Spring 2017, noted that it is on track to meet the intent of the recommendation by the later revised date. TSA noted it had recently updated its qualification process by which qualified product lists will be populated and has already incorporated various aspects of third party testing for legacy security equipment qualification.
    Director: Timothy M. Persons
    Phone: (202) 512-6412

    2 open recommendations
    Recommendation: To help ensure that biosurveillance-related funding is directed to programs that can demonstrate their intended capabilities, and to help ensure sufficient information is known about the current Gen-2 system to make informed cost-benefit decisions about possible upgrades and enhancements to the system, the Secretary of Homeland Security should direct the Assistant Secretary for Health Affairs and other relevant officials within the Department to not pursue upgrades or enhancements to the current BioWatch system until the Office of Health Affairs (OHA): (1) establishes technical performance requirements, including limits of detection, necessary for a biodetection system to meet a clearly defined operational objective for the BioWatch program by detecting attacks of defined types and sizes with specified probabilities; (2) assesses the Gen-2 system against these performance requirements to reliably establish its capabilities; and (3) produces a full accounting of statistical and other uncertainties and limitations in what is known about the system's capability to meet its operational objectives.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To help reduce the risk of acquiring immature detection technologies, the Secretary of Homeland Security should direct the Assistant Secretary for Health Affairs, in coordination with the Under Secretary for Science and Technology, to use the best practices outlined in this report to inform test and evaluation actions for any future upgrades or changes to technology for BioWatch.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Michele Mackin
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: To improve DHS's management of major acquisition programs, the Secretary of Homeland Security should ensure future baselines for all of TSA's major acquisition programs capture the overall historical record of change.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that the Transportation Security Administration (TSA) will begin to incorporate an addendum to future Acquisition Program Baselines (APB) that will provide a single source to show the changes to cost, schedule, and performance metrics, beginning with the initial program baseline and showing traceability of all interim approved versions to the current APB. DHS estimated it would complete this effort April 30, 2016. As of August 2017, DHS leadership had approved updated versions of the two APBs that were the basis for this recommendation. Both included addendums with metrics from prior APBs, but raised questions about traceability to the current cost, schedule, and performance metrics. GAO will assess the updated APBs as a part of its annual review of select DHS major acquisition programs to determine whether the department has addressed the recommendation.
    Recommendation: To more accurately communicate DHS's funding plans for USCG's major acquisition programs, the Secretary of Homeland Security should ensure the funding plans presented to Congress in fiscal year 2015 are comprehensive and clearly account for all operations and maintenance funding DHS plans to allocate to each of the USCG's major acquisition programs.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that the U.S. Coast Guard and the DHS Chief Financial Officer will develop a plan to address this recommendation by September 30, 2015, then work together to fully implement the plan. DHS estimated it would complete this effort March 31, 2016. However, the USCG encountered technical challenges during this process and was unable to implement the plan by that time. The U.S. Coast Guard has revised the estimated completion date, and now anticipates it will be able to address this recommendation in fiscal year 2020.
    Director: Michael J. Sullivan
    Phone: (202) 512-4841

    1 open recommendations
    including 1 priority recommendation
    Recommendation: As DOD plans to significantly increase F-35 procurement funding over the next 5 years, the Secretary of Defense should conduct an affordability analysis of the program's current procurement plan that reflects various assumptions about future technical progress and funding availability.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: In October 2016, DOD had undertaken multiple efforts to re-evaluate the F-35 warfighting requirements. The Deputy Secretary of Defense issued a memo in May 2016 to the congressional defense committees that revalidated the program's current procurement profile. However, the memo noted that there were a number of factors that will need to be analyzed to fully re-evaluate the F-35 warfighting requirements including production and sustainment costs, force structure, and DOD's ability to achieve strategic and operational objectives under its current plans. As of May 2017, the Department was in the process of conducting an affordability analysis and preparing a final response. The final response is expected to be completed in the summer of 2017.
    Director: Kingsbury, Nancy R
    Phone: (202) 512-2700

    3 open recommendations
    including 2 priority recommendations
    Recommendation: In addition to implementing our previous recommendations, to effectively implement key elements of the IRS information security program, the Commissioner of Internal Revenue should ensure contractors receive security awareness training within 5 business days of being granted access to an IRS information system.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: During the audit of IRS' FY 2017 financial statements, IRS indicated that it had not yet implemented this recommendation. When IRS indicates that it has implemented this recommendation, we will review its actions.
    Recommendation: In addition to implementing our previous recommendations, to effectively implement key elements of the IRS information security program, the Commissioner of Internal Revenue should ensure that control testing methodology and results fully meet the intent of the control objectives being tested.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open
    Priority recommendation

    Comments: During the audit of IRS's FY 2017 financial statements, IRS indicated that it has not completed these actions. When IRS indicates that it has implemented the recommendation, we will evaluate the effectiveness of its actions.
    Recommendation: In addition to implementing our previous recommendations, to effectively implement key elements of the IRS information security program, the Commissioner of Internal Revenue should update the remedial action verification process to ensure actions are fully implemented.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open
    Priority recommendation

    Comments: During the audit of IRS's FY 2017 financial statements, IRS indicated that it has not completed actions to implement the recommendation. When IRS indicates that it has implemented the recommendation, we will evaluate the effectiveness of its actions.
    Director: Michele Mackin
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: The legislated cost cap for Ford-class aircraft carrier construction provides a limit on procurement funds. However, the legislation also provides for adjustments to the cost cap. To understand the true cost of each Ford-class ship, Congress should consider revising the cost cap legislation to ensure that all work included in the initial ship cost estimate that is deferred to post-delivery and outfitting account is counted against the cost cap. If warranted, the Navy would be required to seek statutory authority to increase the cap.

    Agency: Congress
    Status: Open

    Comments: This recommendation remains open to allow Congress time to consider legislation amending the cost cap for the Ford class of aircraft carriers. The current version of the fiscal year 2018 National Defense Authorization Act (H.R. 2810) does not amend the current cost cap legislation.
    Director: Mackin, Michele
    Phone: (202) 512-4841

    2 open recommendations
    including 2 priority recommendations
    Recommendation: To ensure Ford-class carrier acquisitions are supported by sound requirements and a comprehensive testing strategy, and to promote the introduction of reliable, warfighting capable ships into the fleet, the Secretary of Defense should direct the Secretary of the Navy to take the following action prior to accepting delivery of Gerald R. Ford CVN 78. The Secretary of Defense should direct the Secretary of the Navy to conduct a cost-benefit analysis on (1) currently required capabilities, including increased sortie generation rates and reduced manning and (2) the time and money needed to field systems to provide these capabilities, in light of known and projected reliability shortfalls for critical systems. This analysis should be informed by demonstrated system performance from land-based testing, including updated reliability growth projections, and should identify trade space among competing cost, schedule, and performance parameters. The analysis should also consider whether the Navy should seek requirements relief from the Joint Requirements Oversight Council, to the extent necessary, to maximize its return on investment to the warfighter. The Navy should report the results of this analysis to Congress within 30 days of CVN 78 commissioning.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: We recommended that DOD conduct a cost-benefit analysis on currently required capabilities, and report the results to Congress within 30 days of CVN 78 commissioning. DOD agreed with our recommendation for a cost-benefit analysis, but disagreed with the timing of it, stating that it plans to measure CVN 78 capabilities through completion of operational testing after ship delivery. Since the release of our report, the Navy completed cost-benefit analyses to determine the acquisition strategy for CVN 79, making two major changes to the ship (replacing the Dual Band Radar (DBR) with a different radar solution and introducing a phased construction and delivery approach.) While these are major program changes, the department did not evaluate the fundamental reason for conducting a cost-benefit analysis, namely that known and projected reliability shortfalls make it unlikely that the program will achieve its sortie generation requirements. In December 2016, an Independent Review Team commissioned by the Under Secretary of Defense, Acquisition, Technology and Logistics completed a comprehensive assessment of the CVN 78's systems, but did not recommend any capability trade-offs or requirements relief.
    Recommendation: To ensure Ford-class carrier acquisitions are supported by sound requirements and a comprehensive testing strategy, and to promote the introduction of reliable, warfighting capable ships into the fleet, the Secretary of Defense should direct the Secretary of the Navy to take the following action prior to accepting delivery of CVN 78. The Secretary of Defense should direct the Secretary of the Navy to adjust the planned post-delivery test schedule to ensure that system integration testing is completed prior to entering initial operational test and evaluation.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: Until the Navy updates the test plan in February 2018, we will not know if it will fully address our recommendation. However, recent test schedules suggest an overlap remains between integration testing and the start of initial operational test and evaluation.
    Director: Sullivan, Michael J
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To improve visibility and management of the department's efforts to transition technologies to support the needs of the warfighter, the Secretary of Defense should require that all technology transition programs track and measure project outcomes, to include not only whether technologies transitioned to an intended user but also the longer-term impact of whether the technologies benefitted acquisition programs or military users in the field.

    Agency: Department of Defense
    Status: Open

    Comments: In commenting on GAO's recommendation, DOD indicated it would continue to anecdotally measure the results of technology investments for 3, 5, or even 10 years after investment and highlight the long-term benefits, as needed, to validate the investment levels associated with the research and development programs. However, the department did not plan to formally require its technology transition programs to track and measure project outcomes, noting concern that tracking and measuring outcomes for hundreds of technology projects would be a labor-intensive and very time-consuming process. DOD's own tracking of its response to this recommendation indicates no planned action and considers the recommendation closed. Nevertheless, GAO continues to monitor the department's activities related to technology transition, as several ongoing DOD efforts may eventually sufficiently address the intent of this recommendation. For example, DOD continues to pursue improvement to technology transition as part of its Better Buying Power 3.0 initiative. This includes a best practices handbook that is expected to address ways to increase collaboration between DOD and commercial industry and, among other things, support technology transition. In August 2017, the Defense Laboratory Office within the Office of the Assistant Secretary of Defense for Research and Engineering confirmed that the handbook, which was stated in summer 2016 to be nearly finalized, stalled out in its completion for an unknown reason and remains on hold. Interest remains in completing it but no definitive plans exist for when that may occur. We will continue to monitor DOD's efforts to track and measure technology transition outcomes, particularly as they relate to completing the handbook, as previous indications were that the handbook could potentially fulfill the intent of our recommendation.