Defense Major Automated Information Systems:

Cost and Schedule Commitments Need to Be Established Earlier

GAO-15-282: Published: Feb 26, 2015. Publicly Released: Feb 26, 2015.

Additional Materials:

Contact:

Carol R. Cha
(202) 512-4456
chac@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

A majority of the 20 selected Department of Defense (DOD) major automated information systems (MAIS) programs had not established their first baselines (which consist of a life cycle cost estimate, a schedule estimate, and performance targets) within 2 years from program start; over half met or planned to meet a statutorily established time frame for deploying capabilities. While the Defense Science Board supports that programs should establish their baselines within 2 years, 12 programs spent, on average, 5 years and 2 months and about $452 million prior to establishing baselines. Programs that have not established baselines are subject to less oversight and cannot be measured against cost, schedule, and performance targets. Also, the propensity to carry out MAIS programs for multiple years prior to committing to baselines is inconsistent with incremental and rapid development as called for in federal law, Office of Management and Budget guidance, and a Defense Science Board recommendation. Notably, over half of the 20 programs met or planned to meet the time frame established by a DOD-specific law for deciding to fully deploy system capabilities, in part because they were restructured into smaller, incremental programs. Until programs establish their cost and schedule baselines within 2 years, they may continue to spend hundreds of millions of dollars with limited oversight and accountability.

Of four selected MAIS programs, two had fully defined and managed their key risks, and two were on track to do so. For example, while the Air Force program did not always identify completion targets for its risk mitigation plans, it had a plan in place to correct this by March 2015. The four programs varied in their implementation of the selected acquisition best practices—requirements development and project planning. Specifically, two programs implemented requirements development best practices and the others were on track to do so. Two programs were on track to implement key planning practices, but the other two had not developed schedules that incorporated all best practices. Further, DOD had not fully developed a comprehensive plan for implementing the Army logistics program, including testing to ensure that its financial statements are auditable. Without effective project planning, these programs risk not meeting cost and schedule targets and implementing systems that do not meet needs.

Selected MAIS Programs' Implementation of Acquisition Best Practices

Program

Risk management

Requirements development

Project planning

Navy's Distributed Common Ground System - Navy Increment 2

Army's Integrated Personnel and Pay System - Army Increment 2

Air Force's Joint Space Operations Center Mission System Increment 2

Army's Logistics Modernization Program Increment 2

● Fully implemented ◐ Partially implemented ◍ On track to fully implement ○ Not implemented

Source: GAO analysis of agency data. I GAO-15-282

Why GAO Did This Study

The National Defense Authorization Act for Fiscal Year 2012 mandated that GAO select, assess, and report on DOD MAIS programs annually through March 2018. This report discusses the results of GAO's third assessment. GAO's objectives included: (1) determine whether selected MAIS programs are meeting time frames for establishing program baselines and deploying capabilities, (2) assess selected MAIS programs' actions to manage risks, and (3) assess the extent to which selected MAIS programs have used key information technology acquisition best practices.

For its first objective, GAO selected a sample of 20 MAIS programs based on a few factors, such as programs that were designated as first (or only) increments. For the other objectives, GAO identified 4 out of 40 programs based on several factors, such as representation from multiple DOD components (1 from Air Force, 2 from Army, and 1 from Navy), and assessed them against selected acquisition best practices for risk management, requirements development, and project planning.

What GAO Recommends

GAO recommends, among other things, that DOD require programs to establish a baseline within 2 years of beginning work and direct the Air Force program and the Army logistics program to address weaknesses in their project planning acquisition practices. DOD concurred with all recommendations except one, with which it partially concurred. GAO maintains that establishing baselines within 2 years would improve outcomes and increase accountability.

For more information, contact Carol R.Cha at (202) 512-4456 or chac@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Comments: The Department developed a draft process document that states that business system (e.g. financial management, logistics management) programs should start development on at least one release within 24 months after programs have identified the needed capabilities and received approval to conduct further analysis into the potential delivery of the capabilities. We will follow-up with the Department for the final process document and guidance, when available.

    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Acquisition, Technology, and Logistics to require MAIS programs to establish their first acquisition program baseline within 2 years of beginning work on the programs.

    Agency Affected: Department of Defense

  2. Status: Closed - Implemented

    Comments: In September 2016, the JMS program updated JMS Increment 2's schedule. As we recommended, the updated schedule now substantially meets the scheduling best practices to (1) sequence all activities within the schedule, and (2) update the schedule with actual progress and logical relationships between activities.

    Recommendation: The Secretary of Defense should direct the Secretary of the Air Force to direct the Joint Space Operations Center Mission System program office to develop a schedule that fully incorporates best practices, including sequencing all activities and updating the schedule with actual progress and logic.

    Agency Affected: Department of Defense

  3. Status: Closed - Implemented

    Comments: In May 2016, the LMP program updated LMS Increment 2's schedule. As we recommended, the updated schedule now substantially meets the scheduling best practice to properly sequence all activities within the schedule.

    Recommendation: The Secretary of Defense should direct the Secretary of the Army to direct the Logistics Modernization Program program office to develop a schedule that fully incorporates the best practice of properly sequencing all schedule activities.

    Agency Affected: Department of Defense

  4. Status: Open

    Comments: According to DOD officials, in response to our recommendation, the department developed a plan to conduct system testing on LMP Increment 2 in accordance with the Federal Information System Controls Audit Manual. The officials stated that the department's plan was to conduct this testing both prior to and after the deployment of new functionality to users. We have requested additional information and documentation from DOD regarding these LMP Increment 2 test plans in order to determine whether the testing associated with auditability of the system was to be conducted before deployment to users.

    Recommendation: The Secretary of Defense should direct the Secretary of the Army to direct the Army (Financial Management and Comptroller) to complete a plan for conducting auditability testing of LMP Increment 2 functionality to ensure that such testing occurs prior to the LMP program management office deploying future functionality.

    Agency Affected: Department of Defense

 

Explore the full database of GAO's Open Recommendations »

Nov 21, 2017

Nov 15, 2017

Nov 7, 2017

Oct 4, 2017

Sep 18, 2017

Sep 6, 2017

Jul 13, 2017

Jun 21, 2017

Jun 13, 2017

Looking for more? Browse all our products here