Information Technology:

Additional Executive Review Sessions Needed to Address Troubled Projects

GAO-13-524: Published: Jun 13, 2013. Publicly Released: Jun 13, 2013.

Additional Materials:

Contact:

David A. Powner
(202) 512-9286
pownerd@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

Since January 2010, the Office of Management and Budget (OMB) and selected agencies have held multiple TechStat Accountability Sessions (TechStats) on information technology (IT) investments that varied in terms of function, significance, and risk. As of April 2013, OMB reported conducting 79 TechStats, which focused on 55 investments at 23 federal agencies. The four agencies conducted 37 TechStats covering 28 investments. About 70 percent of the OMB- and 76 percent of agency-led TechStats on major investments were considered medium- to high-risk at the time of the TechStat. However, the number of at-risk TechStats held to date is relatively small compared to the current number of medium- and high-risk IT investments. Until OMB and agencies develop plans to address these investments, the investments will likely remain at risk.

The selected agencies are generally conducting TechStats in accordance with OMB guidance. OMB's TechStat guidance includes 15 key requirements, such as when TechStats should be implemented, what participants should be included, and how outcomes should be tracked and reported. DHS implemented all of the TechStat requirements. Commerce, HHS, and Agriculture implemented a majority of the requirements, but each had shortcomings. For example, these agencies did not consistently create memorandums with responsible parties and due dates for action items. Fully implementing OMB's guidance could better position agencies to effectively manage and resolve problems on IT investments.

OMB and selected agencies have tracked and reported positive results from TechStats, with most resulting in improved governance. OMB also reported in 2011 that federal agencies achieved almost $4 billion in life-cycle cost savings as a result of TechStat sessions. However, GAO was unable to validate OMB's reported results because OMB did not provide artifacts showing that it ensured the results were valid. From GAO's selected agencies, three investments had cost implications. Agencies provided supporting documentation for about $22.2 million in cost savings and avoidances. Until OMB obtains and shares information on the methods used to validate reported results, it will be difficult for the results to be independently validated and for OMB to provide assurance to Congress and the public that TechStats are achieving their intended impact.

Why GAO Did This Study

While IT investments have the potential to make organizations more efficient, many federal IT projects experience cost overruns, schedule delays, and performance shortfalls. To help address these shortfalls, OMB established TechStats--face-to-face meetings to terminate or turnaround IT investments that are failing or are not producing results.

GAO was asked to evaluate the implementation of TechStats. GAO's objectives were to (1) identify key characteristics of TechStats held to date; (2) evaluate whether selected agencies are conducting TechStats in accordance with OMB guidance, and (3) analyze the extent to which reported TechStat results are tracked and validated. To do so, GAO selected four agencies--Agriculture, Commerce, HHS, and DHS--because these were the agencies with the highest number of at-risk investments. GAO analyzed OMB and agency documentation, compared agency processes to TechStat guidance, compared efforts to validate reported outcomes to leading practices, and interviewed OMB and agency officials.

What GAO Recommends

GAO is making recommendations to OMB to require agencies to address high-risk investments and to report on how they validated the outcomes. GAO is also making recommendations to selected agencies to address weaknesses in following OMB's TechStat guidance. OMB and Commerce officials generally agreed with GAO's recommendations. Agriculture partially agreed with GAO's assessment; neither it nor HHS commented on the recommendations.

For more information, contact David A. Powner at (202) 512-9286 or pownerd@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Comments: The agency generally agreed with the recommendation. However, as of January 2014, the agency stated that it does not require agencies to conduct TechStats for moderately high- or high-risk CIO ratings. We will continue to monitor the implementation of this recommendation.

    Recommendation: To ensure that TechStat sessions are having the appropriate impact in the oversight of underperforming projects, the Director of the Office of Management and Budget should direct the Federal Chief Information Officer (CIO) to require agencies to conduct TechStats for each IT investment rated with a moderately high- or high-risk CIO rating on the IT Dashboard, unless there is a clear reason for not doing so.

    Agency Affected: Executive Office of the President: Office of Management and Budget

  2. Status: Open

    Comments: The agency generally agreed with the recommendation. In January 2014, OMB stated that it ensures that agencies validate its costs savings information as part of its quarterly report to Congress. However, the only cost savings resulting from TechStats reported in the most recent quarterly report were the same ones we were unable to validate in our report. We will continue to monitor the implementation of this recommendation.

    Recommendation: To ensure that TechStat sessions are having the appropriate impact in the oversight of underperforming projects, the Director of the Office of Management and Budget should direct the Federal Chief Information Officer to require agencies to report to OMB on efforts to validate the outcomes, cost savings, and cost avoidances resulting from TechStat sessions; this information should be summarized when OMB reports on governmentwide outcomes.

    Agency Affected: Executive Office of the President: Office of Management and Budget

  3. Status: Open

    Comments: The agency generally agreed with the recommendation. In January 2014, the agency stated that CIO Council tracks the outcomes of TechStats, but did not provide evidence to support that. We will continue to monitor the implementation of this recommendation.

    Recommendation: To ensure that TechStat sessions are having the appropriate impact in the oversight of underperforming projects, the Director of the Office of Management and Budget should direct the Federal Chief Information Officer to direct the Federal CIO Council to track the outcome of TechStat sessions and to support OMB's efforts to validate the resulting cost savings it reports to Congress.

    Agency Affected: Executive Office of the President: Office of Management and Budget

  4. Status: Open

    Comments: The agency had no comment on the recommendation. We have requested documentation and will continue to monitor the implementation of this recommendation.

    Recommendation: The Secretary of Health and Human Services should establish a plan and schedule for addressing each IT investment rated with a moderately high- or high-risk CIO rating on the IT Dashboard; such a plan could include conducting a TechStat session.

    Agency Affected: Department of Health and Human Services

  5. Status: Open

    Comments: The agency had no comment on the recommendation. At the time of our review, we identified several weaknesses in the agency's TechStat processes and management, including creating TechStat memorandums, and ensuring that TechStat action items are actively managed and monitored. We will continue to monitor the implementation of this recommendation.

    Recommendation: The Secretary of Health and Human Services should address the weaknesses in agency- and bureau-led TechStat processes and management outlined in this report.

    Agency Affected: Department of Health and Human Services

  6. Status: Open

    Comments: The agency partially agreed with our assessment of the agency's TechStat process. At the time of our review, we identified several weaknesses in the agency's TechStat processes and management, including holding bureau-led TechStats, including TechStats in its capital planning and governance structure, providing training on TechStats, and consistently capturing action steps, deadlines, and responsibilities in its TechStat memorandums. We will continue to monitor the implementation of this recommendation.

    Recommendation: The Secretaries of Agriculture and Commerce should address the weaknesses in agency- and bureau-led TechStat processes and management outlined in this report.

    Agency Affected: Department of Agriculture

  7. Status: Closed - Implemented

    Comments: The agency agreed with the recommendation. In August 2013, the Department of Commerce provided evidence that it had addressed the weaknesses in its TechStat processes and management. Specifically, the department's TechStat memorandums now include a specific point of contact named and a specific due date for completion. Fully implementing the Office of Management and Budget's guidance on performing TechStats will better position the department to realize the full benefits of the TechStat initiative.

    Recommendation: The Secretaries of Agriculture and Commerce should address the weaknesses in agency- and bureau-led TechStat processes and management outlined in this report.

    Agency Affected: Department of Commerce

 

Explore the full database of GAO's Open Recommendations »

Jun 10, 2014

May 22, 2014

May 12, 2014

May 8, 2014

May 7, 2014

Apr 2, 2014

Feb 26, 2014

Feb 12, 2014

Looking for more? Browse all our products here