What GAO Found
Over the past several decades, the Army and Marine Corps have increased their use of simulation-based training--simulators and computer-based simulations. Historically, the aviation communities in both services have used simulators to train servicemembers in tasks such as takeoffs, and emergency procedures that could not be taught safely live. In contrast, the services' ground communities used limited simulations prior to 2000. However, advances in technology, and emerging conditions in Iraq and Afghanistan have led to increased use of simulation-based training in the ground forces. For example, in response to increases in vehicle rollovers, both services began using simulators to train servicemembers to safely evacuate vehicles. The services are also collaborating in the development of some simulation-based training devices. For instance, according to Marine Corps officials, the service reused 87 percent of the Army's Homestation Instrumentation Training System's components in its own training system, achieving about $11 million in cost avoidance and saving an estimated 7 years in fielding time. The services are also taking steps to better integrate live and simulation-based training, developing technical capabilities to connect previously incompatible simulation-based training devices. The Army's capability is now being fielded, and the Marine Corps' is in the initial development phase.
The Army and Marine Corps consider various factors in determining whether to use live or simulation-based training, but lack key performance and cost information that would enhance their ability to determine the optimal mix of training and prioritize related investments. As the services identify which requirements can be met with either live or simulation-based training or both, they consider factors such as safety and training mission. Also, they have cited numerous benefits of simulation-based training, such as improving servicemember performance in live training events, and reducing operating costs. Both services rely on subject matter experts, who develop their training programs, and after action reports from deployments and training exercises for information on how servicemembers may have benefited from simulation-based training. However, neither service has established outcome metrics to assist them in more precisely measuring the impact of using simulation-based devices to improve performance or proficiency. Leading management practices recognize that performance metrics can help agencies determine the contributions that training makes to improve results. Army and Marine Corps officials also generally consider simulation-based training to be less costly than live training and analyze some data, such as life cycle costs, when considering options to acquire a particular simulation-based training device. However, once simulation-based training devices are fielded, the services neither reevaluate cost information as they determine the mix of training nor have a methodology for determining the costs associated with simulation-based training. Federal internal control standards state that decision makers need visibility over a program's financial data to determine whether the program is meeting the agencies' goals and effectively using resources. Without better performance and cost data, the services lack the information they need to make more fully informed decisions in the future regarding the optimal mix of training and how best to target investments for simulation-based training capabilities.
Why GAO Did This Study
The Army and Marine Corps use live and simulation-based training to meet training goals and objectives. Service officials have noted benefits from the use of simulation-based training--both in terms of training effectiveness and in cost savings or cost avoidance. A House report accompanying the bill for the National Defense Authorization Act for 2012 mandated GAO to review the status of the military services' training programs. This report follows GAO's reports on the Navy and Air Force, and assesses (1) changes in the Army's and Marine Corps' use of simulation-based training, including efforts to integrate live and simulation-based training capabilities; and (2) the factors the Army and Marine Corps consider in determining whether to use live or simulation-based training, including the extent to which they consider performance and cost information. GAO focused on a broad cross-section of occupations (e.g., aviation, armor, artillery), and analyzed service training strategies and other documents; and conducted six site visits and interviewed service officials involved with training and training development for the selected occupations.
GAO recommends that the services develop metrics, and a methodology to compare live and simulation-based training costs. DOD partially concurred, but noted that it captures all relevant costs needed for decision making. GAO continues to believe the services may not be considering some important simulation-based training costs and a specific methodology is needed to more fully identify the universe of costs needed for comparison purposes.
Recommendations for Executive Action
|Department of Defense||To improve decision makers' abilities to make fully informed decisions concerning whether training requirements can be met with live and simulation-based training and determine optimal mixes of live and simulation-based training, the Secretary of Defense should direct the Secretary of the Army and the Commandant of the Marine Corps to develop outcome-oriented performance metrics that can be used to assess the impact of simulation-based training on improving the performance or proficiency of servicemembers and units.|
|Department of Defense||To improve decision makers' abilities to make fully informed decisions concerning whether training requirements can be met with live and simulation-based training and determine optimal mixes of live and simulation-based training, the Secretary of Defense should direct the Secretary of the Army and the Commandant of the Marine Corps to develop a methodology--to include identifying the costs that should be included and how these costs should be captured--for comparing the costs associated with the use of live and simulation-based training.|