DOD Simulations: Improved Assessment Procedures Would Increase the Credibility of Results
PEMD-88-3
Published: Dec 29, 1987. Publicly Released: Feb 05, 1988.
Skip to Highlights
Highlights
GAO reviewed selected Department of Defense (DOD) weapons systems simulations to determine: (1) what factors DOD should consider in assessing simulation credibility; (2) the results of assessing weapons systems simulations with respect to these factors; and (3) DOD efforts to reinforce simulation credibility.
Recommendations
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| Department of Defense | To reinforce its efforts and to ensure that such practices are followed, the Secretary of Defense should develop and implement guidance on producing, validating, documenting, managing, maintaining, using, and reporting weapon-system effectiveness simulations. The guidance should include a provision for routine reviews of a simulation's credibility and, in this way, the identification of problems that should be resolved. |
Closed – Implemented
Many DOD directorates have or are in the process of taking action. There are others, however, that have this action under study.
|
| Department of Defense | The Secretary of Defense should explore the possibility of requiring that a statement regarding validation accompany the report of a simulation's results. |
Closed – Not Implemented
DOD is revising all acquisition guidance.
|
| Department of Defense | To make the ADAGE, Carmonette, and COMO III models more useful in future applications, the agency responsible for managing each simulation should explore the feasibility of remedying the limitations identified, especially in the area of validation. |
Closed – Not Implemented
Carmonette and ADAGE are no longer used by the Army. COMO III is modified for specific studies. Actions are being taken to implement an Army-wide program requiring simulation accreditation.
|
Full Report
Office of Public Affairs
Topics
Air defense systemsComputer modelingTestingWeapons systemsAircraft acquisition programMilitary forcesSystems analysisHelicoptersComparative analysisEngineering