Military and Veterans Disability System:
Pilot Has Achieved Some Goals, but Further Planning and Monitoring Needed
GAO-11-69, Dec 6, 2010
Additional Materials:
- Highlights Page:
- Accessible Text:
Contact:
Since 2007, the Departments of Defense (DOD) and Veterans Affairs (VA) have been testing a new disability evaluation system designed to integrate their separate processes and thereby expedite veterans' benefits for wounded, ill, and injured servicemembers. Having piloted the integrated disability evaluation system (IDES) at 27 military facilities, they are now planning for its expansion military-wide. Part of the National Defense Authorization Act for Fiscal Year 2008 required GAO to report on DOD and VA's implementation of policies on disability evaluations. This report examines: (1) the results of the agencies' evaluation of the IDES pilot, (2) challenges in implementing the IDES pilot to date, and (3) whether DOD and VA's plans to expand the IDES adequately address potential future challenges. GAO analyzed data from DOD and VA, conducted site visits at 10 military facilities, and interviewed DOD and VA officials.
In their evaluation of the IDES pilot as of February 2010, DOD and VA concluded that it had improved servicemember satisfaction relative to the existing "legacy" system and met their established goal of delivering VA benefits to active duty and reserve component servicemembers within 295 and 305 days, respectively, on average. While these results are promising, average case processing times have steadily increased since the February 2010 evaluation. At 296 days for active duty servicemembers, as of August 2010, processing time for the IDES is still an improvement over the 540 days that DOD and VA estimated the legacy process takes to deliver VA benefits to members. However, the full extent of improvement of the IDES over the legacy system is unknown because (1) the 540-day estimate was based on a small, nonrepresentative sample of cases and (2) limitations in legacy case data prevent a comprehensive comparison of timeliness, as well as appeal rates. Piloting of the IDES has revealed several implementation challenges that have contributed to delays in the process, the most significant being insufficient staffing by DOD and VA. Staffing shortages were severe at a few pilot sites that experienced caseload surges. For example, at one of these sites, due to a lack of VA medical staff, it took 140 days on average to complete one of the key features of the pilot--the single exam--compared with the agencies' goal to complete this step of the process in 45 days. The single exam posed other challenges that contributed to process delays, such as exam summaries that did not contain sufficient information for VA to determine the servicemember's benefits and disagreements between DOD and VA medical staff about diagnoses for servicemembers' medical conditions. Cases with these problems were returned for further attention, adding time to the process. Pilot sites also experienced logistical challenges, such as incorporating VA staff at military facilities and housing and managing personnel going through the process. As DOD and VA prepare to expand the IDES worldwide, they have made preparations to address a number of these challenges, but these efforts have yet to be tested, and not all challenges have been addressed. To address staffing shortages and ensure timely processing, VA is developing a contract for additional medical examiners, and DOD and VA are requiring local staff to develop written contingency plans for handling surges in caseloads. However, the agencies lack strategies for meeting some key challenges, such as ensuring enough military physicians to handle anticipated workloads. They also do not have a comprehensive monitoring plan for identifying problems as they occur--such as staffing shortages and insufficiencies in medical exams--in order to take remedial actions as early as possible. GAO is making several recommendations to improve DOD and VA's planning for expansion of the new disability evaluation system, including developing a systematic monitoring process and ensuring that adequate staff is in place. DOD and VA generally concurred with GAO's recommendations and provided technical comments that GAO incorporated into the report as appropriate.
Status Legend:
- Review Pending
- Open
- Closed - implemented
- Closed - not implemented
Recommendations for Executive Action
Recommendation: To ensure that the IDES is sufficiently staffed and that military treatment facilities are prepared to house personnel in the IDES, the Secretary of Defense should direct the military services to conduct thorough assessments prior to each site's implementation of the IDES of the adequacy of staffing of military physicians for completing medical evaluation board (MEB) determinations at military treatment facilities; contingency plans should be developed to address potential staffing shortfalls, for example, due to staff turnover or caseload surges.
Agency Affected: Department of Defense
Status: Open
Comments: Our recent work on the integrated disability evaluation system (IDES) continues to identify challenges with ensuring adequate staffing of military physicians to complete medical evaluation board (MEB) determinations (Military and Veterans Disability System: Preliminary Observations on Evaluation and Planned Expansion of DOD/VA Pilot, GAO-11-191T). DOD officials said that each military department monitors caseload and staffing sufficiency. Additionally, DOD is in the process of adding physicians to improve the timeliness and effectiveness of IDES. GAO will consider whether to close this recommendation after the process of adding staff has been completed.
Recommendation: To ensure that the IDES is sufficiently staffed and that military treatment facilities are prepared to house personnel in the IDES, the Secretary of Defense should direct the military services to conduct thorough assessments prior to each site's implementation of the IDES of the availability of housing for servicemembers in the IDES at military facilities; alternative housing options should be identified if sites do not have adequate capacity.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: DOD addressed the concern about housing of servicemembers undergoing the IDES by issuing an exception to policy authorizing military departments to process initial trainees through the legacy disability evaluation system, rather than the IDES process. In the action memo authorizing this exception, DOD said that this change was intended to address the issue of housing and other issues, due to the additional time that servicemembers remain on active duty when processed through the IDES as compared to the legacy system. The policy exception states that trainess who are processed through the legacy disability evaluation system will be enrolled in the Benefits Delivery at Discharge/VA Quick Start programs to ensure that that they begin receiving VA benefits shortly after separation from military service. DOD officials said that since the policy exception was issued, the military departments have not reported concerns with the capacity to house servicemembers in the IDES.
Recommendation: To ensure that the IDES is sufficiently staffed and that military treatment facilities are prepared to house personnel in the IDES, the Secretary of Defense should direct the military services to conduct thorough assessments prior to each site's implementation of the IDES of the capacity of organizational units to absorb servicemembers undergoing the disability evaluation; plans should be in place to ensure servicemembers are appropriately and constructively engaged.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: DOD addressed the concern about military units' ability to absorb servicemembers undergoing the IDES by issuing an exception to policy authorizing the military departments to process initial trainees through the legacy disability evaluation system, rather than the IDES process. In the action memo authorizing this exception, DOD said that this change was intended to address challenges of command and control, housing, and other issues, due to the additional time that servicemembers remain on active duty when processed through the IDES as compared to the legacy system. The policy exception states that trainess who are processed through the legacy disability evaluation system will be enrolled in the Benefits Delivery at Discharge/VA Quick Start programs to ensure that that they begin receiving VA benefits shortly after separation from military service. DOD officials said that since the policy exception was issued, the military departments have not reported concerns with the ability to absorb servicemembers in the IDES.
Recommendation: To improve their agencies' ability to resolve differences about diagnoses of servicemembers' conditions, and to determine whether their new guidance sufficiently addresses these disagreements, the Secretaries of Defense and Veterans Affairs should conduct a study to assess the prevalence and causes of such disagreements.
Agency Affected: Department of Defense
Status: Closed - Implemented
Comments: DOD contracted with LMI to conduct a study on differences in diagnoses in response to our recommendation. In October 2011, LMI completed the study entitled "Diagnostic Differences in the DOD-VA Integrated Disability Evaluation System."
Recommendation: To improve their agencies' ability to resolve differences about diagnoses of servicemembers' conditions, and to determine whether their new guidance sufficiently addresses these disagreements, the Secretaries of Defense and Veterans Affairs should conduct a study to assess the prevalence and causes of such disagreements.
Agency Affected: Department of Veterans Affairs
Status: Closed - Implemented
Comments: DOD contracted with LMI to conduct a study on differences in diagnoses in response to our recommendation. In October 2011, LMI completed the study entitled "Diagnostic Differences in the DOD-VA Integrated Disability Evaluation System."
Recommendation: To improve their agencies' ability to resolve differences about diagnoses of servicemembers' conditions, and to determine whether their new guidance sufficiently addresses these disagreements, the Secretaries of Defense and Veterans Affairs should establish a mechanism to continuously monitor disagreements about diagnoses between military physicians and VA examiners and between physical evaluation boards (PEB) and VA rating offices.
Agency Affected: Department of Veterans Affairs
Status: Open
Comments: The tracking system for the IDES, the Veterans Tracking Application (VTA), was recently upgraded to include data fields that can capture, monitor, and report when diagnostic disagreements occur. GAO will monitor these new data fields after they have been used for a longer period and determine how VA is using data from these fields to resolve cases with diagnostic disagreements.
Recommendation: To improve their agencies' ability to resolve differences about diagnoses of servicemembers' conditions, and to determine whether their new guidance sufficiently addresses these disagreements, the Secretaries of Defense and Veterans Affairs should establish a mechanism to continuously monitor disagreements about diagnoses between military physicians and VA examiners and between physical evaluation boards (PEB) and VA rating offices.
Agency Affected: Department of Defense
Status: Open
Comments: DOD officials said that their tracking system for the IDES, the Veterans Tracking Application (VTA), was recently upgraded to include data fields that can capture, monitor, and report when diagnostic disagreements occur. DOD has not yet produced reports on such disagreements. We will consider whether to close this recommendation after these new data fields have been used for a longer period and we determine how DOD is using data from these fields to resolve cases with diagnostic disagreements.
Recommendation: To enable their agencies to take early action on problems at IDES sites postimplementation, the Secretaries of Defense and Veterans Affairs should develop a system-wide monitoring mechanism to identify challenges as they arise in all DOD and VA facilities and offices involved in the IDES. This system could include: (1) continuous collection and analysis of data on DOD and VA staffing levels, sufficiency of exam summaries, and diagnostic disagreements; (2) monitoring of available data on caseloads and case processing time by individual VA rating office and PEB; and (3) a formal mechanism for agency officials at local DOD and VA facilities to communicate challenges and best practices to DOD and VA headquarters offices.
Agency Affected: Department of Veterans Affairs
Status: Open
Comments: VA has made several efforts to monitor the IDES and identify challenges. DOD and VA are now including case processing times of individual VA rating offices and PEBs in their weekly monitoring reports. DOD and VA recently added capabilities to their Veterans Tracking Application system to identify exam sufficiency issues and diagnostic differences. We will determine whether this recommendation should be closed after the new features of the tracking system have been in place longer and we understand how VA is using the data to address issues.
Recommendation: To enable their agencies to take early action on problems at IDES sites postimplementation, the Secretaries of Defense and Veterans Affairs should develop a system-wide monitoring mechanism to identify challenges as they arise in all DOD and VA facilities and offices involved in the IDES. This system could include: (1) continuous collection and analysis of data on DOD and VA staffing levels, sufficiency of exam summaries, and diagnostic disagreements; (2) monitoring of available data on caseloads and case processing time by individual VA rating office and PEB; and (3) a formal mechanism for agency officials at local DOD and VA facilities to communicate challenges and best practices to DOD and VA headquarters offices.
Agency Affected: Department of Defense
Status: Open
Comments: DOD has made several efforts to monitor the IDES and identify challenges. DOD is now including case processing times of individual VA offices and PEBs in their weekly monitoring reports. The military departments also send representatives to oversight groups, such as the DES Integrated Working Group, the DES Advisory Council, and the Benefits Executive Council to present information and recommendations for best practices at regularly scheduled meetings. Other efforts have recently begun or are still in process. DOD created an MEB Watchboard and PEB Watchboard to provide case management information, workload status, and the ability to monitor data integrity at local installations. DOD and VA recently added capability to their Veterans Tracking Application system to identify exam sufficiency issues and diagnostic differences. We will determine whether this recommendation should be closed after the new features of the tracking system have been in place longer and we understand how DOD is using the data to address issues.