Skip to main content

Transitioning Veterans: Improved Oversight Needed to Enhance Implementation of Transition Assistance Program

GAO-14-144 Published: Mar 05, 2014. Publicly Released: Mar 05, 2014.
Jump To:
Skip to Highlights

Highlights

What GAO Found

The Departments of Defense (DOD), Labor (DOL), and Veterans Affairs (VA) have implemented most of the key components of the Transition Assistance Program (TAP), a gateway to information and services available to servicemembers transitioning to civilian life. However, the agencies are still in the process of implementing other key components of TAP. While originally planned for October 2013, agencies now plan to implement virtually all components by the end of March 2014, with full implementation expected by June 2014.

Agencies' efforts are underway to adequately address three of five elements that GAO identified as important for effective implementation and evaluation of TAP:

1-Track attendance : DOD has systems to collect and report on attendance, which help measure the extent to which TAP achieves its attendance goals.

2-Ensure training quality : The agencies collect and plan to use participant feedback on instruction, content, and facilities to improve training. Each agency also plans to monitor its respective TAP components through site visits.

3-Assess career readiness : The agencies developed standards to assess servicemembers' career readiness. During a capstone assessment, commanders are expected to verify and document whether standards were met.

Agencies' efforts to address the remaining two elements are mixed:

4-Ensure participation and completion : DOD has assigned commanders the responsibility for overseeing participation and has required the services to schedule training and communicate its importance to servicemembers. While the Army and Air Force gauge participation at the command level, the Navy and Marines lack a similar oversight mechanism.

5-Measure performance and evaluate results : The agencies have established certain measures to assess program performance, but their TAP evaluation approach is incomplete. For example, the agencies have established measures to track program outputs, such as the percentage of servicemembers who have participated in TAP. However, the agencies' efforts to evaluate TAP results have focused on basic end-of-course evaluations and gauging servicemembers' readiness prior to separation instead of higher impact program evaluations, such as assessing the effectiveness of TAP on servicemembers 6 months after they have separated from the military. According to agency officials, such evaluations are being considered for certain components of TAP, but they could not provide GAO with a justification for including or excluding specific components of TAP in their evaluation planning efforts.

Based on GAO's prior work and according to officials from the agencies and organizations GAO spoke with, a key remaining challenge for TAP may be the unfavorable timing and location of program delivery for National Guard and Reserve members. Unlike active duty servicemembers, National Guard and Reserve members receive TAP services closer to their transition and in locations that are generally neither where they work nor live. As a result, they may be distracted and have less time to benefit from TAP services. DOD is not well positioned to verify these concerns because it is not collecting data about these members' experiences with the timing and location of TAP service delivery.

Why GAO Did This Study

Over the next few years, over a million military servicemembers are expected to transition to civilian life and some may face challenges such as finding employment. To help them, TAP provides departing servicemembers employment assistance and information on VA benefits, among other things. Begun in 2011, efforts to revamp TAP are underway based on the VOW to Hire Heroes Act of 2011 and the administration's recommendations. The act also mandated GAO to review TAP. This report addresses: 1) the status of TAP implementation; 2) the extent to which elements of effective implementation and evaluation of TAP have been addressed; and 3) any challenges that may remain. To do this GAO identified five elements of effective implementation and evaluation based on relevant federal laws and previously established GAO criteria for training programs; reviewed related GAO work; assessed reports, plans, and policies provided by agencies that administer TAP; interviewed officials from entities that support servicemembers and veterans; and conducted four nongeneralizable discussion groups with servicemembers who had taken TAP at three military installations.

Recommendations

GAO recommends that DOD improve oversight and implementation of TAP, including actions to gauge participation for all of the services and collect data about National Guard and Reserve members' experiences. DOD disagreed with two of GAO's three recommendations. GAO continues to believe that the recommendations are needed as discussed in the report.

Recommendations for Executive Action

Agency Affected Recommendation Status
Department of Defense To better ensure servicemember participation in and completion of TAP, the Secretary of Defense should direct the Under Secretary for Personnel and Readiness to require that all services provide unit commanders and their leaders information on TAP participation levels of servicemembers under their command, similar to that provided by the Army and Air Force. Such information could be used to help hold leaders accountable for ensuring TAP participation and completion.
Closed – Implemented
In November 2016, DOD launched a new system to electronically collect Transition Assistance Program (TAP)-related data on VOW compliance and Career Readiness Standards attainment. DOD officials told us this new system enables the services to generate customized reports that show TAP participation data and Career Readiness Standard attainment at the command level. In September 2018, DOD provided documentation that such reports can be generated for commanders in all military branches at the installation level. In March 2019, DOD provided additional documentation showing that reports can also be generated at the unit command level, both for TAP completion and timeliness. DOD officials told us that the Transition to Veterans Program Office funds and provides the licenses for the analytics tool that allows the military departments to access these reports. According to these officials, all military departments have personnel trained in how to access and generate the reports--either at the request of commanders or in support of meeting the statutory requirements of TAP.
Department of Defense To provide information on the extent to which the revamped TAP is effective, the Secretary of Defense should direct the Under Secretary for Personnel and Readiness to work with the partner agencies to develop a written strategy for determining which components and tracks to evaluate and the most appropriate evaluation methods. This strategy should include a plan to use the results of evaluations to modify or redesign the program, as appropriate.
Closed – Implemented
DOD non-concurred with our recommendation. However, as of August 2018, DOD has taken actions to implement GAO's recommendation on evaluating the effectiveness of the revamped TAP, information that is currently limited. DOD, in concert with its interagency partners from the Department of Veterans Affairs, Labor, Education, and Homeland Security, the Small Business Administration, and the Office of Personnel Management, issued a Transition Assistance Interagency Evaluation Plan for Fiscal Year 2017-2018. The plan describes how the interagency partners assess TAP effectiveness based on outcome measures and indicators. In addition, DOD officials said the TAP participant assessment provides valuable feedback regarding servicemembers' perceptions of the program's effectiveness.
Department of Defense To ensure that decisions about the participation of eligible members of the National Guard and Reserves in TAP are fully informed, the Secretary of Defense should direct the Under Secretary for Personnel and Readiness to systematically collect information on any challenges facing demobilizing members of the National Guard and Reserves regarding the logistics of the timing and location to attend TAP. For example, agencies might add questions to their online assessment tool specific to eligible members of the National Guard and Reserves who participate in TAP.
Closed – Implemented
DOD has taken three steps to systematically collect information to assess the program delivery experience of demobilizing Guard and Reserve members, according to DOD officials. One step includes adding questions to the "Fiscal Year 2016 Status of Forces Survey - Reserves" regarding any challenges with the timing and location for attending TAP. Two others steps include analyzing information from the TAP online assessment tool to identify trends in Guard and Reserve members' responses and surveying representatives from the Guard and Reserve on a TAP task team.

Full Report

Topics

Career planningEducationEmployment assistance programsEvaluation methodsFederal aid programsMilitary personnelPerformance measuresProgram evaluationProgram managementQuality assuranceStandardsStrategic planningVeterans benefitsVeterans employment programs