Reports & Testimonies

  • GAO’s recommendations database contains report recommendations that still need to be addressed.

    GAO’s recommendations help congressional and agency leaders prepare for appropriations and oversight activities, as well as help improve government operations. Recommendations remain open until they are designated as Closed-implemented or Closed-not implemented. You can explore open recommendations by searching or browsing.

    GAO's priority recommendations are those that we believe warrant priority attention. We sent letters to the heads of key departments and agencies, urging them to continue focusing on these issues. These recommendations are labeled as such. You can find priority recommendations by searching or browsing our open recommendations below, or through our mobile app.

  • Browse Open Recommendations

    Explore priority recommendations by subject terms or browse by federal agency

    Search Open Recommendations

    Search for a specific priority recommendation by word or phrase



  • Governing on the go?

    Our Priorities for Policy Makers app makes it easier for leaders to search our recommendations on the go.

    See the November 10th Press Release


  • Have a Question about a Recommendation?

    • For questions about a specific recommendation, contact the person or office listed with the recommendation.
    • For general information about recommendations, contact GAO's Audit Policy and Quality Assurance office at (202) 512-6100 or apqa@gao.gov.
  • « Back to Results List Sort by   

    Results:

    Subject Term: "Performance measures"

    164 publications with a total of 506 open recommendations including 30 priority recommendations
    Director: Carol Harris
    Phone: (202) 512-4456

    14 open recommendations
    Recommendation: The TSA Administrator should ensure that the TIM program management office establishes and implements specific time frames for determining key strategic implementation details, including how the program will transition from the current state to the final TIM state. (Recommendation 1)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office establishes a schedule that provides planned completion dates based on realistic estimates of how long it will take to deliver capabilities. (Recommendation 2)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office establishes new time frames for implementing the actions identified in the organizational change management strategy and effectively executes against these time frames. (Recommendation 3)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office defines and documents the roles and responsibilities among product owners, the solution team, and any other relevant stakeholders for prioritizing and approving Agile software development work. (Recommendation 4)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office establishes specific prioritization levels for current and future features and user stories. (Recommendation 5)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office implements automated Agile management testing and deployment tools, as soon as possible. (Recommendation 6)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office updates the Systems Engineering Life Cycle Tailoring Plan to reflect the current governance framework and milestone review processes. (Recommendation 7)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office establishes thresholds or targets for acceptable performance-levels. (Recommendation 8)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office begins collecting and reporting on Agile-related cost metrics. (Recommendation 9)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office ensures that program velocity is measured and reported consistently. (Recommendation 10)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The TSA Administrator should ensure that the TIM program management office ensures that unit test coverage for software releases is measured and reported accurately. (Recommendation 11)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Homeland Security should direct the Under Secretary for Management to ensure that appropriate DHS leadership reaches consensus on needed oversight and governance changes related to the frequency of reviewing Agile programs, and then documents and implements associated changes. (Recommendation 12)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Homeland Security should direct the Under Secretary for Management to ensure that the Office of the Chief Technology Officer completes guidance for Agile programs to use for collecting and reporting on performance metrics. (Recommendation 13)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Homeland Security should direct the Under Secretary for Management to ensure that DHS-level oversight bodies review key Agile performance and cost metrics for the TIM program and use them to inform management oversight decisions. (Recommendation 14)

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Joseph W. Kirschbaum
    Phone: (202) 512-9971

    2 open recommendations
    Recommendation: CAPE, in coordination with the military departments and other DOD entities serving as offices of primary responsibility for implementing the recommendations, should develop additional guidance for these offices to identify associated risks and document information about these risks in the centralized tracking tool. (Recommendation 1)

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: DOD CIO--in coordination with CAPE, the military departments, Joint Staff, and U.S. Strategic Command--as the draft template and any other additional tools to aid in their approach are finalized, should identify and communicate to NC3 stakeholders performance measures and milestones to assist in tracking the progress of implementation of the recommendations from the 2015 NC3 report and evaluating the outcomes of implementation actions, and risks associated with the implementation of the recommendations from the 2015 NC3 report. (Recommendation 2)

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: J. Christopher Mihm
    Phone: (202) 512-6806

    4 open recommendations
    Recommendation: The Director of OMB should revise and publicly issue OMB guidance--through an update to its Circular No. A-11, a memorandum, or other means--to provide time frames and associated milestones for implementing the federal program inventory. (Recommendation 2)

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of OMB should consider--as OMB determines its strategy for resumed implementation of the federal program inventory--using a systematic approach, such as the information architecture framework, to help ensure that GPRAMA requirements and our past recommendations for the inventory are addressed. (Recommendation 3)

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of OMB should work with the Performance Improvement Council to identify and share among agencies practices for expanding the use of data-driven performance reviews beyond agency priority goals, such as for other performance goals and at lower levels within agencies, that have led to performance improvements. (Recommendation 4)

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of OMB should update Performance.gov to explain that quarterly reporting on the fiscal year 2014 through 2017 cross-agency priority goals and fiscal year 2016 and 2017 agency priority goals (APGs) was suspended, and provide the location of final progress updates for these goals. (Recommendation 1)

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Shelby S. Oakley
    Phone: (202) 512-3841

    1 open recommendations
    Recommendation: The NNSA Deputy Administrator for DNN should revise the DNN program management policy to require DNN programs and subprograms to follow life-cycle program management. These requirements should include development of schedule and cost estimates that cover the life cycle of DNN programs and subprograms, use of methods to account for uncertainty and risk in such estimates, use of cost and schedule baselines to measure performance over program and subprogram life cycles, and development of program management plans. (Recommendation 1)

    Agency: Department of Energy: National Nuclear Security Administration: Office of Defense Nuclear Nonproliferation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: The Chairman of the FCC should establish quantifiable goals and related measures--performance indicators, targets, and timeframes--for its enforcement program and annually publish the results to demonstrate the performance of this program and improve transparency regarding FCC's enforcement priorities. (Recommendation 1)

    Agency: Federal Communications Commission
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Chairman of the FCC should establish, and make publically available, a communications strategy outlining the agency's enforcement program for external stakeholders, to improve engagement with the telecommunications community on the purposes, objectives, and processes the Enforcement Bureau employs to achieve its mission. (Recommendation 2)

    Agency: Federal Communications Commission
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: David A. Powner
    Phone: (202) 512-9286

    20 open recommendations
    Recommendation: As most agencies lack plans to meet OMB's data center optimization targets by the end of fiscal year 2018, it is increasingly likely that these agencies will require additional time to achieve the data center consolidation and optimization goals required by FITARA and OMB guidance. In order to provide agencies with additional time to meet OMB's data center optimization targets and achieve the related cost savings, Congress should consider extending the time frame for the data center consolidation and optimization provisions of FITARA beyond their current expiration date of October 1, 2018.

    Agency: Congress
    Status: Open

    Comments: When we determine what steps the Congress has taken, we will provide updated information.
    Recommendation: To better ensure that agencies complete important DCOI planning documentation and that the initiative improves governmental efficiency and achieves intended cost savings, the Director of OMB should direct the Federal chief information officer to formally document a requirement for agencies to include plans, as part of existing OMB reporting mechanisms, to implement automated monitoring tools at their agency-owned data centers.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Agriculture
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Commerce
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Energy
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of the Interior
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Justice
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Labor
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of the Treasury
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Department of State
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: General Services Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Small Business Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Nuclear Regulatory Commission
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

    Agency: Office of Personnel Management
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Lori Rectanus
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: To ensure that current pilot programs related to electronic advance data provide insights that help in assessing USPS's effectiveness at providing mail targeted by CBP for inspection, the Secretary of Homeland Security should direct the Commissioner of CBP to, in conjunction with USPS, (1) establish measureable performance goals for pilot programs and (2) assess the performance of the pilots in achieving these goals.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To provide information on the costs and benefits of collecting electronic advance data for use in targeting inbound international mail for screening, the Secretary of Homeland Security should direct the Commissioner of CBP to, in conjunction with USPS, evaluate the relative costs and benefits of collecting electronic advance data for targeting mail for inspection in comparison to other methods.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Lori Rectanus
    Phone: (202) 512-2834

    3 open recommendations
    Recommendation: To manage the mail program more effectively, the Secretary of Veterans Affairs should develop and document a plan to source contracts for mailing equipment in a more strategic manner. Such strategic contract sourcing should enable facilities to obtain equipment to track mail volume and expenditure data more consistently and to maximize cost savings.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To manage the mail program more effectively, the Secretary of Veterans Affairs should update VA Directive 6340 to incorporate agency-wide goals and performance measures for mail operations.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To manage the mail program more effectively, the Secretary of Veterans Affairs should determine and document the authority and responsibilities of the agency and administration-level mail managers to enable them to improve management and oversight of mail operations.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Rebecca Gambler
    Phone: (202) 512-8777

    6 open recommendations
    Recommendation: To better assess whether RSCs are meeting USRAP objectives, the Assistant Secretary of State for Population, Refugees, and Migration should develop outcome-based indicators, as required by State policy.

    Agency: Department of State: Bureau of Population, Refugees and Migration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better assess whether RSCs are meeting USRAP objectives, the Assistant Secretary of State for Population, Refugees, and Migration should monitor RSC performance against such indicators on a regular basis.

    Agency: Department of State: Bureau of Population, Refugees and Migration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better ensure that USCIS officers effectively adjudicate applications for refugee status, the Director of USCIS should develop and implement a plan to deploy officers with national security expertise on circuit rides.

    Agency: Department of Homeland Security: United States Citizenship and Immigration Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better ensure that USCIS officers effectively adjudicate applications for refugee status, the Director of USCIS should conduct regular quality assurance assessments of refugee application adjudications across USCIS's Refugee Affairs Division and International Operations Division.

    Agency: Department of Homeland Security: United States Citizenship and Immigration Services
    Status: Open

    Comments: USCIS provided documentation that U.S. Citizenship and Immigration Services (USCIS) officials conducted a quality assurance assessment of refugee adjudications in July 2017 and has plans to conduct an additional quality assurance assessment in January or February 2018. To fully address this recommendation, USCIS should demonstrate a continued commitment to conducting regular quality assurance assessments of refugee application adjudications.
    Recommendation: To provide reasonable assurance that USRAP applicant fraud prevention and detection controls are adequate and effectively implemented, the Secretaries of Homeland Security and State should conduct regular joint assessments of applicant fraud risk across USRAP.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To provide reasonable assurance that USRAP applicant fraud prevention and detection controls are adequate and effectively implemented, the Secretaries of Homeland Security and State should conduct regular joint assessments of applicant fraud risk across USRAP.

    Agency: Department of State
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Lori Rectanus
    Phone: (202) 512-2834

    7 open recommendations
    Recommendation: The Secretary of the Interior should direct the Director of the National Park Service to direct the U.S. Park Police to ensure that performance measures linked to program goals are included as part of its updated strategic plan and direct it to develop a timeline for completion of this plan.

    Agency: Department of the Interior
    Status: Open

    Comments: Interior concurred with this recommendation and said it would take steps to implement it. When we confirm what actions Interior has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of the Interior should direct the Director of the National Park Service to direct the U.S. Park Police to seek additional input from federal entities with expertise regarding ways to enhance testing of its physical security program.

    Agency: Department of the Interior
    Status: Open

    Comments: Interior concurred with this recommendation and said it would take steps to implement it. When we confirm what actions Interior has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of the Smithsonian Institution should direct the Office of Protection Services to develop program goals and ensure that performance measures linked to those goals are included as part of the strategic plan for security and develop a timeline for completion of this plan.

    Agency: Smithsonian Institution
    Status: Open

    Comments: The Smithsonian concurred with this recommendation and said it would take steps to implement it. When we confirm what actions the Smithsonian has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of the Smithsonian Institution should direct the Office of Protection Services to seek additional input from federal entities with expertise regarding ways to enhance testing of the physical security program.

    Agency: Smithsonian Institution
    Status: Open

    Comments: The Smithsonian concurred with this recommendation and said it would take steps to implement it. When we confirm what actions the Smithsonian has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of the National Gallery of Art should direct the Office of Protection Services to develop a process for documenting risk management decisions.

    Agency: National Gallery of Art
    Status: Open

    Comments: The National Gallery concurred with this recommendation and said it would take steps to implement it. When we confirm what actions the National Gallery has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of the National Gallery of Art should direct the Office of Protection Services to ensure that program goals and performance measures linked to those goals are included as part of the master security plan and develop a timeline for completion of this plan.

    Agency: National Gallery of Art
    Status: Open

    Comments: The National Gallery concurred with this recommendation and said it would take steps to implement it. When we confirm what actions the National Gallery has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Director of the National Gallery of Art should direct the Office of Protection Services to seek additional input from federal entities with expertise regarding ways to enhance testing of the physical security program.

    Agency: National Gallery of Art
    Status: Open

    Comments: The National Gallery concurred with this recommendation and said it would take steps to implement it. When we confirm what actions the National Gallery has taken in response to this recommendation, we will provide updated information.
    Director: Susan Fleming
    Phone: (202) 512-2834

    1 open recommendations
    Recommendation: To better position DOT and FHWA to effectively guide the transformation of federal surface transportation programs to a more performance-oriented approach, and to help states and MPOs overcome anticipated challenges, the Secretary of Transportation should direct the Administrator of FHWA to take the following two actions: 1. Develop a formal TPM implementation plan to include overarching implementation goals, specific actions FHWA plans to take to help states and MPOs successfully implement TPM, and corresponding timelines. 2. Publicly communicate this plan and approach to build a shared understanding of the goals and purpose of the transformation with its grantees.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Barbara Bovbjerg
    Phone: (202) 512-7215

    5 open recommendations
    Recommendation: The Acting Commissioner of the Social Security Administration should direct the agency to develop a long-term facility plan that explicitly links to SSA's strategic goals for service delivery, and includes a strategy for consolidating or downsizing field offices in light of increasing use of and geographic variation in remote service delivery.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA agreed with this recommendations and noted steps it plans to take to enable further reduction in its footprint, such as co-locating field and hearing offices and reducing warehouse space. SSA will also work within the existing Memorandum of Understanding to conduct a proof of concept on space sharing by employees who telework.
    Recommendation: The Acting Commissioner of the Social Security Administration should direct the agency to reassess and, if needed, revise its field office space standards to ensure they provide sufficient flexibility to accommodate both unexpected growth in the demand for services and new service delivery technologies.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA agreed with this recommendations and noted steps it plans to take to enable further reduction in its footprint.
    Recommendation: The Acting Commissioner of the Social Security Administration should direct the agency to ensure the Real Estate and Lease Tracking application has the capacity to accurately track the composition of SSA's office inventory over time.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA agreed with this recommendations and noted steps it plans to take to enable further reduction in its footprint.
    Recommendation: The Acting Commissioner of the Social Security Administration should direct the agency to develop a cost-effective approach to identifying the most common issues with online benefit claims that require staff follow-up with applicants, and use this information to inform improvements to the online claims process.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA agreed with this recommendations and noted steps it plans to take to enable further reduction in its footprint.
    Recommendation: The Acting Commissioner of the Social Security Administration should direct the agency for its alternative customer services approaches, including desktop icons and video services in third-party sites, to develop performance goals and collect performance data related to these goals.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA agreed with this recommendations and noted steps it plans to take to enable further reduction in its footprint, such as expanding video hearing capacity.
    Director: Robert Goldenkoff
    Phone: (202) 512-2757

    3 open recommendations
    Recommendation: The Secretary of Commerce should direct the Under Secretary of the Economics and Statistics Administration and the Director of the U.S. Census Bureau to use the Bureau's evaluations before 2020 to determine the implications of in-office address canvassing on the cost and quality of address canvassing, and use this information to justify decisions related to its re-engineered address canvassing approach.

    Agency: Department of Commerce
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: Early in the next decennial cycle, the Secretary of Commerce should direct the Under Secretary of the Economics and Statistics Administration and the Director of the U.S. Census Bureau to plan and execute more flexible, and perhaps smaller, address canvassing test and evaluation activity needed to support key design decisions having significant effect on the cost and quality of the census.

    Agency: Department of Commerce
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Commerce should direct the Under Secretary of the Economics and Statistics Administration and the Director of the U.S. Census Bureau to use productivity measures that track the progress in completing in-office address canvassing workload and the effectiveness of in-office address canvassing in reducing fieldwork in order to make informed decisions on allocating resources to current and future address canvassing workload so that the operation is completed in a timely and cost-effective manner.

    Agency: Department of Commerce
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: David A. Powner
    Phone: (202) 512-9286

    4 open recommendations
    Recommendation: To assist VA in improving key IT management processes to ensure that investments support the delivery of health care services, the Secretary of Veterans Affairs should direct the Under Secretary for Health and the Chief Information Officer to identify performance metrics and associated targets for the goals and objectives in the department's IT strategic plans, including the Information Resources Management strategic plan and the Health Information Strategic Plan, as they relate to the delivery of health IT and the VHA mission.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In comments on our report, VA concurred with our recommendation and described planned coordination with the Office of Information and Technology and the Veterans Health Administration to develop or revise and maintain performance metrics that support the strategic and health information technology goals and objectives. The department plans to revise performance metrics to align to new goals and objectives by June 2018.
    Recommendation: To assist VA in improving key IT management processes to ensure that investments support the delivery of health care services, the Secretary of Veterans Affairs should direct the Under Secretary for Health and the Chief Information Officer to ensure that the department-level investment review structure is implemented as planned and that guidance on the IT governance process is documented and identifies criteria for selecting new investments, and reselecting investments currently operational at VHA.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In comments on our report, VA concurred with our recommendation and provided meeting minutes for its Portfolio Investment Management Board and a document describing the proposed alignment and interdependencies between the 11 governance boards. We will continue to monitor the implementation of the proposed relationships and review any additional guidance issued that further describes the process used by the governance boards for selecting and reselecting information technology investments.
    Recommendation: To assist VA in improving key IT management processes to ensure that investments support the delivery of health care services, the Secretary of Veterans Affairs should direct the Under Secretary for Health and the Chief Information Officer to identify additional performance metrics to align with VHA's core business functions, and then use these metrics to determine the extent to which the department's IT systems support performance of VHA's mission.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In comments on our report, VA concurred with our recommendation. In addition, the department outlined steps it intends to take to address our recommendation. These steps include developing a set of core metrics to provide continuous input into investment portfolio decisions and establishing a methodology for ensuring that information technology investments are aligned to business needs and that expected outcomes are defined prior to making the investments. The department plans to complete this work by September 2018. We will continue to monitor VA's progress on these efforts.
    Recommendation: To assist VA in improving key IT management processes to ensure that investments support the delivery of health care services, the Secretary of Veterans Affairs should direct the Under Secretary for Health and the Chief Information Officer to ensure that unmet IT needs identified by key program areas--pharmacy benefits management, scheduling, and community care--are addressed appropriately and that related business functions are supported by IT systems to the extent required.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In comments on our report, VA concurred with our recommendation. The department has described its intention to ensure that unmet information technology needs for the pharmacy benefits management, scheduling, and community care program areas are addressed appropriately during fiscal year 2018 budget formulation. We will follow-up with VA to ascertain what needs have been addressed, closed, or reprioritized for each program office during fiscal year 2018.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    1 open recommendations
    Recommendation: To improve the management of the Armed Forces Sports Program and better determine whether the program is achieving its desired results, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to develop and implement performance measures for the Armed Forces Sports Program that measure the desired outcomes for the program and, at a minimum, demonstrate linkage to the program's goals or mission, have a measurable target, and include a baseline that can be used to demonstrate program performance.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD acknowledged the issuance of our final report and concurred with this recommendation. We will provide an update when we confirm the actions DOD takes to develop and implement performance measures for the Armed Forces Sports Program.
    Director: Randall B. Williamson
    Phone: (202) 512-7114

    4 open recommendations
    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to expand existing productivity metrics to track the productivity of all providers of care to veterans by, for example, including contract physicians who are not VA employees as well as advance practice providers acting as sole providers.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to help ensure the accuracy of underlying staffing and workload data by, for example, developing training to all providers on coding clinical procedures.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to develop a policy requiring VAMCs to monitor and improve clinical efficiency through a standard process, such as establishing performance standards based on VA's efficiency models and developing a remediation plan for addressing clinical inefficiency.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to establish an ongoing process to systematically review VAMCs' remediation plans and ensure that VAMCs and Veterans Integrated Service Networks are successfully implementing remediation plans for addressing low clinical productivity and inefficiency.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Anne-Marie Fennell
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: To help determine the extent to which the goals of the Cohesive Strategy are being met, the Secretaries of Agriculture and the Interior should direct the Chief of the Forest Service and the Director of the Office of Wildland Fire, respectively, to work with WFLC to develop measures to assess national progress toward achieving the strategy's goals.

    Agency: Department of Agriculture
    Status: Open

    Comments: In its April 2017 agency comments and a May 2017 follow up discussion, the Forest Service generally agreed with our recommendation. In August 2017, the Forest Service stated that it is working with partners to develop a framework for reporting progress toward the goals of the Cohesive Strategy, based on its own and other potential measures. The agency stated that the framework will be shared with the Wildland Fire Leadership Coalition for input and feedback and that initial meetings with partners were to occur in July 2017, with a proposal to be shared with WFLC in early fall 2017. The final framework is planned for spring of 2018.
    Recommendation: To help determine the extent to which the goals of the Cohesive Strategy are being met, the Secretaries of Agriculture and the Interior should direct the Chief of the Forest Service and the Director of the Office of Wildland Fire, respectively, to work with WFLC to develop measures to assess national progress toward achieving the strategy's goals.

    Agency: Department of the Interior
    Status: Open

    Comments: In its April 2017 agency comments, the Department of the Interior stated that it did not concur with our recommendation. In a letter dated August 2, 2017, Interior stated that it nevertheless will work with its federal and nonfederal partners, with input from the Wildland Fire Leadership Council, to propose a framework using existing measures to assess national progress toward achieving the goals of the Cohesive Strategy. Interior expects initial meetings with partners to occur in the summer of 2017 with a proposal to be shared with WFLC by the fall of 2017 and final framework to be completed in the spring of 2018.
    Director: James Cosgrove
    Phone: (202) 512-7114

    1 open recommendations
    Recommendation: To strengthen CMS's oversight of MA contracts, the Administrator of CMS should review data on disenrollment by health status and the reasons beneficiaries disenroll as part of the agency's routine monitoring efforts.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Andrew Sherrill
    Phone: (202) 512-7215

    1 open recommendations
    Recommendation: To enhance the ability of the Executive Office of the President to implement the Revitalize American Manufacturing and Innovation Act of 2014 requirements related to reporting on advanced manufacturing, the Director of the Office of Science and Technology Policy, working through the National Science and Technology Council and agency leadership, as appropriate, should identify the information they will collect from federal agencies to determine the extent to which the objectives outlined in the National Strategic Plan for Advanced Manufacturing are being achieved.

    Agency: Executive Office of the President: Office of Science and Technology Policy
    Status: Open

    Comments: OSTP did not state whether it agreed or disagreed with this recommendation. They provided some comments on the draft recommendation. For example, OSTP commented that the recommendation could focus on the extent to which the objectives of the Advanced Manufacturing Partnership (AMP) recommendations are being achieved in periodic updates to the implementation of the National Strategic Plan for Advanced Manufacturing. However, these recommendations were not covered in the scope of our report: we focused on reporting on the progress in achieving the objectives of the strategic plan.
    Director: Michael Courts
    Phone: (202) 512-8980

    1 open recommendations
    Recommendation: To strengthen State's ability to address persistent gaps in foreign language proficiency at overseas posts and make informed future resource investments, the Secretary of State should evaluate the effectiveness of efforts implemented under the "Strategic Plan for Foreign-Language Capabilities."

    Agency: Department of State
    Status: Open

    Comments: In his May 25, 2017 letter to the relevant congressional committees leadership, the Department of State reiterated its concurrence with this recommendation and stated that the department will develop a process to evaluate implementation of the 2011 Strategic Plan and future plans, and will report on results of the evaluation by the end of fiscal year 2018.
    Director: Michael J. Courts
    Phone: (202) 512-8980

    4 open recommendations
    Recommendation: To better assess OBO's performance, the Secretary of State should determine whether the existing OBO program performance measure and annual target of moving 1,500 people into safe, secure, and functional facilities is still appropriate or needs to be revised.

    Agency: Department of State
    Status: Open

    Comments: OBO stated that it would perform a multi-year, comprehensive evaluation of this performance metric and determine whether the target remains appropriate. As of October 2017, OBO anticipated this evaluation to be completed in fiscal year 2019.
    Recommendation: To better assess OBO's performance, the Secretary of State should establish additional performance measures applicable to the new goals of the Excellence approach in support of the Capital Security Construction Program.

    Agency: Department of State
    Status: Open

    Comments: As of October 2017, OBO had stated it would develop Excellence-related performance metrics to assess the execution and delivery of its projects. Specifically, these would be tied to the Bureau's strategic plan, which is reviewed annually and updated every three years. The next strategic plan update was estimated to occur in early 2020.
    Recommendation: To better assess OBO's performance, the Secretary of State should finalize the mechanisms OBO will use to better track and evaluate the actual operations and maintenance performance of its buildings--whether Excellence or SED--and document through appropriate policies, procedures, or guidance.

    Agency: Department of State
    Status: Open

    Comments: As of October 2017, OBO was engaged in a life cycle cost analysis methodology project intended to take an in-depth look at OBO's processes, practices, and procedures, compare and contrast them with best industry practices, and make recommendations to the bureau. OBO anticipated finalizing this by early 2018.
    Recommendation: To better assess OBO's performance, the Secretary of State should finalize the mechanisms OBO will use to centrally manage project management data (to include project cost and schedule information), currently termed the Ideal Operational State, and document through appropriate policies, procedures, or guidance.

    Agency: Department of State
    Status: Open

    Comments: As of October 2017, OBO was working on the implementation of its Ideal Operational State initiative, which it envisioned as a multi-year effort subject to budget realities. OBO anticipates having an integrated program schedule by early 2018, although full implementation would take longer.
    Director: Zina Merritt
    Phone: (202) 512-5257

    2 open recommendations
    Recommendation: The Secretary of Defense should direct the Assistant Secretary of Defense for Logistics and Materiel Readiness, in collaboration with the Director, Defense Logistics Agency; the Secretaries of the Army, Navy, and Air Force; the Commandant of the Marine Corps; the Commander of the United States Transportation Command; and the Chairman of the Joint Chiefs of Staff, to use the key attributes of successful performance measures--including clarity, measurable target, objectivity, reliability, baseline and trend data, and linkage--in refining the performance measures in subsequent updates to the Strategy to improve DOD's efforts to monitor asset visibility initiatives.

    Agency: Department of Defense
    Status: Open

    Comments: DOD, in its comments on the draft report, partially concurred. DOD stated that it recognizes the need for performance measures to ensure the success of an asset visibility improvement effort but noted that the level of complexity and granularity of the metrics we suggest may not be suitable for all initiatives. DOD also stated that the purpose of the Strategy is to create a framework whereby the components can work collaboratively to coordinate and integrate department-wide efforts to improve asset visibility, not to provide complete direction on how to define, implement, and oversee these initiatives. Additionally, DOD stated that the next edition of the Strategy will encourage the adoption of our six key attributes for asset visibility initiatives to the extent appropriate, but will not mandate their use. As discussed in our report, use of the key attributes in measuring the performance of asset visibility initiatives would help DOD to better assess department-wide progress against the goals in its Strategy and clarify what additional steps need to be taken to enable decision makers to exercise effective oversight. Encouraging adoption of the key attributes, as DOD plans to do, is a positive step, but we continue to believe that DOD needs to use these key attributes to refine its performance measures to monitor the initiatives in the future.
    Recommendation: The Secretary of Defense should direct the Assistant Secretary of Defense for Logistics and Materiel Readiness, in collaboration with the Director, Defense Logistics Agency; the Secretaries of the Army, Navy, and Air Force; the Commandant of the Marine Corps; the Commander of the United States Transportation Command; and the Chairman of the Joint Chiefs of Staff, to incorporate into after-action reports information relating to performance measures for the asset visibility initiatives when evaluating and closing these initiatives to ensure that implemented initiatives will achieve the goals and objectives in the Strategies.

    Agency: Department of Defense
    Status: Open

    Comments: DOD, in its comments on the draft report, partially concurred. DOD stated that it is important to capture and review performance data prior to a component closing an asset visibility initiative, but that the Strategy after-action report is not intended to be used to evaluate the success of an asset visibility initiative or to determine if an initiative has met its intended objectives. According to DOD, documentation and information to support the evaluation of initiatives is defined by and executed in accordance with component-level policy and procedures. DOD agreed to update its Strategy to clarify the purpose and use of the after-action reports and to ensure that the Strategy specifies roles and responsibilities for evaluating and closing initiatives. DOD?s response, however, did not state whether and how these updates to the Strategy would result in more consistent incorporation of information relating to performance measures when closing initiatives in the future. As we noted previously in this report, according to the 2015 Strategy, the after-action report for closed initiatives should include information on the objectives met, problems or gaps resolved, and measures of success obtained. We believe our recommendation is consistent with this guidance. Without incorporating this information, DOD does not have assurance that closed initiatives have been fully assessed and have resulted in achieving the goals and objectives of the Strategies. Therefore, we continue to believe that full implementation of our recommendation is needed.
    Director: King, Kathleen M
    Phone: (202) 512-7114

    3 open recommendations
    Recommendation: To ensure MACs' provider education efforts are focused on areas vulnerable to improper billing and to strengthen CMS's oversight of those efforts, CMS should require sufficient detail in MAC reporting to allow CMS to determine the extent to which MACs' provider education department efforts focus on areas identified as vulnerable to improper billing.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS concurred with this recommendation and said it would take steps to implement it. In April 2017, CMS released a revised Provider Customer Service Program Activity Report (PAR) template to Medicare Administrative Contractors (MAC). This revised template collects additional information from MACs on their provider outreach and education activities that are specifically geared towards reducing their improper payment rate. All PAR Reports submitted after July 2017 will include information on these topics. Additionally, CMS is implementing increased reporting by MACs in the Provider Customer Service Program Contractor Information Database to track whether education was provided related to the prioritization of efforts to reduce the error rate. CMS expects these additional reporting requirements to be released to the MACs in fall 2017. GAO will continue to monitor CMS efforts.
    Recommendation: To ensure MACs' provider education efforts are focused on areas vulnerable to improper billing and to strengthen CMS's oversight of those efforts, CMS should explicitly require that Medicare Part A and B claims, DME, and home health and hospice MACs work together to educate referring providers on documentation requirements for DME and home health services.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS concurred with this recommendation and said it would take steps to implement it. CMS is developing instructions for the Medicare Administrative Contractors (MAC) that will require MACs to collaborate on a regular basis to provide education to referring providers on documentation and other requirements relative to durable medical equipment and home health services. CMS expects these new instructions to be released to MACs in fall 2017. Additionally, CMS is implementing increased reporting by MACs in the Provider Customer Service Program Contractor Information Database to track the instances of collaboration with other MACs. CMS expects these additional reporting requirements to be released to the MACs in fall 2017. Finally, CMS revised the Provider Customer Service Program Activity Report (PAR) to collect additional information from MACs on education topics where MACs collaborated with each other and with external partners. This new template was released to MACs in April 2017, and all PARs submitted after July 2017 will include information on these topics. GAO will continue to monitor CMS efforts.
    Recommendation: To ensure MACs' provider education efforts are focused on areas vulnerable to improper billing and to strengthen CMS's oversight of those efforts, for any future probe and educate reviews, CMS should establish performance metrics that will help the agency determine the reviews' effectiveness in reducing improper billing.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS concurred with this recommendation and said it would take steps to implement it. Through the Targeted Probe and Educate Pilot, currently under way in Jurisdiction F and set to expand in the near future to additional jurisdictions, CMS has been working to develop more thorough metrics to monitor the outcome and impact of the probe and educate reviews. Detailed metrics in the expanded pilot include service and provider specific error rates, claims metrics, financial impact, education metrics, provider/suppler behavior metrics, as well as volume and outcome of appeals both pre- and post-probe and educate implementation. GAO will continue to monitor CMS efforts.
    Director: Cary B. Russell
    Phone: (202) 512-5431

    2 open recommendations
    Recommendation: To better ensure quality financial execution information is available to guide the Joint Exercise Program, the Secretary of Defense should direct the Office of the Assistant Secretary of Defense for Readiness to direct the combatant commanders to take steps to comply with current Execution Management System guidance to upload supporting documentation that is reconcilable to funds executed from the Combatant Commanders Exercise Engagement and Training Transformation account.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better ensure quality financial execution information is available to guide the Joint Exercise Program, the Secretary of Defense should direct the Office of the Assistant Secretary of Defense for Readiness to, as the department implements financial improvement plans in accordance with the Financial Improvement and Audit Readiness guidance, include specific internal control steps and procedures to address and ensure the completeness and accuracy of information captured for the Joint Exercise Program's Combatant Commanders Exercise Engagement and Training Transformation account.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Shelby S. Oakley
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: The NNSA Administrator should direct the DNN R&D program to track and document the transitioned and deployed technologies that result from its research and technology development projects, to the extent practicable.

    Agency: Department of Energy: National Nuclear Security Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken, we will update.
    Recommendation: The NNSA Administrator should direct the DNN R&D and NPAC programs to document, using a common template or other means, their assessment that compares the final results of each project against the baseline targets established in each project's initial project plan.

    Agency: Department of Energy: National Nuclear Security Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken, we will update.
    Director: Frank Rusco
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: To enhance the transparency and timeliness of NRC's fee-setting process, the Chairman of the Nuclear Regulatory Commission should direct NRC staff to clearly present information in NRC's proposed fee rule, final fee rule, and fee work papers, by defining and consistently using key terms, providing complete calculations for how fees are determined, and ensuring the accuracy of the fee rules and work papers, so that stakeholders can understand fee calculations and provide substantive comments to the agency on them.

    Agency: Nuclear Regulatory Commission
    Status: Open

    Comments: According to NRC, it has provided more detailed explanations and calculations in its fiscal year 2017 proposed fee rule. The agency plans to propose codifying some of these changes in Title 10 of the Code of Federal Regulations Part 170 during its fiscal year 2018 fee rulemaking. We will review NRC's changes after it has codified them in the Code of Federal Regulations and will update the status of this recommendation at that time.
    Recommendation: To enhance the transparency and timeliness of NRC's fee-setting process, the Chairman of the Nuclear Regulatory Commission should direct NRC staff to develop objective, measurable, and quantifiable performance goals and measures that enable NRC to assess the extent to which its efforts to improve transparency and timeliness are successful and implement a plan and schedule for comparing results with the established performance goals.

    Agency: Nuclear Regulatory Commission
    Status: Open

    Comments: NRC convened a steering committee to provide leadership for implementing its efforts to improve transparency and timeliness of its fee-setting process. According to NRC, the steering committee has developed performance measures to gauge success and will monitor planned activities to compare results with the performance goals. We will review NRC's activities to improve transparency and timeliness, as well as the steering committee's actions to measure and monitor success. We will update the status of this recommendation upon completion of our review.
    Director: Rebecca Gambler
    Phone: (202) 512-8777

    1 open recommendations
    Recommendation: To better ensure the effectiveness of CBP's predeparture programs, the Commissioner of U.S. Customs and Border Protection should develop and implement a system of performance measures and baselines to evaluate the effectiveness of CBP's predeparture programs and assess whether the programs are achieving their stated goals.

    Agency: Department of Homeland Security: United States Customs and Border Protection
    Status: Open

    Comments: U.S. Customs and Border Protection's (CBP) Office of Field Operations (OFO) reported that it established a working group comprised of designated program officials from CBP's Admissibility and Passenger Programs; National Targeting Center; Planning, Program Analysis, and Evaluation; and, Preclearance offices to develop and implement a system of performance measures and baselines to evaluate the effectiveness of CBP's predeparture programs. As of July 2017, CBP reported that the working group had developed three performance measures for its predeparture programs. According to OFO officials, fiscal year 2018 will be the first complete year that each of these measures is calculated using a standardized and repeatable methodology and will thus be used as a baseline year. The baselines developed during fiscal year 2018 will then be used in future assessments of program effectiveness. To fully address this recommendation to develop and implement performance measures and baselines for evaluating its predeparture programs, GAO will review documentation from CBP, when available, on the fiscal year 2018 baselines and CBP's planned evaluation of fiscal year 2019 data against those baselines.
    Director: Rebecca Gambler
    Phone: (202) 512-8777

    6 open recommendations
    Recommendation: To better inform on the effectiveness of CDS implementation and border security efforts, the Chief of Border Patrol should strengthen the methodology for calculating recidivism such as by using an alien's apprehension history beyond one fiscal year and excluding aliens for whom there is no record of removal and who may remain in the United States.

    Agency: Department of Homeland Security: United States Customs and Border Protection: Office of the Commissioner: U.S. Border Patrol
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better inform on the effectiveness of CDS implementation and border security efforts, the Chief of Border Patrol should collect information on reasons agents do not apply the CDS guides' Most Effective and Efficient consequences to assess the extent that agents' application of these consequences can be increased and modify development of CDS guides, as appropriate.

    Agency: Department of Homeland Security: United States Customs and Border Protection: Office of the Commissioner: U.S. Border Patrol
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better inform on the effectiveness of CDS implementation and border security efforts, the Chief of Border Patrol should revise CDS guidance to ensure consistent and accurate methodologies for estimating Border Patrol costs across consequences and to factor in, where appropriate and available, the relative costs of any federal partner resources necessary to implement each consequence.

    Agency: Department of Homeland Security: United States Customs and Border Protection: Office of the Commissioner: U.S. Border Patrol
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better inform on the effectiveness of CDS implementation and border security efforts, the Chief of Border Patrol should ensure that sector management is monitoring progress in meeting their performance targets and communicating performance results to Border Patrol headquarters management.

    Agency: Department of Homeland Security: United States Customs and Border Protection: Office of the Commissioner: U.S. Border Patrol
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To better inform on the effectiveness of CDS implementation and border security efforts, the Chief of Border Patrol should provide consistent guidance for alien classification and take steps to ensure CDS Project Management Office and sector management conduct data integrity activities necessary to strengthen control over the classification of aliens.

    Agency: Department of Homeland Security: United States Customs and Border Protection: Office of the Commissioner: U.S. Border Patrol
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Homeland Security should direct the Assistant Secretary of Immigration and Customs Enforcement and Commissioner of Customs and Border Protection to collaborate on sharing immigration enforcement and removal data to help Border Patrol account for the removal status of apprehended aliens in its recidivism rate measure.

    Agency: Department of Homeland Security
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: J. Alfredo Gómez
    Phone: (202) 512-3841

    5 open recommendations
    Recommendation: To help the agency make strategic decisions about how to prioritize and efficiently use available personnel, the Administrator, recognizing the agency's limited resources, should direct the Assistant Administrator for the Office of Administration and Resources Management to develop a documented process that can be consistently applied by regional and national program offices to collect and analyze data on project officer FTEs.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA's December 2016 letter with comments on the draft report, EPA agrees with this recommendation and will initiate implementation in FY 2017 by developing and issuing a survey tool to collect relevant information on project officer FTE and workload. According to the letter, EPA will evaluate the survey results in FY 2018 and establish a formal process to influence out-year budget cycles, beginning with the FY 2020 budget.
    Recommendation: To help the agency make strategic decisions about how to prioritize and efficiently use available personnel, the Administrator, recognizing the agency's limited resources, should direct the Assistant Administrator for the Office of Administration and Resources Management to develop a documented process that can be consistently applied by regional and national program offices to collect and analyze data on grants management workloads.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA's December 2016 letter with comments on the draft report, EPA agrees with this recommendation and will initiate implementation in FY 2017 by developing and issuing a survey tool to collect relevant information on project officer FTE and workload. According to the letter, EPA will evaluate the survey results in FY 2018 and establish a formal process to influence out-year budget cycles, beginning with the FY 2020 budget.
    Recommendation: To help the agency make strategic decisions about how to prioritize and efficiently use available personnel, the Administrator, recognizing the agency's limited resources, should direct the Assistant Administrator for the Office of Administration and Resources Management to develop a documented process that can be consistently applied by regional and national program offices to use project officer FTE and workload data to inform FTE allocations.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA's December 2016 letter with comments on the draft report, EPA agrees with this recommendation and will initiate implementation in FY 2017 by developing and issuing a survey tool to collect relevant information on project officer FTE and workload. According to the letter, EPA will evaluate the survey results in FY 2018 and establish a formal process to influence out-year budget cycles, beginning with the FY 2020 budget.
    Recommendation: To help ensure that EPA has people with the right skills to meet the goals of its 2016-2020 Grants Management Plan, the Administrator should direct the Assistant Administrator for the Office of Administration and Resources Management and regional and national program offices, as appropriate, to review project officer critical skills and competencies and determine training needs to address any gaps.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA's December 2016 letter with comments on the draft report, EPA agrees with this recommendation and will initiate implementation in FY 2017 by developing and issuing a project officer survey tool. According to the letter, based on the survey results, EPA will begin making enhancements to its project officer training program in FY 2018, and continue those efforts in subsequent fiscal years consistent with goal 3 of the agency's 2016-2020 Grants Management Plan.
    Recommendation: To enhance EPA's ability to identify performance shortfalls and appropriate corrective actions, the Administrator should direct the Assistant Administrator for the Office of Administration and Resources Management to develop performance measures to track the effectiveness of the recruitment and retention efforts for grant specialists and collect performance data for these measures.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA's December 2016 letter with comments on the draft report, EPA agrees with this recommendation. According to the letter, in FY 2017, EPA's Office of Grants and Debarment (OGD), with support from the agency's human resources data system, will formalize its process for collecting information on grants specialist recruitment and retention. In FY 2018, EPA will issue performance measures related to grants specialist recruitment and retention.
    Director: Carolyn L. Yocom
    Phone: (202) 512-7114

    3 open recommendations
    Recommendation: To improve oversight of states' payment structures for MLTSS, the Administrator of CMS should require all states to collect and report on progress toward achieving MLTSS program goals, such as whether the program enhances the provision of community-based care.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve oversight of states' payment structures for MLTSS, the Administrator of CMS should establish criteria for what situations would warrant exceptions to the federal standards that the data used to set rates be no older than the three most recent and complete years.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve oversight of states' payment structures for MLTSS, the Administrator of CMS should provide states with guidance that includes minimum standards for encounter data validation procedures.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Kathy King
    Phone: (202) 512-7114

    1 open recommendations
    including 1 priority recommendation
    Recommendation: To help ensure that quality care is provided to AI/AN people, as part of the implementation of its quality framework, the Secretary of HHS should direct the Director of IHS to ensure that agency-wide standards for the quality of care provided in its federally operated facilities are developed, that facility performance in meeting these standards is systematically monitored over time, and that enhancements are made to its adverse event reporting system.

    Agency: Department of Health and Human Services
    Status: Open
    Priority recommendation

    Comments: HHS agreed with our recommendation and cited steps it already has underway to improve the quality of care in IHS's federally-operated facilities. HHS described the development of the IHS Quality Framework and Implementation Plan released in November 2016. However, as of June 2017, IHS had not developed agency-wide standards for the quality of care provided in its federally operated facilities.
    Director: Zina D. Merritt
    Phone: (202) 512-5257

    3 open recommendations
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and as part of DOD's strategic planning process, should define a role for the military department CMOs or DCMOs in developing department-wide goals and objectives for business transformation.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and as part of DOD's strategic planning process, should coordinate with the military department CMOs or DCMOs to align the military departments' goals and objectives for business transformation with department-wide goals and objectives, including in DOD's Agency Strategic Plan.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Deputy Secretary of Defense, in his capacity as the CMO and in coordination with the DOD DCMO, should take action, as appropriate and necessary, to improve the monitoring of the military departments' performance on business transformation efforts. This could be done by revising the Defense Business Council's charter to make the council responsible for monitoring such performance to reflect the responsibilities of the DOD DCMO to monitor performance across the entire department.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Kathleen M. King
    Phone: (202) 512-7114

    1 open recommendations
    Recommendation: To improve the efficiency and effectiveness of the agency's enrollment screening process, the Administrator of CMS should establish objectives and performance measures for assessing progress toward achieving its goals.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: As of August 2017, the Department of Health and Human Services (HHS) considers this recommendation still open. HHS noted that the Centers for Medicare & Medicaid Services is planning to implement this recommendation in early 2018. GAO will continue to monitor the agency's progress and will update the status of the recommendation when we receive additional information.
    Director: Rebecca Gambler
    Phone: (202) 512-8777

    1 open recommendations
    Recommendation: To better assess whether the LOP and LOPC are having a measurable impact in meeting their program objectives, the Director of EOIR should develop and implement a system of performance measures, including establishing a baseline, to regularly evaluate the effectiveness of LOP and LOPC and assess whether the programs are achieving their stated goals.

    Agency: Department of Justice: Executive Office for Immigration Review
    Status: Open

    Comments: In January 2017, EOIR reported that the agency is working with a contractor to redesign EOIR's performance management system consistent with the principles outlined in the Government Performance and Results Modernization Act of 2010. In addition, EOIR reported that staff from its Office of Legal Access Programs (OLAP) plan to participate in strategic planning training, which will include how to establish performance measurements. To fully address the recommendation, EOIR should develop and implement a system of performance measures for LOP and LOPC, including establishing a baseline, and assess program performance against such measures.
    Director: Susan Fleming
    Phone: (202) 512-2834

    3 open recommendations
    Recommendation: To determine whether CSA interventions influence motor carrier safety performance, the Secretary of Transportation should direct the FMCSA Administrator to identify and implement, as appropriate, methods to evaluate the effectiveness of individual intervention types or common intervention patterns to obtain more complete, appropriate, and accurate information on the effectiveness of interventions in improving motor carrier safety performance. In identifying and implementing appropriate methods, FMCSA should incorporate accepted practices for designing program effectiveness evaluations, including practices that would enable FMCSA to more confidently attribute changes in carriers' safety behavior to CSA interventions.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To understand the efficiency of CSA interventions the Secretary of Transportation should direct the FMCSA Administrator to update FMCSA's cost estimates to determine the resources currently used to conduct individual intervention types and ensure FMCSA has cost information that is representative of all states.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To enable FMCSA management to monitor the agency's progress in achieving its effectiveness and efficiency outcomes for CSA interventions and balance priorities, the Secretary of Transportation should direct the FMCSA Administrator to establish and use performance measures to regularly monitor progress toward both FMCSA's effectiveness outcome and its efficiency outcome.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Timothy J. DiNapoli
    Phone: (202) 512-4841

    5 open recommendations
    including 4 priority recommendations
    Recommendation: To better promote federal agency accountability for implementing the FSSI and category management initiatives, the Administrator of Federal Procurement Policy should ensure that transition plans are submitted and monitored as required by FSSI guidance and guidance governing specific category management initiatives.

    Agency: Executive Office of the President: Office of Management and Budget: Office of Federal Procurement Policy
    Status: Open
    Priority recommendation

    Comments: In October 2016, Office of Management and Budget (OMB) staff agreed that agency transitions plans should be submitted and monitored in accordance with guidance, as GAO recommended in October 2016. OMB staff indicated that all FSSIs are now being evaluated against best in class criteria as part of the migration to a category management approach to federal procurement. Further, OMB staff stated that OMB will issue additional policy or guidance as necessary. GAO believes these actions, if implemented, would meet the intent of the recommendation. As of August 1, 2017, OMB staff indicated they are continuing efforts to implement this recommendation. Given that transition plans were also required under FSSI guidance but were not submitted or monitored, it will be important for OMB to ensure that agencies follow through on submitting required plans going forward.
    Recommendation: To better promote federal agency accountability for implementing the FSSI and category management initiatives, the Administrator of Federal Procurement Policy should update the Leadership Council charter to establish an expectation that Leadership Council agencies develop agency-specific targets for use of the solutions approved.

    Agency: Executive Office of the President: Office of Management and Budget: Office of Federal Procurement Policy
    Status: Open
    Priority recommendation

    Comments: In October 2016, OMB staff agreed with the need for agency-specific targets for use of FSSI and category management initiatives as GAO recommended. OMB staff recommended, however, that this be accomplished through the Category Management governance and reporting procedures and processes that will be instituted in upcoming guidance, rather than an update to the Leadership Council charter. In October 2016, OMB issued a draft circular on category management establishing that spend under management will be the principal measure OMB will use to assess agency adoption of category management. OMB staff indicated that they plan to evaluate at least annually agencies' spend under management results, which includes agency adoption of best in class solutions, and then review with agency leaders progress toward meeting goals. As of August 1, 2017, OMB staff indicated they are continuing efforts to implement this recommendation. Given the low agency usage of the FSSIs, without such actions, and ensuring these targets and measures are set, OMB, and specifically the Office of Federal Procurement Policy, will lack the means to monitor progress and hold large procurement agencies accountable for using existing FSSIs or best in class solutions identified under subsequent category management efforts.
    Recommendation: To better promote federal agency accountability for implementing the FSSI and category management initiatives, the Administrator of Federal Procurement Policy should revise the 2015 category management guidance to establish a process for setting targets and performance measures for each Leadership Council agency's adoption of proposed FSSIs and category management solutions and ensure agency specific targets and measures are set.

    Agency: Executive Office of the President: Office of Management and Budget: Office of Federal Procurement Policy
    Status: Open
    Priority recommendation

    Comments: In October 2016, Office of Management and Budget (OMB) staff agreed that Leadership Council agency progress towards implementing category management should be tracked and measured as we recommended. OMB staff reported that guidance is in draft form in which agency progress will be measured using the Spend Under Management (SUM) model which provides an assessment of category management maturity for each of the ten government-wide categories as evaluated against five attributes: leadership, strategy, data, tools, and metrics. OMB will assess agency progress no less than annually and will engage agency leaders in regularly reviewing progress toward their goals. In addition, OMB will track agency spend through best in class contracts and these data will likely be used as an internal category metric and shared with the agencies. Taken together, these actions are responsive to GAO?s recommendations. As of August 1, 2017, OMB staff indicated they are continuing efforts to implement this recommendation. Given the low use of the FSSIs, OMB should continue to carefully monitor category management implementations as it moves forward and ensure that OFPP uses the planned targets and measures to hold agencies accountable for individual results. In short, greater accountability can lead to increased savings.
    Recommendation: To better promote federal agency accountability for implementing the FSSI and category management initiatives, the Administrator of Federal Procurement Policy should report on agency specific targets and metrics as part of the category management Cross-Agency Priority goal.

    Agency: Executive Office of the President: Office of Management and Budget: Office of Federal Procurement Policy
    Status: Open
    Priority recommendation

    Comments: In October 2016, Office of Management and Budget (OMB) staff agreed that agency specific targets and metrics should be reported as GAO recommended in October 2016. OMB staff indicated that results achieved relative to the Category Management Cross Agency Priority (CAP) goal targets will continue to be reported on a quarterly basis on Peformance.gov but that they will likely not include agency specific targets and metrics. Rather, OMB staff indicated that agency spending through best in class solutions will be tracked and used as an internal category metric and that OMB will engage agency leaders in regularly reviewing progress toward their goals and assess agencies no less than annually. GAO believes these actions, if implemented, would meet the intent of the recommendation. As of August 1, 2017, OMB staff indicated they are continuing efforts to implement this recommendation. Given the low agency usage of the FSSIs, OMB needs to monitor progress and hold large procurement agencies accountable for using existing FSSIs or best in class solutions identified under subsequent category management efforts.
    Recommendation: To improve the management of current FSSIs, the GSA FSSI program management office should provide oversight and support to the Information Retrieval FSSI to better align their practices with current strategic sourcing guidance related to collecting and using transactional data to calculate savings.

    Agency: General Services Administration
    Status: Open

    Comments: In response to our recommendation, GSA conducted a gap analysis of the Information Retrieval FSSI and its compliance with FSSI standards and provided the Library of Congress with FSSI best practice tools and resources related to collecting transactional data and calculating savings. According to GSA, the Library of Congress intends to address gaps to support the goal of implementation in the next Information Retrieval award in 2018. GSA will monitor progress, and provide feedback and assistance.
    Director: Debra A. Draper
    Phone: (202) 512-7114

    3 open recommendations
    Recommendation: The Secretary of Veterans Affairs should direct the Under Secretary for Health to define the roles and responsibilities of VAMCs in operationalizing VHA's strategic goals and objectives; this could be accomplished by establishing roles and responsibilities for VAMCs similar to how VHA defines roles and responsibilities for VISNs in VHA Directive 1075 and by developing guidance for VAMCs similar to guidance developed for VISNs.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: According to officials, VHA's Office of Policy and Planning continues to routinely communicate that all components of the organization should align their activities and resources to VA's 2014-2020 strategic goals and objectives, the MyVA Priority and Management Initiatives, and to the five VHA Priorities for Strategic Action. VHA's Office of Policy and Planning has also developed and disseminated Strategic Principals for Operational and Programmatic Decision Making, which was intended to provide a set of unifying principles for operational and programmatic decision-making. In its September 2017 update, VHA provided GAO with a copy of its draft FY 2018-2019 Operational and Modernization Plan. VHA is also in process of developing an Operational Planning Worksheet that is intended to provide instructions, definitions and examples to help create meaningful tactics, identify accountable leads, and document relevant interdependencies and requirements across the organization for VAMCs, VISNs and Program Offices. In its September 2017 update, VHA also noted that the National Leadership Council Strategic Planning Summit was held in June 2017, and that the focus of the summit was to ensure a clear understanding of the five VA/VHA priorities and how to operationalize the priorities at all levels of the organization. According to officials, VHA also held its National Planning Training (NPT) in August 2017 and the training was designed around the five VA/VHA priorities with a significant emphasis on clarifying the roles and responsibilities of VA Health Care Systems, VISNs and Program Offices in operationalizing the five priorities. According to officials, presentations incorporated the five priorities and a discussion on the various operational roles across the organization. VHA also noted that an online discussion board was opened at the conclusion of each NPT session with discussion questions specific to clarifying implementation responsibilities for the five VA/VHA priorities and other strategic initiatives. GAO has requested that VHA provide documentary evidence of these activities to support closure of this recommendation.
    Recommendation: The Secretary of Veterans Affairs should direct the Under Secretary for Health to consistently develop strategies that can be used by VISNs and VAMCs to operationalize VHA's goals and objectives, ensuring that they clearly link directly to VHA's goals and objectives.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: According to officials, VHA held its annual National Leadership Council Strategic Planning Summit in June 2017, during which NLC members and other strategic thinkers representing Program Office and VA Health Care Systems identified a set of strategies and milestones that link to and support operationalizing the five VA/VHA priorities. According to officials, these 16 strategies and milestones serve as the initial framework for operational planning at the VA Health Care System, VISN, and Program Office levels. VHA has provided evidence that it is currently developing its 2018 modernization and operational planning guidance, which is expected to link VA's strategic goals and objectives to the modernization plan and the five VA/VHA priorities. The guidance is also expected to require program offices, VISNs, and VAMCs to submit plans that articulate tactics and milestones and identify requirements that clearly link organizational activities back to operationalizing strategies and accomplishing priorities and goals. According to officials, the next phase of operational planning will occur at the VA Senior Leaders' Business Meeting, during which VA Health Care System, VISN, and Program Office leaders will further detail plans by identifying the tactics and requirements each will implement to operationalize the strategies and achieve the priorities, including identifying individuals that will be responsible for leading implementation of tactics. According to officials, VHA will initiate the final phase of operational planning following this meeting. During this final phase, VHA expects to disseminate its operational plan, and guidance, to VISNs and Program Offices with guidance to work with their subcomponents (VAMCs and other divisions) to finalize details in support of the operational plan. Following, the VISNs and Program Offices are expected to return their plans to VHA's Office of Policy and Planning to be incorporated into VHA's final modernization and operational plan. According to officials, VHA's Office of Policy and Planning has also continued to work very closely with the VA Office of Enterprise Integration to link VHA's strategies and measures with VA's draft 2018-2024 goals, objectives, strategies and measures to ensure consistency and alignment in planning and operationalization. According to officials, these linkages will enable VHA and VA to monitor and report progress on achieving the five VA/VHA priorities.
    Recommendation: The Secretary of Veterans Affairs should direct the Under Secretary for Health to develop an oversight process to assess progress made in meeting VHA's strategic goals and objectives, including feedback on how well activities and programs are contributing to achieving these goals and objectives.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In its 60-day update, VHA notified GAO that performance plans for senior executives will be updated to include requirements to provide oversight to assure that day-to-day activities on initiatives and programs are consistent with organizational goals, objectives and priorities. Furthermore, VHA informed GAO that executive performance, and performance of the organizations they lead, will be assessed using periodic review of performance against established organizational metrics associated with priorities, and annual performance plans of senior executives. In its 60 day update, VHA also notified GAO that VHA's Office of Policy and Planning will monitor implementation on a periodic basis to identify when initiatives or programs are progressing appropriately or at risk of not achieving goals and objectives in accordance with priorities. In VHA's August 2017 update on open recommendations, officials noted that VHA has also developed an internal Healthcare Operations Dashboard--which provides immediate and daily information regarding veterans' health care access, including wait times, productivity, and utilization--and an externally-facing Access and Quality in VA Healthcare web site--which provides veterans, caregivers, and other stakeholders with tools to view access and quality performance for specific VA facilities. According to VHA officials, both VA and VHA are monitoring strategic programs and activities to identify barriers that may impede progress towards the achievement of goals and objectives, which can then be elevated to leadership, as appropriate. In VHA's September 2017 update, officials also noted that VHA's Office of Policy and Planning and Office of Strategic Integration are coordinating the monitoring and quarterly reporting of progress on achievements related to the five VA/VHA priorities and the supporting strategies. According to officials, Priority and Strategy leads have been identified and are responsible for reporting operational progress and for managing any challenges that slow or prevent operationalization. According to officials, progress on all strategies and priorities is being reported at the VHA senior leaders morning meeting on a routine basis. GAO has requested that VHA provide documentary evidence of these activities to support closure of this recommendation.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    1 open recommendations
    Recommendation: To improve the management of DOD's credentialing program and better determine whether the program is achieving its desired results, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to develop and implement program performance measures that include key attributes, such as a baseline and goals, that can be used to assess performance.

    Agency: Department of Defense
    Status: Open

    Comments: DOD did not concur with our recommendation to develop and implement performance measures for its credentialing program. As of August 23, 2017, the department still has yet to develop performance measures for the program.
    Director: Beryl H. Davis
    Phone: (202) 512-2623

    9 open recommendations
    including 4 priority recommendations
    Recommendation: To provide agencies access to SSA's more complete set of death data, Congress should consider amending the Social Security Act to explicitly allow SSA to share its full death file with Treasury for use through the DNP working system.

    Agency: Congress
    Status: Open

    Comments: When we confirm what actions have been taken we will update. As of August 3, 2017, no updated information has been provided.
    Recommendation: To reasonably assure that additional relevant databases are identified and evaluated for inclusion in the DNP working system, the Director of OMB should develop, document, and communicate a formal process that user agencies can use to identify, suggest, and receive feedback on additional databases to be evaluated for inclusion in the DNP working system.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB agreed with this recommendation and cited plans to implement it. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To reasonably assure that the DNP working system is used effectively and consistently, the Director of OMB should develop guidance that clarifies whether the use of DNP's payment integration functionality is required and--if required--the circumstances and process in which agencies may obtain an exemption from this requirement.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open
    Priority recommendation

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB agreed with this recommendation and cited plans to implement it. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To reasonably assure that agencies use the DNP working system effectively, the Director of OMB should develop a strategy--and communicate its strategy through guidance--for how agencies should use the DNP working system to complement existing data matching processes and whether and how agencies should consider using the DNP working system to streamline existing data matching. Such guidance may cover how agencies should demonstrate that their data matching processes meet the requirements in the Improper Payments Elimination and Recovery Improvement Act of 2012, whether agencies can decide on their own which specific databases to use, and how agencies should use the functionalities available through the DNP working system.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open
    Priority recommendation

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB stated that it generally agreed with the concept of developing a strategy for how agencies should use the Do Not Pay (DNP) working system to complement existing data matching processes and would explore the concept further. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To reasonably assure that agencies develop consistent policies and procedures to verify DNP matches, the Director of OMB should provide additional guidance that outlines when and how agencies should verify DNP matches against a secondary source and provide individuals an opportunity to contest before taking adverse actions as a result of DNP matches.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open
    Priority recommendation

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB stated that it agreed with the of consistent policies and procedures and will work with agencies so that their policies and procedures for verifying Do Not Pay (DNP) matches are developed consistently. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To better monitor agency use of the DNP working system once a strategy has been developed, the Director of OMB should develop and implement monitoring mechanisms--such as goals, benchmarks, and performance measures--to evaluate agency use of the DNP working system.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open
    Priority recommendation

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB stated that it agreed with the concept of monitoring mechanisms and will continue to work with agencies to reduce improper payments and encourage agencies to establish goals to improve payment accuracy that will be monitored and evaluated by OMB. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To reasonably assure that agency-reported information on use of the DNP working system is reliable, the Director of OMB should develop a process for comparing agency reporting on the use of the DNP working system to available sources, such as OMB guidance and DNP working system adjudication reports.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB stated that it agreed with the concept of ensuring that data are reliable and will consider the feasibility of a process to compare agency submissions to available sources to reasonably assure that agency-reported information on use of the Do Not Pay (DNP) working system is reliable. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: To reasonably assure that agency-reported information on use of the DNP working system is complete, the Director of OMB should revise its guidance to clarify whether agencies should report on their uses of all of the functionalities of the DNP working system in their agency financial reports.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: We provided a draft of this report to OMB and Treasury and other agencies we reviewed for comment. In its written comments, OMB stated that it agreed with ensuring the completeness of data and will continue to work with agencies and the Chief Financial Officer community to ensure that agency-reported information on the use of the Do Not Pay (DNP) working system is complete. As of August 3, 2017, no updated information has been provided by the OMB. We will continue to monitor the status of this recommendation.
    Recommendation: The Secretary of the Treasury should modify the DNP working system to track adjudication of matches obtained through all functionalities.

    Agency: Department of the Treasury
    Status: Open

    Comments: In a memo dated April 13, 2017, the Department of Treasury (Treasury) stated that it is in the process of evaluating potential solutions to capture information on the impact of Portal functionalities (online single search, continuous monitoring, and batch matching), and has developed a plan with timeframes to assess the technical feasibility as well as user willingness to provide information. However, Treasury stated that it cannot be certain that this evaluation will identify viable solutions, and therefore cannot commit to making any modifications to the working system. Treasury explained, for instance, it may not be possible to design an effective and user-friendly strategy to capture agency decisions to remove an excluded party identified in a continuous monitoring file from a list of approved vendors. Further, Treasury explained that even if it can capture those decisions, it may be even more difficult to assign a dollar value to that decision as there would be no payment pending in this example. Nevertheless, Treasury stated that it is committed to thoroughly evaluating whether a solution is possible, and--if a solution proves feasibly--its goal is to complete a development plan for the implementation of any identified solutions by September 30, 2018.
    Director: Clowers, Angela N
    Phone: (202) 512-7114

    2 open recommendations
    Recommendation: To make it more likely that HHS will achieve its goals to reduce quality measure misalignment and associated provider burden, the Secretary of HHS should direct CMS and the Office of the National Coordinator for Health Information Technology to prioritize their development of electronic quality measures and associated standardized data elements on the specific quality measures needed for the core measure sets that CMS and private payers have agreed to use.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: In January 2017, HHS told us that ONC and CMS are prioritizing efforts to understand challenges associated with the development and implementation of electronic clinical quality measures. However, we determined that the actions did not fully address the recommendation because they focus on efforts to understand the challenges associated with electronic clinical quality measures as opposed to efforts to prioritize their development of measures from the core measure sets that CMS and private payers have agreed to use. As of August 2017, HHS officials have not informed us of any additional actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.
    Recommendation: To make it more likely that HHS will achieve its goals to reduce quality measure misalignment and associated provider burden, the Secretary of HHS should direct CMS to comprehensively plan, including setting timelines, for how to target its development of new, more meaningful quality measures on those that will promote greater alignment, especially measures to strengthen the core measure sets that CMS and private payers have agreed to use.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: In January 2017, HHS told us that it considers this recommendation open and CMS will continue to explore ways for greater alignment through its planning efforts. As of August 2017, HHS officials have not informed us of any additional actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.
    Director: Anne-Marie Fennell
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: To help NMFS and the Councils incorporate climate information into the fisheries management process and better manage climate-related risks, the Secretary of Commerce should direct National Oceanic and Atmospheric Administration's (NOAA) Assistant Administrator for Fisheries to develop guidance to direct the NMFS regions and Councils on how climate information should be incorporated into different parts of the fisheries management process.

    Agency: Department of Commerce
    Status: Open

    Comments: The Department of Commerce and NOAA agreed with this recommendation. On December 2, 2016, the Department of Commerce provided GAO with a letter stating that NMFS will continue to work with the Regional Fishery Management Councils and other stakeholders to identify how to best incorporate climate-related information into the fisheries management process. The letter also identified a number of NMFS' ongoing and planned efforts related to this goal. We plan to follow-up with the agency in Summer 2017 to obtain an update on the status of these efforts and the extent to which they address our recommendation.
    Recommendation: To help NMFS and the Councils incorporate climate information into the fisheries management process and better manage climate-related risks, the Secretary of Commerce should direct NOAA's Assistant Administrator for Fisheries to, in finalizing the regional action plans for implementing the NOAA Fisheries Climate Science Strategy, (1) incorporate the key attributes associated with successful performance measures in the final performance measures developed for the plans and (2) assess whether agency-wide performance measures may be needed to determine the extent to which the objectives of the Strategy overall are being achieved, and develop such measures, as appropriate, that incorporate the key attributes of successful performance measures.

    Agency: Department of Commerce
    Status: Open

    Comments: The Department of Commerce and NOAA agreed with this recommendation. In a letter to GAO on December 2, 2016, the Department of Commerce identified the following two actions that NMFS plans to take to address this recommendation by the end of calendar year 2017 - (1) NMFS will review the draft regional action plans and take appropriate action to ensure, to the extent possible, the performance measures in the final plans include key attributes of successful measures; and (2) NMFS will assess the need for agency-wide measures to track and evaluate achievement of the Strategy objective, and develop such measures as appropriate. We plan to follow-up with the agency in Summer 2017 to obtain an update on the status of these efforts.
    Director: Kimberly Gianopoulos
    Phone: (202) 512-8612

    3 open recommendations
    Recommendation: To provide a basis for comparing actual results with intended results that can generate more meaningful performance information, the Secretaries of the Interior and State and the Attorney General of the United States should jointly work with the Task Force to develop performance targets related to the National Strategy for Combating Wildlife Trafficking Implementation Plan.

    Agency: Department of the Interior
    Status: Open

    Comments: Agency agreed with recommendation and plans to implement it
    Recommendation: To provide a basis for comparing actual results with intended results that can generate more meaningful performance information, the Secretaries of the Interior and State and the Attorney General of the United States should jointly work with the Task Force to develop performance targets related to the National Strategy for Combating Wildlife Trafficking Implementation Plan.

    Agency: Department of Justice
    Status: Open

    Comments: Agency agreed with recommendation and plans to implement it
    Recommendation: To provide a basis for comparing actual results with intended results that can generate more meaningful performance information, the Secretaries of the Interior and State and the Attorney General of the United States should jointly work with the Task Force to develop performance targets related to the National Strategy for Combating Wildlife Trafficking Implementation Plan.

    Agency: Department of State
    Status: Open

    Comments: Agency agreed with recommendation and plans to implement it
    Director: Cary Russell
    Phone: (202) 512-5431

    3 open recommendations
    Recommendation: To ensure that annual training plans are aligned with the Air Force's stated goals to ensure that its forces can successfully achieve missions across a broad range of current and emerging threats, the Secretary of Defense should direct the Secretary of the Air Force to comprehensively reassess the assumptions underlying its annual training requirements--including, but not limited to, the total annual training requirements by aircraft, the criteria for designating aircrews as experienced or inexperienced, and the mix between live and simulator training--and make any appropriate adjustments in future training plans.

    Agency: Department of Defense
    Status: Open

    Comments: The Air Force has taken steps to address this recommendation. As of August 2017, Air Force officials identified a recently completed study, as well as an ongoing study, intended to reassess the assumptions underlying its annual training requirements for fighter aircrews. For example, Air Force officials stated a study was completed in August 2017 reassessing the criteria for designating aircrews as experienced or inexperienced for 4th generation fighter aircraft. In addition, Air Force officials stated that there is an ongoing study to define the optimum mix of annual training requirements for fighter aircrews. These officials stated that an initial briefing of the study results will be provided to Air Force senior leaders in September 2017. Completion of these studies and the corresponding adjustments to annual training requirements should help the Air Force ensure that their training plans are aligned to achieve a range of missions for current and emerging threats as recommended by GAO in its September 2016 report.
    Recommendation: To improve the Air Force's ability to consistently monitor training results and better position it to allocate resources to address factors that limit the effectiveness of training, the Secretary of Defense should direct the Secretary of the Air Force to establish desired learning objectives and training support elements needed to accomplish the training expectations in its annual Ready Aircrew Program tasking memorandums, and develop a process to collect data to assess the effectiveness of annual training against these features.

    Agency: Department of Defense
    Status: Open

    Comments: As of August 2017, no executive action has been taken. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To improve the Air Force's ability to develop the capabilities needed to meet its virtual training needs, the Secretary of Defense should direct the Secretary of the Air Force to continue to refine its planning for virtual training to incorporate the desirable characteristics of a comprehensive strategy, including developing a risk-based investment strategy that identifies and prioritizes capability needs and includes a time line for addressing them.

    Agency: Department of Defense
    Status: Open

    Comments: The Air Force has taken steps to address this recommendation. As of August 2017, Air Force officials stated that the service is in the process of updating its Air Force Operational Training Infrastructure 2035 Flight Plan. This plan will be accompanied by an infrastructure funding strategy and classified supplement. These officials stated that among these three documents the Air Force will incorporate all of the desirable characteristics of a comprehensive strategy. Air Force officials estimate that these documents will be finalized in the fall of 2017. Completion of these documents should help the Air Force incorporate the desirable characteristics of a comprehensive strategy and better enable the Air Force to acquire virtual training devices based on sound requirements and priorities, as recommended by GAO in its September 2016.
    Director: Currie, Christopher P
    Phone: (202) 512-8777

    3 open recommendations
    Recommendation: To better assess the impact of the fire grants program, the Secretary of Homeland Security should direct the FEMA Administrator to establish measurable performance targets linked to AFG and SAFER program goals, such as the desired percentage of awardees who used grants to achieve compliance with equipment standards.

    Agency: Department of Homeland Security
    Status: Open

    Comments: According to officials, FEMA's Grant Programs Directorate is reviewing the current set of program metrics to determine the feasibility of establishing performance targets. FEMA plans to include approved targets in its annual report to Congress that will be issued for fiscal year 2016; the report was undergoing internal review for approval and release as of November 2016. Pending issuance of the report with measurable performance targets linked to AFG and SAFER program goals, this recommendation will remain open.
    Recommendation: To enhance FEMA's efforts to assess and integrate the fire grant programs' contributions to national preparedness, the Secretary of Homeland Security should direct the FEMA Administrator to use the National Preparedness Goal's definition of critical infrastructure as the basis of collecting information from applicants and using the National Critical Infrastructure Prioritization Program list to measure fire grant programs' performance in addressing national priorities.

    Agency: Department of Homeland Security
    Status: Open

    Comments: According to officials, FEMA's Grant Programs Directorate plans to incorporate the National Preparedness Goal definition of national critical infrastructure into fire grant performance measures in FEMA's fiscal year 2017 Annual Report to Congress. Specifically, they said FEMA plans to conduct an assessment of data from AFG program application and awards in order to verify recipients are reporting infrastructure that aligns with the National Preparedness Goal definition of critical infrastructure. In addition, FEMA plans to meet as needed with the National Programs and Protection Directorate's Office of Critical Infrastructure Analysis to determine how the Critical Infrastructure Prioritization Program list can be used in the application process. Pending completion of these efforts, this recommendation will remain open.
    Recommendation: To enhance FEMA's efforts to incorporate new National Fire Operations Reporting System (NFORS) and Fire Community Assessment Response Evaluation System (FireCARES) data elements into fire grants program management activities, the Secretary of Homeland Security should direct the FEMA Administrator to develop a project management plan for identifying relevant data elements in the new NFORS and FireCARES systems and determining how they can be used to improve fire grant applications and awards processes and the performance assessment system.

    Agency: Department of Homeland Security
    Status: Open

    Comments: According to officials, FEMA's Grant Programs Directorate intends to develop a plan to assess the data collected to determine feasibility for integration of NFORS and FireCARES data into the AFG programs. The plan will incorporate ways to improve the applications, awards processes, and tracking of performance. This plan should be completed by March 2017, and FEMA will continue to collaborate with stakeholders for the improvement of the AFG application, awards processes, and performance management. According to FEMA, the estimated completion of this effort is September 2017.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    1 open recommendations
    Recommendation: The Secretary of the Department of Transportation should direct the FHWA Administrator to develop an efficiency measure or measures that demonstrate the linkage between the federal funding of bridges and the desired performance outcomes, such as maintained or improved bridge conditions, and report the resulting information to Congress.

    Agency: Department of Transportation
    Status: Open

    Comments: In October 2016, the U.S. Department of Transportation's Federal Highway Administration (FHWA) reported to GAO that FHWA will review bridge project information and cost data that is currently being collected and review Office of Management and Budget's guidance and other examples for developing meaningful performance measures and measures that were proposed in prior FHWA proposed rulemaking efforts. Following those reviews, FHWA reported that an applicable efficiency measure will be developed that links federal funding and condition of bridges. FHWA reported that this review and evaluation will be completed by January 31, 2018 and once the efficiency measure is implemented it will be reported and incorporated in one of FHWA's existing reports to Congress.
    Director: James McTigue
    Phone: (202) 512-9110

    5 open recommendations
    Recommendation: To ensure that Field Collection program case selection processes support IRS's and the Collection program's mission, including applying tax laws with integrity and fairness to all, the Commissioner of Internal Revenue should develop, document, and communicate Field Collection program and case selection objectives, including the role of fairness, in clear and measurable terms sufficient for use in internal control.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed with the recommendation and described actions it will take to address it, to include that the Small Business/Self-Employed Division (SB/SE) will develop fiscal year 2017 program objectives that align with the mission of SB/SE and that the Collection program will develop and document specific Field Collection and case selection activities that will support SB/SE objectives. However, it is not clear how these efforts will be fully responsive our recommendation to establish Field Collection (not division-level) program and case selection objectives sufficient for use in internal control. IRS said it planned to complete actions on this recommendation by July 2017. We will update the status of IRS's implementation of the recommendation after we complete review of any documents IRS provides on actions taken.
    Recommendation: To ensure that Field Collection program case selection processes support IRS's and the Collection program's mission, including applying tax laws with integrity and fairness to all, the Commissioner of Internal Revenue should develop, document, and implement performance measures clearly linked to the Field Collection program and case selection objectives.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed with the recommendation and outlined planned actions to address it. However, since it is not clear that IRS's planned actions to implement our first recommendation will result in Field Collection program and case selection objectives sufficient for internal control purposes, IRS's ability to address the related recommendation to establish performance measures may be limited. IRS said it planned to complete actions on this recommendation by August 2017. We will update the status of IRS's implementation of the recommendation after we complete review of any documents IRS provides on actions taken.
    Recommendation: To ensure that Field Collection program case selection processes support IRS's and the Collection program's mission, including applying tax laws with integrity and fairness to all, the Commissioner of Internal Revenue should incorporate program and case selection objectives into existing risk management systems or use other approaches to identify and analyze potential risks to achieving those objectives so that Field Collection can establish risk tolerances and appropriate control procedures to address risks.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed with the recommendation and outlined planned actions to address it. However, since it is not clear that IRS's planned actions to implement our first recommendation will result in Field Collection program and case selection objectives sufficient for internal control purposes, IRS's ability to address the related recommendation to assess program risks may be limited. IRS said it planned to complete actions on this recommendation by July 2017. We will update the status of IRS's implementation of the recommendation after we complete review of any documents IRS provides on actions taken.
    Recommendation: To ensure that Field Collection program case selection processes support IRS's and the Collection program's mission, including applying tax laws with integrity and fairness to all, the Commissioner of Internal Revenue should develop, document, and communicate control procedures guidance for group managers to exercise professional judgment in the Field Collection program case selection process to achieve fairness and other program and collection case selection objectives.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed with the recommendation and described actions it will take to address it, to include review of current procedures and guidance and making changes, if necessary. IRS said it planned to complete actions on this recommendation by July 2017. We will update the status of IRS's implementation of the recommendation after we complete review of any documents IRS provides on actions taken.
    Recommendation: To ensure that Field Collection program case selection processes support IRS's and the Collection program's mission, including applying tax laws with integrity and fairness to all, the Commissioner of Internal Revenue should develop, document, and implement procedures to periodically monitor and assess the design and operational effectiveness of both automated and manual control procedures for collection case selection to assure their continued effectiveness in achieving program objectives.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed with the recommendation and outlined planned actions to address it. However, since it is not clear that IRS's planned actions to implement our first recommendation will result in Field Collection program and case selection objectives sufficient for internal control purposes, IRS's ability to address the related recommendation to monitor control procedures may be limited. IRS said it planned to complete actions on this recommendation by July 2017. We will update the status of implementation of the recommendation after we complete review of documents IRS provides on the actions taken.
    Director: Dillingham, Gerald L
    Phone: (202) 512-28334

    2 open recommendations
    Recommendation: To enhance FAA's risk-based approach for oversight of repair stations, the Secretary of Transportation should direct the Administrator of the Federal Aviation Administration to develop and implement a process in Flight Standards for incorporating into SAS the volume of critical maintenance that each U.S. airline contracts to repair stations.

    Agency: Department of Transportation
    Status: Open

    Comments: FAA did not concur with this recommendation. In July 2017, GAO confirmed that FAA does not plan to implement the recommendation because the agency believes the subjective nature of volume of work makes it an ineffective risk indicator. While FAA does not specifically assess volume of work as a primary factor in determining risk at repair stations, the agency does monitor many risks factors as primary risk indicators. Many of these risk indicators are associated with important aspects of work volume such as high workforce turnover; changes in management; rapid growth or downsizing; changes in aircraft complexity/programs; financial conditions; age of fleet and increases in aircraft discrepancies. FAA considers these factors and the criticality of a specific maintenance action on the safe operation of an aircraft to be primary risk indicators.
    Recommendation: To enhance FAA's risk-based approach for oversight of repair stations, the Secretary of Transportation should direct the Administrator of the Federal Aviation Administration to develop and implement an evaluative process with measurable performance goals and measures to determine the effectiveness of SAS as the SMS safety assurance component.

    Agency: Department of Transportation
    Status: Open

    Comments: In July 2017, GAO confirmed that FAA plans to develop overall program goals and metrics as part of the next implementation phase of its new Safety Assurance System. These metrics are expected to be fully developed based on the final design of the new system and the program requirements identified, which is scheduled to be completed in December 2017.
    Director: Kimberly Gianopoulos
    Phone: (202) 512-8612

    3 open recommendations
    Recommendation: To improve CERC's performance monitoring, the Secretary of Energy should ensure that for CERC's second phase the program creates targets and tracks progress against those targets in order to measure program performance.

    Agency: Department of Energy
    Status: Open

    Comments: DOE concurred with GAO's recommendation and has taken steps to implement it since our report. For example, DOE created a standardized reporting template with performance measures for CERC partners to complete on a quarterly basis. DOE officials informed GAO that they are working to develop targets for those performance measures. We will continue to monitor DOE's progress in implementing this recommendation.
    Recommendation: To improve the agency's performance monitoring, the Director of the U.S. Trade and Development Agency should develop and make public annual targets for the agency's performance measures.

    Agency: U.S. Trade and Development Agency
    Status: Open

    Comments: USTDA concurred with GAO's recommendation and has taken steps to implement it since our report. For example, USTDA revised its fiscal year 2016 through 2018 strategic plan to include an annual performance target for one of its two performance measures: the value of exports generated for every program dollar. We will continue to monitor USTDA's progress in developing an annual performance target for its performance measure on procurements awarded to small U.S. businesses.
    Recommendation: To improve the East Asia Program's performance monitoring, the Director of the U.S. Trade and Development Agency should ensure that the East Asia Program sets targets for its performance measures and tracks progress against those measures.

    Agency: U.S. Trade and Development Agency
    Status: Open

    Comments: USTDA concurred with GAO's recommendation. As of October 2016, USTDA had planned to review its internal goals for the East Asia Program, and other regional programs, and to begin to track progress against those goals. We will continue to monitor USTDA's progress in implementing this recommendation.
    Director: Diana C. Maurer
    Phone: (202) 512-9627

    4 open recommendations
    Recommendation: To help determine if pretrial diversion programs and practices are effectively contributing to the achievement of department goals and enhance DOJ's ability to better manage and encourage the use of such programs and practices, the Attorney General should identify, obtain, and track data on the outcomes and costs of pretrial diversion programs.

    Agency: Department of Justice
    Status: Open

    Comments: In providing comments on this report, DOJ concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To help determine if pretrial diversion programs and practices are effectively contributing to the achievement of department goals and enhance DOJ's ability to better manage and encourage the use of such programs and practices, the Attorney General should develop performance measures by which to help assess program outcomes.

    Agency: Department of Justice
    Status: Open

    Comments: In providing comments on this report, DOJ concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To determine how the use of RRCs and home confinement contribute to its goal of helping inmates successfully reenter society, and to better enable BOP to adjust its policies and procedures for the optimal use of these alternatives, as necessary and within statutory requirements, the Director of BOP should identify, obtain, and track data on the outcomes of the programs.

    Agency: Department of Justice: Bureau of Prisons
    Status: Open

    Comments: In providing comments on this report, DOJ concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To determine how the use of RRCs and home confinement contribute to its goal of helping inmates successfully reenter society, and to better enable BOP to adjust its policies and procedures for the optimal use of these alternatives, as necessary and within statutory requirements, the Director of BOP should develop performance measures by which to help assess program outcomes.

    Agency: Department of Justice: Bureau of Prisons
    Status: Open

    Comments: In providing comments on this report, DOJ concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Director: J. Christopher Mihm
    Phone: (202) 512-6806

    13 open recommendations
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Agriculture should describe the Department of Agriculture's (USDA) major management challenges and include performance goals, performance measures, milestones and an agency official responsible for resolving each of its major management challenges as part of USDA's agency performance plan.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of August 2017, USDA had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Commerce should describe the Department of Commerce's major management challenges and include performance goals, performance measures, milestones and an agency official responsible for resolving each of its major management challenges as part of the Department of Commerce's agency performance plan.

    Agency: Department of Commerce
    Status: Open

    Comments: According to the Department of Commerce' action plan to address GAO's recommendations, it will begin including a description of the Department's major management challenges, as well as related performance goals, performance milestones and an agency official responsible for resolving each of its major management challenges, in the Department's annual performance plan reporting, starting with the report to be issued concurrent with final fiscal year 2018 Congressional Budget Justifications (CBJ). As of August 2017, Commerce has not taken action to implement our recommendation. Our review of the Department of Commerce's 2018 CBJ found that it did not include recommended information. When the 2019 CBJ is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Defense should include planned actions for each of the Department of Defense's (DOD) major management challenges and ensure that required information about its major management challenges, currently in DOD's Agency Strategic Plan for Fiscal Years 2015-2018, be included in its agency performance plan so that progress toward resolving each of its major management challenges is transparent and reported annually.

    Agency: Department of Defense
    Status: Open

    Comments: As of August 2017, the Department of Defense had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Energy should describe the Department of Energy's major management challenges and include performance goals, performance measures, milestones and an agency official responsible for resolving each of its major management challenges as part of the Department of Energy's agency performance plan.

    Agency: Department of Energy
    Status: Open

    Comments: As of August 2017, the Department of Energy had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Attorney General should describe the Department of Justice's major management challenges and include performance goals, performance measures, milestones, planned actions and an agency official responsible for resolving each of its major management challenges as part of the Department of Justice's agency performance plan.

    Agency: Department of Justice
    Status: Open

    Comments: According to the Department of Justice's action plan to address GAO's recommendations, it will report the Office of Inspector General Top Management Challenges in both the Annual Financial Report (AFR) and the Annual Performance Report(APR)/Annual Performance Plan(APP). For the APR/APP, the Department of Justice will also include the appropriate performance goals, performance measures, milestones, planned actions addressing the challenges and the name(s) of agency official(s) responsible for resolving each of its major management challenges. As of August 2017, however, the Department of Justice had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Labor should describe the Department of Labor's major management challenges and include performance goals, performance measures, milestones, planned actions, and an agency official responsible for resolving each of its major management challenges as part of the Department of Labor's agency performance plan.

    Agency: Department of Labor
    Status: Open

    Comments: According to the Department of Labor's action plan to address GAO's recommendations, it will comply with the updated Circular A-11 guidance to report on major management challenges in its next Annual Performance Report (APR), published with the FY 2018 Congressional Budget Justification. In its most recent APR, the Department of Labor took steps to implement this recommendation by including planned actions and an agency official responsible for each of the three issues it identified as a major management challenge. Further action is needed to establish performance goals, performance measures, and milestones. When the Fiscal Year 2017 APR is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Transportation should describe the Department of Transportation's major management challenges and include performance goals, performance measures, milestones, planned actions and an agency official responsible for resolving major management challenges as part of the Department of Transportation's agency performance plan.

    Agency: Department of Transportation
    Status: Open

    Comments: As of August 2017, the Department of Transportation had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of the Treasury should include performance goals, performance measures, milestones, and an agency official responsible for resolving major management challenges as part of the Department of the Treasury's agency performance plan.

    Agency: Department of the Treasury
    Status: Open

    Comments: As of August 2017, Treasury had not taken any actions to implement our recommendation. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Administrator of the Environmental Protection Agency (EPA) should include performance goals, performance measures, milestones, planned actions and an agency official responsible for resolving each of its major management challenges as part of EPA's agency performance plan.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: In its Fiscal Year 2018 APP, EPA took steps to implement this recommendation by clearly identifying its major management challenges and including planned actions for resolving them. Further action is needed to establish performance goals, performance measures, milestones, and identify an agency official responsible for resolving the challenge. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Administrator of the General Services Administration (GSA) should describe GSA's major management challenges and include performance goals, performance measures, milestones and an agency official responsible for resolving each of its major management challenges as part of GSA's agency performance plan.

    Agency: General Services Administration
    Status: Open

    Comments: In its Fiscal Year 2018 APP, GSA took steps to implement this recommendation by clearly identifying three major management challenges and including planned actions, performance measures, milestones, and an agency official responsible for resolving them. Further action is needed to establish performance goals. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of Health and Human Services (HHS) should include performance goals, milestones and an agency official responsible for resolving each of HHS's major management challenges as part of HHS's agency performance plan.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: According to its website, for fiscal year 2018, HHS is meeting its performance reporting requirements as designated in the GPRA Modernization Act of 2010 and OMB Circular A-11 through the program performance information provided in the FY 2018 HHS Budget Justifications to Congress. As of August 2017, however, HHS has not taken action to implement our recommendation. Our review of HHS' 2018 Congressional Budget Justification found that it did not include recommended information. When the 2019 CBJ is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Secretary of the Interior should describe the Department of Interior's major management challenges and include performance goals, performance measures, planned actions, milestones and an agency official responsible for resolving each of its major management challenges as part of the Department of the Interior's agency performance plan.

    Agency: Department of the Interior
    Status: Open

    Comments: As of August 2017, the Department of Interior had not taken any actions to implement our recommendation. It is unclear in the APP what Interior considers to be its major management challenges and, if there are such issues, which performance information aligns with resolving those issues. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Recommendation: To improve the public reporting of major management challenges and to ensure performance information is useful, transparent, and complete, the Director of the National Science Foundation (NSF) should describe NSF's major management challenges and identify performance goals, performance measures, milestones, and an agency official responsible for resolving each of its major management challenges as part of NSF's agency performance plan.

    Agency: National Science Foundation
    Status: Open

    Comments: In its Fiscal Year 2018 APP, NSF took steps to implement this recommendation by clearly identifying its major management challenges and including planned actions for resolving them. Further action is needed to establish performance goals, performance measures, milestones, and identify an agency official responsible for resolving the challenge. When the 2019 annual performance plan is issued, we will update the status of this recommendation.
    Director: Jennifer Grover
    Phone: (202) 512-7141

    2 open recommendations
    Recommendation: To better ensure that FAMS uses its resources to cover the highest-risk flights, in addition to considering risk when determining how to divide FAMS's international flight coverage resources among international destinations, the Director of FAMS should incorporate risk into FAMS's method for initially setting its annual target numbers of average daily international and domestic flights to cover.

    Agency: Department of Homeland Security: Transportation Security Administration: Office of Law Enforcement - Federal Air Marshal Service
    Status: Open

    Comments: In May 2016, we found that FAMS officials considered risk when selecting specific domestic and international flights to cover, but they did not consider risk when deciding how to initially divide their annual resources between domestic and international flights. Rather, each year FAMS considered two variables--travel budget and number of air marshals--to identify the most efficient way to divide the agency's resources between domestic and international flights. As a result, we recommended that FAMS incorporate risk into FAMS's method for initially setting its annual target numbers of average daily international and domestic flights to cover. In March 2017, TSA officials reported that FAMS was continuing to identify ways to refine the methodology FAMS uses to allocate resources between international and domestic flights. Specifically, TSA officials noted that FAMS was considering ways to incorporate information on the travel patterns of known or suspected terrorists, trends in TSA PreCheck passenger data, airport screening capabilities, and other factors. FAMS officials also reported that, as part of this effort, they were reviewing their International Concept of Operations. It is unclear how these steps will address the recommendation. To fully address this recommendation, FAMS should incorporate risk into its method for initially setting its annual target numbers of average daily international and domestic flights to cover.
    Recommendation: To better ensure that FAMS uses its resources to cover the highest-risk flights, the Director of FAMS should conduct and document a risk assessment--systematically collecting information on and assigning value to current risks--to further support FAMS's domestic resource allocation decisions, including the identification of high-priority geographic areas.

    Agency: Department of Homeland Security: Transportation Security Administration: Office of Law Enforcement - Federal Air Marshal Service
    Status: Open

    Comments: In May 2016, we reported that FAMS's choice of domestic geographic focus areas and resource allocation levels were based on professional judgment, not risk assessment. With regard to the geographic focus areas, for example, FAMS officials explained that they did not conduct a risk assessment to inform this decision, but rather selected these areas in consultation with 30 subject matter experts from various offices within TSA based on their intuitive, qualitative perceptions of threats, vulnerabilities, potential impacts, history, and the demographics of the areas. Without fully incorporating risk when determining such priorities, FAMS cannot reasonably ensure it is targeting its resources to the highest-risk flights. As a result, we recommended that FAMS conduct and document a risk assessment--systematically collecting information on and assigning value to current risks--to further support FAMS's domestic resource allocation decisions, including the identification of high-priority geographic areas. In March 2017, TSA officials explained that they were continuing to develop their "risk-by-flight" initiative--a long-term effort to develop a method of assigning each domestic flight a relative risk score to assist in identifying high-risk flights. At the time of our report in 2016, FAMS officials estimated that the risk-by-flight tool would probably be ready for use within 7 to 10 years. In March 2017, TSA officials stated that they had developed a prototype Risk-Based Resource Deployment Decision Aid, which they refer to as R2D2. TSA officials further reported that the DHS Science and Technology Directorate had contracted for the development of a risk engine--based on the R2D2 data--to assign risk values to all U.S.-carrier domestic and international flights. TSA officials reported that this contract runs through early 2018. To fully address this recommendation, FAMS should conduct and document a risk assessment to further support FAMS's domestic resource allocation decisions, including the identification of high-priority geographic areas.
    Director: Susan A. Fleming
    Phone: (202) 512-2834

    3 open recommendations
    Recommendation: To strengthen FRA's grants management practices, the Secretary of Transportation should direct the FRA Administrator to enhance the process outlined in the Grants Manual to monitor project performance for future grants to include: (1) performance measures directly linked to project goals, and (2) fully incorporating timely and actionable information on grantee performance into FRA's review process to help determine whether current efforts are in line with the overall project goals.

    Agency: Department of Transportation
    Status: Open

    Comments: DOT agreed with this recommendation and stated that FRA will enhance the grants management manual content linking performance measures to project goals, and incorporating timely and actionable information on grant performance into monitoring and oversight activities. DOT stated FRA would complete these actions by June 30, 2017.
    Recommendation: To strengthen FRA's grants management practices, the Secretary of Transportation should direct the FRA Administrator to develop and provide written guidance to grantees to include FRA's expectations on the type of information grantees should provide, such as guidance specific to deliverables and milestones for each grant project.

    Agency: Department of Transportation
    Status: Open

    Comments: DOT agreed with this recommendation and stated that FRA will identify gaps in existing guidance and develop and disseminate revised guidance to grantees. DOT stated FRA would complete these actions by December 31, 2017.
    Recommendation: To strengthen FRA's grants management practices, the Secretary of Transportation should direct the FRA Administrator to analyze training needs and formalize a training plan for grantees and agency staff, which could include training on grant-specific procedures and policies.

    Agency: Department of Transportation
    Status: Open

    Comments: DOT agreed with this recommendation and FRA developed a revised formal training plan in March 2017. As of May 2017, we are reviewing this plan.
    Director: J. Christopher Mihm
    Phone: (202) 512-6806

    1 open recommendations
    Recommendation: To improve the transparency of public reporting on CAP goal progress, the Director of OMB should, working with the PIC, report on Performance.gov the actions that CAP goal teams are taking, or plan to take, to develop performance measures and quarterly targets.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: We reviewed selected CAP goals quarterly performance information on the Performance.Gov website as of Q4 of FY 2016, which updates the status of the CAP goals through September 2016. Some of the selected CAP goals have updated and new performance measures, but it was not clear the extent to which CAP goal teams included information on the actions they are taking to develop such measures, consistent with our recommendation. We contacted OMB in June 2017 on the current status of this recommendation. We will provide an update to its status once OMB responds to our request.
    Director: Andrew Von Ah
    Phone: (213) 830-1011

    3 open recommendations
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in consultation with officials from the military service components and the JAMRS office, to develop a formal process for coordination on crosscutting issues to facilitate better leveraging of resources. As part of this process, DOD could review existing advertising programs to identify opportunities to reduce unnecessary duplication, overlap, and fragmentation and obtain potential efficiencies.

    Agency: Department of Defense
    Status: Open

    Comments: As of August 2017, a DOD official from the office of Under Secretary of Defense for Personnel and Readiness stated that a working group drafted an Instruction on DOD advertising and marketing and this instruction will be signed within the next 30 days. The instruction requires that the relevant departmentwide office will meet quarterly with the military service marketing representatives to discuss best practices and to look for efficiencies. Further, the official stated that the Army has directed the Army National Guard to work through Army Marketing and Research Group regarding their marketing efforts, which consolidates all Army marketing efforts within one office. The Air force is also in discussion to determine how best to consolidate the marketing efforts of its Guard and Reserve components with the Active Duty to gain efficiencies. We will monitor the issuance of the instruction and the efforts of the Air Force to consolidate activities.
    Recommendation: The Secretary of Defense should direct the Secretaries of the Departments of the Army, the Navy, and the Air Force to ensure that each military service component fully measure advertising performance. This should include both the identification of measurable goals in future versions of the service components' advertising plans and assurance that the service components have access to the necessary performance data to determine the effectiveness of their advertising activities for lead generation activities.

    Agency: Department of Defense
    Status: Open

    Comments: As of August 2017, a DOD official from the office of Under Secretary of Defense for Personnel and Readiness stated that a working group drafted an Instruction on DOD advertising and marketing and this instruction will be signed within the next 30 days. The instruction requires that the relevant department-level office will meet quarterly with the military service marketing representatives to discuss best practices and to look for efficiencies. Upon issuance of the instruction, we will assess the direction provided to the services in the instruction regarding performance measurement.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to ensure, as the department undertakes its effort to issue a department-wide policy for advertising, that this policy (1) clearly defines DOD's role in overseeing the advertising activities of military service components; (2) clarifies issues related to sports-related advertising; and (3) outlines procedures that should guide the components' advertising activities for other types of advertising, such as music concerts, other event advertising, and digital advertising.

    Agency: Department of Defense
    Status: Open

    Comments: As of August 2017, a DOD official from the office of Under Secretary of Defense for Personnel and Readiness stated that a work group session was held in October 2016 and based on the outcome of that work group, DOD has drafted an Instruction on DOD advertising and marketing. That instruction is currently in the "Pre-Signature" phase as a priority instruction which means it should be signed and published within the next 30 days. We will continue to monitor the issuance of this instruction.
    Director: Heather Krause
    Phone: (202) 512-6806

    5 open recommendations
    Recommendation: To help enhance efforts to expand shared services and improve the management of the Administrative Services Franchise Fund (ASFF), the Secretary of Transportation should direct the FAA Administrator to make pricing information, such as ranges of prices, for the ASFF's lines of business publicly available, as appropriate, to help potential customers and agency decision makers understand prices and different choices of services.

    Agency: Department of Transportation
    Status: Open

    Comments: FAA concurred with the recommendation. According to FAA, representatives from FAA's Administrative Services Franchise Fund are serving on the Office of Management and Budget's Shared Services Governance Board--a decision-making body for government-wide shared services initiatives. The Board is working with the General Services Administration's Unified Shared Services Management office on the standardization of publicly available pricing information for the FAA fund and other funds across the government and the forum in which to publish such information. FAA expects to provide an update on how it is addressing this recommendation by November 30, 2017.
    Recommendation: To help enhance efforts to expand shared services and improve the management of the ASFF, the Secretary of Transportation should direct the FAA Administrator to make the ASFF's strategic goals and performance metrics publicly available to help potential customers and agency decision makers understand how the fund is performing on the services provided.

    Agency: Department of Transportation
    Status: Open

    Comments: FAA concurred with the recommendation. According to FAA, representatives from FAA's Administrative Services Franchise Fund are serving on the Office of Management and Budget's Shared Services Governance Board--a decision-making body for government-wide shared services initiatives. The Board is working with the General Services Administration's Unified Shared Services Management office on the standardization of performance metrics for shared service providers (including the FAA fund) and the forum on which to publically share such information. FAA expects to provide an update on how it is addressing this recommendation by November 30, 2017.
    Recommendation: To help enhance efforts to expand shared services and improve the management of the Treasury Franchise Fund (TFF), the Secretary of the Treasury should make pricing information, such as ranges of prices, for the Administrative Resource Center Information Technology Services and Shared Services Programs (SSP) lines of business publicly available, as appropriate, to help potential customers and agency decision makers understand prices and different choices of services.

    Agency: Department of the Treasury
    Status: Open

    Comments: Treasury concurred with the recommendation. In March 2017, GAO contacted Treasury for a status update on how the recommendation is being addressed. We will update the status when the update is received.
    Recommendation: To help enhance efforts to expand shared services and improve the management of the TFF, the Secretary of the Treasury should develop a more complete set of performance metrics for the TFF's SSP line of business to help managers of the SSP line of business, current and potential customers, and agency decision makers monitor and oversee how the fund is performing on the services provided.

    Agency: Department of the Treasury
    Status: Open

    Comments: Treasury concurred with the recommendation. In March 2017, GAO contacted Treasury for a status update on how the recommendation is being addressed. We will update the status when the update is received.
    Recommendation: To help enhance efforts to expand shared services and improve the management of the TFF, the Secretary of the Treasury should develop an operating reserve policy that documents all existing review processes that relate to management of the TFF's operating reserves. These documented policies should include information on how fund managers are to assess the operating reserves, including guidelines to evaluate, use, and maintain the operating reserves over time.

    Agency: Department of the Treasury
    Status: Open

    Comments: Treasury concurred with the recommendation. In March 2017, GAO contacted Treasury for a status update on how the recommendation is being addressed. We will update the status when the update is received.
    Director: John Pendleton
    Phone: (202) 512-3489

    1 open recommendations
    Recommendation: To facilitate implementation of the commission's recommendations and provide managers with information to gauge progress and identify areas that may need attention, the Secretary of the Air Force in coordination with the Chief of Staff of the Air Force should direct the Assistant Vice Chief of Staff of the Air Force to develop complete implementation plans that include performance measures for all 36 commission recommendations that remain open.

    Agency: Department of Defense: Department of the Air Force
    Status: Open

    Comments: In its agency comments, the Air Force concurred with our recommendation and estimated that it would develop performance measures by March 2017. When we confirm what actions the Air Force has taken in response to this recommendation, we will provide updated information.
    Director: Williamson, Randall B
    Phone: (202) 512-7114

    2 open recommendations
    Recommendation: To develop and maintain medical sharing expertise within the network contracting offices, the Secretary of Veterans Affairs should direct the Under Secretary for Health to create a plan for increasing the retention of contracting officers that work in medical sharing teams.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In March 2017, VHA reported that it is working on creating a plan for increasing the retention of contracting officers that work in medical sharing teams. The Medical Sharing Office (MSO) has taken several steps including conducting research on possible ways to minimize or eliminate steps within its existing plan and expanding the number of topical training provided virtually network contracting offices to develop competency in VHA Health Care 1102 staff. In addition, VHA reported they are developing a training schedule to ensure newly deployed interns have received the training and resource to successfully conduct health care contracts if they are assigned to health care resources team and continuing to collaborate with the field to ensure awareness of MSO support and assistance.
    Recommendation: To ensure VHA effectively communicates with its affiliates regarding SSACs, the Secretary of Veterans Affairs should direct the Under Secretary for Health to reach out to all of its affiliates, identify any concerns, and determine the most effective method of communicating with affiliates regarding SSAC development.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In March 2017, the VHA reported that it plans to have an Academic Affiliate Contracting Forum on August 15-16, 2017 in Nashville, TN or Dallas, TX for VHA staff responsible for health care contracts and University affiliates. The purpose of the Forum is to strengthen and advance the collaborative partnership for providing service to Veterans; share perspectives; and enhance awareness about processes, procedures and tools that will help make contracting processes faster and easier for all parties.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    7 open recommendations
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to collect and monitor deployed civilians' perceptions related to mental health care.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to leverage recommendations made by the RAND Corporation in its 2014 report on mental health stigma in the military to update and clarify policies as needed to remove stigmatizing provisions, such as career restrictions that may be too limiting for individuals who have received mental health care.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to establish a clear, consistent definition of those barriers to care generally understood by DOD as "mental health care stigma," to include explanations of its causes or contributing risk factors and ways that stigma is apparent in behaviors and policies.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to establish goals for efforts to address barriers to care generally understood by DOD as "stigma reduction efforts," and performance measures that link to these goals.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to develop a method to collect and analyze information on barriers to seeking mental health care, including stigma, so that reliable data may be gathered and used to measure the effectiveness of stigma reduction efforts over time.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to designate an entity to coordinate efforts to reduce mental health care stigma, among other barriers to care.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: The Secretary of Defense should direct the Under Secretary of Defense for Intelligence to reissue consolidated guidance, incorporating subsequent updates for the denial or suspension of access to classified information and for assignment to sensitive duties based solely on information about mental health care.

    Agency: Department of Defense
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Andrew Von Ah
    Phone: (213) 830-1011

    4 open recommendations
    Recommendation: To ensure the quality of the risk assessments used to inform its future QHSR processes, the Secretary of Homeland Security should direct the Assistant Secretary for Policy to ensure future QHSR risk assessment methodologies reflect key elements of successful risk assessment methodologies, such as being: (1) Documented, which includes documenting how risk information was integrated to arrive at the assessment results, (2) Reproducible, which includes producing comparable, repeatable results, and (3) Defensible, which includes communicating any implications of uncertainty to users of the risk results.

    Agency: Department of Homeland Security
    Status: Open

    Comments: As of June 2016, the Office of Policy's Office of Strategy, Plans, Analysis and Risks completed initial meetings in April 2016 with government and non-government subject matter experts to refine risk analyses for the upcoming 2018 QHSR. Representatives from the department's component and headquarters staff are to take part in the Department's Risk Modeling and Analysis Steering Committee by reviewing, documenting and approving proposed new methodologies planned to help identify and prioritize threats and hazards. This effort is intended to lead to a documented, reproducible, and defensible assessment, according to the DHS officials. This recommendation will remain open until we verify that the risk analysis contains these elements.
    Recommendation: To enable the use of risk information in supporting resource allocation decisions, guiding investments, and highlighting the measures that offer the greatest return on investment, the Secretary of Homeland Security should direct the Assistant Secretary for Policy to refine its risk assessment methodology so that in future QHSRs it can compare and prioritize homeland security risks and risk mitigation strategies.

    Agency: Department of Homeland Security
    Status: Open

    Comments: As of June 2016, the Office of Policy's Office of Strategy, Plans, Analysis, and Risk, with support from the RAND Corporation, has proposed a methodology to assess threats, hazards, and vulnerabilities impacting U.S. homeland security. In addition, the department's Risk Modeling and Analysis Executive Steering Committee is to review and approve the proposed methodology. The methodology is intended to enable the Department of Homeland Security to compare and prioritize homeland security risks and risk mitigation strategies, according to DHS officials. The recommendation will remain open until we verify that the methodology allows such comparisons.
    Recommendation: To ensure proper management of the QHSR stakeholder consultation process, the Secretary of Homeland Security should direct the Assistant Secretary for Policy to identify and implement stakeholder meeting processes to ensure that communication is interactive when project planning for the next QHSR.

    Agency: Department of Homeland Security
    Status: Open

    Comments: As of June 2016, the Office of Policy's Office of Strategy, Plans, Analysis, and Risk finalized a draft stakeholder outreach plan to include use of the Office of Management and Budget's Max electronic collaboration website to engage with federal, state, and local stakeholders. The OMB-MAX website is available to government and non-government offices and allows the posting of documents, articles, and links, as well as facilitating collaborative editing of documents and participant interaction threads, according to DHS officials. In addition, the Office of Policy's Office of Strategy, Plans, Analysis, and Risk is exploring the use of different tools to facilitate more interactive stakeholder engagement. For example, DHS's Office of Partnerships and Engagement is to facilitate additional engagement with external subject matter experts, arrange interagency coordination, and organize review and approval with parties of the homeland security enterprise in order to coordinate and approve the development of the 2018 QHSR. This recommendation will remain open until we verify that interactive communication approaches are implemented.
    Recommendation: To ensure proper management of the internal QHSR stakeholder consultation process, the Secretary of Homeland Security should direct the Assistant Secretary for Policy to clarify component detailee roles and responsibilities when project planning for the next QHSR.

    Agency: Department of Homeland Security
    Status: Open

    Comments: As of June 2016, the Office of Policy's Office of Strategy, Plans, Analysis, and Risk (SPAR) drafted a memorandum for the Deputy Secretary to solicit Component subject matter experts. The memorandum specifies component detailee roles and responsibilities, to include serving in an advisory, consultation, and coordination role, according to DHS officials. SPAR is to lead an integrated group of analysts and strategic planners that are to be supported and augmented by the subject matter experts. The experts and detailees are to serve as members of study teams analyzing key threats, trends, and strategy and policy alternatives associated with issues and challenges relating to DHS's mission and objectives. A second memorandum requesting additional detailee support is to be issued in November 2016, prior to the formal review phase of the new QHSR which is to begin in January 2017. This recommendation will remain open until we verify that clarified detailee roles and responsibilities are finalized and implemented.
    Director: David A. Powner
    Phone: (202) 512-9286

    6 open recommendations
    Recommendation: To ensure that agencies are provided with more complete guidance for contracts for cloud computing services, the Director of OMB should include all ten key practices in future guidance to agencies.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: We are following up with OMB on its service level agreement (SLA) guidance to agencies.
    Recommendation: To help ensure continued progress in the implementation of effective cloud computing SLAs, the Secretary of Defense should direct the appropriate officials to ensure key practices are fully incorporated for cloud services as the contracts and associated SLAs expire. These efforts should include updating the Department of Defense memorandum on acquiring cloud services and current Defense Acquisition Regulations System to more completely include the key practices.

    Agency: Department of Defense
    Status: Open

    Comments: We are following up with DOD on updating their service level agreement (SLA) guidance.
    Recommendation: To help ensure continued progress in the implementation of effective cloud computing SLAs, the Secretaries of Health and Human Services, Homeland Security, Treasury, and Veterans Affairs should direct appropriate officials to develop SLA guidance and ensure key practices are fully incorporated as the contract and associated SLAs expire.

    Agency: Department of Homeland Security
    Status: Open

    Comments: We are following up with DHS on the finalization of its service level agreement (SLA) guidance.
    Recommendation: To help ensure continued progress in the implementation of effective cloud computing SLAs, the Secretaries of Health and Human Services, Homeland Security, Treasury, and Veterans Affairs should direct appropriate officials to develop SLA guidance and ensure key practices are fully incorporated as the contract and associated SLAs expire.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: We are following up with HHS on their service level agreement (SLA) guidance.
    Recommendation: To help ensure continued progress in the implementation of effective cloud computing SLAs, the Secretaries of Health and Human Services, Homeland Security, Treasury, and Veterans Affairs should direct appropriate officials to develop SLA guidance and ensure key practices are fully incorporated as the contract and associated SLAs expire.

    Agency: Department of the Treasury
    Status: Open

    Comments: We are following up with Treasury on their service level agreement (SLA) guidance.
    Recommendation: To help ensure continued progress in the implementation of effective cloud computing SLAs, the Secretaries of Health and Human Services, Homeland Security, Treasury, and Veterans Affairs should direct appropriate officials to develop SLA guidance and ensure key practices are fully incorporated as the contract and associated SLAs expire.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We are following up with VA on their service level agreement (SLA) guidance.
    Director: Dave Wise
    Phone: (202) 512-2834

    2 open recommendations
    including 1 priority recommendation
    Recommendation: To improve the quality and transparency of data entered into FRPP as GSA transitions the database to a platform that would enable greater government-wide use, the Administrator of GSA, in consultation with OMB and federal agencies, should (1) assess the reliability of FRPP data by determining how individual agencies collect and report FRPP data for each FRPP field, including any supplemental guidance used by agencies to comply with government-wide FRPP data definitions as part of the annual certification of FRPP data; (2) analyze the differences in collecting and reporting practices used by these agencies; and (3) identify and make available to FRPP users the limitations of using FRPP data, in the context of how the data are intended to be used in real property decision making and to measure real property performance across agencies and update federal guidance to address limitations, as needed.

    Agency: General Services Administration
    Status: Open
    Priority recommendation

    Comments: GSA partially agreed with the recommendation noting that it has limited resources to fully analyze and map the data relative to FRPP data definitions, and that it is the responsibility of individual agencies to ensure reliability of the data and compliance with FRPP definitions. As of October 2016, GSA has taken some action to implement this recommendation. GSA told us it has made progress by conducting an in-depth survey in June 2106 focusing on several data elements including: replacement value, status, owned and otherwise management operating costs, repair needs, utilization, and lease costs. The survey asked agencies questions regarding the processes/resources used to source and compile these data elements from agency IT systems as well as internal agency guidance. GSA received responses from 24 agencies and stated it plans to complete its initial analysis of the survey in the fall of 2016 and indicate limitations of these data elements. GSA plans to conduct a series of working group meetings with agencies to conduct an in depth review of the survey results and to develop a set of recommendations for the Federal Real Property Council. GSA said these recommendations may include, but are not limited to, altering data dictionary definitions, sharing best or common practices for reporting these data elements, and sharing the limitations on the use of these data elements. Based on the working group outcomes and input from the Federal Real Property Council and OMB, GSA plans to produce a white paper on these topics by the latter part of 2017.
    Recommendation: To enhance the usefulness of the National Strategy for managing federal real property government-wide, the Director of OMB should expand the National Strategy to further address long-standing real property management challenges by: (1) expanding the scope to include maintenance and repair needs; (2) articulating planned actions and identifying alternative approaches, including alternative-funding mechanisms, to address underlying causes of the real property problems; (3) ensuring that performance measures at the agency level inform the overall progress of the National Strategy; and (4) determining the government-wide costs, benefits, and risks by leveraging agencies' long-term capital plans and identifying approaches to optimally manage that risk.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: When we confirm the actions that OMB has taken in response to this recommendation, we will provide updated information.
    Director: Steve D. Morris
    Phone: (202) 512-3841

    6 open recommendations
    Recommendation: To strengthen USDA's ability to better manage and monitor the progress of the Blueprint, including efforts to streamline and improve administrative services, the Secretary of Agriculture should direct the Assistant Secretary for Administration to develop a complete list identifying all of the Blueprint efforts under way and document key information needed to monitor their progress, such as status of implementation, time frames for completion, and related performance measures.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Recommendation: To strengthen USDA's ability to better manage and monitor the progress of the Blueprint, including efforts to streamline and improve administrative services, the Secretary of Agriculture should direct the Assistant Secretary for Administration to reexamine the adequacy of the staff and budget resources committed to the day-to-day management of the Blueprint, and further leverage existing departmental resources as needed.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Recommendation: To improve USDA's efforts to identify and track the benefits of the Blueprint, the Secretary of Agriculture should direct the Assistant Secretary for Administration to document the methodologies used to calculate any savings claimed for the Blueprint effort to ensure any such estimate is based on quality information.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Recommendation: To improve USDA's efforts to identify and track the benefits of the Blueprint, the Secretary of Agriculture should direct the Chief Financial Officer to develop a cost-effective method, using existing data systems, to collect and track USDA's spending on administrative services to identify baseline spending and target areas for future cost savings.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Recommendation: To improve USDA's efforts to identify and track the benefits of the Blueprint, the Secretary of Agriculture should direct the Assistant Secretary for Administration to systematically identify and track nonfinancial benefits from USDA's Blueprint efforts to better gauge the Blueprint's progress and more fully report its results.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Recommendation: To enhance USDA's efforts to share lessons learned from the Blueprint, the Secretary of Agriculture should direct the Assistant Secretary for Administration to maintain and promote existing web-based collaboration tools, including keeping information in these tools current, for agencies and staff offices to report their experiences and lessons learned from their Blueprint efforts to help strengthen internal information sharing and inform future efforts.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of March 2017, we have requested an update from the coordinator for USDA's Blueprint for Stronger Service on USDA's actions, if any, to implement this recommendation.
    Director: Debra A. Draper
    Phone: (202) 512-7114

    12 open recommendations
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to establish FHCC-specific selection criteria for the FHCC facility director and deputy director positions that include responsibilities and leadership competencies for effective collaboration.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to establish FHCC-specific selection criteria for the FHCC facility director and deputy director positions that include responsibilities and leadership competencies for effective collaboration.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to ensure that the evaluation of the leadership performance at the FHCC is carried out jointly between VA and DOD.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to ensure that the evaluation of the leadership performance at the FHCC is carried out jointly between VA and DOD.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to perform data-driven strategic workforce planning prior to implementing any future integration efforts.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to perform data-driven strategic workforce planning prior to implementing any future integration efforts.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to determine how best to fill the FHCC's short-term staffing needs, including any additional statutory authorities that might be necessary to implement the desired approach.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to determine how best to fill the FHCC's short-term staffing needs, including any additional statutory authorities that might be necessary to implement the desired approach.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to resolve differences in IT network security standards to the extent possible prior to implementing any future integration efforts.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should collaborate to resolve differences in IT network security standards to the extent possible prior to implementing any future integration efforts.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should direct FHCC leadership to provide additional guidance on the patient priority system to all staff responsible for approving consults and ensure that the monthly capability and capacity reports include information on all categories of FHCC patients defined by the patient priority system.

    Agency: Department of Defense
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Recommendation: The Secretaries of Veterans Affairs and Defense should direct FHCC leadership to provide additional guidance on the patient priority system to all staff responsible for approving consults and ensure that the monthly capability and capacity reports include information on all categories of FHCC patients defined by the patient priority system.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: We will update the status of this recommendation when we determine what steps the agency has taken to implement it.
    Director: Mark Goldstein
    Phone: (202) 512-6670

    3 open recommendations
    Recommendation: To help improve and measure the availability and adoption of high-speed Internet on tribal lands, the Chairman of the Federal Communications Commission should develop joint outreach and training efforts with USDA whenever feasible to help improve Internet availability and adoption on tribal lands.

    Agency: Federal Communications Commission
    Status: Open

    Comments: As of June 2017, FCC indicated that it is taking steps to hold joint outreach and training efforts with USDA when feasible and FCC plans to document those efforts over the next year. GAO will continue to monitor the status of FCC's efforts.
    Recommendation: To help improve and measure the availability and adoption of high-speed Internet on tribal lands, the Chairman of the Federal Communications Commission should improve the reliability of FCC data related institutions that receive E-Rate funding by defining "tribal" on the program application.

    Agency: Federal Communications Commission
    Status: Open

    Comments: As of June 2017, FCC reiterated that it agrees with this recommendation and is working on developing a definition for "tribal" that it can use. FCC hopes to have the definition developed, approved, and put into use by Spring 2018.
    Recommendation: To help improve and measure the availability and adoption of high-speed Internet on tribal lands, the Chairman of the Federal Communications Commission should develop performance goals and measures to track progress on achieving its strategic objective of ensuring that all tribal schools and libraries have affordable access to modern broadband technologies.

    Agency: Federal Communications Commission
    Status: Open

    Comments: FCC said that defining "tribal" is a necessary first step to tracking progress on ensuring that all tribal schools and libraries have affordable access to modern broadband technologies. FCC plans to have a definition of "tribal" in place by Spring 2018. Once the definition is in place, FCC said that it will start tracking progress using that definition.
    Director: Jessica Farb
    Phone: (202) 512-6991

    2 open recommendations
    Recommendation: To enhance U.S. agencies' performance monitoring of counter-firearms trafficking activities, the Director of the Bureau of Alcohol, Tobacco, Firearms and Explosives should establish and document performance targets for the bureau's key counter-firearms trafficking activities in Belize, Guatemala, and Mexico, as appropriate.

    Agency: Department of Justice: Bureau of Alcohol, Tobacco, Firearms and Explosives
    Status: Open

    Comments: ATF concurred with this recommendation and stated that it plans to implement it. According to ATF officials, ATF has engaged in an overview of performance measures in Mexico and, when applicable, in Guatemala and Belize, and planned to implement a more structured annual system of performance targeting and evaluation for operations in these jurisdictions in fiscal year 2017. As of October 2017, we are continuing to follow up with ATF on its efforts to implement the new performance evaluation system.
    Recommendation: To enhance U.S. agencies' performance monitoring of counter-firearms trafficking activities, the Secretary of State should work with other U.S. agencies and implementers to help ensure that quarterly progress reports identify key challenges and plans to address them.

    Agency: Department of State
    Status: Open

    Comments: The Department of State concurred with this recommendation and stated that it planned to work with other agencies to implement it. State officials noted that the International Narcotics and Law Enforcement Affairs Bureau's quarterly reporting template for interagency partners currently contains a segment entitled "Problems or Challenges and Corrective Action Plan/Risk Identification Mitigation" in which the interagency partner is expected to detail any problems or challenges in implementing any of the program components and activities. State officials stated they will continue to remind interagency partners of this requirement and assist with correct completion of the reporting templates.
    Director: Michele Mackin
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: To address different interpretations of cutter boat requirements, the Commandant of the Coast Guard should direct the NSC program office to clarify the NSC's key performance parameters for the cutter boat operations (specifically the launch and recovery of cutter boats).

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: The Coast Guard is in the process of updating the operator's handbook for the Long Range Interceptor II cutter boat to clarify that it is capable of operating through sea state 5, which will meet the National Security Cutter's key performance parameter related to cutter boat operations. According to Coast Guard officials, the updated operator's handbook should be signed and approved between August and November 2017.
    Director: Valerie Melvin
    Phone: (202) 512-6304

    2 open recommendations
    Recommendation: To help ensure that FDA's IT strategic planning activities are successful in supporting the agency's mission, goals, and objectives, the Commissioner of FDA should require the CIO to establish schedules and milestones for completing a version of an IT strategic plan that incorporates elements to align the plan's strategies with agency-wide priorities; includes results-oriented goals and performance measures that support the agency's mission, along with targets for measuring the extent to which outcomes of IT initiatives support FDA's ability to achieve agency-wide goals and objectives; identifies key IT initiatives that support the agency's goals; and describes interdependencies among the initiatives.

    Agency: Department of Health and Human Services: Food and Drug Administration
    Status: Open

    Comments: FDA concurred with the recommendation and stated that the agency plans to implement it. We contacted the agency in March 2017 and have requested documents regarding FDA's actions to address the recommendation. We are waiting to receive the documents. We will update the status of the agency's actions after we receive and evaluate their response.
    Recommendation: To help ensure that FDA's IT strategic planning activities are successful in supporting the agency's mission, goals, and objectives, the Commissioner of FDA should require the CIO to implement the plan to ensure that expected outcomes of the agency's key IT initiatives are achieved.

    Agency: Department of Health and Human Services: Food and Drug Administration
    Status: Open

    Comments: FDA concurred with the recommendation and stated that the agency plans to implement it. We contacted the agency in March 2017 and have requested documents regarding FDA's actions to address the recommendation. We are waiting to receive the documents. We will update the status of the agency's actions after we receive and evaluate their response.
    Director: James R. McTigue, Jr.
    Phone: (202) 512-9110

    7 open recommendations
    Recommendation: To help ensure SB/SE's audit selection program meets its mission and selects returns fairly, the Commissioner of Internal Revenue should clearly define and document the key term "fairness" for return selection activities.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to incorporate a definition of fairness into the Internal Revenue Manual (IRM), which serves as a single point of reference for guidance to IRS examiners. In February 2016, the Deputy Commissioner of Services and Enforcement (S&E) reiterated IRS's definition of fairness in the examination process to S&E employees. In January 2017, IRS issued interim guidance on fairness in examination case selection. IRS officials said that this guidance is considered "final" until the IRM is updated, no later than January 2019. In February 2017, IRS issued an article on its IRWeb and a message from the Deputy Commissioner S&E on defining fairness in the exam process. We are awaiting resolution of how this definition will be used in three other recommendations on communicating examples as well as developing both a related objective and measure.
    Recommendation: To help ensure SB/SE's audit selection program meets its mission and selects returns fairly, the Commissioner of Internal Revenue should clearly communicate examples of fair selections to staff to better assure consistent understanding.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to communicate examples of fairness to managers and examiners involved in selecting tax returns for examination. In March 2017, the Director of IRS Small Business/Self Employed (SB/SE) Examination-Headquarters issued a memo to SB/SE examination directors that included examples illustrating the fairness definition in return selection. The examples were to be shared with directors, management, and examiners involved in return selection. To close this recommendation, we are waiting for resolution of how the fairness definition will be implemented through related recommendations on developing program objectives and measures assessing fairness in return selection.
    Recommendation: To help ensure SB/SE's audit selection program meets its mission and selects returns fairly, the Commissioner of Internal Revenue should develop, document, and implement program-level objective(s) to evaluate whether the return selection process is meeting its mission of applying the tax law with integrity and fairness to all.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to review its current objectives for the SB/SE examination program and found that an additional program-level objective to evaluate fairness in the return selection was necessary. The new objective is "Ensure examinations are initiated based on indicators of noncomplicance. In addition, ensure a review of the decisions to survey a return (i.e., not initiate an examination) are based on upon factors outlined in the Internal Revenue Manual (IRM) and approved by an appropriate level of management." In March 2017, IRS issued interim guidance communicating the new objective, which was sent to Examination Directors. The guidance and objective were also posted on the IRweb, which is available to all IRS employees. IRS officials said that the interim guidance is considered final until it can be incorporated into the IRM, which should be done within 2 years of when the interim guidance is issued. We are awaiting IRS's response to a related recommendation on developing a measure for this selection objective before deciding to close this recommendation.
    Recommendation: To help ensure that SB/SE's audit selection objective(s) on fairness are used and met, the Commissioner of Internal Revenue should develop, document, and implement related performance measures that would allow SB/SE to determine how well the selection of returns for audit meets the new objective(s).

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to develop, document, and implement additional performance measures if new objectives related to fair return selection were implemented. In March 2017, IRS developed a new objective on fair return selection. In April 2017, IRS officials said that they were working on performance measures related to the new objective on fair return selection. They plan to meet with GAO in 1-2 months to obtain our feedback on the measures.
    Recommendation: To help ensure that SB/SE's audit selection objective(s) on fairness are used and met, the Commissioner of Internal Revenue should incorporate the new objective(s) for fair return selection into the SB/SE risk management system to help identify and analyze potential risks to fair selections.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to consider any new objectives related to fair return selection within SB/SE's current risk management process framework. In March and April 2017, SB/SE developed a tool (RAFT) to include the fair selection objective (and related activities) into its risk register, which is monitored quarterly. IRS provided documentation from the Exam Risk Council meeting that they have discussed and assessed these risks. IRS is still working on documentation to show they are addressing our recommendations and the associated risks. IRS officials said the documentation is due in August 2017.
    Recommendation: The Commissioner of Internal Revenue should develop and implement consistent documentation requirements to clarify the reasons for selecting a return for audit and who reviewed and approved the selection decision.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to evaluate the need to improve its documentation of return selection decisions and the review and approval process. In March 2017, various IRS functions completed templates showing the current status of return selection documentation requirements. As a result, they found that they could improve the consistency and clarity in documentation, approval and review requirements across workstreams by clearly defining procedures and ensuring they are formally documented in the IRM. The Director of Exam Case Selection issued a memo directing that documentation requirements be made consistent in the IRM. IRS officials said that revised documentation requirements are due in August 2017, with IRM incorporation at a later date.
    Recommendation: The Commissioner of Internal Revenue should develop, document, and implement monitoring procedures to ensure that decisions made and coding used to select returns for audit are appropriate.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS agreed to review its current procedures for monitoring return selection decisions and coding used to select returns. In April 2017, IRS officials provided documentation showing they had reviewed campus examination selection dollar thresholds and campus source code definitions. They found that improvements could be made in clarifying source code definitions and reviewing dollar thresholds used to categorize and select, respectively, returns for examination. IRS has issued an IRM procedural update to implement these changes. During our meeting with IRS, we clarified that our recommendation covered monitoring selection decisions more broadly, which IRS acknowledged. Officials said that additional documentation on monitoring selection decisions will be due by August 2017.
    Director: Kathleen M. King
    Phone: (202) 512-7114

    1 open recommendations
    Recommendation: To ensure that HHS workforce efforts meet national needs, the Secretary of Health and Human Services should develop a comprehensive and coordinated planning approach to guide HHS's health care workforce development programs--including education, training, and payment programs--that (1) includes performance measures to more clearly determine the extent to which these programs are meeting the department's strategic goal of strengthening health care; (2) identifies and communicates to stakeholders any gaps between existing programs and future health care workforce needs identified in the Health Resources and Services Administration's workforce projection reports; (3) identifies actions needed to address identified gaps; and (4) identifies and communicates to Congress the legislative authority, if any, the Department needs to implement the identified actions.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: In December 2016, HHS indicated that the agency had not yet taken steps to implement a comprehensive workforce planning effort. Officials said that for the FY2018 cycle, HHS had planned to expand its group developing legislative proposals to include budget issues and gaps that warrant attention. While it did not do so during that cycle, officials indicated that they would recommend this broader approach to workforce planning for future budget and legislative cycles.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    4 open recommendations
    Recommendation: To improve DOD's management of initiatives directed at increasing the recruitment and accessions of women into the officer corps, the Secretary of Defense should direct the Under Secretary of Defense, Personnel and Readiness, in collaboration with the service Secretaries, to develop an oversight framework that includes or incorporates (consistent with applicable law): (1) Service-wide program goals for initiatives directed at female officers' recruitment, such as goals related to the composition of the applicant pool; (2) Performance measures linked to program goals; and (3) Resource allocations linked to program goals.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, the agency concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To improve DOD's management of initiatives directed at increasing the recruitment and accessions of women into the officer corps, the Secretary of Defense should direct the Under Secretary of Defense, Personnel and Readiness, in collaboration with the service Secretaries, to conduct evaluations for key recruitment initiatives to help ensure these initiatives are achieving their intended purpose.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, the agency concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To improve the Coast Guard's management of initiatives to increase the recruitment and accessions of women into the officer corps, the Commandant of the Coast Guard should develop an oversight framework that includes or incorporates (consistent with applicable law): (1) Service-wide program goals for initiatives directed at female officers' recruitment, such as goals related to the composition of the applicant pool; (2) Performance measures linked to program goals; and (3) Resource allocations linked to program goals.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In providing comments on this report, the agency concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Recommendation: To improve the Coast Guard's management of initiatives to increase the recruitment and accessions of women into the officer corps, the Commandant of the Coast Guard should conduct evaluations for key recruitment initiatives to help ensure these initiatives are achieving their intended purpose.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In providing comments on this report, the agency concurred with this recommendation but has not yet taken any actions necessary to implement it.
    Director: Andrew Sherrill
    Phone: (202) 512-7215

    1 open recommendations
    Recommendation: To increase accountability for program performance, the Secretary of VA should establish measures to report on program outcomes for Post-9/11 GI Bill OJT and apprenticeship programs, including considering relevant data sources and seeking legislative authority to gain access to data, if necessary.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs (VA) agrees that program performance metrics should be developed to report on program outcomes. In March 2016, VBA officials said that VBA's Education Service is working with DoD, ED, and the Consumer Financial Protection Bureau to determine the feasibility of collecting and publishing post-graduation data to include data for OJT and apprenticeship programs. The target completion date was June 1, 2016.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    5 open recommendations
    Recommendation: To improve the effectiveness of DOD's strategy for preventing sexual assault in the military, as part of the department's next biennial update to the 2014-16 sexual-assault prevention strategy, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military departments, to link sexual-assault prevention activities with desired outcomes.

    Agency: Department of Defense
    Status: Open

    Comments: DOD action in progress. DOD is conducting assessments at large installations that reflect a cross-section of each of the service's cultures and result in the development of the 2017-2021 DOD Sexual Assault Prevention Plan of Action. According to department officials, the plan will link risks and protective factors.
    Recommendation: To improve the effectiveness of DOD's strategy for preventing sexual assault in the military, as part of the department's next biennial update to the 2014-16 sexual-assault prevention strategy, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military departments, to identify risk and protective factors for all of its domains, including the military community and its leaders.

    Agency: Department of Defense
    Status: Open

    Comments: DOD action in progress. DOD is conducting assessments at large installations that reflect a cross-section of each of the service's cultures and will inform the development of the 2017-2021 DOD Sexual Assault Prevention Plan of Action. According to department officials, the plan will identify risk and protective factors for all domains, including military community and leaders.
    Recommendation: To help ensure widespread adoption and implementation of DOD's sexual-assault prevention strategy and to fulfill its role as a framework that can assist leaders and planners in the development of appropriate tasks, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military departments, to communicate and disseminate DOD's prevention strategy and its purpose to the appropriate levels of program personnel as well as their roles and responsibilities for its implementation.

    Agency: Department of Defense
    Status: Open

    Comments: DOD action in progress. According to DOD officials, DOD's 2017-2021 Sexual Assault Prevention Plan of Action will include a comprehensive communications roll-out plan to ensure every level of DOD understands its role in prevention.
    Recommendation: To help improve DOD's ability to measure the effectiveness of the department's efforts in preventing sexual assault in the military, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in collaboration with the Secretaries of the military departments, to fully develop the department's performance measures for the prevention of sexual assault so that the measures include all key attributes of successful performance measures.

    Agency: Department of Defense
    Status: Open

    Comments: DOD action in progress. DOD is conducting a feasibility assessment to identify metrics that will detect impacts of prevention efforts and show progress on reducing risk and prevalence of sexual assault. The results will be included in the 2017-2021 DOD Sexual Assault Prevention Plan of Action.
    Recommendation: To help ensure widespread adoption and implementation of DOD's sexual-assault prevention strategy and to fulfill its role as a framework that can assist leaders and planners in the development of appropriate tasks, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military departments, to ensure the military services' Sexual Assault Prevention and Response policies are aligned with the department's prevention strategy.

    Agency: Department of Defense
    Status: Open

    Comments: DOD action in progress. As part of its development of the department's 2017-2021 Sexual Assault Prevention Plan of Action, DOD is working to align military service sexual assault prevention policies with the department's overarching sexual assault prevention strategy.
    Director: John Pendleton
    Phone: (202) 512-3489

    1 open recommendations
    Recommendation: To ensure that resources are being efficiently applied to meet the National Guard counterdrug program's objectives, the Secretary of Defense should direct the National Guard Bureau in consultation with the Deputy Assistant Secretary of Defense for Counternarcotics and Global Threats to subsequently collect and use performance information to help inform funding distribution decisions to state programs and to conduct oversight of the training offered by the counterdrug schools.

    Agency: Department of Defense
    Status: Open

    Comments: The National Guard counterdrug program has plans to implement performance information into its fiscal year 2017 annual assessments of the state programs and counterdrug schools. The fiscal year 2017 annual assessments are scheduled to be complete by December 2017. The recommendation will remain open until performance information has been included in the annual assessments.
    Director: Debra A. Draper
    Phone: (202) 512-7114

    1 open recommendations
    Recommendation: To be able to identify and address problems that may occur and thus help ensure a smooth transition, the Secretary of Defense should require the Defense Health Agency ensure that planning documents for the expansion include specific requirements to continuously monitor affected beneficiaries, including whether (1) covered medications are available and filled in a timely and accurate manner through mail order and across MTF pharmacies; and (2) beneficiaries are satisfied with the transition to mail order and MTF pharmacies.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, DOD has not provided information that it plans to separately track through mail order and military treatment facilities the availability, timeliness, and accuracy of prescriptions filled by beneficiaries affected by the expansion of the TRICARE pharmacy pilot. Similarly, DOD has not provided information that it plans to separately track through mail order and military treatment facilities the satisfaction of beneficiaries affected by the expansion of the TRICARE pharmacy pilot.
    Director: Anne-Marie Fennell
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: To better ensure that the agencies have sufficient information to understand the effectiveness of their approach to wildland fires, and to better position them to develop appropriate and effective strategies for wildland fire management, the Secretaries of Agriculture and the Interior should direct the Chief of the Forest Service and the Director of the Office of Wildland Fire to develop specific criteria for selecting wildland fires for review and for conducting the reviews as part of their efforts to improve their approach to reviewing fires.

    Agency: Department of Agriculture
    Status: Open

    Comments: In August 2017, the Forest Service amended its policy to reflect criteria it developed for selecting wildland fires for review. In addition, in August 2017, Forest Service officials told us the agency will host a "Risk Learning Summit" in November 2017 during which they plan to begin developing criteria for conducting fire reviews. They told us that once criteria are agreed upon, they will be reflected in Forest Service policy (through the Forest Service Manual) within a year or so of the summit (around November 2018).
    Recommendation: To better ensure that the agencies have sufficient information to understand the effectiveness of their approach to wildland fires, and to better position them to develop appropriate and effective strategies for wildland fire management, the Secretaries of Agriculture and the Interior should direct the Chief of the Forest Service and the Director of the Office of Wildland Fire to, once such criteria are established, revise agency policies to align with the specific criteria developed by the agencies.

    Agency: Department of Agriculture
    Status: Open

    Comments: In August 2017, the Forest Service amended its policy to reflect criteria it developed for selecting wildland fires for review. In addition, in August 2017, Forest Service officials told us the agency will host a "Risk Learning Summit" in November 2017 during which they plan to begin developing criteria for conducting fire reviews. They told us that once criteria are agreed upon, they will be reflected in Forest Service policy (through the Forest Service Manual) within a year or so of the summit (around November 2018).
    Director: David Powner
    Phone: (202) 512-9286

    17 open recommendations
    Recommendation: To better ensure that agencies' IT savings are being reinvested in the most efficient and effective manner possible, the Director of OMB should direct the Federal CIO to ensure that agencies complete their reinvestment plans, in accordance with established requirements, and maintain those plans on an ongoing basis.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: The Office of Management and Budget (OMB) generally agreed with, and has taken initial steps to implement, our recommendation. In May 2016, OMB released updated guidance for agency's quarterly data submissions that noted the importance of providing savings reinvestment information. Specifically, OMB strongly encouraged agencies to provide reinvestment information where feasible, including a description of the activities that were funded using any savings achieved. OMB further noted that failing to provide such information might result in an agency being unable to accurately track its reinvestments. However, the May 2016 guidance notes that providing this reinvestment information is not required. As of May 2017, OMB had not yet updated its guidance for agencies quarterly data submissions to require reinvestment information. We will continue to evaluate OMB's progress in implementing this recommendation.
    Recommendation: To better ensure that agencies' IT savings are being reinvested in the most efficient and effective manner possible, the Director of OMB should direct the Federal CIO to require agencies to track actual reinvestment performance and define performance targets for agencies' reinvestments, as done previously.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: The Office of Management and Budget (OMB) generally agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, OMB had not issued additional guidance to require agencies to track actual reinvestment performance or defined performance targets for agencies' reinvestments. We will continue to evaluate OMB's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Agriculture should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Agriculture
    Status: Open

    Comments: The Department of Agriculture agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the department's integrated data collection submission to the Office of Management and Budget had not been updated to include reinvestment plans for all reported cost savings and avoidance initiatives. For example, the department reported about $25 million in cost savings and avoidances related to its data center consolidation efforts, but did not include plans regarding how these savings would be reinvested. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, as part of any future update to the department's information resource management strategic plan or equivalent document, the Secretary of Commerce should direct the CIO to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Department of Commerce
    Status: Open

    Comments: The Department of Commerce agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the department had not updated its IT Resource Management Strategic plan to include the approach to reinvesting savings from the consolidation of commodity IT resources. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Commerce should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Commerce
    Status: Open

    Comments: The Department of Commerce agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the department's integrated data collection submission to the Office of Management and Budget had not been updated to include reinvestment plans for all reported cost savings and avoidance initiatives. For example, the department reported about $26 million in cost savings and avoidances related to its server virtualization efforts, but did not include plans regarding how these savings would be reinvested. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Defense should direct the Defense CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Defense
    Status: Open

    Comments: The Department of Defense partially agreed with our recommendation and has taken initial steps to implement it. Specifically, as of May 2017, the department reported approximately $331.4 million in data center consolidation cost savings in its quarterly integrated data collection submission to the Office of Management and Budget. Although the department's submission notes that it plans to reinvest these savings in the agency's core mission, it did not provide any further detail regarding these reinvestment plans. In addition, the department did not report any information technology cost savings and avoidance initiatives related to its business system modernization efforts, which it had previously reported to GAO as an area with substantial savings. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: In addition, to improve the U.S. Army Corps of Engineers' IT savings reinvestment plans, the Secretary of Defense should direct the Secretary of the Army, as part of any future update to the U.S. Army Corps of Engineers' IRM strategic plan or equivalent document, to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Department of Defense
    Status: Open

    Comments: The U.S. Army Corps of Engineers agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the agency had not yet updated its Information Resources Management Strategic Plan to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources. We will continue to evaluate the agency's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Health and Human Services should direct the CIO, as part of any future update to the department's IRM strategic plan or equivalent document, to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: The Department of Health and Human Services (HHS) agreed with, and has taken initial steps to implement, our recommendation. Specifically, in November 2015, the department stated that its Office of the Chief Information Officer will include reinvestment strategies in its next update of the HHS Information Resource Management Strategic Plan. According to the department, the updated strategic plan was expected to be completed by the end of September 2016. However, as of May 2017, the agency had not yet updated its Information Resources Management Strategic Plan to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Homeland Security should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Homeland Security
    Status: Open

    Comments: The Department of Homeland Security agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the department's integrated data collection submission to the Office of Management and Budget had not been updated to include reinvestment plans for all reported cost savings and avoidance initiatives. For example, the department did not include reinvestment plans for two cost avoidances strategies related to the Office of Management and Budget's PortfolioStat initiative that have resulted approximately $96 million in cost avoidances. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Housing and Urban Development should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Housing and Urban Development
    Status: Open

    Comments: The Department of Housing and Urban Development agreed with, and has taken initial steps to implement, our recommendation. Specifically, as of May 2017, the department updated its integrated data collection submission to include reinvestment plans for one of the seven cost savings and avoidance initiatives reported. However, the six remaining initiatives, with savings and avoidances totaling approximately $6 million, did not include reinvestment plans. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's tracking of reinvestments, the Secretary of Labor should direct the CIO to use existing governance mechanisms and any improvements resulting from the implementation of FITARA to improve tracking of how savings have been reinvested.

    Agency: Department of Labor
    Status: Open

    Comments: The Department of Labor has taken initial steps to implement our recommendation. As of November 2015, the department stated that it was planning improvements in the area of information technology (IT) investment management in accordance with the Office of Management and Budget's June 2015 guidance for implementing the December 2014 IT reform law (commonly referred to as the Federal Information Technology Acquisition Reform Act or FITARA). The department added that these improvements would include the tracking of how savings have been reinvested. Subsequently, in May 2016, the department finalized its FITARA Implementation Plan. While the implementation plan discusses planned actions to improve the Chief Information Officer's involvement in agency IT budget requests, acquisition requests, and program management, it did not specifically discuss planned actions to improve the tracking of how information technology savings have been reinvested. In addition, as of May 2017, the department had not documented any FITARA implementation milestones that discussed making improvements in the tracking of how savings are reinvested. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of State should direct the CIO, as part of any future update to the department's IRM strategic plan or equivalent document, to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Department of State
    Status: Open

    Comments: The Department of State has not yet taken steps to implement our recommendation. Specifically, as of May 2017, the agency had not yet updated its Information Technology Strategic Plan to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of the Treasury should direct the CIO, as part of any future update to the department's IRM strategic plan or equivalent document, to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Department of the Treasury
    Status: Open

    Comments: The Department of the Treasury has not yet taken steps to implement our recommendation. Specifically, as of May 2017, the agency had not yet updated its Information Resources Management Strategic Plan to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of the Treasury should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to use any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of the Treasury
    Status: Open

    Comments: The Department of the Treasury has not yet taken steps to implement our recommendation. Specifically, as of May 2017, the department's integrated data collection submission did not include reinvestment plans for all reported cost savings and avoidance initiatives. For example, the department reported about $1.07 billion in cost savings and avoidances from its information technology infrastructure efficiency initiatives, but did not provide information regarding how it plans to reinvest these savings and avoidances. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the department's IT savings reinvestment plans, the Secretary of Veterans Affairs should direct the CIO to ensure that the department's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs agreed with, and has taken initial steps to implement, our recommendation. Specifically, in November 2015, the department's Chief of Staff stated that the Office of Information and Technology was working to establish an office to closely monitor program performance, schedule, return on investment, and total cost of ownership, which will enable reinvestment opportunities. However, as of May 2017, the department's integrated data collection submission did not include reinvestment plans for all of the reported cost savings and avoidance initiatives. For example, the department reported about $177 million in cost savings and avoidances from the renegotiation of an enterprise agreement for software licenses, but did not provide information regarding how it plans to reinvest these savings and avoidances. We will continue to evaluate the department's progress in implementing this recommendation.
    Recommendation: To improve the agency's IT savings reinvestment plans, the Administrator of the Environmental Protection Agency should direct the CIO to ensure that the agency's integrated data collection submission to OMB includes, for all reported initiatives, complete plans to reinvest any resulting cost savings and avoidances from OMB-directed IT reform-related efforts.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: The Environmental Protection Agency agreed with our recommendation, but has not yet taken steps to implement it. Specifically, as of May 2017, the agency's integrated data collection submission did not include reinvestment plans for all of the reported cost savings and avoidance initiatives. For example, the agency reported about $3 million in cost savings and avoidances related to two shared services initiatives, but did not provide information regarding how it plans to reinvest these savings and avoidances. We will continue to evaluate the agency's progress in implementing this recommendation.
    Recommendation: To improve the agency's IT savings reinvestment plans, the Director of the Office of Personnel Management should direct the CIO, as part of any future update to the agency's IRM strategic plan or equivalent document, to include information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) in accordance with OMB's guidance.

    Agency: Office of Personnel Management
    Status: Open

    Comments: The Office of Personnel Management (OPM) agreed with our recommendation, but has not yet taken action to implement it. Specifically, in November 2015, OPM's Acting Director stated that information regarding the approach to reinvesting savings from the consolidation of commodity IT resources (including data centers) would be included in future updates to OPM's Strategic IT Plan. However, as of May 2017, the agency had not yet updated its strategic plan to include this information. We will continue to evaluate the OPM's progress in implementing this recommendation.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    3 open recommendations
    including 3 priority recommendations
    Recommendation: To provide decision makers with appropriate and more complete information on the continuing implementation, management, and oversight of the DHA, the Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to develop a comprehensive requirements assessment process that accounts for needed future skills through the consideration of potential organizational changes and helps ensure appropriate consideration of workforce composition through the determination of the final status of military personnel within the DHA.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: As of April 2017, DOD has taken some steps to implement this action. According to an April 2017 letter from the Acting Principal Deputy Assistant Secretary of Defense (Health Affairs), DOD has established processes and procedures to create an overall personnel management process which are documented in a draft Administrative Instruction estimated to be finalized and published by July 31, 2017.
    Recommendation: To provide decision makers with appropriate and more complete information on the continuing implementation, management, and oversight of the DHA, the Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to develop a plan for reassessing and revalidating personnel requirements as the missions and needs of the DHA evolve over time.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: As of April 2017, DOD has taken some steps to implement this action. According to an April 2017 letter from the Acting Principal Deputy Assistant Secretary of Defense (Health Affairs), DOD has established processes and procedures to create an overall personnel management process which are documented in a draft Administrative Instruction estimated to be finalized and published by July 31, 2017.
    Recommendation: To provide decision makers with appropriate and more complete information on the continuing implementation, management, and oversight of the DHA, the Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to determine the future of the Public Health and Medical Education and Training shared services by either identifying common functions to consolidate to achieve cost savings or by developing a justification for the transfer of these functions from the military services to the DHA that is not premised on cost savings.

    Agency: Department of Defense
    Status: Open
    Priority recommendation

    Comments: As of April 2017, DOD has taken some steps to implement this action. According to an April 2017 letter from the Acting Principal Deputy Assistant Secretary of Defense (Health Affairs), DOD has changed the designation of its Public Health function from a shared service to a division. This change recognizes the distinction that we previously highlighted between a shared service, or the consolidation of functions previously performed by the military services, and a transfer of functions from the military services to the DHA. The letter states that DOD is in the process of assessing business case analyses for various efficiency efforts, with one proposal estimated to save $613 million over three years. DOD has not taken similar action with regard to its Medical Education and Training shared service. As we previously reported in our prior update, while DOD cites future cost savings in its modeling and simulation and online learning product lines, we reported in 2014 that these initiatives overlap with the DHA's Contracting and Procurement and Information Technology shared services. For example, while cost savings for Modeling and Simulation are allocated to the Medical Education and Training Directorate, implementation costs are to be incurred by the Contracting and Procurement shared service. This recommendation will remain open until DOD either identifies common functions to consolidate within Medical Education and Training to achieve cost savings or develops a justification for the transfer of these functions from the military services to the DHA that is not premised on cost savings.
    Director: J. Christopher Mihm
    Phone: (202) 512-6806

    9 open recommendations
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Homeland Security, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by working with OMB to describe on Performance.gov how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Agriculture
    Status: Open

    Comments: On June 15, 2017, the Director of the Office of Management and Budget (OMB) stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor the Department of Agriculture's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Homeland Security, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by working with OMB to describe on Performance.gov how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Defense
    Status: Open

    Comments: On June 15, 2017, the Director of the Office of Management and Budget (OMB) stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor the Department of Defense's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Homeland Security, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by working with OMB to describe on Performance.gov how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of the Interior
    Status: Open

    Comments: On June 15, 2017, the Director of the Office of Management and Budget (OMB) stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor the Department of the Interior's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Homeland Security, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by working with OMB to describe on Performance.gov how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Labor
    Status: Open

    Comments: Labor officials informed us that they had planned to address this recommendation by using a data quality self-assessment pilot they had conducted with component agencies that support Labor's priority goals. Labor had described its plans for this pilot in its fiscal year 2015 performance report and a link is provided from Performance.gov to agencies' performance plans and reports. Labor officials told us they described the results of this pilot in their draft fiscal year 2016 performance report, but according to Labor officials were advised by Office of Management and Budget (OMB) staff to deemphasize the priority goals and thus they dropped this section from the published performance report. On June 15, 2017, the Director of OMB stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor Labor's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by describing in their agencies' annual performance plans and reports how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Agriculture
    Status: Open

    Comments: The Department of Agriculture's (USDA) annual performance report for fiscal year 2016 and performance plan for fiscal year 2018 continues to provide a general statement on how the agency uses a standardized methodology to measure its performance and that agency officials attest to the quality of the performance information. However, USDA does not provide more specific explanation of how it is ensuring the accuracy and reliability of the performance information used to measure progress on the priority goals the agency identified for fiscal years 2016 and 2017. On June 15, 2017, the Director of the Office of Management and Budget stated in a memorandum to agency heads that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor USDA's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by describing in their agencies' annual performance plans and reports how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Defense
    Status: Open

    Comments: The Department of Defense's (DOD) performance report for fiscal year 2016 continues to state that performance goal owners are expected to attest that their performance data is complete, accurate, and reliable. However, the report does not provide more specific explanation for individual priority goals. On June 15, 2017, the Director of the Office of Management and Budget stated in a memorandum to agency heads that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor DOD's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by describing in their agencies' annual performance plans and reports how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of the Interior
    Status: Open

    Comments: The Department of the Interior's 2017/2018 Annual Performance Plan & 2016 Report (APP&R) includes a section concerning data accuracy and reliability and describes in general terms how Interior ensures the accuracy and reliability of performance information and how it addresses the five data quality requirements in the GPRA Modernization Act of 2010(GPRAMA). However, Interior does not provide more specific explanation for individual priority goals. For example, Interior states that the source of performance information are program managers, but does not provide more specific explanation of how the agency obtains performance information for priority goals that address a diverse array of issues, such as assisting Indian tribes, addressing climate change, and managing oil and gas resources. In September 2016, we provided feedback to Interior officials, at their request, and suggested they provide more specific data quality explanation. On June 15, 2017, the Director of the Office of Management and Budget stated in a memorandum to agency heads that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor Interior's efforts to address our recommendation.
    Recommendation: To improve the public reporting about how agencies are ensuring the quality of performance information used to measure progress towards their priority goals, the Secretaries of Agriculture, Defense, Interior, and Labor, and the Administrator of NASA should more fully address GPRAMA requirements and OMB guidance by describing in their agencies' annual performance plans and reports how they are ensuring the quality of performance information used to measure progress towards their APGs.

    Agency: Department of Labor
    Status: Open

    Comments: On June 15, 2017, Labor officials informed us that they had planned to address this recommendation by using a data quality self-assessment pilot they had conducted with component agencies that support Labor's priority goals. Labor had described its plans for this pilot in its fiscal year 2015 performance report. Labor officials told us they described the results of this pilot in their draft fiscal year 2016 performance report, but according to Labor officials were advised by Office of Management and Budget (OMB) staff to deemphasize the priority goals and thus they dropped this section from the published performance report. On June 15, 2017, the Director of OMB stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor Labor's efforts to address our recommendation.
    Recommendation: To help participating agencies improve their public reporting, the Director of OMB, working with the PIC Executive Director, should identify additional changes that need to be made in OMB's guidance to agencies related to ensuring the quality of performance information for APGs on Performance.gov.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: On June 15, 2017, the Director of the Office of Management and Budget (OMB) stated in a memorandum to agency heads that reporting on Performance.gov concerning the previous Administration's priority goals is suspended through the end of fiscal year 2017. The OMB Director stated that priority goals are intended to focus efforts toward achieving the priorities of the current political leadership and that new goals would be established when the President's fiscal year 2019 Budget is released. We will continue to monitor OMB's efforts to address our recommendation.
    Director: Brenda S. Farrell
    Phone: (202) 512-3604

    6 open recommendations
    Recommendation: To promote and enhance familiarity with values-based ethical decision-making across the department, the Secretary of Defense should direct appropriate departmental organization(s), in consultation with the Office of General Counsel and the Senior Advisor for Military Professionalism (SAMP) or its successor organization(s), to assess the feasibility of expanding annual values-based ethics training to include currently non-mandatory recipients.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred, with comment, with this recommendation, noting that the Office of the Senior Advisor for Military Professionalism is a temporary office established by Secretary Hagel for a two year term ending no later than March of 2016. DOD confirmed its position with regard to this recommendation on October 19, 2015. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Recommendation: To ensure that the need for a department-wide values-based ethics program has been addressed, the Secretary of Defense should direct appropriate departmental organization(s), in consultation with the Office of General Counsel, to identify actions and timeframes for responding to the Panel on Contracting Integrity recommendation, including the 14 related 2012 study recommendations, or alternatively demonstrate why additional actions are unwarranted.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred, with comment, with this recommendation, stating among other things that it has practices in place that are consistent with a number of the study recommendations and that it is most receptive to assessing and recommending implementation of additional measures. DOD confirmed its position with regard to this recommendation on October 19, 2015. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Recommendation: To help inform decision makers on the SAMP's progress as well as the decision regarding the extension of the SAMP's term, the Secretary of Defense should direct the SAMP to define timelines and measures to assess its progress in completing its major tasks.

    Agency: Department of Defense
    Status: Open

    Comments: DOD did not concur with this recommendation, stating that the department will submit its Fiscal Year 2015 National Defense Authorization Act report on military programs and controls regarding professionalism to Congress on September 1, 2015, thereby satisfying the requirements of this recommendation. DOD confirmed its position with regard to this recommendation on October 19, 2015. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Recommendation: To increase assurance that commanders are conducting command climate assessments in accordance with statutory requirements and departmental guidance, the Secretary of Defense should direct the Secretaries of the Air Force, the Army, and the Navy, and the Commandant of the Marine Corps to modify existing guidance or develop new guidance to comply with requirements set forth in the Fiscal Year 2014 National Defense Authorization Act and internal DOD guidance.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation, stating that existing Army practice is consistent with the intent of departmental guidance for command climate survey utilization. DOD confirmed its position with regard to this recommendation on October 19, 2015. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Recommendation: To better inform the department's approach to senior officers' professional development, the Secretary of Defense should direct the Secretary of the Navy, the Commandant of the Marine Corps, and the Chairman of the Joint Chiefs of Staff to assess the need for and feasibility of implementing 360-degree assessments for all general and flag officers.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation, stating that it concurs with the recommendation to assess the need for and feasibility of implementing 360-degree assessments, or 360-degree-like feedback assessments, where they are not already being performed, but that it believes that it should only do so for general and flag officers at the three star ranks and below. DOD confirmed its position with regard to this recommendation on October 19, 2015. At that time, DOD also stated that it believes in a holistic approach to developing and assessing professionalism, noting, as an example, the Joint Staff's use of staff assistance visits and Senior Leader "roundtables" to complement the use of 360-degree assessments. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Recommendation: To improve DOD's ability to assess its progress in addressing ethics and professionalism issues, the Secretary of Defense should direct the SAMP, through the Under Secretary of Defense for Personnel and Readiness, or SAMP's successor organization(s), to identify information sources and develop intermediate goals and performance metrics. At minimum, these performance metrics should be clear, quantifiable, and objective, and they should include a baseline assessment of current performance.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred, with comment, with this recommendation, noting that the office of the Senior Advisor for Military Professionalism is a temporary office established by Secretary Hagel for a two year term ending no later than March of 2016. DOD confirmed its position with regard to this recommendation on October 19, 2015. As of October 6, 2016, DOD has not responded to further inquiries regarding any actions it has taken to implement this recommendation.
    Director: Valerie C. Melvin
    Phone: (202) 512-6304

    5 open recommendations
    including 1 priority recommendation
    Recommendation: To improve VA's efforts to effectively complete the development and implementation of VBMS, the Secretary of Veterans Affairs should direct the Under Secretary for Benefits and the Chief Information Officer to develop an updated plan for VBMS that includes (1) a schedule for when VBA intends to complete development and implementation of the system, including capabilities that fully support disability claims, pension claims, and appeals processing and (2) the estimated cost to complete development and implementation of the system.

    Agency: Department of Veterans Affairs
    Status: Open
    Priority recommendation

    Comments: The Department of Veterans Affairs (VA) concurred with our recommendation calling for an updated plan for the Veterans Benefits Management System. However, as of June 2017, the department had not developed a plan that included a schedule for when the Veterans Benefits Administration intends to complete development and implementation of the system, as well as the estimated cost of doing so. We will continue to monitor VA's actions in response to this recommendation.
    Recommendation: To improve VA's efforts to effectively complete the development and implementation of VBMS, the Secretary of Veterans Affairs should direct the Under Secretary for Benefits and the Chief Information Officer to establish goals for system response time and use the goals as a basis for periodically reporting actual system performance.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs (VA) concurred with this recommendation and reported that the Veterans Benefits Management System (VBMS) program office has developed draft metrics for performance of the system. Specifically, VA stated that the office has established key performance indicators as a basis for monitoring the response times of the most commonly executed user transactions (or work events) within VBMS. According to the department, these indicators have been incorporated into the application's continuous monitoring tools for all service level agreements and these agreements are enforced by the VA Service Level Management Board. Nevertheless, as of June 2017, VA had not identified its goals for VBMS response times, nor had the department reported actual system response times. We will continue to monitor VA's actions toward addressing this recommendation.
    Recommendation: To improve VA's efforts to effectively complete the development and implementation of VBMS, the Secretary of Veterans Affairs should direct the Under Secretary for Benefits and the Chief Information Officer to reduce the incidence of high- and medium-priority level defects that are present at the time of future VBMS releases.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs (VA) concurred with this recommendation and, in June 2017, reiterated its plans and procedures for decreasing the incidences of defects in each system release. However, the incidences of high- and medium-priority level defects at the time of recent VBMS releases (i.e., releases 10.1 and 11.0) had increased relative to the number of defects present at the time of the earlier release (i.e., release 8.1) that we described in our report. We will continue to monitor VA's actions and progress in response to this recommendation.
    Recommendation: To improve VA's efforts to effectively complete the development and implementation of VBMS, the Secretary of Veterans Affairs should direct the Under Secretary for Benefits and the Chief Information Officer to develop and administer a statistically valid survey of VBMS users to determine the effectiveness of steps taken to make improvements in users' satisfaction.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs (VA) concurred with this recommendation and in January 2017, conducted a survey of VBMS users that was sent to over 16,000 claims processors at each of its 56 regional offices. Although 52 percent of respondents indicated that they were very satisfied or satisfied with VBMS, the department received only about 2500 responses to the survey for a 15 percent response rate. This low response rate raises concern about whether the survey results are statistically valid. We have requested additional information from VA to determine any actions the department has taken to ensure the statistical validity of its survey results and will assess any information that is provided.
    Recommendation: To improve VA's efforts to effectively complete the development and implementation of VBMS, the Secretary of Veterans Affairs should direct the Under Secretary for Benefits and the Chief Information Officer to establish goals that define customer satisfaction with VBMS and report on actual performance toward achieving the goals based on the results of GAO's survey of VBMS users and any future surveys VA conducts.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs (VA) concurred with this recommendation and conducted a survey of VBMS users in January 2017. However, as of June 2017, the department had yet to develop customer satisfaction goals for VBMS that would provide users with an expectation of the system response times they should anticipate, and management with an indication of how well the system is performing relative to performance goals.
    Director: J. Alfredo Gómez
    Phone: (202) 512-3841

    3 open recommendations
    Recommendation: The EPA Administrator should direct OGD to develop a timetable with milestones and identify and allocate resources for adopting electronic records management for all 10 regional offices.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: Implementation efforts ongoing. According to EPA officials, the Office of Grants and Debarment established an agency-wide electronic grants record workgroup in FY 16 Q1. The workgroup identified the contents of the electronic grant file, technical options and evaluation criteria. OGD has initiated an alternatives analysis and expects to present the results of that analysis to the Grants Management Council in FY 17 Q1. Once the GMC selects the technical approach, the Agency will identify available funding for implementation through the budget process.
    Recommendation: The EPA Administrator should direct OGD to implement plans for adopting an up-to-date and comprehensive IT system by 2017 that will provide accurate and timely data on agencywide compliance with grants management directives.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: Implementation efforts ongoing. According to EPA officials, OGD is already underway with a multi-modular project to upgrade the agency's grants management IT system (IGMS). Module 2 of 3 is on schedule for deployment in FY17 Q1. The final Module is on schedule for deployment, in early FY18. OGD will incorporate in the project performance tracking of priority directives in accordance with the policy framework of the new Grants Management Plan.
    Recommendation: Until the new IT system is implemented, the EPA Administrator should direct OGD to develop ways to more effectively use existing web-based tools to better monitor agencywide compliance with grants management directives.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: Implementation efforts ongoing. According to EPA officials, OGD has already developed the capability to provide managers cumulative annual baseline monitoring data. Further capabilities of web-based tools, namely the replacement of OGD's primary tool Quik Reports, are on schedule for deployment in FY17 Q1. This effort combined with updates to the Grants Datamart will provide valuable long term enhancements for the Agency's grant reporting needs.
    Director: King, Kathleen M
    Phone: (202) 512-7114

    3 open recommendations
    including 3 priority recommendations
    Recommendation: As CMS prepares to solicit the next RAC contract(s), to improve the agency's RAC program operations and contractor oversight, the Administrator of CMS should ensure that work statements included in solicitations for contract proposals and the executed contract(s) set clear expectations about the work CMS intends the RAC to perform and that time frames are established that reflect the time needed to reach milestones.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open
    Priority recommendation

    Comments: HHS agreed with our recommendation. As of March 2017, HHS stated that the agency was evaluating its strategy for the Medicare Part D RAC. Once HHS has completed its evaluation, we will update the status of these recommendations. As of May 2017, GAO considers this recommendation open.
    Recommendation: As CMS prepares to solicit the next RAC contract(s), to improve the agency's RAC program operations and contractor oversight, the Administrator of CMS should conduct annual evaluations of the RAC's performance against measurable performance standards to provide a clear basis on which CMS and the RAC can assess RAC performance in identifying improper payments.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open
    Priority recommendation

    Comments: HHS agreed with our recommendations. As of March 2017, HHS stated that the agency was evaluating its strategy for the Medicare Part D RAC. Once HHS has completed its evaluation, we will update the status of these recommendations. As of May 2017, GAO considers this recommendation open.
    Recommendation: As CMS prepares to solicit the next RAC contract(s), to improve the agency's RAC program operations and contractor oversight, the Administrator of CMS should review the agency's process for identifying, reviewing, and approving new audit issues to identify process improvements that will help ensure the efficient development of appropriate audit issues (i.e., reduce audit issue denials and increase audit issue approvals) and thereby maximize the collection of improper payments.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open
    Priority recommendation

    Comments: HHS agreed with our recommendations. As of March 2017, HHS stated that the agency was evaluating its strategy for the Medicare Part D RAC. Once HHS has completed its evaluation, we will update the status of these recommendations. As of May 2017, GAO considers this recommendation open.
    Director: Gerald Dillingham
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: To implement a more effective international strategy for achieving NextGen interoperability with other nations, the Secretary of Transportation should direct the FAA Administrator to conduct a risk assessment to identify potential threats and vulnerabilities to NextGen interoperability and establish timeframes for periodically re-evaluating these risks.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To implement a more effective international strategy for achieving NextGen interoperability with other nations, the Secretary of Transportation should direct the FAA Administrator to identify and document actions FAA will undertake to mitigate these risks, using information from the risk assessment as a basis for making management decisions about how to allocate resources for these activities.

    Agency: Department of Transportation
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Maurer, Diana C
    Phone: (202) 512-9627

    2 open recommendations
    including 2 priority recommendations
    Recommendation: To ensure that the Department of Justice effectively measures its efforts to address incarceration challenges, the Attorney General should explore additional data collection opportunities and modify its Smart on Crime indicators to incorporate key elements of successful performance measurement systems.

    Agency: Department of Justice
    Status: Open
    Priority recommendation

    Comments: In August 2015, DOJ reported that it has taken steps to obtain new, more granular data elements that it hoped to incorporate into its indicators. However, DOJ also stated that it did not believe that measureable targets were appropriate for its Smart on Crime indicators because prosecutors need to make case by case decisions without regard to targets or concerns for any other incentive. As of October 2016, DOJ had not provided any updates on its progress addressing this recommendation to enhance performance measurement. Until DOJ provides this information, we cannot determine whether its efforts resulted in indicators that incorporate key elements of successful performance measurement systems. In March, 2017, DOJ noted that, due to a change in administration, the consequences of the Smart on Crime initiative are uncertain, and did not provide any further updates on its progress addressing our recommendation.
    Recommendation: To ensure that the Department of Justice effectively measures its efforts to address incarceration challenges, the Attorney General should direct the Office of the Pardon Attorney, in conjunction with the Office of the Deputy Attorney General, to (1) track how long it takes, on average, for commutation of sentence petitions to clear each step in the review process under DOJ's control, and (2) identify and address, to the extent possible, any processes that may contribute to unnecessary delays.

    Agency: Department of Justice
    Status: Open
    Priority recommendation

    Comments: In August 2015, DOJ reported that tracking the steps of its review would not provide meaningful data because the Department prioritizes those cases for review that appear likely to meet the Clemency Initiative factors announced in April 2014. Nevertheless, DOJ stated that it agreed that identifying and addressing unnecessary delays in the review process is important, and that it has been regularly working to identify and address such delays. As of October 2016, DOJ had not provided any updates on its progress addressing this recommendation to better track and address any unnecessary delays. Until it does so, we cannot determine whether it is meeting the key goal of the new Clemency Initiative--to expeditiously identify and review especially meritorious petitions. In March 2017, DOJ noted that due to the accelerated clemency review process implemented in 2015, it currently has no standard process to evaluate, and did not provide any further updates on its progress in addressing our recommendation.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    1 open recommendations
    Recommendation: To more clearly communicate what NTIA hopes to achieve with its ongoing broadband adoption efforts and to demonstrate the agency's progress, the Secretary of Commerce should include in NTIA's annual performance plan a quantifiable outcome-based performance goal and a related performance indicator for the agency's broadband adoption efforts consistent with the strategic plan.

    Agency: Department of Commerce
    Status: Open

    Comments: In responding to the recommendation in a draft of the report, the Department of Commerce stated that it agrees that outcome-based performance tools are important in evaluating the success of an agency program. However, it also stated that an outcome-based measure would not be an accurate measure of NTIA's performance because the agency's ongoing efforts to provide technical assistance to communities to support broadband adoption efforts are advisory and do not provide funding to communities. In August 2016, an NTIA official reiterated this position. We will continue to monitor NTIA's activities in this area, in case its broadband adoption efforts change.
    Director: A. Nicole Clowers
    Phone: (202) 512-8678

    1 open recommendations
    Recommendation: To improve SEC's FINRA oversight program, the SEC Chair should direct the appropriate offices and divisions to incorporate additional risk-management practices by taking several actions, including: (1) establishing specific performance goals for the program and performance measures and related targets to assess Market Oversight's progress in meeting those goals; (2) formalizing documentation of procedures, including procedures for making changes to the annual planned oversight activities and decision-making rationales; and (3) modifying existing risk-assessment procedures to require an assessment of internal risks to successfully meeting the FINRA oversight program's goals and objectives.

    Agency: United States Securities and Exchange Commission
    Status: Open

    Comments: On August 26, 2016, SEC staff said that they had put together proposals to address the recommendation shortly after the report was issued and was awaiting management approval. However, in the meantime, SEC reorganized its examination staff and created a dedicated FINRA oversight group. The reorganization was expected to be complete by October 2016. SEC staff planned to incorporate, for management's approval, the elements in the proposals into the new policies and procedures for the FINRA oversight group. Subsequently, on February 13, 2017, SEC staff said that SEC now has new management in place that are learning about the risk management framework, and are assessing how best to incorporate GAO's recommendations into the framework.
    Director: Maurer, Diana C
    Phone: (202) 512-9627

    2 open recommendations
    Recommendation: To ensure the timely expenditure of VOCA grant funds and thereby limit the carryover of unexpended grant balances, minimize the need for multiple grant extensions, and strengthen OJJDP's capacity to collect and assess grantee performance information, the Assistant Attorney General for OJP should work with the Administrator of OJJDP to conduct a study to examine whether any of its administrative processes contribute to unnecessary delays in grantees' ability to expend VOCA funds within the established 12-month project period and make modifications to these processes as appropriate.

    Agency: Department of Justice: Office of Justice Programs: Office of the Assistant Attorney General
    Status: Open

    Comments: In April 2015, we found that OJJDP had several administrative review and approval processes in place that had contributed to delays in grantees' ability to begin spending their award funds. For instance, grantees could not access their funds until OJJDP had completed its internal review of grantees' budgets--a step that had taken more than 2 months, on average, after the grantees' project period had begun. We recommended that OJP examine its processes and, if appropriate, make modifications to prevent unnecessary delays in grantees' ability to expend VOCA funds within the established project period. In March 2017, OJP reported that its Office of Audit, Assessment and Management (OAAM), worked with OJJDP to complete an assessment to determine the impact of administrative processes on VOCA awards. Focusing on VOCA grants awarded in fiscal years 2010 through 2015, OAAM assessed a number of factors, including (1) the average timeframe for approval of budget reviews; (2) the average timeframe for approval of conference cost requests, and (3) the number of no-cost extensions granted. OJP reported that OAAM continues to work with OJJDP to review documentation to support implementation of process improvements to address the issues the assessment identified. OAAM anticipates issuing a report by March 31, 2017 to OJP's Acting Assistant Attorney General to summarize the results of the assessment and provide updates on the process improvements OJJDP has begun to implement. Examining the delays associated with its administrative review processes and making modifications as necessary will help OJP ensure the effective administration and timely use of grant funds.
    Recommendation: To ensure the timely expenditure of VOCA grant funds and thereby limit the carryover of unexpended grant balances, minimize the need for multiple grant extensions, and strengthen OJJDP's capacity to collect and assess grantee performance information, the Assistant Attorney General for OJP should work with the Administrator of OJJDP to, considering the results of this study, examine whether the current 12-month project period is realistic in light of any administrative processes that cause delay but cannot be modified and extend the project period if necessary.

    Agency: Department of Justice: Office of Justice Programs: Office of the Assistant Attorney General
    Status: Open

    Comments: In April 2015, we found that VOCA grant activities were not being completed within the time parameters OJJDP established for the grant program, and that this may affect the ability of grantees to complete their grant goals and objectives. Specifically, we found that for the 28 VOCA grants that OJJDP awarded from fiscal years 2010 through 2013, grantees had expended less than 20 percent, on average, of each grant they received during the original 12-month project period. In particular, we found that OJJDP's processes for reviewing grantees' budgets and conference planning requests were contributing to delays in grantees' ability to begin spending their funds. We recommended that OJP examine whether 12 months is an appropriate project period length to ensure that VOCA grantees are well positioned to fully expend their grant funds. In March 2017, OJP reported that its Office of Audit, Assessment and Management (OAAM), worked with OJJDP to complete an assessment to determine the impact of administrative processes on VOCA awards. Focusing on VOCA grants awarded in fiscal years 2010 through 2015, OAAM assessed a number of factors, including (1) the average timeframe for approval of budget reviews; (2) the average timeframe for approval of conference cost requests, and (3) the number of no-cost extensions granted. OJP reported that OAAM continues to work with OJJDP to review documentation to support implementation of process improvements to address the issues the assessment identified. OAAM anticipates issuing a report by March 31, 2017 to OJP's Acting Assistant Attorney General to summarize the results of the assessment and provide updates on the process improvements OJJDP has begun to implement. Once OJJDP examines its administrative delays, makes any necessary changes, and reviews the original project period length, OJP will be better positioned to ensure that grantees have an appropriate period in which to expend VOCA grant awards.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    3 open recommendations
    Recommendation: To improve performance management of the Telecommunications Relay Service, the Chairman of the Federal Communications Commission should develop specific performance goals and measures for the TRS program. FCC should establish goals that would guide its efforts on major program dimensions--for example, consider goals and performance measures related to, but not limited to, service quality or competition among providers.

    Agency: Federal Communications Commission
    Status: Open

    Comments: On May 12, 2017, FCC's Liaison reported to us that FCC is working towards implementing these recommendations, but FCC does not have any specific achievements or documentation to report at this time. GAO will continue to monitor and update the status of this rec.
    Recommendation: To improve performance management of the Telecommunications Relay Service, following the establishment of TRS's performance goals, the Chairman of the Federal Communications Commission should conduct a robust risk assessment that can help FCC design a comprehensive internal-control system.

    Agency: Federal Communications Commission
    Status: Open

    Comments: On May 12, 2017, FCC's Liaison reported to us that FCC is working towards implementing these recommendations, but FCC does not have any specific achievements or documentation to report at this time. GAO will continue to monitor and update the status of this rec.
    Recommendation: To improve performance management of the Telecommunications Relay Service, the Chairman of the Federal Communications Commission should improve FCC's communication of TRS rules and procedures to the community of individuals who are deaf, hard of hearing, or have speech disabilities and the companies providing TRS services through the creation and dissemination of a handbook, program manual, or other consolidation of TRS rules and procedures.

    Agency: Federal Communications Commission
    Status: Open

    Comments: On May 12, 2017, FCC's Liaison reported to us that FCC is working towards implementing these recommendations, but FCC does not have any specific achievements or documentation to report at this time. GAO will continue to monitor and update the status of this rec.
    Director: Mak, Marie A
    Phone: (202) 512-4841

    1 open recommendations
    Recommendation: In order for NASA to fully implement the NASA Authorization Act of 2008 and for CASIS to fulfill its responsibility as outlined in the cooperative agreement, the NASA Administrator should direct the Associate Administrator for the Human Exploration and Operations Mission Directorate to fully staff the ISS National Laboratory Advisory Committee.

    Agency: National Aeronautics and Space Administration
    Status: Open

    Comments: NASA does not plan to staff the International Space Station National Laboratory Advisory Committee (INLAC) at this time. Officials stated that they continue to believe that the Center for the Advancement of Science in Space (CASIS) Board of Directors meets the intent of the INLAC charter by providing oversight of CASIS implementation of utilization of the ISS as a national laboratory. NASA remains concerned about staffing another oversight group that may create conflicts with the existing CASIS Board of Directors. NASA is also exploring with CASIS opportunities to open portions of board meetings to the general public and interested parties in order to foster additional transparency and a broad and free exchange of ideas. In response to this recommendation, the Associate Administrator for the Human Exploration and Operations Mission Directorate indicated that NASA was seeking relief from the statutory requirement to staff the INLAC.
    Director: Michele Mackin
    Phone: (202) 512-4841

    2 open recommendations
    Recommendation: To improve DHS's management of major acquisition programs, the Secretary of Homeland Security should ensure future baselines for all of TSA's major acquisition programs capture the overall historical record of change.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that the Transportation Security Administration (TSA) will begin to incorporate an addendum to future Acquisition Program Baselines (APB) that will provide a single source to show the changes to cost, schedule, and performance metrics, beginning with the initial program baseline and showing traceability of all interim approved versions to the current APB. DHS estimated it would complete this effort April 30, 2016. As of August 2017, DHS leadership had approved updated versions of the two APBs that were the basis for this recommendation. Both included addendums with metrics from prior APBs, but raised questions about traceability to the current cost, schedule, and performance metrics. GAO will assess the updated APBs as a part of its annual review of select DHS major acquisition programs to determine whether the department has addressed the recommendation.
    Recommendation: To more accurately communicate DHS's funding plans for USCG's major acquisition programs, the Secretary of Homeland Security should ensure the funding plans presented to Congress in fiscal year 2015 are comprehensive and clearly account for all operations and maintenance funding DHS plans to allocate to each of the USCG's major acquisition programs.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In providing comments on this report, the Department of Homeland Security (DHS) concurred with this recommendation, and stated that the U.S. Coast Guard and the DHS Chief Financial Officer will develop a plan to address this recommendation by September 30, 2015, then work together to fully implement the plan. DHS estimated it would complete this effort March 31, 2016. However, the USCG encountered technical challenges during this process and was unable to implement the plan by that time. The U.S. Coast Guard has revised the estimated completion date, and now anticipates it will be able to address this recommendation in fiscal year 2020.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: To help FCC determine whether its efforts to provide consumers with broadband performance information are effective and meeting consumers' needs, and whether additional efforts--such as a standardized label suggested by FCC's transparency working group--could benefit consumers, FCC should conduct or commission research on the effectiveness of FCC's efforts to provide consumers with broadband performance information and make the results of this research publicly available.

    Agency: Federal Communications Commission
    Status: Open

    Comments: In written comments provided on the draft report, FCC indicated that it concurred with this recommendation. However, as of August 2017, FCC has not taken steps to address this recommendation.
    Recommendation: To help FCC determine whether its efforts to provide consumers with broadband performance information are effective and meeting consumers' needs, and whether additional efforts--such as a standardized label suggested by FCC's transparency working group--could benefit consumers, FCC should establish performance goals and measures under the agency's relevant strategic objectives that allow it to monitor and report on the impact and effectiveness of its efforts.

    Agency: Federal Communications Commission
    Status: Open

    Comments: FCC noted that its fiscal year 2015-2018 strategic plan has strategic objectives related to providing consumers with broadband performance information; however, these objectives lack performance goals that define desired outcomes for FCC's efforts to provide consumers with broadband performance information as well as performance measures to monitor the effectiveness of FCC's efforts.
    Director: Jennifer A. Grover
    Phone: (202) 512-7141

    7 open recommendations
    including 4 priority recommendations
    Recommendation: To ensure that the NSCs can be operated and maintained in the most demanding environments based on mission and maintenance requirements prior to implementation of the CRC, the Coast Guard should, as expeditiously as possible under its capacity limits and fiscal constraints, fulfill the staffing requirements recommended in the 2011 manpower requirements analysis, including ensuring that while implementing the interim 210 Plan, the NSCs operate with sufficient numbers of crew members who possess the recommended mix of skills and abilities.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In August 2015, the Coast Guard stated that funding to fulfill the staffing requirements recommended in the 2011 manpower requirements analysis for the National Security Cutter is under review and is expected to be determined by February 2016. On January 24, 2017, the Coast Guard noted that it expects the crew increase to be reflected in the FY 2017 Appropriation.
    Recommendation: To improve the Coast Guard's ability to make informed decisions about the overall feasibility of its goal to achieve 230 DAFHP using the CRC, and to ensure the effectiveness of the scheduled CRC feasibility test, the Coast Guard's CRC plan, scheduled to be completed by December 2017, should specify mitigation actions to effectively address the risk factors identified in this report, including determining the appropriate number of NSC crew and shoreside-based support personnel with the right mix of skills and abilities and having them in place when the Coast Guard tests the CRC.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open
    Priority recommendation

    Comments: In July 2015, the Coast Guard provided documentation of a manpower requirements analysis and manpower requirements determination, which specify the number of shoreside-based support personnel, such as engineering and maintenance, that are needed to support 4 National Security Cutters (NSC) based in Alameda, CA (i.e., three of the four NSCs using the crew rotational concept). In March 2016, the Coast Guard stated that it would request resources, as appropriate, to ensure that these personnel are in place prior to testing and expects to close this recommendation by November 2017. On January 24, 2017, the Coast Guard noted that it is continuing to develop the final test plan.
    Recommendation: To improve the Coast Guard's ability to make informed decisions about the overall feasibility of its goal to achieve 230 DAFHP using the CRC, and to ensure the effectiveness of the scheduled CRC feasibility test, the Coast Guard's CRC plan, scheduled to be completed by December 2017, should specify mitigation actions to effectively address the risk factors identified in this report, including addressing the misalignment of the crewing concept to be used in the planned CRC test, as compared to the NSC homeporting plan, so that the CRC test is conducted in an operationally realistic environment and that the test results can be used to determine the optimal schedules for rotating crews and performing maintenance.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open
    Priority recommendation

    Comments: In March 2016, the Coast Guard stated it continues to analyze and develop various testing plans and will submit a final plan to increase the NSCs' days away from homeport to Congress by December 2017. On January 24, 2017, the Coast Guard noted that it continues to analyze and develop various testing plans to reach 225 DAFHP onboard NSCs. The test will be performed by Coast Guard Pacific Area during normal operations over an extended period to ensure it is operationally realistic; lessons learned will be used to inform future crewing models. The Coast Guard will submit a final test plan to Congress prior to the deadline set forth by the 2012 Coast Guard Authorization Bill (end of 2017).
    Recommendation: To improve the Coast Guard's ability to make informed decisions about the overall feasibility of its goal to achieve 230 DAFHP using the CRC, and to ensure the effectiveness of the scheduled CRC feasibility test, the Coast Guard's CRC plan, scheduled to be completed by December 2017, should specify mitigation actions to effectively address the risk factors identified in this report, including addressing the potential impacts of wide variations between alternative CRC deployment schedules.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open
    Priority recommendation

    Comments: In March 2016, the Coast Guard stated it continues to analyze and develop various testing plans and will submit a final plan to increase the NSCs' days away from homeport to Congress by December 2017. On January 24, 2017, the Coast Guard noted that it continues to analyze and develop various testing plans to reach 225 DAFHP onboard NSCs. The test will be performed by Coast Guard Pacific Area during normal operations over an extended period to ensure it is operationally realistic; lessons learned will be used to inform future crewing models. The Coast Guard will submit a final test plan to Congress prior to the deadline (end of 2017) set forth by the 2012 Coast Guard Authorization Bill.
    Recommendation: To improve the Coast Guard's ability to make informed decisions about the overall feasibility of its goal to achieve 230 DAFHP using the CRC, and to ensure the effectiveness of the scheduled CRC feasibility test, the Coast Guard's CRC plan, scheduled to be completed by December 2017, should specify mitigation actions to effectively address the risk factors identified in this report, including expanding the Coast Guard's training infrastructure capacity to provide crew members with the necessary training for off-cycle rotating NSC crew members under the CRC.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open
    Priority recommendation

    Comments: In March 2016, the Coast Guard stated it continues to analyze and develop various testing plans and will submit a final plan to increase the NSCs' days away from homeport to Congress by December 2017. On January 24, 2017, the Coast Guard noted that it continues to analyze and develop various testing plans to reach 225 DAFHP onboard NSCs. The test will be performed by Coast Guard Pacific Area during normal operations over an extended period to ensure it is operationally realistic; lessons learned will be used to inform future crewing models. The Coast Guard will submit a final test plan to Congress prior to the deadline set forth by the 2012 Coast Guard Authorization Bill (the end of 2017).
    Recommendation: To ensure that the Coast Guard is making progress in a timely manner to address and effectively mitigate the risk factors identified above, the Coast Guard should develop interim milestones for the various actions to be taken on each of the risk factors as the Coast Guard completes the CRC Plan.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In March 2016, the Coast Guard stated it continues to analyze and develop various testing plans and will submit a final plan to increase the NSCs' days away from homeport to Congress by December 2017. On January 24, 2017, the Coast Guard noted that the analysis is ongoing, and will be addressed in the test plan submitted to Congress in accordance with the 2012 Coast Guard Authorization Bill (end of 2017).
    Recommendation: Finally, to ensure that the Coast Guard is making progress in developing alternative measures that provide more accurate indicators of operational performance in a timely manner, the Coast Guard should establish time frames and interim milestones for developing and implementing these alternative measures for use prior to CRC testing. These measures could then be used for both the NSCs, as well as for other cutters, such as the Offshore Patrol Cutter, that currently use or plan to use the traditional DAFHP performance measure.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In August 2015, the Coast Guard stated that its analysis of alternative measures for use prior to testing the NSCs to use the crew rotational concept was ongoing and did not provide a date for completion. On January 24, 2017, the Coast Guard noted that, in the process of analyzing an alternative to DAFHP, it found that while its enterprise data management system collects the necessary data; the system didn't have an efficient way of aggregating the data for analysis. The first step to develop an appropriate enterprise measure is to improve the data management system through a software change. Once the change is complete, the system will be evaluated and tested to ensure that an aggregated report of discrete Coast Guard Cutter activity is accurate and reliable. The change will include the functionality to separate underway from in-port activity. After examining the results from the software change, the Coast Guard will evaluate an alternative to DAFHP. However, all analyses to date indicate DAFHP remains an important measure for personnel operations tempo and cutter scheduling and will not be eliminated as an available measure. The Coast Guard updated the estimated completion date for this recommendation to July 2018.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: GSA should examine incorporating successful management practices--such as consistently involving tenants at various stages of the project--into its capital investment process to ensure that projects are managed efficiently and that tenant disruptions are minimized.

    Agency: General Services Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: To ensure that GSA's green Recovery Act projects meet relevant requirements, GSA should analyze environmental outcomes against relevant requirements for each of its full and partial-modernization Recovery Act projects and apply any lessons to future projects.

    Agency: General Services Administration
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Zina D. Merritt
    Phone: (202) 512-5257

    3 open recommendations
    Recommendation: To help DOD increase the efficiency and effectiveness of its management of its business operations, and to enhance DOD's ability to achieve its business transformation efforts, the Secretary of Defense should direct the Deputy Secretary of Defense, in his capacity as the CMO, to ensure that the DCMO document business transformation priorities and communicate these priorities to officials responsible for DOD's business functions.

    Agency: Department of Defense
    Status: Open

    Comments: DOD has developed an updated draft of its Agency Strategic Plan for Fiscal Years 2015-2018. Once this draft is signed and issued, we believe it will communicate the department's priorities for its business operations. DOD DCMO officials estimate that the plan will be signed and issued in October 2016.
    Recommendation: To help DOD increase the efficiency and effectiveness of its management of its business operations, and to enhance DOD's ability to achieve its business transformation efforts, the Secretary of Defense should direct the Deputy Secretary of Defense, in his capacity as the CMO, to ensure that the DCMO oversee the development of a corrective action plan, in coordination with officials responsible for DOD business functions, that outlines the root causes for business transformation weaknesses and the solutions needed to address those weaknesses.

    Agency: Department of Defense
    Status: Open

    Comments: DOD has developed an appendix in an updated draft of its Agency Strategic Plan for Fiscal Years 2015-2018 that is titled "Performance Action Plan," but we not yet reviewed this appendix, so cannot assess whether this would meet the intent of our recommendation that they develop a corrective action plan. DOD DCMO officials estimate that the plan, which includes this appendix, will be signed and issued in October 2016.
    Recommendation: To help DOD increase the efficiency and effectiveness of its management of its business operations, and to enhance DOD's ability to monitor the progress of its business transformation efforts, the Secretary of Defense should direct the Office of the DCMO to, in coordination with officials responsible for DOD's business functions, develop performance measures that reflect key attributes of successful performance measures, such as clarity, comprehensiveness, and linkage.

    Agency: Department of Defense
    Status: Open

    Comments: DOD has developed an updated draft of its Agency Strategic Plan for Fiscal Years 2015-2018 that contains a set of performance measures that are more clear and comprehensive than the measures contained in previous strategic plans. This plan also demonstrates how the performances measures to link to strategic goals and objectives. DOD DCMO officials estimate that the plan will be signed and issued in October 2016.
    Director: Gerald L. Dillingham, Ph.D.
    Phone: (202) 512-2834

    2 open recommendations
    Recommendation: If, in the next authorization for FAA, Congress chooses to mandate that FAA take actions to streamline and reform the agency, Congress may wish to consider requiring FAA to (1) track measures of and (2) report to Congress on the actual results of such efforts.

    Agency: Congress
    Status: Open

    Comments: FAA's authorization expired at the end of Fiscal Year 2015. As of May 2017, Congress has passed several FAA authorization extensions that did not include any actions related to this matter. We will continue to monitor legislation, and when we determine what steps the Congress has taken regarding this matter, we will provide updated information.
    Recommendation: To better enable FAA to track, aggregate, and report on the results of its streamlining and reform initiatives, the Secretary of Transportation should direct FAA to develop a mechanism to capture the results of its efficiency initiatives in its planned database for process improvements. Measures of results might include, for example, cost savings, timeliness, or customer service metrics, which may be common to several types of process improvement efforts and therefore facilitate aggregation across improvements.

    Agency: Department of Transportation
    Status: Open

    Comments: As of May 2017, FAA expanded its existing data repository to include results of the efficiency initiatives, but no realized results or benefits have yet been entered into the data repository. GAO will continue to monitor the status of this recommendation.
    Director: Andrew Sherrill
    Phone: (202) 512-7215

    1 open recommendations
    Recommendation: Depending on the outcome of the litigation, the Secretary of Labor should take steps to ensure the agency will be positioned to conduct a meaningful retrospective review consistent with the Executive Order at an appropriate time. These steps should be taken in consultation with the Centers for Medicare & Medicaid Services, and could include, for example, identifying metrics that could be used to evaluate the rule, and implementing a plan to gather and analyze the necessary data.

    Agency: Department of Labor
    Status: Open

    Comments: The Department of Labor's Wage and Hour Division (WHD) agreed with this recommendation and reported that it is working to develop data collection plans and explore a potential evaluation that is focused on the Home Care Rule. As part of this effort, WHD noted that it will continue to work with HHS and other federal partners. In FY16, WHD reported that such an evaluation of how stakeholders and affected industries have responded to the rule would be beneficial. However, litigation has delayed implementation and enforcement of the rule significantly, and WHD believes an evaluation at this stage would be premature and would be unlikely to fully and accurately capture stakeholders' responses to the rule and the resulting impacts. Delaying the evaluation would allow WHD to monitor the results of its own investigations and the effects of ongoing compliance assistance, both of which would be extremely difficult to measure at this early stage. WHD will continue to monitor early implementation to determine the appropriate start for any evaluation.
    Director: James R.McTigue, Jr.
    Phone: (202) 512-9110

    3 open recommendations
    Recommendation: Congress should consider expanding the mandate for 501(c)(3) organizations to electronically file their tax returns to cover a greater share of filed returns.

    Agency: Congress
    Status: Open

    Comments: The threshold over which Treasury/IRS can require electronic reporting is still 250 returns. As of February 18, 2016, there is no proposed legislation in the current Congress which would amend this threshold.
    Recommendation: To improve oversight of charitable organizations, the Commissioner of Internal Revenue should direct EO to develop quantitative, results-oriented compliance goals and additional performance measures and indicators that can be used to assess impact of exams and other enforcement activities on compliance.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS reported it has taken a series of actions to implement this recommendation. First, in FY 2016, IRS implemented a new data-driven case selection model to identify the most non-compliant returns based upon what is reported. Starting in FY 2017, IRS plans to measure the effectiveness of these new data-analytic models and use that performance information as the basis for ongoing discussions with EO Examinations managers on which queries are yielding results and which need to be modified or deleted from the work plan. IRS also developed a weighted disposal code measure, which is intended to help examiners prioritize case selection according to criteria that give more weight to more consequential outcomes. For example, a data mining query generating a lot of revocations would take priority over a query that may only generate written advisories. IRS incorporated the new measure into its current and future work plan monitoring and projections. IRS also began discussions with TE/GE Research and SOI to figure out how to define compliance for the EO population, establish a compliance baseline, and how to develop methods to measure the impact of enforcement actions on voluntary compliance levels in the EO population. Once all these actions are fully implemented, IRS will be in a better position to use this information to develop quantitative, results-oriented compliance goals and additional performance measures and indicators that can be used to assess impact of exams and other enforcement activities on compliance.
    Recommendation: To improve oversight of charitable organizations, the Commissioner of Internal Revenue should continue to work with Treasury officials to do the following: review the flexibility afforded under the Pension Protection Act of 2006 consistent with statutory protections of taxpayer data, clarify what flexibility state regulators have in how they protect and use federal tax data, make modifications to guidance, policies, or regulations as warranted, and clearly communicate this information with state charity regulators.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: In 2016, IRS reported taking three actions to implement this recommendation. First, IRS coordinated a training session for State Charity Regulators on safeguards. The training included a review of the Safeguards Security Report (SSR) and covered several topics including current period safeguard activities, changes to safeguarding procedures, and disposal of information. According to IRS, there were 53 participants representing 45 different states. IRS also revised the 6104 (c)Memorandum of Understanding (MOU) inserting a new paragraph that instructs state charity regulators to contact the Tax Exempt/Government Entities (TEGE) Liaison if there are questions about whether an administrative or judicial proceeding has been initiated. This puts in place a mechanism to provide assurance to the regulator if they have concerns. Third, TEGE officials met with the Department of the Treasury and Office of Chief Counsel to discuss the Priority Guidance Plan for 2015-2016. According to IRS, this meeting included a discussion about flexibility afforded under the PPA and how state regulators can protect and use federal tax data consistent with statutory protections of taxpayer data. More recently, IRS informed us that they made additional changes to the MOU to address concerns raised by state charity officials about re-disclosures. IRS also reported on information-sharing efforts to publicize these changes among state charity regulators including a presentation at the annual National Association of State Charity Officials conference and a virtual presentation that reached over 100 participants representing 33 states. IRS informed state charity regulators that the MOU had been revised to address their concerns about re-disclosures in proceedings had been addressed in the MOU. The TEGE Liaison made a presentation at the Annual NASCO Conference in Washington DC on October 6, 2015 and included this information in the presentation.
    Director: Yvonne D. Jones
    Phone: (202) 512-2717

    1 open recommendations
    Recommendation: Any federal agency designated to investigate future USERRA claims against federal executive agencies should undertake efforts to increase the response rate of the customer satisfaction survey if it continues to be administered, so more tenable conclusions can be drawn from its data. Such efforts may include follow-up phone calls to nonrespondents, additional email notifications requesting participation in the survey, or making the survey easier to complete and submit.

    Agency: Department of Labor
    Status: Open

    Comments: In February 2016, Department of Labor Veterans Employment and Training Service (DOL/VETS) reported their office is handling all USERRA complaints, Federal and non-Federal following conclusion of the demonstration project with OSC. DOL/VETS reported the agency deployed its customer satisfaction survey in May 2016 and will be monitoring and collecting responses on a quarterly basis. The agency plans to employ the same follow-up technique used during the demonstration project and will determine if additional follow-up emails are warranted.
    Director: J. Christopher Mihm
    Phone: (202) 512-6806

    4 open recommendations
    Recommendation: Recognizing that moving toward a more customer-oriented culture within federal agencies is likely to be a continuous effort, the Secretary of Agriculture should direct the Under Secretary for Natural Resources and Environment, to improve Forest Service's customer service standards and feedback review, to: (1) ensure standards include performance targets or goals, (2) ensure standards include performance measures, (3) ensure standards are easily publicly available, (4) develop a feedback mechanism to collect comments agency-wide, which should include guidance or criteria to elevate customer feedback from local and regional offices to identify the need for and to make service improvements.

    Agency: Department of Agriculture
    Status: Open

    Comments: In August 2017, Forest Service provided an update for completing the tasks necessary to respond to our recommendations. In accordance with our recommendations, for each of its customer service standards, the Forest Service has developed goals, targets and measures and we consider this part of the recommendation closed. Forest Service stated the remaining part of the recommendation will be implemented by December 2018. Specifically, the Forest Service stated by December 2018 it will begin to make standards easily publicly available on its public-facing websites. The Forest Service provided the criteria for elevating customer comments and by December 2018 stated it will begin to deploy and collect feedback forms. We will close this recommendation as implemented when standards are publicly available and customer feedback forms are deployed.
    Recommendation: Recognizing that moving toward a more customer-oriented culture within federal agencies is likely to be a continuous effort, the Secretary of Education should direct Federal Student Aid's Chief Operating Officer, to improve Federal Student Aid's customer service standards and feedback review, to: (1) ensure standards are easily publicly available, (2) develop a feedback mechanism that includes guidance or criteria for service providers to elevate customer feedback to identify the need for and to make service improvements.

    Agency: Department of Education
    Status: Open

    Comments: We emailed Department of Education in June 2017 for an update on the status of this recommendation. Once a response is received we will update this recommendation.
    Recommendation: Recognizing that moving toward a more customer-oriented culture within federal agencies is likely to be a continuous effort, the Commissioner of U.S. Customs and Border Protection should, to improve CBP's customer service standards: (1) ensure standards include performance targets or goals, (2) ensure standards include performance measures.

    Agency: Department of Homeland Security: United States Customs and Border Protection
    Status: Open

    Comments: In January 2017, CBP sent an email stating that the agency has done all it can to fully implement the recommendation at this time. Because CBP does not have performance goals or targets for customer service standards this recommendation remains open. In April 2016, CBP provided us with customer service survey questions they use to collect data. Based on our review of that information, we were unable to confirm CBP had established performance targets and goals for the data being collected. As we stated in the report, performance goals should be in a quantifiable and measurable form to define the level of performance to be achieved for program activities each year. Although CBP is collecting new customer service data based on survey responses, without predetermined performance targets that align with a customer service standard it is not clear what or if internal targets or customer needs are being met. In June 2017, we emailed CBP for an update on the status of this recommendation. Once a response is received we will update this recommendation.
    Recommendation: Recognizing that moving toward a more customer-oriented culture within federal agencies is likely to be a continuous effort, the Secretary of the Interior should direct the Assistant Secretary of Fish, Wildlife and Parks, to improve the National Park Service's customer service standards and feedback review, to: (1) ensure standards include performance targets or goals, (2) ensure standards include performance measures, (3) ensure standards are easily publicly available, (4) develop a feedback mechanism that includes guidance or criteria to review and elevate customer feedback from local and regional offices to identify the need for and to make service improvements.

    Agency: Department of the Interior
    Status: Open

    Comments: According to NPS officials, NPS plans on defining a strategy that describes the intended customer experience for highest customer interactions such as Volunteer in Parks program and Teacher engagement program. NPS will align the strategy with overall organizational strategy, share the strategy with all employees (e.g., documentation, training), and update strategy plans to include performance targets and goals for customer service. NPS also plans on soliciting feedback from customers about their experiences with the VIP and Teacher Outreach Programs, collecting unsolicited feedback from customers about their experiences with the organization (e.g., by mining calls, emails, or social media posts), and gathering input from employees about their experiences with customers and their role in delivering the customer experience. NPS plans to share customer experience metrics and models with all employees (e.g., distribute reports and dashboards, conduct training sessions), publish customer service standards on website so that customers know what to expect, and publish customer service data to ensure actual service levels are transparent. Finally NPS plans on piloting the "Federal Feedback" Button and evaluate for expanded use in fiscal year 2018. In June 2017, we emailed NPS for an update on this recommendation. Once a response is received we will update this recommendation.
    Director: Linda T. Kohn
    Phone: (202) 512-7114

    4 open recommendations
    Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to include in the CMS Compare websites, to the extent feasible, estimated out-of-pocket costs for Medicare beneficiaries for common treatments that can be planned in advance.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: As of July 2015 CMS indicated that it is working to implement this recommendation. Specifically, it is actively investigating options for allowing a more targeted and consumer-centric individual user experience on Physician Compare. We will follow up to gather additional information from CMS officials as they continue their work.
    Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to organize cost and quality information in the CMS Compare websites to facilitate consumer identification of the highest-performing providers, such as by listing providers in order based on their performance.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: As of July 2015, CMS indicated that it is working to implement this recommendation. We will follow up to gather additional information from CMS officials as they continue their work.
    Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to include in the CMS Compare websites the capability for consumers to customize the information presented, to better focus on information relevant to them.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: As of July 2015, CMS indicated that it is working to implement this recommendation. Specifically, it is evaluating feasibility of including estimated out-of-pocket costs on physician compare. We will follow up to gather additional information from CMS officials as they continue their work.
    Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to develop specific procedures and performance metrics to ensure that CMS's efforts to promote the development and use of its own and others' transparency tools adequately address the needs of consumers.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: As of July 2015, CMS indicated that it is working to implement this recommendation. CMS also noted that Physician Compare is in the early stages of public reporting, and is evaluating the feasibility of listing providers based on their performance in the new carefinder.gov project. We will follow up to gather additional information from CMS officials as they continue their work.
    Director: John Neumann
    Phone: (202) 512-3841

    4 open recommendations
    Recommendation: To more effectively fulfill its expanded role in providing a clearinghouse of information on available federal technology transfer opportunities, the Chair of FLC, in coordination with the other members of the Executive Board, should work collaboratively with agency and lab members to take steps to better communicate with potential customers during the design and implementation of FLC's clearinghouse initiatives, including conducting customer needs assessments, conducting customer testing of current and future web-based initiatives, and collecting customer feedback on all FLC initiatives to make the initiatives more useful.

    Agency: Federal Laboratory Consortium for Technology Transfer
    Status: Open

    Comments: FLC has provided GAO with information on steps they are taking to address the recommendations in GAO-15-127. A number of these actions should be completed towards the end of 2016 after which we plan to request additional information from FLC.
    Recommendation: To more effectively fulfill its expanded role in providing a clearinghouse of information on available federal technology transfer opportunities, the Chair of FLC, in coordination with the other members of the Executive Board, once feedback is collected from potential customers, should work collaboratively with agency and lab members to use this feedback to improve FLC's initiatives to make them more useful to potential customers, including asking FLC members for additional or different information, as appropriate.

    Agency: Federal Laboratory Consortium for Technology Transfer
    Status: Open

    Comments: FLC has provided GAO with information on steps they are taking to address the recommendations in GAO-15-127. A number of these actions should be completed towards the end of 2016 after which we plan to request additional information from FLC.
    Recommendation: To more effectively fulfill its expanded role in providing a clearinghouse of information on available federal technology transfer opportunities, the Chair of FLC, in coordination with the other members of the Executive Board, should work collaboratively with agency and lab members to develop performance goals and measures for FLC's clearinghouse initiatives and use the results to evaluate progress toward meeting FLC's goals on outreach and networking.

    Agency: Federal Laboratory Consortium for Technology Transfer
    Status: Open

    Comments: FLC has provided GAO with information on steps they are taking to address the recommendations in GAO-15-127. A number of these actions should be completed towards the end of 2016 after which we plan to request additional information from FLC.
    Recommendation: To more effectively fulfill its expanded role in providing a clearinghouse of information on available federal technology transfer opportunities, the Chair of FLC, in coordination with the other members of the Executive Board, should report on FLC's progress in these efforts in its annual report to the President and Congress.

    Agency: Federal Laboratory Consortium for Technology Transfer
    Status: Open

    Comments: FLC has provided GAO with information on steps they are taking to address the recommendations in GAO-15-127. A number of these actions should be completed towards the end of 2016 after which we plan to request additional information from FLC.
    Director: J. Alfredo Gómez
    Phone: (202) 512-3841

    1 open recommendations
    Recommendation: To help ensure that FSIS efforts protect human health by reducing Salmonella and Campylobacter contamination in FSIS-regulated poultry products, in future revisions of the compliance guidelines on controlling Salmonella and Campylobacter, the Secretary of Agriculture should direct the Administrator of FSIS to ensure the inclusion of information on the effectiveness of each recommended farm practice to reduce these pathogens in live poultry.

    Agency: Department of Agriculture
    Status: Open

    Comments: In December 2015, USDA's Food Safety and Inspection Service released the draft revised compliance guideline to assist poultry establishments in controlling Salmonella and Campylobacter in raw poultry. The draft guideline included information on the effectiveness of each recommended farm practice to reduce Salmonella and Campylobacter in live poultry. FSIS announced the availability of and requested comment on the revised compliance guideline in a December 2015 Federal Register Notice. FSIS officials told us that they anticipate finalizing the draft guideline in fiscal year 2017 and the guideline states that while the document is draft, establishments are encouraged to incorporate information in the guideline in their decision-making process. As of April 2017, FSIS had not finalized the guideline.
    Director: John Neumann
    Phone: (202) 512-3841

    4 open recommendations
    Recommendation: To better promote agency accountability, the Secretary of Agriculture should direct the Climate Change Program Office and the Office of Budget and Program Analysis to work with relevant USDA agencies to develop performance measures that better reflect the breadth of USDA's climate change efforts.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of February 2017, we continue to await agency action.
    Recommendation: To better promote agency accountability, the Secretary of Agriculture should direct the Climate Change Program Office and the Office of Budget and Program Analysis to ensure that the department's annual performance plans explain how agency actions will lead to the accomplishment of performance goals in the area of climate change.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of February 2017, we continue to await agency action
    Recommendation: To better promote agency accountability, the Secretary of Agriculture should direct the Climate Change Program Office and the Office of Budget and Program Analysis to use annual performance reports to provide information on the status of agency efforts toward meeting its performance measures in the area of climate change.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of February 2017, we continue to await agency action.
    Recommendation: To provide relevant information to farmers, the Secretary of Agriculture should direct the Climate Change Program Office to work with relevant USDA agencies to develop and provide readily accessible information to farmers on the farm-level economic costs and returns of taking certain actions in response to climate change.

    Agency: Department of Agriculture
    Status: Open

    Comments: As of February 2017, we continue to await agency action.
    Director: Maurer, Diana C
    Phone: (202) 512-9627

    2 open recommendations
    Recommendation: To ensure effective evaluation of federal training programs and enhance DHS's stewardship of resources for federal training programs, the Secretary of Homeland Security should direct DHS components to ensure that their documented training evaluation processes fully address attributes for effective training evaluation processes as they are drafted, updated, or revised.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In September 2014, we reported on the Department of Homeland Security's (DHS) training efforts, including the extent to which DHS has a documented process to evaluate training and development programs. We found that all five DHS components in GAO's review--U.S. Customs and Border Protection, U.S. Immigration and Customs Enforcement, the U.S. Coast Guard, the Transportation Security Administration, and the Federal Law Enforcement Training Center--have a documented process to evaluate their training programs. Their documented processes fully included three of six attributes of effective training evaluation processes identifying goals, programs to evaluate, and how results are to be used. However, the documented processes did not consistently include the other three attributes: methodology, timeframes, and roles and responsibilities. We concluded that by updating documentation to address these attributes, DHS components would have more complete information to guide its efforts in conducting effective evaluations. We therefore recommended that DHS direct its components to ensure that their documented training evaluation processes fully address attributes for effective training evaluation processes as they are drafted, updated, or revised. In September 2016, DHS officials reported that a DHS-wide self-audit of training evaluation processes was completed on March 31, 2016 and found that DHS has current documentation addressing effective learning evaluation programs and that there are commonalities in evaluation procedures across the components. As a part of the self-audit, components provided policy and procedures documents related to their training evaluation processes and found that they adhere to sound instructional systems design models. However, the self-audit focused on identifying the specific training evaluation practices for a sample of courses at each component and not whether the component-level guidance included the attributes for effective training evaluation processes we identified in our report. Further, although DHS updated its department-wide guidance on training evaluation in April 2016 to incorporate the attributes for effective training evaluation processes and some components have followed suit, other components have not. For example, we found that some components, such as Customs and Border Protection and the U.S. Coast Guard, had updated their training evaluation guidance to include the attributes we identified in our report. Others, such as U.S. Immigration and Customs Enforcement were in the process of updating their guidance. However, as of April 2017, the guidance from the Transportation Security Administration remained in draft and the guidance from the Federal Law Enforcement Training Center had not been updated since our review. Therefore, this recommendation remains open pending action on the above noted items.
    Recommendation: To ensure effective evaluation of federal training programs and enhance DHS's stewardship of resources for federal training programs, the Secretary of Homeland Security should identify existing challenges that prevent DHS from accurately capturing training costs department-wide and, to the extent that the benefits of addressing those challenges exceed the costs, implement corrective measures to overcome these challenges..

    Agency: Department of Homeland Security
    Status: Open

    Comments: In September 2014, we reported on the Department of Homeland Security's (DHS) training efforts, including the extent to which DHS has a documented process to reliably capture costs. We found that DHS identified efficiencies and cost savings for delivering a number of training programs. However, different methods are used for capturing training costs across the department, which poses challenges for reliably capturing these costs across DHS. Components capture training costs differently, contributing to inconsistencies in training costs captured across DHS. Variation in methods used to collect data can affect the reliability and quality of DHS-wide training program costs. However, DHS has not identified all challenges that contribute to these inconsistencies. We concluded that DHS could improve its awareness about the costs of training programs DHS-wide and thereby enhance its resource stewardship by identifying existing challenges that prevent DHS from accurately capturing training costs and implementing corrective measures. We therefore recommended that DHS identify existing challenges that prevent DHS from accurately capturing training costs department-wide and, to the extent that the benefits of addressing those challenges exceed the costs, implement corrective measures to overcome these challenges. As of September 2016, DHS reported that its Office of the Chief Human Capital Officer and Office of the Chief Financial Officer worked together to research the issue and determine the best course of action to standardize training cost reporting. However, this did not require a formal root cause analysis. In order to identify a way for the components to capture training costs in a standardized manner, DHS formed a Tiger Team that included officials from each component which identified 12 common functional areas for training to capture training costs. Components were directed to prepare implementation plans outlining how they will begin capturing cost data within the identified functional training areas and, according to DHS, began capturing the data on September 29, 2016. In January 2017, the DHS Chief Financial Officer provided guidance to the components as to how they are to report their training costs to DHS on a quarterly basis. Components provided their first quarterly submission to DHS in January 2017. These steps are in line with the intent of our recommendation. This recommendation will remain open as we monitor its continued implementation over the next two quarters.
    Director: Jennifer A. Grover
    Phone: (202) 512-7141

    1 open recommendations
    Recommendation: To assess the progress of the Secure Flight program toward achieving its goals, the Transportation Security Administration's Administrator should develop additional measures to address key performance aspects related to each program goal, and ensure these measures clearly identify the activities necessary to achieve progress toward the goal.

    Agency: Department of Homeland Security: Transportation Security Administration
    Status: Open

    Comments: When we confirm what actions that DHS TSA has taken in response to this recommendation, we will provide updated information. Status last confirmed on 10/26/15.
    Director: Jacqueline M. Nowicki
    Phone: (617) 788-0580

    2 open recommendations
    Recommendation: Based on GAO's review, the Secretary of Education should direct the Office of Special Education Programs to increase transparency regarding the timeliness of due process hearing decisions for Congress and better target its monitoring and technical assistance to states, revise its performance measure to collect information from states on the amount of time that extensions add to due process hearing decisions.

    Agency: Department of Education
    Status: Open

    Comments: : In April 2017, Education reported that it had developed and implemented a plan to monitor states with 10 or more fully adjudicated hearings in a given year where at least 75 percent of the decisions are issued with extended timelines. Specifically, the agency reported it was actively monitoring 6 states meeting these criteria. It would also provide technical assistance to states, as appropriate, to facilitate more timely resolution of due process disputes. Education also reported that it would gather information on the burden and cost of revising its performance measure, however, as of June 2017, it had not provided documentation that it had done so. While these are positive steps, we will consider closing this recommendation when Education's revises its performance measure on the timeliness of due process hearing decisions.
    Recommendation: Based on GAO's review, the Secretary of Education should direct the Office of Special Education Programs to assist its oversight of dispute resolution, take steps to improve the comparability of parental involvement data while minimizing the burden to states, and use the data for better management decision making. Steps to consider could include establishing and requiring that states follow standard data collection and analysis procedures.

    Agency: Department of Education
    Status: Open

    Comments: In FY15, Education reported that the IDEA Data Center, in relation to the parent involvement portion of the audit, has continued review of APR [need to spell out] indicator B8 to collect information related to data collection methods, results, and improvement activities for the indicator summary for OSEP. It also began reviewing existing sources for information on how parent data are collected and best practices/ exemplars that are publicly available. In April 2017, Education reported it would direct Parent Technical Assistance Centers and other Education-funded centers to work together to develop and disseminate materials to assist states in analyzing and using parental involvement data to improve the provision of special education services. We believe this effort could help individual states improve methods for analyzing and using parental involvement data. However, we await documentation that such materials were developed and distributed. Also, it is unclear how it would improve the comparability of parental involvement data across states and allow Education to accurately assess states' performance on this IDEA indicator.
    Director: Mark Goldstein
    Phone: (202) 512-2834

    1 open recommendations
    Recommendation: The Secretary of Agriculture should align performance goals under the "enhance rural prosperity" strategic objective in the APR to the broadband loan program's purpose, to the extent feasible.

    Agency: Department of Agriculture
    Status: Open

    Comments: USDA's Fiscal Year 2017 Budget Summary and Annual Performance Plan includes a key performance measure for the number of borrowers/subscribers receiving new or improved telecommunication services. This measure will track the number of subscribers proposed to receive broadband service. However, this method does not measure actual adoption of RUS-financed broadband service. Further, the plan does not include goals or measures to determine the program's progress towards economic development in rural areas.
    Director: Andrew Sherrill
    Phone: (202) 512-7215

    2 open recommendations
    Recommendation: To better ensure servicemember participation in and completion of TAP, the Secretary of Defense should direct the Under Secretary for Personnel and Readiness to require that all services provide unit commanders and their leaders information on TAP participation levels of servicemembers under their command, similar to that provided by the Army and Air Force. Such information could be used to help hold leaders accountable for ensuring TAP participation and completion.

    Agency: Department of Defense
    Status: Open

    Comments: DOD disagreed with this recommendation and, as of January 2016, has not taken action to address it. In its written comments published in GAO's 2014 report, DOD questioned GAO's concern that not having a mechanism to ensure a servicemember's completion of TAP by commander would result in commanders not supporting the release of servicemembers to attend TAP. DOD noted that GAO's concern is based on observations that preceded full implementation of the capstone event. In October 2013, DOD launched the capstone as a mandatory process by which commanders verify TAP participation and positively affirm that servicemembers have or have not met career readiness standards. In addition, DOD said that capstone event implementation was accompanied by a communications campaign to inform both commanders and the services. Finally, DOD said that capstone event completion is monitored departmentwide to ensure compliance. However, GAO believes that such monitoring does not provide routine information to commanders and their leaders and not all TAP locations will be monitored routinely. GAO's report noted that DOD reported that ensuring servicemember participation in capstone events was a challenge for most of the services possibly due, in part, to lack of commanders' support. Commander support for the program has been a long-standing challenge for the program. Therefore, we continue to believe that an accountability mechanism is needed for TAP that mirrors the level at which responsibility has been assigned. Since commanders are responsible for ensuring that eligible servicemembers have full access to and successfully complete required TAP components, providing them and their leaders information on TAP participation levels of servicemembers under their command could promote accountability and oversight. Servicemember participation in TAP is generally required by law and DOD policy, and also relates to a Cross-Agency Priority Goal, reinforcing the need for such a mechanism. For GAO to close this recommendation, DOD should require all services to provide unit commanders and their leaders information on TAP participation levels of servicemembers under their command.
    Recommendation: To provide information on the extent to which the revamped TAP is effective, the Secretary of Defense should direct the Under Secretary for Personnel and Readiness to work with the partner agencies to develop a written strategy for determining which components and tracks to evaluate and the most appropriate evaluation methods. This strategy should include a plan to use the results of evaluations to modify or redesign the program, as appropriate.

    Agency: Department of Defense
    Status: Open

    Comments: DOD has partially addressed GAO's recommendation on evaluating the effectiveness of the revamped TAP, information that is currently limited. DOD's May 2014 presentation to OMB on the status of TAP implementation and evaluation efforts lists specific TAP components and tracks in which VA, DOL, and SBA planned to assess TAP effectiveness or post-transition outcomes. Although the presentation to OMB indicated that VA planned a higher level evaluation, as of December 2015, VA officials said they are focusing on lower level evaluations, such as gauging participant reactions to training and monitoring. As of March 2016, DOL has been conducting a quasi-experimental evaluation of the Employment Workshop, which it expects to complete in 2017. Further, SBA officials said they are surveying Entrepreneurial track participants who agreed to a post-TAP, follow-up survey. However, DOD and the agencies have not fully demonstrated a strategic approach to planning higher level evaluations. Specifically, DOD and its partner agencies have not provided a rationale for why they chose to evaluate certain aspects of TAP and not others. A written rationale, along with how the agencies plan to use the results of the evaluations, is required for GAO to consider this recommendation closed.
    Director: Shear, William B
    Phone: (202) 512-8678

    4 open recommendations
    Recommendation: To help ensure that agencies are tracking the effect of strategic sourcing on small businesses, OMB's Administrator for Federal Procurement Policys should monitor agencies' compliance with the requirement to maintain baseline data and performance measures on small business participation in strategic sourcing initiatives.

    Agency: Executive Office of the President: Office of Management and Budget: Office of Federal Procurement Policy
    Status: Open

    Comments: OMB officials have stated that they are in the process of addressing this recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: Consistent with OMB guidance and to track the effect of strategic sourcing on small businesses, the Secretaries of DOD, DHS, HUD, and the Interior, and the Administrator of NASA should collect baseline data and establish performance measures on the inclusion of small businesses in strategic sourcing initiatives.

    Agency: Department of Defense
    Status: Open

    Comments: DOD officials have stated that they are in the process of addressing this recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: Consistent with OMB guidance and to track the effect of strategic sourcing on small businesses, the Secretaries of DOD, DHS, HUD, and the Interior, and the Administrator of NASA should collect baseline data and establish performance measures on the inclusion of small businesses in strategic sourcing initiatives.

    Agency: Department of the Interior
    Status: Open

    Comments: Interior officials have stated that they are in the process of addressing this recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Recommendation: Consistent with OMB guidance and to track the effect of strategic sourcing on small businesses, the Secretaries of DOD, DHS, HUD, and the Interior, and the Administrator of NASA should collect baseline data and establish performance measures on the inclusion of small businesses in strategic sourcing initiatives.

    Agency: National Aeronautics and Space Administration
    Status: Open

    Comments: NASA officials provided an update in March 2017. They stated that they consider the inclusion of small businesses and small disadvantaged businesses throughout the strategic sourcing process and that they track performance on their small business goals at the agency and buying office level. However, they stated they had no plans to track baseline data and performance measures on small business inclusion for individual strategic sourcing efforts or strategic sourcing efforts grouped by categories because they did not see the benefit of doing so. As we stated in our report, OMB memorandums require baseline data and a measure of the change in small business spending for each individual initiative. Therefore, we continue to believe this recommendation has merit and should be fully implemented.
    Director: Kohn, Linda T
    Phone: (202) 512-7114

    5 open recommendations
    Recommendation: To help ensure that qualified CDRs promote improved quality and efficiency of physician care for Medicare beneficiaries, the Secretary of Health and Human Services should direct Centers for Medicare & Medicaid Services (CMS) to establish key requirements for qualified CDRs that focus on improving quality and efficiency. These requirements could include, for example, having CDRs (1) identify key areas of opportunity to improve quality and efficiency for their target populations and collect additional measures designed to address them, (2) collect a core set of measures established by CMS, and (3) demonstrate that their processes for auditing the accuracy and completeness of the data they collect are systematic and rigorous.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: As it has since initiation of the qualified CDR program, CMS continues to allow qualified CDRs to choose what quality measures they will track within very broad parameters. While it has developed a PQRS cross-cutting measure set requirement for physicians using other reporting mechanisms, this requirement does not apply to qualified CDRs. CMS officials report that they have addressed data accuracy and completeness by sharing with qualified CDRs issues and discrepancies that have been found in the data submitted so far.
    Recommendation: To help ensure that qualified CDRs promote improved quality and efficiency of physician care for Medicare beneficiaries, the Secretary of Health and Human Services should direct CMS to establish a requirement for qualified CDRs to demonstrate improvement on key measures of quality and efficiency for their target populations.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: CMS officials report that they are working to implement this recommendation, but they have not yet put forward any specific proposals to address it.
    Recommendation: To help ensure that qualified CDRs promote improved quality and efficiency of physician care for Medicare beneficiaries, the Secretary of Health and Human Services should direct CMS to establish a process for monitoring compliance with requirements for qualified CDRs that draws on relevant expert judgment. This process should assess CDR performance on each requirement in a way that takes into account the varying circumstances of CDRs and their available opportunities to promote quality and efficiency improvement for their target populations.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: The limited changes for qualified clinical data registries that CMS outlined in its CY2016 proposed rule in July 2015 do not address this recommendation. CMS officials report that they are working to implement this recommendation, but the approach they describe focuses on assessing changes in the data submitted by qualified CDRs over several years.
    Recommendation: To help ensure that qualified CDRs promote improved quality and efficiency of physician care for Medicare beneficiaries, the Secretary of Health and Human Services should determine and implement actions to reduce barriers to the development of qualified CDRs, such as (1) developing guidance that clarifies Health Insurance Portability and Accountability Act requirements to promote participation in qualified CDRs; (2) working with private sector entities to make relevant multipayer cost data available to qualified CDRs; (3) testing one or more models of shared savings between Medicare and qualified CDRs that achieve reduced Medicare expenditures with improved quality of care, and (4) providing technical assistance to qualified CDRs.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: The limited changes for qualified clinical data registries that CMS outlined in its CY2016 proposed rule in July 2015 do not address the specific barriers to the development of qualified CDRs that we identified in our report. However, CMS officials report that they have provided technical assistance to qualified CDRs through monthly support calls and an annual kick-off meeting held in spring 2015.
    Recommendation: To help ensure that qualified CDRs promote improved quality and efficiency of physician care for Medicare beneficiaries, the Secretary of Health and Human Services should determine key data elements needed by qualified CDRs--such as those relevant for a required core set of measures--and direct Office of the National Coordinator for Health Information Technology and CMS to include these data elements, if feasible, in the requirements for certification of EHRs under the EHR incentive programs.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: The limited changes for qualified clinical data registries that CMS outlined in its CY2016 proposed rule in July 2015 do not address this recommendation.
    Director: Goldenkoff, Robert N
    Phone: (202) 512-2757

    4 open recommendations
    including 3 priority recommendations
    Recommendation: To help maintain a more thorough and insightful 2020 Census development schedule in order to better manage risks to a successful 2020 Census, the Secretary of Commerce and Undersecretary of Economic Affairs should direct the U.S. Census Bureau to improve the comprehensiveness of schedules, including ensuring that all relevant activities are included in the schedule.

    Agency: Department of Commerce
    Status: Open
    Priority recommendation

    Comments: The Bureau agreed with this recommendation and stated that it is reviewing and refining project schedules to ensure that they include the full scope of work needed to reach operational decision points for the 2020 Census. The 2020 Research and Planning Office currently has 55 decennial project schedules, consisting of more than 3,700 activities. Several project schedules were re-baselined and pushed into production in January 2014. Focused integration sessions occurred in late January and February 2014, resulting in revised schedules. The Bureau released its operational plan and other documentation in November 2015, and announced in June 2016 that it would finalize and release its 2020 Census schedule in July 2016. To fully implement this recommendation, the Bureau needs to include within its integrated master activity schedule at lower levels the activities and milestones it has already identified as needed throughout the 2020 Census lifecycle. We are beginning an audit of the Bureau's scheduling practices this summer and will review actions the Bureau may have taken to address this recommendation.
    Recommendation: To help maintain a more thorough and insightful 2020 Census development schedule in order to better manage risks to a successful 2020 Census, the Secretary of Commerce and Undersecretary of Economic Affairs should direct the U.S. Census Bureau to improve the construction of schedules, including ensuring complete logic is in place to identify the preceding and subsequent activities as well as a critical path that can be used to make decisions.

    Agency: Department of Commerce
    Status: Open
    Priority recommendation

    Comments: The Bureau agreed with this recommendation and stated that it has already begun maturing project schedules to ensure that the logical relationships between discrete schedules are put into place. Schedule integration sessions across projects and programs were held in late January 2014 and into February 2014 and periodically since then, where work is deconstructed into detailed schedules. As the Bureau continues to mature its schedule and scheduling process for the 2020 Census and related tests, its officials say they are taking care to ensure that logical linkages are in place within the schedule and that they are adding additional activities on a rolling basis. Bureau officials believe this ongoing work with the 2020 schedule will ensure they have a robust tool to help manage the 2020 program and make key decisions. The Bureau released its operational plan and other documentation in November 2015 and announced in June 2016 that it would finalize and release its 2020 Census schedule in July 2016. To fully implement this recommendation, the Bureau needs to ensure linkage between activities and the estimated resources needed to complete them. We are beginning an audit of the Bureau's scheduling practices this summer and will review actions the Bureau may have taken to address this recommendation.
    Recommendation: To help maintain a more thorough and insightful 2020 Census development schedule in order to better manage risks to a successful 2020 Census, the Secretary of Commerce and Undersecretary of Economic Affairs should direct the U.S. Census Bureau to improve the credibility of schedules, including conducting a quantitative risk assessment.

    Agency: Department of Commerce
    Status: Open
    Priority recommendation

    Comments: The Bureau agreed with this recommendation and stated that it has already begun maturing project schedules to ensure that the logical relationships between discrete schedules are put into place. Schedule integration sessions across projects and programs were held in late January 2014 and into February 2014 and periodically since then, where work is deconstructed into detailed schedules. As the Bureau continues to mature its schedule and scheduling process for the 2020 Census and related tests, its officials say they are taking care to ensure that logical linkages are in place within the schedule and that they are adding additional activities on a rolling basis. Bureau officials believe this ongoing work with the 2020 schedule will ensure they have a robust tool to help manage the 2020 program and make key decisions. The Bureau released its operational plan and other documentation in November 2015 and announced in June 2016 that it would finalize and release its 2020 Census schedule in July 2016. As part of the maturation process, the Bureau expects to conduct a quantitative risk assessment of decennial project schedules. In 2015, the Bureau provided us with a preliminary output from its risk analysis software as a demonstration of the type of analysis it is committed to, but more recently its officials said that they may not be able to take all the steps needed to satisfy this recommendation. To fully implement this recommendation, the Bureau needs to conduct quantitative schedule risk analyses with the resulting schedule. We are beginning an audit of the Bureau's scheduling practices this summer and will review actions the Bureau may have taken to address this recommendation.
    Recommendation: The Director of the U.S. Census Bureau should initiate a robust workforce planning process for those working on schedules related to the Master Address File, including actions such as an analysis of skills needed, to identify and address gaps in scheduling skills.

    Agency: Department of Commerce: Bureau of the Census
    Status: Open

    Comments: The Census Bureau agreed with this recommendation and states it is taking steps to improve its scheduling practices and to initiate a comprehensive workforce planning process for those working on decennial project schedules. Bureau officials state they are currently evaluating the skills needed for scheduling support of the 2020 Census and will take the appropriate steps to acquire and develop the appropriate mix of skill sets, including but not limited to developing certified scheduling staff, hiring expert contractors to assist with periodic training, and scheduling standards implementation. They also state that the Bureau is committed to continuing to strengthen the schedule management plan, practices, and methods in place for the 2020 Census. The Bureau has experienced turnover in the leadership of the team responsible for 2020 scheduling, and, as of July 2017, Bureau officials have said they are working to collect artifacts that may demonstrate how this recommendation was addressed.
    Director: Farrell, Brenda S
    Phone: (202) 512-3604

    6 open recommendations
    Recommendation: To help ensure that OSD, the military services, and congressional decision makers have a comprehensive understanding of whether ROTC programs are achieving desired results in a cost-effective and efficient manner, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military services, to establish a systematic process to routinely evaluate ROTC program performance that includes establishing performance measures that are clearly defined and include cost components.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Recommendation: To help ensure that OSD, the military services, and congressional decision makers have a comprehensive understanding of whether ROTC programs are achieving desired results in a cost-effective and efficient manner, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military services, to establish a systematic process to routinely evaluate ROTC program performance that includes requiring routine evaluations of ROTC programs that measure progress against the strategic goals and objectives of ROTC programs.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Recommendation: To help ensure that OSD, the military services, and congressional decision makers have a comprehensive understanding of whether ROTC programs are achieving desired results in a cost-effective and efficient manner, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness, in conjunction with the Secretaries of the military services, to establish a systematic process to routinely evaluate ROTC program performance that includes using the performance information resulting from ROTC program evaluations to assess and document the need for the existing number of units,

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. The Services have reviewed and adjusted their current procedures and metrics to better measure and evaluate their ROTC programs prior to the projected DoDI publication date. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Recommendation: To help improve the oversight and accountability of the military services' ROTC programs, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to reexamine and clarify DOD Instruction 1215.08 to clearly delineate roles and responsibilities for oversight of ROTC programs.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Recommendation: To help improve the oversight and accountability of the military services' ROTC programs, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to coordinate with the military services to ensure that service ROTC guidance aligns with the updated DOD instruction.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. The Services have reviewed and adjusted their current procedures and metrics to better measure and evaluate their ROTC programs prior to the projected DoDI publication date. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Recommendation: To help improve the oversight and accountability of the military services' ROTC programs, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to develop and implement, in conjunction with the Secretaries of the military services, a strategy to periodically communicate with Congress and other key stakeholders on ROTC program performance.

    Agency: Department of Defense
    Status: Open

    Comments: As of April 2016, this recommendation is addressed in the current working draft of Department of Defense Instruction (DoDI) 1215.08, "Senior Reserves Officers' Training Corps (ROTC) Programs." A joint Services and DOD working group has finalized updates addressing this recommendation in the draft instruction, but DOD anticipates formal coordination will be delayed until after the 2017 change in the Presidential Administration. This recommendation will remain open until the DoDI addressing this recommendation has been finalized and published.
    Director: Grover, Jennifer A
    Phone: (202) 512-7141

    1 open recommendations
    including 1 priority recommendation
    Recommendation: To help ensure that security-related funding is directed to programs that have demonstrated their effectiveness, the Secretary of Homeland Security should direct the TSA Administrator to limit future funding support for the agency's behavior detection activities until TSA can provide scientifically validated evidence that demonstrates that behavioral indicators can be used to identify passengers who may pose a threat to aviation security.

    Agency: Department of Homeland Security
    Status: Open
    Priority recommendation

    Comments: The Department of Homeland Security (DHS) did not concur with GAO's November 2013 recommendation to the TSA Administrator to limit future funding support for the agency's behavior detection activities until TSA can provide scientifically validated evidence that demonstrates that behavioral indicators can be used to identify passengers who may pose a threat to aviation security. However, as of July 2017, DHS has reduced funding for its behavior detection activities and taken some steps toward identifying additional evidence to support its use of behavioral indicators. TSA officials stated that GAO's recommendation contributed to DHS's decision to reduce the number of behavior detection officers (BDO) from 3,131 full-time equivalents in fiscal year 2013 to 2,393 full-time equivalents employed in fiscal year 2016. Further, in the summer of 2016 and consistent with the Aviation Security Act of 2016, the agency began assigning BDOs to other positions at passenger screening checkpoints where they are able to observe passengers while performing screening duties. According to TSA officials, all BDOs have now been converted into transportation security officers with behavior detection capabilities, which is expected to reduce the cost of the agency's behavior detection activities. As of August 2017, TSA does not yet have an estimate of any associated cost reductions. Since GAO's 2013 report, TSA has revised its list of behavioral indicators and taken some steps to identify evidence that these indicators can be used to identify passengers who may pose a threat to aviation security. Specifically, TSA hired a contractor to search available literature for sources supporting its revised list of 36 behavioral indicators. However, in 2017, GAO reviewed all 178 sources TSA identified and found that 98 percent (175 of 178) did not provide valid evidence for specific behavioral indicators in its revised list and that the remaining 3 sources could be used as valid evidence to support 8 of the 36 indicators. GAO reported that TSA should continue to limit funding for the agency's behavior detection activities until TSA can provide valid evidence demonstrating that behavioral indicators can be used to identify passengers who may pose a threat to aviation security, consistent with the recommendation in its November 2013 report.
    Director: Farrell, Brenda S
    Phone: (202)512-3604

    2 open recommendations
    Recommendation: To provide decision makers with more-complete information on the planned implementation, management, and oversight of DOD's newly created DHA, the Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to develop and present to Congress a comprehensive timeline that includes interim milestones for all reform goals that could be used to show implementation progress.

    Agency: Department of Defense
    Status: Open

    Comments: As of September 2015, DOD has not submitted a comprehensive timeline that includes interim milestones for all reform goals. Further, as we reported in September 2015, DOD's plan for assessing the personnel requirements of the DHA lacks a detailed timeline with milestones and interim steps. Until DOD develops a comprehensive timeline for its reform, this recommendation should remain open. June 2017 Update: The DHA strategic plan/CONOPS showing a comprehensive timeline for all of its reform goals has yet to be released.
    Recommendation: To provide decision makers with more-complete information on the planned implementation, management, and oversight of DOD's newly created DHA, the Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to monitor implementation costs to assess whether the shared-services projects are on track to achieve projected net cost savings or if corrective actions are needed.

    Agency: Department of Defense
    Status: Open

    Comments: As we reported in September 2015, DOD has taken some action on this recommendation for 8 of its 10 shared services. The DHA's internal leadership briefings now identify the major types of implementation costs where relevant, or otherwise address their potential impact. For example, information technology costs are identified as one primary type of costs for the Health Information Technology and Medial Logistics shared services, while contract costs are identified for the Budget and Resource Management, Medical Logistics, and Health Information Technology shared services. By identifying the major types of implementation costs, decision makers are better able to gauge the sensitivity of areas of uncertainty as they make decisions concerning future investments in shared services. MAY 2016 UPDATE: DHA reported and we verified financial savings of $722 million for FY14 and FY15 due to shared services implementation. June 2017 Update: DHA reported and we verified financial savings of $686.6 million for FY 16 due to shared services implementation.
    Director: Trimble, David C
    Phone: (202) 512-3841

    3 open recommendations
    Recommendation: To improve DOE's management and oversight of the WFO program, the Secretary of Energy should require laboratories to establish and follow written procedures for developing WFO project budgets and for charging costs to WFO projects.

    Agency: Department of Energy
    Status: Open

    Comments: According to DOE, the Chief Financial Officer will address this recommendation as part of the revisions to DOE Order 520.1A. As of March 2017, DOE anticipates that the updated order will be completed in the first quarter of fiscal year 2018.
    Recommendation: To improve DOE's management and oversight of the WFO program, the Secretary of Energy should ensure that annual summary reports of WFO activities are prepared so that data on those activities are readily available for those who need this information.

    Agency: Department of Energy
    Status: Open

    Comments: On December 5, 2016, DOE issued revised order 481.1D, Strategic Partnership Projects (SPP) [Formerly Known as Work for Others (Non-Department of Energy Funded Work)] and has removed the requirement to issue annual summary reports of Work for Others activities. Instead, the revised order states that reports can be prepared on an "as needed" basis.
    Recommendation: To improve DOE's management and oversight of the WFO program, the Secretary of Energy should establish performance measures that incorporate key attributes of successful performance measures and that address the objectives of the WFO program.

    Agency: Department of Energy
    Status: Open

    Comments: On December 5, 2016, DOE issued revised order 481.1D Strategic Partnership Projects (SPP)[Formerly Known as Work for Others (Non-Department of Energy Funded Work)]. DOE states that this order addresses performance measures and that the corrective action is closed. Although the order directs DOE Field Office Managers to "establish performance measures to assess the effectiveness of the procedures for SPP review, acceptance, authorization and monitoring consistent with NNSA policies and procedures", it does not further identify specific performance measures that address the objectives of the SPP program as indicated in the order.
    Director: Rusco, Franklin W
    Phone: (202) 512-3841

    2 open recommendations
    Recommendation: The Secretary of the Interior should direct the Director of the Bureau of Land Management to take steps, including making changes to AFMSS, and in any new system that replaces AFMSS, to improve the ability of staff to identify wells that are a high priority for environmental inspection and to incorporate information on the inspection history of wells into the environmental inspection prioritization process.

    Agency: Department of the Interior
    Status: Open

    Comments: BLM concurred with the recommendation and has initiated action to update its Application for permit to drill (APD) permit processing system. This new system will be known as AFMSS II and, when fully implemented, may address GAO's recommendations. Currently, BLM's actions are insufficient to close this recommendation because they have not completed the updates to AFMISS. Specifically, BLM has not completed its update of AFMSS II to cover environmental inspections. We will continue to follow up with BLM as the agency continues to take action to improve its well tracking system. As of September 2017, BLM said it intends to update AFMSS II to cover environmental issues but has not yet done so.
    Recommendation: The Secretary of the Interior should direct the Director of the Bureau of Land Management to take steps to ensure that environmental violations or problems and enforcement actions are documented in a consistent manner.

    Agency: Department of the Interior
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: White, James R
    Phone: (202) 512-9110

    1 open recommendations
    Recommendation: To ensure that IRS is meeting the stated goals of CAP, the Principal Deputy Commissioner of Internal Revenue and Deputy Commissioner for Services and Enforcement should track savings from Compliance Maintenance and CAP overall and develop a plan for reinvesting any savings.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: As of March 2017, IRS had taken some steps to implement this recommendation, but is not fully tracking the amount of dollar savings from using CAP nor developing a plan to reinvest any savings, as GAO recommended in August 2013. IRS is tracking savings by analyzing and comparing the workload inventory of account coordinators who handle CAP cases against team coordinators who handle non-CAP cases. This caseload comparison is a part of IRS's annual CAP evaluation and was included in its June 2014 CAP evaluation plan. Based on GAO's review of the evaluation plan and results, IRS's caseload comparison did not show the amount of dollar savings from CAP. The comparison for tax years 2010 through 2012 showed that account coordinators handling CAP cases exclusively or in conjunction with non-CAP cases have a larger caseload than team coordinators handling non-CAP cases. In addition, IRS has not developed a plan for reinvesting any savings, as GAO recommended in August 2013. Such a plan could help IRS increase audit coverage. IRS stated that it cannot measure the CAP's impact on audit coverage because audit coverage is based on staffing and compliance priorities. Also, IRS said that while quantifying monetary savings would be difficult, it has reinvested its savings by expanding account coordinators' caseloads as shown in the average caseload of CAP and non-CAP cases worked. However, without a plan for tracking savings and using them to increase audit coverage, IRS cannot be assured that the savings are effectively invested in either CAP or non-CAP taxpayers with a high compliance risk. IRS is evaluating the CAP program to determine how it fits with IRS's future vision for examinations. It has no timetable for completing this evaluation. IRS did not accept new CAP applications for 2016, deciding that CAP would be limited to taxpayers who are in the program for 2017.
    Director: Gambler, Rebecca S
    Phone: (202) 512-8777

    3 open recommendations
    Recommendation: To improve the usefulness of southwest border crossing wait time data for informing public and management decisions, the Commissioner of CBP should identify and carry out steps that can be taken to help CBP port officials overcome challenges to consistent implementation of existing wait time estimation methodologies. Steps for ensuring consistent implementation of these methodologies could include, for example, implementing the fiscal year 2008 Western Hemisphere Travel Initiative report recommendations to use closed-circuit television cameras to measure wait time in real time and provide a standardized measurement and validation tool.

    Agency: Department of Homeland Security: United States Customs and Border Protection
    Status: Open

    Comments: As of May 2017, CBP officials report that in order to avoid further investment in a manual wait time methodology, the agency plans to focus resources on developing an enterprise-wide solution for automating the measurement of border delays. CBP estimates that this recommendation will be completed in October 2017.
    Recommendation: To improve the usefulness of southwest border crossing wait time data for informing public and management decisions, the Commissioner of CBP should, in consultation with Federal Highway Administration and state DOTs, assess the feasibility of replacing current methods of manually calculating wait times with automated methods, which could include assessing all of the associated costs and benefits, options for how the agency will use and publicly report the results of automated data collection, the potential trade-offs associated with moving to this new system, and other factors such as those influencing the possible expansion of existing automation efforts to the 34 other locations that currently report wait times but have no automation projects under way.

    Agency: Department of Homeland Security: United States Customs and Border Protection
    Status: Open

    Comments: As of May 2017, CBP's Office of Field Operations (OFO) reports working to identify a feasible and cost effective wait time solution to measure commercial vehicle delays along the southern border. Specifically, CBP officials report that they have been partnering with the Federal Highway Administration and the Texas A&M's Transportation Institute on the deployment of an automated radio-frequency identification measurement solution to measure commercial delays at eight crossings. To verify the accuracy of the automated wait time data, CBP officials report that in June 2016 they conducted a ground-truth analysis with mixed results. CBP officials report DHS Science and Technology directorate delivered their final report in February 2017 and by the end of September 2017, pending review and acceptance of the report's findings, CBP will coordinate efforts to develop the required communication protocols and data schematics for near real-time commercial vehicle wait time updates to the CBP Border Wait Time website and Border Wait Time app. CBP estimates that this recommendation will be completed in October 2017.
    Recommendation: To better ensure that CBP's Office of Field Operations' (OFO) staffing processes are transparent and to help ensure CBP can demonstrate that these resource decisions have effectively addressed CBP's mission needs, the Commissioner of CBP should document the methodology and process OFO uses to allocate staff to land ports of entry on the southwest border, including the rationales and factors considered in making these decisions.

    Agency: Department of Homeland Security: United States Customs and Border Protection
    Status: Open

    Comments: As of May 2017, CBP's Office of Field Operations (OFO) reports that they have adopted a workload staffing model to identify CBP staffing requirements at land ports of entry. CBP officials report that the workload staffing model provides senior leadership with a decision-support tool to identify the number of required resources for each location and accounts for distinct operating environments, unique variables, and major functions and activities. CBP officials report that they use the workload staffing model results in its budget requests and when allocating staff to the ports of entry. However, CBP has not provided GAO with documentation showing how staff are allocated among land ports of entry including how workload staffing model results are used in this process. CBP officials report that in May 2017 OFO began working with contracted experts to synthesize the quantitative and qualitative data available and develop a comprehensive CBP position allocation methodology. CBP estimates that this recommendation will be completed in March 2018.
    Director: Mihm, J Christopher
    Phone: (202) 512-6806

    1 open recommendations
    Recommendation: To improve implementation of GPRAMA and help address pressing governance issues, given the common, long-standing difficulties agencies continue to face in measuring the performance of various types of federal programs and activities--contracts, direct services, grants, regulations, research and development, and tax expenditures--the Director of OMB should work with the PIC to develop a detailed approach to examine these difficulties across agencies, including identifying and sharing any promising practices from agencies that have overcome difficulties in measuring the performance of these program types. This approach should include goals, planned actions, and deliverables along with specific time frames for their completion, as well as the identification of the parties responsible for each action and deliverable.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: In July 2017, Office of Management and Budget (OMB) staff told us that they have made no further progress on this recommendation since their last update in June 2016. At that time, according to information provided by staff from OMB and the Performance Improvement Council (PIC), they had taken some initial steps to address this recommendation in a few areas, such as acquisition management (contracts). In addition, the PIC formed a working group on performance measurement that, in part, is focusing on how to develop appropriate performance measures. However, OMB and the PIC have not yet developed a comprehensive and detailed approach to address these issues as envisioned in our report. We will continue to monitor progress.
    Director: Mihm, J Christopher
    Phone: (202) 512-6806

    2 open recommendations
    Recommendation: When such revisions are made, the Director of OMB should work with the Performance Improvement Council to test and implement these provisions.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: According to information provided by Office of Management and Budget (OMB) and Performance Improvement Council (PIC) staff in June 2015, although OMB revised its guidance as we recommended, it did not work with the PIC to test implementation of these provisions. Instead, they told us that both PIC and OMB staff ensure agencies are implementing these provisions of their guidance when reviewing agencies' agency priority goals (APG) quarterly update submissions. However, our analysis of agencies' APG updates in October 2016 found implementation of these provisions continues to be mixed. We will continue to monitor progress.
    Recommendation: In addition, as OMB works with agencies to enhance Performance.gov to include additional information about APGs, the Director of OMB should ensure that agencies adhere to OMB's guidance for website updates by providing a description of how input from congressional consultations was incorporated into each APG.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: In June 2015, OMB staff stated that they would focus agency attention on congressional consultations and publishing relevant input from those consultations during the development of the 2016-2017 agency priority goals (APG). OMB and agencies published information about the 2016-2017 APGs on Performance.gov in October 2015. However, our analysis of relevant sections of Performance.gov in October 2016 generally found that either agencies did not include information about congressional input or they had not updated Performance.gov to reflect the most recent round of stakeholder engagement. We will continue to monitor progress.
    Director: Powner, David A
    Phone: (202)512-9286

    3 open recommendations
    Recommendation: To improve the reliability of reported cost and schedule variance information for the seven major investments we reviewed, the Acting Commissioner of IRS should direct the Chief Technology Officer to improve the reliability of cost estimates by addressing the weaknesses we identified in this report so that each investment at least substantially meets each of the characteristics of a reliable cost estimate.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: We followed up on the status of IRS's actions to address this recommendation for the Customer Account Data Engine (CADE) 2, the Return Review Program (RRP), and IRS.gov, the three investments with significant planned expenditures for development in fiscal year 2017, according to data reported on the Federal IT dashboard (the remaining four investments in our 2013 review are primarily in operations and maintenance based on the same IT dashboard data). We selected CADE 2, RRP, and IRS.gov because they would benefit most from improvements to cost estimates given their life cycle stage. In the Summer of 2017, IRS provided documentation to demonstrate actions taken to address the weaknesses we had identified with the CADE 2, and RRP cost estimates. We are currently analyzing this information. For IRS.gov, IRS told us the investment had been in operations and maintenance for several years and was therefore not producing the cost documentation that is typically associated with development efforts. We requested documentation supporting this claim and as of September 2017 were waiting to receive it.
    Recommendation: To improve the reliability of reported cost and schedule variance information for the seven major investments we reviewed, the Acting Commissioner of IRS should direct the Chief Technology Officer to improve the extent to which schedules are well-constructed and controlled by addressing the weaknesses we identified in this report so that each investment at least substantially meets each of these characteristics.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: We followed up on the status of IRS's actions to address this recommendation for the Customer Account Data Engine (CADE) 2, the Return Review Program (RRP), and IRS.gov, the three investments with significant expenditures planned for development in fiscal year 2017, according to data reported on the Federal IT dashboard (the remaining four investments in our 2013 review are primarily in operations and maintenance based on the same IT dashboard data). We selected CADE 2, RRP, and IRS.gov because they would benefit most from improvements to schedule estimates given their life cycle stage. In the Summer of 2017, IRS provided documentation to demonstrate actions taken to address the weaknesses we had identified with the CADE 2, and RRP schedule estimates. We are currently analyzing this documentation. For IRS.gov, IRS told us the investment had been in operations and maintenance for several years and was therefore not producing the schedule estimates that are typically associated with development efforts. We requested documentation supporting this claim and as of September 2017 were waiting to receive it.
    Recommendation: To improve the reliability of reported cost and schedule variance information for the seven major investments we reviewed, the Acting Commissioner of IRS should direct the Chief Technology Officer to develop and implement guidance that specifies best practices--such as including evaluating critical path (for projected schedule), using earned value management data, evaluating the performance of completed work and comparing it to the remaining budget, assessing commitment values for material needed to complete remaining work, and estimating future conditions--to consider when determining projected cost and schedule amounts.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: In June 2016, we reported on IRS's development and implementation of its Investment Performance Tool for tracking cost, schedule and scope metrics for its IT investments. At the time, IRS was using the tool for two investments. As of September 2017, we were reviewing the agency?s use of the tool as part of an ongoing review. We plan to further examine the use of the tool and the supporting guidance to determine the extent to which they address this recommendation.
    Director: Melvin, Valerie C
    Phone: (202) 512-6304

    1 open recommendations
    Recommendation: To better ensure that GCSS-Army implements effective risk management and project monitoring and control practices, the Secretary of Defense should direct the Secretary of the Army to direct the GCSS-Army program office to specify the roles and responsibilities of the IV&V agent to ensure that it acts as a third party that validates and verifies the risks and mitigation plans developed by the program office and system integrator.

    Agency: Department of Defense
    Status: Open

    Comments: According to officials from Army's Program Executive Office Enterprise Information Systems in July 2017, the Army is working to draft an updated independent verification and validation policy in response to our recommendation. These officials expected the policy to be signed by the Program Executive Officer later this summer. We will continue to follow-up with the Army regarding this draft policy and the implementation of this recommendation.
    Director: Melito, Thomas
    Phone: (202)512-9601

    2 open recommendations
    Recommendation: To enhance U.S. efforts to promote international religious freedom, the Secretary of State and the Chair of USCIRF should jointly define how State and USCIRF should interact in their efforts to promote international religious freedom, paying particular attention to defining the ex-officio role of the Ambassador-at-Large for International Religious Freedom as a nonvoting USCIRF member.

    Agency: United States Commission on International Religious Freedom
    Status: Open

    Comments: In March 2015, officials from the Bureau of Democracy, Human Rights & Labor (DRL) said that the DRL Front Office and senior management have yet to approve a joint letter between State's Office of International Religious Freedom and the US Commission for International Religious Freedom (USCIRF) that addresses GAO's recommendation. According to the officials, the DRL front office wanted to revisit the letter given the recent appointment of a new Ambassador-at-Large. According to the Ambassador, he met with USCIRF and wanted to provide input to the joint letter, but as of March 2015, the letter had not been approved by State. We followed up again in both August 2015 and August 2016 and were told that no progress on the letter or a joint understanding had been made. In July 2017, the President announced his nominee to be the new Ambassador at Large for International Religious Freedom. As of August 15, 2017, the nomination is pending. State and USCIRF have not reached agreement on a letter responding to our recommendation.
    Recommendation: To enhance U.S. efforts to promote international religious freedom, the Secretary of State and the Chair of USCIRF should jointly define how State and USCIRF should interact in their efforts to promote international religious freedom, paying particular attention to defining the ex-officio role of the Ambassador-at-Large for International Religious Freedom as a nonvoting USCIRF member.

    Agency: Department of State
    Status: Open

    Comments: After the report was issued, in a letter dated May 28, 2013, the State Department said it has met with the U.S. Commission on International Religious Freedom (USCIRF) to discuss a plan for better systematizing the interactions between the entities, including by more clearly defining the ex-officio role of the Ambassador-at-Large. In October 2013 and again in March 2014, State said it continued to discuss this plan with USCIRF. In October 2014, State said it had drafted a joint letter with USCIRF in response to our recommendation, but that it was awaiting a Front Office signature. In March 2015, officials from the Bureau of Democracy, Human Rights & Labor (DRL) said that the DRL Front Office and senior management have yet to approve a joint letter between State's Office of International Religious Freedom and the US Commission for International Religious Freedom (USCIRF) that addresses GAO's recommendation. According to the officials, the DRL front office wanted to revisit the letter given the recent appointment of a new Ambassador-at-Large. According to the Ambassador, he met with USCIRF and wanted to provide input to the joint letter, but as of March 2015, the letter had not been approved by State. We followed up again in both August 2015 and August 2016 and were told that no progress on the letter or a joint understanding had been made. In July 2017, the President announced his nominee to be the new Ambassador at Large for International Religious Freedom. As of August 15, 2017, the nomination is pending. State and USCIRF have not reached agreement on a letter responding to our recommendation.
    Director: Crosse, Marcia G
    Phone: (202)512-3407

    2 open recommendations
    Recommendation: To help ensure that HHS is adequately and comprehensively assessing HPP and PHEP awardees' performance and progress in meeting the medical and public health preparedness goals of the cooperative agreements, the Secretary of Health and Human Services should direct ASPR and CDC to develop objective and quantifiable performance targets and incremental milestones that correspond to the new HPP and PHEP performance measures, against which HHS can gauge progress toward the medical and public health preparedness goals of the cooperative agreements and direct technical assistance, as needed.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: Since we examined the HPP and PHEP cooperative agreements in 2012, ASPR had developed few targets for the HPP program measures or their corresponding indicators that were contained in the HPP performance measurement guidance documents issued for Budget Periods (BP) 2-5, ending June 30, 2017. Additionally, the new HPP performance measure implementation guidance for the 5-year project cycle from 2017-2022 introduces 28 performance measures, with few having targets?the guidance notes that corresponding goals or targets may be set at a later date after data from the first budget period of this new project cycle has been reviewed. Regarding PHEP, CDC had developed performance targets for about half of the performance measures as of the PHEP BP5 performance measurement guidance (BP5 ended June 30, 2017). These performance measures generally remain the same, with existing targets, for BP1 (July 1, 2017-June 30, 2018) of the new 5-year budget cycle. GAO recognizes that it may not be appropriate to develop performance targets for every performance measure depending on the desired process or outcome; however, both agencies still have work to do in this area.
    Recommendation: To help ensure that HHS is adequately and comprehensively assessing HPP and PHEP awardees' performance and progress in meeting the medical and public health preparedness goals of the cooperative agreements, the Secretary of Health and Human Services should ensure that performance measures and targets remain consistent across the 5-year project cycle and that any future measures be comparable to determine whether awardees are making progress toward meeting short- and long-term medical and public health preparedness goals of the cooperative agreements.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: Since we first examined the HPP and PHEP cooperative agreements in 2012, ASPR and CDC had made efforts to maintain consistency in their performance measures, particularly in the last 3 years of the prior project cycle which ended June 30, 2017. However, because part of the recommendation includes consistency of performance measures into future project cycles, we also examined whether both cooperative agreements continued to use basically the same performance measures into the current 5-year cycle, which began July 1, 2017. ASPR's HPP has made a significant change in its performance measures, introducing a new set of 28 performance measures for this new 5-year cycle. CDC's PHEP performance measures generally remained consistent in the last two budget periods of the prior 5-year cycle, and remained generally the same for the first year of the new 5-year cycle (some measures were "retired," though key components from a measure may continue to be used by CDC in other types of reviews). As a result of the change to HPP's measures, GAO anticipates keeping this recommendation open at least for the next few budget periods, in order to determine whether HPP maintains consistency with its new performance measures during the new project cycle.
    Director: Mihm, J Christopher
    Phone: (202)512-3236

    1 open recommendations
    Recommendation: To better leverage agency quarterly performance reviews as a mechanism to manage performance toward agency priority and other agency-level performance goals, the Director of the Office of Management and Budget should work with the Performance Improvement Council and other relevant groups to identify and share promising practices to help agencies extend their quarterly performance reviews to include, as relevant, representatives from outside organizations that contribute to achieving their agency performance goals.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: Staff from the Office of Management and Budget (OMB) and the Performance Improvement Council (PIC) have taken little action to address this recommendation, according to information they shared in May 2016. OMB staff said that while they have found it is useful to engage external stakeholders in improving program delivery at times, agencies view reviews as internal agency management meetings. Thus, they believe it would not always be appropriate to regularly include external representatives. According to PIC staff, the PIC continues to work with agencies to identify examples where agencies have included representatives from outside organizations in quarterly reviews, and to identify promising practices based on those experiences. As those promising practices are identified, PIC staff plan to disseminate them through the PIC Internal Reviews Working Group and other venues. We will continue to monitor progress.
    Director: Yager, Loren
    Phone: (202)512-4347

    1 open recommendations
    including 1 priority recommendation
    Recommendation: To more effectively implement SBA's expansion of OIT field staff as required by the SBJA, the Administrator of the SBA should update SBA's plan for additional OIT staff to include funding sources and time frames, as well as possible efficiencies from clearly defining roles and responsibilities and leveraging other entities' export assistance resources.

    Agency: Small Business Administration
    Status: Open
    Priority recommendation

    Comments: SBA concurred with our recommendations and noted that SBA would work to implement the recommendations. SBA agreed that it intends to respond to staffing requirements of the SBJA while acknowledging resource constraints in its next annual report to Congress. In November 2014, SBA officials said that SBA was in the process of evaluating the impact of Voluntary Early Retirement Authority (VERA) and Voluntary Separation Incentive Payments (VSIP) retirements that took place at the end of September 2014 and was developing a plan for reallocating full-time employees (FTEs). They said that at the end of this process, SBA would have a better understanding of the impact on current and future USEAC staffing levels. In September 2015, SBA stated that it was still in the process of evaluating the impact of the VERA/VSIP retirements that took place at the end of September 2014, and was developing a plan for current and future FTEs. In February 2016, SBA's Office of International Trade (OIT) reported that in the first quarter of fiscal year 2016, it was able to fill the 21st of 30 USEAC-based Export Finance Specialist positions. OIT also reported that it has prepared an updated staffing proposal for the remaining nine positions called for under the Small Business Jobs Act of 2010. OIT noted that filling the remaining nine positions would depend on their receiving additional agency funding. SBA needs to provide documentation of its plan for complying with staffing requirements in the Small Business Jobs Act, or provide evidence that they have reallocated resources to actually do so. As of March 2017, SBA's new leadership was reviewing agency budget and staffing needs and had not provided us with a proposal for filling the remaining positions.
    Director: Cosgrove, James C
    Phone: (202) 512-7114

    2 open recommendations
    Recommendation: As CMS continues to implement and refine the Value Modifier program to enhance the quality and efficiency of physician care, the Administrator of CMS should consider whether certain private-sector practices could broaden and strengthen the program's incentives. Specifically, she should consider (1) developing at least some performance benchmarks that reward physicians for improvement as well as for meeting absolute performance benchmarks, and (2) making Value Modifier adjustments more timely in order to better reflect recent physician performance.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: CMS stated that it is working to implement GAO's recommendation. Previously, the agency noted that it would investigate accelerating the timeline of the Value Modifier, keeping in mind reporting requirements, data availability, and the need for valid and reliable measures. In addition, Congress passed legislation in 2015 requiring CMS to incorporate certain benchmark methodology and timing aspects that reflect GAO's 2013 recommendation, and the agency is replacing the Value Modifier with a new merit-based incentive payment system. CMS's efforts may, in time, address GAO recommendations to improve performance benchmarks and the timeliness of payment adjustments, but they have yet to be fully implemented. As of August 2017, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: The Administrator should develop a strategy to reliably measure the performance of solo and small physician practices, such as by aggregating their performance data to create informal practice groups.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: CMS stated that it is working to implement GAO's recommendation to measure the performance of solo and small physician practices. CMS included in its Value Modifier policies the amount of payment adjustments for solo and small physician practices, along with the parameters for measurement. In addition, Congress passed legislation in 2015 requiring CMS to establish a process to allow solo and physician practices under ten eligible professionals to be measured in a virtual group, and the agency is replacing the Value Modifier with a new merit-based incentive payment system. CMS's efforts may, in time, address GAO recommendations to reliably measure the performance of solo and small physician practices, but they have yet to be fully implemented. As of August 2017, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Director: Powner, David A
    Phone: (202) 512-9286

    2 open recommendations
    Recommendation: The Secretary of Transportation should designate a senior agency official who has departmentwide responsibility, accountability, and authority for geospatial information issues. The Secretary of Transportation direct the designated senior official for geospatial information to prepare, maintain, publish, and implement a strategy for advancing geographic information and related geospatial data activities appropriate to its mission.

    Agency: Department of Transportation
    Status: Open

    Comments: In July 2016, a Transportation official told GAO that the department had completed a draft of the geospatial strategic plan that month. According to a Transportation official, as of March 1, 2017, the draft was under review. On September 8, 2017, a Transportation official stated that the department plans to issue the plan by November 1, 2017.
    Recommendation: To improve OMB oversight of geospatial information and assets, and minimize duplication of federal geospatial investments, the Director of OMB should develop a mechanism, or modify existing mechanisms, to identify and report annually on all geospatial related investments, including dollars invested and the nature of the investment.

    Agency: Executive Office of the President: Office of Management and Budget
    Status: Open

    Comments: OMB has made progress in developing a way to identify and report annually on all geospatial-related investments, but has not completed its efforts. In March 2014, the Federal Geographic Data Committee (FGDC) issued its National Geospatial Data Asset (NGDA) Management Plan. The plan was developed in conjunction with OMB officials. One of the objectives of the plan is to develop and apply a standard definition of a geospatial investment in order to facilitate reporting on budgeted geospatial data investments, due to the fact that different definitions are being used by OMB, the FGDC community, and individual agencies. There are two supporting actions for this objective. The first action was completed with the finalization and issuance of the FGDC's Geospatial Investment Definitions for Tracking and Reporting Geospatial Investment Costs document in April 2016. The document contains a set of geospatial definitions with specific examples for each. The second action is for the geospatial community to apply the definitions in submissions to OMB during the annual federal government budget planning and reporting process. According to FGDC officials, they expect this to be challenging for a number of reasons, including the need for agencies to determine how they can align their investment tracking systems to accommodate the new definitions and the extent to which agencies will be able to use a common reporting capability. As a result, a two-pronged approach is being used. First, FGDC developed a reporting method using the theme implementation plans to support federal geospatial data investment tracking. For example, in February 2017, an official provided an implementation plan from January 2017 which included an estimate of the amount of time federal employees spent on NGDA work, and reported this as a percentage of full-time equivalents. Second, OMB worked with FGDC to revise geospatial investment reporting guidance found in OMB Circular No. A-11. Starting with fiscal year 2018 allocations (Circular No. A-11 revised July 2016), agencies are required to report on annual aggregated geospatial data investments of $100,000 or greater using the Marketplace feature of the Geospatial Platform. According to an agency official, this approach leverages existing, federal government-wide reporting methods already in place and minimizes the potential for agencies to implement separate, potentially duplicative reporting mechanisms that are not integrated with existing OMB reporting procedures. According to OMB officials as of September 7, 2017, OMB anticipates that since fiscal year 2018 will be the first year of implementation, some agencies may have challenges identifying and reporting their data. As a result, OMB states that the content and completeness of the reported information will need to be evaluated prior to determining its fitness and application for overseeing geospatial investments.
    Director: Dillingham, Gerald L
    Phone: (202)512-2834

    3 open recommendations
    Recommendation: To enhance FAA's efforts to improve general aviation safety, the Secretary of Transportation should direct the FAA Administrator to improve measures of general aviation activity by requiring the collection of the number of hours that general aviation aircraft fly over a period of time (flight hours). FAA should explore ways to do this that minimize the impact on the general aviation community, such as by collecting the data at regular events (e.g., during registration renewals or at annual maintenance inspections) that are already required.

    Agency: Department of Transportation
    Status: Open

    Comments: In August 2017, GAO confirmed that FAA's collection of flight hour data during registration renewals or annual maintenance inspections is not feasible because it would require rulemaking and potentially have a significant economic and paperwork impact on the GA community. FAA noted that, although previously the GA Activity Survey was somewhat limited for collecting more extensive flight hour data, improvements to the survey regarding flight hour data collection have resulted in a low standard error of 1.1 percent, which means that the agency and industry can have confidence in the aggregate results regarding how GA is operated in the national airspace system. While there may have been methodological improvements to the survey, FAA's response indicates that it does not require the collection of GA flight hour data. GAO maintains that estimates from the survey still may not be sufficient for drawing conclusions about changes in crash rates over time and that more precise flight hour data could allow FAA to better target its safety efforts within the general aviation community.
    Recommendation: To enhance FAA's efforts to improve general aviation safety, and to ensure that ongoing safety issues are addressed, the Secretary of Transportation should direct the FAA Administrator to set specific general aviation safety improvement goals--such as targets for fatal accident reductions--for individual industry segments using a datadriven, risk management approach.

    Agency: Department of Transportation
    Status: Open

    Comments: GAO confirmed in August 2017 that FAA's General Aviation Joint Steering Committee has undertaken a data-driven approach to resolving and mitigating the risks associated with all General Aviation (GA) fatal accidents and is exploring different metrics for monitoring individual industry segments utilizing tools such as the GA Activity Survey but that credible metrics for each industry sub-sector are currently not feasible. However, our recommendation was for FAA to develop metrics for industry segments because we found a variety of differences in accident and fatality rates among industry segments and believe that focusing on segments with higher instances of both is a better use of FAA's limited resources.
    Recommendation: To enhance FAA's efforts to improve general aviation safety, and to determine whether the programs and activities underlying the 5-year strategy are successful and if additional actions are needed, the Secretary of Transportation should direct the FAA Administrator to develop performance measures for each significant program and activity underlying the 5-year strategy.

    Agency: Department of Transportation
    Status: Open

    Comments: GAO confirmed in August 2017 that FAA has established performance metrics for the activities underlying the 5-year strategy and that the GA fatal accident rate remains its primary performance measure. FAA also reported that additional performance measures would be developed in association with the General Aviation Joint Steering Committee working groups. However, FAA has provided no documentation of its metrics for the associated activities underlying the 5-year strategy therefore this recommendation remains open.
    Director: Draper, Debra A
    Phone: (202)512-3000

    6 open recommendations
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should expedite and communicate a plan with time frames for when iEHR solutions will be made available to joint ventures and other collaboration sites.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should expedite and communicate a plan with time frames for when iEHR solutions will be made available to joint ventures and other collaboration sites.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should take steps to resolve problems with collaboration sites' incompatible business and administrative processes, including reimbursement for services, collection of workload information, dual credentialing, and computer security training.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should take steps to resolve problems with collaboration sites' incompatible business and administrative processes, including reimbursement for services, collection of workload information, dual credentialing, and computer security training.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should clarify, as part of the newly initiated joint efforts to address base access, departmental guidance regarding collaboration to include a discussion of base access issues that local officials should consider when discussing and planning collaboration efforts; this could include a discussion of successful approaches that current collaboration sites have adopted to facilitate base access for veterans and their escorts.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Recommendation: To facilitate the departments' current collaboration efforts, VA and DOD should systematically identify areas where department-level actions could help address significant barriers that hinder collaboration. Specifically, the Secretaries of Veterans Affairs and Defense should clarify, as part of the newly initiated joint efforts to address base access, departmental guidance regarding collaboration to include a discussion of base access issues that local officials should consider when discussing and planning collaboration efforts; this could include a discussion of successful approaches that current collaboration sites have adopted to facilitate base access for veterans and their escorts.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information
    Director: Maurer, Diana C
    Phone: (202) 512-9627

    2 open recommendations
    Recommendation: To strengthen DHS's evaluation and planning process for addressing employee morale, the Secretary of Homeland Security should direct the Office of the Chief Human Capital Officer (OCHCO) and component human capital officials to examine their root cause analysis efforts and, where absent, add the following: comparisons of demographic groups, benchmarking against similar organizations, and linkage of root cause findings to action plans.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In fiscal year 2012, we reviewed and reported on actions DHS took to address the morale of its employees. We reported, among other things, that DHS's Office of the Chief Human Capital Officer and DHS components had not consistently used three survey analysis techniques when analyzing employee survey results--comparisons of demographic groups, benchmarking against similar organizations, and linking root cause findings to action plans. DHS OCHCO officials, and supporting documentation, indicate some actions taken to incorporate these techniques. Specifically, as of June 2017, officials provided copies of the DHS FY 2017 Component Employee Engagement Action Plans. We reviewed the action plans and spoke with DHS OCHCO officials to determine the extent to which DHS's action plans addressed our recommendation. Several action plans we reviewed included evidence of utilizing the three survey analysis techniques we recommended, while other action plans lack some or all of the techniques. For example, components whose action plans fully address the recommendation includes: Customs and Border Protection (CBP), Federal Emergency Management Agency (FEMA), Immigration and Customs Enforcement (ICE), and the Transportation Security Administration (TSA). Components whose action plans partially address the recommendation are: U.S. Citizenship and Immigration Services (USCIS), U.S. Coast Guard (USCG), and U.S. Secret Service (USSS). National Protection and Programs Directorate's (NPPD) action plan did not address any of the three survey analysis techniques. According to DHS OCHCO officials, while OCHCO developed a checklist to consult when creating action plans to address employee survey results, senior management decided not to require that components use the checklist in developing their action plans as it may limit their freedom to develop their goals and planning. To fully address this recommendation, DHS OCHCO officials need to continue to provide documentary evidence of demographic analysis, benchmarking, and root cause linkage efforts completed for components that have not fully addressed the recommendation in their action plans. DHS OCHCO officials agreed with our analysis and reiterated their intent to fully implement this recommendation. We will update the status of this recommendation after additional information is received from DHS. Status as of June 2017.
    Recommendation: To strengthen DHS's evaluation and planning process for addressing employee morale, the Secretary of Homeland Security should direct the OCHCO and component human capital officials to establish metrics of success within the action plans that are clear and measurable.

    Agency: Department of Homeland Security
    Status: Open

    Comments: In fiscal year 2012, we reviewed and reported on actions DHS took to address the morale of its employees. We reported, among other things, that DHS's Office of the Chief Human Capital Officer and DHS components measures of action plan success related to employee morale could have improved clarity and incorporate measurable targets. DHS officials regularly provided us with copies of annual component employee engagement action plans, most recently as of June 2017. We reviewed the action plans and spoke with DHS OCHCO officials to determine the extent to which DHS's action plans addressed our recommendation. Our review in June 2017 indicated that most components' action plans included clear and measureable targets. For example, components whose action plans fully address the recommendation include CBP, Coast Guard, FEMA, ICE, NPPD, USCIS, and USSS. TSA's action plans partially addressed the recommendation and the component is taking steps to improve its measures. To fully address this recommendation, DHS OCHCO officials need to continue to provide documentary evidence of improved measure clarity and incorporate measurable targets in components' action planning efforts. DHS OCHCO officials agreed with our assessment and told us that they continue to provide feedback to component officials to address action planning improvement. These officials reiterated their efforts to fully implement this recommendation and we will update the status of this recommendation after additional information is received from DHS.
    Director: Farrell, Brenda S
    Phone: (202) 512-3604

    3 open recommendations
    Recommendation: To help ensure that Congress has the necessary information to provide effective oversight over DOD's civilian workforce, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to conduct competency gap analyses for DOD's mission-critical occupations and report the results. When managers cannot conduct such analyses, DOD should report a timeline in the strategic workforce plan for providing these assessments.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials with the Defense Civilian Personnel Advisory Service responsible for developing DOD's strategic workforce plans stated that results from the Defense Competency Assessment Tool, which the department began using in 2014 and provides for competency gap assessment of the department's mission-critical occupations and other major civilian occupations, would be reported in the department's next strategic workforce plan to be published in 2015. Update (9/9/2016): Defense Civilian Personnel Advisory Service officials indicated that this recommendation will be addressed when an updated strategic plan is issued in late calendar year 2016.
    Recommendation: To help ensure that the data presented in DOD's strategic workforce plans are current and timely, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to establish and adhere to timelines that will ensure issuance of future strategic workforce plans in accordance with statutory timeframes.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials with the Defense Civilian Personnel Advisory Service responsible for developing DOD's strategic workforce plans stated that the current planning cycle for the department's strategic workforce plans are in line with statutory timeframes. As such, DOD's next strategic workforce plan is expected to be issued in accordance with those timeframes. Update (9/9/2016): Defense Civilian Personnel Advisory Service officials indicated that this recommendation will be addressed when an updated strategic plan is issued in late calendar year 2016.
    Recommendation: To enhance the information that DOD provides Congress in its strategic workforce plan, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness to provide guidance for developing future strategic workforce plans that clearly directs the functional communities to collect information that identifies not only the number or percentage of personnel in its military, civilian, and contractor workforces but also the capabilities of the appropriate mix of those three workforces.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials with the Office of the Under Secretary of Defense (Personnel and Readiness), Total Force Requirements and Sourcing Policies office, stated that DOD continues to develop its Enterprise-wide Contractor Manpower Reporting Application, which will allow the department to collect and report on the number and capabilities of contractors in its workforce. According to the officials, the application will not be ready for implementation until 2015. Officials with the Defense Civilian Personnel Advisory Service responsible for developing DOD's strategic workforce plans stated that once the ability to collect and report on the number of contractors exists, DOD will be able to assess and report on the appropriate mix of military, civilian, and contractor workforces and that information will be included in DOD's mandated strategic workforce plans. Update (9/9/2016): Defense Civilian Personnel Advisory Service officials indicated that this recommendation will be addressed when an updated strategic plan is issued in late calendar year 2016.
    Director: Currie, Christopher
    Phone: (404)679-3000

    1 open recommendations
    including 1 priority recommendation
    Recommendation: To increase the efficiency and effectiveness of the process for disaster declarations, the FEMA Administrator should develop and implement a methodology that provides a more comprehensive assessment of a jurisdiction's capability to respond to and recover from a disaster without federal assistance. This should include one or more measures of a jurisdiction's fiscal capacity, such as TTR, and consideration of the jurisdiction's response and recovery capabilities. If FEMA continues to use the PA per capita indicator to assist in identifying a jurisdiction's capabilities to respond to and recover from a disaster, it should adjust the indicator to accurately reflect the annual changes in the U.S. economy since 1986, when the current indicator was first adopted for use. In addition, implementing the adjustment by raising the indicator in steps over several years would give jurisdictions more time to plan for and adjust to the change.

    Agency: Department of Homeland Security: Directorate of Emergency Preparedness and Response: Federal Emergency Management Agency
    Status: Open
    Priority recommendation

    Comments: On January 20, 2016, FEMA published an Advanced Notice of Proposed Rulemaking to solicit comments on an option FEMA is considering to establish a disaster deductible, which would require a predetermined level of financial or other commitment from a recipient, generally the state or territorial government, before FEMA would provide assistance under the Public Assistance Program. According to FEMA, the agency received 150 responses during the 60-day public comment period, which ended on March 21, 2016, and used this input to develop a plan for further engagement on a more detailed proposal for public comment. The Supplemental Advanced Notice of Proposed Rulemaking, published on January 12, 2017, provided another opportunity for stakeholder input prior to any changes to the Public Assistance program. This proposal included an explanation of how deductible amounts might be calculated, identified specific credits that states could apply for, and detailed how the deductible would be applied post-declaration. Comments on the Supplemental Advanced Notice of Proposed Rulemaking must be submitted by April 12, 2017. Until FEMA implements a new methodology, FEMA will not have an accurate assessment of a jurisdiction's capabilities to respond to and recover from a disaster without federal assistance and runs the risk of recommending that the President award Public Assistance to jurisdictions that have the capability to respond and recover on their own.
    Director: Herr, Phillip R
    Phone: (202)512-8509

    2 open recommendations
    Recommendation: To better ensure that USPS's efforts to expand access through retail alternatives support its strategic goals to improve its service and financial performance, the Postmaster General should develop and implement a plan with a timeline to guide efforts to modernize USPS's retail network that addresses both traditional post offices and retail alternatives. This plan should also include: (1) criteria for ensuring the retail network continues to provide adequate access for customers as it is restructured; (2) procedures for obtaining reliable retail revenue and cost data to measure progress and inform future decision making; and (3) a method to assess whether USPS's communications strategy is effectively reaching customers, particularly those customers in areas where post offices may close.

    Agency: United States Postal Service
    Status: Open

    Comments: USPS has undertaken actions to ensure customers have adequate access to postal services, including providing more ways to access postal services in high-revenue markets and expanding the Village Post Office program in rural areas. With regard to USPS's communications strategy, USPS discussed the public notice requirements that are part of the post office discontinuance policy and the role of the Corporate Communications Office in communicating about postal services provided through retail partners. USPS also discussed the process that occurs during discontinuance proceedings to ensure sufficient service is maintained. However, USPS has not provided information to GAO on how USPS intends to obtain reliable revenue and cost data and how it ensures retail service is sufficient to meet customer demand. GAO discussed the need for additional documentation of these matters. Implementation date is to be determined.
    Recommendation: To help ensure contract postal units and Approved Shippers provide postal products and services in accordance with USPS policies, while making efficient use of its constrained resources, the Postmaster General should establish procedures to focus monitoring of retail partners on those determined to be at a greater risk of not complying with its requirements and procedures.

    Agency: United States Postal Service
    Status: Open

    Comments: During a discussion with USPS in January 2017, USPS described a proposed risk-based approach to monitoring CPUs which, if implemented, would meet the intent of the recommendation. GAO is awaiting documentation of this approach.
    Director: Melvin, Valerie C
    Phone: (202)512-6304

    2 open recommendations
    Recommendation: To help ensure that the development and implementation of IDR and One PI are successful in helping the agency meet the goals and objectives of its program integrity initiatives, the Administrator of CMS should implement and manage plans for incorporating data in IDR to meet schedule milestones.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: While CMS has incorporated shared systems Medicare Part A (insurance for hospital and other inpatient services), Part B (insurance for hospital outpatient, physician, and other services), and three states' Medicaid data into IDR, it has not yet implemented and managed plans for incorporating all states' Medicaid data, as GAO recommended in June 2011. As a result, the repository does not yet include all the data that were planned to be incorporated by the end of 2012, and efforts to add the remaining states' Medicaid data to IDR continue to be behind schedule. As of March 2017, agency officials are working to develop plans to integrate all states' data into IDR as part of ongoing program integrity initiatives.
    Recommendation: To help ensure that the development and implementation of IDR and One PI are successful in helping the agency meet the goals and objectives of its program integrity initiatives, the Administrator of CMS should define any measurable financial benefits expected from the implementation of IDR and One PI.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: As of March 2017, CMS officials reported that they have identified areas of potential cost savings to be achieved by requiring program integrity contractors to use IDR and One PI, as GAO recommended in June 2011. CMS is awarding new contracts to include this requirement, which is expected to result in the agency no longer funding contractors' efforts to establish and maintain their own data warehouses and analytical tools. However, not all of the contracts have been awarded and, therefore, the requirement has not been fully implemented. Until all the new contracts have been awarded that require the contractors to use IDR and One PI for program integrity purposes, CMS will not have reasonable assurance that using the systems will help improve CMS's ability to detect fraud, waste, and abuse in the Medicare and Medicaid programs, and to achieve the $21 billion in financial benefits program officials projected.
    Director: Trimble, David C
    Phone: (202)512-9338

    3 open recommendations
    including 1 priority recommendation
    Recommendation: To improve EPA's ability to oversee the states' implementation of the Safe Drinking Water Act and provide Congress and the public with more complete and accurate information on compliance, the Administrator of EPA should resume data verification audits to routinely evaluate the quality of selected drinking water data on health-based and monitoring violations that the states provide to EPA. These audits should also evaluate the quality of data on the enforcement actions that states and other primacy agencies have taken to correct violations.

    Agency: Environmental Protection Agency
    Status: Open
    Priority recommendation

    Comments: In October 2016, EPA reported that it had not resumed its data verification audits, but is continuing on-site file reviews, completing 5 in 2015, and planning to complete 8 in 2016. Further, EPA continues to focus on developing its SDWIS Prime, which will support electronic verification of data. It plans to have the system operational in March 2018. In the last year, EPA conducted two training events with the regional file review teams which the agency indicated helped (1) identify challenges in completing file reviews and potential solutions, and (2) share best practices to enhance the implementation of the protocol. EPA told us that as the regions build more capacity and experience in conducting these file reviews, EPA expects to gradually increase the number of file reviews completed in a year. According to OECA, who collaborates with the water office for file reviews in some regions, there were no systemic discrepancies between enforcement file contents and data reported to EPA in its test of the protocol for evaluating the quality of enforcement data in 3 states.
    Recommendation: To improve EPA's ability to oversee the states' implementation of the Safe Drinking Water Act and provide Congress and the public with more complete and accurate information on compliance, the Administrator of EPA should work with the states to establish a goal, or goals, for the completeness and accuracy of data on monitoring violations. In setting these goals, EPA may want to consider whether certain types of monitoring violations merit specific targets. For example, the agency may decide that a goal for the states to completely and accurately report when required monitoring was not done should differ from a goal for reporting when monitoring was done but not reported on time.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA, it has not worked with states to establish a national goal for the quality of monitoring violations. EPA stated that without the ability to conduct on-site data verifications using a statistically-based sample size, it is unable to derive a goal that would capture both completeness of state reporting to EPA and whether the states correctly assigned a violation for missed monitoring. EPA said that it intends to work with states to evaluate the establishment of a monitoring data quality goal once the new SDWIS NextGen data system has been developed and electronic data verification functions are incorporated into the system. In April 2015, EPA indicated that the agency intends to separate monitoring violations from reporting violations in the new SDWIS Primacy Agency data system. According to EPA, this will enable the primacy agencies and EPA to better understand the nature of system violations and with the violations delineated in this manner, will allow EPA to consider developing goals for monitoring and reporting violations. In September 2015, EPA reported to GAO that it anticipated that states will begin using SDWIS Prime in September 2017 and that it will consider GAO's recommendation once SDWIS Prime is fully operational and it is able to better establish such a goal.
    Recommendation: To improve EPA's ability to oversee the states' implementation of the Safe Drinking Water Act and provide Congress and the public with more complete and accurate information on compliance, the Administrator of EPA should consider whether EPA's performance measures for community water systems could be constructed to more clearly communicate the aggregate public health risk posed by these systems' noncompliance with SDWA and progress in having those systems return to compliance in a timely manner.

    Agency: Environmental Protection Agency
    Status: Open

    Comments: According to EPA, the agency has not made any adjustments to the performance measures for community water systems. EPA told us that, as part of its periodic review of the 5-year Strategic Plan, it will consult with the states, the Office of Management and Budget, GAO and the National Drinking Water Advisory Committee (NDWAC) on how it could construct a new measure to communicate better the aggregate public health risk posed by noncompliance as GAO suggests. EPA also said that it will continue to use a variety of tools and resources to convey to the public information on drinking water quality and potential health risks associated with exposure to contaminants. In April 2015, EPA wrote: OGWDW did not make any changes in Fiscal Year 2014 to the program's current community water system-based measure which communicates the results of efforts to return systems to compliance and maintain compliance. The "person month" measure provides insight into the duration of health based violations. For FY 15, we have developed a "person month" measure for tribal community water systems. Further efforts to evaluate the current measures and consideration of GAO suggestions will continue to be part of the Agency's periodic review of the five-year strategic plan. In September 2015, EPA told GAO that it was evaluating the effectiveness of the "person month" measure and is continuing to enhance and revise the measures taking GAO suggestions into consideration.
    Director: Brown, Orice Williams
    Phone: (202)512-5837

    3 open recommendations
    Recommendation: To improve strategic planning, performance management, and program oversight within and related to NFIP, the Secretary of DHS should direct the FEMA Administrator to develop a comprehensive workforce plan according to PKEMRA that identifies agency staffing and skills requirements, addresses turnover and staff vacancies, and analyzes FEMA's use of contractors.

    Agency: Department of Homeland Security
    Status: Open

    Comments: According to FEMA officials, as of July 2016, FEMA is in the process of developing a Workforce Strategic Plan they say will contribute to organizational performance and mission by enabling FEMA to align the overall workforce with strategic priorities. FEMA expected to complete the plan by the first quarter of FY2017. As of December 2016, FEMA officials said they were still working to implement this recommendation and agreed to provide us with an update of their progress.
    Recommendation: To improve FEMA's policies, procedures, and systems for achieving NFIP's program goals, the Secretary of DHS should direct the FEMA Administrator to consider the costs and benefits of implementing an interim system for FEMA and updating its document management policies and procedures while waiting for DHS to implement an agencywide electronic document management system.

    Agency: Department of Homeland Security
    Status: Open

    Comments: FEMA officials stated that, as of July 2016, FEMA is working to pilot an Electronic Records Management System (ERMS). They said that they expected to have all email records in an electronic state by December 31, 2016, and all records in an electronic state by December 31, 2019. They said that they expect the end state in 2019 to meet the Presidential Directive and NARA guidelines. As of December 2016, FEMA officials said they were still working to implement this recommendation and agreed to provide us with an update of their progress.
    Recommendation: To improve FEMA's policies, procedures, and systems for achieving NFIP's program goals, the Secretary of DHS should direct the FEMA Administrator to establish timelines for and complete the development and implementation of FEMA's revised acquisition process, in line with the DHS Acquisition Directive 102-01, including a rollout process with staff training and a mechanism to better ensure that all acquisitions undergo the necessary reviews.

    Agency: Department of Homeland Security
    Status: Open

    Comments: FEMA officials stated that, as of July 2016, a Disaster Acquisitions Response Team (DART) was in place along with metrics in place to monitor the team's success. They said they had also awarded a contract to serve as a contract file repository and that previously scanned contract files would be uploaded by December 31, 2016. As of December 2016, FEMA officials said they were still working to implement this recommendation and agreed to provide us with an update of their progress.
    Director: Dicken, John E
    Phone: (202)512-7043

    6 open recommendations
    Recommendation: To ensure that information entered into CMS's complaints database is reliable and consistent, the Administrator of CMS should identify issues with data quality and clarify guidance to states about how particular fields in the database should be interpreted, such as what it means to substantiate a complaint.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS concurred with this recommendation. In November 2014, CMS officials reported that the agency's Survey and Certification Group was in the early stages of a planned multi-year review of all of its business processes, including those related to nursing home complaint investigations. Officials stated that, as part of that review, agency staff would seek to provide clarification on all aspects of the complaint process, including what it means to substantiate a complaint. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To strengthen CMS's assessment of state survey agencies' performance in the management of nursing home complaints, the Administrator of CMS should conduct additional monitoring of state performance using information from CMS's complaints database, such as additional timeliness measures.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: In November 2014, CMS officials reported that the fiscal year 2014 protocol for assessment of state agency performance includes a new measure that tracks how soon after the completion of a complaint investigation a state agency uploads data from that investigation to CMS's complaint tracking system. However, the protocol does not call for assessment of the number of days by which state survey agencies miss the deadlines for some complaint investigations--a measure that we suggested could provide a more comprehensive picture of state agency performance. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To strengthen CMS's assessment of state survey agencies' performance in the management of nursing home complaints, the Administrator of CMS should assure greater consistency in assessments by identifying differences in interpretation of the performance standards and clarifying guidance to state survey agencies and CMS regional offices.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS agreed that CMS needed to strengthen its assessment of state survey agencies' performance in the management of nursing home complaints. In November 2014, CMS officials reported that the agency's fiscal year 2014 protocol for assessment of state agencies' performance requires CMS regional offices to review the extent to which the states' policies are consistent with CMS policies. CMS officials acknowledged that there was some variation among states and noted that the agency's Survey and Certification Group is in the early stages of a multi-year review of all of its business processes. Officials expected this review would identify additional opportunities to improve consistency among states in the application of the performance standards. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To strengthen and increase accountability of state survey agencies' management of the nursing home complaints process, the Administrator of CMS should clarify guidance to the state survey agencies about the minimum information that should be conveyed to complainants at the close of an investigation.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS agreed that CMS needed to take steps to strengthen and increase accountability of state survey agencies' management of nursing home complaints. In November 2014, CMS officials reported that while they believed the CMS State Operations Manual, which specifies procedures for addressing complaints, provides significant guidance regarding the information that state agencies should convey to complainants at the close of an investigation, they would review the guidance to identify any needed changes. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To strengthen and increase accountability of state survey agencies' management of the nursing home complaints process, the Administrator of CMS should provide guidance encouraging state survey agencies to prioritize complaints at the level that is warranted, not above that level.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS agreed that CMS needed to take steps to strengthen and increase accountability of state survey agencies' management of the nursing home complaints process and stated that CMS would provide clarification and guidance to states to ensure complaints were prioritized at the appropriate level. However, in CMS's fiscal year 2014 protocol for assessment of state agency performance, the prioritization standard still required only that complaints be assigned a priority level at or above the level assigned by CMS reviewers. We remain concerned that defining the standard this way may create an incentive for survey agencies to prioritize some complaints at a higher level than is warranted--which could increase workload and potentially jeopardize the timeliness of investigations that warrant the higher priority level. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To strengthen and increase accountability of state survey agencies' management of the nursing home complaints process, the Administrator of CMS should implement CMS's proposed plans to publish state survey agencies' scores but limit publication to those performance standards that CMS considers the most reliable and clear.

    Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
    Status: Open

    Comments: HHS agreed that CMS needed to take steps to strengthen and increase accountability of state survey agencies' management of the nursing home complaints process and said that CMS would work with state officials and others to identify key performance information that would be of public value. In November 2014, CMS officials reported that the agency had not yet outlined a method or timetable for publishing states' performance scores. As of September 2016, CMS officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Director: Clowers, Angela N
    Phone: (202)512-4010

    3 open recommendations
    Recommendation: To help resolve identified borrower noncompliance in a timely manner, the Secretary of Agriculture should direct the Administrator of RHS to implement enforcement mechanisms that can be tailored to the severity of the borrower noncompliance, such as the civil money penalty enforcement provision in its program regulations.

    Agency: Department of Agriculture
    Status: Open

    Comments: The agency continues to take actions to address this recommendation, but has not yet fully implemented it.
    Recommendation: To better ensure that requirements for tenant eligibility are met across the FLH portfolio, the Secretary of Agriculture should direct the Administrator of RHS to require its loan servicers to use the Systematic Alien Verification and Entitlements (SAVE) program administered by the Department of Homeland Security to verify tenant's residency status during supervisory reviews.

    Agency: Department of Agriculture
    Status: Open

    Comments: The agency has not implemented this recommendation.
    Recommendation: The Secretary of Agriculture should direct the Administrator of RHS to better utilize available data on demand for the FLH program--such as systematically reviewing local market analyses, further analyzing occupancy data on a statewide, regional, or national level, and retaining and analyzing application information--to help target available funding to areas of greatest need.

    Agency: Department of Agriculture
    Status: Open

    Comments: The agency continues to take actions to address this recommendation, but has not yet fully implemented it.
    Director: Williamson, Randall B
    Phone: (206)287-4860

    5 open recommendations
    Recommendation: To address weaknesses in DCOE's strategic plan, the Secretary of Defense, through the Director of TMA, should direct the DCOE director to revisit and revise as necessary the organization's goals for completing statutorily required responsibilities.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To address weaknesses in DCOE's strategic plan, the Secretary of Defense, through the Director of TMA, should direct the DCOE director to require the directorates to align their day-to-day activities to support DCOE's mission and goals.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To address weaknesses in DCOE's strategic plan, the Secretary of Defense, through the Director of TMA, should direct the DCOE director to improve the performance measures in the plan to enable DCOE to determine if achievement of each measure fully supports attainment of its associated goal.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To ensure that DCOE obligations are properly classified and recorded in accordance with OMB guidance, the Secretary of Defense, through the Office of the Assistant Secretary of Defense (Health Affairs) (ASD(HA)), should direct TMA to develop written procedures with detailed steps to be performed for ensuring proper classification and recording of obligations in TMA's financial management systems.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Recommendation: To ensure that DCOE obligations are properly classified and recorded in accordance with OMB guidance, the Secretary of Defense, through the ASD(HA), should direct TMA to assign responsibility for updating and maintaining procedural guidance and systems codes to assure consistency with annual OMB guidance.

    Agency: Department of Defense
    Status: Open

    Comments: As of July 2017, DOD officials have not implemented this recommendation. GAO considers it to be open. We will update the status of this recommendation when we receive additional information.
    Director: Wise, David J
    Phone: (202)512-5731

    1 open recommendations
    Recommendation: To ensure that FTA targets its resources effectively as it increases its safety efforts and is able to track the results of these efforts, the Secretary of Transportation should direct the FTA Administrator to use leading practices as FTA develops its plans for fiscal year 2011 and in the future. In particular, the Administrator should create a set of clear and specific performance goals and measures that (1) are aligned with the department's strategic safety goals and identify the intended results of FTA's various safety efforts and (2) address important dimensions of program performance.

    Agency: Department of Transportation
    Status: Open

    Comments: The Moving Ahead for Progress in the 21st Century Act (MAP-21), enacted in 2012, gave the Federal Transit Administration (FTA) authority to establish and enforce a new comprehensive framework for overseeing the safety of public transportation in the U.S. FTA is developing a new National Public Transportation Safety Program, including new safety regulations and a National Safety Plan, to implement this authority. FTA has proposed a National Safety Plan that identifies a potential set of performance measures for FTA, but does not identify related goals or targets. FTA officials said that they would address our recommendation within the next 6-12 months by establishing, within an internal performance plan, a set of clear and specific performance goals and measures for FTA that align with the leading practices we identify. We will follow up in Spring 2017 to check on FTA's progress in implementing this recommendation.
    Director: Pickup, Sharon L
    Phone: (202)512-9619

    2 open recommendations
    Recommendation: To establish ongoing accountability and better leverage the unique positions of the CMO and DCMO to provide the leadership necessary to follow up the Secretary's recent efficiency initiative for the long term, the Secretary of Defense should assign specific roles and responsibilities to the CMO and DCMO for integrating the Secretary's efficiency initiative with ongoing reform efforts, overseeing its implementation, and otherwise institutionalizing the effort for the long term.

    Agency: Department of Defense
    Status: Open

    Comments: DOD concurred with this recommendation, but did not specify the action it planned to take to implement the recommendation. Based on a review of all the memos related to the efficiencies and recent discussions with the Deputy Chief Management Officer and Under Secretary of Defense (Comptroller) offices, there is currently no guidance that formally assigns the DCMO and Comptroller responsibility for tracking and overseeing the implementation of the efficiency initiatives. However, during a March 2011 testimony before the Senate Armed Services Committee, the Comptroller stated that the Deputy Chief Management Officer (DCMO) and the Under Secretary of Defense (Comptroller) were assigned the task of monitoring the implementation of the efficiency initiative and report successes and problems to the Deputy Secretary of Defense, DOD's Chief Management Officer (CMO). Given the responsibilities, under statute and department guidance, related to improving the efficiency and effectiveness of business operations, the DCMO,in conjunction with the Under Secretary of Defense (Comptroller), is positioned to monitor, integrate, and otherwise institutionalize the Secretary of Defense's ongoing efficiency initiative. The recommendation remains unimplemented in the absence of formal guidance that institutionalizes the responsibilities of the CMO and DCMO. As of early September 2015, DOD has not yet issued formal guidance that assigns the CMO and DCMO these specific roles and responsibilities.
    Recommendation: To enhance DOD's ability to set strategic direction for its business transformation efforts, and better align and institutionalize its efforts to develop and implement plans and measure progress against established goals, the Secretary of Defense should direct the CMO to issue guidance to establish a strategic planning process with mechanisms---such as procedures and milestones---for routinely updating the SMP and military department business transformation plans. In particular, this guidance should include elements such as how DOD and the military departments---including the CMO, DCMO, and military department CMOs---will reach consensus on business priorities, coordinate review and approval of updates to plans, synchronize the development of plans with the budget process, and monitor the implementation of reform initiatives, and report progress, on a periodic basis, towards achieving established goals.

    Agency: Department of Defense
    Status: Open

    Comments: DOD partially concurred with this recommendation. As of July 2013, DOD has not issued guidance to establish a strategic planning process with mechanisms, such as procedures and milestones, for routinely updating the Strategic Management Plan and the business transformation plans of the military departments. As of early September 2015, DOD has not yet issued guidance to establish a strategic planning process to update related business transformation plans.
    Director: Wise, David J
    Phone: (202)512-5731

    1 open recommendations
    Recommendation: To improve FTA's ability to determine the extent to which transit grants, current formula incentives, and FTA program activities have had a positive effect on local transit agency performance--and to the extent that FTA finds current data sources to be appropriate and reliable for such purposes-- the Secretary of Transportation should direct the FTA Administrator to further analyze and use data submitted to FTA by local transit agencies. As part of this analysis, FTA may want to identify and evaluate, when applicable, (1) the extent to which transit grant programs are accomplishing their established goals; (2) the areas of performance in which FTA should concentrate its program activities to increase the performance of local transit agencies and the federal transit program in general; and (3) the extent to which formula incentives and other performance accountability mechanisms have influenced the activities and performance of local transit agencies.

    Agency: Department of Transportation
    Status: Open

    Comments: As of July 2017, FTA had published the final National Safety Plan and a final rule on state of good repair for transit assets. However, the final Public Transportation Agency Safety Plan rule is under additional review per the transition in administration. FTA does not expect publication until the end of this calendar year at the earliest. We will continue to monitor DOT actions pertaining to this rulemaking.
    Director: Farrell, Brenda S
    Phone: (202)512-3604

    4 open recommendations
    Recommendation: In future reviews of the civilian senior leader workforces, the Secretary of Defense should direct that the Office of the Under Secretary of Defense for Personnel and Readiness document the analysis conducted to provide supportable information about what DOD's requirements are for the Senior Executive Service, Senior Level, and Senior Technical workforces.

    Agency: Department of Defense
    Status: Open

    Comments: According to an official in the Defense Civilian Personnel Management Service's Civilian Senior Executive Management Division, the department will conduct a complete assessment of its Senior Executive Service, Senior Level, and Senior Technical workforces in late 2014 and early 2015 as required for the Office of Personnel Management's 2016 and 2017 biennial review of executive resources allocations process. According to the official, when the analysis is conducted it will be appropriately documented.
    Recommendation: To improve the management and development of DOD's civilian senior leader workforces, the Secretary of Defense should direct the Under Secretary of Defense for Intelligence to finalize and issue common criteria for the military service intelligence elements and the defense intelligence agencies to use in their assessments of Defense Intelligence Senior Executive Service requirements.

    Agency: Department of Defense
    Status: Open

    Comments: According to officials with the Office of the Under Secretary of Defense (Intelligence), Human Capital Management Office, development of common criteria for assessing and justifying Defense Intelligence Senior Executive Service workforce requirements has been completed. The officials explained that coordination, approval, and implementation of the criteria is pending publication of other related civilian senior leader policies by the Office of the Under Secretary of Defense (Personnel and Readiness).
    Recommendation: To improve the management and development of DOD's civilian senior leader workforces, the Secretary of Defense should direct the Under Secretary of Defense for Personnel and Readiness and the Under Secretary of Defense for Intelligence to better communicate key information, including justifications for each Defense Intelligence Senior Executive Service position needed, during the development and presentation of legislative proposals to congressional decision makers.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials with the Office of the Under Secretary of Defense (Intelligence), Human Capital Management Office, stated that since the Secretary of Defense 2010 Efficiency Initiatives, the defense intelligence community has not developed or presented any legislative proposals related to increases in the number of Defense Intelligence Senior Executive Service allocations. According to the officials, when the department's intelligence community does request additional Defense Intelligence Senior Executive Service allocations from the Congress, they will provide key information and justification along with the proposal.
    Recommendation: To improve the management and development of DOD's civilian senior leader workforces, the Secretary of Defense should direct the Office of the Under Secretary of Defense for Personnel and Readiness to establish clearly defined metrics for the Defense Senior Leader Development Program in order to measure the overall success of the program.

    Agency: Department of Defense
    Status: Open

    Comments: In August 2014, officials in DOD's Defense Civilian Personnel Management Service responsible for the department's Defense Senior Leader Development Program, stated that the metrics for measuring the success of the Defense Senior Leader Development Program were recently revised and are awaiting coordination and approval from the Office of the Under Secretary of Defense (Personnel and Readiness). The metrics are expected to be approved and implemented in fiscal year 2015.
    Director: St James, Lorelei
    Phone: (214)777-5719

    1 open recommendations
    Recommendation: To improve the management and oversight of the Low-Income Program, the Chairman of the FCC should conduct a robust risk assessment of the Low-Income Program.

    Agency: Federal Communications Commission
    Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
    Director: Mackin, Michele
    Phone: (202) 512-7773

    1 open recommendations
    Recommendation: To capitalize on the increase in knowledge gained by creating new baselines for Deepwater assets, and to better manage acquisitions of further assets and capabilities, the Commandant of the Coast Guard should complete, and present to Congress, a comprehensive review of the Deepwater Program that clarifies the overall cost, schedule, quantities, and mix of assets that are needed to meet mission needs and what trade-offs need to be made considering fiscal constraints, given that the currently approved Deepwater baseline is no longer feasible.

    Agency: Department of Homeland Security: United States Coast Guard
    Status: Open

    Comments: In providing comments on this report, the agency concurred with this recommendation but has not yet taken actions necessary to implement it. Since this report, DHS and the Coast Guard have each completed studies examining the mix of assets that composed the Deepwater Program. To date, the Coast Guard has not yet provided the Congress with a comprehensive review that clarifies the program's cost, schedule, quantities, and mix of assets or takes into account the Coast Guard's needs and available resources and makes recommendations about what trade-offs may be necessary. In 2015, we found that the Coast Guard is currently conducting a fleet-wide analysis, including surface, aviation, and information technology, intended to be a fundamental reassessment of the capabilities and mix of assets the Coast Guard needs to fulfill its missions. The Coast Guard is undertaking this effort consistent with direction from Congress. Specifically, the Coast Guard plans first to rewrite its mission needs statement and concept of operations by 2016. Then, it will use a complex model to develop the full fleet mix study. Based on this, the Coast Guard plans to recommend a set of assets that best meets these needs in terms of capability and cost. The Coast Guard plans to complete the full study in time to inform the fiscal year 2019 budget, though specific dates for these events have not been set forth. As of July 2016, the Coast Guard informed GAO that the modeling is complete and the CONOPS report is being developed with a target date of September 30 for completion.
    Director: Melvin, Valerie C
    Phone: (202)512-6304

    3 open recommendations
    Recommendation: To enhance VA's effort to successfully fulfill its forthcoming plans for the outpatient scheduling system replacement project and the HealtheVet program, the Secretary of Veterans Affairs should direct the CIO to ensure implementation of a requirements management plan that reflects leading practices for requirements development and management. Specifically, implementation of the plan should include analyzing requirements to ensure they are complete, verifiable, and sufficiently detailed to guide development, and maintaining requirements traceability from high-level operational requirements through detailed low-level requirements to test cases.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In written comments on our report, VA concurred with this recommendation and in August 2014, identified initial actions the department had taken in response. Specifically, as part of its plans to issue a request for proposals to acquire a replacement scheduling system under its Medical Appointment Scheduling System (MASS) project, VA developed a Business Requirements Document that defines its specific business needs, capabilities, features, and constraints. Additionally, the department reported that it intends to manage and document requirements using processes supported by a Web-based tool called Rational Doors. In August 2015, VA's Office of Acquisition, Logistics, and Construction awarded a contract for the MASS project. However, in April 2016, the department paused MASS to evaluate an alternative project to enhance its legacy scheduling system. Subsequently, in early 2017, the department restarted the MASS project. Nevertheless, as of June 2017, the department had not developed a requirements management plan for MASS. Thus, the MASS project has not yet reached the point where the effectiveness of the requirements management activities we recommended can be assessed.
    Recommendation: To enhance VA's effort to successfully fulfill its forthcoming plans for the outpatient scheduling system replacement project and the HealtheVet program, the Secretary of Veterans Affairs should direct the CIO to adhere to the department's guidance for system testing including (1) performing testing incrementally and (2) resolving defects of average and above severity prior to proceeding to subsequent stages of testing.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: In written comments on our report, VA concurred with this recommendation and stated that testing was managed using documented, repeatable processes that are included in the department's ProPath Web-based tool. According to the Acting Deputy Chief Information Officer for Product Development, the Medical Appointment Scheduling System (MASS) project is expected to incorporate Agile software development practices, including the use of incremental testing. In August 2015, the department awarded a contract for the MASS project that included task orders for the development of test plans. However, in April 2016, the department paused MASS to evaluate an alternative to enhance its legacy scheduling system. In early 2017, the department restarted the MASS project, but as of June 2017, had not developed a test plan for MASS. Thus, the project has not yet reached the point where adherence to the department's system testing guidance can be assessed.
    Recommendation: To enhance VA's effort to successfully fulfill its forthcoming plans for the outpatient scheduling system replacement project and the HealtheVet program, the Secretary of Veterans Affairs should direct the CIO to ensure that the policies and procedures VA is establishing to provide meaningful program oversight are effectively executed and that they include (1) robust collection methods for information on project costs, benefits, schedule, risk assessments, performance metrics, and system functionality to support executive decision making; (2) the establishment of reporting mechanisms to provide this information in a timely manner to department IT oversight control boards; and (3) defined criteria and documented policies on actions the department will take when development deficiencies for a project are identified.

    Agency: Department of Veterans Affairs
    Status: Open

    Comments: The Department of Veterans Affairs concurred with this recommendation and identified various actions it has taken in response. Specifically, the department awarded a contract for its Medical Appointment Scheduling System (MASS) project in August 2015. However, in April 2016, it paused MASS to evaluate an alternative to enhance its legacy scheduling system. In June 2017, VA reported that the MASS project had been resumed and indicated that it would adhere to the department's Veteran-focused Intake Process (VIP), which is intended to ensure oversight, accountability, and traceability of all program activity. Also, the department reported that MASS had met its first VIP milestone, Critical Decision 1, in January 2017. However, key future activities, including product development and testing, have not yet been demonstrated, while VIP milestones (e.g., Critical Decision 2), have not yet been met. Thus, MASS has not reached the point where the effectiveness of project oversight can be fully assessed.
    Director: White, James R
    Phone: (202)512-9039

    1 open recommendations
    Recommendation: Should the program be extended beyond 2009, to ensure that the maximum amount of capital ends up in low-income community businesses, Congress may wish to consider offering grants to CDEs that would provide the funds to low-income community businesses. If it does so, Congress may wish to require Treasury to gather appropriate data to assess whether and to what extent the grant program increases the amount of federal subsidy provided to low-income community businesses compared to the NMTC; whether the grant program otherwise affects the success of efforts to assist low-income communities; and how costs for administering the program incurred by the CDFI Fund, CDEs, and investors would change. One option may be for Congress to set aside a portion of funds to be used as grants and a portion to be used as tax credit allocation authority under the current structure of the program in a future allocation round to facilitate comparison of the two program structures.

    Agency: Congress
    Status: Open

    Comments: The Consolidated Appropriations Act of 2016 extended the NMTC through 2019 (Public Law 114-113). However, the act did not modify the program to include grants in lieu of credits, as GAO suggested in January 2010. The Joint Committee on Taxation estimates the cost of this extension to be approximately $2.6 billion. As of June 2017, Congress has not taken additional action that would address this matter for consideration.
    Director: Stephenson, John B
    Phone: (202)512-6225

    1 open recommendations
    Recommendation: Because EPA alone cannot address the complexities of the nation's challenges in addressing environmental health risks for children, Congress may wish to consider re-establishing a government-wide task force on children's environmental health risks, similar to the one previously established by Executive Order 13045 and co-chaired by the Administrator of EPA and the Secretary of Health and Human Services. Congress may wish to consider charging it with identifying the principal environmental health threats to children and developing national strategies for addressing them. Congress may also wish to consider establishing in law the Executive Order's requirement for periodic reports about federal research findings and research needs regarding children's environmental health.

    Agency: Congress
    Status: Open

    Comments: As of December 2016, we have not identified actions by the Congress to establish in law requirements such as those in EO 13025.
    Director: White, James R
    Phone: (202)512-5594

    1 open recommendations
    Recommendation: Congress may wish to consider providing IRS with math error authority (MEA) to use prior years' tax return information to automatically verify taxpayers' compliance with the limit on the number of years the Hope credit can be claimed.

    Agency: Congress
    Status: Open

    Comments: As of August 3, 2017, Congress has not provided IRS with math error authority (MEA) to use prior years' tax return information to automatically verify taxpayers' compliance with the limit on the number of years the Hope Scholarship Credit, now known as the American Opportunity Tax Credit (AOTC) can be claimed. The AOTC can be claimed by taxpayers for qualified tuition and related expenses for 4 years of postsecondary education. Under the Protecting Americans From Tax Hikes Act of 2015, IRS was granted MEA to disallow a claim for the AOTC if the taxpayer is not permitted to claim the credit due to prior fraudulent or reckless claims, or if the taxpayer omitted information relating to prior improper claims of the credit. IRS does not have authority to automatically deny an AOTC even if the taxpayer claims the credit for more than the 4 allowable years. GAO has in the past provided technical assistance to the House Solutions Caucus in drafting legislative language for a bill on extending MEA to use prior years' returns for verifying compliance with limits on the credit. In addition, the Administration has for many years included a revenue proposal in Treasury's Green Book to provide IRS with "correctable error authority" where the (1) information provided by the taxpayer does not match the information contained in government databases, (2) taxpayer has exceeded the lifetime limit for claiming the credit or deduction, or (3) taxpayer failed to include proper documentation with his or her return. If this revenue proposal was enacted, IRS would have the authority to deny claims for the AOTC if the taxpayer has already received the credit for 4 years.
    Director: Dinapoli, Timothy J
    Phone: (202)512-3000

    2 open recommendations
    Recommendation: To better inform acquisition decisions, assist DOD personnel in performing their management oversight responsibilities, and improve DOD's surveillance of services contracts, the Secretary of Defense should require before the award of any contract or issuance of task order for services closely supporting inherently governmental functions that program and contracting officials consider and document their assessment of the unique risks of these services and the steps that have been taken to mitigate such risks.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, DOD concurred with this recommendation and had initiated actions to provide additional guidance. As of September 2017, however, DOD has not provided additional guidance to its contracting officers on considering, documenting, and mitigating the risks associated when obtaining services closely associated with inherently governmental functions.
    Recommendation: To better inform acquisition decisions, assist DOD personnel in performing their management oversight responsibilities, and improve DOD's surveillance of services contracts, the Secretary of Defense should develop guidance to identify approaches that DOD should take to enhance management oversight when contractors provide services that closely support inherently governmental functions.

    Agency: Department of Defense
    Status: Open

    Comments: In providing comments on this report, DOD concurred with this recommendation and had initiated actions to provide additional guidance. As of September 2017, however, DOD has not provided additional guidance to its contracting officers on the steps they should take to enhance oversight of contractors providing services closely associated with inherently governmental functions.
    Director: White, James R
    Phone: (202) 512-9039

    2 open recommendations
    Recommendation: To better ensure the notice phase is achieving desired results at the lowest costs, the Commissioner of Internal Revenue should provide IRS collection managers and executives accessible, reliable information on what the business rules are.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS said in January 2016, that it planned to review current business rules and communicate clear guidance and documentation on business rules to appropriate IRS staff by July 2016. In October 2016, IRS provided documentation of some actions taken and planned, and noted it expects to provide additional business rules information in evaluations planned by June 2017. IRS confirmed this status in March 2017.
    Recommendation: To better ensure the notice phase is achieving desired results at the lowest costs, the Commissioner of Internal Revenue should periodically and regularly evaluate the business rules in terms of efficiency and effectiveness or other results and ensure the results are available to managers so the data and methodologies can be used or considered in future evaluations.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS said in January 2016, that it would conduct periodic reviews, update business rules if needed, and ensure follow-up for ad hoc evaluations by June 2017. In October 2016, IRS provided documentation of planned actions to periodically evaluate the business rules and communicate evaluation results and business rules information to appropriate IRS staff by June 2017. IRS confirmed this status in March 2017.
    Director: Gambler, Rebecca S
    Phone: (202)512-8816

    4 open recommendations
    Recommendation: To improve the reliability and accountability of checkpoint performance results to the Congress and the public, the Commissioner of Customs and Border Protection should establish internal controls for management oversight of the accuracy, consistency, and completeness of checkpoint performance data.

    Agency: Department of Homeland Security: Directorate of Border and Transportation Security: Bureau of Customs and Border Protection
    Status: Open

    Comments: In our review of Border Patrol traffic checkpoints, we found inconsistencies in the way field agents collected and entered performance data into the checkpoint information system. As a result, data reported in the system were unreliable. We recommended that Border Patrol establish internal controls to ensure the accuracy, consistency, and completeness of checkpoint performance data. In October 2009, the Border Patrol reported internal control solutions were underway, which would primarily involve upgrading its existing checkpoint data systems and creating a checkpoint data oversight protocol. In June 2013, Border Patrol reported that it was developing a redesigned checkpoint information system that should address the data errors and issues identified by our report. The agency also noted that it was exploring ways to implement a data oversight procedure and training on the importance of accurate data collection. In October 2014, the Border Patrol reported that the recommendation was being addressed in various phases, with a new expected completion date of March 2015. In June 2015, Border Patrol revised the expected completion date to September 2015. In September 2016, Border Patrol officials stated that the agency had not yet updated its checkpoint data system or created a data oversight protocol. Without established internal controls, the integrity of Border Patrol's performance and accountability system with regard to checkpoint operations remains uncertain.
    Recommendation: To improve the reliability and accountability of checkpoint performance results to the Congress and the public, the Commissioner of Customs and Border Protection should implement the quality of life measures that have already been identified by the Border Patrol to evaluate the impact that checkpoints have on local communities. Implementing these measures would include identifying appropriate data sources available at the local, state, or federal level, and developing guidance for how data should be collected and used in support of these measures.

    Agency: Department of Homeland Security: Directorate of Border and Transportation Security: Bureau of Customs and Border Protection
    Status: Open

    Comments: In our review of Border Patrol traffic checkpoints, we found that the Border Patrol had identified some measures to evaluate the impact that checkpoints have on local communities in terms of quality of life, but Border Patrol had not implemented the measures. As a result, the Border Patrol lacked information on how checkpoint operations could affect nearby communities. In October 2009, the Border Patrol reported that it was reevaluating its checkpoint performance measures, including quality of life measures. In June 2012, Border Patrol reported that the University of Arizona and the University of Texas, El Paso had completed a study for CBP on checkpoints. This study made several recommendations to Border Patrol on evaluating the impact of checkpoints on local communities using quantitative measures and with maintaining regular contact with the public to elicit opinions on experiences with the checkpoint, both positive and negative. At the time, the Border Patrol noted it intended to develop quantitative measures on community impact, such as on public safety and quality of life, using information collected in the new checkpoint information system it was planning. Border Patrol also noted that it was considering the budgetary feasibility of (1) conducting a survey of checkpoint travelers to gather detailed information about the community and impact metrics that are of highest importance to the public and (2) implementing an expedited lane for regular and pre-approved travelers. In July 2014, the Border Patrol revised the expected completion date for this recommendation to March 2015, noting that it planned to request ideas from the field commanders on what the agency could measure that would accurately depict the impact of checkpoints on the community. In June 2015, Border Patrol revised the expected completion date to September 2015. In September 2016, officials from Border Patrol's Checkpoint Program Management Office said quality of life measures had not been implemented and they were not aware of any plans to develop and implement such measures.
    Recommendation: To improve the reliability and accountability of checkpoint performance results to the Congress and the public, the Commissioner of Customs and Border Protection should use the information generated from the quality of life measures in conjunction with other relevant factors to inform resource allocations and address identified impacts.

    Agency: Department of Homeland Security: Directorate of Border and Transportation Security: Bureau of Customs and Border Protection
    Status: Open

    Comments: In our review of Border Patrol traffic checkpoints, we found that while the Border Patrol's national strategy cites the importance of assessing the community impact of Border Patrol operations, the implementation of such measures was lacking in terms of checkpoint operations. We recommended that Border Patrol implement such measures in areas of community concern to provide greater attention and priority in Border Patrol operational and staffing decisions to address any existing issues. In October 2009, the Border Patrol reported that once it had completed an upgrade of its existing checkpoint data systems and had reevaluated its checkpoint performance measures, the agency would begin using information garnered by these performance measures to inform future resource allocation decisions. This was originally expected to be completed by September 30, 2010, but due to budgetary and other issues, the checkpoint system upgrades were not yet completed as of June 2013. Border Patrol reported to us in June 2013 that the redesigned and upgraded checkpoint information system was expected to be implemented in September 2014. In July 2014, however, Border Patrol revised its expected completion date to March 2016. In June 2015, Border Patrol reported that it was on target to meet this March 2016 completion date. However, in September 2016, officials from Border Patrol's Checkpoint Program Management Office stated that they were not aware of any planned or completed actions to address this recommendation.
    Recommendation: To ensure that the checkpoint design process results in checkpoints that are sized and resourced to meet operational and community needs, the Commissioner of Customs and Border Protection should, in connection with planning for new or upgraded checkpoints, conduct a workforce planning needs assessment for checkpoint staffing allocations to determine the resources needed to address anticipated levels of illegal activity around the checkpoint.

    Agency: Department of Homeland Security: Directorate of Border and Transportation Security: Bureau of Customs and Border Protection
    Status: Open

    Comments: In our review of Border Patrol traffic checkpoints, we found that Border Patrol's checkpoint strategy to push illegal aliens and smugglers to areas around checkpoints-which could include nearby communities-underscores the need for the Border Patrol to ensure that it deploys sufficient resources and staff to these areas. We recommended that Border Patrol conduct a needs assessment when planning for a new or upgraded checkpoint in order to better ensure that officials consider the potential impact of the checkpoint on the community and plan for a sufficient number of agents and resources. In October 2009, Border Patrol reported that the agency was evaluating its checkpoint policy regarding the establishment of a new checkpoint or the upgrade of an old checkpoint, and checkpoint policy changes would be finalized by September 30, 2010. Border Patrol also reported that checkpoint system upgrades that capture data on checkpoint performance would help management determine future resource needs at checkpoints. In June 2013, Border Patrol reported that due to budget and other issues, the checkpoint system upgrade had not been completed, and the rewritten checkpoint data protocol had not been approved. In June 2013, Border Patrol reported that as part of the checkpoint study conducted by the DHS Centers of Excellence, the Centers created checkpoint simulation tools that would help inform resource allocations when determining the number of inspection lanes on current or new checkpoints. The Border Patrol agreed with the utility of such a model, but noted that the Border Patrol would need to purchase modeling software--a cost-prohibitive measure in the current budget environment. In the interim, Border Patrol is developing a formal workforce staffing model to identify staffing strategies for all Border Patrol duties. Border Patrol expected to implement this model for checkpoint staffing assignments in fiscal year 2014. However, in July 2014, Border Patrol reported that the Border Patrol Personnel Requirements Determination project was still being developed and would not be complete until 2015. That process will inform staffing at checkpoints. As a result, Border Patrol revised its expected implementation date to September 2015. In June 2015, Border Patrol reported that it was on target to implement this recommendation by September 2015. In September 2016, Border Patrol officials reported that the agency's Personnel Requirements Determination process would not provide information on staffing needs until fiscal year 2017 or 2018, and also noted that this effort is not specifically examining staffing needs at checkpoints. Officials said there could be additional ways to address the recommendation, but that there were no ongoing efforts to do so apart from any information that may be available from the Personnel Requirements Determination process.
    Director: Herr, Phillip R
    Phone: (202) 512-8509

    3 open recommendations
    Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to meet standards set forth in previous GAO work, based on the Government Performance and Results Act of 1993, and develop performance measures to assess: (1) the outcomes of the triennial review program, such as a method for evaluating improvements in grantee performance in meeting more federal requirements over time (2) and the quality of the triennial review through improved contractor oversight, testing, or inspection.

    Agency: Department of Transportation
    Status: Open

    Comments: Federal Transit Administration (FTA) responded to our recommendations stating that it plans to improve the quality of oversight reviews. Actions aimed to improve quality are: (1) increasing oversight of contractors by emphasizing regional and headquarters' participation in all on-site triennial reviews and (2) increasing annual oversight conference participation and quarterly review workshops that focus on improving performance measures. These activities were to be specified in new procedures coming out in 2011.
    Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA Administrator to improve the objectivity and reliability of the "Close Findings Timely" performance measure by: (1) developing an internal controls process to verify grantees have satisfactorily resolved findings before closing them (2) continuing to emphasize the use of OTRAK across all regions and developing a process to close out triennial reviews in OTRAK upon grantees' completion of corrective actions.

    Agency: Department of Transportation
    Status: Open

    Comments: Federal Transit Administration (FTA) is working to strengthen the internal control process for closing out triennial review findings. Specifically, it is drafting operating procedures indicating that (1) the regional offices have the primary responsibility to provide the necessary technical assistance to grantees to close-out findings as well as ensure the findings are not closed-out prematurely and (2) program managers have a secondary responsibility to verify whether the findings were closed out properly. The procedures were to be issued in October 2010.
    Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA to ensure that additional outcome and quality performance measures are balanced with the existing measures for assessing the timeliness of the triennial review program so that one priority is not emphasized at the expense of others.

    Agency: Department of Transportation
    Status: Open

    Comments: Federal Transit Administration (FTA) anticipates adding a performance measurement, called reduction in repeat findings, that relates to assessing the quality of the review. FTA officials told us that this new performance measurement is noncontroversial and was to be discussed at a June 2012 Oversight Meeting.
    Director: Clark, Cheryl E
    Phone: (202)512-9521

    1 open recommendations
    Recommendation: The IRS should direct the appropriate IRS officials to establish procedures requiring that each physical security analyst conduct a periodic documented review of the Emergency Signal History Report and emergency contact list for its respective location to ensure that (1) appropriate corrective actions have been planned for all incidents reported by the central monitoring station and (2) the emergency contact list for each location is current and includes only appropriate contacts.

    Agency: Department of the Treasury: Internal Revenue Service
    Status: Open

    Comments: IRS's efforts to address this recommendation are ongoing. In August 2016, IRS updated the IRM to require that (1) corrective actions are planned for all incidents reported by the central monitoring station and (2) the emergency contact list for each location is current and includes only appropriate contacts. IRS stated that in fiscal year 2017 it will update procedures and provide training to employees to help ensure that the updates to the guidance are communicated to affected employees. We will continue to evaluate IRS's corrective actions during our fiscal year 2017 audit.
    Director: White, James R
    Phone: (202) 512-5594

    1 open recommendations
    Recommendation: Given the potential for improving compliance now and in the future, Congress may wish to provide IRS with the authority to use math error checks to identify and correct returns with ineligible (1) IRA "catch-up" contributions, and (2) contributions to traditional IRAs from taxpayers over age 70-1/2.

    Agency: Congress
    Status: Open

    Comments: As of April 2017, the Congress has not provided IRS with the math error authority to ensure that taxpayers comply with certain catch-up and contributions requirements.
    Director: Shames, Lisa R
    Phone: (202)512-2649

    5 open recommendations
    Recommendation: To better ensure sufficient oversight and management direction are provided to guide USDA's civil rights efforts, to make responsibility for improvement clear, and to make USDA's performance more transparent, Congress may wish to consider making USDA's Assistant Secretary for Civil Rights subject to a statutory performance agreement.

    Agency: Congress
    Status: Open

    Comments: As of September 2013, action on a new farm bill is pending and it is not known whether Congress will make the Assistant Secretary subject to a performance agreement.
    Recommendation: To better ensure sufficient oversight and management direction are provided to guide USDA's civil rights efforts, to make responsibility for improvement clear, and to make USDA's performance more transparent, Congress may wish to consider establishing a USDA civil rights oversight board.

    Agency: Congress
    Status: Open

    Comments: As of September 2013, action on a new farm bill is pending and it is not known whether Congress will establish a USDA civil rights oversight board.
    Recommendation: To improve USDA efforts to address civil rights issues and the participation of minority farmers and ranchers in USDA programs, the Secretary of Agriculture should prepare and implement an improvement plan for resolving discrimination complaints that sets time frame goals and provides management controls for resolving complaints from beginning to end.

    Agency: Department of Agriculture
    Status: Open

    Comments: USDA has not fully implemented this recommendation. As of August 2012, USDA had developed a plan to improve resolution of discrimination complaints, and the Office of the Assistant Secretary for Civil Rights (OASCR) had implemented many of the plan's actions, such as placing priority on processing program complaints facing the statute of limitations. However, USDA had more work to do on (1) establishing an electronic records management system; (2) implementing the Lean Six Sigma (LSS) process; (3) conducting pilot efforts to explore establishing new time frame goals for intake, investigation, and adjudication activities to resolve employee and program complaints; and (4) providing documentation of new policies, procedures, guidance, and training needed to determine if new management controls cover the entire process for resolving complaints. As of September 2013, OASCR's electronic complaints management systems allow OASCR to scan in, store, and retrieve multiple records in a searchable environment. OASCR undertook a review of the program complaint process through LSS, and based on the results, extended the scope of the review to include the employment complaint process. OASCR implemented core changes through LSS that identify efficiencies to reduce time frames. OASCR has established time frame goals for processing program complaints; however, it has yet to establish them for investigating and adjudicating employment complaints. Time frame goals for the entire employment complaint resolution process would have to be final before management controls can be made final.
    Recommendation: To improve USDA efforts to address civil rights issues and the participation of minority farmers and ranchers in USDA programs, the Secretary of Agriculture should develop and implement a plan to ensure the accuracy, completeness and reliability of ASCR's databases on customer and employee complaints, and that provides for independent validation of ASCR's data quality.

    Agency: Department of Agriculture
    Status: Open

    Comments: USDA has not fully implemented this recommendation. As of August 2012, the Office of the Assistant Secretary for Civil Rights' (OASCR) efforts to ensure data reliability of the iComplaints employee complaints database included a comprehensive set of business rules, a data integrity tool, and a quality review management module. Also, OASCR had developed and was implementing a plan to check the accuracy of the data entered for every program complaint in the Program Complaints Management System (PCMS). However, OASCR had not provided all of the documentation needed to assess whether its planned efforts contain key elements to ensure the accuracy, completeness, and reliability of the iComplaints and PCMS databases. For example, OASCR officials had neither provided documentation showing that the office developed departmental policy to ensure the consistent use of iComplaints and PCMS nor training to ensure the completeness of data in PCMS. As of September 2013, OASCR officials provided standard operating procedures (SOPs) for processing program complaints, which include numerous steps to ensure the consistent use of PCMS. OASCR officials also provided SOPs for processing employment complaints; however, the SOPs have not been finalized for the investigation and adjudication phases of the processing and are therefore insufficient to ensure the consistent use of iComplaints. OASCR officials did provide documentation showing that OASCR has established a formal training program to ensure that OASCR and USDA civil rights practitioners are trained in the proper use of PCMS and iComplaints. In addition, the PCMS Data Integrity Team is working to correct discrepancies found as of October 2012. This effort is 85 percent complete.
    Recommendation: To improve USDA efforts to address civil rights issues and the participation of minority farmers and ranchers in USDA programs, the Secretary of Agriculture should develop a results-oriented department-level strategic plan for civil rights at USDA that unifies USDA's departmental approach with that of ASCR and the newly created Office of Advocacy and Outreach and that is transparent about USDA's efforts to address the concerns of stakeholders.

    Agency: Department of Agriculture
    Status: Open

    Comments: USDA has not fully implemented this recommendation. As of August 2012, the Office of the Assistant Secretary for Civil Rights (OASCR) had not updated its strategic plan since our report was issued in October 2008. From October 1, 2009, to November 20, 2011, OASCR was placed under Departmental Management and during that time was not required to develop or update its own strategic plan, according to OASCR officials. Since November 20, 2011, OASCR has reported directly to the Secretary and has been working to develop its own strategic plan. On July 31, 2012, we obtained a revised draft of OASCR's strategic plan that covers fiscal years 2011-2015. This draft still has a number of shortcomings. For example, it (1) focuses primarily on the activities OASCR plans and does not unify OASCR's approach with the Office of Advocacy and Outreach, other USDA agencies, or the department as a whole; (2) does not describe the viewpoints and interests of USDA's external stakeholders, such as community-based organizations; and (3) does not fully address other key issues identified in our report, such as measuring performance to gauge progress, using performance information for identifying performance gaps and making program improvements, and identifying external and internal factors that can influence the achievement of its long-term goals. As of September 2013, OASCR had, by November 2012, finalized and published its strategic plan for fiscal years 2011-2015. The published plan includes some time frame goals for processing program and employment complaints, but these goals are incomplete. The published plan also includes some minor editorial changes, but otherwise, it was almost identical to the draft plan we reviewed in July 2012 and still has the same shortcomings that we identified at that time.
    Director: Herr, Phillip R
    Phone: (202)512-8984

    2 open recommendations
    Recommendation: To improve the effectiveness of the federal investment in surface transportation, meet the nation's transportation needs, and ensure a sustainable commitment to transportation infrastructure, Congress may wish to consider reexamining and refocusing surface transportation programs to be responsive to these principles so that they institute tools and approaches to that emphasize the return on the federal investment.

    Agency: Congress
    Status: Open

    Comments: Congress has not yet acted on this recommendation. The Fixing America's Surface Transportation Act (FAST Act; P.L. 114-94), signed into law in December 2015, is due to be reauthorized in fiscal year 2021.
    Recommendation: To improve the effectiveness of the federal investment in surface transportation, meet the nation's transportation needs, and ensure a sustainable commitment to transportation infrastructure, Congress may wish to consider reexamining and refocusing surface transportation programs to be responsive to these principles so that they address the current imbalance between federal surface transportation revenues and spending.

    Agency: Congress
    Status: Open

    Comments: Congress has not yet acted on this recommendation. The Fixing America's Surface Transportation Act (FAST Act; P.L. 114-94), signed into law in December 2015, did not address the current imbalance between federal surface transportation revenues and spending. The Act is due to be reauthorized in fiscal year 2021.
    Director: Goldenkoff, Robert N
    Phone: (202)512-6794

    1 open recommendations
    Recommendation: To improve the Bureau's recruiting, hiring, and training of temporary field staff, the Secretary of Commerce should direct the Director of the U.S. Census Bureau to modify recruiting and hiring tools, including the skills test and phone interview, to better differentiate applicants with the skills and competencies needed by crew leaders from those who would be better suited for other field positions.

    Agency: Department of Commerce
    Status: Open

    Comments: During April 2011, the Bureau reported on actions taken to modify recruiting and hiring tools. As of May 2014, the Bureau had drafted its 2020 Workforce Action Plan that will inform its decisions on managing human capital for 2020. The plan is expected to inform a variety of hiring and recruiting activities, including conducting a skills analysis for research and testing projects. We met with Bureau officials in August 2016 to discuss efforts they may have used in the 2016 Census Test in response to this recommendation. We discussed the status of this recommendation with Bureau officials in July 2017, and we await supporting documentation on possible actions taken.
    Director: Daly, Kay L
    Phone: 2025124063

    1 open recommendations
    Recommendation: To better understand the relationship of costs and revenues related to fees SSA collects for administering state SSI supplementation programs, the Commissioner of SSA should direct appropriate officials to study those costs to determine the full cost, including the cost of services provided by other entities for the benefit of SSA.

    Agency: Social Security Administration
    Status: Open

    Comments: SSA is continuing with the roll out of the Employee Office Sampler to all field offices across the nation. According to SSA, this tool removes the manual aspect of the District Office Work Sampling process. A decision was made by SSA to update the Standard Time Values (STVs) used for costing out the full cost SSA incurs for processing state Social Security Insurance claims. SSA stated that it completed these studies in fiscal year 2012 and placed the new STVs into its Cost Analysis System for use in fiscal year 2013. According to SSA, this update allows SSA to more accurately capture the full cost of this work for the agency. In December 2016, SSA stated that it has completed the roll out of the Employee Office Sampler (EOS) to the field offices in the fourth quarter of fiscal year 2016. The Office of Financial Policy and Operations is currently working on a proposal for the IT Investment Process (ITIP) to roll out the EOS to the remaining operational components, targeted for early 2017.
    Director: Daly, Kay L
    Phone: 2025124063

    2 open recommendations
    Recommendation: To help ensure that Transportation components implement reliable cost accounting methodologies for use in managerial decision making in accordance with departmental objectives, the Secretary of Transportation should direct appropriate department officials to finalize and issue a policy for implementing MCA departmentwide.

    Agency: Department of Transportation
    Status: Open

    Comments: Transportation initiated a major, multi-year department-wide program to re-engineer their financial processes, including cost accounting. Because of the complexity of cost accounting and the complications of the next release of their financial software, Transportation has told us that cost accounting is scheduled as a future process to be reviewed. As a result, Transportation has not yet implemented this recommendation to finalize and issue a policy for implementing MCA departmentwide.
    Recommendation: To help ensure that Transportation components implement reliable cost accounting methodologies for use in managerial decision making in accordance with departmental objectives, the Secretary of Transportation should direct appropriate department officials to finalize and issue formal procedures, revised as necessary, to monitor implementation of that policy and establish a sound system of controls.

    Agency: Department of Transportation
    Status: Open

    Comments: Transportation initiated a major, multi-year department-wide program to re-engineer their financial processes, including cost accounting. Because of the complexity of cost accounting and the complications of the next release of their financial software, Transportation has told us that cost accounting is scheduled as a future process to be reviewed. As a result, Transportation has not finalized or issued a policy for implementing MCA departmentwide.
    Director: Fleming, Susan A
    Phone: 2025128984

    4 open recommendations
    Recommendation: To improve Amtrak's efforts in addressing financial management challenges and better support management decision making, the president of Amtrak should perform a comprehensive risk assessment of financial reporting processes that support preparation of monthly performance reports and the RPI, to include determining areas of vulnerability, implementing appropriate compensating and mitigating internal controls, and ongoing monitoring to ensure compliance.

    Agency: National Railroad Passenger Corporation
    Status: Open

    Comments: GAO is continuing to work with Amtrak to obtain information on the status of this recommendation and will update provide updates as available.
    Recommendation: To improve Amtrak's efforts in addressing financial management challenges and better support management decision making, the president of Amtrak should document policies and procedures related to controlling the information in the monthly performance reports, including the RPI. The policies and procedures should cover how expenses are allocated to Amtrak's routes, as well as specific guidance on documenting the justification and authorization of changes made to allocation methods.

    Agency: National Railroad Passenger Corporation
    Status: Open

    Comments: We will continue to work with Amtrak to obtain information about the status of this recommendation and will provide updates as available.
    Recommendation: To improve Amtrak's efforts in addressing financial management challenges and better support management decision making, the president of Amtrak should develop a comprehensive action plan for immediately implementing preventive controls to enhance the reliability of financial data and address the reportable condition over accounting for capital assets in the most recent reports and letters of comment from the independent public accountant.

    Agency: National Railroad Passenger Corporation
    Status: Open

    Comments: We will continue to work with Amtrak to obtain information about this recommendation and will provide updates as available.
    Recommendation: To ensure that Amtrak can better meet the challenge of increasing its efficiency and reducing its operating costs, the president of Amtrak should establish efficiency and unit cost measures with clear inputs to benchmark individual asset and corporate productivity, which will demonstrate efficient use of Amtrak's resources.

    Agency: National Railroad Passenger Corporation
    Status: Open

    Comments: We will continue to work with Amtrak to obtain information about the status of this recommendation and will provide updates as available.
    Director: Goldstein, Mark L
    Phone: (202)512-3000

    1 open recommendations
    Recommendation: Given the critical importance of telecommunications technologies to schools and libraries, the Chairman of the Federal Communications Commission should direct FCC staff to establish performance goals and measures for the E-rate program that are consistent with the Government Performance and Results Act. FCC should use the resulting performance data to develop analyses of the actual impact of E-rate funding and to determine areas for improved program operations.

    Agency: Federal Communications Commission
    Status: Open

    Comments: In an August 2007 order, FCC adopted two performance measures for the E-rate program, one for Internet connectivity and the other for application processing. The order did not include specific E-rate program goals, although FCC said in this order that it anticipated adopting performance goals as it and USAC gained experience with the performance measures. While FCC's efforts to develop performance measures have the potential to eventually produce better information than is currently available on E-rate program performance, these measures fall short when compared to the key characteristics of successful performance measures and FCC still has not established program goals. FCC says it is still working on developing goals and performance measures for the Universal Service programs.
    Director: Shear, William B
    Phone: (202)512-8678

    2 open recommendations
    Recommendation: To better address the purpose of the 8(a) program, meet the needs and expectations of the firms in the program, and improve SBA's ability to determine how well the program is working, the Administrator, SBA, should periodically perform a nationwide sample survey of 8(a) firms to obtain measurable program data. At a minimum, the survey should assess whether SBA assistance is meeting the firms' expectations and needs.

    Agency: Small Business Administration
    Status: Open

    Comments: SBA drafted a plan for providing individualized business development assistance to 8(a) firms, along with an assessment tool--the 8(a) Business Development Assessment Tool (BDAT). A subsequent evaluation of BDAT revealed that the tool would not provide the expected outcome. Consequently, the Office of Government Contracting and Business Development launched a more broad modernization effort in December of 2011. One of the outcomes of that effort was the conceptualization of the One Track Certification Management System (One Track CMS), which included many of the requirements from the BDAT. However, SBA experienced some delays regarding the contract for development and the ultimate implementation of the One Track CMS. On June 3, 2015, SBA and GAO staff met to discuss the status of open SBA 8(a) program recommendations. This recommendation was mentioned, but, no updates on the current status of this recommendation were provided. The One Track CMS was not yet operational as of the date of that meeting.
    Recommendation: To better address the purpose of the 8(a) program, meet the needs and expectations of the firms in the program, and improve SBA's ability to determine how well the program is working, the Administrator, SBA, should provide a method for collecting data on each firm's training needs for tracking the assistance provided.

    Agency: Small Business Administration
    Status: Open

    Comments: With the deployment of the Business Development Management Information System on July 28, 2008, along with an 8(a) Business Development Assessment Tool (BDAT)--which will entail an enhancement of SBA's Business Development Management Information System--SBA stated that it will be able to annually collect data that will be used to assess an 8(a) participant's needs for technical assistance and training. A subsequent evaluation of BDAT revealed that the tool would not provide the expected outcome. Consequently, the Office of Government Contracting and Business Development launched a more broad modernization effort in December of 2011. One of the outcomes of that effort was the conceptualization of One Track Certification Management System (One Track CMS), which included many of the requirements from the BDAT. However, SBA experienced some delays regarding the contract for development and the ultimate implementation of the One Track CMS. On June 3, 2015, SBA and GAO staff met to discuss the status of open SBA 8(a) program recommendations. This recommendation was mentioned, but no updates on the current status of this recommendation were provided. The One Track CMS was not yet operational as of the date of that meeting.