Recommendation: To the extent that Congress wants to further encourage federal agencies to use tribal energy sources, it should consider amending the Energy Policy Act of 2005 to provide more specific direction to federal agencies for implementing the tribal energy preference, to include consideration of additional incentives or requirements to use these energy sources. (Matter for Consideration 1)

Agency: Congress
Status: Open

Comments: We will provide updated information when we confirm what steps Congress has taken related to this matter.

Recommendation: The Secretary of Labor should direct its subagencies, other than ETA, to design and implement a process to manage and administer grantees' compliance with the Stevens Amendment, including determining to what extent to provide guidance to grantees on calculations. (Recommendation 1)

Agency: Department of Labor
Status: Open

Comments: In responding to the report, DOL stated that it concurs with the recommendation. DOL's subagency, OSHA, provided written comments and stated that it generally agreed with GAO's recommendation. On March 3, 2020, DOL staff said the agency will provide an update to its response to this recommendation, along with responses to open recommendations from other GAO reports, in several months.

Recommendation: The Secretary of Education should design and implement a process to manage and administer grantees' compliance with the Stevens Amendment, including determining to what extent to provide guidance to grantees on calculations. (Recommendation 3)

Agency: Department of Education
Status: Open

Comments: In a subsequent response to the report, Education stated that it concurred with GAO's recommendation and is considering enhancing its current approach to overseeing compliance with the Stevens Amendment through post-award monitoring activities. On March 9, 2020, an Education Department Official stated that the planned date that work is due to be completed by the applicable program office is 9/30/2020. According to the official, the work will promote consistency across applicable grant programs and enhance their monitoring efforts. The official further stated that Education will develop general monitoring guidance to further check on compliance with the Stevens Amendment for implementation across Education's grantmaking Principal Offices. As a part of monitoring, program offices will be expected to review the Stevens Amendment statutory requirements with grantees and plans to reiterate that grantees are required to disclose for their grant project the percent of the costs financed with federal funds, the federal dollar amount, and the percentage and dollar amount financed by nongovernmental funds when issuing statements, press releases, bid solicitations, and other documents describing their grant project. Education also plans to remind grantees that they must document how the dollar amounts and percentages were calculated in the disclosures and maintain this documentation with their grant file. We will update the action taken in response to this recommendation when further action is confirmed.

Recommendation: The Director of OMB, working with CFOC, should (1) collect data metrics regularly on the Career Roadmap Builder online tool and Grants Training 101 to determine how widely the resources are being used, and (2) obtain periodic feedback from federal agencies on the usefulness of these tools and any needed improvements. (Recommendation 2)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: OMB staff provided us with oral comments stating that the agency partially concurred with our recommendations. For our second recommendation, OMB agreed that user feedback data regarding the Career Roadmap Builder and Grants Training 101 is useful. However, OMB stated that while it will continue to collect data on the number of users, it believes that federal agencies should be responsible for collecting specific, detailed user data if they are using those resources. We continue to believe that OMB and CFOC would benefit from collecting specific, detailed user data on these tools, which they devoted time and multiple resources to developing. Collecting detailed data metrics that go beyond the number of users can help OMB and CFOC to better evaluate the effectiveness of these grants training tools. Additionally, OMB stated the agency is committed to working with CFOC to review the Grants Training 101 module to determine how useful it is and if any improvements or adjustments are needed. In May 2019, OMB staff said that no action had been taken to date in response to this recommendation. In January 2020, OMB responded in writing to this recommendation stating that it was continuing to collect data on usage for both training tools on the CFO.gov site. OMB specified, however, that the usage data was for the number of visitors on the two sites and on users by agency. OMB went on to say that each agency is responsible for the professional development of its own workforce, and that Federal agencies can, at their discretion, collect user data if the Roadmap and Grant Training 101 are part of their official training program. In addition, OMB stated it had made the Grants Training 101 available publicly for federal and non-federal personnel on CFO.Gov, and that collecting specific user data is not considered by them to be beneficial to demonstrate the usefulness of the materials. Based on this response, we will continue to inquire as to the availability and use of metrics and effectiveness measures for the Career Roadmap and the Grants Training 101 modules.

Recommendation: The Secretary of HHS should establish a process to monitor and evaluate HHS's grants training at the central office level. This process should include (1) a method for identifying all employees working on grants across the agency, and (2) oversight procedures to evaluate the sufficiency of sub-agencies' grants training efforts including the incorporation of leading practices related to assessing competencies, training approaches, accountability, and training results. (Recommendation 3)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS concurred with our findings and recommendation. In its comment letter, HHS stated that its Office of Grants Policy, Oversight, and Evaluation, within the Office of Grants and Acquisition Policy and Accountability, Division of Grants, in conjunction with the HHS ReInvent Grants Initiative would be developing and implementing a department-wide financial assistance training and certification program to improve the functional effectiveness of the financial assistance management workforce in the areas of internal controls and risk mitigation. The program is designed to support the professional development of the HHS grants management workforce through both instructor-led and online courses. HHS' ReInvent Grants Management (RGM) staff and GAO held a conference call on November 30th, 2018 to discuss how RGM intended to address the recommendation in GAO-18-491 by developing a generalized framework for the Grants Management Training and Certification (GMTC) program for HHS. An HHS official reported that at its December 2019 quarterly meeting, the HHS Division of Workforce Development (DWD) reported they had in the past quarter: briefed the HHS Executive Committee on Grants Administration Policy (ECGAP) on the DWD mission and goals for training the grants workforce; developed briefing documents and presentations based on a RGM developed framework to develop competencies and outline curriculum of the GMTC program; continued to review and refine the program framework to incorporate DWD mission and goals; drafted the initial policy to further inform the structure and procedures of the GMTC program (e.g. certification levels, required coursework, career development requirements), which should be issued by HHS Office of Grants within Federal Fiscal Year 2020; and collaborated with the HHS Grants Closeout Business Process Reengineering Team to discuss current grants closeout status and how DWD can support grant staff and grant recipient closeout training efforts. Given the ongoing nature of HHS efforts, GAO will continue to monitor progress on a quarterly basis.

Recommendation: The FTA Administrator should initiate a rulemaking regarding the evaluation and rating process for Core Capacity Improvement projects, consistent with statutory provisions. (Recommendation 1)

Agency: Department of Transportation
Status: Open

Comments: As of March 2020, DOT indicated that the Department was working to determine what actions it will take regarding initiating a rulemaking. When we confirm what actions DOT has taken in response to this recommendation, we will provide updated information.

Recommendation: The FEMA Assistant Administrator for Recovery, in coordination with the Associate Administrator of the Federal Insurance and Mitigation Administration, should develop performance measures and associated objectives for the new delivery model to better align with FEMA's strategic goal for hazard mitigation in the recovery process. (Recommendation 5)

Agency: Department of Homeland Security: Directorate of Emergency Preparedness and Response: Federal Emergency Management Agency: Office of Response and Recovery: Assistant Administrator for Recovery
Status: Open

Comments: FEMA concurred with this recommendation and said it would take steps to implement it. As of September 2018, officials reported completing activities to develop disaster-specific mitigation performance measures that align with strategic goals and analyzed available data to identify the drivers of mitigation in events of various sizes. Due to hiring delays associated with the establishment of the 406 Mitigation Branch, officials have extended the expected completion date for all actions, including proposing refined performance measures to FEMA senior leadership, to the end of January 2019. As of December 2019, GAO is awaiting a response from FEMA on their progress completing these actions.

Recommendation: To help ensure that the pilot programs for disconnected youth can be effectively implemented over the lifetime of the initiative, the Director of OMB should coordinate with relevant federal agencies to identify and estimate expected annual financial and staff resource contributions from each agency, including during the implementation and evaluation phases of the pilots.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: As of May 2020, the Office of Management and Budget (OMB) and relevant federal agencies described steps they have taken that could address the intent of this recommendation. However, they have not yet shared documentation so that we can independently verify those actions. Since we issued our report in April 2017, federal agencies discontinued contributing financial resources to support joint pilot program activities, such as start-up grants, general technical assistance, or evaluations. According to OMB staff and officials at several agencies in August 2018, that change in contributions began with the fiscal year 2018 pilots. At that time, they all told us that relevant agencies would continue to provide staff support to the pilots, as needed. In April 2020, officials from the Department of Education (Education)-the lead agency for overall performance partnership efforts-informed us that six pilots remain active, through September 2020, and were able to provide information about staff resource contributions. For example, Education officials told us that two of the department's employees devote less than 10 percent of their time to support those six pilots. We have requested additional information from Education to better understand staff resource commitments and contributions from other agencies involved in those six pilots.

Recommendation: To ensure that federal agencies involved in the disconnected youth pilots are able to evaluate pilot outcomes and ultimately communicate to Congress whether and to what extent the flexibilities tested by the pilots should be integrated into broader efforts, the Director of OMB should coordinate with relevant federal agencies to identify criteria or standards for assessing scalability, and collect data needed to address those criteria or standards.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: As of May 2020, the Office of Management and Budget (OMB) and relevant federal agencies described steps they have taken that could address this recommendation. However, they have not yet shared documentation so that we can independently verify those actions. In August 2018, OMB staff told us that they were coordinating relevant work with the Department of Health and Human Services (HHS) and the Department of Labor (DOL), which is leading the national evaluation for the disconnected youth pilot programs. OMB staff told us this group was studying specific criteria or standards that could be used for assessing the scalability of the disconnected youth pilot programs. In April 2020, DOL officials told us that the department was examining issues related to scalability in products it is developing as part of the national evaluation. For example, the officials informed us that DOL plans to publish a report in summer 2020 that examines the effects of flexibilities tested by individual pilot programs, and their potential to be scaled. Furthermore, DOL officials told us that the department, in coordination with OMB, HHS, and other relevant agencies, had drafted, but not yet finalized, a memorandum that identifies criteria for assessing scalability. We have requested copies of relevant DOL evaluation products and the memorandum. When provided, we will assess the extent to which they address our recommendation.

Recommendation: As NIH-DFAS begins formalizing its internal guidance, the Director of NIH-DFAS should establish a mechanism for tracking key milestones in the indirect cost rate-setting process, such as when indirect cost rate proposals are due.

Agency: Department of Health and Human Services: Public Health Service: National Institutes of Health: Office of Management: Office of Acquisition and Logistics Management: Office of Acquisition Management and Policy: Division of Financial Advisory Services
Status: Open

Comments: HHS concurred with this recommendations. In response, HHS stated that National Institute of Health's Division of Financial Advisory Services (DFAS) will establish a mechanism for tracking key milestones in the indirect cost rate-setting process. NIH-DFAS has initiatives underway that include moving from paper to electronic submissions of indirect cost proposals and developing a replacement to its Commercial Rate Agreement Distribution Services website. DFAS is looking into the feasibility of incorporating key milestones into these two major initiatives. NIH-DFAS is currently working with a contractor to develop a web based system that will establish a tracking system to account for when indirect cost proposal are due from organizations. The original initiative to enable the electronic submission of indirect cost proposals was modified to incorporate this new requirement. NIH-DFAS anticipates the planned date for implementation of this system to be October 1, 2017. As of February 4, 2020, this recommendation is still open because DFAS does not have the "proposal due date" and "extension due date" data fields activated in eFLow. DFAS is looking into adding those enhancements and hope to have these updates implemented by June 30, 2020. On July 8th, 2020, NIH-DFAS notified us that they plan to update us with the status of this recommendation by October 2020. We will continue to monitor the status of this recommendation.

Recommendation: In order to ensure complete, analyzable records regarding research grant award decisions are available for management and analysis, the Secretary of Energy should direct DOE's grant-making agencies to implement additional data collection efforts, which should include: (1) Retaining complete records of pre-proposal, proposal, and award data, including a record of proposal disposition, in linked electronic files to facilitate aggregate, statistical analysis of the grant-making process, including the calculation of success rates. (2) Collecting demographic, education, and career information from applicants, on a voluntary basis, that is not available to proposal reviewers but is used for analysis of success rates.

Agency: Department of Energy
Status: Open

Comments: DOE generally agreed with this recommendation. DOE's Office of Science began collecting investigator demographics during the second quarter of fiscal year 2015 and already retained complete records that enabled the calculation of success rates. According to DOE officials, since September 2017, the other three grant-making components included in our audit have been taking various actions to implement the recommendation. These three components, the Office of Nuclear Energy (NE), the Advanced Research Projects Agency-Energy (ARPA-E), and the Office of Energy Efficiency and Renewable Energy (EERE), all complete steps to ensure that they retain complete grant life cycle information for each individual award, including complete records of pre-proposal, proposal, and award data in linked electronic files, thus fulfilling the first part of our recommendation. In 2019, EERE coordinated the development of a Federal Register Notice (FRN) regarding data collection jointly with NE and ARPA-E. The FRN drafted by EERE was finalized and published on February 11, 2020 (Vol. 85, Issue 28, Pages 7759-7760 [FR DOC# 2020-02674]). Under the proposed information collection request, an interface will be implemented in DOE grant application systems to allow external users to voluntarily provide a minimal amount of demographic information to comply with this recommendation, pursuant to review by the Office of Management and Budget. On June 30th, DOE officials shared with GAO the draft FRN for the 30-day notice and request for public comment prior to implementation.

Recommendation: To comply with Title IX enforcement requirements, the Secretary of the Department of Defense, which funds STEM research at universities, should direct the Director of the Office of Diversity Management and Equal Opportunity to ensure that Title IX compliance reviews of DOD's grantees are periodically conducted.

Agency: Department of Defense
Status: Open

Comments: DOD agreed with this recommendation and noted it is in the process of revising current DOD guidance which will address its Title IX enforcement requirements. In September 2017, a DOD official stated that the agency is in the process of formulating instructions related to both Title IX and Title VI that they believe will address the recommendation regarding Title IX enforcement. In a memorandum issued in December 2017, a DOD official described the agency's corrective action plan (CAP), including drafting an updated rule for the Code of Federal Regulations and the development and issuance of internal DOD policy documents regarding Title IX enforcement requirements. Both of these activities were expected to be completed by June 2019. DOD reported in March 2020 that it is continuing to revise current DOD guidance to address its Title IX enforcement requirements. The Director of DOD's Office of Diversity, Equity, and Inclusion (ODEI) stated in a letter to GAO that the revised Titile IX policy is in the early stages of DOD's policy process. ODEI expressed its commitment to developing the revised policy and ensuring Title IX compliance reviews are conducted as per the revised policy and GAO's recommendation. In September of 2020, DoD sent an update indicating that they will issue a policy memorandum, specifically outlining the requirement for DoD Components who provide financial assistance to educational programs or activities conduct periodic compliance reviews. This is expected to be complete by December 31, 2020.

Recommendation: To establish accountability for meeting the programs' goal of increasing the participation of traditionally underrepresented groups in the highway construction workforce, the Secretary of Transportation should direct the FHWA Administrator to create and implement an oversight mechanism that (1) holds states accountable for meeting federal training criteria and (2) clearly stipulates how FHWA will assess state program effectiveness, including what type of program achievement data states are to submit and how such data will be used. This oversight mechanism should include assessing the effectiveness of its division offices in overseeing state activities.

Agency: Department of Transportation
Status: Open

Comments: FHWA has taken initial steps to implement a mechanism for state oversight, which includes collecting program implementation information from each state. FHWA plans to convene a working group to review this information and provide feedback to states on their programs. FHWA officials then anticipate sharing best practices and essential requirements for the program through webinars and other technical assistance. As of August 2019, FHWA has gathered information from states and is in the early stages of implementing this oversight mechanism.

Recommendation: To support the triennial review program's goal of having grantees consistently meet more federal requirements, the Secretary of Transportation should direct the FTA to ensure that additional outcome and quality performance measures are balanced with the existing measures for assessing the timeliness of the triennial review program so that one priority is not emphasized at the expense of others.

Agency: Department of Transportation
Status: Open

Comments: Federal Transit Administration (FTA) anticipates adding a performance measurement, called reduction in repeat findings, that relates to assessing the quality of the review. This has been added to FTA's new Quality Review program focused on improving its Triennial Review program.