Reports & Testimonies

  • GAO’s recommendations database contains report recommendations that still need to be addressed.

    GAO’s recommendations help congressional and agency leaders prepare for appropriations and oversight activities, as well as help improve government operations. Recommendations remain open until they are designated as Closed-implemented or Closed-not implemented. You can explore open recommendations by searching or browsing.

    GAO's priority recommendations are those that we believe warrant priority attention. We sent letters to the heads of key departments and agencies, urging them to continue focusing on these issues. These recommendations are labeled as such. You can find priority recommendations by searching or browsing our open recommendations below, or through our mobile app.

  • Browse Open Recommendations

    Explore priority recommendations by subject terms or browse by federal agency

    Search Open Recommendations

    Search for a specific priority recommendation by word or phrase



  • Governing on the go?

    Our Priorities for Policy Makers app makes it easier for leaders to search our recommendations on the go.

    See the November 10th Press Release


  • Have a Question about a Recommendation?

    • For questions about a specific recommendation, contact the person or office listed with the recommendation.
    • For general information about recommendations, contact GAO's Audit Policy and Quality Assurance office at (202) 512-6100 or apqa@gao.gov.
  • « Back to Results List Sort by   

    Results:

    Subject Term: "Success rates"

    1 publication with a total of 5 open recommendations
    Director: Melissa Emrey-Arras
    Phone: (617) 788-0534

    5 open recommendations
    Recommendation: In order to ensure complete, analyzable records regarding research grant award decisions are available for management and analysis, the Secretary of Defense should direct the Under Secretary of Defense for Acquisition, Technology and Logistics to lead the implementation of additional data collection efforts in coordination with DOD's grant-making components. These should include: (1) Retaining complete records of pre-proposal, proposal, and award data, including a record of proposal disposition, in linked electronic files to facilitate aggregate, statistical analysis of the grant-making process, including the calculation of success rates. (2) Collecting demographic, education, and career information from applicants, on a voluntary basis, that is not available to proposal reviewers but is used for analysis of success rates.

    Agency: Department of Defense
    Status: Open

    Comments: DOD agreed with our recommendation to implement additional data collection efforts. As of August, 2017, the Basic Research Office (BRO) has drafted an implementation plan and schedule for the collection of demographic data on grant applicants and lifecycle grant data. As part of this, BRO has identified a number of issues to be addressed and resolved within DoD. One of these areas is the protection of any information collected to assess the success rates of women as Principal Investigators (PIs)/co-PIS under STEM Research grants and cooperative agreements. As a result, before BRO proceeds with its planned actions, they are working with the Office of Information Management, WHS, to ensure there are no issues related to the Privacy Act. The agency did not provide a timeline to GAO for when these actions are expected to be completed.
    Recommendation: In order to ensure complete, analyzable records regarding research grant award decisions are available for management and analysis, the Secretary of Energy should direct DOE's grant-making agencies to implement additional data collection efforts, which should include: (1) Retaining complete records of pre-proposal, proposal, and award data, including a record of proposal disposition, in linked electronic files to facilitate aggregate, statistical analysis of the grant-making process, including the calculation of success rates. (2) Collecting demographic, education, and career information from applicants, on a voluntary basis, that is not available to proposal reviewers but is used for analysis of success rates.

    Agency: Department of Energy
    Status: Open

    Comments: DOE generally agreed with our recommendation to implement additional data collection efforts. According to DOE officials, as of September, 2017, of the four components audited at DOE, all four have taken actions toward implementing the recommendation and one component has completed its implementation. Specifically, the Office of Science began collecting investigator demographics during the second quarter of fiscal year 2015 and already retained complete records that enabled the calculation of success rates. Three additional DOE components conducted a joint feasibility study and all concur that it is feasible to collect data on demographic, education and career information of applicants. The Office of Nuclear Energy (NE) revised its approach to data collection and now retains complete grant life cycle information for each individual award, including complete records of pre-proposal, proposal, and award data in linked electronic files. NE is also changing existing data systems to input/track voluntarily submitted demographic information on Principle Investigators on applications to facilitate aggregate, statistical analysis of the grant-making process, including the calculation of success rates. The agency notes that for NE, the completion of the actions required to implement this recommendation is estimated to take up to 12 months. Advanced Research Projects Agency-Energy (ARPA-E) and the Office of Energy Efficiency and Renewable Energy (EERE) participated in the joint feasibility study regarding the collection of demographic data, but have not completed any actions to implement such data collection.
    Recommendation: As NASA begins to collect demographic data on its grant proposals and awards, the NASA Administrator should include the following key components: (1) Retain complete records of pre-proposal, proposal, and award data, including a record of proposal disposition, in linked electronic files to facilitate aggregate, statistical analysis of the grant-making process, including the calculation of success rates. (2) Collect demographic, education, and career information from applicants, on a voluntary basis, that is not available to proposal reviewers but is used for analysis of success rates.

    Agency: National Aeronautics and Space Administration
    Status: Open

    Comments: NASA agreed with our recommendation and indicated it will begin collecting basic demographic, education, and career data from its research grant applicants on a voluntary basis by the end of fiscal year 2016. In addition, NASA noted it will explore its ability to consolidate proposal and award data as part of the ongoing update to its procurement and grants management systems. As of September 2017, NASA officials reported that the notice of grant award document (form 1687) was modified to require entry of the proposal number on the form in order to capture the linkage between proposal and award. When the transition to the new contract/grant writing system (Procurement for Public Sector) occurred in June 2017, NASA began using the amended award notice. NASA states they are continuing to investigate system options for fine tuning this cross-referencing methodology. However, as of September 2017, there were no stated plans to collect or track demographic, education, or career characteristics of grant applicants in such a way as to facilitate the analysis of success rates.
    Recommendation: To comply with Title IX enforcement requirements, the Secretary of the Department of Defense, which funds STEM research at universities, should direct the Director of the Office of Diversity Management and Equal Opportunity to ensure that Title IX compliance reviews of DOD's grantees are periodically conducted.

    Agency: Department of Defense
    Status: Open

    Comments: DOD agreed with our recommendation and noted it is in the process of revising current DOD guidance which will address its Title IX enforcement requirements. In a conversation with GAO in September 2017, a DOD official stated that the agency is in the process of formulating instructions related to both Title IX and Title VI that they believe will address the recommendation regarding Title IX enforcement. To date, these actions are not complete as they are still in the process of developing appropriate language.
    Recommendation: To comply with Title IX enforcement requirements, the Secretary of the Department of Health and Human Services, which funds STEM research at universities, should ensure that Title IX compliance reviews of NIH's grantees are periodically conducted.

    Agency: Department of Health and Human Services
    Status: Open

    Comments: HHS indicated it would consult with NIH and initiate a sex discrimination compliance review program that includes grantee institutions with STEM programs. We will update the status of this recommendation when the agency provides documentation that these efforts have been completed.