Recommendation: The Secretary of Defense should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 1)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense partially concurred with this recommendation noting the challenge with balancing ensuring public access to research data with considerations of national security and personally identifiable information. As discussed in our report, balancing these considerations is a challenge that agency officials and stakeholders identified during our work. Accordingly, our recommendation to DOD regarding findability and accessibility of agency-funded research data was qualified to pertain to appropriate agency-funded research data--recognizing that it might not be appropriate to make certain datasets publically available because of national security or other concerns. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Education should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 2)

Agency: Department of Education
Status: Open

Comments: The Department of Education concurred with this recommendation. According to its response to our report, the Department awarded a contract to support enhancements to its Education Resources Information Center (ERIC) to link scholarly research publications supported by the Department to its publicly accessible datasets. The Department indicated it expects to complete this work by September 30, 2020. When we confirm what actions the Department has taken to implement this recommendation we will provide additional information.

Recommendation: The Director of the Agency for Healthcare Research and Quality should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 3)

Agency: Department of Health and Human Services: Public Health Service: Agency for Healthcare Research and Quality
Status: Open

Comments: The Agency for Healthcare Research and Quality concurred with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Commissioner of the Food and Drug Administration should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 4)

Agency: Department of Health and Human Services: Food and Drug Administration
Status: Open

Comments: The Food and Drug Administration concurred with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Homeland Security should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 5)

Agency: Department of Homeland Security
Status: Open

Comments: The Department of Homeland Security concurred with this recommendation and noted that it was in the process of establishing a portal on its website to increase public access to agency-funded research. The department estimated these efforts would be completed by June 30, 2020. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Veterans Affairs should take steps to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 6)

Agency: Department of Veterans Affairs
Status: Open

Comments: The Department of Veterans Affairs concurred with this recommendation but indicated in its comments on the report that had already taken steps to implement it. As discussed in the report, the department's efforts to ensure research data availability pertained to a portion of the agency's federally-funded research data. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Director of the National Science Foundation should fully implement plans to ensure appropriate agency-funded research data are readily findable and accessible to the public. (Recommendation 7)

Agency: National Science Foundation
Status: Open

Comments: NSF concurred with this recommendation. According to its response to our report, NSF is expanding its public access repository to include metadata records about data that support publications resulting from NSF-funded research. NSF's response stated that, by storing metadata records for supporting datasets alongside metadata records for publications, the public will be able to more easily find and access appropriate agency funded research data. We will provide an update when we obtain additional information about the status of implementing this recommendation.

Recommendation: The Secretary of Defense should complete development of data management plan requirements for extramural researchers. (Recommendation 8)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense concurred with this recommendation noting planned steps to complete development of data management plan requirements. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of the Agency for Healthcare Research and Quality should complete development of data management plan requirements. (Recommendation 9)

Agency: Department of Health and Human Services: Public Health Service: Agency for Healthcare Research and Quality
Status: Open

Comments: The Agency for Healthcare Research and Quality concurred with this recommendation. When we confirm what actions the agency has taken to implement the recommendation we will provide updated information.

Recommendation: The Secretary of Homeland Security should complete development of data management plan requirements. (Recommendation 10)

Agency: Department of Homeland Security
Status: Open

Comments: The Department of Homeland Security concurred with this recommendation, stating that it would develop a departmentwide management directive for research and development data as well as data management plan guidance and a template to document requirements. The department estimated that these efforts would be completed by June 30, 2020. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The U.S. Agency for International Development Administrator should complete development of data management plan requirements for extramural researchers. (Recommendation 11)

Agency: United States Agency for International Development
Status: Open

Comments: The U.S. Agency for International Development agreed with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Agriculture should complete development of guidance and provide training to agency officials or others involved in reviewing the merits of researchers' data management plans. (Recommendation 12)

Agency: Department of Agriculture
Status: Open

Comments: The U.S. Department of Agriculture agreed with the findings of our report. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The U.S. Agency for International Development Administrator should complete development of and provide training for agency officials or others involved in reviewing the merits of researchers' data management plans. (Recommendation 13)

Agency: United States Agency for International Development
Status: Open

Comments: The U.S. Agency for International Development agreed with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Commissioner of the Food and Drug Administration should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 14)

Agency: Department of Health and Human Services: Food and Drug Administration
Status: Open

Comments: The Food and Drug Administration concurred with this recommendation. When we confirm what actions the agency has taken to implement the recommendation we will provide updated information.

Recommendation: The Secretary of Homeland Security should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 15)

Agency: Department of Homeland Security
Status: Open

Comments: The Department of Homeland Security concurred with this recommendation, and indicated it would evaluate training needs for data management plan reviews and develop plans to fulfill any additional training needs identified. The department estimated these efforts would be completed by September 30, 2020. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Veterans Affairs should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 16)

Agency: Department of Veterans Affairs
Status: Open

Comments: The Department of Veterans Affairs concurred with this recommendation and identified several planned steps to identify and meet training needs for those involved in reviewing researchers' data management plans. The department estimated these efforts would be completed by September 30, 2020. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Director of the Agency for Healthcare Research and Quality should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 17)

Agency: Department of Health and Human Services: Public Health Service: Agency for Healthcare Research and Quality
Status: Open

Comments: The Agency for Healthcare Research and Quality concurred with this recommendation stating that it would assess training needs for agency officials and others involved in reviewing the merits of researchers' data management plans and would develop and provide additional training if warranted. When we confirm what actions the agency has taken to implement the recommendation we will provide updated information.

Recommendation: The Secretary of Defense should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 18)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense concurred with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Energy should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 19)

Agency: Department of Energy
Status: Open

Comments: The Department of Energy concurred with this recommendation and stated it would assess and develop a plan to meet the training needs of internal DOE staff and external peer reviewers of data management plans. DOE estimated these efforts would be completed by December 31, 2020. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Environmental Protection Agency Administrator should evaluate training needs for agency officials or others involved in reviewing the merits of researchers' data management plans and, if additional training is found to be warranted, develop and provide such training. (Recommendation 20)

Agency: Environmental Protection Agency
Status: Open

Comments: The Environmental Protection Agency agreed with this recommendation stating that, during fiscal year 2020, the agency will evaluate training needs for agency officials who review researchers' data management plans. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Agriculture should develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 21)

Agency: Department of Agriculture
Status: Open

Comments: The U.S. Department of Agriculture agreed with the findings of our report. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Defense should develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 22)

Agency: Department of Defense
Status: Open

Comments: The Department of Defense concurred with this recommendation When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of the Agency for Healthcare Research and Quality should develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements.(Recommendation 23)

Agency: Department of Health and Human Services: Public Health Service: Agency for Healthcare Research and Quality
Status: Open

Comments: The Agency for Healthcare Research and Quality concurred with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Commissioner of the Food and Drug Administration should develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 24)

Agency: Department of Health and Human Services: Food and Drug Administration
Status: Open

Comments: The Food and Drug Administration concurred with this recommendation. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Director of the National Institutes of Health should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 25)

Agency: Department of Health and Human Services: Public Health Service: National Institutes of Health
Status: Open

Comments: The National Institutes of Health concurred with this recommendation but stated that the agency already had mechanisms in place to ensure compliance with public access plan and associated requirements for publications and data. As discussed in the report, we believe our recommendation, as worded, appropriately reflected the extent to which the agency had implemented researcher compliance mechanisms at the time of issuance of our report. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Homeland Security should develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 26)

Agency: Department of Homeland Security
Status: Open

Comments: The Department of Homeland Security concurred with this recommendation and stated it would develop a mechanism to ensure researcher compliance with the department's public access plan and data management plan requirements. The department estimated these efforts would be completed by September 30, 2020. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The National Oceanic and Atmospheric Administration Administrator should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 27)

Agency: Department of Commerce: National Oceanic and Atmospheric Administration
Status: Open

Comments: The Department of Commerce agreed with this recommendation and the National Oceanic and Atmospheric Administration indicated it was pursuing multiple mechanisms to implement it. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Energy should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 28)

Agency: Department of Energy
Status: Open

Comments: The Department of Energy concurred with this recommendation stating that it would develop a compliance mechanism to identify researchers receiving funding from DOE financial assistance awards who are not compliant with DOE's public access plan for publications. DOE estimated these efforts would be completed by December 31, 2020. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Veterans Affairs should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 29)

Agency: Department of Veterans Affairs
Status: Open

Comments: The Department of Veterans Affairs concurred with this recommendation but indicated in its comments on the report that had already taken steps to implement it. As discussed in the report, the department's public access compliance mechanism covered a portion of the agency's federally-funded research data.. When we confirm what actions the agency has taken in response to the recommendation, we will provide updated information.

Recommendation: The Secretary of Transportation should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 30)

Agency: Department of Transportation
Status: Open

Comments: The Department of Transportation concurred with this recommendation. According to its response to our report, the Department will build upon existing compliance mechanisms to ensure researcher compliance with its public access plan and associated requirements. As part of this process, the Department reported that it plans to update its public access plan, and expects to complete these actions by December 31, 2020. When we confirm what actions the Department has taken to implement this recommendation we will provide additional information.

Recommendation: The National Institute of Standards and Technology Director should fully develop and implement a mechanism to ensure researcher compliance with the public access plan and associated requirements. (Recommendation 31)

Agency: Department of Commerce: National Institute of Standards and Technology
Status: Open

Comments: The Department of Commerce agreed with this recommendation and the National Institute of Standards and Technology identified several planned steps to implement it with full completion anticipated by December 31, 2020. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: As the Subcommittee on Open Science moves forward, the Office of Science and Technology Policy co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 32)

Agency: Executive Office of the President: Office of Science and Technology Policy
Status: Open

Comments: OSTP disagreed with GAO's November 2019 recommendation, stating that the subcommittee had already taken steps to implement the leading practices GAO identified. However, OSTP officials did not provide documentation of these efforts and GAO continued to believe the recommendation was warranted. In March 2020, OSTP provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: As the Subcommittee on Open Science moves forward, the Department of Defense co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 33)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with GAO's November 2019 recommendation, noting that DOD participates in subcommittee initiatives, including a working group on disclosure risk management, which is a topic of great importance to DOD. In March 2020, the Office of Science and Technology Policy provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: As the Subcommittee on Open Science moves forward, the Department of Energy co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 34)

Agency: Department of Energy
Status: Open

Comments: DOE concurred with GAO's November 2019 recommendation. DOE noted that, as a co-chair of the subcommittee, it is actively identifying areas of collaboration across agencies in implementing open science practices. In March 2020, the Office of Science and Technology Policy provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: As the Subcommittee on Open Science moves forward, the National Institutes of Health co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 35)

Agency: Department of Health and Human Services: Public Health Service: National Institutes of Health
Status: Open

Comments: NIH concurred with GAO's November 2019 recommendation. NIH stated that the subcommittee and its working groups are actively coordinating and building consensus on issues and processes to implement leading practices that enhance and sustain collaboration across federal agencies. In March 2020, the Office of Science and Technology Policy provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: As the Subcommittee on Open Science moves forward, the National Oceanic and Atmospheric Administration co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 36)

Agency: Department of Commerce: National Oceanic and Atmospheric Administration
Status: Open

Comments: NOAA concurred with GAO's November 2019 recommendation, noting that NOAA would work with the subcommittee to identify more opportunities for collaboration to promote access to research results. In March 2020, the Office of Science and Technology Policy provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: As the Subcommittee on Open Science moves forward, the National Science Foundation co-chair, in coordination with other co-chairs and participating agencies, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 37)

Agency: National Science Foundation
Status: Open

Comments: The National Science Foundation concurred with GAO's November 2019 recommendation. In March 2020, the Office of Science and Technology Policy provided information on steps the subcommittee has taken to address issues associated with public access to federally funded research results, including certain areas GAO identified as presenting challenges to public access plan implementation in the November 2019 report. GAO will collect and evaluate additional information to determine the extent to which these steps incorporate leading practices for interagency collaboration GAO has identified. By taking steps to fully implement the relevant leading practices we have identified, the subcommittee and its member agencies could better marshal their collective efforts to address common public access plan implementation challenges that agency officials and stakeholders identified.

Recommendation: The Commissioner of FHA should enhance the content and communication of FHA's policies and procedures on conveyance condition, including by considering the program stakeholder views discussed in this report and other stakeholder input. (Recommendation 1)

Agency: Department of Housing and Urban Development: Federal Housing Administration
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Commissioner of FHA should develop a formal plan for evaluating the outcomes of the preconveyance inspection pilot that includes key elements of evaluation design—such as evaluation objectives and measures—and utilizes participant feedback and control groups, as appropriate. (Recommendation 3)

Agency: Department of Housing and Urban Development: Federal Housing Administration
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Administrator of the EPA should develop a program management plan that includes a schedule of the actions EPA will take and the resources and funding it needs to establish and implement the Columbia River Basin Restoration Program, including formation of the associated Columbia River Basin Restoration Working Group, and submit this plan to the appropriate congressional authorizing committees as part of the fiscal year 2020 budget process. (Recommendation 1).

Agency: Environmental Protection Agency
Status: Open

Comments: EPA reconvened the Columbia River Toxics Reduction Working Group. As of May 2019, EPA officials told us they are working on the development of a program management plan to identify the actions and timeline for implementing the Columbia River Basin Restoration Program. In July 2019, EPA released a status update entitled, "2019 Status Update: Columbia River Basin Toxics Reduction" that provides a summary of the working group's major accomplishments since 2010, as well as priority efforts for future work. In September 2019, EPA announced the availability of $900,000 in grants to reduce toxics throughout the Columbia River Basin for the Clean Water Act Section 123 Columbia River Basin Restoration Grant Program for fiscal year 2019 through fiscal year 2020. As of October 2020, we have not received additional information from EPA regarding this recommendation. We will update the recommendation's status when we do.

Recommendation: The Director of OMB should develop and provide guidance on the types of projects and activities that agencies involved in the protection and restoration of the Columbia River Basin should include in their reports, as well as the processes they should follow in compiling the related budget and spending information. (Recommendation 2).

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: As of April 2020, OMB staff did not provide an update. When we receive an update, we will provide information on actions taken.

Recommendation: For RHS properties whose mortgages have matured, Congress should consider granting RHS the authority to renew annual rental assistance payments to owners who wish to continue to receive them and provide vouchers to tenants living in rental assistance units in properties whose owners choose to no longer receive rental assistance.

Agency: Congress
Status: Open

Comments: In September 2019, Sen. Jeanne Shaheen introduced S. 2567 that proposed decoupling Section 521 rental assistance from the Section 515 mortgage, allowing rental assistance to continue after the mortgage is paid in full. The bill also would expand the use of the Section 542 Rural Development Voucher program to include all tenants in properties with loans that had matured, rather than just tenants in properties with prepaid mortgages. Sen. Shaheen's bill was referred to the Senate Committee on Banking, Housing, and Urban Affairs. As of September 2020, no additional action had been taken.

Recommendation: The RHS Administrator should establish additional controls to check the accuracy of all loan information entered into RHS information technology systems, to help ensure complete, accurate, and reliable data for estimating rural rental housing property exit dates. (Recommendation 1)

Agency: Department of Agriculture: Rural Housing Service
Status: Open

Comments: USDA said it would prioritize the development of options for the RHS Information Technology System , including dashboards and other protocols, to provide more analytical assessments and accurate data with respect to mortgage maturity dates and property-level information. It also said it would strengthen its partnership with Rural Development's Information Technology staff and develop more effective communication tools with RHS field personnel to highlight the importance of maintaining reliable data. USDA estimated it would complete these steps by September 30, 2019. However, as of May 2020, USDA officials had not provided us documentation of their efforts.

Recommendation: The RHS Administrator should establish a process to help ensure regular and frequent updates for the preservation tool and its underlying data. (Recommendation 2)

Agency: Department of Agriculture: Rural Housing Service
Status: Open

Comments: USDA said it would embed quality assurance in the preservation tool to ensure that the underlying data are accurately sourced, maintained, and analyzed. USDA also said it would ensure involvement from RHS National Office staff and RHS field office staff in this process to maximize the resources allocated to ensuring that the tool's data are integral and timely. Finally, USDA said RHS National Office personnel in the Deputy Administrator's office will be assigned quality control responsibility for the accurate maintenance of the tool. USDA estimated it would complete these steps by September 30, 2019. However, as of May 2020, USDA officials had not provided us documentation of their efforts.

Recommendation: The RHS Administrator should establish performance goals and measures for its rural rental housing preservation and rehabilitation efforts and report out these outcomes. (Recommendation 3)

Agency: Department of Agriculture: Rural Housing Service
Status: Open

Comments: USDA said it would incorporate preservation goals, objectives, and measures into its on-going updates and edits to handbook guidance. As an initial step, on June 4, 2018, the agency incorporated the guidance provided in the Unnumbered Letter titled "Dynamic Servicing Strategies for the Multi-family Housing Direct Loan Portfolio." The revisions also renamed Chapter 6 of the handbook to "Portfolio and Property Assessment." USDA said on-going guidance updates will prioritize preservation as the goal of servicing strategies and require program staff to exhaust all potential remedies to achieve this goal prior to proceeding to terminate assistance or otherwise not preserve the affordable housing property. USDA officials expected these and other steps to be completed by September 30, 2019. However, in May 2020, USDA officials said publication of the guidance had been delayed, and guidance was not expected to issue until early fiscal year 2022.

Recommendation: The RHS Administrator should monitor the results of rural rental housing preservation efforts and assess the degree to which those efforts yielded intended outcomes. (Recommendation 4)

Agency: Department of Agriculture: Rural Housing Service
Status: Open

Comments: USDA said that in conjunction with its establishment of preservation goals and objectives, it would utilize a performance tracking system and establish management routines to discuss and strategize how to achieve these goals. In November 2019, USDA officials said they had assessed the Section 515 Multi-Family Housing Preservation and Revitalization demonstration program and planned to finalize a plan that would enhance program delivery efficiency and consistency within 8 months (July 2020). However, as of May 2020, USDA officials had not provided documentation showing performance tracking or routine monitoring efforts. The officials said they planned to complete an evaluation of rural housing preservation goals or objectives by the third quarter of fiscal year 2022.

Recommendation: The RHS Administrator should identify, analyze, and respond to risks to achieving its preservation goals, including resource and staffing limitations. (Recommendation 5)

Agency: Department of Agriculture: Rural Housing Service
Status: Open

Comments: USDA said it would utilize a performance tracking system and establish management routines to discuss and strategize how to achieve its goals. According to USDA, this will include an assessment of challenges and risks that may affect the achievement of performance and preservation objectives. However, as of May 2020, USDA had not provided us documentation of its efforts to identify, analyze and respond to risks to achieving its preservation goals.

Recommendation: To help achieve EQIP's purpose of optimizing environmental benefits, the Secretary of Agriculture should direct the Chief of the Natural Resources Conservation Service to direct EQIP program managers to coordinate with the leaders of USDA's CEAP to help ensure that CEAP studies consider the practical limitations and trade-offs faced by program managers and to provide program managers with better information to target EQIP funds where they will optimize environmental benefits.

Agency: Department of Agriculture
Status: Open

Comments: As of May 2020, the agency has not taken action. When we obtain information from the agency, we will update the status of this recommendation.

Recommendation: To help achieve EQIP's purpose of optimizing environmental benefits, the Secretary of Agriculture should direct the Chief of the Natural Resources Conservation Service to revise guidance on state offices' EQIP allocation processes, stipulating that data on environmental concerns, where available, should be a primary factor influencing allocations within states.

Agency: Department of Agriculture
Status: Open

Comments: As of May 2020, the agency has not taken action. When we obtain information from the agency, we will update the status of this recommendation.

Recommendation: To help achieve EQIP's purpose of optimizing environmental benefits, the Secretary of Agriculture should direct the Chief of the Natural Resources Conservation Service to establish a review process at the regional level for review and concurrence of EQIP payment rates above a threshold (e.g., rates greater than 50 percent, with justification).

Agency: Department of Agriculture
Status: Open

Comments: As of May 2020, the agency has not taken action. When we obtain information from the agency, we will update the status of this recommendation.

Recommendation: To help achieve EQIP's purpose of optimizing environmental benefits, the Secretary of Agriculture should direct the Chief of the Natural Resources Conservation Service to modify guidance and ranking tools so that they more accurately value an EQIP application's anticipated environmental benefits relative to estimated costs.

Agency: Department of Agriculture
Status: Open

Comments: As of May 2020, the agency has not taken action. When we obtain information from the agency, we will update the status of this recommendation.

Recommendation: To help NMFS and the Councils incorporate climate information into the fisheries management process and better manage climate-related risks, the Secretary of Commerce should direct NOAA's Assistant Administrator for Fisheries to, in finalizing the regional action plans for implementing the NOAA Fisheries Climate Science Strategy, (1) incorporate the key attributes associated with successful performance measures in the final performance measures developed for the plans and (2) assess whether agency-wide performance measures may be needed to determine the extent to which the objectives of the Strategy overall are being achieved, and develop such measures, as appropriate, that incorporate the key attributes of successful performance measures.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce and NOAA agreed with this recommendation. In October 2019, NOAA provided GAO with a written update on actions taken in response to this recommendation, including the development of agency-wide metrics for the NOAA Fisheries Climate Science Strategy. In September 2020, NOAA informed GAO that it plans to update the performance metrics for the regional action plans to include our key attributes in 2021. We will continue to monitor NOAA's progress on this effort and will review the updated performance metrics to assess the extent to which the agency has addressed our recommendation.

Recommendation: To improve the effectiveness of federal efforts to monitor wild, native bee populations, the Secretary of Agriculture, as a co-chair of the White House Pollinator Health Task Force, should coordinate with other Task Force agencies that have monitoring responsibilities to develop a mechanism, such as a federal monitoring plan, that would (1) establish roles and responsibilities of lead and support agencies, (2) establish shared outcomes and goals, and (3) obtain input from relevant stakeholders, such as states.

Agency: Department of Agriculture
Status: Open

Comments: As of October 2019, USDA had taken relevant and positive actions but had not yet fully implemented GAO's February 2016 recommendation for monitoring wild, native bees. According to a senior USDA official, a Native Bee Monitoring Steering Committee composed of representatives from four USDA agencies is developing a response to the recommendation. According to the official, the steering committee has taken or plans to take several steps regarding a monitoring plan. First, the steering committee held a stakeholder listening session in June 2017 to obtain public opinion regarding (1) why a native bee monitoring program is important, (2) the type of information and data needed to adequately conduct monitoring, and (3) how the public would like to see the monitoring data used. Highlights of the input received at the listening session and the goals of the national monitoring plan were discussed in a symposium held in November 2017 at the National Entomological Society of America Annual Meeting. USDA gathered additional recommendations from symposium participants based on monitoring programs for other declining species of concern, such as birds, bats, and butterflies. Second, the steering committee drafted a prospectus that will delineate activities being conducted by relevant federal agencies with responsibilities for surveying species of concern, including plans to coordinate activities and outline individual roles and responsibilities towards facilitating a national monitoring plan. According to the senior official, the committee worked with USDA officials to ask other federal agencies associated with the Pollinator Task Force to summarize their current and future activities in support of monitoring native bee populations. The committee completed its report entitled The Current State of Federal Agency Coordination in Monitoring Native Bee Health in January 2019. Third, the steering committee held a "Scientists' Summit" in April 2018 at the National Conservation Training Center. The purpose was to obtain scientific expert opinion regarding (1) why a native bee monitoring strategy is needed; (2) what such a monitoring strategy would measure and be used for; (3) standard minimum protocols that would improve data quality and sharing; and (4) databases that could be used to house data from a monitoring strategy. Participants included university and governmental experts on bees, statisticians, modelers and ecologists, and conservation biologists assessing other species in decline. Workshop discussion leaders subsequently drafted for publication in a scientific journal a whitepaper with recommendations on a U.S. national native bee monitoring strategy. However, as of October 2019, according to senior USDA officials, the white paper had not yet been accepted for publication. We support the agencies' efforts to date to implement the recommendation. However, we believe that the agencies must take additional steps to improve the effectiveness of federal efforts to monitor wild, native bee populations and will continue to monitor their actions. In 2020, according to a senior USDA official, a National Native Bee Monitoring Research Coordination Network is being formed to address GAO's recommendation to develop a federal monitoring plan for wild, native bees, with the project expected to begin in spring 2020. Some USDA officials told us that without a team to coordinate a monitoring plan, individual agency efforts may be ineffective in providing the needed information in trends on wild, native bees in the United States. The project is scheduled to be completed in 3 years.