Recommendation: The Director of OMB should comply with its statutory requirement to issue implementation guidance to agencies to develop and maintain comprehensive data inventories. (Recommendation 1)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of OMB should comply with the statutory requirement to electronically publish a report on agencies' performance and compliance with the OPEN Government Data Act. (Recommendation 2)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Director of OMB, in collaboration with the Administrator of GSA, should establish policy to ensure the routine identification and correction of errors in electronically published performance information. (Recommendation 3)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Commissioner of the IRS should ensure that information is collected on taxpayers' experiences with all online services and the extent to which the services are meeting taxpayers' needs. (Recommendation 1)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS agreed with this recommendation. In June 2020, IRS reported that it intends to "implement new surveys to better capture customer experience data" with its online services. To this end, IRS in March 2020 published a notice in the Federal Register stating that it intends to seek approval from the Office of Management and Budget (OMB) on collecting information in a manner consistent with section 280 of OMB's Circular A-11 intended to improve the customer experience with federal services. Among other requirements, section 280 of Circular A-11 directs agencies to collect feedback from customers. IRS states that it intends to complete this process and fully address the recommendation by the end of calendar year 2021. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should ensure that information collected on taxpayers' experiences with online services is summarized in the document serving as IRS's performance plan and report. (Recommendation 2)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS agreed with this recommendation. In June 2020, IRS reported that it is working to "implement new surveys to better capture customer experience data" and intends to publish this information on Performance.gov. Further, IRS states that it "will evaluate and identify the most appropriate medium each year for publication of data based on statutory and other requirements" and expects to fully address this recommendation by November 15, 2022. Section 280 of the Office of Management and Budget's Circular A-11 states that in addition to publishing this information on Performance.gov, agencies should also summarize this information in performance plans and reports. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should direct the Director of OLS and the Chief Research and Analytics Officer to work together to analyze the potential effects of online services on taxpayer burden. (Recommendation 3)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS agreed with this recommendation. In June 2020, IRS reported two planned actions to address this: 1) IRS will conduct comparative analyses of the current Individual Taxpayer Burden and Taxpayer Compliance Burden surveys and expects to complete this by September 30, 2020; and 2) IRS will implement new customer experience surveys to better capture comparative data relating to user perceptions of the ease and effectiveness of both online and traditional interactions and expects to complete this by the end of calendar year 2021. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should ensure that taxpayer input is included as an element of IRS's identification and prioritization process for new online services. (Recommendation 4)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS agreed with the recommendation. In June 2020, IRS reported that it plans to introduce new survey methods to obtain taxpayer input regarding potential new online services. One specific example IRS provided was testing a new version of the irs.gov satisfaction survey. This new version, which was launched in January 2020, asks respondents what additional online services taxpayers would like and solicits suggestions from taxpayers for improving IRS's online services. IRS stated that it is currently evaluating this new survey method. IRS expects to fully address the recommendation by the end of calendar year 2021. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should work with relevant officials to set a target to reduce taxpayer burden through the development of new online services. (Recommendation 5)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS did not agree with this recommendation. In June 2020, IRS stated that it will analyze the effect of online services on taxpayer burden in response to recommendation number 3 of this report. However in regards to setting a target, IRS reiterated its view that its "taxpayer burden measurement methodology is not designed to evaluate the effect of specific online services or web site enhancements." Further, IRS states that changes in tax policy (e.g., the Tax Cuts and Jobs Act of 2017) can affect taxpayer burden and it believes other factors, such as ease of use of online services, are more important to the taxpayer experience. Our report recognized that it may take time for the relevant IRS offices to review how online services may be affecting taxpayer burden. However, we continue to believe that this recommendation has merit because IRS has previously stated that it expects online services to reduce taxpayer burden, thereby contributing to one of IRS's strategic goals. Since IRS has already stated it plans to analyze the effect of online services on taxpayer burden in response to recommendation number 3, we believe it would be relatively easy for IRS to use the results of that analysis to set a more specific goal. For example, IRS in its June 2020 update refers to the time taxpayers spend using online services. A potential research question could be the extent to which taxpayers are more efficiently completing tasks using IRS's online services as IRS makes improvements to these services. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should direct the Chief Information Officer and the Director of OLS to ensure that planned future capabilities of digital communication platforms are tested or piloted before deployment with a particular focus on mitigating the risks that were identified in prior pilots of digital communication services, such as challenges in establishing common objectives and enrolling taxpayers. (Recommendation 6)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS agreed with this recommendation. In June 2020, IRS reported that it will apply multiple user preference and usability testing methods to the design of Taxpayer Digital Communications. For example, IRS said it surveyed visitors to IRS.gov about their views towards digital communications in the winter of 2019-2020 and in March 2020 conducted remote testing sessions with taxpayers to obtain feedback on two possible design options. IRS says additional testing may be done and expects to fully address this recommendation by November 30, 2020. We will continue to monitor IRS's efforts to address this recommendation.

Recommendation: The Commissioner of the IRS should direct the Commissioner of W&I to work with the Director of OLS to ensure that future decisions regarding whether to renew the Free File agreement incorporate findings from a comprehensive examination of the benefits and costs of the agreement as it relates to long term plans for IRS's online services, including plans to file amended returns electronically. (Recommendation 7)

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: Our report identified IRS's pledge to "not enter the tax preparation software and e-filing services marketplace" as a potential cost of IRS's agreement with Free File, Inc. to provide services to eligible taxpayers. Shortly after our report was issued, the Commissioner of the Wage and Investment Division signed on December 23, 2019 an addendum to the most recent agreement between IRS and Free File, Inc. which among other provisions struck the language prohibiting IRS from offering its own online filing services. Under the terms of the addendum, companies participating in Free File, Inc. will continue to provide services to eligible taxpayers subject to some new requirements, such as a prohibition on companies excluding their services from internet search engines and surveying a sample of taxpayers about their experiences. The agreement between IRS and Free File, Inc. remains scheduled to expire in October 2021. While the deletion of the language prohibiting IRS from offering its own online filing services removes a cost for IRS, our recommendation was for any future renewal of the agreement to be based on a comprehensive examination of the benefits and costs of the agreement as it relates to IRS's plans to expand online services. IRS agreed with our recommendation. In June 2020, IRS said that it "would continue to coordinate with appropriate stakeholders to assess the costs and benefits derived from the Free File agreement and incorporate findings in future agreements". In addition, several new developments have occurred related to Free File: 1) IRS used Free File, Inc. in the spring of 2020 to develop a website to identify Americans who were not required to file a 2019 tax return and may be eligible for economic impact payments pursuant to the Coronavirus Aid, Relief, and Economic Security Act; 2) IRS announced in May 2020 that taxpayers will soon be able to electronically file an amended return using tax software and IRS's announcement of this planned capability refers to its agreement with Free File, Inc.; and 3) one of the ten companies which had been participating in Free File, Inc. announced it plans to leave in October 2020. We will continue to monitor IRS's efforts to address the recommendation.

Recommendation: The Director of the Bureau of Land Management (BLM) should create and implement a policy for standard posting requirements regarding comments and their identity information, particularly for duplicate comments, and should clearly communicate this policy to the public on the BLM website. (Recommendation 1)

Agency: Department of the Interior: Bureau of Land Management
Status: Open

Comments: BLM concurred with the recommendation. In December 2019, BLM indicated that it will develop and issue policy for standard posting requirements regarding public comments and associated identity information as well as duplicative comments which will be available on BLM's website. BLM officials estimate that this will be completed in March 2020. Until these items are completed, our recommendation to BLM remains open.

Recommendation: The Administrator of Centers for Medicare & Medicaid Services (CMS) should create and implement a policy for standard posting requirements regarding comments and their identity information, particularly for duplicate comments, and should clearly communicate this policy to the public on the CMS website. (Recommendation 2)

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: In January 2020, the Department of Health and Human Services stated that CMS already has policies for standard posting requirements, and noted that they would update their policy and communicate it on the CMS website. However, while CMS provided us with an excerpt of the updated language, as written, it does not include information about how the agency posts duplicate comments. Further, CMS did not provide us with this policy, and our review of the website does not indicate any changes have been made. HHS stated it would provide additional follow up actions by 7/23/2020. Given that we found significant variation in the way that CMS posts comments, even within a single docket, we continue to believe that it is important for CMS to develop and implement a standard policy for posting duplicate comments and their identity information, in addition to communicating this policy to the public on the CMS website.

Recommendation: The Director of the Consumer Financial Protection Bureau (CFPB) should finalize its draft policy for posting comments and their identity information, particularly for duplicate comments, and clearly communicate it to the public on the CFPB website. (Recommendation 3)

Agency: Consumer Financial Protection Bureau
Status: Open

Comments: CFPB concurred with the recommendation. In December 2019, CFPB indicated that it will develop new language for consumerfinance.gov to better explain the Bureau's "post all" policy, and any exceptions to it. Additionally, CFPB is finalizing internal procedures for posting comments. Until these items are completed, our recommendation to CFPB remains open.

Recommendation: The Assistant Secretary of Labor for the Employee Benefits Security Administration (EBSA) should
1. create and implement a policy for standard posting requirements regarding comments and their identity information, particularly for duplicate comments;
2. clearly communicate this policy to the public on the EBSA website; and
3. evaluate the duplicative practice of replicating rulemaking dockets on the EBSA website, to either discontinue the practice or include a reference to Regulations.gov and explanation of how the pages relate to one another. (Recommendation 4)

Agency: Department of Labor: Employee Benefits Security Administration
Status: Open

Comments: EBSA concurred with the recommendation. In September 2019, EBSA stated that it will develop a written policy regarding posting of comments, including that of duplicate comments. This information will be available on their website. Additionally, EBSA will post a reference to Regulations.gov as part of each Notice of Proposed Rulemaking (NPRM) webpage that includes public comments together with an explanation of its relation to Regulations.gov as a means to access public comments on EBSA's rulemaking initiatives. EBSA officials did not provide a date by which these actions will be implemented. Additionally, while EBSA noted that internal and external users prefer the agency's current practice of replicating rulemaking dockets, the agency did not provide evidence that a formal evaluation had been conducted, and did not identify plans to do so. As a result, at this time our recommendation to EBSA remains open.

Recommendation: The Administrator of the Environmental Protection Agency (EPA) should finalize its draft policy for posting comments and their identity information, particularly for duplicate comments, and clearly communicate it to the public on the EPA website. (Recommendation 5)

Agency: Environmental Protection Agency
Status: Open

Comments: EPA concurred with the recommendation. In January 2020, EPA indicated that it will finalize its Docket Center's Document Processing Standard Operating Procedure as well as its website. This update will include information detailing when all duplicate comments are posted to Regulations.gov and when just one representative sample of a duplicate comment is posted. EPA officials estimate that this will be completed in February 2020. Until these items are completed, our recommendation to EPA remains open.

Recommendation: The Director of the Fish and Wildlife Service (FWS) should create and implement a policy for standard posting requirements regarding comments and their identity information, particularly for duplicate comments, and should clearly communicate this policy to the public on the FWS website. (Recommendation 6)

Agency: Department of the Interior: United States Fish and Wildlife Service
Status: Open

Comments: FWS concurred with the recommendation. In December 2019, FWS stated that it will update its service manual to include all standard posting requirements regarding public comments and their identity information. Additionally, FWS will include a statement on the FWS' website to inform the public about posting of public comments and identity information to regulations.gov. FWS officials estimate that this will be completed in June 2020. Until these items are completed, our recommendation to FWS remains open.

Recommendation: The Administrator of the Wage and Hour Division (WHD) should clearly communicate its policy for posting comments and their identity information, particularly for duplicate comments, to the public on the WHD website. (Recommendation 8)

Agency: Department of Labor: Wage and Hour Division
Status: Open

Comments: WHD concurred with the recommendation. In August 2019, WHD indicated that it will add text to each webpage for any rulemaking that invites public comments which states that any personal information included in the comments (including duplicate) will be posted to Regulations.gov without change. However, the text provided by officials does not explain WHD's policy of posting duplicate comments as a group under a single document ID, and therefore does not clearly communicate the agency's posting practices to the public. As a result, at this time our recommendation to WHD remains open.

Recommendation: The Secretary of the Treasury should fully comply with OMB's requirements by providing metadata in a single location that are easy to find on the USAspending.gov website. (Recommendation 3)

Agency: Department of the Treasury
Status: Open

Comments: Treasury agreed with the recommendation. As of September 2020, metadata are not available on USAspending.gov.

Recommendation: The Director, working with the Study, should ensure that as the Study finalizes its reporting format, it fully incorporates leading practices of performance reporting. (Recommendation 1)

Agency: Environmental Protection Agency
Status: Open

Comments: In June 2020, the Long Island Sound Study (Study) stated that it has incorporated two leading practices into the reporting format for its progress reports. In addition, the Study website shows the progress toward ecosystem targets compared to the recovery plan, and for a preceding period of time when data are available. According to the Study, EPA hired a contractor to develop a report addressing our recommendations. The Study is using the contractor report to finalize its reporting format and plans to develop an online reporting and tracking system that fully incorporates leading practices of performance reporting. We will review the format of the online tracking system when it becomes available and provide updated information as appropriate.

Recommendation: The Director, working with the Study, should develop cost estimates that include analyses of uncertainties for each of the targets in the 2015 plan. (Recommendation 2)

Agency: Environmental Protection Agency
Status: Open

Comments: In June 2020, the Study reported that it had hired a contractor to develop a report including the range of costs, including uncertainty bounds, needed to attain each of the targets in the 2015 plan. The contractor has completed its study. Cost estimates for each ecosystem target were developed by adding up the existing cost ranges for each of the implementation actions in the 2015 plan. The report is posted and accessible to the public on the Long Island Sound Study website (https://longislandsoundstudy.net/2019/11/addressing-gaos-recommendations-liss-performance-reporting-and-cost-estimating/). The report contains recommendations for the Study to continue estimating costs in future reports. We are following up with EPA to determine whether the Study will do this.

Recommendation: The Director, working with the Study, should estimate the range of potential costs for all implementation actions and include the estimates in future supplements to the 2015 plan. (Recommendation 3)

Agency: Environmental Protection Agency
Status: Open

Comments: In June 2020, the Study said that as part of the Plan 2020-2024 implementation action update, it will include a range of costs for implementation actions. We will review the supplemental documents when they are available and provide updated information as appropriate.

Recommendation: The Commissioner of CBP should take steps to evaluate the effectiveness of CBP's IPR enforcement efforts, such as by improving its metrics to track the overall effectiveness of its IPR enforcement efforts, evaluating selected activities to enhance IPR enforcement, and developing a process to assess and share information on port-led initiatives to enhance IPR enforcement (Recommendation 1)

Agency: Department of Homeland Security: United States Customs and Border Protection
Status: Open

Comments: CBP concurred with this recommendation. In September 2018, CBP stated that it had established an IPR working group that meets every 4-6 weeks to implement its Fiscal Year 2018 IPR Strategic Plan and develop priorities and metrics. CBP stated that, in these meetings, headquarters and field personnel share information on the results and effectiveness of local and national port initiatives and develop policies for improving IPR enforcement. Additionally, CBP provided evidence that it has begun efforts to improve its tracking of metrics and evaluation of selected activities to enhance IPR enforcement. For example, CBP provided data for 5 of the 16 measurement indicators included in its IPR Strategic Plan. Additionally, the IPR Strategic Plan includes at least 5 action items to assess or evaluate aspects of CBP's IPR enforcement. As of February 2020, CBP officials indicated they are continuing to work on these efforts. We will continue to monitor their implementation.

Recommendation: The Commissioner of CBP, in consultation with ICE, should assess what, if any, additional information would be beneficial to share with the private sector and, as appropriate, take action to enhance information sharing, where possible, such as by proposing regulatory revisions or requesting additional legal authorities from Congress. (Recommendation 2)

Agency: Department of Homeland Security: United States Customs and Border Protection
Status: Open

Comments: CBP concurred with this recommendation. CBP stated that, in May 2018, it briefed the Senate Finance Committee on six policy goals to improve IPR, import safety, and e-commerce enforcement that require additional legislative authority to implement. In December 2018, CBP stated that it had identified the need to establish an information sharing structure for e-commerce as a first step in implementing its E-Commerce Strategy. CBP officials stated that they would work with offices throughout CBP and with key stakeholders in the trade community and the Commercial Customs Advisory Committee (COAC) to build an information sharing structure and identify the necessary statutory and regulatory changes to implement it. CBP said that, when statutory changes have been identified, it will work through the interagency process to make any necessary Congressional recommendations. In January 2020, the Department of Homeland Security published a report that identified actions to combat trafficking of counterfeit and pirated goods in conjunction with the private sector. These actions included steps to share additional information with the private sector. For example, the report said that when CBP identifies suspected counterfeit merchandise that is destined for a U.S. fulfillment center or warehouse, it will notify the e-commerce platform or other third-party intermediary operating the facility. This will allow the operator of the fulfillment center or warehouse to remove or destroy any identical items from the same seller in coordination with rights holders. The report also recommends the formation of the Anti-Counterfeiting Consortium to Identify Online Nefarious Actors and a framework for sharing information with sellers, shippers, and other third-party intermediaries. If implemented, these steps could help to enhance information sharing with the private sector. GAO continues to monitor the implementation of these actions.

Recommendation: The Secretary of Homeland Security, in collaboration with other agencies, through the planned interagency working group or another mechanism, should identify further opportunities to more effectively publicize resources to reach additional colleges. (Recommendation 2)

Agency: Department of Homeland Security
Status: Open

Comments: In early 2020, the federal government created the schoolsafety.gov clearinghouse website to compile and publicize emergency preparedness resources from across multiple agencies including the Departments of Education, Homeland Security, and Justice. The website houses key emergency preparedness resources we identified during our work as well as newer information that was not part of our review, such as guidance related to the Coronavirus Pandemic. DHS issued a press release when the website was launched, but does not prominently publicize it on it website, including on its webpages that are specifically focused on colleges and universities. We will monitor the agency's efforts to publicize these resources and consider closing it at that time.

Recommendation: The Attorney General, in collaboration with other agencies through the planned interagency working group or another mechanism, should identify further opportunities to more effectively publicize resources to reach additional colleges. (Recommendation 3)

Agency: Department of Justice
Status: Open

Comments: In early 2020, the federal government created the schoolsafety.gov clearinghouse website to compile and publicize emergency preparedness resources from across multiple agencies including the Departments of Education, Homeland Security, and Justice. The website houses key emergency preparedness resources we identified during our work as well as newer information that was not part of our review, such as guidance related to the Coronavirus Pandemic. DOJ issued a press release when the website was launched, but does not prominently publicize it on it website, including on its webpages that are specifically focused on colleges and universities. We will monitor the agency's efforts to publicize these resources and consider closing it at that time.

Recommendation: The Director of OMB should continue to provide ongoing technical assistance that significantly contributes to agencies making their own determinations about their DATA Act reporting requirements and monitor agency submissions. (Recommendation 1)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open
Priority recommendation

Comments: OMB stated in January 2020 that it believes that the assistance it has previously provided to help agencies make their own reporting determinations fulfills the recommendation's intent. However, because we continue to identify instances where agencies had not submitted these data, we continue to believe that OMB needs to follow up with agencies that are not submitting quarterly data to find out why they are not reporting. It also needs to update its list of agencies required to report.

Recommendation: The Director of OMB should clarify and align existing guidance regarding the appropriate definitions agencies should use to collect and report on Primary Place of Performance and establish monitoring mechanisms to foster consistent application and compliance. (Recommendation 2)

Agency: Executive Office of the President: Office of Management and Budget
Status: Open
Priority recommendation

Comments: OMB has issued or contributed to guidance documents that are intended to help agencies collect and report on "Primary Place of Performance." We believe that providing specific examples of how agencies should approach challenging situations when reporting on this data element for grants would provide further clarity.

Recommendation: The Secretary of the Treasury should reasonably assure that ongoing monitoring controls to help ensure the completeness and accuracy of agency submissions are designed, implemented, and operating as designed. (Recommendation 4)

Agency: Department of the Treasury
Status: Open
Priority recommendation

Comments: In September 2019, Treasury officials stated that they are working to formalize a process for monitoring agency submissions. This process will include (1) emailing agencies prior to submission deadlines to remind them of the approaching submission deadlines; (2) following up with agencies that do not submit required data by the submission deadline and offering technical assistance as needed; and (3) forwarding a list of non-compliant agencies to OMB. GAO will continue to monitor Treasury's efforts to establish monitoring controls to help ensure the completeness and accuracy of the data.

Recommendation: The Secretary of the Treasury should disclose known data quality issues and limitations on the new USAspending.gov. (Recommendation 5)

Agency: Department of the Treasury
Status: Open
Priority recommendation

Comments: As of January 2020, Treasury has made progress by disclosing limitations related to unreported spending, among other things. Treasury is planning a major update to the USAspending.gov website to include more information about known data quality issues. Treasury plans to make this update to the website in the coming months and has an internal target date of June 2020 for completion. When completed, this action will help users make more informed decisions about how to interpret and use the data provided on the website.

Recommendation: The Undersecretary for Health should take additional steps to ensure that VA's website reports health care quality measures that cover a broad range of health care services, highlights key differences in the clinical quality of care, and presents this information in an easily accessible and understandable way (Recommendation 1).

Agency: Department of Veterans Affairs
Status: Open

Comments: As of January 2020, VA provided information that they had updated information on its website to include more quality measures, particularly as they relate to outpatient care. While VA has made progress in reporting on additional measures, we reviewed VA's website-specifically, their Access and Quality webpage which is the primary webpage for veterans to access information on quality-as of February 2020 and found that VA has still yet to report on a broad range of quality measures that would assist veterans in making health care decisions for inpatient care. For example, VA does not report any quality measures related to readmissions and mortality; length-of-stay; or efficiency. VA also continues to report only one timely and effective care measure for inpatient care. With regards to presentation of its quality measures, VA no longer links its Access and Quality webpage to the homepage of VA's website, making it more difficult to find. Additionally, for the new outpatient measures that VA has added to its website, VA has not presented these measures in an easily understandable way as there is little explanation of what they are measuring and how veterans can use these measures to make healthcare decisions. We will keep this recommendation open until VA has made further updates to its website.

Recommendation: The Undersecretary for Health should direct VA Central Office to conduct a systematic assessment of the completeness and accuracy of patient clinical information across VAMCs that is used to calculate the health care quality measures VA reports and address any deficiencies that affect the accuracy of these measures (Recommendation 2).

Agency: Department of Veterans Affairs
Status: Open

Comments: As of January 2020, VA has said they have focused on three main efforts as it relates to documenting information on VA quality of care, including: timeliness of access information (e.g., wait times) to health care within VA facilities; timeliness and accuracy of payments to community care providers; and accuracy of coding and documentation within VA and from community providers. In particular, VA has conducted several efforts to improve education and training on clinical documentation and coding, particularly for providers. VA has also said it has made efforts in requiring programs across regional networks aimed at improving clinical documentation and coding. While these efforts can help with improving documentation of care to veterans, it is unclear how VA Central Office has assessed whether these efforts have actually achieved its goals and improved the accuracy of its quality measures. As we stated in our report, VA Central Office has not conducted a systematic assessment of the completeness and accuracy of the clinical data recorded in VA patient medical records across all VAMCs. The results of such a systematic analysis could help identify the deficiencies, if any, in the recording of patient clinical information and what steps, if any, VA Central Office may need to take to address them. We will keep this recommendation open until VA provides information on a systematic assessment of clinical documentation.

Recommendation: To help improve students' access to information so that they can make well-informed transfer decisions, the Secretary of Education should require schools to (1) disclose the list of schools with which they have articulation agreements online if the school has a website, and (2) clearly inform students, on the school's website if it has one, when no articulation agreements on credit transfer are in place. If the department determines that it does not have the authority to require this, it should nonetheless encourage schools to take these actions (through guidance or other means).

Agency: Department of Education
Status: Open

Comments: As of March 2020, Education continues to disagree with this recommendation, noting that it already requires schools to disclose a list of other schools with which they have established articulation agreements. However, we believe that posting this information online would make it more accessible to prospective students compared to publications located physically on a school's campus, particularly for those who live far away from the school. Education also noted that students should contact specific schools to obtain accurate and updated transfer information. However, we found that not all schools listed transfer-specific contacts on their websites. In addition, Education cautioned that placing special emphasis on articulation agreements could mislead students because the agreements - or lack thereof - do not fully reflect the transferability of credits However, we found that a majority of schools already disclose a list of partner schools on their websites. We believe that posting a list of partner schools online would complement credit transfer policies, which schools are already required to post online. Given that the purpose of required consumer disclosures on articulation agreements is to inform students, we continue to believe that posting this information online would make it more accessible to prospective students and their families while enhancing students' understanding of their transfer options.

Recommendation: To help improve the Five-Star System's ability to enable consumers to understand nursing home quality and make distinctions between high- and low- performing homes, the Administrator of CMS should add information to the Five-Star System that allows consumers to compare nursing homes nationally.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: HHS did not concur with this recommendation. CMS officials told us in July 2019 that they do not plan to implement this recommendation. We maintain that adding national comparison information is important.

Recommendation: The Director of the Office of Management and Budget, in consultation with the Performance Improvement Council and General Services Administration, should ensure the information presented on Performance.gov consistently complies with GPRAMA public reporting requirements for the website's content.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: In February 2018, the Office of Management and Budget (OMB) and General Services Administration launched an updated version of Performance.gov. Our updated analysis of information presented on the site in August 2020 found that it does not meet all requirements. However, OMB continues to take action to address this recommendation. For example, Performance.gov does not include a required inventory of federal programs. In July 2020, OMB reported that it is working with agencies to address this requirement. Beginning with the fiscal year 2021 federal budget cycle, OMB and agencies plan to merge implementation of existing web-based reporting of performance and spending data to provide a more coherent picture of federal programs and activities. We will continue to monitor the status of actions taken to address this recommendation.

Recommendation: To improve the quality of the data published on ForeignAssistance.gov and help ensure consistency in published information, the Secretary of State should, in consultation with the Director of OMB and the USAID Administrator, develop additional guidance that takes into consideration current challenges to updating ForeignAssistance.gov with verified data.

Agency: Department of State
Status: Open
Priority recommendation

Comments: As of May 2020, State had taken some steps to coordinate with OMB and USAID to improve the quality of data reported for ForeignAssistance.gov. Notably, in May 2020, State and USAID submitted a joint report to Congress outlining a plan to consolidate the two federal websites reporting foreign assistance spending--ForeignAssistance.gov (managed by State) and explorer.usaid.gov (managed by USAID). As part of the plan, State and USAID will establish a joint data governance structure to reduce discrepancies in data, bolster the capacity of agencies to submit data, and ensure the accuracy and quality of data. Once the governance structure is finalized, they will send a copy to GAO. GAO will then review this information to assess if it sufficiently addresses GAO's recommendation.

Recommendation: To better ensure agencies fulfill their requirements, including implementing IQA guidelines and helping to promote easier public access to IQA information on agency websites, the Director of OMB should consolidate and centralize on OMB's IQA guidance website a government-wide summary of requests for correction submitted under the IQA.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: According to OMB, during the last two years OIRA has significantly improved the ease of access to and findability of documents on OMB's information quality website. OMB says it has a number of additional improvements in progress. We have requested information on those additional improvements. We will continue to monitor OMB's efforts related to this recommendation.

Recommendation: To better ensure agencies fulfill their requirements, including implementing IQA guidelines and helping to promote easier public access to IQA information on agency websites, the Director of OMB should work with the Department of Defense and the Federal Housing Finance Agency to help ensure that they post their IQA administrative mechanisms and IQA guidance online.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: According to OMB, it worked with the Federal Housing Finance Agency (FHFA) to improve the accessibility of their Information Quality Act guidance. In addition, OMB stated that FHFA took it upon themselves to update their guidelines. OMB has not provided any information regarding its work with DOD in this area. We will continue to monitor OMB's efforts related to this recommendation.

Recommendation: To better ensure agencies fulfill their requirements, including implementing IQA guidelines and helping to promote easier public access to IQA information on agency websites, the Director of OMB should provide additional guidance for agencies to help improve the transparency and usability of their IQA websites to help ensure the public can easily find and access online information about agency IQA implementation. Such guidance should include (1) specific time frames for agencies to post information on the IQA correction requests they have received, including making it clear when agencies have not received IQA requests; (2) instructions for agencies to include a statement on their IQA websites that the agencies may address correction requests through other administrative processes; (3) instructions for agencies to include, when responding to correction requests, whether those agencies plan to address the request through another administrative processes, and if so, which process they will use; and (4) suggestions for improving usability of agencies' websites including fixing broken links.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: According to OMB, in conjunction with its annual data call, the agency has and will continue to provide guidance to agencies about improving the transparency and usability of their websites, including the need to update broken links. In addition OMB issued M-19-15, designed to address a number of related and additional implementation concerns, including transparency and procedural improvements. OMB's guidance to date has not included specific items as specified in the recommendation. We will continue to monitor OMB's efforts related to this recommendation.

Recommendation: To improve agencies' guidance development, review, evaluation, and dissemination processes for non-significant guidance, we recommend that the Secretaries of USDA, HHS, DOL, and Education should improve the usability of selected component websites to ensure that the public can easily find, access, and comment on online guidance. These improvements could be informed by the web and customer satisfaction metrics that components have collected on their websites. Some examples of changes that could facilitate public access to online guidance include (1) improving website usability by clarifying which links contain guidance; (2) highlighting new or important guidance; and (3) ensuring that posted guidance is current.

Agency: Department of Health and Human Services
Status: Open

Comments: In comments printed in the April 2015 final report, HHS concurred with the recommendation and stated that it would review current links to guidance documents and explore ways to enhance their visibility and usability. As of June 2020, GAO is working with HHS officials to obtain additional updates and documentation regarding the department's implementation of this recommendation.

Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to include in the CMS Compare websites, to the extent feasible, estimated out-of-pocket costs for Medicare beneficiaries for common treatments that can be planned in advance.

Agency: Department of Health and Human Services
Status: Open

Comments: As of September 2019, HHS officials have not informed us of any actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.

Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to organize cost and quality information in the CMS Compare websites to facilitate consumer identification of the highest-performing providers, such as by listing providers in order based on their performance.

Agency: Department of Health and Human Services
Status: Open

Comments: As of September 2019, HHS officials have not informed us of any actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.

Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to include in the CMS Compare websites the capability for consumers to customize the information presented, to better focus on information relevant to them.

Agency: Department of Health and Human Services
Status: Open

Comments: As of September 2019, HHS officials have not informed us of any actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.

Recommendation: To improve consumers' access to relevant and understandable information on the cost and quality of health care services, the Secretary of HHS should direct the Administrator of CMS to develop specific procedures and performance metrics to ensure that CMS's efforts to promote the development and use of its own and others' transparency tools adequately address the needs of consumers.

Agency: Department of Health and Human Services
Status: Open

Comments: As of September 2019, HHS officials have not informed us of any actions taken to implement this recommendation. We will update the status of this recommendation when we receive additional information.

Recommendation: To improve the completeness and accuracy of data submissions to the USASpending.gov website, the Director of the Office of Management and Budget, in collaboration with Treasury's Fiscal Service, should clarify guidance on (1) agency responsibilities for reporting awards funded by non-annual appropriations; (2) the applicability of USASpending.gov reporting requirements to non-classified awards associated with intelligence operations; (3) the requirement that award titles describe the award's purpose (consistent with our prior recommendation); and (4) agency maintenance of authoritative records adequate to verify the accuracy of required data reported for use by USASpending.gov.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open
Priority recommendation

Comments: OMB has taken several steps related to this recommendation as of December 2019, but have not fully addressed it. Specifically, working with the Department of the Treasury to implement the DATA Act, OMB took partial action on two aspects of the recommendation and are still considering actions on two others. 1) OMB staff said they continue to deliberate on agency responsibilities for reporting awards funded by non-annual appropriations. 2) OMB staff provided a Frequently Asked Question (FAQ) addressing the applicability of USASpending.gov reporting requirements for recipient information related to classified or sensitive information. GAO reviewed the FAQ and determined that additional guidance is still needed to ensure complete reporting of unclassified awards as required by FFATA. 3) OMB staff have agreed that it will be important to clarify guidance on how agencies can report on award titles that appropriately describes the awards' purposes and noted that they are working on providing additional guidance to agencies as part of their larger DATA Act implementation efforts. 4) OMB released policy guidance in May 2016 (MPM 2016-03) that identifies the authoritative sources for reporting procurement and award data. However, GAO's review of this policy guidance determined that it does not address the underlying source that can be used to verify the accuracy of non-financial procurement data or any source for data on assistance awards.

Recommendation: To ensure effective management and modernization of HUD's IT environment, the Secretary of Housing and Urban Development should direct the department's Chief Information Officer to define the scope, implementation strategy, and schedule of its overall modernization approach, with related goals and measures for effectively overseeing the effort.

Agency: Department of Housing and Urban Development
Status: Open
Priority recommendation

Comments: In July 2018, the Office of the Chief Information Officer (OCIO) reported that the goal of the Chief Technology Officer's technical assessment of HUD's IT environment was to identify gaps and develop an implementation strategy and approach to establish a modernization roadmap. As of March 2020, OCIO reported that it had completed the technical assessment to identify gaps in IT. The department has also taken action to define an overall modernization approach, including the scope, implementation strategy, and schedule for modernizing its IT environment and systems. However, as of March 2020, HUD had not yet established measures for overseeing its modernization efforts.

Recommendation: Congress should consider strengthening the current consumer privacy framework to reflect the effects of changes in technology and the marketplace--particularly in relation to consumer data used for marketing purposes--while also ensuring that any limitations on data collection and sharing do not unduly inhibit the economic and other benefits to industry and consumers that data sharing can accord. Among the issues that should be considered are: (1) the adequacy of consumers' ability to access, correct, and control their personal information in circumstances beyond those currently accorded under FCRA; (2) whether there should be additional controls on the types of personal or sensitive information that may or may not be collected and shared; (3) changes needed, if any, in the permitted sources and methods for data collection; and (4) privacy controls related to new technologies, such as web tracking and mobile devices.

Agency: Congress
Status: Open

Comments: As of July 2020, Congress has not taken action on this matter.

Recommendation: To enhance the value of Performance.gov for intended audiences and improve the ability to identify and prioritize potential improvements, the Director of the Office of Management and Budget--working with the Performance Improvement Council and the General Services Administration--should seek to ensure that all performance, search, and customer satisfaction metrics, consistent with leading practices outlined in HowTo.gov, are tracked for the website, and, where appropriate, create goals for those metrics to help identify and prioritize potential improvements to Performance.gov.

Agency: Executive Office of the President: Office of Management and Budget
Status: Open

Comments: As of October 2020, the Office of Management and Budget (OMB) and General Services Administration (GSA) had taken some actions toward addressing this recommendation. According to information that OMB staff provided in March 2019, OMB and GSA tracked 12 metrics for Performance.gov that are recommended for federal websites. However, as of October 2020, OMB and GSA had not created goals for any of those metrics, nor did they track 12 additional recommended metrics. In March 2019, GSA staff told us that, in lieu of goals, OMB and GSA staff held regular meetings to discuss the data collected for the metrics they tracked. However, without the additional metrics or any goals, OMB and GSA lack a full understanding of how well the website is performing, and what actions are needed to improve its performance and usability to achieve desired results. We will continue to monitor the status of actions taken to address this recommendation.

Recommendation: The Acting Commissioner of the Internal Revenue Service should direct appropriate officials to develop a long-term strategy to improve web services provided to taxpayers, in accordance with Howto.gov and other federal guidance outlined in our report. To accomplish this, the IRS should establish a numerical or other measureable goal to improve taxpayer satisfaction and a timeframe for achieving it.

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: IRS has made progress in improving its online services strategy, as we recommended, but as of February 2020, IRS has not yet completed its efforts. IRS's strategy has evolved from a singular focus on on-line services to a more comprehensive strategy of taxpayer interaction through all service channels. In February 2016, IRS announced an agency-wide Future State Initiative, which in part, aims to deliver service improvements across different taxpayer interactions such as individual online accounts assistance, exams, and collections. In July 2016, the official responsible for IRS's on-line office reported that the agency is working towards developing an overall customer service satisfaction goal as part of the IRS Future State Initiative. The official said that this goal is broadly meant to cover various ways the public interacts with IRS, including web, phone, correspondence and walk in. In November 2016, IRS provided documentation on the goals of the Future State Initiative. However, this documentation does not include specific numerical targets for the performance measures that IRS expects to achieve for each goal or a timeline to achieve those goals. IRS officials stated they will incorporate a customer service satisfaction goal in its upcoming strategic plan. IRS released the Fiscal Year 2018-2022 Strategic Plan, however a numerical or other measureable goal to improve taxpayer satisfaction with the website was not included in it. We are currently following up with IRS to determine their next steps.