Recommendation: The Under Secretary for Health should establish steps for communicating to VA's actuarial consultant information on data quality, including any limitations, used in the actuarial modeling that informs VA's community care budget estimates. (Recommendation 1)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Under Secretary for Health should establish further steps for assessing and communicating to stakeholders the degree of overall uncertainty associated with actuarial projections for community care that inform the community care budget estimates. (Recommendation 2)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: Congress should consider requiring VA to establish an overall wait-time performance measure for veterans to receive care under the VCCP that will permit VA to measure and monitor the timeliness of VCCP appointments and compare timeliness to that of VA medical facilities. (Matter for Consideration 1)

Agency: Congress
Status: Open

Comments: When we determine what steps the Congress has taken, we will provide updated information.

Recommendation: The Under Secretary of Health should align its monitoring metrics with the time frames established in the VCCP scheduling process. (Recommendation 1)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Under Secretary of Health should conduct a review of community provider enrollment and use of the HSRM to include identifying and taking steps to remove any challenges to community provider enrollment and use; and, if determined appropriate, establish a requirement for community providers to use the HSRM; and (Recommendation 2)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Under Secretary of Health should direct VAMC leadership to assess their community care staffing and resource needs, and develop a plan to address any identified risks to their ability to schedule appointments in a timely manner, including strategies to adjust staff levels and address recruitment and retention challenges as needed. (Recommendation 3)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, consistently collect complete and accurate information about the quality of available civilian health care in proximity to its MTFs (such as ratings from the Centers for Medicare and Medicaid Services and perceptions from MTF officials who regularly coordinate with civilian providers, among other means) and assess that information to inform recommendations for future MTF restructuring decisions. (Recommendation 1)

Agency: Department of Defense
Status: Open

Comments: DOD partially concurred with this recommendation. In its response, the department described its planned implementation steps, such as publishing measures it may use for assessing available civilian health care. We will continue to monitor the status of the measures and any other actions the department takes to address the recommendation.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, consistently collect complete and accurate information about the extent to which current health care providers within the TRICARE networks meet access-to-care standards, and assess that information to inform recommendations on future MTF restructuring decisions. (Recommendation 2)

Agency: Department of Defense
Status: Open

Comments: DOD partially concurred with this recommendation. The department noted actions underway and planned to implement it, including a centralized appointment booking system and monitoring access to care as MTFs restructure. We will continue to monitor the status of this effort and any other actions the department takes to address the recommendation.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, consistently collect complete and accurate information about the extent to which non-network civilian health care providers that could be incorporated into the TRICARE network meet access-to-care standards in terms of drive time, and assess that information to inform recommendations on future MTF restructuring decisions. (Recommendation 3)

Agency: Department of Defense
Status: Open

Comments: DOD partially concurred with this recommendation, and described planned steps to implement it for future MTF restructuring decisions. We will continue to monitor actions the department takes to address the recommendation.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, conducts a sensitivity analysis of the relative cost-effectiveness of MTF-provided care compared to civilian-provided care under varying assumptions, and document that information for decision makers to inform recommendations on future MTF restructuring decisions. Varying conditions could include different types of health care services, reducing the cost of military personnel salaries, and increasing estimated MTF wRVUs and civilian reimbursement rates. (Recommendation 4)

Agency: Department of Defense
Status: Open

Comments: DOD partially concurred with this recommendation. We will continue to monitor actions the department takes to address the recommendation.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, establishes clear roles and responsibilities for executing and monitoring transitions for MTFs identified for restructuring. (Recommendation 5)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation and described actions underway and planned to implement it. We will continue to monitor actions the department takes to address the recommendation.

Recommendation: The Secretary of Defense should ensure that the Assistant Secretary of Defense for Health Affairs, in coordination with the Surgeons General of the military departments and the Director of the DHA, defines measurable objectives for MTF restructuring transitions, establishes thresholds and goals for each objective, and applies them to evaluate progress and challenges. For example, measurable objectives, thresholds, and goals, should include an evaluation of medical providers' clinical readiness, civilian health care provider adequacy, and the cost-effectiveness of MTF and purchased care. (Recommendation 6)

Agency: Department of Defense
Status: Open

Comments: DOD concurred with this recommendation and described actions underway and planned to implement it. We will continue to monitor actions the department takes to address the recommendation.

Recommendation: The Commissioner of the Social Security Administration should clarify policies and procedures to remind staff that a diagnosis of a substance use disorder is not necessary to conduct a Drug Addiction and Alcoholism evaluation. (Recommendation 1)

Agency: Social Security Administration
Status: Open

Comments: SSA agreed with this recommendation. The agency stated that it had revised related policies in February 2020, and had planned to issue guidance and video-on-demand training to further clarify policies and procedures in this area. However, SSA said its efforts to maintain mission critical activities amid the COVID-19 pandemic have delayed further implementation of this recommendation and a specific implementation date could not be provided at this time.

Recommendation: The Commissioner of the Social Security Administration should ensure that staff document their rationale for decisions involving the Drug Addiction and Alcoholism evaluation process. (Recommendation 2)

Agency: Social Security Administration
Status: Open

Comments: SSA agreed with this recommendation. The agency said it had planned to issue guidance reinforcing its policy on properly documenting decisions involving the Drug Addiction and Alcoholism evaluation process. However, SSA said its efforts to maintain mission critical activities amid the COVID-19 pandemic have delayed implementation of this recommendation and a specific implementation date could not be provided at this time.

Recommendation: The Under Secretary for Health should document same-day services objectives and develop performance goals and related performance measures to facilitate the periodic assessment of the impact of same-day services on veterans' access to care. (Recommendation 1)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Under Secretary of Health should require that all failures to meet quality standards are cited as deficiencies on SVH inspections. (Recommendation 2)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: VA concurred with this recommendation and, as of July 2020, had taken some initial steps to address the recommendation such as modifying the SVH contractor's contract to stop the practice of using 'recommendations' for low-level deficiencies and beginning the process of revising a VA policy to address this practice.

Recommendation: The Under Secretary of Health should develop guidance for Veterans Affairs Medical Center staff conducting optional onsite CNH reviews. (Recommendation 3)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: VA concurred in principle with this recommendation and indicated in January 2020 that it had begun taking actions to address this recommendation such as developing a memo of clarification and planning the release of additional guidance for staff.

Recommendation: The Under Secretary of Health should provide information on the quality of all SVHs that is comparable to the information provided on the other nursing home settings on its Access to Care website. (Recommendation 4)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: VA concurred in principle and, as of July 2020, had begun taking some steps to address this recommendation such as exploring options for presenting SVH quality measure data.

Recommendation: As VA and IHS revise the MOU and related performance measures, the Secretary of Veterans Affairs should ensure these measures are consistent with the key attributes of successful performance measures, including having measurable targets. (Recommendation 1)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Veterans Affairs should, in consultation with IHS and tribes, establish and distribute a written policy or guidance on how referrals from IHS and Tribal Health Program (THP) facilities to VA facilities for specialty care can be managed. (Recommendation 2)

Agency: Department of Veterans Affairs
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: As VA and IHS revise the MOU and related performance measures, the Director of IHS should ensure these measures are consistent with the key attributes of successful performance measures, including having measurable targets. (Recommendation 3)

Agency: Department of Health and Human Services: Public Health Service: Indian Health Service
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: Once VA's new software for managing authorizations has been fully implemented, the Undersecretary for Health should monitor data on secondary authorization requests approval decision time frames to ensure VA medical facilities are in adherence with VA policy, assess the reasons for nonadherence with the policy, and take corrective actions as necessary. (Recommendation 1)

Agency: Department of Veterans Affairs
Status: Open

Comments: VA agreed with our recommendation and stated that it has already taken steps to improve compliance with secondary authorization request approval timeframes.by identifying challenges, agreeing on improvement actions, and providing training. According to VA, its new Health Share Referral Manager system, which VA expects will be fully implemented across all medical facilities by December 2019, will automate secondary authorization request reporting and tracking. According to VA, it will utilize this new system to ensure compliance with secondary authorization request approval time frames.

Recommendation: The Undersecretary for Health should collect data and monitor compliance with the Choice Program contractual requirements pertaining to customer service for community providers, and take corrective actions as necessary. (Recommendation 2)

Agency: Department of Veterans Affairs
Status: Open

Comments: VA agreed with our recommendation and stated that it currently does not have the ability to monitor and assess the performance of customer service operations under the Choice Program contracts. VA has included additional requirements for customer service in the Veterans Community Care Network request for proposals and plans to monitor compliance with these requirements under the Veterans Community Care Program. VA expects to implement this recommendation by December 2019.

Recommendation: The Director of IHS should obtain, on an agency-wide basis, information on temporary provider contractors, including their associated cost and number of full-time equivalents, and use this information to inform decisions about resource allocation and provider staffing. (Recommendation 1)

Agency: Indian Health Service
Status: Open

Comments: In February 2020, IHS reported that challenges in rolling-up contractor information on a national level stem from the fact that the agency often uses single contract vehicles, such as staffing companies, to hire multiple providers for temporary periods of time. IHS's contract databases do not centrally track the numbers of individual providers through such staffing contracts. The ability to analyze and compare detailed actual costs of federal hires vs. contract hires is currently limited to local information sources and on a narrow area of focus, such as one provider category or one facility at a time. IHS reported that the agency is implementing a monthly reporting requirement for IHS Areas and plans to use this information to inform decisions about resource allocation and provider staffing. We will review these reporting requirements when they have been fully implemented.

Recommendation: The Under Secretary of Health should ensure all RME inspections are being conducted and reported as required and that the inspection results VHA has are complete. (Recommendation 1)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: VA agreed with this recommendation and indicated it would establish an oversight process for reviewing and monitoring findings from inspections. VA has described some of the oversight actions it has put in place and noted that actions would be completed in 2020. We will update the status of this recommendation when additional information is received.

Recommendation: The Under Secretary of Health should examine the Sterile Processing Services workforce needs and take action based on this assessment, as appropriate. (Recommendation 3)

Agency: Department of Veterans Affairs: Veterans Health Administration
Status: Open

Comments: VA agreed with this recommendation and indicated it would review workforce needs and take necessary actions. VA has described some of the actions taken and noted that actions would be completed in 2019. We will update the status of this recommendation when additional information is received.

Recommendation: The Secretary of HHS should establish numeric enrollment targets for healthcare.gov, to ensure it can monitor its performance with respect to its objectives. (Recommendation 2)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS does not concur with this recommendation. In October 2018, the agency noted that there are numerous external factors, such as the state of the economy and plan premiums, that may affect the number of people who decide to enroll in coverage. HHS also stated that it does not believe that numeric enrollment targets are relevant to assess the performance of objectives related to a successful open enrollment period. We continue to believe that the development of numeric enrollment targets is important for effective monitoring of the program and management of its resources. As of September 2019, HHS had not provided any additional information about steps to implement this recommendation. The status of this recommendation will be reconsidered once relevant action is taken.

Recommendation: Should the agency continue to focus on enhancing the consumer experience as a goal for the program, the Secretary of HHS should assess other aspects of the consumer experience, such as those it previously identified as key, to ensure it has quality information to achieve its goal. (Recommendation 3)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS concurs with this recommendation, and in October 2018, stated that as it is looking for ways to improve the consumer experience, it will consider focusing its assessment on other aspects of the consumer experience as needed. As of September 2019, HHS had not provided evidence of any additional steps it had taken to improve the consumer experience. The status of this recommendation will be reconsidered once relevant action is taken.

Recommendation: The Under Secretary for Health should establish an achievable wait-time goal for the consolidated community care program that VA plans to implement that will permit VHA to monitor whether veterans are receiving VA community care within time frames that are comparable to the amount of time they would otherwise wait to receive care at VHA medical facilities. (Recommendation 1)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open
Priority recommendation

Comments: The Veterans Health Administration (VHA) agreed with our recommendation and stated in March 2020 that it is taking steps to establish a wait-time goal for the new consolidated community care program-the Veterans Community Care Program. Actions include updating VHA's current directives and the implementation of the HealthShare Referral Manager, a software system that will provide VHA the capability to monitor wait times.

Recommendation: The Under Secretary for Health should design an appointment scheduling process for the consolidated community care program that VA plans to implement that sets forth time frames within which (1) veterans' referrals must be processed, (2) veterans' appointments must be scheduled, and (3) veterans' appointments must occur, which are consistent with the wait-time goal VHA has established for the program. (Recommendation 2)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open
Priority recommendation

Comments: The Veterans Health Administration (VHA) agreed with our recommendation and stated in March 2020 that it is taking steps to design an appointment scheduling process for the new consolidated community care program-the Veterans Community Care Program. This includes actions to develop a wait-time goal, and the development and review of VHA's new community care directive.

Recommendation: The Under Secretary for Health should establish a mechanism that will allow VHA to systematically monitor the average number of days it takes for VAMCs to prepare referrals, for VAMCs or TPAs to schedule veterans' appointments, and for veterans' appointments to occur, under the consolidated community care program that VA plans to implement. (Recommendation 3)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open

Comments: The Veterans Health Administration (VHA) agreed with our recommendation and stated in March 2020 that it is taking steps to establish a mechanism to monitor appointment timeliness for the new consolidated community care program-the Veterans Community Care Program. This includes the implementation of the HealthShare Referral Manager, a software system that will allow VHA to measure timeliness of appointment scheduling actions, development of a wait-time goal, review of current VHA directives, and the development of reports that can be used by VA medical centers to monitor appointment scheduling timeliness.

Recommendation: The Under Secretary for Health should implement a mechanism to prevent veterans' clinically indicated dates from being modified by individuals other than VHA clinicians when veterans are referred to the consolidated community care program that VA plans to implement. (Recommendation 4)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open

Comments: The Veterans Health Administration (VHA) agreed with our recommendation and stated that it is taking steps to implement a mechanism to prevent veterans' clinically indicated dates (CID) from being modified by VHA staff other than VHA providers for the new consolidated community care program-the Veterans Community Care Program. Specifically, VHA developed the HealthShare Referral Manager (HSRM), a software system for VA medical center (VAMC) staff to use to manage VCCP referrals, including creating authorizations and scheduling veteran appointments with community providers. VHA deployed the HSRM at all VAMCs as of June 24, 2019, and according to VHA officials, the system was fully implemented as of December 31, 2019. In March 2020, VHA provided documentation that shows (1) the VHA clinician populates the CID field when they create the referral in VA's electronic medical record system, (2) when the referral is forwarded to HSRM for referral management and appointment scheduling by VAMC staff, the CID field in HSRM is auto-populated based on the CID in VA's electronic medical record system, and (3) the auto-populated CID field in HSRM cannot be edited. However, under VA's current scheduling process, some VHA staff can still edit the referral after the VHA provider enters the CID and before it is sent to the HSRM for scheduling. VHA will need to take action to ensure this part of the process has protections to ensure veterans' CIDs aren't modified after being entered by the VHA provider.

Recommendation: The Under Secretary for Health should implement a mechanism to separate clinically urgent referrals and authorizations from those for which the VAMC or the TPA has decided to expedite appointment scheduling for administrative reasons. (Recommendation 5)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open

Comments: The Veterans Health Administration (VHA) did not concur with this recommendation, and states a mechanism is no longer needed as VA medical center staff are responsible for appointment scheduling under the new consolidated community care program, the Veterans Community Care Program (VCCP), not staff from third-party administrators. However, we believe this recommendation is still relevant, and in July 2020 we asked VHA for evidence to show that VA medical center staff, when scheduling VCCP appointments, are not changing routine referrals to an urgent status to expedite appointment scheduling in cases of delays.

Recommendation: The Under Secretary for Health should (1) establish oversight mechanisms to ensure that VHA is collecting reliable data on the reasons that VAMC or TPA staff are unsuccessful in scheduling veterans' appointments through the consolidated community care program VA plans to implement, and (2) demonstrate that it has corrected any identified deficiencies. (Recommendation 6)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open

Comments: The Veterans Health Administration (VHA) agreed with our recommendation and stated in March 2020 that it is taking steps to establish an oversight mechanism to ensure VHA is collecting reliable data in cases where staff are unsuccessful in scheduling veterans' appointments for the new consolidated community care program-the Veterans Community Care Program. This includes actions to implement the HealthShare Referral Manager, a software system that will allow VHA to produce reports on reasons for unsuccessful scheduling attempts, development of a community care directive, and an analysis of the reasons behind unsuccessful scheduling.

Recommendation: The Secretary of Veterans Affairs should ensure that the contracts for the consolidated community care program VA plans to implement include performance metrics that will allow VHA to monitor average driving times between veterans' homes and the practice locations of community providers that participate in the TPAs' networks. (Recommendation 7)

Agency: Department of Veterans Affairs
Status: Open

Comments: The Veterans Health Administration agreed with this recommendation, and as of March 2020, reported that it included performance metrics related to drive times in its contracts for the new third-party administrators in Regions 1-4 of the new Community Care Network under the Veterans Community Care Program. The contracts for Regions 5 and 6 have not been awarded yet.

Recommendation: The Under Secretary for Health should issue a comprehensive policy directive and operations manual for the consolidated community care program VA plans to implement and ensure that these documents are reviewed and updated in a timely manner after any significant changes to the program occur. (Recommendation 10)

Agency: Department of Veterans Affairs: Office of the Under Secretary for Health
Status: Open

Comments: The Veterans Health Administration agreed in principle with this recommendation, and stated that it has taken action to develop a new community care directive, which was under technical review as of March 2020.

Recommendation: The Secretary of Defense should direct the Assistant Secretary of Defense (Health Affairs) to provide written documentation of DOD's approach to developing and approving the TRICARE Select access standards, as well as the final access standards, to Congress. (Recommendation 1)

Agency: Department of Defense
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Undersecretary for Health should take additional steps to ensure that VA's website reports health care quality measures that cover a broad range of health care services, highlights key differences in the clinical quality of care, and presents this information in an easily accessible and understandable way (Recommendation 1).

Agency: Department of Veterans Affairs
Status: Open

Comments: As of January 2020, VA provided information that they had updated information on its website to include more quality measures, particularly as they relate to outpatient care. While VA has made progress in reporting on additional measures, we reviewed VA's website-specifically, their Access and Quality webpage which is the primary webpage for veterans to access information on quality-as of February 2020 and found that VA has still yet to report on a broad range of quality measures that would assist veterans in making health care decisions for inpatient care. For example, VA does not report any quality measures related to readmissions and mortality; length-of-stay; or efficiency. VA also continues to report only one timely and effective care measure for inpatient care. With regards to presentation of its quality measures, VA no longer links its Access and Quality webpage to the homepage of VA's website, making it more difficult to find. Additionally, for the new outpatient measures that VA has added to its website, VA has not presented these measures in an easily understandable way as there is little explanation of what they are measuring and how veterans can use these measures to make healthcare decisions. We will keep this recommendation open until VA has made further updates to its website.

Recommendation: The Undersecretary for Health should direct VA Central Office to conduct a systematic assessment of the completeness and accuracy of patient clinical information across VAMCs that is used to calculate the health care quality measures VA reports and address any deficiencies that affect the accuracy of these measures (Recommendation 2).

Agency: Department of Veterans Affairs
Status: Open

Comments: As of January 2020, VA has said they have focused on three main efforts as it relates to documenting information on VA quality of care, including: timeliness of access information (e.g., wait times) to health care within VA facilities; timeliness and accuracy of payments to community care providers; and accuracy of coding and documentation within VA and from community providers. In particular, VA has conducted several efforts to improve education and training on clinical documentation and coding, particularly for providers. VA has also said it has made efforts in requiring programs across regional networks aimed at improving clinical documentation and coding. While these efforts can help with improving documentation of care to veterans, it is unclear how VA Central Office has assessed whether these efforts have actually achieved its goals and improved the accuracy of its quality measures. As we stated in our report, VA Central Office has not conducted a systematic assessment of the completeness and accuracy of the clinical data recorded in VA patient medical records across all VAMCs. The results of such a systematic analysis could help identify the deficiencies, if any, in the recording of patient clinical information and what steps, if any, VA Central Office may need to take to address them. We will keep this recommendation open until VA provides information on a systematic assessment of clinical documentation.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to ensure that state-based marketplace annual sustainability plans, to the extent possible, have complete 5-year budget forecasts. (Recommendation 1)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS did not concur with our recommendation and stated that it had updated its requirement to request 2-year budget forecasts instead of 5-year budget forecasts. In its December 2017 statement of actions, HHS stated that it was working to streamline and simplify its data collection effort as part of the annual sustainability plan. In April 2018, HHS provided a revised 2-year budget forecast template as well as related state marketplace training documentation. As of April 2020, HHS had not provided further documented evidence of its streamlined process using the 2-year budget forecast template or justification that a 5-year budget is not necessary for assessing long-term financial sustainability and state marketplace sustainability risks.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to ensure that all state-based marketplaces provide required annual financial audit reports which are in accordance with generally accepted government auditing standards. (Recommendation 2)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS concurred with our recommendation and stated in its December 2017 update that it continued to provide technical assistance such as webinars and other trainings on independent financial and programmatic audit submission requirements. In April 2018, HHS provided evidence that it had taken some steps to ensure that state-based marketplaces provide required annual financial audit reports, including draft financial audit procedures, documentation of related training provided to states, and a revised HHS state officer annual review checklist emphasizing financial audit reporting. However as of April 2020, the department had not provided evidence of finalized procedures, examples of checklist usage, or of states providing annual financial audit reports. Further, HHS training documentation stated that state-based marketplaces could provide alternate financial audit reports, such as a state-wide financial audit report, in lieu of a marketplace specific report. It is not clear from the provided evidence that the department has ensured that state-based marketplaces are in compliance with financial audit reporting requirements. We will continue to monitor the department's progress in implementing the recommendation and provide updates when the agency takes further action.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to ensure that marketplace IT self-sustainability risk assessments are based on fully defined measurable terms, a clear categorization process, and a defined response to high risks. (Recommendation 3)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS concurred with our recommendation and stated in its December 2017 update that it would refine its marketplace self-sustainability risk assessment process to provide greater insight into the state marketplace sustainability efforts and to identify areas where states may need assistance. In April 2018, HHS provided evidence that it had taken some steps to base its risk assessments on fully defined processes. CMS provided documentation of clearly defined and measurable terms used for state marketplace budget analysis. However, HHS did not provide evidence that these defined terms were incorporated into analyses or risk assessments. As of April 2020, CMS has not provided evidence that it took steps to develop a clear categorization process or a defined response to high risks. We will continue to monitor the department's progress in implementing the recommendation and provide updates when the agency takes action.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to ensure that states develop, update, and follow performance measurement plans that allow the states to continuously identify and assess the most important IT metrics for their state marketplaces. (Recommendation 4)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS partially concurred with our recommendation and stated in its December 2017 update that though each marketplace was accountable for managing and reporting its own IT metrics in accordance with federal and state law, HHS would work with states on the improvement of their management and operations through technical assistance and oversight and accountability measures. As of April 2020, the agency had not yet provided sufficient evidence that it has implemented the recommendation. We will continue to monitor the department's progress in implementing the recommendation and provide updates when the agency takes action.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to conduct operational analysis reviews and systematically monitor the performance of states' marketplace IT systems using key performance indicators. (Recommendation 5)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS did not concur with our recommendation and stated that it conducted Open Enrollment Readiness Reviews to assess marketplace key performance indicators, which according to CMS officials, are similar to operational analysis reviews. However, as of October 2018, HHS had not provided evidence that the Open Enrollment Readiness Reviewed systematically and comprehensively reported on the key performance indicators or include discussion of other key elements identified in best practices for operational analysis reviews, such as how objectives could be better met, or costs could be saved. As of April 2020, the agency had not yet provided sufficient evidence that it has implemented the recommendation.

Recommendation: The Secretary of Health and Human Services should direct the Administrator of the Centers for Medicare & Medicaid Services to take steps to ensure that metrics collected from states to monitor marketplaces' operational performance link to performance goals and include baselines and targets to monitor progress. (Recommendation 6)

Agency: Department of Health and Human Services
Status: Open

Comments: HHS partially concurred with our recommendation and stated in its December 2017 update that states were responsible for monitoring their own performance measures but HHS would continue to review IT metrics of state marketplaces in the implementation phase of their systems through technical assistance activities and oversight and accountability measures. As of April 2020, the agency had not yet provided sufficient evidence that it has implemented the recommendation. We will continue to monitor the department's progress in implementing the recommendation and provide updates when the agency takes action.

Recommendation: To improve CMS's oversight of states' MLTSS programs, the Administrator of CMS should take steps to identify and obtain key information needed to oversee states' efforts to monitor beneficiary access to quality services, including, at a minimum, obtaining information specific to network adequacy, critical incidents, and appeals and grievances.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: The Department of Health and Human Services (HHS) agreed with this recommendation. In December 2017, HHS communicated its intent to review regulations and enhance its capacity to measure, monitor, and improve care and quality across a number of domains, including MLTSS. As of February 2020, HHS stated that it is developing guidance related to reporting on key information needed to oversee beneficiary access to care. GAO will continue to monitor the department's actions and any steps taken to address this recommendation.

Recommendation: To improve annual reporting on PTC improper payments, control activities related to eligibility determinations, and calculations of advance PTC, the Secretary of Health and Human Services should direct the Administrator of CMS to annually report improper payment estimates and error rates for the advance PTC program.

Agency: Department of Health and Human Services
Status: Open
Priority recommendation

Comments: The Department of Health and Human Services (HHS) concurred with this recommendation. On May 23, 2018, HHS's Centers for Medicare and Medicaid Services (CMS) stated that it is currently in the process of developing an improper payment measurement for the advance premium tax credit (PTC). The development of the measurement methodologies will be a multi-year process which consists of the development of measurement policies, procedures, and tools. It also includes extensive pilot testing to ensure an accurate and efficient improper payment estimate, as well as, acquisition activities for procurement of improper payment measurement contractors. In January 2020, CMS stated that it is still in the process of developing an improper payment measurement for the advance PTC. Further, CMS stated that it provided progress updates in the fiscal year 2019 HHS agency financial report (AFR), and will continue to do so in future AFRs until an improper payment rate is estimated. We will continue to monitor the agency's actions to address this recommendation.

Recommendation: To improve annual reporting on PTC improper payments, control activities related to eligibility determinations, and calculations of advance PTC, and until annual reporting of improper payment estimates and error rates for the advance PTC program is performed, the Secretary of Health and Human Services should direct the Administrator of CMS to disclose significant matters relating to the Improper Payments Information Act (IPIA) estimation, compliance, and reporting objectives for the advance PTC program in the agency financial report, including CMS's progress and timeline for expediting the achievement of those objectives and the basis for any delays in meeting IPIA requirements.

Agency: Department of Health and Human Services
Status: Open

Comments: HHS concurred with this recommendation. On February 28, 2018, the Department of Health and Human Services's (HHS) Centers for Medicare and Medicaid Services (CMS) stated that updates on the advance premium tax credit (PTC) program improper payment measurement development were provided in the fiscal year (FY) 2017 Agency Financial Report (AFR), which was published in November 2017. In FY 2018, we reviewed the FY 2017 AFR that HHS's CMS cited in support for closing this recommendation. Based on our review, the FY 2017 AFR does not address our recommendation as it does not provide a timeline for reporting an improper payment estimate. In FY 2019, we reviewed HHS's FY 2018 AFR published in November 2018, which includes a statement that HHS will continue to update its annual AFRs on the status of the measurement program development until the improper payment estimate is reported. However, this latest AFR also does not provide a timeline for reporting an improper payment estimate for HHS's PTC program. In January 2020, CMS stated that it is in the process of procuring federal contractors to perform the improper payment measurement. However, CMS further stated that due to uncertainties surrounding the timing of the procurement, CMS does not anticipate publishing a reporting timeline until the contracts have been awarded. We will continue to monitor the agency's actions to address this recommendation.

Recommendation: To improve annual reporting on PTC improper payments, control activities related to eligibility determinations, and calculations of advance PTC, the Secretary of Health and Human Services should direct the Administrator of CMS to design and implement procedures for verifying the identities of phone and mail applicants to reasonably assure that ineligible individuals are not enrolled in qualified health plans in the marketplaces or provided advance PTC.

Agency: Department of Health and Human Services
Status: Open

Comments: The Department of Health and Human Services (HHS) neither agreed nor disagreed with this recommendation. Regarding verification of filer identity, HHS stated, in response to the draft report, that for individuals starting an application via phone, the call center representatives use verbal attestations for verifications from individuals. HHS stated that for paper applications, individuals must provide names and complete addresses as well as other information. In addition, HHS stated that individuals must attest that the information they provide on all applications is accurate by signing under penalty of perjury. However, these steps do not involve the verification of an applicant's identity to a third-party source. In August 2018, HHS officials stated that they are exploring alternatives for assessing risk and ensuring integrity of applicant information that is provided to the program and ways to ensure personal information provided by an individual is accurate through a variety of means. After this analysis phase, they will assess resource requirements, cost, and operational implications for potential implementation approaches with a target date for completion of 2019. As of December 2018, HHS had not designed and implemented procedures for verifying the identities of phone and mail applicants, as GAO recommended. As of January 2020, HHS indicated that it is developing new policy and guidance which could significantly change potential solutions or requirements. However, HHS did not provide us a time frame for when it plans to finalize the new policy and guidance. We will continue to monitor agency's actions to address the recommendation.

Recommendation: To comply with improper payments reporting requirements and improve procedures related to processing PTC information on tax returns, the Commissioner of Internal Revenue should direct the appropriate officials to assess the program against applicable IPIA-defined thresholds and conclude on its susceptibility to significant improper payments, and revise the scope of its improper payments susceptibility assessment for the PTC program to include instances in which advance PTC is greater than or equal to the amount of PTC claimed on the tax return. If the program meets the IPIA definition for being susceptible to significant improper payments based on this assessment, estimate and report improper payments associated with the PTC program consistent with IPIA requirements.

Agency: Department of the Treasury: Internal Revenue Service
Status: Open
Priority recommendation

Comments: The Internal Revenue Service (IRS) partially agreed with this recommendation. On December 13, 2019, IRS provided us a status update and stated that its Research, Applied Analytics and Statistics division completed an analysis of net premium tax credit (PTC) using National Research Program (NRP) tax years 2015 and 2014 data during the 4th quarter of fiscal year 2019 and developed improper payment estimates using two different methodological approaches. However, IRS indicated that it did not publish these improper payment estimates in Treasury's Agency Financial Report for two reasons: (1) there is as yet insufficient NRP data to develop an estimate that is within the confidence interval and margin of error prescribed by the Office of Management and Budget for improper payments sampling, and (2) the Department of the Treasury (Treasury) wishes to engage with Health and Human Services' Centers for Medicare & Medicaid Services on the potential for developing a joint rate estimate for advance PTC and PTC. In addition, IRS noted that it had not yet determined whether this is even possible from a data compatibility standpoint. Further, IRS stated that while the estimates do not meet the statistical precision requirement, they do suggest that Net PTC would meet the criteria to be considered susceptible to significant improper payments. IRS indicated that when it last discussed this recommendation with GAO, it was suggested this recommendation would be closed once improper payment rates are published. However, IRS would now like GAO to consider closing this recommendation at this time given (1) the IRS's efforts to analyze potential improper payments, (2) Treasury's new approach to reporting, and (3) the need for additional years of data before a statistically valid estimate can be developed. We do not believe the recommendation should be closed at this time based on the three reasons IRS has listed above. However, we credit IRS for exploring ways to meet the intent of the recommendation. We will continue to monitor the agency's actions to address this recommendation.

Recommendation: To comply with improper payments reporting requirements and improve procedures related to processing PTC information on tax returns, the Commissioner of Internal Revenue should direct the appropriate officials to assess and document the feasibility of approaches for incorporating information from the marketplaces on individuals who did not demonstrate that they met the eligibility requirements for citizenship or lawful presence in the tax compliance process. If determined feasible, IRS should work with Treasury to require marketplaces to periodically provide such information on individuals and use such information to recover advance PTC made for those individuals.

Agency: Department of the Treasury: Internal Revenue Service
Status: Open

Comments: The Internal Revenue Service (IRS) agreed with this recommendation. In December 2018, an IRS official indicated that IRS conducted a detailed review of the recommendation. IRS informed GAO that it is internally discussing an alternative way to address the recommendation to prevent premium tax credit to noncitizens. The IRS official indicated that IRS is reviewing this alternative with the Department of the Treasury and the Department of Health and Human Services' Centers for Medicare & Medicaid Services. IRS did not provide GAO with a time frame for its implementation. On December 13, 2019, IRS provided us a status update and stated that it had no new information for this recommendation. We will continue to monitor the agency's actions to address this recommendation.

Recommendation: To help ensure that its efforts to increase patients' electronic access to health information are successful, the Secretary of HHS should direct ONC to use the information these performance measures provide to make program adjustments, as appropriate. Such actions may include, for example, assessing the status of program operations or identifying areas that need improvement in order to help achieve program goals related to increasing patients' ability to access their health information electronically.

Agency: Department of Health and Human Services
Status: Open

Comments: As of May 2019, ONC is collecting and evaluating information from national surveys, program data, and third-party data sources. As ONC works to implement its evaluations, it should identify how evidence collected from national surveys, program data and third-party data sources has been used to assess the outcomes of key efforts and adjust programs accordingly.

Recommendation: To improve care for women veterans, the Secretary of Veterans Affairs should direct the Under Secretary for Health to strengthen the environment of care inspections process and VHA's oversight of this process by expanding the list of requirements that facility staff inspect for compliance to align with VHA's women's health handbook, ensuring that all patient care areas of the medical facility are inspected as required, clarifying the roles and responsibilities of VA medical facility staff responsible for identifying and addressing compliance, and establishing a process to verify that noncompliance information reported by facilities to VHA Central Office is accurate and complete.

Agency: Department of Veterans Affairs
Status: Open

Comments: As of October 2018, VA has taken some actions to address this recommendation, but additional actions are needed to fully implement it. We will update the status of this recommendation when we receive additional information from VA.

Recommendation: To improve care for women veterans, the Secretary of Veterans Affairs should direct the Under Secretary for Health to monitor women veterans' access to key sex-specific care services--mammography, maternity care, and gynecology--under current and future community care contracts. For those key services, monitoring should include an examination of appointment scheduling and completion times, driving times to appointments, and reasons appointments could not be scheduled with community providers.

Agency: Department of Veterans Affairs
Status: Open
Priority recommendation

Comments: As of June 2017, VHA still lacks data and performance measures for the availability under Choice of sex-specific care, such as mammograms, maternity care, or gynecology. In contrast, for another VA care in the community program, PC3 (a program that the Choice third party administrators also administer) VHA collects data and has performance measures to evaluate women veterans' access to mammography and maternity care. To fully implement this recommendation, VHA needs to extend the collection of data to include care delivered through the Choice Program and other community care programs and establish related performance measures. VA is in the process of letting contracts for its new community care program and is expected to have contracts in place for all regions of the country in fiscal year 2019

Recommendation: The Secretary of Veterans Affairs should direct the Under Secretary for Health to monitor the full amount of time newly enrolled veterans wait to be seen by primary care providers, starting with the date veterans request they be contacted to schedule appointments. This could be accomplished, for example, by building on the data collection efforts currently being implemented under the "Welcome to VA" program.

Agency: Department of Veterans Affairs
Status: Open
Priority recommendation

Comments: In March 2016, GAO recommended that VA monitor the full amount of time newly enrolled veterans wait to be seen by primary care providers, starting with the date veterans request they be contacted to schedule appointments. VA concurred with this recommendation, and in June 2017, reported to GAO that it had taken actions to address it. Specifically, VA indicated that it revised an internal report to help identify and document all newly enrolled veterans and monitor their appointment request status. The report is intended to enable VHA and its medical centers to oversee the enrollment and appointment process by tracking the following timeframes: (1) application to enrollment, (2) enrollment to initial contact, (3) initial contact to primary care appointment, and (4) total time from application to primary care appointment. However, VA also indicated in its response that it did not have data that captures application dates for all newly enrolled veterans. As such, the report could not be used to consistently monitor the full amount of time these veterans wait to be seen by primary care providers. In January 2018, VA reported developing and implementing technical enhancements to its electronic systems that will enable it to capture the application date for all newly enrolled veterans. In April 2018 and December 2018, VA reported making continued efforts to implement technical enhancements to its electronic system. In its February 2020 update, VA identified several steps that the agency was completing to fully implement the revised internal report and noted that following a successful piloting of the report, the agency would implement it system-wide. VA reported that it expects to fully address this recommendation by October 2020.

Recommendation: To improve its oversight of network adequacy in MA, the Administrator of CMS should augment MA network adequacy criteria to address provider availability.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: HHS concurred with this recommendation, and noted in a February 2018 update that CMS requires MAOs to identify provider availability in certain circumstances, such as in granting exceptions to the agency's network adequacy criteria. CMS also stated that it would consider augmenting MA network adequacy criteria to address provider availability in future years. However, CMS's 2018 MA network adequacy guidance stated that the agency does not currently consider provider availability when reviewing an organization's network adequacy, and this guidance was not updated in 2019. As a result, as of September 2019, agency officials have not implemented this recommendation.

Recommendation: To improve its oversight of network adequacy in MA, the Administrator of CMS should verify provider information submitted by MAOs to ensure validity of the Health Services Delivery data.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: HHS concurred with this recommendation, and noted in a February 2018 update that the agency has standardized existing protocols to ensure the validity of the Health Services Delivery data submitted by MAOs with regards to exceptions requests and partial county justifications. However, CMS's 2018 MA network adequacy guidance stated that MAOs remain responsible for conducting validation of Health Services Delivery data. Unless CMS verifies provider information submitted by MAOs, the agency cannot be confident that MAOs are meeting network adequacy criteria. As of September 2019, agency officials have not implemented this recommendation.

Recommendation: To improve its oversight of network adequacy in MA, the Administrator of CMS should set minimum requirements for MAO letters notifying enrollees of provider terminations and require MAOs to submit sample letters to CMS for review.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: HHS concurred with this recommendation. In a September 2017 update, the agency stated that it had met the spirit of our recommendation by adding its best practice suggestions of what should be included in the written termination notice to the Medicare Managed Care Manual. However, as we noted in our report, those practices are not required, nor are the letters regularly reviewed. As of September 2019, agency officials have not yet implemented this recommendation.

Recommendation: To ensure reliable measurement of veterans' wait times for medical appointments, the Secretary of VA should direct the Under Secretary for Health to take actions to improve the reliability of wait time measures either by clarifying the scheduling policy to better define the desired date, or by identifying clearer wait time measures that are not subject to interpretation and prone to scheduler error.

Agency: Department of Veterans Affairs
Status: Open
Priority recommendation

Comments: VA agreed with our recommendation. VA has taken actions intended to address the reliability of appointment wait times through improvements in appointment scheduling, including issuing a revised scheduling policy, providing and documenting scheduler training and improving oversight through scheduler audits. While the revised scheduling policy and subsequent guidance changed the terminology of wait time measures, it did not substantively clarify or define the desired date, one of the dates used for measuring appointment wait times. Therefore, we continue to believe that the desired date is still subject to interpretation and prone to scheduler error, which poses concerns for the reliability of wait times measured using the patient's desired date. Furthermore, in its internal audit report dated February 2019, VA reported it was unable to evaluate the accuracy and reliability of its wait-time data due to the lack of business rules for calculating them, indicating that additional efforts are needed to address this issue. In January 2020, VA reported to us that the internal audit did not test whether schedulers entered the patient's desired date into the scheduling system in compliance with VHA policy because of the lack of verifiable source documentation. Given our continued concerns about VA's ability to ensure the reliability of the wait-time data, we have requested additional information from VA about its wait time methodology and assessment of evidence underlying the audit findings.

Recommendation: To improve timely medical appointments and to address patient and staff complaints about telephone access,the Secretary of VA should direct the Under Secretary for Health to ensure that all VAMCs provide oversight of telephone access and implement best practices outlined in its telephone systems improvement guide.

Agency: Department of Veterans Affairs
Status: Open

Comments: VA concurred with this recommendation and stated that VISN and VA Medical Center leadership would use best practices to develop and implement improved telephone service plans. As of March 2015, VA had developed a standardized telephone assessment tool and requested that facilities that care for 5,000 or more veterans complete the assessment and select actions for improvement based on its existing telephone systems improvement guide. Based on this request, VA received telephone assessment and improvement plans from 286 facilities that care for 5,000 or more veterans. VA is monitoring the facilities' telephone performance and is re-baselining call center infrastructure at each facility with a survey and new performance goals. In September 2015, VA issued an updated Telephone Access and Contact Management Improvement Guide. VA has also drafted an update to its directive on telephone access to outpatient care. As of July 2019, VA decided not to advance the draft policy for review and approval at this time, because of the significant uncertainty due to ongoing development of VA clinical contact centers and telehealth services. VA stated that it remains committed to developing sound policy related to virtual (telephone, video, and web-chat) access to clinical care.

Recommendation: In light of the need for accurate and complete information on children's access to health services under Medicaid and CHIP, the requirement that states report information to CMS on certain aspects of their Medicaid and CHIP programs, and problems with accuracy and completeness in this state reporting, the Administrator of CMS should work with states to identify additional improvements that could be made to the CMS 416 and CHIP annual reports, including options for reporting on the receipt of services separately for children in managed care and fee-for-service delivery models, while minimizing reporting burden, and for capturing information on the CMS 416 relating to children's receipt of treatment services for which they are referred.

Agency: Department of Health and Human Services: Centers for Medicare and Medicaid Services
Status: Open

Comments: In August 2019, CMS stated that the agency's long-term plan is to use the Transformed Medicaid Statistical Information System (T-MSIS) to analyze information on children's receipt of Early and Periodic Screening, Diagnostic and Treatment (EPSDT) services. As of June 2020, CMS had developed a new CMS-416 reporting form that gives states the option of having CMS calculate the measures for the report using T-MSIS. CMS stated that it intends to implement this option for states for fiscal year 2020 CMS-416 reports, which are due in April 2021. As of August 2020, the new CMS-416 form was undergoing Paperwork Reduction Act review. CMS is also exploring using T-MSIS to generate the Core Set of Children's Health Care Quality Measures for Medicaid and CHIP, some of which are included in the CHIP annual report. As of June 2020, CMS had begun a pilot test to generate five of the Core Set measures using 2018 T-MSIS data. GAO considers this recommendation open and will continue to monitor CMS's progress towards its long-term goal of using T-MSIS to monitor children's receipt of EPSDT services.

Recommendation: To enhance the provision of dental care to children covered by Medicaid and CHIP, and to help ensure that HHS's Insure Kids Now Web site is a useful tool to help connect children covered by Medicaid and CHIP with participating dentists who will treat them, the Secretary of HHS should require states to verify that dentists listed on the Insure Kids Now Web site have not been excluded from Medicaid and CHIP by the HHS-OIG, and periodically verify that excluded providers are not included on the lists posted by the states.

Agency: Department of Health and Human Services
Status: Open

Comments: As of September 2020, CMS has not indicated taking steps to require states to ensure excluded providers are not listed on the Insure Kids Now website, nor has it indicated taking steps to periodically verify that providers excluded from Medicaid and CHIP are not on the list. CMS has said that it relies on states to provide accurate lists of eligible dentists and that data issues prevent the agency from independently verifying that excluded providers are not included on the Insure Kids Now website. We continue to believe that CMS should require states to ensure that excluded providers are not listed on the website and periodically verify that excluded providers are not included on the lists posted by the states, so that the website does not present inaccurate information about providers available to serve Medicaid-covered children.