VA Health Care:

Improvements Needed in Data and Monitoring of Clinical Productivity and Efficiency

GAO-17-480: Published: May 23, 2017. Publicly Released: Jun 23, 2017.

Multimedia:

  • PODCAST: Monitoring VA's Clinical Productivity and Efficiency

    Download

    6:33

    The Department of Veterans Affairs has faced challenges managing its budget and ensuring that veterans have access to health care. So, how can the VA accurately measure whether it's providing quality health care?

    View the transcript

Additional Materials:

Contact:

Randall B. Williamson
(202) 512-7114
williamsonr@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

To help manage and optimize its resources, the Department of Veterans Affairs collects data on the productivity and efficiency of its health care providers and medical centers.

However, we found that the data VA collects do not account for all providers or clinical services, and may not accurately reflect clinical workload or staffing levels. We also found that VA lacks a robust process to oversee medical centers' efforts to identify drivers of low productivity and efficiency and implement solutions.

We recommended that VA address these data concerns and strengthen how it oversees its medical centers.

 

Photo of VA Headquarters Building

Photo of VA Headquarters Building

Multimedia:

  • PODCAST: Monitoring VA's Clinical Productivity and Efficiency

    Download

    6:33

    The Department of Veterans Affairs has faced challenges managing its budget and ensuring that veterans have access to health care. So, how can the VA accurately measure whether it's providing quality health care?

    View the transcript

Additional Materials:

Contact:

Randall B. Williamson
(202) 512-7114
williamsonr@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

In 2013, the Department of Veterans Affairs (VA) implemented clinical productivity metrics to measure physician providers' time and effort to deliver procedures. VA also developed statistical models to track clinical efficiency at VA medical centers (VAMC). Data collected under the metrics and models are used to identify sub-optimal clinical productivity and inefficiency at VAMCs. GAO found that contrary to federal internal control standards for information, VA's metrics and models may not provide quality information because the information is incomplete and may not accurately reflect clinical productivity and efficiency. GAO identified limitations with VA's metrics and models that limit VA's ability to assess whether resources are being used effectively. Specifically,

  • Productivity metrics are not complete because they do not account for all providers or clinical services. Due to data systems limitations, the metrics do not capture all types of providers who deliver care at VAMCs, including contract physicians and advanced practice providers, such as nurse practitioners, serving as sole-providers. In addition, the metrics do not capture providers' workload evaluating and managing hospitalized patients.
  • Productivity metrics may not accurately reflect the intensity of clinical workload. A 2016 VA audit shows that VA providers do not always accurately code the intensity of—that is, the amount of effort needed to perform— clinical procedures or services. As a result, VA's productivity metrics may not accurately reflect provider productivity, as differences between providers may represent coding inaccuracies rather than true productivity differences.
  • Productivity metrics may not accurately reflect providers' clinical staffing levels. Officials at five of the six selected VAMCs GAO visited reported that providers do not always accurately record the amount of time they spend performing clinical duties, as distinct from other duties.
  • Efficiency models may also be adversely affected by inaccurate workload and staffing data. To the extent that the intensity and amount of providers' clinical workload are inaccurately recorded, some of VA's efficiency models examining VAMC utilization and expenditures may also be inaccurate. For example, the model that examines administrative efficiency requires accurate data on the amount of time VA providers spend on administrative tasks; if the time providers allocate to clinical, administrative, and other tasks is incorrect, the model may overstate or understate administrative efficiency.

GAO found that VA Central Office has taken steps to help VAMCs monitor provider productivity by developing a comprehensive analytical tool VAMCs can use to identify the drivers of low productivity. While VAMCs are required to monitor VA's productivity metrics, GAO found that VA does not require VAMCs to monitor VA's efficiency models. Further, VA does not systematically oversee VAMCs' efforts to monitor clinical productivity and efficiency. As a result, VA cannot systematically identify best practices to address low productivity and inefficiency as well as determine the factors VAMCs commonly identify as contributing to low productivity and inefficiency. This approach is inconsistent with federal standards for internal control related to monitoring.

Why GAO Did This Study

VA has faced challenges managing its budget and ensuring veterans' access to health care, generating congressional interest in asking GAO to examine VA's use of its productivity and efficiency metrics.

This report assesses (1) whether VA's clinical productivity metrics and efficiency models provide complete and accurate information on provider productivity and VAMC efficiency, and (2) VA's efforts to monitor and improve clinical productivity and efficiency.

GAO reviewed VA documentation, such as policies and guidance, and 2015 data on clinical productivity and efficiency, the most recent data available. GAO also interviewed VA Central Office officials about VA's metrics and models and monitoring efforts. GAO visited six VAMCs and their corresponding Veterans Integrated Service Networks, selected based on geographic diversity, variation of facility complexity, and differences in productivity and efficiency levels. GAO examined VA's efforts to monitor and improve clinical productivity and efficiency in the context of federal standards for internal control related to information and monitoring.

What GAO Recommends

GAO is making four recommendations to improve the completeness and accuracy of VA's productivity metrics and efficiency models and to strengthen VA's oversight of VAMCs' use of these metrics and models. VA concurred or concurred in principle with GAO's recommendations and described its plans to implement them.

For more information, contact Randall B. Williamson at (202) 512-7114 or williamsonr@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to expand existing productivity metrics to track the productivity of all providers of care to veterans by, for example, including contract physicians who are not VA employees as well as advance practice providers acting as sole providers.

    Agency Affected: Department of Veterans Affairs

  2. Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to help ensure the accuracy of underlying staffing and workload data by, for example, developing training to all providers on coding clinical procedures.

    Agency Affected: Department of Veterans Affairs

  3. Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to develop a policy requiring VAMCs to monitor and improve clinical efficiency through a standard process, such as establishing performance standards based on VA's efficiency models and developing a remediation plan for addressing clinical inefficiency.

    Agency Affected: Department of Veterans Affairs

  4. Status: Open

    Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

    Recommendation: To improve the completeness and accuracy of VA's productivity metrics and efficiency models and strengthen the monitoring of clinical productivity and efficiency VA-wide, the Secretary of the Department of Veterans Affairs should direct the Undersecretary for Health to establish an ongoing process to systematically review VAMCs' remediation plans and ensure that VAMCs and Veterans Integrated Service Networks are successfully implementing remediation plans for addressing low clinical productivity and inefficiency.

    Agency Affected: Department of Veterans Affairs

 

Explore the full database of GAO's Open Recommendations »

Jul 20, 2017

Jul 13, 2017

Jul 12, 2017

Jul 10, 2017

Jun 23, 2017

Jun 14, 2017

May 24, 2017

May 5, 2017

Apr 4, 2017

Looking for more? Browse all our products here