Under contract with the Centers for Medicare and Medicaid Services (CMS), states conduct surveys at nursing homes to help ensure compliance with federal quality standards. Over the past decade, the Government Accountability Office (GAO) has reported on inconsistencies in states' assessment of nursing homes' quality of care, including understatement--that is, when state surveys fail to cite serious deficiencies or cite them at too low a level. In 2008, GAO reported that 9 states had high and 10 had low understatement based on CMS data for fiscal years 2002 through 2007. This report examines the effect on nursing home deficiency understatement of CMS's survey process, workforce shortages and training, supervisory reviews of surveys, and state agency practices. GAO primarily collected data through two Web-based questionnaires sent to all eligible nursing home surveyors and state agency directors, achieving 61 and 98 percent response rates, respectively.
A substantial percentage of both state surveyors and directors identified general weaknesses in the nursing home survey process, that is, the survey methodology and guidance on identifying deficiencies. On the questionnaires, 46 percent of surveyors and 36 percent of directors reported that weaknesses in the traditional survey methodology, such as too many survey tasks, contributed to understatement. Limited experience with a new data-driven survey methodology indicated possible improvements in consistency; however, an independent evaluation led CMS to conclude that other tools, such as survey guidance clarification and surveyor training and supervision, would help improve survey accuracy. According to questionnaire responses, workforce shortages and greater use of surveyors with less than 2 years' experience sometimes contributed to understatement. Nearly three-quarters of directors reported that they always or frequently experienced a workforce shortage, while nearly two-thirds reported that surveyor inexperience always, frequently, or sometimes led to understatement. Substantial percentages of directors and surveyors indicated that inadequate training may compromise survey accuracy and lead to understatement. According to about 29 percent of surveyors in 9 high understatement states compared to 16 percent of surveyors in 10 low understatement states, initial surveyor training was not sufficient to cite appropriate scope and severity--a skill critical in preventing understatement. Furthermore, over half of directors identified the need for ongoing training for experienced surveyors on both this skill and on documenting deficiencies, a critical skill to substantiate citations. CMS provides little guidance to states on supervisory review processes. In general, directors reported on our questionnaire that supervisory reviews occurred more often on surveys with higher-level rather than on those with lower-level deficiencies, which were the most frequently understated. Surveyors who reported that survey teams had too many new surveyors also reported frequent changes to or removal of deficiencies, indicating heavier reliance on supervisory reviews by states with inexperienced surveyors. Surveyors and directors in a few states informed us that, in isolated cases, state agency practices or external pressure from stakeholders, such as the nursing home industry, may have led to understatement. Forty percent of surveyors in five states and four directors reported that their state had at least one practice not to cite certain deficiencies. Additionally, over 40 percent of surveyors in four states reported that their states' informal dispute resolution processes favored concerns of nursing home operators over resident welfare. Furthermore, directors from seven states reported that pressure from the industry or legislators may have compromised the nursing home survey process, and two directors reported that CMS's support is needed to deal with such pressure. If surveyors perceive that certain deficiencies may not be consistently upheld or enforced, they may choose not to cite them.
Recommendations for Executive Action
|Centers for Medicare & Medicaid Services||To address concerns about weaknesses in CMS survey methodology and guidance, Administrator of CMS should make sure that action is taken to address concerns identified with the new QIS methodology, such as ensuring that it accurately identifies potential quality problems.|
|Centers for Medicare & Medicaid Services||To address concerns about weaknesses in CMS survey methodology and guidance, Administrator of CMS should clarify and revise existing CMS written guidance to make it more concise, simplify its application in the field, and reduce confusion, particularly on the definition of actual harm.|
|Centers for Medicare & Medicaid Services||To address surveyor workforce shortages and insufficient training, the Administrator of CMS should consider establishing a pool of additional national surveyors that could augment state survey teams or identify other approaches to help states experiencing workforce shortages.|
|Centers for Medicare & Medicaid Services||To address surveyor workforce shortages and insufficient training, the Administrator of CMS should evaluate the current training programs and division of responsibility between federal and state components to determine the most cost-effective approach to: (1) providing initial surveyor training to new surveyors, and (2) supporting the continuing education of experienced surveyors.|
|Centers for Medicare & Medicaid Services||To address inconsistencies in state supervisory reviews, the Administrator of CMS should set an expectation through guidance that states have a supervisory review program as a part of their quality-assurance processes that includes routine reviews of deficiencies at the level of potential for more than minimal harm (D-F) and that provides feedback to surveyors regarding changes made to citations.|
|Centers for Medicare & Medicaid Services||To address state agency practices and external pressure that may compromise survey accuracy, the Administrator of CMS should reestablish expectations through guidance to state survey agencies that noncitation practices--official or unofficial--are inappropriate, and systematically monitor trends in states' citations.|
|Centers for Medicare & Medicaid Services||To address state agency practices and external pressure that may compromise survey accuracy, the Administrator of CMS should establish expectations through guidance to state survey agencies to communicate and collaborate with their CMS regional offices when they experience significant pressure from legislators or the nursing home industry that may affect the survey process or surveyors' perceptions.|