Most States Are Developing Statewide Information Systems, but the Reliability of Child Welfare Data Could Be Improved
GAO-03-809: Published: Jul 31, 2003. Publicly Released: Aug 12, 2003.
To better monitor children and families served by state child welfare agencies, Congress authorized matching funds for the development of statewide automated child welfare information systems (SACWIS) and required that the Department of Health and Human Services (HHS) compile information on the children served by state agencies. This report reviews (1) states' experiences in developing child welfare information systems and HHS's role in assisting in their development, (2) factors that affect the reliability of data that states collect and report on children served by their child welfare agencies and HHS's role in ensuring the reliability of those data, and (3) practices that child welfare agencies use to overcome challenges associated with SACWIS development and data reliability.
HHS reported that 47 states are developing or operating a SACWIS, but many continue to face challenges developing their systems. Most state officials said they recognize the benefit their state will achieve by developing SACWIS, such as contributing to the timeliness of child abuse and neglect investigations; however, despite the availability of federal funds since 1994, states reported a median delay of 2 and a half years beyond the timeframes they set for completion. States reported that they encountered some difficulties during SACWIS development, such as challenges receiving state funding and creating a system that reflected their work processes. In response to some of these challenges, HHS has provided technical assistance to help states develop their systems and conducted on-site reviews of SACWIS to verify that the systems meet federal requirements. Despite efforts to implement comprehensive information systems, several factors affect the states' ability to collect and report reliable adoption, foster care, and child abuse and neglect data. States responding to GAO's survey and officials in the 5 states GAO visited reported that insufficient caseworker training and inaccurate and incomplete data entry affect the quality of the data reported to HHS. In addition, states reported technical challenges reporting data. Despite HHS's assistance, many states report ongoing challenges, such as the lack of clear and documented guidance on how to report child welfare data. In addition, although states were mandated to begin reporting data to the Adoption and Foster Care Analysis and Reporting System (AFCARS) in 1995, few reviews of states' AFCARS reporting capabilities have been conducted to assist states in resolving some of their reporting challenges. Some states are using a variety of practices to address the challenges associated with developing SACWIS and improving data reliability. For example, 44 states included caseworkers and other system users in the design and testing of SACWIS, and 28 states reported using approaches to help caseworkers identify and better understand the data elements that are required for federal reporting.
Recommendation for Executive Action
Status: Closed - Not Implemented
Comments: The agency increased the number of Adoption and Foster Care Analysis and Reporting System (AFCARS) reviews conducted in fiscal year 2005 from four reviews to five. With respect to improved guidance, the agency continues to report this task as an on-going process conducted through the various vehicles identified in its original comments and made no commitment to adjusting its current process. HHS took no other action on this recommendation.
Recommendation: To improve the reliability of state-reported child welfare data, the Secretary of HHS should consider, in addition to HHS's recent efforts to improve AFCARS data, ways to enhance the guidance and assistance offered to states to help them overcome the key challenges in collecting and reporting child welfare data. These efforts could include a stronger emphasis placed on conducting AFCARS reviews and more timely follow-up to help states implement their improvement plans or identifying a useful method to provide clear and consistent guidance on AFCARS and National Child Abuse and Neglect Data System reporting.
Agency Affected: Department of Health and Human Services