2020 Census: Innovations Helped with Implementation, but Bureau Can Do More to Realize Future Benefits
Fast Facts
This report examines 2020 Census innovations designed to save money and boost data quality.
As 2020 activities close, the Census Bureau now expects the census will have cost about $14.2 billion, including $1.1 billion to respond to COVID-19. This is about $96 per household. If this holds, the Bureau will have slowed a cost increase trend. Adjusted for inflation, the cost per household was $80 in 2000 and $92 in 2010.
New devices and automation in the field for the first time helped boost productivity more than expected. The Bureau could do a better job analyzing the effectiveness of and refining these and other measures. We recommended it do so.
Highlights
What GAO Found
With the decennial census coming to a close, the Bureau expects the 2020 Census to cost roughly $14.2 billion (in nominal year dollars), which is above initial estimates but below the Bureau's most recent estimate of $15.6 billion. This figure includes $1.1 billion that has been spent responding to the unprecedented Coronavirus Disease 2019 (COVID-19) pandemic. If this scenario holds, the Bureau also will have been able to slow the trend in increasingly costly decennials, with 2020 costing roughly $96 per household, compared to $92 for 2010, $80 for 2000, and $45 for 1990 (adjusted for inflation).
The Bureau slowed decennial cost growth but did not position itself to know how much money was saved by each of its planned 2020 innovation areas. Bureau officials told GAO that they did not track the specific innovation areas within their revised cost estimation and budget execution framework and that they focused less on cost savings stemming from the innovation areas as they transitioned to implementing the census. GAO's March 2020 cost estimating and assessment guide, however, notes that a primary purpose of a cost estimate is to help managers evaluate affordability and performance against plans, as well as the selection of alternative solutions. Tracking operational innovations as part of the cost estimation and budget execution framework will help the Bureau to assess the cost effectiveness of future designs.
An expanded range of response modes, the extended self-response window, and a modified outreach strategy helped the Bureau achieve a higher-than-expected 63.4 percent self-response rate by mid-August 2020 amid challenging conditions related to COVID-19. While the Bureau made a late design change in February 2020 to its Internet response system, thereby introducing risk, 50.6 percent of households self-responded to the 2020 Census using the Internet prior to Non-Response Follow-Up – higher than the 41.8 percent that the Bureau had anticipated. The flexibility in response options also created the potential for the Bureau to receive multiple responses across multiple modes from a given household. Receiving more than 17 million responses without a census-issued identifier (compared to the approximately 9 million that the Bureau expected) increased the Bureau's workload to verify the data. For future decennials, researching and testing how design innovations may affect the methodologies and time required for post-data collection processing will help the Bureau manage any risks of delayed delivery of data products.
Improved use of technology aided the productivity of the Bureau's field operations, though using additional measures of productivity results could help the Bureau maximize future gains. Specifically, the use of laptops and smartphones to collect census data in the field for the first time, along with a case routing and assignment capability known as the optimizer, helped the Bureau canvass and enumerate more cases per hour than the Bureau had anticipated. Bureau officials said that they have not yet analyzed any additional measures of the optimizer's success that the Bureau had originally identified, such as miles traveled per case or hours worked per enumerator. Without identifying and reporting on a wider range of measures of effectiveness, the Bureau may miss opportunities to learn how it might further refine optimization efforts to achieve higher productivity in future operations.
Why GAO Did This Study
For the 2020 Census, the U.S. Census Bureau (Bureau) implemented a series of planned innovations to rein in cost increases that have characterized recent decennial censuses and enhance data quality. For example, the Bureau reengineered the way that it compiled its address list to reduce time spent physically going door-to-door. The Bureau also developed automated tools designed to manage follow-up with nonresponding households more efficiently. Understanding how these innovations performed can help to gauge the cost and quality of the 2020 Census while informing decisions about future censuses.
This report, the second in a series of retrospective reviews of the 2020 Census, examines the extent to which the Bureau's innovations to the 2020 Census helped the Bureau achieve its cost and quality goals. GAO reviewed Bureau planning documentation, interviewed key officials, analyzed preliminary Bureau field production data, and surveyed area census office managers.
Recommendations
GAO is making three recommendations, including that the Bureau track savings from future innovations; research and test any effects of those innovations on data processing timelines; and identify and report on additional measures on the effectiveness of the Bureau's optimization. The Bureau agreed with GAO's findings and recommendations. The Bureau also provided technical comments, which GAO incorporated as appropriate.
Recommendations for Executive Action
Agency Affected | Recommendation | Status |
---|---|---|
Department of Commerce |
Priority Rec.
The Secretary of Commerce and the Director of the U.S. Census Bureau should track the Bureau's future design innovations within the Bureau's cost estimation and budget execution framework (Recommendation 1).
|
Commerce agreed with our recommendation. The Bureau indicated in its action plan in December 2021 responding to the recommendation that all 2030 costs would be estimated and tracked through its cost estimation and budget execution mechanism known as the Work Breakdown Structure (WBS). In March 2022, Bureau officials briefed us on their plans to have program managers approximate allocations of cost within the WBS to specific areas of enhancement being researched and tested for the 2030 Census. Officials piloted this approach with related management reporting in spring 2022 before creating baselines for tracking cost in enhancement areas more broadly. In March 2023, the Bureau provided us with its fiscal year 2022 obligations mapped to each enhancement area as well as its comparable operating plan data for fiscal year 2023 and budget request for fiscal year 2024. According to Bureau officials, the tracked information is already helping managers answer questions about the allocation of resources across research areas, and better delineating their allocations to the more general planning of the next census. Further, in April 2023 officials said this has helped ensure coverage of operations by different research efforts and justify resource needs. Tracking investments in enhancements and innovations throughout the lifecycle will position the Bureau, and others, to better identify the effects of design changes on future census costs.
|
Department of Commerce | The Secretary of Commerce and the Director of the U.S. Census Bureau should for future decennials research and test how innovations or design changes affect the methodologies and time required for post-data collection steps. (Recommendation 2). |
Commerce agreed with the recommendation. The Bureau indicated in its action plan in December 2021 responding to the recommendation that it is collecting lessons learned from response processing and related operations to inform its 2030 planning teams. It noted that an objective of integrating data collection, response processing, and data analysis is for the 2030 Census to address any data anomalies in near-real time, which it expects to demonstrate later in the decade. As of March 2024, the Bureau is planning a 2030 research project on how best to implement near-real time data processing. In order to fully implement this recommendation, the Bureau will need to demonstrate how changes in its planned approach will affect post-data collection timelines.
|
Department of Commerce | The Secretary of Commerce and the Director of the U.S. Census Bureau should identify and report additional measures on the effectiveness of optimization as part of the Bureau's operational assessments and evaluations (Recommendation 3). |
Commerce agreed with the recommendation. The Bureau indicated in its action plan in December 2021 responding to the recommendation that it is still conducting the analyses needed for its Non-Response Follow-Up (NRFU) operational assessments. The Bureau noted that its study plan for those assessments includes several questions that could provide additional information on the effectiveness of the optimization used. In March 2024, the Bureau shared with us its 2020 NRFU operational assessment from November 2023, which included a series of aggregate measures of the operational efficiency of the Bureau's optimization approach (such as the time, mileage, and cost required to get successful enumerations). In April 2024, the Bureau also shared examples of its capacity to monitor these metrics at subnational levels and demonstrated ways in which it plans to use this capacity to help inform 2030 planning and research. As a result, the Bureau will be better positioned to monitor and manage trends and variation in how field work is being completed across locations.
|