Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies metrics on the extent to which governments participating in LUCA overlap in their coverage of residents, as well as the characteristics of participants such as type of government and geographic area, and reports on such metrics. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that its 2020 LUCA Assessment would identify the impacts, if any, of governments providing overlapping coverage in their submissions to the Bureau. In order to fully implement this recommendation, the Bureau will need to identify metrics on submissions from governments that describe both the participating governments and extent of their overlap in coverage.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau takes steps to conduct in-office reviews of a greater share of addresses submitted by governments before the addresses are added to the Bureau's address list for potential field work. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would continue to identify improvements to address list-sharing programs so that more addresses submitted by governments are reviewed using in-office methods. In order to fully implement this recommendation, the Bureau will need to take steps that result in a greater share of addresses submitted by governments being reviewed in-office.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau, as part of the Bureau's assessment of LUCA for 2020, consults with OMB to report on the factors that led to enumeration outcomes of addresses reinstated to the Bureau's master address list by the LUCA appeals process. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would research appeals-reinstated addresses to determine the factors that led to the initial rejection of those addresses, any reasons for their reinstatement upon appeal, and the enumeration outcomes of those addresses. In order to fully implement this recommendation, the Bureau will need to complete and report on this work.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies and tracks specific costs for related address list development efforts. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would use existing systems to identify and report the costs of individual address list update-related activities. The Bureau also indicated that it would develop the means for capturing the cost of machine-based methods of updating the address list. In order to fully implement this recommendation, the Bureau will need to identify and track costs with sufficient detail to compare the relative cost-effectiveness of alternative efforts it considers and uses to build its address list.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau improves the use of LUCA results to inform procedures of other decennial operations, such as sharing information on address update quality to inform NRFU planning or administrative records modeling. (Recommendation 5)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would investigate how best to improve the flow of address data from governments into other census activities, such as research on administrative records or address canvassing. In order to fully implement this recommendation, the Bureau will need to establish and demonstrate the use of pathways for data on address collected from governments and their quality to inform the planning of other census activities that rely on address data.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau realigns the schedule of LUCA-related programs to provide participants with more time to review addresses. (Recommendation 6)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would look for opportunities to allow participants more time to review the address list for their areas, subject to the timing and design of LUCA 2030. In order to fully implement this recommendation, the Bureau will need to ensure that governments invited to review addresses are provided sufficient time to review them.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau uses the Bureau's data on hard-to-count areas to inform geographic activities such as: targeting LUCA outreach to tribal, state, and local governments; planning additional rounds of in-office address canvassing; and providing feedback to tribal, state, and local governments on gaps in their respective address data. (Recommendation 7)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would give participants access to the Bureau's data on hard-to-count areas so that participants could prioritize their address list review efforts. In order to fully implement this recommendation, the Bureau will need to demonstrate how it is using its data on hard-to-count areas to improve targeting of outreach to governments, planning other address-improvement activity, and providing feedback to governments.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau, as part of the Bureau's strategic planning process for geographic programs, reexamines LUCA in conjunction with stakeholders, other federal agencies as appropriate, and Congress to address the issues we have identified, including but not limited to:

• Identifying and assessing alternatives and describing corresponding effects on the decennial census.
• Reporting out on the assessment of alternatives, including justifications.
• Developing legislative proposals, as appropriate, for any changes needed to LUCA and address data in order to implement preferred alternatives. (Recommendation 8)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would reach out to stakeholders in the Summer of 2022 to discuss reexamining LUCA and other address frame initiatives. In order to fully implement this recommendation, the Bureau will need to carryout a reexamination with stakeholders on the issues identified in our report as well as identify and report on alternatives as well as legislative proposals as may be appropriate.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau develops and obtains management approval of mitigation and contingency plans for all risks that require them. (Recommendation 1)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: As of May 2020, the Bureau's program risk registers included a clear indication of the status of mitigation plans; however, the Bureau's portfolio risk register did not, without which there was not a clear indication of which portfolio risk mitigation plans had been approved by management. As of August 2020, the Bureau's portfolio risk register also included a clear indication of mitigation plan status. At that time, we reviewed the Bureau's program and portfolio risk registers to determine whether the Bureau had developed and obtained management approval of mitigation and contingency plans for all risks that required them. We found six risks that met the Bureau's requirements for a contingency plan but did not have an approved contingency plan in place. We notified the Bureau and asked them to ensure that approved mitigation and contingency plans were in place for all risks that required them. We will continue to monitor the Bureau's actions to implement this recommendation.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau updates the Bureau's decennial risk management plan to require that risk mitigation and contingency plans, including the risk register descriptions and separate plans, have the seven key attributes for helping to ensure they contain the information needed to manage risk. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: In July 2020, the Bureau updated its decennial risk management plan and, in doing so, implemented this recommendation for six of the seven key attributes we identified. The missing attribute was monitoring plans: a description in each mitigation and contingency plan of how the agency will monitor the risk response-with performance measures and milestones, where appropriate-to help track whether the plan is working as intended. According to Bureau officials, rather than requiring this attribute, they instead noted it as a lesson learned for the 2030 Census and documented it in their knowledge management tool. In August 2020, we requested documentation of these actions. Once received, we will assess whether these actions suffice to close the recommendation.

Recommendation: The Secretary of Commerce should direct the Director of the Census Bureau to direct the Census Bureau's Chief Information Officer (CIO) to take steps to ensure that identified corrective actions for cybersecurity weaknesses are implemented within prescribed time frames. (Recommendation 1)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with our recommendation. It provided an action plan in August 2019. We will review the Bureau's progress in addressing this recommendation as part of our ongoing work on the 2020 Census.

Recommendation: The Secretary of Commerce should direct the Director of the Census Bureau to direct the Bureau's CIO to implement a formal process for tracking and executing appropriate corrective actions to remediate cybersecurity weaknesses identified by DHS, and expeditiously address the identified deficiencies. (Recommendation 2)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with our recommendation. In August 2019, the Bureau stated that it is developing a process for tracking and executing corrective actions identified by governing bodies and external entities. We will review the Bureau's progress in addressing this recommendation as part of our ongoing work on the 2020 Census.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies and implements changes to align census field supervisor screening, authorities, and information flows to allow greater use of the census field supervisor position to provide supervisory support to enumerators. (Recommendation 2)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: In its February 2019 action plan, the Bureau indicated having updated the Census Field Supervisor hiring assessment to include questions on supervisory experience, in line with draft documentation provided near the end of our engagement. The Bureau also indicated that, by June 2019, it would communicate as part of supervisor training increased supervisory responsibilities and the need to more actively work with enumerators in answering casework questions. In August 2020, the Bureau informed us that the Bureau would not be altering the information flows for 2020 operations to ensure that census field supervisors receive the same guidance and procedural updates that managers within the area census office receive. To fully implement this recommendation for future fieldwork, the Bureau's planned or other actions will also need to demonstrate how the census field supervisors will have the information they need to carry out their responsibilities to provide supervisory support to enumerators.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau enables area census offices to prepare targeted, mid-operation training or guidance as needed to address procedural changes or implementation issues encountered locally during Non-Response Follow-Up. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: In its February 2019 action plan, the Bureau indicated that it plans, by June 2019, to give area census offices (ACOs) the ability to distribute training and informational updates to their local workforces through the Operational Control System. As of January 2020, we are reviewing updated Bureau training documentation on planned mid-operation procedural changes. In April 2020, the Bureau informed us that ACOs would not be empowered during 2020 operations to deliver to their workforces standardized, mid-operation guidance that would be targeted to specific issues being observed locally in the field. Officials noted that they would revisit this issue after 2020 operations have concluded. To fully implement this recommendation for future fieldwork, the Bureau will need to demonstrate the ability of ACOs to identify procedural or other implementation issues encountered locally and develop some form of actionable guidance disseminated systematically to its workforce in near-real time.

Recommendation: The Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to revise and test procedures on how to better leverage enumerator-collected information on the best time or day to conduct interviews, and ensure enumerators are properly trained on these procedures.

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In the Bureau's March 2017 action plan, it reported that as the Census Bureau develops enhancements to the procedures and training for enumerators, it will reflect on what it has learned from 2016 Census Test experiences as well as from recommendations such as this. It reported a target completion of December 2018, following completion and analyses of the nonresponse follow-up operation for the 2018 End-to-End Census Test. In January 2018, Bureau officials told us that leveraging enumerator collected information on the best time to conduct an interview would not be a part of questionnaire design's functionality for 2020 and will most likely rely on the system optimizer to determine the best time to contact a household. Bureau officials indicated they may push this recommendation out to 2030. During the 2018 Test, we continued to observe that enumerator notes were not being systematically reviewed by supervisors and managers, such that information such as office hours for apartment managers among other information we reported on was not being used by the operation. In June 2019, the Bureau informed us that it had added functionality to the enumerator device for enumerators to alert supervisors of case notes of "high importance" and was revising training to explain its use. Additionally, in December 2019, the Bureau shared documentation that reiterated the importance of enumerators reviewing prior case notes but clarified that enumerators should not expect their supervisors to regularly review those case notes. In April 2020, Bureau officials indicated that it was not likely that the Bureau would revise CFS training to systematically review case notes for the 2020 cycle, though we are following up with the Bureau to see if this can be done given the revised census time frames stemming from the COVID-19 outbreak. To fully implement this recommendation for 2020 and for future fieldwork, the Bureau needs to make better use of the information collected by enumerators during interview attempts about when to make additional attempts, such as during reported working hours of property managers for large multi-unit structures that house a large number of non-respondents.