Recommendation: The Secretary of Commerce, in consultation with the department-level Executive Resources Board and Office of Executive Resources, should fully implement policy and guidance in development that require the bureaus to maintain career SES reassignment-related documentation in the SES member's Official Personnel Folder, and to provide those documents to the Office of Executive Resources for review and approval before making career SES reassignments. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: In its comments on a draft of this report, Commerce concurred with the recommendation and indicated it will take steps to implement the recommendation. We will continue to monitor Commerce's progress.

Recommendation: The Secretary of Commerce should direct BIS to identify, analyze, and respond to factors in the process that may cause submission errors. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should direct BIS to identify, assess, and make program changes to address issues that have impeded timeliness and created the backlog of exclusion requests. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should assign responsibility for regularly reviewing the impact of the tariffs on steel and aluminum imports, including tariff exclusions, and document the results. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should align the agency's contingency plan with OMB guidance by including (1) plans for a potential prolonged shutdown; (2) flexibilities available to supervisors if furloughed employees were unable to return to work after the end of the shutdown; and (3) procedures for resuming program activities, including steps to ensure appropriate oversight and disbursement of funds upon the end of a shutdown. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce agreed with the recommendation and stated that it will develop an action plan to address the recommendation to better align its contingency plan with OMB guidance. When we confirm what actions Commerce has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should ensure that the Under Secretary for Industry and Security, in consultation with university representatives, provides additional or revises existing guidance and outreach to address university-specific export control issues to further support universities' understanding and compliance with the Export Administration Regulations. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce concurred with the recommendation. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies metrics on the extent to which governments participating in LUCA overlap in their coverage of residents, as well as the characteristics of participants such as type of government and geographic area, and reports on such metrics. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that its 2020 LUCA Assessment would identify the impacts, if any, of governments providing overlapping coverage in their submissions to the Bureau. In order to fully implement this recommendation, the Bureau will need to identify metrics on submissions from governments that describe both the participating governments and extent of their overlap in coverage.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau takes steps to conduct in-office reviews of a greater share of addresses submitted by governments before the addresses are added to the Bureau's address list for potential field work. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would continue to identify improvements to address list-sharing programs so that more addresses submitted by governments are reviewed using in-office methods. In order to fully implement this recommendation, the Bureau will need to take steps that result in a greater share of addresses submitted by governments being reviewed in-office.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau, as part of the Bureau's assessment of LUCA for 2020, consults with OMB to report on the factors that led to enumeration outcomes of addresses reinstated to the Bureau's master address list by the LUCA appeals process. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would research appeals-reinstated addresses to determine the factors that led to the initial rejection of those addresses, any reasons for their reinstatement upon appeal, and the enumeration outcomes of those addresses. In order to fully implement this recommendation, the Bureau will need to complete and report on this work.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies and tracks specific costs for related address list development efforts. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would use existing systems to identify and report the costs of individual address list update-related activities. The Bureau also indicated that it would develop the means for capturing the cost of machine-based methods of updating the address list. In order to fully implement this recommendation, the Bureau will need to identify and track costs with sufficient detail to compare the relative cost-effectiveness of alternative efforts it considers and uses to build its address list.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau improves the use of LUCA results to inform procedures of other decennial operations, such as sharing information on address update quality to inform NRFU planning or administrative records modeling. (Recommendation 5)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would investigate how best to improve the flow of address data from governments into other census activities, such as research on administrative records or address canvassing. In order to fully implement this recommendation, the Bureau will need to establish and demonstrate the use of pathways for data on address collected from governments and their quality to inform the planning of other census activities that rely on address data.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau realigns the schedule of LUCA-related programs to provide participants with more time to review addresses. (Recommendation 6)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would look for opportunities to allow participants more time to review the address list for their areas, subject to the timing and design of LUCA 2030. In order to fully implement this recommendation, the Bureau will need to ensure that governments invited to review addresses are provided sufficient time to review them.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau uses the Bureau's data on hard-to-count areas to inform geographic activities such as: targeting LUCA outreach to tribal, state, and local governments; planning additional rounds of in-office address canvassing; and providing feedback to tribal, state, and local governments on gaps in their respective address data. (Recommendation 7)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would give participants access to the Bureau's data on hard-to-count areas so that participants could prioritize their address list review efforts. In order to fully implement this recommendation, the Bureau will need to demonstrate how it is using its data on hard-to-count areas to improve targeting of outreach to governments, planning other address-improvement activity, and providing feedback to governments.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau, as part of the Bureau's strategic planning process for geographic programs, reexamines LUCA in conjunction with stakeholders, other federal agencies as appropriate, and Congress to address the issues we have identified, including but not limited to:

• Identifying and assessing alternatives and describing corresponding effects on the decennial census.
• Reporting out on the assessment of alternatives, including justifications.
• Developing legislative proposals, as appropriate, for any changes needed to LUCA and address data in order to implement preferred alternatives. (Recommendation 8)

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In its April 2020 action plan, the Bureau indicated that it would reach out to stakeholders in the Summer of 2022 to discuss reexamining LUCA and other address frame initiatives. In order to fully implement this recommendation, the Bureau will need to carryout a reexamination with stakeholders on the issues identified in our report as well as identify and report on alternatives as well as legislative proposals as may be appropriate.

Recommendation: The Secretary of Commerce should update the department's environmental justice strategic plan. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: The department did not provide comments on our report or recommendation. We will continue to review the department's actions and provide updated information.

Recommendation: The Secretary of Commerce should issue a progress report on the department's environmental justice efforts each year. (Recommendation 11)

Agency: Department of Commerce
Status: Open

Comments: The department did not provide comments on our report or recommendation. We will continue to review the department's actions and provide updated information.

Recommendation: The Secretary of Commerce should update the department's policies to require (1) an organization-wide cybersecurity risk assessment and (2) the use of risk assessments to inform POA&M prioritization. (Recommendation 5)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce did not state whether or not it concurred with this recommendation. As of January 2020, we had not received information pertaining to planned actions for this recommendation. Once the department states that it has taken action, we plan to verify whether implementation has occurred.

Recommendation: The Secretary of Commerce should establish a process for conducting an organization-wide cybersecurity risk assessment. (Recommendation 6)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Department of Commerce did not state whether or not it concurred with this recommendation. As of February 2020, the department stated that its intends to evaluate whether there are any gaps in its cybersecurity policy pertaining to the establishment of an organization-wide cybersecurity risk assessment and will establish a plan to fill in gaps as necessary. The department added that it is making strides in the implementation of a tool that can aggregate data into a dashboard for a unified visibility across the department. Once the department has provided evidence of these actions, we plan to verify whether implementation has occurred.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau develops and obtains management approval of mitigation and contingency plans for all risks that require them. (Recommendation 1)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: As of May 2020, the Bureau's program risk registers included a clear indication of the status of mitigation plans; however, the Bureau's portfolio risk register did not, without which there was not a clear indication of which portfolio risk mitigation plans had been approved by management. As of August 2020, the Bureau's portfolio risk register also included a clear indication of mitigation plan status. At that time, we reviewed the Bureau's program and portfolio risk registers to determine whether the Bureau had developed and obtained management approval of mitigation and contingency plans for all risks that required them. We found six risks that met the Bureau's requirements for a contingency plan but did not have an approved contingency plan in place. We notified the Bureau and asked them to ensure that approved mitigation and contingency plans were in place for all risks that required them. We will continue to monitor the Bureau's actions to implement this recommendation.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau updates the Bureau's decennial risk management plan to require that risk mitigation and contingency plans, including the risk register descriptions and separate plans, have the seven key attributes for helping to ensure they contain the information needed to manage risk. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: In July 2020, the Bureau updated its decennial risk management plan and, in doing so, implemented this recommendation for six of the seven key attributes we identified. The missing attribute was monitoring plans: a description in each mitigation and contingency plan of how the agency will monitor the risk response-with performance measures and milestones, where appropriate-to help track whether the plan is working as intended. According to Bureau officials, rather than requiring this attribute, they instead noted it as a lesson learned for the 2030 Census and documented it in their knowledge management tool. In August 2020, we requested documentation of these actions. Once received, we will assess whether these actions suffice to close the recommendation.

Recommendation: The Secretary of Commerce should direct the National Institute of Standards and Technology (NIST) Director to work with other sponsoring federal agencies to develop and implement network-wide performance goals for the Manufacturing USA program with measurable targets and time frames. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: Commerce partially concurred with this recommendation according to its response to our report. Commerce stated that it lacks the legal authority to compel action by other federal agencies, and that legal constraints aside, it believes it is bad management practice to ask institutes to respond to performance goals issued by different bodies. As of March 2020, Commerce stated that it plans to report on performance goals for Commerce-sponsored institutes effective with the 2019 annual report, which it expects to issue by September 2020. Commerce also agreed to continue working closely with other sponsoring federal agencies on program and network goals for the Manufacturing USA institutes, but did not commit to working with sponsoring federal agencies to develop and implement network-wide performance goals with measurable targets and time frames. We recognize that Commerce does not have management authority over other the institutes sponsored by other agencies. We believe our report sufficiently characterizes the development of network-wide performance goals, targets, and time frames as a collaborative effort between Commerce and sponsoring agencies that is in keeping with Commerce's network-wide coordination functions under the RAMI Act. Moreover, our recommendation specifically pertained to developing performance goals for the Manufacturing USA program, not individual institutes. As we stated in our report, this would not necessarily entail new performance measures but, rather, could consist of measurable near-term performance goals corresponding to program performance measures already in place. Further, as stated in our report, GAO's prior work has shown that systems of performance measures benefit from certain key practices, such as creating a hierarchy that breaks down broad, long-term goals and objectives into more specific, near-term performance goals with measurable targets and time frames. Our recommendation was designed to ensure that the Manufacturing USA program performance measurement structure that Commerce has already worked with the other sponsoring agencies to develop more fully aligns with these key practices. We continue to believe that by working with other sponsoring federal agencies to develop and implement network-wide performance goals with targets and time frames, Commerce would be better able to observe and report on progress toward long-term Manufacturing USA program goals and objectives.

Recommendation: The Secretary of Commerce should direct the NIST Director to work with other sponsoring federal agencies to ensure that the Manufacturing USA network-wide performance measures are directly aligned with the network-wide performance goals, the Manufacturing USA strategic objectives and program goals, and the statutory purposes of the Revitalize American Manufacturing and Innovation (RAMI) Act. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: Commerce partially concurred with this recommendation according to its response to our report. In March 2020, Commerce stated that it supports the alignment of performance measures with performance goals only for Commerce-sponsored institutes. Commerce stated that it is unable to commit to this recommendation as 13 of the 14 existing institutes were authorized under authorities other than the RAMI Act and are sponsored by agencies other than Commerce. Commerce also stated that, until additional institutes authorized by the RAMI Act are in place, it does not support additional performance measures for the single Commerce-sponsored institute beyond the RAMI Act requirements, as doing so would impose an unfair level of scrutiny. Commerce agreed to report on performance metrics for department-sponsored institutes effective with the current annual report, which is expected by September 2020. We recognize that Commerce does not have management authority over other the institutes sponsored by other agencies. We believe our report sufficiently characterizes the effort to align the network-wide performance measures with network-wide performance goals and Manufacturing USA program goals as a collaborative effort between Commerce and sponsoring agencies that is in keeping with Commerce's coordination functions under the RAMI Act. Our recommendation does not ask Commerce to compel actions by other agencies, nor to develop any additional performance measures. As noted in our report, the Manufacturing USA program's performance measurement structure aligns near-term performance measures directly to the program's long-term goals. This structure bypasses connecting the performance measures with the program's objectives that have been developed to break down the long-term goals more specifically. GAO's prior work has shown that systems of performance measures benefit from certain key practices, such as creating a hierarchy that breaks down broad, long-term goals and objectives into more specific, near-term performance goals with measurable targets and time frames. Our recommendation was designed to ensure that the Manufacturing USA program performance measurement structure that Commerce has already worked with the other sponsoring agencies to develop more fully aligns with these key practices. We continue to believe that by working with other sponsoring federal agencies to ensure that the Manufacturing USA network-wide performance measures are directly aligned with the Manufacturing USA strategic program goals and objectives and the statutory purposes of the RAMI Act, Commerce would be better able to observe and report on progress made toward achieving the statutory purposes of the Manufacturing USA program.

Recommendation: The Secretary of Commerce should direct the NIST Director to develop criteria to evaluate whether the Commerce-sponsored institute can sustain its operations without additional federal financial assistance after its initial agreement. If an analysis based on such criteria indicates that additional federal financial assistance is needed to help the institute sustain its operations, then the Secretary of Commerce should consider a legislative proposal to amend relevant provisions of the RAMI Act. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: Commerce partially concurred with this recommendation according to its response to our report. In March 2020, Commerce stated that it will develop criteria to evaluate the sufficiency of the Commerce-sponsored institute's sustainability plan based on the anticipated operating costs of the institute at fully operational steady state, and the likelihood of sustaining those operations through the specific efforts outlined in the sustainability plan. Commerce stated that it plans to develop the evaluation criteria by April 2020. We will update this recommendation after we learn more about these efforts.

Recommendation: The Secretary of Commerce should direct the Director of the Census Bureau to direct the Census Bureau's Chief Information Officer (CIO) to take steps to ensure that identified corrective actions for cybersecurity weaknesses are implemented within prescribed time frames. (Recommendation 1)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with our recommendation. It provided an action plan in August 2019. We will review the Bureau's progress in addressing this recommendation as part of our ongoing work on the 2020 Census.

Recommendation: The Secretary of Commerce should direct the Director of the Census Bureau to direct the Bureau's CIO to implement a formal process for tracking and executing appropriate corrective actions to remediate cybersecurity weaknesses identified by DHS, and expeditiously address the identified deficiencies. (Recommendation 2)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with our recommendation. In August 2019, the Bureau stated that it is developing a process for tracking and executing corrective actions identified by governing bodies and external entities. We will review the Bureau's progress in addressing this recommendation as part of our ongoing work on the 2020 Census.

Recommendation: The Secretary of Commerce should take action to meet the data center closure targets established under DCOI by OMB. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: In comments on our report, the Department of Commerce (Commerce) agreed with our recommendation and began taking action to implement it. After the Office of Management and Budget (OMB) released the updated Data Center Optimization Initiative policy in June 2019, the department subsequently reported meeting its targets for server utilization. However, the department also reported that it had not yet met its target for the virtualization and advanced energy metering metrics. We will continue to monitor Commerce's progress in implementing this recommendation.

Recommendation: The Secretary of Commerce should ensure that the CIO of Commerce establishes a consistent and repeatable mechanism to track savings and cost avoidances from the migration and deployment of cloud services. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce (Commerce) concurred with our recommendation and stated that it planned to develop a mechanism to track savings to implement this recommendation. In October 2019, Commerce officials noted that the department would update its current procedures related to tracking savings and cost avoidances within one year once OMB issues guidance related to tracking cloud savings (OMB has not yet implemented guidance in this area). As of May 2020, the procedures have not yet been updated. We will continue to monitor Commerce's progress with these efforts.

Recommendation: To complete the appropriate assignment of codes to their positions performing IT, cybersecurity, or cyber-related functions, in accordance with the requirements of the Federal Cybersecurity Workforce Assessment Act of 2015, the Secretary of Commerce should take steps to review the assignment of the "000" code to any positions in the department in the 2210 IT management occupational series and assign the appropriate NICE framework work role codes. (Recommendation 2)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Department of Commerce concurred with the recommendation, but as of January 2020, it had not yet provided sufficient evidence that it had implemented the recommendation. We will continue to monitor the situation.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau identifies and implements changes to align census field supervisor screening, authorities, and information flows to allow greater use of the census field supervisor position to provide supervisory support to enumerators. (Recommendation 2)

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: In its February 2019 action plan, the Bureau indicated having updated the Census Field Supervisor hiring assessment to include questions on supervisory experience, in line with draft documentation provided near the end of our engagement. The Bureau also indicated that, by June 2019, it would communicate as part of supervisor training increased supervisory responsibilities and the need to more actively work with enumerators in answering casework questions. In August 2020, the Bureau informed us that the Bureau would not be altering the information flows for 2020 operations to ensure that census field supervisors receive the same guidance and procedural updates that managers within the area census office receive. To fully implement this recommendation for future fieldwork, the Bureau's planned or other actions will also need to demonstrate how the census field supervisors will have the information they need to carry out their responsibilities to provide supervisory support to enumerators.

Recommendation: The Secretary of Commerce should ensure that the Director of the Census Bureau enables area census offices to prepare targeted, mid-operation training or guidance as needed to address procedural changes or implementation issues encountered locally during Non-Response Follow-Up. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: In its February 2019 action plan, the Bureau indicated that it plans, by June 2019, to give area census offices (ACOs) the ability to distribute training and informational updates to their local workforces through the Operational Control System. As of January 2020, we are reviewing updated Bureau training documentation on planned mid-operation procedural changes. In April 2020, the Bureau informed us that ACOs would not be empowered during 2020 operations to deliver to their workforces standardized, mid-operation guidance that would be targeted to specific issues being observed locally in the field. Officials noted that they would revisit this issue after 2020 operations have concluded. To fully implement this recommendation for future fieldwork, the Bureau will need to demonstrate the ability of ACOs to identify procedural or other implementation issues encountered locally and develop some form of actionable guidance disseminated systematically to its workforce in near-real time.

Recommendation: As the QIS Subcommittee moves forward, the Department of Commerce co-chair, in coordination with other co-chairs and participating agency officials, should take steps to fully implement leading practices that enhance and sustain collaboration. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce agreed with GAO's September 2018 recommendation and, as of January 2020, had taken steps to work with the other co-chairs of the National Science and Technology Council's Quantum Information Science (QIS) Subcommittee to begin implementing it. The QIS Subcommittee, created pursuant to the National Quantum Initiative Act, enacted in 2018, continues to be led by four co-chairs from the Department of Commerce's National Institute of Standards and Technology, Department of Energy, National Science Foundation (NSF), and OSTP. The law requires, among other things, that the QIS Subcommittee develop a 5-year Strategic Plan by December 21, 2019. In January 2020, an NSF official and OSTP staff reported that a draft strategic plan was under review. According to the NSF official, the strategic plan will include an assessment of actions the agencies are taking in support of QIS, and, in particular, the degree to which the agencies have developed mechanisms that enhance and sustain collaboration. The official said the draft plan will be submitted to the National Quantum Initiative Advisory Committee, which conducts independent assessments of and advises the President and QIS Subcommittee on matters related to the National Quantum Initiative. The NSF official reported that the membership of the Advisory Committee will be announced in the spring 2020 timeframe, at which time it will begin its review of the draft strategic plan. In addition to the development of a strategic plan, the National Quantum Initiative Act called for the establishment of a National Quantum Coordination Office to support the QIS Subcommittee, which OSTP formed in March 2019. Following this, in Oct. 2019 the QIS Subcommittee created three interagency working groups: (1) the science working group is working to coordinate the scientific and technical aspects of programs; (2) the workforce, infrastructure, and industry working group is working to identify workforce and technology needs; and (3) the end-user group is working to connect the nation's research and development community, including academics and industry players, to potential early adopters in the federal government. Taking this action will help to enhance and strengthen interagency collaboration and could help ensure that agencies effectively marshal their efforts to maintain U.S. competitiveness in quantum computing. When the strategic plan is finalized and we confirm what additional actions the QIS Subcommittee has taken to fully implement leading practices that enhance and sustain collaboration, we will provide updated information.

Recommendation: The Secretary of Commerce should ensure that the department's IT management policies address the role of the CIO for key responsibilities in the five areas we identified. (Recommendation 5)

Agency: Department of Commerce
Status: Open

Comments: The agency agreed with the recommendation and, in October 2018, described a a number of steps it planned to take to address the responsibility gaps identified in the report. We will continue to monitor the steps the agency takes to address these requirements.

Recommendation: The Secretary of Commerce should ensure that the Bureau of Economic Analysis includes Puerto Rico in its reporting on gross domestic product, as it does for four other U.S. territories. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce agreed with this recommendation. As of August 2018, the Bureau of Economic Analysis (BEA) received initial funding for the remainder of FY18 and FY19 to begin producing economic statistics for Puerto Rico. BEA is currently in the process of meeting with the government and other stakeholders and building a work plan, with a kick-off expected in early FY19 and initial outputs anticipated in late FY19. In addition, BEA reported taking steps to develop a work plan to calculate GDP and review the economic and demographic data currently available from the federal government and Puerto Rico. Any short-term efforts to calculate GDP will rely heavily on data currently collected by the Puerto Rico government. Additional efforts beyond FY19 are contingent on resource availability.

Recommendation: The Secretary of Commerce, in cooperation with DOL's Bureau of Labor Statistics, should conduct a study on the feasibility of including Puerto Rico in its reporting of the Current Population Survey. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce agreed with this recommendation. In June 2018, the Department noted that in Fall 2016, the Census Bureau and DOL's Bureau of Labor Statistics estimated that an assessment of the feasibility of expanding the Current Population Survey (CPS) data products to include Puerto Rico would cost approximately $1.5 million over an 18-month period. Commerce understands that BLS, which funds the majority of the CPS, does not have the funds within its budget to conduct a feasibility study. Given these resources constraints, Census and BLS would also not be able to absorb the costs of collecting, analyzing and producing the data in the out years. As of June 2019, Commerce has coordinated with BLS regarding the related feasibility study required per House Report 115-704. We will close this recommendation when the study is begun.

Recommendation: The Secretary of Commerce should instruct NIST to fully report the range of challenges in federal patent licensing, such as those outlined in this report, by, for example, leveraging its survey of practices at federal technology transfer offices, past Federal Laboratory Consortium studies, and agency reports and including that information in its summary reports to Congress. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: According to the Department of Commerce, NIST actions in response to the recommendation are in process. In August 2020, Commerce officials stated that the next annual report to the President and Congress was in the review process and is expected to be published this fall.

Recommendation: The Secretary of Commerce should instruct NIST to clarify the link between establishing patent license financial terms and the goal of promoting commercial use, through appropriate means, such as the upcoming rule-making process and updating relevant guidance. (Recommendation 2)

Agency: Department of Commerce
Status: Open

Comments: According to the Department of Commerce, NIST actions in response to the recommendation are in process and the purpose of licensing royalties will be addressed through a related initiative. The expected completion date for this action has been revised to November 2020.

Recommendation: The Secretary of Commerce should instruct NIST to facilitate formal information sharing among the agencies to provide federal labs with information on financial terms in comparable patent licenses, as appropriate. (Recommendation 3)

Agency: Department of Commerce
Status: Open

Comments: According to the Department of Commerce, NIST actions in response to the recommendation are in process. The actions to address it have been discussed by the Interagency Workgroup for Technology Transfer and the FLC, including adding a licensing guide and community of practice for licensing terms to the FLC website. In August 2020, Commerce stated that the expected completion date for this action has been revised to September 2020.

Recommendation: The Secretary of Commerce should evaluate the level of preparedness for cybersecurity personnel not currently holding certifications to take certification exams, identify strategies for mitigating any gaps identified, and report this information to Congress. (Recommendation 1)

Agency: Department of Commerce
Status: Open

Comments: Department of Commerce (Commerce) officials concurred with our recommendation and planned to evaluate the level of preparedness for cybersecurity personnel not currently holding certifications to take certification exams, and to identify strategies for mitigating any gaps identified. As of August 2020, Commerce had not provided sufficient evidence that it had implemented the recommendation. We will continue to monitor the situation.

Recommendation: The Secretary of Commerce should ensure that the office of the CAO is involved in the process to identify IT acquisitions. (Recommendation 4)

Agency: Department of Commerce
Status: Open

Comments: In a March 2018 response to our report, the agency agreed with our recommendation and stated that the CIO and the Senior Procurement Executive will issue a memo to their acquisition and CIO member offices clarifying the offices joint responsibilities to ensure that all IT acquisitions are submitted to the CIO for review and approval. The memo is also to provide guidance on the process by which the CIO will review proposed contract actions. However, as of February 2020, the agency had not responded to requests for updates. We will continue to monitor the implementation of this recommendation.

Recommendation: The Secretary of Commerce should ensure that IT acquisition plans or strategies are reviewed and approved according to OMB's guidance. (Recommendation 5)

Agency: Department of Commerce
Status: Open

Comments: In a March 2018 response to our report, the agency agreed with our recommendation and stated that it intended to clarify its policies and procedures to comply with OMB rules, including the IT acquisition checklist, which must be completed for every proposed contract action. In addition, the CIO and Senior Procurement Executive will work together to review existing acquisition plan review and approval processes. However, as of February 2020, the agency had not responded to requests for updates. We will continue to monitor the implementation of this recommendation.

Recommendation: The Secretaries of Agriculture, Commerce, Defense, Homeland Security, Energy, HHS, Interior, Labor, State, Transportation, Treasury, and VA; the Attorney General of the United States; the Administrators of EPA, GSA, and SBA; the Director of OPM; and the Chairman of NRC should take action to, within existing OMB reporting mechanisms, complete plans describing how the agency will achieve OMB's requirement to implement automated monitoring tools at all agency-owned data centers by the end of fiscal year 2018.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce (Commerce) agreed with our recommendation and described planned actions to address it. Specifically, the department noted that, as part of its effort to consolidate, define, and establish a plan to deploy an enterprise-wide automated monitoring tool, it had identified two component agencies that would offer a data center infrastructure management tool as a service. The department added that this approach would allow it to monitor and report cost savings and avoidances more efficiently. In November 2019, Commerce reported that it had 73 agency-owned data centers that the department planned to keep open. However, of those 73, only seven had implemented the required advanced monitoring tools. As of January 2020, we have not received a more recent update from the department about how it will meet the Data Center Optimization Initiative requirement to implement monitoring tools at the remaining 66 of its agency-owned data centers. We will continue to monitor the status of this recommendation.

Recommendation: Early in the next decennial cycle, the Secretary of Commerce should direct the Under Secretary of the Economics and Statistics Administration and the Director of the U.S. Census Bureau to plan and execute more flexible, and perhaps smaller, address canvassing test and evaluation activity needed to support key design decisions having significant effect on the cost and quality of the census.

Agency: Department of Commerce
Status: Open

Comments: As of September 2020, the Bureau had not yet begun its 2030 testing and evaluation planning. When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.

Recommendation: The Secretary of Commerce should direct the NOAA Administrator to develop a strategy for expanding NOAA's use of the private sector in its hydrographic survey program, as required by law.

Agency: Department of Commerce
Status: Open

Comments: In September 2018, NOAA reported that it had awarded a contract to assess hydrographic surveying needs and had drafted a Memorandum of Agreement to improve coordination with the U.S. Geological Survey on data acquisition and management. NOAA also reported that it planned to identify surveying tasks that could be accomplished using the private sector, and would take steps to improve the funding transfer process so that it could take advantage of Federal Emergency Management Agency and National Transportation Safety Board funds available for certain types of private sector survey activities. NOAA officials stated these tasks would be completed and a final strategy on working with the private sector issued by December 30, 2020.

Recommendation: To enhance information available to operational unit managers, the Secretary of Commerce should direct the director of NOAA's WFMO to ensure that complete information on hiring requests is routinely communicated to NWS managers throughout the three phases of the hiring process, such as by supporting the development of improved tracking and reporting capabilities in the planned new Commerce-wide data system.

Agency: Department of Commerce
Status: Open

Comments: The agency agreed with our recommendation. As of June 2020, the agency had taken some action, but had not fully implemented it. We will update this recommendation's status as we receive more information.

Recommendation: To enhance interagency collaboration in the Manufacturing USA program, the Secretary of Commerce should direct the Director of the National Institute of Standards and Technology to work with all non-sponsoring agencies whose missions contribute to or are affected by advanced manufacturing to revise the Manufacturing USA governance system to ensure the roles and responsibilities for how these agencies could contribute to the Manufacturing USA program are fully identified.

Agency: Department of Commerce
Status: Open

Comments: In October 2019, the National Institute of Standards and Technology (NIST) reported that, working through the Manufacturing USA interagency team and the National Science and Technology Subcommittee on Advanced Manufacturing, it had revised the Manufacturing USA governance document to include a section defining roles related to facilitating information sharing for agencies who are not sponsoring Manufacturing USA institutes. We are seeking clarification from NIST on which non-sponsoring agencies are covered by the new section. We will revisit the status of this recommendation once we receive clarification.

Recommendation: The Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to revise and test procedures on how to better leverage enumerator-collected information on the best time or day to conduct interviews, and ensure enumerators are properly trained on these procedures.

Agency: Department of Commerce
Status: Open

Comments: Commerce agreed with this recommendation. In the Bureau's March 2017 action plan, it reported that as the Census Bureau develops enhancements to the procedures and training for enumerators, it will reflect on what it has learned from 2016 Census Test experiences as well as from recommendations such as this. It reported a target completion of December 2018, following completion and analyses of the nonresponse follow-up operation for the 2018 End-to-End Census Test. In January 2018, Bureau officials told us that leveraging enumerator collected information on the best time to conduct an interview would not be a part of questionnaire design's functionality for 2020 and will most likely rely on the system optimizer to determine the best time to contact a household. Bureau officials indicated they may push this recommendation out to 2030. During the 2018 Test, we continued to observe that enumerator notes were not being systematically reviewed by supervisors and managers, such that information such as office hours for apartment managers among other information we reported on was not being used by the operation. In June 2019, the Bureau informed us that it had added functionality to the enumerator device for enumerators to alert supervisors of case notes of "high importance" and was revising training to explain its use. Additionally, in December 2019, the Bureau shared documentation that reiterated the importance of enumerators reviewing prior case notes but clarified that enumerators should not expect their supervisors to regularly review those case notes. In April 2020, Bureau officials indicated that it was not likely that the Bureau would revise CFS training to systematically review case notes for the 2020 cycle, though we are following up with the Bureau to see if this can be done given the revised census time frames stemming from the COVID-19 outbreak. To fully implement this recommendation for 2020 and for future fieldwork, the Bureau needs to make better use of the information collected by enumerators during interview attempts about when to make additional attempts, such as during reported working hours of property managers for large multi-unit structures that house a large number of non-respondents.

Recommendation: To facilitate the analysis of gaps between current skills and future needs, the development of strategies for filling the gaps, and succession planning, the Secretary of Commerce should require the Chief Information Officer, Chief Human Capital Officer, and other senior managers as appropriate to address the shortfalls in IT workforce planning noted in this report, including the following actions: (1) establish and maintain a workforce planning process; (2) develop competency and staffing requirements; (3) assess competency and staffing needs regularly; (4) assess gaps in competencies for all components of the workforce; (5) develop strategies and plans to address gaps in competencies and staffing; (6) implement activities that address gaps, including an IT acquisition cadre, cross-functional training of acquisition and program personnel, a career path for program managers, and special hiring authorities, if justified and cost-effective; (7) monitor the department's progress in addressing IT competency and staffing gaps; and (8) report to department leadership on progress in addressing competency and staffing gaps.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The department agreed with the recommendation and stated that it plans to fully implement it. In October 2019 (in GAO-20-129), we reported the results of our evaluation of the department's progress in implementing the eight IT workforce planning activities. Specifically, we reported that the department had substantially implemented the activity to develop competency and staffing requirements, minimally or partially implemented four activities, and not implemented the remaining three activities. In July 2020, the department provided a summary of actions it claimed it had taken to close the recommendation. The department also provided supporting documentation. We are reviewing the documentation to determine whether it fully addresses the recommendation.

Recommendation: To help reduce federal fiscal exposure by enhancing the resilience of infrastructure to extreme weather, the Secretary of Commerce, through the Director of NIST, in consultation with MitFLG and USGCRP, should convene federal agencies for an ongoing governmentwide effort to provide the best available forward-looking climate information to standards-developing organizations for their consideration in the development of design standards, building codes, and voluntary certifications.

Agency: Department of Commerce
Status: Open

Comments: As of August 5, 2020, NIST has not convened a governmentwide effort to provide the best available forward-looking climate information to standards developing-organizations.

Recommendation: To improve federal agencies' efforts to rationalize their portfolio of applications, the heads of the Departments of Agriculture, Commerce, Education, Energy, Health and Human Services, Housing and Urban Development, the Interior, Labor, State, Transportation, the Treasury, and Veterans Affairs; and heads of the Environmental Protection Agency; National Aeronautics and Space Administration; National Science Foundation; Nuclear Regulatory Commission; Office of Personnel Management; Small Business Administration; Social Security Administration; and U.S. Agency for International Development should direct their Chief Information Officers (CIOs) and other responsible officials to improve their inventories by taking steps to fully address the practices we identified as being partially met or not met.

Agency: Department of Commerce
Status: Open

Comments: We reported that the Department of Commerce did not meet the following software application inventory practice: regularly updates the inventory with quality controls to ensure reliability. Specifically, the department did not provide evidence of a process to regularly update its inventory or quality controls to ensure the reliability of the data collected. In October 2017, the department reported that application inventory information will be captured through the Department of Commerce Capital Planning and Investment Control (CPIC) system, as part of its regular updating of investment information. Further, the department stated that it will update its CPIC handbook to provide guidance on quality control to ensure reliability of the data collected. In November 2018 and November 2019 we followed-up with Commerce on the status of their efforts; however, as of January 2020, we had not received an update. We plan to continue to follow up with Commerce to monitor the status of these planned actions.

Recommendation: To help NMFS and the Councils incorporate climate information into the fisheries management process and better manage climate-related risks, the Secretary of Commerce should direct NOAA's Assistant Administrator for Fisheries to, in finalizing the regional action plans for implementing the NOAA Fisheries Climate Science Strategy, (1) incorporate the key attributes associated with successful performance measures in the final performance measures developed for the plans and (2) assess whether agency-wide performance measures may be needed to determine the extent to which the objectives of the Strategy overall are being achieved, and develop such measures, as appropriate, that incorporate the key attributes of successful performance measures.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce and NOAA agreed with this recommendation. In October 2019, NOAA provided GAO with a written update on actions taken in response to this recommendation, including the development of agency-wide metrics for the NOAA Fisheries Climate Science Strategy. In September 2020, NOAA informed GAO that it plans to update the performance metrics for the regional action plans to include our key attributes in 2021. We will continue to monitor NOAA's progress on this effort and will review the updated performance metrics to assess the extent to which the agency has addressed our recommendation.

Recommendation: To fulfill the role assigned to it under the 1980 Act, the Secretary of Commerce should engage with industry stakeholders and continually identify and assess critical materials needs across a broad range of industrial sectors.

Agency: Department of Commerce
Status: Open

Comments: In December 2016, Commerce provided information on its implementation of the recommendation from GAO-16-699. Commerce stated that it had developed an action plan consisting of the following steps: (1) consulting with relevant offices and agencies, including: OSTP, DOD, the U.S. Geological Survey, DOE, the U.S. International Trade Commission, the Bureau of Industry and Security, the National Institute of Standards and Technology, and the National Oceanic and Atmospheric Administration; (2) determining criteria to be used when it is necessary to collect information to identify and assess critical materials needs; (3) determining appropriate steps, which might include: (a) developing a summary of information that federal agencies currently collect on the domestic and international supply of critical raw materials; (b) soliciting input from a broad range of industries through a Federal Register notice; (c) assessing aggregate information, as allowable under law, that is submitted through the Miscellaneous Tariff Bill process over the course of fiscal year 2017; and (d) consulting with federal advisory groups for advice; (4) determining the audience for collected information and methodology for information dissemination; (5) determining the process for identifying further information collection needs and methodology for disseminating collected information; and (6) determining the timeline and responsibilities for information collection and distribution. In an April 2017 update, Commerce stated that it had identified points of contacts in seven of the eight agencies listed in its action plan and is in the process of contacting them for input. Commerce stated that it hoped to identify an appropriate contact in the eighth agency in the near future. Commerce stated that it had also drafted questions to ask the agencies in order to implement the action plan. Commerce did not provide a timeframe for when it expected to complete implementation of the action plan. In a June 2018 update, Commerce stated that since the change in Administration, Commerce has not been able to identify staff in all agencies to work with, but that Commerce is now in contact with several agencies who are aware of industry needs. Commerce did not provide a timeframe for when it expected to complete execution of its action plan. We requested additional information on Commerce's efforts to implement this recommendation, including plans to solicit industry input, and will update the status of the recommendation based on additional information received.

Recommendation: To improve the effectiveness of the SEC's conflict minerals disclosure rule, the Secretary of Commerce should submit to the appropriate congressional committees a plan outlining steps that Commerce will take, with associated time frames, to (1) assess the accuracy of the independent private sector audits (IPSA) and other due diligence processes described under section 13(p) of the Securities Exchange Act of 1934; (2) develop recommendations for the process used to carry out such audits, including ways to improve the accuracy of the audits and establish standards of best practices for such audits; and (3) acquire the necessary knowledge, skills, and abilities to carry out these responsibilities.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with this recommendation. In response to this recommendation, Commerce indicated in an October 25, 2016 letter to GAO that it has developed a three-step approach which parallels the three distinct elements of the recommendation. To fully implement this recommendation, Commerce needs to submit the said three-step plan, including associated timeframes for their completion, to the appropriate congressional committees. Section 1502 of the Dodd-Frank Act defines "appropriate committees" to mean the Committee on Appropriations, the Committee on Foreign Affairs, the Committee on Ways and Means, and the Committee on Financial Services of the House of Representatives; and the Committee on Appropriations, the Committee on Foreign Relations, the Committee on Finance, and the Committee on Banking, Housing, and Urban Affairs of the Senate. In a January 2018 email, a Commerce official indicated to GAO that the agency had reviewed the 19 IPSA audits filed by companies in 2016, and the agency plans to complete a review of the 16 IPSA audits filed in 2017 by the end of FY 2018. However, the official noted that the "Department will not undertake the development of recommendations and best practices while the SEC is revising its rule." Commerce cited SEC staff's recent updated guidance and ongoing reviews of the conflict minerals rule, among other things, as their primary reason. However, the SEC staff's updated guidance also clarified that the guidance "does not express any legal conclusion on the rule" and is "subject to any further action that may be taken by the Commission." Therefore, the rule is still in effect, according to SEC staff. We requested a status update in October 2019 and Commerce responded: "In National Association of Manufacturers v. United States SEC, 2017 U.S. Dist. LEXIS 135732 (2017), the District Court for the District of Columbia declared an element of the relevant SEC rule unconstitutional, necessitating that the SEC determine how that decision affects overall implementation of the Conflict Minerals rule. Until the SEC completes its deliberative process, makes such determination, and implements any necessary revisions to the rule, the Department does not intend to undertake additional work under Section 1502 of the Dodd-Frank Wall Street Reform and Consumer Protection Act with regard to the assessment of the accuracy of the audits and other due diligence processes or recommendations regarding the audits. After which point, the Department will assess how the SEC determination and any revisions to the rule affect the Department's plans for implementing GAO's recommendation."

Recommendation: To ensure Bureau and congressional confidence that the Bureau's budgeted contingencies are at appropriate levels, the Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to improve control over how risk and uncertainty are accounted for and communicated with the Bureau's decennial cost estimation process, such as by implementing and institutionalizing processes or methods for doing so with clear guidance.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce agreed with this recommendation. Specifically, we reported that the Bureau should ensure that its budget for contingencies for the 2020 Census reflect an accurate accounting of risk and uncertainty. In doing this, the Bureau should improve controls over risk and uncertainty in the cost estimate process, and institutionalize these controls by providing clear methods for their use. In July 2018, we completed a review of documentation to support the updated October 2017 cost estimate and found that the Bureau performed uncertainty and sensitivity analysis on the estimate and appropriately added funding into the cost estimate to reflect inherent uncertainty and to account for specific risks. In order to fully implement this recommendation, the Bureau will need to link specific risks to funds set aside in the $1.2 billion general risk contingency fund. Therefore, as of January 2020, this recommendation remains valid and should be addressed: that the Bureau properly account for risk in the 2020 Census cost estimate.

Recommendation: To help ensure the Bureau focuses its resources on those activities that show promise for substantially reducing enumeration cost, in advance of the 2016 Census Test and later tests, the Secretary of Commerce should direct the Under Secretary of the Economics and Statistics Administration and the Director of the U.S. Census Bureau to, ensure systematic capture of information about fieldwork cases that experience problems by including information in enumerator training about where to record the issues, who to contact, what details to include, and the importance of doing so.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce concurred with this recommendation. The Census Bureau informed us in December 2015 that no later than the end of December 2015, it would document how these matters have been addressed in the enumerator training (or in help screens on their mobile device) planned for the 2016 Census Test, and that it would use results and observations from that test to further refine such information for future tests and for the 2020 Census. The Bureau provided us with related training materials for the 2016 Test, yet we made similar observations during the 2016 test and the 2018 End-to-End test. For the Bureau to be informed on any additional training needs or other operational decisions for 2020, it will need to continue to expand its efforts in collecting information on enumerator-reported problems per our 2015 recommendation. In April 2020, Bureau officials said that it was not likely they would be able to incorporate additional changes for the 2020 Census field operations. With the Bureau's more recent April announcement to further delay field operations due to the Covid-19 outbreak, we are continuing to ask the Bureau if there is opportunity to address this recommendation. To fully implement this recommendation, the Bureau needs to identify what information it finds valuable to have from its enumerators, such as the incidence of specific technical problems with the survey instrument or mobile device and ensure that enumerators and their first-line supervisors are made aware of the importance of recording such information and how to do so.

Recommendation: To help the department effectively manage spending on mobile devices and services, the Secretary of Commerce should ensure a reliable department-wide inventory of mobile service contracts is developed and maintained.

Agency: Department of Commerce
Status: Open

Comments: As of January 2020, the Department of Commerce had not implemented this recommendation. In July 2018, the department provided an inventory that shows, by service provider and department component, the number of devices per rate plan and monthly rate; however, the inventory did not include the number of voice minutes, gigabytes of data, and text messages allowed per line per month. Furthermore, the department had not demonstrated that it had accounted for all of its mobile service contracts. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To help the department effectively manage spending on mobile devices and services, the Secretary of Commerce should ensure procedures to monitor and control spending are established department-wide. Specifically, ensure that (1) procedures include assessing devices for zero, under, and over usage; (2) personnel with authority and responsibility for performing the procedures are identified; and (3) the specific steps to be taken to perform the process are documented.

Agency: Department of Commerce
Status: Open

Comments: As of January 2020, the department had not addressed the recommendation. In July 2018, the department described steps it was taking to identify lines that were inactive for a period of three or more continuous months (zero usage). However, as of January 2020, the department had not demonstrated that it has established documented procedures that address the elements of our recommendation. We will continue to monitor the department's progress.

Recommendation: To ensure the effective management of software licenses, the Secretary of Commerce should provide software license management training to appropriate agency personnel addressing contract terms and conditions, negotiations, laws and regulations, acquisition, security planning, and configuration management.

Agency: Department of Commerce
Status: Open

Comments: In April 2018, the Department of Commerce reported that training will be concurrent with the implementation of the new inventory. It estimates the completion of this to be June 30, 2019. In October 2017, the department reported that they were reaching out to another federal agency to learn about the software license management training they offer to incorporate lessons learned into the Commerce's future training plans. However, as of November 2019, the department has not provided an update on these efforts. GAO will continue to monitor the department's progress in implementing this recommendation.

Recommendation: To help maintain a more thorough and insightful 2020 Census development schedule in order to better manage risks to a successful 2020 Census, the Secretary of Commerce and Undersecretary of Economic Affairs should direct the U.S. Census Bureau to improve the credibility of schedules, including conducting a quantitative risk assessment.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Bureau agreed with this recommendation and stated that it had already begun maturing project schedules to ensure that the logical relationships between discrete schedules were put into place. Schedule integration sessions across projects and programs were held in late January 2014 and into February 2014 and periodically since then, where work was deconstructed into detailed schedules. The Bureau released its operational plan and other documentation in November 2015 and announced in June 2016 that it would finalize and release its 2020 Census schedule in July 2016. In 2015, the Bureau provided us with a preliminary output from its risk analysis software as a demonstration of the type of analysis it had committed to, but since then its officials have said that they will not be able to take all the steps needed to satisfy this recommendation for the 2020 Census. The Bureau took steps toward conducting quantitative schedule risk analyses with its master activity schedule for the 2020 Census, but effectively ran out of time to do so. Assigning resources to large complex schedules in order to conduct such analyses is easier to do early in schedule development process, as we recommended the Bureau do in 2009 for its 2020 Census schedule. This recommendation will remain open pending the Bureau taking steps to carry out quantitative risk assessments of its 2030 schedule with appropriate resources linked to it.

Recommendation: To improve the department's implementation of PortfolioStat, the Secretary of Commerce should direct the CIO to reflect 100 percent of information technology investments in the department's enterprise architecture.

Agency: Department of Commerce
Status: Open

Comments: In October 2018, the Commerce described its process for updating its IT asset inventory as part of the budget formulation process and provided a mapping of investments to its enterprise architecture as evidence that it had implemented this recommendation. However, the department did not provide any policies and procedures supporting the process it described to us. In addition, it did not provide any evidence of controls to ensure that all investments had been captured in the enterprise architecture. In January 2020, the department told us that its Office of the Chief Information Officer had new leadership and as a result the department was expected to make significant progress in addressing the recommendation this year.

Recommendation: To improve the department's implementation of PortfolioStat, the Secretary of Commerce should direct the CIO to develop a complete commodity IT baseline.

Agency: Department of Commerce
Status: Open

Comments: In October 2018, Commerce officials told GAO about actions taken that they believed addressed the recommendation and provided supporting documentation. Specifically, they stated that they send out an annual data call for bureaus to provide their IT asset inventory as part of the budget submission process. They stated they also perform department-level validation of the bureaus' inventories and aggregate them into a single department inventory. As evidence, they provided a data call memo with supporting instructions and a template for bureaus to establish an IT asset inventory. They also provided examples of three bureau inventories received in response to data calls. In addition, they provided the final aggregated inventory (for fiscal year 2017) and department-level validation of bureau submissions. However, the department did not provide any policies or procedures documenting the process they described. In addition, we could not determine whether the creation of the department-wide inventory was a one-time effort or a recurring activity. In January 2020, the department told us that its Office of the Chief Information Officer had new leadership and as a result the department was expected to make significant progress in addressing the recommendation this year.

Recommendation: To improve the consistency, comprehensiveness, and transparency of information provided to Congress and policymakers on the federal investment in export promotion programs, the Secretary of Commerce, as chair of the TPCC, should report in its National Export Strategies on how resources are allocated by agency and aligned with priorities.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Export Enhancement Act [15 U.S.C. Section 4727(c)] states that the Trade Promotion Coordinating Committee's (TPCC) strategies should establish a set of priorities for federal export promotion activities and propose a unified federal trade promotion budget that supports the plan. In written comments on GAO's report, the Director of the TPCC Secretariat generally concurred with the recommendation on behalf of the Secretary. Nevertheless, the Director noted the TPCC's limited authority over budget reporting and resource allocations and gave examples of some challenges they faced, including shifts in the political and budgetary landscape and how different Administrations and Congresses have emphasized different priorities over time. In the years following GAO's 2013 report, the TPCC has not issued any National Export Strategies (NES), except in 2016; however this 2016 NES did not include any budget information on how resources were allocated by agency and aligned with the strategy's priorities. In August 2020 Commerce officials told GAO they had collected budget information from TPCC agencies related to trade promotion activities (FY19 actual and FY20 requested). They noted that the budget categories and agencies from which it was collected reflected changes in Administration priorities and new Congressional mandates. However, they said this information has not been transmitted to Congress.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should fully establish an approach for measuring enterprise architecture outcomes, including a documented method (i.e., steps to be followed) and metrics that are measurable, meaningful, repeatable, consistent, actionable, and aligned with the agency's enterprise architecture's strategic goals and intended purpose.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce has not implemented this recommendation. Since we reported in 2012 that the department had established metrics for measuring enterprise architecture outcomes but not a method for measuring the metrics, the department issued an Enterprise Architecture Value Measurement Plan in April 2018. This plan included outcome metrics; however, the department had not documented a method for measuring the metrics. In January 2020, the department's Office of the Chief Information Officer (CIO) stated that the department recently appointed a new CIO (acting) and was in the process of revisiting strategic planning initiatives and implementation to ensure they are congruent with the IT strategic vision and objectives. The Office of the CIO also said it was hiring a new Chief Enterprise Architect, which would impact previous initiatives and strategies. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To enhance federal agencies' ability to realize enterprise architecture benefits, the Secretaries of the Departments of Agriculture, the Air Force, the Army, Commerce, Defense, Education, Energy, Homeland Security, the Interior, Labor, the Navy, State, Transportation, the Treasury, and Veterans Affairs; the Attorney General; the Administrators of the Environmental Protection Agency, General Services Administration, National Aeronautics and Space Administration, and Small Business Administration; the Commissioners of the Nuclear Regulatory Commission and Social Security Administration; and the Directors of the National Science Foundation and the Office of Personnel Management should periodically measure and report enterprise architecture outcomes and benefits to top agency officials (i.e., executives with authority to commit resources or make changes to the program) and to OMB.

Agency: Department of Commerce
Status: Open

Comments: The Department of Commerce has not implemented this recommendation. In April 2018, the department issued an Enterprise Architecture Value Measurement Plan; however, the department has not demonstrated that it has measured and reported enterprise architecture outcomes. In January 2020, the department's Office of the Chief Information Officer (CIO) stated that the department recently appointed a new CIO (acting) and was in the process of revisiting all strategic planning initiatives and implementation to ensure they are congruent with the IT strategic vision and objectives. The Office of the CIO also said it was hiring a new Chief Enterprise Architect, which would impact previous initiatives and strategies. We will continue to monitor the department's efforts to implement the recommendation.

Recommendation: To ensure that the performance measures used to evaluate the TAA for Firms program demonstrate program results and to help ensure that EDA can comprehensively evaluate the effectiveness of the program, the Secretary of Commerce should broaden the program's evaluation approach, for instance, by developing additional quantifiable outcome-oriented performance goals and measures for key program areas and conducting further analysis of the data to isolate the impact of the TAA for Firms program from other influences, such as economic trends.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce concurred with our findings and recommendations. As of August 2020, EDA is taking actions to implement our recommendation. In 2012, EDA commissioned a study to inform the development of performance metrics and evaluation methods for the TAA for Firms program. Issued in October 2014, the study provided recommendations to EDA on potential performance metrics, tested the metrics by conducting a statistical analysis of TAA for Firms clients against a control group as well as a survey, and suggested data sources for conducting future evaluations of the TAA for Firms program. According to EDA officials, the study would help provide a foundation for more robust longitudinal performance measurement and enhanced policy analysis, thereby enabling EDA to more comprehensively evaluate the program. These officials noted that, in April 2017, the authors of the study finalized an operational toolkit containing recommended metrics and protocols for data collection and impact evaluation methods. In June 2017, EDA began to pilot test these recommended metrics and evaluation methods to improve program evaluation. EDA formed a working group in December 2017 to further refine the new evaluation system and metrics based on the results of the pilot tests. In May 2018, EDA's working group concluded the refinement of the metrics. In August 2018, EDA continued to collect data on these metrics from its grantees using a pilot survey and refined the metrics as EDA received additional responses and feedback about the pilot survey from grantees. As of August 2020, EDA had developed new data collection instruments that will gather data and information on the TAA for Firms program's outputs and outcomes. EDA intends to use the information collected from the new instruments to conduct program evaluations to better understand how program performance compares with performance goals and the impact of the TAA for Firms program, according to EDA officials. EDA is in the process of developing software to administer the instruments and an internal working group is guiding the implementation of the new data collection system. EDA expects to implement the new system in fiscal year 2020, according to EDA officials. We will continue to monitor Commerce's efforts to implement our recommendation.

Recommendation: To improve the data available to manage and evaluate the TAA for Firms program, the Secretary of Commerce should develop a data system to consistently collect, maintain, and analyze sufficiently reliable and up-to-date data on program operations and participant firms.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce concurred with our findings and recommendations. As of August 2020, EDA is taking actions to implement our recommendation. According to EDA officials, in fiscal year 2017, EDA had developed an improvement plan for its agency-wide data system for collecting data on program operations. As of August 2020, EDA is working with a contractor to implement a new data system to assist in administering and managing the TAA for Firms program. For example, EDA officials expect the new data system to allow TAA Centers to submit participant firms' petitions for certification and adjustment proposals to EDA electronically for review and approval. In addition, these officials noted that the new data system will facilitate EDA's analysis of program performance. EDA anticipates that the new data system for the TAA for Firms program will be operational in fiscal year 2021. We will continue to monitor Commerce's efforts to implement our recommendation.

Recommendation: To help improve the effectiveness of the Bureau's outreach and enumeration efforts, especially for HTC populations, should they be used again in the 2020 Census, and improve the Bureau's marketing/outreach efforts, the Secretary of Commerce should require the Under Secretary for Economic Affairs as well as the Director of the U.S. Census Bureau to develop mechanisms to increase coordination and communication between the partnership and local census office staff. Possible actions include offering more opportunities for joint training, establishing protocols for coordination, and more effectively leveraging the partnership contact database to better align partnership outreach activities with local needs.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Department generally agreed with this recommendation. In 2011, the Bureau reported on the agency's assessment of the partnership program. In September 2014, the Bureau's Path to the 2020 Census, identified the Partnership Program as one of the best methods for communicating the importance of response and states its intent to map out details about the Partnership Program in early 2016. As of March 2018, Bureau officials said they were developing coordination mechanisms between partnership and Area Census Office staff for the 2020 Census. For example, the Bureau updated a form it had used during the 2010 Census to track partnership outreach activities to help facilitate information sharing within the Bureau and said it plans to make additional updates. In March 2019, the Bureau informed us that it is assigning at least one partnership specialist to each census office manager to help address this recommendation. As we reported in May 2020, the Bureau had not put in place expectations for how Partnership staff should support area census office staff. We also reported that pluralities of area census office managers we surveyed in March 2020 were dissatsified with the level of clarity of roles and responsibilities of Partnership staff, as well as the level of communication and coordination between Partnership and office staff. To fully implement this recommendation, the Bureau will need to take such steps as documenting for partnership specialists and their area census office manager how they are expected to work together and other significant mechanisms that would increase effectiveness of coordination and communication between partnership and local field office staff.

Recommendation: To help improve the effectiveness of the Bureau's outreach and enumeration efforts, especially for HTC populations, should they be used again in the 2020 Census, and to improve some of the Bureau's key efforts to enumerate HTC populations, the Secretary of Commerce should require the Under Secretary for Economic Affairs as well as the Director of the U.S. Census Bureau to determine the factors that led to the staffing issues observed during SBE and take corrective actions to ensure more efficient SBE staffing levels in 2020.

Agency: Department of Commerce
Status: Open

Comments: The Department generally agreed with this recommendation. In September 2012, the Bureau issued its assessment of the Service Based Enumeration Program. The assessment reported on the number of individuals counted and the complexities of this special enumeration activity. The assessment did not address the Bureau's approach to staffing this special enumeration activity. In its 2020 Census Operational Plan, issued in October 2017, the Bureau provided a high level overview of reengineered field operations plans but did not provide details on special enumeration efforts. In April 2018, the Bureau provided us with its planned staffing ratios for its Service-Based Enumeration activity for the 2020 Census in comparison to those used in the 2010 Census, as well as results of its 2016 Census Test of SBE activity. As of August 2020 we have ongoing work that will be examining implementation of peak field operations and providing updates to this recommendation. In order to fully implement this recommendation, the Bureau needs to demonstrate that its planning for how it will determine staffing levels for SBE takes into account the factors that led to inefficient staffing allocation previously.

Recommendation: To help improve the effectiveness of the Bureau's outreach and enumeration efforts, especially for HTC populations, should they be used again in the 2020 Census, and to improve some of the Bureau's key efforts to enumerate HTC populations, the Secretary of Commerce should require the Under Secretary for Economic Affairs as well as the Director of the U.S. Census Bureau to evaluate the extent to which each special enumeration activity improved the count of traditionally hard-to-enumerate groups and use the results to help inform decision making on spending for these programs in 2020.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: The Department generally agreed with this recommendation. In 2012, the Bureau reported on assessments of many 2010 special enumeration activities such as the Service-Based Enumeration and the Be Counted/Questionnaire Assistance Center Programs. These assessments revealed the number of persons counted and spending for the special enumeration activities. Separately, the Bureau issued results of the 2010 Census Coverage Measurement Program that described the level of coverage of various hard-to-enumerate populations generally without attributing coverage to specific enumeration activities. Since 2015, the Bureau has issued annual updates of its 2020 Census Operational Plans, which have not provided details of plans for various special enumeration activities. In April 2017 Bureau officials provided us with evaluation results of its 2010 communication efforts and other documents related to ongoing efforts to reduce errors in the census. As of August 2020, we are in communication with Bureau officials about steps they are taking to implement this recommendation. To fully implement this recommendation, the Bureau needs to demonstrate how it is relying on data about how various special enumeration activities of historically hard-to-enumerate groups contributed to census coverage in 2010 to inform its design for the 2020 Census.

Recommendation: To improve the Bureau's use of its master schedule to manage the 2020 decennial census, the Secretary of Commerce should require the Director of the U.S. Census Bureau to include estimates of the resources, such as labor, materials, and overhead costs, in the 2020 integrated schedule for each activity as the schedule is built, and prepare to carry out other steps as necessary to conduct systematic schedule risk analyses on the 2020 schedule.

Agency: Department of Commerce
Status: Open
Priority recommendation

Comments: Commerce neither agreed nor disagreed with this recommendation. Regarding GAO's 2013 assessment of the Bureau's schedule (GAO-14-59), Bureau officials stated that they hoped to begin identifying the resources needed for each activity in their schedules by early 2014. Bureau officials announced they had completed the 2020 Census schedule in July 2016, and have since periodically described their intent to link resources to activities within their schedules. However, as of May 2018, when the Bureau had not taken these steps. Senior Bureau officials stated that it would require additional staffing in order to plan for and implement this recommendation. In July 2018 (GAO-18-589) we reported again on the status of the Bureau's scheduling, stating that when the Bureau has resource loaded its schedule, it will be able to use the schedule more effectively as a management tool. The Bureau took steps toward assigning resources to its master activity schedule for the 2020 Census, but effectively ran out of time to do so. Assigning resources to large complex schedules is easier to do early in schedule development process, as we recommended the Bureau do in 2009 for its 2020 Census schedule. This recommendation will remain open pending the Bureau taking steps in developing its 2030 schedule with appropriate resources linked to it.