The National Center for Science and Engineering Statistics (NCSES) collects and analyzes data to help people understand U.S. performance in science and engineering in a global context. NCSES covers topics such as research facility funding and job opportunities for science and engineering graduates.
Governments, companies, nonprofits, and others use this data to make decisions. But NCSES generally didn't involve these users in developing its strategic priorities, and its communication plan is outdated—making it harder to ensure that its data and analysis are really meeting its users' needs.
We recommended updating plans to improve communication.
What GAO Found
To address its responsibilities as a federal statistical agency, the National Center for Science and Engineering Statistics (NCSES) evaluates its data quality and coordinates with agencies about current data needs. NCSES evaluates data accuracy, relevance, and timeliness, and it reports the results of these evaluations. To supplement its internal evaluation efforts, NCSES contracts with the research and evaluation community. These external evaluations can identify priority focus areas to ensure data remain relevant and can result in recommendations to improve processes. NCSES also coordinates with federal agencies, primarily through interagency groups, to communicate and plan new data collections and standardize data collection measures. Through its evaluation and coordination activities, NCSES interacts with a range of stakeholders to address science and engineering statistical needs (see figure).
Examples of National Center for Science and Engineering Statistics (NCSES) Stakeholders
To identify emerging data needs, NCSES conducts research activities, but it has not communicated with stakeholders about agency priorities. In 2019, NCSES developed a strategic communication plan to guide engagement with stakeholders, but it has not updated this plan to account for new priorities. NCSES has also developed priority-setting documents, including a learning agenda, which identifies priority questions for evidence building. But NCSES has not engaged with external stakeholders about these priorities, potentially missing opportunities to better address needs, such as enabling academics to align their research to relevant policy questions. Communications strategies designed to ensure consistent, broad outreach could expand users' awareness of NCSES planned data collection, which could, in turn, more effectively enlist opportunities for stakeholders to provide input to ensure the relevance of these data.
Why GAO Did This Study
Governments at all levels, businesses, and the public rely on federal statistics to inform evidence-based decisions and enable the development of sound policies. Housed within the National Science Foundation, NCSES is the nation's source for science and engineering information and statistics. NCSES produces data and analysis on how the United States compares to other countries on key topics such as producing science and engineering graduates and spending on research and development in the context of rising global economic competition.
The Research and Development, Competition, and Innovation Act includes a provision for GAO to examine to what extent NSF has processes to ensure NCSES data and analyses meet current and future needs. This report (1) describes how NCSES ensures its data and analyses meet data quality standards including relevance, and (2) evaluates the extent to which NCSES has processes to identify emerging needs.
GAO reviewed NCSES planning documents, and interviewed NCSES officials and stakeholders of its statistical products. GAO compared NCSES processes to relevant standards and guidelines published by Office of Management and Budget and National Academies of Sciences, Engineering, and Medicine.
GAO is recommending that NCSES update its current communication plan to identify methods and tools for communicating with stakeholders on data collection and priorities. NCSES concurred with the recommendation.
Recommendations for Executive Action
|National Center for Science and Engineering Statistics||The Director of NCSES should update the agency's communication plan to identify appropriate methods and tools for communicating with stakeholders regarding data collection efforts, agency strategic priorities, and learning agendas. (Recommendation 1)||