Data Science: NIH Needs to Implement Key Workforce Planning Activities
Fast Facts
The National Institutes of Health—a leader in the support of biomedical research—faces a shortage of employees with data science expertise. NIH needs this expertise to handle the growing amount of increasingly complex data from advances in research.
NIH plans to enhance its data science workforce, but it hasn't examined the skills of existing staff to determine what it needs to reach its goals. Until NIH addresses this skills gap, it risks not having staff in place to administer tens of billions of dollars in annual research grants.
Our 11 recommendations address this and other issues.
Highlights
What GAO Found
While the National Institutes of Health (NIH) included a data science workforce goal in its June 2018 Strategic Plan for Data Science, the agency has not fully implemented the key workforce planning activities established by federal guidance (see table). For example, NIH developed and implemented plans to enhance its data science workforce; however, these plans were not linked to gaps in its data science workforce. Near the conclusion of GAO's review, officials said that an agency-wide Data Science Workforce Working Group had been established to address priority hiring and retention needs. However, they did not provide documentation supporting the group's activities. Fully addressing the workforce planning activities would help ensure that NIH has the data science workforce it needs to effectively meet its mission.
National Institutes of Health's Implementation of Key Activities for Data Science Workforce Planning
|
Key workforce planning practices and supporting activities |
Rating |
|---|---|
|
Set the strategic direction for workforce planning |
|
|
Establish and maintain a workforce planning process |
Partially implemented |
|
Develop competency and staffing requirements |
Partially implemented |
|
Analyze the workforce to identify skill gaps |
|
|
Reassess competency and staffing needs regularly |
Not implemented |
|
Determine gaps in competencies and staffing regularly |
Not implemented |
|
Develop and implement strategies to address skill gaps |
|
|
Develop strategies and plans to address gaps in competencies and staffing |
Partially implemented |
|
Implement activities that address gaps |
Partially implemented |
|
Monitor and report progress in addressing skill gaps |
|
|
Monitor the agency's progress in addressing competency and staffing gaps |
Not implemented |
|
Report to agency leadership on progress in addressing competency and staffing gaps |
Not implemented |
Legend: Fully implemented: NIH provided evidence that addressed the activity; partially implemented: NIH provided evidence that it had addressed some, but not all of the activity; not implemented: NIH did not provide evidence that it had addressed any of the activity.
Source: GAO analysis of NIH documentation. | GAO-23-105594
NIH's data management and sharing policy, effective January 2023, is consistent with relevant Office of Science and Technology Policy data sharing requirements. However, NIH had not finalized the guidance its staff needs to evaluate the data management and sharing plans and determine researchers' compliance with them. In addition, officials stated several times during the course of GAO's review that they had revised their time frames for doing so. The officials said they were delayed in completing the guidance because they were focused on informing the public about the new policy. They also anticipated releasing the guidance by June 2023 in time to assess the first round of plans. However, NIH did not document this new time frame. Documenting the new time frame and monitoring progress against it would ensure NIH's accountability for finalizing the guidance on time. In addition, until the agency finalizes and implements the guidance, its staff are less likely to consistently assess data sharing plans. This, in turn, would limit NIH's goal of maximizing appropriate sharing of scientific data generated from federally funded research.
Why GAO Did This Study
NIH, the federal government's leader in supporting biomedical research, faces a shortage of employees with data science expertise needed to, among other things, analyze and extract insights from increasingly large and complex sets of data. In June 2018, NIH developed a Strategic Plan for Data Science, which included an objective to enhance its data science workforce that addresses this need.
The explanatory statement accompanying the Further Consolidated Appropriations Act, 2020, contained a provision for GAO to review NIH's data science workforce planning. This report, among other things, determines the extent to which 1) NIH has conducted data science workforce strategic planning in accordance with key practices and 2) NIH's data management and sharing policy and guidance are consistent with federal guidance.
To do so, GAO assessed agency documentation against key workforce planning practices identified in prior GAO work. It also compared NIH's data management and sharing policy and plans to relevant federal requirements, and interviewed NIH officials.
Recommendations
GAO is making 11 recommendations to NIH to fully implement key workforce planning activities and finalize data management and sharing guidance. NIH concurred with nine of the recommendations and stated it had implemented the other two. However, the agency did not provide sufficient evidence of the implementation. As a result, GAO continues to believe the recommendations are appropriate.
Recommendations for Executive Action
| Agency Affected | Recommendation | Status |
|---|---|---|
| National Institutes of Health | The NIH Director should ensure that NIH establishes a comprehensive data science workforce planning process that addresses the shortfalls noted in this report. (Recommendation 1) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH develops staffing requirements for the data science workforce. (Recommendation 2) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH reassesses its data science competency and staffing needs periodically. (Recommendation 3) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH analyzes its workforce to identify gaps in data science competencies and staffing. (Recommendation 4) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH develops specific strategies and plans to address identified gaps in data science competencies and staffing. (Recommendation 5) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH implements strategies and plans to address identified gaps in data science competencies and staffing. (Recommendation 6) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH develops and tracks metrics to monitor the agency's progress in addressing data science competency and staffing gaps. (Recommendation 7) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH develops a process to track data science staff. (Recommendation 8) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH requires reporting to agency leadership on progress made in addressing data science competency and staffing gaps. (Recommendation 9) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH documents new time frames to complete the guidance its staff will need to assess data management and sharing plans, and ensure that the guidance is implemented. (Recommendation 10) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|
| National Institutes of Health | The NIH Director should ensure that NIH documents new time frames to complete the guidance its staff will need to determine researchers' compliance with their data management and sharing plans, and ensure that the guidance is implemented. (Recommendation 11) |
Open
When we confirm what actions NIH has taken in response to this recommendation, we will provide updated information.
|