State Small Business Credit Initiative: Opportunities Exist to Enhance Performance Measurement and Evaluation
What GAO Found
As of June 30, 2013, State Small Business Credit Initiative (SSBCI) participants--states, territories, and municipalities--had used $549 million of the $1.5 billion the Department of the Treasury (Treasury) allocated to them, nearly four times the amount used as of June 30, 2012. However, the rates at which participants have used funds continue to vary, as shown below. While initial challenges generally have been addressed, others remain. Participants' challenges with using funds at the start of the program resulted from some program policies not being finalized and low demand for some program types, among other things. Treasury and participants have since addressed many of these issues, but according to agency officials and others, participants will likely continue to face some challenges in using SSBCI funds. For example, some large lenders have been reluctant to partner with SSBCI participants because the variation in participants' programs makes it difficult for lenders to implement the program on a national basis, which has limited the program's reach into the small business lending market.
Treasury uses performance measures to manage SSBCI. For example, Treasury uses performance measures to adjust staff allocations and to identify participants that may need additional assistance. Although Treasury has set targets for program administration measures (for example, how long it takes the agency to approve participants' requests to modify their programs), it has not set targets for performance (for example, the amount of funds used over time). Federal internal control standards and performance management leading practices encourage agencies to set targets, where appropriate. Targets could help Treasury identify program areas needing improvement. Treasury has also recently started to determine how it will evaluate SSBCI's effectiveness and plans to form a working group of participants to help design the format of the evaluation. GAO guidance on designing evaluations encourages agencies to obtain input from external stakeholders, including Congress, that are expected to be interested in the results. By seeking input from external stakeholders early in the design phase, Treasury can help ensure that it designs an evaluation that is useful for decision makers and other agencies working to promote small business credit access.
Why GAO Did This Study
The Small Business Jobs Act of 2010 created SSBCI within Treasury. The program provides direct funding to participants for programs that expand access to capital for small businesses. The act mandates that GAO conduct an annual audit of the program. GAO's first two reports examined Treasury's implementation of SSBCI and its processes for monitoring compliance and procedures for evaluating and communicating program outcomes. This third report examines, among other things, the extent to which (1) participants have used their SSBCI allocations and faced challenges in using the funds, and (2) Treasury has used performance measures and program evaluation to manage SSBCI. GAO reviewed Treasury's SSBCI policies and procedures and participants' data on fund usage and interviewed officials from Treasury, eight states, and one municipality. GAO selected the states and municipality based on usage of SSBCI funds, the number of programs they implemented, and geographic dispersion, among other things.
GAO recommends that Treasury set targets for selected measures to track SSBCI's performance and seek input from Congress and other federal agencies on what information will be useful in assessing SSBCI's effectiveness as Treasury designs its program evaluation. Treasury agreed with both of these recommendations.
Recommendations for Executive Action
|Department of the Treasury||To enhance the use of performance measures to manage SSBCI and assess progress, the Secretary of the Treasury should establish targets for selected performance measures related to monitoring program performance.||
Consistent with our recommendation, Treasury established targets for several of its performance measures. Specifically, it developed performance targets for 4 measures: (1) the amount of private-sector leverage used, (2) the amount of funds available to states, (3) the extent to which states' programs target small businesses with an average size of 500 or fewer employees, and (4) the extent to which states' programs target support towards loans with an average principal amount of $5 million or less. Officials explained that they used the stated program objectives in the Small Business Jobs Act of 2010 to select the measures for which they established targets. Treasury officials stated that they intend to use the measures for which they did not establish targets as additional indicators of performance, which include volume and dollar amount of loans or investments supported by SSBCI funds and estimated number of jobs created or retained.
|Department of the Treasury||To better ensure that Treasury's SSBCI program evaluation provides information useful for future decision making and effective management and oversight, the Secretary of the Treasury should seek input from program stakeholders--including other agencies involved in promoting small businesses and Congress--as it designs its SSBCI program evaluation.||
In response to our recommendation, Treasury received input from internal agency subject-matter experts and experts from OMB and have reached out to congressional staff for feedback. Specifically, Treasury conducted meetings with experts in December 2013 and January 2014 on how it will evaluate the performance of SSBCI, which will be completed in 2017. Treasury officials also reached out to staff of two congressional committees in October 2014 for feedback on the proposed evaluation design.