Problems and Needed Improvements in Evaluating Office of Education Programs
HRD-76-165: Published: Sep 8, 1977. Publicly Released: Sep 8, 1977.
- Full Report:
A review was conducted to determine the effectiveness of federally supported education evaluations, primarily those concerning elementary and secondary education programs, in order to obtain objective data for allocating resources and in deciding whether or not programs should be continued or modified. Questionnaires were sent to education agencies in all States and the District of Columbia and to a statistical sample of local school districts to obtain State and local agencies' views on Federal education program evaluations. Federal, State, and local education agencies frequently use standardized norm-referenced achievement tests to measure the effect of Federal education programs.
The Office of Education's evaluation studies can better serve Congress by having them timed to coincide with the legislative cycle and by more frequent briefings of congressional committee staffs. The Office Education needs to make a better effort to set forth specific qualitative and quantitative program objectives in order to provide a clear basis for program evaluation. The usefulness of the State and local evaluation reports needs improvements in the areas of: relevance of reports to policy issues, data completeness and comparability, and report timeliness. If the reporting systems based on aggregated local agency data are to be effective, standardization of data collection efforts is needed. Educators and test experts disagree on the use of standardized norm-referenced tests versus criterion-referenced tests. More research may be needed on criterion-referenced tests and on how to reduce racial, sexual, and cultural biases in standardized tests.