Skip to main content

B-212274.2, AUG. 15, 1984, 84-2 CPD 182

B-212274.2 Aug 15, 1984
Jump To:
Skip to Highlights

Highlights

POINT SCORES ARE MERELY GUIDES FOR INTELLIGENT DECISION MAKING BY SELECTING OFFICIALS. UNLESS A SOLICITATION SETS FORTH A PRECISE NUMERICAL FORMULA AND PROVIDES THAT A CONTRACT WILL BE AWARDED TO THE OFFEROR WHOSE PROPOSAL RECEIVES THE HIGHEST NUMBER OF POINTS. WHETHER THE POINT SPREAD BETWEEN TWO COMPETING PROPOSALS INDICATES A SIGNIFICANT SUPERIORITY OF ONE OVER THE OTHER IS PRINCIPALLY WITHIN THE DISCRETION OF THE PROCURING AGENCY. PROTESTER'S MERE DISAGREEMENT WITH AGENCY'S ASSESSMENT OF STRENGTHS OF COMPETING PROPOSALS DOES NOT SHOW THAT AGENCY'S SELECTION IS CLEARLY UNREASONABLE OR PROVIDE A BASIS FOR GAO TO QUESTION IT. THIS TYPE OF EDUCATION PREVIOUSLY HAS BEEN PROVIDED BY ACADEMIC INSTITUTIONS THAT WERE IN EUROPE "AT THE AIR FORCE'S INVITATION.

View Decision

B-212274.2, AUG. 15, 1984, 84-2 CPD 182

CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - POINT RATING - PROPRIETY OF EVALUATION DIGEST: 1. IN NEGOTIATED PROCUREMENT, POINT SCORES ARE MERELY GUIDES FOR INTELLIGENT DECISION MAKING BY SELECTING OFFICIALS, AND UNLESS A SOLICITATION SETS FORTH A PRECISE NUMERICAL FORMULA AND PROVIDES THAT A CONTRACT WILL BE AWARDED TO THE OFFEROR WHOSE PROPOSAL RECEIVES THE HIGHEST NUMBER OF POINTS, AWARD NEED NOT BE MADE ON THAT BASIS. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - POINT RATING - SIGNIFICANCE OF DIFFERENCES 2. WHETHER THE POINT SPREAD BETWEEN TWO COMPETING PROPOSALS INDICATES A SIGNIFICANT SUPERIORITY OF ONE OVER THE OTHER IS PRINCIPALLY WITHIN THE DISCRETION OF THE PROCURING AGENCY. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - ADMINISTRATIVE DISCRETION 3. PROTESTER'S MERE DISAGREEMENT WITH AGENCY'S ASSESSMENT OF STRENGTHS OF COMPETING PROPOSALS DOES NOT SHOW THAT AGENCY'S SELECTION IS CLEARLY UNREASONABLE OR PROVIDE A BASIS FOR GAO TO QUESTION IT.

TROY STATE UNIVERSITY:

TROY STATE UNIVERSITY PROTESTS THE AWARD OF A CONTRACT TO PROVIDE GRADUATE-LEVEL COURSES IN BUSINESS, BUSINESS ADMINISTRATION, AND MANAGEMENT TO U.S. AIR FORCE PERSONNEL STATIONED OVERSEAS. THE FIRM ALLEGES THAT THE AIR FORCE FAILED TO CONSIDER ITS LOWER PROPOSED COSTS AND SUPERIOR RECORD, ESTABLISHED OVER 10 YEARS OF PROVIDING SUCH COURSES ON A NONCOMPETITIVE BASIS, IN MAKING AN AWARD TO THE UNIVERSITY OF MARYLAND.

WE DENY THE PROTEST.

BACKGROUND:

UNDER SOLICITATION NO. F61546-83-R-0027, ISSUED BY HEADQUARTERS, U.S. AIR FORCE EUROPE (USAFE), THE AGENCY SOUGHT PROPOSALS FOR LECTURES AND LABORATORIES FOR MORE THAN 20 PROGRAMS, RANGING FROM HIGH SCHOOL COMPLETION TO GRADUATE DEGREES IN DIFFERENT SUBJECTS. THE AIR FORCE MAKES TUITION PAYMENTS FOR APPROXIMATELY 40,000 OFF-DUTY MEMBERS WHO VOLUNTEER TO ENROLL EACH YEAR. ACCORDING TO THE CONTRACTING OFFICER, THIS TYPE OF EDUCATION PREVIOUSLY HAS BEEN PROVIDED BY ACADEMIC INSTITUTIONS THAT WERE IN EUROPE "AT THE AIR FORCE'S INVITATION," UNDER CONTRACTS RENEWED PERIODICALLY ON A SOLE-SOURCE BASIS.

IN ACCORD WITH THE CURRENT, COMPETITIVE SOLICITATION, WHICH INDICATED THAT MULTIPLE AWARDS WOULD BE MADE, THE AIR FORCE ON JANUARY 5, 1984 AWARDED SEVEN CONTRACTS FOR COURSES TO BEGIN THIS FALL. THE TOTAL VALUE OF ALL USAFE EDUCATION CONTRACTS, EXPECTED TO HAVE 5-YEAR TERMS, IS ESTIMATED AT BETWEEN $35 AND $40 MILLION.

SOLICITATION PROVISIONS:

AT ISSUE HERE IS LINE ITEM NO. 15, COVERING "POST-BACCALAUREATE COURSES IN BUSINESS/BUSINESS ADMINISTRATION/MANAGEMENT." THE ONLY OFFERORS WERE TROY STATE AND THE UNIVERSITY OF MARYLAND. EACH OF THESE INSTITUTIONS, IT SHOULD BE NOTED, RECEIVED CONTRACTS TO PROVIDE OTHER COURSES COVERED BY OTHER LINE ITEMS.

THE SOLICITATION REQUIRED OFFERORS TO MEET CERTAIN THRESHOLD REQUIREMENTS CONCERNING, FOR EXAMPLE, ACCREDITATION, LIBRARY AND OTHER RESEARCH FACILITIES, AND ADMISSION STANDARDS AND GRADES, BEFORE THEIR PROPOSALS WOULD BE CONSIDERED. THE SUBSEQUENT EVALUATION WAS ON THE BASIS OF FOUR PRIMARY FACTORS, WHICH IN DESCENDING ORDER OF IMPORTANCE WERE:

--UNDERSTANDING, APPROACH, METHODS, AND ABILITY TO PROVIDE TOTAL SERVICES TO AS MANY STUDENTS AS POSSIBLE AT THE MAXIMUM NUMBER OF AIR FORCE LOCATIONS IN EUROPE;

--EXPERIENCE WITH PROGRAMS WITH SIMILAR CHARACTERISTICS; AND

--TUITION STRUCTURE, RATES, OR FEES.

IN ADDITION, THE SOLICITATION LISTED A LARGE NUMBER OF SUBFACTORS (20 UNDER THE FIRST PRIMARY FACTOR ALONE) THAT THE AIR FORCE WOULD CONSIDER BEFORE MAKING AWARD TO OFFERORS WHOSE PROPOSALS WERE FOUND TO HAVE THE GREATEST POTENTIAL, PRICE AND OTHER FACTORS CONSIDERED.

EVALUATION AND AWARD:

IN ACCORD WITH AIR FORCE REGULATIONS, EVALUATION WAS A THREE-STAGE PROCESS, FIRST BY A SOURCE SELECTION EVALUATION BOARD, THEN BY AN ADVISORY COMMITTEE, AND FINALLY BY A SOURCE SELECTION AUTHORITY.

TROY STATE'S WEIGHTED POINT SCORE FOR LINE ITEM NO. 15 WAS 32,157, COMPARED WITH 30,467.5 FOR THE UNIVERSITY OF MARYLAND; MOREOVER, ITS PROPOSED COSTS WOULD HAVE BEEN LOWER THAN MARYLAND'S $144 A SEMESTER HOUR IF IT HAD BEEN AWARDED A CONTRACT FOR THE GRADUATE BUSINESS COURSES IN ADDITION TO TWO OTHERS THAT IT DID RECEIVE. UNDER A COMBINATION OFFER, TROY STATE PROPOSED A PRICE OF $130 A SEMESTER HOUR EACH FOR INTERNATIONAL RELATIONS, PUBLIC RELATIONS, AND THE GRADUATE BUSINESS COURSES.

THE SOURCE SELECTION ADVISORY COMMITTEE, HOWEVER, FOUND "NO SIGNIFICANT DIFFERENCE" INDICATED BY THE WEIGHTED SCORES OF THE TWO PROPOSALS. RECOMMENDED AWARD TO THE UNIVERSITY OF MARYLAND BECAUSE IT REQUIRED, AS A PREREQUISITE TO THE GRADUATE BUSINESS COURSES, ONE UNDERGRADUATE COURSE IN ECONOMICS AND ANOTHER IN EITHER PSYCHOLOGY OR SOCIOLOGY. IN ADDITION, THE COMMITTEE CONSIDERED THE UNIVERSITY OF MARYLAND'S COURSE OFFERINGS AND DEGREE OPTIONS BROADER THAN TROY STATE'S. IT ALSO NOTED THAT MARYLAND'S PROPOSAL WAS RANKED FIRST FOR UNDERGRADUATE BUSINESS COURSES IN WHICH SOME OF THE FACULTY FOR THE PARALLEL GRADUATE PROGRAM ALSO WOULD TEACH.

TROY STATE'S PROTEST:

TROY STATE DISAGREES WITH THE DETERMINATION THAT THE WEIGHTED SCORES DID NOT REFLECT A SIGNIFICANT DIFFERENCE BETWEEN PROPOSALS. IT ARGUES THAT THE POINT SPREAD IS STATISTICALLY SIGNIFICANT AND THAT THE AIR FORCE THEREFORE IMPROPERLY CONSIDERED THE STRENGTHS OUTLINED ABOVE IN SELECTING THE UNIVERSITY OF MARYLAND. TROY STATE ARGUES THAT THE DIFFERENCE BETWEEN ITS PROPOSED PRICE AND THE UNIVERSITY OF MARYLAND'S ALSO MANDATED AN AWARD TO IT.

IN ADDITION, TROY STATE DISAGREES WITH THE AIR FORCE'S ASSESSMENT OF THE UNIVERSITY OF MARYLAND'S UNDERGRADUATE PREREQUISITES, ARGUING THAT THEY CANNOT AFFECT THE QUALITY OF GRADUATE LEVEL COURSES AND MAY BE SATISFIED BY COURSES THAT ARE TOTALLY UNRELATED TO BUSINESS. TROY STATE FURTHER ASSERTS THAT THE DIFFERENCE BETWEEN THE COURSE OFFERINGS OF THE TWO UNIVERSITIES IS MINIMAL.

TROY STATE ALSO CONTENDS THAT THE UNIVERSITY OF MARYLAND'S RANKING FOR THE UNDERGRADUATE BUSINESS COURSES SHOULD NOT HAVE BEEN CONSIDERED BECAUSE "PLACEMENT IN OTHER COMPETITIONS" WAS NOT IDENTIFIED AS AN EVALUATION FACTOR. FINALLY, TROY STATE ALLEGES THAT THE UNIVERSITY OF MARYLAND'S CAPABILITY IS "UNPROVEN," BECAUSE IT DOES NOT CURRENTLY OFFER A MASTER OF SCIENCE IN MANAGEMENT AT ANY AIR FORCE INSTALLATION, AND IT HAS OFFERED GRADUATE LEVEL PROGRAMS IN EUROPE ONLY SINCE 1983.

GAO ANALYSIS:

NOTWITHSTANDING TROY STATE'S ASSERTION THAT ITS HIGHER WEIGHTED SCORE ENTITLES IT TO AWARD, WE FIND THAT THE AIR FORCE'S SELECTION OF THE UNIVERSITY OF MARYLAND WAS REASONABLE AND IN ACCORD WITH LISTED EVALUATION CRITERIA. AS WE HAVE STATED IN MANY DECISIONS, POINT SCORES ARE MERELY GUIDES FOR INTELLIGENT DECISIONMAKING BY SELECTING OFFICIALS. UNLESS A SOLICITATION SETS FORTH A PRECISE NUMERICAL FORMULA AND PROVIDES THAT A CONTRACT WILL BE AWARDED TO THE OFFEROR WHOSE PROPOSAL RECEIVES THE HIGHEST NUMBER OF POINTS, AWARD NEED NOT BE MADE ON THAT BASIS. BDM CORP., B-211129, AUG. 23, 1983, 83-2 CPD PARA. 234, AND CASES CITED THEREIN.

HERE, THERE WAS NO SUCH FORMULA AND NO STATEMENT THAT THE HIGHEST SCORED OFFEROR FOR EACH ITEM WOULD BE AWARDED A CONTRACT. OFFERORS MERELY WERE ADVISED OF THE FOUR MAJOR EVALUATION FACTORS AND OF THE RELATED SUBFACTORS ON WHICH THEY WOULD BE EVALUATED. AS FOR LOWER COSTS, IT IS CLEAR FROM THE SOLICITATION THAT PROPOSED TUITION FEES WERE THE LEAST IMPORTANT FACTOR, AND SUCH FEES ARE REFLECTED IN THE FINAL, WEIGHTED SCORES.

THE RECORD INDICATES THAT FOR LINE ITEM NO. 8, COVERING GRADUATE COURSES IN INTERNATIONAL RELATIONS, TWO PROPOSALS ALSO WERE CONSIDERED WITHOUT A SIGNIFICANT DIFFERENCE. FOR THIS ITEM, BOSTON UNIVERSITY RECEIVED A WEIGHTED SCORE OF 35,281, WHILE TROY STATE RECEIVED A WEIGHTED SCORE OF 33,307; HOWEVER, TROY STATE WAS AWARDED THE CONTRACT. AS THE AIR FORCE IMPLIES, IF TROY STATE'S ARGUMENT IS LEGALLY CORRECT, THIS AWARD SHOULD HAVE GONE TO BOSTON UNIVERSITY-- A POSSIBILITY THE PROTESTER DOES NOT ADDRESS.

IN BOTH CASES, WHETHER THE POINT SPREAD BETWEEN TWO COMPETING PROPOSALS INDICATED A SIGNIFICANT SUPERIORITY OF ONE OVER THE OTHER WAS PRINCIPALLY WITHIN THE DISCRETION OF THE AIR FORCE. SEE MITEK SYSTEMS, INC. - REQUEST FOR RECONSIDERATION, B-208786.3, MAY 10, 1983, 83-1 CPD PARA. 494. THE AGENCY'S CONSIDERATION OF SPECIAL STRENGTHS (AND WEAKNESSES) WAS, IN EFFECT, CONSIDERATION OF THE SIGNIFICANCE OF THE POINT SCORES. FOR EXAMPLE, THE SOURCE SELECTION ADVISORY COMMITTEE FOUND THAT PREREQUISITES IN PSYCHOLOGY AND SOCIOLOGY WERE HIGHLY DESIRABLE IN VIEW OF THE BEHAVIORAL STRESSES OF GRADUATE STUDY IN MANAGEMENT. WHILE TROY STATE DISAGREES WITH THIS ASSESSMENT, IT HAS NOT SHOWN THAT IT WAS CLEARLY UNREASONABLE OR PROVIDED A BASIS FOR OUR OFFICE TO QUESTION THE EVALUATION. SEE LOUIS BERGER & ASSOCIATES, INC., B-208502, MARCH 1, 1983, 83-1 CPD PARA. 195.

THE AIR FORCE STATES THAT IT CONSIDERED THE UNIVERSITY OF MARYLAND'S FIRST RANKING IN THE UNDERGRADUATE BUSINESS COURSES TO BE A STRENGTH BECAUSE IT REGARDS THE PROGRAMS AS PARALLEL AND BECAUSE SOME FACULTY WILL TEACH IN BOTH. ALTHOUGH "PLACEMENT IN OTHER COMPETITIONS" WAS INDEED NOT AN EVALUATION FACTOR, THE COMPETITION FOR THE UNDERGRADUATE BUSINESS COURSES WAS CLOSELY RELATED TO THAT FOR THE GRADUATE BUSINESS COURSES, AND THE AIR FORCE'S CONSIDERATION OF THE UNIVERSITY OF MARYLAND'S RANKING FOR BOTH WAS, IN OUR OPINION, REASONABLE.

AS FOR THE UNIVERSITY OF MARYLAND'S EXPERIENCE, THE SOLICITATION LISTED EXPERIENCE IN DELIVERING PROGRAMS ON MILITARY INSTALLATIONS, OVERSEAS, AND OFF-CAMPUS AS SUBFACTORS. IT DID NOT, HOWEVER, REQUIRE EXPERIENCE IN GRADUATE-LEVEL COURSES AT AIR FORCE INSTALLATIONS, EITHER IN THIS COUNTRY OR OVERSEAS. ANY ATTEMPT TO RESTRICT THE USAFE PROGRAM IN THIS MANNER WOULD, IN OUR OPINION, PERPETUATE THE SOLE SOURCE CONTRACTS THAT THE AIR FORCE, THROUGH THIS COMPETITIVE PROCUREMENT, WAS ATTEMPTING TO AVOID.

THE PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs