Skip to main content

B-188997, NOV 23, 1977

B-188997 Nov 23, 1977
Jump To:
Skip to Highlights

Highlights

ALLEGATION THAT AGENCY EVALUATORS FAILED TO CONSIDER BLANKET OFFER OF COMPLIANCE WITH SPECIFICATIONS IN EVALUATION OF PROTESTER'S PROPOSAL IS NOT PERSUASIVE EVIDENCE OF BIAS WHERE REQUEST FOR PROPOSALS STATES THAT SUCH BLANKET OFFERS WOULD BE CONSIDERED INADEQUATE. 2. TECHNICAL CLARIFICATION QUESTIONS TO OFFERORS IN COMPETITIVE RANGE DO NOT PROVIDE EVIDENCE OF BIAS IN EVALUATION WHERE MOST QUESTIONS ARE SUBSTANTIALLY SIMILAR AND THOSE QUESTIONS WHICH ARE DIFFERENT RELATE TO DEFICIENCIES NOTED IN INDIVIDUAL PROPOSALS. 3. PROTEST OF RELATIVE WEIGHT GIVEN TO EVALUATION FACTORS MADE AFTER RECEIPT OF INITIAL PROPOSALS AND AWARD IS TIMELY WHERE PROTESTER WAS NOT ADVISED OF RELATIVE WEIGHT UNTIL RECEIPT OF DOCUMENTS FROM AGENCY AND PROTEST WAS MADE WITHIN 10 WORKING DAYS THEREAFTER. 4.

View Decision

B-188997, NOV 23, 1977

1. ALLEGATION THAT AGENCY EVALUATORS FAILED TO CONSIDER BLANKET OFFER OF COMPLIANCE WITH SPECIFICATIONS IN EVALUATION OF PROTESTER'S PROPOSAL IS NOT PERSUASIVE EVIDENCE OF BIAS WHERE REQUEST FOR PROPOSALS STATES THAT SUCH BLANKET OFFERS WOULD BE CONSIDERED INADEQUATE. 2. TECHNICAL CLARIFICATION QUESTIONS TO OFFERORS IN COMPETITIVE RANGE DO NOT PROVIDE EVIDENCE OF BIAS IN EVALUATION WHERE MOST QUESTIONS ARE SUBSTANTIALLY SIMILAR AND THOSE QUESTIONS WHICH ARE DIFFERENT RELATE TO DEFICIENCIES NOTED IN INDIVIDUAL PROPOSALS. 3. PROTEST OF RELATIVE WEIGHT GIVEN TO EVALUATION FACTORS MADE AFTER RECEIPT OF INITIAL PROPOSALS AND AWARD IS TIMELY WHERE PROTESTER WAS NOT ADVISED OF RELATIVE WEIGHT UNTIL RECEIPT OF DOCUMENTS FROM AGENCY AND PROTEST WAS MADE WITHIN 10 WORKING DAYS THEREAFTER. 4. EVALUATION OF OFFEROR'S UNDERSTANDING OF A PROCUREMENT BASED ON PROPOSAL'S RESPONSE, OR LACK THEREOF, TO EACH OF THE REQUIREMENTS SET FORTH IN THE SPECIFICATION AND THE NATURE OF THAT RESPONSE, E.G., WHETHER A SPECIFIC TECHNICAL APPROACH WAS PROPOSED OR MERELY AN OFFER OF COMPLIANCE WITHOUT DETAIL, IS NOT SO INHERENTLY SUBJECTIVE AS TO BE ARBITRARY. 5. CONTRACTING AGENCY HAS THE RESPONSIBILITY OF DETERMINING THE RELATIVE MERIT OF PROPOSALS. GAO WILL NOT QUESTION SUCH A DETERMINATION ABSENT A CLEAR SHOWING ON THE RECORD THAT IT IS UNREASONABLE, E.G., HAS NO RATIONAL BASIS. MERE ALLEGATION OF PREJUDICE IS NOT SUFFICIENT SHOWING. WHERE PROTESTER IS UNABLE TO MEET ITS BURDEN OF AFFIRMATIVELY SHOWING BIAS AND UNREASONABLE EVALUATION, PROTEST IS DENIED.

LOGIC SYSTEMS:

LOGIC SYSTEMS (LOGIC) PROTESTS THE AWARD OF A CONTRACT TO ZETA RESEARCH, INC. (ZETA), UNDER REQUEST FOR PROPOSALS (RFP) NO. N00421-76 R-0275 ISSUED BY THE NAVAL AIR STATION (NAS), PATUXENT RIVER, MARYLAND. LOGIC'S PROTEST IS PREMISED ON CONTENTIONS THAT THE EVALUATION OF PROPOSALS WAS PREJUDICED AND THAT LOGIC WAS DENIED AN EQUAL OPPORTUNITY FOR ITS TECHNICAL PRESENTATION.

THE RFP IN QUESTION SOUGHT TECHNICAL AND PRICE PROPOSALS FOR THE FURNISHING OF A QUANTITY OF LARGE AND SMALL X-Y PLOTTERS AND ADVISED THAT TECHNICAL FACTORS WOULD BE WEIGHTED THREE TIMES AND IMPORTANT AS PRICE. PROPOSALS WERE SUBMITTED BY FOUR COMPANIES, ONE OF WHICH WAS ELIMINATED FROM THE COMPETITIVE RANGE AFTER THE INITIAL TECHNICAL REVIEW. TECHNICAL DISCUSSIONS WERE HELD WITH THE THREE REMAINING OFFERORS ON NOVEMBER 16-18, 1976, AND EACH OF THE OFFERORS WAS GIVEN AN OPPORTUNITY TO CLARIFY ITS PROPOSAL IN WRITING. THE INITIAL TECHNICAL REVIEW WAS COMPLETED ON DECEMBER 20, 1976, WITH ZETA AND LOGIC RECEIVING SCORES OF 98.3 PERCENT AND 78.1 PERCENT, RESPECTIVELY. THE RFP WAS AMENDED ON JANUARY 28, 1977, TO CORRECT CERTAIN SPECIFICATION ERRORS IN THE INITIAL SOLICITATION AND TO INCREASE THE QUANTITY OF PLOTTERS TO 5 LARGE AND 18 SMALL DEVICES. OFFERORS WERE GIVEN UNTIL FEBRUARY 17, 1977, TO SUBMIT REVISED OFFERS. LOGIC ALSO WAS REQUESTED TO CLARIFY SOME MINOR POINTS WHICH, IN THE AGENCY'S WORDS, "APPARENTLY HAD BEEN OVERLOOKED DURING THE MEETING OF NOVEMBER 17, 1976." THE FINAL SCORES AND PRICES FOR ZETA AND LOGIC WERE AS FOLLOWS:

PRICE SCORE

ZETA$247,299.84 98.3%

LOGIC 172,934.00 79.7%

THE AGENCY EMPLOYED THE FOLLOWING "BEST BUY" COMPUTATION IN MAKING ITS SOURCE SELECTION:

TECHNICAL SCORE X.75 GOVERNMENT COSTS ESTIMATE X.25 BEST BUY

CONTRACTOR PRICE

THE GOVERNMENT COST ESTIMATE WAS $151,000. THE "BEST BUY" SCORES FOR ZETA AND LOGIC WERE .89 AND .81, RESPECTIVELY. THE CONTRACT WAS AWARDED TO ZETA ON MARCH 29, 1977.

THERE ARE THREE FUNDAMENTAL PREMISES UNDERLYING LOGIC'S CONTENTIONS OF BIAS IN THE TECHNICAL EVALUATION. FIRST, LOGIC CONTENDS THAT THE EVALUATORS IGNORED STATEMENTS IN ITS INITIAL PROPOSAL (1) EXPRESSING UNCONDITIONAL ACCEPTANCE AND CONFORMANCE TO ALL POINTS OF THE SPECIFICATIONS NOT SPECIFICALLY DISCUSSED IN LOGIC'S PROPOSAL AND (2) INDICATING THAT A MODIFIED STANDARD COMMERCIAL PLOTTER WAS TO BE FURNISHED. THE STATEMENTS TO WHICH LOGIC REFERS WERE AS FOLLOWS:

"THE FOLLOWING INFORMATION DISCUSSES ONLY THOSE PARAGRAPHS THAT THE LOGIC SYSTEMS PLOTTER DOES NOT MEET OR EXCEED SPECIFICATIONS OR THAT ADDITIONAL INFORMATION IS NECESSARY."

- AND -

"THIS BID IS BASED ON AN EXISTING PLOTTER DESIGN. ONLY MINOR CHANGES ARE REQUIRED TO MEET THIS SPECIFICATION."

LOGIC ASSERTS THAT THE PROCURING ACTIVITY FAILED TO CONSIDER THE FIRST OF THESE PHRASES AS EVIDENCE OF COMPLIANCE WITH THE SPECIFICATION AND POINTS TO A REMARK THAT LOGIC "PROPOSED A STANDARD COMMERCIAL UNIT WITH NO MODIFICATION" IN A TECHNICAL ACTIVITY MEMORANDUM DATED DECEMBER 20, 1976, AS EVIDENCE THAT ITS PROPOSAL WAS NOT CAREFULLY READ BY THE EVALUATOR, CONTENDING THAT THIS CONCLUSION IS CONTRARY TO THE INTENT EXPRESSED IN THE SECOND SET OF PHRASES ABOVE.

PROPOSALS WERE REQUIRED TO BE PREPARED IN ACCORDANCE WITH THE GENERAL GUIDELINES FOR CONTENT AND FORMAT SET OUT ON PAGE 10 OF THE RFP. THESE GUIDELINES STRESS THAT THE PURPOSE OF THE PROPOSAL IS TO PROVIDE THE BASIS FOR SOUND TECHNICAL JUDGMENTS AND STATE SPECIFICALLY THAT "STATEMENTS THAT THE OFFEROR UNDERSTANDS, CAN OR WILL COMPLY WITH THE SPECIFICATIONS AND STATEMENTS PARAPHRASING THE SPECIFICATION OR PARTS THEREOF ARE CONSIDERED INADEQUATE." WE NOTE ALSO THAT LOGIC'S INITIAL PROPOSAL DOES NOT DESCRIBE OR OTHERWISE PROVIDE ANY EVIDENCE OF THE MODIFICATIONS APPARENTLY CONTEMPLATED BY LOGIC TO MEET THE SPECIFICATIONS. IN THESE CIRCUMSTANCES, WE DO NOT CONSIDER THE EVALUATION OF LOGIC'S PROPOSAL TO BE UNREASONABLE.

SECONDLY, LOGIC CONTENDS THAT THE WRITTEN TECHNICAL CLARIFICATION QUESTIONS PROVIDED TO IT IN DISCUSSIONS AT THE NOVEMBER 17 MEETING WERE SUPERFICIAL WHEN COMPARED TO THE TECHNICAL QUESTIONS ASKED OF ZETA. LOGIC ARGUES THAT THIS IS EVIDENCE THAT THE PARTY OR PARTIES FORMULATING THESE QUESTIONS WERE ALREADY BIASED IN FAVOR OF ZETA'S OFFERED PRODUCT. WE DO NOT AGREE.

WE NOTE PARTICULARLY THAT THE MAJORITY OF THE QUESTIONS ASKED OF BOTH ZETA AND LOGIC REFER TO THREE COMMON AREAS OF CONCERN: OPERATING LIFE AND DESIGN DERATING CRITERIA; OPERATING NOISE LEVEL AND SOUND SUPPRESSION; AND AVAILABILITY AND TYPES OF PENS AND PAPER. THE BALANCE OF THE QUESTIONS REFERS TO DEFICIENCIES OR EXCEPTIONS NOTED IN EACH OFFEROR'S PARTICULAR PROPOSAL. WHILE WE RECOGNIZE THAT THE PARTICULAR PHRASING OF THE QUESTIONS DIFFERS, WE DO NOT CONSIDER THE COMMON QUESTIONS SO SUBSTANTIVELY DIFFERENT AS TO EVIDENCE PREJUDICE AND WE WOULD EXPECT THAT CLARIFICATION QUESTIONS CONCERNING DEFICIENCIES UNIQUE TO ONE PROPOSAL WOULD DIFFER FROM THOSE OF ANOTHER PROPOSAL. WE DO NOT CONSIDER THE RECORD HERE TO AFFORD PERSUASIVE EVIDENCE OF BIAS.

LASTLY, LOGIC STATES THE TECHNICAL EVALUATION WAS BASED PRIMARILY ON FACTORS RELATING TO THE QUALITY OF THE PROPOSAL RATHER THAN THE OFFERED EQUIPMENT. IN SUPPORT OF THIS ARGUMENT, LOGIC POINTS OUT THAT TWO PROPOSAL-RELATED FACTORS, COMPLETENESS AND THOROUGHNESS OF THE PROPOSAL AND THE OFFEROR'S GRASP OF THE PROBLEM ACCOUNTED FOR 6 OUT OF 11 FINAL EVALUATION POINTS. LOGIC ASSERTS THAT THESE FACTORS ARE INHERENTLY SUBJECTIVE AND ARBITRARY AND OBJECTS TO THEIR RELATIVE WEIGHT.

THE AGENCY CONTENDS THAT THIS PART OF LOGIC'S PROTEST IS UNTIMELY UNDER OUR BID PROTEST PROCEDURES, 4 C.F.R. SEC. 20 (1976), WHICH REQUIRE THAT PROTESTS OF IMPROPRIETIES APPARENT ON THE FACE OF A SOLICITATION BE RAISED PRIOR TO THE DATE FOR OPENING OF BIDS OR RECEIPT OF INITIAL PROPOSALS. C.F.R. SEC. 20.2(B)(1). AS WE NOTED ABOVE, HOWEVER, LOGIC IS NOT PROTESTING THE EVALUATION CRITERIA BUT THEIR RELATIVE WEIGHT. WE NOTE ALSO THAT THE RELATIVE IMPORTANCE OF THESE CRITERIA IS NOT APPARENT ON THE FACE OF THE SOLICITATION, AND THAT LOGIC DID NOT HAVE NOTICE OF THE ACTUAL WEIGHT ACCORDED EACH CRITERION UNTIL ITS RECEIPT ON MAY 23, 1977, OF MATERIALS FURNISHED BY NAS. LOGIC'S PROTEST OF THE RELATIVE WEIGHTS OF THE CRITERIA, RECEIVED IN THIS OFFICE ON MAY 31, 1977, IS THEREFORE TIMELY.

WE DO NOT AGREE, HOWEVER, WITH LOGIC'S ASSESSMENT OF THE EVALUATION FACTORS. THE EVALUATION AND AWARD CRITERIA SET FORTH IN THE RFP FOR THE MEASUREMENT OF TECHNICAL CAPABILITY ARE DIVIDED INTO ONLY TWO MAJOR ELEMENTS: UNDERSTANDING OF THE REQUIREMENT AND TECHNICAL APPROACH. THE RFP LISTS 13 SUBELEMENTS, SUCH AS OPERATIONAL CAPABILITY, SYSTEM CAPABILITY, RELIABILITY, ETC. UNDER THE TECHNICAL APPROACH HEADING; NONE ARE LISTED UNDER THE UNDERSTANDING OF THE REQUIREMENT HEADING. LOGIC STATES THAT THIS LISTING LED IT TO BELIEVE THAT TECHNICAL APPROACH WAS THE MORE IMPORTANT FACTOR.

THE GENERAL GUIDELINES FOR CONTENT AND FORMAT OF THE TECHNICAL PROPOSAL APPEARING ON PAGE 10 OF THE SOLICITATION STRESS THE IMPORTANCE OF THE PROPOSAL AND ITS REFLECTION OF THE OFFEROR'S UNDERSTANDING OF THE PROCUREMENT IN THE FOLLOWING LANGUAGE:

"THE TECHNICAL PROPOSAL SHALL BE SUCH AS TO ENABLE MANAGEMENT- ENGINEERING ORIENTED PERSONNEL TO MAKE A THOROUGH EVALUATION AND ARRIVE AT A SOUND DETERMINATION AS TO WHETHER THE PROPOSAL MEETS THE REQUIREMENTS OF THE GOVERNMENT. TO THIS END, THE TECHNICAL PROPOSAL SHOULD BE SO SPECIFIC, DETAILED AND COMPLETE AS TO CLEARLY AND FULLY DEMONSTRATE THAT THE OFFEROR HAS A THOROUGH UNDERSTANDING OF THE REQUIREMENTS OF THE GOVERNMENT AND THE CONTENTS OF THE ATTACHED SPECIFICATIONS."

WE CONSIDER THIS CLEAR EVIDENCE OF THE IMPORTANCE THAT THE EVALUATING ACTIVITY ATTACHED TO PROPOSAL FACTORS.

NEITHER DO WE CONSIDER THE EVALUATION CRITERIA IN QUESTION TO BE INHERENTLY SO SUBJECTIVE AS TO BE ARBITRARY. THE RECORD HERE INDICATES THAT PROPOSALS WERE EVALUATED FOR UNDERSTANDING OF THE PROBLEM ON THE BASIS OF THEIR COMPLETENESS AND THOROUGHNESS AS WELL AS THE OFFERORS' GRASP OF THE PROBLEM THE NARRATIVE SUMMARIES SUPPORTING EACH EVALUATION INDICATE THAT EMPHASIS WAS PLACED ON THE OFFEROR'S RESPONSE, OR LACK THEREOF, TO EACH OF THE REQUIREMENTS SET FORTH IN THE SOLICITATION AND THE NATURE OF THAT RESPONSE, E.G., WHETHER A SPECIFIC TECHNICAL APPROACH WAS PROPOSED OR MERELY A BLANKET OFFER OF COMPLIANCE WITHOUT SUPPORTING DETAIL. WE FIND NO PERSUASIVE EVIDENCE THAT THIS STANDARD WAS NOT APPLIED EQUALLY TO ALL PROPOSALS.

IT IS OUR VIEW THAT THE DETERMINATION OF THE RELATIVE MERITS OF PROPOSALS IS THE RESPONSIBILITY OF THE CONTRACTING AGENCY SINCE IT MUST BEAR THE BURDEN OF ANY DIFFICULTIES INCURRED BECAUSE OF A DEFECTIVE EVALUATION. BOYLE ENGINEERING CORPORATION, B-183355, JUNE 10, 1975, 75-1 CPD 354; HANSA ENGINEERING CORPORATION, B-187675, JUNE 13, 1977, 77-1 CPD 423. WILL QUESTION CONTRACTING OFFICIALS' DETERMINATIONS CONCERNING THE TECHNICAL MERITS OF PROPOSALS ONLY UPON A CLEAR SHOWING OF UNREASONABLENESS, ABUSE OF DISCRETION, OR VIOLATION OF PROCUREMENT STATUTES OR REGULATIONS. SEE, E.G., EXECUTIVE MANAGEMENT SERVICES, INC., B-187052, FEBRUARY 15, 1977, 77-1 CPD 110; JOANELL LABORATORIES, INCORPORATED, 56 COMP.GEN. 291 (1977), 77-1 CPD 51; GROUP OPERATION, INC., 55 COMP.GEN. 1315 (1976), 76-2 CPD 79; APPLIED SYSTEM CORPORATION, B-181696, OCTOBER 8, 1974, 74-2 CPD 195. WE WILL NOT CONSIDER A TECHNICAL EVALUATION TO BE UNREASONABLE MERELY BECAUSE THERE IS SUBSTANTIAL DISAGREEMENT BETWEEN THE CONTRACTING AGENCY AND THE OFFEROR OR BECAUSE BIAS HAS BEEN ALLEGED; IT MUST BE DEMONSTRATED CLEARLY ON THE RECORD THAT THERE IS NO RATIONAL BASIS FOR THE EVALUATION FOR IT TO BE CONSIDERED UNREASONABLE. SEE JOANELL LABORATORIES, INCORPORATED, SUPRA, AND CASES CITED THEREIN; OPTIMUM SYSTEMS, INC., B-187560, AUGUST 31, 1977, 77-2 CPD 165.

IN CONSIDERATION OF THE ABOVE, WE ARE OF THE OPINION THAT LOGIC HAS PROVIDED NO SUBSTANTIAL EVIDENCE OF PREJUDICE IN THE EVALUATION OF ITS PROPOSAL. SINCE WE FIND NO IMPROPRIETY IN THE EVALUATION OF PROPOSALS, WE CANNOT CONSIDER THAT PROTESTER HAS MET ITS BURDEN OF AFFIRMATIVELY PROVING ITS ALLEGATION. SEE HANSA ENGINEERING CORPORATION, SUPRA.

ACCORDINGLY, THE PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs