Skip to main content

B-204969, AUG 18, 1982

B-204969 Aug 18, 1982
Jump To:
Skip to Highlights

Highlights

PROTEST OF TECHNICAL EVALUATION OF PROPOSAL IS DENIED WHERE PROTESTER HAS NOT SHOWN EVALUATION TO BE UNREASONABLE OR ARBITRARY. 2. PROPOSAL OF MORE THAN ESTIMATED NUMBER OF MAN-YEARS IN RFP IS NOT A DEPARTURE FROM RFP REQUIREMENTS. SINCE ESTIMATE WAS MERELY THAT AND NOT A REQUIREMENT. DDC ESSENTIALLY ARGUES THAT THE TECHNICAL EVALUATION WAS DEFECTIVE. QUESTIONS ASKED BY PROSPECTIVE OFFERORS WERE ANSWERED IN WRITING AND MADE A PART OF THE RFP BY AMENDMENT NO. 0001. ONE OF THE QUESTIONS ASKED WHAT WAS THE ANTICIPATED LEVEL OF EFFORT PER YEAR. THE ANSWER WAS THAT 1.25 MAN-YEARS WERE ANTICIPATED. TECHNICAL PROPOSALS WERE TO BE EVALUATED IN ACCORDANCE WITH THE FOLLOWING FACTORS. WITH THE FIRST TWO FACTORS MAKING UP ALMOST ONE-HALF OF THE TOTAL VALUE OF ALL FACTORS: "(I) UNDERSTANDING THE PROJECT - POINTS WILL BE AWARDED BASED ON THE CONTRACTOR'S DEMONSTRATED UNDERSTANDING OF THE PROJECT AND REQUIREMENTS THAT MUST BE SATISFIED.

View Decision

B-204969, AUG 18, 1982

DIGEST: 1. PROTEST OF TECHNICAL EVALUATION OF PROPOSAL IS DENIED WHERE PROTESTER HAS NOT SHOWN EVALUATION TO BE UNREASONABLE OR ARBITRARY. 2. PROPOSAL OF MORE THAN ESTIMATED NUMBER OF MAN-YEARS IN RFP IS NOT A DEPARTURE FROM RFP REQUIREMENTS, SINCE ESTIMATE WAS MERELY THAT AND NOT A REQUIREMENT.

DIVERSIFIED DATA CORPORATION:

DIVERSIFIED DATA CORPORATION (DDC) PROTESTS THE AWARD OF A COST-PLUS FIXED-FEE CONTRACT FOR MAINTENANCE OF THE ACQUISITION MANAGEMENT SYSTEM FILE OF THE INFORMATION REQUIREMENTS CONTROL AUTOMATED SYSTEM DATA BASE TO EG&G INCORPORATED (EG&G) UNDER REQUEST FOR PROPOSALS (RFP) MDA903-82 R-002 ISSUED BY THE DEFENSE SUPPLY SERVICE-WASHINGTON (DSS-W). DDC ESSENTIALLY ARGUES THAT THE TECHNICAL EVALUATION WAS DEFECTIVE.

WE DENY THE PROTEST.

THE RFP SET FORTH THE SCOPE AND OBJECTIVES OF THE CONTRACT GENERALLY AND THEN PROVIDED DESCRIPTIONS OF THE SIX SPECIFIC TASKS TO BE PERFORMED AND A LIST OF REPORTS TO BE DELIVERED UNDER THE CONTRACT. QUESTIONS ASKED BY PROSPECTIVE OFFERORS WERE ANSWERED IN WRITING AND MADE A PART OF THE RFP BY AMENDMENT NO. 0001. ONE OF THE QUESTIONS ASKED WHAT WAS THE ANTICIPATED LEVEL OF EFFORT PER YEAR. THE ANSWER WAS THAT 1.25 MAN-YEARS WERE ANTICIPATED.

THE RFP ALSO LISTED THE EVALUATION FACTORS FOR AWARD. TECHNICAL PROPOSALS WERE TO BE EVALUATED IN ACCORDANCE WITH THE FOLLOWING FACTORS, LISTED IN DESCENDING ORDER OF IMPORTANCE, WITH THE FIRST TWO FACTORS MAKING UP ALMOST ONE-HALF OF THE TOTAL VALUE OF ALL FACTORS:

"(I) UNDERSTANDING THE PROJECT - POINTS WILL BE AWARDED BASED ON THE CONTRACTOR'S DEMONSTRATED UNDERSTANDING OF THE PROJECT AND REQUIREMENTS THAT MUST BE SATISFIED.

"(II) TECHNICAL APPROACH AND SCHEDULE - POINTS WILL BE AWARDED BASED ON THE CONTRACTOR'S TECHNICAL APPROACH TO THE ACCOMPLISHMENT OF THE TASKS CITED IN SECTION C-1 AND FOR THE DELIVERABLES LISTED IN SECTION F-3.

"(III) STAFF QUALIFICATIONS - POINTS WILL BE AWARDED BASED ON SKILL LEVEL AND EXPERIENCE OF PROPOSED KEY PERSONNEL. RESUMES OF THE PROPOSED TECHNICAL STAFF WILL BE EVALUATED AND SCORED ACCORDING TO SPECIALIZED EXPERIENCE, NUMBER OF YEARS OF EXPERIENCE AND EDUCATIONAL BACKGROUND.

"(IV) CONTRACTOR EXPERIENCE AND CAPABILITY - POINTS WILL BE AWARDED BASED ON THE CONTRACTOR'S PREVIOUS EXPERIENCE IN DATA MANAGEMENT, AVAILABLE RESOURCES AND CLIENT SATISFACTION.

"(V) PROJECT MANAGEMENT - POINTS WILL BE AWARDED BASED ON THE QUALIFICATIONS OF THE PROJECT MANAGER MANAGEMENT APPROACH, PROJECT TEAM ORGANIZATION, INTERNAL CONTROLS, COST AND QUALITY CONTROL, AND REPORTING METHODS.

"(VI) LEVEL OF EFFORT - POINTS WILL BE AWARDED BASED ON THE CONTRACTOR'S ABILITY TO RESPOND TO THE REQUIREMENTS OF THE STATEMENT OF WORK WITHOUT EXTENSIVE TRAINING OR OTHER DELAYS."

IN THE TECHNICAL PROPOSAL REQUIREMENTS SECTION, THE RFP REQUIRED OFFERORS TO PROVIDE A TABLE SHOWING THE MAN-HOURS TO BE SPENT ON EACH TASK BY EACH PERSON ASSIGNED TO THE PROJECT.

CONCERNING COST, THE RFP STATED THAT COST WOULD NOT BE ASSIGNED A NUMERICAL WEIGHT AND WOULD BE SUBORDINATE TO TECHNICAL CONSIDERATIONS. FURTHER, THE RFP STATED THAT THE INTENT OF THE PROCUREMENT WAS TO ACHIEVE MAXIMUM QUALITY OF PERFORMANCE WITH REALISTIC COST.

TWO PROPOSALS WERE RECEIVED. THE TECHNICAL PROPOSALS WERE EVALUATED BY A PANEL OF FOUR EVALUATORS. EG&G'S PROPOSAL RECEIVED A COMPOSITE SCORE OF 97.75 OUT OF 100 POSSIBLE POINTS; DDC'S PROPOSAL RECEIVED A SCORE OF 58.25. DSS-W FOUND THAT DDC'S TECHNICAL PROPOSAL WAS TECHNICALLY UNACCEPTABLE AND REFUSED TO CONSIDER IT FURTHER. EG&G'S COSTS WERE $117,412; DDC'S WERE $85,625. DSS-W PERFORMED A COST ANALYSIS OF EG&G'S COST PROPOSAL AND FOUND THE COSTS TO BE REASONABLE AND REALISTIC. AWARD WAS MADE TO EG&G.

DDC ESSENTIALLY ARGUES THAT THE TECHNICAL EVALUATION WAS DEFECTIVE BOTH IN THE SCORING OF ITS PROPOSAL AND IN THE SCORING OF EG&G'S PROPOSAL. DDC ALSO ARGUES THAT THE EVALUATORS DEPARTED FROM THE STATED EVALUATION CRITERIA IN JUDGING THE PROPOSALS. FINALLY, DDC ALLEGES THAT THE EVALUATORS WERE BIASED IN FAVOR OF EG&G AND AGAINST DDC.

GENERALLY, IT IS NOT THE FUNCTION OF THIS OFFICE TO REEVALUATE TECHNICAL PROPOSALS OR RESOLVE DISPUTES OVER THE SCORING OF TECHNICAL PROPOSALS. DECISION SCIENCES CORPORATION, B-182558, MARCH 24, 1975, 75-1 CPD 175; TECHPLAN CORPORATION, B-180795, SEPTEMBER 16, 1974, 74-2 CPD 169; 52 COMP.GEN. 382 (1972). THE DETERMINATION OF THE NEEDS OF THE GOVERNMENT AND THE METHOD OF ACCOMMODATING SUCH NEEDS IS PRIMARILY THE RESPONSIBILITY OF THE PROCURING AGENCY, 46 COMP.GEN. 606 (1967), WHICH, THEREFORE, IS RESPONSIBLE FOR THE OVERALL DETERMINATION OF THE RELATIVE DESIRABILITY OF PROPOSALS. IN MAKING SUCH DETERMINATIONS, CONTRACTING OFFICERS ENJOY A REASONABLE RANGE OF DISCRETION IN DETERMINING WHICH OFFER SHOULD BE ACCEPTED FOR AWARD AND THEIR DETERMINATIONS WILL NOT BE QUESTIONED BY OUR OFFICE UNLESS THERE IS A CLEAR SHOWING OF UNREASONABLENESS, AN ARBITRARY ABUSE OF DISCRETION, OR A VIOLATION OF THE PROCUREMENT STATUTES AND REGULATIONS. METIS CORPORATION, 54 COMP.GEN. 612 (1975), 75-1 CPD 44.

ALSO, WHILE TECHNICAL EVALUATIONS MUST BE BASED ON THE STATED EVALUATION CRITERIA, THE INTERPRETATION AND APPLICATION OF SUCH CRITERIA IS OFTEN SUBJECTIVE IN NATURE. WE WILL NOT OBJECT SO LONG AS THE APPLICATION OF THE CRITERIA IS REASONABLY AND LOGICALLY RELATED TO THE CRITERIA AS STATED. SEE, E.G., HUMAN RESOURCES RESEARCH ORGANIZATION, B-203302, JULY 8, 1982, 82-2 CPD .

THE ESSENCE OF DDC'S COMPLAINT IS THAT ITS PROPOSAL WAS SEVERELY CRITICIZED FOR THE NUMBER OF MAN-HOURS IT PROPOSED FOR TASK 1, EVEN THOUGH IT ADHERED TO THE 1.25-MAN-YEAR ESTIMATE CONTAINED IN THE RFP. CONVERSELY, EG&G'S PROPOSAL WAS SCORED ALMOST PERFECTLY, EVEN THOUGH IT PROPOSED MAN-YEARS IN EXCESS OF THE 1.25 ESTIMATE. DDC POINTS TO THE INITIAL REQUEST FOR CONTRACT SERVICES FORM, WHICH HAD A 3.5-MAN-YEAR ESTIMATE, AS EVIDENCE THAT DSS-W USED 3.5 MAN-YEARS, NOT 1.25, TO EVALUATE PROPOSALS.

DSS-W DENIES USING THE 3.5-MAN-YEAR ESTIMATE IN THE EVALUATION AND STATES THAT IT WAS AN INTERNAL DOCUMENT FROM THE PLANNING STAGES OF THE PROCUREMENT. THE ESTIMATE USED AS AN AID IN EVALUATING PROPOSALS, ACCORDING TO DSS-W, WAS THE 1.25-MAN-YEAR FIGURE. DSS-W POINTS OUT THAT THE CRITICISM OF DDC'S PROPOSAL WAS NOT BASED ON THE TOTAL MAN YEARS PROPOSED WHICH WAS NOT A PROBLEM, BUT RATHER ON DDC'S PROPORTIONATE ALLOCATION OF THE MAN-HOURS AMONG THE TASKS. DSS-W POINTS OUT THAT DDC WAS CRITICIZED FOR ALLOCATING A RELATIVELY SMALL PERCENTAGE OF ITS TOTAL MAN-HOURS TO TASK 1, WHICH DSS-W STATES IS THE MOST IMPORTANT TASK AND REQUIRES THE MOST INTENSIVE EFFORT. CONVERSELY, DDC PROPOSED A RELATIVELY LARGE PERCENTAGE OF ITS TOTAL MAN HOURS FOR OTHER LESS IMPORTANT TASKS. ACCORDING TO DSS-W, THIS GROSS MISALLOCATION OF MAN-HOURS INDICATES DDC'S LACK OF UNDERSTANDING OF THE TASKS.

THERE IS NO EVIDENCE TO SUPPORT DDC'S POSITION THAT DSS-W USED THE 3.5- MAN-YEAR ESTIMATE TO EVALUATE PROPOSALS. THE COMMENTS OF THE EVALUATORS SHOW THAT DDC'S PROPOSAL WAS NOT DOWNGRADED BECAUSE IT PROPOSED A TOTAL OF 1.25 MAN-YEARS, NOR WAS EG&G'S PROPOSAL SCORED HIGHER BECAUSE IT PROPOSED A HIGHER MAN-YEAR TOTAL OR MORE MAN-HOURS FOR TASK 1. RATHER, EACH PROPOSAL WAS SCORED AS IT WAS BECAUSE OF THE RELATIVE ALLOCATION OF MAN- HOURS WITHIN EACH PROPOSAL. THIS WAS USED AS AN INDICATOR OF THE OFFERORS' UNDERSTANDING OF THE CONTRACT REQUIREMENTS. WE SEE NOTHING IMPROPER IN USING MAN-HOUR ESTIMATES AS AN INDICATOR OF WHAT ELEMENTS OF CONTRACT PERFORMANCE A CONTRACTOR HAS PLACED EMPHASIS ON AND, CONSEQUENTLY, AS AN INDICATOR OF ITS UNDERSTANDING OF THE REQUIREMENTS OF THE CONTRACT (THE MOST IMPORTANT TECHNICAL EVALUATION CRITERION HERE). SEE, E.G., MOORE JOHNSON/SHOTWELL-ANDERSON, B-200093, FEBRUARY 11, 1981, 81-1 CPD 92.

ALSO, A REVIEW OF THE STATEMENTS OF THE EVALUATORS INDICATES THAT THE WRITTEN MATERIAL IN DDC'S PROPOSAL CORROBORATED THE INFERENCE DRAWN FROM ITS RELATIVE ALLOCATION OF MAN-HOURS - THAT DDC DID NOT FULLY UNDERSTAND THE CONTRACT REQUIREMENTS. A NUMBER OF EVALUATORS STATED THAT DDC'S PROPOSAL CONSISTED LARGELY OF PARAPHRASES OF VARIOUS DEPARTMENT OF DEFENSE DOCUMENTS CONCERNING THE SUBJECT MATTER AND DEMONSTRATED LITTLE UNDERSTANDING OF THE REQUIREMENTS. DDC WAS ALSO DOWNGRADED FOR ITS EXTENSIVE TRAVEL SCHEDULE WHEN LITTLE TRAVEL IS NECESSARY FOR CONTRACT PERFORMANCE.

DDC ALSO CITES SEVERAL STATEMENTS MADE, ALL BUT ONE BY ONE EVALUATOR, AS EVIDENCE THAT EVALUATION FACTORS NOT LISTED IN THE RFP WERE USED BY THE EVALUATORS IN JUDGING PROPOSALS AND THAT THE EVALUATORS WERE BIASED.

IN EXAMINING THESE STATEMENTS, WE FOUND THAT SEVERAL WERE REASONABLY RELATED TO STATED EVALUATION CRITERIA. FOR EXAMPLE, DDC COMPLAINS THAT THE EVALUATORS CRITICIZED DDC'S STAFF BECAUSE ITS DEGREES WERE NOT RELATED TO THE WORK INVOLVED. DDC ARGUES THAT THE RFP CONTAINED NO SPECIFIC DEGREE REQUIREMENT. HOWEVER, WE NOTE THAT "EDUCATIONAL BACKGROUND" IS SPECIFICALLY MENTIONED IN THE "STAFF QUALIFICATIONS" EVALUATION CRITERION. OTHER STATEMENTS WERE MERELY PART OF SEVERAL REASONS GIVEN FOR A CONCLUSION. SOME STATEMENTS WERE NOT IMPORTANT OR RELEVANT TO THE EVALUATION. ON THE WHOLE, THIS EVALUATOR'S COMMENTS WERE CONSONANT WITH THE POINT SCORES AND THE OVERALL TECHNICAL EVALUATION. ALSO, WE FIND NO EVIDENCE OF BIAS FROM THE POSITIVE STATEMENTS MADE ABOUT EG&G'S PROPOSAL AND THE NEGATIVE STATEMENTS MADE ABOUT DDC'S. THESE COMMENTS WERE ALSO CONSISTENT WITH THE POINT SCORING AND THE OVERALL EVALUATION. A PROTESTER HAS THE BURDEN OF PROVING BIAS ON THE PART OF PROPOSAL EVALUATORS AND PREJUDICIAL MOTIVES WILL NOT BE ATTRIBUTED ON THE BASIS OF INFERENCE OR SUPPOSITION. DEVELOPMENT ASSOCIATES, INC., B-205380, JULY 12, 1982, 82-2 CPD . IN ANY EVENT, EVEN EXCLUDING THE SCORES OF THIS EVALUATOR DOES NOT SUBSTANTIALLY CHANGE DDC'S RANKING.

DDC ALSO CONTENDS THAT THE PATTERN IN THE SCORES, SIMILAR SCORES BY ALL EVALUATORS FOR EACH OFFEROR AND UNIFORMLY GREAT DISPARITY BETWEEN OFFERORS, IS EVIDENCE OF A FLAWED EVALUATION. SINCE THE NATURE OF SCORING TECHNICAL PROPOSALS IS INHERENTLY SUBJECTIVE, WE CANNOT CONCLUDE FROM THE PATTERNS OF POINT SCORING THAT AN EVALUATION IS FLAWED. SEE, E.G., PANUZIO/REES ASSOCIATES, B-197516, NOVEMBER 26, 1980, 80-2 CPD 395; C.L.SYSTEMS, INC., B-197123, JUNE 30, 1980, 80-1 CPD 448.

BASED ON THE ABOVE, WE CANNOT CONCLUDE THAT DSS-W'S TECHNICAL EVALUATION FINDING DDC'S PROPOSAL TO BE TECHNICALLY UNACCEPTABLE WAS ARBITRARY OR UNREASONABLE.

DDC ALSO CONTENDS THAT EG&G'S PROPOSAL OF MORE MAN-HOURS THAN DSS-W ESTIMATED IS A DEPARTURE FROM THE STATED REQUIREMENTS OF THE RFP. DDC ARGUES IN THIS SITUATION THAT DEFENSE ACQUISITION REGULATION SEC. 3 805.4(C) (1976 ED.) REQUIRES DSS-W TO PERMIT ALL OFFERORS TO REVISE THEIR PROPOSALS IN RESPONSE TO THE CHANGED REQUIREMENTS.

WE DISAGREE. THE NUMBER OF MAN-YEARS WAS MERELY AN ESTIMATE, NOT A REQUIREMENT. EG&G'S PROPOSAL OF MORE THAN THE ESTIMATED AMOUNT OF MAN HOURS IS NOT A DEPARTURE FROM AN RFP REQUIREMENT WITHIN THE MEANING OF THE CITED PROVISION. SEE, E.G. ABT ASSOCIATES, INC., B-196365, MAY 27, 1980, 80-1 CPD 362.

THE PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs