Skip to main content

B-199741, JUL 31, 1981

B-199741 Jul 31, 1981
Jump To:
Skip to Highlights

Highlights

PROTESTER HAS BURDEN OF PROVING BIAS ON PART OF AGENCY'S PROCUREMENT OFFICIALS AND PREJUDICIAL MOTIVES WILL NOT BE ATTRIBUTED TO SUCH OFFICIALS ON BASIS OF INFERENCE OR SUPPOSITION. 2. CONTENT AND EXTENT OF AGENCY'S DISCUSSIONS WITH OFFEROR IS MATTER OF JUDGMENT PRIMARILY FOR DETERMINATION BY AGENCY INVOLVED AND THAT DETERMINATION IS NOT SUBJECT TO QUESTION BY GAO UNLESS IT IS CLEARLY WITHOUT REASONABLE BASIS. GAO FINDS AGENCY'S DISCUSSION APPROACH WAS REASONABLE. THERE IS NO REQUIREMENT TO DISCUSS ALL INFERIOR ASPECTS OF PROTESTER'S OTHERWISE TECHNICALLY ACCEPTABLE PROPOSAL. 3. QUESTIONS OR REQUESTS THAT OFFEROR AMPLIFY UPON OR CLARIFY PARTICULAR ASPECTS OF ITS PROPOSAL HAVE BEEN REGARDED AS SUFFICIENT TO CONSTITUTE MEANINGFUL DISCUSSIONS. 4.

View Decision

B-199741, JUL 31, 1981

DIGEST: 1. PROTESTER HAS BURDEN OF PROVING BIAS ON PART OF AGENCY'S PROCUREMENT OFFICIALS AND PREJUDICIAL MOTIVES WILL NOT BE ATTRIBUTED TO SUCH OFFICIALS ON BASIS OF INFERENCE OR SUPPOSITION. 2. CONTENT AND EXTENT OF AGENCY'S DISCUSSIONS WITH OFFEROR IS MATTER OF JUDGMENT PRIMARILY FOR DETERMINATION BY AGENCY INVOLVED AND THAT DETERMINATION IS NOT SUBJECT TO QUESTION BY GAO UNLESS IT IS CLEARLY WITHOUT REASONABLE BASIS. GAO FINDS AGENCY'S DISCUSSION APPROACH WAS REASONABLE. MOREOVER, THERE IS NO REQUIREMENT TO DISCUSS ALL INFERIOR ASPECTS OF PROTESTER'S OTHERWISE TECHNICALLY ACCEPTABLE PROPOSAL. 3. QUESTIONS OR REQUESTS THAT OFFEROR AMPLIFY UPON OR CLARIFY PARTICULAR ASPECTS OF ITS PROPOSAL HAVE BEEN REGARDED AS SUFFICIENT TO CONSTITUTE MEANINGFUL DISCUSSIONS. 4. RECORD WHICH MERELY INDICATES THAT AGENCY AND PROTESTER DISAGREE AS TO VALUE OF DISCUSSIONS THAT OCCURRED IN SOME AREAS OF OFFEROR'S PROPOSAL DOES NOT PROVIDE BASIS FOR GAO TO CONCLUDE THAT MEANINGFUL DISCUSSIONS WERE NOT CONDUCTED WITH PROTESTER. 5. GAO FINDS THAT AGENCY'S EVALUATION BOARD COMPLIED WITH REQUIREMENT'S OF DOT ORDER 4200.11 REGARDING LISTING IN WRITTEN REPORT TO SOURCE SELECTION OFFICIAL OF EVALUATION CRITERIA, WEIGHTS GIVEN TO EACH EVALUATION CRITERION, AND SCORING OF PROPOSALS. IN ANY EVENT, GAO BELIEVES WRITTEN REPORT CONTAINS SUFFICIENTLY DETAILED NARRATIVE ANALYSIS OF EACH OFFEROR'S PROPOSAL TO PROVIDE SOURCE SELECTION OFFICIAL ADEQUATE FACTUAL BASIS FOR SELECTION DECISION. 6. RECORD SHOWS THAT, CONTRARY TO PROTESTER'S ASSERTION, SOME MEMBERS OF AGENCY'S BOARD WERE PRESENT AT PROTESTER'S ORAL PRESENTATION. PROTESTER HAS MADE NO ARGUMENT TO SUPPORT ITS CONTENTION THAT ALL MEMBERS OF BOARD SHOULD HAVE BEEN PRESENT AT ORAL PRESENTATION. 7. DETERMINATION OF RELATIVE MERITS OF OFFEROR'S TECHNICAL PROPOSAL IS PRIMARILY RESPONSIBILITY OF PROCURING AGENCY AND GAO WILL NOT DISTURB AGENCY EVALUATIONS UNLESS ARBITRARY OR IN VIOLATION OF PROCUREMENT LAWS AND REGULATIONS. BASED ON REVIEW OF RECORD, GAO BELIEVES THAT AGENCY'S EVALUATION OF PROTESTER'S PROPOSAL WAS REASONABLE. 8. ONCE DISCUSSIONS ARE REOPENED WITH ONE OFFEROR AFTER RECEIPT OF BEST AND FINAL OFFERS, THEY MUST BE REOPENED WITH ALL OFFERORS IN COMPETITIVE RANGE AND OPPORTUNITY GIVEN TO SUBMIT REVISED PROPOSALS. HOWEVER, GAO DOES NOT BELIEVE THAT AGENCY'S DEDUCTION OF COST CREDIT FROM AWARDEE'S COST PROPOSAL CONSTITUTED REOPENING OF NEGOTIATIONS BECAUSE CREDIT WAS MANDATED BY RFP, AWARDEE DID NOT STATE EXCEPTION TO CREDIT IN PROPOSAL, APPLICATION IS MECHANICAL, MATHEMATICAL PROCEDURE AND AWARDEE WAS CONTACTED FOR SOLE PURPOSE OF CONFIRMING APPLICATION. 9. ONCE OFFERORS ARE INFORMED OF CRITERIA AGAINST WHICH PROPOSALS WILL BE EVALUATED, AGENCY MUST ADHERE TO THOSE CRITERIA OR INFORM ALL OFFERORS OF ANY CHANGES MADE IN EVALUATION SCHEME. HOWEVER, CRITERION WHICH AGENCY'S BOARD ELIMINATED FROM CONSIDERATION AFTER RECEIPT OF INITIAL PROPOSALS WAS NOT EXPLICITLY STATED IN RFP. FURTHERMORE, EVEN THOUGH CRITERION WAS NOT TAKEN INTO ACCOUNT AS SEPARATE FACTOR, CRITERION WAS CONSIDERED AS PART OF CRITERION SPECIFIED IN RFP. 10. GAO DOES NOT BELIEVE ELIMINATION OF EVALUATION SUBCRITERION VIOLATED DOT ORDER 4200.11. GAO CONCLUDES THAT SUBCRITERION WAS DEVISED IN ACCORDANCE WITH TERMS OF THAT ORDER TO ASSIST BOARD'S TECHNICAL EVALUATORS IN OWN INTERNAL DELIBERATIONS. 11. GAO FINDS THAT FEE WAS NOT MAJOR FACTOR UNDER RFP'S SOURCE SELECTION SCHEME. AGENCY'S SOURCE SELECTION PLAN WHICH REFERENCED FEE AS MAJOR FACTOR WAS NEVER COMMUNICATED TO ANY OFFEROR DURING PROCUREMENT AND WAS SUPERSEDED BY RFP. 12. IN COST-REIMBURSEMENT PROCUREMENTS, EVALUATED RATHER THAN PROPOSED COSTS PROVIDE SOUNDER BASIS FOR DETERMINING MOST ADVANTAGEOUS PROPOSAL. CONCLUSIONS REACHED BY AGENCY IN EVALUATING PROPOSED COST ARE ENTITLED TO GREAT WEIGHT AND GAO WILL NOT QUESTION AGENCY'S COST REALISM DETERMINATION UNLESS IT IS NOT SUPPORTED BY REASONABLE BASIS. RECORD SHOWS THAT AGENCY'S COST EVALUATION OF PROTESTER'S AND AWARDEE'S PROPOSED COSTS WAS REASONABLE.

DYNALECTRON CORPORATION:

DYNALECTRON CORPORATION (DYNALECTRON) PROTESTS THE AWARD OF A CONTRACT TO BOEING SERVICES INTERNATIONAL, INC. (BOEING), UNDER REQUEST FOR PROPOSALS (RFP) NO. DOT-FR-936500 ISSUED BY THE DEPARTMENT OF TRANSPORTATION (DOT), FEDERAL RAILROAD ADMINISTRATION. THE RFP WAS FOR THE OPERATION AND MAINTENANCE OF THE FEDERAL RAILROAD ADMINISTRATION TRANSPORTATION TEST CENTER, PUEBLO, COLORADO, FOR A PERIOD OF 4 YEARS WITH AN OPTIONAL FIFTH YEAR.

SUBSEQUENT TO THE FILING OF THIS PROTEST, DYNALECTRON BROUGHT SUIT IN THE UNITED STATES DISTRICT COURT FOR THE DISTRICT OF COLUMBIA AGAINST DOT AND BOEING (CIVIL ACTION NO. 80-2088). THE COURT HAS STAYED ITS DECISION PENDING OUR DECISION ON DYNALECTRON'S PROTEST.

DYNALECTRON RAISES THE FOLLOWING GROUNDS OF PROTEST:

(1)SOME OF THE MEMBERS OF THE TECHNICAL EVALUATION TEAM WERE BIASED AND PREJUDICED AGAINST DYNALECTRON AND THE BIAS AND PREJUDICE RESULTED IN AN UNFAIR EVALUATION OF DYNALECTRON'S PROPOSAL;

(2) DOT FAILED TO CONDUCT MEANINGFUL DISCUSSIONS BY NOT ADVISING DYNALECTRON OF THE SPECIFIC AREAS IN WHICH ITS PROPOSALS WERE ALLEGEDLY DEFICIENT OR WEAK AND BY NOT GIVING DYNALECTRON THE OPPORTUNITY TO ADDRESS AND CORRECT THE ALLEGED DEFICIENCIES OR WEAKNESSES;

(3) THERE WAS NO RATIONAL BASIS FOR THE DIFFERENCES IN THE POINT SCORES GIVEN UNDER EACH TECHNICAL EVALUATION CRITERION BY DOT'S EVALUATION BOARD AND THE BOARD'S DETERMINATIONS OF GREATER TECHNICAL MERIT USING POINT SCORES WERE NOT REASONABLY RELATED TO WHAT THE POINT SCORES MEANT IN TERMS OF AN OFFEROR'S ACTUAL TECHNICAL PERFORMANCE;

(4) MEMBERS OF DOT'S EVALUATION BOARD WERE NOT PRESENT AT DYNALECTRON'S ORAL PRESENTATION AND, CONSEQUENTLY, THE OVERALL SELECTION PROCESS UNDER THE RFP WAS PREJUDICED;

(5)DOT FAILED TO DEMONSTRATE THAT ITS TECHNICAL DETERMINATIONS HAD A RATIONAL BASIS BECAUSE IT DID NOT PROVIDE ANYTHING IN THE PROCUREMENT RECORD OTHER THAN ULTIMATE CONCLUSIONS WITHOUT ANY FACTUAL SUPPORT FOR THE CONCLUSIONS;

(6) DOT ALLOWED BOEING THE OPPORTUNITY TO REVISE ITS PROPOSAL AFTER THE SUBMISSION OF BEST AND FINAL OFFERS, THEREBY CONSTITUTING AN IMPROPER REOPENING OF NEGOTIATIONS PRIOR TO THE EXECUTION OF THE AWARDED CONTRACT;

(7) DOT VIOLATED DOT ORDER 4200.11, SECTION

"E," PARAGRAPH 11(B), BY DELETING OR CHANGING CERTAIN TECHNICAL EVALUATION CRITERIA SUBSEQUENT TO THE RECEIPT OF INITIAL PROPOSALS;

(8) BY IGNORING THE SIGNIFICANT SAVINGS OFFERED BY DYNALECTRON'S LOWER FEE, DOT DID NOT CONDUCT THE PROCUREMENT IN ACCORDANCE WITH THE RFP'S SOURCE SELECTION PLAN WHICH MADE FEE A MAJOR PRICE DISCRIMINATOR FOR PURPOSE OF SELECTION; AND

(9) DOT'S COST REALISM ANALYSES WERE DEFECTIVE AND NOT PERFORMED IN ACCORDANCE WITH APPLICABLE REGULATIONS IN THAT THE COST REALISM PLAN WAS CHANGED FROM THE ONE DOT ORIGINALLY SET UP AND DOT MADE COST ADJUSTMENTS WHICH HAD NO RATIONAL BASIS.

WE FIND DYNALECTRON'S CONTENTIONS WITHOUT MERIT.

BACKGROUND

THE RFP WAS ISSUED ON AUGUST 13, 1979. THE THEN INCUMBENT CONTRACTOR, DYNALECTRON, HAD BEEN PROVIDING THE OPERATION AND MAINTENANCE SERVICES AT THE TRANSPORTATION TEST CENTER UNDER A PRIOR 4 YEAR CONTRACT AWARD IN AUGUST 1976. FOUR PROPOSALS WERE RECEIVED IN RESPONSE TO THE RFP, INCLUDING ONE FROM DYNALECTRON AND ONE FROM BOEING. FOLLOWING DISCUSSIONS WITH ALL THE OFFERORS, REVISED TECHNICAL PROPOSALS WERE RECEIVED ON MAY 8, 1980, AND FINAL COST PROPOSALS WERE RECEIVED ON MAY 15, 1980. DOT'S EVALUATION BOARD, IN ITS FINAL TECHNICAL EVALUATION, RANKED BOEING'S PROPOSAL SUPERIOR TO DYNALECTRON'S. ON JULY 25, 1980, THE AGENCY'S SOURCE SELECTION OFFICIAL MADE THE DECISION TO AWARD THE CONTRACT TO BOEING AND, ON THE SAME DATE, DYNALECTRON PROTESTED THE DECISION TO THIS OFFICE. JULY 29, 1980, THE CONTRACTING OFFICER AWARDED THE CONTRACT TO BOEING.

BIAS IN BOARD'S EVALUATION

DYNALECTRON NOTES THAT, AFTER THE SUBMISSION OF BEST AND FINAL OFFERS, THE COMPOSITION OF DOT'S TECHNICAL EVALUATION BOARD WAS CHANGED. TWO INDIVIDUALS WERE ADDED. DYNALECTRON ALLEGES THAT ONE OF THE ADDED INDIVIDUALS, IF NOT BOTH, WAS BIASED AGAINST IT. DYNALECTRON FURTHER ALLEGES THAT ONE OF THE ADDED INDIVIDUALS STATED AT ONE TIME TO A DYNALECTRON EMPLOYEE THAT HE WAS GOING TO DO EVERYTHING HE COULD TO HELP ANOTHER COMPANY OBTAIN THE TRANSPORTATION TEST CENTER CONTRACT. ACCORDING TO DYNALECTRON, THE CHAIRMAN OF DOT'S EVALUATION BOARD WAS ADVISED OF THE MATTER PRIOR TO THE ADDITION OF THE INDIVIDUAL AND THE COMPANY WAS INFORMED THAT THE INDIVIDUAL WOULD PLAY NO PART IN THE SOURCE EVALUATION PROCESS. THUS, DYNALECTRON BELIEVES THE CHAIRMAN'S APPOINTMENT OF THE INDIVIDUAL AS A TECHNICAL EVALUATOR IN DISREGARD OF HIS ASSURANCES TO DYNALECTRON ALSO SHOWS THAT THE CHAIRMAN WAS BIASED AGAINST IT.

DYNALECTRON FURTHER CONTENDS THAT THE RECORD REVEALS A PATTERN OF ACTION ON THE PART OF THE AGENCY THAT CONSISTENTLY RESULTED IN THE COMPANY'S COMPETITIVE POSITION BEING PREJUDICIALLY COMPROMISED. IN SUPPORT OF THIS CONTENTION, DYNALECTRON ALLEGES THAT DOT'S BOARD IGNORED CERTAIN DOCUMENTATION DYNALECTRON SUBMITTED; ATTEMPTED TO EVALUATE CERTAIN ASPECTS OF DYNALECTRON'S TECHNICAL PROPOSAL ON A BASIS INCONSISTENT WITH THE RFP'S EVALUATION FACTORS; AND FAILED TO EVALUATE FEE AS A MAJOR PRICE DISCRIMINATOR. IN PARTICULAR, DYNALECTRON ALLEGES THAT THE SCORING SHEETS OF THE TECHNICAL EVALUATORS FURNISHED TO IT BY DOT SHOW SCORING INCONSISTENCIES WITH REGARD TO CORPORATE TEST EXPERIENCE; MANAGEMENT PLAN; UNDERSTANDING OF INTERFACE REQUIREMENTS WITH VARIOUS DISCIPLINES; ABILITY TO ATTRACT AND RETAIN HIGHLY QUALIFIED PROFESSIONAL AND TECHNICAL PERSONNEL; QUALIFICATIONS OF KEY PERSONNEL; AND EMPLOYEE COMPENSATION AND BENEFIT PACKAGE. ACCORDING TO DYNALECTRON, AN OFFEROR WITH A LOWER POINT SCORE IN THESE AREAS WAS RANKED HIGHER THAN AN OFFEROR WITH A HIGHER POINT SCORE. AS AN EXAMPLE, DYNALECTRON ALLEGES THAT A POINT SCORE OF 7.13 RATED "GOOD" BUT A POINT SCORE OF 5.25 RATED "VERY GOOD."

DOT TAKES THE POSITION THAT THE MERE FACT THAT SOME OF THE ORIGINAL FIVE EVALUATION PERSONNEL CHANGED DURING THE PROCUREMENT SHOULD NOT SUGGEST ANY IMPROPRIETY. DOT STATES THAT ONE TECHNICAL EVALUATOR WAS REPLACED PRIOR TO THE RECEIPT OF BEST AND FINAL OFFERS BECAUSE OF "SERIOUS ILLNESS." DOT ALSO STATES THAT ANOTHER TECHNICAL EVALUATOR WAS REPLACED AFTER THE RECEIPT OF FINAL REVISED PROPOSALS - AGAIN BECAUSE OF "SERIOUS ILLNESS."

AS TO THE PREJUDICIAL STATEMENT THAT DYNALECTRON ALLEGES ONE OF THE ADDED EVALUATORS MADE, DOT HAS SUBMITTED AN AFFIDAVIT FROM THIS INDIVIDUAL IN WHICH HE DENIES ANY PREJUDICE IN HIS TECHNICAL EVALUATION OF DYNALECTRON OR ANY OTHER OFFEROR. FURTHER, DOT POINTS OUT THAT DYNALECTRON HAS CITED NO SPECIFIC INSTANCE OF BIAS OR PREJUDICE IN THIS INDIVIDUAL'S EVALUATION OF DYNALECTRON'S PROPOSAL. MOREOVER, THE AGENCY INDICATES THAT IT REVIEWED THE FINAL WEIGHTED SCORES OF ALL THE TECHNICAL EVALUATORS AND CONDUCTED A SEPARATE ANALYSIS, REMOVING EACH EVALUATOR'S SCORES FROM THE OVERALL SCORING AND RANKING THE OFFERORS BASED ON THE REMAINING EVALUATORS' SCORES. DOT STATES THAT, WHEN THE SCORES OF THE INDIVIDUAL ALLEGEDLY PREJUDICED AGAINST DYNALECTRON WERE REMOVED, THE RELATIVE RANKING OF THE OFFERORS DID NOT CHANGE, THAT IS, DYNALECTRON STILL RANKED BEHIND BOEING TECHNICALLY. DOT BELIEVES, THEN, THAT THE UNIFORMITY OF SCORING BY THE EVALUATORS DISPELS DYNALECTRON'S CLAIM OF BIAS.

ANALYSIS

THE CRITICAL TEST FOR DETERMINING BIAS IN THE AGENCY'S EVALUATION OF PROPOSALS IS WHETHER ALL OFFERORS IN THE COMPETITION WERE TREATED FAIRLY AND EQUALLY. SEE SERVO CORPORATION OF AMERICA, B-193240, MAY 29, 1979, 79-1 CPD 380. HOWEVER, THE PROTESTER HAS THE BURDEN OF AFFIRMATIVELY PROVING ITS CASE AND UNFAIR OR PREJUDICIAL MOTIVES WILL NOT BE ATTRIBUTED TO PROCUREMENT OFFICIALS ON THE BASIS OF INFERENCE OR SUPPOSITION. SEE A.R.F. PRODUCTS, INC., 56 COMP.GEN. 201, 208 (1976), 76-2 CPD 541.

WE AGREE WITH DOT THAT DYNALECTRON HAS CITED NO SPECIFIC INSTANCE OF BIAS OR PREJUDICE IN THE EVALUATION OF DYNALECTRON'S TECHNICAL PROPOSAL. WHERE THE WRITTEN RECORD FAILS TO DEMONSTRATE BIAS, THE PROTESTER'S ALLEGATIONS ARE PROPERLY TO BE REGARDED AS MERE SPECULATION. SPERRY RAND CORPORATION, 56 COMP.GEN. 312, 319 (1977), 77-1 CPD 77.

WITH RESPECT TO DYNALECTRON'S ALLEGATIONS THAT DOT ENGAGED IN A PATTERN OF ACTION THAT CONSISTENTLY COMPROMISED DYNALECTRON'S COMPETITIVE POSITION, WE BELIEVE THAT, AT BEST, DYNALECTRON IS ATTEMPTING TO DEMONSTRATE AGENCY BIAS ON THE BASIS OF CIRCUMSTANTIAL EVIDENCE. RECOGNIZE THAT WHERE THE SUBJECTIVE MOTIVATION OF AN AGENCY'S PROCUREMENT PERSONNEL IS BEING CHALLENGED, IT MAY BE DIFFICULT FOR A PROTESTER TO ESTABLISH - ON THE WRITTEN RECORD WHICH FORMS THE BASIS FOR OUR OFFICE'S DECISIONS IN PROTESTS - THE EXISTENCE OF BIAS. SEE JOSEPH LEGAT ARCHITECTS, B-187160, DECEMBER 13, 1977, 77-2 CPD 458. HOWEVER, WE DO NOT THINK THAT DYNALECTRON'S ALLEGATIONS REGARDING DOT'S EVALUATION OF PROPOSED FEE AND THE SCORING SHEETS OF THE TECHNICAL EVALUATORS ARE SUFFICIENT IN THEMSELVES TO SHOW A MOTIVATION OR INTENT ON THE PART OF THE AGENCY'S PROCUREMENT OFFICIALS TO DISCRIMINATE AGAINST THE COMPANY.

MEANINGFUL DISCUSSIONS

DYNALECTRON ASSERTS THAT THE "DEFICIENCIES" WHICH DOT FOUND IN ITS PROPOSALS WERE NEVER COMMUNICATED TO IT UNTIL AFTER THE COMPETITION AND FOLLOWING AWARD OF A CONTRACT TO BOEING. DYNALECTRON BELIEVES THAT, IF THESE "DEFICIENCIES" HAD BEEN PROPERLY POINTED OUT DURING NEGOTIATIONS, DYNALECTRON COULD HAVE EITHER CONVINCED THE AGENCY OF ITS ERRONEOUS ASSESSMENTS OF DYNALECTRON'S PROPOSALS OR CHANGED ITS PROPOSALS TO CORRECT THE ALLEGED WEAKNESSES. SPECIFICALLY, DYNALECTRON CONTENDS THAT, WITHOUT THE BENEFIT OF DISCUSSIONS, ITS TECHNICAL PROPOSAL WAS DETERMINED TO BE DEFICIENT IN THE FOLLOWING AREAS: CORPORATE TEST EXPERIENCE; INTERFACES AND DIALOGUE; PLANNING AND WORK CONTROL; RETENTION AND ATTRACTION OF KEY PERSONNEL AND COMPENSATION PLAN; SUBCONTRACTING AND BATTELLE LABORATORY EXPERIENCE; AND QUALITY ASSURANCE PLANS.

A. CORPORATE TEST EXPERIENCE

DYNALECTRON ALLEGES THAT IN ACCORDANCE WITH THE RFP EVALUATION FACTORS IT EXTENSIVELY ADDRESSED THE REQUIREMENTS FOR CORPORATE TEST EXPERIENCE IN ITS PROPOSAL. IN PARTICULAR, DYNALECTRON ALLEGES THAT ITS PROPOSAL OUTLINED IN DETAIL CORPORATE TEST EXPERIENCE ON SIX MAJOR GOVERNMENT CONTRACTS. ACCORDING TO DYNALECTRON, DOT RATED DYNALECTRON AFTER THE INITIAL TECHNICAL EVALUATION AS HAVING "SIGNIFICANT CORPORATE EXPERIENCE AND A GOOD MANAGEMENT PLAN" APPLICABLE TO TRANSPORTATION TEST CENTER-TYPE OPERATIONS. WITHOUT ANY INDICATION FROM DOT OF DEFICIENCIES REGARDING TEST EXPERIENCE, DYNALECTRON ALLEGES THAT IT SUBMITTED ITS BEST AND FINAL PROPOSAL WITH ONLY MINOR CHANGES.

UPON FINAL TECHNICAL EVALUATION, DYNALECTRON POINTS OUT THAT DOT FOUND THAT DYNALECTRON'S CORPORATE TEST EXPERIENCE STEMMED MAINLY FROM ITS INVOLVEMENT AT THE TRANSPORTATION TEST CENTER AND THAT THE COMPANY COULD NOT DOCUMENT AT LEAST FOUR SIMILAR COMPLEX TEST OPERATION CONTRACTS LIKE THE ONE AT THE TRANSPORTATION TEST CENTER. DYNALECTRON ARGUES THAT IT NEVER HAD THE OPPORTUNITY THROUGH MEANINGFUL DISCUSSIONS TO OFFER DOT A BETTER PROPOSAL. IF IT HAD BEEN ADVISED OF ITS DEFICIENCIES IN THIS AREA, DYNALECTRON ASSERTS THAT IT WOULD HAVE FURNISHED ADDITIONAL INFORMATION ON THE CONTRACTS DISCUSSED IN DETAIL IN ITS PROPOSAL AND COULD HAVE PROVIDED ADDITIONAL INFORMATION WITH MORE SPECIFIC DETAIL ON THE OTHER CONTRACTS MENTIONED IN BOTH THE EXECUTIVE SUMMARY AND SECTION "I" PORTIONS OF ITS PROPOSAL. IN PARTICULAR, DYNALECTRON CONTENDS THAT IT WOULD HAVE ELABORATED ON ITS 31 YEARS OF CONTINUOUS PERFORMANCE AT THE NATIONAL AERONAUTICS AND SPACE ADMINISTRATION (NASA) WHITE SANDS MISSILE RANGE.

DOT STATES THAT DYNALECTRON'S CORPORATE TEST EXPERIENCE WAS, IN FACT, SCORED LOWER IN THE FINAL TECHNICAL EVALUATION. DOT FURTHER STATES THAT THIS WAS PRIMARILY BECAUSE THE TECHNICAL EVALUATORS IN THEIR INITIAL EVALUATION ERRONEOUSLY CONSIDERED PRIOR RAILROAD TESTING EXPERIENCE. ACCORDING TO DOT, RAILROAD EXPERIENCE WAS REMOVED FROM THE EVALUATION PROCESS IN THE FINAL EVALUATION BECAUSE IT WAS DETERMINED BY THE BOARD THAT RAILROAD EXPERIENCE WAS NOT SET FORTH IN THE RFP'S TECHNICAL EVALUATION CRITERIA. IN ANY EVENT, DOT ACKNOWLEDGES THAT DYNALECTRON DID, IN FACT, OPERATE ALL OF THE CONTRACT FACILITIES REFERENCED IN ITS PROPOSALS. IN THIS REGARD, DOT EMPHASIZES THAT DYNALECTRON'S SCORE WAS ONLY 0.3 BELOW WHAT WAS CONSIDERED A "MAJOR POSITIVE AREA" (STRENGTH) AND, THEREFORE, DYNALECTRON'S PROPOSAL IN THIS AREA CANNOT BE CONSIDERED WEAK OR DEFICIENT. B. INTERFACES AND DIALOGUE

DYNALECTRON ALLEGES THAT DOT WAS AGAIN ONLY ABLE TO IDENTIFY DEFICIENCIES IN THIS AREA AFTER THE SUBMISSION OF BEST AND FINAL OFFERS. DYNALECTRON POINTS OUT THAT DOT'S INITIAL TECHNICAL EVALUATION REPORT RATED DYNALECTRON'S PROPOSAL AS HAVING CLEARLY RECOGNIZED THE INTERFACE REQUIREMENTS AND AS HAVING AN EFFECTIVE SYSTEM TO ENSURE A CONTINUOUS DIALOGUE. HOWEVER, DYNALECTRON NOTES THAT THE FINAL TECHNICAL REPORT EVALUATED DYNALECTRON'S PROPOSALS AS HAVING NO INDICATION OF A CONTINUOUS REVIEW OR EVALUATION OF PROGRAMS AND AS GIVING ONLY MINIMAL ATTENTION TO THE INTERACTION OF VARIOUS OPERATION FUNCTIONS. DYNALECTRON ASSERTS THAT THE ABOVE-MENTIONED "DEFICIENCIES" DIRECTLY RELATE TO TECHNICAL EVALUATION CRITERIA SET FORTH IN THE RFP FOR THE ATTAINMENT OF THE MAXIMUM TECHNICAL SCORE. DESPITE THIS RELATIONSHIP, DYNALECTRON ARGUES THAT THE PROCUREMENT RECORD IS BARREN OF ANY DIRECT OR INDIRECT STATEMENTS THAT WOULD INDICATE THAT DYNALECTRON WAS NOT MEETING THE RFP'S EVALUATION CRITERIA IN THIS AREA. CONSEQUENTLY, DYNALECTRON ALLEGES THAT IT MADE ONLY MINOR CHANGES IN ITS TECHNICAL PROPOSALS FOR BEST AND FINAL OFFERS. FURTHERMORE, DYNALECTRON TAKES THE POSITION THAT HAD DOT IDENTIFIED THE "DEFICIENCIES" IT FOUND REGARDING INTERFACE AND GOVERNMENT/CONTRACTOR DIALOGUE, DYNALECTRON COULD HAVE TAKEN STEPS TO CLARIFY OR REVISE ITS PROCEDURES TO ELIMINATE THEM.

DOT CONTENDS THAT DYNALECTRON HAS IGNORED CERTAIN PORTIONS OF THE BOARD'S FINDINGS. DOT STATES THAT THE BOARD ALSO FOUND THAT THE DETAIL GIVEN BY DYNALECTRON TO INTERFACES AND DAILY CONTACTS WAS GOOD AND CONSIDERABLE ATTENTION WAS GIVEN TO OBJECTIVES AND MILESTONES. DOT ALSO CALLS OUR ATTENTION TO THE FACT THAT DYNALECTRON ACHIEVED AN EQUAL SCORE TO BOEING IN THIS AREA. THUS, DOT BELIEVES THAT NO DEFICIENCY EXISTED IN DYNALECTRON'S PROPOSALS WITH REGARD TO INTERFACE AND DIALOGUE. FURTHERMORE, DOT URGES THAT IT WOULD HAVE BEEN INEQUITABLE AND UNFAIR TO OTHER OFFERORS FOR IT TO HAVE SUGGESTED WAYS FOR DYNALECTRON, THE INCUMBENT CONTRACTOR AT THE TIME, TO IMPROVE ITS ALREADY MORE THAN ACCEPTABLE PROPOSAL.

C. PLANNING AND WORK CONTROL

DYNALECTRON DIRECTS OUR ATTENTION TO THE FACT THAT DOT'S BOARD SCORED THE COMPANY 18 POINTS LOWER IN THE FINAL TECHNICAL EVALUATION AS A RESULT OF DYNALECTRON'S "CONTINUED INABILITY TO RECOGNIZE TEST EVALUATION PROBLEMS AND PROPOSE SOUND SOLUTION." ALSO, THE BOARD FOUND THAT DYNALECTRON'S COST TRACKING SYSTEM FOR THE TASK/WORK ORDER SYSTEM WOULD NOT MEET THE 7- DAY TURNAROUND REQUIREMENT FOR TOP PERFORMANCE. GIVEN THE FACT THAT ITS INITIAL TECHNICAL EVALUATION WAS SO MUCH HIGHER THAN ITS FINAL SCORE, DYNALECTRON TAKES THE POSITION THAT IT MET ALL THE RFP CRITERIA FOR PLANNING AND WORK CONTROL. AGAIN, DYNALECTRON ASSERTS THAT AFTER BEST AND FINAL OFFERS ITS PROPOSALS WERE SEVERLY DOWNGRADED WITHOUT ANY OPPORTUNITY BEING GIVEN TO DYNALECTRON TO CORRECT THEM.

DOT STATES THAT DYNALECTRON'S FINAL SCORE WAS A TOTAL 18 POINTS LOWER FOR ALL FACTORS, NOT JUST PLANNING AND WORK CONTROL. DOT INDICATES THAT THE OVERALL LOWER SCORE WAS IN PART BECAUSE FOR EACH TECHNICAL EVALUATION FACTOR POINT A SCORE OF 5, AS OPPOSED TO 7 IN THE INITIAL EVALUATION, WAS MADE "AVERAGE." DOT ALSO EMPHASIZES THAT THE LOWER SCORES ON THE FINAL EVALUATION WERE CONSISTENTLY LOWER FOR ALL OFFERORS, NOT JUST DYNALECTRON. FINALLY, DOT CONTENDS THAT TO HAVE CONTINUALLY NEGOTIATED WITH DYNALECTRON, SUGGESTING SPECIFIC WAYS FOR THE COMPANY TO IMPROVE ITS PROPOSAL IN THIS AREA, WOULD HAVE BEEN INEQUITABLE AND UNFAIR TO THE OTHER OFFERORS AND WOULD HAVE ULTIMATELY RESULTED IN TECHNICAL LEVELING.

D. KEY PERSONNEL AND COMPENSATION PLAN

DYNALECTRON ARGUES THAT DOT REPEATED THE SAME PATTERN IN EVALUATING DYNALECTRON'S KEY PERSONNEL AND COMPENSATION PLAN AS IT DID WITH THE OTHER AREAS OF DYNALECTRON'S PROPOSALS. ACCORDING TO DYNALECTRON, DOT'S INITIAL TECHNICAL ASSESSMENT WAS THAT ITS PROPOSAL SHOWED ABOVE AVERAGE ABILITY WITH REGARD TO PERSONNEL RECRUITMENT AND RETENTION THROUGH A REALISTIC COMPENSATION PLAN. MORE SPECIFICALLY, DYNALECTRON STATES THAT ITS INITIAL PROPOSAL WAS FOUND TO HAVE AN "EXCELLENT" COMPENSATION PLAN TO COVER 36 OF THE COMPANY'S TOP-SALARIED EMPLOYEES. ALSO, DYNALECTRON'S PROPOSAL WAS FOUND TO HAVE EXHIBITED A CAPABILITY TO ATTRACT CRITICAL, SKILLED PEOPLE. HOWEVER, IN THE FINAL TECHNICAL EVALUATION, DYNALECTRON POINTS OUT THAT DOT FOUND THAT IT HAD DEMONSTRATED A CONTINUED INABILITY TO ATTRACT AND RETAIN QUALIFIED PROFESSIONALS AND THAT THE PLAN TO PROVIDE A BONUS TO 30 KEY PERSONNEL WAS PROVEN TO BE OF LITTLE VALUE TO RETAIN EXPERIENCED SALARIED PERSONNEL. THUS, DYNALECTRON CONTENDS THAT, IF DOT HAD INFORMED IT THAT SPECIFIC ASPECTS WERE DEFICIENT, DYNALECTRON COULD HAVE OFFERED COMPENSATION PLAN IMPROVEMENTS.

DOT STATES THAT AT THE TIME OF THE PROCUREMENT THERE HAD BEEN A 100 PERCENT TURNOVER IN DYNALECTRON'S KEY PERSONNEL AT THE TRANSPORTATION TEST CENTER SINCE THE COMPANY HAD BEEN AWARDED THE OPERATION CONTRACT IN 1976. FURTHERMORE, THE INDIVIDUAL LISTED AS DYNALECTRON'S PROPOSED RAIL DYNAMICS LABORATORY MANAGER IN THE COMPANY'S INITIAL PROPOSAL LEFT THE TRANSPORTATION TEST CENTER PRIOR TO THE SUBMISSION OF BEST AND FINAL OFFERS. IN ADDITION, DOT STATES THAT THE BOARD KNEW THAT DYNALECTRON'S PROPOSED TECHNICAL SERVICE DIRECTOR HAD ACCEPTED ANOTHER POSITION WITHIN THE COMPANY. MOREOVER, DOT NOTES THAT DYNALECTRON'S PROPOSED DEPUTY SITE MANAGER RESIGNED FROM THE COMPANY PRIOR TO DOT'S ANNOUNCEMENT OF THE AWARD TO BOEING.

TURNING TO DYNALECTRON'S CONTENTION THAT ITS COMPENSATION PACKAGE COULD HAVE BEEN IMPROVED IF ITS WEAKNESSES HAD BEEN POINTED OUT, DOT DECLARES THAT IT DID ASK DYNALECTRON IN WRITING FOR ADDITIONAL INFORMATION ON DYNALECTRON'S CORPORATE INCENTIVE COMPENSATION PLAN AND DYNALECTRON WAS QUESTIONED IN WRITING AS TO THE PLAN'S AWARD FEE RELATIONSHIP BETWEEN PROPOSED COSTS AND PROBABLE COSTS. MORE IMPORTANTLY, DOT STATES THAT IN DYNALECTRON'S ORAL PRESENTATION IT WAS MADE CLEAR THAT DYNALECTRON WAS PROPOSING COMPENSATION, INCENTIVE AND BONUS PLANS THAT WERE IN PART INTENDED TO ADDRESS THE PROBLEM OF THE HIGH TURNOVER OF PROFESSIONAL AND TRAINED TECHNICAL PERSONNEL AT THE TRANSPORTATION TEST CENTER - A PROBLEM DYNALECTRON ACKNOWLEDGED WAS OF GREAT CONCERN TO IT AS THE THEN INCUMBENT CONTRACTOR. DOT FURTHER STATES THAT VARIOUS ASPECTS OF COMPENSATION AND PERSONNEL PLANS, AS WELL AS INCENTIVE AND BONUS PLANS, WERE DISCUSSED AT THE NEGOTIATION MEETING AND THAT CHANGES WERE MADE IN DYNALECTRON'S FINAL PLAN FOR CRITICAL SKILL COMPENSATION.

FURTHERMORE, DOT ASSERTS THAT, AS THE INCUMBENT CONTRACTOR, DYNALECTRON HAD AN ADVANTAGE OVER THE OTHER OFFERORS ON ITS INTIMATE KNOWLEDGE OF TRANSPORTATION TEST CENTER OPERATIONS. IN THIS REGARD, DOT NOTES THAT DYNALECTRON EXPRESSED A CONCERN TO IT THAT DISCUSSIONS NOT BE CONDUCTED WITH THE OTHERS WHICH MIGHT RESULT IN THE TECHNICAL LEVELING OF PROPOSALS. THEREFORE, DOT BELIEVES THAT IT IS INCONGRUOUS FOR DYNALECTRON TO CONTEND THAT DOT DID NOT ADEQUATELY INFORM DYNALECTRON OF MATTERS WHICH DYNALECTRON MAY NOT HAVE WANTED DOT TO DISCUSS WITH OTHER OFFERORS.

E. SUBCONTRACTING AND BATTELLE COLUMBUS LABORATORY

DYNALECTRON ARGUES THAT IN THE VARIOUS CORRESPONDENCE BETWEEN IT AND DOT DURING THE EVALUATION PROCESS, IN THE ORAL PRESENTATION, AND IN THE ORAL NEGOTIATIONS, DOT DID NOT POINT OUT DEFICIENCIES WHICH IT FOUND IN DYNALECTRON'S PROPOSALS REGARDING THE COMPANY'S SUBCONTRACTING PLAN - IN PARTICULAR, THE PROPOSED USE OF BATTELLE COLUMBUS LABORATORY. DYNALECTRON'S OPINION, DOT DID NOT RAISE ANY SUBSTANTIVE ISSUES REGARDING DYNALECTRON'S SUBCONTRACTING PLAN IN EITHER THE ORAL PRESENTATION OR IN THE ORAL NEGOTIATIONS. FURTHER, DYNALECTRON ARGUES THAT FROM THE QUESTIONS DOT RAISED IN THIS AREA, NEITHER DYNALECTRON NOR ANY OTHER OFFER COULD HAVE CONCLUDED THAT DEFICIENCIES WERE PRESENT. RATHER, DYNALECTRON BELIEVES THAT IN ITS QUESTIONS DOT DWELLED ON WHAT CAN ONLY BE CATEGORIZED AS MINUTE DETAILS.

IN RESPONSE, DOT DECLARES THAT BY A LETTER IN NOVEMBER 1979, IT REQUESTED FROM DYNALECTRON AN EXPLANATION OF BATTELLE STAFFING IN TERMS OF QUANTITY AND LOCATION (WHETHER ONSITE OR OFFSITE). IN ADDITION, DOT INDICATES THAT BY LETTER OF JANUARY 25, 1980, IT REQUESTED CLARIFICATION OF DYNALECTRON AS TO: (1) THE ROLE OF BATTELLE'S SITE MANAGER, (2) WHO WOULD EVALUATE SUBCONTRACT PERFORMANCE, (3) HOW JOINT BATTELLE/DYNALECTRON EFFORTS WOULD BE MONITORED AND MANAGED, AND (4) THE NUMBER OF YEARS BATTELLE WOULD BE ONSITE. IN THE ORAL PRESENTATION, DOT STATES THAT IT SPECIFICALLY ADDRESSED ITS LACK OF UNDERSTANDING OF THE DYNALECTRON/BATTELLE CONTRACTUAL RELATIONSHIPS, THE LEVEL OF EFFORT BATTELLE WOULD PROVIDE AND THE METHOD OF EVALUATING BATTELLE'S PERFORMANCE.

DOT ALSO STATES THAT DURING ORAL DISCUSSIONS IT REQUESTED DYNALECTRON TO PROVIDE A MORE DETAILED PROPOSAL RELATIVE TO THE TERMS AND CONDITIONS UNDER WHICH BATTELLE WOULD PERFORM. ACCORDING TO DOT, IT WAS DURING ORAL DISCUSSIONS THAT DYNALECTRON ANNOUNCED A NEW APPROACH TO ITS INVOLVEMENT WITH BATTELLE, THAT IS, BATTELLE WOULD BE USED ONLY ON AN AS-NEEDED BASIS. IN THIS REGARD, DOT CALLS OUR ATTENTION TO DYNALECTRON'S APRIL 15, 1980, LETTER CONFIRMING NEGOTIATIONS IN WHICH DYNALECTRON STATED THAT IT WOULD BE REVISING ITS TECHNICAL AND COST PROPOSALS RELATIVE TO BATTELLE AND THAT THE COMPANY'S BASIC AGREEMENT WITH BATTELLE WOULD BE INCLUDED IN ITS FINAL PROPOSAL. DOT STATES, MOREOVER, THAT, ALTHOUGH DYNALECTRON IN ITS POST NEGOTIATION DOCUMENTATION STATED THAT A COPY OF THE BATTELLE SUBCONTRACT WOULD BE SUBMITTED WITH ITS FINAL TECHNICAL PROPOSAL, NO COPY WAS PROVIDED BY DYNALECTRON WITH ITS FINAL PROPOSAL.

IN VIEW OF THE FOREGOING, DOT TAKES THE POSITION THAT IT DID RAISE SUBSTANTIVE ISSUES REGARDING BATTELLE AND THAT DYNALECTRON WAS AWARE OF THE AGENCY'S CONCERNS REGARDING THE TERMS AND CONDITIONS OF THE BATTELLE SUBCONTRACT. CONSEQUENTLY, DOT BELIEVES THAT DYNALECTRON'S ALLEGATIONS AS TO NO SUBSTANTIVE COMMUNICATIONS OR DISCUSSIONS IN THIS AREA ARE UNFOUNDED.

F. QUALITY ASSURANCE PLAN

DYNALECTRON ASSERTS THAT DOT'S FAILURE TO CONDUCT MEANINGFUL DISCUSSIONS IS MOST VISIBLE WITH RESPECT TO THE AGENCY'S CONSIDERATION OF THE COMPANY'S QUALITY ASSURANCE PLAN. DYNALECTRON ALLEGES THAT DOT RATED ITS PLAN AS UNACCEPTABLE BECAUSE THE PLAN MISSED CERTAIN KEY RFP REQUIREMENTS. DYNALECTRON ASSERTS THAT DESPITE DOT'S LOW EVALUATION OF DYNALECTRON'S QUALITY ASSURANCE PLAN, DYNALECTRON NEVER RECEIVED ONE COMMENT FROM DOT ON IT DURING THE ENTIRE SELECTION PROCESS.

DOT STATES THAT AN OFFEROR'S QUALITY ASSURANCE PLAN WAS OF "MINOR SIGNIFICANCE" AS AN EVALUATION FACTOR AND WAS MERGED WITH THE MORE SIGNIFICANT FACTORS OF SAFETY AND SECURITY. ALSO, DOT STATES THAT DYNALECTRON'S QUALITY ASSURANCE PLAN WAS DETERMINED TO BE UNACCEPTABLE BECAUSE DYNALECTRON SUBMITTED A PROPOSAL WHICH DID NOT EQUAL EVEN THE COMPANY'S THEN CURRENT TRANSPORTATION TEST CENTER OPERATIONS. IN DOT'S OPINION, IT WAS NOT APPROPRIATE FOR IT TO PROVIDE AFFIRMATIVE GUIDANCE TO DYNALECTRON BY SUGGESTING THAT DYNALECTRON PROPOSE NO LESS THAN WHAT THE COMPANY WAS THEN PROVIDING UNDER ITS THEN EXISTING OPERATIONS CONTRACT.

ANALYSIS

BEFORE COMMENTING ON DYNALECTRON'S ARGUMENTS WHY DOT FAILED TO CONDUCT MEANINGFUL DISCUSSIONS, WE THINK IT IS APPROPRIATE TO SET FORTH SEVERAL GENERAL PRINCIPLES CONCERNING OUR REVIEW IN THIS AREA.

FEDERAL PROCUREMENT REGULATIONS SEC. 1-3.805-1 (1964 ED. AMEND. 153) REQUIRES THAT ORAL OR WRITTEN DISCUSSIONS BE HELD WITH ALL OFFERORS IN A COMPETITIVE RANGE, AND WE HAVE RECOGNIZED THAT THIS MANDATE CAN BE SATISFIED ONLY BY DISCUSSIONS THAT ARE MEANINGFUL. UNION CARBIDE CORPORATION, 55 COMP.GEN. 802, 806 (1976), 76-1 CPD 134. HOWEVER, WE HAVE SPECIFICALLY REJECTED THE NOTION THAT AGENCIES ARE OBLIGATED UNDER THE ABOVE-CITED STATUTE TO AFFORD OFFERORS ALL-ENCOMPASSING NEGOTIATIONS. ALL -ENCOMPASSING NEGOTIATIONS MAY UNFAIRLY PREJUDICE THE RIGHTS OF OTHER COMPETING OFFERORS. IN PARTICULAR, DEFICIENCIES OR WEAKNESSES IN A PROPOSAL NEED NOT BE POINTED OUT WHEN TO DO SO COULD RESULT IN TECHNICAL "TRANSFUSION" (DISCLOSURE OF ONE OFFEROR'S INNOVATIVE SOLUTION TO A PROBLEM) OR TECHNICAL "LEVELING" (HELPING ONE OFFEROR BRING HIS ORIGINAL INADEQUATE PROPOSAL UP TO THE LEVEL OF OTHER ADEQUATE PROPOSALS BY POINTING OUT WEAKNESSES RESULTING FROM LACK OF DILIGENCE OR COMPETENCE). 52 COMP.GEN. 870 (1973); 51 COMP.GEN. 621 (1972).

FURTHER, THE CONTENT AND EXTENT OF MEANINGFUL DISCUSSIONS IN A GIVEN CASE IS A MATTER OF JUDGMENT PRIMARILY FOR DETERMINATION BY THE AGENCY INVOLVED AND THAT DETERMINATION IS NOT SUBJECT TO QUESTION BY OUR OFFICE UNLESS IT IS CLEARLY WITHOUT A REASONABLE BASIS. WASHINGTON SCHOOL OF PSYCHIATRY, B-189702, MARCH 7, 1978, 78-1 CPD 176; SYSTEMS ENGINEERING ASSOCIATES CORPORATION, B-187601, FEBRUARY 24, 1977, 77-1 CPD 137. SUCH MATTERS ARE NOT SUBJECT TO ANY FIXED, INFLEXIBLE RULE. 53 COMP.GEN. 240, 247 (1973). NEVERTHELESS, GOVERNMENT NEGOTIATORS SHOULD BE AS SPECIFIC AS PRACTICAL CONSIDERATIONS WILL PERMIT IN ADVISING OFFERORS OF THE CORRECTIONS REQUIRED IN THEIR PROPOSALS. 52 COMP.GEN. 466, 468 (1973).

WITH THESE GENERAL PRINCIPLES IN MIND, WE WILL NOW COMMENT ON THE PROTESTER'S ARGUMENTS. OUR COMMENTS ARE KEYED TO THE ABOVE-LETTERED PARAGRAPHS.

A. RFP TECHNICAL EVALUATION CRITERIA FACTOR IA REQUIRED OFFERORS TO DEMONSTRATE CORPORATE EXPERIENCE IN PERFORMING TESTING, DATA COLLECTION AND EVALUATION AND HOW THE OFFERORS PROPOSED TO USE THE EXPERIENCE AT THE TRANSPORTATION TEST CENTER. IN ITS FINAL REPORT, DOT'S BOARD CONCLUDED THAT OUTSIDE THE TRANSPORTATION TEST CENTER CONTRACT DYNALECTRON WAS WEAK IN INSTRUMENTATION AND COMPLEX DATA ANALYSIS EXPERIENCE. WE BELIEVE IT IS CLEAR THAT THE BOARD WAS NOT QUESTIONING WHETHER DYNALECTRON DID IN FACT OPERATE ALL OF THE CONTRACT FACILITIES REFERENCED IN ITS PROPOSAL. RATHER, IT DETERMINED THAT DYNALECTRON'S INVOLVEMENT UNDER THOSE CONTRACTS CONSISTED MAINLY OF MAINTAINING THE FACILITIES AND EQUIPMENT. THE COMPANY ITSELF PERFORMED FEW OF THESE FACILITIES' COMPLEX TEST OPERATIONS. UNDER THE CIRCUMSTANCES, WE SEE NO REASON, THEN, FOR DOT TO HAVE ENGAGED IN EXTENSIVE DISCUSSIONS WITH DYNALECTRON IN THIS AREA. DOT'S BOARD CAREFULLY EXAMINED THE CONTRACTS SET FORTH IN DYNALECTRON'S PROPOSAL AND FOUND THAT DYNALECTRON'S EXPERIENCE WAS NOT SIMILAR TO THE TRANSPORTATION TEST CENTER IN TERMS OF PERFORMING TESTING OPERATIONS. THE RECORD SHOWS THAT DOT'S TECHNICAL EVALUATORS CONTACTED THE GOVERNMENT CONTRACTING OFFICERS AND CONTRACT MONITORS FOR THESE CONTRACTS AND DISCUSSED THE NATURE OF DYNALECTRON'S PERFORMANCE ON THEM. FURTHERMORE, IN VIEW OF THE FACT THAT DYNALECTRON ATTAINED A HIGH SCORE FOR CORPORATE EXPERIENCE, WE AGREE WITH DOT THAT DYNALECTRON'S PROPOSAL CANNOT BE DEEMED TO HAVE BEEN DEFICIENT IN THIS AREA. WE BELIEVE THAT WHATEVER INADEQUACIES DYNALECTRON HAD RELATED MAINLY TO INADEQUACIES FOUND IN COMPARISON WITH THE SUPERIOR SCORE OF BOEING. SEE GOULD, INC., B-192930, MAY 7, 1979, 79-1 CPD 311.

B. IN ADDITION TO THE STATEMENTS REFERENCED BY DYNALECTRON, DOT'S BOARD STATED IN ITS FINAL REPORT:

"DYNALECTRON PRESENTS AN UNDERSTANDING OF THE TEST COMPLEXITIES AND INTERFACE FUNCTIONS AS THEY EXIST AT THE TEST CENTER. HOWEVER, THEIR UNDERSTANDING AND PROBLEM RECOGNITION IS BASED MAINLY ON TEST CENTER EXPERIENCES WHERE PERFORMANCE HAS BEEN AVERAGE. THERE IS LITTLE EVIDENCE OF SOLVING INTERFACE PROBLEMS ON A CONTINUING BASIS ***."

THE RECORD SHOWS THAT ALTHOUGH DYNALECTRON'S PROPOSAL CONTAINED SOME WEAKNESSES, THE COMPANY WAS FOUND TO HAVE GIVEN GOOD DETAIL TO INTERFACES AND, OVERALL, THE COMPANY'S UNDERSTANDING OF THE RFP'S INTERFACE REQUIREMENTS WAS RATED AS ACCEPTABLE. THEREFORE, WE CANNOT SAY THAT DOT WAS ARBITRARY OR UNREASONABLE IN NOT DISCUSSING THIS ASPECT OF DYNALECTRON'S PROPOSAL. WE THINK THAT DYNALECTRON IS, IN EFFECT, CONTENDING THAT DOT SHOULD HAVE DISCUSSED EACH AREA OF ITS PROPOSAL RECEIVING LESS THAN THE MAXIMUM SCORE. AS WE STATED IN WASHINGTON SCHOOL OF PYSCHIATRY, SUPRA, THERE IS NO REQUIREMENT TO DISCUSS ALL INFERIOR ASPECTS OF AN OTHERWISE TECHNICALLY ACCEPTABLE PROPOSAL.

C. RFP FACTOR IG REQUIRED OFFERORS TO PROVIDE METHODS OF FURNISHING WORK CONTROL AND PLANNING IN ALL FUNCTIONAL AREAS INCLUDING TASK MANAGEMENT, COST TRACKING AND STATUS REPORTING. ALSO, UNDER RFP FACTOR IVC, OFFERORS WERE REQUIRED TO SUBMIT INFORMATION WHICH CLEARLY DEMONSTRATED EXPERIENCE AND PERFORMANCE UNDER CONTRACT TO OTHER GOVERNMENT AND COMMERCIAL ORGANIZATIONS FROM THE STANDPOINT OF DETAILED PLANNING OF PROJECTS, ABILITY TO MEET SCHEDULES AND CONTROL COSTS. IN ITS FINAL REPORT, DOT'S BOARD STATED:

"AS THE INCUMBENT, DYNALECTRON HAS A GOOD UNDERSTANDING OF THE TASK ORDER/WORK ORDER SYSTEM INCLUDING THE COMPLEX INTERFACES INVOLVED. AS PROPOSED, THE COST TRACKING SYSTEM WILL NOT MEET THE 7-DAY TURN-AROUND REQUIRED FOR TOP PERFORMANCE. STEPS, INITIATED BY THE RFP, ARE UNDERWAY TO TRANSFER THE SYSTEM TO ON-SITE BUT ARE NOT NOTED IN THE PROPOSAL. PROVEN PLANNING AND SCHEDULING PERFORMANCE IS LACKING."

OVERALL, THE BOARD RATED DYNALECTRON AS ACCEPTABLE WITH REGARD TO WORK/COST CONTROL, PLANNING, SCHEDULING AND REPORTING.

MORE IMPORTANTLY, IT APPEARS FROM THE RECORD THAT DYNALECTRON ERRED IN ARGUING THAT ITS PLANNING AND WORK CONTROL DEFICIENCIES WERE SCORED BY DOT UNDER RFP EVALUATION FACTOR II, UNDERSTANDING OF OPERATIONAL REQUIREMENTS AND PROBLEMS. WITH REGARD TO UNDERSTANDING OPERATIONAL REQUIREMENTS, MOREOVER, DYNALECTRON'S PROPOSAL WAS SCORED SECOND HIGHEST, HIGHER THAN BOEING'S. CONSEQUENTLY, WHILE THERE MAY HAVE BEEN SOME WEAKNESSES, WE DO NOT BELIEVE THAT DYNALECTRON'S PROPOSAL WAS DEFICIENT AS TO EITHER PLANNING AND WORK CONTROL OR UNDERSTANDING OPERATIONAL REQUIREMENTS.

WE NOTE THAT DOT DID DOWNGRADE DYNALECTRON'S PROPOSAL UNDER PLANNING AND WORK CONTROL BECAUSE THE COMPANY DID NOT MEET THE 7-DAY COST TRACKING REPORT TURNAROUND TIME. HOWEVER, IN ITS NOVEMBER 29, 1979, LETTER TO DYNALECTRON REQUESTING CLARIFICATION OF AMBIGUITIES IN DYNALECTRON'S PROPOSAL, DOT INFORMED THE COMPANY THAT ON ONE PAGE OF ITS PROPOSAL IT WAS STATED THAT COST REPORTS WERE TO BE ISSUED EVERY 2 WEEKS WHILE OTHER PAGES SAID WEEKLY. WE THINK THAT THE REQUEST FOR CLARIFICATION SHOULD HAVE LED DYNALECTRON TO ANY INADEQUACIES REGARDING TURNAROUND TIME FOR THE ISSUANCE OF COST-TRACKING REPORTS. WE HAVE HELD THAT QUESTIONS WHICH LEAD OFFERORS INTO AREAS OF THEIR PROPOSALS THAT ARE UNCLEAR ARE SUFFICIENT TO PUT THEM ON NOTICE THAT THEIR PROPOSALS MAY BE INADEQUATE IN THOSE AREAS. SEE, E.G., SYSTEMS CONSULTANTS, INC., B-187745, AUGUST 29, 1977, 77-2 CPD 153; ASC SYSTEMS CORPORATION, B-186865, JANUARY 26, 1977, 77-1 CPD 60.

D. IN OUR OPINION, PERSONNEL ISSUES AND COMPENSATION PLANS WERE DISCUSSED EXTENSIVELY WITH DYNALECTRON THROUGHOUT THE NEGOTIATION PROCESS. ADDITION, WE BELIEVE IT IS CLEAR THAT THE DISCUSSIONS WITH DYNALECTRON IN THIS AREA WERE UNDERTAKEN BECAUSE OF THE HIGH TURNOVER RATE OF DYNALECTRON'S KEY OPERATING PERSONNEL AT THE TRANSPORTATION TEST CENTER. AS TO DYNALECTRON'S COMPENSATION PLAN, DOT, IN LETTERS DATED JANUARY 25, 1980, AND MARCH 11, 1980, QUESTIONED AND REQUESTED ADDITIONAL INFORMATION CONCERNING VARIOUS ASPECTS OF THE COMPANY'S PROPOSED PLAN. WHATEVER WEAKNESS EXISTED IN DYNALECTRON'S PROPOSALS REGARDING ITS KEY PERSONNEL AND COMPENSATION PLANS WAS THE RESULT OF DYNALECTRON'S LACK OF DILIGENCE IN PREPARING THEM. WE HAVE STATED THAT THE CONTRACTING AGENCY NEED NOT POINT OUT WEAKNESSES IN A PROPOSAL WHICH ARE THE RESULT OF THE PROTESTER'S OWN LACK OF DILIGENCE, COMPETENCE OR INVENTIVENESS IN PREPARING HIS PROPOSAL. 51 COMP.GEN. 621, SUPRA; RAYTHEON SERVICE COMPANY; INFORMATICS INFORMATION SYSTEMS COMPANY, INC., B-194928, MARCH 25, 1980, 80-1 CPD 214.

E. WE ALSO BELIEVE THAT DOT'S CONCERNS WITH RESPECT TO DYNALECTRON'S BATTELLE SUBCONTRACT WERE DISCUSSED EXTENSIVELY WITH DYNALECTRON. IN THIS REGARD, THE RECORD REVEALS THE PROPOSED BATTELLE SUBCONTRACT WAS SUPPOSED TO UPGRADE DYNALECTRON'S OVERALL ABILITY TO PERFORM COMPLEX TESTING BECAUSE BATTELLE WOULD BE PROVIDING SPECIAL TESTING EXPERTISE FROM TIME TO TIME. THROUGHOUT THE PROCUREMENT - IN EVERY LETTER THAT WAS SENT TO DYNALECTRON SEEKING CLARIFICATIONS OR RAISING QUESTIONS - SOME MENTION WAS MADE BY DOT OF THE PROPOSED BATTELLE SUBCONTRACT. WE THINK, THEN, THAT THE RECORD ESTABLISHES THAT DOT'S DISCUSSION APPROACH IN THIS AREA WAS REASONABLE. AT MOST, DYNALECTRON HAS MERELY SHOWN THAT IT DISAGREES WITH DOT AS TO THE VALUE OF THE DISCUSSIONS THAT DID TRANSPIRE. THEREFORE, DYNALECTRON'S ARGUMENTS FAIL TO PROVIDE ANY BASIS FOR US TO CONCLUDE THAT MEANINGFUL DISCUSSIONS WERE NOT HELD. SEE PORTFOLIO ASSOCIATES, INC., B-192763, MAY 31, 1979, 79-1 CPD 384.

WE ALSO NOTE THAT DYNALECTRON ALLEGES THAT IT WAS DOWNGRADED IN THE GENERAL AREA OF SUBCONTRACTING WITHOUT BEING AFFORDED AN OPPORTUNITY TO IMPROVE ITS PROPOSAL. DOT STATES THAT IN THE FINAL EVALUATION REPORT ITS BOARD MADE NO MENTION OF THIS "MINOR ITEM." EVEN ASSUMING, THEN, THAT DYNALECTRON IS CORRECT IN CONTENDING THAT DOT SHOULD HAVE DISCUSSED SUBCONTRACTING, WE FAIL TO SEE HOW DYNALECTRON HAS BEEN PREJUDICED. THE RECORD SHOWS THAT THE ACTUAL DIFFERENCE IN SCORES BETWEEN DYNALECTRON'S INITIAL PROPOSAL AND ITS FINAL PROPOSAL WAS PRIMARILY BECAUSE RAILROAD TESTING EXPERIENCE WAS REMOVED AS AN EVALUATION CRITERIA AND BECAUSE OF DYNALECTRON'S FAILURE TO CLEARLY DEFINE THE NATURE AND EXTENT OF ITS INVOLVEMENT WITH BATTELLE.

F. THE RECORD REVEALS THAT QUALITY ASSURANCE WAS NOT AN INDEPENDENT FACTOR IN DOT'S TECHNICAL EVALUATION OF PROPOSALS. RATHER, IT WAS MERGED WITH SAFETY AND SECURITY FACTORS. DYNALECTRON'S FINAL SCORE FOR THE COMBINED FACTORS WAS SECOND HIGHEST, HIGHER THAN BOEING'S. UNDER THE CIRCUMSTANCES, THEN, IT IS CLEAR THAT DYNALECTRON'S PROPOSAL WAS NOT INADEQUATE OR DEFICIENT WITH REGARD TO THE COMBINED EVALUATION FACTORS. CONSEQUENTLY, WE SEE NO PREJUDICE TO DYNALECTRON FROM DOT'S NOT POINTING OUT TO THE COMPANY THAT ITS QUALITY ASSURANCE PLAN WAS UNACCEPTABLE.

BASIS FOR VARIANCES IN POINT SCORES

DYNALECTRON CONTENDS THAT DOT HAS NOT PROVIDED AN EXPLANATION AS TO HOW THE RATINGS GIVEN TO THE OFFERORS RELATE TO THEIR POINT SCORES. ACCORDING TO DYNALECTRON, THERE IS NO RATIONAL BASIS FOR THE VARIANCE IN RANKING OF THE OFFERORS UNDER EACH EVALUATION CRITERION WHEN SUCH RANKINGS ARE COMPARED TO THE BROAD SPECTRUM OF SCORES GIVEN FOR EACH RANKING. DYNALECTRON ALLEGES THAT IT FOUND NUMEROUS INCONSISTENCIES IN ITS REVIEW OF THE SCORING SHEETS OF DOT'S TECHNICAL EVALUATORS. DYNALECTRON FURTHER ALLEGES THAT IT FOUND DISCREPANCIES BETWEEN THE ADJECTIVE RATINGS AND THE POINT SCORES IN THE CHART OF SIGNIFICANT EVALUATION DISCRIMINATORS CONTAINED IN THE FINAL REPORT OF DOT'S BOARD. AS AN EXAMPLE, DYNALECTRON ALLEGES THAT A POINT SCORE OF 7.88 RATED ONLY "GOOD" WHILE AN IDENTICAL SCORE RATED "SUPERIOR." DYNALECTRON ALSO CITES AS EXAMPLES OTHER EVALUATION CRITERIA AREAS WHERE AN OFFEROR WITH A LOWER POINT SCORE WAS RANKED HIGHER THAN AN OFFEROR WITH A HIGHER POINT SCORE.

IN ADDITION, DYNALECTRON ASSERTS THAT DOT HAS FAILED TO COMPLY WITH THE REGULATORY REQUIREMENTS OF ITS ORDER 4200.11 (1972). DYNALECTRON EMPHASIZES THAT UNDER SECTION "H," PARAGRAPH (3)(A)2, OF THE ORDER, DOT'S BOARD MUST MAKE FINAL SUMMARY CHARTS OF WHAT IT CONSIDERS TO BE SIGNIFICANT DISCRIMINATORS AMONG THE PROPOSALS. DYNALECTRON FURTHER POINTS OUT THAT, UNDER PARAGRAPH (3)(B)2 OF SECTION "H," THE BOARD IS REQUIRED TO TRACE EVALUATION CRITERIA, WEIGHTS AND SCORING IN SUFFICIENT DETAIL TO PERMIT EXAMINATION OF THE RESULTS OF EACH EVALUATION DISCRIMINATOR TO THE FINAL RESULTS. DYNALECTRON GOES ON TO ARGUE THAT IN THE SCHEME SET FORTH IN ORDER 4200.11 FOR THE DETAILED TRACING OF EVALUATION THE SIGNIFICANT TECHNICAL DISCRIMINATORS ARE TO BE TIED TO POINT SCORES AND, IN TURN, THAT THE ADJECTIVAL RATINGS USED ON THE SIGNIFICANT DISCRIMINATORS ARE TO BE BASED ON A UNIFORM APPLICATION OF SCORING DIFFERENCES TO EACH DISCRIMINATOR. THUS, DYNALECTRON ASSERTS THAT THE ALLEGED LACK OF CONSISTENCY EVIDENCED IN THE TECHNICAL EVALUATOR'S SCORING SHEETS DEMONSTRATES DOT'S NONCOMPLIANCE WITH ORDER 4200.11.

IN RESPONSE, DOT STATES THAT EACH STEP OF THE PROCUREMENT PROCESS FROM THE SOLICITATION OF PROPOSALS TO THE AWARD OF THE CONTRACT WAS RECORDED. DOT BELIEVES THAT THE DOCUMENTATION IS BOTH EXTENSIVE AND VOLUMINOUS. ALSO, DOT NOTES THAT THE PROCUREMENT RECORD INCLUDES THE INITIAL AND FINAL SCORING SHEETS OF ALL PROPOSALS. THEREFORE, DOT TAKES THE POSITION THAT THERE WAS COMPLIANCE WITH ORDER 4200.11 AND THAT A DETAILED "AUDIT TRAIL" WAS MADE TRACING THE POINT SCORING TO THE TECHNICAL EVALUATION CRITERIA.

DOT ALSO STATES THAT, PURSUANT TO ORDER 4200.11, ITS BOARD DIRECTED THE PREPARATION OF A SIGNIFICANT DISCRIMINATOR CHART AS A SUBJECT OVERLAY TO THE WRITTEN REPORT OF ITS TECHNICAL EVALUATORS IN ORDER TO HIGHLIGHT AREAS OF TECHNICAL EVALUATION THAT WERE CLOSE, THAT A SIGNIFICANT DISCRIMINATOR CHART WAS DERIVED FROM THE WRITTEN REPORT OF THE TECHNICAL EVALUATORS AND THAT THE CHART WAS MERELY USED AS A SUPPLEMENT TO THE PRIMARY EVALUATION TOOL OF THE ACTUAL SCORES OF THE TECHNICAL EVALUATORS.

ANALYSIS

THE PROVISIONS OF DOT ORDER 4200.11 WHICH DYNALECTRON HAS REFERENCED IN SUPPORT OF ITS ARGUMENTS DEAL WITH THE PREPARATION OF THE WRITTEN REPORT OF THE BOARD'S EVALUATION FINDINGS TO THE SOURCE SELECTION OFFICIAL. APPEARS THAT THE ORDER IS A DOCUMENT SPELLING OUT INTERNAL OPERATING PROCEDURES RATHER THAN A PROCUREMENT REGULATION HAVING A BINDING EFFECT BETWEEN THE AGENCY AND THE OFFERORS. HOWEVER, IN ANY EVENT, WE DO NOT FIND THAT THERE WAS ANY VIOLATION OF THE ORDER. SUBPARAGRAPH 3C(3)(A)(2) OF SECTION "H" PROVIDES THAT THE BOARD'S FINDINGS SHALL INCLUDE, AS BACKGROUND, FINAL SUMMARY CHARTS OF WHAT THE BOARD CONSIDERS TO BE THE SIGNIFICANT DISCRIMINATORS AMONG PROPOSALS. SUBPARAGRAPH 3C(3)(B)(2) PROVIDES THAT THE BOARD REPORT SHALL INCLUDE, AS APPROPRIATE, THE EVALUATION CRITERIA, THE WEIGHTS GIVEN TO EACH EVALUATION AND THE SCORING OF THE PROPOSALS. THIS IS TO ALLOW THE SOURCE SELECTION OFFICIAL TO EXAMINE IN DETAIL EACH PHASE OF THE EVALUATION AND TO TRACE THE DISCRIMINATORS TO THE FINAL RESULTS. IN SHORT, WE BELIEVE THAT THESE PORTIONS OF DOT ORDER 4200.11 ARE DESIGNED TO GIVE THE SOURCE SELECTION OFFICIAL SUFFICIENT INFORMATION TO MAKE THE SELECTION DECISION.

FROM OUR REVIEW OF THE CONTENTS OF THE BOARD'S FINAL REPORT, WE BELIEVE THAT IT COMPLIED WITH THE ABOVE-MENTIONED REQUIREMENTS OF DOT ORDER 4200.11 FOR REPORT CONTENT. AS TO THE ALLEGED DISCREPANCIES BETWEEN THE POINT SCORES AND THE ADJECTIVE RATINGS ON THE SIGNIFICANT DISCRIMINATOR CHART, IT APPEARS FROM THE RECORD THAT THE ADJECTIVE RATINGS ON THE CHART WERE PRESENTED IN THE CONTEXT OF EACH OFFEROR'S TOTAL EVALUATION SCORE. ALSO, WE NOTE THAT DOT INDICATES THAT THE ADJECTIVE RATINGS ON THE CHART MAINTAINED A RELATIVITY TO THE UNDERLYING SCORES OF THE TECHNICAL EVALUATORS AND THAT THE SIGNIFICANT DISCRIMINATOR CHART DID NOT CHANGE OR ADD TO THE SCORES OF THE TECHNICAL EVALUATORS. IN ANY EVENT, WE THINK THAT THE BOARD'S FINAL REPORT CONTAINS A NARRATIVE DISCUSSION OF THE STRENGTHS AND WEAKNESSES OF EACH OFFERORS PROPOSAL SUFFICIENTLY DETAILED TO PROVIDE THE SOURCE SELECTION OFFICIAL WITH AN ADEQUATE FACTUAL BASIS FOR THE SELECTION DECISION. WITH REGARD TO THE INCONSISTENCIES THAT DYNALECTRON ALLEGES EXIST IN THE ACTUAL SCORING SHEETS OF THE TECHNICAL EVALUATORS, WE FIND THAT THE COMPANY HAS OFFERED NO SPECIFIC EXAMPLES OF SUCH INCONSISTENCIES. RATHER, IT APPEARS THAT IN REFERRING TO AREAS WHERE AN OFFEROR WITH A LOWER POINT SCORE WAS RANKED HIGHER THAN AN OFFEROR WITH A HIGHER POINT SCORE, DYNALECTRON IS MAKING ARGUMENTS PERTAINING TO ALLEGED INCONSISTENCIES IN THE SIGNIFICANT DISCRIMINATOR CHART CONTAINED IN THE BOARD'S FINAL REPORT.

PRESENCE OF DOT BOARD MEMBERS AT ORAL PRESENTATION DYNALECTRON HAS PRESENTED NO ARGUMENT IN SUPPORT OF ITS CONTENTION THAT THE OVERALL SELECTION PROCESS WAS PREJUDICED BECAUSE MEMBERS OF DOT'S BOARD WERE NOT PRESENT AT DYNALECTRON'S ORAL PRESENTATION. IN ANY EVENT, THE RECORD SHOWS THAT FOUR MEMBERS OF DOT'S BOARD WERE PRESENT AT DYNALECTRON'S ORAL PRESENTATION. AS TO THOSE MEMBERS WHO DID NOT ATTEND, WE HAVE HELD THAT ALL OF A BOARD'S TECHNICAL EVALUATORS NEED NOT RESCORE THE REVISED PROPOSALS SUBMITTED BY THE OFFERORS. SEE COLUMBIA RESEARCH CORPORATION, B-193154, MAY 15, 1979, 79-1 CPD 353. WE SEE NO REASON TO APPLY A DIFFERENT RULE WITH REGARD TO THE ATTENDANCE OF THE MEMBERS OF AN AGENCY'S EVALUATION BOARD AT AN OFFEROR'S ORAL PRESENTATION.

RATIONAL BASIS FOR TECHNICAL DETERMINATIONS

BEFORE SETTING FORTH DYNALECTRON'S ARGUMENTS IN SUPPORT OF ITS CONTENTION THAT THERE WAS NO RATIONAL BASIS FOR DOT'S TECHNICAL DETERMINATIONS, WE BELIEVE IT IS NECESSARY TO STATE THE GENERAL PRINCIPLES WHICH GOVERN OUR REVIEW OF AN AGENCY'S TECHNICAL EVALUATIONS.

THE DETERMINATION OF THE RELATIVE MERITS OF A PROPOSAL, PARTICULARLY WITH RESPECT TO TECHNICAL CONSIDERATIONS, IS PRIMARILY A MATTER OF ADMINISTRATIVE DISCRETION. DYNAMIC SCIENCE, INC., B-188472, JULY 20, 1977, 77-2 CPD 39. OUR FUNCTION IS NOT TO EVALUATE ANEW PROPOSALS SUBMITTED AND MAKE OUR OWN DETERMINATIONS AS TO THEIR RELATIVE MERITS. HOUSTON FILMS, INC. (RECONSIDERATION), B-184402, JUNE 16, 1976, 76-1 CPD 380. THAT FUNCTION IS THE RESPONSIBILITY OF THE CONTRACTING AGENCY WHICH MUST BEAR THE BURDEN OF ANY DIFFICULTIES RESULTING FROM A DEFECTIVE EVALUATION. MACMILLAN OIL COMPANY, B-189725, JANUARY 17, 1978, 78-1 CPD 37. IN LIGHT OF THIS, WE HAVE REPEATEDLY HELD THAT PROCURING OFFICIALS ENJOY A REASONABLE DEGREE OF DISCRETION IN EVALUATION OF PROPOSALS AND THAT THIS WILL NOT BE DISTURBED UNLESS SHOWN TO BE ARBITRARY OR IN VIOLATION OF THE PROCUREMENT LAWS AND REGULATIONS. PIASECKI AIRCRAFT CORPORATION, B-190178, JULY 6, 1978, 78-2 CPD 10.

ADDITIONALLY, THE PROTESTER HAS THE BURDEN OF AFFIRMATIVELY PROVING ITS CASE. C. L. SYSTEMS, INC., B-197123, JUNE 30, 1980, 80-1 CPD 448. THE FACT THAT THE PROTESTER DOES NOT AGREE WITH THE AGENCY'S EVALUATION OF ITS PROPOSAL DOES NOT IN ITSELF RENDER THE EVALUATION UNREASONABLE. KAMAN SCIENCES CORPORATION, B-190143, FEBRUARY 10, 1978, 78-1 CPD 117.

WITH THESE GENERAL PRINCIPLES IN MIND, WE WILL NOW EXAMINE DYNALECTRON'S ARGUMENTS.

A. CORPORATE TEST EXPERIENCE

DYNALECTRON CONTENDS THAT THERE IS NO EVIDENCE IN THE RECORD TO SUPPORT DOT'S FINDING THAT DYNALECTRON'S CORPORATE TEST EXPERIENCE STEMMED PRIMARILY FROM ITS INVOLVEMENT AT THE TRANSPORTATION TEST CENTER AND THAT DYNALECTRON COULD NOT DOCUMENT AT LEAST FOUR SIMILAR COMPLEX TEST OPERATIONS LIKE THE TRANSPORTATION TEST CENTER. IN DYNALECTRON'S OPINION, DOT IGNORED THE SUBSTANTIAL CORPORATE TEST EXPERIENCE IN ALL THE CONTRACTS OUTLINED IN ITS PROPOSAL, INCLUDING 31 YEARS OF CONTINUOUS PERFORMANCE BY DYNALECTRON AT THE NASA WHITE SANDS MISSILE RANGE. ALSO, DYNALECTRON ASSERTS THAT DOT'S REASSESSMENT OF THE COMPANY'S CORPORATE TEST EXPERIENCE CENTERED ON THE NASA WHITE SANDS TEST FACILITY (WSTF) CONTRACT HELD BY DYNALECTRON FROM 1972 TO 1975. ACCORDING TO DYNALECTRON, THIS CONTRACT PROVIDED A SUBSTANTIAL BASIS FOR ITS CORPORATE EXPERIENCE QUALIFICATIONS FOR AWARD OF THE TRANSPORTATION TEST CENTER CONTRACT IN 1976; YET, THIS TEST EXPERIENCE WAS DEEMED INADEQUATE IN 1980, EVEN THOUGH IT HAD BEEN SUBSTANTIALLY INCREASED BY 4 YEARS AS INCUMBENT CONTRACTOR AT THE TRANSPORTATION TEST CENTER.

MORE SPECIFICALLY, DYNALECTRON CHALLENGES THE FOLLOWING STATEMENT MADE IN THE REPORT DOT PREPARED ON THIS PROTEST:

"ACCORDING TO THE CONTRACTING OFFICER AT WSTF, THE TECHNICAL COMPLEXITY OF WORK INCREASED SIGNIFICANTLY AND THEREFORE THEY DETERMINED DYNALECTRON DID NOT HAVE THE CORPORATE TESTING EXPERIENCE THEY REQUIRED AND AS A RESULT A CONTRACT WAS AWARDED TO THE LOCKHEED CORPORATION, WHO WAS PRECEIVED TO BE TECHNICALLY STRONGER, AT A HIGHER PRICE."

DYNALECTRON HAS SUBMITTED A LETTER DATED JANUARY 5, 1980, FROM THE CONTRACTING OFFICER AT WSTF STATING THAT HE DID NOT REMEMBER TALKING TO ANYONE FROM DOT CONCERNING DYNALECTRON'S PERFORMANCE AT WSTF AND THAT HE WOULD NOT HAVE AGREED WITH THE ABOVE-QUOTED STATEMENT THEN OR NOW.

IN RESPONSE, DOT REITERATES THE FACT THAT THE TECHNICAL EVALUATORS DID DISCUSS WITH THE APPLICABLE CONTRACTING OFFICERS AND CONTRACT MONITORS THE CONTRACT FACILITIES THAT DYNALECTRON STATED IN ITS PROPOSAL IT OPERATED. DOT STATES THAT THE SIGNIFICANT REDUCTION IN DYNALECTRON'S TECHNICAL SCORE IN THIS AREA FROM THE INITIAL EVALUATION IS IN LARGE PART ATTRIBUTABLE TO THE INVESTIGATION OF DYNALECTRON'S PREVIOUS CONTRACTS TO ESTABLISH CORPORATE TEST EXPERIENCE IN OPERATIONS SIMILAR TO THE TRANSPORTATION TEST CENTER. DOT EMPHASIZES THAT THE TECHNICAL EVALUATORS' ULTIMATE CONCLUSION BASED ON THIS INVESTIGATION WAS THAT DYNALECTRON'S INVOLVEMENT ON THESE PREVIOUS CONTRACTS CONSISTED MAINLY OF MAINTAINING THE FACILITIES AND EQUIPMENT AND DYNALECTRON PERFORMED FEW OF THE COMPLEX TEST OPERATIONS AT THESE FACILITIES ITSELF.

IN ADDITION, DOT NOTES THAT DYNALECTRON'S EXPERIENCE AT WSTF FROM 1972 THROUGH 1975 DID PROVIDE A SUBSTANTIAL BASIS FOR AWARD OF THE TRANSPORTATION TEST CENTER CONTRACT TO IT IN 1976. DOT POINTS OUT, HOWEVER, THAT THE TECHNICAL REQUIREMENTS OF THE WORK AT THE TRANSPORTATION TEST CENTER HAVE INCREASED GREATLY SINCE THE 1976 COMPETITION FROM A ROLE OF SUPPORTING A TEST TO THE ROLE OF ACTUAL CONDUCTING A TEST, COLLECTING THE DATA AND EVALUATING THE RESULTS. THUS, DOT ASSERTS THAT DYNALECTRON'S PREVIOUS WSTF EXPERIENCE WAS NOT IN CONSONANCE WITH THE TRANSPORTATION TEST CENTER OPERATING REQUIREMENTS SET FORTH IN THE RFP.

B. KEY PERSONNEL

DYNALECTRON CHALLENGES THE BOARD'S FINDING THAT DURING THE PERIOD BETWEEN THE INITIAL AND FINAL TECHNICAL EVALUATION, DYNALECTRON LOST SEVERAL KEY TECHNICAL PEOPLE. DYNALECTRON ALLEGES THAT THE KEY TECHNICAL PEOPLE REFERRED TO BY THE BOARD WERE IDENTIFIED IN THE POST AWARD DEBRIEFING. DYNALECTRON GOES ON TO ARGUE THAT, UNDER THE TECHNICAL EVALUATION CRITERIA SET FORTH IN THE RFP, THE ABILITY TO RETAIN PERSONNEL APPLIED ONLY TO KEY TECHNICAL ENGINEERS AND MANAGEMENT, THAT IS, SALARIED EMPLOYEES. ACCORDING TO DYNALECTRON, NONE OF THE INDIVIDUALS IDENTIFIED AT THE POST AWARD DEBRIEFING WERE SALARIED EMPLOYEES. CONSEQUENTLY, DYNALECTRON BELIEVES THAT THE DOWNGRADING BY THE BOARD IN THIS AREA CANNOT BE JUSTIFIED.

DYNALECTRON ALSO QUESTIONS THE OVERALL DETERMINATION THAT THE COMPANY'S ACTIONS DEMONSTRATED A CONTINUED INABILITY TO ATTRACT AND RETAIN QUALIFIED PROFESSIONALS. IN THIS REGARD, DYNALECTRON ASSERTS THAT THE BOARD COMPLETELY IGNORED THE FACT THAT, BASED ON LOCAL AND STATE TURNOVER RATES, IT WAS WELL BELOW THE AVERAGE FOR PUEBLO AND FOR COLORADO ON THE WHOLE. DYNALECTRON FURTHER ASSERTS THAT THE LOSS OF THREE PEOPLE IN COMPARISON WITH ITS STAFF OF 168 AT THE TRANSPORTATION CENTER CANNOT BE SAID TO CONSTITUTE A SIGNIFICANT TURNOVER OF PERSONNEL. FINALLY, DYNALECTRON ARGUES THAT DOT IS IN ERROR WITH REGARD TO THE REASONS FOR THE TRANSFER OF SOME OF ITS KEY PEOPLE BECAUSE THE COMPANY MADE PLANS FOR THEM ELSEWHERE IN THE ORGANIZATION IN THE EVENT THE CONTRACT WAS NOT AWARDED TO IT.

DOT CONTENDS THAT DYNALECTRON HAS ATTEMPTED TO USE A NARROW INTERPRETATION OF THE RFP TO ESTABLISH THAT THE BOARD COULD NOT JUSTIFY DOWNGRADING DYNALECTRON'S FAILURE TO RETAIN NONSALARIED PERSONNEL. DOT STATES THAT THE RFP REQUIRED OFFERORS TO SUBMIT A RECRUITMENT PLAN FOR "ACQUIRING" SKILLED PROFESSIONALS AND TECHNICIANS, INCLUDING PLANS TO UTILIZE ONSITE PERSONNEL AS APPROPRIATE. WHILE THE REQUIREMENT MAY HAVE TECHNICALLY ONLY SPECIFIED PERSONNEL ACQUISITION, DOT BELIEVES THAT IT IS ILLOGICAL TO ASSUME THAT THE PURPOSE OF A COMPANY'S RECRUITMENT OF PERSONNEL IS OTHER THAN TO HAVE THEM CONTINUE IN THE COMPANY'S EMPLOY.

WITH REGARD TO THE TURNOVER OF DYNALECTRON'S PERSONNEL, DOT CALLS OUR ATTENTION TO THE FACT THAT SINCE THE 1976 CONTRACT COMPETITION FOR THE TRANSPORTATION TEST CENTER THERE HAS BEEN A 100-PERCENT TURNOVER IN DYNALECTRON'S KEY PERSONNEL.

C. PLANNING AND WORK CONTROL

DYNALECTRON CONTENDS THAT DOT'S EVALUATION OF ITS PROPOSED 7-DAY TURNAROUND PERIOD FOR COST TRACKING REPORTS WAS IRRATIONAL. DYNALECTRON ASSERTS THAT NO TIME REQUIREMENT IS MENTIONED IN THE RFP FOR COST REPORTS EVEN THOUGH IT APPEARS FROM THE EVALUATION THAT DOT WAS IMPLYING THERE WAS ONE. DYNALECTRON FURTHER ASSERTS THAT, EVEN THOUGH IT SPECIFICALLY STATED THAT IT WOULD MEET THE 7-DAY TURNAROUND TIME, DOT STILL DOWNGRADED ITS PROPOSAL IN THIS AREA.

DYNALECTRON ALSO DISAGREES WITH DOT'S CONCLUSION THAT DYNALECTRON SHOULD HAVE UPDATED ITS FINAL PROPOSAL TO SET FORTH THE EXACT PLAN FOR TRANSFERRING DYNALECTRON'S COST TRACKING SYSTEM FROM THE COMPANY'S CORPORATE OFFICE TO THE TRANSPORTATION TEST CENTER. DYNALECTRON CONTENDS THAT AT THE TIME FOR SUBMISSION OF FINAL PROPOSALS NO NEED EXISTED FOR DYNALECTRON TO UPDATE ITS PROPOSAL. MORE SPECIFICALLY, DYNALECTRON CONTENDS THAT THE ACTUAL IMPLEMENTATION OF THE TRANSFER PLAN WAS CONTINGENT ON A COMPUTER BECOMING OPERATIONALLY READY AT THE TRANSPORTATION TEST CENTER. ACCORDING TO DYNALECTRON, THE TRANSPORTATION TEST CENTER COMPUTER WAS NOT OPERATIONALLY READY AT THE TIME OF BEST AND FINALS.

DOT STATES THAT IN ITS FINAL PROPOSAL DYNALECTRON DID NOT STATE THAT A 7- DAY TURNAROUND WOULD BE MET FOR COST TRACKING REPORTS. DYNALECTRON MERELY STATED THAT REPORTS WOULD BE ISSUED WEEKLY. AS TO DYNALECTRON'S PLAN FOR TRANSFERRING ITS COST TRACKING SYSTEM TO THE TRANSPORTATION TEST CENTER, DOT STATES DYNALECTRON ONLY INDICATED IN ITS FINAL PROPOSAL THAT "AS SOON AS POSSIBLE" IN THE NEW CONTRACT IT WOULD MOVE ITS COST TRACKING SYSTEM AND THAT ANALYSIS OF THE NEEDED PROGRAM CHANGES WOULD BEGIN "AS SOON AS" DOT AWARDED THE TRANSPORTATION TEST CENTER COMPUTER CONTRACT. DOT FURTHER STATES THAT THE COMPUTER CONTRACT HAD BEEN AWARDED 4 MONTHS BEFORE THE TIME FOR SUBMISSION OF FINAL PROPOSALS.

D. BATTELLE SUBCONTRACT

DYNALECTRON ARGUES THAT DOT HAS AMPLE ASSURANCE THAT BATTELLE WAS A "COMMITTED TEAM MEMBER" OF DYNALECTRON. IN THIS REGARD, DYNALECTRON ALLEGES THAT DOT'S BOARD HAD A WRITTEN LETTER OF INTENT FROM BATTELLE FURNISHED BY DYNALECTRON'S PROPOSAL. DYNALECTRON ALSO ASSERTS THAT THE BOARD HAD DETAILED ORAL ASSURANCES OF TWO BATTELLE OFFICIALS GIVEN AT THE COMPANY'S ORAL PRESENTATION AND A COPY OF A WRITTEN BINDING AGREEMENT THAT DYNALECTRON HAD WITH BATTELLE TO USE THAT COMPANY IN A TECHNICAL SUPPORT ROLE IN THE EVENT THE TRANSPORTATION TEST CENTER CONTRACT WAS AWARDED TO DYNALECTRON. MORE SPECIFICALY, DYNALECTRON CHARGES THAT THE BOARD KNEW THAT DYNALECTRON HAD ENTERED INTO A WRITTEN, FORMAL, BINDING AGREEMENT WITH BATTELLE COMMITTING ITSELF TO PAY A MINIMUM FEE OF $40,000 PER YEAR EVEN IF NO WORK WAS CALLED FOR AND TO NEGOTIATE A DEFINITIZED SUBCONTRACT IF DYNALECTRON WAS AWARDED THE TRANSPORTATION TEST CENTER CONTRACT. ACCORDING TO DYNALECTRON, A COPY OF THE BATTELLE AGREEMENT WAS SUBMITTED WITH DYNALECTRON'S FINAL COST PROPOSAL RATHER THAN ITS FINAL TECHNICAL PROPOSAL.

DOT STATES THAT BETWEEN INITIAL AND FINAL PROPOSAL EVALUATION, DYNALECTRON INSTITUTED A MAJOR REDIRECTION OF ITS USE OF BATTELLE. DOT STATES THAT IN ITS FINAL PROPOSAL DYNALECTRON ELIMINATED ALL ONSITE BATTELLE STAFF AND ASSOCIATED COSTS AND IN ITS PLACE PROPOSED AN ON CALL ARRANGEMENT. AS TO THE DEFINITIZED AGREEMENT BETWEEN DYNALECTRON AND BATTELLE, DOT INDICATES THAT DURING NEGOTIATIONS IT NEITHER REQUESTED NOR REQUIRED A DEFINITIZED SUBCONTRACT, BUT IT DID ASK FOR A DEFINITIVE PROPOSAL SETTING FORTH BATTELLE'S TESTING INVOLVEMENT. ACCORDING TO DOT, HOWEVER, THE AGREEMENT DYNALECTRON ULTIMATELY SUBMITTED WAS DATED OCTOBER 5, 1979, PREDATING DYNALECTRON'S INITIAL PROPOSAL SUBMISSION BY 1 MONTH. THUS, DOT ARGUES THAT THIS AGREEMENT DID NOT REFLECT ANY CHANGES RELATIVE TO DYNALECTRON'S MAJOR REDIRECTION OF THE PROPOSED USE OF BATTELLE. DOT EMPHASIZES, MOREOVER, THAT THE AGREEMENT SUBMITTED WAS NOT SPECIFIC IN ANY TECHNICAL AREA.

IN ADDITION, DOT STATES THAT THE BATTELLE AGREEMENT PROVIDED NO SPECIFIC CONTRACT COST INFORMATION AND, THEREFORE, COULD ONLY BE CONSIDERED AS PART OF DYNALECTRON'S TECHNICAL PROPOSAL. AS SUPPLEMENTAL INFORMATION TO DYNALECTRON'S TECHNICAL PROPOSAL, DOT STATES, HOWEVER, THAT THE AGREEMENT WAS LATE SINCE IT WAS SUBMITTED AFTER THE DATE TECHNICAL PROPOSALS WERE DUE. THE LATE AGREEMENT, THEN, WAS NOT PROVIDED TO THE BOARD.

ANALYSIS

(KEYED TO ABOVE-LETTERED PARAGRAPHS)

A. WE FAIL TO UNDERSTAND DYNALECTRON'S ALLEGATION THAT DOT IGNORED THE CORPORATE TEST EXPERIENCE IN THE CONTRACTS OUTLINED IN ITS PROPOSAL SINCE DOT EXPLICITYLY STATES THAT THE TECHNICAL EVALUATORS CONDUCTED AN INVESTIGATION OF DYNALECTRON'S PREVIOUS CONTRACTS TO ESTABLISH CORPORATE TEST EXPERIENCE IN OPERATIONS SIMILAR TO THE TRANSPORTATION TEST CENTER. DYNALECTRON HAS PROVIDED NO ARGUMENT CONCERNING THE NATURE AND EXTENT OF ITS TEST EXPERIENCE AS CONTRACTOR FOR 31 YEARS AT THE NASA WHITE SANDS MISSILE RANGE. AS TO DYNALECTRON'S EXPERIENCE FROM 1972 TO 1975 AT WSTF, WE THINK THAT DOT HAS SUFFICIENTLY ESTABLISHED THAT DYNALECTRON'S TEST EXPERIENCE AT WSTF WAS LIMITED AND NOT IN CONSONANCE WITH THE RFP'S TEST REQUIREMENTS. WITH REGARD TO DYNALECTRON'S ATTEMPT TO DISCREDIT DOT'S INVESTIGATION OF DYNALECTRON'S TEST EXPERIENCE, WE NOTE THAT DOT INSISTS THAT ONE OF ITS TECHNICAL EVALUATORS DID IN FACT HAVE A TELEPHONE CONVERSATION IN JUNE OR JULY 1980 WITH THE CONTRACTING OFFICER AT WSTF AND THAT THE TECHNICAL EVALUATOR DISCUSSED THE PERFORMANCE OF BOTH DYNALECTRON AND LOCKHEED CORPORATION AT WSTF WITH PARTICULAR EMPHASIS PLACED ON THE RELATIVE MAGNITUDE AND COMPLEXITY OF WSTF ACTIVITIES DURING THE RESPECTIVE TENURE OF THE TWO COMPANIES. IN THIS REGARD, DOT HAS SUBMITTED AN AFFIDAVIT FROM THE TECHNICAL EVALUATOR SETTING FORTH THE DETAILS OF THE ABOVE-MENTIONED DISCUSSION. MOREOVER, DOT HAS ATTACHED TO THE EVALUATOR'S AFFIDAVIT SEVERAL DOCUMENTS GIVEN TO IT BY NASA. THESE NASA DOCUMENTS FURTHER VERIFY, IN OUR OPINION, THE FACTUAL CONTENT OF THE STATEMENTS MADE IN THE AFFIDAVIT OF THE TECHNICAL EVALUATOR.

B. WE BELIEVE THAT DYNALECTRON HAS OFFERED LITTLE EVIDENCE TO SHOW THAT DOT'S BOARD INCORRECTLY CONCLUDED THAT DYNALECTRON HAD EXPERIENCED A VERY HIGH TURNOVER IN BOTH PROFESSIONALS AND TECHNICIANS DURING THE PERIOD OF TIME THAT IT WAS OPERATING CONTRACTOR AT THE TRANSPORTATION TEST CENTER. THE SEVERAL KEY TECHNICAL PEOPLE THAT DYNALECTRON LOST DURING THE PERIOD BETWEEN TECHNICAL EVALUATIONS WERE MERELY CITED BY DOT'S BOARD AS A FURTHER DEMONSTRATION OF DYNALECTRON'S CONTINUED INABILITY TO ATTRACT AND RETAIN QUALIFIED PROFESSIONALS. MORE IMPORTANTLY, DYNALECTRON HAD RECEIVED A HIGH INITIAL SCORING FOR ITS PERSONNEL PLAN BECAUSE OF ITS BONUS AND INCENTIVE PLANS FOR ITS UPPER MANAGEMENT STAFF AND OTHER SELECTED INDIVIDUALS. THE RECORD REVEALS THAT UPON CLOSER EVALUATION, DYNALECTRON'S BONUS PLAN WAS FOUND TO BE OF "LITTLE VALUE TO RETAIN EXPERIENCED SALARIED PERSONNEL." THE BOARD ULTIMATELY FOUND THAT THERE WERE FEW FRINGE BENEFIT INCENTIVES AND ONLY THE BASICS IN RETIREMENT BENEFITS.

C. IN ITS FINAL REPORT, DOT'S BOARD STATED THAT DYNALECTRON'S COST TRACKING SYSTEM, "AS PROPOSED," WOULD NOT MEET THE 7-DAY TURNAROUND REQUIRED FOR "TOP PERFORMANCE." FROM OUR READING OF THE REPORT, WE DO NOT THINK THAT THE BOARD WAS IMPLYING THAT DYNALECTRON FAILED TO MEET ANY RFP REQUIREMENTS FOR THE SUBMISSION OF COST TRACKING REPORTS. RATHER, WE THINK THE BOARD WAS INDICATING THAT THE TIME REQUIRED TO COMPLETE THE COST TRACKING CYCLE FROM DYNALECTRON'S PROPOSED COMPUTERIZED COST TRACKING SYSTEM TO THE WORK CONTROL CENTER AND BACK INTO THE COST TRACKING SYSTEM WOULD BE MORE THAN 7 DAYS. FURTHER, WE NOTE THAT DYNALECTRON'S PROPOSAL STATED ONLY THAT ITS WORK CONTROL CENTER WOULD USE WEEKLY REPORTS FROM THE COST TRACKING SYSTEM TO TRACK WORK ORDER PERFORMANCE.

WITH RESPECT TO THE TRANSFER OF DYNALECTRON'S COST TRACKING SYSTEM TO THE TRANSPORTATION TEST CENTER, WE FAIL TO UNDERSTAND WHY THE FACT THAT THE CENTER'S COMPUTER WAS NOT OPERATIONALLY READY SHOULD HAVE PREVENTED DYNALECTRON FROM SUBMITTING IN ITS FINAL PROPOSAL AN OVERALL PLAN FOR IMPLEMENTING TRANSFER. WHILE DYNALECTRON MAY NOT HAVE BEEN ABLE TO SUBMIT A PRECISE SCHEDULE OF REQUIRED PROGRAMMING CHANGES, WE BELIEVE THAT THE COMPANY COULD HAVE NOTED THE GENERAL STEPS TO BE TAKEN TO ACCOMPLISH THE TRANSFER. IN ITS FINAL REPORT, DOT'S BOARD NOTED THAT SOME STEPS WERE UNDERWAY TO TRANSFER DYNALECTRON'S COST TRACKING SYSTEM ONSITE BUT SUCH STEPS WERE NOT SET OUT IN DYNALECTRON'S PROPOSAL.

D. THE RECORD SHOWS THAT IN ADDITION TO THE FINDINGS DOT MADE FROM THE INVESTIGATION OF DYNALECTRON'S TEST EXPERIENCE, DYNALECTRON'S PROPOSAL WAS DOWNGRADED BECAUSE DOT REEVALUATED THE ROLE OF BATTELLE IN PROVIDING IN- DEPTH TECHNICAL CAPABILITY. WE AGREE WITH DOT THAT DURING NEGOTIATIONS ITS BOARD WAS ESSENTIALLY ASKING FOR A DEFINITIVE PROPOSAL SETTING FORTH BATTELLE'S TESTING INVOLVEMENT. HOWEVER, IT IS CLEAR FROM THE RECORD THAT DYNALECTRON'S INVOLVEMENT WITH BATTELLE WAS NOT CLEARLY DEFINED WITH BATTELLE HAVING NO PERSONNEL AT THE TRANSPORTATION TEST CENTER OR ANY FORMAL SUBCONTRACT TO PERFORM A SPECIFIED NUMBER OF TASKS OR FUNCTIONS. UNDER THE CIRCUMSTANCES, WE BELIEVE THAT DOT'S FINDINGS IN THIS AREA HAD A RATIONAL BASIS IN FACT.

REVISION OF THE BOEING PROPOSAL

DYNALECTRON CONTENDS THAT BOEING WAS ALLOWED AN OPPORTUNITY TO REVISE ITS COST PROPOSAL AFTER THE SUBMISSION OF FINAL PROPOSALS. IN DYNALECTRON'S OPINION, DOT'S ADJUSTMENT IN BOEING'S CONTRACT PRICE CONSTITUTED A REOPENING OF NEGOTIATIONS BECAUSE ANY CHANGE IN A PROPOSAL ONCE IT IS SUBMITTED AFTER BEST AND FINALS CONSTITUTES NEGOTIATIONS. THEREFORE, DYNALECTRON ARGUES THAT NEGOTIATIONS SHOULD HAVE BEEN REOPENED WITH ALL OFFERORS AND NEW BEST AND FINALS REQUESTED. ACCORDING TO DYNALECTRON, IF AN OFFEROR IS GIVEN THE OPPORTUNITY TO DISCUSS PORTIONS OF ITS PROPOSAL, WHETHER OR NOT SUCH DISCUSSIONS ULTIMATELY TAKE PLACE, THE AGENCY MUST OPEN DISCUSSIONS WITH ALL OFFERORS WITHIN THE COMPETITIVE RANGE.

DOT STATES THAT IT SPECIFICALLY EXAMINED ALL COST ELEMENTS SET FORTH IN BOEING'S PROPOSAL AND DETERMINED WITH REGARD TO DIRECT LABOR AND FRINGE BENEFITS THAT $1,150,149 IN CAFETERIA CREDITS WERE NOT TAKEN AGAINST LABOR. AMENDMENT 3 PROVIDED THAT OFFERORS WERE TO INCLUDE IN THEIR COST PROPOSALS AS A CREDIT FOR CAFETERIA AND MOTOR POOL AGAINST DIRECT LABOR COST $200,000 FOR THE FIRST CONTRACT YEAR ESCALATED BY 7 PERCENT FOR EACH FOLLOW-ON YEAR OF THE CONTRACT. HAVING MADE THE DETERMINATION THAT BOEING'S PROPOSAL DID NOT CONTAIN A CAFETERIA CREDIT, DOT STATES THAT IT DECIDED THAT IT WOULD BE APPROPRIATE TO OBTAIN CLARIFICATION FROM BOEING. BOEING WAS CONTACTED BY TELEPHONE AND ASKED WHERE IN ITS COST PROPOSAL IT HAD TAKEN THE CAFETERIA CREDIT AND, IN A SUBSEQUENT TELEPHONE RESPONSE, BOEING CONFIRMED DOT'S DETERMINATION THAT A CAFETERIA CREDIT HAD NOT BEEN TAKEN. DOT DECLARES THAT IT REDUCED THE ESTIMATED COST OF BOEING'S PROPOSAL BASED UPON THE GOVERNMENT'S ADJUSTMENT FOR CAFETERIA CREDITS MANDATED BY AMENDMENT 3 TO THE RFP.

IN RESPONSE TO DYNALECTRON'S CONTENTION THAT DISCUSSIONS TOOK PLACE, DOT POINTS OUT THAT BOEING MADE NO CHANGE IN ITS PROPOSAL AND DID NOT SUBMIT ANY CONTRACT DOCUMENT. DOT FURTHER ARGUES THAT, BECAUSE THE CAFETERIA CREDIT ADJUSTMENT WAS CLEARLY MANDATED BY THE GOVERNMENT IN THE RFP, IT WAS ONLY REASONABLE TO REFLECT THIS CREDIT TO THE GOVERNMENT IN THE ESTIMATED COST OF THE AWARDED CONTRACT. DOT FURTHER POINTS OUT, MOREOVER, THAT THE REDUCTION IN THE ESTIMATED CONTRACT COST WAS TAKEN AFTER BOEING WAS SELECTED FOR AWARD. THUS, DOT BELIEVES THAT SINCE THE REDUCTION IN NO WAY AFFECTED THE AWARD DECISION, NO NEGOTIATIONS OCCURRED AFTER THE RECEIPT OF BEST AND FINALS.

ANALYSIS

IN NEGOTIATED PROCUREMENTS, MEANINGFUL DISCUSSIONS MUST GENERALLY BE HELD WITH ALL OFFERORS WHOSE INITIAL PROPOSALS ARE ACCEPTABLE. SEE JOHN FLUKE MANUFACTURING COMPANY, INC., B-195091, NOVEMBER 20, 1979, 79-2 CPD 367. IF DISCUSSIONS ARE REOPENED WITH ONE OFFEROR AFTER THE RECEIPT OF BEST AND FINAL OFFERS, THEY MUST BE REOPENED WITH ALL OFFERORS IN THE COMPETITIVE RANGE AND AN OPPORTUNITY GIVEN TO SUBMIT REVISED PROPOSALS. UNIVERSITY OF NEW ORLEANS, B-184194, SEPTEMBER 19, 1977, 77-2 CPD 201. HOWEVER, WHETHER DISCUSSIONS HAVE BEEN HELD IS A MATTER TO BE DETERMINED ON THE BASIS OF THE ACTIONS OF THE PARTIES INVOLVED. NEW HAMPSHIRE-VERMONT HEALTH SERVICE, 57 COMP.GEN. 347 (1978), 78-1 CPD 202. WHILE IT IS NOT ALWAYS EASY TO DETERMINE IF A GOVERNMENT-OFFEROR CONTACT OR INTERCHANGE CONSTITUTES COMPETITIVE RANGE DISCUSSIONS, WE HAVE STATED THAT THE ACID TEST OF WHETHER DISCUSSIONS HAVE BEEN HELD IS WHETHER IT CAN BE SAID THAT AN OFFEROR WAS PROVIDED THE OPPORTUNITY TO REVISE OR MODIFY ITS PROPOSAL. SEE 51 COMP.GEN. 479 (1972); THE HUMAN RESOURCES COMPANY, B-187153, NOVEMBER 30, 1976, 76-2 CPD 459.

FROM THE RECORD, IT IS CLEAR THAT THE CAFETERIA CREDIT WAS MANDATED BY THE TERMS OF AMENDMENT 3 TO THE RFP AND WAS NOT OFFERED AS A MEANS TO INDUCE ANY NEGOTIATED CONCESSION FROM BOEING. BOEING DID NOT STATE ANY EXCEPTION TO THE CREDIT IN ITS PROPOSAL AND THE APPLICATION OF THE CREDIT IS A MECHANICAL, MATHEMATICAL PROCEDURE. SINCE THE POST-CLOSING DATE CONTACT WITH BOEING WAS FOR THE SOLE PURPOSE OF CONFIRMING THE MECHANICAL APPLICATION OF THE CREDIT SPECIFIED IN THE RFP AND SINCE NO NEW INFORMATION RESULTED FROM THE INTERCHANGE BETWEEN THE PARTIES, THE CONTACT DID NOT CONSTITUTE IMPROPER DISCUSSIONS. GENERAL KINETICS, INC., B-190359, MARCH 24, 1978, 78-1 CPD 231.

CHANGE IN TECHNICAL EVALUATION CRITERIA

DYNALECTRON ASSERTS THAT DOT VIOLATED THE REQUIREMENTS OF DOT ORDER 4200.11 BY CHANGING THE RFP TECHNICAL EVALUATION CRITERIA AFTER THE SUBMISSION OF INITIAL PROPOSALS. IN THIS REGARD, DYNALECTRON CHARGES THAT, BY DELETING RAILROAD EXPERIENCE AS AN EVALUATION CRITERION UNDER RFP FACTOR IIA, DOT BLATANTLY IGNORED THE REQUIREMENT OF PARAGRAPH 11(B)1 OF SECTION "E" OF THE ORDER THAT EVALUATION CRITERIA AND WEIGHTS SHALL NOT BE CHANGED AFTER PROPOSALS ARE SUBMITTED. IN DYNALECTRON'S OPINION, THE RFP EVALUATION CRITERIA, WHEN TAKEN TOGETHER WITH THE RFP'S STATEMENT OF WORK, IDENTIFIED RAILROAD EXPERIENCE AS A CRITERION. AS AN EXAMPLE, DYNALECTRON CITES RFP SECTION "D," PAGE D-2, FACTOR IA, WHICH REQUIRED DEMONSTRATED EXPERIENCE IN PERFORMING TESTING, AND RFP PARAGRAPH 1.4.1 IN THE STATEMENT OF WORK, WHICH DESCRIBED THE REQUIREMENTS FOR TESTING OF TRACK, VEHICLES, SYSTEMS AND COMPONENTS. DYNALECTRON ASSERTS THAT IT WAS CLEARLY PREJUDICED BY THE ELIMINATION OF THE RAILROAD EXPERIENCE CRITERION AS EVIDENCED BY THE CONSEQUENT DOWNGRADING OF ITS PROPOSAL AND THE UPGRADING OF BOEING'S PROPOSAL.

DOT STATES THAT IN THE INITIAL EVALUATION OF PROPOSALS, THE TECHNICAL EVALUATORS "ERRONEOUSLY" CONSIDERED PRIOR RAILROAD TESTING EXPERIENCE AS A SEPARATE SUBFACTOR UNDER RFP EVALUATION FACTOR I. ACCORDING TO DOT, RAILROAD EXPERIENCE WAS REMOVED FROM THE EVALUATION PROCESS IN THE FINAL EVALUATION BECAUSE THE BOARD DETERMINED THAT RAILROAD EXPERIENCE WAS NOT SET FORTH IN THE RFP TECHNICAL EVALUATION CRITERIA. THEREFORE, IN ORDER TO CONFORM TO THE EVALUATION CRITERIA, DOT INDICATES THAT THE TECHNICAL EVALUATORS WERE DIRECTED TO REMOVE THIS EVALUATION CONSIDERATION FROM THE FINAL SCORING.

ANALYSIS

WHILE PROCURING AGENCIES HAVE BROAD DISCRETION IN DETERMINING THE EVALUATION PLAN THEY WILL USE, THEY DO NOT HAVE THE DISCRETION TO ANNOUNCE IN THE SOLICITATION THAT ONE PLAN WILL BE USED AND THEN FOLLOW ANOTHER IN THE ACTUAL EVALUATION. SEE UMPQUA RESEARCH COMPANY, B-199014, APRIL 3, 1981, 81-1 CPD 254. ONCE OFFERORS ARE INFORMED OF THE CRITERIA AGAINST WHICH THEIR PROPOSALS WILL BE EVALUATED, THE AGENCY MUST ADHERE TO THOSE CRITERIA OR INFORM ALL OFFERORS OF ANY SIGNIFICANT CHANGES MADE IN THE EVALUATION SCHEME. TELECOMMUNICATIONS MANAGEMENT CORPORATION, 57 COMP.GEN. 251 (1978), 78-1 CPD 80; EASTMAN KODAK COMPANY, B-194584, AUGUST 9, 1979, 79-2 CPD 105. CONSEQUENTLY, IT IS IMPROPER FOR AN AGENCY TO DEPART IN ANY MATERIAL WAY FROM THE EVALUATION PLAN DESCRIBED IN THE SOLICITATION WITHOUT INFORMING THE OFFERORS AND GIVING THEM AN OPPORTUNITY TO STRUCTURE THEIR PROPOSALS WITH THE NEW EVALUATION SCHEME IN MIND. UMPQUA RESEARCH COMPANY, SUPRA.

ON THE OTHER HAND, WHILE AGENCIES ARE REQUIRED TO IDENTIFY THE MAJOR EVALUATION FACTORS APPLICABLE TO A PROCUREMENT, THEY NEED NOT EXPLICITLY IDENTIFY THE VARIOUS ASPECTS OF EACH WHICH MIGHT BE TAKEN INTO ACCOUNT. ALL THAT IS REQUIRED IS THAT THOSE ASPECTS NOT IDENTIFIED BE LOGICALLY AND REASONABLY RELATED TO OR ENCOMPASSED BY THE STATED EVALUATION FACTORS. BUFFALO ORGANIZATION FOR SOCIAL AND TECHNOLOGICAL INNOVATION, INC., B-196279, FEBRUARY 7, 1980, 80-1 CPD 107. HERE, IT IS CLEAR THAT RAILROAD TEST EXPERIENCE WAS NOT AN EXPLICITLY STATED EVALUATION FACTOR. THE RFP LISTED AS A SUBELEMENT UNDER EVALUATION FACTOR I, CORPORATE TEST EXPERIENCE AND MANAGEMENT PLAN, DEMONSTRATED CORPORATE EXPERIENCE IN PERFORMING TESTING, DATA COLLECTION AND EVALUATION AND HOW THE OFFEROR PROPOSED TO USE SUCH EXPERIENCE AT THE TRANSPORTATION TEST CENTER.

FURTHERMORE, EVEN THOUGH RAILROAD EXPERIENCE WAS NOT TAKEN INTO ACCOUNT AS A SEPARATE FACTOR IN THE FINAL EVALUATION, DOT INVESTIGATED THE PREVIOUS CONTRACTS THE OFFERORS LISTED IN THEIR PROPOSALS TO ESTABLISH CORPORATE TEST EXPERIENCE. THE RESULTS OF THAT INVESTIGATION WERE TAKEN INTO CONSIDERATION IN EVALUATING THE PROPOSALS. THUS, TO THE EXTENT THE CONTRACTS LISTED BY THE OFFERORS CONCERNED RAILROAD TESTING, THE CORPORATE EXPERIENCE IN PERFORMING RAILROAD TESTING WAS TAKEN INTO CONSIDERATION.

THEREFORE, WE DO NOT FIND THAT DOT DEVIATED FROM THE CORPORATE TEST EXPERIENCE FACTOR SPECIFIED IN THE RFP.

WITH REGARD TO DYNALECTRON'S CONTENTION THAT DOT VIOLATED THE REQUIREMENT OF PARAGRAPH 11B OF SECTION "E" OF DOT ORDER 4200.11, WE BELIEVE THAT DYNALECTRON HAS IGNORED THE PLAIN MEANING OF THE PARAGRAPH. PARAGRAPH 11B ONLY PROHIBITS CHANGES IN THE STATED RFP EVALUATION CRITERIA ONCE PROPOSALS ARE RECEIVED. FROM OUR VIEW OF THE RECORD, IT APPEARS THAT THE SUBFACTOR CRITERIA FOR RAILROAD EXPERIENCE EMPLOYED BY THE TECHNICAL EVALUATORS IN THE INITIAL TECHNICAL EVALUATION WAS DEVISED PURSUANT TO SECTION "E," PARAGRAPH 11A, OF DOT ORDER 4200.11. PARAGRAPH 11A PROVIDES:

"DETERMINING TEAM EFFORTS. PRIOR TO RECEIPT OF PROPOSALS, THE SEB SHALL DETERMINE WHICH EVALUATION CRITERIA WILL BE ASSIGNED TO TEAMS FOR EVALUATION AND MAKE THE TEAM ASSIGNMENTS. TEAMS SHALL DEVELOP THEIR OWN SUBCRITERIA AND INTERNAL VALUES OR WEIGHTS, AS APPROPRIATE, AND SUBMIT THEM TO THE SEB FOR APPROVAL. THE SCORING SYSTEM USED BY TEAMS SHALL BE DEVELOPED INDEPENDENTLY OF THE VALUES OR WEIGHTS ESTABLISHED FOR SEB USE. CRITERIA WEIGHTS DETERMINED BY THE SEB SHALL NOT BE DISCLOSED TO ANY TEAM MEMBER WHO IS NOT ALSO AN SEB MEMBER."

WE BELIEVE, THEN, THAT THE SUBCRITERIA FOR RAILROAD EXPERIENCE WAS DEVISED IN ORDER TO ASSIST THE TECHNICAL EVALUATORS IN THEIR INTERNAL DELIBERATIONS AND THAT THE BOARD'S ELIMINATION OF THIS SUBFACTOR CRITERION AFTER RECEIPT OF PROPOSALS WAS NOT PROHIBITED BY DOT ORDER 4200.11.

FEE AS A MAJOR PRICE DISCRIMINATOR

DYNALECTRON ALLEGES THAT DOT THROUGHOUT THE SELECTION PROCESS TOTALLY IGNORED THE SIGNIFICANT SAVINGS OFFERED BY ITS HAVING THE LOWEST FEE OF ANY OF THE FOUR OFFERORS. DYNALECTRON FURTHER ALLEGES THAT THE BOARD NEVER BROUGHT THE ISSUE OF FEE TO THE ATTENTION OF THE SOURCE SELECTION OFFICIAL. ACCORDING TO DYNALECTRON, DOT'S SOURCE SELECTION PLAN MADE FEE A MAJOR PRICE DISCRIMINATOR FOR PURPOSES OF SELECTING THE CONTRACT AWARDEE. THEREFORE, WITH A SAVINGS IN FEE OF SUCH AN ALLEGEDLY LARGE MAGNITUDE AND WITH THE IMPORTANCE OF FEE AS A MAJOR DISCRIMINATOR, DYNALECTRON ARGUES THAT THE SOURCE SELECTION OFFICIAL'S SELECTION OF THE MOST ADVANTAGEOUS PROPOSAL MIGHT HAVE BEEN OTHER THAN BOEING'S IF THE MATTER OF FEE HAD BEEN BROUGHT TO HIS ATTENTION.

IN RESPONSE, DOT TAKES THE POSITION THAT THE SOURCE SELECTION PLAN, PREPARED IN MAY 1979, WAS SOLELY A COMMUNICATION BETWEEN THE TRANSPORTATION TEST CENTER AND THE SECRETARY OF TRANSPORTATION TO ESTABLISH THE GENERAL GROUND RULES FOR THE FORTHCOMING PROCUREMENT AND WAS NEVER INTENDED TO BE A DOCUMENT THAT SET FORTH THE CRITERIA FOR EVALUATING PROPOSALS. MORE SPECIFICALLY, DOT STATES THAT THE SOURCE SELECTION PLAN WAS NEVER SENT TO OFFERORS NOR WAS ANY REPRESENTATION EVER MADE TO THE OFFERORS THAT THE PLAN WOULD BE USED TO EVALUATE PROPOSALS.

DOT FURTHER ARGUES THAT THE SOURCE SELECTION PLAN WAS SUPERSEDED BY THE RFP WHICH SET FORTH THE ACTUAL REQUIREMENTS AND CRITERIA FOR OFFERORS TO PROPOSE AGAINST. DOT EMPHASIZES THAT THE RFP ESTABLISHED PROPOSAL EVALUATION CRITERIA AND THE RELATIVE IMPORTANCE OF THE MAJOR EVALUATION FACTORS. SPECIFICALLY, DOT POINTS OUT THAT PARAGRAPH 21 OF THE RFP PROVIDED THAT COST WOULD BE A SIGNIFICANT FACTOR IN THE AWARD DECISION BUT COST WOULD BE A "LESS SIGNIFICANT FACTOR" THAN THE TECHNICAL PROPOSAL. ACCORDING TO DOT, THERE IS NO REQUIREMENT UNDER THE FEDERAL PROCUREMENT REGULATIONS THAT COST-REIMBURSEMENT-TYPE CONTRACTS BE AWARDED ON THE BASIS OF EITHER (1) THE LOWEST PROPOSED COST, (2) THE LOWEST PROPOSED FEE, OR (3) THE LOWEST ESTIMATED COST PLUS PROPOSED FEE. RATHER, THE PRIMARY CONSIDERATION IN DETERMINING TO WHOM THE AWARD UNDER A NEGOTIATED PROCUREMENT SHALL BE MADE IS WHICH CONTRACTOR CAN PERFORM THE CONTRACT IN A MANNER MOST ADVANTAGEOUS TO THE GOVERNMENT.

ANALYSIS

BASED ON OUR REVIEW OF THE RECORD, WE FIND THAT FEE WAS CONSIDERED BY THE BOARD AND ALSO THAT THE MATTER WAS BROUGHT TO THE ATTENTION OF THE SOURCE SELECTION OFFICIAL. THE REPORT OF THE COST EVALUATORS TO THE CHAIRMAN OF THE BOARD CONTAINS SEVERAL SECTIONS WHERE THE FEES OF THE OFFERORS ARE SET OUT FOR COMPARISON. THE BOARD'S FINAL REPORT TO THE SOURCE SELECTION OFFICIAL CONTAINS SEVERAL SUCH SECTIONS AS WELL. FURTHER, WE FIND DYNALECTRON'S ARGUMENT THAT DOT WAS REQUIRED TO AWARD THE TRANSPORTATION TEST CENTER CONTRACT TO DYNALECTRON IN LIGHT OF THE COMPANY'S LOW FEE CONTRADICTS THE SELECTION SCHEME CONTAINED IN PARAGRAPH 21 OF THE RFP. UNDER THIS PARAGRAPH, THE CONTRACT WAS ESSENTIALLY TO BE AWARDED TO THE OFFEROR WHOSE PROPOSAL OFFERED THE TECHNICAL/COST RELATIONSHIP MOST ADVANTAGEOUS TO THE GOVERNMENT.

EVALUATION OF COST PROPOSALS

DYNALECTRON ASSERTS THAT THE COST EVALUATION PERFORMED BY DOT LACKED A RATIONAL BASIS. DYNALECTRON ALSO CONTENDS THAT THE VARIOUS ADJUSTMENTS AND LACK OF ADJUSTMENTS MADE TO THE VARIOUS OFFERORS' PROPOSED COSTS DID NOT COMPLY WITH THE REQUIREMENTS OF THE FEDERAL PROCUREMENT REGULATIONS - IN PARTICULAR, IN THE AREAS OF VACATION, SALARIED PAID TIME OFF, CAFETERIA CREDITS AND RELOCATION. WITH REGARD TO RELOCATION COSTS, DYNALECTRON ALLEGES THAT DOT IGNORED THE FAILURE OF BOEING TO OFFER THE MINIMUM NUMBER OF SALARIED MAN-YEARS OF EFFORT AS REQUIRED BY AMENDMENT 3 TO THE RFP.

A. VACATION

DYNALECTRON QUESTIONS DOT'S DECREASE OF ITS PROPOSED PRODUCTIVE MAN HOURS BY 21 HOURS PER EMPLOYEE BECAUSE THE DYNALECTRON COST PROPOSAL DEDUCTED ONLY 59 HOURS PER YEAR FOR VACATION INSTEAD OF 80 HOURS. ACCORDING TO DYNALECTRON, THIS ADJUSTMENT RESULTED IN AN INCREASE IN DYNALECTRON'S PROPOSED COST OF OVER $348,556. DYNALECTRON ARGUES THAT BY THE ABOVE- MENTIONED ACTION, DOT IGNORED THE REGULATORY REQUIREMENT THAT AGENCIES CONSIDER HISTORICAL COSTS. ACCORDING TO DYNALECTRON, THE HISTORICAL EXPERIENCE SET FORTH IN ITS COST PROPOSAL CLEARLY SHOWED THAT ONLY 59 HOURS PER YEAR WERE NECESSARY FOR VACATION.

DOT STATES THAT THERE WAS MORE TO THE AREA OF VACATION THAN DYNALECTRON'S PAST EXPERIENCE. ACCORDING TO DOT, THERE WAS THE MORE SIGNIFICANT MATTER OF FAIRNESS TO ALL OFFERORS IN THE EVALUATION. DOT ARGUES THAT ONLY DYNALECTRON, THE THEN INCUMBENT CONTRACTOR, HAD THE BENEFIT OF KNOWING THE HISTORICAL EXPERIENCE AT THE TRANSPORTATION TEST CENTER AS TO VACATION USED. IN ORDER TO AVOID ANY UNFAIR ADVANTAGE IN FAVOR OF DYNALECTRON, DOT PROVIDED EMPLOYEE LONGEVITY DATA TO ALL OFFERORS FOR THEIR USE IN COMPUTING LONGEVITY. DOT STATES THAT THIS DATA SHOWED THAT BY THE CONTRACT AWARD DATE ALL EMPLOYEES WOULD BE REQUIRED TO BE GIVEN 80 HOURS OF VACATION. CONSEQUENTLY, HAVING PROVIDED EMPLOYEE LONGEVITY DATA TO ALL OFFERORS AND HAVING SEEN THAT NO OFFEROR OTHER THAN DYNALECTRON DEDUCTED LESS THAN AN AVERAGE OF 80 HOURS PER YEAR FOR VACATION, DOT STATES THAT IT WAS ITS JUDGMENT THAT TO PERMIT DYNALECTRON TO USE A 59-HOUR VACATION FACTOR WOULD NOT HAVE BEEN REASONABLE, FAIR, OR RATIONAL.

B. SALARIED PAID TIME OFF

DYNALECTRON ASSERTS THAT DOT AGAIN ERRONEOUSLY DECREASED ITS PROPOSED PRODUCTIVE MAN-HOURS PER PERSON. IN DYNALECTRON'S VIEW, DOT SIMPLY DID NOT ASSESS THE MERITS OF DYNALECTRON'S COST PROPOSAL IN TERMS OF HOURS SALARIED PAID TIME OFF PER SALARIED EMPLOYEE. IN ARRIVING AT PRODUCTIVE MAN-HOURS PER PERSON, DYNALECTRON ALLEGES THAT IT COMPUTED SALARIED PAID TIME OFF AT A RATE OF 19 HOURS PER SALARIED EMPLOYEE. DYNALECTRON FURTHER ALLEGES THAT IN ITS COST PROPOSAL IT GAVE AN EXTENSIVE EXPLANATION FOR THE REDUCTION FROM 38 HOURS IN THE PAST TO THE 19 HOURS THAT IT PROPOSED. ACCORDING TO DYNALECTRON, THE REDUCTION TO 19 HOURS WAS BASED UPON DEVELOPMENT OF FORMAL WRITTEN PROCEDURES FOR CONTROL OF TIME OFF AND MORE ACCURATE ACCOUNTING OF EXTRA HOURS BEYOND 40 HOURS WORKED BY SALARIED PERSONS. DYNALECTRON CONTENDS THAT, DESPITE THIS EXTENSIVE EXPLANATION, DOT ADDED 19 HOURS PER SALARIED EMPLOYEE FOR SALARIED TIME OFF.

DOT STATES THAT DYNALECTRON SUBMITTED HISTORICAL DATA TO IT THAT SHOWED THAT THE COMPANY AVERAGED 38 HOURS PER YEAR OF PAID TIME OFF FOR SALARIED EMPLOYEES. DOT ADMITS THAT DYNALECTRON DID PUBLISH JUST PRIOR TO ITS FINAL PROPOSAL SUBMISSION A GENERAL MANAGEMENT INSTRUCTION WHICH ATTEMPTED TO CHANGE DYNALECTRON'S POLICY ON SALARIED PERSONNEL COMPENSATORY TIME. DOT STATES, HOWEVER, THAT THE GENERAL MANAGEMENT INSTRUCTION WAS CONSIDERED TO BE UNCLEAR AND INCONSISTENT. DOT FURTHER STATES THAT THE INSTRUCTION POSSIBLY PERMITTED UNALLOWABLE COSTS TO BE CLAIMED UNDER THE CONTRACT AS IT ALLOWED PERSONNEL IN SOME INSTANCES TO TAKE COMPENSATORY TIME OFF WITH PAY PRIOR TO THEIR ACCRUING SUCH TIME. IN DOT'S OPINION, THIS WAS BELIEVED NOT TO MEET THE DEFINITIONS CONTAINED IN THE FEDERAL PROCUREMENT REGULATIONS FOR ALLOWABILITY AND ALLOCABILITY. IN ANY EVENT, DOT ASSERTS THAT IT DID CONSIDER AND ASSESS THE MERITS OF DYNALECTRON'S PROPOSED SAVINGS BASED ON THE COMPANY'S GENERAL MANAGEMENT INSTRUCTION AND CONCLUDED THAT A PROPER RESULT WAS TO PROJECT COSTS IN THIS AREA USING 38 HOURS INSTEAD OF 19.

C. CAFETERIA CREDITS

AS AN ALTERNATE TO ITS ARGUMENT THAT DOT REOPENED NEGOTIATIONS BY GIVING BOEING OVER $1 MILLION DOLLARS IN CAFETERIA CREDITS AFTER BEST AND FINAL OFFERS, DYNALECTRON CONTENDS THAT THERE IS NO SUPPORTING EVIDENCE IN THE RECORD TO INDICATE THAT A THOROUGH ANALYSIS OF BOEING'S PROPOSAL WAS DONE TO ELIMINATE THE POSSIBILITY THAT BOEING HAD IN FACT ALREADY TAKEN THE CREDIT. IN THIS REGARD, BOEING ARGUES THAT THE CAFETERIA CREDIT ADJUSTMENT COULD HAVE BEEN MADE IN ANY NUMBER OF WAYS OTHER THAN A SPECIFIC LINE ITEM DEDUCTION. AS AN EXAMPLE, DYNALECTRON INDICATES THAT A CREDIT IN DIRECT LABOR COULD HAVE BEEN TAKEN. DYNALECTRON URGES THAT WE UNDERTAKE AN IN-DEPTH ANALYSIS OF BOEING'S COST PROPOSAL TO INSURE THAT A DOUBLE CREDIT WAS NOT GIVEN TO BOEING.

DOT INSISTS THAT THE BOARD'S COST EVALUATION TEAM CHECKED AND RECHECKED THE POSSIBILITY OF BOEING HAVING TAKEN THE CREDIT FOR CAFETERIA RECEIPTS. DOT STATES THAT ONLY WHEN THE BOARD ASSURED ITSELF THAT THE CREDIT WAS NOT TAKEN BY BOEING ANYWHERE IN ITS COST PROPOSAL WAS AN ADJUSTMENT MADE. THEREFORE, DOT BELIEVES THAT THERE IS NO QUESTION THAT THIS CREDIT ADJUSTMENT TO BOEING'S COST PROPOSAL WAS APPROPRIATE.

D. RELOCATION COSTS

DYNALECTRON ASSERTS THAT DOT DID NOT DEVELOP ITS OWN ESTIMATE FOR THE COMPARISON AND EVALUATION OF THE OFFERORS' RELOCATION COSTS. DYNALECTRON GOES ON TO ARGUE THAT WITHOUT SUCH AN ESTIMATE THE ONLY LOGICAL BASIS FOR EVALUATING RELOCATION COST WAS HISTORICAL EXPERIENCE. DYNALECTRON ALLEGES, HOWEVER, THAT DOT APPARENTLY DISREGARDED THE HISTORICAL EXPERIENCE AT THE TRANSPORTATION TEST CENTER AND INSTEAD BASED ITS ADJUSTMENT OF BOEING'S PROPOSED RELOCATION COSTS ON THAT COMPANY'S AVERAGE SEPARATION AT NASA'S KENNEDY SPACE CENTER. DYNALECTRON ALLEGES THAT IN ITS PROPOSAL IT DOCUMENTED A TRANSPORTATION TEST CENTER HISTORY OF RELOCATIONS TO ARRIVE AT AN ESTIMATED 16 RELOCATIONS PER YEAR. DYNALECTRON BELIEVES THAT BASED ON THIS HISTORICAL EXPERIENCE 16 RELOCATIONS PER YEAR WAS THE MINIMUM FIGURE THAT DOT SHOULD HAVE USED. DYNALECTRON, THEREFORE, QUESTIONS DOT'S FACTUAL SUPPORT FOR THE CONCLUSION THAT THE KENNEDY SPACE CENTER SEPARATION EXPERIENCE WAS THE SAME AS THE TRANSPORTATION TEST CENTER EXPERIENCE. IN DYNALECTRON'S OPINION, DOT SHOULD HAVE ADDED AN ADDITIONAL $200,000 TO BOEING'S PROPOSED RELOCATION COSTS TO MAKE THEM APPROXIMATE TO DYNALECTRON'S.

DOT STATES THAT DYNALECTRON'S PROPOSED RELOCATION COSTS WERE $305,460 AND BOEING'S ADJUSTED RELOCATION COSTS WERE $413,445. DOT EMPHASIZES, THEN, THAT THE ESTIMATED TOTAL PROBABLE RELOCATION COSTS WERE SIGNIFICANTLY GREATER FOR BOEING THAN FOR DYNALECTRON. AS TO BOEING'S SEPARATION EXPERIENCE AT KENNEDY SPACE CENTER, DOT RECOGNIZES THAT THERE WAS NO FACTUAL WAY TO GUARANTEE THAT THAT EXPERIENCE COULD BE DIRECTLY TRANSPOSED TO THE TRANSPORTATION TEST CENTER. DOT POINTS OUT, HOWEVER, THAT THERE WAS ALSO NO WAY TO GUARANTEE THAT DYNALECTRON'S SEPARATION EXPERIENCE WAS A TRUE REPRESENTATION OF WHAT IT SHOULD HAVE BEEN OR COULD HAVE BEEN FOR THE TRANSPORTATION TEST CENTER UNDER DIFFERENT MANAGEMENT. IN DOT'S OPINION, CORPORATE MANAGEMENT HAS A TREMENDOUS EFFECT ON RETENTION OF PERSONNEL. CONSEQUENTLY, IN VIEW OF DYNALECTRON'S HISTORY OF PROBLEMS IN TURNOVER OF PERSONNEL, DOT STATES THAT IT DID NOT RELY ON THE COMPANY'S EXPERIENCE IN TERMS OF SEPARATIONS.

E. MINIMUM STAFFING FOR SALARIED PERSONNEL

IN REVIEWING DOT'S ANALYSIS OF BOEING'S RELOCATION COST, DYNALECTRON ASSERTS THAT DOT CLEARLY IGNORED THE FACT THAT BOEING DID NOT OFFER THE MINIMUM SALARIED STAFFING REQUIRED BY AMENDMENT 3 TO THE RFP. ACCORDING TO DYNALECTRON, AMENDMENT 3 REQUIRED THAT OFFERORS PROPOSE A MINIMUM OF 168 MAN-YEARS OF EFFORT FOR EACH OF THE 4 BASIC CONTRACT YEARS AND 185 MAN -YEARS FOR THE OPTION YEAR. DYNALECTRON ALLEGES THAT BOEING, BY DOT'S OWN ADMISSION, PROPOSED ONLY 151 AND 169 MAN-YEARS, RESPECTIVELY. CALCULATING ON THE BASIS OF A DIFFERENCE OF $5 PER HOUR BETWEEN SALARIED AND NONSALARIED PERSONNEL, DYNALECTRON TAKES THE POSITION THAT BOEING'S COST PROPOSAL WAS THEREFORE UNDERSTATED BY APPROXIMATELY $899,199.

DOT STATES THAT THE RFP WAS NOT AS RESTRICTIVE AS DYNALECTRON ASSERTS WITH REGARD TO MAN-YEARS OF EFFORT. DOT STATES THAT THE RFP MERELY REQUIRED THAT OFFERORS PROPOSE ON A TARGET OF PRODUCTIVE MAN HOURS FALLING WITHIN A MINIMUM AND MAXIMUM SWING. WITHIN THIS SWING, DOT STATES THAT SALARIED STAFF WAS CONSTRAINED ONLY IN WHAT WAS DEFINED AS "SALARIED OTHER" AND EACH OFFEROR WAS FREE TO USE ITS OWN JUDGMENT IN TERMS OF THE NUMBER OF "SALARIED MANAGERS" IT PROPOSED. IN BOEING'S CASE, DOT INDICATES THAT WHEN ITS PROPOSED TOTAL OF 151 SALARIED PERSONNEL FOR THE BASIC 4 YEARS AND 169 FOR THE OPTION YEAR WERE ADDED TO THE SALARIED PERSONNEL OF BOEING'S THREE MINORITY AND SMALL BUSINESS SUBCONTRACTORS, BOEING'S PROPOSAL MET THE MINIMUM MANNING REQUIREMENT OF THE RFP.

ANALYSIS

(KEYED TO THE ABOVE-LETTERED PARAGRAPHS)

A. EVALUATED COSTS RATHER THAN PROPOSED COSTS PROVIDE A SOUNDER BASIS FOR DETERMINING THE MOST ADVANTAGEOUS PROPOSAL IN COST REIMBURSEMENT PROCUREMENTS SINCE THE GOVERNMENT IS REQUIRED WITHIN CERTAIN LIMITS TO PAY THE CONTRACTOR'S ACTUAL, ALLOWABLE AND ALLOCABLE COSTS. 52 COMP.GEN. 870, 874 (1973). WE HAVE STATED THAT THE PROCUREMENT AGENCY'S JUDGMENT AS TO THE METHODS USED IN DEVELOPING THE GOVERNMENT'S COST ESTIMATE AND THE CONCLUSIONS REACHED IN EVALUATING THE PROPOSED COSTS ARE ENTITLED TO GREAT WEIGHT SINCE THE PROCUREMENT AGENCIES ARE IN THE BEST POSITION TO DETERMINE REALISM OF COSTS AND MUST BEAR THE MAJOR CRITICISM FOR COST OVERRUNS BECAUSE OF DEFECTIVE COST ANALYSES. DYNATREND, INC., B-192038, JANUARY 3, 1979, 79-1 CPD 4. THUS, WE WILL NOT SECOND-GUESS AN AGENCY'S COST REALISM DETERMINATION UNLESS IT IS NOT SUPPORTED BY A REASONABLE BASIS. GREY ADVERTISING, INC., 55 COMP.GEN. 111 (1976), 76-1 CPD 325. BELIEVE THAT DOT'S DETERMINATION NOT TO ALLOW DYNALECTRON TO USE A 59 HOUR VACATION FACTOR WAS REASONABLE. IT APPEARS FROM THE RECORD THAT THE HISTORICAL EXPERIENCE OF DYNALECTRON WITH REGARD TO PRODUCTIVE MAN HOURS WAS ONLY FOR A 1-YEAR PERIOD. MOREOVER, THE RFP'S AREA WAGE DETERMINATION REQUIRED OFFERORS TO RECOGNIZE 2 WEEKS OF VACATION AFTER 1 YEAR OF SERVICE. EVEN SO, WE NOTE THAT DOT DID RECOGNIZE THAT THIS WAGE DETERMINATION DID NOT APPLY TO SALARIED EMPLOYEES AND, THUS, DOT, IN STRICT COMPLIANCE WITH THE RFP, DID NOT ASSESS TO DYNALECTRON'S PROPOSAL THE COSTS OF INCREASED VACATION TO SUCH EMPLOYEES. FINALLY, WE ALSO NOTE THAT THE ADDITIONAL HOURS ADDED TO DYNALECTRON'S COST PROPOSAL WERE COMPUTED AT THE RFP'S MINIMUM PRODUCTIVE MAN-HOURS INSTEAD OF THE HIGHER FIGURE USED BY DYNALECTRON.

B. WE BELIEVE THAT THE ESSENTIAL POINT HERE CENTERED AROUND THE APPROPRIATENESS OF DYNALECTRON'S TREATMENT OF SICK LEAVE FOR SALARIED EMPLOYEES. APPARENTLY, DYNALECTRON HAD NOT BEEN USING A SPECIFIED SICK LEAVE POLICY FOR SALARIED EMPLOYEES AND SALARIED SICK LEAVE HAD BEEN INCLUDED IN DYNALECTRON'S LEVEL OF EFFORT AT THE TRANSPORTATION TEST CENTER. HOWEVER, WITH THE EXCEPTION OF DYNALECTRON, THE OTHER OFFERORS HAD SPECIFIED LEVELS FOR SICK LEAVE FOR SALARIED PERSONNEL IN THEIR COST PROPOSAL. IN FACT, THE RECORD SHOWS THAT THE METHODOLOGY USED BY DYNALECTRON IN ESTIMATING SALARIED TIME OFF WAS DISCUSSED DURING NEGOTIATIONS. DURING THE DISCUSSIONS IT APPEARS THAT DYNALECTRON REQUESTED THAT DOT CONSIDER THE FACT THAT OFTEN DYNALECTRON'S PERSONNEL WORKED OVERTIME WITHOUT COMPENSATION WHICH DYNALECTRON BELIEVED OFFSET THE INCLUSION OF SALARIED SICK LEAVE IN THE LEVEL OF EFFORT. BECAUSE DOT CONSIDERED UNUSUAL DYNALECTRON'S PROPOSAL TO OFFSET SALARIED PAID TIME OFF WITH OVERTIME, DOT CONCLUDED THAT THE HALVING OF DYNALECTRON'S 38 HOURS OF PAID TIME-OFF FIGURE WAS NOT SUPPORTABLE AND IN CONFLICT WITH NORMAL ACCOUNTING PRACTICES.

C. DYNALECTRON HAS RAISED ONLY A SUSPICION THAT BOEING RECEIVED DOUBLE CREDIT FOR CAFETERIA CREDITS. DOT SPECIFICALLY STATES THAT IT CHECKED AND RECHECKED THE POSSIBILITY OF BOEING HAVING RECEIVED DOUBLE CREDIT AND DETERMINED THAT NO DOUBLE CREDIT OCCURRED. AS TO DYNALECTRON'S REQUEST THAT WE INDEPENDENTLY INVESTIGATE TO ENSURE THAT DOUBLE CREDIT WAS NOT GIVEN TO BOEING, IT IS NOT OUR PRACTICE TO CONDUCT INVESTIGATIONS PURSUANT TO OUR BID PROTEST FUNCTION FOR THE PURPOSE OF ESTABLISHING THE VALIDITY OF A PROTESTER'S SPECULATIVE STATEMENTS. MISSION ECONOMIC DEVELOPMENT ASSOCIATION, B-182686, AUGUST 2, 1976, 76-2 CPD 105. IN THE ABSENCE OF PROBATIVE EVIDENCE, AS IS THE CASE HERE, WE MUST ASSUME THAT A PROTESTER'S ALLEGATIONS ARE SPECULATIVE AND CONCLUDE THAT THE PROTESTER HAS NOT MET ITS BURDEN OF PROOF. DEPENDABLE JANITORIAL SERVICE AND SUPPLY, B-190231, JANUARY 3, 1978, 78-1 CPD 1.

D. WE AGREE WITH DOT'S POSITION THAT RELOCATION COST IS INTIMATELY RELATED TO CORPORATE MANAGEMENT. THE RECORD SHOWS THAT DYNALECTRON HAD A HISTORY OF TURNOVER OF PERSONNEL PROBLEMS AT THE TRANSPORTATION TEST CENTER AS EVIDENCED, PARTICULARLY BY THE 100-PERCENT TURNOVER IN DYNALECTRON'S KEY PERSONNEL DURING THE LIFE OF ITS CONTRACT THERE. FURTHER, WE BELIEVE THAT DOT'S USE OF BOEING'S SEPARATION HISTORY AT KENNEDY SPACE CENTER WAS REASONABLE. THE RECORD REVEALS THAT DOT CHOSE BOEING'S KENNEDY SPACE CENTER EXPERIENCE AS A BASELINE FOR PROJECTION OF RELOCATION COSTS BECAUSE THE KENNEDY SPACE CENTER AND THE TRANSPORTATION TEST CENTER WERE BOTH REMOTE LOCALES. EVEN SO, BOEING'S RETENTION OF PERSONNEL SITUATION WAS STILL MORE DIFFICULT THAN DYNALECTRON'S BECAUSE THE KENNEDY SPACE CENTER WORKFORCE ENJOYED MANY POTENTIAL JOB OPPORTUNITIES IN THE SURROUNDING MILITARY-COMMERCIAL SPACE BUSINESS COMMUNITY AND, THUS, WAS QUITE MOBILE. BECAUSE OF THE LIMITED JOB OPPORTUNITIES IN THE PUEBLO, COLORADO, AREA, IT APPEARS THAT THE WORKFORCE AT THE TRANSPORTATION TEST CENTER WAS SUBSTANTIALLY CAPTIVE.

E. DYNALECTRON REFERENCES SUBSTITUTE PAGE D-8 OF AMENDMENT 3 AS SUPPORT FOR ITS CONTENTION THAT THAT RFP AMENDMENT REQUIRED OFFERORS TO PROPOSE A MINIMUM OF 168 MAN-YEARS OF EFFORT FOR EACH OF THE 4 BASIC CONTRACT YEARS AND 185 MAN-YEARS FOR THE OPTION YEAR. HOWEVER, WE FIND NOTHING ON THAT PAGE OR ELSEWHERE IN AMENDMENT 3 THAT SPECIFIED SUCH A MINIMUM. RATHER, AMENDMENT 3 TO THE RFP PROVIDED AS FOLLOWS:

"2. THE OFFEROR SHALL PROPOSE A TARGET OF PRODUCTIVE MANHOURS FOR THE INITIAL FOUR YEARS FALLING WITHIN A SWING FROM 3,788,928 PRODUCTIVE MANHOURS TO 4,642,560 PRODUCTIVE MANHOURS, WHICH SHALL RESULT IN THE CONTRACT MINIMUM AND MAXIMUM FOR THE FOUR YEARS. THE OFFEROR SHALL ALSO PROPOSE A TARGET OF PRODUCTIVE MANHOURS FOR THE OPTION YEAR FALLING WITHIN A SWING FROM 1,044,576 PRODUCTIVE MANHOURS TO 1,276,704 PRODUCTIVE MANHOURS WHICH SHALL RESULT IN THE CONTRACT MINIMUM AND MAXIMUM FOR THE OPTION YEAR. THE GOVERNMENT ESTIMATED TARGETS OF MAN YEARS FALL APPROXIMATELY IN THE MIDDLE OF THESE SWINGS (REFERENCE SCHEDULES 4, 4A, 5 AND 5A OF THIS SECTION). PROPOSALS SHALL NOT DEVIATE ( OR -) MORE THAN 34 MAN YEARS FROM THE GOVERNMENT ESTIMATE (AS SET FORTH IN SCHEDULE 5) FOR EACH YEAR PROPOSED. PROPOSALS SHALL NOT DEVIATE ( OR -) MORE THAN 36 MAN YEARS FROM THE GOVERNMENT ESTIMATE (AS SET FORTH IN SCHEDULE 5A) FOR THE OPTION YEAR PROPOSED."

AS DOT POINTS OUT, WHEN THE SALARIED PERSONNEL OF BOEING'S MINORITY AND SMALL BUSINESS CONTRACTORS WERE ADDED TO BOEING'S OWN SALARIED PERSONNEL, BOEING'S PROPOSAL SATISFIED THE TARGET GUIDELINES OF RFP AMENDMENT 3.

CONCLUSION

ACCORDINGLY, DYNALECTRON'S PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs