Skip to main content

B-215554, SEP 26, 1985, 85-2 CPD 341

B-215554 Sep 26, 1985
Jump To:
Skip to Highlights

Highlights

WHERE A SOURCE SELECTION EVALUATION BOARD (SSEB) DETERMINES THAT TECHNICAL DATA CONTAINED IN AN OFFEROR'S PROPOSAL HAVE NOT BEEN SUPPORTED IN THE PROPOSAL. ISSUES CONCERNING THE EVALUATION OF A PROTESTER'S COST PROPOSAL ARE ACADEMIC WHEN THE AGENCY PROPERLY HAS DETERMINED THAT THE PROTESTER'S TECHNICAL PROPOSAL IS UNACCEPTABLE. WHERE THE PROTESTER AND THE AGENCY DISAGREE OVER WHETHER THE PROTESTER'S DESIGN WOULD MEET THE REQUIREMENTS OF THE SOLICITATION AND THE PROTESTER HAS NOT SHOWN THAT THE AGENCY'S ANALYSES OF THE PROTESTER'S PROPOSAL WERE CLEARLY IN ERROR. GAO WILL NOT QUESTION THE AGENCY'S TECHNICAL CONCLUSION. WHICH WERE MORE CONSERVATIVE THAN THE PROTESTER'S DATA. IS NOT OBJECTIONABLE WHEN THE PROTESTER FAILED TO PROVIDE THE AGENCY WITH ADEQUATE BACKUP MATERIAL TO SUPPORT THE USE OF THE PROTESTER'S DATA.

View Decision

B-215554, SEP 26, 1985, 85-2 CPD 341

CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - TECHNICAL ACCEPTABILITY - ADMINISTRATIVE DETERMINATION DIGEST: 1. WHERE A SOURCE SELECTION EVALUATION BOARD (SSEB) DETERMINES THAT TECHNICAL DATA CONTAINED IN AN OFFEROR'S PROPOSAL HAVE NOT BEEN SUPPORTED IN THE PROPOSAL, THE SSEB MAY, BASED ON ITS COLLECTIVE EXPERIENCE, EXTRAPOLATE FROM THE DATA SUPPLIED BY THE OFFEROR TO PRODUCE RELIABLE DATA NEEDED TO EVALUATE THE PROPOSAL. CONTRACTS - PROTESTS - GENERAL ACCOUNTING OFFICE PROCEDURES - TIMELINESS OF PROTEST - DATE BASIS OF PROTEST MADE KNOWN TO PROTESTER 2. EACH NEW BASIS FOR PROTEST FIRST RAISED AFTER THE INITIAL FILING OF A PROTEST MUST SATISFY INDEPENDENTLY GAO'S TIMELINESS REQUIREMENTS, AND A PROTESTER'S RESERVATION OF THE RIGHT TO RAISE NEW ISSUES SUBSEQUENT TO THE INITIAL FILING DOES NOT EXEMPT THE PROTESTER FROM THESE REQUIREMENTS. CONTRACTS - PROTESTS - MOOT, ACADEMIC, ETC. QUESTIONS - PROTESTER NOT IN LINE FOR AWARD 3. ISSUES CONCERNING THE EVALUATION OF A PROTESTER'S COST PROPOSAL ARE ACADEMIC WHEN THE AGENCY PROPERLY HAS DETERMINED THAT THE PROTESTER'S TECHNICAL PROPOSAL IS UNACCEPTABLE. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - TECHNICAL ACCEPTABILITY - ADMINISTRATIVE DETERMINATION 4. WHERE THE PROTESTER PROPOSES A PAYLOAD WEIGHT OF 54.54 (PLUS OR MINUS 0.43) POUNDS, AND THREE WEIGHT ANALYSES BY THE AGENCY SHOW THAT THE PROTESTER'S PAYLOAD WOULD EXCEED THE 55-POUND LIMIT STATED IN THE SOLICITATION, THE AGENCY'S CONCLUSION THAT THE PROTESTER'S PAYLOAD CARRIED A VERY HIGH RISK OF BEING OVERWEIGHT CANNOT BE SAID TO BE UNREASONABLE, PARTICULARLY WHEN THE AGENCY HAS REASON TO QUESTION THE ACCURACY OF THE PROTESTER'S WEIGHT DATA. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - TECHNICAL ACCEPTABILITY - OFFEROR'S RESPONSIBILITY TO DEMONSTRATE 5. WHERE THE PROTESTER AND THE AGENCY DISAGREE OVER WHETHER THE PROTESTER'S DESIGN WOULD MEET THE REQUIREMENTS OF THE SOLICITATION AND THE PROTESTER HAS NOT SHOWN THAT THE AGENCY'S ANALYSES OF THE PROTESTER'S PROPOSAL WERE CLEARLY IN ERROR, GAO WILL NOT QUESTION THE AGENCY'S TECHNICAL CONCLUSION. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - TECHNICAL ACCEPTABILITY - ADMINISTRATIVE DETERMINATION 6. AN AGENCY'S USE FOR EVALUATION PURPOSES OF ITS OWN SENSITIVITY DATA, WHICH WERE MORE CONSERVATIVE THAN THE PROTESTER'S DATA, IS NOT OBJECTIONABLE WHEN THE PROTESTER FAILED TO PROVIDE THE AGENCY WITH ADEQUATE BACKUP MATERIAL TO SUPPORT THE USE OF THE PROTESTER'S DATA. CONTRACTS - PROTESTS - BURDEN OF PROOF - ON PROTESTER 7. PROTEST IS DENIED WHERE THE PROTESTER ADMITS THAT THE DRIFT RATE PROPOSED IN ITS DESIGN DOES NOT SATISFY THE REQUIREMENT OF THE SOLICITATION AND THE PROTESTER DOES NOT PROVIDE A BASIS FOR QUESTIONING THE AGENCY'S JUDGMENT THAT THE PROPOSED RATE WOULD PRESENT SERIOUS OPERATIONAL PROBLEMS. CONTRACTS - NEGOTIATION - OFFERS OR PROPOSALS - EVALUATION - TECHNICAL ACCEPTABILITY - ADMINISTRATIVE DETERMINATION 8. AGENCY EVALUATORS CANNOT JUST ACCEPT BLINDLY AN OFFEROR'S CONCLUSION THAT ITS DESIGN WILL BE STABLE, BUT MUST MAKE AN INDEPENDENT JUDGMENT OF THE RISKS INHERENT IN THE PROPOSED DESIGN.

WESTINGHOUSE ELECTRIC CORPORATION:

WESTINGHOUSE ELECTRIC CORPORATION PROTESTS THE REJECTION OF THE PROPOSAL IT SUBMITTED IN RESPONSE TO REQUEST FOR PROPOSALS (RFP) NO. DAAK20-84-O- 0337, ISSUED BY THE ARMY ELECTRONICS RESEARCH AND DEVELOPMENT COMMAND, FORT MONMOUTH, NEW JERSEY. WESTINGHOUSE DISPUTES THE ARMY'S DETERMINATION THAT ITS PROPOSAL WAS TECHNICALLY UNACCEPTABLE AND CONTENDS THAT THE AGENCY IMPROPERLY EVALUATED THE PROPOSAL, THAT THE EVALUATORS PRESENTED INACCURATE INFORMATION CONCERNING THE PROPOSAL TO THE SOURCE SELECTION AUTHORITY, AND THAT THE AGENCY IGNORED THE SIGNIFICANT COST SAVINGS THAT THE WESTINGHOUSE PROPOSAL WOULD YIELD. WE DENY THE PROTEST IN PART AND DISMISS IT IN PART.

I. BACKGROUND

THE SOLICITATION SOUGHT PROPOSALS FOR THE FULL-SCALE DEVELOPMENT /1/ OF A FORWARD-LOOKING INFRARED (FLIR) MISSION PAYLOAD SUBSYSTEM (FMPS) FOR THE ARMY'S REMOTELY PILOTED AIR VEHICLE (RPV). THE RPV IS A DRONE AIRCRAFT THAT THE ARMY PLANS TO USE FOR BATTLEFIELD RECONNAISSANCE, TARGET DESIGNATION, ARTILLERY FIRE ADJUSTMENT, AND DAMAGE ASSESSMENT. THE RPV SYSTEM CONSISTS OF AN AIR VEHICLE, A GROUND CONTROL STATION, LAUNCH AND RECOVERY EQUIPMENT, AND GENERAL SUPPORT AND MAINTENANCE EQUIPMENT. INTERCHANGEABLE PAYLOADS WILL ENABLE THE RPV TO PERFORM ITS VARIOUS MISSIONS UNDER VARYING CONDITIONS.

ONE PAYLOAD CURRENTLY IN DEVELOPMENT IS A DAYTIME SYSTEM CONSISTING PRIMARILY OF A TELEVISION CAMERA AND A LASER RANGEFINDER/DESIGNATOR. THE LATTER DEVICE CAN BE ALIGNED OPTICALLY WITH THE TV CAMERA TO FOCUS A LASER BEAM ON A TARGET, EITHER TO MEASURE ITS DISTANCE OR TO GUIDE SO CALLED "SMART AMMUNITION." WESTINGHOUSE IS DEVELOPING THE DAYTIME SYSTEM UNDER A SUBCONTRACT WITH THE RPV'S PRIME CONTRACTOR. THE SOLICITATION IN THIS CASE, HOWEVER, WAS FOR A SYSTEM THAT CAN PERFORM THE SAME MISSION AT NIGHT OR WHEN VISIBILITY IS REDUCED BECAUSE OF ADVERSE WEATHER CONDITIONS. THIS CAPABILITY IS ACHIEVED LARGELY THROUGH USE OF A THERMAL IMAGING SENSOR, OR FLIR.

THE SOLICITATION STATED THAT THE ARMY WOULD AWARD A FIXED-PRICE INCENTIVE CONTRACT TO THE OFFEROR WITH THE BEST OVERALL PROPOSAL BASED ON THE FOLLOWING MAJOR FACTORS, IN ORDER OF IMPORTANCE: TECHNICAL, INTEGRATED LOGISTICS SUPPORT (ILS), COST, AND MANAGEMENT. EVALUATION SUBFACTORS WERE LISTED UNDER EACH MAJOR FACTOR. IN THE TECHNICAL AREA, THE SUBFACTORS WERE, IN DESCENDING ORDER OF IMPORTANCE:

1. INTEGRATION AND ASSEMBLY

2. FLIR SENSOR

3. GIMBALS AND STABILIZATION

4. ELECTRONICS

5. LASER RANGEFINDER/DESIGNATOR

6. TESTING

7. PAYLOAD CONTROL UNIT

ONLY FORD AND WESTINGHOUSE SUBMITTED PROPOSALS IN RESPONSE TO THE SOLICITATION. FOLLOWING AN INITIAL EVALUATION OF THE PROPOSALS BY THE SOURCE SELECTION EVALUATION BOARD (SSEB), THE AGENCY DETERMINED THAT BOTH PROPOSALS WERE IN THE COMPETITIVE RANGE. THE AGENCY THEN HELD THREE SUCCESSIVE ROUNDS OF NEGOTIATIONS WITH THE OFFERORS. EACH ROUND CONSISTED OF A NUMBER OF WRITTEN QUESTIONS TO THE OFFERORS, ORAL DISCUSSIONS, WRITTEN RESPONSES BY THE OFFERORS, AND A FURTHER EVALUATION BY THE SSEB. AFTER EVALUATING THE BEST AND FINAL OFFERS, THE SSEB GAVE THE WESTINGHOUSE PROPOSAL AN OVERALL TECHNICAL RATING OF UNACCEPTABLE, BASED ON PERCEIVED DEFICIENCIES UNDER TWO TECHNICAL EVALUATION SUBFACTORS: INTEGRATION AND ASSEMBLY, AND GIMBALS AND STABILIZATION. THE SSEB REPORTED THE RESULTS OF ITS EVALUATION TO THE SOURCE SELECTION AUTHORITY (SSA) WHO SELECTED FORD AEROSPACE FOR AWARD. BY LETTER DATED MAY 31, 1984, THE AGENCY NOTIFIED WESTINGHOUSE THAT ITS PROPOSAL HAD BEEN REJECTED AND BRIEFLY SUMMARIZED THE REASONS FOR THE UNACCEPTABLE RATING UNDER THE TWO TECHNICAL SUBFACTORS LISTED ABOVE.

BY LETTER DATED JUNE 14, WESTINGHOUSE FILED A PROTEST WITH THIS OFFICE CONTENDING THAT THE ARMY HAD DETERMINED INCORRECTLY THAT ITS PROPOSAL WAS TECHNICALLY UNACCEPTABLE, CITING BOTH THE INTEGRATION AND ASSEMBLY AND THE GIMBALS AND STABILIZATION SUBFACTORS. THE PROTESTER ALSO COMPLAINED THAT THE AGENCY FAILED TO CONSIDER ITS SUBSTANTIAL COST ADVANTAGE. WESTINGHOUSE STATED THAT IT HAD BEEN UNABLE TO OBTAIN A COMPLETE DEBRIEFING AND, THAT FOR THIS REASON AND BECAUSE OF THE COMPLEXITY OF THE ISSUES INVOLVED, IT WAS RESERVING THE RIGHT TO SUPPLEMENT ITS PROTEST WHEN IT LEARNED MORE ABOUT WHY THE AGENCY HAD REJECTED ITS PROPOSAL.

AFTER THE AGENCY SUBMITTED ITS ADMINISTRATIVE REPORT-- WHICH CONSISTED OF 25 VOLUMES OF MATERIAL-- WESTINGHOUSE SUBMITTED A LENGTHY STATEMENT ON AUGUST 30 WHICH EXPLAINED THE BASIS FOR ITS DISAGREEMENT WITH THE AGENCY CONCERNING THE INTEGRATION AND ASSEMBLY AND THE GIMBALS AND STABILIZATION TECHNICAL SUBFACTORS. THE STATEMENT ALSO RAISED ISSUES CONCERNING THE EVALUATION OF THE PROTESTER'S PROPOSAL UNDER THE ILS, COST, AND MANAGEMENT FACTORS. FOLLOWING A PROTEST CONFERENCE ATTENDED BY REPRESENTATIVES FROM WESTINGHOUSE, THE ARMY AND THIS OFFICE, BOTH PARTIES MADE FURTHER SUBMISSIONS. THE ARMY OFFERED A DETAILED POINT-BY-POINT REFUTATION OF ALL THE ALLEGATIONS MADE BY WESTINGHOUSE IN ITS SUBMISSION OF AUGUST 30. AFTER REVIEWING THIS MATERIAL, WESTINGHOUSE SAID THAT IT CONTINUED TO MAINTAIN THAT THE ARMY HAD NOT PROPERLY EVALUATED ITS PROPOSAL.

II. TIMELINESS

THE AGENCY ARGUES THAT THE ISSUES RAISED FOR THE FIRST TIME IN THE PROTESTER'S AUGUST 30 SUBMISSION ARE UNTIMELY. WE AGREE.

OUR BID PROTEST PROCEDURES, APPLICABLE AT THE TIME THIS PROTEST WAS FILED, STATED THAT A PROTEST BASED ON OTHER THAN ALLEGED SOLICITATION IMPROPRIETIES MUST BE FILED WITHIN 10 DAYS OF WHEN THE BASIS FOR THE PROTEST IS KNOWN OR SHOULD HAVE BEEN KNOWN. 4 C.F.R. SEC. 21.2(B)(2) (1984). IN THIS CASE, WESTINGHOUSE KNEW WHEN IT RECEIVED THE ARMY'S LETTER OF MAY 31 THAT THE AGENCY HAD DETERMINED THAT ITS PROPOSAL WAS UNACCEPTABLE BASED ON PERCEIVED DEFICIENCIES IN TWO TECHNICAL SUBFACTORS: INTEGRATION AND ASSEMBLY, AND GIMBALS AND STABILIZATION. FOLLOWING A DEBRIEFING ON JUNE 13, WESTINGHOUSE FILED A PROTEST ON JUNE 14 CHALLENGING THE AGENCY'S CONCLUSIONS WITH RESPECT TO THESE TWO TECHNICAL SUBFACTORS AND ITS FAILURE TO CONSIDER THE COST ADVANTAGE OF THE FIRM'S PROPOSAL. WESTINGHOUSE RESERVED THE RIGHT TO SUPPLEMENT ITS PROTEST WITH ADDITIONAL FACTS IF AND WHEN THEY BECAME AVAILABLE. IN ITS SUBMISSION OF AUGUST 30, WESTINGHOUSE RAISED ADDITIONAL ISSUES CONCERNING THE ILS, COST, AND MANAGEMENT EVALUATION FACTORS.

AS THE ARMY CORRECTLY POINTS OUT, A PROTESTER'S USE OF LANGUAGE RESERVING THE RIGHT TO RAISE NEW ISSUES SUBSEQUENT TO FILING ITS INITIAL PROTEST DOES NOT EXEMPT THE PROTESTER FROM OUR TIMELINESS REQUIREMENTS. TRACOR JITCO INC., B-208476, JAN. 31, 1983, 83-1 CPD PARA. 98. RATHER, EACH NEW BASIS FOR PROTEST FIRST RAISED AFTER THE INITIAL FILING MUST SATISFY THE TIMELINESS REQUIREMENTS INDEPENDENTLY. SISKA CONSTRUCTION CO. INC., B-218428, JUNE 11, 1985, 85-1 CPD PARA. 669.

WHILE THE LINE BETWEEN A NEW BASIS FOR PROTEST AND ADDITIONAL DETAILS IN SUPPORT OF A TIMELY FILED PROTEST IS NOT ALWAYS CLEAR, WE THINK THE ISSUES RAISED IN THE AUGUST 30 LETTER CONCERNING ILS AND MANAGEMENT EVALUATION FACTORS ARE INDEPENDENT BASES FOR CHALLENGING THE EVALUATION OF THE WESTINGHOUSE PROPOSAL. SINCE THE LATEST THAT WESTINGHOUSE COULD HAVE BEEN AWARE OF THE ARMY'S EVALUATION OF ITS PROPOSAL WITH RESPECT TO THESE TWO FACTORS WAS IN LATE JULY, WHEN IT RECEIVED A COPY OF THE AGENCY REPORT, THE RAISING OF THESE ISSUES FOR THE FIRST TIME ON AUGUST 30 WAS UNTIMELY. WITH RESPECT TO THE COST ISSUE, THE PROTESTER MERELY ALLEGED IN ITS PROTEST ON JUNE 14 THAT THE AGENCY GAVE NO CONSIDERATION TO THE FACT THAT ACCEPTANCE OF ITS PROPOSAL WOULD HAVE RESULTED IN A LOWER COST TO THE GOVERNMENT. WHILE WE AGREE WITH THE ARMY THAT THE ARGUMENTS MADE BY WESTINGHOUSE IN ITS AUGUST 30 SUBMISSION PROBABLY RAISE NEW ISSUES REGARDING THE AGENCY'S EVALUATION OF THE WESTINGHOUSE COST PROPOSAL, WE THINK THE ISSUE IS ACADEMIC. GIVEN OUR CONCLUSION THAT THE AGENCY REASONABLY DETERMINED THAT THE WESTINGHOUSE PROPOSAL WAS TECHNICALLY UNACCEPTABLE, THERE IS NO REASON TO CONSIDER ANY OF THE ISSUES CONCERNING THE EVALUATION OF THE COST PROPOSAL SINCE THE PROPOSAL COULD NOT HAVE BEEN ACCEPTED FOR AWARD. FIL-COIL CO. INC., B-213078, FEB. 22, 1984, 84-1 CPD PARA. 219.

III. SUMMARY CONCLUSION

THIS PROTEST INVOLVES A PROCUREMENT OF EXTREMELY SOPHISTICATED HARDWARE. THE ISSUES RAISED BY THE PROTESTER WERE HIGHLY TECHNICAL AND REQUIRED US TO REVIEW A VOLUMINOUS AND COMPLEX RECORD. EACH OF THE ISSUES TIMELY RAISED IS DISCUSSED BELOW. SINCE BOTH WESTINGHOUSE AND THE ARMY ESSENTIALLY REPEAT MANY OF THE SAME ARGUMENTS WITH RESPECT TO EACH OF THESE ISSUES, HOWEVER, WE FIRST PRESENT OUR OVERALL OBSERVATIONS AND CONCLUSIONS.

THE SUBSTANTIVE ISSUES RAISED INVOLVE AREAS OF TECHNICAL DISAGREEMENT BETWEEN WESTINGHOUSE AND THE ARMY. IN THIS REGARD, IT IS NOT THE FUNCTION OF THIS OFFICE TO REEVALUATE TECHNICAL PROPOSALS. BANK STREET COLLEGE OF EDUCATION, 63 COMP.GEN. 393 (1984), 84-1 CPD PARA. 607. THE DETERMINATION OF THE NEEDS OF THE GOVERNMENT AND THE METHOD OF ACCOMMODATING SUCH NEEDS ARE PRIMARILY THE RESPONSIBILITY OF THE PROCURING AGENCY, 46 COMP.GEN. 606 (1967), WHICH THEREFORE IS RESPONSIBLE FOR THE OVERALL DETERMINATION OF THE RELATIVE DESIRABILITY AND TECHNICAL ADEQUACY OF PROPOSALS. IN MAKING SUCH DETERMINATIONS, THE AGENCY'S SPECIALISTS AND TECHNICIANS ENJOY A REASONABLE RANGE OF DISCRETION, AND THIS OFFICE WILL NOT QUESTION THEIR DETERMINATIONS UNLESS THERE IS A CLEAR SHOWING OF UNREASONABLENESS, AN ARBITRARY ABUSE OF DISCRETION, OR A VIOLATION OF THE PROCUREMENT STATUTES AND REGULATIONS. METIS CORP., 54 COMP.GEN. 512 (1975), 75-1 CPD PARA. 44. THIS IS PARTICULARLY SO WHERE, AS HERE, THE AGENCY IS PROCURING SOPHISTICATED TECHNICAL HARDWARE. COHERENT LASER SYSTEMS, B-204701, JUNE 2, 1982, 82-1 CPD PARA. 517. WE DID NOT PERFORM AN INDEPENDENT TECHNICAL EVALUATION IN THIS CASE, BUT RATHER APPLIED THE STANDARD SET FORTH ABOVE. USING THIS STANDARD, WE FOUND NO BASIS FOR OBJECTING TO THE EVALUATION OF THE WESTINGHOUSE PROPOSAL.

ONE COMMON THREAD THAT RUNS THROUGH ALL OF THE TECHNICAL ISSUES IS THE ALLEGATION BY WESTINGHOUSE THAT THE SSEB SUBSTITUTED ITS OWN DATA FOR THAT SUPPLIED BY WESTINGHOUSE AND THUS MISREPRESENTED ITS PROPOSAL TO THE SSA. WE FOUND NO EVIDENCE OF MISREPRESENTATION OR OTHER IMPROPRIETY. FIRST, THE ISSUE HERE IS NOT WHETHER THE SSEB COMMUNICATED VERBATIM TO THE SSA ALL OF THE CLAIMS MADE BY WESTINGHOUSE IN ITS PROPOSAL, BUT RATHER WHETHER THE EVALUATION BY THE SSEB, UPON WHOSE JUDGMENT THE SSA APPEARS TO HAVE RELIED HEAVILY IN MAKING THE AWARD DECISION, WAS FAIR AND REASONABLE. THIS RESPECT, IT APPEARS THAT THE SSEB CONTINUALLY WAS FRUSTRATED BY THE INADEQUACY OF THE BACKUP DATA SUPPLIED BY WESTINGHOUSE. THROUGHOUT THE ENTIRE EVALUATION PROCESS, INCLUDING HUNDREDS OF DISCUSSION POINTS CALLED "ERRORS, OMISSIONS AND CLARIFICATIONS," THE SSEB FOUND, AND OUR REVIEW HAS CONFIRMED, THAT THE DATA SUPPLIED BY WESTINGHOUSE WERE HARD TO FIND, INCOMPLETE OR CONCLUSORY. WHEN THE SSEB FOUND THE WESTINGHOUSE DATA TO BE INADEQUATE, IT OFTEN EXTRAPOLATED FROM THAT DATA AND SUBSTITUTED ITS OWN DATA, WHICH WERE USUALLY MORE CONSERVATIVE. WHILE THIS CAUSED THE SSEB'S ASSESSMENT OF THE RISKS INVOLVED IN THE PROPOSAL TO VARY FROM THE PROTESTER'S ASSESSMENT, WE THINK THE SSEB WAS MERELY PERFORMING ITS ASSIGNED TASK OF CONDUCTING AN INDEPENDENT EVALUATION OF THE TECHNICAL ADEQUACY OF THE WESTINGHOUSE DESIGN.

IV. DETAILED ANALYSIS

IN ASSESSING THE MERITS OF THE WESTINGHOUSE AND FORD PROPOSALS, THE AGENCY USED A RATING SCHEME INVOLVING STRONG POINTS, SIGNIFICANT STRONG POINTS (GREEN FLAGS), WEAK POINTS, AND MAJOR DEFICIENCIES (RED FLAGS). THE AGENCY USED THESE RATINGS AS GUIDES TO DETERMINE WHETHER EACH PROPOSAL WAS ACCEPTABLE OR UNACCEPTABLE FOR EACH EVALUATION FACTOR AND SUBFACTOR. THE AGENCY REJECTED THE PROPOSAL FROM WESTINGHOUSE BECAUSE OF RED FLAGS THE FIRM'S PROPOSAL RECEIVED (LEADING TO UNACCEPTABLE RATINGS) FOR SIX EVALUATION SUBFACTORS. IN ITS PROTEST, WESTINGHOUSE CONCENTRATES ON THESE SIX AREAS AND HAS ATTEMPTED TO CHALLENGE SPECIFIC STATEMENTS MADE BY THE SSEB WITH RESPECT TO EACH. OUR CONSIDERATION OF THE PROTEST FOLLOWS THIS APPROACH.

A. INTEGRATION AND ASSEMBLY

1. WEIGHT

THE PURCHASE DESCRIPTION INCORPORATED IN THE SOLICITATION STATED THAT THE TOTAL INSTALLED WEIGHT OF THE FMPS AND THE MOUNTING FIXTURE ON THE RPV COULD NOT EXCEED 55 POUNDS. THE WESTINGHOUSE PROPOSAL RECEIVED A FINAL RATING OF UNSATISFACTORY UNDER THE INTEGRATION AND ASSEMBLY SUBFACTOR IN PART BECAUSE OF A RED FLAG IN THE WEIGHT AREA. THE EVALUATORS STATED THAT WESTINGHOUSE HAD ADMITTED IN ITS PROPOSAL THAT ITS DESIGN WOULD WEIGH AT LEAST 55.61 POUNDS AND THAT, ALTHOUGH WESTINGHOUSE HAD SUGGESTED WEIGHT REDUCTION MEASURES TOTALING 1.67 POUNDS, WESTINGHOUSE HAD NOT INCORPORATED THESE MEASURES IN ITS PROPOSED DESIGN. MOREOVER, THE EVALUATORS CITED THREE SEPARATE GOVERNMENT ANALYSES OF THE WESTINGHOUSE DESIGN SHOWING THAT THE WESTINGHOUSE FMPS WOULD WEIGH BETWEEN 59.72 AND 62.02 POUNDS. WESTINGHOUSE SAYS THAT THE PROPOSED WEIGHT OF ITS FMPS WAS NOT THE 55.61 POUNDS USED BY EVALUATORS, BUT RATHER WAS 54.54 POUNDS, PLUS OR MINUS 0.43 POUNDS. WESTINGHOUSE CHALLENGES THE ACCURACY OF THE THREE ANALYSES MADE BY THE EVALUATORS, CONTENDING THAT THEY WERE NOT BASED ON DATA PROVIDED BY WESTINGHOUSE AND THAT THEY IMPROPERLY USED GROWTH PERCENTAGES IN ESTIMATING THE WEIGHT OF THE WESTINGHOUSE DESIGN. THE ARMY'S INDISCRIMINATE USE OF GROWTH PERCENTAGES, SAYS WESTINGHOUSE, FAILED TO ACCOUNT FOR THE FACTS THAT THE PROPOSED SYSTEM WAS IN LARGE PART A MATURE DESIGN-- AND THUS WOULD NOT EXPERIENCE THE SAME RATE OF WEIGHT GROWTH AS MIGHT A SYSTEM IN AN EARLIER STAGE OF DEVELOPMENT-- AND THAT THE WEIGHT FIGURES PROVIDED BY WESTINGHOUSE WERE BASED ON SCALE WEIGHTS OF EXISTING COMPONENTS.

FROM OUR REVIEW OF THE RECORD, IT APPEARS THAT THE CLAIM BY THE EVALUATORS THAT WESTINGHOUSE "ADMITS TO BEING OVER THE REQUIRED WEIGHT" IS NOT ENTIRELY ACCURATE. WESTINGHOUSE ACTUALLY PROPOSED A WEIGHT OF 54.54 POUNDS, PLUS OR MINUS A TOLERANCE OF 0.43 POUNDS. THE FIRM ARRIVED AT THIS WEIGHT BY SUBTRACTING 1.67 POUNDS FROM THE 55.72 POUNDS IT ORIGINALLY PROPOSED TO ACCOUNT FOR SELECTED WEIGHT REDUCTION MEASURES. WESTINGHOUSE THEN ADDED 0.49 POUNDS TO ACCOUNT FOR CHANGES MADE TO REDUCE SINUSOIDAL (UP AND DOWN) VIBRATION. THE AGENCY CALCULATED THE WEIGHT OF THE PROPOSED WESTINGHOUSE FMPS TO BE 55.61 POUNDS BY TAKING THE WEIGHT ORIGINALLY PROPOSED BY WESTINGHOUSE, 55.72 POUNDS, AND SUBTRACTING 0.11 POUNDS TO ACCOUNT FOR A CORRECTION IN THE ACTUAL WEIGHT OF THE FLIR, A WEIGHT THAT WAS SUBSTANTIATED BY THE FLIR SUBCONTRACTOR. THUS, THE AGENCY DID NOT INCLUDE IN ITS CALCULATIONS EITHER THE 1.67-POUND DECREASE OR THE 0.49- POUND INCREASE. WHILE THE AGENCY'S REASON FOR OVERLOOKING THE 0.49-POUND INCREASE IS NOT APPARENT, THE RECORD INDICATES THAT THE EVALUATORS IGNORED THE 1.67 POUNDS OF WEIGHT REDUCTION MEASURES PROPOSED BY WESTINGHOUSE BECAUSE THEY FOUND THAT THE PROPOSED MEASURES HAD NOT BEEN SUBSTANTIATED ADEQUATELY. FOR EXAMPLE, THE EVALUATORS NOTED THAT WHILE WESTINGHOUSE PROPOSED A CHANGE TO A COMPOSITE GRAPHITE EPOXY MATERIAL FOR BOTH THE YOKE AND THE ELEVATION GIMBAL, THE FIRM HAD SAID IN ITS ORIGINAL PROPOSAL THAT THIS WOULD RESULT IN "LOW PRODUCIBILITY, HIGH COMPLEXITY AND HIGH COST, AND SHOULD NOT BE DONE." THE EVALUATORS ALSO SAID A PROPOSED 0.30-POUND REDUCTION IN THE WEIGHT OF THE FLIR THROUGH SUBSTITUTION OF MATERIALS HAD NOT BEEN ADDRESSED BY THE FLIR SUBCONTRACTOR.

FROM OUR REVIEW OF THE RECORD, WE CANNOT SAY THAT THE AGENCY'S CONCLUSION THAT THE WESTINGHOUSE DESIGN POSED AN UNACCEPTABLE RISK OF NOT MEETING THE WEIGHT LIMIT WAS UNREASONABLE. AS EXPLAINED BY THE AGENCY, THE PRECISE WEIGHT OF THE FMPS IS IMPORTANT BECAUSE CHANGES IN PAYLOAD WEIGHT DIRECTLY AFFECT THE CENTER OF GRAVITY, AND THUS THE FLIGHT PERFORMANCE, OF THE AIR VEHICLE. EXCESS WEIGHT ALSO CAN AFFECT ADVERSELY THE AIR VEHICLE'S MANEUVERABILITY, RANGE, ENDURANCE, AND SPEED. FOR THESE REASONS, THE SOLICITATION ESTABLISHED A MAXIMUM FMPS WEIGHT OF 55 POUNDS.

WHILE IT MAY NOT HAVE BEEN ACCURATE FOR THE EVALUATORS TO CLAIM THAT WESTINGHOUSE "ADMITS TO BEING OVER THE REQUIRED WEIGHT," THE WEIGHT THAT WESTINGHOUSE PROPOSED NEVERTHELESS WAS VERY CLOSE TO THE MAXIMUM ALLOWED, AND IT IS CLEAR THROUGHOUT THE EVALUATION DOCUMENTS THAT THE SSEB WAS CONCERNED THAT THE WESTINGHOUSE DESIGN CARRIED A VERY HIGH RISK OF PRODUCING A PAYLOAD THAT WOULD BE OVERWEIGHT. IN ADDITION, THE EVALUATORS STATED THAT THIS CONCERN WAS INCREASED BECAUSE OF THEIR VIEW THAT THE WEIGHT DATA PROVIDED WESTINGHOUSE THROUGHOUT THE PROCUREMENT CYCLE WERE CONFUSED, INCONSISTENT AND LACKED COHESIVENESS. THIS CONCERN WAS FURTHER HEIGHTENED BY THE NEED FOR WESTINGHOUSE TO MAKE ITS FMPS MORE RIGID, WHICH THE EVALUATORS BELIEVED ALMOST CERTAINLY WOULD MEAN ADDITIONAL WEIGHT.

WE UNDERSTAND THE PROTESTER'S CONCERN THAT THE AGENCY EVALUATORS MAY HAVE OVEREMPHASIZED THE WEIGHT GROWTH PERCENTAGE IN THE AGENCY ANALYSES. THE ASSESSMENT OF THE RISK OF WEIGHT GROWTH INHERENT IN THE WESTINGHOUSE DESIGN IS, HOWEVER, LARGELY A MATTER OF TECHNICAL JUDGMENT, ANALYSIS AND EXPERIENCE AND WE ARE NOT PREPARED TO CONCLUDE THAT THE EVALUATORS ACTED UNREASONABLY BECAUSE THEY TOOK A CONSERVATIVE APPROACH IN THE EVALUATION. A SIGNIFICANT CONTRIBUTING FACTOR TO THIS APPROACH SEEMS TO HAVE BEEN THE EVALUATORS' INABILITY TO FIND ADEQUATE SUPPORTING DATA IN THE VARIOUS WESTINGHOUSE SUBMISSIONS, A CONCERN RAISED BY THE AGENCY IN A MAY 24, 1984, LETTER TO THE FIRM.

2. STRUCTURAL INTEGRITY

THE WESTINGHOUSE PROPOSAL ALSO RECEIVED A RED FLAG BECAUSE THE EVALUATORS PREDICTED EXCESSIVE LINE-OF-SIGHT ERRORS. IN ESSENCE, THE EVALUATORS FEARED THAT DURING EXTREME AIR VEHICLE DISTURBANCES, THE STRUCTURAL RESPONSE OF THE FMPS WOULD IMPAIR THE PAYLOAD'S ABILITY TO MAINTAIN A LINE OF SIGHT AND, THUS, WOULD NOT PERMIT ACCURATE TARGET TRACKING OR DESIGNATION. IN THIS CONNECTION, THE PURCHASE DESCRIPTION CONTAINED SEVERAL SPECIFIC REQUIREMENTS FOR THE FMPS TO MEET IN ORDER TO MINIMIZE EXTERNAL DISTURBANCE EFFECTS ON THE LINE OF SIGHT. ONE OF THESE READ: "GIMBAL MECHANICAL RESONANCES. THE LOWEST FREQUENCY MECHANICAL RESONANCE SHALL BE GREATER THAN 150 HZ."

THE BRIEFING TO THE SSA WITH RESPECT TO THIS ISSUE WAS AS FOLLOWS: "STRUCTURAL FLEXIBILITY AND RESONANCES CAUSE EXCESSIVE LINE-OF-SIGHT ERRORS, PRECLUDING TARGET TRACKING OR DESIGNATION. FLIR OPTICAL BENCH RESONATES BELOW REQUIRED 150 HZ. THRESHOLD. ICD (INTERFACE CONTROL DOCUMENT)-SPECIFIED VIBRATION ENVELOPE CAUSES EXCESSIVE LINE-OF-SIGHT JITTER." IN ADDITION, THE AGENCY ALSO NOTES THAT THE ERRORS AT THE ISOLATOR RESONANCE FREQUENCY ARE MORE THAN SIX TIMES THAT PERMITTED BY THE SPECIFICATION AND THAT THE OPTICAL BENCH HEAT EXCHANGER (OB/HE) ALSO FAILS THE 150-HZ. RESONANCE REQUIREMENT.

WESTINGHOUSE QUESTIONS THE AGENCY'S POSITION FIRST BY CONTENDING THAT THE 150-HZ. RESONANCE THRESHOLD DOES NOT APPLY TO THE FLIR OPTICAL BENCH OR TO THE OB/HE BECAUSE NEITHER OF THESE ITEMS IS A GIMBAL. MOREOVER, WESTINGHOUSE CONTENDS, IT AMPLY DEMONSTRATED THE ADEQUACY OF ITS STRUCTURAL DESIGN IN BOTH ITS BEST AND FINAL SUBMISSION AND ITS RIGIDITY STUDY. FURTHER, WESTINGHOUSE ARGUES THAT THE AIRCRAFT ENGINE, WHICH IS THE SOURCE OF THE VIBRATION, DOES NOT ROTATE SLOWLY ENOUGH DURING FLIGHT SUCH THAT EXCESSIVE LINE-OF-SIGHT JITTER WOULD RESULT.

THE ARMY CONCEDES THAT NEITHER THE FLIR OPTICAL BENCH OR THE OB/HE IS A GIMBAL. IT STATES, HOWEVER, THAT BOTH OF THESE ITEMS ARE KEY STRUCTURAL MEMBERS OF THE OUTER AZIMUTH GIMBAL WHICH MAINTAIN THE MECHANICAL RIGIDITY OF THAT GIMBAL. AS SUCH, ANY DISTURBANCE TRANSMITTED TO THESE COMPONENTS WILL AFFECT THE OUTER AZIMUTH GIMBAL AND, THEREFORE, AFFECT LINE-OF-SIGHT ACCURACY. WE ARE UNABLE TO FIND WHERE WESTINGHOUSE QUESTIONS THIS REASONING. WITH RESPECT TO THE WESTINGHOUSE RIGIDITY STUDY, THE ARMY NOTES THAT WHILE THE STUDY DOES SHOW ACCEPTABLE LINE-OF-SIGHT MOTIONS, THE STUDY WAS BASED ON MUCH DIFFERENT VIBRATION LEVELS THAN THOSE SPECIFIED IN THE INTERFACE CONTROL DOCUMENT. ONLY IN ITS FINAL OFFER DID WESTINGHOUSE USE THE REQUIRED VIBRATION LEVELS. IN THAT SUBMISSION, HOWEVER, WESTINGHOUSE MADE A NUMBER OF DESIGN CHANGES IN ORDER TO MEET THE RIGIDITY REQUIREMENTS. THESE CHANGES, SAYS THE ARMY, SIMPLY LED TO GREATER CONCERN ABOUT THE RISKS OF THE WESTINGHOUSE PROPOSAL AND STILL DID NOT MEET ALL THE REQUIREMENTS OF THE INTERFACE CONTROL DOCUMENT. FINALLY, WE NOTE THAT WESTINGHOUSE ACKNOWLEDGED IN ITS REVISED PROPOSAL THAT ITS LINE-OF-SIGHT MOTION DID NOT MEET THE REQUIREMENTS OF THE SPECIFICATION AT ALL FREQUENCIES, BUT ARGUED THAT THIS CONDITION WAS ACCEPTABLE BECAUSE THE LINE-OF-SIGHT ERROR RATE WOULD NOT BE EXCESSIVE AT THE RPV'S MINIMUM IN- FLIGHT ENGINE SPEED. IT APPEARS TO US, HOWEVER, THAT WESTINGHOUSE'S POSITION THAT THE AIRCRAFT ENGINE DOES NOT ROTATE SLOWLY ENOUGH DURING FLIGHT TO CAUSE ENOUGH VIBRATION TO RESULT IN EXCESSIVE LINE-OF-SIGHT ERRORS IS IN EFFECT AN ATTEMPT TO ALTER THE REQUIRED VIBRATION LEVELS CONTAINED IN THE INTERFACE CONTROL DOCUMENT.

WE REVIEWED ALL OF THE TECHNICAL ARGUMENTS MADE BY WESTINGHOUSE CONCERNING STRUCTURAL INTEGRITY TOGETHER WITH THE ARMY'S DETAILED TECHNICAL RESPONSES TO THOSE ARGUMENTS. ALTHOUGH WESTINGHOUSE IS CONVINCED THAT ITS DESIGN WOULD MEET THE REQUIREMENTS OF THE SOLICITATION, IT APPEARS TO US THAT THE ARMY HAD GOOD REASON, BASED ON ITS OWN ANALYSIS, TO CONCLUDE THAT IT WOULD NOT. WESTINGHOUSE HAS NOT CONVINCED US THAT THE ARMY'S ANALYSIS WAS CLEARLY IN ERROR.

3. BORESIGHT

THE WESTINGHOUSE PROPOSAL RECEIVED A RED FLAG IN THE FINAL EVALUATION BECAUSE OF A PERCEIVED PROBLEM WITH BORESIGHT, A MEASURE OF HOW CLOSE THE LASER IS TO THE TARGET. AFTER WESTINGHOUSE FILED ITS PROTEST, THE ARMY REEXAMINED THIS ISSUE AND DETERMINED THAT WHILE THE BORESIGHT PROBLEM WAS STILL A WEAK POINT, IT WAS NOT SO SERIOUS AS TO MERIT A RED FLAG. ALTHOUGH WESTINGHOUSE DOES NOT CONCEDE THAT ITS BORESIGHT CAPABILITY IS A WEAK POINT, WE SEE NO REASON TO DISCUSS THIS ISSUE FURTHER SINCE THE ARMY'S POSITION IS THAT ELIMINATING THE BORESIGHT RED FLAG WOULD NOT HAVE CHANGED THE OVERALL UNACCEPTABLE RATING FOR THE INTEGRATION AND ASSEMBLY SUBFACTOR. THUS, IT DOES NOT APPEAR THAT THE ADMITTED ERROR CONCERNING THE EVALUATION OF BORESIGHT WAS MATERIAL.

4. WIDE FIELD OF VIEW DETECTION

IN ITS FINAL SUBMISSION, WESTINGHOUSE PROPOSED AN ENTIRELY NEW FLIR DESIGN IN RESPONSE TO CONCERNS BY THE EVALUATORS. ALTHOUGH THE PROPOSED FLIR WAS RATED UNDER THE FLIR EVALUATION FACTOR, THE RANGE OF THE FLIR WAS ALSO EVALUATED UNDER THE INTEGRATION AND ASSEMBLY FACTOR. THE COMMENTS OF THE EVALUATORS UNDER BOTH FACTORS INDICATE A CONCERN WITH THE DETECTION CAPABILITY OF THE FLIR IN THE WIDE FIELD OF VIEW. THIS CONCERN DOES NOT APPEAR TO HAVE AFFECTED THE OVERALL ACCEPTABLE RATING OF THE WESTINGHOUSE FLIR UNDER THE FLIR EVALUATION FACTOR, BUT DID GIVE RISE TO A RED FLAG UNDER THE INTEGRATION AND ASSEMBLY FACTOR. BASICALLY, THE EVALUATORS BELIEVED THAT WESTINGHOUSE HAD NOT PROVIDED ENOUGH DATA TO ESTABLISH THAT THE PROPOSED FLIR WOULD SATISFY THE WIDE FIELD OF VIEW TARGET DETECTION RANGE REQUIREMENT CONTAINED IN THE SOLICITATION. THE EVALUATORS WERE PARTICULARLY CONCERNED ABOUT THIS LACK OF DATA BECAUSE THE DETECTION SENSITIVITY PREDICTED BY WESTINGHOUSE WAS SIGNIFICANTLY MORE THAN ANYTHING CURRENTLY BEING PRODUCED. CONSEQUENTLY, IN EVALUATING THE DETECTION RANGE OF THE FLIR, THE ARMY USED ITS OWN, MORE CONSERVATIVE SENSITIVITY DATA.

IN RAISING THIS ISSUE IN ITS PROTEST, WESTINGHOUSE CONTENDED THAT THE ARMY'S ANALYSIS "IS SOMEWHAT ARBITRARY AND CONTAINS CERTAIN INVALID ASSUMPTIONS." WESTINGHOUSE SAID THAT BECAUSE OF THE CLASSIFIED NATURE OF THIS SUBJECT, IT WOULD PRESENT THE DETAILS TO SUPPORT ITS CONTENTION LATER. IN ITS SUBSEQUENT SUBMISSIONS, HOWEVER, WESTINGHOUSE EITHER DID NOT ADDRESS THIS ISSUE OR SIMPLY STATED THAT THE REQUIRED DETECTION RANGE WOULD BE MET USING WESTINGHOUSE'S PROPOSED SENSITIVITY FACTOR, AFTER ALLEGING THAT THE AGENCY HAD BEEN ARBITRARY IN CHOOSING ITS OWN DETECTION SENSITIVITY TO EVALUATE THE DETECTION RANGE OF THE PROPOSED FLIR.

BECAUSE WESTINGHOUSE DID NOT PROVIDE THE DETAILS IT PROMISED IN SUPPORT OF ITS PROTEST ON THIS ISSUE, OUR REVIEW WAS LIMITED TO THE ARMY'S CHOICE OF A DETECTION SENSITIVITY IN THE EVALUATION. THE ARMY'S POSITION IS THAT SINCE WESTINGHOUSE DID NOT PROVIDE THE DATA TO SUPPORT THE DETECTION SENSITIVITY IT USED IN ITS MATHEMATICAL MODEL, THE AGENCY USED THE "COMMON MODULE SPECIFICATION." OTHER THAN ARGUING THAT THIS IS NOT THE VALUE IT USED, WESTINGHOUSE HAS MADE NO EFFORT TO SHOW THAT THE ARMY'S ACTION IN THIS REGARD WAS UNREASONABLE. WE DO NOT THINK THAT THE AGENCY EVALUATORS WERE OBLIGATED TO ACCEPT THE PROTESTER'S OPTIMISTIC PREDICTIONS OF DETECTOR SENSITIVITY WITHOUT ADEQUATE BACKUP DATA. WE THEREFORE HAVE NO BASIS TO QUESTION THE EVALUATORS' TECHNICAL JUDGMENT ON THIS POINT.

B. GIMBALS AND STABILIZATION

WESTINGHOUSE'S PROPOSAL RECEIVED AN UNACCEPTABLE RATING UNDER THE GIMBALS AND STABILIZATION FACTOR BASED ON RED FLAGS ON TWO SUBFACTORS: RATE ERROR AND STABILIZATION ERROR.

1. RATE ERROR

RATE ERROR IS A MEASURE OF HOW FAR THE FLIR GIMBAL HAS DRIFTED OFF ITS LINE OF SIGHT DUE TO SOME DISTURBANCE SUCH AS AIR VEHICLE MANEUVERS, VIBRATION OR TURBULENCE. THE FLIR GIMBAL IS A MOTORIZED HOUSING THAT POINTS THE FLIR AND KEEPS IT LOCKED ON TARGET. IF THE GIMBAL DRIFTS, THE DUAL AXIS RATE TRANSDUCER (DART) SENSES AND MEASURES THE DRIFT AND INSTRUCTS THE MOTORS THAT DRIVE THE GIMBAL HOW FAR TO MOVE THE GIMBAL TO RESTORE THE PROPER ORIENTATION. THE WESTINGHOUSE PROPOSAL RECEIVED A RED FLAG BECAUSE THE INDICATED RATE ERROR SIGNIFICANTLY EXCEEDED THAT ALLOWED BY THE SOLICITATION. IN ADDITION, THE ARMY FOUND THAT THE DRIFT RATE OF THE DART AVERAGED 10 TIMES THE RATE ALLOWED BY THE SPECIFICATION.

WESTINGHOUSE ACKNOWLEDGES THAT THE DRIFT RATE OF ITS DART IS HIGHER THAN THE PURCHASE DESCRIPTION ALLOWED, BUT SAYS THAT THIS WOULD HAVE NO ADVERSE EFFECT ON THE ABILITY OF THE FMPS TO PERFORM ITS MISSION. IT EMPHASIZES THAT ITS DART WOULD PROVE TO BE COST EFFECTIVE. THE ARMY SAYS THAT SUCH COST ADVANTAGES ARE IRRELEVANT BECAUSE THE WESTINGHOUSE DART WOULD NOT PERFORM ADEQUATELY. THE ARMY CITES THE DRIFT RATE REQUIRED BY THE SOLICITATION AND SAYS THAT SIGNIFICANT DEPARTURES FROM THIS RATE WILL RESULT IN POOR TRACKING OF TARGETS.

IN OUR VIEW, THE ESSENCE OF WESTINGHOUSE'S ARGUMENT APPEARS TO BE THAT COMPLIANCE WITH THE DRIFT RATE SPECIFICATION IS NOT NECESSARY FOR OVERALL PERFORMANCE. TO THIS EXTENT, WESTINGHOUSE EITHER IS PRESENTING AN UNTIMELY CHALLENGE TO THE REQUIREMENT WITH WHICH IT ADMITTEDLY DOES NOT COMPLY. IN ANY EVENT, WE HAVE NO BASIS UPON WHICH TO QUESTION THE AGENCY'S TECHNICAL JUDGMENT THAT BOTH THE DRAFT AND ERROR RATES PROPOSED BY WESTINGHOUSE, WHICH ADMITTEDLY DO NOT MEET THE SPECIFICATION REQUIREMENTS, WOULD PRESENT SERIOUS OPERATIONAL PROBLEMS. STABILIZATION ERRORS

THE WESTINGHOUSE PROPOSAL RECEIVED A RED FLAG BECAUSE THE EVALUATORS CONCLUDED THAT THE PROPOSED DESIGN WAS UNSTABLE. THE FLIR SENSOR IS MOUNTED ON A GIMBAL FOR THE PURPOSE OF MOVEMENT IN THE "AZIMUTH" (LEFT OR RIGHT) OR ELEVATION (UP OR DOWN). THE SENSOR MUST BE ISOLATED FROM ANY AIRCRAFT VIBRATION SO THAT THE IMAGE PRODUCED BY THE SENSOR WILL NOT BE BLURRED. THE SSEB, USING THREE SEPARATE ANALYSES CONDUCTED BY A SUBCONTRACTOR AND ONE APPARENTLY CONDUCTED BY THE AGENCY'S OWN EXPERTS, CONCLUDED THAT WESTINGHOUSE'S PROPOSED SYSTEM WILL BE MARGINALLY UNSTABLE IN THE ELEVATION LINE OF SIGHT BECAUSE THE SENSOR WILL BOUNCE UP AND DOWN. IT ALSO CONCLUDED THAT THE AZIMUTH LINE OF SIGHT WILL BE COMPLETELY UNSTABLE BECAUSE THE SENSOR WILL OSCILLATE TO THE LEFT AND RIGHT.

WESTINGHOUSE DISAGREES WITH THE EVALUATORS' FINDINGS BASED PRIMARILY ON ITS VIEW THAT THE SUBCONTRACTOR'S ANALYSES CONTAIN AT LEAST 10 SIGNIFICANT ERRORS. THE PROTESTER MAINTAINS THAT ITS SYSTEM HAS BEEN BUILT AND TESTED AND ARGUES THAT THE DATA PRESENTED IN ITS PROPOSAL CONCLUSIVELY SUBSTANTIATE THAT ITS DESIGN IS STABLE.

THE AGENCY NOTES THAT WESTINGHOUSE HAS NOT ACTUALLY BUILT THE EXACT SYSTEM PROPOSED AND MAINTAINS THAT WHATEVER ERRORS WERE FOUND IN THE ANALYSES WERE EITHER MINOR OR WORKED TO WESTINGHOUSE'S FAVOR.

IT IS CLEAR THAT WESTINGHOUSE DOES NOT AGREE WITH THE ANALYSES CONDUCTED OF ITS SYSTEM. ON THE OTHER HAND, THE AGENCY EVALUATORS MUST MAKE THEIR INDEPENDENT JUDGMENTS OF THE RISKS INHERENT IN A PROPOSED DESIGN. THEY CANNOT JUST ACCEPT BLINDLY A PROSPECTIVE CONTRACTOR'S CONCLUSION THAT ITS DESIGN WILL WORK. WE DO NOT REQUIRE THAT THE EVALUATORS' JUDGMENTS BE PERFECT, ONLY REASONABLE. WHILE WE UNDERSTAND THE PROTESTER'S STRONGLY HELD VIEW THAT ITS SYSTEM WILL IN FACT BE STABLE, IT HAS NOT CONVINCED US THAT THE FOUR SEPARATE ANALYSES, ALL OF WHICH REACHED THE OPPOSITE CONCLUSION, WERE SIMPLY WRONG. CONSEQUENTLY, WE THINK THAT THE EVALUATORS REASONABLY COULD HAVE CONCLUDED THAT THERE WAS A SUBSTANTIAL RISK OF INSTABILITY IN THE WESTINGHOUSE DESIGN.

V. CONCLUSION

FROM OUR REVIEW OF THE RECORD AS A WHOLE, WE CANNOT QUESTION THE AGENCY'S OVERALL CONCLUSION THAT THE PROPOSED WESTINGHOUSE DESIGN CARRIED A SUBSTANTIAL RISK OF BEING OVERWEIGHT, NOT MEETING PERFORMANCE REQUIREMENTS, OR BOTH. THE PROTEST IS DENIED IN PART AND DISMISSED IN PART.

/1/ FULL-SCALE DEVELOPMENT IS A PHASE OF A WEAPON SYSTEM'S ACQUISITION CYCLE IN WHICH ALL COMPONENTS OF THE SYSTEM ARE DESIGNED, FABRICATED AND TESTED. IT INCLUDES DELIVERY OF PROTOTYPES (IN THIS CASE, 10) AND TECHNICAL DATA. FULL-SCALE DEVELOPMENT PRECEDES FULL PRODUCTION.

GAO Contacts

Office of Public Affairs