Skip to main content

B-215174, AUG 14, 1985, 85-2 CPD 166

B-215174 Aug 14, 1985
Jump To:
Skip to Highlights

Highlights

CONTRACTOR'S TECHNICAL EVALUATION OF THE PROTESTER'S EQUIPMENT OFFERED AS FUNCTIONAL EQUIVALENT TO NAMED BRAND COMPUTERS IN RESPONSE TO A COMMERCE BUSINESS DAILY (CBD) ANNOUNCEMENT OF INTENTION TO PLACE A DELIVERY ORDER FOR NAMED BRAND COMPUTERS IS CONSISTENT WITH THE MANDATE TO MAXIMIZE COMPETITION. THE OVERRIDING CONSIDERATION IN EVALUATING EQUIVALENCY OF PRODUCT OFFERED IN RESPONSE TO CBD NOTICE OF CONTRACTOR'S INTENT TO PLACE DELIVERY ORDER FOR BRAND NAME COMPUTER SYSTEM ON BEHALF OF AGENCY IS WHETHER THE "EQUAL" PRODUCT PERFORMS THE NEEDED FUNCTION IN A LIKE MANNER WITH THE DESIRED RESULTS. CONTRACTOR'S TECHNICAL EVALUATION WILL NOT BE DISTURBED WHERE IT IS NOT SHOWN TO BE UNREASONABLE.

View Decision

B-215174, AUG 14, 1985, 85-2 CPD 166

CONTRACTS - FEDERAL SUPPLY SCHEDULE - PURCHASES FOR SYSTEM - COMPETITION ADEQUACY DIGEST: 1. A CONTRACTOR BUYING FOR AN AGENCY MUST SEEK MAXIMUM PRACTICABLE COMPETITION BEFORE PLACING A DELIVERY ORDER AGAINST A NONMANDATORY AUTOMATIC DATA PROCESSING (ADP) SCHEDULE CONTRACT. CONTRACTOR'S TECHNICAL EVALUATION OF THE PROTESTER'S EQUIPMENT OFFERED AS FUNCTIONAL EQUIVALENT TO NAMED BRAND COMPUTERS IN RESPONSE TO A COMMERCE BUSINESS DAILY (CBD) ANNOUNCEMENT OF INTENTION TO PLACE A DELIVERY ORDER FOR NAMED BRAND COMPUTERS IS CONSISTENT WITH THE MANDATE TO MAXIMIZE COMPETITION. EQUIPMENT - AUTOMATIC DATA PROCESSING SYSTEMS - ACQUISITIONS, ETC. FEDERAL SUPPLY SCHEDULE 2. THE OVERRIDING CONSIDERATION IN EVALUATING EQUIVALENCY OF PRODUCT OFFERED IN RESPONSE TO CBD NOTICE OF CONTRACTOR'S INTENT TO PLACE DELIVERY ORDER FOR BRAND NAME COMPUTER SYSTEM ON BEHALF OF AGENCY IS WHETHER THE "EQUAL" PRODUCT PERFORMS THE NEEDED FUNCTION IN A LIKE MANNER WITH THE DESIRED RESULTS. CONTRACTOR'S TECHNICAL EVALUATION WILL NOT BE DISTURBED WHERE IT IS NOT SHOWN TO BE UNREASONABLE, AND WHERE PROTESTER MERELY DISAGREES WITH EVALUATION ON BASIS OF TECHNICAL DISPUTES, PROTESTER HAS NOT CARRIED BURDEN OF PROOF.

INTERNATIONAL SYSTEMS MARKETING, INC:

INTERNATIONAL SYSTEMS MARKETING, INC. (ISM), PROTESTS THE DEPARTMENT OF ENERGY'S (DOE) PROPOSED DELIVERY ORDER (DE-ACO6-77RLO1030) TO INTERNATIONAL BUSINESS MACHINE CORPORATION (IBM) COVERING 60 IBM-PC MODEL 5150174 COMPUTERS AND RELATED EQUIPMENT UNDER IBM'S NONMANDATORY AUTOMATIC DATA PROCESSING (ADP) SCHEDULE CONTRACT NO. GS-OOK-84-0155658 WITH THE GENERAL SERVICES ADMINISTRATION. THE PURCHASE ACTUALLY WILL BE MADE FOR DOE BY ROCKWELL HANFORD OPERATIONS (ROCKWELL), A PRIME CONTRACTOR ACTING AS PURCHASING AGENT FOR DOE. THE PROTESTER CONTENDS THAT IT HAS OFFERED THE FUNCTIONAL EQUIVALENT TO THE IBM EQUIPMENT SPECIFIED FOR LESS THAN THE IBM SCHEDULED PRICE, BUT THE AGENCY, THROUGH ITS PURCHASING AGENT ROCKWELL, WILL NOT ALLOW IT TO COMPETE FOR THE REQUIREMENT BASED ON AN IMPROPER TECHNICAL EVALUATION AND REJECTION OF THE EQUIPMENT IT OFFERED. WE DENY THE PROTEST.

BACKGROUND

THE RICHLAND OPERATIONS OFFICE OF DOE (RICHLAND) IS RESPONSIBLE FOR THE MANAGEMENT OF A 570-SQUARE MILE AREA IN WASHINGTON STATE, COMMONLY CALLED THE HANFORD SITE, WHERE NUCLEAR RELATED ACTIVITIES ARE CONDUCTED. RICHLAND IMPLEMENTS ITS MANAGEMENT RESPONSIBILITIES THROUGH CONTRACTS WITH EIGHT COMMERCIAL FIRMS WHICH MUST INTERFACE WITH EACH OTHER TO MEET THE PROGRAMMATIC MISSIONS OF DOE IN THE CONTROL AND UTILIZATION OF THE HANFORD SITE. THE CONTRACTUAL ACTIVITIES OF TWO OF THESE PRIME CONTRACTORS ARE INVOLVED IN THIS PROTEST-- NAMELY BOEING COMPUTER SERVICES-RICHLAND (BOEING) WHICH PROVIDES ON SITE AUTOMATIC DATA PROCESSING SERVICES TO RICHLAND AND ROCKWELL WHICH IS RESPONSIBLE FOR DIRECT SITE PURCHASING OF GOODS AND SERVICES USED BY BOEING AND OTHER DOE CONTRACTORS. THE PROTEST IS SUBJECT TO REVIEW BY THIS OFFICE AS A SUBCONTRACT PROTEST. OPTIMUM SYSTEMS, INC., 54 COMP.GEN. 767, 774 (1975), 75-1 CPD PARA. 166 AT 9.

DOE REPORTS THAT ROCKWELL CONDUCTED THIS PROCUREMENT IN ACCORDANCE WITH THE FEDERAL INFORMATION RESOURCES MANAGEMENT REGULATIONS (FIRMR) (41 C.F.R. SECS. 1-4.11, ET SEQ. (1984)), WHICH PERMIT AN AGENCY TO PLACE AN ORDER AGAINST AUTOMATIC DATA PROCESSING (ADP) SCHEDULE CONTRACTS, LIKE IBM'S IN THIS CASE, WHEN CERTAIN CONDITIONS ARE MET. ONE CONDITION IS THAT THE AGENCY SYNOPSIZE IN THE COMMERCE BUSINESS DAILY (CBD) ITS INTENT TO PLACE AN ORDER AGAINST A NONMANDATORY ADP SCHEDULE CONTRACT AT LEAST 15 CALENDAR DAYS BEFORE PLACING THE ORDER. ID. SEC. 1-4.1109-6(B)(3). THE AGENCY MUST THEN EVALUATE ALL WRITTEN RESPONSES TO THE NOTICE FROM RESPONSIBLE NONSCHEDULE VENDORS TO DETERMINE WHETHER THE SCHEDULE CONTRACT REPRESENTS THE LOWEST OVERALL COST ALTERNATIVE. ID. SEC. 1-4.1109- 6(G)(2)(I). THIS PROCEDURE IS NOT A FORMAL COMPETITION; RATHER, IT IS A DEVICE TO TEST THE ADP MARKET TO DETERMINE WHETHER THERE ARE NONSCHEDULE VENDORS INTERESTED IN COMPETING FOR THE REQUIREMENT AT PRICES THAT WOULD MAKE COMPETITION PRACTICABLE. IF EVALUATION OF RESPONSES INDICATES THAT A COMPETITIVE ACQUISITION WOULD BE MORE ADVANTAGEOUS TO THE GOVERNMENT, A FORMAL SOLICITATION NORMALLY WOULD BE ISSUED, AND ALL VENDORS, INCLUDING SCHEDULE VENDORS, INVITED TO COMPETE. ID. SEC. 1-4.1109-6(G). SEE ALSO CMI CORPORATION, B-210154, SEPT. 23, 1983, 83-2 CPD PARA. 364 AT 2.

IN THE APRIL 25, 1984, CBD ROCKWELL PUBLISHED ITS INTENT TO PURCHASE 60 IBM-PC MODEL 5150174 COMPUTERS AND RELATED EQUIPMENT FOR DOE DIRECTLY FROM IBM UNDER IBM'S NONMANDATORY AUTOMATIC DATA PROCESSING SCHEDULE CONTRACT NO. GS-00K-84-0155658 WITH THE GENERAL SERVICES ADMINISTRATION UNLESS ANOTHER VENDOR ESTABLISHED ITS ABILITY TO FURNISH IBM-PC COMPUTERS. MAY 1, ISM RESPONDED TO THE SYNOPSIS BY OFFERING TO SUPPLY THE ISM UNISYSTEM-PC PERSONAL COMPUTER AS A FUNCTIONAL EQUIVALENT TO THE IBM-PC. ISM STATED IN ITS RESPONSE THAT ITS EQUIPMENT HAD BEEN TESTED BY DOE AND WAS IN USE BY OTHER GOVERNMENT AGENCIES. ISM ALSO SUBMITTED A LIST OF ITS EQUIPMENT USERS TO ASSIST IN VERIFYING COMPATIBILITY WITH THE IBM SYSTEM AND OFFERED TO PROVIDE DEMONSTRATIONS OF ITS EQUIPMENT TOGETHER WITH TECHNICAL INFORMATION FOR A COMPLETE TECHNICAL EVALUATION.

CLAIMING THAT IT HAD NOT RECEIVED ANY RESPONSE FROM ROCKWELL OR DOE, AND SINCE THE CBD SYNOPSIS PROVIDED FOR AWARD TO IBM IN THE ABSENCE OF ANY RESPONSE BY MAY 10, ISM FILED ITS PROTEST WITH THIS OFFICE ON MAY 7, 1984, CONTENDING THAT:

"THE PURCHASE OF THE BRAND NAME PRODUCT WITHOUT CONSIDERATION OF FUNCTIONALLY EQUIVALENT PRODUCTS VIOLATED PUBLIC CONTRACTS LAW AND DOE REGULATIONS WHICH SEEK TO ENCOURAGE COMPETITION TO THE EXTENT CONSISTENT WITH THE PROCUREMENT."

DOE REPORTED TO OUR OFFICE ON JUNE 1, 1984, THAT ISM'S PROTEST BASIS WAS BOTH PREMATURE AND MOOT, BECAUSE BOEING WAS IN THE PROCESS OF PERFORMING A TECHNICAL EVALUATION TO DETERMINE WHETHER ISM'S PRODUCT WAS EQUIVALENT TO THE IBM-PC COMPUTER, OR OTHERWISE SUITED FOR APPLICATION AT THE HANFORD SITE. IN FACT, ON MAY 8 ROCKWELL ASKED BOEING TO EVALUATE THE ISM PRODUCT AND BY MAY 18 AN ISM UNISYSTEM-PC COMPUTER HAD BEEN OBTAINED ON LOAN FOR TESTING AND EVALUATION PURPOSES. DOE ALSO REPORTED THAT EVEN IF THE ISM UNISYSTEM-PC COMPUTER WAS DETERMINED TO BE THE FUNCTIONAL EQUIVALENT OF THE IBM-PC COMPUTER, A COMPETITIVE PROCUREMENT FOR THE AGENCY'S REQUIREMENT WOULD NOT NECESSARILY FOLLOW WITHOUT THE ADDITIONAL FINDING THAT THE ISM PRODUCT MET THE AGENCY'S MINIMUM NEEDS. IN THIS CASE, MINIMUM NEEDS-- IN ADDITION TO THE SALIENT CHARACTERISTICS OF A PRODUCT-- INCLUDED CONSIDERATIONS OF VENDOR MAINTENANCE, TRAINING, INSTALLATION CONFIGURATION AND USAGE THROUGHOUT THE HANFORD SITE. AT THE TIME, CONSISTENT WITH THE HANFORD AUTOMATIC DATA PROCESSING MANAGEMENT PLAN, THE IBM-PC COMPUTER WAS THE ONLY PRODUCT DETERMINED TO MEET THE MINIMUM NEEDS OF THE AGENCY AS THE INITIAL MICRO COMPUTER HARDWARE CONFIGURATION. THUS, WHETHER THE I8M PRODUCT WAS EQUAL TO THE IBM-PC COMPUTER WAS ONLY THE FIRST OF SEVERAL CRITICAL ANALYSES ESSENTIAL TO DETERMINING IF ISM'S PRODUCT AND RELATED SERVICES WOULD MEET DOE'S MINIMUM NEEDS.

ON AUGUST 27, DOE SUPPLEMENTED ITS REPORT ON ISM'S PROTEST WITH THE RESULTS OF BOEING'S TECHNICAL EVALUATION AND THE CONCLUSION THAT THE ISM UNISYSTEM-PC COMPUTER IS NOT "EQUAL" TO THE IBM-PC COMPUTER.

ON OCTOBER 4, ISM RESPONDED TO BOTH DOE REPORTS OF JUNE 1 AND AUGUST 27 CONTENDING THAT (1) ITS PROTEST WAS NOT PREMATURE, BUT RATHER WAS COMPETENT IN STATING A BASIS ON WHICH RELIEF MAY BE GRANTED BY THIS OFFICE AND WAS TIMELY FILED UNDER OUR BID PROTEST PROCEDURES (4 C.F.R. PART 21 (1984)); AND (2) DOE AND ROCKWELL MAY NOT REJECT ISM'S OFFER ON THE BASIS OF THE BOEING TECHNICAL EVALUATION BECAUSE THE RESULTS OF THE EVALUATION ARE "FLAWED BY IMPROPER TESTING PROCEDURES."

TIMELINESS

OUR BID PROTEST PROCEDURES APPLICABLE TO THIS PROCUREMENT (4 C.F.R.PART 21 (1984)) ENCOURAGE PROTESTERS TO SEEK RESOLUTION OF THEIR COMPLAINTS INITIALLY WITH THE CONTRACTING AGENCY, AND A PROTEST WILL BE CONSIDERED IF FILED INITIALLY WITH THIS OFFICE NOT LATER THAN 10 DAYS AFTER THE BASIS FOR PROTEST IS KNOWN. SEE 4 C.F.R. SECS. 21.2(A) AND (B)(2) (1984). HERE, ISM PROTESTED ROCKWELL'S INTENTION TO PROCURE ONLY IBM-PC MACHINES WITH DOE BEFORE THE MAY 10 CLOSING DATE FOR RECEIPT OF OFFERS. ROCKWELL'S INTENTION TO CONTRACT WITH IBM WAS FIRST STATED IN THE APRIL 25, 1984, CBD ANNOUNCEMENT AND HAS PERSISTED THROUGHOUT THE PERIOD RESULTING IN OUR DECISION HERE. MOREOVER, BOEING DID NOT COMPLETE ITS EVALUATION OF ISM'S EQUIPMENT FOR ROCKWELL UNTIL JULY 19 WHEN IT DETERMINED THAT THE ISM UNISYSTEM-PC COMPUTER SHOULD BE REJECTED AS NOT EQUAL TO THE IBM-PC COMPUTER. ACCORDINGLY, SINCE ISM PROTESTED ROCKWELL'S INTENT TO BUY FROM IBM AND THE ULTIMATE REJECTION OF ISM'S PRODUCT BEFORE BOTH THE CLOSING DATE AND BEFORE BOEING DETERMINED THAT THE ISM UNISYSTEM-PC COMPUTER WAS NOT ACCEPTABLE, WE CONSIDER ISM'S PROTEST TO BE TIMELY UNDER 4 C.F.R. SEC. 21.2(B)(2) WHICH REQUIRES FILING WITHIN 10 DAYS AFTER THE BASIS FOR PROTEST IS KNOWN. MOREOVER, IN VIEW OF BOEING'S DETERMINATION THAT ISM'S PRODUCT IS NOT ACCEPTABLE, THE PROTEST IS NEITHER PREMATURE NOR ACADEMIC AND WE WILL, THEREFORE, CONSIDER IT ON ITS MERITS.

THE EVALUATION

ISM CONTENDS THAT THE SOLICITATION IS IMPROPERLY RESTRICTED TO IBM AND THAT DOE, THROUGH BOEING, HAS INCORRECTLY EVALUATED AND REJECTED THE EQUIPMENT ISM PROPOSED. INITIALLY, WE NOTE THAT SPECIFICATIONS SHOULD STATE ONLY THE ACTUAL MINIMUM NEEDS OF THE AGENCY AND SHOULD NOT LIMIT ACCEPTABLE OFFERS TO ONE SUPPLIER'S PRODUCT UNLESS THAT PRODUCT IS THE ONLY ONE WHICH WILL SATISFY THE AGENCY'S NEEDS. WANG LABORATORIES, INC., B-215589, SEPT. 17, 1984, 84-2 CPD PARA. 300, RECONSIDERED AND AFFIRMED, B-215589.2, DEC. 10, 1984, 84-2 CPD PARA. 642. SEE ALSO FIRMIR, 41 C.F.R. SECS. 1-4.1109(A)(2) (1984), WHICH PROVIDES THAT ALL PURCHASES MUST BE MADE ON A COMPETITIVE BASIS TO THE MAXIMUM PRACTICABLE EXTENT AND THE EXISTENCE OF A NONMANDATORY ADP SCHEDULE CONTRACT DOES NOT EXCUSE THE PROCURING AGENCY FROM SEEKING MAXIMUM PRACTICABLE COMPETITION. MOREOVER, WE HAVE HELD THAT, WHERE A PROCURING AGENCY HAS INFORMATION WHICH INDICATES THAT A SECOND SOURCE MAY BE CAPABLE OF FULFILLING THE AGENCY'S NEEDS, IT IS INCUMBENT UPON PROCURING OFFICIALS TO INVESTIGATE FURTHER PRIOR TO AWARDING A SOLE SOURCE CONTRACT. DANTEC ELECTRONICS, INC., B-213247, AUG. 27, 1984, 84-2 CPD PARA. 224 AT 5. WE CONCLUDE THAT BOEING'S EVALUATION OF ISM'S UNISYSTEM-PC COMPUTER, AS IT REPRESENTS THE AGENCY'S EVALUATION OF THE PROTESTER'S RESPONSE TO THE CBD NOTICE, WAS CONSISTENT WITH THE MANDATE TO MAXIMIZE COMPETITION. SEE ALSO COMDISCO, INC., B-214409.2, OCT. 18, 1984, 64 COMP.GEN. 11, 84-2 CPD PARA. 416.

AS TO THE EVALUATION ITSELF, OUR DECISIONS GENERALLY RECOGNIZE THAT THE PROCURING AGENCY IS RESPONSIBLE FOR EVALUATING THE DATA SUPPLIED BY AN OFFEROR AND ASCERTAINING IF IT PROVIDES SUFFICIENT INFORMATION TO DETERMINE THE ACCEPTABILITY OF THE OFFEROR'S ITEM. AUTOMATED PRODUCTION EQUIPMENT CORPORATION, B-210476, MAR. 6, 1984, 84-1 CPD PARA. 269. THE OVERRIDING CONSIDERATION IN DETERMINING THE EQUIVALENCY OF AN OFFERED PRODUCT TO THE NAMED PRODUCT FOR PURPOSES OF ACCEPTABILITY IS WHETHER THE "EQUAL" PRODUCT PERFORMS THE NEEDED FUNCTION IN A LIKE MANNER AND WITH THE DESIRED RESULTS. SEE LANIER BUSINESS PRODUCTS OF WESTERN MARYLAND, INC., B-214468, JULY 23, 1984, 84-2 CPD PARA. 85 AT 4. WE WILL NOT DISTURB THE TECHNICAL DETERMINATION BY THE AGENCY UNLESS IT IS SHOWN TO BE UNREASONABLE. AUTOMATED PRODUCTION EQUIPMENT CORP., B-210476, SUPRA. MOREOVER, THE PROTESTER BEARS THE BURDEN OF AFFIRMATIVELY PROVING ITS CASE, AND THE FACT THAT THE PROTESTER DOES NOT AGREE WITH THE AGENCY'S TECHNICAL EVALUATION DOES NOT IN ITSELF RENDER THE EVALUATION UNREASONABLE. PANASONIC INDUSTRIAL COMPANY, B-207852.2, APR. 12, 1983, 83-1 CPD PARA. 379.

DOE EXPLAINS THAT THE HANFORD COMPUTER STORE, WHICH IS OPERATED BY BOEING AND FOR WHICH THIS PROCUREMENT WOULD PROVIDE INVENTORY STOCK AVAILABLE FOR RICHLAND CONTRACTORS, IS THE CORNERSTONE OF THE HANFORD ADP MANAGEMENT PLAN TO MAXIMIZE SITEWIDE COMPATIBILITY AND INCREASE ADP RESPONSIVENESS AND FLEXIBILITY. DOE REPORTS THAT PRIOR TO THE ESTABLISHMENT OF THE HANFORD COMPUTER STORE EACH OF THE EIGHT DOE HANFORD SITE CONTRACTORS WAS RESPONSIBLE FOR DEFINING AND TAKING STEPS TO SATISFY ITS ADP EQUIPMENT REQUIREMENTS. THERE WAS NO SITEWIDE CONTROL OVER THE TYPE OF EQUIPMENT PURCHASED, ITS UTILIZATION, MAINTENANCE, OR TRAINING. THE LACK OF CONTROL, COUPLED WITH THE BURGEONING OFFICE COMPUTER INDUSTRY CREATED SIGNIFICANT PROBLEMS AT RICHLAND WITH RESPECT TO EFFECTIVE IMPLEMENTATION AND EXECUTION OF DOE'S MISSION AND UTILIZATION OF DOE FUNDS. EQUIPMENT INCOMPATIBILITY, INEFFECTIVE UTILIZATION OF LIMITED TRAINING RESOURCES, THE POTENTIAL PROCUREMENT OF OUTMODED OR LESS THAN STATE-OF-THE-ART EQUIPMENT, AND INCREASED MAINTENANCE, TRAINING AND OPERATIONS BUDGETS ARE ILLUSTRATIVE EXAMPLES OFFERED BY DOE OF THE TYPES OF PROBLEMS WHICH AROSE. THUS, DOE CREATED THE HANFORD COMPUTER STORE FOR THE USE OF ITS PRIME CONTRACTORS IN ORDER TO EFFECT A MORE UNIFIED ADP PROCUREMENT POLICY AND TO MAXIMIZE SITEWIDE COMPATIBILITY. THE HANFORD COMPUTER STORE PROVIDES CONFIGURATION CONTROL ON GENERAL USAGE COMPUTER OPERATING SYSTEMS. IN THE INSTANT PROCUREMENT, THE ISM UNISYSTEM-PC COMPUTER WAS EVALUATED FOR EQUIVALENCY WITH THE IBM-PC COMPUTER AS THE "INITIAL LEVEL- ONE MICROCOMPUTER HARDWARE CONFIGURATION" FOR THE HANFORD SITE. LEVEL-ONE SUPPORTED HARDWARE AND SOFTWARE ARE DEFINED AS THOSE PRODUCTS THAT HAVE DEMONSTRATED A SUITABILITY FOR MEETING A LARGE BASE OF USER'S REQUIREMENTS. DOE REPORTS THAT BOEING'S EVALUATION METHODOLOGY WAS DIVIDED INTO THREE MAJOR AREAS; NAMELY, USER FRIENDLINESS, HARDWARE COMPATIBILITY, AND SOFTWARE COMPATIBILITY. /1/

HARDWARE PROBLEM

FROM REVIEWS PERFORMED BY BOEING ON 14 TYPES OF HARDWARE CURRENTLY CLASSIFIED IN LEVEL-ONE, DOE REPORTS THAT TWO HARD DISK SYSTEMS, THE TALLGRASS AND DAVONG PRODUCTS, DID NOT WORK SATISFACTORILY ON THE ISM UNISYSTEM-PC COMPUTER. THESE HARD DISK SYSTEMS PROVIDE MASS STORAGE TO THE PERSONAL COMPUTER WITHOUT WHICH MANY APPLICATIONS CURRENTLY RUNNING AT THE HANFORD SITE WOULD BE REDUCED TO SUCH LIMITED STORAGE CAPACITIES THAT THEY COULD NOT RUN ON THE UNISYSTEM-PC. ACCESSING THE HARD DISK BY THE ISM PERSONAL COMPUTER COMMONLY RESULTED IN AN INTERRUPT LEVEL CONFLICT WITH THE SYSTEM'S SECOND SERIAL PORT. /2/ TO ENSURE THAT THE TALLGRASS HARD DISK SYSTEM WAS WORKING PROPERLY DURING THE TESTS WITH THE ISM PRODUCT, THE ENTIRE TALLGRASS SYSTEM WAS REMOVED FROM THE ISM UNIT AND INSTALLED ON AN IBM-PC COMPUTER. THE SAME TESTS WERE RUN WITHOUT ANY PROBLEMS. DATA FILES ON THE HARD DISK COULD BE ACCESSED WITHOUT ERROR, PROGRAMS THAT WERE STORED ON THE HARD DISK COULD BE RUN FROM THE HARD DISK, AND FILES COULD BE SENT TO THE HARD DISK. THE PROBLEM WAS DISCUSSED WITH ISM WHICH SENT A REPLACEMENT INTEGRATED CIRCUIT FOR ITS UNIT. THIS REPLACEMENT INTEGRATED CIRCUIT WAS INSTALLED BY BOEING UNDER TELEPHONE SUPERVISION FROM ISM. THE RETEST RESULTED IN THE SAME FAILURE AS THE REPORT OF "ERROR IN BASE MEMORY" OCCURRED EACH TIME THE FILES STORED ON THE TALLGRASS HARD DISK WERE ACCESSED.

BOEING ALSO EXPERIENCED DIFFICULTY WHEN THE ISM UNISYSTEM-PC COMPUTER USER WANTED TO GO FROM ONE TO TWO SERIAL PORTS SINCE NONE OF THE DOCUMENTATION PROVIDED BY I8M CLEARLY SHOWED HOW TO RECONFIGURE THE SERIAL INTERFACE PORTS IF BOTH SERIAL PORTS AND THE PARALLEL PORT WERE REQUIRED. ISM HAD TO SUPPLY THE INFORMATION TO THE USER BY TELEPHONE.

ANOTHER PROBLEM OCCURRED WHEN BOEING EVALUATORS ATTEMPTED TO USE THE DAVONG HARD DISK SYSTEM. THE OPERATING SYSTEM COULD NOT BE INSTALLED AT ALL USING THE STANDARD SETUP PROCEDURE. DURING THE TEST THE SYSTEM WOULD "HANG," THAT IS, IT WOULD NOT FUNCTION UNTIL THE COMPUTER WAS TURNED OFF AND THEN BACK ON AGAIN. IMMEDIATELY AFTER THIS TEST, BOEING REPORTS THAT THE FLOPPY DISK CONTROLLER ON THE UNISYSTEM-PC UNIT ALSO FAILED. WHEN ISM WAS CONTACTED REGARDING THIS PROBLEM, THEY OFFERED NO SUGGESTIONS AS TO WHY THE DAVONG HARD DISK SYSTEM WOULD NOT WORK ON THEIR COMPUTER AND INSTEAD FORWARDED A REPLACEMENT CONTROLLER BOARD FOR THE ONE WHICH HAD FAILED THE TEST.

ISM CONTENDS THAT ANY HARDWARE PROBLEM EXPERIENCED BY BOEING WAS THE RESULT OF IMPROPER TESTING PROCEDURES SINCE, AS ISM OBSERVES, ITS OPERATIONS/TECHNICAL/REFERENCE MANUAL WAS RETURNED UNOPENED. IN ADDITION, ISM CLAIMS IT WAS IN CONSTANT TELEPHONE CONTACT WITH BOEING, AND REQUESTED NOTIFICATION BY BOEING IF ANY PROBLEMS AROSE. ISM THEN CONTENDS THAT BOEING DID NOT NOTIFY IT OF ANY PROBLEM. ISM BLAMES BOEING'S FAILURE TO USE ITS MANUAL FOR BOEING'S MISUNDERSTANDING CONCERNING THE SECOND SERIAL PORT ON ISM'S UNIT WHICH ISM EXPLAINS WAS INITIALLY SET UP TO HANDLE JUST ONE SERIAL PORT, THE SECOND SERIAL PORT BEING DISABLED TO ALLOW FOR TESTING OF OPTIONAL HARDWARE. IN ADDITION, ISM ASSERTS THAT THE MANUAL SPECIFICALLY COVERED THE RECONFIGURATION OF THE SERIAL INTERFACE PORTS WHEN BOTH SERIAL AND PARALLEL PORTS WERE REQUIRED, WHICH INVOLVES ENABLING AND DISABLING THE PORTS WITH AN INTEGRATED CIRCUIT AVAILABLE FROM ISM AT NO CHARGE. ISM CONCLUDES ON THE ISSUE OF HARDWARE THAT ITS UNISYSTEM-PC COMPUTER CAN OPERATE THE TALLGRASS AND DAVONG HARD DISK SYSTEMS IN THE SAME MANNER AS AN IBM PC.

DOE RESPONDS TO THE CHARGE THAT BOEING'S TECHNICAL PERSONNEL DID NOT USE THE ISM REFERENCE MANUAL BY STATING THAT BOEING RECEIVED TWO DOCUMENTS WITH THE ISM HARDWARE, THE FIRST WAS A PHOTOCOPY OF AN ISM COMPANY DOCUMENT WHICH BOEING OPENED AND USED; THE SECOND WAS AN IBM USERS' MANUAL WHICH BOEING ALREADY HAD ON HAND AND THEREFORE DID NOT OPEN. BOEING FURTHER REPORTS THAT IT DID CONTACT ISM REPEATEDLY WHEN EVALUATION PERSONNEL WERE UNABLE TO MAKE BOTH THE TALLGRASS AND DAVONG HARD DISK SYSTEMS WORK WITH ISM EQUIPMENT. BOEING INDICATES THAT IT DISCUSSED THESE PROBLEMS WITH ISM BUT WAS UNABLE TO CORRECT THE PROBLEMS UPON RETESTING. BOEING CONCLUDES THAT THE ISM COMPUTER SHOULD HAVE WORKED AS SHIPPED FROM THE FACTORY, BUT IT DID NOT, AND THIS FACT ALONE INDICATES THAT THE ISM COMPUTER IS NOT EQUAL TO THE IBM-PC COMPUTER.

SOFTWARE PROBLEM

BOEING FOUND THAT ALL SOFTWARE TESTED SATISFACTORILY EXCEPT WHERE THE SOFTWARE REQUIRED RESPONSES THROUGH THE FUNCTION KEYS "ALT-F1" THROUGH "ALT-F10". THIS PROBLEM OCCURRED USING VISICALC IV AND PC TERM. /3/ PERFORMING AN ASSEMBLY LANGUAGE TEST TO EVALUATE WHY THE UNISYSTEM-PC COMPUTER WOULD NOT OPERATE THESE PARTICULAR KEYS, BOEING DETERMINED THAT THE DIFFERENCES ARE A FUNCTION OF THE CODE THAT READS THE KEYBOARD. ISM RESPONDS THAT BOEING'S PROBLEM WAS APPARENTLY CAUSED BY THE REPLACEMENT OF THE ORIGINAL 8088 CHIP WHICH WAS ON THE UNIT SUPPLIED BY ISM. BOEING COUNTERS THAT THIS IS NOT THE CASE AND IT DID NOT REPLACE ISM'S 8088 CHIP THAT WAS SENT WITH THE EVALUATION UNIT. MOREOVER, BOEING OFFERS THAT IT KNOWS OF NO REASON TO REPLACE 8088 CHIPS TO SOLVE THE PROBLEM RELATED TO SOFTWARE INCOMPATIBILITY AND STATES THAT BOEING EVALUATIONS DO NOT INCLUDE TESTING OF INDIVIDUAL ELECTRONIC DEVICES.

ISM CONCLUDES THAT THE EVALUATION WAS FAULTY, THAT ITS PROTEST SHOULD BE UPHELD AND A COMPETITIVE PROCUREMENT SHOULD BE INITIATED. DOE CONTENDS THAT BOEING'S EVALUATION WAS NOT AN EXHAUSTIVE TECHNICAL REVIEW OF ISM'S PRODUCT DESIGN TECHNIQUE AND MANUFACTURING METHODOLOGY, NOR WAS THE PURPOSE OF THE REVIEW TO PROVIDE REVERSE ENGINEERING SERVICES TO ISM AND THEREBY DEVELOP AN IBM-PC COMPUTER "EQUAL" FOR ISM. RATHER, IN DOE'S VIEW, THE EVALUATION WAS AS COMPLETE AS PRACTICABLE UNDER THE CIRCUMSTANCES, TESTING TO ASSURE THAT ISM'S CLAIMS OF COMPATIBILITY ACROSS THE BOARD WITH IBM-PC PRODUCTS WERE WELL FOUNDED. DOE CONCLUDES ON THE BASIS OF BOEING'S EVALUATION THAT THOSE CLAIMS ARE INCORRECT AND THAT THE ISM COMPUTER IS NOT AN "EQUAL" PRODUCT TO THE IBM-PC COMPUTER.

CONCLUSION

AS WE HAVE INDICATED, THE OVERALL DETERMINATION OF THE TECHNICAL ADEQUACY OF A RESPONSE TO A CBD NOTICE OF A DELIVERY ORDER AGAINST A SCHEDULE CONTRACT IS PRIMARILY A FUNCTION OF THE PROCURING AGENCY WHICH WE QUESTION ONLY UPON A CLEAR SHOWING OF UNREASONABLENESS, AN ARBITRARY ABUSE OF DISCRETION OR A VIOLATION OF PROCUREMENT, STATUTES AND REGULATIONS. SEE ALSO JARRETT S. BLANKENSHIP CO., B-213473, JUNE 25, 1984, 84-1 CPD PARA. 662.

ESSENTIALLY, THIS CASE PRESENTS NUMEROUS AREAS OF DISAGREEMENT BETWEEN THE PROTESTER AND THE USER AGENCY, AND BOTH SIDES HAVE PRESENTED HIGHLY TECHNICAL SUPPORT FOR THEIR POINTS OF VIEW. HOWEVER, IT IS THE PROTESTER WHICH MUST BEAR THE BURDEN OF SHOWING THAT THE CONTRACTING OFFICIALS' ACTIONS WERE ARBITRARY, CAPRICIOUS OR AN ABUSE OF PROCUREMENT DISCRETION. SEE DANTEC ELECTRONICS, INC., B-213247, SUPRA, AT 4. THE FACT THAT ISM'S EQUIPMENT ALLEGEDLY HAS BEEN USED BY OTHER ACTIVITIES DOES NOT MEET THIS STANDARD OR OTHERWISE SUPPORT ISM'S PROTEST IN THIS CASE SINCE ONE PROCURING ACTIVITY'S ACCEPTANCE OF AN ITEM DOES NOT DETERMINE THE PROPRIETY OF ANOTHER PROCURING ACTIVITY'S EVALUATION OF THAT SAME ITEM. AUTOMATED PRODUCTION EQUIPMENT CORPORATION, B-210476, SUPRA.

FROM THE RECORD PRESENTED, IT IS CLEAR THAT BOEING'S EXPERTS TESTED ISM'S PERSONAL COMPUTER FOR EQUIVALENCY WITH IBM'S PERSONAL COMPUTER AND COMPATIBILITY WITH SOFTWARE USED EXTENSIVELY BY DOE USER CONTRACTORS. FOR EXAMPLE, IN THE HARDWARE COMPATIBILITY EVALUATION TO DETERMINE WHETHER OR NOT THE PRODUCT WILL SUCCESSFULLY OPERATE AND FUNCTION WITH OTHER HARDWARE DEVICES IN THE LEVEL-ONE MICROCOMPUTER HARDWARE CONFIGURATION, BOEING DETERMINED THAT TWO ESSENTIAL HARD DISK SYSTEMS, THE TALLGRASS AND DAVONG PRODUCTS, DID NOT WORK SATISFACTORILY WITH THE ISM UNISYSTEM-PC COMPUTER. IN SIMILAR TESTS TO DETERMINE THE COMPATIBILITY AND SUITABILITY OF THE ISM UNISYSTEM-PC COMPUTER WITH USERS' LEVELONE SUPPORTED SOFTWARE REQUIREMENTS, BOEING DETERMINED THAT THE EQUALLY ESSENTIAL VISICALC IV AND PC TERM SOFTWARE PACKAGES TESTED UNSATISFACTORILY WITH THE ISM PRODUCT. ISM WAS CONTACTED WHEN PROBLEMS AROSE, BUT BOEING PERSONNEL WERE UNABLE TO EFFECT CORRECTIONS AND DETERMINED THAT ISM'S PRODUCT WAS NOT EQUAL TO IBM'S PRODUCT. WHILE ISM DISAGREES WITH BOEING'S OPINIONS AND HAS PROVIDED HIGHLY TECHNICAL ARGUMENTS TO SUPPORT ITS POSITIONS, ISM HAS NOT SHOWN THAT BOEING'S EXPERTS' TECHNICAL OPINIONS IN EVALUATING THE ISM UNISYSTEM-PC COMPUTER WERE CLEARLY UNREASONABLE OR THAT THE TEST PROCEDURES FOLLOWED WERE IN ANY WAY DEFICIENT. JARRETT S. BLANKENSHIP CO., B-213473, SUPRA. WE, THEREFORE, DEFER TO THE CONTRACTING AGENCY'S EXPERT EVALUATION AND OPINION IN THIS CASE SINCE ISM HAS NOT MET THE HEAVY BURDEN OF PROOF PLACED UPON IT. SEE DANTEC ELECTRONICS, INC., B-213247, SUPRA, AND DECISIONS CITED THEREIN; SEE ALSO WANG LABORATORIES, INC., B-215589, SUPRA.

THE PROTEST IS DENIED.

/1/ THE USER FRIENDLINESS EVALUATION CONSIDERS HOW EASY THE PRODUCT IS TO SET UP AND INSTALL, HOW QUICKLY AN OPERATOR CAN BECOME PROFICIENT AT USING THE PRODUCT, AND A REVIEW OF THE WAY THE FEATURES OF THE PRODUCT ARE IMPLEMENTED. THE HARDWARE COMPATIBILITY EVALUATION DETERMINES WHETHER OR NOT THE PRODUCT WILL SUCCESSFULLY OPERATE AND FUNCTION WITH THE OTHER HARDWARE DEVICES THAT ARE TYPICALLY CONNECTED TO THIS TYPE OF PRODUCT. SOFTWARE COMPATIBILITY EVALUATION IS BASED UPON SIMILAR TESTS AS THE HARDWARE COMPATIBILITY EVALUATION. DOE FURTHER REPORTS THAT ANY NEW SOFTWARE PRODUCT IS CONSIDERED AGAINST CURRENT LEVEL-ONE APPROVED SOFTWARE TO ENSURE THAT THE ULTIMATE USERS OF THE PRODUCT WILL NEED A MINIMUM OF OUTSIDE ASSISTANCE IN SETTING UP AND LEARNING HOW TO USE THE NEW PRODUCT.

/2/ THE INTERRUPTS ARE INTERNAL MESSAGES TO TELL THE COMPUTER WHEN A DEVICE IS READY TO RECEIVE OR SEND DATA; IT APPEARED IN THE COURSE OF THIS EVALUATION THAT THE COMPUTER WAS UNABLE TO DISTINGUISH BETWEEN THE PORTS OR THE HARD DISK AS THE SOURCE OF THE INTERRUPT MESSAGES.

/3/ THE PC TERM AND VISICALC IV SOFTWARE PACKAGES PROVIDE TELECOMMUNICATIONS WITH MAINFRAME COMPUTERS AND SPREADSHEET ANALYSIS.

GAO Contacts

Office of Public Affairs