Skip to main content

B-194286.2, SEP 14, 1979

B-194286.2 Sep 14, 1979
Jump To:
Skip to Highlights

Highlights

MODIFICATIONS TO BENCHMARK SOFTWARE WHICH ARE REQUIRED TO BE SUBMITTED WITH TECHNICAL PROPOSAL ARE SUBJECT TO EVALUATION AS PART OF PROPOSAL AND MUST MEET REQUIREMENTS OF REQUEST FOR PROPOSALS. 2. WHERE REQUEST FOR PROPOSALS ADVISES THAT ORAL MODIFICATIONS OF REQUIREMENTS ARE UNAUTHORIZED. PROTESTER COULD NOT REASONABLY HAVE BEEN MISLED INTO MAKING SOFTWARE MODIFICATIONS DIRECTLY CONTRARY TO MANDATORY REQUIREMENTS ON THE BASIS OF ORAL ADVICE FROM TECHNICAL REPRESENTATIVE. 3. DETERMINATION THAT PROPOSAL DOES NOT MEET REQUIREMENTS IS REASONABLE WHERE OFFEROR'S MODIFICATIONS TO BENCHMARK SOFTWARE ARE CONTRARY TO MANDATORY REQUIREMENTS IN ONE INSTANCE AND. MERE OFFER TO COMPLY WITH REQUIREMENT IS NOT SUFFICIENT. 4.

View Decision

B-194286.2, SEP 14, 1979

DIGEST: 1. ABSENT PROVISION TO THE CONTRARY, MODIFICATIONS TO BENCHMARK SOFTWARE WHICH ARE REQUIRED TO BE SUBMITTED WITH TECHNICAL PROPOSAL ARE SUBJECT TO EVALUATION AS PART OF PROPOSAL AND MUST MEET REQUIREMENTS OF REQUEST FOR PROPOSALS. 2. WHERE REQUEST FOR PROPOSALS ADVISES THAT ORAL MODIFICATIONS OF REQUIREMENTS ARE UNAUTHORIZED, PROTESTER COULD NOT REASONABLY HAVE BEEN MISLED INTO MAKING SOFTWARE MODIFICATIONS DIRECTLY CONTRARY TO MANDATORY REQUIREMENTS ON THE BASIS OF ORAL ADVICE FROM TECHNICAL REPRESENTATIVE. 3. DETERMINATION THAT PROPOSAL DOES NOT MEET REQUIREMENTS IS REASONABLE WHERE OFFEROR'S MODIFICATIONS TO BENCHMARK SOFTWARE ARE CONTRARY TO MANDATORY REQUIREMENTS IN ONE INSTANCE AND, AT BEST, DEMONSTRATE PROBABILITY OF NONCOMPLIANCE IN ANOTHER. MERE OFFER TO COMPLY WITH REQUIREMENT IS NOT SUFFICIENT. 4. EXCLUSION OF OFFEROR FROM COMPETITIVE RANGE IS REASONABLE HERE OFFEROR'S MODIFICATIONS TO BENCHMARK SOFTWARE SUBMITTED WITH PROPOSAL INDICATE NONCOMPLIANCE WITH MANDATORY REQUIREMENTS OF REQUEST FOR PROPOSALS.

NESHAMINY VALLEY INFORMATION PROCESSING, INC.:

NESHAMINY VALLEY INFORMATION PROCESSING, INC. (NVIP), PROTESTS ITS EXCLUSION FROM THE COMPETITIVE RANGE UNDER A PROCUREMENT CONDUCTED BY THE AUTOMATIC DATA PROCESSING SELECTION OFFICE (ADPSO) OF THE DEPARTMENT OF THE NAVY. FOR THE REASONS STATED BELOW, WE DENY THE PROTEST.

ON AUGUST 28, 1978, ADPSO ISSUED REQUEST FOR PROPOSALS (RFP) N66032 78-R- 0009 FOR THE ACQUISITION OF TELEPROCESSING SERVICES TO SUPPORT THE NAVY'S PERSONALIZED RECRUITING FOR IMMEDIATE AND DELAYED ENLISTMENT (PRIDE) SYSTEM UTILIZED BY THE NAVY RECRUITING COMMAND. THE PRIDE SYSTEM FUNCTIONS AS A MANAGEMENT INFORMATION SYSTEM, TRACKING EACH NEW RECRUIT FROM ENLISTMENT THROUGH ASSIGNMENT TO A SCHOOL OR DUTY STATION, PROVIDING CURRENT DATA ON WEEKLY RECRUITING GOALS, AND INTERFACING WITH SYSTEMS EMPLOYED BY OTHER PERSONNEL-RELATED ORGAIZATIONAL UNITS. THE RFP ADVISED THAT OFFERORS SUBMITTING ACCEPTABLE PROPOSALS WOULD BE REQUIRED TO PERFORM A BENCHMARK, I.E., WOULD BE REQUIRED TO DEMONSTRATE THE CAPABILITY OF THEIR COMPUTER SYSTEM BY RUNNING A SET OF NAVY PROGRAMS. A COPY OF THE BENCHMARK SOFTWARE WAS INCORPORATED IN THE RFP. WHILE OFFERORS COULD MODIFY THE PROGRAMS TO MAKE THEM COMPATIBLE WITH THEIR PARTICULAR COMPUTER SYSTEM, ALL CHANGES WERE TO BE EXPLAINED IN THE OFFEROR'S TECHNICAL PROPOSAL.

NVIP CONTENDS THAT THE EVALUATION OF ITS PROPOSAL WAS UNFAIR AS THE RESULT OF PREJUDICE ARISING FROM IMPROPER OBJECTIONS BY ADPSO EVALUATORS TO NVIP'S MODIFICATIONS TO THE BENCHMARK SOFTWARE. OUR REVIEW OF OBJECTIONS TO AN AGENCY'S TECHNICAL EVALUATION IS LIMITED TO EXAMINING WHETHER THE EVALUATION WAS FAIR AND REASONABLE AND CONSISTENT WITH THE EVALUATION CRITERIA. WE WILL QUESTION CONTRACTING OFFICIALS' DETERMINATIONS AS TO THE TECHNICAL MERITS OF PROPOSALS ONLY UPON A CLEAR SHOWING OF UNREASONABLENESS, ABUSE OF DISCRETION, OR VIOLATION OF PROCUREMENT LAWS OR REGULATIONS. SEE DISCUSSION IN INTASA, B-191877, NOVEMBER 15, 1978, 78-2 CPD 347; JOSEPH LEGAT ARCHITECTS, B-187160, DECEMBER 13, 1977, 77-2 CPD 458. IN RESPONSE TO NVIP'S OBJECTIONS, WE HAVE REVIEWED THE RFP, NVIP'S PROPOSAL AND PROGRAM CHANGES, AND ADPSO'S EVALUATION, AND IN EACH INSTANCE WE FIND A REASONABLE BASIS FOR ADPSO'S ASSESSMENT.

BEFORE DISCUSSING NVIP'S SPECIFIC OBJECTIONS, HOWEVER, WE OBSERVE THAT NVIP APPARENTLY REGARDS ITS BENCHMARK MODIFICATIONS TO BE INDEPENDENT FROM ITS TECHNICAL PROPOSAL, A VIEW WE CONSIDER INCORRECT. ONE OF THE PURPOSES OF A BENCHMARK IS TO PROVIDE A PROSPECTIVE SUPPLIER THE OPPORTUNITY TO DEMONSTRATE THAT ITS EQUIPMENT OR SOFTWARE CONFORMING TO THE PROCURING AGENCY'S REQUIREMENTS WILL PERFORM SATISFACTORILY. WHERE, AS HERE, OFFERORS ARE REQUIRED TO DESCRIBE IN DETAIL IN THEIR TECHNICAL PROPOSALS THE SOFTWARE MODIFICATIONS NECESSARY TO PERMIT RUNNING THE BENCHMARK ON THEIR PARTICULAR EQUIPMENT, ABSENT PROVISION TO THE CONTRARY, THESE MODIFICATIONS ARE SUBJECT TO EVALUATION AS PART OF THE PROPOSAL TO DETERMINE THEIR COMPLIANCE WITH THE SPECIFICATIONS.

NVIP FIRST OBJECTS TO ADPSO CRITICISM OF ITS MODIFICATIONS TO TWO OF THE BENCHMARK INPUT/OUTPUT (I/O) ROUTINES CALLED LREAD AND LWRITE. DESCRIBED IN THE RFP, LREAD IS A FORTRAN RANDOM ACCESS I/O ROUTINE WHICH READS A NAMED FILE RESIDENT ON A DISC ONE WORD AT A TIME UNTIL THE CORRECT START WORD IN THE FILE IS REACHED, THEN PERFORMS ONE MORE READ TO FILL THE DESIRED ARRAY. A PARTICULAR PIECE OF DATA IS READ BY SPECIFYING ITS LOCATION IN THE FILE IN TERMS OF ITS DISPLACEMENT IN WORDS FROM THE FRONT OF THE FILE AND THE LENGTH IN WORDS OF THE DESIRED SEGMENT, I.E., READ FIVE WORDS BEGINNING WITH THE 27TH WORD IN THE FILE. LREAD SEARCHES THE FILE ONE WORD AT A TIME UNTIL IT REACHES THE SPECIFIED STARTING POINT, THEN PERFORMS ONE LAST READ TO GET THE DESIRED DATA AND BRING IT INTO THE COMPUTER. LWRITE USES THE SAME BASIC PROCESS TO MOVE DATA FROM THE COMPUTER TO A DESIRED LOCATION IN THE FILE. NVIP CONSIDERED THIS TO BE COMBERSOME AND REWROTE THESE ROUTINES TO READ (OR WRITE) THE ENTIRE FILE IN ONE I/O.

NVIP ALSO MODIFIED THE SPECIFICATIONS FOR DATA ARRAYS ON WHICH LREAD AND LWRITE OPERATE. AS DRAFTED BY ADPSO, THESE TWO SUBROUTINES WERE DESIGNED TO ACCESS AN ARRAY CALLED JDAT OF EITHER 350 OR 400 WORDS IN LENGTH, DEPENDING ON THE ROUTINE. EACH JDAT ARRAY IS, IN EFFECT, A SUBSET OF ONE OF THREE 600-WORD LOGICAL RECORDS ESTABLISHED AT THE OUTSET OF THE BENCHMARK PROGRAMS. NVIP MODIFIED THE JDAT ARRAYS TO BE 600 WORDS IN LENGTH. THE RESULT OF THIS CHANGE WAS THAT THE ENTIRE RECORD OF 600 WORDS HAD TO BE READ EACH TIME IT WAS ACCESSED.

NVIP CONTENDS THAT THE NAVY SHOULD NOT HAVE CONSIDERED THIS A DEFICIENCY BECAUSE THE NAVY "DIRECTED" NVIP TO MAKE THESE CHANGES TO THE BENCHMARK SOFTWARE. IN THIS CONNECTION, NVIP ASSERTS THAT DURING A THREE-WAY CONVERSATION AMONG NVIP PERSONNEL AND THE ADPSO'S TECHNICAL REPRESENTATIVE, NVIP WAS ADVISED THAT IT COULD WRITE THE CODE SO THAT THE ENTIRE RECORD COULD BE WRITTEN OR READ WITH ONE I/O. NVIP CONTENDS THAT NAVY EVALUATORS FAILED TO UNDERSTAND THESE CHANGES BECAUSE THE TECHNICAL REPRESENTATIVE LEFT THE NAVY PRIOR TO THE RECEIPT OF PROPOSALS AND FAILED TO ADVISE EITHER ADPSO OR OTHER OFFERORS OF THESE AUTHORIZED CHANGES.

ADPSO ADVISES THAT THE PURPOSE OF THESE ROUTINES WAS TO TEST THE CAPABILITY OF A VENDOR'S SYSTEM TO READ THE JDAT ARRAY, OR A PORTION THEREOF, WITHOUT READING THE ENTIRE 600-WORD RECORD. ADPSO DETERMINED THAT NVIP'S APPROACH DID NOT SATISFY THIS REQUIREMENT.

WE THINK THAT ADPSO'S EVALUATION OF THIS ASPECT OF NVIP'S PROPOSAL WAS REASONABLE. THE RFP PROVIDED THAT CERTAIN OF THE NAVY-SUPPLIED BENCHMARK SOFTWARE WAS REQUIRED TO BE REPLACED AND THAT OTHER SOFTWARE COULD BE REPLACED BY VENDOR-SUPPLIED PROGRAMS PERFORMING THE SAME FUNCTIONS. OFFERORS WERE ADVISED, HOWEVER, THAT THE BENCHMARK PROGRAMS COULD BE MODIFIED ONLY TO THE EXTENT NECESSARY TO PERMIT THEM TO RUN ON THE VENDOR'S SYSTEM AND WERE CAUTIONED THAT THE BENCHMARK PROGRAMS WERE NOT TO BE OPTIMIZED TO IMPROVE THEIR EFFICIENCY; THE LOGIC OF THE PROGRAMS WAS NOT TO BE CHANGED. THE RFP CLEARLY STATED THE REQUIREMENT FOR ACCESS TO A FIELD OR PORTION OF A RECORD AND DESCRIBED THIS FEATURE AS A REQUIREMENT OF THE USER'S APPLICATION PROGRAMS. NVIP'S CHANGES TO THE BENCHMARK SOFTWARE GO BEYOND THESE STRICTURES AND RESULT IN A ROUTINE WHICH DOES NOT MEET THE RFP'S REQUIREMENTS. WE THINK ADPSO WAS REASONABLE IN ITS ASSESSMENT.

FURTHERMORE, WE DO NOT THINK THAT NVIP COULD REASONABLY HAVE BEEN MISLED INTO MAKING THESE MODIFICATIONS ON THE BASIS OF A CONVERSATION WITH A NAVY TECHNICAL REPRESENTATIVE. WE NOTE FIRST THAT NVIP'S MODIFICATION TO THESE ROUTINES IS DIRECTLY CONTRARY TO A MANDATORY REQUIREMENT FOR ACCESS CAPABILITY TO A PORTION OF A RECORD. WE NOTE ALSO THAT THE RFP SPECIFICALLY ADVISED OFFERORS THAT ORAL MODIFICATIONS OF THE REQUIREMENTS WERE UNAUTHORIZED. WE THINK THAT IT SHOULD HAVE BEEN OBVIOUS TO NVIP THAT THE CAPABILITY TO ACCESS A PORTION OF A RECORD WAS A MANDATORY REQUIREMENT THAT COULD BE CHANGED ONLY BY A WRITTEN AMENDMENT TO THE RFP. NONE OF THE 10 AMENDMENTS TO THIS SOLICITATION PERMIT PROGRAM MODIFICATIONS OF THE SCOPE UNDERTAKEN BY NVIP. COMPARE GENASYS CORPORATION, B-190504, SEPTEMBER 11, 1978, 78-2 CPD 182.

NVIP'S SECOND PRINCIPAL OBJECTION IS TO ADPSO'S NEGATIVE EVALUATION OF NVIP'S SUBSTITUTE FOR A BIT MANIPULATION FUNCTION IN THE BENCHMARK SOFTWARE. NVIP CONTENDS THAT ADPSO'S EVALUATION WAS IMPROPER BECAUSE ITS MODIFIED VERSION OF THE SOFTWARE PERFORMS EXACTLY THE SAME AS THE ORIGINAL AND, IN ANY EVENT, THAT IT THE BIT MANIPULATION CAPABILITY WITHIN 2 WEEKS OF CONTRACT AWARD.

SOME MINIMAL BACKGROUND IS NECESSARY BEFORE DISCUSSING THIS QUESTION. COMPUTERS STORE ALPHANUMERIC INFORMATION (CHARACTERS) IN THE FORM OF "BYTES" WHICH ARE FIXED-LENGTH GROUPS OF "BITS" OR BINARY DIGITS. BITS MAY BE EITHER 1 OR 0. EACH CHARACTER HAS ITS OWN UNIQUE BIT PATTERN WITHIN A PARTICULAR COMPUTER. FOR INSTANCE, IF WE ASSUME THAT A PARTICULAR COMPUTER USES AN EIGHT-BIT BYTE, THE NUMBER 1 MIGHT ALWAYS BE STORED INTERNALLY AS "00000001," AND THE LETTER "A" MIGHT ALWAYS BE "00010001." WHILE A BYTE OR CHARACTER IS NORMALLY THE SMALLEST UNIT OF INFORMATION USED IN A PROGRAM, SOME APPLICATIONS REQUIRE THE ABILITY TO REFERENCE AND CHANGE SPECIFIC BITS.

THE RFP REQUIRED VENDORS TO PROVIDE A VARIABLE LENGTH BIT MANIPULATION CAPABILITY, I.E., A FUNCTION WHICH WOULD PERMIT NAVY PROGRAMMERS TO ALTER THE VALUE OF SPECIFIC BITS OR STRINGS OF BITS, TO WHICH NVIP PROVIDED TWO RESPONSES. FIRST, NVIP STATED IN ITS TECHNICAL PROPOSAL THAT IT WOULD PROVIDE A VARIABLE LENGTH BIT MANIPULATION CAPABILITY WITHIN 2 WEEKS OF CONTRACT AWARD. SECOND, NVIP MODIFIED A BIT MANIPULATION FUNCTION IN THE BENCHMARK SOFTWARE TO PERFORM CHARACTER SUBSTITUTION. IN THIS LATTER REGARD, THE NAVY USED A FUNCTION SUPPLIED BY THE INCUMBENT VENDOR CALLED "FLD," WHICH ACCOMPLISHES BIT MANIPULATION BY SUBSTITUTING N-BITS OF A SPECIFIED VALUE FOR A SPECIFIED STRING N-BITS LONG; FLD WAS USED IN THE BENCHMARK TO PERFORM BYTE LENGTH SUBSTITUTIONS BEGINNING ON BYTE BOUNDARIES, IN EFFECT PERFORMING CHARACTER SUBSTITUTIONS. IN ITS PROGRAM MODIFICATIONS, NVIP STATED THAT ITS OWN FLD ROUTINE COULD NOT APPEAR ON BOTH SIDES OF THE EQUAL SIGN, AS DID THE NAVY'S, AND IT SUBSITUTED ITS OWN FLD ROUTINE IN COMBINATION WITH TWO LOGICAL FUNCTIONS. NVIP DID NOT EXPLAIN WHETHER ITS OWN FLD FUNCTION PERFORMS BIT OR CHARACTER MANIPULATION AND LITERATURE EXAMINED BY ADPSO PERTAINING TO NVIP'S PARTICULAR SYSTEM INDICATES THAT THE LOGICAL FUNCTION USED BY NVIP PERFORMS CHARACTER AND NOT BIT MANIPULATION. ADPSO CONCLUDED ON THIS BASIS THAT NVIP'S PROPOSAL DID NOT MEET ITS REQUIREMENTS.

WE THINK THAT ADPSO'S EVALUATION WAS REASONABLE. THE RFP REQUIRED THAT OFFERORS EXPLAIN IN DETAIL HOW EACH REQUIREMENT WOULD BE MET AND THE REQUIREMENT FOR A VARIABLE LENGTH BIT MANIPULATION CAPABILITY WAS CLEARLY STATED. NVIP'S DUAL RESPONSE, AMOUNTING TO AN OFFER TO COMPLY IN ONE INSTANCE AND AN APPARENT NONCOMPLYING DEMONSTRATION IN THE SECOND INSTANCE, FALLS FAR SHORT OF A DETAILED EXPLANATION OF HOW THE REQUIREMENT WOULD BE MET. WE HAVE PREVIOUSLY CRITICIZED MERE OFFERS OF COMPLIANCE WITH TECHNICAL REQUIREMENTS WHERE, AS HERE, THE RFP REQUIRES A DETAILED RESPONSE. SEE LOGIC SYSTEMS, B-188997, NOVEMBER 23, 1977, 77-2 CPD 398. THIS CRITICISM IS EQUALLY APPLICABLE TO A RESPONSE WHICH INDICATES, AT BEST, A PROBABILITY OF NONCOMPLIANCE WITH A MANDATORY RFP REQUIREMENT. THINK THIS RECORD SUPPORTS THE REASONABLENESS OF ADPSO'S EVALUATION OF THIS FACTOR.

WE HAVE EXAMINED EACH OF THE OTHER DEFICIENCIES CITED BY ADPSO IN NVIP'S PROPOSAL. IN EACH INSTANCE, WE FIND SUBSTANTIAL SUPPORT FOR ADPSO'S POSITION. CONSEQUENTLY, WE FIND NO BASIS UPON WHICH WE MIGHT QUESTION THE REASONABLENESS OF ADPSO'S EVALUATION OF NVIP'S PROPOSAL. FURTHERMORE, SINCE NVIP DID NOT ESTABLISH ITS ABILITY TO MEET THE RFP'S MANDATORY REQUIREMENTS, WE CANNOT OBJECT TO ITS EXCLUSION FROM THE COMPETITIVE RANGE. SEE TECHNIARTS, B-192158, MARCH 29, 1979, 79-1 CPD 213.

THE PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs