Skip to main content

B-191013, MAY 31, 1978

B-191013 May 31, 1978
Jump To:
Skip to Highlights

Highlights

PROTEST THAT AGENCY HAS UNDERESTIMATED VALUE WHICH USE OF OPTICAL CHARACTER RECOGNITION EQUIPMENT COULD HAVE IN AUTOMATICALLY PROCESSING FORMS IS UNTIMELY RAISED BECAUSE PROTESTER FAILED TO PROTEST TO GAO WITHIN 10 DAYS OF INITIAL ADVERSE AGENCY ACTION. 2. ASSERTION THAT BENCHMARK SHOULD HAVE BEEN STRUCTURED TO USE "REAL" DATA IS UNTIMELY. ALLEGATION THAT OFFSET PRINTED TEST DECK WAS NOT ADEQUATELY REPRESENTATIVE OF TYPEWRITTEN FORMS WHICH AGENCY EXPECTS CONTRACTORS' EQUIPMENT TO READ IS TIMELY. PROTEST WAS FILED WITHIN 10-WORKING DAYS AFTER PROTESTER LEARNED THAT TIMELY INITIAL PROTEST TO AGENCY WAS DENIED. 4. FORMULATION OF TEST DECK FROM WHICH BENCHMARK WAS PERFORMED REQUIRED EXERCISE OF SOUND AGENCY DISCRETION.

View Decision

B-191013, MAY 31, 1978

1. PROTEST THAT AGENCY HAS UNDERESTIMATED VALUE WHICH USE OF OPTICAL CHARACTER RECOGNITION EQUIPMENT COULD HAVE IN AUTOMATICALLY PROCESSING FORMS IS UNTIMELY RAISED BECAUSE PROTESTER FAILED TO PROTEST TO GAO WITHIN 10 DAYS OF INITIAL ADVERSE AGENCY ACTION. 2. ASSERTION THAT BENCHMARK SHOULD HAVE BEEN STRUCTURED TO USE "REAL" DATA IS UNTIMELY. SOLICITATION INDICATED THAT AGENCY WOULD CREATE TEST DECK USING FORMS SPECIFICALLY PREPARED FOR THAT PURPOSE AND PROTESTER FAILED TO PURSUE ITS CONTENTIONS IN A TIMELY MANNER. 3. ALLEGATION THAT OFFSET PRINTED TEST DECK WAS NOT ADEQUATELY REPRESENTATIVE OF TYPEWRITTEN FORMS WHICH AGENCY EXPECTS CONTRACTORS' EQUIPMENT TO READ IS TIMELY. PROTEST WAS FILED WITHIN 10-WORKING DAYS AFTER PROTESTER LEARNED THAT TIMELY INITIAL PROTEST TO AGENCY WAS DENIED. 4. FORMULATION OF TEST DECK FROM WHICH BENCHMARK WAS PERFORMED REQUIRED EXERCISE OF SOUND AGENCY DISCRETION. USE OF OFFSET PRINTING PROCESS TO PRODUCE TEST DECK FOR BENCHMARKING OPTICAL CHARACTER RECOGNITION EQUIPMENT WAS NOT UNREASONABLE NOTWITHSTANDING POSSIBILITY THAT PROTESTER MIGHT HAVE RECEIVED GREATER ADVANTAGE HAD TEST BEEN STRUCTURED DIFFERENTLY.

INFORMATION INTERNATIONAL, INC.:

INFORMATION INTERNATIONAL, INC. (III) PROTESTS THE SOCIAL SECURITY ADMINISTRATION'S (SSA) REFUSAL TO AMEND SSA-RFP-78-0001 IN CERTAIN RESPECTS. THE SOLICITATION CALLS FOR THE PROCUREMENT OF MULTI-FONT OPTICAL SCANNING EQUIPMENT TO PERMIT SSA TO MACHINE "READ" W-2, W-2P AND W -3 FORMS, CONVERTING THE INFORMATION CONTAINED ON THEM TO MAGNETIC TAPE. AUTOMATION OF EXISTING INFORMATION PROCESSING IS TO BE ACCOMPLISHED BY THE BEGINNING OF 1979, WITH RESULTING DATA BEING SHARED BY SSA AND THE INTERNAL REVENUE SERVICE. THE PROTESTER SUBSEQUENTLY RAISED OTHER ISSUES UNDER THE SAME SOLICITATION WHICH WILL BE CONSIDERED SEPARATELY AT A LATER DATE IN ACCORDANCE WITH OUR PROTEST PROCEDURES.

THE PROTESTER OBJECTS TO THE FORM AND CONTENT OF THE OPERATIONAL CAPABILITY DEMONSTRATION (OCD), A BENCHMARK REQUIRED BY SSA AS PART OF ITS EVALUATION OF PROPOSALS. PRINCIPALLY, THE PROTESTER CLAIMS:

"(1) THE TEST IS TOO SIMPLE TO DISCRIMINATE BETWEEN OPTICAL SCANNING EQUIPMENT SINCE ONLY THE EASIEST 70% OF THE FORMS ARE TO BE READ;

"(2) THE TEST IS UNREPRESENTATIVE OF THE REAL WORLD DATA BECAUSE IT DOESN'T CONTAIN ANY ACTUAL FORMS; AND

"(3) THE TEST IS COMPOSED OF OFFSET PRINTED FACSIMILIES OF FORMS RATHER THAN ACTUAL TYPEWRITTEN OR COMPUTER PRINTED FORMS."

AS TO PROTESTER'S POINT (1) ABOVE, IT IS APPARENT THAT THE OBJECTION DOES NOT CONCERN THE FORM OF THE TEST, PER SE, BUT CONCERNS SSA'S DETERMINATION THAT THE EQUIPMENT TO BE FURNISHED IS REQUIRED ONLY TO PROCESS APPROXIMATELY 70 PERCENT OF SSA'S ANNUAL WORKLOAD. AS EXPRESSED BY THE PROTESTER,

"THE ORIGINAL ANNOUNCEMENT OF THE PROCUREMENT *** AS CORRECTED ON JULY 16, 1977, STATED A WORKLOAD OF 158 MILLION ITEMS OR APPROXIMATELY 68 MILLION DOCUMENTS. *** IT WAS NOT CLEAR UNTIL ISSUANCE OF THE SEPTEMBER 6, 1977, AMENDMENT THAT THE SOLICITATION PROVIDED FOR A WORKLOAD OF ONLY 105.6 MILLION ITEMS OR 48 MILLION DOCUMENTS - A DECREASE OF ABOUT 30%. SUBSEQUENTLY, SSA ACKNOWLEDGED THAT IT WOULD REQUIRE AUTOMATIC OPTICAL SCANNING OF ONLY 70% OF THE TOTAL WORKLOAD. THE OCD APPARENTLY WAS DESIGNED TO TEST ONLY AN EASILY READ SAMPLE OF DOCUMENTS SO AS TO CORRESPOND TO THIS REDUCED WORKLOAD. ***."

THE PROTESTER RAISED THIS ISSUE IN A LETTER DATED OCTOBER 3, 1977, WHICH WAS SUBMITTED TO SSA BEFORE THE CLOSING DATE FOR THE RECEIPT OF INITIAL PROPOSALS. SSA DENIED THE PROTESTER'S CONTENTIONS IN A LETTER DATED DECEMBER 1, 1977, IN WHICH SSA STATED THAT:

"IT IS THE AGENCY'S PREROGATIVE TO SPECIFY THE WORKLOAD FOR WHICH AN RFP IS ISSUED. IN JANUARY 1977, 6 MONTHS PRIOR TO THE RELEASE OF THE INITIAL RFP, THE PLANNING ASSUMPTION WAS ESTABLISHED, FOR A VARIETY OF REASONS, THAT 30 PERCENT OF THE DOCUMENTS WOULD NOT BE CONSIDERED AS SUSCEPTIBLE TO SCANNING. THAT PLANNING ASSUMPTION HAS REMAINED CONSTANT THROUGHOUT THE RFP PROCESSING. THE 30-PERCENT NONSCANNABLE ASSUMPTION WAS INHERENT AND SPECIFIED IN THE JUSTIFICATION REVIEWED BY VARIOUS ORGANIZATIONS, INTERNAL AND EXTERNAL TO SSA, PRIOR TO THE RELEASE OF THE RFP. IN ADDITION, ALL VENDORS, INCLUDING (THE PROTESTER) WHICH HAD INDICATED AN INTEREST IN THE RFP WERE INFORMED IN A MARCH 16, 1977, LETTER THAT PART OF THE ANNUAL REPORTING WORKLOAD WOULD NOT BE SUBJECTED TO SCANNING."

UNDER OUR PROCEDURES A PROTEST WHICH IS INITIALLY FILED WITH AND DENIED BY THE PROCURING AGENCY MUST BE PURSUED WITH GAO WITHIN 10 DAYS OF FORMAL NOTIFICATION OR ACTUAL OR CONSTRUCTIVE KNOWLEDGE OF THE INITIAL ADVERSE AGENCY ACTION.

THE PROTESTER ARGUES THAT THIS LETTER SHOULD NOT BE CONSIDERED AS EVIDENCING AN INITIAL AGENCY DECISION, BECAUSE SSA LATER REQUESTED ITS COMPLAINTS REGARDING THE BENCHMARK BE REDUCED TO WRITING AND THE "70% LIMITATION" WAS ONE OF THOSE COMPLAINTS. IN ITS VIEW, SSA REOPENED THE QUESTION WITHIN THE 10-DAY PERIOD DURING WHICH THE PROTESTER WOULD OTHERWISE HAVE BEEN REQUIRED TO FILE ITS PROTEST AND IN THE CIRCUMSTANCES, IT HAD NO BASIS TO "REASONABLY BELIEVE THAT THE EXISTING STATE OF FACTS WAS NOT THREATENING." MOREOVER, THE PROTESTER ASSERTS, "GAO'S UNDERLYING POLICY FOR INSISTING UPON STRICT TIME LIMITS (DOES NOT) COMPEL DISMISSAL OF THIS ISSUE, FOR IT WAS NOT DELAYED BEYOND THE TIME WHEN ANOTHER INTERRELATED OBJECTION WAS PROTESTED."

EVEN THOUGH WE AGREE THAT THIS ISSUE IS INTERTWINED WITH THE PROTESTER'S TIMELY OBJECTIONS TO THE BENCHMARK TEST, PARTICULARLY REGARDING THE PROTESTER'S PERCEPTION OF THEM, WE FIND IT DIFFICULT TO BELIEVE THAT AN OFFEROR IN SUCH A POSITION WOULD HAVE READ SSA'S DECEMBER 1 RESPONSE AS LEAVING ANY DOUBT THAT SSA WAS REJECTING ITS ARGUMENT. THE BEST THAT COULD BE SAID IS THAT THE PROTESTER DID NOT UNDERSTAND THE IMPACT OF THE 70 PERCENT CUT-OFF, AN ASSUMPTION WHICH IS BELIED BY ITS ARGUMENTS IN ITS OCTOBER 3 LETTER. CONCOMITANTLY, IT IS OUR OPINION THAT THE PROTESTER COULD NOT HAVE CONCLUDED REASONABLY THAT SSA WOULD ALLOW IT TO REOPEN CONSIDERATION OF THE 70 PERCENT QUESTION, IN CONJUNCTION WITH ITS DISCUSSION OF OBJECTIONS TO SSA'S BENCHMARK DATA.

MOREOVER, REGARDING THE PROTESTER'S CONTENTION THAT TIME IS NOT OF THE ESSENCE BECAUSE WE ARE CONFRONTED BY A PROTEST ON OTHER ISSUES, SSA'S COMMENTS IN ITS DECEMBER 1 LETTER SUGGEST THE CONTRARY. THIS CASE UNDERSCORES THE IMPORTANCE OF MAINTAINING STRICT TIME LIMITS DURING WHICH PROTESTS SHOULD BE FILED. WERE WE TO FAVORABLY CONSIDER THE PROTEST REGARDING THE COMPOSITION OF MATERIALS USED IN PERFORMING THE BENCHMARK, OUR DECISION COULD RESULT IN MORE THAN SIMPLY A RECOMMENDATION THAT THE TEST BE RERUN, DISRUPTING MUCH OF SSA'S PROGRAM PLANNING. IN THE CIRCUMSTANCES WE BELIEVE THE PROTESTER IS UNTIMELY AS TO THIS ISSUE.

WE TURN, NEXT, TO THE PROTESTER'S COMPLAINT THAT THE OCD SHOULD HAVE BEEN BASED ON USE OF ACTUAL FORMS. THE PROTESTER ARGUES THAT THE OCD WOULD HAVE BEEN MORE REPRESENTATIVE OF "REAL WORLD" DATA HAD SSA USED EXISTING FORMS, BECAUSE THE FULL RANGE OF TYPEFACES WHICH MIGHT BE EXPECTED IN PRACTICE WOULD BE LIKELY TO OCCUR AND BECAUSE ACTUAL FORMS WOULD HAVE BEEN HANDLED AND POSSIBLY TORN AND DAMAGED.

THE RECORD SHOWS THAT WRITTEN QUESTIONS AND ANSWERS WERE INCORPORATED IN AMENDMENT 3, DATED SEPTEMBER 23, 1977, WHICH AMENDED THE RFP TO REFLECT THE FOLLOWING:

"THE PAGES TO BE SCANNED WILL BE 40 POUND WEIGHT PLUS OR MINUS 5 PERCENT (SUBSTANCE WEIGHT 1,000 SHEETS 17X22 INCHES) OCR QUALITY. NEITHER LINE PRINT STOCK PAPER NOR CARBON IMPRINTED PAGES WILL BE USED IN THE OCD. THE PAGES WILL BE PREPARED BY COMMERCIAL PRINTING. SSA WILL SUPPLY A SMALL QUANTITY OF FILLED-OUT PAGES, AS PART OF THE OCD PROCEDURAL DOCUMENTATION PACKAGE TO REPRESENT A SAMPLE OF THE DATA CONDITIONS EXPECTED IN THE PRODUCTION ENVIRONMENT."

AS EXPLAINED BY SSA, IT DID NOT USE ACTUAL FORMS BECAUSE IT DID NOT HAVE THE FORMS WHICH EVENTUALLY WILL BE USED AND IT DID NOT CONSIDER USE OF EXISTING FORMS TO BE SUITABLE. WHILE THE PROTESTER BELIEVES THE TEST SHOULD HAVE BEEN CONSTRUCTED BY USING EXISTING FORMS, THE FORMS USED TO REPORT SIMILAR DATA IN THE PAST ARE TO BE REPLACED WHEN THE TRANSITION TO AN OCR BASED SYSTEM IS COMPLETED. OPERATION OF THE OCR SYSTEM IS NOT TO COMMENCE UNTIL JANUARY OF 1979. MOREOVER, THE NEW FORMS WILL NOT BE COMPLETED UNTIL AFTER THE SUBJECT CONTRACT IS AWARDED, BECAUSE

"*** A PORTION OF *** (THE) PRINTING SPECIFICATIONS RELATE TO THE OCR DROPOUT INK (AN 'INK' WHICH DOES NOT REGISTER IN THE SCANNING PROCESS AND WHICH, THEREFORE, DOES NOT OBLITERATE ANY DATA PRINTED BY THE EMPLOYER OVER THAT INK). THE COLOR OF THE OCR DROPOUT INK REQUIREMENTS VARIES AMONG THE SYSTEMS BEING PROPOSED UNDER THIS RFP."

THE RFP INCLUDED SAMPLES DEPICTING THE PROPOSED LAYOUT OF THE NEW FORMS AND OTHER DATA RELATING TO THEM. THE PROTESTER ALSO KNEW THAT ONLY A LIMITED NUMBER OF TYPEFACES WOULD BE USED. IN OUR VIEW AMENDMENT 3 PUT POTENTIAL OFFERORS ON NOTICE THAT SSA DID NOT INTEND TO USE ACTUAL EXISTING FORMS BUT WOULD PRODUCE AN OCD TEST DECK ON FORMS WHICH WOULD BE SPECIFICALLY PRINTED FOR THAT PURPOSE.

A PROTEST OF AN ALLEGED IMPROPRIETY WHICH IS APPARENT UPON THE FACE OF A SOLICITATION OR AMENDMENT TO A SOLICITATION MUST BE FILED INITIALLY BEFORE THE NEXT SUCCEEDING CLOSING DATE FOR THE RECEIPT OF PROPOSALS. 4 C.F.R. SEC. 20.2(B) (1977). EVEN IF A PROTEST IS FILED WITH THE PROCURING ACTIVITY BEFORE THAT DATE, IT MUST BE PROTESTED IN OUR OFFICE NOT LATER THAN 10-WORKING DAYS AFTER THE PROTESTER HAS ACTUAL OR CONSTRUCTIVE KNOWLEDGE OF INITIAL AGENCY ACTION DENYING HIS COMPLAINT. 4 C.F.R. SEC. 20.2(A). THE MOST THAT CAN BE SAID HERE IS THAT THE PROTESTER BROUGHT SEVERAL OF ITS CONCERNS TO SSA'S ATTENTION AND FAILED TO FOLLOW-UP ITS COMPLAINTS BY FILING A PROTEST WITH OUR OFFICE AFTER IT LEARNED THAT SSA WOULD STAND BY ITS INTENTIONS.

FINALLY THE PROTESTER OBJECTS TO TESTING OFFERORS' EQUIPMENT WITH FORMS WHICH CONTAIN INFORMATION REPRODUCED BY OFFSET PRINTING RATHER THAN BY A TYPEWRITTEN OR COMPUTER PRINTED PROCESS. THE PROTESTER PROPOSED A MICROFILM SCANNING PROCESS, AS DISTINGUISHED FROM PAPER SCAN PROCESSES PROPOSED BY OTHERS. MOREOVER, THE PROTESTER CLAIMS THAT ITS COMBINATION OF EQUIPMENT AND SOFTWARE HAS BEEN SPECIALLY DESIGNED TO READ THE INFORMATION TO BE PROVIDED BY THE USER ON THE FORM BY IMPACT PRINTING (TYPEWRITING). THE PROTESTER'S PROCESS UTILIZES SUPPORTING AUTOMATIC DATA PROCESSING EQUIPMENT, WHICH PERMITS IT TO CAPTURE INFORMATION BY READING SOME 500 DIFFERING SHADES OF GRAY WHICH COULD OCCUR IN THE TYPEWRITTEN PROCESS.

THE PROTESTER POINTS OUT THAT IN FILLING IN THE FORMS BY OFFSET PRINTING PROCESSES THE ORIGINAL IMAGES ARE DISTORTED BY REDUCING GRAY TONES TO EITHER BLACK OR WHITE. THAT PORTION OF AN OFFSET PRINTED IMAGE WHICH IS RENDERED WHITE IS LOST, MAKING IT IMPOSSIBLE FOR ANY KIND OF EQUIPMENT TO READ IT. THAT PORTION WHICH IS MADE BLACK BECOMES MORE EASILY READABLE BY ALL EQUIPMENT. IN THE PROTESTER'S VIEW THIS AFFECTS THE ACCURACY WHICH CAN BE ACHIEVED, THE RATE AT WHICH MATERIALS CAN BE PROCESSED AND THE AMOUNT OF EQUIPMENT AND NUMBER OF PERSONNEL REQUIRED TO PERFORM A STATED TASK. BECAUSE THE EQUIPMENT PROPOSED BY THE PROTESTER IS MORE EXPENSIVE THAN OTHER AVAILABLE EQUIPMENT, IT CAN HOPE TO BE AWARDED THE CONTRACT ONLY BY SHOWING THAT ITS PROCESS WOULD PROVE TO BE MORE COST EFFECTIVE. TO THE EXTENT, THEN, THAT THE PROTESTER'S COMPARATIVE ABILITY TO READ THE TEST DECK IS REDUCED, ITS COMPETITIVE POSITION IS ADVERSELY AFFECTED. BECAUSE AWARD IS TO BE MADE ON THE BASIS OF LOWEST LIFE-CYCLE COST OF PROPOSED EQUIPMENT TO THE GOVERNMENT, FAILURE OF THE OCD TO PROPERLY REFLECT SSA'S ANTICIPATED REQUIREMENTS WOULD RESULT IN AN UNBALANCED APPLICATION OF THE EVALUATION CRITERION, PREVENTING THE GOVERNMENT FROM OBTAINING FULL AND FREE COMPETITION. CF., SOUTHEASTERN SERVICES, INC. AND WORLDWIDE SERVICES, INC., 56 COMP.GEN. 668 (1977), 77-1 CPD 390.

CONCERNING THE TIMELINESS OF THIS ISSUE, SSA ARGUES THAT THE PROTESTER HAD EARLY NOTICE OF SSA'S INTENTION TO USE OFFSET PRINTED MATERIALS BECAUSE IT HAD INDICATED IN THE RFP AND REITERATED IN THE OCD PROCEDURE PACKAGE THAT THE "TEST DECK WILL CONSIST OF ALPHA (UPPER AND LOWER CASE), NUMERIC AND SPECIAL CHARACTERS (- . , $ ' ) PREPRINTED ON W-2 AND W-3 FORMS IN A VARIETY OF TYPEWRITER AND 1 LINE PRINTER FONTS ***."

WE AGREE THAT THIS MAY HAVE BEEN WHAT SSA MEANT BY THE LANGUAGE QUOTED. MOREOVER, WE BELIEVE THAT SSA'S INTENTION TO USE OFFSET PREPARED COPY IN PREPARING THE OCD TEST DECKS IS REFLECTED IN THE SOLICITATION DOCUMENTS AS EARLY AS AMENDMENT 3, QUOTED EARLIER. OUR DIFFICULTY WITH SSA'S POSITION RESULTS FROM OUR VIEW THAT THE TERMS USED IN THE CONTEXT OF THIS PROCUREMENT TENDED TO BE AMBIGUOUS. PRINTED MATERIAL ENCOMPASSES TYPEWRITTEN TEXT, AS DISTINGUISHED FROM HAND-WRITTEN MATERIAL WHICH ACCORDING TO THE PROTESTER ITS EQUIPMENT CAN ALSO BE PROGRAMMED TO READ. SSA'S REFERENCE IN AMENDMENT 3 TO USE OF "COMMERCIAL PRINTING" MUST BE READ IN CONJUNCTION WITH ITS REFERENCE, ALSO, TO THE "SMALL QUANTITY OF FILLED-OUT PAGES" WHICH IT STATED IT INTENDED TO FURNISH WITH THE OCD PROCEDURAL PACKAGE FURNISHED EACH OFFEROR AT THE CLOSING DATE FOR RECEIPT OF INITIAL PROPOSALS. THE OCD PROCEDURAL PACKAGE FURTHER PROVIDED THAT:

"THE OCD TEST DECK WILL CONSIST OF APPROXIMATELY 20,000 PAGES (A PAGE CONTAINS EITHER THREE W-2'S OR ONE W-3) OF W-3 AND W-2 FORMS DIVIDED INTO FOUR WORK UNITS OF APPROXIMATELY 5,000 PAGES EACH. THESE PAGES WILL BE PRINTED AND TYPED ON GOVERNMENT AND COMMERCIAL LINE-PRINTERS AND TYPEWRITERS. THEY WILL BE ARRANGED TO REPRESENT PRODUCTION WORK ***." (EMPHAISIS ADDED.)

IN THE CIRCUMSTANCES, WE BELIEVE THAT THE PROTESTER MIGHT NOT HAVE KNOWN OR HAD REASON TO KNOW AT LEAST BEFORE DECEMBER 1, 1977, THAT SSA WOULD USE FORMS ON WHICH INFORMATION WOULD BE OFFSET PRINTED IN CONSTRUCTING THE TEST DECK. THE PROTESTER'S OCD WAS ORIGINALLY SCHEDULED FOR DECEMBER 7. ON THAT DATE, IT REFUSED TO RUN THE BENCHMARK, ORALLY OBJECTING TO THE USE OF OFFSET PRINTED MATERIALS. IT FOLLOWED THIS UP BY SUBMITTING THE REASONS FOR ITS REFUSAL IN THE DECEMBER 9 LETTER REFERRED TO IN SSA'S DECEMBER 23 TELEGRAM. SINCE THE PROTEST WAS FILED IN OUR OFFICE ON JANUARY 3, 1978, LESS THAN 10 WORKING DAYS FOLLOWING ITS RECEIPT OF SSA'S ADVERSE RESPONSE, THE PROTEST OF THIS ISSUE IS TIMELY. TURNING TO THE MERITS OF THE PROTESTER'S COMPLAINT, THE PARTIES AGREE THAT USE OF OFFSET PRINTING PROCESSES DOES DISTORT THE QUALITY OF THE ORIGINAL IMPACT PRINTED CHARACTERS. SSA MAINTAINS, HOWEVER, THAT ALL SYSTEMS ARE AFFECTED ADVERSELY, AND ARGUES THAT OTHER GRAY TONES ARE CREATED SO THAT EQUIPMENT SUCH AS THE PROTESTER PROPOSES SHOULD STILL OUTPERFORM ITS COMPETITION IN A REPRESENTATIVE MANNER.

THE PROTESTER ARGUES HOWEVER THAT THE GRAYS CREATED BY OFFSET PRINTING ARE SPURIOUS. MOREOVER, IT ASSERTS THAT:

"SSA FAILS TO REALIZE THAT THE ACT OF OFFSET REPRODUCTION HAS VIRTUALLY NULLIFIED ITS EFFORTS AT CREATING TEST VARIETY. IN OFFSET REPRODUCTION (1) RIBBON INK COLOR DIFFERENCES ARE ELIMINATED; (2) TYPOGRAPHICAL ERRORS CORRECTED BY THE TYPIST ARE INACCURATELY REPRODUCED; (3) FONT CHARACTERISTICS SUCH AS LINE WIDTH AND PROPORTION ARE CHANGED; AND (4) IMPACT VARIATIONS DUE TO POOR ALIGNMENT OF PRINTING DEVICES OR AGE AND WEAR OF RIBBONS ARE DROPPED OUT."

HOWEVER, SSA ALSO POINTS OUT THAT IT WENT TO GREAT EFFORT TO ATTEMPT TO CONSTRUCT A TEST DECK WHICH IT BELIEVED PROVIDED A FAIR TEST. THE INITIAL OCD - THE ONE THE PROTESTER FIRST REFUSED TO TAKE - WAS CANCELLED BECAUSE SSA'S TECHNICAL ADVISER CONCLUDED THAT THE DEGREE OF DIFFICULTY REFLECTED IN THE ORIGINAL DECKS WAS NOT EQUAL AMONG OFFERORS. THE TEST DECKS FINALLY RUN BY ALL OF THE OFFERORS (INCLUDING THE PROTESTER) WERE PREPARED BY VISUALLY SCREENING PAGES FOR UNIFORMITY AND SELECTING THEM TO ASSURE AS BEST SSA BELIEVES POSSIBLE THAT THE DIFFICULTY OF READING THE DECKS WAS EVENLY BALANCED.

MOREOVER, SSA INDICATES THAT IT REJECTED USE OF ORIGINAL (AS DISTINGUISHED FROM PRINTED OR COPIED) MATERIALS, BECAUSE THE RESOURCE REQUIREMENTS (PRIMARILY PERSONNEL NEEDS) AND LOGISTICAL PROBLEMS WHICH WOULD HAVE TO BE MET TO KEY AND VERIFY THE DATA WERE CONSIDERED EXCESSIVE AND BECAUSE DETERIORATION OF TYPEWRITER RIBBONS, OPERATOR FATIGUE, AND SIMILAR FACTS WOULD HAVE REQUIRED CONSIDERABLE QUALITY CONTROL TO ASSURE THAT EACH OFFEROR'S TEST DECK CONTAINED A REPRESENTATIVE DISTRIBUTION OF DATA CHARACTERISTICS. SSA WAS PARTICULARLY CONCERNED, AS WE HAVE NOTED, THAT ONE OR MORE VENDORS MIGHT LATER CLAIM THAT THE DATA IT WAS REQUIRED TO USE WAS NOT REPRESENTATIVE. INSTEAD, SSA PRODUCED THE DECKS FROM APPROXIMATELY 500 ORIGINAL DOCUMENTS INCLUDING WHAT IT DETERMINED WAS A REPRESENTATIVE SAMPLE OF THE 26 MOST PREDOMINANT PRINTING FONTS. IT THEN USED OFFSET PROCESSES TO PRODUCE THE FULL DECK BY VARYING PRINTING CONDITIONS.

AS BOTH SIDES IN THIS DISPUTE RECOGNIZE, THIS OFFICE WILL NOT SUBSTITUTE ITS JUDGMENT FOR THAT OF PROCURING OFFICIALS IN MATTERS INVOLVING THE EXERCISE OF THEIR DISCRETION. IN SUCH CASES, WE WILL SUSTAIN A PROTEST ONLY IF IT IS SHOWN THAT THE ACTIONS TAKEN ARE NOT REASONABLY FOUNDED AND THUS, RESULTED IN AN ABUSE OF DISCRETION. IN THIS REGARD, IT DOES NOT MATTER THAT WE MIGHT OURSELVES HAVE ACTED DIFFERENTLY, HAD THE DECISION BEEN OURS TO MAKE. IT WOULD NOT MATTER, EITHER, IF THE PROCURING ACTIVITY'S ACTIONS SIMPLY APPEAR MISTAKEN IN RETROSPECT, UNLESS THE AGENCY WERE TO HOLD TO ITS ERROR ARBITRARILY. THE EXERCISE OF DISCRETION BY ITS NATURE INCLUDES THE POSSIBILITY THAT THE ACTION TAKEN MAY BE WRONG.

WE AGREE WITH THE PROTESTER THAT USE OF OFFSET PRINTING CAN BE EXPECTED TO VARY FONT CHARACTERISTICS AND THAT REGARDING ITS PROCESS, THOSE GRAYS CREATED INCIDENT TO AN OFFSET PRINTING PROCESS SHOULD BE CONSIDERED TO BE EXTRANEOUS. USE OF OFFSET PRINTING PROCESSES CAN BE EXPECTED TO RESULT IN DISTORTION OF THE ABSOLUTE ABILITY OF OFFERORS TO PERFORM SSA'S REQUIREMENTS. WE FIND OURSELVES LESS CONVICED THAN IS SSA THAT THE DIFFERENCES WILL NOT RESULT IN AT LEAST SOME DISTORTION OF THE OFFERORS' COMPARATIVE POSITION. PERHAPS IT WOULD HAVE BEEN WISER HAD SSA STRUCTURED THE OCD SO AS TO AT LEAST INCLUDE A CONTROL SAMPLE OF DOCUMENTS WITH TYPEWRITTEN INFORMATION FROM WHICH IT COULD HAVE STATISTICALLY EVALUATED THE VALIDITY OF ITS TESTING ASSUMPTIONS.

WE RECOGNIZE THAT THE PARTIES' POSITION REFLECT THEIR RESPECTIVE VIEWS REGARDING WHETHER THE SCOPE OF SSA'S INFORMATION PROCESSING NEEDS SHOULD REFLECT 70 PERCENT OR 85 PERCENT OF ITS TOTAL REQUIREMENTS. IF SSA IS CORRECT IN ITS BELIEF THAT ALL OF THE CONTENDERS' EQUIPMENT SHOULD BE EXPECTED TO READ WELL WHEN ONLY THE EASIEST 70 PERCENT OF MATERIAL PROCURED IS SCANNED, THE RELATIVE IMPORTANCE OF ERROR RATE CALCULATIONS IS REDUCED IN COMPARISON TO THE IMPORTANCE OF EQUIPMENT AND MANPOWER LEVELS AND SIMILAR CONSIDERATIONS. THEREFORE, ALTHOUGH SSA MIGHT HAVE PROCEEDED DIFFERENTLY, IT IS OUR CONCLUSION THAT IT ACTED REASONABLY, GIVEN ALL OF THE CIRCUMSTANCES INVOLVED.

THIS PROTEST ALSO CONCERNS A NUMBER OF INCIDENTAL MATTERS REGARDING CHANGES MADE BY AMENDMENT 5, FOR PURPOSES OF THE SECOND OCD. HOWEVER, THESE QUESTIONS HAVE NOT BEEN PURSUED BY THE PROTESTER.

ACCORDINGLY, THE PROTEST IS DISMISSED IN PART AND DENIED IN REMAINING PART.

GAO Contacts

Kenneth E. Patton
Managing Associate General Counsel
Office of the General Counsel

Edward (Ed) Goldstein
Managing Associate General Counsel
Office of the General Counsel

Media Inquiries

Sarah Kaczmarek
Managing Director
Office of Public Affairs

Public Inquiries