Skip to main content

B-225357.2, MAR 10, 1987, 87-1 CPD 270

B-225357.2 Mar 10, 1987
Jump To:
Skip to Highlights

Highlights

AN AGENCY'S DETERMINATION OF WHETHER PROPOSAL IS IN THE COMPETITIVE RANGE IS A MATTER OF AGENCY DISCRETION WHICH THE GENERAL ACCOUNTING OFFICE WILL NOT DISTURB ABSENT A CLEAR SHOWING THAT AGENCY'S DETERMINATION LACKED A REASONABLE BASIS. PROPOSAL WHICH WAS REASONABLY FOUND TO BE SO DEFICIENT IN ITS TECHNICAL ADEQUACY. THAT MAJOR REVISIONS WOULD HAVE BEEN REQUIRED TO MAKE IT ACCEPTABLE WAS PROPERLY EXCLUDED FROM THE COMPETITIVE RANGE. PROTEST THAT AGENCY IMPROPERLY EVALUATED PROPOSAL ON BASIS OF LEVELS OF AGENCY STANDARDS NOT STATED IN THE REQUEST FOR PROPOSALS (RFP) IS DENIED SINCE THERE IS NO REQUIREMENT THAT RFP PRECISELY SPECIFY ACCEPTABLE LEVEL OF EFFORT AND MANNER OF PERFORMANCE WHERE SOLICITATION CALLS FOR A PERFORMANCE ORIENTED RESEARCH AND ANALYSIS PROJECT WHICH.

View Decision

B-225357.2, MAR 10, 1987, 87-1 CPD 270

PROCUREMENT - COMPETITIVE NEGOTIATION - OFFERS - COMPETITIVE RANGES - EXCLUSION - ADMINISTRATIVE DISCRETION DIGEST: 1. AN AGENCY'S DETERMINATION OF WHETHER PROPOSAL IS IN THE COMPETITIVE RANGE IS A MATTER OF AGENCY DISCRETION WHICH THE GENERAL ACCOUNTING OFFICE WILL NOT DISTURB ABSENT A CLEAR SHOWING THAT AGENCY'S DETERMINATION LACKED A REASONABLE BASIS. PROPOSAL WHICH WAS REASONABLY FOUND TO BE SO DEFICIENT IN ITS TECHNICAL ADEQUACY-- THE MOST HEAVILY WEIGHTED EVALUATION CRITERION-- THAT MAJOR REVISIONS WOULD HAVE BEEN REQUIRED TO MAKE IT ACCEPTABLE WAS PROPERLY EXCLUDED FROM THE COMPETITIVE RANGE. PROCUREMENT - COMPETITIVE NEGOTIATION - OFFERS - EVALUATION - ADMINISTRATIVE DISCRETION PROCUREMENT - COMPETITIVE NEGOTIATION - OFFERS - EVALUATION ERRORS - ALLEGATION SUBSTANTIATION 2. PROTEST THAT AGENCY IMPROPERLY EVALUATED PROPOSAL ON BASIS OF LEVELS OF AGENCY STANDARDS NOT STATED IN THE REQUEST FOR PROPOSALS (RFP) IS DENIED SINCE THERE IS NO REQUIREMENT THAT RFP PRECISELY SPECIFY ACCEPTABLE LEVEL OF EFFORT AND MANNER OF PERFORMANCE WHERE SOLICITATION CALLS FOR A PERFORMANCE ORIENTED RESEARCH AND ANALYSIS PROJECT WHICH, BY ITS NATURE, LENDS ITSELF TO INDIVIDUAL STANDARDS OF QUALITY AND COMPETITIVENESS.

PERSONNEL DECISIONS RESEARCH INSTITUTE:

PERSONNEL DECISIONS RESEARCH INSTITUTE (PDRI) PROTESTS THE EXCLUSION OF ITS PROPOSALS (RFP) NO. MDA903-86-R-0214 ISSUED BY THE DEPARTMENT OF THE ARMY, DEFENSE SUPPLY SERVICE - WASHINGTON (DSS-W). THE RFP WAS FOR A COST -PLUS-FIXED-FEE CONTRACT FOR A JOB ANALYSIS STUDY OF ARMY MILITARY AND CIVILIAN COMPTROLLER JOBS. PDRI CONTENDS THAT ITS PROPOSAL WAS IMPROPERLY AND UNFAIRLY EVALUATED. THE PROTESTER REQUESTS RELIEF IN THE FORM OF THE TERMINATION OF THE CONTRACT AND AWARD INSTEAD TO PDRI AND/OR AWARD OF THE COSTS OF PREPARING ITS PROPOSAL AND FILING AND PURSUING THIS PROTEST. ALTERNATIVELY, PDRI REQUESTS THAT THE PROCUREMENT BE RECOMPETED UNDER A SOLICITATION REVISED FOR CLARITY.

WE DENY THE PROTEST.

UNDER THE TERMS OF THE RFP, TECHNICAL PROPOSALS WERE TO BE EVALUATED IN THE FOLLOWING THREE CATEGORIES, IN DESCENDING ORDER OF RELATIVE IMPORTANCE: TECHNICAL ADEQUACY, PERSONNEL QUALIFICATIONS, AND ORGANIZATIONAL EXPERIENCE. THE RFP DOES NOT STATE THE MAXIMUM POINT SCORES TO BE ALLOCATED FOR EACH OF THE THREE AREAS OF EVALUATION; HOWEVER, IT DOES STATE THAT TECHNICAL ADEQUACY IS THE MOST IMPORTANT FACTOR, BUT PERSONNEL QUALIFICATIONS AND ORGANIZATIONAL EXPERIENCE TOGETHER WILL RECEIVE GREATER WEIGHT THAN TECHNICAL ADEQUACY. THE SOLICITATION ALSO PROVIDES THAT COST PROPOSALS WILL BE SUBORDINATE TO TECHNICAL CONSIDERATIONS AND EVALUATED SEPARATELY FROM TECHNICAL PROPOSALS BUT WILL NOT BE ASSIGNED NUMERICAL WEIGHTS.

ACCORDING TO THE RFP STATEMENT OF WORK, THE ANALYSIS OF MILITARY AND CIVILIAN JOBS IN THE COMPTROLLER FIELD IN THE ARMY IS THE OBJECTIVE OF THE WORK CALLED FOR BY THIS SOLICITATION. THE RFP SETS FORTH AS ONE OF THE ESSENTIAL PURPOSES OF THE STUDY THE EXAMINATION OF WHETHER, AS THOUGHT BY THE ARMY, ITS CIVILIAN AND MILITARY COMPTROLLERS PERFORM ESSENTIALLY IDENTICAL WORK AND, THEREFORE, THAT THE CIVILIAN AND MILITARY COMPTROLLER JOBS ARE INTERCHANGEABLE. THE RFP FURTHER STATES THAT DUE TO FUNDING CONSIDERATIONS THE BASIC JOB ANALYSIS CONTRACT MUST BE FOR CIVILIAN PERSONNEL, WITH AN OPTION FOR THE JOB ANALYSIS OF MILITARY PERSONNEL-- THAT OPTION TO BE EXERCISED WITHIN 1 YEAR OF AWARD OF THE BASIC CONTRACT, ALTHOUGH THE OPTION WOULD "PROBABLY RUN CONCURRENTLY WITH THE BASIC CONTRACT." IN VIEW OF THE SOMEWHAT COMPLEX VARIABLES NECESSITATED BY THESE FUNDING CONSIDERATIONS, THE STATEMENT OF WORK STATES THAT PROPOSALS ARE TO "DESCRIBE HOW THE WORK WOULD BE ACCOMPLISHED IF THE TWO JOB ANALYSES (CIVILIAN AND MILITARY) OCCUR CONCURRENTLY OR CONSECUTIVELY" AND PROVIDE THE COST OF A COMBINED OFFER, I.E., FOR THE BASIC CONTRACT AND THE OPTION, IN ADDITION TO THE COST OF SEPARATE OFFERS FOR THE BASIC CONTRACT TO BE FOLLOWED BY THE OPTION CONTRACT. TO FACILITATE THE PROVISION OF THIS INFORMATION, THE STATEMENT OF WORK PROVIDED DATA ON THE GEOGRAPHICAL LOCATIONS OF CIVILIAN AND MILITARY COMPTROLLERS AS WELL AS THEIR JOB SERIES AND RANKS.

THE WORK REQUIRED BY THE RFP INCLUDED DETERMINING THE TASKS TO BE INCLUDED IN THE COMPTROLLER JOB INVENTORY AND INTERVIEWING A SAMPLING OF JOB INCUMBENTS. THE SAMPLING SIZE AND MAKEUP WERE "TO BE DETERMINED BY THE CONTRACTOR ... SUBJECT TO THE ARMY CIVILIAN PERSONNEL CENTER CIVPERCEN APPROVAL." USING THE GEOGRAPHIC DISTRIBUTION FOR THE CIVILIAN AND MILITARY COMPTROLLER POPULATIONS PROVIDED IN THE SOLICITATION, OFFERORS WERE TO DEVELOP A PRELIMINARY SAMPLING PLAN TO BE INCLUDED IN THEIR PROPOSALS.

OF THE 11 PROPOSALS RECEIVED IN RESPONSE TO THE SOLICITATION, THE THREE MEMBER EVALUATION PANEL DETERMINED THAT TWO PROPOSALS WERE IN THE COMPETITIVE RANGE. THE EVALUATION PANEL REJECTED THE PROPOSAL OF PDRI, THE THIRD RANKED OFFEROR, AS TECHNICALLY UNACCEPTABLE, HAVING NO REASONABLE CHANCE FOR AWARD, BECAUSE MAJOR REVISIONS WOULD HAVE BEEN NECESSARY TO MAKE THE PROPOSAL ACCEPTABLE. THE AGENCY MADE AWARD TO THE HIGHEST-RANKED OFFEROR, WHOSE PROPOSED COST WAS LESS THAN THAT OF THE SECOND-RANKED FIRM.

SUBSEQUENT TO THE AGENCY DEBRIEFING CONCERNING THE TECHNICAL EVALUATION OF ITS PROPOSAL, PDRI FILED ITS PROTEST ALLEGING, GENERALLY, THAT: (1) CERTAIN CRITERIA AGAINST WHICH ITS PROPOSAL WAS EVALUATED WERE "EITHER STATED UNCLEARLY AND VAGUELY OR NOT SPECIFIED AT ALL IN THE SOLICITATION" AND, THEREFORE, ITS PROPOSAL MAY NOT HAVE BEEN EVALUATED BY THE SAME CRITERIA AS WERE ALL OTHER PROPOSALS; (2) UNKNOWN TO IT UNTIL THE DEBRIEFING, CERTAIN EVALUATION CRITERIA UNDER WHICH ITS PROPOSAL WAS EXCLUDED WERE UNREASONABLE OR UNDULY RESTRICTIVE; AND (3) SOME OF THE EVALUATION PANEL'S CONCLUSIONS REGARDING PDRI'S PROPOSALS WERE "SIMPLY UNTRUE."

IT APPEARS TO US THAT PDRI WAS PROVIDED A RATHER THOROUGH DEBRIEFING OF THE WEAKNESSES THE PANEL PERCEIVED IN ITS PROPOSAL IN ALL THREE RATING CATEGORIES, AND PDRI HAS TAKEN ISSUE WITH EVERY ONE OF THEM. THE POINTS OF CONTENTION ARE NUMEROUS, VARY WIDELY IN THEIR SIGNIFICANCE, SOMETIMES REFLECT MISUNDERSTANDINGS OF THE EVALUATORS' CONCLUSIONS, IN SOME INSTANCES CONSIST OF DIFFERENCES IN OPINION AMONG PROFESSIONALS AS TO WHAT CONSTITUTES "GOOD SCIENCE," AND WERE NOT ALWAYS REBUTTED BY PDRI FOLLOWING ITS RECEIPT OF THE AGENCY REPORT. WE HAVE CONSIDERED ALL THESE CONTENTIONS AND CONCLUDE THAT, ON THE WHOLE, THEY DO NOT SHOW PDRI TO HAVE BEEN THE VICTIM OF ARBITRARY CONDUCT, AND THAT IT IS NOT NECESSARY FOR US TO DISCUSS ALL OF THEM IN ORDER TO ARRIVE AT A DECISION, PARTICULARLY WITH REGARD TO THE "PERSONNEL QUALIFICATIONS" AND "ORGANIZATIONAL EXPERIENCE" CRITERIA AS TO WHICH PDRI'S POINT SCORE RANKING PLACED IT IN THE MIDST OF THE TWO FIRMS IN THE COMPETITIVE RANGE, NOR EVEN WITH REGARD TO MOST DEFICIENCIES IDENTIFIED BY THE EVALUATION PANEL UNDER THE SINGLE MOST IMPORTANT CRITERION-- "TECHNICAL ADEQUACY"-- BECAUSE TWO FUNDAMENTAL DEFICIENCIES IN PDRI'S PROPOSAL RELATED TO THAT CRITERION ARE DISPOSITIVE OF THE PROTEST. THESE DEFICIENCIES CONCERN THE PROTESTER'S FAILURE TO PROVIDE THE COMPUTER HARDWARE AND SOFTWARE RESOURCES NECESSARY TO PERFORMANCE OF THE CONTRACT AND DEFICIENCIES IN ITS INTERVIEW SAMPLING PLAN.

COMPUTER HARDWARE AND SOFTWARE

THE RFP REQUIRED THAT THE CONTRACTOR "PROVIDE COMPUTER HARDWARE AND SOFTWARE" TO ANALYZE JOB ANALYSIS RESPONSES USING THE TASK INVENTORY/COMPREHENSIVE OCCUPATIONAL DATA ANALYSIS PACKAGE (CODAP) METHODOLOGY. IN ITS OFFER PDRI STATED THAT IT:

"... HAD MADE TENTATIVE ARRANGEMENTS WITH THE U.S. AIR FORCE HUMAN RESOURCES LABORATORY (AFHRL) TO USE THEIR COMPUTER SYSTEM WITH THE LATEST VERSION OF CODAP. WE WILL, HOWEVER, REQUIRE AN OFFICIAL COMMUNICATION FROM CIVPERCEN TO AFHRL REQUESTING THIS USE."

IN THE ARMY'S VIEW, PDRI'S PROPOSAL FAILED TO MEET THE RFP REQUIREMENT THAT THE CONTRACTOR WAS TO PROVIDE COMPUTER HARDWARE AND SOFTWARE SINCE IT PROPOSED TO USE GOVERNMENT RESOURCES-- SPECIFICALLY, AIR FORCE HARDWARE AND SOFTWARE-- OVER WHICH, ACCORDING TO THE ARMY, NEITHER PDRI NOR THE ARMY HAS CONTROL. THE EVALUATION PANEL, THEREFORE, CONCLUDED THAT THE PROTESTER'S PROPOSAL WAS "NOT TECHNICALLY ADEQUATE" IN THIS MAJOR RESPECT.

IN ITS PROTEST, PDRI STATES IT WAS INFORMED AT THE DEBRIEFING THAT ITS FAILURE TO PROVIDE HARDWARE AND SOFTWARE BUT TO USE GOVERNMENT EQUIPMENT TO CONDUCT THE CODAP ANALYSIS WAS THE MAJOR WEAKNESS OF ITS PROPOSAL, AND THAT "THE REVIEWER IMPLIED STRONGLY THAT THE CONTRACTOR WAS TO OWN THE HARDWARE AND SOFTWARE." THE PROTESTER ARGUES THAT THE ALLEGED REQUIREMENT THAT THE OFFEROR "OWN" THE HARDWARE AND SOFTWARE IT PROPOSES TO USE WAS, ON ONE HAND, NOT CLEARLY STATED IN THE SOLICITATION, AND ON THE OTHER HAND, WAS AN UNREASONABLE AND UNNECESSARILY RESTRICTIVE REQUIREMENT. THE PROTESTER DEFENDS THE ARRANGEMENT IT PROPOSED FOR THE USE OF COMPUTER EQUIPMENT BY STATING THAT IN A TELEPHONE CONVERSATION WITH AN AFHRL OFFICIAL PRIOR TO SUBMITTING ITS PROPOSAL, IT RECEIVED THE AGREEMENT OF THAT OFFICIAL THAT PDRI WOULD BE GIVEN ACCESS TO THE AFHRL SYSTEM "UPON WRITTEN REQUEST FROM CIVPERCEN." THE PROTESTER FURTHER DEFENDS ITS PROPOSED ARRANGEMENT BY MAINTAINING, IN ESSENCE, THAT AFHRL'S COMPUTER IS THE ONLY COMPUTER ON WHICH THE MOST RECENT VERSION OF CODAP (ASC II) IS CURRENTLY INSTALLED AND THAT THE USE OF THIS MOST RECENT VERSION IS NECESSARY IN ORDER TO ACHIEVE THE "BEST POSSIBLE DATA ANALYSIS."

THE AGENCY FIRST UNEQUIVOCALLY DENIES THAT PDRI WAS PENALIZED OR FAULTED BECAUSE IT DID NOT OWN THE COMPUTER EQUIPMENT OR SOFTWARE IT PROPOSED TO USE, AND DENIES THAT ITS ESTABLISHED AN UNDISCLOSED RESTRICTIVE OR ADDITIONAL OWNERSHIP REQUIREMENT. RATHER, THE ARMY EMPHASIZES THAT THE RFP CONTAINED THE MORE GENERAL REQUIREMENT THAT THE CONTRACTOR "PROVIDE" THESE RESOURCES. (THAT THIS WAS THE ARMY'S INTERPRETATION IS SUPPORTED BY OUR IN CAMERA EXAMINATION OF THE PROPOSALS INCLUDED IN THE COMPETITIVE RANGE, WHICH INDICATES THAT THOSE OFFERORS DO NOT OWN THE NONGOVERNMENT COMPUTER EQUIPMENT THEY PROPOSED TO USE.) IN RESPONDING TO PDRI'S ARGUMENTS, THE CHAIRMAN OF THE EVALUATION PANEL INDICATED THAT DURING THE EVALUATION OF THE PROTESTER'S PROPOSAL HE INQUIRED OF THE AFHRL OFFICIAL, WHO PDRI SAYS AGREED TO ITS PROPOSED USE OF AIR FORCE EQUIPMENT, AS TO WHETHER THE FIRM HAD "REQUESTED FREE COMPUTER SUPPORT AS STATED IN THEIR ... PROPOSAL." ACCORDING TO THE PANEL CHAIRMAN, THE OFFICIAL RESPONDED IN THE NEGATIVE. /1/ THE AGENCY FURTHER STATES THAT MANY COMPUTERS ARE CAPABLE OF RUNNING CODAP AND MANY UNIVERSITIES AND PRIVATE COMPANIES ARE EXPERIENCED IN USING THAT PROGRAM. THE ARMY ALSO INDICATES IT WAS AWARE OF THE AFHRL COMPUTER EQUIPMENT AND ITS CAPABILITY PRIOR TO THE ISSUANCE OF THE SOLICITATION AND THAT IT CONSIDERED AND REJECTED THE PROSPECT OF PROVIDING GOVERNMENT COMPUTER EQUIPMENT FOR THE PROJECT. FOR THAT REASON, THE AFHRL RESOURCES WERE NOT LISTED IN THE RFP AS AMONG THE GOVERNMENT- FURNISHED SUPPLIES OR SERVICES TO BE PROVIDED TO THE CONTRACTOR.

THE TECHNICAL EVALUATION PANEL THUS DETERMINED THAT THE PROTESTER FAILED TO COMPLY WITH THE REQUIREMENT THAT IT PROVIDE THE COMPUTER EQUIPMENT TO RUN CODAP AND STATES THAT THIS DEFICIENCY WAS "SO SERIOUS THAT IT ALMOST CONSIDERED PDRI'S PROPOSAL NONRESPONSIVE FOR THIS REASON ALONE." PDRI MAINTAINS THAT "THE AGENCY ALLEGES THIS TECHNICAL DEFICIENCY AS A STRATEGY FOR UNFAIRLY AND UNREASONABLY ASSERTING THAT PDRI 'HAD NO REASONABLE CHANCE FOR AWARD.'" THE PROTESTER FURTHER EXPRESSES THE VIEW THAT THE ARMY HAS CHOSEN FOR AWARD A PROPOSAL WHICH OFFERS A TECHNICALLY INFERIOR DATA ANALYSIS, WHEREAS IT PROPOSED THE BEST POSSIBLE DATA ANALYSIS PROCEDURE.

SINCE THE CONTRACTING AGENCY IS RESPONSIBLE FOR DEFINING ITS NEEDS AND THE BEST METHODS OF ACCOMMODATING THEM, THE EVALUATION OF PROPOSALS AND THE DETERMINATION OF COMPETITIVE RANGE IS A MATTER PRIMARILY WITHIN THE DISCRETION OF THE PROCURING AGENCY, AND WE WILL NOT OVERTURN THAT DETERMINATION IN THE ABSENCE OF CLEAR EVIDENCE THAT IT HAD NO REASONABLE BASIS OR IS IN VIOLATION OF FEDERAL PROCUREMENT LAWS OR REGULATIONS. PROFFITT AND FOWLER, B-219917, NOV. 19, 1985, 85-2 CPD PARA. 566 AT 4; MAXIMA CORP., B-220072, DEC. 24, 1985, 85-2 CPD PARA. 708 AT 3. OFFERS WHICH ARE TECHNICALLY UNACCEPTABLE AS SUBMITTED AND WOULD REQUIRE MAJOR REVISIONS TO BE MADE ACCEPTABLE SHOULD NOT BE INCLUDED IN THE COMPETITIVE RANGE. HARBERT INTERNATIONAL, INC., B-222472, JULY 15, 1986, 86-2 CPD PARA. 67.

THE EVALUATION SCORE SHEETS INDICATE THAT BECAUSE PDRI ASSUMED THAT THE ARMY WOULD REQUEST THE USE OF AIR FORCE EQUIPMENT AND OFFERED NO ALTERNATIVE FOR THE PROVISION OF COMPUTER EQUIPMENT, THE PROPOSAL, IN THE FIRST INSTANCE, WAS ADJUDGED TECHNICALLY UNACCEPTABLE IN THE MANNER IT PROPOSED TO CARRY OUT THE JOB ANALYSIS, PER SE.

ONE DISPOSITIVE CONSIDERATION IN THE DETERMINATION AS TO WHETHER THE ARMY'S EVALUATION WAS REASONABLE WITH RESPECT TO THIS ASPECT OF THE PROTESTER'S PROPOSAL IS THE FACT THAT PDRI'S PROPOSAL TO "PROVIDE" THE COMPUTER EQUIPMENT WAS, AS IT SPECIFICALLY STATED, CONDITIONED UPON THE ARMY'S REQUEST FOR THE USE OF AIR FORCE EQUIPMENT. IN VIEW OF SUCH A CONDITIONAL OFFER WITHOUT AN ALTERNATIVE MEANS OF PROVIDING THE EQUIPMENT, AS REQUIRED BY THE RFP, WE FIND THAT THE PROPOSAL DID NOT CONFORM TO THAT REQUIREMENT. MOREOVER, WHILE THE PROTESTER MAINTAINS THAT IT RECEIVED AN ORAL CONDITIONAL AGREEMENT FROM AN AFHRL OFFICIAL, IT PRODUCED NO EVIDENCE EITHER TO THE CONTRACTING AGENCY OR TO OUR OFFICE THAT AFHRL DID, IN FACT, AGREE TO THE ARRANGEMENT IT PROPOSED. THUS, EXCLUSION OF THE PROPOSAL FROM THE COMPETITIVE RANGE ON THIS BASIS WAS NOT IMPROPER SINCE IT WOULD HAVE REQUIRED MAJOR REVISIONS TO BE MADE ACCEPTABLE IN THIS AREA. FORECASTING INTERNATIONAL LTD., B-220622.3, APR. 1, 1986, 86-1 CPD PARA. 306; MICRONESIA MEDIA DISTRIBUTORS, INC., B-222443, JULY 16, 1986, 86-2 CPD PARA. 72 AT 3.

PDRI ALSO IMPLIES THAT IT HAD A REASONABLE EXPECTATION THAT THE ARMY WOULD FIND ITS PROPOSED COMPUTER HARDWARE AND SOFTWARE ARRANGEMENT ACCEPTABLE BECAUSE THE AGENCY PREVIOUSLY ACCEPTED A SIMILAR PROPOSAL IN WHICH THE PROTESTER WAS AWARDED A CONTRACT FOR A JOB ANALYSIS USING CODAP. THE ARMY INDICATES, HOWEVER, THAT IN THE SITUATION TO WHICH PDRI REFERS, THE ARMY CHOSE NOT TO REQUEST THE USE OF AFHRL EQUIPMENT, BUT BECAUSE THE PROPOSAL CONTAINED AN ALTERNATIVE MEANS OF PROVIDING THE EQUIPMENT REQUIRED, PDRI WAS AWARDED THE CONTRACT. THE ARMY FURTHER STATES (AND PDRI UNPERSUASIVELY CONTESTS THE ARMY'S ACCOUNT) THAT ITS PREVIOUS REQUEST FOR THE USE OF AFHRL EQUIPMENT IN CONNECTION WITH THAT PRIOR CONTRACT WAS AUTHORIZED ONLY WHEN, DURING THE PERFORMANCE OF THE CONTRACT, THE AGENCY LEARNED THAT-- CONTRARY TO ITS PROPOSAL-- PDRI HAD FAILED TO BUDGET PROPERLY FOR THE ALTERNATIVE PLAN (WHICH THE ARMY HAD ACCEPTED), AND THUS THE TIMELY EXECUTION OF THE CONTRACT WAS JEOPARDIZED. NOTWITHSTANDING THE VALIDITY OR MERITS OF THESE ARGUMENTS AND DEFENSES RAISED BY THE PROTESTER AND THE AGENCY, THE FACT THAT THE AGENCY PREVIOUSLY AUTHORIZED OR COOPERATED WITH A PROPOSED PERFORMANCE PROCEDURE WHICH WAS NOT CONTEMPLATED BY THE RFP IN SOME OTHER PROCUREMENT DOES NOT JUSTIFY A PROPOSAL OFFERING LESS THAN WHAT THE SUBJECT RFP REQUIRES, BECAUSE EACH PROCUREMENT MUST STAND UPON ITS OWN PROPRIETIES. SEE DISCOUNT MACHINERY & EQUIPMENT, INC., B-223547, AUG. 29, 1986, 86-2 CPD PARA. 242. HERE, THE RFP EXPRESSLY STATED THAT IT WAS THE CONTRACTOR'S RESPONSIBILITY TO "PROVIDE" THE COMPUTER RESOURCES NECESSARY FOR THE PERFORMANCE OF THIS CONTRACT, WHICH RESOURCES, THE RECORD SHOWS, ARE READILY AVAILABLE IN THE COMMERCIAL MARKETPLACE. PDRI DID NOT OFFER TO PROVIDE THESE RESOURCES. IT PROPOSED THAT THE GOVERNMENT PROVIDE THESE RESOURCES, APPARENTLY AT NO COST TO PDRI BUT NOT AT NO COST TO THE GOVERNMENT. THERE MAY BE INSTANCES WHERE THE GOVERNMENT DECIDES THAT IT IS IN ITS INTEREST TO A CONTRACTOR AND ADVISES ALL COMPETITORS FOR THE CONTRACT OF THAT FACT IN THE SOLICITATION. THIS IS NOT SUCH A CASE; IN FACT, THE RECORD SHOWS THAT THE ARMY CONSIDERED AND REJECTED THAT ALTERNATIVE BEFORE THE RFP WAS ISSUED. UNDER THESE CIRCUMSTANCES, WE DO NOT THINK IT UNREASONABLE FOR THE EVALUATION PANEL TO HAVE CONCLUDED THAT IT WAS A MAJOR DEFICIENCY IN PDRI'S PROPOSAL FOR IT NOT TO HAVE INCLUDED THE PROVISION OF THE COMPUTER RESOURCES ESSENTIAL TO THE PERFORMANCE OF THE CONTRACT.

IF PDRI BELIEVED (AS IT SEEM TO SUGGEST) THAT THE ONLY METHOD OF PROVIDING THE GOVERNMENT'S ACTUAL NEEDS WAS THROUGH AFHRL, THAT JUDGMENT WOULD NECESSITATE THE CONCLUSION THAT THE RFP WAS DEFECTIVE IN THAT IT DID NOT PROVIDE FOR, OR REQUIRE SUCH USE-- A MATTER WHICH, IN ORDER TO HAVE BEEN TIMELY CONSIDERED, SHOULD HAVE BEEN RAISED PRIOR TO THE CLOSING DATE FOR RECEIPT OF PROPOSALS. 4 C.F.R. SEC. 21.2(A)(1) (1986).

INTERVIEW SAMPLING PLAN

PDRI PROPOSED AN INTERVIEW SAMPLE CONSISTING OF APPROXIMATELY 250 CIVILIAN AND 50 MILITARY PERSONNEL OUT OF A TOTAL OF 9,119 AND 1,217, RESPECTIVELY; IT PROPOSED TO CONDUCT INTERVIEWS AT FIVE CIVILIAN LOCATIONS AND ONE MILITARY LOCATION OUT OF 168 TOTAL TOTAL LOCATIONS. /2/ THE ARMY STATES THAT PDRI'S SAMPLING PLAN FOR THE SELECTION OF EMPLOYEES TO BE INTERVIEWED TO DEVELOP THE TASK INVENTORY WAS UNACCEPTABLE BECAUSE THE NUMBER OF INTERVIEWS PROPOSED WAS INSUFFICIENT TO COVER ADEQUATELY THE COMPTROLLER FUNCTION AND, THEREFORE, TO ACCOMPLISH THE RFP OBJECTIVE.

IN ITS PROTEST PDRI STATES THAT IT LEARNED AT THE DEBRIEFING THAT THE EVALUATION PANEL CONSIDERED ITS SAMPLING PLAN DEFICIENT BECAUSE (1) "ANY PROPOSED INTERVIEW SAMPLE OF LESS THAN 500 INDIVIDUALS WAS CONSIDERED TOO SMALL DUE TO THE 'COMPLEX' NATURE OF THE CAREER PROGRAM"; (2) A PROPOSAL TO VISIT LESS THAN 20 SITES WAS UNACCEPTABLE; AND (3) PDRI DID NOT PROPOSE TO VISIT "MAJOR COMMANDS" THAT WERE CONSIDERED TO BE REQUIRED INTERVIEW LOCATIONS. THE PROTESTER EXPRESSES THE VIEW THAT IF THERE WERE FIXED THRESHOLDS OF 500 INTERVIEWEES AND 20 INTERVIEW SITES, THAT INFORMATION SHOULD HAVE BEEN STATED IN THE SOLICITATION SO THAT ALL OFFERORS WOULD BE "ON AN EQUAL FOOTING WITH RESPECT TO THESE FIXED REQUIREMENTS AND THUS MAKE THE AWARD MORE COMPETITIVE."

THE ARMY STATES THAT IT HAD AN ESTIMATE OF THE NUMBER OF SAMPLES WHICH IT CONSIDERED NECESSARY FOR A PROPERLY DESIGNED TASK INVENTORY, BUT THAT ITS ESTIMATE WAS NOT DESIGNED TO CONSTITUTE A REQUIRED NUMBER OF INTERVIEW SITES TO BE VISITED IN ORDER TO SUCCESSFULLY ACCOMPLISH THE RFP OBJECTIVE. THE AGENCY FURTHER STATES THAT IT DID NOT OBJECT TO THE NUMBER OF INTERVIEW SITES PROPOSED BY PDRI, BUT IT OBJECTED TO THE SELECTION OF SITES PDRI PROPOSED BECAUSE THE SELECTION SHOWED THAT THE PROTESTER DID NOT CONSIDER RELEVANT VARIABLES SUCH AS "OVERSEAS SITES WHERE MOST OF THE MILITARY POPULATION RESIDES, ... SMALL COMPTROLLER SHOPS WHERE WORK MAY BE PERFORMED QUITE DIFFERENTLY" THAN AT LARGER SHOPS, AND OTHER LOCATIONS WHICH WOULD ASSURE THE INCLUSION OF CERTAIN COMPTROLLER JOBS EXCLUDED IN PDRI'S PROPOSED SAMPLING. ALTHOUGH THE PROTESTER ARGUES THAT IT CHOSE INTERVIEW SITES ON THE BASIS OF LOCATIONS HAVING THE LARGEST CONCENTRATION OF COMPTROLLERS, THE ARMY STATES THAT THE BASIS OF ITS EVALUATION OF THE SAMPLING PLAN WAS WHETHER THE PLAN ADEQUATELY COVERED THE STUDY POPULATION SET FORTH IN THE RFP.

FURTHER, IN REGARD TO THE ADEQUACY OF ITS SAMPLING PLAN, PDRI MAKES THE SIMILAR CONTENTION THAT IT WAS UNFAIR OF THE EVALUATION TEAM TO NEGATIVELY EVALUATE ITS PROPOSAL ON THE BASIS THAT PDRI DID NOT INCLUDE ANY EUROPEAN LOCATIONS AND TWO SPECIFIC CORPS OF ENGINEERS LOCATIONS AMONG THE SITES IT WOULD TWO SPECIFIC CORPS OF ENGINEERS LOCATIONS AMONG THE SITES IT WOULD VISIT, BECAUSE, IF OFFERS WERE TO BE JUDGED ON THE BASIS OF WHETHER THEY PROPOSED TRAVEL TO SPECIFIC LOCATIONS, INCLUDING EUROPEAN SITES, THAT SHOULD HAVE BEEN STATED IN THE RFP.

THE ARMY MAINTAINS THAT THE DESIRABILITY OF CONDUCTING INTERVIEWS AT EUROPEAN SITES WAS IMPLICIT IN THE RFP BY VIRTUE OF THE EXCLUSION FROM THIS SOLICITATION OF A PROHIBITION AGAINST TRAVEL OUTSIDE THE CONTINENTAL UNITED STATES AND THE INCLUSION OF INFORMATION SHOWING A MAJOR PRESENCE OF MILITARY FINANCE OFFICERS (MILITARY OCCUPATIONAL SPECIALITY (MOS) 44S) AND COMPTROLLERS (MOS 45S) IN EUROPE.

WHERE, AS IN THIS CASE, A SOLICITATION CALLS FOR THE CONDUCT OF A PERFORMANCE ORIENTED RESEARCH AND ANALYSIS PROJECT, THERE IS NO REQUIREMENT THAT THE MANNER IN WHICH OFFERORS ARE TO FULFILL THE REQUIRED TASKS BE SPECIFIED IN THE RFP, AND THE FACT THAT AN OFFEROR'S RESPONSE IN CERTAIN AREAS OF EVALUATION DIFFERS FROM THE EXPECTATIONS OF THE CONTRACTING AGENCY DOES NOT RENDER THE RFP'S REQUIREMENTS VAGUE OR AMBIGUOUS. SEE DIGITAL RADIO CORP., B-216441, MAY 10, 1985, 85-1 CPD PARA. 526 AT 6. ACCORDINGLY, WE DO NOT CONSIDER THAT THE RFP WAS DEFECTIVE FOR FAILURE TO CONTAIN INFORMATION NECESSARY FOR THE PROPER PREPARATION OF PROPOSALS ON THE BASIS THAT IT DID NOT SPECIFY NUMERICAL CRITERIA THAT WOULD BE DEEMED TO CONSTITUTE SUCCESSFUL INTERVIEW SAMPLING PROPOSALS. SEE INTELCOM SUPPORT SERVICES, B-222547, AUG. 1, 1986, 86-2 CPD PARA. 135 AT 4.

THE PROTESTER FURTHER ARGUES CONCERNING ITS SAMPLING PLAN THAT IT PROPOSED TO INTERVIEW A RELATIVELY LOW NUMBER OF MILITARY COMPTROLLERS BECAUSE OF THE STATEMENT IN THE RFP STATEMENT OF WORK THAT "THE DEPARTMENT OF THE ARMY BELIEVES THAT ITS CIVILIAN AND MILITARY COMPTROLLERS PERFORM ESSENTIALLY IDENTICAL WORK." ALTHOUGH THIS STATEMENT DOES APPEAR IN THE RFP STATEMENT OF WORK, THE SOLICITATION ALSO SPECIFICALLY PROVIDES THAT ONE ESSENTIAL PURPOSE OF THE COMPTROLLER JOB ANALYSIS IS TO DETERMINE WHETHER, AS THOUGHT BY THE ARMY, THE MILITARY AND CIVILIAN COMPTROLLER JOBS ARE, IN FACT, INTERCHANGEABLE. IN OTHER WORDS, WHEN THE ARMY'S STATEMENT OF ITS VIEW CONCERNING MILITARY AND CIVILIAN JOBS IS READ IN CONTEXT, IT IS CLEAR THAT THE QUESTION OF THE INTERCHANGEABILITY OF THE JOBS IS ONE MATTER TO BE RESOLVED THROUGH THE STUDY SOLICITED. THUS, TO THE EXTENT THAT PDRI LIMITED THE NUMBER OF MILITARY COMPTROLLERS IT PROPOSED TO INTERVIEW BECAUSE OF THE REFERENCED STATEMENT, ITS PROPOSED INTERVIEW SAMPLING WAS BASED ON A MISINTERPRETATION OF THE STATEMENT OF WORK, THE MEANING OF WHICH SHOULD HAVE BEEN CLEAR FROM THE CONTEXT OF THE STATEMENT, AS WELL AS FROM ALL THE INFORMATION IN THE RFP, TAKEN AS A WHOLE.

CONCLUSION

IT IS APPARENT THAT THE MOST SERIOUS DEFICIENCIES IN THE PROTESTER'S PROPOSAL WERE IN THE CATEGORY OF TECHNICAL ADEQUACY, THE MOST HEAVILY WEIGHTED OF THE THREE EVALUATION CATEGORIES. IN VIEW OF THE TECHNICAL DEFICIENCIES DISCUSSED, AS WELL AS THE NATURE AND EXTENT THEREOF, WE AGREE WITH THE AGENCY'S DETERMINATION THAT THE PROPOSAL WOULD HAVE REQUIRED MAJOR REVISIONS IN ORDER TO BE MADE TECHNICALLY ACCEPTABLE. OUR REVIEW OF THE RECORD PROVIDES NO BASIS TO CONCLUDE THAT, AS A GENERAL MATTER, THE ARMY'S EXCLUSION OF PDRI'S PROPOSAL FROM THE COMPETITIVE RANGE WAS ARBITRARY OR UNREASONABLE, SINCE IN OUR VIEW, THE TECHNICAL INADEQUACIES ALONE SUPPORT THE AGENCY'S DECISION.

THE PROTEST IS DENIED. IN VIEW OF THIS RESULT, THE PROTESTER'S CLAIMS FOR THE COSTS OF PREPARING ITS PROPOSAL AND FILING THE PROTEST ARE DENIED. FORECASTING INTERNATIONAL LTD., B-220622.3, SUPRA, 86-1 CPD PARA. 306 AT 7.

/1/ WHILE THE PROTESTER DOES NOT STATE THAT IT REQUESTED "FREE" COMPUTER SUPPORT OF AFHRL, WE NOTE THAT IN ITS COMMENTS ON THE AGENCY REPORT ON THIS POINT, THE PROTESTER ONLY REAFFIRMS THAT IT RECEIVED THE AFHRL OFFICIAL'S AGREEMENT BY TELEPHONE AND OFFERS NO PROOF OF ANY KIND OF COMMITMENT FOR THE USE OF THE AIR FORCE'S COMPUTER EQUIPMENT. THE PROTESTER ALSO STATES THAT IT IS A NOT-FOR-PROFIT ORGANIZATION, AND ASSERTS THAT AS SUCH, IT MAY UNDER CERTAIN AFHRL PROVISIONS USE THE COMPUTER EQUIPMENT IN QUESTION WITHOUT CHARGE.

/2/ THE PROTESTER PROPOSED TO INTERVIEW AT ONE MILITARY SITE IF THE OPTION FOR THE MILITARY COMPTROLLER JOB ANALYSIS WERE EXERCISED CONCURRENTLY WITH THAT FOR CIVILIAN PERSONNEL.

GAO Contacts

Office of Public Affairs