Skip to main content

B-191877, NOVEMBER 15, 1978

B-191877 Nov 15, 1978
Jump To:
Skip to Highlights

Highlights

WHERE AGENCY BELIEVES INDIVIDUAL EVALUATORS' SCORE SHEETS ARE EXEMPT FROM DISCLOSURE UNDER FREEDOM OF INFORMATION ACT (FOIA). PROTESTER'S RECOURSE IS TO PURSUE DISCLOSURE REMEDY UNDER FOIA. GAO FUNCTION IS NOT TO EVALUATE PROPOSALS. TO EXAMINE RECORD AND CONSIDER WHETHER AGENCY'S DETERMINATIONS HAVE BEEN CLEARLY SHOWN TO HAVE NO REASONABLE BASIS. 3. DO NOT ESTABLISH THAT EVALUATION RESULTS CLEARLY HAVE NO REASONABLE BASIS. 4. CONSIDERING "LEGAL BACKGROUND" AS UNDISCLOSED TECHNICAL EVALUATION SUBSCRIPTION IS NOT IMPROPER WHERE RFP CONTAINED EVALUATION CRITERION DEALING WITH OFFEROR EXPERIENCE IN DEVELOPING NATIONAL AND REGIONAL PROGRAMS. RFP SPECIFICATIONS INDICATE LEGAL CONSIDERATIONS ARE PERTINENT TO CONTRACT WORK.

View Decision

B-191877, NOVEMBER 15, 1978

DIGEST: 1. WHERE AGENCY BELIEVES INDIVIDUAL EVALUATORS' SCORE SHEETS ARE EXEMPT FROM DISCLOSURE UNDER FREEDOM OF INFORMATION ACT (FOIA), PROTESTER'S RECOURSE IS TO PURSUE DISCLOSURE REMEDY UNDER FOIA. GAO HAS NO AUTHORITY UNDER FOIA TO DETERMINE WHAT INFORMATION GOVERNMENT AGENCIES MUST DISCLOSE. 2. CONSIDERING OBJECTIONS TO TECHNICAL EVALUATION OF PROPOSALS, GAO FUNCTION IS NOT TO EVALUATE PROPOSALS, BUT TO EXAMINE RECORD AND CONSIDER WHETHER AGENCY'S DETERMINATIONS HAVE BEEN CLEARLY SHOWN TO HAVE NO REASONABLE BASIS. 3. WHERE RFP STATED REQUIREMENTS FOR TECHNICAL ASSISTANCE CONTRACT IN GENERAL TERMS, OBJECTIONS TO TECHNICAL EVALUATION-- PREMISED ESSENTIALLY ON PROTESTER'S SUBSTITUTION OF ITS JUDGMENT FOR AGENCY'S AS TO RELATIVE MERITS OF DIFFERENT TECHNICAL APPROACHES-- DO NOT ESTABLISH THAT EVALUATION RESULTS CLEARLY HAVE NO REASONABLE BASIS. 4. CONSIDERING "LEGAL BACKGROUND" AS UNDISCLOSED TECHNICAL EVALUATION SUBSCRIPTION IS NOT IMPROPER WHERE RFP CONTAINED EVALUATION CRITERION DEALING WITH OFFEROR EXPERIENCE IN DEVELOPING NATIONAL AND REGIONAL PROGRAMS, AND RFP SPECIFICATIONS INDICATE LEGAL CONSIDERATIONS ARE PERTINENT TO CONTRACT WORK-- DRAFTING SECTIONS OF FOREST SERVICE MANUAL. 5. ALLEGATION THAT NO NEGOTIATIONS WERE CONDUCTED IS WITHOUT MERIT. AGENCY'S REQUEST FOR AND RECEIPT OF "CLARIFICATIONS" INVOLVING MATERIAL CHANGES IN OFFERORS' PROPOSALS CONSTITUTE DISCUSSIONS, AND DISCUSSIONS ARE SYNONYMOUS WITH NEGOTIATIONS. 6. ALLEGATION AFTER AWARD THAT PROTESTER SHOULD NOT HAVE HAD TO FURNISH CLARIFICATIONS OF ITS PROPOSAL REQUESTED BY AGENCY DURING DISCUSSIONS IS UNTIMELY. PROTESTER WAS ON CONSTRUCTIVE NOTICE OF BASIS FOR PROTEST AT CLOSING DATE FOR RECEIPT OF BEST AND FINAL OFFERS AND DID NOT PROTEST WITHIN 10 WORKING DAYS THEREAFTER. 7. CONTENTIONS OF IMPROPER ACTIONS BY AGENCY TECHNICAL EVALUATORS IN EVALUATION AND SCORING OF REVISED TECHNICAL PROPOSALS ARE WHOLLY SPECULATIVE WHERE WRITTEN RECORD DOES NOT CLEARLY DEMONSTRATE EXISTENCE OF UNFAIR OR IMPROPER CONDUCT. 8. WHERE FIRM-FIXED-PRICE PROPOSALS ARE SUBMITTED AND PRICE NEGOTIATED IS BASED ON ADEQUATE PRICE COMPETITION, THERE IS NO LONGER ANY REQUIREMENT THAT AGENCY CONDUCT COST ANALYSIS OF COST OR PRICING DATA SUBMITTED WITH PROPOSALS.

(TABLE OF CONTENTS OMITTED)

INTASA HAS PROTESTED THE AWARD OF A CONTRACT TO THE CENTER FOR NATURAL AREAS (CNA) BY THE U.S. FOREST SERVICE, DEPARTMENT OF AGRICULTURE, UNDER REQUEST FOR PROPOSALS (RFP) NO. 4-78. MAINLY, THE PROTESTER CHALLENGES THE TECHNICAL AND PRICE EVALUATIONS CONDUCTED BY THE FOREST SERVICE.

I. BACKGROUND

THE RFP WAS ISSUED JANUARY 6, 1978, AND CONTEMPLATED THE AWARD OF A FIRM- FIXED-PRICE CONTRACT FOR A "LAND MANAGEMENT PLANNING MANUAL." CLAUSE 10 OF THE RFP, "AWARD OF CONTRACT," AS AMENDED, PROVIDED IN PERTINENT PART:

"EVALUATION OF PROPOSALS.

"THE PROPOSALS WILL BE RANKED ON THE BASIS OF TOTAL SCORES FROM THE TECHNICAL AND PRICE EVALUATION.

"THE TECHNICAL PORTION OF THE PROPOSALS WILL BE GIVEN A SUBJECTIVE REVIEW AND ANALYSIS BY A CONTRACT REVIEW BOARD, WHO WILL NOT HAVE ACCESS TO THE PRICE PROPOSALS. THE BOARD WILL RATE EACH TECHNICAL PROPOSAL ON THE BASIS OF ITS TECHNICAL MERIT. TECHNICAL PROPOSALS WILL BE RATED ON THE FACTORS LISTED BELOW. A POINT SYSTEM WILL BE USED. THE MAXIMUM POSSIBLE POINT VALUES FOR EACH FACTOR ARE:

"CRITERIA MAXIMUM POINTS

"1. TECHNICAL PROPOSAL

"A. EXPERIENCE WITH DEVELOPMENT 10 OF BROAD SCALE NATIONAL AND REGIONAL PROGRAMS (WRC LEVEL B, EPA 208, ETC.)

"B. FAMILIARITY WITH LAND MANAGEMENT 10 PLANNING CONCEPTS AND PROCESSES AS ARE APPLICABLE TO DEVELOPMENT OF LAND MANAGEMENT PLANS FOR USE IN THE FOREST SERVICE.

"C. PROFESSIONAL QUALIFICATIONS OF 10 PERSONNEL AND AVAILABILITY OF SUCH PERSONNEL.

"D. PROPOSAL FOR ACCOMPLISHING 30 REQUIRED TASKS AND PROVIDING FINAL PRODUCTS.

"E. QUALIFICATIONS OF THE BIDDER 10 INCLUDING BUSINESS STABILITY.

"2. PRICE 30

"THE LOWEST PRICED PROPOSAL OF THOSE PROPOSALS WITHIN THE TECHNICALLY ACCEPTABLE RANGE WILL BE ASSIGNED THE MAXIMUM RATING OF 30 POINTS. EACH OF THE REMAINING PROPOSALS WILL BE DIVIDED INTO THE LOWEST PRICE, YIELDING AN INDEX VALUED BETWEEN 0 AND 1. THESE INDEXES WILL BE MULTIPLIED BY THE MAXIMUM PRICING WEIGHT OF 30, RESULTING IN PRORATED RATINGS FOR EACH PRICE PROPOSAL."

SEVEN PROPOSALS WERE RECEIVED AND EVALUATED, WITH THE PROTESTER AND CNA RANKED AS FOLLOWS: (TABLE OMITTED)

THE TOTAL SCORES RANGED FROM A LOW OF 50.56 TO A HIGH OF 77.80, WHILE THE RANGE IN OFFERED PRICES WAS $85,985 TO $212,123. THE GOVERNMENT ESTIMATE FOR THE WORK WAS $101,027.

THE FOREST SERVICE DECIDED TO CONDUCT DISCUSSIONS WITH ALL SEVEN OFFERORS. AFTER DISCUSSIONS, BEST AND FINAL OFFERS WERE SUBMITTED AND EVALUATED: (TABLE OMITTED)

THE TOTAL SCORES OF THE BEST AND FINAL OFFERS RANGED FROM 54.18 TO CNA'S 86.6, WHILE THE RANGE IN PRICES WAS FROM CNA'S LOW OF $94,464.33 TO A HIGH OF $179,578. AWARD WAS MADE TO CNA IN APRIL 1978, AND INTASA THEN PROTESTED.

II. PROCEDURAL ISSUES

INTASA HAS REPEATEDLY REQUESTED THAT IT BE FURNISHED WITH COPIES OF THE INDIVIDUAL EVALUATION WORKSHEETS PREPARED BY THE FOREST SERVICE'S TECHNICAL EVALUATORS. THE CONTRACTING OFFICER'S LETTER TO THE PROTESTER DATED APRIL 27, 1978, FURNISHED SOME DATA CONCERNING THE EVALUATION BUT REFUSED TO RELEASE THIS INFORMATION, STATING THAT IT WAS BEING WITHHELD PURSUANT TO EXEMPTION 5 OF THE FREEDOM OF INFORMATION ACT (FOIA), 5 U.S.C. 552(B)(5)(1976). INTASA PROTESTS THIS DECISION.

OUR OFFICE HAS NO AUTHORITY UNDER FOIA TO DETERMINE WHAT INFORMATION MUST BE DISCLOSED BY GOVERNMENT AGENCIES. WHILE INFORMATION IN AN AGENCY REPORT WHICH THE AGENCY BELIEVES IS EXEMPT FROM DISCLOSURE UNDER FOIA WILL BE CONSIDERED BY OUR OFFICE IN REACHING A DECISION ON THE MERITS OF THE PROTEST, WE WILL NOT DISCLOSE IT OUTSIDE THE GOVERNMENT. THE PROTESTER'S RECOURSE IN SUCH SITUATIONS IS TO PURSUE ITS DISCLOSURE REMEDY UNDER THE PROCEDURES PROVIDED BY FOIA. SEE NATIONAL MOTORS CORPORATION ET AL., B-189933, JUNE 7, 1978, 78-1 CPD 416; UNIVERSITY OF NEW ORLEANS, B-184194, MAY 26, 1978, 78-1 CPD 401; CORBETTA CONSTRUCTION COMPANY OF ILLINOIS, INC., 55 COMP.GEN. 972, 990-991 (1976), 76-1 CPD 240.

INTASA HAS ALSO COMPLAINED THAT THE CONTRACTING OFFICER ATTEMPTED TO PERSUADE IT TO DROP ITS PROTEST BY ASKING WHAT IT HAD TO GAIN FROM THE PROTEST. ASSUMING THIS TO BE TRUE, WE ARE IN ANY EVENT UNAWARE OF ANYTHING IN FEDERAL PROCUREMENT REGULATIONS (FPR) SEC. 1-2.407-8 ("PROTESTS AGAINST AWARD") (2D ED., FPR AMEND. 139, JANUARY 1975) WHICH PRECLUDED THE CONTRACTING OFFICER FROM TAKING SUCH ACTION.

FURTHER, INTASA COMPLAINS OF A SLOW RESPONSE BY THE CONTRACTING OFFICER TO ITS REQUESTS FOR INFORMATION, SINCE IT REQUESTED A COPY OF CNA'S PROPOSAL ON APRIL 17, 1978, BUT DID NOT RECEIVE IT UNTIL MAY 1, 1978. ARE UNAWARE OF ANY LAW OR REGULATION WHICH WAS CONTRAVENED IN THIS REGARD, AND AGAIN SEE NO IMPROPRIETY IN THE CONTRACTING OFFICER'S ACTIONS.

FINALLY, THE PROTESTER ALLEGES THAT THE CONTRACTING OFFICER RUSHED TO EXECUTE THE CONTRACT WITH CNA KNOWING THAT THE PROTEST PROCESS WOULD TAKE SO LONG THAT INTASA WOULD BE PRECLUDED FROM OBTAINING EFFECTIVE RELIEF. THIS UNSUBSTANTIATED ALLEGATION IS MOOTED BY THE FACT THAT THIS DECISION DENIES INTASA'S PROTEST.

III. SCOPE OF GAO REVIEW

INTASA HAS REQUESTED THAT OUR OFFICE CONDUCT AN "INDEPENDENT TECHNICAL REVIEW" OF THE PROPOSALS. THE PROTESTER BELIEVES THAT WHILE IT HAS STATED ITS CASE SO THAT A REASONABLE PROFESSIONAL COULD READILY SEE THE DIFFERENCE BETWEEN ITS PROPOSAL AND CNA'S, AN INDEPENDENT TECHNICAL REVIEW IS THE ONLY WAY TO RESOLVE THE MATTER.

WE BELIEVE THESE STATEMENTS REFLECT A MISUNDERSTANDING BY THE PROTESTER OF THE SCOPE OF OUR REVIEW OF ISSUES CONCERNING THE TECHNICAL EVALUATION OF PROPOSALS IN A NEGOTIATED PROCUREMENT. THE FOLLOWING STATEMENT FROM JULIE RESEARCH LABORATORIES, INC., 55 COMP.GEN. 374, 382 (1975), 75-2 CPD 232, IS PERTINENT:

"JRL HAS INDICATED THAT A 'THOROUGH TECHNICAL REVIEW' BY OUR OFFICE OF THE POINTS AT ISSUE IS NECESSARY. AT THE OUTSET, IT IS IMPORTANT TO NOTE THAT OUR OFFICE HAS NEVER TAKEN THE POSITION THAT WE WILL SUBSTITUTE OUR JUDGMENT FOR THE AGENCY'S-- BY CONDUCTING TECHNICAL EVALUATIONS OF PROPOSALS AND RENDERING DETERMINATIONS AS TO THEIR ACCEPTABILITY-- SIMPLY BECAUSE A PROTEST AGAINST THE TECHNICAL EVALUATION HAS BEEN FILED. ON THE CONTRARY, OUR DECISIONS HAVE REPEATEDLY EMPHASIZED THAT THESE FUNCTIONS ARE PRIMARILY THE RESPONSIBILITY OF THE CONTRACTING AGENCY, WHOSE JUDGMENT WILL NOT BE DISTURBED BY OUR OFFICE UNLESS CLEARLY SHOWN TO BE WITHOUT A REASONABLE BASIS. SEE, IN THIS REGARD, AUSTIN ELECTRONICS, 54 COMP.GEN. 60 (1974), 74-2 CPD 61; 52 COMP.GEN. 393, 399-400 (1972); 52 ID. 382, 385 (1972)."

AS INDICATED IN JULIE RESEARCH LABORATORIES AND MANY OTHER DECISIONS OF OUR OFFICE, OUR FUNCTION IS NOT TO EVALUATE THE PROPOSALS DE NOVO AND MAKE OUR OWN DETERMINATIONS AS TO THEIR ACCEPTABILITY OR RELATIVE MERITS. RATHER, WE APPLY A STANDARD OF REVIEW TO DETERMINATIONS WHICH ARE THE RESPONSIBILITY OF, AND WHICH HAVE ALREADY BEEN ARRIVED AT BY, THE CONTRACTING AGENCY. SEE JOSEPH LEGAT ARCHITECTS, B-187160, DECEMBER 13, 1977, 77-2 CPD 458, AND DECISIONS CITED THEREIN. IN APPLYING THE STANDARD OF REVIEW WE LOOK TO THE WRITTEN RECORD SUBMITTED BY THE PARTIES INVOLVED. HOUSTON FILMS, INC. (RECONSIDERATION), B-184402, JUNE 16, 1976, 76-1 CPD 380. SINCE THE AGENCY OFFICIALS ARE ACCORDED A CONSIDERABLE RANGE OF JUDGMENT AND DISCRETION IN CARRYING OUT THE EVALUATION, THEIR DETERMINATIONS ARE ENTITLED TO GREAT WEIGHT. JOSEPH LEGAT ARCHITECTS, SUPRA; OLIN CORPORATION, ENERGY SYSTEMS OPERATIONS, B-187311, JANUARY 27, 1977, 77-1 CPD 68. THE FACT THAT THE PROTESTER DISAGREES WITH THE AGENCY'S EVALUATION DOES NOT IN ITSELF ESTABLISH THAT THE EVALUATION CLEARLY HAD NO REASONABLE BASIS. HOUSTON FILMS, INC., SUPRA. IN ADDITION,

"* * * WE WILL NOT SUBSTITUTE OUR JUDGMENT FOR THAT OF THE COGNIZANT CONTRACTING OFFICIALS BY MAKING AN INDEPENDENT JUDGMENT AS TO THE PRECISE NUMERICAL SCORES WHICH SHOULD HAVE BEEN ASSIGNED EACH PROPOSAL * * *."

PRC COMPUTER CENTER, INC. ET AL., 55 COMP.GEN. 60, 68-69 (1975), 75-2 CPD 35.

THE SAME PRINCIPLE APPLIES WITH RESPECT TO THE SELECTION OF WHICH OF SEVERAL PROPOSALS IS MOST ADVANTAGEOUS TO THE GOVERNMENT. SOURCE SELECTION IS THE RESPONSIBILITY OF THE CONTRACTING AGENCY. OUR FUNCTION IS NOT TO MAKE THE SELECTION, BUT TO DECIDE WHETHER THE AGENCY'S SELECTION HAS BEEN SHOWN TO BE LEGALLY OBJECTIONABLE. SEE B-178220, DECEMBER 10, 1973; EPSCO, INCORPORATED, B-183816, NOVEMBER 21, 1975, 75-2 CPD 338.

IV. SPECIFIC OBJECTIONS TO TECHNICAL EVALUATION

THE PROTESTER HAS RAISED A NUMBER OF OBJECTIONS TO THE TECHNICAL EVALUATION WHICH MAY BE SUMMARIZED, ALONG WITH THE FOREST SERVICE'S RESPONSES, AS FOLLOWS:

PROTESTER: THE RFP (PAGE 12, CLAUSE 2.(DD)) REQUIRED THAT THE TECHNICAL PROPOSAL CONTAIN A DETAILED PLAN COVERING, AMONG OTHER THINGS, THE MECHANISM FOR COOPERATION BETWEEN THE TASK FORCE AND OTHER FOREST SERVICE PERSONNEL IN DEVELOPING MANUAL MATERIAL AND THE TECHNICAL APPROACH FOR DEVELOPING THE CONTENT OF THE MANUAL SECTIONS. IN OTHER WORDS, THE RFP ASKED FOR A DETAILED PLAN WHICH COULD BE IMPLEMENTED IMMEDIATELY WITH ONLY MINOR MODIFICATIONS. CNA'S TECHNICAL PROPOSAL (PAGE 4.1) STATED THAT ITS "WORK PLAN" EMPHASIZED INTERACTION WITH FOREST SERVICE PERSONNEL AND INDICATED THAT IT WAS TOO EARLY TO IDENTIFY HOW THIS INTERACTION WOULD BE INTEGRATED WITH DEVELOPMENT OF THE PRODUCTS TO BE PROVIDED UNDER THE CONTRACT. CNA INDICATED THAT IT WOULD DEVELOP A WORK PLAN UNDER THE CONTRACT, WHEREAS THIS WAS WHAT THE RFP CALLED FOR IN THE PROPOSALS.

FOREST SERVICE:

"THE DIFFERENCE IN APPROACH BY CNA AND INTASA IS A CRUCIAL POINT. THE OVERALL TECHNICAL APPROACH PROPOSED BY CNA INVOLVED A CLOSE WORKING RELATIONSHIP BETWEEN THE CONTRACTOR AND THE FOREST SERVICE AT ALL LEVELS. INTASA VIEWS THE CONTRACTOR'S ROLE MUCH DIFFERENTLY. INTASA PROPOSED 3 OR 4 DAY WORKSHOPS WHERE THEY (INTASA) ARE IN CHARGE, PRESENT A PROGRAM, OBTAIN FEEDBACK, AND PREPARE A FINAL PRODUCT. THE FOREST SERVICE SEES THE CONTRACTOR IN A SUPPORTIVE ROLE. ALTHOUGH INTASA UNDERSTANDS THE PROBLEM, THEIR APPROACH IS LESS DESIRABLE."

P: CNA'S APPROACH IS NOT SENSITIVE TO WEAKNESSES WITHIN THE FOREST SERVICE, WHEREAS INTASA METICULOUSLY SPELLED OUT ITS APPROACH SO AS TO MAXIMIZE THE EFFECTIVENESS OF AN "OUTSIDER" WORKING WITHIN A FEDERAL AGENCY.

FS:

"THE CONTRACT REQUIRES THE CONTRACTOR TO ASSIST IN THE RESOLUTION OF CERTAIN ISSUES (I.E., INFORMATION SYSTEMS, ANALYSIS REQUIREMENTS, LINKAGES, PLANNING PRODUCTION). HE IS NOT REQUIRED TO IDENTIFY AND RESOLVE ALL ISSUES RELATING TO IMPLEMENTATION OF THE * * * REGULATIONS; THE FOREST SERVICE ITSELF WILL DEAL WITH THESE ISSUES."

P: CNA'S ESTIMATE OF 28.5 MAN-DAYS TO DOCUMENT CROSS-REFERENCES IN MATERIAL IS NOT EXPLAINED, NOR DOES CNA RECOGNIZE THE NEED FOR AN INCREMENTAL APPROACH TO MANUAL DEVELOPMENT. INTASA'S PROPOSED 6 HOURS OF WORK ON CROSS-REFERENCING IS MORE REASONABLE.

FS: INTASA'S PROPOSED 6 HOURS IS SERIOUSLY QUESTIONABLE. MORE WORK IS REQUIRED THAN COULD BE PROVIDED IN 6 HOURS.

P: CNA'S PROPOSAL DOES NOT EXPLICITLY ADDRESS HOW TESTING OF CONCEPTS WILL BE CONDUCTED, WHILE INTASA'S DOES.

FS: WHILE INTASA'S PROPOSED PROCEDURE (TESTING WORKSHOPS) IS NOT "WRONG," THE QUESTION IS WHETHER THIS IS THE BEST WAY TO HANDLE THE PROBLEM. CONCEPTS SHOULD BE TESTED IN AN OPERATIONAL SETTING.

P: CNA'S PROPOSAL IS LESS THAN CLEAR IN REGARD TO ITS TIME ALLOCATION TABLE, AND AS TO HOW THE SEVEN-PERSON CNA TEAM WILL FUNCTION, AND IN OTHER AREAS.

FS: THE FOREST SERVICE IS SATISFIED THAT CNA SATISFACTORILY SPELLED OUT ITS ROLE IN THIS EFFORT.

P: AN APPROACH PROVIDING EFFECTIVE INTERNAL REVIEW IS ESSENTIAL AND WAS PROPOSED BY INTASA, WHEREAS CNA PROPOSED LESS EFFECTIVE OUTSIDE REVIEW.

FS: BOTH INTERNAL AND EXTERNAL REVIEW ARE NEEDED. INTASA COVERED INTERNAL REVIEW BUT DID NOT RECOMMEND ANY EXTERNAL REVIEW. INTERNAL ACCEPTANCE OF MANUAL MATERIAL IS A PROBLEM WITH WHICH THE FOREST SERVICE MUST DEAL.

P: THE CNA PROPOSAL CONTAINS MUCH SUPERFLUOUS MATERIAL. FOR EXAMPLE, IF THE FOREST SERVICE CONSIDERED LETTERS OF RECOMMENDATION TO BE DESIRABLE, IT SHOULD HAVE SO INDICATED IN THE RFP EVALUATION CRITERIA.

FS: PROPOSALS WERE NOT EVALUATED ON THE BASIS OF THE NUMBER OF PAGES. LETTERS OF COMMENDATION WERE CONSIDERED UNDER THE EVALUATION CRITERION REGARDING EXPERIENCE IN DEVELOPMENT OF BROAD SCALE NATIONAL AND REGIONAL PROGRAMS.

P: CNA'S PROPOSAL MYSTERIOUSLY INDICATES THAT IT NOW HAS A SOLE SOURCE CONTRACT TO REVIEW DOCUMENTS TO BE PRODUCED UNDER THE CURRENT CONTRACT.

FS: THIS ASSUMPTION ON THE PROTESTER'S PART IS NOT RELEVANT TO THE PRESENT PROTEST.

CNA: THE REFERENCED SOLE-SOURCE CONTRACT DOES NOT INVOLVE REVIEW OF DOCUMENTS DEVELOPED UNDER THE PROTESTED CONTRACT.

P: CNA'S STYLE OF PROPOSAL WRITING MAKES IT SOMETIME DIFFICULT TO UNDERSTAND AND CNA'S INTENTION.

FS: AS THE PROTESTER ITSELF NOTES, PROPOSAL WRITING STYLE IS A HIGHLY PERSONALIZED AFFAIR.

THE FOREST SERVICE'S VIEW IS THAT THE PROTEST IN THIS RESPECT IS BASED ESSENTIALLY ON A BIASED AND SELF-SERVING EVALUATION BY INTASA OF ITS OWN AND CNA'S PROPOSALS. THE AGENCY INDICATES THAT THE PROTESTER, READING INTO THE RFP ITS OWN INTERPRETATION OF THE GOVERNMENT'S INTENTION, IS IN EFFECT ATTEMPTING TO SUBSTITUTE ITS OWN JUDGMENT FOR THAT OF THE FOREST SERVICE TECHNICAL EVALUATORS. WE BELIEVE THIS VIEW IS SUPPORTED BY THE PROTESTER'S OWN STATEMENTS WHICH RECOGNIZE THAT THE RFP REQUIREMENTS WERE STATED IN GENERAL TERMS. AS INTASA STATES, "DETAILS OF THE PROBLEM FOR WHICH THE FOREST SERVICE SOUGHT OUTSIDE TECHNICAL ASSISTANCE ARE NOT OBVIOUS FROM READING RFP-4-78. * * * (THE PRIMARY MESSAGE IN THE RFP IS THAT THE GOVERNMENT WANTS TO HIRE 'PROFESSIONAL TIME' FROM OUTSIDE CONTRACTORS; PRODUCT AND INTERACTION REQUIREMENTS ARE ONLY VAGUELY DESCRIBED."

HAVING REVIEWED THE PROTESTER'S CONTENTIONS AND THE FOREST SERVICE'S RESPONSES, WE SEE NO GROUNDS TO OBJECT TO THE EVALUATION. THE FACT THAT THE PROTESTER DISAGREES WITH THE CONCLUSIONS REACHED BY THE AGENCY IS NOT ENOUGH TO SHOW THAT THOSE CONCLUSIONS CLEARLY HAVE NO REASONABLE BASIS.

V. UNDISCLOSED EVALUATION SUBCRITERION

INTASA, IN ITS MAY 5, 1978, LETTER OF PROTEST, ALSO CONTENDED THAT CNA'S KEY INVESTIGATORS ARE NOT EMINENTLY QUALIFIED BECAUSE THEIR BACKGROUND IS LEGAL, WHEREAS INTASA'S PERSONNEL HAVE QUALIFICATIONS RELATING TO SYSTEMS THE FOREST SERVICE'S REPORT ANSWERED:

"WE STRONGLY EMPHASIZE THAT LEGAL AUTHORITY AND POLICY SUPPORT IS AN EXTREMELY IMPORTANT ASPECT OF THE REQUIRED EXPERIENCE. IT IS OBVIOUS THAT CNA DOES, IN FACT, HAVE MORE EXPERIENCE IN THE AREA WHERE EXPERIENCE IS VITAL TO THE SUCCESS OF THE COMPLETION OF CONTRACT REQUIREMENTS."

THE PROTESTER COMMENTS THAT A TECHNICAL EVALUATION MUST BE CONDUCTED IN STRICT CONFORMITY WITH THE RFP EVALUATION CRITERIA, AND NOTES THAT NOWHERE IN THE RFP DID THE FOREST SERVICE STATE THAT LEGAL BACKGROUND WOULD BE AN EVALUATION CRITERION. INTASA BELIEVES THIS AFTER-THE-FACT ADOPTION OF A NEW EVALUATION CRITERION IS IN VIOLATION OF APPLICABLE PROCUREMENT REGULATIONS. FURTHER, INTASA POINTS OUT THAT THE FOREST SERVICE HAS REVEALED THAT IT APPLIED THREE UNDISCLOSED SUBCRITERIA UNDER THE EVALUATION CRITERION, "EXPERIENCE WITH DEVELOPMENT OF BROAD SCALE NATIONAL AND REGIONAL PROGRAMS." THESE WERE (1) EXPERIENCE IN METHODOLOGY DEVELOPMENT; (2) EXPERIENCE RELATED TO DIRECTION AND GUIDANCE, AND (3) EXAMPLES OF PERFORMANCE IN ACTION CASE STUDIES. THE PROTESTER BELIEVES THESE THREE SUBCRITERIA RELATE TO POLICY AND PLANNING, NOT TO LEGAL BACKGROUND.

THE RULE IN REGARD TO EVALUATION SUBCRITERIA IS THAT EACH SUBCRITERION NEED NOT BE DISCLOSED IN THE RFP, SO LONG AS THE RFP INFORMS OFFERORS OF THE BASIC CRITERIA, AND ANY SUBCRITERIA USED BY THE AGENCY IN THE ACTUAL EVALUATION ARE MERELY "DEFINITELY OF" THE BASIC CRITERIA. GENASYS CORPORATION, 56 COMP.GEN. 835, 840 (1977), 77-2 CPD 60. STATED ANOTHER WAY, "THERE IS GENERALLY N REQUIREMENT FOR AN AGENCY TO LIST SUBCRITERIA WHEN THEY ARE REASONABLY RELATED TO OR ENCOMPASSED BY THE MAIN EVALUATION CRITERION." NORTH AMERICAN TELEPHONE ASSOCIATION, B-187239, DECEMBER 15, 1976, 76-2 CPD 495. IN GENASYS, FOR EXAMPLE, WHERE ONE OF THE RFP'S BASIC CRITERIA WAS "RELATED CORPORATE EXPERIENCE" IN A PROCUREMENT OF AN ACCOUNTING SYSTEM TO BE IMPLEMENTED VIA A TELE-COMMUNICATIONS NETWORK, IT WAS NOT IMPROPER FOR THE AGENCY TO APPLY UNDISCLOSED SUBCRITERIA OF "TELE COMMUNICATIONS EXPERIENCE" AND "FEDERAL GOVERNMENT ACCOUNTING EXPERIENCE."

THE PRESENT PROCUREMENT IS FOR TECHNICAL ASSISTANCE IN THE DEVELOPMENT, TESTING AND DRAFTING OF SEVERAL FOREST SERVICE MANUAL SECTIONS. BELIEVE THE RFP'S GENERAL SPECIFICATIONS INDICATE THAT LEGAL CONSIDERATIONS ARE PERTINENT TO THE WORK. FOR EXAMPLE, THE CONTRACTOR IS TO PROVIDE ASSISTANCE IN CONNECTION WITH A MANUAL SECTION DEALING WITH THE RESOURCES PLANNING ACT, AND WITH ANOTHER SECTION TREATING GENERALLY THE AUTHORITIES FOR (AS WELL AS OTHER ASPECTS OF) FOREST SERVICE LAND MANAGEMENT PLANNING. FURTHER, THE CONTRACTOR WILL BE PROVIDED WITH A SET OF DRAFT REGULATIONS PERTAINING TO SECTION "G" OF THE NATIONAL FOREST MANAGEMENT ACT, AND MUST DOCUMENT THE CROSS REFERENCES BETWEEN THIS MATERIAL AND THE MANUAL MATERIAL DRAFTED UNDER THE CONTRACT.

IN VIEW OF THE FOREGOING, WE BELIEVE THAT LEGAL BACKGROUND MAY BE REASONABLY RELATED TO SEVERAL OF THE RFP TECHNICAL EVALUATION CRITERIA. NOR DO WE INTERPRET THE FOREST SERVICE'S ABOVE-QUOTED STATEMENT TO MEAN, AS THE PROTESTER INTIMATES, THAT THE AGENCY CONCEDES THAT LEGAL BACKGROUND WAS OR BECAME THE PARAMOUNT CONSIDERATION IN THE TECHNICAL EVALUATION. THE AGENCY'S STATEMENT WAS MADE IN RESPONSE TO THE PROTESTER'S ALLEGATION THAT CNA'S PERSONNEL WERE NOT AS WELL QUALIFIED AS INTASA'S BECAUSE THEIR BACKGROUND WAS LEGAL. IN OUR VIEW, THE AGENCY'S STATEMENT SIMPLY REAFFIRMS THAT LEGAL BACKGROUND WAS A VERY IMPORTANT ASPECT OF OFFEROR EXPERIENCE, GIVEN THE NATURE OF THE RFP REQUIREMENTS. FOR REASONS ALREADY NOTED, WEIGHING THE EXPERIENCE OF THE VARIOUS OFFERORS IS THE FUNCTION OF THE FOREST SERVICE TECHNICAL EVALUATORS, AND THE FACT THAT THE PROTESTER WOULD HAVE CONDUCTED THE EVALUATION DIFFERENTLY DOES NOT SHOW THAT THE AGENCY'S EVALUATION HAD NO REASONABLE BASIS.

VI. CONDUCT OF DISCUSSIONS

THE PROTESTER MAINTAINS THAT INSTEAD OF "NEGOTIATIONS" THE FOREST SERVICE MERELY SENT A LETTER TO ALL OFFERORS REQUESTING "CLARIFICATIONS." ALSO, INTASA STATES THAT IT SHOULD NOT HAVE HAD TO RESPOND TO THE REQUEST BECAUSE ITS INITIAL PROPOSAL ADEQUATELY ADDRESSED ALL QUESTIONS.

THE FOREST SERVICE'S MARCH 24, 1978, LETTER TO THE OFFERORS RAISED SEVERAL QUESTIONS AS TO STAFFING, ADVISED THE OFFERORS HOW TO COMPUTE THEIR TRAVEL AND PER DIEM COSTS, AND REQUESTED BEST AND FINAL OFFERS. THE AGENCY MAINTAINS THAT SUCH REQUESTS FOR CLARIFICATIONS "OF A SUBSTANTIAL NATURE" ARE NEGOTIATIONS. ALSO, THE FOREST SERVICE STATES THAT THE CONTRACTING OFFICER TOLD INTASA AWARD COULD NOT BE MADE TO IT ON THE BASIS OF ITS INITIAL PROPOSAL BECAUSE ITS PRICE WAS CONSIDERED TO BE TOO HIGH.

AN AGENCY'S REQUEST FOR AND RECEIPT OF "CLARIFICATIONS" WHICH INVOLVE MATERIAL CHANGES IN OFFERORS' PROPOSALS CONSTITUTE DISCUSSIONS. SEE NEW HAMPSHIRE-VERMONT HEALTH SERVICE, 57 COMP.GEN. 347, 353 (1978) 78-1 CPD 202. THE TERMS "DISCUSSIONS" AND "NEGOTIATIONS" ARE USUALLY REGARDED AS SYNONYMOUS. SEE RANTEC DIVISION, EMERSON ELECTRIC CO., B-185764, JUNE 4, 1976, 76-1 CPD 360. WHILE DISCUSSIONS MUST BE MEANINGFUL, THEIR SCOPE AND EXTENT IS A MATTER PRIMARILY FOR DETERMINATION BY THE CONTRACTING AGENCY, WHOSE JUDGMENT WILL NOT BE DISTURBED BY OUR OFFICE UNLESS CLEARLY SHOWN TO HAVE NO REASONABLE BASIS. INTASA'S GENERAL OBJECTIONS IN THIS CASE FURNISH NO GROUNDS FOR A CONCLUSION THAT MEANINGFUL DISCUSSIONS OR NEGOTIATIONS WERE NOT CONDUCTED. SEE JOSEPH LEGAT ARCHITECTS, SUPRA.

FURTHER, INTASA'S OBJECTION THAT IT SHOULD NOT HAVE HAD TO SUBMIT ANY CLARIFICATIONS IS UNTIMELY. UNDER SECTION 20.2(B)(2) OF OUR BID PROTEST PROCEDURES, 4 C.F.R.PART 20 (1978), PROTESTS MUST BE FILED WITHIN 10 WORKING DAYS AFTER THE BASIS FOR PROTEST IS KNOWN OR SHOULD HAVE BEEN KNOWN, WHICHEVER IS EARLIER. IF AN OFFEROR BELIEVES THE AGENCY IS UNREASONABLY REQUIRING IT TO SUBMIT ADDITIONAL DATA AND IS UNABLE TO RESOLVE THE MATTER DURING DISCUSSIONS, IT IS ON CONSTRUCTIVE NOTICE OF ITS BASIS FOR PROTEST IF THE AGENCY HAS NOT ACCEDED TO ITS POSITION BY THE CLOSING DATE FOR RECEIPT OF BEST AND FINAL OFFERS. JOSEPH LEGAT ARCHITECTS, SUPRA, 77-2 CPD 458, AT P. 21.

VII. REVISED TECHNICAL SCORES

INTASA REPEATEDLY STATES THAT IT IS UNABLE TO UNDERSTAND HOW THE FOREST SERVICE ARRIVED AT THE TECHNICAL SCORES OF THE INTASA AND CNA BEST AND FINAL OFFERS. (IN THE FINAL EVALUATION, CNA'S SCORE INCREASED FROM 51.8 TO 56.6, AND INTASA'S FROM 55.4 TO 56.4.) THE PROTESTER STATES IN ITS JULY 11, 1978, LETTER TO OUR OFFICE THAT IN THE ABSENCE OF EVIDENCE TO SUPPORT THESE CHANGES,

" * * * (WE CAN ONLY ASSUME THAT EITHER THE REVIEW COMMITTEE HAD INFORMATION ON COST AS THE CONTRACTING OFFICER REVEALED TO INTASA ON APRIL 17, OR ONE OF THE COMMITTEE MEMBERS RAISED HIS SCORE FOR CNA SUFFICIENTLY TO ENSURE THAT THE FIRM WOULD WIN ON A COMBINATION OF HIGHEST TECHNICAL SCORE - LOWEST PRICE."

INTASA SUSPECTS THAT ONE OF THE TECHNICAL EVALUATORS (WHOM IT DOES NOT IDENTIFY) WAS CONSISTENTLY BIASED IN FAVOR OF CNA, AND MAKES THE VERY SERIOUS ALLEGATION THAT "BASED ON THE EVIDENCE, WE SUBMIT THAT THE PROCUREMENT PROCESS WAS NOT COMPETITIVE AND THAT IT WAS 'WIRED' IN CNA'S FAVOR."

THE FOREST SERVICE'S JUNE 23, 1978, REPORT STATES THAT THE BEST AND FINAL OFFERS WERE EVALUATED BY THE TECHNICAL EVALUATION PANEL INDEPENDENTLY FROM THE PRICE PROPOSALS, WHICH WERE EVALUATED BY THE CONTRACTING OFFICER. ALSO, THE REPORT STATES THAT IN THE INITIAL EVALUATION ONLY ONE PRICE PROPOSAL (THAT OF CONSUMER DYNAMICS, INC.) HAD BEEN DISCUSSED WITH THE TECHNICAL EVALUATORS. MORE GENERALLY, THE FOREST SERVICE STATES THAT THE PROPOSALS WERE EVALUATED BY FIVE HIGHLY COMPETENT TECHNICAL EVALUATORS, THAT THE SCORES GIVEN TO PROPOSALS WERE THE RESULT OF THE EVALUATORS' JUDGMENT REGARDING THE TECHNICAL MERITS OF THE PROPOSALS IN LIGHT OF THE EVALUATION CRITERIA, AND THAT THEIR INDIVIDUAL AND COLLECTIVE JUDGMENTS ARE DOCUMENTED IN THE RECORD.

ALLEGATIONS VERY SIMILAR TO INTASA'S WERE RAISED IN JOSEPH LEGAT ARCHITECTS, SUPRA. SPECIFICALLY, THE PROTESTER IN THAT CASE ALLEGED THAT THE TECHNICAL SCORING OF BEST AND FINAL OFFERS WAS MANIPULATED IN THAT THE SUCCESSFUL OFFEROR'S PROPOSAL RECEIVED ADDITIONAL POINTS WHICH WERE NOT WARRANTED BY THE CHANGES IN THE PROPOSAL. OUR DECISION STATED (77-2 CPD 458 AT PAGE 27):

"IN THIS REGARD, WE BELIEVE THE ARMY'S POSITION IS SIMPLY THAT THE EVALUATORS CONSIDERED (THE SUCCESSFUL OFFEROR'S) REVISED TECHNICAL PROPOSAL AND DECIDED, IN THE EXERCISE OF THEIR JUDGMENT, TO ACCORD IT ADDITIONAL POINTS IN CERTAIN AREAS. WHILE WE HAVE EXAMINED THE RECORD OF THE EVALUATORS' NUMERICAL POINT SCORING AND (THE SUCCESSFUL OFFEROR'S) REVISED PROPOSAL DRAWINGS * * * IT IS NOT, AS ALREADY INDICATED, OUR FUNCTION EITHER TO EVALUATE THE CHANGES IN (THE) PROPOSAL OR TO DECIDE WHAT, IF ANY, ADDITIONAL POINTS SHOULD HAVE BEEN ASSIGNED. THESE ARE FUNCTIONS OF THE ARMY'S ANALYSIS AND PLANNING. TECHNICAL EVALUATORS, AND WE CANNOT SAY BASED UPON THE RECORD THAT THE ASSIGNMENT OF THE ADDITIONAL POINTS * * * CLEARLY HAS NO REASONABLE BASIS."

HAVING EXAMINED THE RECORD IN THE PRESENT CASE, WE BELIEVE THAT WHAT WE SAID IN JOSEPH LEGAT ARCHITECTS APPLIES HERE AS WELL. AS ALSO POINTED OUT AT LENGTH IN JOSEPH LEGAT ARCHITECTS, WHERE, AS HERE, THE WRITTEN RECORD DOES NOT CLEARLY DEMONSTRATE THE EXISTENCE OF UNFAIR OR IMPROPER CONDUCT ON THE PART OF AGENCY OFFICIALS, A PROTESTER'S ALLEGATIONS IN THIS RESPECT ARE PROPERLY TO BE REGARDED AS WHOLLY SPECULATIVE AND CONJECTURAL. 77-2 CPD 458 AT PP. 39.42.

VIII. PRICE EVALUATION

THE PROTESTER STATES THAT, IN LIGHT OF THE COST OR PRICING DATA SUBMITTED WITH CNA'S PROPOSAL, IT DOES NOT UNDERSTAND HOW CNA COULD PROPOSED 4,320 MAN-HOURS OF EFFORT AT THE COST INDICATED. INTASA ANALYZES AT SOME LENGTH THE SALARIES, GENERAL AND ADMINISTRATIVE (G&A) EXPENSES AND OTHER CNA COST ELEMENTS. IN GENERAL, INTASA QUESTIONS WHETHER CERTAIN COST ELEMENTS INVOLVED IN PERFORMING THE CONTRACT WORK HAVE BEEN INCLUDED IN CNA'S PRICE, AND CONTENDS THAT OTHER ELEMENTS, SUCH AS G&A, APPEAR TO BE LOW.

THE PROPOSALS IN THIS PROCUREMENT WERE SUBMITTED, AND THE CONTRACT AWARD WAS MADE, ON A FIRM-FIXED-PRICE BASIS. THE RFP REQUIRED OFFERORS TO SUBMIT "COST OR PRICING DATA" AND INDICATED THAT COST ANALYSIS WOULD BE PERFORMED. HOWEVER, THE FOREST SERVICE STATES THAT IT DID NOT FIND IT NECESSARY TO DISCUSS PRICE WITH THE SEVEN OFFERORS IN THE COMPETITIVE RANGE. ALSO, THE FOREST SERVICE INDICATES THAT THE CONTRACTING OFFICER CONDUCTED PRICE ANALYSIS BY COMPARING THE PRICES OFFERED BY THE OFFERORS, THAT HE CONSIDERED CNA'S BEST AND FINAL PRICE TO BE REASONABLE, AND THAT HE DETERMINED CNA TO BE A RESPONSIBLE PROSPECTIVE CONTRACTOR. WE BELIEVE IT IS REASONABLY CLEAR FROM THE AGENCY'S REPORT THAT THE CONTRACTING OFFICER WAS SATISFIED THAT AN ADEQUATE DEGREE OF PRICE COMPETITION HAD BEEN GENERATED IN THE PROCUREMENT.

UNDER FPR SEC. 1-3.807-3(A) (2D ED., FPR AMEND. 190, MARCH 1978) SUBMISSION AND CERTIFICATION OF COST OR PRICING DATA IS REQUIRED PRIOR TO THE AWARD OF ANY NEGOTIATED CONTRACT EXPECTED TO EXCEED $100,000. HOWEVER, FPR SEC. 1-3.807-3(B) STATES THAT THIS REQUIREMENT MAY BE WAIVED WHERE THE CONTRACTING OFFICER DETERMINES IN WRITING THAT THE PRICE NEGOTIATED IS BASED UPON ADEQUATE PRICE COMPETITION. WHILE FPR SEC. 1- 3.807-2(A) (2D ED., FPR AMEND. 103, MARCH 1972) STATES THAT COST ANALYSIS SHALL BE PERFORMED WHEN COST OR PRICING DATA IS REQUIRED TO BE SUBMITTED, IT ALSO INDICATES THAT WHETHER COST ANALYSIS OR PRICE ANALYSIS IS TO BE PERFORMED IS DEPENDENT ON THE FACTS SURROUNDING THE PARTICULAR PROCUREMENT AND THE PRICING SITUATION. UNDER FPR SEC. 1 3.807-2(B), PRICE ANALYSIS, WHICH IS THE PROCESS OF EVALUATING PRICES WITHOUT EVALUATING THEIR SEPARATE COST ELEMENTS, MAY BE ACCOMPLISHED IN VARIOUS WAYS, INCLUDING A COMPARISON OF THE OFFERED PRICES.

IN LIGHT OF THE FACTS IN THE PRESENT PROCUREMENT, WE SEE NOTHING OBJECTIONABLE IN THE FOREST SERVICE'S RELYING ON PRICE ANALYSIS AND COMPARING THE OFFERORS' PRICES TO DETERMINE PRICE REASONABLENESS, EVEN THOUGH THE RFP HAD REQUIRED SUBMISSION OF COST OR PRICING DATA AND STATED THAT COST ANALYSIS WOULD BE PERFORMED. IF THE PRICE NEGOTIATED IS BASED ON ADEQUATE PRICE COMPETITION, THE AGENCY IS NO LONGER REQUIRED TO CONDUCT COST ANALYSIS OF THE COST OR PRICING DATA SUBMITTED WITH THE PROPOSALS. SEE, IN THIS REGARD, 49 COMP.GEN. 295 (1969). IN ADDITION, EVEN WHERE A FIRM-FIXED-PRICE PROPOSAL IS SUBJECTED TO COST ANALYSIS, THE GOVERNMENT BELIEVES THERE IS A RISK THE PRICE MAY BE UNREALISTICALLY LOW, AND THERE ARE ALLEGATIONS OF A POSSIBLE "BUY-IN," THE GOVERNMENT IS NOT NECESSARILY REQUIRED TO REJECT THE PROPOSAL. CF. EPSCO, INCORPORATED, SUPRA, AND 50 COMP.GEN. 788 (1971). FURTHER, INSOFAR AS THE QUESTION OF UNREASONABLY LOW PRICE RELATES TO AN OFFEROR'S RESPONSIBILITY, OUR OFFICE DOES NOT REVIEW AFFIRMATIVE DETERMINATIONS OF RESPONSIBILITY UNLESS THERE IS A SHOWING OF FRAUD OR AN ALLEGED MISAPPLICATION OF DEFINITIVE RESPONSIBILITY CRITERIA, NEITHER OF WHICH IS INVOLVED HERE. SEE H. WEBB HAYES & ASSOCIATES, B-191259, MAY 1, 1978, 78-1 CPD 336, AND DECISIONS CITED THEREIN. FOR THE FOREGOING REASONS, THE QUESTIONS RAISED BY INTASA CONCERNING CNA'S PRICE PROPOSAL FURNISH NO BASIS FOR OBJECTION TO THE FOREST SERVICE'S EVALUATION OF CNA'S PRICE.

IX. CONCLUSION

THE PROTEST IS DENIED.

GAO Contacts

Office of Public Affairs