Consolidated Engineering Services, Inc.
Highlights
Consolidated Engineering Services, Inc. (CES) protests the award of a contract to Meridian Management Corporation (MMC) under request for proposals (RFP) No. SSA-RFP-08-1004 by the Social Security Administration for facility management services. The protester contends that the agency's evaluation of the offerors' technical proposals was unreasonable, and that the selection decision was flawed.
B-311313, Consolidated Engineering Services, Inc., June 10, 2008
DOCUMENT FOR PUBLIC RELEASE
The decision issued on the date below was subject to a GAO Protective Order. This redacted version has been approved for public release.
Decision
Matter of: Consolidated Engineering Services, Inc.
Kenneth B. Weckstein, Esq., and Michael D. Maloney, Esq., Brown Rudnick Berlack Israels LLP, for the protester.
Michael A. Gordon, Esq., and Fran Baskin, Esq., Michael A. Gordon, PLLC, for Meridian Management Corporation, an intervenor.
Mark S. Ledford, Esq., Social Security Administration, for the agency.
Jonathan L. Kang, Esq., and Ralph O. White, Esq., Office of the General Counsel, GAO, participated in the preparation of the decision.
DIGEST
1. Protest is sustained where agency's evaluation of offerors' experience relied on factors not identified in the solicitation and on distinctions between offerors' experience that were not supported by the record.
2. Protest is sustained where source selection decision was based on a flawed technical evaluation, and also considered an undisclosed evaluation criterion of transition risk in assuming that any non-incumbent contractor would likely cause mistakes in performance that would result in costs for the agency.
DECISION
Consolidated Engineering Services, Inc. (CES) protests the award of a contract to Meridian Management Corporation (MMC) under request for proposals (RFP) No. SSA-RFP-08-1004 by the Social Security Administration for facility management services. The protester contends that the agency's evaluation of the offerors' technical proposals was unreasonable, and that the selection decision was flawed.
BACKGROUND
The RFP was issued on
The RFP anticipated the award of a fixed-price contract, with a 1-year base performance period and nine 1-year option periods. The RFP stated that proposals would be evaluated on the basis of the following factors: experience, past performance, and price. RFP sect. H-1. The non-price factors were of equal importance and, combined, were slightly more important than price. RFP amend. 1 sect. H-1. The RFP also stated that the agency would evaluate offerors' experience and past performance to develop a confidence/performance risk assessment for each proposal. The confidence/performance risk assessment was to be used, along with price, to conduct the selection decision. RFP sect. H-2.2.
As relevant here, the RFP stated that the agency would evaluate offerors' proposals under the experience factor based on the following criteria:
Experience is the opportunity to learn by doing. The Government will evaluate the extent to which an offeror possesses experience in work similar to the Government's requirements under this solicitation in terms of size, scope and complexity, to enable the offeror to:
-identify performance uncertainties and risks;
-identify potential performance problems and their symptoms;
-identify, fashion and select prospective and appropriate solutions;
-implement effective corrective actions;
-develop and implement actions that improve efficiency and/or useful life expectancy of facilities and equipment; and
-achieve the overall objectives of the contract.
RFP sect. H-1(d)(1).
The RFP further stated that proposals would be evaluated based on offerors' experience in the following critical areas: custodial services, elevator maintenance, energy management, life safety systems maintenance, mechanical systems operation and maintenance, security services, utilities service management, and working productively with unions.
For the confidence/performance risk assessment, the RFP stated that the agency would consider offerors' past performance and experience to create the composite assessment that reflect[s] the Government's level of confidence that the offeror, if selected for award, would successfully perform the requirements of this contract. RFP sect. H-2.2. The RFP advised that offerors' proposals would be assigned one of the following ratings under the confidence/performance risk assessment:
Full Confidence/No Risk -- Essentially no doubt/risk exists that the offeror will successfully perform the required effort.
High Confidence/Little Risk -- Little doubt/risk exists that the offeror will successfully perform the required effort.
Confidence/Some Risk -- Some doubt/risk exists that the offeror will successfully perform the required effort.
Unknown Confidence/ Unknown Risk -- Where no relevant performance record was identified, confidence level/performance risk is unknown.
Little Confidence/Substantial Risk -- Substantial doubt/risk exists that the offeror will successfully perform the required effort.
No Confidence/Extreme Risk -- Extreme doubt/risk exists that the offeror will successfully perform the required effort.
The agency received proposals from six offerors by the closing date of
The agency established a competitive range of the most highly-rated proposals, consisting of CES, MMC, and a third offeror. Agency Report (AR), Tab 6, Competitive Range Determination, at 4-5. The agency then conducted discussions with each offeror in the competitive range, received revised proposals, and conducted new evaluations.
The final ratings for each offerors' proposal were follows:
CES | MMC | |
Experience | Extremely Similar | Extremely Similar |
Past Performance[2] | Excellent | Excellent |
Confidence/ Performance Risk | High Confidence/ Little Risk | Full Confidence/ No Risk |
Price | $[deleted] | $46,368,279 |
AR, Tab 18, Source Selection Decision (SSD), at 4, 6, 7.
In the selection decision, the CO concluded that although CES's and MMC's proposals received similar ratings, MMC's proposal had several advantages that warranted selection for award. The selection decision first discussed each offeror's proposal, and the CO's basis for assigning ratings under each evaluation factor. Although CES and MMC received equal ratings under the experience and past performance evaluation factors, the CO concluded that MMC's proposal merited a confidence/performance risk rating of full confidence/no risk, whereas CES merited a rating of high confidence/little risk. AR, Tab 18, SSD, at 6-7.
In comparing the offerors, the CO concluded that MMC was superior to CES under the past performance and experience evaluation factors. Under the past performance evaluation, the CO noted that both offerors were rated excellent, and that there were no performance problems reported for either. The CO concluded that while both firms received equal past performance ratings, there is somewhat less past performance related risk associated with award to
Under the experience evaluation, the CO noted that both offerors were rated as having experience extremely similar to the solicitation requirements. Nonetheless, the CO stated that the extremely similar ratings represented a range of possible merit for each offeror's experience, and that MMC's experience was superior to CES's experience. The CO first concluded that while CES had experience in managing all of the eight critical areas required under the solicitation, the company had performed them in a number of different multi-service contracts, none of which required the performance and management of these functions at one site.
The CO then cited two examples to illustrate her view that MMC's experience was more relevant than CES's experience, explaining that while Meridian and CES both appear to be excellent contractors with extensive experience . . . [t]he differences are in the details.
In the final tradeoff between CES's and MMC's proposals, the CO stated that the selection decision would be based on the following consideration: Given
The agency selected MMC's proposal for award on
DISCUSSION
CES challenges the reasonableness of the agency's evaluation of the offerors' experience and the selection decision. The evaluation of an offeror's proposal, including experience, is a matter within the agency's discretion. IPlus, Inc., B-298020, B-298020.2,
Although the protester raises several allegations regarding the agency's evaluation of the offerors' proposals and assignment of adjectival ratings, our decision here primarily addresses the agency's direct comparison of the offerors' proposals.[3] As discussed below, we agree with the protester that the agency's comparison of the offerors' proposals and the selection decision were unreasonable.
Comparison of Offerors' Experience
The protester argues that the agency's evaluation of the offerors' experience was unreasonable and not supported by the record. As discussed above, the agency rated both offerors under the experience factor as having experience that is extremely similar to the requirements of the solicitation, the highest possible rating. The agency concluded, however, that MMC's experience was more relevant than CES's based on a general comparison of the relevance of the offerors' experience, and on two specific examples which the agency concluded illustrated differences between the offerors. We discuss first the agency's general evaluation of the offerors' relative experience, and then address the two specific examples. As discussed below, we conclude that the agency's evaluation of the offerors' relative experience was not reasonable.
1. Overall Relevance of Experience
The selection decision first emphasized that CES's experience was less relevant than MMC's because the protester had not performed all of the eight critical areas listed in the experience factor under one contract. The protester contends that the agency's reliance on this distinction was unreasonable. We agree.
In the comparison of the overall experience records of CES and MMC, the CO explains twice that she found a significant distinction based on whether the offerors had performed all of the eight critical areas under one contract:
Unlike CES,has experience performing all eight critical areas combined under one contract, [the incumbent] GLPSC combined facilities management contract. . . . Meridian
However, whilehas experience performing all these functions under one contract (the [incumbent contract]), CES' experience is spread over a number of contracts, none of which required the performance and management of all of these functions at one site. Meridian
AR, Tab 18, SSD, at 12.
During the hearing, counsel for the agency asked the CO to explain what the government was looking for in the overall solicitation. AD at . The CO stated the agency was seeking to identify offerors that had experience in providing all services under all the categories under one contract.
Agencies are required to evaluate proposals based solely on the factors identified in the solicitation, and must adequately document the bases for their evaluation conclusions. Intercon Assocs., Inc., B-298282, B-298282.2,
The solicitation stated that offerors experience would be evaluated as follows: Experience will be evaluated in terms of the size, scope and complexity of the operation. Experience in the following [eight] critical areas, listed in alphabetical order, will be evaluated. RFP sect. H-1(d)(1). We agree with the agency that the solicitation anticipated award of a single contract, and that the ability to perform all of the services under a single contract is a basis for evaluation. We do not agree, however, that the CO's one contract criterion for evaluating the relevance of offerors' experience was a reasonable proxy for that evaluation. Instead, we think that the RFP does not support the agency's one contract interpretation for evaluating experience, and that the interpretation was not reasonably related to the stated evaluation criteria.
The RFP does not state that the agency was seeking proposals from offerors who had performed all of the eight critical areas of experience under one contract; instead, the solicitation states that the agency will evaluate offerors' experience to determine whether their experience with the eight critical areas is similar to the requirements of the solicitation. The CO's one contract approach meant that the agency did not consider any offeror to have equivalent experience to the incumbent contractor unless the offeror had performed the exact same services required under the solicitation in the same manner as the incumbent, i.e., under one contract.
In addition to being inconsistent with the RFP, the CO's interpretation appears to have unduly restricted competition by unreasonably disfavoring non-incumbent firms competing with the incumbent. Specifically, the agency's action prejudiced CES by precluding consideration of whether offerors' references demonstrated, individually or collectively, experience that was similar in size, scope or complexity to the solicitation requirements.[4] In this regard, the CO simply assumed, without meaningful analysis, that CES's collective experience, which the record shows clearly included multi-function contracts involving all of the services required under the solicitation, could not have been the equal to MMC's under the incumbent contract.[5] On this record, we conclude that the agency's evaluation was not reasonably consistent with the stated evaluation factors.
2. Centrifugal Chillers
In the first of the two specific examples of areas where the CO concluded that MMC's experience was more relevant than CES's, the selection decision states that MMC had more relevant experience managing centrifugal chillers. The selection decision states that the offerors' experience was distinguishable because CES has 9 years of experience with 300-ton
During her testimony, the CO stated that although CES was given credit for having experience in centrifugal chiller maintenance, she distinguished between the experience of CES and MMC because she concluded that CES did not have experience with maintenance of the same type or models of chillers as those at the GLPSC. AD at . The CO stated that she believed that there are differences between various models of centrifugal chillers, and that CES's experience was less relevant than MMC's experience managing the 533-ton
The TET report, however, does not discuss differences between the offerors' experience, and does not support the conclusions made by the CO in the selection decision.[6] The TET report stated that CES has performed maintenance on Trane and York chilled water equipment which is very similar to the chilled water equipment at the [GLPSC]. AR, Tab 5, TET Report, at 20. The TET report does not identify which models of centrifugal chillers with which CES or MMC has experience, nor does the report draw any distinctions between the offerors' experience with centrifugal chillers or discuss why their experience is different.
Additionally, the record shows that the CO did not have a clear understanding of which types of chillers CES had experience maintaining. The CO stated, for example, that her reference in the selection decision to CES's experience with
On this record, we conclude that the evaluation of the offerors' proposals regarding their experience with centrifugal chillers was not reasonable. As the CO acknowledges, she does not understand whether the experience each offeror had with the chillers was different in any meaningful way, and the report provided to her by the TET does not discuss or otherwise provide any basis to distinguish between the offerors' experience. Moreover, the selection decision's assessment of MCC's experience again appears to reflect an unsupported, and anti-competitive, preference for the incumbent.
3. Security Services
The CO also concluded that MMC's experience in managing security services was more relevant than CES's experience. The CO noted that both offerors proposed to meet the security requirements under the contract through subcontractors, and that each offeror had previously performed contracts where they had managed security services subcontractors. The CO concluded, however, the MMC's experience was more relevant because
The record shows that the CO rated the experience of both offerors' proposed subcontractors as extremely similar to the security requirements in the solicitation. AR, Tab 5, TET Report, at 6, 20. The CO, however, distinguished between the experience of the CES and MMC in their management of security subcontractors. AR, Tab 5, TET Report, at 6, 20; Tab 18, SSD, at 6, 12. In this regard, the CO determined that MMC had experience managing a subcontractor at the GLPSC on the incumbent contract, and therefore had extremely similar experience. AR, Tab 5, TET Report, at 6; Tab 18, SSD, at 12. In contrast, CES had experience managing a subcontractor at a military installation, which the CO concluded was not entirely similar to managing armed guard services in a multi-story office building setting like that of the GLPSC. AR, Tab 18, SSD, at 6. Specifically, the CO concluded that CES had not adequately explained in its proposal why the requirements of the security subcontract it managed were similar to the requirements of the solicitation. AD at . Thus, in contrast with the unsupported preference for the incumbent's experience discussed above, we think the CO reasonably distinguished the nature of the protester's prior work from the work required under the solicitation. We therefore find no basis to sustain this protest ground.
In sum, we conclude the agency's evaluation of the offerors' relative merits under the experience factor was flawed, and thus the agency's conclusion that MMC's experience was more relevant than CES's experience lacked a reasonable basis. We further conclude that CES was prejudiced by this flawed evaluation because the agency relied upon it in selecting MMC's higher-priced proposal for award, and sustain the protest on this basis. See McDonald Bradley, B-270126,
Source Selection Tradeoff Analysis
The protester argues that the agency's selection decision was flawed for two reasons: (1) the tradeoff analysis relied on the flawed evaluation of the offerors' experience, and (2) the tradeoff analysis concluded that non-incumbent contractors generally pose risks in their transition to contract performance, and that those concerns warranted discounting CES's lower proposed price--notwithstanding the fact that the solicitation did not call for evaluation of offerors' approaches to transition. We agree with the protest on both issues.
First, the tradeoff analysis concluded that MMC's experience was clearly superior to CES's experience, and that this difference required the CO to address whether MMC's higher-priced proposal merited selection as opposed to CES's lower-priced proposal. Because, as discussed above, the agency's underlying evaluation of the offerors' experience was unreasonable, we conclude that CES's was prejudiced by the agency's reliance on that evaluation in the selection decision.
Next, the agency's tradeoff determination relied on assumptions concerning the risk posed by award of a contract to a non-incumbent offeror that were unreasonable and inconsistent with the solicitation. As explained above, the CO determined that although CES's proposed price was $[deleted] lower than MMC's, this difference was more than offset[] by MMC's lower performance risk based on that offeror's successful performance of the incumbent contract. AR, Tab 18, SSD, at 12. The CO also concluded that the $[deleted] price differential was not significant because of the possibility that a non-incumbent contractor, such as CES, could experience problems during contract transition that would eliminate the differential: It is reasonable to assume that CES will make some mistakes during the learning phase at a new facility, and that [s]uch a mistake (i.e., one that damages equipment, injures an employee, or causes a building closure) could easily cost the agency more than $[deleted].
The CO acknowledged in her testimony that her concern regarding the transition risk was based on general assumptions regarding non-incumbents, rather than any aspect of CES's proposal. AD at . Specifically, the CO cited two factors for her assumptions regarding transition risk: (1) what the CO termed general knowledge concerning the difficulties that a non-incumbent might have in contract transition, and (2) the CO's experience with a contract in
Additionally, the solicitation did not require offerors to identify their approaches to contract transition in their proposals, nor did the agency state that it would take transition costs or risk into account in evaluating offerors' proposals.[7] We think that the agency's use of assumptions concerning transition risk here constituted an improper use of an undisclosed and anti-competitive evaluation criterion that was not related to any risk or price evaluation identified in the solicitation. See Global Analytic Info. Tech. Servs. Inc., supra. The undisclosed evaluation factor of transition risk and associated cost clearly prejudiced CES because it effectively negated the price advantage CES's proposal had as compared to MMC.
On this record we conclude that the agency's selection decision was not reasonable, and that CES was prejudiced by the agency's reliance on the flawed evaluation of offerors' experience and the agency's unreasonable assumptions concerning transition risk. We therefore sustain the protest on these bases.
RECOMMENDATION
We recommend that the agency reevaluate the offerors' proposals, consistent with this decision. If the agency concludes that its needs require a consideration of transition risk, it should issue a revised solicitation and obtain new proposals from the offerors. At the conclusion of this process, we recommend that the agency make a new selection decision. If MMC is not found to offer the best value to the government, the agency should terminate MMC's contract for the convenience of the government.
We also recommend that CES be reimbursed the costs of filing and pursuing this protest, including reasonable attorney fees. Bid Protest Regulations, 4 C.F.R. sect. 21.8(d)(1) (2008). CES should submit its certified claim for costs, detailing the time expended and cost incurred, directly to the contracting agency within 60 days after receipt of this decision. 4 C.F.R. sect. 21.8(f)(1).
The protest is sustained.[8]
Gary L. Kepplinger
General Counsel
[1] In developing the protest record, our Office conducted a recorded telephone hearing in which the CO testified. Since there is not a written transcript of this hearing, references in this decision to the hearing are to the time index on the audio disc.
[2] Following the TET's evaluation of offerors' proposals, the CO determined that additional references for CES's and MMC's past performance should be consulted. AR, Tab 18, SSD, at 4-6. During this process, the agency revised the past performance evaluation ratings for MMC and CES from outstanding, the highest rating, to excellent, the next-highest rating.
[3] For example, CES contends that the agency's evaluation of MMC's proposal under the experience factor was improper because, the protester argues, the solicitation did not allow the agency to consider offerors' performance of contracts with the agency. In this regard, the solicitation stated that the agency would evaluate the offeror's experience in providing relevant and similar services to other corporations or Government agencies. RFP sect. H-1(d)(1). CES contends that this language precluded the agency from considering offerors' experience in performing contracts for agency. We think this argument relies on an unreasonable interpretation of the solicitation, namely that the word other precludes the agency from considering the performance of any work that an offeror performed for the agency--such as the incumbent contract. We have reviewed all of the issues raised in CES's protest, and conclude that none has merit, aside from those we specifically address herein.
[4] In this regard, the TET evaluation noted that two of the facilities listed in CES's experience references were extremely similar in size, scope and complexity to the GLPSC, and the other two were larger and more complex than the GLPSC. AR, Tab 5, TET Report, at 20.
[5] The agency and the intervenor argue that our decision in Ashe Facility Servs., Inc.,
B-292218.3, B-292218.4,
[6] In her testimony, the CO did not identify any documents other than the TET report upon which she based her conclusions regarding the offerors' experience with centrifugal chillers. AD at .
[7] In her testimony, the CO acknowledged that the solicitation did not advise non-incumbent offerors that they would be evaluated on the basis of their ability to perform a transition from the incumbent contractor. AD at .
[8] During the course of this protest, the agency determined that, although the filing of this protest trigged the required suspension of contract performance under the Competition in Contracting Act (CICA), an override of that suspension was necessary. Specifically, the agency determined that continued contract performance by Meridian Management Corporation (MMC), the awardee, will be in the best interest of the