Competitive Dialogue: Procurement Guidance
Competitive Dialogue: Procurement Guidance
PROCUREMENT GUIDANCE
Competitive Dialogue
How to undertake a Competitive Dialogue
Procurement Process
October 2017
Published October, 2017 – First Edition
Copyright © 2017
The World Bank
1818 H Street NW
Washington DC 20433
Telephone: 202-473-1000
Internet: www.worldbank.org
Disclaimer
This work is a product of the staff of The World Bank. The findings, interpretations, and
conclusions expressed in this work do not necessarily reflect the views of The World Bank, its
Board of Executive Directors, or the governments they represent.
This section explains the common abbreviations and defined terms that are used in this guidance.
Defined terms are written using capital letters.
Business Day Any day that is an official working day of the Borrower. It
excludes the Borrower’s official public holidays.
Contract Award Notice The published award of contract notice as described in the
Procurement Regulations, Paragraphs 5.93 to 5.95.
Final Proposals The final Proposal submitted at the end of the Competitive
Dialogue process.
Initial Selection (IS) The shortlisting process used prior to inviting request for
Proposals in the procurement of Goods, Works or Non-
consulting Services.
Abbreviation / term Full terminology / definition
Probity Assurance A third party that provides specialist probity services for
Provider (Probity Auditor) concurrent monitoring of the Procurement Process.
Procurement Documents A generic term used to cover all Procurement Documents issued
by the Borrower soliciting applications/bids/Proposals. It
includes: prequalification document, initial selection document,
request for bids document, request for Proposal documents,
forms of contracts and any addenda.
Procurement Process The process that starts with the identification of a need and
continues through planning, preparation of specifications/
requirements, budget considerations, selection, contract award,
and contract management. It ends on the last day of the
warranty period.
Procurement Policy Bank Policy, “Procurement in IPF and Other Operational
Procurement Matters.”
Procurement Regulations The “World Bank Procurement Regulations for IPF Borrowers”.
Proposal An offer, in response to a request for Proposals, which may or
may not include price, by one party to provide Goods, Works,
Abbreviation / term Full terminology / definition
Non-Consulting Services or Consulting Services to another
party.
Proposer An individual entity or joint venture that submits a Proposal for
Goods, Works, and Non-consulting Services in response to a
request for Proposals.
RFB Request for Bids as a selection method.
1
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
2
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Section I. Overview of a Competitive Dialogue
process
Section I. Overview of a Competitive Dialogue process
Purpose
This Guidance is designed to provide Borrowers with a practical toolkit to support designing
and undertaking a Competitive Dialogue Procurement Process.
This Guidance complements and expands on the procedures for Competitive Dialogue
described in Annex XIII of the Procurement Regulations. Each Competitive Dialogue process
“needs” to be carefully designed and customized to fit the project, in order to maximize the
effectiveness of this procurement selection arrangement.
Background
Competitive Dialogue is an interactive multistage Procurement selection arrangement that
allows for dynamic engagement with Proposers. As such, it is a highly effective Procurement
Process for complex, high-value and/or innovative contracts. Competitive Dialogue is most
suitable for undertaking procurements where:
1. a number of alternative solutions, that satisfy the Borrower’s requirements, may be
possible, and the detailed technical and commercial arrangements required to support
those solutions require discussion and development between the Borrower and
Proposers; and
2. due to the nature and complexity of the procurement, the Borrower is not objectively
able to:
a. adequately define the technical or performance specifications and scope to
satisfy its requirements; or
b. adequately specify the legal and/or financial arrangements of the contract.
The Borrower should justify the use of Competitive Dialogue and include the rationale in the
Project Procurement Strategy for Development (PPSD).
Under a Competitive Dialogue process, following Initial Selection, the Borrower enters into
dialogue with each Proposer. The aim is to identify and define the “means” best suited to
satisfy the Borrower’s “needs”.
The “needs” are the Borrower’s requirements as described in the Standard Procurement
Documents (SPDs), while the “means” are a Proposer’s solution, which includes technical,
financial and legal aspects, for delivering the “needs”
The Borrower’s “needs” should be clear and specific, and the Competitive Dialogue process
should be used to determine the range of options available for delivering them and ultimately
the solution that offers the Most Advantages Proposal (MAP) determined by the Proposal
evaluation criteria. In many instances the “needs” are expressed in terms of functionality or
performance. However, the “means” of delivering those “needs” should not be specified by the
Borrower, as the purpose of the Competitive Dialogue process is to identify the best way of
satisfying those ”needs”. Basically, the Competitive Dialogue process analyses Interim
3
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Proposals and through ongoing dialogue each Proposer develops an appropriate customized
solution. The dialogue continues until “needs” and “means” are matched.
4
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
STAGE 5: Request Final Once the dialogue phase closes the Borrower
Proposals, evaluation invites the submission of Final Proposals and
and contract award undertakes final evaluation of the Proposals
5
6
Section II. Stages of a Competitive Dialogue
process
Section II. Stages of a Competitive Dialogue process
If the answer to most, if not all, of these questions is “yes”, then Competitive Dialogue is an
appropriate Procurement selection arrangement to adopt for the contract.
Justifying the choice
Borrowers will be required to prepare a PPSD. The PPSD should set out the justification for the
use of Competitive Dialogue as the Procurement selection arrangement for the contract. This
justification should be supported by answering the questions set out above.
7
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Governance
Competitive Dialogue is normally used for high-value, complex and/or innovative contracts. As
such, it is important that the Procurement Process is conducted within a clear and well defined
governance framework.
8
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Such a framework should be designed, agreed and put in place before commencement of the
Competitive Dialogue and should take into account the following considerations:
a. Governance Body: The allocation of responsibility for final approvals of key decisions
during the dialogue process to a governance body. The governance body may already
exist in relation to planning the project, but if not, one should be created. The
governance body should need to consider key decisions to keep the Competitive
Dialogue proceeding without delay, such as:
i. the results of the Initial Selection;
ii. the Competitive Dialogue RFP for issue;
iii. any down-selection;
iv. the closure of the dialogue phase;
v. the selection of the Most Advantageous Proposal; and
vi. the contractual documentation for signature.
9
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
1. Probity Auditor
The Procurement Regulations require the Borrower to appoint an independent Probity
Assurance Provider (Probity Auditor), acceptable to the Bank, to oversee the integrity of the
entire Competitive Dialogue process. The governance framework designed for the Competitive
Dialogue process should recognize this requirement and ensure that the Probity Auditor has
access to all relevant and appropriate aspects of the project management and governance
arrangements. The Probity Auditor should attend all key meetings to ensure that the
governance arrangements in place are robust.
The Probity Auditor will provide independent scrutiny of the Competitive Dialogue process.
This includes scrutiny of, for example:
a. overall governance and management of the procurement;
b. evaluations of Applications and Proposals;
c. procurement decision making;
d. the dialogue phase with each Proposer; and
e. the conduct of any negotiations that take place.
The Probity Auditor should be able to attend all dialogue meetings to ensure that a competitive
process takes place and that no unfair advantage or disadvantage is given to any of the
Proposers as result of these dialogue meetings. The Probity Auditor should also be given access
to all key procurement information and material, including the Initial Selection and RFP
documents, and all submissions received from Proposers, including clarification questions and
their responses.
Where the Probity Auditor is a single person, dialogue sessions should be organized in such a
way as to allow attendance at all meetings, meaning that dialogue sessions should be
sequential and not simultaneous. Where the Probity Auditor is a firm, the lead Probity Auditor
should attend all cross-work stream dialogue sessions with each Proposer and all governance
meetings and Competitive Dialogue team meetings at which key decisions are to be made.
The Probity Auditor should receive copies of all agendas for, and minutes of dialogue meetings,
plus any written information or material that the Proposer provides at a dialogue meeting.
Annex B provides more information on the selection of a Probity Auditor and Annex C provides
a draft specification for commissioning a Probity Auditor.
2. Personnel
Competitive Dialogue requires skilled personnel from various backgrounds to assist in the
planning, preparation, evaluation, dialogue and contract award. Borrowers should assess their
current staffing capacity and capability in areas such as procurement, finance, legal, technical
expertise, contract management and any other relevant areas, to identify where additional
support may be required. As part of the PPSD, Borrowers should include a capability and
capacity plan to explain how they will obtain the specialist capability and capacity to
implement the Competitive Dialogue process. The implementation and operationalization of
10
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
the capacity and capability plan should be integrated into the project plan and included within
the PAD.
The Competitive Dialogue lead should have a strong understanding and recent experience of
management of complex procurements, and if possible a Competitive Dialogue process.
Factors and skills to be taken into account when deciding the composition of the Competitive
Dialogue team and work stream sub-teams, which are multi-disciplinary, include:
a. experience in governance and management of complex Procurement Processes;
b. experience of planning and conducting a Competitive Dialogue;
c. experience of developing appropriate evaluation criteria for Initial Selection and
undertaking Proposal evaluation of complex Proposals;
d. negotiation skills and experience of close involvement in Proposer selection and
awarding major contracts; and
e. comprehensive financial expertise to, for example, express financial aspects of the
project requirement within RFP documents, evaluate financial Proposals and aspects
of the Competitive Dialogue, understand the Borrower’s financial positon and
governance processes to ensure contract affordability and value for money.
11
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
3. Timescales
Competitive Dialogue can take significantly longer than other Procurement Processes. Given
the level of complexity, it is not unusual for a Competitive Dialogue to run for 12-18 months or
more to complete. Borrowers should plan for a timescale that is realistic and allows sufficient
time to work with Proposers to develop solutions that satisfy the requirement, but which also
maintains momentum and focus.
In particular, sufficient time should be allocated to:
a. Dialogue: Each round of dialogue should allow sufficient time for meaningful
engagement between Borrower and Proposers. At least a full day with each Proposer
should be set aside for the dialogue itself, as well as sufficient time, for preparation,
writing up minutes, and time for the parties to fulfil agreed actions and develop
Proposals further between dialogue rounds. A common approach is to undertake
dialogue rounds in four week cycles, with a week of dialogue, preceded by a week’s
preparation time and two weeks’ post-dialogue to work on Proposal development.
Particularly complex procurements may require several rounds of dialogue, 6-8 is not
uncommon, including an initial round to ensure that Proposers have a full
understanding of the RFP content, the Borrower’s “needs” and the Procurement
Process to be followed.
b. Proposal Evaluation: Proposal evaluation can be highly time consuming and resource
intensive. Evaluation may involve the entire Competitive Dialogue team, work stream
sub-teams, and in some instances a wider group of stakeholders, all of who will need
to diarize time to undertake such evaluation alongside their normal duties, if they are
not full-time dedicated to the Competitive Dialogue process.
c. Approvals: Key decisions may require governance body approval, or authorization from
a higher authority within the Borrower’s organization. This will be in addition to “no
objections” from the Bank, which may be required to adhere to meeting cycles or
governance processes outside the scope of the Competitive Dialogue process.
12
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Sufficient time for these processes to take place should be planned into the project
timeline.
d. Probity Assurance: Probity Assurance “needs” to be factored into planning and
decision making, including documentation review, meeting attendance, review of
minutes of meetings/dialogue and reporting.
dialogue round 2 37 5
dialogue round 3 41 4
Award contract 55 2
4. Work streams
Work streams should align with the key elements of the Proposal such as price/cost, technical,
commercial/financial and legal. Whilst each work stream is discrete there may be some overlap
between them, which will require careful management.
For example, as price/cost is evaluated separately from technical aspects under the two-
envelope system, a price/cost work stream should be established that allows these aspects to
be considered and discussed on a confidential basis separately from the technical solution.
13
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
If design forms a major part of the requirement and evaluation, this may merit a discrete work
stream to conduct dialogue focused on that aspect of the solution.
A mechanism should exist to allow cross-cutting issues to be managed between work streams,
for example, by commencing or ending a dialogue session with a cross-work stream dialogue.
In addition, the Competitive Dialogue process management should ensure that input from one
work stream is regularly provided to the other workstreams, where required.
Dialogue should be structured to allow all aspects of the Borrower’s requirements to be
discussed at least once during the dialogue process. Dialogue session agendas should be
planned in advance so that each work stream can cover all key areas adequately over the
course of the dialogue period. Proposers may be asked to submit material in advance of
dialogue meetings relating to their developing Proposals. Borrowers should have time to
consider such material and provide feedback during the subsequent dialogue session.
The requirement for additional dialogue on specific topics should be agreed at the end of each
dialogue session to ensure that all Proposers are given sufficient and equal opportunity to
engage with the Borrower.
5. Location
Dialogue is resource intensive, and it is not unusual for thirty (30) or more people to be involved
at any one time, especially if multiple work streams exist. Dialogue rounds will need to be
accommodated in a venue capable of allowing a plenary session involving such a number to be
housed in one room and dependent on the Probity Audit arrangements, alongside space for 3-
4 work streams to be in dialogue at the same time in separate rooms, and for parties to be able
to conduct confidential discussions outside of the dialogue.
Since it is usual for the Borrower to host dialogue meetings, it should be borne in mind that
Proposers may have to bring teams potentially from overseas to attend dialogue sessions,
which will also have a bearing on location in terms of making the Procurement Process
logistically feasible and affordable.
6. Administration
The task of making logistical arrangements and ensuring a sound audit trail to support the
Competitive Dialogue is significant. Borrowers should ensure that adequate administration
and secretariat resources are in place.
In particular, arrangements for preparing and issuing dialogue session agendas, preparing,
reviewing and approving minutes should be put in place and agreed between all parties. This
will help ensure that responsibility for noting and agreeing action points and matters agreed
during dialogue sessions are allocated. Consideration should be given to the use of recording
equipment during dialogue sessions to maintain a full record of discussions. The Proposer’s
consent to recording should be obtained in writing in advance of the dialogue sessions. Copies
of the unedited recordings should be made available to the Proposer with whom the Borrower
was meeting.
14
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
7. Communication
A protocol for communication between parties should be agreed. This should cover:
a. the route through which all formal communication between Borrower and Proposers
should take place, for example, via the Competitive Dialogue lead or work stream leads.
Care should be taken to avoid formal communication taking place outside of official
routes to ensure that a full audit trail can be maintained.
b. the use of an on-line procurement ‘portal’ (which the Bank has established as being
adequate and appropriate) should be used to issue and receive all documentation, such
as, RFP, clarifications, agendas and minutes and submissions from Proposers. The
system must be capable of providing an audit trail and protecting each Proposer’s
confidential and commercially sensitive information.
8. Commercial confidentiality
Confidentiality is fundamental to ensuring fairness and integrity in the Procurement Process.
In addition to the confidentiality of the Proposal evaluation, as required by the Procurement
Regulations, Borrowers shall not disclose information marked by an Applicant or Proposer as
confidential to another Applicant or Proposer. Confidential information may include
proprietary information, trade secrets and commercially or financially sensitive information.
In a Competitive Dialogue, this includes a Proposer’s design and proposed solution, new ideas,
and innovation. Ensuring confidentiality gives Proposers reassurance that their commercially
sensitive information will be protected.
Failure to maintain confidentiality will undermine the integrity of the Competitive Dialogue
process, the willingness of Proposers to put forward credible solutions and may result in
Complaints that, if upheld, may mean the cancellation of the Competitive Dialogue process.
Considering the high costs of preparing Proposals under Competitive Dialogue, Proposers will
be reluctant to be involved in a Competitive Dialogue process unless they are given absolute
reassurance on confidentially.
It is usual for the Borrower to circulate answers to all Proposers in relation to clarifications
and queries. Borrowers must identify if a clarification or query from one Proposer relates to
the confidential or commercially sensitive information of another. Where it does, such
information must not be released and the requesting Proposer advised that no answer will be
given to protect confidentiality.
Proposers submitting a clarification or query should indicate whether they consider their
clarification or query to be commercially confidential to them, and thus the question and
answer not to be shared with other Proposers. If the Borrower considers that, in the interest
of open and fair competition, the clarification or query cannot be responded to on a
confidential basis, the Proposer should be informed and allowed to withdraw the clarification
or query if they prefer for it not to be shared with other Proposers.
15
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
It is important, therefore, to ensure that Proposers fully understand the the Borrower’s
requirements leading to the required output(s) and that these are expressed in sufficient detail
in the RFP for Proposers to be able to develop an Initial Proposal outlining the initial solution
that meets those requirements.
At one extreme, Borrowers may have developed a highly-detailed specification that sets out
very clearly what the expected outputs should be. This may take the form of a reference
design, for example, that Proposers are expected to follow. In such a scenario, it is unlikely that
Competitive Dialogue is an appropriate procurement selection arrangement, since the form of
the solution is largely prescribed, with little value to be derived from the dialogue process.
At the other extreme, the Borrower may provide only a very high statement of need, with little
direction given to Proposers as to the form their solutions should take. While this provides
significant scope for innovation and for Proposers to use their expertise and experience to
develop high value solutions, it increases the risk that Proposers will be unable to develop a
solution that meets the requirement and therefore runs the risk that the dialogue process will
not result in an acceptable solution.
Where possible, it is recommended that Borrowers adopt a position somewhere between these
two extremes. This means developing a problem definition, or statement of need, or
business/performance requirements in enough detail to provide Proposers with a clear picture
of the output required and clear steer towards an acceptable solution, while leaving room for
innovation and for the development of value added ideas during the dialogue process.
One way of doing this is to develop a high-level reference design, for example, that contains
mandatory elements, if any exist, (that Proposers must adhere to) and advisory elements (that
Proposers can deviate from by agreement with the Borrower if the deviation offers an
acceptable solution). For example, in a hospital contract, the Borrower may require certain
hospital departments to be located adjacent to each other for specific clinical reasons, and so
such adjacency may be deemed mandatory. Other departments could be in different
configurations, with no mandatory adjacency applicable, but which merit discussion in
dialogue to explore viable configurations.
16
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
10.Risk Management
The Competitive Dialogue team and sub teams should establish a risk management process.
An example is set out in Figure V.
Borrowers should consider the appointment of a dedicated risk management specialist, who
takes responsibility for the management of all risk processes including:
a. identification,
b. analysis - assessment and quantification,
c. management – avoid, mitigate, transfer, accept,
d. review.
The specialist should work closely with the Competitive Dialogue lead and across all the work
streams in order to create a comprehensive risk management plan and risk register.
It is recommended that Borrowers undertake a series of risk workshops with the Competitive
Dialogue team members, selected key stakeholders and others within the Borrower’s
organization who understand the risks likely to be involved and can assume ownership over
them. The workshops should focus on determining a range of project and procurement risks.
Typical risk categories that might be considered include:
a. Procurement Process risks,
b. political, policy and legislative risks,
c. Borrower organization’s risks,
d. reputational risks,
e. technical and design risks,
f. cost and affordability risks,
17
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
g. contractual/legal risks,
h. timeline risks,
i. environmental, social, health and safety risks,
j. implementation/construction risks,
k. operation and performance risks.
These risks, once identified, may be further allocated between a range of categories depending
on which party would bear the risk, for example, risks:
a. borne by the Borrower,
b. borne and priced by Proposers,
c. that are unquantifiable,
d. that would have a major impact on the price/cost of the contract that cannot be
managed by any party, for example, inflation or interest rate movements.
Risks can then be further analyzed by their probability and their impact, for example, those
that:
a. are deemed to have a very high, high, medium or low risk of being realized during the
Procurement Process and contract lifespan,
b. those that would have an insignificant, minor, moderate, major or catastrophic impact
(financial or otherwise) if realized during the Procurement Process and contract
lifespan.
Following assessment of all the risks, each risk should be allocated to an owner who is
responsible for its management. This should be recorded in the risk register.
The risk register should be maintained as a live document and regularly updated with the risk
profile for the procurement and kept under constant review. The top risks should be reported
to the governance body on a regular basis.
18
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
19
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
investment that will be lost if the Proposer in not successful. Therefore, Applicants are likely
to have strict internal company processes that determine whether they want to participate in
a Competitive Dialogue.
In markets where Competitive Dialogue is a relatively novel concept, potential Applicants /
Proposers may be reluctant to make such a commitment and this may be detrimental to the
level of competition that can be secured for the procurement. Therefore, early market
engagement is a critical activity in encouraging market involvement and providing information
that allows potential Applicants to make an informed decision on participation as well as
identifying any factors that may be a barrier or disincentive for their participation.
In addition, Borrowers should give thought to the level of competition likely to be present and
consider if it may be necessary to incentivize potential Applicants and Proposers to take part
in the Procurement Process by committing to underwrite some, or all of their Proposal
preparation costs, incurred while participating in the dialogue stage of the process. This means
that unsuccessful Proposers will not be at significant financial risk. If it is deemed that the use
of such an instrument is desirable, this should be fully justified in the PPSD and detailed in the
Initial Selection and RFP documents.
In considering this, Borrowers should explore the option of setting a cap on the level of
underwriting that the Borrower can offer and to the number of Proposers to whom this offer
would be available, for example, it may be restricted to Proposers taken to the final stage of
dialogue, after down-selection at the Interim Proposal stage.
20
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
21
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
1. dialogue is a highly resource intensive process and can be extremely difficult to manage
effectively if the number of Proposers is large – any more than six would most likely be
unmanageable
22
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
23
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
It may be appropriate, therefore, to include in the dialogue process an Interim Proposals step
(or more than one should this prove necessary or desirable) from the Proposers. Normally using
the evaluation criteria specified in the RRP, an assessment of Proposals can be used to
establish the relative positions of the Proposers and their direction of travel towards viable
solutions. The outcome of this evaluation may provide an indication of whether it might be
preferable at this point to down-select one or more Proposers from the dialogue process and
continuing dialogue with the remaining Proposers.
Consideration should be given to the timing of an Interim Proposals. It should take place early
enough in the dialogue process to avoid Proposers continuing to develop proposals, at a high
cost given the complexity involved, that ultimately will fail to meet the requirements or have
little likelihood of being selected as the preferred solution. However, it should not take place
so early as to deny Proposers the opportunity to present well-developed solutions capable of
full evaluation. An example would be in a procurement designed with six rounds of dialogue,
with an Interim Proposal requested after round two.
Once the evaluation has taken place, the Borrower will have the information required to
support a decision as to whether to down-select. At this point, a Proposer may be eliminated
from the dialogue process, where it is clear that there is a significant risk that they will not be
24
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
able to deliver an acceptable, value for money solution. If there is no evidence of any Proposer
falling behind the others, then a Borrower should continue with all the Proposers.
The process for down-selection should be unambiguously set out in the RFP, making it clear
that the Borrower reserves the right to down-select but is not obliged to do so.
Alternative Proposals
It is possible that a Proposer may wish to bring forward, in addition to their main Proposal, an
alternative Proposal. An alternative Proposal is a solution that deviates in some way from the
requirement set out by the Borrower, usually because the Proposer believes that such an
alternative solution might offer better value for money or enhance innovation within their
Proposals that might offer the Proposer a competitive advantage.
For example, a Proposer may bring forward a solution whereby the Borrower or a third party
provides certain elements of the requirement, rather than the Proposer. Alternatively, the
Proposer may develop a design that does not adhere to mandatory elements of the
specification, but which appears to offer cost savings.
The Borrower should specify from the outset of the dialogue process whether alternative
Proposals will be considered. If alternative Proposal are not permitted, this should be stated
within the RFP. If the Borrower is willing to consider alternative Proposals, the process for
evaluating any such Proposals should be considered carefully and set out in the RFP. If
alternative Proposals are permitted, Proposers should also be required to submit a compliant
Proposal, that is, one that fully adheres to the Borrower requirements, alongside the
alternative Proposal so that the benefits arising from the alternative Proposal can be properly
evaluated. The advantages of the use of alternative Proposals are that they can maximize the
opportunity for Proposers to develop value for money and innovative solutions that may
improve the delivered solution in some way.
However, the use of alternative Proposals can present difficulties in a Competitive Dialogue
procurement. They can often be difficult to evaluate, as the presence of an alternative
Proposal, by its very nature, means that all Proposals can no longer be evaluated on
comparable basis. The Borrower may be required to undertake significant work to carry out a
full like for like evaluation, and significant additional dialogue may be needed to establish if the
alternative Proposal is viable.
Where a Borrower decides to allow alternative Proposals, they should develop a Proposal
evaluation approach for undertaking and dealing with them and clearly state in the RFP the
basis on which any decision made to allow or disallow these in the dialogue process.
25
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Figure VII – Request for Interim Proposals Phase 3 process flow chart
For Phase 2, Request for Interim Proposals, Borrowers use the Bank’s Standard Procurement
Documents for Competitive Dialogue (this model RFP is in development at the time of
publication).
The Phase 2, Request for Interim Proposals comprises all documentation required for
Proposers to fully understand the contract requirements. The key elements include:
1. full description of the problem definition, or statement of need, or
business/performance requirements, outputs and/or results that require to be
achieved;
2. the Procurement Process and timeline;
3. details of how the dialogue will be conducted and the timeline;
4. commercial parameters;
5. contract agreement that will apply;
6. evaluation criteria and methodology to be applied to the selection of the Most
Advantageous Proposal; and
7. process for down selecting Proposals during dialogue.
Each of these elements should be fully drafted prior to commencement of the Competitive
Dialogue so that:
1. momentum can be maintained with no delay once the dialogue has started; and
2. the risk of any one Proposer influencing the content of the RFP once procurement has
already started is removed.
26
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Step 4: Dialogue
During this step the Borrower enters into dialogue with Proposers. This involves the
Borrower holding a series of separate, confidential bilateral meetings (rounds) with each
Proposer to discuss all aspects of the Proposal. Each dialogue meeting will focus on specific
aspects of the proposed solution. Each aspect should align with the work streams
described earlier, for example: technical, price/cost, commercial/financial and legal. Each
Proposer must be given an equal opportunity to participate in each dialogue round, unless
they are eliminated from the process (see down-selection).
The Borrower should indicate, in the RFP, the number of anticipated rounds of dialogue
that are planned to take place. However, additional rounds can take place to reach the
necessary degree of certainty as to the proposed solutions. There is no limit to the number
of rounds that may be necessary.
Rounds should be structured and Proposers notified, in the RFP, the topics to be discussed
and the timing for each meeting (dialogue sessions). Arrangements for rounds may include:
1. An initial meeting to ensure that Proposers fully understand the content of the RFP
and to provide an opportunity for clarification. The meeting is also likely to be the first
time that the Borrower and Proposer teams will have met, so the session presents an
opportunity to build relationships and agree how dialogue with each Proposer will be
27
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
conducted. This meeting may take place separately from the first round of dialogue
described below and scheduled as a precursor to it.
2. A dialogue round that will focus specifically on Interim Proposals. Interim Proposals will
have been submitted in advance of the dialogue session so that the Borrower may make
an initial assessment of their content. The dialogue round will provide an opportunity
for Proposers to explain the thinking behind the proposed solution, and for the
Borrower to seek clarifications and provide feedback.
Feedback should be sufficiently detailed and robust to allow the Proposer to gain
certainty that their solution is likely to be acceptable to the Borrower and that they
may continue to develop it. If the solution, or any aspect of it, is not acceptable to the
Borrower, this dialogue session is the time at which this should be made clear to the
Proposer so that no further time is wasted on developing a solution that is not likely to
meet the requirements.
3. Further rounds of dialogue will focus on all aspects of the proposed solution and
organized in accordance with the Borrower’s work streams.
Step 5 – Testing readiness
A final dialogue round should take place focused on testing the readiness to close dialogue
and invite Final Proposals. It is recommended that this round is preceded by inviting draft
Final Proposals that reflect the dialogue and feedback. A draft Final Proposal is an initial
version of the Final Proposal. Where the Borrower intends to apply this process, details
must be clearly set out in the RFP.
A draft Final Proposal should be written in exactly the same format as the Final Proposal.
It will not, however, be formally evaluated. Instead, it should be reviewed with a view to
identifying areas of Proposals that are not yet compliant or where further work is required,
through dialogue, to allow the Proposer to complete the design of their solutions and
submit fully compliant Proposals.
Once the Borrower is satisfied that two or more compliant and acceptable solutions have
emerged the Borrower should close the dialogue phase.
Following closure of dialogue the Borrower should refines the problem definition or
statement of need or business/performance requirements and should prepare addenda to
the RFP to convert it into the Phase 3 RFP.
28
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Figure VIII – Request for Final Proposals Phase 3 process flow chart
29
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Proposal Evaluation
The purpose of Proposal evaluation is to determine the ‘Most Advantageous Proposal’.
Competitive Dialogue involves the application of rated criteria. In this circumstance the Most
Advantageous Proposal is the Proposer that meets the qualification criteria and whose
Proposal has been determined to be:
1. substantially responsive to the RFP, and
2. the highest ranked Proposal.
The process by which Proposals are to be evaluated should be agreed prior to going to market
and set out in detail in the RFP. Proposers need to clearly understand how their Proposals will
be evaluated. This will influence their approach to developing their solutions as they will have
a full understanding of what the Borrower considers most important, whether this is price or
qualitative aspects of solutions, and which among the qualitative aspects is given the most
weight – for example, design, operational management approach, construction plans etc.
The Most Advantageous Proposal evaluation allows for the optimum combination cost and
non-cost attributes to be considered. It is not necessarily the lowest priced Proposal. The
evaluation process should therefore be designed to assess both technical Proposals
(qualitative) and financial Proposals (quantitative) elements and for these to be combined to
allow an overall evaluation.
There are several ways in which this can be achieved. A common method is the quality and
cost method, in which separate scores are developed for financial Proposals (quantitative) and
technical Proposals (qualitative), with each being given a weighting out of 100. For example,
price may be given a weighting of 55% and quality 45%. This weighting can be adjusted
according the importance accorded by the Borrower to either element.
1. Evaluation team: those who need to be involved in the evaluation process should be
identified from the outset and provided with sufficient guidance to enable them to be
able to carry out the evaluation role effectively.
Typically, members of the Competitive Dialogue team and sub-teams, supported by
such specialist advisors as may be required, will be involved in evaluation. However,
this group may need to be augmented by others with specific knowledge and
understanding, ideally from a user perspective, of the “needs” being satisfied by the
procurement
2. Timetabling: the periods of time during which evaluation will take place “needs” to be
known from the outset as part of the procurement timetable as set out in the RFP.
Time should be scheduled in the diaries of those to be involved in evaluation well in
advance.
30
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
1. a compliance check to ensure that the Proposals received are in accordance with
instructions and requirements of the RFP;
2. an updated check on Proposers to ensure that they still meet the qualification criteria;
and
3. an initial review noting points for clarification, which should be issued to Proposers and
responses required as quickly as possible so that evaluation is not delayed. Proposers
are not permitted to amend their Proposals at this stage. They are only permitted to
provide clarity and additional explanation where required on the content on their Final
Proposal submission.
31
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
described above. This would render unnecessary a technical score, as all aspects of
contractual dialogue can be reflected in the financial score.
The design of the technical evaluation should be part of a coherent process that considers the
problem definition, or statement of need, or business/performance requirements and how
Proposers are required to demonstrate their ability to describe a proposed solution. Evaluation
can be based on pass/fail criteria and scored rated criteria. Key considerations in designing the
evaluation criteria and evaluation methodology include:
1. develop a description of the required contract output (the problem definition, or
statement of need, or business/performance requirements);
2. a set of questions designed to test the ability of Proposals to deliver a workable
solution that meets the problem definition, or statement of need, or
business/performance requirements;
3. the questions are grouped into relevant strands (for example, questions relating to
design, operation, community benefits or management), with each strand given an
overall weighting within the technical score;
4. each question within each strand is given a weighting with the total being the overall
weighting for the strand;
5. inclusion of a minimum threshold to be set for the overall technical score below which
a solution would be deemed unacceptable and therefore non-compliant;
6. whether there are any evaluation elements where a particularly low score would render
the submission non-compliant; and
7. the use of the draft Final Proposal process described above to ensure that Proposers
are aware of such shortcomings and are given the opportunity to address these before
submitting their Final Proposal.
The result should provide an evaluation framework that allows all aspects of a Proposers
submission to be explored and tested against the problem definition, or statement of need, or
business/performance requirements.
Where an interim evaluation is to be used, for example, to down-select during dialogue, the
same evaluation criteria should be applied in the evaluation of Final Proposals. However,
Borrowers should give thought to the financial weighting applied in Interim Proposals
evaluation as it is unlikely that Proposers will have developed robust pricing at an early stage
in dialogue and so it may not be appropriate to place a high weight on financial Proposals. A
weight of 5-10 % may be sufficient to allow financial Proposals to be included in evaluation
without giving it undue emphasis. Similarly, it may be preferable for Proposers to focus their
efforts on certain aspects of their solution in the early stages of dialogue, for example design.
Where dialogue leading up to the Interim Proposals has focused on specific aspects of Proposer
solutions, these areas should be given the higher weightings in evaluation of Interim Proposals,
with areas not yet discussed in detail in dialogue so far given lower weight.
Evaluation of financial Proposals
The most common approach to scoring financial Proposals is for the lowest priced Proposal to
be given the maximum score available under the price/cost criteria and for other Proposals to
32
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
be scored in relation to the lowest. Again, there are several approaches that can be taken to
this and it is for Borrowers to decide on the methodology that works best for their contract.
The Banks standard RFP contains a suggested approach that is considered good practice,
summarized below.
What constitutes price in the evaluation of financial Proposals should be considered carefully
and defined clearly in the RFP. Points to consider for inclusion within the definition may
include:
1. the schedule of payments to be made by the Borrower to the Proposer under the
contract to be agreed between the parties over the lifetime of that contract;
2. any costs that will be incurred by the Borrower as a direct result of the Proposals
brought forward but not included in the above payment stream – for example, the
effect that the solution has on the Borrower’s own cost base if this is a differentiating
factor between solutions;
3. the inferred cost of any risk that the Borrower had envisaged being borne by the
Proposer, but which the Proposer is seeking to pass back to the Borrower. This value
could be developed by assessing the financial impact that the Borrower would sustain
should be risk be realized, combined with the estimated probability of risk realization
to give a risk-adjusted value; and
4. Any other adjustment made to price that the Borrower deems appropriate as a result
of evaluation of information supporting the price Proposals that indicates that certain
aspects of the price calculation are not sufficiently robust to be relied upon as a true
reflection of the price that will be paid.
The dialogue process should allow time for price to be discussed with each Proposer and the
value of any of the adjustments noted above made known to Proposers so that they can
consider their position prior to finalization of their Proposals.
33
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
To ensure transparency and accountability the Probity Auditor’s report (excluding all
confidential and commercially sensitive information) should be sent as an attachment to
the Notice of Intention to Award the contract, sent to all Proposers who were involved in
the dialogue, and published on the Borrower’s website.
34
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Contract Award
Following the Borrower’s decision to award the contract, and before the Notice of Intention to
Award the contract is transmitted, the Probity Auditor shall provide a probity report on all
phases of the Competitive Dialogue process. The report shall be provided to the Borrower with
a copy sent to the Bank.
Competitive Dialogue procurements are normally subject to prior review, irrespective of value
or procurement risk levels because Competitive Dialogues by nature of the complexity of the
selection method and arrangement are determined to be inherently risky.
The contract award process under Competitive Dialogue should adhere to the Procurement
Regulations requirements for contracts that are subject to prior review.
35
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
During the dialogue phase and early contract implementation, Proposers / the Contractor may
seek to:
1. allow the “means” to move apart from the “need” to, for example, improve profit
margins on the contract or to simplify the task of enacting contractual commitments;
and
2. interpret aspects of the development of their solution as changes imposed by the
Borrower rather than a refinement of the “means” by which the “needs” are delivered,
and so pass on the risk, and therefore cost, to the Borrower.
Figure IX demonstrates the impact of these behaviors and Borrowers should guard against
such behaviors and ensure that, in the period after contract award, the Contractor continues
to seek to deliver the “needs” via the “means” agreed.
36
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Contract implementation
It is essential that the Borrower prepares a contract management plan prior to the award of
the contract describing how the contract will be managed. The contract management plan
should be agreed with Proposer prior to contact award and incorporated into the contract.
Once the contract is awarded, contract implementation will continue to need careful oversight
and management to ensure that the winning solution (the “needs” and the “means”) is fully
delivered and not subject to unilateral scope reduction by the contractor.
The management of the contract implementation can be highly resource intensive, with a high
level of focus required on ensuring that the contractor delivers the solution proposed and
accepted under the Competitive Dialogue procurement, and that the “means” delivered in
reality continue to match the “needs” identified at the outset. It is preferable to have the
involvement of Borrower staff with a strong working knowledge of the contractual
arrangement.
37
38
Annex
Annex A – practice
A – Good Goodtipspractice tips
Dialogue not negotiation The Proposer must develop the “means” to satisfy the “needs”.
The process should be used to bring “needs” and “means”
together.
Issue resolution Address the difficult issues that need to be resolved from the
outset – don’t put them off until later and deal with the easy ones
first.
Level playing field Be completely transparent and fair with all Proposers:
Feedback Give good, clear, open and honest written feedback in dialogue
sessions – this reduces the risk of misinterpretation, which could
lead to challenge or failure to deliver “means” that meet the
“needs”.
Clarity of focus Be clear in dialogue about what is wanted – doing so will avoid
Proposers wasting time on elements of a solution that are not
39
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Clarifications sought Submission and response times must be reasonable – allow time
to consider these properly, but not so long that delays are caused.
Closing dialogue This should only take place once the Borrower is confident that
“means” match “needs”. This will require sound judgment as to
what remain material unresolved issues compared to points of
minor clarification that take place prior to any contract award. All
dialogues should close at the same time.
40
Annex
Annex B – Probity
B – Probity Auditor Auditor
Background
A probity audit is an assurance engagement, in which a Probity Auditor provides independent
scrutiny of a Procurement Process and expresses an objective opinion as to whether the
prescribed probity requirements have been adhered to. The conclusion expressed should be
based on evidence gathered against prescribed criteria.
Independence is essential to a probity audit. A third party to the Procurement Process should
be able to rely on the probity audit to obtain confidence that the probity requirements of that
Procurement Process have been adhered to.
Key elements of a probity audit are:
• Criteria - These are the predetermined benchmarks used to measure and evaluate
whether the probity requirements within the Procurement Process have been met. The
criteria should be clarified and agreed prior to commencement of the audit.
• Evidence - The Probity Auditor is required to obtain sufficient, appropriate evidence
for all established criteria. The Probity Auditor’s decision must be supported by robust
facts and documentary evidence. It is not sufficient for professional judgement to be
used as the justification for decisions that are not otherwise supported by the facts
and circumstances of the audit or sufficient relevant evidence. However, the Probity
Auditor will use professional judgement as to whether the evidence is adequate to
support the decision based on the determined criteria.
The results and opinion of the Probity Auditor as to whether the probity requirements have
been met are documented in a probity audit report, which includes any significant issues that
have been identified and that impact upon the opinion that the Probity Auditor provides.
Auditor Independence
Ensuring the independence of the Probity Auditor will help to make sure that they provide an
objective and impartial view of probity within the Procurement Process.
The involvement of an independent Probity Auditor provides greater assurance to the Bank
and to Bidders/Proposers wishing to do business with the Borrower as to the probity of the
Procurement Process.
Determining Independence
A key element of independence is impartiality, which “means” being free from bias and not
affected by influences or interests that compromise professional judgment.
Impartiality allows the Probity Auditor to act with integrity and to exercise objectivity in
respect of the probity engagement. For a Probity Auditor to be impartial and free from bias,
they should not be exposed to situations or relationships that may impair their objectivity with
41
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
respect to the engagement, or that may be perceived as impairing their objectivity with
respect to the engagement.
Probity auditors must not only be independent in action but must also be perceived to be
independent. The appearance of independence, as demonstrated by external facts and
circumstances, provides an important indicator of actual independence.
There are many potential threats to independence as well as potential safeguards that
mitigate these threats. A summary of these is provided below.
Threats to Independence
• Self-Interest - This occurs where the Probity Auditor stands to benefit from a
financial or significant non-financial interest in a probity client (Borrower or Supplier).
When evaluating the significance of the self-interest threat, consider the type of
interest (direct or indirect) and the materiality of the interest.
• Self-Review - This occurs where a Probity Auditor reviews their own advice. For
example, a Probity Auditor provides advice regarding probity within a Procurement
Process and then conducts a probity audit over the procurement.
• Advocacy - This occurs where the Probity Auditor promotes, or may be perceived to
promote, a Borrower’s or Suppliers position to the point that objectivity may, or may
be perceived to be, compromised. For example, this can arise where a Probity Auditor
entity promotes a particular procurement approach to market and selection method
which has not been reviewed for probity by a third party.
• Familiarity - This occurs where a close relationship between the Probity Auditor and a
Borrower or Supplier causes the Probity Auditor to become biased to the Borrower or
Supplier.
• Intimidation - This occurs where the Probity Auditor is deterred from acting
objectively, by threats (actual or perceived) from other parties associated with the
procurement. For example, a Probity Auditor may be threatened with replacement over
a disagreement over a probity issue in the Procurement Process, or have their
credibility threatened.
42
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
Conflict of interest
Conflicts of interest represent one of the potential threats to independence. A conflict of
interest means having an interest (whether personal, financial or otherwise) which conflicts
with, or may reasonably be perceived as conflicting with, the ability of the Probity Auditor to
perform their obligations fairly and objectively. Perceived or potential conflicts of interest can
be as damaging as actual conflicts of interest.
Recommended Practice
The issue of independence should be specifically considered and addressed prior to engaging a
Probity Auditor. At this stage, potential threats to independence should be considered as well
as any safeguards that might eliminate or reduce the threats to independence.
In the case of a Probity Audit, independence is essential. A third party to the procurement
should be able to rely on the Probity Audit to obtain greater confidence regarding whether the
probity requirements of that procurement have been adhered to.
Potential Probity Auditor should be required to divulge all potential threats to independence,
including conflicts of interest, at the time of offer or as soon as any conflict becomes apparent
during the probity service engagement. The Probity Auditor should be required to provide
written assurance that they have no conflict of interest in the procurement, can remain
objective and impartial throughout the engagement, and will provide notification of any
conflict of interest, or compromise to independence, that arises during the Probity services
engagement.
If the Borrower is advised of any threat to independence that has arisen during the probity
service engagement, its impact on the engagement should be considered including how the
threat will be managed.
43
44
Annex C – Sample Terms of Reference for
Probity
Annex Audits
C - Sample Terms of Reference for Probity Audits
Project Background
PCU to complete information on the background of the project
a. the Competitive Dialogue negotiation process is consistent with the applicable World
Bank Procurement Guidelines, the Procurement Documents as issued to the Proposers
and any applicable national policies or procedures;
b. the Competitive Dialogue process as conducted is fair, balanced, transparent and
conducted with integrity, so that no party is treated unfairly;
c. risks are identified and mitigating actions are taken in a timely, effective manner;
d. probity principles are applied and probity practices are applied with integrity.
Scope of Work
The Probity Assurance Auditor shall:
45
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
a. Conduct a risk assessment and identify possible probity issues that may arise
before the Competitive Dialogue process commences (for more detailed
information on risk assessment, refer to the ICAC's publication Practical Guide
to Corruption Prevention: Module 2 - Corruption Risk Assessment and
Management).
b. Provide impartial advice to the Borrower, as necessary or as requested, on how
emerging issues can be resolved or managed, for example, conflicts of interest.
However, it must be emphasized that the Probity Auditor is not part of the
decision-making process.
c. Assist with improving the level of decision-making, if the circumstances so
warrant.
d. Observe and document the process followed and document and report on any
probity issues that may arise.
e. Liaise with other departments of the Borrower, if appropriate, for example,
Ministry of Legal Affairs, tax authorities, etc.
3. Document information and report to the organization
46
Guidance - How to undertake a Competitive Dialogue Selection Arrangement
47
For additional information about the World Bank Procurement Framework,
including Standard Procurement Documents (SPDs), Guidance, briefing, training
and e-learning materials see www.worldbank.org/procurement