IT Applications Services Panel

Invitation to Respond to
Statements of Work*
Statements of Work* Title:

Testing Services

CLOSING TIME:
11:00 AM Tuesday 21st December 2011

ISSUED BY:
DELETED*, IT Sourcing and Commercial Office
 Table of Contents

PART A STATEMENTS OF WORK* (SOW 105).......................................................5

A1 - INTRODUCTION................................................................................................5
A1.1 Sourcing and Business Objectives...........................................................5
A1.2 Background....................................................................................................5
A1.3 Services*.........................................................................................................6
A1.5 Structure of Invitation to Respond and Process..................................13
A2 - STATEMENT(S) OF WORK*..........................................................................15
A2.1 Submission...................................................................................................15
A3 - CONDITIONS...................................................................................................16
A3.1 Exclusion of liability...................................................................................16
A4 - SELECTION PROCESS.................................................................................16
A4.1 BAFO Process..............................................................................................16
A5 - CLARIFICATION OF STATEMENTS OF WORK*........................................16
A6 - PRESENTATIONS...........................................................................................17

PART B CONTENT REQUIREMENT AND SUPPLIER*’S

STATEMENT OF WORK FORM*.................................................................................18
B1 - NOTE TO SUPPLIER*....................................................................................18
B2 - IDENTITY OF SUPPLIER*.............................................................................18
B3 - EVALUATION CRITERIA...............................................................................18

PART C QUALITATIVE REQUIREMENTS..............................................................19

C1 - CAPABILITY (WEIGHTING 40 %).................................................................19
C1.1 Experiences and Track Record................................................................19
C1.2 Resourcing...................................................................................................19
C1.3 Technical Skills............................................................................................20
C1.4 Quality Control.............................................................................................20
C2 - DELIVERY APPROACH (WEIGHTING 60 %)..............................................20
Strategic Objectives..............................................................................................20
C2.1 Processes Methodology............................................................................21
C2.2 Governance..................................................................................................21
C2.4 Engagement Management.........................................................................21
C2.5 Ability to Integrate with EB Processes / other External
Service Providers........................................................................................22
C2.6 Coordination of Subcontractors..............................................................22
C2.7 Knowledge Transfer and Management...................................................22
C 2.8 Management of Testing Undertaken by Third Parties.........................22
C2.9 Non-Functional Testing..............................................................................23
C2.10 Managed Testing Services........................................................................23
C2.11 Test Estimation............................................................................................23
C2.12 Adherence to Standards............................................................................23
C2.13 Test Methodologies.....................................................................................24
C2.14 Test Process Improvement (TPI)..............................................................24
Document Name: Testing Services - Invitation to Respond
 C2.15 Testing of Support Work............................................................................24
C2.16 Access to Testing Competencies............................................................24
C2.17 Defect Prevention Techniques.................................................................24
C2.18 Test Environment Solutions.....................................................................24
C2.18 Test Tool Solutions.....................................................................................25
C2.19 Essential Test Areas...................................................................................25

PART D - OTHER REQUIREMENTS.......................................................................26

1.1. SOW* Departures.........................................................................................26
1.2. SOW*..............................................................................................................26
1.3. Alternative Proposals.................................................................................26

INVITATION TO RESPOND ACKNOWLEDGEMENT FORM...................................28

Document Name: Testing Services - Invitation to Respond

Document Revision

Original Draft 14 October 2011

Final version 24 November 2011

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

PART A STATEMENTS OF WORK* (SOW 105)

A1 - INTRODUCTION
A1.1 Sourcing and Business Objectives
EB is seeking a suitable Supplier* to provide testing Services*in order to satisfy the
following objectives:

 Improve the reliability and stability of EB IT environments;

 Adopt a risk based approach to testing;
 Reduce project costs and time by reducing defects moving into production;
 Provide evidential business value of testing to key stakeholders;
 Maintain access to a scalable resource pool of cost-effective testing professionals with
proven skills, qualifications and experience and proficiency in EB systems and
technologies;
 Access to resources on short notice (less than 1 week);
 Facilitate knowledge transfer across EB and retain intellectual property in testing
services and content;
 Maintain access to an integrated end-to-end testing toolset that facilitates a
methodological approach to testing services;
 Implement best practice testing service methodology and governance;
 Implement test capture mechanisms to enable automated testing for regression and
disaster recovery testing;
 Maintain access to a scalable, on-demand testing environment that provides
integration between EB’s major applications; and
 Move the Services* provision to a unit Price* based method of charging by the end of
the first year of the proposed SOW*.
A1.2 Background
EB currently performs application testing via its in-house Quality Centre (QC) team within
the Application Services Delivery section of EB’s IT Branch.
This Quality Centre team coordinates and performs application, system, integration,
performance/load, and regression testing (where necessary) as well as assisting the
business in the development and execution of User* Acceptance* testing for projects that
are part of the IT Branch portfolio and the Foundation Transformation Program (FTP)
Branch.
The manner in which the Quality Centre is engaged differs from IT Branch to FTP. The
Quality Centre is engaged by the Project Management Office, responsible for the
governance, commissioning, management and coordination of projects within the IT
Branch portfolio. FTP projects choose to engage the Quality Centre on a project by project
basis, with each project having their own project management methodology and approach
to testing.
As EB proceeds with its strategic program of work, carried out by FTP, and IT Branch’s
technology upgrade program the demands on this team are increasing. Resourcing in the
Quality Centre is augmented by third parties, as required, to meet demand. Constant
changes in project priorities and deadlines are resulting in a high degree of planning and
coordination as well as re-work and revision.
EB utilizes, where possible, commercial off-the-shelf (COTS) packages. It does not
currently have the expertise and maturity to enforce minimum testing standards on

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

vendors and service providers and is not able to demand visibility of and monitor testing
undertaken by Third Parties*.
Coupled with this inflexible and complex resourcing model, EB has not invested in a
comprehensive test suite and has a rigid test environment that is in high demand by
multiple projects, often with competing requirements.
This has resulted in project delays, inadequate testing and projects incurring actual and
perceived unnecessary costs.
The EB IT landscape consists of the following key technology areas:
 Service Oriented Architecture (SOA) using Software AG’s Webmethods platform;
 Extract, Transform Load (ETL) using Informatica tool set;
 Business Intelligence using IBM’s Cognos 8 as it’s primary reporting tool;
 Enterprise Resource Planning using Mincom’s Ellipse 6.3;
 Geographic Information System (GIS) using ESRI and Telvent software;
 Mobile Solutions using Mincom’s suite of mobile solutions;
 Primavera Project Management tools;
 Customer Care and Billing System (CC&B) using Oracle software; and
 MBS Hub provided by Hansen Technologies.

A1.3 Services*
EB requires the following Services*/Deliverables* to be provided by the successful
Supplier* under the agreed Statement of Work* in a Phased Approach.
Phase 1 – Transition and Set Up – 3 month period.
Phase 2 – Testing Base Services – 3 year duration commencing on execution of this SOW*
The required timeframes for Phase 1 & 2 Services*/Deliverables* are detailed in the
following section A1.4.

1. Development of Governance and Organisational Structure- (Phase 1)

The Supplier* shall work with EB to develop a testing Services* organisational structure
that best supports the needs of EB. Such a structure shall incorporate the roles retained in-
house by EB (see Attachment A). The Supplier* shall develop, in conjunction with EB a
robust governance model to support the ongoing management of the testing Services*. The
developed model shall be working towards best practice in testing Services* and take into
account the existing EB resources/skills set, all relevant standards, methodologies,
planning, performance measurements, reporting; risks etc.

 Deliverables:
1. An agreed Organisational Structure for Testing Services*; and
2. An agreed governance model

2. Development of Test Policy & Strategy – (Phase 1)

The Supplier* shall work with the EB QC team and key stakeholders to develop a robust
‘Test Policy’ and ‘Test Strategy’. The ‘Test Policy’ and ‘Strategy’ shall set out how EB can
achieve higher rates of defect detection and removal, lower development costs, lower
maintenance costs, lower total cost of ownership (TCO), shorten development schedules
and provide greater satisfaction among customers of IT solutions.

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

The Test Policy and Strategy should adhere to the recognised industry best practice and
standards such as terminology and referential material defined in ISEB/ISTQB, IEEE
standards specific to testing, ISO standards specific to testing, and industry recognised
Capability Maturity Models.
The ‘Test Policy’ shall reflect the values and goals of EB and address the test activities for
new development projects and support work.
The ‘Test Strategy’ shall cover the generic test requirements for EB including the value to
EB business by conducting testing and tangible and intangible benefits to IT Branch, FTP
Branch, external service providers, vendors of COTS packages, development teams and the
Quality Centre Team.

As a minimum the ‘Test Strategy’ shall define the following topics:

1. Standards to comply to;
2. Third Party* testing management and monitoring;
3. Measurements and metrics to be applied;
4. Levels of testing;
5. Types of testing;
6. Entry and exit criteria for each level;
7. Test control and reporting;
8. Approach to incident management;
9. Configuration management;
10. Completion criteria;
11. Testing techniques to be used at each test level;
12. Integration procedures;
13. Approach to testing support work; and
14. Continuous test process improvement.

 Deliverables:
1. An agreed Test Policy reviewed and signed off by the EBQC team and
stakeholders;
2. An agreed Test Strategy reviewed and signed off by the EBQC team and
stakeholders;
3. Templates for Testing Artefacts (Test Plan, Test Case templates etc.); and
4. Associated Implementation plans.

3. Testing Methodology & Process- (Phase 1)

EB, currently, loosely follows Sequential (Waterfall) and iterative Testing Methodology on
IT projects, where Project Management typically stipulate the test methodology utilized on
projects. The Supplier* shall work with EB to develop an organisation wide, industry
strength test methodology and test process that address areas such as static testing; system
and system integration testing; functional and non-functional testing; user acceptance
testing; regression testing; performance, volume, load and soak testing; penetration and
security testing and infrastructure testing etc.

The Supplier* shall work with the EB QC team to Develop* and implement a robust test
methodology catering to EB's unique challenges. The Test process must outline the
following fundamental topics and as a minimum shall detail the testing activities and tasks
associated with each topic:

1. Test Planning and Control;

2. Test Analysis and Design
3. Test Implementation and Execution;
4. Evaluation of Exit Criteria and Reporting;
5. Test Closure; and

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

6. Test Estimation Framework.

 Deliverables:
4. Test Management process Documentation*.

5. Non-Functional Testing- (Phase 1)

The Supplier* shall provide Non Functional testing Services*, which will include but is not
limited to:

 Load and performance testing;

 Stress and volume testing;
 Scalability Testing
 Operational acceptance testing;
 Recovery testing;
 Disaster recovery testing;
 Data conversion and migration testing;
 Installation Testing;
 Compatibility Testing (Evaluation of an application's compatibility with
the computing environment.);
 Security/ Penetration testing; and
 Usability testing.

The Supplier*, in consultation with the EB QC, shall first develop a Non Functional Testing
Options to present to EB. This will drive the development of the Non-Functional Testing
Strategy.

 Deliverables:
1. Non-Functional Testing Options; and
2. Non-Functional Testing Strategy;

6. Testing of Support Work- (Phase 1)

A significant portion of EB IT workload is support work, undertaken by in-house
development teams and Third Parties*, in the form of enhancements, bug-fixes, and
changes necessary to keep IT Systems* operational and current. Changes can be to IT
Systems* or to the underpinning infrastructure.

The Supplier* is required to Develop* and implement a Strategy for Testing support work.

 Deliverables:
1. Support Work - Testing Strategy.

7. Testing Tools - (Phase 1)

EB’s investment in testing tools is limited to HP Quality Centre and HP Quick Test Pro. EB
has not invested in industry strength load / performance testing tools and it is unlikely that
capital will be allocated to implement a full suite of testing tools. As a result, EB requires
the Supplier* to provide EB access to testing tools to either replace or complement the
existing tool set. It is preferred that such provision be based on a service cost per use/test
case/test script etc, as opposed to the purchase of specific licences. The Supplier* will be
required to provide a “Test Tool Strategy”, incorporating the associated implementation
plan, administration and management together with a pricing schedule for the provision of
the Test tools.

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

 Deliverables:
1. Test Tool Strategy;
2. Tool Implementation Plan;
3. Administration and management procedures; and
4. Test Tool Price Schedule

8. Regression Testing & Test Automation - (Phase 2)

Wester Power* currently holds licenses for HP Quick Test Pro, which is the test automation
tool of choice in EB. However, EB does not have automated regression tests that can be
regularly executed. The Supplier* shall work with the EB QC team to progress to
automated test cases that are then available for regression testing. The Supplier* shall be
required to develop an overall strategy and implementation plan for this work.

 Deliverables:
1. Test Automation & Regression Test Options
2. Automated Test Strategy;
3. Regression Test Strategy; and
4. Test Automation & Regression Test Implementation Plan.

9. Testing Environments - (Phase 2)

EB currently has rigid development and test environments that are difficult to duplicate
and are not under change control. These environments require a large lead-time to set up,
are costly, lack architectural consistency and integration to critical applications. There is
also increasing demand and contention between projects for both priorities and timelines.
Integration between major EB applications is generally not available in most dev/test
environments.

The Supplier* shall carry out detailed analysis and due diligence of EB’s existing test
environments. The Supplier* shall provide an “Environment Options Report” and high
level costed proposals to provide cost effective, efficient infrastructure test environment
provisioning and management. EB wishes to move to a “unit cost” testing environment
that can be set up and pulled down as requirements dictate.

The Supplier* shall provide an Environment Test Strategy outlining the processes for
environment management, change and release management, data management, security
and access management. The Test Strategy should also address an approach to upgrade
and maintain environments so that environments are current and relevant.

 Deliverables:
1. Analysis of current environments;
2. Test Environment Options Report (incorporating High Level Costed
Proposals); and
3. Test Environment Strategy

10. Resource Availability and Knowledge Retention - (Phase 1 & 2)

Western Power has a small test team that currently lacks the bandwidth to carry out testing
on all projects that require testing. The current team’s activities are predominately set
around the coordination of testing priorities and environments rather than the testing
itself. Flexibility in resourcing is currently limited to contractor augmentation. Intellectual
property and knowledge retention is fractured with this ad-hoc approach to resourcing.

EB seeks to implement a blended Testing team, consisting of in-house EB testing

professionals in partnership with testing professionals from the Supplier*. This will form

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

the core Testing team and is to be supplemented by additional testers from the Supplier* as
and when required.

The Supplier* shall provide resourcing for Testing ‘Base’ Services* from the
commencement of the SOW* in the form of four (4) Key Personnel* to cover the roles and
responsibilities in the following table:

Role Responsibilities
1. Test Program Manager To work with EB in developing and delivering the Phase 1
and Phase 2 Deliverables*. To provide leadership and Test
Program management for the ongoing baseline Services*
and to provide the conduit back into the Supplier*
organisation and appropriate specialists. To work with EB
in the review of resource planning over a full portfolio.
2. Senior Test Analyst To carry out testing Services* on IT and FTP projects and
Business as Usual (BAU) programs of work.
3. Test Analyst To carry out testing Services* on IT and FTP projects and
Business as Usual (BAU) programs of work.
4. Test Analyst To carry out testing Services* on IT and FTP projects and
Business as Usual (BAU) programs of work.

The Supplier* shall also be required to provide:

 Access to a scalable resource pool of cost-effective testing professionals with
proven skills, qualifications and experience - for the duration of the
engagement;

 Access to resources on short notice, one to four weeks, or with adequate notice,
four weeks or greater.

 Access to a regular pool of testing professionals who are proficient in the use
of EB Systems* and technologies.

The above short term non-base Service* resources will be engaged on a time and materials
Price* basis.
The Supplier* shall also provide a structured plan and methodology in respect of
knowledge transfer between EB and the Supplier*

11. Managed Testing Services - (Phase 2)

EB seeks to transition the provision of Testing Services* in to a true managed Services*
model during the course of the engagement. The Supplier* is required to provide an
options report specifying suitable services for transition to a managed Service* model,
prerequisites, proposed timelines and plans.

Following the Acceptance* of the Option Paper, the Supplier* shall Develop* a Managed
Testing Services* Strategy with agreed timelines and plans for the implementation; in
addition to Service Level Agreements.

 Deliverables:
1. Managed Testing Services* Options Report; and
2. Managed Testing Services* Strategy.

A1.4 Deliverables* / Services* Timelines

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

EB wish to meet the following timelines in respect of the Services* and associated
Deliverables*:

Completion Dates
Deliverable*/Service* 1st Draft for Final Phase 1 Phase 2
Review by Draft for
EB Sign Off
by EB
Development of
Governance and
Organisational
Structure
Organisational 1/04/12 -
Structure

Governance Model 1/04/12 -

Test Policy &

Strategy
Development
Test Policy 1/03/12 -

Test Strategy 1/04/12 -

Implementation 1/04/12
Plans

Templates for Testing 1/04/12 -

Artefacts

Testing Methodology

Test Management 1/04/12 -

Process
Documentation*

Non-Functional
Testing

Non-Functional 16/03/12
Testing Options
Non-Functional 1/04/12
Testing Strategy
Testing of Support
Work

Support Work 1/04/12

Testing Strategy
Testing Tools

Test Tool Strategy 16/03/12

Tool Implementation 1/04/12
Plan
Administration and 1/04/12

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

Management
Procedures
Test Tool Price 1/04/12
schedule
Test Environment
Strategy

Analysis of Current - 01/06/12

Environments

Test Environment - 15/06/12

Options Report
(incorporating High
Level Costed
Proposals)
Test Environment - 30/06/12
Strategy

Regression Testing &

Test Automation
Approach
Test Automated & - 01/06/12
Regression Test
Options
Test Automation - 15/06/12
Strategy

Regression Test - 15/06/12

Strategy

Test Automated & - 30/06/12

Regression Test
Implementation Plan
Managed Testing
Services
Managed Testing 15/06/12
Services* Options
Report
Managed Testing 30/06/12
Services *Strategy
Resource Availability Commencement
and Knowledge Dates
Retention
Resource 1 - - 01/02/12 01/05/12

Resource 2 - - 01/02/12 01/05/12

Resource 3 - - 01/02/12 01/05/12
Resource 4 01/02/12 01/05/12

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

A1.5 Structure of Invitation to Respond and Process

The purpose of this invitation is to select a Supplier* from the IT Applications Service*s
Panel for the provision of Services* to EB via the execution of a Statement of Work*
(SOW*):
SOW 105: Testing Services

Two-Phase Dependent SOW*

The Service*s to be provided under this SOW* will be delivered in two dependant phases
as defined in A1.3 Services*.
The successful Supplier* to this SOW* will conduct Phase 1 Service*s and present the
Deliverables* to EB for consideration and evaluation. If EB deems the Deliverables*
delivered in Phase 1 to be acceptable, the Supplier* may be requested to continue to
execute the Phase 2 ongoing Testing Base Service*s.
If EB, at its absolute discretion, deems the Deliverables* presented by the Supplier* at the
end of Phase 1 to be unacceptable, EB reserves the right to go back to the market via a new
ITR/SOW* to seek responses from the IT Application Supplier*s for the Service*s defined in
Phases 1 & 2.

EB Retention of Intellectual Property

Supplier*s are to note that all Intellectual Property (IP) Developed* by the Supplier* in
Phase 1 Deliverables* will vest solely in EB, who shall have the absolute right to use such
IP in any way it chooses, including but not limited to using the Deliverables* from Phase 1
in any subsequent commercial process .
The following are the significant milestone dates relative to this Invitation to Respond.

Milestone SOW 006

SOW* Issued 28th November 2011

Clarification Sessions 12th December 2011

SOW* Closes 11:00 A.M. 21st December 2011

Nominate preferred Supplier* 16th January 2012

Internal Approvals / Final 23rd January 2012

Negotiations

Execute SOW* 27th January 2012

Commence Phase 1 Services* 1st February 2012

Complete Phase 1 Services* 30th April 2012

Commencement of Phase 2 Services* 1st May 2012

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

A2 - STATEMENT(S) OF WORK*
A2.1 Submission
Suppliers* shall submit the response to the Statement of Work* by email:

Mark to the attention of

DELETED

Supplier*’s responses to the Statement of Work* must be received by EB on or before the

“Closing Time” stated within this invitation document. EB may, in its’ discretion, elect to
consider or reject responses to the Statements of Work* that are received after the “Closing
Time”.
Supplier*’s should confirm EB’s receipt of their responses by phoning the recipient at
either of the contact numbers defined below.

A2.2 Statements of Work* Validity Period

The validity period for this Statement of Work* is for a period of 180 days.

A2.3 Contact Persons

Enquiries relative to this Statement of Work* should be directed to:

Name: xxx
Title: IT Commercial Manager
Telephone: (xxx) – Mobile Phone – yyy

E-mail: DELETED

The Supplier* must not contact any other person within EB in respect to this Statement of
Work*.
The Supplier* may rely solely upon the information contained within the related Statement
of Work* and this covering Invitation to Respond, and any other formal communication
provided by the contact persons. Any information obtained by a Supplier* from any other
means, source or person should not be considered when responding to this Invitation to
Respond for Statement of Work* 105.

A3 - CONDITIONS
The conditions under which the response to the Statement of Work* are submitted are
those referred to in clause C.4 and C.5 in the Master IT Supply Contract* entered into
between EB and the Supplier*.
A3.1 Exclusion of liability
(a) The Supplier* will bear entirely and exclusively all costs and expenses incurred
and in any way associated with developing, preparing and submitting its response to the
Statement of Work*, including attending meetings, site visits and interviews and providing

Document Name: Testing Services - Invitation to Respond

 Part A - SUPPLIER* TO KEEP THIS PART

any additional information required by EB irrespective of whether or not the Supplier*’s

Statement of Work Form* is accepted or rejected.
(b) Without limiting clause A3, EB is not liable for any loss, expenses, costs or
damages incurred by the Supplier* in relation to the preparation or submission of a
Statement of Work* or subsequently in negotiations or otherwise arising from the process.
(c) This exclusion applies in relation to this Statement of Work* and also in relation to
any other oral or written communications or disclosures to the Supplier* by EB.

A4 - SELECTION PROCESS
Value for money is a key objective to ensure that when purchasing products and/or
Services*, EB achieves the best possible outcome, for every dollar spent, by assessing the
costs and benefits of, and the risks inherent in, any Statement of Work*, rather than simply
selecting the lowest Price*.
In determining value for money, EB will assess:
(a) the ‘Qualitative Requirements’ detailed herein;
(b) the Estimated Total Cost* of the submitted response to this Invitation to Respond and
Statement of Work*; and
(c) the assessed risks associated with each response.
The determination of value for money will require a consideration of all of the above
factors and any other matters that EB considers relevant.
A4.1 BAFO Process
Supplier*s are to note that EB does not intend to undertake a “Best and Final Offer”
(BAFO) stage in the assessment and award of t Statement of Work*.

A5 - CLARIFICATION OF STATEMENTS OF WORK*

Suppliers* are advised that EB will conduct one, two-hour clarification session for each
Supplier (if required) on Monday 12th December 2011 at the premises of Western Power IT
Branch. Supplier*s are to contact EB to reserve a slot for these sessions at their earliest
convenience. No other formal evaluation sessions will be held.
Supplier*s should direct ad-hoc queries/clarifications to the contact persons defined in this
Letter of Invitation. Western Power will determine how to respond to the clarification at its
discretion, and will share any clarification response with other Supplier*s if, at its
discretion, EB considers the response clarification to be of a material nature.

A6 - PRESENTATIONS
Suppliers* may be requested to provide a presentation of their proposed offer to the EB
Evaluation panel and other key stakeholders the week commencing 9th January 2012. Such
a presentation will be to provide clarity to any proposal and provide the Evaluation panel
to seek further detailed information in that respect.

Document Name: Testing Services - Invitation to Respond

 Part B - SUPPLIER* TO COMPLETE AND RETURN THIS PART

PART B CONTENT REQUIREMENT AND SUPPLIER*’S

STATEMENT OF WORK FORM*

PART B SHOULD BE COMPLETED BY THE SUPPLIER* AND IMMEDIATELY RETURNED

TO EB.

B1 - NOTE TO SUPPLIER*
In preparing its response to the Statement of Work*, the Supplier* must:
a) address each requirement in the form set out in Part B;
b) take into account the Statement of Work* requirements. The Supplier* must read
these in conjunction with the Master IT Supply Contract*;
c) in respect of the ‘Qualitative Requirements’, provide full details of any claims,
statements or examples;

B2 - IDENTITY OF SUPPLIER*
The Supplier* must provide the following details:

SUPPLIER* TO COMPLETE:
(a) Name of Supplier* ......................................................................................
(b) Contact Person: ......................................................................................
(c) Email: ......................................................................................
(d) Telephone: ......................................................................................
(e) Facsimile: ......................................................................................
NB: The Statement of Work Form* does not require the Supplier*’s signature until
such time as it is required to be executed by EB (Master IT Supply Contract* Clause
C5.1(g).

B3 - EVALUATION CRITERIA
The responses to this Statement of Work* will be assessed according to the key “Value for
Money” objectives outlined in Section A.4 of this document. The following requirements
are to be specifically addressed by the Supplier*s in their responses.

EB reserves the right to reject any Statement of Work* that does not properly address and
satisfy any of the Qualitative Requirements.
EB is seeking the following documents as part of a response from the Supplier*s:
(a) a document of not more than 40 pages (plus appendices) addressing all of the
“Qualitative Requirements” detailed in Part C.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

PART C QUALITATIVE REQUIREMENTS

In answering the qualitative requirements, Supplier*s should note the following:

 Supplier*s must address each qualitative requirement using the headings provided;
 Supplier*s should address each issue outlined within a qualitative requirement;
 Supplier*s should assume that the Evaluation Panel has no knowledge of the
Supplier*’s organisation, its activities, experience or any previous work undertaken;
 Supplier*s should provide full details for any claims, statements or examples used to
address the qualitative requirements; and
 Supplier* responses should be relevant to Western Power.

Supplier*’s responses will be evaluated against the following qualitative requirements and
weightings.

C1 - CAPABILITY (WEIGHTING 40 %)
C1.1 Experiences and Track Record
The Supplier* must describe its previous experience and level of success in respect to
previously completed contracts in the implementation of testing services in the IT arena.

The project delivery experience must include details of the scope of the engagement and
outline how any issues arising during the provision of the obligations were dealt with and
if the overall scope under those contracts was completed within budget, on time and to the
required standard.

The Supplier* must also provide in the following table the project names, contact names
and contact numbers of referees from the cited project(s).

Company Name Contact Name & Contact Project

Position Phone
Number

C1.2 Resourcing
The Supplier* must detail the following in respect to the resourcing requirements:

 how it intends to resource for the Base Services* including how continuity of Services*
to cover sickness, leave, training etc of the Key Personnel* will be provided;

 how it intends to provide the additional flexible resourcing to scale up and down to
meet the project pipeline, including likely timeframes for on-boarding resources;

 if the Supplier* intends to provide offshore resource capability and how this will be
provided;

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

 how it intends to provide a regular pool of testing professionals who are proficient in
the use of EB Systems* and technologies;

 how it intends to provide testing professionals with proven skills, qualifications and
relevant experience;

 how it intends to provide resources on short notice (one to four weeks) and with
adequate notice (four weeks or more); and

 if it intends to Subcontract* any of the Services*; if so,

 provide a list and full details of proposed Subcontractors* who are to be

utilised to carry out the Services* together with the obligations to be sub
contracted and similar projects undertaken by the subcontractor.

C1.3 Technical Skills

Technical skills’ refers to the ability of the Supplier* to provide the Key Personnel* who are qualified
to perform the Services* and to provide technical advice if and when necessary to complete the
Supplier*’s obligations.

The Supplier* must provide details and evidence of the experience, technical skills and
qualifications of the Key Personnel* to be allocated to perform the Supplier*’s obligations
relative to the Transition Services* and ongoing base Testing Services* being delivered.

The Supplier* must provide EB with the C.V. for these resources, outlining the skills that
relate specifically to the technical skill set requirement for the Service*s to be provided
under this Statement of Work*. The Supplier* shall also advise the availability of the Key
Personnel* relative to EB’s timeframes for Transition and the ongoing Testing Services*.

C1.4 Quality Control

The Supplier* must outline the standards, processes and strategies that will be utilised to
check the quality of the Services* to be provided under this Statement of Work*

C2 - DELIVERY APPROACH (WEIGHTING 60 %)

Strategic Objectives
The provision of Testing Services*, by the Supplier*, shall contribute to EB strategic objectives in
the areas of Service Management, Project Management, Customer Satisfaction and the management
of Operational Expenses.

The EB strategic objectives are as follows.

 Core IT Systems* availability: Testing strategies to specifically address continuity

of core business critical IT Systems*.
 Core IT Systems* reliability (number of major incidents per month) - Testing
strategies to minimize interruptions to business critical IT Systems*.
 IT projects delivered on schedule, within budget and to sponsor satisfaction:
Contribute to project objectives of budget and schedule through early and reliable
identification and mitigation of product risks for Systems* under test. The
provision of early and accurate test-estimates in to the project planning cycle to
ensure project schedules are accurate and include sufficient testing. Robust test
scheduling procedures to monitor and actualize changes to testing scope and
estimates.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

 Customer Satisfaction: Improve business satisfaction in IT Systems* by

minimizing interruptions to and contributing towards continuity of business
critical Systems*.
 Operational Expenses: Minimize spend on Operational Expenditure by reducing
the number of undetected defects leaking in to the live environment - thereby
reducing the support costs of a System*.

The Supplier* must outline how it can deliver Testing Services* expertly and efficiently
while proving quantifiable value for money benefits and contributing to EBs strategic
objectives.

C2.1 Processes Methodology

The Supplier* must outline the processes and approach they will undertake to develop the
testing Services* model with EB including any methodologies that will be deployed in the
development of the Phase 1 and 2 Deliverable*s.

Supplier*s should expand on how the deployment of these processes, tools and
methodologies would add value to EB with respect to the provision of the Testing
Services*.

The Supplier* should include details of resource commitments for EB to enable them to
effectively manage their time during the Transition Phase (Phase 1).

C2.2 Governance
The Supplier* must define what Governance mechanisms and methodologies will be
implemented to ensure that EB’s business needs are met.

The Supplier* shall also provide their proposed service level regime metric that they would
employ to maintain the quality of Services* provided to EB. Service level metrics are to be
defined for the following areas.

 Individual Testing Services* proposed by the Supplier*.

 Engagement between the Supplier* and EB.

 Service Level Agreements* that govern the Services* provided by the blended team
of test professionals.

The Supplier* should also provide the governance/probity/conflict of interest

methodologies and procedures they would employ in the situation where the Supplier*
may be testing their own company’s Developed Software*/Systems*.

C2.4 Engagement Management

The Supplier* must outline how they intend to deliver the requested Services*.

Specifically the Supplier* must identify the Key Personnel* they intend to mobilise in the
delivery of the Phase 1 and 2 requested Services*; a proposed implementation plan for
providing the Phase 1 Deliverables as well as their proposed Organisational Structures and
Engagement Models that will underpin the delivery of these Services*.

C2.5 Ability to Integrate with EB Processes / other External Service Providers

As the delivery of the required Services* under this Statement of Work* is likely to involve
liaison between multiple entities, including EB and other external service providers, the

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

Supplier* must define the mechanisms/processes/methodologies etc that they propose in

order to manage the provision of the Services* in a multi-sourced environment.

C2.6 Coordination of Subcontractors

The Supplier* must describe how the management and coordination of Subcontractors* (if
any) will be conducted, to address issues such as quality, performance, timeliness and/ or
reporting and ensure that the Supplier*’s obligations and EB’s business needs are met.

C2.7 Knowledge Transfer and Management

The Supplier* shall detail the approach, systems, tools and processes to be adopted to
enable knowledge management in a blended test team structure. In particular, the
Supplier* shall address the following:

 facilitation of knowledge transfer across EB testing professionals and testing

stakeholders (knowledge transfer of Supplier*’s systems, processes and tools);
 facilitation of knowledge transfer across the Supplier*’s resource pool,
particularly any new Personnel*;
 retention and development of intellectual property in testing services and
content; and
 how it intends to access any global knowledge and ‘best practices’ held within
it’s own organisation in fulfilling it’s obligations in respect of the Services*
provided.

C 2.8 Management of Testing Undertaken by Third Parties

IT and FTP Branch strategy towards application and System* development in EB is to utilize,
where possible, Commercial Off-The-Shelf (COTS) packages and to appoint dedicated External
Service Providers (ESP) in the development and integration of large scale application projects.
Projects under the FTP Branch portfolio adhere closely to this strategy.

There is a school of thought in EB that Vendors of COTS packages and External Service Providers
appointed to Develop* application and integration solutions, should conduct the bulk of testing. At
present, EB does not have the expertise and maturity to enforce minimum testing standards on
Vendors and Service Providers at the time of awarding contracts and Statements of Work*. EB also
lacks the ability to demand visibility of and monitor testing undertaken by Third Parties*.

The EB infrastructure environment landscape is diverse and complex with Third Parties*
responsible for the management of upgrades and changes to the environments. Western Power does
not have a strategy around the testing of infrastructure.

The Supplier* must outline:

 how it proposes to manage testing undertaken by Third Parties*; and

 typical Service Level Agreements to enforce, manage and monitor testing

undertaken by Third Parties*;

The Supplier* is required to propose policies, strategies and industry best practice and
approaches to testing changes to the infrastructure environments.

C2.9 Non-Functional Testing

The Supplier* shall outline how it proposes to provide Non-Functional Testing Services,
specifically;

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

 the frequency, ease of access and cost of accessing the Supplier*'s Non-
Functional Testing expertise and competencies;

 prerequisites for implementing a Non-Functional Testing service;

 tools and environments, with cost estimates; and

 service provision models such as performance testing as a service.

C2.10 Managed Testing Services

The Supplier* shall propose how it can transition the provision of suitable Testing Services
to a Managed Testing Services model over the term of the engagement. The proposition
shall outline timelines, phases and inputs necessary for a successful transition and the
Testing Services the Supplier* deems suitable to transition. The end goal of the transition
shall be unit price based model for the Managed Testing Services.

C2.11 Test Estimation

The Supplier* shall propose Test Estimation methods and techniques that address the
following objectives.

 A risk based approach to test estimation which takes in to account complexity

and criticality of an application or system.
 The ability to produce early and accurate test estimates.
 The ability to produce test estimates that can be easily fed in to project
planning activities.
 The ability to produce robust test estimates that can be adjusted as and when
scope and assumptions change.
 Test Estimates that are easily communicable to all project stakeholders.

C2.12 Adherence to Standards

The Supplier* must outline compliance and adherence to industry best practice, standards
and capability maturity models; with particular attention, but not limited to the following.

 ISO 9126 Software Engineering Product Quality.

 ISO 12207 Systems and Software Engineering - Software Lifecycle processes.
 IEEE 829 (1998) Standard for Software Test Documentation,
 Capability Maturity Model (CMM),
 ISEB/ International Software Testing Qualifications Board (ISTQB)
Certification.
C2.13 Test Methodologies
The Supplier* shall propose test methodologies or an approach for determining test
methodologies that are suitable for EB. IT projects utilize a loosely applied sequential and
iterative methodologies on projects.

C2.14 Test Process Improvement (TPI)

The Supplier* shall outline a TPI model or an approach to TPI that is suitable for EB.

C2.15 Testing of Support Work

The Supplier shall outline how it will provision Testing Services of Support Work that
address the following objectives.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

 A testing strategy and process, based on industry best practice, for the testing
of support work.
 A testing strategy for support work that is accepted by in-house development
teams, third parties and IT Service Management (ITSM).
 The capability to identify, assess and prioritize changes that require testing
and exclude changes that don’t require testing.
 The ability to clearly measure the benefits of undertaking testing of support
work.
 A cost effective and scalable approach to testing support work.

C2.16 Access to Testing Competencies

The Supplier shall outline the frequency, levels and mechanisms through which EB can
access the Supplier's testing centre of excellence, competency centres and expertise.

The Supplier shall also outline an approach to cross-skilling of EB staff on the Supplier's
processes, tools and methodologies.

C2.17 Defect Prevention Techniques

The Supplier shall demonstrate their expertise in implementing defect prevention
techniques with measurable benefits. The Supplier* must address the following.

 Steps to introduce and implement defect prevention techniques in an

organization.
 Common challenges when introducing and implementing defect prevention
techniques.
 Measurable benefits of defect prevention.

C2.18 Test Environment Solutions

The Supplier shall demonstrate their expertise in the provisioning and management of Test
Environments. The Supplier* shall address the following.

 Suitable approaches for introducing and implementing Release and Change

Management on EB test environments.
 The ability to provision new test environments in a timely and cost effective
manner.
 The ability to upgrade and maintain test environments such that they are current.
 Activities to determine the current state of test environments.
 Virtualization and Cloud-based solutions for Testing Environments.
 Test Environment Management strategies and processes.
 Suitable approaches to the management and maintenance of data on test
environments.
 The approach to security and access on test environments.

C2.18 Test Tool Solutions

EB’s investment in testing tools is limited to HP Quality Centre and HP Quick Test Pro. EB has
not invested in industry strength load / performance testing tools and it is unlikely that capital will
be allocated to implement a full suite of testing tools.

The Supplier* shall demonstrate capability an expertise in the provisioning of Testing

Tools.

The provision of Testing Tool services shall satisfy the following objectives.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

 The ability to leverage existing in-house tools and compliment with additional
tools.
 The ability to replace existing tools, demonstrating the benefits of doing this.
Specify how current testing artefacts can be retained and migrated if the current
toolset is replaced.
 Skills and expertise in the management and administration of proposed toolsets,
specifying exactly how EB can access this expertise.
 The ability to upgrade and maintain the toolset such that it is current and relevant.
 Expertise in types of tools such as functional (manual and automated),
performance and static analysis tools.

C2.19 Essential Test Areas

The Supplier* is required to detail its expertise (tools, systems, processes, professionals) in
the provision of testing Services* in each of these areas. For each area, detail the
approaches to testing, testing tools, means through which Western Power can access
expertise and case studies of how the Supplier* has provided these services.

 Service Oriented Architecture (SOA) using Software AG’s Webmethods platform;

 Extract, Transform Load (ETL) using Informatica tool set;
 Business Intelligence using IBM’s Cognos 8 as it’s primary reporting tool;
 Enterprise Resource Planning using Mincom’s Ellipse 6.3;
 Geographic Information System (GIS) using ESRI and Telvent software;
 Mobile Solutions using Mincom’s suite of mobile solutions;
 Primavera Project Management tools;
 Document Management using Hummingbird;
 Data migration and reconciliation testing;
 Customer Care and Billing System (CC&B) using Oracle software; and
 MBS Hub provided by Hansen Technologies.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

PART D - OTHER REQUIREMENTS

1. Commercial Risk
Although Supplier*s initially provided EB with “Commercial” information in response to
their submissions to be part of the IT Application Service Panel, EB is seeking to re-assess
the following information specifically relative to the required Services* defined in the
Supplier*’s proposed Statement of Work*.

1.1. SOW* Departures

The Supplier* must set out in the following table all proposed Departures* from the
SOW*. The proposed Departures* must be in the numerical order of the clauses to
be departed from and where the Departure* requires changes in wording,
proposed new wording must be set out in an appendix to the Supplier*’s
response*.

ITEM NO. SOW* REF. NO. DEPARTURE*

1.2. SOW*
Supplier*s shall provide a proposed Statement of Work* (which should be an updated and
populated version of the Statement of Work* attached to this Invitation to Respond)

1.3. Alternative Proposals

EB may entertain other commercial models that achieve the same business outcome at a
lower overall cost.

The Supplier* is requested to provide brief details of any alternative commercial models
they wish to propose which may be in respect of the proposed project resourcing
model/organisation model.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

PART E - PRICING

1. Service*s /Deliverables*
The Supplier is required to provide a Price* for the following Key Personnel*

Service* Phase 1 Phase 1 Phase 2 Phase 2

Services* / Services* / Services* / Services*/
Deliverables* Deliverables* Deliverables* Deliverables*
AUS$ (ex GST) Total Estimated AUS$ (ex GST) Total Estimated
Hours Hours

1. Test Program
Manager

2. Senior Test Analyst

3. Test Analyst

4. Test Analyst

Total Estimated $ $
Cost/hours

Supplier*s may provide alternative pricing solutions where they deem they provide better
value for money for EB.

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

INVITATION TO RESPOND ACKNOWLEDGEMENT

FORM

SOW* NUMBER: 105 Testing Services

We acknowledge receipt of your Statement of Work* and wish to advise that:

(i) we will be submitting a hardcopy/electronic response.

(ii) we will not be responding for the following reasons:
......................................................................................................................................

..................................................................................................................................... .

(delete (i) or (ii) as appropriate)

Representative of the Supplier* (Name):.............................................................................

Position:

Supplier* Name: ....................................................................................

Supplier* Address:

....................................................................................

Please return this form by:

email to: DELETED

Document Name: Testing Services - Invitation to Respond

 Part C - SUPPLIER* TO COMPLETE AND RETURN THIS PART

ATTACHMENT A – EB CURRENT RESOURCE STRUCTURE

EB QUALITY CENTRE

Quality
Centre
Team
Leader

Test Test Test Test

Test Analyst Analyst Analyst Analyst
Analyst
FTE FTE FTE FTE
FTE

The current team structure operates with all test analysts reporting direct to the
Team Leader.

Document Name: Testing Services - Invitation to Respond