Get the full ebook with Bonus Features for a Better Reading Experience on ebookmeta.

com

Test Automation A manager s guide 1st Edition Boby

Jose

https://ebookmeta.com/product/test-automation-a-manager-s-
guide-1st-edition-boby-jose/

OR CLICK HERE

DOWLOAD NOW

Download more ebook instantly today at https://ebookmeta.com

 Recommended digital products (PDF, EPUB, MOBI) that
you can download immediately if you are interested.

Test Automation Engineering Handbook Manikandan

Sambamurthy

https://ebookmeta.com/product/test-automation-engineering-handbook-
manikandan-sambamurthy/

ebookmeta.com

Science of Selenium Master Web UI Automation and Create

Your Own Test Automation Framework 1st Edition Rahman

https://ebookmeta.com/product/science-of-selenium-master-web-ui-
automation-and-create-your-own-test-automation-framework-1st-edition-
rahman/
ebookmeta.com

A Project Manager s Book of Templates 1st Edition Dionisio

https://ebookmeta.com/product/a-project-manager-s-book-of-
templates-1st-edition-dionisio/

ebookmeta.com

Reference and Identity in Public Discourses 1st Edition

Ursula Lutzky

https://ebookmeta.com/product/reference-and-identity-in-public-
discourses-1st-edition-ursula-lutzky/

ebookmeta.com
Space Technology: A Short Introduction Ignacio Chechile

https://ebookmeta.com/product/space-technology-a-short-introduction-
ignacio-chechile/

ebookmeta.com

Polyface Micro Success with Livestock on a Homestead Scale

1st Edition Joel Salatin

https://ebookmeta.com/product/polyface-micro-success-with-livestock-
on-a-homestead-scale-1st-edition-joel-salatin/

ebookmeta.com

Pathways of Job related Negative Behaviour Handbooks of

Workplace Bullying Emotional Abuse and Harassment 2

https://ebookmeta.com/product/pathways-of-job-related-negative-
behaviour-handbooks-of-workplace-bullying-emotional-abuse-and-
harassment-2/
ebookmeta.com

Burn It All Down 1st Edition Nicolas Didomizio

https://ebookmeta.com/product/burn-it-all-down-1st-edition-nicolas-
didomizio/

ebookmeta.com

Marine Pollution, Shipping Waste and International Law 1st

Edition Gabriela Argüello

https://ebookmeta.com/product/marine-pollution-shipping-waste-and-
international-law-1st-edition-gabriela-arguello/

ebookmeta.com
Safety Engineering in the Oil and Gas Industry 1st Edition
Karan Sotoodeh

https://ebookmeta.com/product/safety-engineering-in-the-oil-and-gas-
industry-1st-edition-karan-sotoodeh/

ebookmeta.com
TEST AUTOMATION
BCS, THE CHARTERED INSTITUTE FOR IT

BCS, The Chartered Institute for IT, is committed to making IT good for society. We use
the power of our network to bring about positive, tangible change. We champion the
global IT profession and the interests of individuals, engaged in that profession, for the
benefit of all.

Exchanging IT expertise and knowledge

The Institute fosters links between experts from industry, academia and business to
promote new thinking, education and knowledge sharing.

Supporting practitioners
Through continuing professional development and a series of respected IT qualifications,
the Institute seeks to promote professional practice tuned to the demands of business.
It provides practical support and information services to its members and volunteer
communities around the world.

Setting standards and frameworks

The Institute collaborates with government, industry and relevant bodies to establish
good working practices, codes of conduct, skills frameworks and common standards.
It also offers a range of consultancy services to employers to help them adopt best
practice.

Become a member
Over 70,000 people including students, teachers, professionals and practitioners enjoy
the benefits of BCS membership. These include access to an international community,
invitations to a roster of local and national events, career development tools and a
quarterly thought-leadership magazine. Visit www.bcs.org/membership to find out
more.

Further information
BCS, The Chartered Institute for IT,
3 Newbridge Square,
Swindon, SN1 1BY, United Kingdom.
T +44 (0) 1793 417 417
(Monday to Friday, 09:00 to 17:00 UK time)
www.bcs.org/contact
http://shop.bcs.org/
TEST AUTOMATION
A manager’s guide

Boby Jose
© BCS Learning and Development Ltd 2021

The right of Boby Jose to be identified as author of this work has been asserted by him in accordance with
sections 77 and 78 of the Copyright, Designs and Patents Act 1988.

All rights reserved. Apart from any fair dealing for the purposes of research or private study, or criticism or
review, as permitted by the Copyright Designs and Patents Act 1988, no part of this publication may be repro-
duced, stored or transmitted in any form or by any means, except with the prior permission in writing of the
publisher, or in the case of reprographic reproduction, in accordance with the terms of the licences issued by
the Copyright Licensing Agency. Enquiries for permission to reproduce material outside those terms should
be directed to the publisher.

All trade marks, registered names etc. acknowledged in this publication are the property of their respective
owners. BCS and the BCS logo are the registered trade marks of the British Computer Society charity number
292786 (BCS).

Published by BCS Learning and Development Ltd, a wholly owned subsidiary of BCS, The Chartered Institute
for IT, 3 Newbridge Square, Swindon, SN1 1BY, UK.
www.bcs.org

Paperback ISBN: 978-1-78017-5454

PDF ISBN: 978-1-78017-5461
ePUB ISBN: 978-1-78017-5478

British Cataloguing in Publication Data.

A CIP catalogue record for this book is available at the British Library.

Disclaimer:
The views expressed in this book are of the author and do not necessarily reflect the views of the Institute
or BCS Learning and Development Ltd except where explicitly stated as such. Although every care has been
taken by the authors and BCS Learning and Development Ltd in the preparation of the publication, no warranty
is given by the authors or BCS Learning and Development Ltd as publisher as to the accuracy or complete-
ness of the information contained within it and neither the authors nor BCS Learning and Development Ltd
shall be responsible or liable for any loss or damage whatsoever arising by virtue of such information or any
instructions or advice contained within this publication or by any of the aforementioned.

All URLs were correct at the time of publication.

Publisher’s acknowledgements
Reviewers: Kari Kakkonen, Francisca Cano Ortiz and Matthew Riddiough Boylan
Publisher: Ian Borthwick
Commissioning editor: Rebecca Youé
Production manager: Florence Leroy
Project manager: Sunrise Setting Ltd
Copy-editor: Gillian Bourn
Proofreader: Barbara Eastman
Indexer: John Silvester
Cover design: Alex Wright
Cover image: iStock - Leonid Andronov
Typeset by Lapiz Digital Services, Chennai, India.

iv
To all my mentors who have inspired and encouraged me

v
CONTENTS

List of figures and tables x

Author xiii
Abbreviations xv
Useful websites xix
Preface xxii

PART ONE: THE ‘WHATS’ AND ‘WHYS’ OF TEST AUTOMATION 1

1 TEST AUTOMATION: A STRATEGIC VIEW 3

1.1 Introduction 3
1.2 Manual testing and automated testing 6
1.3 The ‘whats’ and the ‘whys’ of test automation 10
1.4 Managing stakeholders in test automation 12
1.5 Test automation policy, strategy and plan 15
1.6 CBA and ROI for test automation 19
1.7 Automation feasibility 27
1.8 Overselling automation 28
1.9 Summary 28

2. DOMAIN-FOCUSED TEST AUTOMATION 30

2.1 Software development approaches 30
2.2 Test automation and business models 45
2.3 Test automation in functional and non-functional testing 52
2.4 Trends 61
2.5 Summary 64

3. TEST AUTOMATION TOOL SELECTION 65

3.1 Test automation tool selection 65
3.2 Tool selection assessment 70
3.3 Coding or scripting 71
3.4 Scriptless automation 72
3.5 Summary 73

4. PEOPLE AND TEAM 74

4.1 Test automation team 74
4.2 Skills 76
4.3 Hiring process 79
4.4 Summary 83

vii
CONTENTS

5. AUTOMATION FRAMEWORKS 84
5.1 Linear test automation framework 85
5.2 Modular testing framework 88
5.3 Library architecture testing framework 89
5.4 Data-driven testing framework 90
5.5 Keyword-driven testing framework 92
5.6 Hybrid testing framework 94
5.7 Test-driven development testing framework 95
5.8 Behaviour-driven development testing framework 97
5.9 Summary 98

6. ENVIRONMENTS 99
6.1 Test automation environments 100
6.2 Summary 105

7. CANDIDATES FOR AUTOMATION 106

7.1 What should be automated? 106
7.2 What should not be automated? 108
7.3 Summary 108

8. TEST AUTOMATION AND TEST COVERAGE 110

8.1 Test coverage 110
8.2 Test automation metrics 114
8.3 Summary 115

PART TWO: HOW AND WHEN TO DO AUTOMATION 117

9. TEST AUTOMATION SUBJECT MATTER EXPERT 119

9.1 Essential skills for a test automation engineer 119
9.2 Building a successful career in test automation 128
9.3 Summary 130

10. TEST AUTOMATION TOOLS 131

10.1 Understanding licence models 131
10.2 Leading test automation tools 135
10.3 Cost factors 143
10.4 Summary 145

11. TEST AUTOMATION AND PROGRAMMING LANGUAGES 146

11.1 Programming languages for test automation 148
11.2 Coding or scripting methods and techniques 151
11.3 Candidates for test automation scripting 153
11.4 Developing your first script 154
11.5 Summary 155

12. AUTOMATION FRAMEWORK DESIGN AND DEVELOPMENT 156

12.1 Test automation components’ definitions 157
12.2 Building a test automation framework 158
12.3 SUT architecture 167
12.4 Test data management 171
12.5 Summary 174

viii
 CONTENTS

13. MEASURING TEST AUTOMATION 175

13.1 Test automation metrics 176
13.2 Requirement and coverage metrics 177
13.3 Defect metrics 177
13.4 Management reporting 178
13.5 Automated test metrics 183
13.6 Summary 184

14 CONCLUSION 185

APPENDICES187

APPENDIX A: CODING STANDARDS AND COMMENTS 189

APPENDIX B: SAMPLE TEST AUTOMATION FRAMEWORK 191

APPENDIX C: SAMPLE INTERVIEW QUESTIONS 196

APPENDIX D: SAMPLE SKILL SET OF TEST AUTOMATION 199

ENGINEERS

APPENDIX E: TEMPLATES 201

Template 1: Sample test policy 201
Template 2: Sample test automation plan 204
Template 3: Cost-benefit analysis 211
Template 4: Automation suitability checklist 214
Template 5: Tool evaluation 215
Template 6: ROI trend 216
Template 7: ROI 218

APPENDIX F: TEST AUTOMATION – INDUSTRY EXAMPLES 221

APPENDIX G: ISTQB TEST AUTOMATION ARCHITECTURE 229

References 231
Further reading 232
Glossary 233
Index 242

ix
LIST OF FIGURES AND TABLES

FIGURES

Figure 1.1 Triple constraints 4

Figure 1.2 Manual testing versus test automation 6
Figure 1.3 Why test automation? 11
Figure 1.4 Stakeholder involvement matrix 13
Figure 1.5 Stakeholders 14
Figure 1.6 Document hierarchy 16
Figure 1.7 Automation test approach 19
Figure 1.8 Cost-benefit analysis framework 22
Figure 1.9 ROI versus releases 25
Figure 2.1 Waterfall approach 31
Figure 2.2 Agile approach 32
Figure 2.3 Waterfall testing 34
Figure 2.4 Test automation in Waterfall 35
Figure 2.5 Agile testing 37
Figure 2.6 Test automation in Agile at an enterprise level 38
Figure 2.7 DevOps 40
Figure 2.8 DevOps CI/CD workflow 40
Figure 2.9 DevOps test automation 41
Figure 2.10 MTS pillars 50
Figure 2.11 Functional test automation types 54
Figure 2.12 Non-functional test automation types 55
Figure 3.1 Automation tools versus cost matrix 69
Figure 3.2 Tool selection process 70
Figure 5.1 Test automation frameworks 86
Figure 5.2 Linear test automation framework 87
Figure 5.3 Modular test automation framework 88
Figure 5.4 Library architecture test automation framework 90
Figure 5.5 Data-driven test automation framework 91
Figure 5.6 Keyword-driven test automation framework 92
Figure 5.7 Hybrid test automation framework 94
Figure 5.8 Test-driven development 96
Figure 5.9 Behaviour-driven development 98
Figure 6.1 Test environment sequential diagram 101
Figure 7.1 Test automation: initial days 106
Figure 7.2 Test automation growth 107
Figure 9.1 Test automation engineer essential skills 121

x
 LIST OF FIGURES AND TABLES

Figure 10.1 Software licence models 134

Figure 10.2 Testing tools 135
Figure 11.1 Generations of programming languages 147
Figure 11.2 Structured scripting 152
Figure 12.1 Test automation road map 162
Figure 12.2 Framework folder structure 163
Figure 12.3 BDD SpecFlow for an ecommerce project (example) 164
Figure 12.4 Application data sheet 166
Figure 12.5 Application areas/modules data sheet (regression suite) 166
Figure 12.6 Data sheet (regression suite) 167
Figure 12.7 Test report 168
Figure 12.8 Test execution summary 169
Figure 12.9 Detailed result 170
Figure 12.10 Test data creation 173
Figure 13.1 Product automation metrics 179
Figure 13.2 Defect trends 180
Figure 13.3 Test automation trend based on coverage and cost 180
Figure 13.4 Test automation trend based on effort and quality 181
Figure 13.5 Test automation trend based on test execution rate 181
Figure 13.6 Test automation defect removal efficiency 182
Figure 13.7 Test automation defect root cause analysis 182
Figure 13.8 Test automation defect density 183
Figure 13.9 Test automation environment down metrics 184
Figure A.1 Test automation framework folder structure 191
Figure A.2 Test automation framework for a real-life project 192
Figure A.3 Test automation framework test result 1 194
Figure A.4 Test automation framework test result 2 195
Figure A.5 Tentative high-level plan and schedule 212
Figure A.6 ROI chart for automation 217
Figure A.7 The Generic Test Automation Framework 230

TABLES

Table 2.1 Test automation and domains 30

Table 2.2 Comparison between Waterfall and Agile testing 32
Table 2.3 Functional requirements specifications 53
Table 2.4 Non-functional requirements specifications 55
Table 2.5 Testing stages and automation 56
Table 2.6 Testing types and automation 58
Table 4.1 Competency matrix for test automation 78
Table 4.2 Skill assessment matrix 83
Table 5.1 Example keyword table 93
Table 6.1 Environments and their features 101
Table 7.1 Candidates for automated testing 109
Table 10.1 API/web service testing tools 136
Table 10.2 Unit testing tools 137
Table 10.3 Functional and web tools 138
Table 10.4 Mobile testing tools 139
Table 10.5 Test and defect management tools 140

xi
LIST OF FIGURES AND TABLES

Table 10.6 Cross-browser testing tools 141

Table 10.7 Performance and load testing tools 141
Table 10.8 Security and penetration testing tools 142
Table 10.9 AL/ML powered testing tools 142
Table 10.10 Test framework tools 143
Table 12.1 Common definitions 157
Table 12.2 Framework platform requirements 159
Table 12.3 Test data management tools 174
Table A.1 Test automation framework folder description 192
Table A.2 Test automation framework folder description for a  193
real-life project

xii
AUTHOR

Boby Jose holds a BSc in Physics and Masters in Business Administration (MBA), and
has over two decades of work experience in software testing within the business,
technology, IT, infrastructure, outsourcing and consulting industries. He started his
professional career as a business analyst and ecommerce consultant. Professionally
trained and certified in test automation, Boby’s career progressed through offshore IT
service companies, cutting edge product development and testing in informatics, and
test consulting with a leading North American technology consultancy, and later with
a leading European IT consultancy. He has worked in companies ranging from 500 to
250,000 employees and has led testing engagements with more than 100 members.

Boby has successfully managed the testing of many large IT transformation programmes
and globally distributed software engagements. He is based in London, United Kingdom,
and has software testing experience in the public, private, secure and product sectors
in the US, Europe, Middle East and Asia. Boby has extensive experience in the fields of
test strategy, test management, test planning, Test automation, test governance, test
transformation, test environment management, infrastructure test management, test
consulting and product test management.

Boby also has substantial testing and test automation experience in agro, bioinformatics,
client/server, custom and bespoke solutions, digital, ecommerce, education, enterprise
applications, enterprise resource planning (ERP), finance, healthcare, legacy, life science,
marketplace, material science, mobile, multichannel, retail, scientific, tax, telecom,
travel and transport, and web technologies. His skills spread across Agile, continuous
integration (CI) and continuous delivery (CD), functional testing, infrastructure testing,
iterative, IT service continuity (ITSC) testing, non-functional testing, operational
acceptance testing (cloud, on-premises and hybrid), performance testing, portfolio,
project and programme test management, security and penetration testing, test
strategies and plans, user acceptance testing (for over 100 countries), V-model and
Waterfall.

He is a certified ISTQB® Advanced Test Manager, as well as having qualifications that

include TPI NEXT® Foundation, ISTQB-ISEB Foundation Level, PRINCE2® Foundation
and Practitioner, Mobile App Testing, Certified Agile Scrum Master and Certified Scrum
Product Owner.

He has published many papers, articles and points of view on topics such as the
intricacies of mobile application testing, managing up in testing, process improvement
through goal problem approach, investing in test automation (cost-benefit analysis and
return on investment (ROI)) and software testing of product versus application-based

xiii
Another Random Scribd Document
with Unrelated Content
 Plate CXX.

P. H. G. del. et lith. Reeve, Benham & Reeve, imp.

Podiceps Dominicus, Linn.

(p. 440.)

Transcriber’s Notes:
Blank pages have been removed.
Obvious typographical errors have been silently corrected.
Attribution punctuation has been made consistent.
*** END OF THE PROJECT GUTENBERG EBOOK ILLUSTRATIONS OF
THE BIRDS OF JAMAICA ***

Updated editions will replace the previous one—the old editions will
be renamed.

Creating the works from print editions not protected by U.S.

copyright law means that no one owns a United States copyright in
these works, so the Foundation (and you!) can copy and distribute it
in the United States without permission and without paying
copyright royalties. Special rules, set forth in the General Terms of
Use part of this license, apply to copying and distributing Project
Gutenberg™ electronic works to protect the PROJECT GUTENBERG™
concept and trademark. Project Gutenberg is a registered trademark,
and may not be used if you charge for an eBook, except by following
the terms of the trademark license, including paying royalties for use
of the Project Gutenberg trademark. If you do not charge anything
for copies of this eBook, complying with the trademark license is
very easy. You may use this eBook for nearly any purpose such as
creation of derivative works, reports, performances and research.
Project Gutenberg eBooks may be modified and printed and given
away—you may do practically ANYTHING in the United States with
eBooks not protected by U.S. copyright law. Redistribution is subject
to the trademark license, especially commercial redistribution.

START: FULL LICENSE

THE FULL PROJECT GUTENBERG LICENSE
 PLEASE READ THIS BEFORE YOU DISTRIBUTE OR USE THIS WORK

To protect the Project Gutenberg™ mission of promoting the free

distribution of electronic works, by using or distributing this work (or
any other work associated in any way with the phrase “Project
Gutenberg”), you agree to comply with all the terms of the Full
Project Gutenberg™ License available with this file or online at
www.gutenberg.org/license.

Section 1. General Terms of Use and

Redistributing Project Gutenberg™
electronic works
1.A. By reading or using any part of this Project Gutenberg™
electronic work, you indicate that you have read, understand, agree
to and accept all the terms of this license and intellectual property
(trademark/copyright) agreement. If you do not agree to abide by all
the terms of this agreement, you must cease using and return or
destroy all copies of Project Gutenberg™ electronic works in your
possession. If you paid a fee for obtaining a copy of or access to a
Project Gutenberg™ electronic work and you do not agree to be
bound by the terms of this agreement, you may obtain a refund
from the person or entity to whom you paid the fee as set forth in
paragraph 1.E.8.

1.B. “Project Gutenberg” is a registered trademark. It may only be

used on or associated in any way with an electronic work by people
who agree to be bound by the terms of this agreement. There are a
few things that you can do with most Project Gutenberg™ electronic
works even without complying with the full terms of this agreement.
See paragraph 1.C below. There are a lot of things you can do with
Project Gutenberg™ electronic works if you follow the terms of this
agreement and help preserve free future access to Project
Gutenberg™ electronic works. See paragraph 1.E below.
1.C. The Project Gutenberg Literary Archive Foundation (“the
Foundation” or PGLAF), owns a compilation copyright in the
collection of Project Gutenberg™ electronic works. Nearly all the
individual works in the collection are in the public domain in the
United States. If an individual work is unprotected by copyright law
in the United States and you are located in the United States, we do
not claim a right to prevent you from copying, distributing,
performing, displaying or creating derivative works based on the
work as long as all references to Project Gutenberg are removed. Of
course, we hope that you will support the Project Gutenberg™
mission of promoting free access to electronic works by freely
sharing Project Gutenberg™ works in compliance with the terms of
this agreement for keeping the Project Gutenberg™ name associated
with the work. You can easily comply with the terms of this
agreement by keeping this work in the same format with its attached
full Project Gutenberg™ License when you share it without charge
with others.

1.D. The copyright laws of the place where you are located also
govern what you can do with this work. Copyright laws in most
countries are in a constant state of change. If you are outside the
United States, check the laws of your country in addition to the
terms of this agreement before downloading, copying, displaying,
performing, distributing or creating derivative works based on this
work or any other Project Gutenberg™ work. The Foundation makes
no representations concerning the copyright status of any work in
any country other than the United States.

1.E. Unless you have removed all references to Project Gutenberg:

1.E.1. The following sentence, with active links to, or other

immediate access to, the full Project Gutenberg™ License must
appear prominently whenever any copy of a Project Gutenberg™
work (any work on which the phrase “Project Gutenberg” appears,
or with which the phrase “Project Gutenberg” is associated) is
accessed, displayed, performed, viewed, copied or distributed:
 This eBook is for the use of anyone anywhere in the United
States and most other parts of the world at no cost and with
almost no restrictions whatsoever. You may copy it, give it away
or re-use it under the terms of the Project Gutenberg License
included with this eBook or online at www.gutenberg.org. If you
are not located in the United States, you will have to check the
laws of the country where you are located before using this
eBook.

1.E.2. If an individual Project Gutenberg™ electronic work is derived

from texts not protected by U.S. copyright law (does not contain a
notice indicating that it is posted with permission of the copyright
holder), the work can be copied and distributed to anyone in the
United States without paying any fees or charges. If you are
redistributing or providing access to a work with the phrase “Project
Gutenberg” associated with or appearing on the work, you must
comply either with the requirements of paragraphs 1.E.1 through
1.E.7 or obtain permission for the use of the work and the Project
Gutenberg™ trademark as set forth in paragraphs 1.E.8 or 1.E.9.

1.E.3. If an individual Project Gutenberg™ electronic work is posted

with the permission of the copyright holder, your use and distribution
must comply with both paragraphs 1.E.1 through 1.E.7 and any
additional terms imposed by the copyright holder. Additional terms
will be linked to the Project Gutenberg™ License for all works posted
with the permission of the copyright holder found at the beginning
of this work.

1.E.4. Do not unlink or detach or remove the full Project

Gutenberg™ License terms from this work, or any files containing a
part of this work or any other work associated with Project
Gutenberg™.

1.E.5. Do not copy, display, perform, distribute or redistribute this

electronic work, or any part of this electronic work, without
prominently displaying the sentence set forth in paragraph 1.E.1
with active links or immediate access to the full terms of the Project
Gutenberg™ License.

1.E.6. You may convert to and distribute this work in any binary,
compressed, marked up, nonproprietary or proprietary form,
including any word processing or hypertext form. However, if you
provide access to or distribute copies of a Project Gutenberg™ work
in a format other than “Plain Vanilla ASCII” or other format used in
the official version posted on the official Project Gutenberg™ website
(www.gutenberg.org), you must, at no additional cost, fee or
expense to the user, provide a copy, a means of exporting a copy, or
a means of obtaining a copy upon request, of the work in its original
“Plain Vanilla ASCII” or other form. Any alternate format must
include the full Project Gutenberg™ License as specified in
paragraph 1.E.1.

1.E.7. Do not charge a fee for access to, viewing, displaying,

performing, copying or distributing any Project Gutenberg™ works
unless you comply with paragraph 1.E.8 or 1.E.9.

1.E.8. You may charge a reasonable fee for copies of or providing

access to or distributing Project Gutenberg™ electronic works
provided that:

• You pay a royalty fee of 20% of the gross profits you derive
from the use of Project Gutenberg™ works calculated using the
method you already use to calculate your applicable taxes. The
fee is owed to the owner of the Project Gutenberg™ trademark,
but he has agreed to donate royalties under this paragraph to
the Project Gutenberg Literary Archive Foundation. Royalty
payments must be paid within 60 days following each date on
which you prepare (or are legally required to prepare) your
periodic tax returns. Royalty payments should be clearly marked
as such and sent to the Project Gutenberg Literary Archive
Foundation at the address specified in Section 4, “Information
 about donations to the Project Gutenberg Literary Archive
Foundation.”

• You provide a full refund of any money paid by a user who

notifies you in writing (or by e-mail) within 30 days of receipt
that s/he does not agree to the terms of the full Project
Gutenberg™ License. You must require such a user to return or
destroy all copies of the works possessed in a physical medium
and discontinue all use of and all access to other copies of
Project Gutenberg™ works.

• You provide, in accordance with paragraph 1.F.3, a full refund of

any money paid for a work or a replacement copy, if a defect in
the electronic work is discovered and reported to you within 90
days of receipt of the work.

• You comply with all other terms of this agreement for free
distribution of Project Gutenberg™ works.

1.E.9. If you wish to charge a fee or distribute a Project Gutenberg™

electronic work or group of works on different terms than are set
forth in this agreement, you must obtain permission in writing from
the Project Gutenberg Literary Archive Foundation, the manager of
the Project Gutenberg™ trademark. Contact the Foundation as set
forth in Section 3 below.

1.F.

1.F.1. Project Gutenberg volunteers and employees expend

considerable effort to identify, do copyright research on, transcribe
and proofread works not protected by U.S. copyright law in creating
the Project Gutenberg™ collection. Despite these efforts, Project
Gutenberg™ electronic works, and the medium on which they may
be stored, may contain “Defects,” such as, but not limited to,
incomplete, inaccurate or corrupt data, transcription errors, a
copyright or other intellectual property infringement, a defective or
damaged disk or other medium, a computer virus, or computer
codes that damage or cannot be read by your equipment.

1.F.2. LIMITED WARRANTY, DISCLAIMER OF DAMAGES - Except for

the “Right of Replacement or Refund” described in paragraph 1.F.3,
the Project Gutenberg Literary Archive Foundation, the owner of the
Project Gutenberg™ trademark, and any other party distributing a
Project Gutenberg™ electronic work under this agreement, disclaim
all liability to you for damages, costs and expenses, including legal
fees. YOU AGREE THAT YOU HAVE NO REMEDIES FOR
NEGLIGENCE, STRICT LIABILITY, BREACH OF WARRANTY OR
BREACH OF CONTRACT EXCEPT THOSE PROVIDED IN PARAGRAPH
1.F.3. YOU AGREE THAT THE FOUNDATION, THE TRADEMARK
OWNER, AND ANY DISTRIBUTOR UNDER THIS AGREEMENT WILL
NOT BE LIABLE TO YOU FOR ACTUAL, DIRECT, INDIRECT,
CONSEQUENTIAL, PUNITIVE OR INCIDENTAL DAMAGES EVEN IF
YOU GIVE NOTICE OF THE POSSIBILITY OF SUCH DAMAGE.

1.F.3. LIMITED RIGHT OF REPLACEMENT OR REFUND - If you

discover a defect in this electronic work within 90 days of receiving
it, you can receive a refund of the money (if any) you paid for it by
sending a written explanation to the person you received the work
from. If you received the work on a physical medium, you must
return the medium with your written explanation. The person or
entity that provided you with the defective work may elect to provide
a replacement copy in lieu of a refund. If you received the work
electronically, the person or entity providing it to you may choose to
give you a second opportunity to receive the work electronically in
lieu of a refund. If the second copy is also defective, you may
demand a refund in writing without further opportunities to fix the
problem.

1.F.4. Except for the limited right of replacement or refund set forth
in paragraph 1.F.3, this work is provided to you ‘AS-IS’, WITH NO
OTHER WARRANTIES OF ANY KIND, EXPRESS OR IMPLIED,
INCLUDING BUT NOT LIMITED TO WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR ANY PURPOSE.

1.F.5. Some states do not allow disclaimers of certain implied

warranties or the exclusion or limitation of certain types of damages.
If any disclaimer or limitation set forth in this agreement violates the
law of the state applicable to this agreement, the agreement shall be
interpreted to make the maximum disclaimer or limitation permitted
by the applicable state law. The invalidity or unenforceability of any
provision of this agreement shall not void the remaining provisions.

1.F.6. INDEMNITY - You agree to indemnify and hold the Foundation,

the trademark owner, any agent or employee of the Foundation,
anyone providing copies of Project Gutenberg™ electronic works in
accordance with this agreement, and any volunteers associated with
the production, promotion and distribution of Project Gutenberg™
electronic works, harmless from all liability, costs and expenses,
including legal fees, that arise directly or indirectly from any of the
following which you do or cause to occur: (a) distribution of this or
any Project Gutenberg™ work, (b) alteration, modification, or
additions or deletions to any Project Gutenberg™ work, and (c) any
Defect you cause.

Section 2. Information about the Mission

of Project Gutenberg™
Project Gutenberg™ is synonymous with the free distribution of
electronic works in formats readable by the widest variety of
computers including obsolete, old, middle-aged and new computers.
It exists because of the efforts of hundreds of volunteers and
donations from people in all walks of life.

Volunteers and financial support to provide volunteers with the

assistance they need are critical to reaching Project Gutenberg™’s
goals and ensuring that the Project Gutenberg™ collection will
remain freely available for generations to come. In 2001, the Project
Gutenberg Literary Archive Foundation was created to provide a
secure and permanent future for Project Gutenberg™ and future
generations. To learn more about the Project Gutenberg Literary
Archive Foundation and how your efforts and donations can help,
see Sections 3 and 4 and the Foundation information page at
www.gutenberg.org.

Section 3. Information about the Project

Gutenberg Literary Archive Foundation
The Project Gutenberg Literary Archive Foundation is a non-profit
501(c)(3) educational corporation organized under the laws of the
state of Mississippi and granted tax exempt status by the Internal
Revenue Service. The Foundation’s EIN or federal tax identification
number is 64-6221541. Contributions to the Project Gutenberg
Literary Archive Foundation are tax deductible to the full extent
permitted by U.S. federal laws and your state’s laws.

The Foundation’s business office is located at 809 North 1500 West,

Salt Lake City, UT 84116, (801) 596-1887. Email contact links and up
to date contact information can be found at the Foundation’s website
and official page at www.gutenberg.org/contact

Section 4. Information about Donations to

the Project Gutenberg Literary Archive
Foundation
Project Gutenberg™ depends upon and cannot survive without
widespread public support and donations to carry out its mission of
increasing the number of public domain and licensed works that can
be freely distributed in machine-readable form accessible by the
widest array of equipment including outdated equipment. Many
small donations ($1 to $5,000) are particularly important to
maintaining tax exempt status with the IRS.

The Foundation is committed to complying with the laws regulating

charities and charitable donations in all 50 states of the United
States. Compliance requirements are not uniform and it takes a
considerable effort, much paperwork and many fees to meet and
keep up with these requirements. We do not solicit donations in
locations where we have not received written confirmation of
compliance. To SEND DONATIONS or determine the status of
compliance for any particular state visit www.gutenberg.org/donate.

While we cannot and do not solicit contributions from states where

we have not met the solicitation requirements, we know of no
prohibition against accepting unsolicited donations from donors in
such states who approach us with offers to donate.

International donations are gratefully accepted, but we cannot make

any statements concerning tax treatment of donations received from
outside the United States. U.S. laws alone swamp our small staff.

Please check the Project Gutenberg web pages for current donation
methods and addresses. Donations are accepted in a number of
other ways including checks, online payments and credit card
donations. To donate, please visit: www.gutenberg.org/donate.

Section 5. General Information About

Project Gutenberg™ electronic works
Professor Michael S. Hart was the originator of the Project
Gutenberg™ concept of a library of electronic works that could be
freely shared with anyone. For forty years, he produced and
distributed Project Gutenberg™ eBooks with only a loose network of
volunteer support.
Project Gutenberg™ eBooks are often created from several printed
editions, all of which are confirmed as not protected by copyright in
the U.S. unless a copyright notice is included. Thus, we do not
necessarily keep eBooks in compliance with any particular paper
edition.

Most people start at our website which has the main PG search
facility: www.gutenberg.org.

This website includes information about Project Gutenberg™,

including how to make donations to the Project Gutenberg Literary
Archive Foundation, how to help produce our new eBooks, and how
to subscribe to our email newsletter to hear about new eBooks.