Scribd
Upload
448 views

Web Scraping Project Requirement Document Template

This document provides a template for creating a web data scraping requirements document. It outlines sections including an overview of the project, problem statement, obstacles, deliverables, exact requirements, success criteria and milestones. The template aims to help stakeholders understand various factors of web scraping projects and provide a starting point for documenting requirements.

Uploaded by

Wellington Oliveira
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
448 views

Web Scraping Project Requirement Document Template

This document provides a template for creating a web data scraping requirements document. It outlines sections including an overview of the project, problem statement, obstacles, deliverables, exact requirements, success criteria and milestones. The template aims to help stakeholders understand various factors of web scraping projects and provide a starting point for documenting requirements.

Uploaded by

Wellington Oliveira
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 6

`

Preface
At PromptCloud, we are aware that acquiring clean and ready-to-use web data in high volume can
be a daunting task. Also, when you are tasked with creating a requirement document for your
project, it can become very difficult to start from scratch. That’s the reason we have come up with
this template to help you get started quickly and keep the stakeholders in loop about the project.

This template will help you understand various factors of web scraping projects from sample
content while saving time and resources. Also, this can serve as a source of inspiration for web data
collection projects.
`

Date 06-05-2019

Point of contact for the project Jane Doe ([email protected])

Expected date to get live data 06-06-2019

Web data required for Company name Inc.

Potential services required from vendor - Data extraction


- Normalization
- API-based delivery
- Regular maintenance and QA
- Product matching (optional)

In-house tech team contact John Doe ([email protected])


`

Table of Contents
1. Project Overview 4
2. Problem Statement 5
4. Obstacles 5
5. Technical Obstacles 5
6. Industry and Market Risks 5
7. Budgetary Risks 5
8. List of deliverables 5
9. Exact Requirements 5
10. Success Criteria 6
11. Milestones and Reporting 6
`

1. Project Overview
[A brief description of the project stating the aims, scope and intended operation]

2. Problem Statement
[The problem that the business is trying to solve. For example, augmenting internal data with external
data to get better market insights and competitive landscape.]

3. Justification for Web Scraping Project


[How web scraping can help in solving the problem.]

4. Obstacles
[A description of the possible risks involved with the project and how you will manage them]

5. Technical Obstacles
[Any technical obstacles like integration between different systems, as well as mitigation strategies]

6. Industry and Market Risks


[Any industry or market-related risks. These might include certain technologies or approached getting
outmoded. For each risk there should be explanation of best practices, future proofing and, if applicable,
development.]

7. Budgetary Risks
[These might include going over budget or extending the milestones. Explain how the project milestones
and budget related risks will be mitigated.]

8. List of deliverables
[A list of deliverables from the data vendors. It can be data extraction and development of integrations to
push the data into your system.]

9. Exact Requirements
A. Mention the frequency for delivering extracted web data: live/daily/weekly/monthly

B. Mention in the list below the URL(s) from which you wish to extract data along with
the required data fields:

URL Data fields (comma separated)


`

Note: It is always advisable to keep certain set of URLs that deliver similar data fields in one group.

10. Success Criteria


[The metrics that need to be measured in order to justify the resource investment. It can be anything
from revenue growth to increase in market share.]

11. Milestones and Reporting


Milestone Tasks Reporting Hrs Date

1 - Analysis

1.1

1.2

2 - Development for data consumption

2.1

2.2

3 - Testing data quality

3.1

3.2

4 - Deployment

4.1

5 - Training

5.1

You might also like