Google Cloud Computing Foundation Course

Priyanka Vergardia
Google Cloud

Lecture-25
Module introduction

Hi, I am Priyanka, and welcome to the module. Where do I store this stuff? In this module, you
will see how you can take advantage of managed storage and databases for cloud applications.
So far in this course, you have learned what GCP is, why you should have a solid platform
before beginning a GCP transfer, and how GCP supports the building of apps. In this module,
you will learn about storage and database options in GCP.

(Refer Slide Time: 00:28)

The objective of this module is for you to be able to implement a variety of structured and
unstructured storage models. To achieve this goal, you will need to meet the following learning
objectives. Discuss the different storage options that exist in the cloud. Differentiate between
structured and unstructured storage in the cloud, compare the role of the different cloud storage
options, and explore the use case for relational versus NoSQL storage.

90
(Refer Slide Time: 00:56)

You will also describe leveraging cloud storage as unstructured storage and explained relational
database options in the cloud and describe the NoSQL options in GCP.

(Refer Slide Time: 01:07)

These are the topics that make up the module. First, you will learn about the different storage
options available in the cloud. Then you will see the difference between structured and
unstructured storage and how you can leverage unstructured storage using cloud storage. A

91
hands-on lab will allow you to explore a range of activities applicable to cloud. You will then
review the use case for SQL managed services. Next, you will explore cloud SQL.

And then, complete another lab where you will import data into cloud SQL and perform basic
data analysis. You will discover how to leverage Cloud Spanner and explore the available
NoSQL options. You will then learn how to use Cloud Datastore as a NoSQL document store.
You will complete the module with an app development activity that requires you to store app
data in Cloud Datastore, and then you will learn how Cloud BigTable can be leveraged as a
NoSQL option. The module will end with a short quiz and a recap of the key learning points
covered in the module.

92
 Google Cloud Computing Foundation Course
Priyanka Vergardia
Google Cloud

Lecture-26
Storage Options in the Cloud

Let’s start the first topic, the different storage options that exist in cloud. GCP offers many
different storage options from object stores to database services. These options how to save costs
and reduce the time it takes to launch and make most of the data set by being able to analyse of a
wide variety of data.

(Refer Slide Time: 00:21)

All applications create and use data. We provide all tools you need to build and move
applications to the cloud. This includes storing videos, images, and other objects, even
operational application data. Applications, in many cases, required storage solutions, and GCP
provides managed services that are scalable, reliable, and easy to operate. For relational
databases, which are commonly used today, offer Cloud SQL for MySQL in PostgreSQL as well
as Cloud Spanner.

93
We also have a non-relational or NoSQL database like Cloud Datastore and Cloud Bigtable. Big
Query is a highly scalable enterprise data warehouse and works outside the storage solutions to
discuss this module.

(Refer Slide Time: 01:09)

There are three common use cases for cloud storage. The first is content storage and delivery.
This is where you have content such as images or videos when you serve the content to the users
wherever they are. People wanted their content fast running under the Global network the
Google provide and ensure positive experiences for users. The second use case is storage and
data analytics and general compute.

You can process or expose your data to analytics tools like the analytics stack of the product that
GCP offers and you things like genomics sequencing for the internet of things data analysis.
Third use case is backup and archival storage. You can save storage cost by migrating
infrequently accessed contents to cheaper cloud storage options. It’s also critical to have a copy
in the cloud for recovery purposes. Just in case anything happens to your data on-premises.

94
(Refer Slide Time: 02:04)

If you work with databases, we have two priorities for you. The first priority is to help you
migrate the existing database to the Cloud and move them to the right service. You will likely be
moving My SQL or PostgreSQL to Cloud SQL. The second priority is to help you innovate,
build a rebuild for the cloud take advantage of mobile, and plan for future growth.

95
 Google Cloud Computing Foundation Course
Priyanka Vergardia
Google Cloud

Lecture-27
Structured and Unstructured Storage in the Cloud

Now you see the difference between structured and unstructured storage and how to choose
between them in the cloud.

(Refer Slide Time: 00:08)

Structured data is what most people are used to working with and typically fits with the columns
and rows in spreadsheets and relational databases. You can expect this data to be organized and
clearly defined, and it is usually easy to capture and analyze. Examples of structured data
wouldn’t include name, address, contact number, date, and billing information. The benefit of
structured data where it can be understood by programming languages, and data can be
manipulated relatively quickly.

It is estimated that around 80% of all data is unstructured. It’s far more difficult to process or
analyze unstructured data using traditional methods as there’s no internal identifier to enable
search functions to identify it. Unstructured data often includes text and multimedia content for
example email, messages, documents, photos, videos, presentations, web pages, and so on.

96
Organizations are focusing increasingly on mining unstructured data for inside that provide them
the competitive edge.

(Refer Slide Time: 01:18)

This flowchart shows the decision tree for determining based on the use case, which stored
solution would be utilized. If you need a solution to hold files, backups, logs, blobs, for example,
a good unstructured solution would be Cloud Storage. If you need a structured solution and
utilizing workload analytics Cloud BigQuery and Cloud Bigtable are two options. If a relational
database is needed, then you can choose either a traditional manage MySQL or PostgreSQL
database using CloudSQL or horizontally scalable highly available databases like Cloud
Spanner.

And if you need a simple NoSQL option to use for your application Cloud Datastore is a solid
choice. In the topic that follows you learn more about each option.

97
 Google Cloud Computing Foundation Course
Priyanka Vergardia
Google Cloud

Lecture-28
Unstructured Storage using Cloud Storage

(Refer Slide Time: 00:07)

In this topic, you will consider how you can leverage unstructured storage using Cloud Storage.
Cloud Storage is just one of the many storage options on GCP and store and search object data,
also known as blob data.

98
(Refer Slide Time: 00:18)

You can store an unlimited amount of objects in the cloud up to 5 terabytes in size each. Cloud
Storage is well-suited for binary or object data such as images media servings and backups.
Cloud Storage is the same storage that we use for images in Google Photos, Gmail attachments,
Google Docs, and so on. Users have a variety of storage requirements for a multitude of use
cases. To cater to these requirements, we offer different classes of cloud storage. The classes are
based on how often the data is accessed.

(Refer Slide Time: 00:50)

99
Multi-regional storage costs a bit more, but it is due redundant that means you pick a broad
geographical location like the United States, the European Union or Asia, and Cloud Storage
stores your data in at least two geographic locations separated by at least 160 kilometers. This
option is ideal for storing data that is frequently accessed around the world, such as serving
website content, streaming videos, or gaming and mobile applications.

Regional storage lets you store your data in a specific GCP region. For example, US central one,
Europe West one or Asia East one it’s cheaper than multi-regional storage but it offers less
redundancy. This option is ideal for data analytics and machine learning jobs. Nearline storage is
a low cost highly durable storage service for storing in frequently accessed data. This storage
class is a better choice than multi-regional storage or regional storage in scenarios where you
plan to read or modify your data on average once a month or less.

For example, if you want to continuously add files to cloud storage and plan to access these files
once a month for analysis Nearline storage is a great choice. Typical users for this storage class
includes long-tail content, multimedia source file storage, and online backups. Coldline storage
is a very low-cost, highly durable storage service for data archiving online backups and disaster
recovery. Coldline storage is the best choice for data that you plan to access at most once a year.

Due to this slightly lower availability, 90-day minimum storage duration, the cost for data
access, and higher pre-operational cost. Typical use cases include archive data, data with lengthy
storage durations from legal or regulatory requirements, tape migrations, and disaster recovery.
Cloud storage is unique in a number of ways. It has a single API, milliseconds data access
latency, and 11 nines durability across all storage classes.

Cloud Storage also offers object lifecycle management, which uses policies to automatically
move data to lower-cost storage classes as it is accessed less frequently throughout its life.

100
(Refer Slide Time: 03:22)

Cloud Storage files are organized into buckets. When you create a bucket, you give it a globally
unique name. You specify a geographic location where the bucket and its contents are stored,
and you choose one of the default storage classes that you were introduced to earlier. There are
several ways to control users’ access to your objects and buckets. For most purposes, cloud IAM
is sufficient. Rules are inherited from project to bucket to object.

If you need final control, you can create access control lists. ACL’s define who has access to
your bucket and objects as well as what level of access they have. Each ACL consists of two
pieces of information. A scope that defines who can perform the specified actions and
permission, which defines what action can be performed, for example, read or write. If you want,
you can turn on object versioning on your buckets.

Cloud Storage keeps a history of modifications that overrides or deletes for all objects in the
bucket. You can list the archived versions of an object, restore an object to an older state, or
permanently delete a version as needed. If you do not turn on object versioning new always
overrides old. Cloud Storage also offers lifecycle management policies. For example, you could
tell cloud storage to delete objects older than 365 days or to delete objects created before January

101
1st, 2013, or to keep only the three most recent versions of each object in a bucket that has
versioning enabled.

102