(Omran) Introduction To Google Cloud Platform
(Omran) Introduction To Google Cloud Platform
→ Google Identity
A bit of history, about me!
People Impacted Speeches & Trainings
→ 2015 – 6 sessions / 920+ attendees → Egypt → United States of America
→ Tunisia → Qatar
Plus+
I’m Open source addicted! In My Team
→ 70+ open source projects → We’re passionate about quality and efficiency
→ All for one & one for all - MENAIO Summit '18 (goo.gl/KZWabk)
Compute App Container Cloud Cloud Cloud Cloud Resource Cloud Security Key
Engine Engine Engine BigQuery Cloud IAM
Dataflow Dataproc Dataprep Manager Scanner Management
Service
Cloud Container- Cloud Cloud Data Data Loss Identity-Aware Security Key
GPU Genomics BeyondCorp
Functions Optimized OS Datalab Pub/Sub Studio Prevention API Proxy Enforcement
BETA BETA
Cloud IoT Cloud Machine Cloud Cloud Cloud Video Cloud Cloud Cloud Data
Core Learning Vision API Speech API Intelligence Storage Bigtable Datastore Transfer
API Appliance
Private
BETA
Developer Tools
The Products logos contained in this icon library may be used freely and without permission to accurately reference Google's technology and tools, for instance in books or architecture diagrams. 12
GCP Compute
Compute Engine
IaaS
Compute, Storage & Network
Run VMs on Google Infrastructure
Billing, 1st minute then per second
Up to 96 cores and 624 GB memory
Predefined & Custom machine types
Sustained and committed usage discount
App Engine
PaaS
Free quota
Auto scaling
Lego-like services
Massively scalable
You, your app and Google
Java, Python, PHP, Go, .Net, Node.js, custom
Services Powered by App Engine
● Khan Academy
○ Non for profit educational organisation
○ 10 million unique users / month, 300+ million lessons, 5000+
videos
● Snapchat
○ Photo and video messaging app
○ 100 million active users / day, 8,796 photos shared / second, 7
billion video views / day
● Rovio
○ Mobile / Web games
○ 140+ million downloads, 13+ million users / month
Typical Web App Architecture
Operating System
n g
ni
s
ation
Tu
i c
on
Ap p l
f
ig
Indexes
ur
a
tio
ns
Maintenance
ity
bil
Secu Sh
ala
rity P ard
atch
Sc
es ing
Har
s den
Fa ilure Replication ing
dw are
Har
Typical Web App Architecture
Ca r e
n ’ t
Do
With Google App Engine
And if you had high traffic..
We’ve got your back! App Engine lets you go big from 1st day!
Container Engine
Infrastructure as Code
Docker Support
Fully Managed Kubernetes Clusters
Highly Scalable
Private Container Registry
BETA
Cloud Function
Serverless Model
Integrated with: PubSub, Datastore, etc.
Mobile Ready: Execute from Firebase
Support for Node.js
Pay only for function execution
Use Cases
● Mobile Backend
● APIs, Microservices
● IoT
● HTTP Hooks
● ETL
GCP Storage
Cloud Storage
IaaS
Multi-petabytes Object storage
Globally replicated
Highly available and reliable
Flexible security models
Cloud SQL
Relational MySQL database
Fully managed
Highly available
Auto backup
MySQL + PostgresQL
Cloud Datastore
NoSQL like solution
Fully managed
Highly available and scalable
Flexible access
Autoscaled
BigQuery
Columnar Database
Big Data Warehouse
SQL like queries
Analyse terabytes of data
Streaming data
Batch processing
Cloud Spanner
Relational Database
Horizontally scalable
High performance & availability
Automatic replication
Fully managed
Cloud Bigtable
Massively scalable NoSQL
Low latency, High throughput
Good for both operational + analytical
Seamless cluster resizing
Fully managed
Building your own solution is like LEGO
GCP Data Processing
Big Data & Challenges
● Big data is data that is so large and complex that it becomes difficult to
process using traditional tools.
● Widely characterised in terms of three dimensions (3Vs):
○ Volume: massive datasets (terabytes, petabytes,...)
○ Variety: different kinds of data (structured, semi-structured and unstructured).
○ Velocity: the rate at which the data is generated from batch to real time.
● Traditional OLTP and data warehouse (ETL, data marts and star schemas)
only deals with structured data
● Web logs, social media, device logs, Cisco netflow collector, etc. Nothing
done all data is archived or deleted
● Schema on Write is not suitable for such data
● Opportunities lost (Insights, etc.)
Big Data on GCP Zero-ops, serverless Big Data architecture
Constrained Standard
Devices Devices Storage
Non-TCP HTTPS
Cloud
e.g. BLE
Storage
Cloud
Datastore
Ingest Pipelines Application &
Cloud Presentation
Cloud Cloud Bigtable
Pub/Sub Dataflow App
Engine
Cloud IoT Analytics
Core Monitoring Container
Cloud Engine
Gateway
Dataflow
Compute
Logging
BigQuery Engine
Cloud
Dataproc
Cloud
Datalab
GCP Data Processing
Kubernetes
TensorFlow
Getting Started
What we’ve covered
GCP Compute
GCP Storage
GCP IoT Core
Kubernetes
TensorFlow
GCP Data Processing
Where to Get Started
https://cloud.google.com/getting-started/
https://codelabs.developers.google.com/?cat=Cloud
Something Free
● https://cloud.google.com/free/
● Free Trial: $300 and 12 months
● Free Tier extends beyond 12
months too (Always Free)
Thank You!
Abdelrahman Omran | @Omranic | [email protected]