Redshift VS BigQuery

May 6, 20175 likes2,262 views

in this presentation we go through the differences and similarities between Redshift and BigQuery. It was presented during the Athens Big Data meetup May 2017.

Amazon Redshift
Released on 2012 (beta)
based on ParAccel (PostgreSQL clone)
Designed for OLAP and BIapplications
Relationaland Columnardatabase
Petabyteto Exabytescale (Spectrum)

Google BigQuery
evolution of Dremel(2006)
Initially launched in 2010
WebService on top of Dremel Technology
More of a hybridsystem (columnar + nested data)
Petabytescale

Amazon Redshift Google BigQuery
Build on top of a proven technology
Relational
SQL
Analysts
Build something from scratch
Nested data structures are a first class citizen
NoSQL
Developers
VS

Amazon Redshift Google BigQuery
S3
Kinesis
CSV, Avro, JSON
Google Cloud Storage
Streaming Inserts
Google Analytics Premium
CSV, Avro, JSON
VS

Amazon Redshift Google BigQuery
Schemas
Tables
Datasets
Tables
VS

Data Types
Redshift:Closer to the StandardSQLdatatypes (e.g. INT4,
INT8) but doesnotsupport the full range of PostgreSQL
data types
BigQuery: Smaller set of data types supported. But...

Data Types
Redshift:Very basic support for JSON
BigQuery: Support for Array and STRUCT types. Nesteddata
structures are first class citizens.

Data Manipulation
BigQuery used to be appendonly, now it supportsUpdates
andDeletes (DML). But still limited.
Redshift always had this Supported via SQL but with a
catch (Vacuum)

Table Manipulation
BigQuery: Limited and expensive via standard SQL, or via
HTTP API (but you have to unload and reload the table).
Redshift: Supported via SQL
Both support views but not materialized

Data Consistency
Redshift supports transactions VS BigQuery No
Deduplication harder to be achieved on BigQuery (costly
also).
Even more complex when we go streaming.

Data Consistency
Kinesis: At least once semantics
BigQuery: best-effort deduplication time window +
insertId.

Cluster Management
Here is where BigQueryreallyshines. It is fullymanaged with
supportforHA.
Redshift doesnotabstract completely the hardware from the
user and it is difficult to implement it as a HA service.
This changes with Spectrum.

Connectivity
Redshift:API+ FullJDBC/ODBCsupport.
& access to all the standardPostgreSQL tools.
BigQuery: Mainly through the RESTAPI, JDBC/ODBC drivers
only for queries.

Authentication
Redshift:AWSIAM
BigQuery: OAuth

Amazon Redshift Google BigQuery
Resources capped by your cluster size
No quotas related to inserts/updates
etc
2,000 slots per account
Encourages the append only model with
strict DML quotas
Both have a limit of 50 concurrent Queries
Cluster resizing a pain with Redshift.

Optimization
Redshift:DistributionKeys(Partitioning),SortKeys,Column
Compression
BigQuery: You don’t have to worry about all these, but it
allows you to define time based partitioning.

Optimization
Redshift:DistributionKeys(Partitioning),SortKeys,Column
Compression
With great power comes great responsibility: Vacuuming

Optimization
With BigQueryyou can only optimize your queries on the
statement level and partition over time.

Costs
BigQuery:more difficulttoestimatecosts but costs scale
based on usage. $5 / TB (on demand)
Redshift: you know exactlyhow much you will pay but
you payregardlessofusage.

Performance
BenchmarkbyPanoply
DebunkingMisleadingBenchmarksOfRedshiftvsBigQuery
HNDiscussion
BenchmarkbyPeriscopeData

Amazon Redshift Google BigQueryVS
similarities are greater than the differences

Amazon Redshift Google BigQuery
More predictable costs
More intuitive data modeling (Analysts)
Options for optimizations
Easier & cheaper to start with
Good for nested data
Easier to work with time series
VS

Thanks!kostas@blendo.co
www.blendo.co
Get the free Amazon Redshift guide
http://bit.ly/redshift-guide

BigQuery is Google Cloud Platform's interactive big data service that allows users to analyze massive datasets in seconds using SQL-like queries. It offers a scalable and fast way to query terabytes of data without the expense of maintaining servers or databases. BigQuery organizes data into a project-dataset-table hierarchy and uses a distributed architecture to efficiently process queries across servers.

Google BigQuery Best PracticesMatillion

In this webinar you'll learn about the best practices for Google BigQuery—and how Matillion ETL makes loading your data faster and easier. Find out from our experts how to leverage one of the largest, fastest, and most capable cloud data warehouses to improve your business and save money. In this webinar: - Discover how to work fast and efficiently with Google BigQuery - Find out the best ways to monitor and control costs - Learn to leverage Matillion ETL and optimize Google BigQuery - Get tips and tricks for better performance

Google Dremel. Concept and Implementations.Vicente Orjales

Big Query BasicsIdo Green

Google BigQuery - Features & BenefitsAndreas Raible

Introduction to NoSQL DatabasesDerek Stainer

This document provides an overview and introduction to NoSQL databases. It begins with an agenda that explores key-value, document, column family, and graph databases. For each type, 1-2 specific databases are discussed in more detail, including their origins, features, and use cases. Key databases mentioned include Voldemort, CouchDB, MongoDB, HBase, Cassandra, and Neo4j. The document concludes with references for further reading on NoSQL databases and related topics.

Big Data Analytics with Google BigQuery. By Javier Ramirez. All your base Co...javier ramirez

BigQuery for BeginnersBetter&Stronger

An short introduction on Big Query. With this presentation you'll quickly discover : How load data in BigQuery How to build dashboard using BigQuery How to work with BigQuery and, at last but not least, we've added some best practices We hope you'll enjoy this presentation and that it will help you to start exploring this wonderful solution. Don't hesitate to send us your feedbacks or questions

You might be paying too much for BigQueryRyuji Tamagawa

My Talk at GCPUG-Taiwan on 2015/5/8. You use BigQuery with SQL, but the internal work of BigQuery is very different from traditional Relational Database systems you may familiar with. One of the way to understand how BigQuery works is to see it from the cost you pay for BigQuery. Knowing how to save money while using BigQuery is to know how BigQuery works to some extent. In this session, let’s talk about practical knowledge (saving money) and exciting technology (how BigQuery works)!

An overview of BigQuery GirdhareeSaran

Big queryTanvi Parikh

Google BigQuery is Google's fully managed big data analytics service that allows users to analyze very large datasets. It offers a fast and easy to use service with no infrastructure to manage. Developers can stream up to 100,000 rows of data per second for near real-time analysis. BigQuery bills users per project on a pay-as-you-go model, with the first 1TB of data processed each month free of charge.

9. Document Oriented DatabasesFabio Fumarola

BigQuery walk through.pptxVikRam S

Introduction to MongoDBMongoDB

MS-SQL SERVER ARCHITECTUREDouglas Bernardini

MS SQL Server is a database server produced by Microsoft that enables users to write and execute SQL queries and statements. It consists of several features like Query Analyzer, Profiler, and Service Manager. Multiple instances of SQL Server can be installed on a machine, with each instance having its own set of users, databases, and other objects. SQL Server uses data files, filegroups, and transaction logs to store database objects and record transactions. The data dictionary contains metadata about database schemas and is stored differently in Oracle and SQL Server.

[오픈소스컨설팅]Day #1 MySQL 엔진소개, 튜닝, 백업 및 복구, 업그레이드방법Ji-Woong Choi

PostgreSQL Database Slidesmetsarin

Online index rebuild automationCarlos Sierra

AWS Simple Storage Service (s3) zekeLabs Technologies

Training for AWS Solutions Architect at http://zekelabs.com/courses/amazon-web-services-training-bangalore/.Training for AWS Solutions Architect at http://zekelabs.com/courses/amazon-web-services-training-bangalore/. This slide describes about features of simple storage service, s3 buckets, s3-static web hosting, cross region replication, storage classes and comparison, glacier, transfer acceleration, life cycle management, security and encryption ___________________________________________________ zekeLabs is a Technology training platform. We provide instructor led corporate training and classroom training on Industry relevant Cutting Edge Technologies like Big Data, Machine Learning, Natural Language Processing, Artificial Intelligence, Data Science, Amazon Web Services, DevOps, Cloud Computing and Frameworks like Django,Spring, Ruby on Rails, Angular 2 and many more to Professionals. Reach out to us at www.zekelabs.com or call us at +91 8095465880 or drop a mail at [email protected]

Mongodb basics and architectureBishal Khanal

MongoDB is a document-oriented NoSQL database written in C++. It uses a document data model and stores data in BSON format, which is a binary form of JSON that is lightweight, traversable, and efficient. MongoDB is schema-less, supports replication and high availability, auto-sharding for scaling, and rich queries. It is suitable for big data, content management, mobile and social applications, and user data management.

Top 65 SQL Interview Questions and Answers | EdurekaEdureka!

** MYSQL DBA Certification Training https://www.edureka.co/mysql-dba ** This Edureka PPT on Top 65 SQL Interview Question and Answers will help you to prepare yourself for Database Administrators Interviews. It covers questions for beginners, intermediate and experienced professionals. Follow us to never miss an update in the future. Instagram: https://www.instagram.com/edureka_learning/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

Getting started with BigQueryPradeep Bhadani

This document provides an overview of BigQuery and how to get started with it. BigQuery is a fully managed data warehouse offered by Google Cloud Platform. It offers a serverless, fast, and scalable solution for data analysis. The document discusses what BigQuery is, its key features and concepts like datasets, tables, and billing. It also covers best practices for query performance and cost optimization. The presenter provides their contact details and links to their website and YouTube channel for additional resources.

Mongodb vs mysqlhemal sharma

This document compares MySQL and MongoDB databases. MySQL is an open-source relational database that uses structured query language and requires defining a schema upfront. MongoDB is a non-relational database that stores data as JSON-like documents, uses dynamic schemas, and supports complex data structures easily. The document discusses their differences in flexibility, querying languages, relationships, performance, security models, popular use cases, and when each database is generally better suited. It concludes that neither is necessarily better, and they serve different purposes depending on project needs.

Google BigQuery for Everyday DeveloperMárton Kodok

IV. IT&C Innovation Conference - October 2016 - Sovata, Romania A. Every scientist who needs big data analytics to save millions of lives should have that power Legacy systems don’t provide the power. B. The simple fact is that you are brilliant but your brilliant ideas require complex analytics. Traditional solutions are not applicable. The Plan: have oversight over developments as they happen. Goal: Store everything accessible by SQL immediately. What is BigQuery? Analytics-as-a-Service - Data Warehouse in the Cloud Fully-Managed by Google (US or EU zone) Scales into Petabytes Ridiculously fast Decent pricing (queries $5/TB, storage: $20/TB) *October 2016 pricing 100.000 rows / sec Streaming API Open Interfaces (Web UI, BQ command line tool, REST, ODBC) Familiar DB Structure (table, views, record, nested, JSON) Convenience of SQL + Javascript UDF (User Defined Functions) Integrates with Google Sheets + Google Cloud Storage + Pub/Sub connectors Client libraries available in YFL (your favorite languages) Our benefits no provisioning/deploy no running out of resources no more focus on large scale execution plan no need to re-implement tricky concepts (time windows / join streams) pay only the columns we have in your queries run raw ad-hoc queries (either by analysts/sales or Devs) no more throwing away-, expiring-, aggregating old data.

An Introduction To NoSQL & MongoDBLee Theobald

This document provides an introduction to NoSQL and MongoDB. It discusses that NoSQL is a non-relational database management system that avoids joins and is easy to scale. It then summarizes the different flavors of NoSQL including key-value stores, graphs, BigTable, and document stores. The remainder of the document focuses on MongoDB, describing its structure, how to perform inserts and searches, features like map-reduce and replication. It concludes by encouraging the reader to try MongoDB themselves.

Altinity Quickstart for ClickHouse-2202-09-15.pdfAltinity Ltd

Welcome to a live session of our popular introduction to ClickHouse application development. The talk explains what ClickHouse is and how to install it. We then work through the basics of inserting and selecting data, followed by tips on how to maximize the legendary performance of ClickHouse. You’ll get everything you need to get started on your own application, including some time at the end for questions.

Oracle architecture with details-yogiji creationsYogiji Creations

Oracle is a database management system with a multi-tiered architecture. It consists of a database on disk that contains tables, indexes and other objects. An Oracle instance contains a memory area called the System Global Area that services requests from client applications. Background processes facilitate communication between the memory structures and database files on disk. Logical database structures like tablespaces, segments, extents and blocks help organize and manage the physical storage of data.

Apache Hadoop India Summit 2011 talk "Making Hadoop Enterprise Ready with Am...Yahoo Developer Network

1) Amazon Elastic MapReduce enables customers to easily process vast amounts of data by launching Hadoop clusters across AWS infrastructure. 2) It provides features for managing, monitoring, and debugging Hadoop jobs and clusters without the operational complexities of Hadoop. 3) New features were announced that provide more flexibility for enterprises including expanding and shrinking running clusters, using spot instances to reduce costs, and additional support options.

Nonrelational DatabasesUdi Bauman

Non-relational databases were developed to address the problems that traditional relational databases have in handling web-scale applications with massive amounts of data and users. They sacrifice consistency to gain availability and partition tolerance. Examples include BigTable, HBase, Dynamo, and Cassandra. They provide benefits like massive scalability, high availability, and elasticity through techniques like consistent hashing, replication, and MapReduce processing.

More Related Content

What's hot (20)

BigQuery for BeginnersBetter&Stronger

You might be paying too much for BigQueryRyuji Tamagawa

An overview of BigQuery GirdhareeSaran

Big queryTanvi Parikh

9. Document Oriented DatabasesFabio Fumarola

BigQuery walk through.pptxVikRam S

Introduction to MongoDBMongoDB

MS-SQL SERVER ARCHITECTUREDouglas Bernardini

[오픈소스컨설팅]Day #1 MySQL 엔진소개, 튜닝, 백업 및 복구, 업그레이드방법Ji-Woong Choi

PostgreSQL Database Slidesmetsarin

Online index rebuild automationCarlos Sierra

AWS Simple Storage Service (s3) zekeLabs Technologies

Mongodb basics and architectureBishal Khanal

Top 65 SQL Interview Questions and Answers | EdurekaEdureka!

Getting started with BigQueryPradeep Bhadani

Mongodb vs mysqlhemal sharma

Google BigQuery for Everyday DeveloperMárton Kodok

An Introduction To NoSQL & MongoDBLee Theobald

Altinity Quickstart for ClickHouse-2202-09-15.pdfAltinity Ltd

Oracle architecture with details-yogiji creationsYogiji Creations

BigQuery for BeginnersBetter&Stronger

You might be paying too much for BigQueryRyuji Tamagawa

An overview of BigQuery GirdhareeSaran

Big queryTanvi Parikh

9. Document Oriented DatabasesFabio Fumarola

BigQuery walk through.pptxVikRam S

Introduction to MongoDBMongoDB

MS-SQL SERVER ARCHITECTUREDouglas Bernardini

[오픈소스컨설팅]Day #1 MySQL 엔진소개, 튜닝, 백업 및 복구, 업그레이드방법Ji-Woong Choi

PostgreSQL Database Slidesmetsarin

Online index rebuild automationCarlos Sierra

AWS Simple Storage Service (s3) zekeLabs Technologies

Mongodb basics and architectureBishal Khanal

Top 65 SQL Interview Questions and Answers | EdurekaEdureka!

Getting started with BigQueryPradeep Bhadani

Mongodb vs mysqlhemal sharma

Google BigQuery for Everyday DeveloperMárton Kodok

An Introduction To NoSQL & MongoDBLee Theobald

Altinity Quickstart for ClickHouse-2202-09-15.pdfAltinity Ltd

Oracle architecture with details-yogiji creationsYogiji Creations

Similar to Redshift VS BigQuery (20)

Apache Hadoop India Summit 2011 talk "Making Hadoop Enterprise Ready with Am...Yahoo Developer Network

Nonrelational DatabasesUdi Bauman

SQL Server 2016 new featuresSpanishPASSVC

Building a modern data warehouseJames Serra

Embarking on building a modern data warehouse in the cloud can be an overwhelming experience due to the sheer number of products that can be used, especially when the use cases for many products overlap others. In this talk I will cover the use cases of many of the Microsoft products that you can use when building a modern data warehouse, broken down into four areas: ingest, store, prep, and model & serve. It’s a complicated story that I will try to simplify, giving blunt opinions of when to use what products and the pros/cons of each.

Moving from SQL Server to MongoDBNick Court

The document summarizes BuzzNumbers' transition from using SQL Server to MongoDB as their database. It discusses problems they faced with SQL Server like scalability issues and performance problems with large datasets. It then covers why they chose to use MongoDB, including its ability to scale horizontally and handle large volumes of writes and reads. Finally, it discusses lessons learned in moving to a NoSQL database and using MongoDB and .NET to build their analytics product.

Build Intelligent Apps with the Microsoft Data & AI PlatformMicrosoft Tech Community

This document summarizes new and updated Azure data and analytics services. It highlights the general availability of SQL Server 2017 on Windows and Linux, Azure Database Migration Service, Azure Databricks, new performance tiers for Azure SQL Data Warehouse and HDInsight Kafka. It also mentions new capabilities for Azure Machine Learning, Azure Data Factory, Azure Database for MySQL and PostgreSQL, and preview releases of Azure SQL Database Managed Instance and other services.

Beyond Relational DatabasesGregory Boissinot

This document provides an overview of relational databases and the emergence of alternative database technologies like NoSQL. It discusses the dominance and stability of relational databases but also some of their limitations for certain use cases. It introduces NoSQL databases and why they emerged, focusing on their scalability and flexibility compared to relational databases. The document describes different types of NoSQL databases and how they handle concepts like schemas, transactions and scaling. It provides examples of when different database types may be more suitable and discusses additional concepts like aggregates, consistency models and sharding.

Amazon-Redshift-dBT-Best-Practices_paper.pdfHoang CHi THang

SQL Server 2008 for Developersukdpe

Open Source für den geschäftskritischen EinsatzMariaDB plc

The document summarizes MariaDB's 2017 roadshow. It discusses that MariaDB is building an easy to use, extendable database that can be deployed on premise, in the cloud, or in a hybrid environment. It also notes that MariaDB provides enterprise features like high availability, performance, and security while being fully open source and encouraging community collaboration. Finally, it provides information on where MariaDB is used and how organizations can get support from MariaDB.

Data SLA in the public cloudLiran Zelkha

The document discusses data service level agreements (SLAs) in public cloud environments. It explains that achieving availability, consistency, and scalability is challenging due to Brewer's CAP theorem. It reviews strategies for relational and NoSQL databases to handle these tradeoffs, including dropping consistency or availability depending on needs. Code examples demonstrate typical operations for Cassandra, MongoDB, and Neo4J NoSQL databases. The conclusion recommends choosing solutions based on requirements and migrating to NoSQL as needed to address scaling issues.

http://www.hfadeel.com/Blog/?p=151xlight

The document discusses scalable storage systems and key-value stores as an alternative to traditional databases. It provides an overview of vertical and horizontal scalability. Traditional databases are not well-suited for scalable systems due to their complexity, wasted features, and multi-step query processing. Key-value stores offer simpler data models and interfaces that are designed from the start for scaling across hundreds of machines. Performance comparisons show key-value stores significantly outperforming traditional databases. The document also outlines how key-value storage systems work at the aggregation and storage layers.

Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...Severalnines

Join Johan Andersson, CTO at Severalnines, and Ralf Gebhardt, Product Manager at MariaDB, as they unveil the latest release of ClusterControl, the all-inclusive database management system that lets you easily deploy, monitor, manage and scale highly available open source databases - and load balancers - in any environment: on-premise or in the cloud. We have a particular focus on MariaDB 10.2, thanks to Ralf’s participation, who talk us through the latest features, and give us a sneak preview of what to expect in MariaDB 10.3. ClusterControl now supports the latest versions of MariaDB, MySQL NDB Cluster and PostgreSQL; and introduces a series of new database backup functionalities that range from AWS & Google Cloud integration backup services to automatic backup verifications, making it ever more efficient to run a solid backup strategy for open source database infrastructures. We also look at our new operational reports and email notification features - all in a live demo that you don’t want to miss. AGENDA - MariaDB 10.2: all the new features and a first look at MariaDB 10.3 - ClusterControl 1.5 - What’s new: - MariaDB 10.2 support - AWS & Google Cloud services integration - Enhanced backup functions - New features & support for: - PostgreSQL - MySQL NDB Cluster - ProxySQL - Operational reports - Live demo - Q&A PRESENTERS Johan Andersson, CTO, Severalnines - Johan's technical background and interest are in high performance computing as demonstrated by the work he did on main-memory clustered databases at Ericsson as well as his research on parallel Java Virtual Machines at Trinity College Dublin in Ireland. Prior to co-founding Severalnines, Johan was Principal Consultant and lead of the MySQL Clustering & High Availability consulting group at MySQL / Sun Microsystems / Oracle, where he designed and implemented large-scale MySQL systems for key customers. Johan is a regular speaker at MySQL User Conferences as well as other high profile community gatherings with popular talks and tutorials around architecting and tuning MySQL Clusters. Ralf Gebhardt is Product Manager at MariaDB Corporation. He is responsible for MariaDB Server and MariaDB Connectors. He joined MariaDB/SkySQL in 2011 as Principal Sales Engineer. After 10 years professional experience in Software Development, Support, Training and Consulting, He started working at MySQL GmbH as Sales Engineer in 2002. In the course of the acquisition of Sun Microsystems he joined Oracle, still responsible for MySQL. He holds a masters degree in Computer Engineering from the University of Cooperative Education (in cooperation with IBM Deutschland).

[pgday.Seoul 2022] PostgreSQL with Google CloudPgDay.Seoul

Google Cloud offers several fully managed database services for PostgreSQL workloads, including Cloud SQL and AlloyDB. Cloud SQL provides a fully managed relational database service for PostgreSQL, MySQL, and SQL Server. It offers 99.999% availability, unlimited scaling, and automatic failure recovery. AlloyDB is a new database engine compatible with PostgreSQL that provides up to 4x faster transactions and 100x faster analytics queries than standard PostgreSQL. It features independent scaling of storage and computing resources. Google Cloud aims to be the best home for PostgreSQL workloads by providing compatibility with open source PostgreSQL and enterprise-grade features, performance, reliability, and support across its database services.

Aws Summit Berlin 2013 - Understanding database options on AWSAWS Germany

NoSQL Options ComparedSergey Bushik

This document compares different NoSQL database options and discusses which type may be best for different use cases. It provides an overview of the current NoSQL landscape and models, including key-value, document, graph and wide column stores. Specific databases like Redis, CouchBase, Neo4j and Cassandra are compared based on features like query support, operations, and commercial options. The document recommends choosing a database based on the specific problem and considering aspects like data size, read/write needs, and tradeoffs between consistency, availability and partitioning. It also advocates starting small but with significance and considering hybrid SQL/NoSQL approaches.

SQL AzureLynn Langit

SQL Azure provides a relational database as a service on the Windows Azure platform. It aims to be familiar to SQL Server developers by using the same programming model and tools. SQL Azure databases are automatically replicated and scaled to ensure high availability and performance. The initial release will focus on supporting common web and departmental application scenarios. Over time, additional SQL Server capabilities will be added as services on SQL Azure.

Whats New Sql Server 2008 R2Eduardo Castro

About "Apache Cassandra"Jihyun Ahn

The document provides an overview of Apache Cassandra, an open-source distributed database management system. It discusses Cassandra's peer-to-peer architecture that allows for scalability and availability. The key concepts covered include Cassandra's data model using columns, rows, column families and its distribution across nodes using consistent hashing of row keys. The document also briefly outlines Cassandra's basic read and write operations and how it handles replication and failure recovery.

Sql azure dec_2010 Lynn & IkeIke Ellis

Apache Hadoop India Summit 2011 talk "Making Hadoop Enterprise Ready with Am...Yahoo Developer Network

Nonrelational DatabasesUdi Bauman

SQL Server 2016 new featuresSpanishPASSVC

Building a modern data warehouseJames Serra

Moving from SQL Server to MongoDBNick Court

Build Intelligent Apps with the Microsoft Data & AI PlatformMicrosoft Tech Community

Beyond Relational DatabasesGregory Boissinot

Amazon-Redshift-dBT-Best-Practices_paper.pdfHoang CHi THang

SQL Server 2008 for Developersukdpe

Open Source für den geschäftskritischen EinsatzMariaDB plc

Data SLA in the public cloudLiran Zelkha

http://www.hfadeel.com/Blog/?p=151xlight

Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...Severalnines

[pgday.Seoul 2022] PostgreSQL with Google CloudPgDay.Seoul

Aws Summit Berlin 2013 - Understanding database options on AWSAWS Germany

NoSQL Options ComparedSergey Bushik

SQL AzureLynn Langit

Whats New Sql Server 2008 R2Eduardo Castro

About "Apache Cassandra"Jihyun Ahn

Sql azure dec_2010 Lynn & IkeIke Ellis

Recently uploaded (20)

brainstorming-techniques-infographics.pptxmaritzacastro321

AllContacts Vs AllSubscribers - SFMC.pptxbpkr84

computer organization and assembly language.docxalisoftwareengineer1

Data Analytics Overview and its applicationsJanmejayaMishra7

Cleaned_Lecture 6666666_Simulation_I.pdfalcinialbob1234

LLM finetuning for multiple choice google bertChadapornK

How iCode cybertech Helped Me Recover My Lost Fundsireneschmid345

I was devastated when I realized that I had fallen victim to an online fraud, losing a significant amount of money in the process. After countless hours of searching for a solution, I came across iCode cybertech. From the moment I reached out to their team, I felt a sense of hope that I can recommend iCode Cybertech enough for anyone who has faced similar challenges. Their commitment to helping clients and their exceptional service truly set them apart. Thank you, iCode cybertech, for turning my situation around! [email protected]

Stack_and_Queue_Presentation_Final (1).pptxbinduraniha86

Andhra Pradesh Micro Irrigation Project”vzmcareers

Chromatography_Detailed_Information.docxNohaSalah45

Calories_Prediction_using_Linear_Regression.pptxTijiLMAHESHWARI

Simple_AI_Explanation_English somplr.pptxssuser2aa19f

Minions Want to eat presentacion muy lindaCarlaAndradesSoler1

How to join illuminati Agent in uganda call+256776963507/0741506136illuminati Agent uganda call+256776963507/0741506136

Developing Security Orchestration, Automation, and Response ApplicationsVICTOR MAESTRE RAMIREZ

Template_A3nnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnncegiver630

Telangana State, India’s newest state that was carved from the erstwhile state of Andhra Pradesh in 2014 has launched the Water Grid Scheme named as ‘Mission Bhagiratha (MB)’ to seek a permanent and sustainable solution to the drinking water problem in the state. MB is designed to provide potable drinking water to every household in their premises through piped water supply (PWS) by 2018. The vision of the project is to ensure safe and sustainable piped drinking water supply from surface water sources

DPR_Expert_Recruitment_notice_Revised.pdfinmishra17121973

presentation of first program exist.pptxMajidAzeemChohan

Geometry maths presentation for begginerszrjacob283

Shotgun detailed overview my this ppt formatefreefreefire0998

brainstorming-techniques-infographics.pptxmaritzacastro321

AllContacts Vs AllSubscribers - SFMC.pptxbpkr84

computer organization and assembly language.docxalisoftwareengineer1

Data Analytics Overview and its applicationsJanmejayaMishra7

Cleaned_Lecture 6666666_Simulation_I.pdfalcinialbob1234

LLM finetuning for multiple choice google bertChadapornK

How iCode cybertech Helped Me Recover My Lost Fundsireneschmid345

Stack_and_Queue_Presentation_Final (1).pptxbinduraniha86

Andhra Pradesh Micro Irrigation Project”vzmcareers

Chromatography_Detailed_Information.docxNohaSalah45

Calories_Prediction_using_Linear_Regression.pptxTijiLMAHESHWARI

Simple_AI_Explanation_English somplr.pptxssuser2aa19f

Minions Want to eat presentacion muy lindaCarlaAndradesSoler1

How to join illuminati Agent in uganda call+256776963507/0741506136illuminati Agent uganda call+256776963507/0741506136

Developing Security Orchestration, Automation, and Response ApplicationsVICTOR MAESTRE RAMIREZ

Template_A3nnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnncegiver630

DPR_Expert_Recruitment_notice_Revised.pdfinmishra17121973

presentation of first program exist.pptxMajidAzeemChohan

Geometry maths presentation for begginerszrjacob283

Shotgun detailed overview my this ppt formatefreefreefire0998

Redshift VS BigQuery

1. BigQuery Redshift VS

4. Amazon Redshift Released on 2012 (beta) based on ParAccel (PostgreSQL clone) Designed for OLAP and BIapplications Relationaland Columnardatabase Petabyteto Exabytescale (Spectrum)

5. Google BigQuery evolution of Dremel(2006) Initially launched in 2010 WebService on top of Dremel Technology More of a hybridsystem (columnar + nested data) Petabytescale

6. Amazon Redshift Google BigQuery Build on top of a proven technology Relational SQL Analysts Build something from scratch Nested data structures are a first class citizen NoSQL Developers VS

7. Loading Data

8. Amazon Redshift Google BigQuery S3 Kinesis CSV, Avro, JSON Google Cloud Storage Streaming Inserts Google Analytics Premium CSV, Avro, JSON VS

9. Data Modeling

10. Amazon Redshift Google BigQuery Schemas Tables Datasets Tables VS

11. Data Types

12. Data Types Redshift:Closer to the StandardSQLdatatypes (e.g. INT4, INT8) but doesnotsupport the full range of PostgreSQL data types BigQuery: Smaller set of data types supported. But...

13. Data Types Redshift:Very basic support for JSON BigQuery: Support for Array and STRUCT types. Nesteddata structures are first class citizens.

14. Working with Data

15. Data Manipulation BigQuery used to be appendonly, now it supportsUpdates andDeletes (DML). But still limited. Redshift always had this Supported via SQL but with a catch (Vacuum)

16. Table Manipulation BigQuery: Limited and expensive via standard SQL, or via HTTP API (but you have to unload and reload the table). Redshift: Supported via SQL Both support views but not materialized

17. Data Consistency

18. Data Consistency Redshift supports transactions VS BigQuery No Deduplication harder to be achieved on BigQuery (costly also). Even more complex when we go streaming.

19. Data Consistency Kinesis: At least once semantics BigQuery: best-effort deduplication time window + insertId.

20. Cluster Management

21. Cluster Management Here is where BigQueryreallyshines. It is fullymanaged with supportforHA. Redshift doesnotabstract completely the hardware from the user and it is difficult to implement it as a HA service. This changes with Spectrum.

22. Cluster Management Connectivity

23. Connectivity Redshift:API+ FullJDBC/ODBCsupport. & access to all the standardPostgreSQL tools. BigQuery: Mainly through the RESTAPI, JDBC/ODBC drivers only for queries.

24. Authentication Redshift:AWSIAM BigQuery: OAuth

25. Cluster Management Quotas

26. Amazon Redshift Google BigQuery Resources capped by your cluster size No quotas related to inserts/updates etc 2,000 slots per account Encourages the append only model with strict DML quotas Both have a limit of 50 concurrent Queries Cluster resizing a pain with Redshift.

27. Cluster Management Optimization

28. Optimization Redshift:DistributionKeys(Partitioning),SortKeys,Column Compression BigQuery: You don’t have to worry about all these, but it allows you to define time based partitioning.

29. Optimization Redshift:DistributionKeys(Partitioning),SortKeys,Column Compression With great power comes great responsibility: Vacuuming

30. Optimization With BigQueryyou can only optimize your queries on the statement level and partition over time.

31. Cluster Management Costs

32. Costs BigQuery:more difficulttoestimatecosts but costs scale based on usage. $5 / TB (on demand) Redshift: you know exactlyhow much you will pay but you payregardlessofusage.

33. Ecosystem

35. Performance

36. Performance BenchmarkbyPanoply DebunkingMisleadingBenchmarksOfRedshiftvsBigQuery HNDiscussion BenchmarkbyPeriscopeData

37. BigQuery Redshift OR ??

38. Amazon Redshift Google BigQueryVS similarities are greater than the differences

39. Amazon Redshift Google BigQuery More predictable costs More intuitive data modeling (Analysts) Options for optimizations Easier & cheaper to start with Good for nested data Easier to work with time series VS

40. [email protected] www.blendo.co Get the free Amazon Redshift guide http://bit.ly/redshift-guide

Redshift VS BigQuery

Recommended

More Related Content

What's hot (20)

Similar to Redshift VS BigQuery (20)

Recently uploaded (20)

Redshift VS BigQuery