Relational Databases - Benefits and Challenges

Oct 4, 20160 likes245 views

This document discusses relational databases and some of their key properties and tradeoffs. It notes that consistency, availability, and partition tolerance in shared data systems can only achieve two of the three properties at once, according to Brewer's CAP theorem. The document then examines different requirements like querying, transactions, consistency and scaling in the context of choosing a database for a startup's application. It provides an example use case of using PostgreSQL, Redis, and MongoDB together to address these requirements for a listings application called Kuai List.

Relational Databases
An experience by a young startup aficionado

"The primary online data store for an
application is the worst place to take a risk with
new technology."
Adam D' Angelo - Quora CEO

CAP Theorem
"Of three properties of shared-data systems-data
Consistency, system Availability and tolerance to
network Partitions - only two can be achieved at any
given moment in time."
- 2000 Prof. Eric Brewer, PoDC Conference Keynote
- 2002 Seth Gilbert and Nancy Lynch, ACM SIGACT News 33(2)

How Do I choose the right Database?
How do elephants make decisions?
They make the smartest decisions,
hence no sacrifices are needed.

It’s all about the Trade-offs
Source: http://blog.nahurst.com/visual-guide-to-nosql-systems

Trade-offs and theories are naturally
confusing!!!

Hands-on experience is the best
The most improvised white-board ever!

Requirement #1:
What do we know already?

Requirement #2:
What is trending?
Source: http://db-engines.com/en/ranking_trend

Requirement #3:
What about complex queries?
AHA!!! Relationships do matter right?

Requirement #4:
What about Transactions?
● Transactions ensure that you atomically make changes to your database.

Requirement #5:
What about Consistency?
● Achieved through ACID transactions.
● Consistency is about ensuring that all clients have the same view of the data.

Requirement #6:
How about Scaling?
● Option 1: I assume we can scale as we go...
● Option2: How about implementing Layers (Memecached) on top of Relational DBs.
(Facebook, Twitter and Airbnb)
● Option 3: If scaling is urgent, how about partitioning at the application level. (FriendFeed)

Use Case:
Kuai List
● We use PostgreSQL for writing and updating listings only.
● For retrieving at desirable speeds we use Amazon Elasticache (Redis - in-memory cache)
on top of our core relational database.
● NoSQL (MongoDB) for storing listings that never change.

Scaling Challenge #1:
Host in the cloud
● We migrated our core database to Amazon RDS (with zero downtime).
● Amazon RDS makes it easy to use replication to enhance availability and reliability for
production workloads.

Consistency:
Synchronous Replication
Datacenter A
Datacenter B
Datacenter C
Datacenter D

This document provides an overview of key concepts for AWS Certified Data Analytics, including data structures, types, preparation, sources, formats (structured, unstructured, semi-structured), the data lifecycle, AWS services for data storage and analytics, and visualization. It emphasizes that data is a valuable commodity and discusses challenges of analyzing growing unstructured data from various sources using traditional tools.

Big Data Analytics & ArchitectureAnjani Phuyal

Azure cognitive serviceVishwas N

1. The document discusses artificial intelligence and machine learning models, from research and development to production deployment. 2. It notes that AI today is trying to mimic human senses through computer vision, natural language processing, and cognitive capabilities like perception and perspectives. 3. The document outlines the machine learning lifecycle from data collection and training to model deployment on various targets using products that leverage machine learning.

Reactive Reatime Big Data with Open Source Lambda Architecture - TechCampVN 2014Trieu Nguyen

This document discusses using a reactive lambda architecture with open source tools to solve real-time big data problems. It begins by defining big data and explaining that simply having data is not enough - you need to solve the right problems with the right team and tools. It then presents three example problems that could benefit from real-time big data solutions: disaster prediction and response, understanding customers through social media data, and optimizing marketing campaigns in real-time. The document proposes using a reactive lambda architecture along with open source frameworks like Hadoop, Spark, Storm and databases like Redis, HDFS and HBase to build streaming data pipelines and query data in real-time. It demonstrates this through a social media user tracking and personalized recommendations use

Distributed Tracing: New DevOps FoundationCodeOps Technologies LLP

An Overview of Data Management Paradigms: Relational, Document, and GraphMarko Rodriguez

Here are the key steps: 1. Create vertex for each band member with properties like name, etc 2. Create vertex for each song with properties like title 3. Create edge between band member and song to indicate they performed it 4. Add properties to edges like number of performances This models the relationships between band members and songs they played in a graph structure optimized for traversal.

NewSQL - The Future of Databases?Elvis Saravia

NewSQL databases seek to provide the same scalable performance as NoSQL databases for online transaction processing workloads, while still maintaining the ACID guarantees of a traditional SQL database. NewSQL databases use new architectures like multi-version concurrency control and partition-level locking to allow for horizontal scaling and high availability without sacrificing consistency. They also provide highly optimized SQL engines to query data in a distributed environment.

Big data business caseKarthik Padmanabhan ( MLE℠)

This document discusses big data concepts including what constitutes big data, dimensions of big data, the big data lifecycle, and where big data is used. It provides examples of big data use cases in industries like automotive, healthcare, and retail. Key aspects of big data technologies like Hadoop, HDFS, MapReduce, and NoSQL databases are explained at a high level. The challenges of big data including the CAP theorem and approaches to distributed and parallel processing are also summarized.

Essential Data Engineering for Data Scientist SoftServe

Big Data - Need of Converged Data PlatformGeekNightHyderabad

MongoDB and In-Memory ComputingDylan Tong

MongoDB World 2019: MongoDB Cluster Design: From Redundancy to GDPRMongoDB

No matter if you're thinking of migrating to MongoDB, or need to meet legal requirements for an existing on-prem cluster, this talk has you covered. We start with the basics of replication and sharding and quickly scale up, covering everything you need to know to control your data, and keep it safe from unexpected data loss or downtime - a well-designed MongoDB cluster should have no single point of failure. Learn how others are “stretching” what’s possible but why you shouldn't! I'll present real-world examples from my life in the field in Europe and beyond.

SparkNitish Upreti

The document provides an overview of the Spark framework for lightning fast cluster computing. It discusses how Spark addresses limitations of MapReduce-based systems like Hadoop by enabling interactive queries and iterative jobs through caching data in-memory across clusters. Spark allows loading datasets into memory and querying them repeatedly for interactive analysis. The document covers Spark's architecture, use of resilient distributed datasets (RDDs), and how it provides a unified programming model for batch, streaming, and interactive workloads.

The Future of Distributed DatabasesNuoDB

Big Data made easy in the era of the Cloud - Demi Ben-AriDemi Ben-Ari

Five Ways To Do Data Analytics "The Wrong Way"Discover Pinterest

The document discusses various approaches to data analytics and common pitfalls. It provides examples of recommendation systems at Netflix and Pandora that achieved success by focusing on the business goals rather than just the technology. It also warns against complexifying systems and architectures unnecessarily over time and refusing to remove outdated components. Overall it advocates embracing complexity but also avoiding duct tape solutions, and designing systems with the intended use and business goals in mind rather than getting attached to specific technologies.

Real time data viz with Spark Streaming, Kafka and D3.jsBen Laird

This document discusses building a dynamic visualization of large streaming transaction data. It proposes using Apache Kafka to handle the transaction stream, Apache Spark Streaming to process and aggregate the data, MongoDB for intermediate storage, a Node.js server, and Socket.io for real-time updates. Visualization would use Crossfilter, DC.js and D3.js to enable interactive exploration of billions of records in the browser.

Who Needs One Database Anyway? byGlauber CostaScyllaDB

How much money do you lose every time your ecommerce site goes down?DataStax

In today’s environment, you must serve your customers with uptime (all the time) availability, plus hidden benefits like state-of-the-art fraud detection and game-changing recommendation engines. In this webinar, you’ll learn how to: -Get uptime, all the time, so you can serve your customers without outages -Ingest huge velocities of data from anywhere -Maximize mobile, online and cloud applications with the security your customers expect -Identify patterns between formerly silo’d data, even text and call logs -Get the search & insight you need without performance hits

Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc

Big data workloads are growing rapidly and require unprecedented scale in data storage, processing power and bandwidth. Cloud infrastructure provides the flexibility and economics needed to support big data's mixed workloads through software-defined compute, storage, networking and security. This allows organizations to gain real-time insights from massive data sets and harness big data's potential for industries like retail, manufacturing and more.

Fai[ Away with Dynamo, Bigtabte, and Cassandra194 cHArlrEF.docxssuser454af01

Fai[ Away with Dynamo, Bigtabte, and Cassandra 194 cHArlrEFt =; Database Processing (2) Does this design eliminate the potential for data integrity problems that occur in the spreadsheet? \iVhy or whynot? (3) Design a database for the data model that uses l4lork- Version2. Speciff key and foreign key columns. (a) Design a database for the data models that uses Work- Version?. Specify key and foreign key columns. (5) Is the design with Work-Version2 betler than the design for Work-Version3? Why or why not? d. Figure 5-30c shows a third alternative data model for the sheet-music-tracking problem. In this data model, use As you learned in Case Study 1, Amazon.com processed more than 306 order items per second on its peak day of the 2012 holiday sales season. To do that, it processed customer transactions on tens of thousands of servers. With that many com- puters, failure is inevitable. Even if the probability of any one server failing is .0001, the likelihood that not one out of 10,000 of them fails is .9999 raised to the 10,000 power, which is about .37. Thus, for these assumptions the likelihood of at least one failure is 63 percent. For reasons that go beyond the scope of this discussion, the likelihood of failure is actually much greater. Amazon.com must be able to thrive, even in the presence of such constant failure. O! as Arfiazon.com engineers stated: "Customers should be able to view and add items to their shopping cart even if disks are failing, network routes are flap- ping, o1 data centers are being destroyed byioinadosl'e The onlyway to deal with such failure is to replicate the data on multiple servers. \{/hen a customer stores a Wish List, for example, that Wish List needs to be stored on different, geo- graphically separated servers. Then, when (notice when, not fl a server with one copy of the Wish List fails, Amazon.com applications obtain it from another server. Such data replication solves one problem but introduces another Suppose that the customer's Wish List is stored on servers A, B, and C and server A fails. \Arhile server A is dolrm, server B or C can provide a copy of the Wish List, but if the either Work_Version2 or Work_Version3, whichever you think is better. (r) Select identifiers for each entity in your data fustiffyour selection. (2) Summarize the differences befiiveen this data model and that in Figure 5-30b. \tVhich data model is better? why? (3) Design a database for this data model. Speci$r key and foreign key columns. Which of the three data models is the best? fusti$r your customer changes it, that Wish List can only be rewritten servers B and C. It cannot be written to A, because A is running. When server A comes back into service, it will the old copy of the Wish List. The next day, when the reopens his or her Wish List, two different versions the most recent one on servers B and C and an older one server A. The customer wants the most current one. How Amazon.com ensure that it w ...

Navigating NoSQL in cloudy skiesshnkr_rmchndrn

NoSQL is not a buzzword anymore. The array of non- relational technologies have found wide-scale adoption even in non-Internet scale focus areas. With the advent of the Cloud...the churn has increased even more yet there is no crystal clear guidance on adoption techniques and architectural choices surrounding the plethora of options available. This session initiates you into the whys & wherefores, architectural patterns, caveats and techniques that will augment your decision making process & boost your perception of architecting scalable, fault-tolerant & distributed solutions.

Big data managementzeba khanam

Big data management requires large data centers to store the vast amounts of data being generated. Hadoop is a technology used to manage big data across clusters of commodity servers in data centers. It uses a distributed file system and is designed to parallelize data processing. Data centers are facilities that house computer systems and associated components, such as telecommunications and storage systems, that are needed to manage big data. They contain rows of server racks and must have sufficient power and cooling to handle large amounts of structured and unstructured data from sources like the New York Stock Exchange, Google, and Facebook. As data volumes continue increasing rapidly, more advanced technologies will be needed to manage big data in the future.

AI Scalability for the Next DecadePaula Koziol

If you're like most of the world, you're on an aggressive race to implement machine learning applications and on a path to get to deep learning. If you can give better service at a lower cost, you will be the winners in 2030. But infrastructure is a key challenge to getting there. What does the technology infrastructure look like over the next decade as you move from Petabytes to Exabytes? How are you budgeting for more colossal data growth over the next decade? How do your data scientists share data today and will it scale for 5-10 years? Do you have the appropriate security, governance, back-up and archiving processes in place? This session will address these issues and discuss strategies for customers as they ramp up their AI journey with a long term view.

Intro to Spark development Spark Summit

The document is an agenda for an intro to Spark development class. It includes an overview of Databricks, the history and capabilities of Spark, and the agenda topics which will cover RDD fundamentals, transformations and actions, DataFrames, Spark UIs, and Spark Streaming. The class will include lectures, labs, and surveys to collect information on attendees' backgrounds and goals for the training.

Document Databases In Online Publishing Irakli Nadareishvili

Irakli describes how he tricked conference organizers into letting him speak by exaggerating his qualifications. He is director of engineering at National Public Radio, where he leads the software team responsible for NPR's website and apps. Previously, he developed open-source products for online publishers. While only having used document databases for about a year, he enjoyed the experience and wanted to share his story of falling in love with these databases at the conference.

Availability in a cloud native world v1.6 (Feb 2019)removed_414e600f33c7539c2e1b596a774aaebd

The Future of Brain-Powered Learning Elvis Saravia

The document discusses the potential future of brain-machine interfaces (BMI) in education in the year 2050. It describes a proposed BMI learning network called BLiNK that would allow for direct brain-to-brain communication and knowledge sharing between learners and instructors. BLiNK is suggested to offer personalized learning pathways, virtual classrooms, access to knowledge databases, and real-time analytics on learning progress. The pros of BLiNK include learner-centered and on-demand education, while the cons could include issues regarding privacy, health, and potential for brain hacking or mind control if not properly regulated.

Introduction to Fundamentals of RNNsElvis Saravia

The document provides an overview of recurrent neural networks (RNNs). RNNs can model sequential data by incorporating information about previous elements in the sequence through their hidden state. RNNs share parameters across time steps and can capture long-term dependencies. They are well-suited for applications involving time series data and natural language. The document reviews the basic components of RNNs including recurrent neurons, unfolding RNNs over time, and training RNNs using backpropagation through time.

More Related Content

Similar to Relational Databases - Benefits and Challenges (20)

Big data business caseKarthik Padmanabhan ( MLE℠)

Essential Data Engineering for Data Scientist SoftServe

Big Data - Need of Converged Data PlatformGeekNightHyderabad

MongoDB and In-Memory ComputingDylan Tong

MongoDB World 2019: MongoDB Cluster Design: From Redundancy to GDPRMongoDB

SparkNitish Upreti

The Future of Distributed DatabasesNuoDB

Big Data made easy in the era of the Cloud - Demi Ben-AriDemi Ben-Ari

Five Ways To Do Data Analytics "The Wrong Way"Discover Pinterest

Real time data viz with Spark Streaming, Kafka and D3.jsBen Laird

Who Needs One Database Anyway? byGlauber CostaScyllaDB

How much money do you lose every time your ecommerce site goes down?DataStax

Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc

Fai[ Away with Dynamo, Bigtabte, and Cassandra194 cHArlrEF.docxssuser454af01

Navigating NoSQL in cloudy skiesshnkr_rmchndrn

Big data managementzeba khanam

AI Scalability for the Next DecadePaula Koziol

Intro to Spark development Spark Summit

Document Databases In Online Publishing Irakli Nadareishvili

Availability in a cloud native world v1.6 (Feb 2019)removed_414e600f33c7539c2e1b596a774aaebd

Big data business caseKarthik Padmanabhan ( MLE℠)

Essential Data Engineering for Data Scientist SoftServe

Big Data - Need of Converged Data PlatformGeekNightHyderabad

MongoDB and In-Memory ComputingDylan Tong

MongoDB World 2019: MongoDB Cluster Design: From Redundancy to GDPRMongoDB

SparkNitish Upreti

The Future of Distributed DatabasesNuoDB

Big Data made easy in the era of the Cloud - Demi Ben-AriDemi Ben-Ari

Five Ways To Do Data Analytics "The Wrong Way"Discover Pinterest

Real time data viz with Spark Streaming, Kafka and D3.jsBen Laird

Who Needs One Database Anyway? byGlauber CostaScyllaDB

How much money do you lose every time your ecommerce site goes down?DataStax

Keynote Address at 2013 CloudCon: Future of Big Data by Richard McDougall (In...exponential-inc

Fai[ Away with Dynamo, Bigtabte, and Cassandra194 cHArlrEF.docxssuser454af01

Navigating NoSQL in cloudy skiesshnkr_rmchndrn

Big data managementzeba khanam

AI Scalability for the Next DecadePaula Koziol

Intro to Spark development Spark Summit

Document Databases In Online Publishing Irakli Nadareishvili

Availability in a cloud native world v1.6 (Feb 2019)removed_414e600f33c7539c2e1b596a774aaebd

More from Elvis Saravia (8)

The Future of Brain-Powered Learning Elvis Saravia

Introduction to Fundamentals of RNNsElvis Saravia

Text mining lab (summer 2017) - Word Vector RepresentationElvis Saravia

Thesis oral defense 2015 elvis saraviaElvis Saravia

This document summarizes a student's master's thesis project on inferring user interests from microblog data through opinion mining. The project developed a framework that uses contextual and emotion analysis of Twitter data to identify users' interests. It extracts interest candidates using POS tagging, keyword extraction, and rule-based concept extraction. It then classifies emotions and filters interests based on positive emotions. The identified interests are ranked and categorized to infer users' top interests. Experiments showed the approach achieved over 80% precision on average at identifying top interests. Future work could analyze emotion patterns over time and consider negative emotions.

An Introduction to Apache SparkElvis Saravia

Spark is a big data processing framework built in Scala that runs on the JVM. It provides speed, generality, ease of use, and accessibility for processing large datasets. Spark features include working directly on memory for speed, supporting MapReduce, lazy evaluation of queries for optimization, and APIs for Scala, R and Python. It includes Spark Streaming for real-time data, Spark SQL for SQL queries, and MLlib for machine learning. Resilient Distributed Datasets (RDDs) are Spark's fundamental data structure, and MapReduce is a programming model used for processing large amounts of data in parallel.

The Neurochemistry of MusicElvis Saravia

Crowdsource Delivery System - Improving traditional delivery systemsElvis Saravia

This document proposes a crowdsourced delivery system to improve traditional delivery methods. It outlines problems with current systems like delays and inefficiency. The proposed solution uses humans as delivery runners. Sellers would post products for sale online and specify a delivery fee. The system would notify runners to deliver products fast and efficiently. Key features include tracking runner locations, recommendation systems based on location, and a reputation system to build trust. The goal is a reliable, efficient and automated delivery process without limitations.

Subconscious Crowdsourcing: A Feasible Data Collection Mechanism for Mental D...Elvis Saravia

1) The document proposes a method called "subconscious crowdsourcing" to collect social media data from users with mental disorders in order to build predictive models for mental disorder detection. 2) It extracts linguistic and behavioral features from Twitter data like emotion transitions and social interactions to train models for bipolar disorder and borderline personality disorder classification. 3) Experimental results show the TF-IDF model achieves the best performance in 10-fold cross validation tests and addresses the selection bias problem of prior work by detecting actual disorder sufferers rather than just those discussing mental health topics.

The Future of Brain-Powered Learning Elvis Saravia

Introduction to Fundamentals of RNNsElvis Saravia

Text mining lab (summer 2017) - Word Vector RepresentationElvis Saravia

Thesis oral defense 2015 elvis saraviaElvis Saravia

An Introduction to Apache SparkElvis Saravia

The Neurochemistry of MusicElvis Saravia

Crowdsource Delivery System - Improving traditional delivery systemsElvis Saravia

Subconscious Crowdsourcing: A Feasible Data Collection Mechanism for Mental D...Elvis Saravia

Recently uploaded (20)

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Procurement Insights Cost To Value Guide.pptxJon Hansen

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

How analogue intelligence complements AIPaul Rowe

Artificial Intelligence is providing benefits in many areas of work within the heritage sector, from image analysis, to ideas generation, and new research tools. However, it is more critical than ever for people, with analogue intelligence, to ensure the integrity and ethical use of AI. Including real people can improve the use of AI by identifying potential biases, cross-checking results, refining workflows, and providing contextual relevance to AI-driven results. News about the impact of AI often paints a rosy picture. In practice, there are many potential pitfalls. This presentation discusses these issues and looks at the role of analogue intelligence and analogue interfaces in providing the best results to our audiences. How do we deal with factually incorrect results? How do we get content generated that better reflects the diversity of our communities? What roles are there for physical, in-person experiences in the digital world?

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Cyber Awareness overview for 2025 month of securityriccardosl1

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

Procurement Insights Cost To Value Guide.pptxJon Hansen

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

How analogue intelligence complements AIPaul Rowe

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

Cyber Awareness overview for 2025 month of securityriccardosl1

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Relational Databases - Benefits and Challenges

1. Relational Databases An experience by a young startup aficionado

2. "The primary online data store for an application is the worst place to take a risk with new technology." Adam D' Angelo - Quora CEO

3. CAP Theorem "Of three properties of shared-data systems-data Consistency, system Availability and tolerance to network Partitions - only two can be achieved at any given moment in time." - 2000 Prof. Eric Brewer, PoDC Conference Keynote - 2002 Seth Gilbert and Nancy Lynch, ACM SIGACT News 33(2)

4. How Do I choose the right Database? How do elephants make decisions? They make the smartest decisions, hence no sacrifices are needed.

5. It’s all about the Trade-offs Source: http://blog.nahurst.com/visual-guide-to-nosql-systems

6. But is it really just about trade-offs?

7. Trade-offs and theories are naturally confusing!!!

8. Hands-on experience is the best The most improvised white-board ever!

9. Requirement #1: What do we know already?

10. Requirement #2: What is trending? Source: http://db-engines.com/en/ranking_trend

11. That was easy!!!

12. Requirement #3: What about complex queries? AHA!!! Relationships do matter right?

13. Requirement #4: What about Transactions? ● Transactions ensure that you atomically make changes to your database.

14. Requirement #5: What about Consistency? ● Achieved through ACID transactions. ● Consistency is about ensuring that all clients have the same view of the data.

15. Requirement #6: How about Scaling? ● Option 1: I assume we can scale as we go... ● Option2: How about implementing Layers (Memecached) on top of Relational DBs. (Facebook, Twitter and Airbnb) ● Option 3: If scaling is urgent, how about partitioning at the application level. (FriendFeed)

16. Use Case: Kuai List ● We use PostgreSQL for writing and updating listings only. ● For retrieving at desirable speeds we use Amazon Elasticache (Redis - in-memory cache) on top of our core relational database. ● NoSQL (MongoDB) for storing listings that never change.

17. Scaling Challenge #1: Host in the cloud ● We migrated our core database to Amazon RDS (with zero downtime). ● Amazon RDS makes it easy to use replication to enhance availability and reliability for production workloads.

18. Consistency: Synchronous Replication Datacenter A Datacenter B Datacenter C Datacenter D

Relational Databases - Benefits and Challenges

Recommended

More Related Content

Similar to Relational Databases - Benefits and Challenges (20)

More from Elvis Saravia (8)

Recently uploaded (20)

Relational Databases - Benefits and Challenges