SlideShare a Scribd company logo
DynomiteDB
High availability via a shared nothing architecture
with no single point of failure (SPOF)
Agenda
• What is DynomiteDB?
• Other Solutions ?
• DynomiteDB concepts
• Dynomite Architecture
• Demo Time
What is DynomiteDB?
• DynomiteDB is a high performance Dynamo layer that adds data replication and
sharding to Redis and other single-server storage engines, plus the ability to scale
linearly, high availability via a shared nothing architecture with no single point of
failure (SPOF), and support for 1000+ node clusters that span multiple data
centers.
• A high performance, linearly scalable, highly available (HA) and distributed open-
source database with support for pluggable persistent and in-memory storage
engines.
• Redis provides DynomiteDB with a high performance backend and is the primary
API supported by Dynomite. You can use any Redis client in your favorite
programming language to build high performance, scalable applications with
DynomiteDB.
Other solutions?
• Twenproxy - redis api limited, just sharding depends on sentinel
(limited,complex)
• Codis – Many componentes whick makes a complex solution
(complex and depends on sentinel)
• Redis Cluster – not a solution!
• Redis Sentinel – Active/Passive (No way)
DynomiteDB
• DynomiteDB is a high performance Dynamo layer that adds data
replication and sharding to Redis.
• Multiple storage engines supported.
• Linear Scability
• high availability via a shared nothing architecture with no single point
of failure (SPOF)
• Support for 1000+ node clusters that span multiple data centers.
• Persistent storages supported
• Sync/Async replication depends on consistency level
• Peer-to-peer architecture
DynamoniteDB Architecture
dc_one dc_quorum
Architecture Considerations
• The number of racks per DC defines the replication factor (RF). The RF is
the number of replicas per DC.
• Each replica is stored on a different node where each replica node is in a
different rack
• Data token range is defined on each node dynomiteDB configuration file
• It´s extremely important planning data token range before deployment
• Write and read consistency level must be defined to fit your needs
Demo requirements
• Three servers topology
• One DC, three racks with one node each ( testing purposes).
• A token range defined by: 0, 1431655765 e 2863311530
• Redis as backend
Demo architecture
Replication Test
Solution Resilience/High Availability
Thank you!
Questions?
More information:
Linkedin
https://www.linkedin.com/in/leandro-totino-pereira-06726227
Facebook:
https://www.facebook.com/leandro.totinopereira

More Related Content

What's hot (20)

PDF
RedisConf17 - Redis Enterprise on IBM Power Systems
Redis Labs
 
PDF
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Redis Labs
 
PPTX
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs
 
PDF
Scylla Summit 2016: Compose on Containing the Database
ScyllaDB
 
PPTX
ClustrixDB: how distributed databases scale out
MariaDB plc
 
PPTX
How to power microservices with MariaDB
MariaDB plc
 
PDF
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red_Hat_Storage
 
PDF
Scylla Summit 2022: Building Zeotap's Privacy Compliant Customer Data Platfor...
ScyllaDB
 
PDF
How to Build a Scylla Database Cluster that Fits Your Needs
ScyllaDB
 
PDF
How Kafka and MemSQL Became the Dynamic Duo (Sarung Tripathi, MemSQL) Kafka S...
HostedbyConfluent
 
PDF
Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...
confluent
 
PPTX
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
Red_Hat_Storage
 
PPTX
How we switched to columnar at SpendHQ
MariaDB plc
 
PDF
RedisConf18 - Redis at LINE - 25 Billion Messages Per Day
Redis Labs
 
PDF
Latency and Consistency Tradeoffs in Modern Distributed Databases
ScyllaDB
 
PPTX
HBaseConAsia2018 Track3-2: HBase at China Telecom
Michael Stack
 
PDF
Scylla Summit 2022: Operating at Monstrous Scales: Benchmarking Petabyte Work...
ScyllaDB
 
PPTX
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Eric Carter
 
PDF
Voldemort on Solid State Drives
Vinoth Chandar
 
PPTX
RedisConf18 - Re-architecting Redis-on-Flash with Intel 3DX Point™ Memory
Redis Labs
 
RedisConf17 - Redis Enterprise on IBM Power Systems
Redis Labs
 
Dynomite: A Highly Available, Distributed and Scalable Dynamo Layer--Ioannis ...
Redis Labs
 
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs
 
Scylla Summit 2016: Compose on Containing the Database
ScyllaDB
 
ClustrixDB: how distributed databases scale out
MariaDB plc
 
How to power microservices with MariaDB
MariaDB plc
 
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red_Hat_Storage
 
Scylla Summit 2022: Building Zeotap's Privacy Compliant Customer Data Platfor...
ScyllaDB
 
How to Build a Scylla Database Cluster that Fits Your Needs
ScyllaDB
 
How Kafka and MemSQL Became the Dynamic Duo (Sarung Tripathi, MemSQL) Kafka S...
HostedbyConfluent
 
Performance Tuning RocksDB for Kafka Streams' State Stores (Dhruba Borthakur,...
confluent
 
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
Red_Hat_Storage
 
How we switched to columnar at SpendHQ
MariaDB plc
 
RedisConf18 - Redis at LINE - 25 Billion Messages Per Day
Redis Labs
 
Latency and Consistency Tradeoffs in Modern Distributed Databases
ScyllaDB
 
HBaseConAsia2018 Track3-2: HBase at China Telecom
Michael Stack
 
Scylla Summit 2022: Operating at Monstrous Scales: Benchmarking Petabyte Work...
ScyllaDB
 
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Eric Carter
 
Voldemort on Solid State Drives
Vinoth Chandar
 
RedisConf18 - Re-architecting Redis-on-Flash with Intel 3DX Point™ Memory
Redis Labs
 

Similar to DynomiteDB - No spof High-availability Redis cluster solution (20)

PPTX
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld
 
PDF
End of RAID as we know it with Ceph Replication
Ceph Community
 
PDF
Red hat storage el almacenamiento disruptivo
Nextel S.A.
 
PPTX
RedisConf17 - Redis Enterprise: Continuous Availability, Unlimited Scaling, S...
Redis Labs
 
PDF
Presentacion redislabs-ihub
ssuser9d7c90
 
PPTX
Introduction to Redis
Arnab Mitra
 
PPTX
Azure DocumentDB Overview
Andrew Liu
 
PDF
Running Production CDC Ingestion Pipelines With Balaji Varadarajan and Pritam...
HostedbyConfluent
 
PPTX
Redis meetup
Nikhil Dole
 
PPTX
What's new with enterprise Redis - Leena Joshi, Redis Labs
Redis Labs
 
PDF
Redis
Hung-yu Lin
 
PDF
NoSQL – Data Center Centric Application Enablement
DATAVERSITY
 
PDF
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Celia Chase
 
PDF
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
DoKC
 
PDF
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
DoKC
 
PPTX
1.2 build cloud_fabric_final
Paulo Freitas
 
PPTX
Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020
Redis Labs
 
PDF
Hpc lunch and learn
John D Almon
 
PPTX
Automating a PostgreSQL High Availability Architecture with Ansible
EDB
 
PDF
Dell EMC: Virtualizace není jen hypervisor!
MarketingArrowECS_CZ
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld
 
End of RAID as we know it with Ceph Replication
Ceph Community
 
Red hat storage el almacenamiento disruptivo
Nextel S.A.
 
RedisConf17 - Redis Enterprise: Continuous Availability, Unlimited Scaling, S...
Redis Labs
 
Presentacion redislabs-ihub
ssuser9d7c90
 
Introduction to Redis
Arnab Mitra
 
Azure DocumentDB Overview
Andrew Liu
 
Running Production CDC Ingestion Pipelines With Balaji Varadarajan and Pritam...
HostedbyConfluent
 
Redis meetup
Nikhil Dole
 
What's new with enterprise Redis - Leena Joshi, Redis Labs
Redis Labs
 
NoSQL – Data Center Centric Application Enablement
DATAVERSITY
 
Reliable Storage for High Availability, Disaster Recovery, Clouds and Contain...
Celia Chase
 
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
DoKC
 
Disaggregated Container Attached Storage - Yet Another Topology with What Pur...
DoKC
 
1.2 build cloud_fabric_final
Paulo Freitas
 
Moving Beyond Cache by Yiftach Shoolman Redis Labs - Redis Day Seattle 2020
Redis Labs
 
Hpc lunch and learn
John D Almon
 
Automating a PostgreSQL High Availability Architecture with Ansible
EDB
 
Dell EMC: Virtualizace není jen hypervisor!
MarketingArrowECS_CZ
 
Ad

Recently uploaded (20)

PPTX
Introduction to Fluid and Thermal Engineering
Avesahemad Husainy
 
PPTX
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
PPTX
business incubation centre aaaaaaaaaaaaaa
hodeeesite4
 
PDF
Packaging Tips for Stainless Steel Tubes and Pipes
heavymetalsandtubes
 
PPTX
Online Cab Booking and Management System.pptx
diptipaneri80
 
PDF
STUDY OF NOVEL CHANNEL MATERIALS USING III-V COMPOUNDS WITH VARIOUS GATE DIEL...
ijoejnl
 
PDF
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
PDF
Air -Powered Car PPT by ER. SHRESTH SUDHIR KOKNE.pdf
SHRESTHKOKNE
 
PDF
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
PDF
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
PPTX
filteration _ pre.pptx 11111110001.pptx
awasthivaibhav825
 
PDF
Advanced LangChain & RAG: Building a Financial AI Assistant with Real-Time Data
Soufiane Sejjari
 
PPTX
ETP Presentation(1000m3 Small ETP For Power Plant and industry
MD Azharul Islam
 
PDF
CAD-CAM U-1 Combined Notes_57761226_2025_04_22_14_40.pdf
shailendrapratap2002
 
PPTX
Information Retrieval and Extraction - Module 7
premSankar19
 
PPTX
Inventory management chapter in automation and robotics.
atisht0104
 
PPTX
MSME 4.0 Template idea hackathon pdf to understand
alaudeenaarish
 
PDF
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
PPTX
Precedence and Associativity in C prog. language
Mahendra Dheer
 
PDF
Jual GPS Geodetik CHCNAV i93 IMU-RTK Lanjutan dengan Survei Visual
Budi Minds
 
Introduction to Fluid and Thermal Engineering
Avesahemad Husainy
 
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
business incubation centre aaaaaaaaaaaaaa
hodeeesite4
 
Packaging Tips for Stainless Steel Tubes and Pipes
heavymetalsandtubes
 
Online Cab Booking and Management System.pptx
diptipaneri80
 
STUDY OF NOVEL CHANNEL MATERIALS USING III-V COMPOUNDS WITH VARIOUS GATE DIEL...
ijoejnl
 
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
Air -Powered Car PPT by ER. SHRESTH SUDHIR KOKNE.pdf
SHRESTHKOKNE
 
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
filteration _ pre.pptx 11111110001.pptx
awasthivaibhav825
 
Advanced LangChain & RAG: Building a Financial AI Assistant with Real-Time Data
Soufiane Sejjari
 
ETP Presentation(1000m3 Small ETP For Power Plant and industry
MD Azharul Islam
 
CAD-CAM U-1 Combined Notes_57761226_2025_04_22_14_40.pdf
shailendrapratap2002
 
Information Retrieval and Extraction - Module 7
premSankar19
 
Inventory management chapter in automation and robotics.
atisht0104
 
MSME 4.0 Template idea hackathon pdf to understand
alaudeenaarish
 
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
Precedence and Associativity in C prog. language
Mahendra Dheer
 
Jual GPS Geodetik CHCNAV i93 IMU-RTK Lanjutan dengan Survei Visual
Budi Minds
 
Ad

DynomiteDB - No spof High-availability Redis cluster solution

  • 1. DynomiteDB High availability via a shared nothing architecture with no single point of failure (SPOF)
  • 2. Agenda • What is DynomiteDB? • Other Solutions ? • DynomiteDB concepts • Dynomite Architecture • Demo Time
  • 3. What is DynomiteDB? • DynomiteDB is a high performance Dynamo layer that adds data replication and sharding to Redis and other single-server storage engines, plus the ability to scale linearly, high availability via a shared nothing architecture with no single point of failure (SPOF), and support for 1000+ node clusters that span multiple data centers. • A high performance, linearly scalable, highly available (HA) and distributed open- source database with support for pluggable persistent and in-memory storage engines. • Redis provides DynomiteDB with a high performance backend and is the primary API supported by Dynomite. You can use any Redis client in your favorite programming language to build high performance, scalable applications with DynomiteDB.
  • 4. Other solutions? • Twenproxy - redis api limited, just sharding depends on sentinel (limited,complex) • Codis – Many componentes whick makes a complex solution (complex and depends on sentinel) • Redis Cluster – not a solution! • Redis Sentinel – Active/Passive (No way)
  • 5. DynomiteDB • DynomiteDB is a high performance Dynamo layer that adds data replication and sharding to Redis. • Multiple storage engines supported. • Linear Scability • high availability via a shared nothing architecture with no single point of failure (SPOF) • Support for 1000+ node clusters that span multiple data centers. • Persistent storages supported • Sync/Async replication depends on consistency level • Peer-to-peer architecture
  • 7. Architecture Considerations • The number of racks per DC defines the replication factor (RF). The RF is the number of replicas per DC. • Each replica is stored on a different node where each replica node is in a different rack • Data token range is defined on each node dynomiteDB configuration file • It´s extremely important planning data token range before deployment • Write and read consistency level must be defined to fit your needs
  • 8. Demo requirements • Three servers topology • One DC, three racks with one node each ( testing purposes). • A token range defined by: 0, 1431655765 e 2863311530 • Redis as backend