ScyllaDB Real-Time Event Processing with CDC

Jun 20, 2024Download as PPTX, PDF0 likes376 views

ScyllaDB’s Change Data Capture (CDC) allows you to stream both the current state as well as a history of all changes made to your ScyllaDB tables. In this talk, Senior Solution Architect Guilherme Nogueira will discuss how CDC can be used to enable Real-time Event Processing Systems, and explore a wide-range of integrations and distinct operations (such as Deltas, Pre-Images and Post-Images) for you to get started with it.

Real-Time Event
Processing with CDC
Guilherme Nogueira, Senior Solutions
Architect

Guilherme Nogueira
■ Senior Solutions Architect @ ScyllaDB
■ Previously at IBM
■ Loves all things open source
■ Just got a new puppy!

■ What is CDC?
■ Use cases
■ Comparison
■ Record types
■ Consuming CDC data
Presentation Agenda

Change Data Capture – CDC
Consumable modification record for one or more tables
■ Key Feature of ScyllaDB (GA'd in 4.3/2021.1)
■ Constantly receiving improvements
■ Capture changes (write/delete/updates)
■ Each change can trigger an event
■ Asynchronously readable by a Consumer
■ Unified for both CQL and DynamoDB Streams

Where and How is CDC Used
■ Database Replication (Elasticsearch)
■ Notification Systems
■ External Cache Invalidation
■ In-flight Analytics
■ Such as Fraud Detection
■ Downstream Application Triggers

How does ScyllaDB CDC Compares Against ...
Cassandra DynamoDB MongoDB ScyllaDB
Consumer location on-node off-node off-node off-node
Replication duplicated deduplicated deduplicated deduplicated
Deltas yes limited partial optional
Pre-image no yes no optional
Post-image no yes yes optional
Slow consumer
reaction
Table stopped Consumer loses data Consumer loses data Consumer loses data
Ordering no yes yes yes

What do I Get Out of CDC?
Delta Preimage Postimage
'full': contain
information about every
modified column
'keys': only the primary
key of the change will
be recorded
'false': Disables the
feature
'true': contain only the
columns that were
changed by the write
‘full’: contain the entire
row (how it was before
the write was made)
'false': Disables the
feature
'true': show the affected
row’s state after the
write. Postimage row
always contains all the
columns no matter if they
were affected by the
change or not
What was changed? What was before? What’s the end result?

How to Consume CDC Data
■ CDC data is available through normal CQL
■ Easy to read raw streams
■ Already de-duplicated
■ All delta and pre image values are normal CQL data
■ Can consume without knowledge of server internals
■ Layered approach
■ CDC core functionality relatively simple. Allows for more sophisticated
adaptors
■ Push models etc.

Integration Libraries
■ High(er) level CDC consumer libraries with examples:
■ Java – https://github.com/scylladb/scylla-cdc-java
■ Go – https://github.com/scylladb/scylla-cdc-go
■ Rust – https://github.com/scylladb/scylla-cdc-rust
■ Python - coming
■ Kafka integration https://github.com/scylladb/scylla-cdc-source-
connector

■ Easy to integrate and consume
■ Plain tables
■ Robust
■ Replicated in same way as normal data
■ Benefits from all read path improvements
■ Reasonable overhead
■ Coalesced writes to same replica ranges
■ Overhead is comparable to adding another table
■ Does not overflow if consumer fails to act
■ Data is TTL'd
Why CDC on ScyllaDB?

Stay in Touch
Guilherme Nogueira
guilherme.nogueira@scylladb.com
hopugop
https://www.linkedin.com/in/guilherme-nogueira-
4740a116/

Scylla began with a Cassandra compatibility story, implementing Cassandra’s query language (CQL) and replicating its user-visible architecture. Recently we introduced “Alternator” - an experimental feature adding compatibility with a second NoSQL database: Amazon’s DynamoDB. In this talk we look at why DynamoDB’s API was chosen as a good target for our API extension, how DynamoDB is similar to Scylla - and how it differs, and how we can implement DynamoDB’s API in Scylla. We will describe our progress so far in making Alternator compatible with DynamoDB - and what still remains to be done so that any DynamoDB application can run unmodified on Scylla.

Exploring ScyllaDB’s DynamoDB-Compatible API by Guilherme Nogueira & Nadav Ha...ScyllaDB

NoSQL Database Migration Masterclass - Session 3: Migration LogisticsScyllaDB

Scylla Summit 2022: Building Zeotap's Privacy Compliant Customer Data Platfor...ScyllaDB

Customer Data Platforms, commonly called CDPs, form an integral part of the marketing stack powering Zeotap's Adtech and Martech use-cases. The company offers a privacy-compliant CDP platform, and ScyllaDB is an integral part. Zeotap's CDP demands a mix of OLTP, OLAP, and real-time data ingestion, requiring a highly-performant store. In this presentation, Shubham Patil, Lead Software Engineer, and Safal Pandita, Senior Software Engineer at Zeotap will share how ScyllaDB is powering their solution and why it's a great fit. They begin by describing their business use case and the challenges they were facing before moving to ScyllaDB. Then they cover their technical use-cases and requirements for real-time and batch data ingestions. They delve into our data access patterns and describe their data model supporting all use cases simultaneously for ingress/egress. They explain how they are using Scylla Migrator for our migration needs, then describe their multiregional, multi-tenant production setup for onboarding more than 130+ partners. Finally, they finish by sharing some of their learnings, performance benchmarks, and future plans. To watch all of the recordings hosted during Scylla Summit 2022 visit our website here: https://www.scylladb.com/summit.

Kernel Recipes 2015 - So you want to write a Linux driver frameworkAnne Nicolas

Writing a new driver framework in Linux is hard. There are many pitfalls along the way; this talk hopes to point out some of those pitfalls and hard lessons learned through examples, advice and humorous anecdotes in the hope that it will aid those adventurous enough to take on the task of writing a new driver framework. The scope of the talk includes internal framework design as well as external API design exposed to drivers and consumers of the framework. This presentation pulls directly from the Michael Turquette’s experience authoring the Common Clock Framework and maintaining that code for the last four years. Additionally Mike has solicited tips and advice from other subsystem maintainers, for a well-rounded overview. Be prepared to learn some winning design patterns and hear some embarrassing stories of framework design gone wrong. Mike Turquette, BayLibre

DynamoDB to ScyllaDB: Technical Comparison and the Path to SuccessScyllaDB

What can you expect when migrating from DynamoDB to ScyllaDB? This session provides a jumpstart based on what we’ve learned from working with your peers across hundreds of use cases. Discover how ScyllaDB’s architecture, capabilities, and performance compares to DynamoDB’s. Then, hear about your DynamoDB to ScyllaDB migration options and practical strategies for success, including our top do’s and don’ts.

Building Next Generation Drivers: Optimizing Performance in Go and RustScyllaDB

Optimizing shard-aware drivers for ScyllaDB has taken multiple initiatives, often requiring a complete rewrite from scratch. Learn the work undertaken to improve performance of ScyllaDB drivers for both Go and Rust, plus how the Rust code base will be used as a core for drivers with other language bindings going forward. The session highlights performance increases obtained using techniques available in the respective programming languages, including shaving performance off Google's B-tree implementation with Go generics, and using the asynchronous Tokio framework as the basis of a new Rust driver.

The Future of Fast Databases: Lessons from a Decade of QuestDBjavier ramirez

Over the last decade, QuestDB has been at the forefront of handling time series data with a focus on speed and efficiency. In this talk, I’ll share practical insights from our experience serving thousands of users, highlighting what we’ve learned about building and maintaining a fast database that can ingest millions of events per second. QuestDB, an open-source time series database, has traditionally relied on a custom-built, non-standard data storage format designed for performance. As we move forward, we’re actively developing its architecture to support open formats like Apache Parquet and Arrow, reflecting a broader industry shift. I’ll discuss the engineering challenges we’ve faced during this transition, the new possibilities it creates, and why these changes are crucial for the evolving database landscape. Through live demos, I’ll showcase QuestDB’s performance in real-time data ingestion and queries, and demonstrate some of the features enabled by these new formats.

Who Needs One Database Anyway? byGlauber CostaScyllaDB

Cassandra to ScyllaDB: Technical Comparison and the Path to SuccessScyllaDB

What can you expect when migrating from Cassandra to ScyllaDB? This session provides a jumpstart based on what we’ve learned from working with your peers across hundreds of use cases. Discover how ScyllaDB’s architecture, capabilities, and performance compares to Cassandra’s. Then, hear about your Cassandra to ScyllaDB migration options and practical strategies for success, including our top do’s and don’ts.

Empowering the AWS DynamoDB™ application developer with AlternatorScyllaDB

Getting started with AWS DynamoDB™ is famously easy, but as an application grows and evolves it often starts to struggle with DynamoDB’s limitations. We introduce Scylla’s Alternator, which provides the same API as DynamoDB but aims to empower the application developer. In this presentation we will survey some of Alternator’s developer-centered features: Alternator lets you test and eventually deploy your application anywhere, on any public cloud or private cluster. It efficiently supports multiple tables so it does not require difficult single-table design. Finally, Alternator provides the developer with strong observability tools. The insights provided by these tools can detect bottlenecks, improve performance and even lower its cost.

Introducing Scylla Open Source 4.0ScyllaDB

Since its inception, Scylla has offered a compelling alternative to Apache Cassandra, providing better performance for a lower cost of ownership. With Scylla Open Source 4.0 we continue to extend our CQL interface features and capabilities and also now provide an open source alternative to DynamoDB, allowing you to run your workloads anywhere, on any cloud provider, or on premises. Join ScyllaDB co-founders, CTO Avi Kivity and CEO Dor Laor, for a look at the new features in Scylla Open Source 4.0, and architectural and cost comparisons with the coming Cassandra 4.0. Topics will include: Improved consistency with our new Lightweight Transactions Scylla Operator for Kubernetes How we stack up against Apache Cassandra 4.0 Our “run anywhere” DynamoDB alternative

Where Did All These Cycles Go?ScyllaDB

This document discusses various places where CPU cycles are wasted in production systems based on insights from continuous profiling of large compute clusters. Some examples of wasted cycles include misconfiguration of the underlying OS, suboptimal choices of dependencies, and excessive serialization/deserialization. Specific issues highlighted include gettimeofday calls on older AWS instances, kubelet directory walking, exception throwing in xgboost, and high CPU usage from zlib. Continuous fleet-wide profiling is becoming an important tool for identifying such performance issues.

[DSC Europe 23] Matteo Molteni - Implementing a Robust CI Workflow with dbt f...DataScienceConferenc1

In this talk, I will discuss how to implement a robust CI (Continuous Integration) workflow with dbt (Data Build Tool) to optimize data warehouse quality. The implementation of a CI workflow can streamline collaboration and improve the quality of the data warehouse by catching errors early in the development process. By leveraging dbt's modular approach and test-driven development practices, the CI workflow can help data teams ensure the accuracy and reliability of their data. Attendees will learn best practices for implementing a CI workflow with dbt and how to optimize their data warehousing quality

CDC patterns in Apache Kafka®confluent

This document discusses using Apache Kafka as a data hub to capture changes from various data sources using change data capture (CDC). It outlines several common CDC patterns like using modification dates, database triggers, or log files to identify changes. It then discusses using Kafka Connect to integrate various data sources like MongoDB, PostgreSQL and replicate changes. The document provides examples of open source CDC connectors and concludes with suggestions for getting involved in the Apache Kafka community.

BigDL: Bringing Ease of Use of Deep Learning for Apache Spark with Jason Dai ...Databricks

BigDL is a distributed deep learning framework for Apache Spark open sourced by Intel. BigDL helps make deep learning more accessible to the Big Data community, by allowing them to continue the use of familiar tools and infrastructure to build deep learning applications. With BigDL, users can write their deep learning applications as standard Spark programs, which can then directly run on top of existing Spark or Hadoop clusters. In this session, we will introduce BigDL, how our customers use BigDL to build End to End ML/DL applications, platforms on which BigDL is deployed and also provide an update on the latest improvements in BigDL v0.1, and talk about further developments and new upcoming features of BigDL v0.2 release (e.g., support for TensorFlow models, 3D convolutions, etc.).

Exploiting GPU's for Columnar DataFrrames by Kiran LonikarSpark Summit

Kiran Lonikar proposes extending Project Tungsten in Spark SQL to enable parallel execution of DataFrame operations on GPUs. The proposal involves refactoring DataFrames to use a columnar layout and generating OpenCL code for batched execution across columns. Initial results show speedups from GPU execution. Future work includes supporting multi-GPU execution and adapting additional systems like Impala that may be better suited than Spark for GPU integration.

Stream, stream, stream: Different streaming methods with Spark and KafkaItai Yaffe

Going into different streaming methods, we will share our experience as early-adopters of Spark Streaming and Spark Structured Streaming, and how we overcame technical barriers (and there were plenty...). We will also present a rather unique solution of using Kafka to imitate streaming over our Data Lake, while significantly reducing our cloud services’ costs. Topics include : * Kafka and Spark Streaming for stateless and stateful use-cases * Spark Structured Streaming as a possible alternative * Combining Spark Streaming with batch ETLs * “Streaming” over Data Lake using Kafka

DIscover Spark and Spark streamingMaturin BADO

This document provides an overview of Spark, including how it differs from MapReduce by loading more data into memory and implementing caching mechanisms. It discusses Spark's ecosystem, features like RDDs, and how it can run on Hadoop clusters. It also summarizes Spark Streaming, describing how it processes data in micro-batches, provides windowing and transformation operations on DStreams, and unifies batch, streaming, and interactive analytics.

Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez

Los sistemas distribuidos son difíciles. Los sistemas distribuidos de alto rendimiento, más. Latencias de red, mensajes sin confirmación de recibo, reinicios de servidores, fallos de hardware, bugs en el software, releases problemáticas, timeouts... hay un montón de motivos por los que es muy difícil saber si un mensaje que has enviado se ha recibido y procesado correctamente en destino. Así que para asegurar mandas el mensaje otra vez.. y otra... y cruzas los dedos para que el sistema del otro lado tenga tolerancia a los duplicados. QuestDB es una base de datos open source diseñada para alto rendimiento. Nos queríamos asegurar de poder ofrecer garantías de "exactly once", deduplicando mensajes en tiempo de ingestión. En esta charla, te cuento cómo diseñamos e implementamos la palabra clave DEDUP en QuestDB, permitiendo deduplicar y además permitiendo Upserts en datos en tiempo real, añadiendo solo un 8% de tiempo de proceso, incluso en flujos con millones de inserciones por segundo. Además, explicaré nuestra arquitectura de log de escrituras (WAL) paralelo y multithread. Por supuesto, todo esto te lo cuento con demos, para que veas cómo funciona en la práctica.

Why We Chose ScyllaDB over DynamoDB for "User Watch Status"ScyllaDB

Testing Persistent Storage Performance in Kubernetes with SherlockScyllaDB

Getting to understand your Kubernetes storage capabilities is important in order to run a proper cluster in production. In this session I will demonstrate how to use Sherlock, an open source platform written to test persistent NVMe/TCP storage in Kubernetes, either via synthetic workload or via variety of databases, all easily done and summarized to give you an estimate of what your IOPS, Latency and Throughput your storage can provide to the Kubernetes cluster.

MongoDB vs ScyllaDB: Tractian’s Experience with Real-Time MLScyllaDB

Tractian, an AI-driven industrial monitoring company, recently discovered that their real-time ML environment needed to handle a tenfold increase in data throughput. In this session, JP Voltani (Head of Engineering at Tractian), details why and how they moved to ScyllaDB to scale their data pipeline for this challenge. JP compares ScyllaDB, MongoDB, and PostgreSQL, evaluating their data models, query languages, sharding and replication, and benchmark results. Attendees will gain practical insights into the MongoDB to ScyllaDB migration process, including challenges, lessons learned, and the impact on product performance.

How Opera Syncs Tens of Millions of Browsers and Sleeps Well at NightScyllaDB

Opera chose Scylla over Cassandra to sync the data of millions of browsers to a back-end data repository. The results of the migration and further optimizations they made in their stack helped Opera to gain better latency/throughput and lower resources usage beyond their expectations. Attend this session to learn how to Migrate your data in a sane way, without any downtime Connect a Python+Django web app to Scylla, how to use intranode sharding to improve your application

Pluggable Infrastructure with CI/CD and DockerBob Killen

Parallel Computing: Perspectives for more efficient hydrological modelingGrigoris Anagnostopoulos

Lambda Architecture with SparkKnoldus Inc.

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...ScyllaDB

With over a billion Indians set to shop online, Meesho is redefining e-commerce by making it accessible, affordable, and inclusive at an unprecedented scale. But scaling for Bharat isn’t just about growth—it’s about building a tech backbone that can handle massive traffic surges, dynamic pricing, real-time recommendations, and seamless user experiences. In this session, we’ll take you behind the scenes of Meesho’s journey in democratizing e-commerce while operating at Monster Scale. Discover how ScyllaDB plays a crucial role in handling millions of transactions, optimizing catalog ranking, and ensuring ultra-low-latency operations. We’ll deep dive into our real-world use cases, performance optimizations, and the key architectural decisions that have helped us scale effortlessly.

More Related Content

Similar to ScyllaDB Real-Time Event Processing with CDC (20)

The Future of Fast Databases: Lessons from a Decade of QuestDBjavier ramirez

Who Needs One Database Anyway? byGlauber CostaScyllaDB

Cassandra to ScyllaDB: Technical Comparison and the Path to SuccessScyllaDB

Empowering the AWS DynamoDB™ application developer with AlternatorScyllaDB

Introducing Scylla Open Source 4.0ScyllaDB

Where Did All These Cycles Go?ScyllaDB

[DSC Europe 23] Matteo Molteni - Implementing a Robust CI Workflow with dbt f...DataScienceConferenc1

CDC patterns in Apache Kafka®confluent

BigDL: Bringing Ease of Use of Deep Learning for Apache Spark with Jason Dai ...Databricks

Exploiting GPU's for Columnar DataFrrames by Kiran LonikarSpark Summit

Stream, stream, stream: Different streaming methods with Spark and KafkaItai Yaffe

DIscover Spark and Spark streamingMaturin BADO

Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez

Why We Chose ScyllaDB over DynamoDB for "User Watch Status"ScyllaDB

Testing Persistent Storage Performance in Kubernetes with SherlockScyllaDB

MongoDB vs ScyllaDB: Tractian’s Experience with Real-Time MLScyllaDB

How Opera Syncs Tens of Millions of Browsers and Sleeps Well at NightScyllaDB

Pluggable Infrastructure with CI/CD and DockerBob Killen

Parallel Computing: Perspectives for more efficient hydrological modelingGrigoris Anagnostopoulos

Lambda Architecture with SparkKnoldus Inc.

The Future of Fast Databases: Lessons from a Decade of QuestDBjavier ramirez

Who Needs One Database Anyway? byGlauber CostaScyllaDB

Cassandra to ScyllaDB: Technical Comparison and the Path to SuccessScyllaDB

Empowering the AWS DynamoDB™ application developer with AlternatorScyllaDB

Introducing Scylla Open Source 4.0ScyllaDB

Where Did All These Cycles Go?ScyllaDB

[DSC Europe 23] Matteo Molteni - Implementing a Robust CI Workflow with dbt f...DataScienceConferenc1

CDC patterns in Apache Kafka®confluent

BigDL: Bringing Ease of Use of Deep Learning for Apache Spark with Jason Dai ...Databricks

Exploiting GPU's for Columnar DataFrrames by Kiran LonikarSpark Summit

Stream, stream, stream: Different streaming methods with Spark and KafkaItai Yaffe

DIscover Spark and Spark streamingMaturin BADO

Cómo hemos implementado semántica de "Exactly Once" en nuestra base de datos ...javier ramirez

Why We Chose ScyllaDB over DynamoDB for "User Watch Status"ScyllaDB

Testing Persistent Storage Performance in Kubernetes with SherlockScyllaDB

MongoDB vs ScyllaDB: Tractian’s Experience with Real-Time MLScyllaDB

How Opera Syncs Tens of Millions of Browsers and Sleeps Well at NightScyllaDB

Pluggable Infrastructure with CI/CD and DockerBob Killen

Parallel Computing: Perspectives for more efficient hydrological modelingGrigoris Anagnostopoulos

Lambda Architecture with SparkKnoldus Inc.

More from ScyllaDB (20)

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...ScyllaDB

Leading a High-Stakes Database MigrationScyllaDB

Navigating common mistakes and critical success factors Is your team considering or starting a database migration? Learn from the frontline experience gained guiding hundreds of high-stakes migration projects – from startups to Google and Twitter. Join us as Miles Ward and Tim Koopmans have a candid chat about what tends to go wrong and how to steer things right. We will explore: - What really pushes teams to the database migration tipping point - How to scope and manage the complexity of a migration - Proven migration strategies and antipatterns - Where complications commonly arise and ways to prevent them Expect plenty of war stories, along with pragmatic ways to make your own migration as “blissfully boring” as possible.

Achieving Extreme Scale with ScyllaDB: Tips & TradeoffsScyllaDB

Explore critical strategies – and antipatterns – for achieving low latency at extreme scale If you’re getting started with ScyllaDB, you’re probably intrigued by its potential to achieve predictable low latency at extreme scale. But how do you ensure that you’re maximizing that potential for your team’s specific workloads and technical requirements? This webinar offers practical advice for navigating the various decision points you’ll face as you evaluate ScyllaDB for your project and move into production. We’ll cover the most critical considerations, tradeoffs, and recommendations related to: - Infrastructure selection - ScyllaDB configuration - Client-side setup - Data modeling Join us for an inside look at the lessons learned across thousands of real-world distributed database projects.

Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...ScyllaDB

How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn IsarathamScyllaDB

How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd ColemanScyllaDB

ScyllaDB: 10 Years and Beyond by Dor LaorScyllaDB

There’s a common adage that it takes 10 years to develop a file system. As ScyllaDB reaches that 10 year milestone in 2025, it’s the perfect time to reflect on the last decade of ScyllaDB development – both hits and misses. It’s especially appropriate given that our project just reached a critical mass with certain scalability and elasticity goals that we dreamed up years ago. This talk will cover how we arrived at ScyllaDB X Cloud achieving our initial vision, and share where we’re heading next.

Reduce Your Cloud Spend with ScyllaDB by Tzach LivyatanScyllaDB

Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence LiuScyllaDB

Vector Search with ScyllaDB by Szymon WasikScyllaDB

Vector search is an essential element of contemporary machine learning pipelines and AI tools. This talk will share preliminary results on the forthcoming vector storage and search features in ScyllaDB. By leveraging Scylla's scalability and USearch library's performance, we have designed a system with exceptional query latency and throughput. The talk will cover vector search use cases, our roadmap, and a comparison of our initial implementation with other vector databases.

Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...ScyllaDB

Workload Prioritization is a ScyllaDB exclusive feature for controlling how different workloads compete for system resources. It's used to prioritize urgent application requests that require immediate response times versus others that can tolerate slighter delays (e.g., large scans). Join this session for a demo of how applying workload prioritization reduces infrastructure costs while ensuring predictable performance at scale.

Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...ScyllaDB

Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...ScyllaDB

Object Storage in ScyllaDB by Ran Regev, ScyllaDBScyllaDB

In this talk we take a look at how Object Storage is used by Scylla. We focus on current usage, namely - for backup, and we look at the shift in implementation from an external tool to native Scylla. We take a close look at the complexity of backup and restore mostly in the face of topology changes and token assignments. We also take a glimpse to the future and see how Scylla is going to use Object Storage as its native storage. We explore a few possible applications of it and understand the tradeoffs.

Lessons Learned from Building a Serverless Notifications System by Srushith R...ScyllaDB

A Dist Sys Programmer's Journey into AI by Piotr SarnaScyllaDB

High Availability: Lessons Learned by Paul PreuveneersScyllaDB

How Natura Uses ScyllaDB and ScyllaDB Connector to Create a Real-time Data Pi...ScyllaDB

Persistence Pipelines in a Processing Graph: Mutable Big Data at Salesforce b...ScyllaDB

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...ScyllaDB

Leading a High-Stakes Database MigrationScyllaDB

Achieving Extreme Scale with ScyllaDB: Tips & TradeoffsScyllaDB

Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...ScyllaDB

How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn IsarathamScyllaDB

How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd ColemanScyllaDB

ScyllaDB: 10 Years and Beyond by Dor LaorScyllaDB

Reduce Your Cloud Spend with ScyllaDB by Tzach LivyatanScyllaDB

Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence LiuScyllaDB

Vector Search with ScyllaDB by Szymon WasikScyllaDB

Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...ScyllaDB

Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...ScyllaDB

Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...ScyllaDB

Object Storage in ScyllaDB by Ran Regev, ScyllaDBScyllaDB

Lessons Learned from Building a Serverless Notifications System by Srushith R...ScyllaDB

A Dist Sys Programmer's Journey into AI by Piotr SarnaScyllaDB

High Availability: Lessons Learned by Paul PreuveneersScyllaDB

How Natura Uses ScyllaDB and ScyllaDB Connector to Create a Real-time Data Pi...ScyllaDB

Persistence Pipelines in a Processing Graph: Mutable Big Data at Salesforce b...ScyllaDB

Recently uploaded (20)

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

tecnologias de las primeras civilizaciones.pdffjgm517

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

Cybersecurity Identity and Access Solutions using Azure ADVICTOR MAESTRE RAMIREZ

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Role of Data Annotation Services in AI-Powered ManufacturingAndrew Leo

Electronic_Mail_Attacks-1-35.pdf by xploitniftliyevhuseyn

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.

Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul

Artificial intelligence is changing how businesses operate. Companies are using AI agents to automate tasks, reduce time spent on repetitive work, and focus more on high-value activities. Noah Loul, an AI strategist and entrepreneur, has helped dozens of companies streamline their operations using smart automation. He believes AI agents aren't just tools—they're workers that take on repeatable tasks so your human team can focus on what matters. If you want to reduce time waste and increase output, AI agents are the next move.

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Drupalcamp Finland – Measuring Front-end Energy ConsumptionExove

IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...organizerofv

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Semantic Cultivators : The Critical Future Role to Enable AIartmondano