How to Measure Latency

Oct 7, 20210 likes2,042 views

Measuring Latency for Monitoring and Benchmarking purposes is notoriously difficult. There are a lot of pitfalls with collecting, aggregating and analyzing latency data. In the talk, we will make an effort to visit this topic from a top-down perspective and compile known complications and best-practice approaches on how to avoid them. This will include: Measurement Overhead Queuing effects – Coordinated omission Histograms for Aggregation and Visualization Percentile aggregation Latency bands and burn-down charts Latency comparison methods (QQ Plots, KS-Distance)

Brought to you by
How to Measure Latency?
Heinrich Hartmann
Principal Engineer @

@HeinrichHartmann
Motivation and Background
■ I have been talking about Statistics and Latency for the last years
State of the Histogram (SLOConf 2021) / Circllhist (paper) / Latency SLOs Done Right (FOSDEM 2019) /
Statistics for Engineers (2014..2019)
■ Inspiration comes from series of talks from ~2013-15
Gil Tene - How (not) to measure Latency
Slides (London 2013) / Video (StrangeLoop 2015) / Blog - HighScalability 2015
■ On Coordinated Omission - Ivan Prisyazhynyy
Published two days ago on P99CONF.io

"It's slow" is the hardest
problem you will ever debug.
Theo Schlossnagle @postwait

@HeinrichHartmann
How to Measure Latency?
t_start = time.now()
#
# operation you want to measure
#
latency = time.now() - t_start

@HeinrichHartmann
Things to watch out for
■ Capture early returns / exceptions
● Use: try/catch/ﬁnally or defer
■ Which clock is used?
● Want: high-resolution, monotonic, system time (e.g. time.monotonic() in Python)
■ Measurement Overhead
● Measuring time takes time (at least 30ns, often >300ns)
● OK for 0.1ms or more (I/O Latency)
● Careful for 10us or lower (micro benchmarking)
■ Abstracting time measurements in code
● Write a @timed decorator. Use tracing libraries (@trace)

@HeinrichHartmann
Measuring Latency over Time

@HeinrichHartmann
A practical Queuing Model

@HeinrichHartmann
Response Time vs. Service Time

@HeinrichHartmann
Response Time vs. Service Time
Image Credits: ŠJů, Wikimedia Commons, CC BY-SA 3.0 , via Wikimedia Commons
Service Time
Response Time

@HeinrichHartmann
Where to Measure Latency?
- Only get Service Time
+ Easy to implement
+ Most meaningful
- Hard to implement

You can't measure Response
Time on the Server.
@HeinrichHartmann
SAD BUT
TRUE

Request Time vs. Service Time
An Experiment

@HeinrichHartmann
Simulation Setup
■ Request Rate (~ constant)
■ Concurrency (Active Requests)
■ Response Time
■ Arrival Rate
■ Concurrency (Active Workers)
■ Service Time (constant)
- 10 workers
- 10ms service time
- 1K rps capacity
Metrics
code @ https://github.com/HeinrichHartmann/libq

@HeinrichHartmann
Queuing System at 50% Capacity

@HeinrichHartmann
Queuing System at 90% Capacity

@HeinrichHartmann
Queuing System at 99% Capacity

@HeinrichHartmann
Queuing System at 100% Capacity

@HeinrichHartmann
Queuing System at 101% Capacity

@HeinrichHartmann
Coordinated Omission in Load Testing
Def. Coordination between Load Generator (Client) and Server that leads to
confusing Service Time with Response times.
Examples
■ Client backs off when server is falling behind
■ Client is stalled when Server is stalled
This is surprisingly common (cf. Gil's talk, Ivan's blog)

@HeinrichHartmann
Best Practice: Histogram (Metrics)
More Details:
- Latency SLOs done right @ FOSDEM 2019
- State of The Histogram @ SLOConf 2021 [slides] [video]

Brought to you by
Further Reading
- HeinrichHartmann.com/latency
- @HeinrichHartmann
Thank you!

Management & streamlining of test data is more than important and test data management remains a critical component in the testing life cycle for software & apps. Test data management or TDM, facilitates test data during various phases of a software development life cycle. The data consumed, tested & modified is constantly put to use during the complete software cycle. The evolution of Test Data Management into a comprehensive service ensures that the need for relevant data during various phases of the software life cycles are taken care of pushing faster go-market times. Get More Insight at: http://softwaretestingsolution.com/blog/test-data-management-managed-service-software-quality-assurance/

KONAN_Yao_Ange_Vinny.pdfHichemZouaoui2

This document summarizes a feasibility study on integrating GIS substations into the Ivorian electricity network through the construction of the 225 kV Yopougon 3 (YOP3) substation. The study finds that while GIS technology has a slightly higher cost than AIS technology, it optimizes space usage and has a better environmental impact. An economic analysis over a 20-year period shows that GIS has higher profitability indicators, such as an economic internal rate of return over 10%, an advantage cost ratio over 1, a positive net present value, and a return on investment under 10 years, demonstrating that GIS substations are technically and economically viable for the Ivorian network.

Rapport de projet_de_fin_d__tudes__pfe__safwen (8)safwenbenfredj

Conduite d'un projet informatique - Etude PréalableMohamed Sabra

Application web et mobile.potxBelwafi Bilel

Elastix4.0 High Availability without ElastixHA moduleHani Perkasa

Rapport du Projet de Fin d'année Génie informatique ENSA AGADIRAHMEDAKHACHKHOUCH

La Gamification - tendance incontournable, mémoire par Clémence Roullet Renol...Self-employed

PFE .NET CRMRym DAKHLI

This document is a graduation project report for a Bachelor's degree in Applied Computer Technologies. The project involved developing a web platform for customer relationship management (CRM) for the company SINORFI. It was carried out using the Scrum agile methodology. The report first provides background on SINORFI and its services, the purpose of the project, an overview of CRM and cloud computing. It then describes adopting the Scrum methodology, including roles and artifacts. The main body of the report documents the initial "Sprint Zero" phase. This includes software requirements specification, product backlog, and technical choices. It also outlines the first development Sprint focusing on account management functionality.

Monitoring in CloudStackShapeBlue

In this session, Lucian talks about monitoring CloudStack and its related components. What are the best practices and what do you need to track closely to ensure your cloud reliability. Lucian is a long-time sysadmin and Apache Cloustack user and contributor. He has a background in hosting, virtualisation and datacentre operations, but is now working full time on Cloudstack. ----------------------------------------- CloudStack Collaboration Conference 2022 took place on 14th-16th November in Sofia, Bulgaria and virtually. The day saw a hybrid get-together of the global CloudStack community hosting 370 attendees. The event hosted 43 sessions from leading CloudStack experts, users and skilful engineers from the open-source world, which included: technical talks, user stories, new features and integrations presentations and more.

Guía de instalación de la version VMware ESXi 6.0.0Alejandro Marin

Programmation Android - 05 - Google mapYann Caron

Nutanix NEXT on Tour - Maarssen, Netherlands NEXTtour

The document provides an agenda for a Nutanix .NEXT event, including keynote speeches on Nutanix products and use cases from HERO and OGD. It discusses Nutanix adoption in Europe, the benefits of hyperconverged infrastructure, and Nutanix products like Acropolis and Prism. Later presentations will provide overviews of Nutanix deployments at HERO and OGD, focusing on simplified management and improved performance.

Conception et développement d’une place de marché B2CNassim Bahri

Mon mémoire de PFE pour le projet Conception et développement d'une place de marché destiné au grand public(B2C). Le concept de cette place de marché est assez simple puisqu’il joue le rôle d’un portail qui met en relation les entreprises avec une grande masse de clients. Ce dernier est composé de plusieurs vitrines dont chacune est relative à une entreprise qui sera responsable de la gérer suite à un contrat avec la poste.

Soutenance de stageGaut' Xp

Rapport PFE Application Web Mobiles belwafi bilelBelwafi Bilel

Skynet Week 1 H4D Stanford 2016Stanford University

Rapport PFE2021.pdfCoulibalyYoussoufngo

Rapport de stage développement informatique MehdiOuqas

Sénégal: Impacts du COVID-19 sur la production, la pauvreté et les systèmes a...International Food Policy Research Institute (IFPRI)

Network Automation: Ansible 101APNIC

This document provides an overview and agenda for an Ansible 101 tutorial on network automation. It introduces Ansible concepts like playbooks, templates, variables, roles, and tasks. The tutorial will cover setting up an inventory and roles to generate network device configurations from templates using variables. It also discusses debugging Ansible and provides resources for learning more about network automation with Ansible.

Rapport pfe- Refonte et déploiement d’une solution de messagerie en utilisant...Nawres Farhat

Présentation de Microsoft AzureChristophe Peugnet

pfe_final.pptxhani911563

This document summarizes a graduation project for an Intelligent Navigation Aid System (NAS) presented by Hani YOUSFI. The project included developing a conceptual study of the NAS, taking measurements with sensors, processing the data on a Raspberry Pi, testing machine learning algorithms, building and deploying a Python model to the Raspberry Pi. The system is intended to help rehabilitate visually impaired individuals by detecting obstacles. The document outlines the plan, introduction, company presentation, hardware/software environment, conceptual study, realization steps, conclusion and perspectives.

OpenStack Ironic - Bare Metal-as-a-ServiceRamon Acedo Rodriguez

Presentation PFE sur le PIM (Product Information Management)younes elmorabit

Rapport pfe talan_2018_donia_hammamiDonia Hammami

Statistics for EngineersHeinrich Hartmann

1) Heinrich Hartmann presented on statistics and monitoring for engineers. He discussed various methods for API monitoring including external monitoring, log analysis, and measuring latency averages and percentiles. 2) Histograms were presented as another method that involves dividing the latency and time scales into bands and reporting periods to count samples, allowing flexible analysis while enabling aggregation. 3) Takeaways included being wary of line graphs, not aggregating percentiles but instead using histograms, keeping all raw data, and striving for meaningful metrics.

Latency SLOs Done Right @ SREcon EMEA 2019Heinrich Hartmann

Latency is a key indicator of service quality, and important to measure and track. However, measuring latency correctly is not easy. In contrast to familiar metrics like CPU utilization or request counts, the "latency" of a service is not easily expressed in numbers. Percentile metrics have become a popular means to measure the request latency, but have several shortcomings, especially when it comes to aggregation. The situation is particularly dire if we want to use them to specify Service Level Objectives (SLOs) that quantify the performance over a longer time horizons. In the talk we will explain these pitfalls, and suggest three practical methods how to implement effective Latency SLOs.

Lecture 3 inventory_build_up_january_2020blinking1

The document discusses operations management concepts including inventory build-up and Little's Law. It provides examples of inventory build-up diagrams showing the relationship between input and capacity rates over time and how excess demand leads to increasing inventory levels. It introduces Little's Law which establishes a relationship between average inventory, average throughput rate, and average flow time in a queueing system. Specifically, it states that average inventory equals average throughput rate multiplied by average waiting time.

More Related Content

What's hot (19)

PFE .NET CRMRym DAKHLI

Monitoring in CloudStackShapeBlue

Guía de instalación de la version VMware ESXi 6.0.0Alejandro Marin

Programmation Android - 05 - Google mapYann Caron

Nutanix NEXT on Tour - Maarssen, Netherlands NEXTtour

Conception et développement d’une place de marché B2CNassim Bahri

Soutenance de stageGaut' Xp

Rapport PFE Application Web Mobiles belwafi bilelBelwafi Bilel

Skynet Week 1 H4D Stanford 2016Stanford University

Rapport PFE2021.pdfCoulibalyYoussoufngo

Rapport de stage développement informatique MehdiOuqas

Sénégal: Impacts du COVID-19 sur la production, la pauvreté et les systèmes a...International Food Policy Research Institute (IFPRI)

Network Automation: Ansible 101APNIC

Rapport pfe- Refonte et déploiement d’une solution de messagerie en utilisant...Nawres Farhat

Présentation de Microsoft AzureChristophe Peugnet

pfe_final.pptxhani911563

OpenStack Ironic - Bare Metal-as-a-ServiceRamon Acedo Rodriguez

Presentation PFE sur le PIM (Product Information Management)younes elmorabit

Rapport pfe talan_2018_donia_hammamiDonia Hammami

PFE .NET CRMRym DAKHLI

Monitoring in CloudStackShapeBlue

Guía de instalación de la version VMware ESXi 6.0.0Alejandro Marin

Programmation Android - 05 - Google mapYann Caron

Nutanix NEXT on Tour - Maarssen, Netherlands NEXTtour

Conception et développement d’une place de marché B2CNassim Bahri

Soutenance de stageGaut' Xp

Rapport PFE Application Web Mobiles belwafi bilelBelwafi Bilel

Skynet Week 1 H4D Stanford 2016Stanford University

Rapport PFE2021.pdfCoulibalyYoussoufngo

Rapport de stage développement informatique MehdiOuqas

Sénégal: Impacts du COVID-19 sur la production, la pauvreté et les systèmes a...International Food Policy Research Institute (IFPRI)

Network Automation: Ansible 101APNIC

Rapport pfe- Refonte et déploiement d’une solution de messagerie en utilisant...Nawres Farhat

Présentation de Microsoft AzureChristophe Peugnet

pfe_final.pptxhani911563

OpenStack Ironic - Bare Metal-as-a-ServiceRamon Acedo Rodriguez

Presentation PFE sur le PIM (Product Information Management)younes elmorabit

Rapport pfe talan_2018_donia_hammamiDonia Hammami

Similar to How to Measure Latency (20)

Statistics for EngineersHeinrich Hartmann

Latency SLOs Done Right @ SREcon EMEA 2019Heinrich Hartmann

Lecture 3 inventory_build_up_january_2020blinking1

OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannNETWAYS

APIs sind überall. In modernen (mircro-) service orientierten Architekturen nehmen APIs eine zentrale Rolle ein, deren Performance man im Auge behalten muss. Zentrale Fragen sind: Hat sich die User Experience für einige/alle Nutzer gerade verschlechtert? Wo liegen die Ursachen? Was sind die Business Implications? Diese Fragen sind keineswegs leicht zu beantworten. Im Talk stellen wir verschiedene Ansätze zum API monitoring vor, diskutieren Stärken und Schwächen, und zeigen häufig angetroffene Missverständnisse auf. Erstaunlicher Weise gibt es einen klaren Gewinner, der noch wenig Verbreitung gefunden hat.

OSMC 2016 - Friends and foes by Heinrich HartmannNETWAYS

Scalable Online Analytics for MonitoringHeinrich Hartmann

Monitoring systems will get smarter in order to keep up with the demands of tomorrow's IT architectures. Features like anomaly detection, root cause analysis, and forecasting tools will be critical components of this next level of monitoring. At the same time, the data that monitoring systems ingest is ever increasing in amount and velocity. This session covers architectural models for advanced online analytics. We argue that stateful online computations provide a means to realize machine learning on high-velocity data. We show how alerting systems, event engines, stream aggregators, and time-series databases interact to support smart, scalable, and resilient monitoring solutions. Heinrich Hartmann is the Chief Data Scientist at Circonus. He is driving the development of analytics methods that transform monitoring data into actionable information as part of the Circonus monitoring platform. In his prior life, Heinrich pursued an academic career as a mathematician (PhD in Bonn, Oxford). Later he transitioned into computer science and worked as consultant for a number of different companies and research institutions.

Nigel Thurlow - DevOps is Enterprise Wide.pdfDevOpsDays DFW

This document discusses various lean and agile concepts including value streams, kanban, scrum, complexity, bottlenecks, and genchi genbutsu. It provides definitions and comparisons of key terms. Several diagrams and formulas are also presented to illustrate lean principles such as queuing theory, Little's Law, and the impact of team size on communication lines. The overall document focuses on clarifying lean thinking and debunking misconceptions.

Actionable information 1LineView Academy (was OFX Academy)

2015 ars eu_red_s9_schutterGeorge Schutter, de

Resilient service to-service calls in a post-Hystrix worldRares Musina

At N26, we want to make sure we have resilience and fault tolerance built into our backend service-to-service calls. Our services used a combination of Hystrix, Retrofit, Retryer, and other tools to achieve this goal. However, Netflix recently announced that Hystrix is no longer under active development. Therefore, we needed to come up with a replacement solution that maintains the same level of functionality. Since Hystrix provided a big portion of our http client resilience (including circuit breaking, connection thread pool thresholds, easy to add fallbacks, response caching, etc.), we used this announcement as a good opportunity to revisit our entire http client resilience stack. We wanted to find a solution that consolidated our fragmented tooling into an easy-to-use and consistent approach. This talk will share the approach we are currently implementing and the tools we analyzed while making the decision. Its aim is to provide backend devs (primarily working on JVM languages) and SREs with a comprehensive view on the state of the art for service-to-service call tooling (resilience 4j, envoy, gRPC, retrofit, etc), mechanisms to improve service-to-service call resiliency (timeouts, circuit breaking, adaptive concurrency limits, outlier detection, rate limiting, etc.) and a discussion on where these mechanisms should be implemented (client side, side-car proxy, server-side side-car proxy or server-side).

Download full ebook of Factory Physics 3rd Edition Wallace Hopp instant downl...uskovkuzabi

Ask the Expert: Lean Leadership - Can We Talk About OEE?MileyJames

This document discusses how to calculate Overall Equipment Effectiveness (OEE) and factors like set-up time, utilization, efficiency, and first-pass yield. It recommends measuring set-up times separately to better understand their impact on machine throughput. An example calculation shows an OEE of 59% based on 75% utilization, 90% efficiency, and 88% first-pass yield. It outlines collecting OEE data by machine to identify improvement opportunities, educating operators, and holding supervisors accountable for addressing issues to improve effective use of resources.

Queueing Theory and its BusinessS ApplicationsBiswajit Bhattacharjee

Queueing Theory is the mathematical study of waiting lines in systems where demand for service exceeds the available resources. A pioneer in the field was Agner Krarup Erlang who applied its principles to telecommunications. The document discusses key concepts in queueing theory including arrival and service processes, queue configurations, performance measures and examples of real-world applications. It also covers limitations of classical queueing models in fully representing complex real systems.

Lanner client TST discuss simulation application and benefitLanner

Real-Time Machine Learning at Industrial scale (University of Oxford, 9th Oct...TUMRA | Big Data Science - Gain a competitive advantage through Big Data & Data Science

Right now in institutions around the world, some of the greatest minds in computer science and statistics are coming up with amazing new algorithms and mathematically beautiful solutions. However it's entirely possible that the solutions they conceive will be impracticable in industry. The reason is simple; "the best answer is useless if it arrives too late to do anything with it". The key principle here is the compromise between 'accuracy' and 'latency'. In this talk I will describe examples where this holds true, and how I am using real-time machine learning models to solve challenges in eCommerce, Financial Services and Media companies. http://tumra.com/blog/real-time-machine-learning-at-industrial-scale

Process improvement techniquesHakeem-Ur- Rehman

This document outlines techniques for process analysis and improvement. It defines key process terminology and describes how to create a process flow diagram. The document provides an example of analyzing a scooter assembly process, including calculating activity times, capacity, cycle time, and worker utilization. It demonstrates how line balancing can increase process capacity and efficiency by reallocating tasks between workers.

4Developers 2015: Measure to fail - Tomasz KowalczewskiPROIDEA

YouTube: https://www.youtube.com/watch?v=H5F0D55nKX4&index=11&list=PLnKL6-WWWE_WNYmP_P5x2SfzJ7jeJNzfp Tomasz Kowalczewski Language: English Hardware fails, applications fail, our code... well, it fails too (at least mine). To prevent software failure we test. Hardware failures are inevitable, so we write code that tolerates them, then we test. From tests we gather metrics and act upon them by improving parts that perform inadequately. Measuring right things at right places in an application is as much about good engineering practices and maintaining SLAs as it is about end user experience and may differentiate successful product from a failure. In order to act on performance metrics such as max latency and consistent response times we need to know their accurate value. The problem with such metrics is that when using popular tools we get results that are not only inaccurate but also too optimistic. During my presentation I will simulate services that require monitoring and show how gathered metrics differ from real numbers. All this while using what currently seems to be most popular metric pipeline - Graphite together with com.codahale metrics library - and get completely false results. We will learn to tune it and get much better accuracy. We will use JMeter to measure latency and observe how falsely reassuring the results are. We will check how graphite averages data just to helplessly watch important latency spikes disappear. Finally I will show how HdrHistogram helps in gathering reliable metrics. We will also run tests measuring performance of different metric classes

Measure to failTomasz Kowalczewski

Hardware fails, applications fail, our code... well, it fails too (at least mine). To prevent software failure we test. Hardware failures are inevitable, so we write code that tolerates them, then we test. From tests we gather metrics and act upon them by improving parts that perform inadequately. Measuring right things at right places in an application is as much about good engineering practices and maintaining SLAs as it is about end user experience and may differentiate successful product from a failure. In order to act on performance metrics such as max latency and consistent response times we need to know their accurate value. The problem with such metrics is that when using popular tools we get results that are not only inaccurate but also too optimistic. During my presentation I will simulate services that require monitoring and show how gathered metrics differ from real numbers. All this while using what currently seems to be most popular metric pipeline - Graphite together with metrics.dropwizard.io library - and get completely false results. We will learn to tune it and get much better accuracy. We will use JMeter to measure latency and observe how falsely reassuring the results are. Finally I will show how HdrHistogram helps in gathering reliable metrics. We will also run tests measuring performance of different metric classes.

Contoh Desain Slide Presentasi Ilmiah Kreatif dan Menarik #1Arry Rahmawan

Ketika saya mengampu mata kuliah permodelan sistem, di mana mata kuliah ini merupakan mata kuliah untuk mahasiswa tingkat 3, saya menugaskan mahasiswa untuk melakukan sebuah penelitian sederhana dengan menerapkan prinsip - prinsip ilmiah ke lapangan langsung. Saya juga menantang mereka untuk dapat mempresentasikan hasil penelitian mereka dengan tampilan slide yang tidak biasa dan menjemukan. Hingga akhirnya, inilah beberapa di antaranya. Bagaimana menurut Anda?

Three Perspectives on Measuring LatencyScyllaDB

Latency is one of the most common Service Level Indicators (SLI), but where should it be measured from? There are three main ways to measure latency: •Server-side latency: Precise and high cardinality but missing the big picture •Client-side latency: Big picture but noisy •Blackbox monitoring latency: Good trade-off between the other two In this talk, we will dive deeper into each perspective and how all of them can be leveraged. We will use Criteo’s large-scale key/value infrastructure as a case study

Statistics for EngineersHeinrich Hartmann

Latency SLOs Done Right @ SREcon EMEA 2019Heinrich Hartmann

Lecture 3 inventory_build_up_january_2020blinking1

OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannNETWAYS

OSMC 2016 - Friends and foes by Heinrich HartmannNETWAYS

Scalable Online Analytics for MonitoringHeinrich Hartmann

Nigel Thurlow - DevOps is Enterprise Wide.pdfDevOpsDays DFW

Actionable information 1LineView Academy (was OFX Academy)

2015 ars eu_red_s9_schutterGeorge Schutter, de

Resilient service to-service calls in a post-Hystrix worldRares Musina

Download full ebook of Factory Physics 3rd Edition Wallace Hopp instant downl...uskovkuzabi

Ask the Expert: Lean Leadership - Can We Talk About OEE?MileyJames

Queueing Theory and its BusinessS ApplicationsBiswajit Bhattacharjee

Lanner client TST discuss simulation application and benefitLanner

Real-Time Machine Learning at Industrial scale (University of Oxford, 9th Oct...TUMRA | Big Data Science - Gain a competitive advantage through Big Data & Data Science

Process improvement techniquesHakeem-Ur- Rehman

4Developers 2015: Measure to fail - Tomasz KowalczewskiPROIDEA

Measure to failTomasz Kowalczewski

Contoh Desain Slide Presentasi Ilmiah Kreatif dan Menarik #1Arry Rahmawan

Three Perspectives on Measuring LatencyScyllaDB

More from ScyllaDB (20)

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...ScyllaDB

With over a billion Indians set to shop online, Meesho is redefining e-commerce by making it accessible, affordable, and inclusive at an unprecedented scale. But scaling for Bharat isn’t just about growth—it’s about building a tech backbone that can handle massive traffic surges, dynamic pricing, real-time recommendations, and seamless user experiences. In this session, we’ll take you behind the scenes of Meesho’s journey in democratizing e-commerce while operating at Monster Scale. Discover how ScyllaDB plays a crucial role in handling millions of transactions, optimizing catalog ranking, and ensuring ultra-low-latency operations. We’ll deep dive into our real-world use cases, performance optimizations, and the key architectural decisions that have helped us scale effortlessly.

Leading a High-Stakes Database MigrationScyllaDB

Navigating common mistakes and critical success factors Is your team considering or starting a database migration? Learn from the frontline experience gained guiding hundreds of high-stakes migration projects – from startups to Google and Twitter. Join us as Miles Ward and Tim Koopmans have a candid chat about what tends to go wrong and how to steer things right. We will explore: - What really pushes teams to the database migration tipping point - How to scope and manage the complexity of a migration - Proven migration strategies and antipatterns - Where complications commonly arise and ways to prevent them Expect plenty of war stories, along with pragmatic ways to make your own migration as “blissfully boring” as possible.

Achieving Extreme Scale with ScyllaDB: Tips & TradeoffsScyllaDB

Explore critical strategies – and antipatterns – for achieving low latency at extreme scale If you’re getting started with ScyllaDB, you’re probably intrigued by its potential to achieve predictable low latency at extreme scale. But how do you ensure that you’re maximizing that potential for your team’s specific workloads and technical requirements? This webinar offers practical advice for navigating the various decision points you’ll face as you evaluate ScyllaDB for your project and move into production. We’ll cover the most critical considerations, tradeoffs, and recommendations related to: - Infrastructure selection - ScyllaDB configuration - Client-side setup - Data modeling Join us for an inside look at the lessons learned across thousands of real-world distributed database projects.

Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...ScyllaDB

How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn IsarathamScyllaDB

How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd ColemanScyllaDB

ScyllaDB: 10 Years and Beyond by Dor LaorScyllaDB

There’s a common adage that it takes 10 years to develop a file system. As ScyllaDB reaches that 10 year milestone in 2025, it’s the perfect time to reflect on the last decade of ScyllaDB development – both hits and misses. It’s especially appropriate given that our project just reached a critical mass with certain scalability and elasticity goals that we dreamed up years ago. This talk will cover how we arrived at ScyllaDB X Cloud achieving our initial vision, and share where we’re heading next.

Reduce Your Cloud Spend with ScyllaDB by Tzach LivyatanScyllaDB

Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence LiuScyllaDB

Vector Search with ScyllaDB by Szymon WasikScyllaDB

Vector search is an essential element of contemporary machine learning pipelines and AI tools. This talk will share preliminary results on the forthcoming vector storage and search features in ScyllaDB. By leveraging Scylla's scalability and USearch library's performance, we have designed a system with exceptional query latency and throughput. The talk will cover vector search use cases, our roadmap, and a comparison of our initial implementation with other vector databases.

Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...ScyllaDB

Workload Prioritization is a ScyllaDB exclusive feature for controlling how different workloads compete for system resources. It's used to prioritize urgent application requests that require immediate response times versus others that can tolerate slighter delays (e.g., large scans). Join this session for a demo of how applying workload prioritization reduces infrastructure costs while ensuring predictable performance at scale.

Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...ScyllaDB

Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...ScyllaDB

Object Storage in ScyllaDB by Ran Regev, ScyllaDBScyllaDB

In this talk we take a look at how Object Storage is used by Scylla. We focus on current usage, namely - for backup, and we look at the shift in implementation from an external tool to native Scylla. We take a close look at the complexity of backup and restore mostly in the face of topology changes and token assignments. We also take a glimpse to the future and see how Scylla is going to use Object Storage as its native storage. We explore a few possible applications of it and understand the tradeoffs.

Lessons Learned from Building a Serverless Notifications System by Srushith R...ScyllaDB

A Dist Sys Programmer's Journey into AI by Piotr SarnaScyllaDB

High Availability: Lessons Learned by Paul PreuveneersScyllaDB

How Natura Uses ScyllaDB and ScyllaDB Connector to Create a Real-time Data Pi...ScyllaDB

Persistence Pipelines in a Processing Graph: Mutable Big Data at Salesforce b...ScyllaDB

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...ScyllaDB

Leading a High-Stakes Database MigrationScyllaDB

Achieving Extreme Scale with ScyllaDB: Tips & TradeoffsScyllaDB

Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...ScyllaDB

How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn IsarathamScyllaDB

How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd ColemanScyllaDB

ScyllaDB: 10 Years and Beyond by Dor LaorScyllaDB

Reduce Your Cloud Spend with ScyllaDB by Tzach LivyatanScyllaDB

Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence LiuScyllaDB

Vector Search with ScyllaDB by Szymon WasikScyllaDB

Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...ScyllaDB

Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...ScyllaDB

Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...ScyllaDB

Object Storage in ScyllaDB by Ran Regev, ScyllaDBScyllaDB

Lessons Learned from Building a Serverless Notifications System by Srushith R...ScyllaDB

A Dist Sys Programmer's Journey into AI by Piotr SarnaScyllaDB

High Availability: Lessons Learned by Paul PreuveneersScyllaDB

How Natura Uses ScyllaDB and ScyllaDB Connector to Create a Real-time Data Pi...ScyllaDB

Persistence Pipelines in a Processing Graph: Mutable Big Data at Salesforce b...ScyllaDB

Recently uploaded (20)

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, presentation slides, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Cyber Awareness overview for 2025 month of securityriccardosl1

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc

Most consumers believe they’re making informed decisions about their personal data—adjusting privacy settings, blocking trackers, and opting out where they can. However, our new research reveals that while awareness is high, taking meaningful action is still lacking. On the corporate side, many organizations report strong policies for managing third-party data and consumer consent yet fall short when it comes to consistency, accountability and transparency. This session will explore the research findings from TrustArc’s Privacy Pulse Survey, examining consumer attitudes toward personal data collection and practical suggestions for corporate practices around purchasing third-party data. Attendees will learn: - Consumer awareness around data brokers and what consumers are doing to limit data collection - How businesses assess third-party vendors and their consent management operations - Where business preparedness needs improvement - What these trends mean for the future of privacy governance and public trust This discussion is essential for privacy, risk, and compliance professionals who want to ground their strategies in current data and prepare for what’s next in the privacy landscape.

Semantic Cultivators : The Critical Future Role to Enable AIartmondano

AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB

I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.

Splunk Security Update | Public Sector Summit Germany 2025Splunk

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

How Can I use the AI Hype in my Business Context?Daniel Lehner

𝙄𝙨 𝘼𝙄 𝙟𝙪𝙨𝙩 𝙝𝙮𝙥𝙚? 𝙊𝙧 𝙞𝙨 𝙞𝙩 𝙩𝙝𝙚 𝙜𝙖𝙢𝙚 𝙘𝙝𝙖𝙣𝙜𝙚𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨 𝙣𝙚𝙚𝙙𝙨? Everyone’s talking about AI but is anyone really using it to create real value? Most companies want to leverage AI. Few know 𝗵𝗼𝘄. ✅ What exactly should you ask to find real AI opportunities? ✅ Which AI techniques actually fit your business? ✅ Is your data even ready for AI? If you’re not sure, you’re not alone. This is a condensed version of the slides I presented at a Linkedin webinar for Tecnovy on 28.04.2025.

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Linux Support for SMARC: How Toradex Empowers Embedded DevelopersToradex

Toradex brings robust Linux support to SMARC (Smart Mobility Architecture), ensuring high performance and long-term reliability for embedded applications. Here’s how: • Optimized Torizon OS & Yocto Support – Toradex provides Torizon OS, a Debian-based easy-to-use platform, and Yocto BSPs for customized Linux images on SMARC modules. • Seamless Integration with i.MX 8M Plus and i.MX 95 – Toradex SMARC solutions leverage NXP’s i.MX 8 M Plus and i.MX 95 SoCs, delivering power efficiency and AI-ready performance. • Secure and Reliable – With Secure Boot, over-the-air (OTA) updates, and LTS kernel support, Toradex ensures industrial-grade security and longevity. • Containerized Workflows for AI & IoT – Support for Docker, ROS, and real-time Linux enables scalable AI, ML, and IoT applications. • Strong Ecosystem & Developer Support – Toradex offers comprehensive documentation, developer tools, and dedicated support, accelerating time-to-market. With Toradex’s Linux support for SMARC, developers get a scalable, secure, and high-performance solution for industrial, medical, and AI-driven applications. Do you have a specific project or application in mind where you're considering SMARC? We can help with Free Compatibility Check and help you with quick time-to-market For more information: https://www.toradex.com/computer-on-modules/smarc-arm-family

#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada

Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next. Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/ Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.

Complete Guide to Advanced Logistics Management Software in Riyadh.pdfSoftware Company

Explore the benefits and features of advanced logistics management software for businesses in Riyadh. This guide delves into the latest technologies, from real-time tracking and route optimization to warehouse management and inventory control, helping businesses streamline their logistics operations and reduce costs. Learn how implementing the right software solution can enhance efficiency, improve customer satisfaction, and provide a competitive edge in the growing logistics sector of Riyadh.

Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell

DevOpsDays Atlanta 2025 - Building 10x Development Organizations.pptxJustin Reock

Building 10x Organizations with Modern Productivity Metrics 10x developers may be a myth, but 10x organizations are very real, as proven by the influential study performed in the 1980s, ‘The Coding War Games.’ Right now, here in early 2025, we seem to be experiencing YAPP (Yet Another Productivity Philosophy), and that philosophy is converging on developer experience. It seems that with every new method we invent for the delivery of products, whether physical or virtual, we reinvent productivity philosophies to go alongside them. But which of these approaches actually work? DORA? SPACE? DevEx? What should we invest in and create urgency behind today, so that we don’t find ourselves having the same discussion again in a decade?

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Mobile App Development Company in Saudi ArabiaSteve Jonas

EmizenTech is a globally recognized software development company, proudly serving businesses since 2013. With over 11+ years of industry experience and a team of 200+ skilled professionals, we have successfully delivered 1200+ projects across various sectors. As a leading Mobile App Development Company In Saudi Arabia we offer end-to-end solutions for iOS, Android, and cross-platform applications. Our apps are known for their user-friendly interfaces, scalability, high performance, and strong security features. We tailor each mobile application to meet the unique needs of different industries, ensuring a seamless user experience. EmizenTech is committed to turning your vision into a powerful digital product that drives growth, innovation, and long-term success in the competitive mobile landscape of Saudi Arabia.