Keep Calm and Distributed Tracing

Nov 24, 2020Download as PPTX, PDF0 likes79 views

This document discusses distributed tracing and provides an overview of its history and key concepts. It begins with an overview of logging, tracing, and monitoring techniques. It then discusses the challenges of debugging asynchronous distributed systems and how distributed tracing addresses these challenges. The document outlines the basic terminology and components of distributed tracing systems, including spans and traces. It provides a timeline of major developments in distributed tracing technologies from 2010 to the present. It concludes with recommendations around using OpenTelemetry or OpenTracing for instrumentation and notes areas that were not covered in depth.

Angelo Simone Scotto
Solution Architect
angelo.scotto@computer.org
Keep Calm and Distributed Tracing

Logging Tracing Monitoring
Technical
Pattern
Event Stream:
Append-Only Timestamped Records (a.k.a. Logs)
Trigger A specific event None (periodic)
Payload Business Events Technical Events System Status
Historical
Approach
LogLevel >= Info LogLevel = Trace Performance
Counters

Time
Above -> Before
Below -> After
Log File
• A log on a single machine/core
is simple to inspect.

Log File 1
• A log on a single machine/core
is simple to inspect.
• Async code (not just distributed
code) is way more complex.
• You need to aggregate data
from different places.
• You need to correlate traces
on one machine with traces on
others.
• This is why debugging async code
is hard.
Log File 3
Log File 2
?

• Seminal paper on Distributed Tracing.
• Defines the main terminology.

• Other key takeaway:
• Application Transparency:
programmers should not need
(necessarily) to be aware of the
tracing system.
• Sampling: Not all traces are
persisted, a probabilistic approach is
used (i.e. 1 sample every 1024 traces)
• Span: the primary building block of a distributed trace, representing an
individual unit of work done in a distributed system.
• Trace: a tree of Spans: a visualization of the life of a request as it moves
through a distributed system.

• 2010 – Google publishes Dapper Article (without source code).
• 2012 – Twitter publishes Zipkin (and source code).
• 2015 – Uber develops Jaeger (not published).
• 2016 – OpenTracing standard is published and joins CNCF.
• 2017 – Uber publishes Jaeger (and source code) and donate it to CNCF

• OpenTelemetry in .NET is just a wrapper on existing Activity and
ActivitySource classes from System.Diagnostics.
• Ensure high performance and stability.
• Is future-proof.
• OpenTelemetry still in pre-release (1.0.0-rc1.1).
• OpenTelemetry.Instrumentation nuget packages (AspNet, SqlClient,
Redis,…)
• OpenTelemetry.Exporter nuget packages (Jaeger, Zipkin, OTEL,…)

Code available https://bit.ly/netconfit-disttracing

• Successful Distributed Systems requires Distributed Tracing.
• Auto Instrumenting your applications requires few lines of code.
• Do yourself a favour and start instrumenting.
• OpenTracing or OpenTelemetry?
• OpenTelemetry is the future and now in RC (not yet in GA).
• OpenTracing is more mature but superseded by OpenTelemetry.
• We just scratched the surface:
• No in-depth discussion on Metrics and Logs.
• No in-depth discussion on async comms (i.e. queues instead of http).
• No in-depth analysis on OTEL Architecture (i.e. standalone connector).
• No in-depth analysis on trace enrichment/filtering/modification.
• No in-depth analysis on baggage/context serialization.

Slide e materiale su
https://aspit.co/netconfit-20
angelo.scotto@computer.org

The document discusses observability with InfluxDB/IOx and OpenTelemetry. It provides definitions and descriptions of InfluxDB/TSM and InfluxDB/IOx storage engines, highlighting their strengths. It also defines OpenTelemetry as a standard for observability signals including metrics, logs and traces. The document outlines how OpenTelemetry aims to provide a common instrumentation standard to unify the observability stack, and describes how InfluxData supports and integrates with OpenTelemetry.

Introduction to InfluxDB 2.0 & Your First Flux Query by Sonia Gupta, Develope...InfluxData

Vasilis Papavasiliou [Mist.io] | Integrating Telegraf, InfluxDB and Mist to M...InfluxData

Mist is an open source multicloud management platform. Mist.io's goal is to make multicloud simple and offer a single interface from where you can manage everything. To help users make informed decisions about their infrastructure, Mist is integrating with Telegraf and InfluxDB for collecting and storing monitoring metrics. This is an evolution of a previous stack based on collectd and Graphite. This session will go over why Mist.io moved and the implementation details of its current stack. The session will also analyze the challenges faced and the solutions built. This session is a follow-up to the webinar presentation at https://www.influxdata.com/resources/how-to-gain-visibility-into-containers-vms-and-multi-cloud-environments-using-telegraf-influxdb-and-mist/ which focuses more on the technical details.

How to Store and Visualize CAN Bus Telematic Data with InfluxDB Cloud and Gra...InfluxData

The document discusses how CSS Electronics stores and visualizes telematic data collected from CAN bus networks using InfluxDB and Grafana. Specifically, it summarizes: 1) CSS Electronics develops CAN bus data loggers and sensors to collect data from vehicles and industrial equipment. They implemented InfluxDB to store the decoded telematic data and Grafana to visualize it in customizable dashboards. 2) The process involves logging raw CAN bus data, decoding it using Python scripts, and writing it to InfluxDB. Grafana then pulls the data from InfluxDB to generate intuitive dashboards without coding. 3) Examples are shown of heavy vehicle, automotive, maritime, and sensor fusion dashboards. The solution is open source

InfluxDB IOx Tech Talks: A Rusty Introduction to Apache Arrow and How it App...InfluxData

InfluxDB IOx Tech Talks - December 2020 A Rusty Introduction to Apache Arrow and How it Applies to a Time Series Database This session will start with a tech talk from an InfluxDB IOx team member. This is your chance to interact directly with Influxers who are available to answer your questions about all things InfluxDB IOx and time series — including Paul Dix, Founder and CTO of InfluxData. This event will last about an hour and there will be time for live Q&A.

Catalogs - Turning a Set of Parquet Files into a Data SetInfluxData

InfluxDB IOx Tech Talks Placing a Parquet file into an object store serves as a simple data persistence format. However, storing data into multiple files enabling upserts, deletions, format upgrades, metadata management, and consistency checks at scale requires some form of a catalog that manages these files. In this talk we will explore the requirements for a catalog for InfluxDB IOx, prior art from the Parquet ecosystem, and the proposed solution.

How an Open Marine Standard, InfluxDB and Grafana Are Used to Improve Boating...InfluxData

Steve and Teppo presented a solution for visualizing and analyzing boat data from disparate sources. Their goals were to record all boat data for later analysis, create customizable dashboards to visualize data and trends, and gain access to data from any source. Their solution uses Signal K to connect data sources, writes the data to InfluxDB for storage, and uses Grafana dashboards to visualize trends over time. This has helped users monitor engine performance, electrical systems, storms, and troubleshoot issues remotely. Future work includes more dashboards, alerts, device integrations, and extending the Signal K data model.

InfluxDB Community Office Hours September 2020 InfluxData

The document provides information about InfluxDB 2.0 going to general availability (GA) and the migration path for existing users. It discusses that the next release will be the first release candidate with bug fixes and no new features. It also outlines reasons users may want to hold off upgrading, including continuous queries and authorization changes. The document asks existing users to help with testing the upcoming release candidate.

Nicolas Steinmetz [CérénIT] | Sustain Your Observability from Bare Metal TICK...InfluxData

When moving your apps to Kubernetes, you need to keep your existing observability at the same level or better. Kubernetes will give you some challenge, as you can’t strictly deploy the TICK Stack as you did before, but also allow some opportunities. The talk is about my journey on this topic and will cover Telegraf as DaemonSet to fetch nodes resources, as a deployment to fetch metrics from different endpoints and hopefully with Telegraf as an operator to illustrate sidecar deployment. All these metrics will be pushed to InfluxDB (v1/v2) and may be visualized in Chronograf or Grafana.

How to Create a Modern IIoT Monitoring Solution On iOS Using Swift, MQTT and ...InfluxData

MOXIE IoT uses industry standards and cutting-edge technology to create a monitoring solution which provides their manufacturing customers with a single source of truth. Their iOS iPad app equips their customers to visualize and analyze industrial factory data in real time. Discover how they use a time series database, MQTT and Ultra-Wideband to accurately measure and track any object, device, personnel or machinery. In this webinar, Dr. Austin Gurley will dive into: MOXIE’s approach to app-centric asset monitoring Their ability to help customers streamline operations while bridging the gap between hardware and software How a time series database improves customer experience by enabling them to query, filter and parse their data Techniques for performing Flux queries in iOS Swift

InfluxDB Cloud Product Update InfluxData

Learn more about InfluxData’s time series platform. InfluxDB Cloud is a fast, elastic, serverless real-time monitoring platform, dashboarding engine, analytics service and event and metrics processor. It is available on AWS, Azure and Google Cloud. Since its launch, we have been busy making updates to the product! Join Balaji Palani, Director of Product Management, as he demonstrates the the latest features of InfluxDB Cloud. This one-hour webinar will feature a product update and Q&A time.

InfluxData Architecture for IoT | Noah Crowley | InfluxDataInfluxData

Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData InfluxData

Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaInfluxData

InfluxDB 2.0 Client Libraries by Noah CrowleyInfluxData

InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxData

How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData

Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...InfluxData

An external plugin allows Telegraf to collect metrics from external programs. This presentation demonstrates how to create an external plugin by printing 3D data from an Octoprint server. It discusses the basics of external plugins, provides a simple example using Bash, and walks through building a plugin for Octoprint using Go. The presentation concludes by discussing how to create plugins in other languages like Rust and ideas for other external plugins.

InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxData

Why Architecting for Disaster Recovery is Important for Your Time Series Data...InfluxData

Time Series data at Capital One consists of Infrastructure, Application, and Business Process Metrics. The combination of these metrics are what the internal stakeholders rely on for observability which allows them to deliver better service and uptime for their customers, so protecting this critical data with a proven and tested recovery plan is not a “nice to have” but a “must have.” In this talk, the members of IT staff, Saravanan Krisharaju, Rajeev Tomer, and Karl Daman will share how they built a fault-tolerant solution based on InfluxEnterprise and AWS that collects and stores metrics and events. They added to this, Machine Learning, which uses the collected time series to model predictions which are then brought back into InfluxDB time series database for real-time access. This Capital One team shares the journey they took to architect and build this solution as well as plan and execute on their disaster recovery plan.

Kapacitor Stream ProcessingInfluxData

How to Use Telegraf and Its Plugin EcosystemInfluxData

Telegraf is the open source server agent which is used to collect metrics from your stacks, sensors and systems. It is InfluxDB’s native data collector that supports over 250+ inputs and outputs. Learn how to send data from a variety of systems, apps, databases and services in the appropriate format to InfluxDB. Discover tips and tricks on how to write your own plugins. Join this webinar as Jessica Ingrassellino and Samantha Wang dive into: Types of Telegraf plugins (i.e. input, output, aggregator and processor) Specific plugins including Execd input plugins and the Starlark processor plugin How to create your own Telegraf plugin

IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData

The presentation introduces a Google Cloud native architecture for collecting, processing, analyzing and archiving of events from IoT devices, vehicles as well as upstream software systems. InfluxDB and its connection to global native Google Cloud services like BigQuery or Cloud Machine Learning Engine as well as Kubernetes is at the center of the architecture. The architecture demonstrates how access to global scaling cloud services addresses use cases from the Energy Sector.

Setting Up InfluxDB for IoT by David G SimmonsInfluxData

IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntopInfluxData

Network traffic monitoring tools are traditionally based on the packet paradigm where tools need to analyse each incoming and outgoing packet. As systems are moving towards a micro-service oriented architecture based on containers, the packet paradigm is no longer enough to provide IT visibility as services interact inside a system and not over a network where it is possible to install network sensors. This talk will explain how open source tools designed by ntop on top of InfluxDB allow packet monitoring tools to be complemented with container monitoring and thus implement a lightweight visibility solution for modern IT infrastructures.

Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...InfluxData

There are many challenges to building production IoT applications — whether deployed on the shop floor or in millions of homes. Data, specifically time series data, need not be one of them. In this session, Brian Gilmore, IoT Product Manager at InfluxData, outlines the key components of architecture for capturing and analyzing IoT data at ANY scale and showcases how he has implemented these recommendations in his own lab. You will leave this virtual talk with a blueprint for getting started yourself — this talk also covers integrations with Machine Learning and other advanced topics, so InfluxDB users of all experience are welcome!

Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...InfluxData

Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenInfluxData

Consolidating MLOps at One of Europe’s Biggest AirportsDatabricks

At Schiphol airport we run a lot of mission critical machine learning models in production, ranging from models that predict passenger flow to computer vision models that analyze what is happening around the aircraft. Especially now in times of Covid it is paramount for us to be able to quickly iterate on these models by implementing new features, retraining them to match the new dynamics and above all to monitor them actively to see if they still fit the current state of affairs. To achieve those needs we rely on MLFlow but have also integrated that with many of our other systems. So have we written Airflow operators for MLFlow to ease the retraining of our models, have we integrated MLFlow deeply with our CI pipelines and have we integrated it with our model monitoring tooling. In this talk we will take you through the way we rely on MLFlow and how that enables us to release (sometimes) multiple versions of a model per week in a controlled fashion. With this set-up we are achieving the same benefits and speed as you have with a traditional software CI pipeline.

Building a Distributed & Automated Open Source Program at NetflixAll Things Open

More Related Content

What's hot (20)

Nicolas Steinmetz [CérénIT] | Sustain Your Observability from Bare Metal TICK...InfluxData

How to Create a Modern IIoT Monitoring Solution On iOS Using Swift, MQTT and ...InfluxData

InfluxDB Cloud Product Update InfluxData

InfluxData Architecture for IoT | Noah Crowley | InfluxDataInfluxData

Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData InfluxData

Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaInfluxData

InfluxDB 2.0 Client Libraries by Noah CrowleyInfluxData

InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxData

How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData

Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...InfluxData

InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxData

Why Architecting for Disaster Recovery is Important for Your Time Series Data...InfluxData

Kapacitor Stream ProcessingInfluxData

How to Use Telegraf and Its Plugin EcosystemInfluxData

IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData

Setting Up InfluxDB for IoT by David G SimmonsInfluxData

IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntopInfluxData

Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...InfluxData

Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...InfluxData

Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenInfluxData

Nicolas Steinmetz [CérénIT] | Sustain Your Observability from Bare Metal TICK...InfluxData

How to Create a Modern IIoT Monitoring Solution On iOS Using Swift, MQTT and ...InfluxData

InfluxDB Cloud Product Update InfluxData

InfluxData Architecture for IoT | Noah Crowley | InfluxDataInfluxData

Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData InfluxData

Intro to InfluxDB 2.0 and Your First Flux Query by Sonia GuptaInfluxData

InfluxDB 2.0 Client Libraries by Noah CrowleyInfluxData

InfluxDB 101 – Concepts and Architecture by Michael DeSa, Software Engineer |...InfluxData

How a Time Series Database Contributes to a Decentralized Cloud Object Storag...InfluxData

Sebastian Spaink [InfluxData] | Layer by Layer: Printing Your Own External In...InfluxData

InfluxDB 101 - Concepts and Architecture | Michael DeSa | InfluxDataInfluxData

Why Architecting for Disaster Recovery is Important for Your Time Series Data...InfluxData

Kapacitor Stream ProcessingInfluxData

How to Use Telegraf and Its Plugin EcosystemInfluxData

IoT Event Processing and Analytics with InfluxDB in Google Cloud | Christoph ...InfluxData

Setting Up InfluxDB for IoT by David G SimmonsInfluxData

IT Monitoring in the Era of Containers | Luca Deri Founder & Project Lead | ntopInfluxData

Brian Gilmore [InfluxData] | InfluxDB in an IoT Application Architecture | In...InfluxData

Tim Hall and Ryan Betts [InfluxData] | InfluxDB Roadmap and Engineering Updat...InfluxData

Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenInfluxData

Similar to Keep Calm and Distributed Tracing (20)

Consolidating MLOps at One of Europe’s Biggest AirportsDatabricks

Building a Distributed & Automated Open Source Program at NetflixAll Things Open

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.

Monitoring Big Data Systems Done "The Simple Way" - Demi Ben-Ari - Codemotion...Codemotion

Once you start working with Big Data systems, you discover a whole bunch of problems you won’t find in monolithic systems. Monitoring all of the components becomes a big data problem itself. In the talk, we’ll mention all of the aspects that you should take into consideration when monitoring a distributed system using tools like Web Services, Spark, Cassandra, MongoDB, AWS. Not only the tools, what should you monitor about the actual data that flows in the system? We’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.

Monitoring Big Data Systems "Done the simple way" - Demi Ben-Ari - Codemotion...Demi Ben-Ari

Once you start working with distributed Big Data systems, you start discovering a whole bunch of problems you won’t find in monolithic systems. All of a sudden to monitor all of the components becomes a big data problem itself. In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system once you’re using tools like: Web Services, Apache Spark, Cassandra, MongoDB, Amazon Web Services. Not only the tools, what should you monitor about the actual data that flows in the system? And we’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.

Hot to build continuously processing for 24/7 real-time data streaming platform?GetInData

Reproducibility and automation of machine learning processDenis Dus

Go Observability (in practice)Eran Levy

Tracing 2000+ polyglot microservices at Uber with Jaeger and OpenTracingYuri Shkuro

The Art of Container MonitoringDerek Chen

According to service scale, there are hundreds or thousands of running containers in your service. Should we monitor each container by microscope or monitor each microservice by magnifier? This depends which granularity can help us find and solve the problems. In this sharing, I will introduce how to use cAdvisor, Icinga2, InfluxDB and Grafana to build a self-hosted monitoring system. In addition, I also discuss with how to embrace open source and share some practical experiences.

Mike Bartley - Innovations for Testing Parallel Software - EuroSTAR 2012TEST Huddle

Itsummit2015 blizzardkevin_donovan

This document summarizes a presentation on avoiding "snowflakes", which are uniquely configured systems, when migrating applications to the cloud. The presentation discusses how snowflakes can cause problems with management, updates, and failures. It then outlines how the organization standardized components, implemented infrastructure as code, and adopted other DevOps practices to allow new systems to be set up quickly and reliably while maintaining existing systems in a consistent way during their cloud migration.

OpenTelemetry 101 FTWNGINX, Inc.

It's been said that open source software is eating the world. In the observability space, the project making this possible is OpenTelemetry. It's quickly becoming the standard for instrumentation and data collection of observability data. Understanding what data to collect and how to collect it properly is fundamental to ensuring users can quickly address availability and performance issues. Steve Flanders, Director of Engineering at Splunk, discusses the components of the project, its current status, and how you can get started integrating it into your modern app infrastructure. Speakers: Steve Flanders

Observability, Distributed Tracing, and Open Source: The Missing PrimerVMware Tanzu

Open source tools like OpenTelemetry, OpenTracing, and W3C Trace Context are helping to standardize distributed tracing and observability. This allows developers to understand problems in microservices architectures by propagating unique trace IDs and collecting metrics and traces across services. While open source tools are useful for development and pre-production, commercial solutions are needed to handle production workloads at scale with additional features like access control and automated instrumentation. Standardization through open source is key to managing today's complexity in distributed systems.

Prometheus - Intro, CNCF, TSDB,PromQL,GrafanaSridhar Kumar N

Introduction to Civil Infrastructure PlatformSZ Lin

Building a custom cms with djangoYann Malet

1. The document outlines the process and methodology for building a custom content management system (CMS) with Django. It discusses planning the project through iterative sprints, dealing with migrating legacy data from existing systems, and determining when to customize Django versus using or contributing to existing third-party apps. 2. When migrating legacy data, the document notes it is important to make the migration process easy to run frequently as the data model evolves. Tips include using other servers to avoid slowing down development and handling inconsistent or complex legacy data fields. 3. In determining whether to customize Django or use third-party apps, the document recommends starting with app templates and reusable apps but being willing to fork early if

Deep Dive Time Series Anomaly Detection in Azure with dotnetMarco Parenzan

Deep dive time series anomaly detection with different Azure Data ServicesMarco Parenzan

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Berlin 2017Demi Ben-Ari

This document discusses monitoring big data systems in a simple way. It begins with introducing the speaker and their background. The rest of the document outlines monitoring concepts, common big data architectures involving Spark and Cassandra, and potential problems that can arise. It then provides recommendations for setting up a monitoring stack involving metrics collection, logging, dashboards, and alerting. Specifically, it recommends using Graphite, Grafana, Coralogix, and Redash. The document emphasizes the importance of correlating application and system metrics and asking the right monitoring questions.

Consolidating MLOps at One of Europe’s Biggest AirportsDatabricks

Building a Distributed & Automated Open Source Program at NetflixAll Things Open

Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker

Monitoring Big Data Systems Done "The Simple Way" - Demi Ben-Ari - Codemotion...Codemotion

Monitoring Big Data Systems "Done the simple way" - Demi Ben-Ari - Codemotion...Demi Ben-Ari

Hot to build continuously processing for 24/7 real-time data streaming platform?GetInData

Reproducibility and automation of machine learning processDenis Dus

Go Observability (in practice)Eran Levy

Tracing 2000+ polyglot microservices at Uber with Jaeger and OpenTracingYuri Shkuro

The Art of Container MonitoringDerek Chen

Mike Bartley - Innovations for Testing Parallel Software - EuroSTAR 2012TEST Huddle

Itsummit2015 blizzardkevin_donovan

OpenTelemetry 101 FTWNGINX, Inc.

Observability, Distributed Tracing, and Open Source: The Missing PrimerVMware Tanzu

Prometheus - Intro, CNCF, TSDB,PromQL,GrafanaSridhar Kumar N

Introduction to Civil Infrastructure PlatformSZ Lin

Building a custom cms with djangoYann Malet

Deep Dive Time Series Anomaly Detection in Azure with dotnetMarco Parenzan

Deep dive time series anomaly detection with different Azure Data ServicesMarco Parenzan

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Berlin 2017Demi Ben-Ari

More from Angelo Simone Scotto (10)

Rective Programming with Actor Model in .NETAngelo Simone Scotto

The document discusses reactive and event-driven applications. It notes that code is traditionally executed sequentially but this can cause issues like deadlocks. It then discusses how the actor model addresses this by having discrete units that communicate asynchronously via message passing, avoiding shared state. This allows for better scalability and resilience. It provides examples of actor frameworks for .NET.

DevOps, Lean and YouAngelo Simone Scotto

Agile, DevOps, X-Teams: Is software a social science?Angelo Simone Scotto

Adapt or Go extinctAngelo Simone Scotto

In this presentation we will see why, according to several sources, our work is becoming more and more risk-prone. Where all sources all agree about causes of this tendency, they also agree on solution: Experimentation. Experiments can go wrong and therefore our duty is not just "to be agile" but to lower the cost of our experiments failure. As conclusion we will see three ideas (TrialSourcing, Products management and #NoEstimates movement) all leveraging on experiments to gain organization advantages.

Discovering RxJS - MilanoJS Meeting in May 2016Angelo Simone Scotto

Taming Asynchrony using RxJSAngelo Simone Scotto

Reactive Extensions (Rx) originated in the .NET world, devised and built by Erik Meijer and his team at Microsoft, Rx is a library to compose asynchronous and event-based programs. Available, among other languages, for Javascript(RxJS) it is meant for usage in frontend and backend programming. In this session we will see an introduction to Rx, why it is so useful to deal with async computation and how you can use RxJS in your code.

Redis LabcampAngelo Simone Scotto

Redis is an open source, in-memory data structure store used as a database, cache, and message broker. It supports data structures like strings, hashes, lists, sets, sorted sets with operations like gets, sets, pushes, pops, increments. Redis has simple single-threaded architecture with data always in RAM for speed. It persists data to disk and has pub/sub for messaging. Redis can be used for many use cases like caching, queues, user sessions. A blog platform example showed how Redis could implement user management, posts, tags, voting, and notifications.

Are Microservices our future?Angelo Simone Scotto

This presentation explores the Microservices architecture style. Although there is no precise definition of this architectural style (some argue Microservices is not an architectural style, just another term for SOA architectures), there is increasing agreement this approach is useful in implementing highly scalable, robust and configurable software systems. We’ll attempt to clarify the topic from a purely architectural point of view dispelling some myths in the process.

An Introduction to Machine LearningAngelo Simone Scotto

Actor Model & Reactive ManifestoAngelo Simone Scotto

Actor Model is a general model of concurrent computation developed by Carl Hewitt in 1973. It provides a flexible mechanism for building parallel and distributed software systems. In recent years the advent of multi-core architecture and massive cloud-based concurrent applications renewed the interest in Actor-based programming, as it helps in development of reliable, scalable and massively-concurrent computer systems. Therefore actor frameworks are available for every programming language and their implementations are currently used by the major web service competitors such as Linkedin, Twitter, Amazon, Yahoo!, Facebook and Microsoft.

Rective Programming with Actor Model in .NETAngelo Simone Scotto

DevOps, Lean and YouAngelo Simone Scotto

Agile, DevOps, X-Teams: Is software a social science?Angelo Simone Scotto

Adapt or Go extinctAngelo Simone Scotto

Discovering RxJS - MilanoJS Meeting in May 2016Angelo Simone Scotto

Taming Asynchrony using RxJSAngelo Simone Scotto

Redis LabcampAngelo Simone Scotto

Are Microservices our future?Angelo Simone Scotto

An Introduction to Machine LearningAngelo Simone Scotto

Actor Model & Reactive ManifestoAngelo Simone Scotto

Recently uploaded (20)

Who Watches the Watchmen (SciFiDevCon 2025)Allon Mureinik

Tests, especially unit tests, are the developers’ superheroes. They allow us to mess around with our code and keep us safe. We often trust them with the safety of our codebase, but how do we know that we should? How do we know that this trust is well-deserved? Enter mutation testing – by intentionally injecting harmful mutations into our code and seeing if they are caught by the tests, we can evaluate the quality of the safety net they provide. By watching the watchmen, we can make sure our tests really protect us, and we aren’t just green-washing our IDEs to a false sense of security. Talk from SciFiDevCon 2025 https://www.scifidevcon.com/courses/2025-scifidevcon/contents/680efa43ae4f5

Societal challenges of AI: biases, multilinguism and sustainabilityJordi Cabot

EASEUS Partition Master Crack + License Codeaneelaramzan63

What Do Contribution Guidelines Say About Software Testing? (MSR 2025)Andre Hora

Software testing plays a crucial role in the contribution process of open-source projects. For example, contributions introducing new features are expected to include tests, and contributions with tests are more likely to be accepted. Although most real-world projects require contributors to write tests, the specific testing practices communicated to contributors remain unclear. In this paper, we present an empirical study to understand better how software testing is approached in contribution guidelines. We analyze the guidelines of 200 Python and JavaScript open-source software projects. We find that 78% of the projects include some form of test documentation for contributors. Test documentation is located in multiple sources, including CONTRIBUTING files (58%), external documentation (24%), and README files (8%). Furthermore, test documentation commonly explains how to run tests (83.5%), but less often provides guidance on how to write tests (37%). It frequently covers unit tests (71%), but rarely addresses integration (20.5%) and end-to-end tests (15.5%). Other key testing aspects are also less frequently discussed: test coverage (25.5%) and mocking (9.5%). We conclude by discussing implications and future research.

PDF Reader Pro Crack Latest Version FREE Download 2025mu394968

🌍📱👉COPY LINK & PASTE ON GOOGLE https://dr-kain-geera.info/👈🌍 PDF Reader Pro is a software application, often referred to as an AI-powered PDF editor and converter, designed for viewing, editing, annotating, and managing PDF files. It supports various PDF functionalities like merging, splitting, converting, and protecting PDFs. Additionally, it can handle tasks such as creating fillable forms, adding digital signatures, and performing optical character recognition (OCR).

F-Secure Freedome VPN 2025 Crack Plus Activation New Versionsaimabibi60507

How can one start with crypto wallet development.pptxlaravinson24

The Significance of Hardware in Information Systems.pdfdrewplanas10

Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage DashboardsBradBedford3

Join Ajay Sarpal and Miray Vu to learn about key Marketo Engage enhancements. Discover improved in-app Salesforce CRM connector statistics for easy monitoring of sync health and throughput. Explore new Salesforce CRM Synch Dashboards providing up-to-date insights into weekly activity usage, thresholds, and limits with drill-down capabilities. Learn about proactive notifications for both Salesforce CRM sync and product usage overages. Get an update on improved Salesforce CRM synch scale and reliability coming in Q2 2025. Key Takeaways: Improved Salesforce CRM User Experience: Learn how self-service visibility enhances satisfaction. Utilize Salesforce CRM Synch Dashboards: Explore real-time weekly activity data. Monitor Performance Against Limits: See threshold limits for each product level. Get Usage Over-Limit Alerts: Receive notifications for exceeding thresholds. Learn About Improved Salesforce CRM Scale: Understand upcoming cloud-based incremental sync.

Kubernetes_101_Zero_to_Platform_Engineer.pptxCloudScouts

Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdfTechSoup

In this webinar we will dive into the essentials of generative AI, address key AI concerns, and demonstrate how nonprofits can benefit from using Microsoft’s AI assistant, Copilot, to achieve their goals. This event series to help nonprofits obtain Copilot skills is made possible by generous support from Microsoft. What You’ll Learn in Part 2: Explore real-world nonprofit use cases and success stories. Participate in live demonstrations and a hands-on activity to see how you can use Microsoft 365 Copilot in your own work!

Exploring Code Comprehension in Scientific Programming: Preliminary Insight...University of Hawai‘i at Mānoa

This presentation explores code comprehension challenges in scientific programming based on a survey of 57 research scientists. It reveals that 57.9% of scientists have no formal training in writing readable code. Key findings highlight a "documentation paradox" where documentation is both the most common readability practice and the biggest challenge scientists face. The study identifies critical issues with naming conventions and code organization, noting that 100% of scientists agree readable code is essential for reproducible research. The research concludes with four key recommendations: expanding programming education for scientists, conducting targeted research on scientific code quality, developing specialized tools, and establishing clearer documentation guidelines for scientific software. Presented at: The 33rd International Conference on Program Comprehension (ICPC '25) Date of Conference: April 2025 Conference Location: Ottawa, Ontario, Canada Preprint: https://arxiv.org/abs/2501.10037

Designing AI-Powered APIs on Azure: Best Practices& ConsiderationsDinusha Kumarasiri

AI is transforming APIs, enabling smarter automation, enhanced decision-making, and seamless integrations. This presentation explores key design principles for AI-infused APIs on Azure, covering performance optimization, security best practices, scalability strategies, and responsible AI governance. Learn how to leverage Azure API Management, machine learning models, and cloud-native architectures to build robust, efficient, and intelligent API solutions

Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMaxim Salnikov

Avast Premium Security Crack FREE Latest Version 2025mu394968

🌍📱👉COPY LINK & PASTE ON GOOGLE https://dr-kain-geera.info/👈🌍 Avast Premium Security is a paid subscription service that provides comprehensive online security and privacy protection for multiple devices. It includes features like antivirus, firewall, ransomware protection, and website scanning, all designed to safeguard against a wide range of online threats, according to Avast. Key features of Avast Premium Security: Antivirus: Protects against viruses, malware, and other malicious software, according to Avast. Firewall: Controls network traffic and blocks unauthorized access to your devices, as noted by All About Cookies. Ransomware protection: Helps prevent ransomware attacks, which can encrypt your files and hold them hostage. Website scanning: Checks websites for malicious content before you visit them, according to Avast. Email Guardian: Scans your emails for suspicious attachments and phishing attempts. Multi-device protection: Covers up to 10 devices, including Windows, Mac, Android, and iOS, as stated by 2GO Software. Privacy features: Helps protect your personal data and online privacy. In essence, Avast Premium Security provides a robust suite of tools to keep your devices and online activity safe and secure, according to Avast.

Automation Techniques in RPA - UiPath CertificateVICTOR MAESTRE RAMIREZ

WinRAR Crack for Windows (100% Working 2025)sh607827

FL Studio Producer Edition Crack 2025 Full Versiontahirabibi60507

Why Orangescrum Is a Game Changer for Construction Companies in 2025Orangescrum

How Valletta helped healthcare SaaS to transform QA and compliance to grow wi...Egor Kaleynik

This case study explores how we partnered with a mid-sized U.S. healthcare SaaS provider to help them scale from a successful pilot phase to supporting over 10,000 users—while meeting strict HIPAA compliance requirements. Faced with slow, manual testing cycles, frequent regression bugs, and looming audit risks, their growth was at risk. Their existing QA processes couldn’t keep up with the complexity of real-time biometric data handling, and earlier automation attempts had failed due to unreliable tools and fragmented workflows. We stepped in to deliver a full QA and DevOps transformation. Our team replaced their fragile legacy tests with Testim’s self-healing automation, integrated Postman and OWASP ZAP into Jenkins pipelines for continuous API and security validation, and leveraged AWS Device Farm for real-device, region-specific compliance testing. Custom deployment scripts gave them control over rollouts without relying on heavy CI/CD infrastructure. The result? Test cycle times were reduced from 3 days to just 8 hours, regression bugs dropped by 40%, and they passed their first HIPAA audit without issue—unlocking faster contract signings and enabling them to expand confidently. More than just a technical upgrade, this project embedded compliance into every phase of development, proving that SaaS providers in regulated industries can scale fast and stay secure.

Who Watches the Watchmen (SciFiDevCon 2025)Allon Mureinik

Societal challenges of AI: biases, multilinguism and sustainabilityJordi Cabot

EASEUS Partition Master Crack + License Codeaneelaramzan63

What Do Contribution Guidelines Say About Software Testing? (MSR 2025)Andre Hora

PDF Reader Pro Crack Latest Version FREE Download 2025mu394968

F-Secure Freedome VPN 2025 Crack Plus Activation New Versionsaimabibi60507

How can one start with crypto wallet development.pptxlaravinson24

The Significance of Hardware in Information Systems.pdfdrewplanas10

Adobe Marketo Engage Champion Deep Dive - SFDC CRM Synch V2 & Usage DashboardsBradBedford3

Kubernetes_101_Zero_to_Platform_Engineer.pptxCloudScouts

Microsoft AI Nonprofit Use Cases and Live Demo_2025.04.30.pdfTechSoup

Exploring Code Comprehension in Scientific Programming: Preliminary Insight...University of Hawai‘i at Mānoa

Designing AI-Powered APIs on Azure: Best Practices& ConsiderationsDinusha Kumarasiri

Meet the Agents: How AI Is Learning to Think, Plan, and CollaborateMaxim Salnikov

Avast Premium Security Crack FREE Latest Version 2025mu394968

Automation Techniques in RPA - UiPath CertificateVICTOR MAESTRE RAMIREZ

WinRAR Crack for Windows (100% Working 2025)sh607827

FL Studio Producer Edition Crack 2025 Full Versiontahirabibi60507

Why Orangescrum Is a Game Changer for Construction Companies in 2025Orangescrum

How Valletta helped healthcare SaaS to transform QA and compliance to grow wi...Egor Kaleynik

Keep Calm and Distributed Tracing

1. Angelo Simone Scotto Solution Architect [email protected] Keep Calm and Distributed Tracing

3. Logging Tracing Monitoring Technical Pattern Event Stream: Append-Only Timestamped Records (a.k.a. Logs) Trigger A specific event None (periodic) Payload Business Events Technical Events System Status Historical Approach LogLevel >= Info LogLevel = Trace Performance Counters

4. Time Above -> Before Below -> After Log File • A log on a single machine/core is simple to inspect.

5. Log File 1 • A log on a single machine/core is simple to inspect. • Async code (not just distributed code) is way more complex. • You need to aggregate data from different places. • You need to correlate traces on one machine with traces on others. • This is why debugging async code is hard. Log File 3 Log File 2 ?

7. • Seminal paper on Distributed Tracing. • Defines the main terminology.

8. • Other key takeaway: • Application Transparency: programmers should not need (necessarily) to be aware of the tracing system. • Sampling: Not all traces are persisted, a probabilistic approach is used (i.e. 1 sample every 1024 traces) • Span: the primary building block of a distributed trace, representing an individual unit of work done in a distributed system. • Trace: a tree of Spans: a visualization of the life of a request as it moves through a distributed system.

10. • 2010 – Google publishes Dapper Article (without source code). • 2012 – Twitter publishes Zipkin (and source code). • 2015 – Uber develops Jaeger (not published). • 2016 – OpenTracing standard is published and joins CNCF. • 2017 – Uber publishes Jaeger (and source code) and donate it to CNCF

12. ? ? ?

16. • 2010 – Google publishes Dapper Article (without source code). • 2012 – Twitter publishes Zipkin (and source code). • 2015 – Uber develops Jaeger (not published). • 2016 – OpenTracing standard is published and joins CNCF. • 2017 – Uber publishes Jaeger (and source code) and donate it to CNCF. • 2018 – Google publishes OpenCensus (and source code). • 2018 – W3C initiate a Distributed Tracing Working Group. • 2018 – OpenMetrics is published and adopted by CNCF.

17. • 2010 – Google publishes Dapper Article (without source code). • 2012 – Twitter publishes Zipkin (and source code). • 2015 – Uber develops Jaeger (not published). • 2016 – OpenTracing standard is published and joins CNCF. • 2017 – Uber publishes Jaeger (and source code) and donate it to CNCF. • 2018 – Google publishes OpenCensus (and source code). • 2018 – W3C initiate a Distributed Tracing Working Group. • 2018 – OpenMetrics is published and adopted by CNCF. • 2019 – OpenTelemetry is published and is adopted by CNCF.

23. • OpenTelemetry in .NET is just a wrapper on existing Activity and ActivitySource classes from System.Diagnostics. • Ensure high performance and stability. • Is future-proof. • OpenTelemetry still in pre-release (1.0.0-rc1.1). • OpenTelemetry.Instrumentation nuget packages (AspNet, SqlClient, Redis,…) • OpenTelemetry.Exporter nuget packages (Jaeger, Zipkin, OTEL,…)

26. Code available https://bit.ly/netconfit-disttracing

27. Code available https://bit.ly/netconfit-disttracing

28. Code available https://bit.ly/netconfit-disttracing

30. • Successful Distributed Systems requires Distributed Tracing. • Auto Instrumenting your applications requires few lines of code. • Do yourself a favour and start instrumenting. • OpenTracing or OpenTelemetry? • OpenTelemetry is the future and now in RC (not yet in GA). • OpenTracing is more mature but superseded by OpenTelemetry. • We just scratched the surface: • No in-depth discussion on Metrics and Logs. • No in-depth discussion on async comms (i.e. queues instead of http). • No in-depth analysis on OTEL Architecture (i.e. standalone connector). • No in-depth analysis on trace enrichment/filtering/modification. • No in-depth analysis on baggage/context serialization.

31. Slide e materiale su https://aspit.co/netconfit-20 [email protected]

Keep Calm and Distributed Tracing

Recommended

More Related Content

What's hot (20)

Similar to Keep Calm and Distributed Tracing (20)

More from Angelo Simone Scotto (10)

Recently uploaded (20)

Keep Calm and Distributed Tracing