Effective monitoring with statsd - Alexis lê-quôc

Oct 25, 20130 likes1,027 views

This document discusses effective application monitoring using tools like Datadog. It introduces the OODA loop concept of observe, orient, decide, and act for monitoring systems. Key aspects that observations from monitoring tools need to be timely, correct, and comprehensive. It then discusses how StatsD works as a simple and effective monitoring tool that collects custom metrics and sends them to backends using a simple text protocol. The document cautions about some common pitfalls of StatsD like treating counters as rates instead of counts and issues with histograms assuming normal distributions. It emphasizes the importance of tagging for organizing metrics and provides links to get started with StatsD.

An application
through a monitoring
tool

OODA Loop (simpliﬁed)
Observe

Orient

Act

Decide

M
on
ito
g rin
To
ol

OODA Loop (simpliﬁed)
Observe

Orient

Act

Decide

Yo
u

M
on
ito
g rin
To
ol

OODA Loop (simpliﬁed)
Observe

Orient

Act

Decide

Yo
u

M
on
ito
g rin
To
ol

OODA Loop (simpliﬁed)
Orient

Yo
u

Observe

Act

Decide

M
on
ito
g rin
To
ol

Yo
u

Yo
u

Yo
u

OODA Loop (simpliﬁed)
Observe

Act

Orient

Decide

Observations need to
be...
1.Timely
2.Correct
3.Comprehensive

Observations need to
be...
1.Timely
2.Correct
3.Comprehensive

Else

Observations need to
be...
1.Timely
2.Correct
3.Comprehensive

Else

Garbage
In, Garbage
Out

Timely
Initial
assumptions

Initial set of
metrics

Contact
with reality

Revised
assumptions

Revised set
of metrics

M
N in
ot ut
we es
ek
s

Timely
Initial
assumptions

Initial set of
metrics

Contact
with reality

Revised
assumptions

Revised set
of metrics

Comprehensive
Resources
Resources
Resources
Resources
Resources

Work

Value

Comprehensive
Easy to collect
generic
but not actionable
Resources
Resources
Resources
Resources
Resources

Work

Value

Comprehensive
Easy to collect
generic
but not actionable
Resources
Resources
Resources
Resources
Resources

Work

Value

Harder to collect,
custom
but most actionable

How statsD works
pageviews:100|
c@0.25
latency:320|ms
backlog:333|g
uniques:765|s
Client libraries talk to a
simple UDP server...

...using a simple text protocol

statsD types
Type

Deﬁnition

Example

Gauges

Absolute values

Queue size

Counters

Per-second rates

Page views

Histograms

Gauge summary

Page Latency

Timers

Gauge distribution

Page Latency

Sets

Counters of unique
things

Unique visitors

statsD problems
Type
Gauges
Counters
Histograms
Timers
Sets

Deﬁnition

Problem

Absolute values

Latest value wins.
Gauge deltas???

Per-second rates

Rates, not counts (!
= rrdtool)

Gauge summary

Assumes normal
distribution

Can measure much
Gauge distribution
more than time
Counters of unique
things

:-)

#1 pitfall: “Counters”
http://dtdg.co/tokyo-counters

How we use statsD
http://dtdg.co/tokyo-dog

Essential: Tagging
http://dtdg.co/tokyo-tags

How to get started
• statsD https://github.com/etsy/statsd
• client libraries https://github.com/etsy/statsd/wiki
(my company) 1-stop shop http://www.datadoghq.com

ありがとうございました。
質問？@alq

Thank you very much!
Questions？ @alq

This document provides an overview of Graphite and StatsD. StatsD is a network daemon that listens for statistics like counters or timers over UDP and sends them to Carbon. Carbon is another network daemon that listens for statistics over TCP and stores them on disk using Whisper, a fixed-size database like RRD. Graphite is a web-based interface for visualizing the stored metrics, allowing users to render graphs and create dashboards from the collected time-series data.

Dev opsdays scriptcodeDevopsdays

Zero to hero - Geoff WebbDevopsdays

This document provides an overview of the steps to implement continuous delivery, from theory to practice. It discusses building code, deploying changes, running applications, and managing environments in a continuous delivery model. The key points are: - Continuous delivery involves automating the process of building, testing, and deploying code changes on a regular basis. - While the theory is straightforward, existing codebases, systems and team dynamics can make implementation challenging. - The document outlines pragmatic approaches like focusing on automation and taking incremental steps to establish continuous delivery practices over time.

Letting go gavin - Mc DonaldDevopsdays

This document appears to be a slide deck for a DevOpsDays Ignite talk on letting go and cloud survival. It includes topics like server naming conventions using roles and regions, inventory management by attaching servers to people, configuration management tools like Ansible and Puppet, automated builds from bare metal images, and replacing systems instead of fixing them. Images are included from sources like Muppets and LEGO to accompany some of the topics. The presentation is given by Gavin McDonald from Hootsuite.

Dw tpain - Gordon KlokDevopsdays

This document discusses using a PID controller to dynamically limit the rate of MySQL backups using innobackupex to avoid overloading the storage servers. It describes setting up pv to monitor and rate limit the backup, with a remote PID controller adjusting the limit in real time based on iostat metrics to keep the storage servers optimally utilized during backups. The controller aims to keep the average queue size around 1.0 on the storage devices containing MySQL data files.

Dev ops finishes what agile started - Manfred MoserDevopsdays

The document discusses how DevOps finishes what Agile started by integrating development, security, and operations. It notes that organizations struggle to manage the increasing complexity, diversity, volume, and pace of change of the many components that modern applications rely on. Adopting DevOps practices like continuous integration/delivery and automating policies is necessary for organizations to effectively manage components and release applications while minimizing security and quality risks. The document advocates for "shifting security left" by incorporating security practices earlier in the development process.

Game of thrones - Jonathan ThorpeDevopsdays

Heka - Rob MillerDevopsdays

Heka is a unified data processing tool that can replace multiple existing tools like collectd, statsd, logstash, and riemann. It acquires data from various sources through inputs, transforms and transports the data through splitters, decoders, filters and a router. The data can then be output to external services, other Heka instances, or a dashboard. Plugins are added dynamically through sandboxes without needing to restart the service, and misbehaving plugins are automatically shut off. Heka aims to reduce the number of processes to manage by providing a single flexible and configurable tool that can be easily extended to handle different data processing needs.

Gaming dev ops - Eduardo SaitoDevopsdays

The document describes the evolution of alert workflows at a gaming company. Traditionally, all alerts went to operations teams who had to track down the relevant developers. A new system routes each alert directly to the team that can resolve it, whether operations, a specific development project, or analytics. This improves response time by ensuring alerts go to those responsible without operations having to transfer the issue. Status updates are also provided via an IM bot for better communication across teams.

From the classroom to the cloud a journey with node.js - Christopher HogueDevopsdays

Dev ops at mobify - Kyle YoungDevopsdays

This document provides a high-level overview of different teams involved with DevOps including the Product Team, Customer Success team, Marketing Team, Sales Engineers, and some final thoughts. It mentions that the Product Team uses tools like fabric, puppet, and CircleCI and that the Customer Success team helps customers with what the Product Team builds. It also notes the Marketing Team uses Markdown, pelican, fabric, and git and that Sales Engineers help generate leads using DevOps.

Your business needs devops, so don’t follow - Brian johnson Devopsdays

The document criticizes how ITIL has been commercialized and misused to prioritize process over practical solutions. It argues that businesses need DevOps to focus on collaboration, speed, and delivering working solutions rather than rigid processes. While ITIL originally aimed to help businesses, it has been corrupted by those seeking to treat it as the sole framework and sell unnecessary certification programs and products. The author advocates for embracing DevOps' potential for addressing lifecycles and reducing costs and time to market, rather than declaring it the new ITIL.

Test kitchen 1.0 - Fletcher NicholDevopsdays

Living system or build factory - Chris MaxwellDevopsdays

This document discusses the differences between living systems and build factories in IT operations. A living system mutates and evolves over time as the business needs change, resulting in each system being slightly different. In contrast, a build factory aims to replicate systems exactly using automated procedures so that each new system has identical configurations. The document advocates describing processes, automating steps, and enabling production of identical systems through repetition as an effective approach for build factories. It also notes some challenges that can arise when deeply embedded problems occur in living systems or unexpected changes are required for production systems.

From vagrant to production - Mark EijsermansDevopsdays

This document discusses the evolution of HootSuite's development and operations processes over several years as the company grew. It begins with a small co-located team that could release to production anytime with low overhead. It progresses to larger distributed teams releasing every 2-4 weeks through a more complicated process. The current process involves 6-10 releases per day through automation and practices like infrastructure as code that allow anyone to deploy. Key steps along the way included adopting Vagrant for development environments, implementing continuous integration and delivery pipelines, and moving to a microservices architecture.

Dev ops lessons learned - Michael CollinsDevopsdays

The document discusses lessons learned from trying to implement DevOps in a rapidly growing company. Some key lessons include: (1) being able to clearly articulate what DevOps means for both individuals and the organization; (2) trusting developers and providing them with what they need; and (3) starting DevOps efforts with a focus on development environments rather than just production. The document also emphasizes focusing on toolchains rather than individual tools, using a service delivery pipeline approach, and ensuring good communication and hiring practices.

Building for operations - Reinhardt QuelleDevopsdays

The document discusses building applications for operability. It describes the different perspectives of operations and development teams. Operations teams view servers as part of clusters and focus on system-level configuration and components. Development teams focus mainly on application configuration. The document emphasizes that applications need to be built to allow for sharing of data and configurations across server clusters to support high availability and scalability. It provides examples of how server infrastructure and applications are structured, such as front-end servers routing requests to application servers.

Taking devops to the Next Level - Max MartinDevopsdays

This document discusses how Puppet, Mcollective, and related tools have advanced to help users take DevOps to the next level. It summarizes new features in Puppet 3.0 like improved speed and scalability, Hiera for hierarchical configuration data, and PuppetDB for fast, scalable storage of Puppet data. It also outlines advances in Mcollective for orchestration and tools like Geppetto and the Puppet Forge. The document argues these tools help users achieve higher levels of speed, scalability, extensibility, reliability, flexibility, agility, and community involvement.

Sensu intro - Sean PorterDevopsdays

Ops for everyone - John BrittonDevopsdays

The document discusses using Boxen and Puppet to automate and configure a developer's Mac environment. It describes how Boxen allows one to install common tools like Homebrew, Git, Ruby versions and more with a single command on day one. It also explains how to configure personal and project-specific settings through Puppet manifests. Finally, it outlines how to use Hubot for chatops to share and operate terminals collaboratively.

Being healthy dev and ops in cookpad - Issei NarutaDevopsdays

Making operations visible - Nick GallbreathDevopsdays

This document provides an overview of a presentation given by Nick Galbreath at DevOpsDays Tokyo 2013 about making operations visible. The presentation encourages organizations to expose more operational metrics and business data through systems like Graphite and StatsD to improve communication and collaboration between teams. It provides examples of how to collect and visualize different types of data from applications, systems, and business processes. The goal is to overcome excuses for lack of visibility and have organizations complete the "One Machine, One Day, One Person Challenge" to start capturing and sharing their key operational and business metrics.

What science tells us about information infrastructure - Mark BurgessDevopsdays

This document discusses the challenges of information technology (IT) infrastructure given its uncertain and dynamic nature. While IT would be easier if systems were deterministic, they are only in approximate balance due to environmental complexity impacting sensitivity. Continuous delivery requires continuous automation rather than power-assisted intervention. There is no such thing as an immutable system since intended changes do not prevent unintended changes. Failures are semantic and processes are dynamic, making control difficult, as the history of engineering shows the challenges of preventing cracks from spreading.

How to use continuous improvement kungfu to pay down technical debt - Kevin B...Devopsdays

This document describes how a team used continuous improvement techniques like kanban and daily standup meetings to pay down technical debt. They started by making their work visible on a kanban board and experimenting daily to address obstacles. This helped them gradually increase the amount of work spent paying off technical debt. Over time, they recruited more teams, improved coordination, and built faster feedback loops to work towards their goal of continuous delivery. Their daily improvements helped transform their work processes and productivity.

Giving (and taking) back - Mike FiedlerDevopsdays

The document discusses ways for people to get involved in open source projects even without coding skills. It recommends starting by learning code through online courses, reading project documentation, and getting involved by running tests, documenting issues, and submitting patches. The document emphasizes that contributing helps both the project and the contributor's learning and that maintaining open source projects requires setting a low barrier to entry, writing intentions clearly, leading by example, and using tools like GitHub, Travis CI, and open source licenses.

Enterprise dev ops , going big and f*$^#&g up, a cautionary tale - Mike BaukesDevopsdays

A company attempted a large-scale DevOps initiative to improve their development and production processes, but faced many challenges that ultimately led to failures in production. The company cultures and teams were spread across geographies and organizational structures, leading to tensions. Processes were rife with technical debt, and the new DevOps team recruited elite developers who caused arrogance and tensions. A lack of representative testing environments and data on risks meant changes regressed in production. Key lessons included needing empathy, data, and addressing human/cultural issues for DevOps transformations to succeed at scale.

Morgue , helping better understand events by building a post mortem tool - Be...Devopsdays

The document discusses Morgue, a tool for conducting post-mortem analyses of software issues and outages. Morgue aims to improve on wikis by providing structured templates for post-mortems, tracking metrics like severity levels and times over multiple incidents, and integrating with other tools like Jira. It currently has features like markdown, images, tags and linking to status sites. Future goals include adding graphs and enforcing remediation steps from previous issues. Morgue is open source and hosted on GitHub for community contributions.

What if devops was invented by Coca ColaDevopsdays

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Splunk Security Update | Public Sector Summit Germany 2025Splunk

More Related Content

More from Devopsdays (20)

Gaming dev ops - Eduardo SaitoDevopsdays

From the classroom to the cloud a journey with node.js - Christopher HogueDevopsdays

Dev ops at mobify - Kyle YoungDevopsdays

Your business needs devops, so don’t follow - Brian johnson Devopsdays

Test kitchen 1.0 - Fletcher NicholDevopsdays

Living system or build factory - Chris MaxwellDevopsdays

From vagrant to production - Mark EijsermansDevopsdays

Dev ops lessons learned - Michael CollinsDevopsdays

Building for operations - Reinhardt QuelleDevopsdays

Taking devops to the Next Level - Max MartinDevopsdays

Sensu intro - Sean PorterDevopsdays

Ops for everyone - John BrittonDevopsdays

Being healthy dev and ops in cookpad - Issei NarutaDevopsdays

Making operations visible - Nick GallbreathDevopsdays

What science tells us about information infrastructure - Mark BurgessDevopsdays

How to use continuous improvement kungfu to pay down technical debt - Kevin B...Devopsdays

Giving (and taking) back - Mike FiedlerDevopsdays

Enterprise dev ops , going big and f*$^#&g up, a cautionary tale - Mike BaukesDevopsdays

Morgue , helping better understand events by building a post mortem tool - Be...Devopsdays

What if devops was invented by Coca ColaDevopsdays

Gaming dev ops - Eduardo SaitoDevopsdays

From the classroom to the cloud a journey with node.js - Christopher HogueDevopsdays

Dev ops at mobify - Kyle YoungDevopsdays

Your business needs devops, so don’t follow - Brian johnson Devopsdays

Test kitchen 1.0 - Fletcher NicholDevopsdays

Living system or build factory - Chris MaxwellDevopsdays

From vagrant to production - Mark EijsermansDevopsdays

Dev ops lessons learned - Michael CollinsDevopsdays

Building for operations - Reinhardt QuelleDevopsdays

Taking devops to the Next Level - Max MartinDevopsdays

Sensu intro - Sean PorterDevopsdays

Ops for everyone - John BrittonDevopsdays

Being healthy dev and ops in cookpad - Issei NarutaDevopsdays

Making operations visible - Nick GallbreathDevopsdays

What science tells us about information infrastructure - Mark BurgessDevopsdays

How to use continuous improvement kungfu to pay down technical debt - Kevin B...Devopsdays

Giving (and taking) back - Mike FiedlerDevopsdays

Enterprise dev ops , going big and f*$^#&g up, a cautionary tale - Mike BaukesDevopsdays

Morgue , helping better understand events by building a post mortem tool - Be...Devopsdays

What if devops was invented by Coca ColaDevopsdays

Recently uploaded (20)

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots. 📕 Here's what you can expect: - Modeling: Build end-to-end processes using BPMN. - Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes. - Operating: Control process instances with rewind, replay, pause, and stop functions. - Monitoring: Use dashboards and embedded analytics for real-time insights into process instances. This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes. 👨‍🏫 Speaker: Andrei Vintila, Principal Product Manager @UiPath This session streamed live on April 29, 2025, 16:00 CET. Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Want to learn practical tips for designing systems that can scale efficiently without compromising speed? Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development. As you explore key principles of designing low-latency systems with Rust, you will learn how to: - Create and compile a real-world app with Rust - Connect the application to ScyllaDB (NoSQL data store) - Negotiate tradeoffs related to data modeling and querying - Manage and monitor the database for consistently low latencies

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Spark is a powerhouse for large datasets, but when it comes to smaller data workloads, its overhead can sometimes slow things down. What if you could achieve high performance and efficiency without the need for Spark? At S&P Global Commodity Insights, having a complete view of global energy and commodities markets enables customers to make data-driven decisions with confidence and create long-term, sustainable value. 🌍 Explore delta-rs + CDC and how these open-source innovations power lightweight, high-performance data applications beyond Spark! 🚀

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

tecnologias de las primeras civilizaciones.pdffjgm517

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/ HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar. Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten. In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich - Zugriff auf die Konsole - Auffinden und Interpretieren von Protokolldateien - Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS) - Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien - Nutzung der Client Clocking-Funktion

Cyber Awareness overview for 2025 month of securityriccardosl1

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

At InData Labs, we have been keeping an ear to the ground, looking out for AI-enabled digital transformation trends coming our way in 2025. Our report will provide a look into the technology landscape of the future, including: -Artificial Intelligence Market Overview -Strategies for AI Adoption in 2025 -Anticipated drivers of AI adoption and transformative technologies -Benefits of AI and Big data for your business -Tips on how to prepare your business for innovation -AI and data privacy: Strategies for securing data privacy in AI models, etc. Download your free copy nowand implement the key findings to improve your business.

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

TrsLabs - Fintech Product & Business ConsultingTrs Labs

Hybrid Growth Mandate Model with TrsLabs Strategic Investments, Inorganic Growth, Business Model Pivoting are critical activities that business don't do/change everyday. In cases like this, it may benefit your business to choose a temporary external consultant. An unbiased plan driven by clearcut deliverables, market dynamics and without the influence of your internal office equations empower business leaders to make right choices. Getting things done within a budget within a timeframe is key to Growing Business - No matter whether you are a start-up or a big company Talk to us & Unlock the competitive advantage

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Top 10 IT Help Desk Outsourcing ServicesInfrassist Technologies Pvt. Ltd.

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Splunk Security Update | Public Sector Summit Germany 2025Splunk

Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Build Your Own Copilot & Agents For DevsBrian McKeiver

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB

Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan

Heap, Types of Heap, Insertion and DeletionJaydeep Kale

Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok

Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma

Rusty Waters: Elevating Lakehouses Beyond Sparkcarlyakerly1

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

tecnologias de las primeras civilizaciones.pdffjgm517

HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda

Cyber Awareness overview for 2025 month of securityriccardosl1

Technology Trends in 2025: AI and Big Data AnalyticsInData Labs

TrsLabs Consultants - DeFi, WEb3, Token ListingTrs Labs

TrsLabs - Fintech Product & Business ConsultingTrs Labs

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Top 10 IT Help Desk Outsourcing ServicesInfrassist Technologies Pvt. Ltd.

Effective monitoring with statsd - Alexis lê-quôc

1. Effective Monitoring with

2. @alq CTO at Datadog

3. An application through the naked eye

4. An application through a monitoring tool

5. OODA Loop (simpliﬁed) Observe Orient Act Decide

6. OODA Loop (simpliﬁed) Observe Orient Act Decide

7. M on ito g rin To ol OODA Loop (simpliﬁed) Observe Orient Act Decide

8. Yo u M on ito g rin To ol OODA Loop (simpliﬁed) Observe Orient Act Decide

9. Yo u M on ito g rin To ol OODA Loop (simpliﬁed) Orient Yo u Observe Act Decide

10. M on ito g rin To ol Yo u Yo u Yo u OODA Loop (simpliﬁed) Observe Act Orient Decide

11. Observations need to be... 1.Timely 2.Correct 3.Comprehensive

12. Observations need to be... 1.Timely 2.Correct 3.Comprehensive

13. Observations need to be... 1.Timely 2.Correct 3.Comprehensive Else

14. Observations need to be... 1.Timely 2.Correct 3.Comprehensive Else Garbage In, Garbage Out

15. Timely Initial assumptions Initial set of metrics Contact with reality Revised assumptions Revised set of metrics

16. M N in ot ut we es ek s Timely Initial assumptions Initial set of metrics Contact with reality Revised assumptions Revised set of metrics

17. Comprehensive Resources Resources Resources Resources Resources Work Value

18. Comprehensive Easy to collect generic but not actionable Resources Resources Resources Resources Resources Work Value

19. Comprehensive Easy to collect generic but not actionable Resources Resources Resources Resources Resources Work Value Harder to collect, custom but most actionable

20. statsD Easy

21. statsD Easy Timely

22. statsD Easy Timely Comprehensive

23. How statsD works pageviews:100| [email protected] latency:320|ms backlog:333|g uniques:765|s Client libraries talk to a simple UDP server... ...using a simple text protocol

24. statsD types Type Deﬁnition Example Gauges Absolute values Queue size Counters Per-second rates Page views Histograms Gauge summary Page Latency Timers Gauge distribution Page Latency Sets Counters of unique things Unique visitors

25. statsD problems Type Gauges Counters Histograms Timers Sets Deﬁnition Problem Absolute values Latest value wins. Gauge deltas??? Per-second rates Rates, not counts (! = rrdtool) Gauge summary Assumes normal distribution Can measure much Gauge distribution more than time Counters of unique things :-)

26. #1 pitfall: “Counters” http://dtdg.co/tokyo-counters

27. How we use statsD http://dtdg.co/tokyo-dog

28. Essential: Tagging http://dtdg.co/tokyo-tags

29. How to get started • statsD https://github.com/etsy/statsd • client libraries https://github.com/etsy/statsd/wiki (my company) 1-stop shop http://www.datadoghq.com

30. ありがとうございました。質問？@alq Thank you very much! Questions？ @alq

Effective monitoring with statsd - Alexis lê-quôc

Recommended

More Related Content

More from Devopsdays (20)

Recently uploaded (20)

Effective monitoring with statsd - Alexis lê-quôc