SlideShare a Scribd company logo
Zabbix Log Management
Crash Course
Running time: 50 minutes
Configuring logging
Pre-3.0
● LogFile (if not set, syslog used)
● LogFileSize
● DebugLevel
Configuring Logging in 3.0
3.0+
● LogType – system/file/console
● LogFile (if LogType=file)
● LogFileSize
● DebugLevel
Log Format
Not configurable
1714:20160909:031847.509 log message
PID date time ms
Log-related Issues
Each process opens logfile individually
Holds two filedescriptors
May keep deleted logfiles around (improved in 3.0)
Zabbix processes may hang (ZBX-3788)
http://blog.zabbix.com/mysterious-zabbix-problems-how-we-debug-them
DebugLevel
0 - basic information about starting and stopping of
Zabbix processes
1 - critical information
2 - error information
3 - warnings
4 - for debugging (produces lots of information)
5 - extended debugging (produces even more
information)
Which One Is Sane?
Almost everybody runs at DebugLevel=3
Embedded devices – lower levels
DebugLevel=4 – if there are known problems
The Less Sane Ones
● 4 - for debugging (produces lots of information)
● 5 - extended debugging (produces even more
information)
But what's "lots of information" and "even more
information"?
DebugLevel 4
__zbx_zbx_setproctitle() title:'timer #1 [processed 1 triggers, 0
events in 0.006850 sec, 0 maintenances in 0.000000 sec,
processing maintenance periods]'
In process_maintenance()
query [txnlev:0] [select
m.maintenanceid,m.maintenance_type,m.active_since,tp.timeperiod
_type,tp.every,tp.month,tp.dayofweek,tp.day,tp.start_time,tp.period,tp
.start_date from maintenances m,maintenances_windows
mw,timeperiods tp where m.maintenanceid=mw.maintenanceid and
mw.timeperiodid=tp.timeperiodid and m.active_since<=1473415320
and m.active_till>1473415320]
In update_maintenance_hosts()
DebugLevel 5
DebugLevel=5 adds:
● Received page in webmonitoring
● Received XML in VMware monitoring
http://blog.zabbix.com/zabbix-2-4-features-part-8-debugging-web-and-vmware-monitoring
Runtime Loglevel Changing
Awesome (not just great)
In 2.4 – many upgraded
http://blog.zabbix.com/zabbix-2-4-features-part-6-runtime-loglevel-changing
Change Loglevel for...
Whole Zabbix
One Zabbix process type
Single Zabbix process (by pocess type & number)
Single Zabbix process (by PID)
Examples
zabbix_server --runtime-control log_level_increase
zabbix_server -R log_level_increase=poller
zabbix_server -R log_level_increase=trapper,3
zabbix_server -R log_level_increase=12345
Bash Completion
zabbix_server -R log_level_increase=[tab][tab]
alerter discoverer housekeeper ipmi poller proxy poller trapper
configuration syncer escalator http poller java poller self-monitoring unreachable poller
db watchdog history syncer icmp pinger poller timer vmware collector
Many Options
zabbix_get -[tab][tab]
-h -I -p --source-
address --tls-ca-file --tls-crl-file --tls-psk-identity
--help -k --port --tls-agent-
cert-issuer --tls-cert-file --tls-key-file -V
--host --key -s --tls-agent-
cert-subject --tls-connect --tls-psk-file --version
Want Bash Completion?
Ask your packager
https://github.com/zabbix/zabbix-bash-completion
BOOM-THANK-YOU

More Related Content

ODP
Kick-off Project 2: Presentatie Linux
Patrick Koning
 
PDF
Monit
guest4e4710
 
PDF
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016
Zabbix
 
PDF
Rihards Olups - Zabbix at Nokia - Case Study
Zabbix
 
PPT
Syslog.ppt
ifsharahmad
 
PDF
Trouble shoot with linux syslog
ashok191
 
PDF
[Python] Quick book for dell switch_os10
Jo Hoon
 
PPTX
Let the Tiger Roar!
MongoDB
 
Kick-off Project 2: Presentatie Linux
Patrick Koning
 
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016
Zabbix
 
Rihards Olups - Zabbix at Nokia - Case Study
Zabbix
 
Syslog.ppt
ifsharahmad
 
Trouble shoot with linux syslog
ashok191
 
[Python] Quick book for dell switch_os10
Jo Hoon
 
Let the Tiger Roar!
MongoDB
 

Similar to Rihards Olups - Zabbix log management (20)

PPTX
Hdlogger project 2014.Aug
捷恩 蔡
 
PPTX
Logging.pptxbjjjjbhhn bhnjnnnnnnnnnnnn
anshumankapooriitbco
 
PPT
Logback
Anubhav Shukla
 
PPTX
Graylog for open stack 3 steps to know why
Mạnh Đinh
 
PDF
Graylog for open stack 3 steps to know why
Vietnam Open Infrastructure User Group
 
PDF
Java Logging discussion Log4j,Slf4j
Rajiv Gupta
 
PDF
Php logging
Brent Laminack
 
PDF
Syslog Protocols
Martin Schütte
 
PPTX
1 booting process and software based solution
Urwa Shanza
 
PDF
Developer Fundamentals - Logging
Axel Irriger
 
PPTX
Logging from the bottom up
Francis Edwards
 
PDF
MongoDB 3.0 and WiredTiger (Event: An Evening with MongoDB Dallas 3/10/15)
MongoDB
 
PDF
Monitor all the things - Confoo
felixtrepanier
 
PDF
Top 10 Tricks and Tools of an Oracle EPM Administrator
nking821
 
PDF
Joblib PyDataParis2016
Alexandre Abadie
 
PDF
Joblib Toward efficient computing : from laptop to cloud
PyDataParis
 
ODP
Mastering InnoDB Diagnostics
guest8212a5
 
ODP
Harrison fisk masteringinnodb-diagnostics
guest8212a5
 
PPTX
Zarafa SummerCamp 2012 - Z-push 2.0 changes for administrators
Zarafa
 
Hdlogger project 2014.Aug
捷恩 蔡
 
Logging.pptxbjjjjbhhn bhnjnnnnnnnnnnnn
anshumankapooriitbco
 
Graylog for open stack 3 steps to know why
Mạnh Đinh
 
Graylog for open stack 3 steps to know why
Vietnam Open Infrastructure User Group
 
Java Logging discussion Log4j,Slf4j
Rajiv Gupta
 
Php logging
Brent Laminack
 
Syslog Protocols
Martin Schütte
 
1 booting process and software based solution
Urwa Shanza
 
Developer Fundamentals - Logging
Axel Irriger
 
Logging from the bottom up
Francis Edwards
 
MongoDB 3.0 and WiredTiger (Event: An Evening with MongoDB Dallas 3/10/15)
MongoDB
 
Monitor all the things - Confoo
felixtrepanier
 
Top 10 Tricks and Tools of an Oracle EPM Administrator
nking821
 
Joblib PyDataParis2016
Alexandre Abadie
 
Joblib Toward efficient computing : from laptop to cloud
PyDataParis
 
Mastering InnoDB Diagnostics
guest8212a5
 
Harrison fisk masteringinnodb-diagnostics
guest8212a5
 
Zarafa SummerCamp 2012 - Z-push 2.0 changes for administrators
Zarafa
 
Ad

More from Zabbix (20)

PDF
Zabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with Zabbix
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil Community
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Andre Deo - SNMP and Zabbix
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Rodrigo Mohr - Challenges on Large Env with Or...
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...
Zabbix
 
PDF
Zabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMP
Zabbix
 
PDF
Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016
Zabbix
 
PDF
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Zabbix
 
PDF
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Zabbix
 
PDF
Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016
Zabbix
 
PDF
Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016
Zabbix
 
PDF
Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...
Zabbix
 
PDF
Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016
Zabbix
 
PDF
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016
Zabbix
 
PDF
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016
Zabbix
 
PDF
Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016
Zabbix
 
PDF
Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016
Zabbix
 
Zabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with Zabbix
Zabbix
 
Zabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil Community
Zabbix
 
Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...
Zabbix
 
Zabbix Conference LatAm 2016 - Andre Deo - SNMP and Zabbix
Zabbix
 
Zabbix Conference LatAm 2016 - Rodrigo Mohr - Challenges on Large Env with Or...
Zabbix
 
Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...
Zabbix
 
Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...
Zabbix
 
Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...
Zabbix
 
Zabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMP
Zabbix
 
Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016
Zabbix
 
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Zabbix
 
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Zabbix
 
Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016
Zabbix
 
Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016
Zabbix
 
Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...
Zabbix
 
Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016
Zabbix
 
Mikhail Serkov - Zabbix for HPC Cluster Support | ZabConf2016
Zabbix
 
Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016
Zabbix
 
Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016
Zabbix
 
Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016
Zabbix
 
Ad

Recently uploaded (20)

PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PPTX
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PPTX
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PDF
Doc9.....................................
SofiaCollazos
 
PDF
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
PDF
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
PDF
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PDF
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
PDF
Trying to figure out MCP by actually building an app from scratch with open s...
Julien SIMON
 
PPTX
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
PPTX
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
PDF
Software Development Methodologies in 2025
KodekX
 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
PDF
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Dev Dives: Automate, test, and deploy in one place—with Unified Developer Exp...
AndreeaTom
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
Doc9.....................................
SofiaCollazos
 
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
Get More from Fiori Automation - What’s New, What Works, and What’s Next.pdf
Precisely
 
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
 
Trying to figure out MCP by actually building an app from scratch with open s...
Julien SIMON
 
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
Software Development Methodologies in 2025
KodekX
 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
Presentation about Hardware and Software in Computer
snehamodhawadiya
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 

Rihards Olups - Zabbix log management

  • 1. Zabbix Log Management Crash Course Running time: 50 minutes
  • 2. Configuring logging Pre-3.0 ● LogFile (if not set, syslog used) ● LogFileSize ● DebugLevel
  • 3. Configuring Logging in 3.0 3.0+ ● LogType – system/file/console ● LogFile (if LogType=file) ● LogFileSize ● DebugLevel
  • 5. Log-related Issues Each process opens logfile individually Holds two filedescriptors May keep deleted logfiles around (improved in 3.0) Zabbix processes may hang (ZBX-3788) http://blog.zabbix.com/mysterious-zabbix-problems-how-we-debug-them
  • 6. DebugLevel 0 - basic information about starting and stopping of Zabbix processes 1 - critical information 2 - error information 3 - warnings 4 - for debugging (produces lots of information) 5 - extended debugging (produces even more information)
  • 7. Which One Is Sane? Almost everybody runs at DebugLevel=3 Embedded devices – lower levels DebugLevel=4 – if there are known problems
  • 8. The Less Sane Ones ● 4 - for debugging (produces lots of information) ● 5 - extended debugging (produces even more information) But what's "lots of information" and "even more information"?
  • 9. DebugLevel 4 __zbx_zbx_setproctitle() title:'timer #1 [processed 1 triggers, 0 events in 0.006850 sec, 0 maintenances in 0.000000 sec, processing maintenance periods]' In process_maintenance() query [txnlev:0] [select m.maintenanceid,m.maintenance_type,m.active_since,tp.timeperiod _type,tp.every,tp.month,tp.dayofweek,tp.day,tp.start_time,tp.period,tp .start_date from maintenances m,maintenances_windows mw,timeperiods tp where m.maintenanceid=mw.maintenanceid and mw.timeperiodid=tp.timeperiodid and m.active_since<=1473415320 and m.active_till>1473415320] In update_maintenance_hosts()
  • 10. DebugLevel 5 DebugLevel=5 adds: ● Received page in webmonitoring ● Received XML in VMware monitoring http://blog.zabbix.com/zabbix-2-4-features-part-8-debugging-web-and-vmware-monitoring
  • 11. Runtime Loglevel Changing Awesome (not just great) In 2.4 – many upgraded http://blog.zabbix.com/zabbix-2-4-features-part-6-runtime-loglevel-changing
  • 12. Change Loglevel for... Whole Zabbix One Zabbix process type Single Zabbix process (by pocess type & number) Single Zabbix process (by PID)
  • 13. Examples zabbix_server --runtime-control log_level_increase zabbix_server -R log_level_increase=poller zabbix_server -R log_level_increase=trapper,3 zabbix_server -R log_level_increase=12345
  • 14. Bash Completion zabbix_server -R log_level_increase=[tab][tab] alerter discoverer housekeeper ipmi poller proxy poller trapper configuration syncer escalator http poller java poller self-monitoring unreachable poller db watchdog history syncer icmp pinger poller timer vmware collector
  • 15. Many Options zabbix_get -[tab][tab] -h -I -p --source- address --tls-ca-file --tls-crl-file --tls-psk-identity --help -k --port --tls-agent- cert-issuer --tls-cert-file --tls-key-file -V --host --key -s --tls-agent- cert-subject --tls-connect --tls-psk-file --version
  • 16. Want Bash Completion? Ask your packager https://github.com/zabbix/zabbix-bash-completion