SlideShare a Scribd company logo
Performance Vision and
Elastic Search / Hotrod
Brett Airey
September 2015
Products we use
What we do !
• Network Performance analysis.
• Application Performance analysis.
• Build Big Data Systems (Splunk & Hotrod)
• Troubleshooting IT incidents full stack.
• Manage and traffic-shape networks for
maximum performance. ( Bandwidth still
issue outside of major cities)
• Custom Logging pipeline for Clients
The Challenges
• Securactive - Technical Tool for the Tech’s
• Disparate systems all have own Reporting
• No Central point for Correlation and
Collaboration.
• Aggregation of Data , lose the ability to drill in
to the fine resolution in a reasonable time
period.
Need more transparency of key Metrics
The Dream for resolving Incidents
all stakeholders metrics in one place
Incident
COMMON TIME SERIES
NETWORK METRICS
ALL DEVICE ACCESS LOGS
CHANGE CONTROL EVENTS
SERVER RESOURCE METRICS
APPLICATION METRICS / LOGS
STORAGE PERFORMANCE METRICS
APM NPM (Securactive )
Why we believe tools like
Elasticsearch is the way
• Open-source (Important community for us)
• In memory searching, so it’s fast, scalable.
• Has proven performance.
• Hardware requirements low spec.
• Works well with Docker “ Micro Services”
How we are doing it
• HTML “API” into Securactive
• Program …..
• Import
• Naming convention - Std names ie Host,ipadd
• HOTROD “ Panoptix”
Why HotRod into Elasticsearch
• Authentication as standard.
• Reader app to track highwatermark.
• Alerting on variances to baseline.
• Limit user view through role based access.
• Loosley coupled, ability to change
components with relative ease.
So how does it all work..
I am sure in the future versions we will get
nicely formatted JSON.
Performance
Vision
Elastic DB
Hotrod/Elastic
Interface
How it all fits Together
Harvesting Data from Securactive
The Elasticsearch Query
HotRod RESTful endpoint (API)
Displaying the Chart
Screen Shots
Quick select periods and aggregation as well as Refresh
interval for Dashboards
Screen Shots
Visualise your key metrics
Screen Shots
Visualise your Data using the extensive graphs available
HotRod is Opensource
panoptix-za/HotRod ·
GitHub
Ad

Recommended

Workshop on CIFS / SMB Protocol Performance Analysis
Workshop on CIFS / SMB Protocol Performance Analysis
PerformanceVision (previously SecurActive)
 
Reduce Risk with End to End Monitoring of Middleware-based Applications
Reduce Risk with End to End Monitoring of Middleware-based Applications
SL Corporation
 
Enhanced Multisite Site Selection for Windows 10 and DirectAccess with KEMP L...
Enhanced Multisite Site Selection for Windows 10 and DirectAccess with KEMP L...
Kemp
 
REST vs. Messaging For Microservices
REST vs. Messaging For Microservices
Eberhard Wolff
 
Resilience from Theory to Practice
Resilience from Theory to Practice
LivePerson
 
Tips for Optimizing Web Performance
Tips for Optimizing Web Performance
ThousandEyes
 
Microservices in the Apache Kafka Ecosystem
Microservices in the Apache Kafka Ecosystem
confluent
 
Service Discovery with Consul
Service Discovery with Consul
Ali Demirsoy
 
Microservices: Breaking Apart the Monolith
Microservices: Breaking Apart the Monolith
Iron.io
 
In the Spotlight WSO2 App Factory
In the Spotlight WSO2 App Factory
WSO2
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
Synapse360
 
[WSO2Con EU 2017] Writing Microservices Using MSF4J
[WSO2Con EU 2017] Writing Microservices Using MSF4J
WSO2
 
Presentation network design and security for your v mware view deployment w...
Presentation network design and security for your v mware view deployment w...
solarisyourep
 
Digital Transformation through Open Software Defined Infrastructure
Digital Transformation through Open Software Defined Infrastructure
Open Networking Summit
 
WSO2Con US 2013 - Connected Business - making it happen
WSO2Con US 2013 - Connected Business - making it happen
WSO2
 
Micro Services Architecture
Micro Services Architecture
Ranjan Baisak
 
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Nagarro
 
Turning client-side-to-server-side-ruxcon-2011-laurent
Turning client-side-to-server-side-ruxcon-2011-laurent
lgandx
 
Complex End-to-End Testing
Complex End-to-End Testing
Erika Barron
 
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
HostedbyConfluent
 
Dynatrace
Dynatrace
Purnima Kurella
 
Wso2 in action
Wso2 in action
Bui Kiet
 
Service mesh in Microservice World to Manage end to end service communications
Service mesh in Microservice World to Manage end to end service communications
Satya Syam
 
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
HostedbyConfluent
 
IBM Datapower Gateways - Devops with UrbanCode Deploy
IBM Datapower Gateways - Devops with UrbanCode Deploy
Jared Putman
 
[WSO2Con EU 2017] Container-native Architecture
[WSO2Con EU 2017] Container-native Architecture
WSO2
 
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
WSO2
 
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
New Relic
 
Elastic in oil and gas
Elastic in oil and gas
Diego Escobar
 
Tagthiscarslidedeck
Tagthiscarslidedeck
tagthiscar
 

More Related Content

What's hot (20)

Microservices: Breaking Apart the Monolith
Microservices: Breaking Apart the Monolith
Iron.io
 
In the Spotlight WSO2 App Factory
In the Spotlight WSO2 App Factory
WSO2
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
Synapse360
 
[WSO2Con EU 2017] Writing Microservices Using MSF4J
[WSO2Con EU 2017] Writing Microservices Using MSF4J
WSO2
 
Presentation network design and security for your v mware view deployment w...
Presentation network design and security for your v mware view deployment w...
solarisyourep
 
Digital Transformation through Open Software Defined Infrastructure
Digital Transformation through Open Software Defined Infrastructure
Open Networking Summit
 
WSO2Con US 2013 - Connected Business - making it happen
WSO2Con US 2013 - Connected Business - making it happen
WSO2
 
Micro Services Architecture
Micro Services Architecture
Ranjan Baisak
 
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Nagarro
 
Turning client-side-to-server-side-ruxcon-2011-laurent
Turning client-side-to-server-side-ruxcon-2011-laurent
lgandx
 
Complex End-to-End Testing
Complex End-to-End Testing
Erika Barron
 
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
HostedbyConfluent
 
Dynatrace
Dynatrace
Purnima Kurella
 
Wso2 in action
Wso2 in action
Bui Kiet
 
Service mesh in Microservice World to Manage end to end service communications
Service mesh in Microservice World to Manage end to end service communications
Satya Syam
 
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
HostedbyConfluent
 
IBM Datapower Gateways - Devops with UrbanCode Deploy
IBM Datapower Gateways - Devops with UrbanCode Deploy
Jared Putman
 
[WSO2Con EU 2017] Container-native Architecture
[WSO2Con EU 2017] Container-native Architecture
WSO2
 
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
WSO2
 
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
New Relic
 
Microservices: Breaking Apart the Monolith
Microservices: Breaking Apart the Monolith
Iron.io
 
In the Spotlight WSO2 App Factory
In the Spotlight WSO2 App Factory
WSO2
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
Synapse360
 
[WSO2Con EU 2017] Writing Microservices Using MSF4J
[WSO2Con EU 2017] Writing Microservices Using MSF4J
WSO2
 
Presentation network design and security for your v mware view deployment w...
Presentation network design and security for your v mware view deployment w...
solarisyourep
 
Digital Transformation through Open Software Defined Infrastructure
Digital Transformation through Open Software Defined Infrastructure
Open Networking Summit
 
WSO2Con US 2013 - Connected Business - making it happen
WSO2Con US 2013 - Connected Business - making it happen
WSO2
 
Micro Services Architecture
Micro Services Architecture
Ranjan Baisak
 
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Nagarro
 
Turning client-side-to-server-side-ruxcon-2011-laurent
Turning client-side-to-server-side-ruxcon-2011-laurent
lgandx
 
Complex End-to-End Testing
Complex End-to-End Testing
Erika Barron
 
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
Kubernetes Connectivity to Cloud Native Kafka | Christina Lin and Evan Shorti...
HostedbyConfluent
 
Wso2 in action
Wso2 in action
Bui Kiet
 
Service mesh in Microservice World to Manage end to end service communications
Service mesh in Microservice World to Manage end to end service communications
Satya Syam
 
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
Data Mess to Data Mesh | Jay Kreps, CEO, Confluent | Kafka Summit Americas 20...
HostedbyConfluent
 
IBM Datapower Gateways - Devops with UrbanCode Deploy
IBM Datapower Gateways - Devops with UrbanCode Deploy
Jared Putman
 
[WSO2Con EU 2017] Container-native Architecture
[WSO2Con EU 2017] Container-native Architecture
WSO2
 
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
[WSO2Con EU 2017] WSO2 Unleashed: Full Stack Automation, Pitfalls and Solutions
WSO2
 
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
Customer Driven DevOps at Work: Operating the Digital Turnstile [FutureStack1...
New Relic
 

Similar to How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data (20)

Elastic in oil and gas
Elastic in oil and gas
Diego Escobar
 
Tagthiscarslidedeck
Tagthiscarslidedeck
tagthiscar
 
Elastic Search Capability Presentation.pptx
Elastic Search Capability Presentation.pptx
Knoldus Inc.
 
03-NOV-1510-Ognjen-Antonic-Telemach-stream-1
03-NOV-1510-Ognjen-Antonic-Telemach-stream-1
Ognjen Antonic
 
BigData Search Simplified with ElasticSearch
BigData Search Simplified with ElasticSearch
TO THE NEW | Technology
 
Elastic Observability keynote
Elastic Observability keynote
Elasticsearch
 
Regina Pison - Elastic - OSL19
Regina Pison - Elastic - OSL19
marketingsyone
 
Building for, perceiving and measuring performance for mobile web
Building for, perceiving and measuring performance for mobile web
Robin Glen
 
Managed Search: Presented by Jacob Graves, Getty Images
Managed Search: Presented by Jacob Graves, Getty Images
Lucidworks
 
Keynote: Making search better, faster, easier
Keynote: Making search better, faster, easier
Elasticsearch
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?
Elasticsearch
 
Monitoring modern applications using Elastic
Monitoring modern applications using Elastic
Elasticsearch
 
Using Elasticsearch for Analytics
Using Elasticsearch for Analytics
Vaidik Kapoor
 
Deliver great user experiences with RUM and synthetic monitoring
Deliver great user experiences with RUM and synthetic monitoring
Elasticsearch
 
What's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releases
Elasticsearch
 
Elasticsearch features and ecosystem
Elasticsearch features and ecosystem
Pavel Alexeev
 
Performance Measurement and Monitoring for Salesforce Web & Mobile Apps
Performance Measurement and Monitoring for Salesforce Web & Mobile Apps
Salesforce Developers
 
Varnishing Search Perfromance
Varnishing Search Perfromance
Volkan Yazıcı
 
SF ElasticSearch Meetup 2013.04.06 - Monitoring
SF ElasticSearch Meetup 2013.04.06 - Monitoring
Sushant Shankar
 
Elastic Security Brochure
Elastic Security Brochure
Joseph DeFever
 
Elastic in oil and gas
Elastic in oil and gas
Diego Escobar
 
Tagthiscarslidedeck
Tagthiscarslidedeck
tagthiscar
 
Elastic Search Capability Presentation.pptx
Elastic Search Capability Presentation.pptx
Knoldus Inc.
 
03-NOV-1510-Ognjen-Antonic-Telemach-stream-1
03-NOV-1510-Ognjen-Antonic-Telemach-stream-1
Ognjen Antonic
 
BigData Search Simplified with ElasticSearch
BigData Search Simplified with ElasticSearch
TO THE NEW | Technology
 
Elastic Observability keynote
Elastic Observability keynote
Elasticsearch
 
Regina Pison - Elastic - OSL19
Regina Pison - Elastic - OSL19
marketingsyone
 
Building for, perceiving and measuring performance for mobile web
Building for, perceiving and measuring performance for mobile web
Robin Glen
 
Managed Search: Presented by Jacob Graves, Getty Images
Managed Search: Presented by Jacob Graves, Getty Images
Lucidworks
 
Keynote: Making search better, faster, easier
Keynote: Making search better, faster, easier
Elasticsearch
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?
Elasticsearch
 
Monitoring modern applications using Elastic
Monitoring modern applications using Elastic
Elasticsearch
 
Using Elasticsearch for Analytics
Using Elasticsearch for Analytics
Vaidik Kapoor
 
Deliver great user experiences with RUM and synthetic monitoring
Deliver great user experiences with RUM and synthetic monitoring
Elasticsearch
 
What's new at Elastic: Update on major initiatives and releases
What's new at Elastic: Update on major initiatives and releases
Elasticsearch
 
Elasticsearch features and ecosystem
Elasticsearch features and ecosystem
Pavel Alexeev
 
Performance Measurement and Monitoring for Salesforce Web & Mobile Apps
Performance Measurement and Monitoring for Salesforce Web & Mobile Apps
Salesforce Developers
 
Varnishing Search Perfromance
Varnishing Search Perfromance
Volkan Yazıcı
 
SF ElasticSearch Meetup 2013.04.06 - Monitoring
SF ElasticSearch Meetup 2013.04.06 - Monitoring
Sushant Shankar
 
Elastic Security Brochure
Elastic Security Brochure
Joseph DeFever
 
Ad

More from PerformanceVision (previously SecurActive) (15)

Presentation of Performance Vision Version 3.3
Presentation of Performance Vision Version 3.3
PerformanceVision (previously SecurActive)
 
Concrete use cases of SQL Performance Analysis
Concrete use cases of SQL Performance Analysis
PerformanceVision (previously SecurActive)
 
HTTP Application Performance Analysis
HTTP Application Performance Analysis
PerformanceVision (previously SecurActive)
 
What's new in Performance vision version 3.2
What's new in Performance vision version 3.2
PerformanceVision (previously SecurActive)
 
Performance vision Version 3.0 - What's New
Performance vision Version 3.0 - What's New
PerformanceVision (previously SecurActive)
 
What's new in Performance Vision version 2.18
What's new in Performance Vision version 2.18
PerformanceVision (previously SecurActive)
 
Network & Application Performance Monitoring - Troubleshooting HTTP Applicati...
Network & Application Performance Monitoring - Troubleshooting HTTP Applicati...
PerformanceVision (previously SecurActive)
 
HTTP Application Performance Analysis
HTTP Application Performance Analysis
PerformanceVision (previously SecurActive)
 
Performance vision Version 2.15 news
Performance vision Version 2.15 news
PerformanceVision (previously SecurActive)
 
Présentation N&APM en environnement hospitalier (CH Laborit)
Présentation N&APM en environnement hospitalier (CH Laborit)
PerformanceVision (previously SecurActive)
 
Performance Vision - What's new in version 2.9
Performance Vision - What's new in version 2.9
PerformanceVision (previously SecurActive)
 
Gestion des performances applicatives en environnement Cloud et Virtualisation
Gestion des performances applicatives en environnement Cloud et Virtualisation
PerformanceVision (previously SecurActive)
 
Workshop APM in a Cloud & Virtualized environment
Workshop APM in a Cloud & Virtualized environment
PerformanceVision (previously SecurActive)
 
Présentation de Performance Vision en 2 minutes
Présentation de Performance Vision en 2 minutes
PerformanceVision (previously SecurActive)
 
2 minute presentation of Performance Vision
2 minute presentation of Performance Vision
PerformanceVision (previously SecurActive)
 
Network & Application Performance Monitoring - Troubleshooting HTTP Applicati...
Network & Application Performance Monitoring - Troubleshooting HTTP Applicati...
PerformanceVision (previously SecurActive)
 
Gestion des performances applicatives en environnement Cloud et Virtualisation
Gestion des performances applicatives en environnement Cloud et Virtualisation
PerformanceVision (previously SecurActive)
 
Ad

Recently uploaded (20)

Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Safe Software
 
PyCon SG 25 - Firecracker Made Easy with Python.pdf
PyCon SG 25 - Firecracker Made Easy with Python.pdf
Muhammad Yuga Nugraha
 
OpenACC and Open Hackathons Monthly Highlights June 2025
OpenACC and Open Hackathons Monthly Highlights June 2025
OpenACC
 
OpenPOWER Foundation & Open-Source Core Innovations
OpenPOWER Foundation & Open-Source Core Innovations
IBM
 
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model Library
PetraVukmirovic
 
Lessons Learned from Developing Secure AI Workflows.pdf
Lessons Learned from Developing Secure AI Workflows.pdf
Priyanka Aash
 
10 Key Challenges for AI within the EU Data Protection Framework.pdf
10 Key Challenges for AI within the EU Data Protection Framework.pdf
Priyanka Aash
 
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik
 
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
Priyanka Aash
 
2025_06_18 - OpenMetadata Community Meeting.pdf
2025_06_18 - OpenMetadata Community Meeting.pdf
OpenMetadata
 
"Database isolation: how we deal with hundreds of direct connections to the d...
"Database isolation: how we deal with hundreds of direct connections to the d...
Fwdays
 
Enhance GitHub Copilot using MCP - Enterprise version.pdf
Enhance GitHub Copilot using MCP - Enterprise version.pdf
Nilesh Gule
 
EIS-Webinar-Engineering-Retail-Infrastructure-06-16-2025.pdf
EIS-Webinar-Engineering-Retail-Infrastructure-06-16-2025.pdf
Earley Information Science
 
"Scaling in space and time with Temporal", Andriy Lupa.pdf
"Scaling in space and time with Temporal", Andriy Lupa.pdf
Fwdays
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine Learning
Safe Software
 
Securing Account Lifecycles in the Age of Deepfakes.pptx
Securing Account Lifecycles in the Age of Deepfakes.pptx
FIDO Alliance
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?
Shashi Sathyanarayana, Ph.D
 
Daily Lesson Log MATATAG ICT TEchnology 8
Daily Lesson Log MATATAG ICT TEchnology 8
LOIDAALMAZAN3
 
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Safe Software
 
PyCon SG 25 - Firecracker Made Easy with Python.pdf
PyCon SG 25 - Firecracker Made Easy with Python.pdf
Muhammad Yuga Nugraha
 
OpenACC and Open Hackathons Monthly Highlights June 2025
OpenACC and Open Hackathons Monthly Highlights June 2025
OpenACC
 
OpenPOWER Foundation & Open-Source Core Innovations
OpenPOWER Foundation & Open-Source Core Innovations
IBM
 
OWASP Barcelona 2025 Threat Model Library
OWASP Barcelona 2025 Threat Model Library
PetraVukmirovic
 
Lessons Learned from Developing Secure AI Workflows.pdf
Lessons Learned from Developing Secure AI Workflows.pdf
Priyanka Aash
 
10 Key Challenges for AI within the EU Data Protection Framework.pdf
10 Key Challenges for AI within the EU Data Protection Framework.pdf
Priyanka Aash
 
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik - Passionate Tech Enthusiast
Raman Bhaumik
 
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
A Constitutional Quagmire - Ethical Minefields of AI, Cyber, and Privacy.pdf
Priyanka Aash
 
2025_06_18 - OpenMetadata Community Meeting.pdf
2025_06_18 - OpenMetadata Community Meeting.pdf
OpenMetadata
 
"Database isolation: how we deal with hundreds of direct connections to the d...
"Database isolation: how we deal with hundreds of direct connections to the d...
Fwdays
 
Enhance GitHub Copilot using MCP - Enterprise version.pdf
Enhance GitHub Copilot using MCP - Enterprise version.pdf
Nilesh Gule
 
EIS-Webinar-Engineering-Retail-Infrastructure-06-16-2025.pdf
EIS-Webinar-Engineering-Retail-Infrastructure-06-16-2025.pdf
Earley Information Science
 
"Scaling in space and time with Temporal", Andriy Lupa.pdf
"Scaling in space and time with Temporal", Andriy Lupa.pdf
Fwdays
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine Learning
Safe Software
 
Securing Account Lifecycles in the Age of Deepfakes.pptx
Securing Account Lifecycles in the Age of Deepfakes.pptx
FIDO Alliance
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
AI vs Human Writing: Can You Tell the Difference?
AI vs Human Writing: Can You Tell the Difference?
Shashi Sathyanarayana, Ph.D
 
Daily Lesson Log MATATAG ICT TEchnology 8
Daily Lesson Log MATATAG ICT TEchnology 8
LOIDAALMAZAN3
 

How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data

  • 1. Performance Vision and Elastic Search / Hotrod Brett Airey September 2015
  • 3. What we do ! • Network Performance analysis. • Application Performance analysis. • Build Big Data Systems (Splunk & Hotrod) • Troubleshooting IT incidents full stack. • Manage and traffic-shape networks for maximum performance. ( Bandwidth still issue outside of major cities) • Custom Logging pipeline for Clients
  • 4. The Challenges • Securactive - Technical Tool for the Tech’s • Disparate systems all have own Reporting • No Central point for Correlation and Collaboration. • Aggregation of Data , lose the ability to drill in to the fine resolution in a reasonable time period. Need more transparency of key Metrics
  • 5. The Dream for resolving Incidents all stakeholders metrics in one place Incident COMMON TIME SERIES NETWORK METRICS ALL DEVICE ACCESS LOGS CHANGE CONTROL EVENTS SERVER RESOURCE METRICS APPLICATION METRICS / LOGS STORAGE PERFORMANCE METRICS APM NPM (Securactive )
  • 6. Why we believe tools like Elasticsearch is the way • Open-source (Important community for us) • In memory searching, so it’s fast, scalable. • Has proven performance. • Hardware requirements low spec. • Works well with Docker “ Micro Services”
  • 7. How we are doing it • HTML “API” into Securactive • Program ….. • Import • Naming convention - Std names ie Host,ipadd • HOTROD “ Panoptix”
  • 8. Why HotRod into Elasticsearch • Authentication as standard. • Reader app to track highwatermark. • Alerting on variances to baseline. • Limit user view through role based access. • Loosley coupled, ability to change components with relative ease.
  • 9. So how does it all work.. I am sure in the future versions we will get nicely formatted JSON. Performance Vision Elastic DB Hotrod/Elastic Interface
  • 10. How it all fits Together
  • 11. Harvesting Data from Securactive
  • 15. Screen Shots Quick select periods and aggregation as well as Refresh interval for Dashboards
  • 17. Screen Shots Visualise your Data using the extensive graphs available