SlideShare a Scribd company logo
How to Achieve Success With
Application Performance Monitoring Initiatives

                             Rodney Morrison
                                 VP, Products
                               SL Corporation
Agenda

   Definition and Objectives of APM
   Analyst Breakdown of the APM Solution Space
   Challenges to Success
   Coming Advancements in APM
   An Investment Bank Use Case
What is APM?

 APM refers to the discipline within systems
  management that focuses on monitoring and
  managing the performance and service
  availability of software applications.

 The two main sources of information for proper
  application management are resources and user
  experience.
Factors Driving APM Initiatives

 Complexity of applications increasing dramatically
 Cost estimations of application downtimes are
  more frequently calculated and on the rise
 High severity incidents on the rise
 MTTR is often 30 minutes to 3 hours in even the
  most critical application areas
The Perfect Storm
 Best practices for change control have created
  operational silos
 Events geared more for operational management
  are passed to application support teams from all
  silos
 Each technology stack requires expertise and
  training in administrative and monitoring tools

Result
 High level of noisy, uncorrelated events make
  proactive application management impossible
 Lack of centralized access to data and
  performance history leads to lengthy triage for
  resolution
APM Breakdown – The Analyst’s Vision

   End-user experience monitoring
   Runtime architecture discovery
   Transaction monitoring
   Component deep-dive monitoring
   Performance Analytics
Usage of Management Tools Evolves With Complexity
The Missing Gap

 Centralized console
  for all performance
  data
 Summary views
  relevant to
  applications and
  services
 Application-centric event filtering and correlation
 Historical views of performance metrics for
  baselining and event analysis
Advanced APM

 Analytics engines for discovering performance
  patterns
 Automation – Command and Control
IT Challenges for APM Initiatives
  Reduce incidents and time to repair with very
   specific application visibility requirements
     Emphasis on root cause
  Analysis Tools detailing application
   performance for preventative care and
   capacity planning
  To support line-of-business visibility into
   application availability, performance, the risk
   associated with that performance, and SLA
   monitoring
  To standardize on a common delivery platform
   for application support to reduce operation
   costs
Best Practices for APM Delivery and Maintenance


   Create a team  Specifically tasked with APM
   Define           Skills: Basic knowledge of
                       applications, underlying
   Measure
                       infrastructure, software
   Analyze
                       components and architectures,
   Improve
                       and can liaise with business and
   Control            development
Best Practices for APM Delivery and Maintenance


   Create a team    Choose initial critical

   Define            applications
                     Gather requirements
   Measure
                     Gather all relevant and
   Analyze
                      accessible performance metrics
   Improve
                     Choose tool sets
   Control
Best Practices for APM Delivery and Maintenance


   Create a team    Aggregate metrics and create
   Define            baseline

   Measure          Determine initial rule sets and
                      thresholds
   Analyze
                     Configure summary views and
   Improve
                      drill down per defined role
   Control
Best Practices for APM Delivery and Maintenance


   Create a team    Iterate with key stakeholders
   Define           Verify that the information is
   Measure           correct, and pertinent to role
                      activities
   Analyze
                     Practice scenarios to verify that
   Improve
                      discovery and drill down to
   Control
                      analysis or root cause is optimal
                      per role
Best Practices for APM Delivery and Maintenance


   Create a team    Track MTTR improvements
   Define           Determine repair activities
   Measure           performed outside of the APM

   Analyze           solution, can they be
                      automated?
   Improve
                     Are there other metrics or
   Control
                      correlations that need to be
                      included to capture outlier
                      events?
Best Practices for APM Delivery and Maintenance


   Create a team    Tweak thresholds to optimize
   Define            alerts

   Measure          Add any new important metrics

   Analyze           or correlations

   Improve          Add automated responses
                     Add new important applications
   Control
Case Study:
One of the World’s Largest Financial Institutions
Case Study:
 One of the World’s Largest Financial Institutions

Real World Best Practices

 Designate main support team and determine roll-out plan
 Choose application group or initial critical applications for
  implementation
 Determine user roles exec/application support/tech support
 Determine application architectures
 Determine available monitoring systems and sources of
  performance data
 Work with technology support teams and determine agents/no
  agent technology
 Determine dashboard templates to create consistent company-
  wide standards
 Move to next app group or let app support teams build out
Case Study:
One of the World’s Largest Financial Institutions
Alert Summary
Composite Objects of Underlying Data
Alerting in Context of Process Flow
Technology Summaries - Web Server Farms
Detail JMS Server
WebLogic Server Metrics
Data Grid Utilization
Detail – JMS Destinations
JVM Metrics
ROI

 Total benefit
   – Reduction in outages = reduction in…
      •   Idle labor
      •   Loss of business
      •   Penalties for unmet SLAs/JIT agreements
      •   Loss of discounts for early payments
      •   Penalties for late payments
      •   Cost of idle equipment/telecommunications
      •   Cost of facilities
      •   Cost of recovery
      •   Cost of damage to perceived customer service
      •   Cost of damage to brand perception

   – Improved productivity
   – Reduced complexity – faster training of new employees
   – Capacity planning
 $35.7MM in Year 1
Conclusion

 The enterprise IT environment is becoming
  exponentially more complex
 Multiple disparate unconnected
  monitoring solutions are
  only adding to the complex-
  ity and management costs.
 End to End APM solutions
  are not only viable but
  have already been proven
  to deliver great benefits
Questions?

More Related Content

PPT
Rational Quality Manager af Lars Stensig Olesen, IBM Danmark
PPT
Collaborative Quality Management
PPTX
Applicability of CMMI for Small to Medium Enterprises
PPT
AIIM and ECM 0707
PDF
Whitepaper:Barriers to Effective and Strategic SPM Compensation
PPT
Relgo networks reviews (erp) systems
PPT
The True Costs and Benefits of CMMI Level 5
PPTX
Six sigma difference b/w DMAIC & DMADV
Rational Quality Manager af Lars Stensig Olesen, IBM Danmark
Collaborative Quality Management
Applicability of CMMI for Small to Medium Enterprises
AIIM and ECM 0707
Whitepaper:Barriers to Effective and Strategic SPM Compensation
Relgo networks reviews (erp) systems
The True Costs and Benefits of CMMI Level 5
Six sigma difference b/w DMAIC & DMADV

What's hot (15)

PPT
QM-007-Design for 6 sigma
PPTX
Erp implementation approaches.
PDF
Software QA Metrics Dashboard Benchmarking
PDF
Design & Process FMEA Manual
PPTX
Webinar | APM Best Practices - Effectively managing the safety lifecycle
PDF
Erp governance methodology and case studies v rjt
PPT
Failure mode and effects analysis
PDF
IRJET- Agile Management in Construction Industry
PPTX
How to Instill a Culture of Reliability - "The Big Bang"
PPT
ERP implementation
PPTX
Getting to Know Enterprise Content Management (ECM) and How It Can Help You
PPTX
SharePoint 2013 ECM & Methodology
PPT
PPM STUDIO for CMMI
PDF
Sap test center of excellence
PPT
QM-007-Design for 6 sigma
Erp implementation approaches.
Software QA Metrics Dashboard Benchmarking
Design & Process FMEA Manual
Webinar | APM Best Practices - Effectively managing the safety lifecycle
Erp governance methodology and case studies v rjt
Failure mode and effects analysis
IRJET- Agile Management in Construction Industry
How to Instill a Culture of Reliability - "The Big Bang"
ERP implementation
Getting to Know Enterprise Content Management (ECM) and How It Can Help You
SharePoint 2013 ECM & Methodology
PPM STUDIO for CMMI
Sap test center of excellence
Ad

Viewers also liked (20)

PPTX
Comparison of self portraits by hogarth and reynolds
PDF
Oracle Application Performance Monitoring Cloud Service Omc apm data_sheet
PPTX
CA Application Performance Management - Julio 2015
PPTX
My Application is Slow | Best Practices for Troubleshooting and Prevention
PDF
Managing and Monitoring Application Performance
PPTX
Application Performance Monitoring (APM)
PPTX
A Modern Approach to Performance Monitoring
PPTX
Application Performance Management 9.30 HPE whats new | 360 View
PPT
App Dynamics
PPT
Application Performance Monitoring
PDF
What is Application Performance Management?
PPTX
Docker/DevOps Meetup: Metrics-Driven Continuous Performance and Scalabilty
PDF
Finding Transition States Algorithmically for Automatic Reaction Mechanism Ge...
PPTX
Tata Teleservices Login Process for IPS and PRI
PDF
אקטיביזם תקשורתי
PDF
Introduction to Beanstalk Giving
PDF
TUCON 2011- Identifying and resolving Middleware Issues 4x faster at 1/5th th...
PDF
2010 2015年中国厨具行业投资分析及前景预测报告-简版报告
DOCX
Syllabus comm 3190 01.spring 2012
PDF
AIChE 2011 - Automatic Reaction Mechanism Generation with Group Additive Kine...
Comparison of self portraits by hogarth and reynolds
Oracle Application Performance Monitoring Cloud Service Omc apm data_sheet
CA Application Performance Management - Julio 2015
My Application is Slow | Best Practices for Troubleshooting and Prevention
Managing and Monitoring Application Performance
Application Performance Monitoring (APM)
A Modern Approach to Performance Monitoring
Application Performance Management 9.30 HPE whats new | 360 View
App Dynamics
Application Performance Monitoring
What is Application Performance Management?
Docker/DevOps Meetup: Metrics-Driven Continuous Performance and Scalabilty
Finding Transition States Algorithmically for Automatic Reaction Mechanism Ge...
Tata Teleservices Login Process for IPS and PRI
אקטיביזם תקשורתי
Introduction to Beanstalk Giving
TUCON 2011- Identifying and resolving Middleware Issues 4x faster at 1/5th th...
2010 2015年中国厨具行业投资分析及前景预测报告-简版报告
Syllabus comm 3190 01.spring 2012
AIChE 2011 - Automatic Reaction Mechanism Generation with Group Additive Kine...
Ad

Similar to TradeTech Architecture 2011 - Rodney Morrison, How to Achieve Success with Application Performance Monitoring Initiatives (20)

PDF
APM Center of Excellence Drives Improved Business Results at Itau Unibanco
PDF
Accelerating Your Mastery of APM Through Skills Self-Analysis - AppSphere16
PDF
Why not let apm do all the heavy lifting beyond the basics of monitoring | Sw...
PDF
How the Big Data of APM can Supercharge DevOps
PDF
Infrastructure and APM Approach and Framework v.3
PPTX
ManageEngine - Forrester Webinar: Maximize your application performance to en...
PPTX
Why you need Application Performance Monitoring
PPT
2011 sept 13 performance webinar with notes (5b)
DOC
Performance management network
PDF
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...
PDF
Introducing the E.P.I.C. APM: Stimulate User-Loyalty and Differentiation
PPTX
Finding application problems before they impact users
PDF
CA PPM Rationalizaiton
PPTX
Application Performance Monitoring from end user to Oracle Java Cloud Service...
PDF
Vendor Analysis Template
PPTX
Why Do You Need a Monitoring Tool for Application Performance.pptx
PDF
Ibm itsm portfolio
PPTX
The Need for AppOps in the Dynamic Data Center and Cloud
PPTX
The Business Justification for APM
PDF
Webinar - Is your Web Application Performance Doomed?
APM Center of Excellence Drives Improved Business Results at Itau Unibanco
Accelerating Your Mastery of APM Through Skills Self-Analysis - AppSphere16
Why not let apm do all the heavy lifting beyond the basics of monitoring | Sw...
How the Big Data of APM can Supercharge DevOps
Infrastructure and APM Approach and Framework v.3
ManageEngine - Forrester Webinar: Maximize your application performance to en...
Why you need Application Performance Monitoring
2011 sept 13 performance webinar with notes (5b)
Performance management network
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...
Introducing the E.P.I.C. APM: Stimulate User-Loyalty and Differentiation
Finding application problems before they impact users
CA PPM Rationalizaiton
Application Performance Monitoring from end user to Oracle Java Cloud Service...
Vendor Analysis Template
Why Do You Need a Monitoring Tool for Application Performance.pptx
Ibm itsm portfolio
The Need for AppOps in the Dynamic Data Center and Cloud
The Business Justification for APM
Webinar - Is your Web Application Performance Doomed?

More from SL Corporation (20)

PPTX
SL: Maximize your Middleware Uptime - From TIBCO BusinessWorks to Apache Kafk...
PPTX
What’s New and Exciting with RTView and TIBCO Middleware Monitoring
PPTX
Reduce Risk with End to End Monitoring of Middleware-based Applications
PPTX
Complete, Empowered and Focused. Be the IT Superhero.
PPTX
Tibco NOW San Diego 2017 RTView Breakout session
PPTX
Need Middleware Monitoring? Build a Better Business Case.
PPTX
Find the REAL culprit behind your TIBCO performance issues
PPTX
10 Tips for Better BusinessEvents Monitoring
PPTX
The All-in-One TIBCO Monitor, Correlating Performance Across TIBCO Technologi...
PDF
10 EMS MONITORING TIPS IN 30 MINUTES BEST PRACTICES FROM TIBCO EMS PROFESSIO...
PPTX
Give ‘Em What They Want! Self-Service Middleware Monitoring in a Shared Servi...
PDF
Coherence monitoring 101
PDF
What's New in RTView Core 6.5
PDF
Introducing RTView Enterprise Monitor 1.5
PDF
Redefining End-to-End Monitoring: Service Model Integration
PDF
Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...
PDF
Climb Out of Your Monitoring Silo – Enable Real End-to-End Visibility for You...
PDF
Real-Time Coherence Monitoring in Integrated Environments
PPTX
Sl virtual apps-131106
PPTX
TUCON 2013
SL: Maximize your Middleware Uptime - From TIBCO BusinessWorks to Apache Kafk...
What’s New and Exciting with RTView and TIBCO Middleware Monitoring
Reduce Risk with End to End Monitoring of Middleware-based Applications
Complete, Empowered and Focused. Be the IT Superhero.
Tibco NOW San Diego 2017 RTView Breakout session
Need Middleware Monitoring? Build a Better Business Case.
Find the REAL culprit behind your TIBCO performance issues
10 Tips for Better BusinessEvents Monitoring
The All-in-One TIBCO Monitor, Correlating Performance Across TIBCO Technologi...
10 EMS MONITORING TIPS IN 30 MINUTES BEST PRACTICES FROM TIBCO EMS PROFESSIO...
Give ‘Em What They Want! Self-Service Middleware Monitoring in a Shared Servi...
Coherence monitoring 101
What's New in RTView Core 6.5
Introducing RTView Enterprise Monitor 1.5
Redefining End-to-End Monitoring: Service Model Integration
Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...
Climb Out of Your Monitoring Silo – Enable Real End-to-End Visibility for You...
Real-Time Coherence Monitoring in Integrated Environments
Sl virtual apps-131106
TUCON 2013

Recently uploaded (20)

PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
August Patch Tuesday
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Encapsulation theory and applications.pdf
PPTX
Spectroscopy.pptx food analysis technology
PPTX
TLE Review Electricity (Electricity).pptx
MIND Revenue Release Quarter 2 2025 Press Release
Network Security Unit 5.pdf for BCA BBA.
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Programs and apps: productivity, graphics, security and other tools
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Accuracy of neural networks in brain wave diagnosis of schizophrenia
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Unlocking AI with Model Context Protocol (MCP)
August Patch Tuesday
Reach Out and Touch Someone: Haptics and Empathic Computing
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Assigned Numbers - 2025 - Bluetooth® Document
Univ-Connecticut-ChatGPT-Presentaion.pdf
Group 1 Presentation -Planning and Decision Making .pptx
OMC Textile Division Presentation 2021.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Encapsulation_ Review paper, used for researhc scholars
Encapsulation theory and applications.pdf
Spectroscopy.pptx food analysis technology
TLE Review Electricity (Electricity).pptx

TradeTech Architecture 2011 - Rodney Morrison, How to Achieve Success with Application Performance Monitoring Initiatives

  • 1. How to Achieve Success With Application Performance Monitoring Initiatives Rodney Morrison VP, Products SL Corporation
  • 2. Agenda  Definition and Objectives of APM  Analyst Breakdown of the APM Solution Space  Challenges to Success  Coming Advancements in APM  An Investment Bank Use Case
  • 3. What is APM?  APM refers to the discipline within systems management that focuses on monitoring and managing the performance and service availability of software applications.  The two main sources of information for proper application management are resources and user experience.
  • 4. Factors Driving APM Initiatives  Complexity of applications increasing dramatically  Cost estimations of application downtimes are more frequently calculated and on the rise  High severity incidents on the rise  MTTR is often 30 minutes to 3 hours in even the most critical application areas
  • 5. The Perfect Storm  Best practices for change control have created operational silos  Events geared more for operational management are passed to application support teams from all silos  Each technology stack requires expertise and training in administrative and monitoring tools Result  High level of noisy, uncorrelated events make proactive application management impossible  Lack of centralized access to data and performance history leads to lengthy triage for resolution
  • 6. APM Breakdown – The Analyst’s Vision  End-user experience monitoring  Runtime architecture discovery  Transaction monitoring  Component deep-dive monitoring  Performance Analytics
  • 7. Usage of Management Tools Evolves With Complexity
  • 8. The Missing Gap  Centralized console for all performance data  Summary views relevant to applications and services  Application-centric event filtering and correlation  Historical views of performance metrics for baselining and event analysis
  • 9. Advanced APM  Analytics engines for discovering performance patterns  Automation – Command and Control
  • 10. IT Challenges for APM Initiatives  Reduce incidents and time to repair with very specific application visibility requirements  Emphasis on root cause  Analysis Tools detailing application performance for preventative care and capacity planning  To support line-of-business visibility into application availability, performance, the risk associated with that performance, and SLA monitoring  To standardize on a common delivery platform for application support to reduce operation costs
  • 11. Best Practices for APM Delivery and Maintenance  Create a team  Specifically tasked with APM  Define  Skills: Basic knowledge of applications, underlying  Measure infrastructure, software  Analyze components and architectures,  Improve and can liaise with business and  Control development
  • 12. Best Practices for APM Delivery and Maintenance  Create a team  Choose initial critical  Define applications  Gather requirements  Measure  Gather all relevant and  Analyze accessible performance metrics  Improve  Choose tool sets  Control
  • 13. Best Practices for APM Delivery and Maintenance  Create a team  Aggregate metrics and create  Define baseline  Measure  Determine initial rule sets and thresholds  Analyze  Configure summary views and  Improve drill down per defined role  Control
  • 14. Best Practices for APM Delivery and Maintenance  Create a team  Iterate with key stakeholders  Define  Verify that the information is  Measure correct, and pertinent to role activities  Analyze  Practice scenarios to verify that  Improve discovery and drill down to  Control analysis or root cause is optimal per role
  • 15. Best Practices for APM Delivery and Maintenance  Create a team  Track MTTR improvements  Define  Determine repair activities  Measure performed outside of the APM  Analyze solution, can they be automated?  Improve  Are there other metrics or  Control correlations that need to be included to capture outlier events?
  • 16. Best Practices for APM Delivery and Maintenance  Create a team  Tweak thresholds to optimize  Define alerts  Measure  Add any new important metrics  Analyze or correlations  Improve  Add automated responses  Add new important applications  Control
  • 17. Case Study: One of the World’s Largest Financial Institutions
  • 18. Case Study: One of the World’s Largest Financial Institutions Real World Best Practices  Designate main support team and determine roll-out plan  Choose application group or initial critical applications for implementation  Determine user roles exec/application support/tech support  Determine application architectures  Determine available monitoring systems and sources of performance data  Work with technology support teams and determine agents/no agent technology  Determine dashboard templates to create consistent company- wide standards  Move to next app group or let app support teams build out
  • 19. Case Study: One of the World’s Largest Financial Institutions
  • 20. Alert Summary Composite Objects of Underlying Data
  • 21. Alerting in Context of Process Flow
  • 22. Technology Summaries - Web Server Farms
  • 26. Detail – JMS Destinations
  • 28. ROI  Total benefit – Reduction in outages = reduction in… • Idle labor • Loss of business • Penalties for unmet SLAs/JIT agreements • Loss of discounts for early payments • Penalties for late payments • Cost of idle equipment/telecommunications • Cost of facilities • Cost of recovery • Cost of damage to perceived customer service • Cost of damage to brand perception – Improved productivity – Reduced complexity – faster training of new employees – Capacity planning  $35.7MM in Year 1
  • 29. Conclusion  The enterprise IT environment is becoming exponentially more complex  Multiple disparate unconnected monitoring solutions are only adding to the complex- ity and management costs.  End to End APM solutions are not only viable but have already been proven to deliver great benefits