Hotsos 2011: Mining the AWR repository for Capacity Planning, Visualization, & other real world stuff
3 likes3,123 views
The document discusses mining the Automatic Workload Repository (AWR) in Oracle databases for capacity planning, visualization, and other real-world uses. It introduces Karl Arao as a speaker and discusses topics he will cover including AWR, diagnosing performance issues using AWR data, visualization of AWR data, capacity planning, and tools for working with AWR data like scripts and linear regression. References and resources on working with AWR are also provided.
Ad
More Related Content
What's hot (20)
Similar to Hotsos 2011: Mining the AWR repository for Capacity Planning, Visualization, & other real world stuff (20)
Ad
More from Kristofferson A (11)
Ad
Recently uploaded (20)
Hotsos 2011: Mining the AWR repository for Capacity Planning, Visualization, & other real world stuff
- 1. Mining the AWR repository for Capacity Planning, Visualization, & other real world stuff
- 2. Who am I? • Karl Arao, Oracle ACE, OCP-DBA, RHCE • Currently @ Enkitec - Senior Technical Consultant • Formerly @ SQL*Wizard - Solutions Architect • Blog: http://karlarao.wordpress.com • Wiki: http://karlarao.tiddlyspot.com
- 3. Who am I? • Karl Arao, Oracle ACE, OCP-DBA, RHCE • Currently @ Enkitec - Senior Technical Consultant • Formerly @ SQL*Wizard - Solutions Architect • Blog: http://karlarao.wordpress.com • Wiki: http://karlarao.tiddlyspot.com
- 4. Who am I? • Karl Arao, Oracle ACE, OCP-DBA, RHCE • Currently @ Enkitec - Senior Technical Consultant • Formerly @ SQL*Wizard - Solutions Architect • Blog: http://karlarao.wordpress.com • Wiki: http://karlarao.tiddlyspot.com
- 5. What will I talk about?
- 7. Overwhelming
- 8. AWR HELL
- 10. My first close encounter
- 11. gc block lost – sudden slow down http://karlarao.wordpress.com/2009/06/07/diagnosing-and-resolving-gc-block-lost
- 12. gc block lost – sudden slow down http://karlarao.wordpress.com/2009/06/07/diagnosing-and-resolving-gc-block-lost
- 13. gc block lost – sudden slow down http://karlarao.wordpress.com/2009/06/07/diagnosing-and-resolving-gc-block-lost
- 14. gc block lost – sudden slow down http://karlarao.wordpress.com/2009/06/07/diagnosing-and-resolving-gc-block-lost
- 15. After gc block lost – normal workload http://karlarao.wordpress.com/2009/06/07/diagnosing-and-resolving-gc-block-lost
- 16. Utilization = Requirement / Capacity
- 17. Double Y Axis Graph
- 18. t1 -------------------------------------> t0 335 – 336 – 337 – 338 – 339
- 25. delta issue
- 29. AWR Scripts
- 30. Visualization
- 31. Can’t go back in time?
- 32. AAS – Average Active Sessions Kyle Hailey: http://www.perfvision.com/ftp/class/02_AAS.ppt Max CPU Max CPU
- 33. AAS – the Golden Metric AAS & CPU count as a yardstick for a possible performance problem: if AAS < 1 -- Database is not blocked AAS ~= 0 -- Database basically idle -- Problems are in the APP not DB AAS < # of CPUs -- CPU available -- Database is probably not blocked -- Are any single sessions 100% active? AAS > # of CPUs -- Could have performance problems AAS >> # of CPUS -- There is a bottleneck
- 34. AAS from V$ACTIVE_SESSION_HISTORY AAS = Sample Count / Elapsed Time CPU count = 4 = 19410 / 600 = 32.35
- 35. AAS from DBA_HIST_ACTIVE_SESS_HISTORY AAS = (Sample Count * 10) / Elapsed Time CPU count = 4 = (1950 * 10) / 600 = 32.5
- 36. AAS from AWR Report AAS = DB Time / Elapsed Time CPU count = 4 = 291.81 / 9.10 = 32.07
- 37. AAS from AWR Top Events AAS = DB Time / Elapsed Time CPU count = 4 291.81 / 9.10 = 32.07 AAS = Event Time / Elapsed Time 17410 / 546 = 31.9
- 39. Textual trends
- 43. AAS throughout the AWR retention period! http://karlarao.wordpress.com/2010/07/25/graphing-the-aas-with-perfsheet-a-la-enterprise-manager
- 45. Utilization is the ultimate metric!
- 46. awr_genwl.sql
- 48. U=R/C
- 49. where aas > 1
- 50. Filter the data points • AAS range aas > 1 • Per SNAP_ID or range of SNAP_IDs id in (336) where id >= 336 and id <= 340 • Oracle CPU Utilization oracpupct > 50 • OS CPU Utilization oscpupct > 50 • Workload periods AND TO_CHAR(s0.END_INTERVAL_TIME,'D') >= 1 -- Day of week: 1=Sunday 7=Saturday AND TO_CHAR(s0.END_INTERVAL_TIME,'D') <= 7 AND TO_CHAR(s0.END_INTERVAL_TIME,'HH24MI') >= 0900 -- Hour AND TO_CHAR(s0.END_INTERVAL_TIME,'HH24MI') <= 1800 AND s0.END_INTERVAL_TIME >= TO_DATE('2010-jan-17 00:00:00','yyyy-mon-dd hh24:mi:ss') -- Data range AND s0.END_INTERVAL_TIME <= TO_DATE('2010-aug-22 23:59:59','yyyy-mon-dd hh24:mi:ss‘)
- 52. core need = # of cores * utilization * 1.25 Database Consolidation Best Practices http://husnusensoy.files.wordpress.com/2010/05/database-consolidation-best-practices.pdf
- 55. Total disk IOPS = (IOPS * Read Ratio) + (IOPS * Write Ratio * RAID penalty) Number of disk = Total disk IOPS / IOPS per disk
- 57. awr_iowl.sql
- 58. Average latency issue 60 minutes interval 10 minutes interval
- 59. latency (ms) = (readtim / phy reads) * 10
- 65. x data (CPU) = is the "independent value", used to predict the value of y y data (AAS) = is the "dependent value", variable whose value is to be predicted
- 71. r2toolkit Uses the following inbuilt Oracle functions: •regr_count •regr_r2 •regr_intercept •regr_slope
- 72. r2toolkit The toolkit systematically gets the statistic with highest correlation coefficient (relationship) No guess work!
- 73. Linear Regression – what’s the value? Lets you do forecast that can guide you with targeted response time optimizations and workload reduction. • Drill down on SNAP_IDs (data samples) with high AAS • Know what’s causing the high AAS on those SNAP_IDs • Tune the bottleneck - results to huge savings on system resources!
- 74. Linear Regression on 2 node RAC http://karlarao.tiddlyspot.com/#r2project racnode1 racnode2
- 75. Drilling down on the peak workload... with AAS of 10
- 76. Drilling down on the peak workload... with AAS of 10
- 81. Now on the low workload period... with AAS of 2.2
- 82. Now on the low workload period... with AAS of 2.2
- 86. Recap • Mine the beautiful data set • Visualization tell a story immediately • Statistics to make sense of data
- 87. Let the AWR data set change your mind set!
- 88. Thank you!
- 89. References and Tools • http://karlarao.wordpress.com – http://karlarao.tiddlyspot.com/#%5B%5BStorage%20IOPS%2Ccapacity%2Cperformance %2Ccost%5D%5D – http://karlarao.tiddlyspot.com/#Statistics – http://karlarao.tiddlyspot.com/#OraclePerformance • Tanel Poder @ http://blog.tanelpoder.com – http://www.tanelpoder.com/files/TPT_public.zip – http://www.tanelpoder.com/files/PerfSheet.zip – Neil Gunther & Tanel Poder - Multidimensional Visualization of Oracle Performance using Barry007 http://arxiv.org/pdf/0809.2532 • Kyle Hailey @ http://ashmasters.com , http://www.perfvision.com • Craig Shallahamer @ orapub.com – Introduction To Oracle Server Consolidation http://resources.orapub.com/product_p/server_consolidation_ppt.htm • Husnu Sensoy @ husnusensoy.wordpress.com – Database Consolidation Best Practices http://husnusensoy.files.wordpress.com/2010/05/database-consolidation-best- practices.pdf • Andy Rivenes @ http://www.appsdba.com/pubs.htm • Neeraj Bhatia @ www.nioug.org/files/Linear_Regression.pdf