Expert Days 2011: The VP R&D Open Seminar: Systems Performance Seminar
1 like3,265 views
The document discusses identifying performance bottlenecks in systems, exploring factors such as server and client influences, code inefficiencies, and data storage strategies. It outlines diagnostic tools and solutions including profiling, caching, SQL optimization, and strategies for managing big data like sharding and NoSQL databases. The goal is to enhance performance through a systematic approach to understanding and resolving inefficiencies.
![Where the H#@$ is My Performance Bottleneck? [email_address] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com](https://image.slidesharecdn.com/expertdaysvprdopenseminarsystemsperfomranceseminar-110712152811-phpapp02/85/Expert-Days-2011-The-VP-R-D-Open-Seminar-Systems-Performance-Seminar-1-320.jpg)
Expert Days 2011: The VP R&D Open Seminar: Systems Performance Seminar
- 1. Where the H#@$ is My Performance Bottleneck? [email_address] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com
- 3. Why Do I Care? From 0 to 100 (US mass adaptation) Phone: 100 yrs Radio: 40 yrs TV: 30 yrs Mobile: 20 yrs Internet: 10 yrs Facebook: 2 yrs
- 6. Motivation
- 10. Assumptions…
- 11. IS IT THE SERVER OR THE CLIENT?
- 12. Waterfall Time!
- 13. Better a Neighbor Nearby Than a Brother Far Away http://www.tcpipguide.com/free/t_TCPWindowSizeAdjustmentandFlowControl.htm
- 14. Network Effect Solutions CDN Compression; Minification; Sprites; Embed http://www.akamai.com/stateoftheinternet/
- 15. Show Time!
- 16. STEP 2: IT'S DEFINITELY IN THE CODE!
- 17. Code Profilers
- 18. Code Anti Patterns Do It Yourself Infrastructure Cache Data Stores Locks and Semaphores Code that Cannot be Tested/Automated
- 19. Load Stress
- 20. STEP 3: WHERE DO WE STORE THE DATA? http://1userverrack.net/2011/06/08/hp-blade-server-9/
- 21. SQL Server Alerts Connection Leak: >200 Object Execution Times Locks
- 22. SQL Server Execution Time Graphs
- 23. SQL Server Execution Time Details
- 24. Activity Monitor
- 25. Database Anti Patterns Software Engineering Patterns ORM Blobs No Denormalization Nested/Complex SQL Statements Too Few/Many Indexes
- 26. ALTERNATIVE STRATEGIES FOR BIG DATA CASES
- 27. Strategy A - Sharding
- 28. Strategy B – In Memory Databases
- 29. 700 Inserts/Sec In Memory Engine 3000 Inserts/Sec InnoDB Engine 700 Inserts/Sec Amazon AWS Standard Large Instance
- 30. Strategy C – MapReduce http://blogs.microsoft.co.il/blogs/vprnd
- 31. Strategy D - NoSQL insert get multiget remove truncate <Key, Value> http://wiki.apache.org/cassandra/API
- 32. Sharding Again
- 34. Horizontal Sharding Static Hashing Complex growth Simple Mod 10 = 0 Mod 10 = 1 Mod 10 = 2 Mod 10 = 3 Mod 10 = 4 Mod 10 = 5 Mod 10 = 6 Mod 10 = 7 Mod 10 = 8 Mod 10 = 9
- 35. Key locations are defined in a directory Simple growth Directory is SPOF The Directory Can be Very Large Horizontal Sharding
- 36. Horizontal Sharding Static Hashing with Directory Mapping Simple Growth The Small Directory Can be Cached on Each App Server Mod 1000 = 4
- 37. Horizontal Sharding Each key is signed by the DB# on creation Simple growth The Key Store Can be Cached on Each App Server
- 38. STEP 4: SYSTEM ASPECTS
- 39. Network WireShark Ping Tracert Netstat –na WAN
- 40. Storage Database I/O NAS SAN SSD
- 41. Monitoring
- 42. The Bottom Line: Grow ∞ Thank you! and Keep Performing! Moshe Kaplan
Editor's Notes
- #4: The world is changing more and more fast You have to minimize NRE You must support unexpected demand You must provide top service (people now leaves cell operator after single incident, rather then 5, 10 years ago Firms a vulnerable – Citi worth 20Bill $ instead of 200 Bill a year ago Break and Mortar bookstores 15 years ago and Amazon…. Will it happen again to banks, insurance, real estate agencies… IS YOUR MARKET THE NEXT FOR PENETRATION – Finance? Real Estate? How to win a rival that is not existing yet? http://www.johnmwillis.com/ibm/cloud-computing-and-the-enterprise/ -
- #43: Start with nothing: storage, FW, LB, Server and grow… Can buy servers for more than hour