Scale and Cloud Design Patterns
1 like608 views
Best Practices for Scale and Cloud by Moshe Kaplan: Auto scale, Queues, Session off loading, Database
![http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com
Cookie Encryption
private static void SetEncryptedCookie(
string name, string value
) {
var encryptName = SomeEncryptionMethod(name);
Response.Cookies[encryptName].Value = SomeEncryptionMethod(value);
//set other cookie properties here, expiry &c.
//Response.Cookies[encryptName].Expires = ...
}
private static string GetEncryptedCookie(string name)
{
//you'll want some checks/exception handling around this
return SomeDecryptionMethod(
Response.Cookies[SomeDecryptionMethod(name)].Value);
}
32](https://image.slidesharecdn.com/scaleandclouddesignpatterns-141216204251-conversion-gate02/85/Scale-and-Cloud-Design-Patterns-32-320.jpg)
Ad
More Related Content
Similar to Scale and Cloud Design Patterns (20)
More from Moshe Kaplan (17)
Ad
Recently uploaded (20)
Ad
Scale and Cloud Design Patterns
- 1. The VP R&D Open Seminar Scale and Cloud Design Patterns [email protected] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com
- 3. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com3 Why Do I Care? From 0 to 100 (USmassadaptation) Phone: 100 yrs Radio: 40 yrs TV: 30 yrs Mobile: 20 yrs Internet: 10 yrs Facebook: 2 yrs
- 7. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar 20 YEARS OF WEB20 YEARS OF WEB ARCHITECTURESARCHITECTURES 7 http://www.trucoteca.com/juego/erase-una-vez-el-hombre-del-antiguo-egipto-a-la-r-10236.html
- 8. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Once Upon a Time... Man 8 http://act2.me/full-stack-web-development/
- 10. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar UNDERSTAND THE SOURCEUNDERSTAND THE SOURCE Scale Pattern #0 10
- 12. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar MINIMIZE DIRECT TRAFFICMINIMIZE DIRECT TRAFFIC Scale Pattern #1 12
- 14. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com CDN: Move Your Files to the Network 14 http://www.akamai.com/stateoftheinternet/http://www.akamai.com/stateoftheinternet/
- 15. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Geo LB: Move Your App to the Network 15 http://www.akamai.com/stateoftheinternet/http://www.akamai.com/stateoftheinternet/
- 16. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com DNS based Load Balancing Architecture 16
- 17. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com DNS Load Balancing External service monitorsour servers Once in 30sec HTTPpage: Should return >=400 if fails If all failed, can be redirected to static file at external service 17
- 18. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com How fast will it take to recover? 18 Phase User in Site New User Detect Failure < 30 sec < 30 sec DNSTTL < 15 sec Browser Cache Chrome (42%) < 60 sec IE(27%) < 1800 sec Firefox (11%) < 30sec Safari (11%) - Total Recovery time (sec) < 75 - 1845 < 30
- 19. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Monthly Cost Analysis Cost /Unit Total Domain 2 $0.5/Domain $1.0 Queries 4 Million $0.5/Million $2.0 Health Checks 6 checks $0.75/Check $3.0 Total $6.0 19
- 24. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar USE NATIVE NOTIFICATIONUSE NATIVE NOTIFICATION Scale Pattern #2 24
- 25. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Use Native Notifications If You Can 25
- 26. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Use PubNub/Pusher If You Cannot 26
- 28. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar FRONT END AUTO SCALINGFRONT END AUTO SCALING Scale Pattern #2 28
- 32. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Cookie Encryption private static void SetEncryptedCookie( string name, string value ) { var encryptName = SomeEncryptionMethod(name); Response.Cookies[encryptName].Value = SomeEncryptionMethod(value); //set other cookie properties here, expiry &c. //Response.Cookies[encryptName].Expires = ... } private static string GetEncryptedCookie(string name) { //you'll want some checks/exception handling around this return SomeDecryptionMethod( Response.Cookies[SomeDecryptionMethod(name)].Value); } 32
- 33. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar BACK END AUTO SCALINGBACK END AUTO SCALING Scale Pattern #3 33
- 35. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar CODE DEPLOYMENTCODE DEPLOYMENT Scale Pattern #4 35
- 36. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Continuous Deployment: End to End Testing 36 http://tapetim.diq.co.il/36__The_Matrix,_1999,_Green_Falling_Code.htm http://community.sharpdevelop.net/blogs/mattward/pages/FeatureTourUnitTesting.aspx http://www.javalinux.it/wordpress/2008/05/19/subversion-branching-in-my-experience/ http://www.nytimes.com/2008/04/20/magazine/20Build-text.html Automatic Tests Merge to Trunk Feature CODE P1 P2 P3 Feedback http://blogs.microsoft.co.il/blogs/vprnd
- 40. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar REDUCING DATA LOADREDUCING DATA LOAD Scale Pattern #5 40
- 45. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Invalidation Can Be Nightmare 45 http://luauf.com/2009/06/08/%C2%BFque-es-memcached/
- 46. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Geo Load Balancing Can be Worse 46
- 47. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Finally, Recovery May Not Be Better 47
- 49. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Database Anti Patterns Software Engineering Patterns ORM Blobs No Denormalization Nested/Complex SQL Statements Too Few/Many Indexes 49
- 50. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar AVOIDING THE DATAAVOIDING THE DATA SPOFSPOF Scale Pattern #6 50
- 54. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar DOCUMENT DATABASESDOCUMENT DATABASES Buzz*:MongoDB 54
- 55. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com When Should I Choose NoSQL? 55 http://guyharrison.squarespace.com/blog/tag/nosql • Eventually Consistent • Document Store • Key Value
- 56. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Same Terminology Database Database Table Collection Row Document 56
- 57. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com A Blog Case Study in RDBMS 57 http://www.slideshare.net/nateabele/building-apps-with-mongodb
- 58. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com And as a SW Engineer would like it to be… 58 http://www.slideshare.net/nateabele/building-apps-with-mongodb
- 60. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Auto Selection Using Quorum 60 Selection Methods: • Low Priority • Hidden • (Weighted) Voting
- 62. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar EVENTUALLY CONSISTENTEVENTUALLY CONSISTENT Buzz*:Cassandra 62
- 63. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Write Flows: Single Region, Multi AZ 63 http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html
- 64. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Write Flows: Multi Region 64 http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalability-on.html
- 65. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar TRACE CODE ISSUESTRACE CODE ISSUES Scale Pattern #7 65
- 67. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Code Anti Patterns Do It Yourself Infrastructure Cache Data Stores Locksand Semaphores Code that Cannot be Tested/Automated 67
- 69. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com The VP R&D Open Seminar SELECT THE RIGHT STORAGESELECT THE RIGHT STORAGE Scale Pattern #8 69
- 70. http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com Storage 70 Attribute RAM SSD HDD (SAS) Volatile Yes(*) No No Latency Low Low High Read MB/s 4000+ 520 164 Write MB/s 4000+ 480 164 IOPS 100,000 100 Price/GB $5.5 $0.5 $0.05
- 71. The VP R&D Open Seminar Moshe Kaplan +972-54-2291978 [email protected] http://blogs.microsoft.co.il/blogs/vprnd http://top-performance.blogspot.com
Editor's Notes
- #4: The world is changing more and more fast You have to minimize NRE You must support unexpected demand You must provide top service (people now leaves cell operator after single incident, rather then 5, 10 years ago Firms a vulnerable – Citi worth 20Bill $ instead of 200 Bill a year ago Break and Mortar bookstores 15 years ago and Amazon…. Will it happen again to banks, insurance, real estate agencies… IS YOUR MARKET THE NEXT FOR PENETRATION – Finance? Real Estate? How to win a rival that is not existing yet? http://www.johnmwillis.com/ibm/cloud-computing-and-the-enterprise/ -
- #22: sudo more /var/www/www.niio.com/public_html/Niio/Gruntfile.js