Understand immutable infrastructure, what? Why? How? - Meta-Meetup DEVOPS NIGHT
Download as PPTX, PDF2 likes694 views
Quentin Adam from Clever Cloud discusses immutable infrastructure and automation. He argues that infrastructure should be treated as ephemeral instances rather than precious servers. Stateless applications deployed across immutable instances in an automated fashion provide scalability, high availability, and security. Key aspects include splitting state from process, service discovery, configuration as code, distributed systems, and monitoring.
Understand immutable infrastructure, what? Why? How? - Meta-Meetup DEVOPS NIGHT
- 2. Quentin ADAM from the Clever Cloud @waxzce on twitter – github- soundcloud – instagram …. WHO AM I ?
- 3. MY DAY TO DAY WORK : CLEVER CLOUD, THE IT AUTOMATION COMPANY
- 4. KEEP YOUR APPS ONLINE. MADE WITH NODE.JS, SCALA, JAVA, RUBY, PHP, PYTHON, GO… Cloud & on premise ;-)
- 5. AND LEARN A LOT OF THINGS ABOUT YOUR CODE, APPS, AND GOOD/BAD DESIGN…
- 6. GIVE BACK TO THE COMMUNITY NEVER GONNA LET YOU DOWN clever-cloud.com
- 8. 40 times in 5 years price drop of AWS SERVERS COSTS ARE GOING DOWN
- 9. Google I/O 2015 “RACE TO ZERO” I.E THE SERVER IS FREE
- 10. In fact, all you have is… COOL. YOU HAVE A SERVER.
- 11. HOSTING Backup Updates Certification Agreement Process Provisioning Security Hardware maintenance
- 13. ONCE UPON A TIME, MY BELOVED SERVERS
- 15. CREATE HISTORY
- 16. DOCUMENTATION
- 17. SPECIFIC
- 18. TAYLOR MADE
- 19. NOT ABLE TO SCALE
- 21. Automate SPLIT COMPLEX PROBLEMS INTO A COLLECTION OF SMALL ONES
- 22. POSSIBLE SERVERS STATES … Updated to V43 New configuration files Install new service History …
- 23. AVOID HISTORY
- 24. FIX STATE OF THE DATA TO ENSURE ACCESSIBILITY
- 25. POSSIBLE STATE IN AN IMMUTABLE STATE working Not working Very simple to predicate
- 26. FIX THE HISTORY IN A IMMUTABLE STATE
- 27. BTW, REAL WORLD INSIGHT “WE LIVE IN A MUTABLE WORLD, DEAL WITH IT”
- 30. PET != CATTLE
- 32. NO MORE OLYMPIC CONTEST ON UPTIME
- 33. And why it’s a problem to manage technical product and decision with book keepers point of view https://www.youtube.com/watch?v=0ip1FoBsLB4 (AWS PRICING HYPOCRISY LEAD TO BAD PRACTICE) Summon Yog-Sothoth
- 35. PRODUCTION HAS TO BE PERFECT
- 36. PEOPLE ARE NOT PERFECT
- 37. PEOPLE HAVE NOTHING TO DO ON PRODUCTION STUFF
- 38. AT CLEVER CLOUD SSH CONNECTION IS A RED ALERT
- 40. SPLIT PROCESS AND STORAGE Storage • Databases • Files • Sessions • Events • … Code • Can be replicated • Stateless • Process
- 42. VM, docker, kubernetes, puppet, ansible, vmware… This is not the problem TECHNOLOGIES?
- 43. Containers, VMs... Comment ces technologies fonctionnent et comment les différencier? (Quentin Adam) https://www.youtube.com/watch?v=wG4_JQXvZIc DOCKER
- 44. THERE IS ONE PROCESS: BUILD
- 45. THEN, REGISTER
- 46. AND LIVE WITHOUT DATA
- 47. AND DIE WHEN MORE UPDATED VERSION IS THERE
- 49. FULLY AUTOMATED HOSTING FACTORY
- 50. AN INSTANCE IS DEAD OR ALIVE AND THAT’S ALL
- 56. Picking one instance or another doesn’t matter STATELESSNESS IS THE KEY
- 57. BECAUSE YOU WILL NOT RELY ON A SERVER ANYMORE
- 58. CREATE A FACTORY OF INSTANCE
- 61. Consul, etcd, Clever Cloud service dependencies SERVICE DISCOVERY
- 65. NO OVER ENGINEERING ON CONFIGURATION, WHEN YOU NEED TO CONFIGURE THE CONFIGURATION INJECTOR, YOU ARE TOO FAR 🖇
- 66. HOW TO MANAGE DATA?
- 67. SPLIT DATA AND PROCESS: FS COMPOSITION Runtime • local • replicable • updated Data • file system • block storage • replicated • copy on write?
- 69. Not part of this list DATABASE (ACID OR NOT, SQL OR NOT)
- 70. FILE SYSTEM
- 71. BLOC STORAGE
- 72. OBJECT STORAGE
- 73. (COPY ON WRITE)
- 74. (COPY ON WRITE)
- 75. DATA MANAGEMENT IS BIND TO DB NEEDS
- 76. ACID : DUPLICATE & DATA EVOLUTION
- 77. INSTANCE FOR ONE ORGANIZATION ACID • Atomicity • Consistency • Isolation • Durability Powerful data management • Transaction • User management • One above one Take advantage of ACID database
- 78. BUT IT DESIGNS A BOTTLENECK
- 79. EXAMPLE : E-SHOP ON CLASSIC MODE
- 80. EXAMPLE : E-SHOP ON CLASSIC MODE User A buy a hdd Database Transaction : • Stock management • Order management • Invoice generation • Customer Account reward • … Transaction user A is processed Stock & Order are just perfectly synchronize
- 81. EXAMPLE : E-SHOP ON CLASSIC MODE User A buy a hdd Database Transaction : • Stock management • Order management • Invoice generation • Customer Account reward • … Transaction user A is processed Stock & Order are just perfectly synchronize User B buy a hdd Transaction user B is processed then
- 82. EXAMPLE : E-SHOP ON MULTI-TENANT MODE i.e. : Multiple shop of various sellers on the same instance
- 83. EXAMPLE : E-SHOP ON MULTI-TENANT MODE User A buy a hdd on seller A Database Transaction : • Stock management • Order management • Invoice generation • Customer Account reward • … Transaction user A is processed Stock & Order are just perfectly synchronize User B buy a book on seller B Transaction user B is processed then
- 86. FORGET THE SAN, GO FULL DISTRIBUTED
- 88. BE CONSISTENT AND PREDICTABLE
- 90. EXPOSE METRICS
- 91. BETA ALERT
- 92. IMMUTABILITY AS A PATTERN ANOTHER TALK FROM ME ;-) FR version : https://www.youtube.com/watch?v=y1BR7Rh7FSY&t=15s
- 99. F*CK 12 FACTORS?
- 100. TCP ?
- 102. @waxzceTHANK YOU ! ANY QUESTIONS ? Clever Cloud gift coupon: devopsNIGHT17 [email protected]
Editor's Notes
- #12: Integrating a new technical stack can take months Installing new software is just a tiny part of the work