StorageOS, Storage for Containers Shouldn't Be Annoying at Container Camp UK
Download as PPTX, PDFâą1 likeâą508 views
The document discusses StorageOS, a solution for managing persistent storage for containers. It highlights the developer experience, operational ease, and security features while addressing challenges in persistent storage, networking, and orchestration. StorageOS supports various infrastructures, providing benefits for stateful containers, continuous delivery, and efficient volume management.
StorageOS, Storage for Containers Shouldn't Be Annoying at Container Camp UK
- 1. Storage for containers shouldnât be annoying Karolis Rusenas @KRusenas https://github.com/rusenask [email protected]
- 2. Agile Storage. On-Demand, Anywhere, Made Easy. What we care about ï” Developer experience ïŠ Use existing tools (create and use Docker volumes without ever interacting with StorageOS directly (UI/CLI/API). ïŠ Reasonable defaults - compression, encryption, replicationâŠ ï” Operating experience ïŠ Run StorageOS as a container, separate image or whatever way you like, itâs just a binary! :) ïŠ API first - UI and CLI reuses same single HTTP API, easy to automate stuff. ïŠ Pluggable configuration backends for whatever you have in your stack - Consul, Zookeeper, BoltDB, Etcd (easy to add custom ones). ï” Security ï” Perfomance 2
- 3. Challenges âą Persistent storage âą Networking âą Security âą Infrastructure âą Orchestration
- 4. Our targets âą Persistent storage âą Networking âą Security âą Infrastructure âą Orchestration
- 6. Jim was almost ready to implement his first app with persistent storage running in Docker container
- 7. How easy is it to get persistent storage with StorageOS?
- 9. Thatâs the line âą sudo docker run -d --name test-redis01 -v test-dev-redis01:/data --volume-driver=storageos redis redis-server --appendonly yes Usual stuff Letâs give our new friend a name Telling Docker to use StorageOS driver More of the usual stuff
- 11. Infrastructure
- 12. Infrastructure âą Cloud providers such as GCE or AWS provide EBS volumes for persistent storage.
- 13. You can always build something on your ownâŠ
- 14. On-premises infrastructure & StorageOS âą Benefits of containers without moving to cloud by providing EBS volume alternative via Docker volume plugin. âą Hyper-converged mode - run your workloads on the same nodes as StorageOS controllers for maximum performance. âą Client mode - present virtual volumes to Docker containers, easy access to remote volumes. âą QoS âą Compression âą Data deduplication âą E2E encryption
- 15. Agile Storage. On-Demand, Anywhere, Made Easy. StorageOS Use Cases 15 ï” Stateful Containers for Databases and Fast DB recovery ï” Continuous Integration/Delivery ï” Secure Cloud Mobility and Cost Reduction ï” Performance Acceleration and Volume Management API
- 17. 17 Controller Node control plane HTTP API Nats UI (Angular) Docker plugin Scheduler Dataplane drivers Supervisor 5 secret binaries Configfs data plane
- 18. 18 Controller Node control plane HTTP API Nats UI (Angular) Docker plugin Scheduler Dataplane drivers Supervisor 5 secret binaries Configfs Client Node control plane Docker plugin Nats HA Client Supervisor 5 secret binaries data plane
- 19. 19 controplane High level overview controplane controplane dataplane dataplane dataplane nats Consul Consul Consul http client http/nats Docker dataplane server
- 20. Our stack âą Consul/BoltDB - store configuration. BoltDB is useful when running a single node or during development/testing. âą Nats - messaging system âą Go - control plane is written in this awesome language âą C - data plane, mostly for speed and available libraries
- 21. Consul/BoltDB ï” KV store, easy to use, backup. ï” Service discovery (when using BoltDB itâs not important since we assume that you are running a single node) ï” Leadership election - some components of the system should be running only on one node so they are all fighting for leadership (i.e. scheduler, retry logic). ï” Split brain detection 21
- 22. Leadership election.. why? ï” Sometimes (and quite often) you need only one node in your distributed system performing specific actions, i.e. scheduling, retrying some actions.. ï” Most of the distributed KV stores implement locking mechanism on keys, that could be used to elect leaders and detect leader failures. ï” Check out https://github.com/docker/leadership - probably not enough code there to include it as a library though. 22
- 23. 23 Node 1 Node 2 Node 3 Node 4 Node 5 Leaderâs key All nodes try to acquire a lock on specific key
- 24. 24 Node 1 (leader) Node 2 Node 3 Node 4 Node 5 Leaderâs key Only one will succeed P.S. Donât forget to use locks with TTL!
- 25. Nats (https://nats.io) ï” Lightweight ï” Server is just a goroutine in your main process ï” Instant messaging between components ï” Simple pub/sub or request/reply syntax ï” Mesh networking 25
- 26. Nats (https://nats.io) auto discovery: https://github.com/nats-io/gnatsd/issues/126 26
- 27. Safer messaging 27 Messaging wrapper Dispatch event Persist event in KV store Publish event to Nats Send event: Receive event: Receive event Update event to âreceiveâ state Do stuff Then we can have a process that constantly looks for forgotten events :)
- 28. Statik (https://github.com/rakyll/statik) ï” Compile your static assets into Go binary! 28
- 29. Suture (https://github.com/thejerf/suture) ï” Erlang-ish supervisor trees for Go ï” Stable ï” Combined with statik and go-bindata you can drastically simplify your deployments 29
- 30. Using Dockerâs healthcheck functionality (added in 1.12) ï” https://docs.docker.com/engine/reference/builder/#/healthcheck ï” Dockerfile: ï” $docker ps 30 Useful when you have several dependencies, like KV store.