Docker 101 for Oracle DBAs - Oracle OpenWorld 2017
2 likes617 views
SUN5617- Docker 101 for Oracle DBAs Linux Container (not to be confused with Oracle Container Cloud Service), like Docker and LxC, is a next-generation virtualization technology. Imagine having all the benefits of a hypervisor-based virtual machine but with no performance overhead. It’s this combination that makes containers ideal for databases, especially when running on bare metal. While the adoption of containers has been steadily increasing for many applications and databases, the Oracle community at large has been fairly sluggish. In this session bring your laptop along and practice basic docker commands.
![NAS / SAN / CLOUD / SDS
DOCKER VOLUMES
Container
Volume
Host 1
Container
Volume
Host 1
Container
Volume
Host 1
Local Storage Distributed / Shared Storage
Choose between
mobility &
performance
[Host]/opt/data-dir:[Container]/etc/config
Local Storage](https://image.slidesharecdn.com/fulayoow2017docker101-171002015649/85/Docker-101-for-Oracle-DBAs-Oracle-OpenWorld-2017-24-320.jpg)
Ad
More Related Content
What's hot (19)
Similar to Docker 101 for Oracle DBAs - Oracle OpenWorld 2017 (20)
Ad
Recently uploaded (20)
Ad
Docker 101 for Oracle DBAs - Oracle OpenWorld 2017
- 1. ROBIN SYSTEMS SUN5617: Docker 101 for Oracle DBAs Adeesh Fulay Director of Products @AdeeshF [email protected] robinsystems.com
- 2. ABOUT ME › Over 14 years of experience across virtualization, storage, middleware, databases, & big data applications › Director of Products, Robin Systems › Application Virtualization Platform for big data apps and databases › Previously @ › VMware - vSphere, vCloud Director, vCloud Air (public cloud) › Oracle America – OEM, DBLM, DBaaS, DB Cloning, Job System, Reporting, Plugins, etc … › mValent Inc (acquired by Oracle) - Config mgmt of Middleware & Database products Adeesh Fulay Director of Products @AdeeshF [email protected] linkedin.com/in/adeeshfulay
- 3. AGENDA › Why Containers? › Linux Container Overview › Look Under the Hood › Getting Hands Dirty!!! › Containerized Databases › Summary
- 5. THE ANALOGY: CARGO TRANSPORT
- 6. CARGO SOLUTION: INTERMODAL SHIPPING CONTAINER
- 8. BUSINESS SOLUTION: LINUX CONTAINERS
- 10. VIRTUALIZATION Each virtual machine includes not only the app binary, but the entire operating system (Guest OS) and necessary libraries (which may weight 10s of GB) Host OS Hypervisor Guest OS Libraries App A Guest OS Libraries App B Host OS Libraries App A Libraries App B DOCKER Each container contains only the necessary application binary and its dependent libraries (which may weight 10s of MB). The operating system is shared by all containers. CONTAINERS
- 11. UNDERSTANDING CONTAINERS Each container has: 1. Its own network interface (and IP address) 2. Its own file system 3. Isolation (security) › Container A & B can’t harm (or even see) each other › Uses Linux kernel’s “namespaces” for this 4. Isolation (resource usage) › Soft & hard quotas for CPU, RAM and IO › Uses Linux kernel’s “cgroups” for this Wait, this looks like a virtual machine! So, what’s the difference? Userspace Linux Kernel Cgroups Namespaces Management Interface LXC App A App B
- 12. WHY CONTAINERS? › OS-Based Lightweight Virtualization Technology › Content & Resource Isolation › Better Performance › Better Efficiency & Smaller footprint › Build, ship, deploy anywhere › Separation of Duties Source: IBM Research http://domino.research.ibm.com/library/cyberdig.nsf/papers/0929052195DD819C85257D2300681 E7B/$File/rc25482.pdf
- 13. TYPES OF CONTAINERS • The Ngnix • Node.js • Postgres • Redis • MariaDB • Node.js • ElasticSearch • Wordpress • Node.js SYSTEM CONTAINERS • Each container runs an entire service stack (multiple applications per container) • Meant to be used as lightweight VM. Examples – LXC, OpenVZ, Solaris Zones • No need to repackage applications in any special way • Supports in-place patch/upgrade & SSH access Great for Traditional Applications Ngnix Node.js Postgres Redis MariaDB Node.js ElasticSearch Wordpress Ngnix APPLICATION CONTAINERS • Each container runs a single application (single concern per container philosophy) • Most popular container format. Example – Docker • Requires applications to be repackaged and reconfigured to work with Docker image format • Patch/Upgrade entails replacing container image Great for Modern Applications Blog on LXC vs Docker: https://robinsystems.com/blog/containers-deep-dive-lxc-vs-docker-comparison/
- 14. WHY DOCKER? A value of 100 is the peak popularity for the term. ~450K images on DockerHub ~8 Billion pulls from DockerHub
- 15. ORACLE SUPPORTS BOTH DOCKER AND LXC LXC Support: http://www.oracle.com/technetwork/database/virtualizationmatrix-172995.html › General › OracleJava › OpenJDK › Database › RDBMS › MySQL › NoSQL › Middleware › Glassfish › WebLogic › Coherence › Tuxedo › HTTP Server Official Oracle on Docker repository: https://github.com/oracle/docker-images Oracle Database Oracle RAC (CRS + ASM) LXC (Test & Production) ✓ ✓ Docker (Dev Only) ✓ ✘
- 17. UNDER THE HOOD
- 18. DOCKER ARCHITECTURE Key Components Docker Engine / Daemon Docker Containers Docker Images Docker Registry Docker Client Client can be on the same or different host as the daemon. They communicate over sockets or REST APIs.
- 19. DOCKER ENGINE Docker Engine: Responsible for managing networking, images, containers, volumes, plugins, orchestration, etc Install Docker Engine on your laptops and servers
- 20. IMAGES › Images are made up of multiple r/o layers › Containers are a thin r/w layer on top › Layers are shared by multiple images › Storage drivers › AUFS (Ubuntu, OSX) › Device mapper (RHEL, CentOS) › BTRFS (Oracle Linux) › Overlay, Overlay2 › ZFS › Layer default location: /var/lib/docker Additional Reading: https://adeeshfulay.wordpress.com/2017/09/08/understanding-docker-images-and-layers/
- 21. DOCKERFILES Base Docker Image New Docker Image Instructions • Run commands • Add file or folder • Define ENV variables • Define processes to run • Set entrypoint Dockerfile $ Docker build –t <tag> <dir with dockerfile>
- 22. CONTAINER MANAGEMENT Container is like a directory. It is created from an image, and contains everything required to run an app. Containers like VMs have state and are portable. Containerd: Simple daemon that uses runtimes to manage containers runC: Docker’s default container runtime. Can be replaced with other OCI compliant runtimes. Docker Engine
- 23. IMAGE REGISTRY Registry is a distribution component of Docker. It can be private or public (Docker Hub: https://hub.docker.com)
- 24. NAS / SAN / CLOUD / SDS DOCKER VOLUMES Container Volume Host 1 Container Volume Host 1 Container Volume Host 1 Local Storage Distributed / Shared Storage Choose between mobility & performance [Host]/opt/data-dir:[Container]/etc/config Local Storage
- 25. DOCKER NETWORKING Bridge Network Overlay Network Reference: https://blog.docker.com/2016/12/understanding-docker- networking-drivers-use-cases/ Network types Details None No external n/w Host Share host n/w stack Bridge NATing, expose ports, poor performance macvlan Uses host subnet, VLAN, swarm mode Overlay Multi-host, VXLAN, swarm mode 3rd Party Plugins OpenvSwitch, Weave, …..
- 26. CONTAINER ORCHESTRATION › Multi-container, Multi-Host scheduling › Supports multiple container formats- Docker & LXC › Placement, Affinity and Anti-affinity rules › Multi-Tenancy, RBAC, AuthN, & AuthZ › Scaling Options – Up/Down, Out/Back › Management of Storage & Networking › Data Management - Snapshot, restore, time travel, clone › High Availability & Auto Failover › Service discovery and load balancing › Extensible – Onboard custom apps
- 27. ORACLE, DOCKER, & KUBERNETES Oracle is late to the party, but making big investments now to catch up!!
- 28. GETTING HANDS DIRTY!!! › DEMO Mike Rowe of Dirty Jobs
- 29. DEMO: DOCKER EXAMPLES › Docker info › Dockerhub & Oracle container registry › Docker images & Docker pull › Dockerfile › Docker run –d <oradb> -v … › Docker ps -a › Docker exec –ti <cname> bash › Docker logs … › Docker inspect <oradb> › Docker network ls › Docker volume ls
- 30. Containerized Databases › Good Idea or Disaster?
- 31. How do I get the absolute best performance? How can I rapidly clone my production for test/dev runs? How do I apply patches and upgrades without bringing down the application? How do I avoid overprovisioning from the start? How do I quickly deploy my applications? Can I run multiple applications on the same setup without worrying about noisy neighbors? OPERATIONAL CHALLENGES How do I handle spikes and growth?
- 32. Robin AVP: Virtualize And Manage BigData & Database Apps with Bare Metal Performance Guaranteed Min and Max IOPS Consolidate without losing predictability Push-button Application Provisioning, Elastic Scaling 10x time saving by managing application not infrastructure Space-efficient snapshots and clones in minutes Application time travel (storage, app, network and config) No Virtualization Overhead 40% - 60% performance advantage VM INTEGRATED SCALE-OUT BLOCK STORAGE VIRTUAL NETWORKING CONTAINER-BASED VIRTUALIZATION APPLICATION LIFECYCLE MANAGEMENT CONVERGED PLATFORM Application-aware Infrastructure plumbing Deploy applications guaranteeing compute+storage anti/affinity rules Custom Apps
- 33. CONSOLIDATION OPTIONS FOR ORACLE DATABASES Options à Virtual Machine Oracle 12c Multitenant Containers on Robin Criteria ⬇ Performance overhead Significant Hypervisor layer, Guest OS Significant Shared Redo logs, Noisy neighbors problem Negligible Completely independent, no hypervisor Availability High One VM doesn’t impact another one Medium CDB shutdown takes down all PDBs with it High Just like VMs Isolation Excellent Good Shared buffer cache Excellent Performance predictability Poor Cannot cap IOPS at the hypervisor layer Good IOPS control only available on Exadata Excellent. Built into the platform Agility Good Excellent Excellent Manageability High OS sprawl High Challenges in getting patching window Low No OS sprawl, no additional licenses 33 https://robinsystems.com/solutions/relational-databases/