How to Use Mirroring and Caching to Optimize your Container Registry

May 29, 20200 likes421 views

Brandon Mitchell, Boxboat + Docker Captain - How do you make your builds more performant? This talk looks at options to configure caching and mirroring of images that you need to save on bandwidth costs and to keep running even if something goes down upstream.

Caching
Caching Demos
Caching Limitations
Caching Other Registries
Caching Gitlab Demo
Mirroring
Manual Mirroring
Summary
Agenda
@sudo_bmitch1 / 35

How to Use Mirroring and
Caching to Optimize Your
Image Registry
Brandon Mitchell
Twitter: @sudo_bmitch
GitHub: sudo-bmitch
2 / 35

Ephemeral Build Server?
@sudo_bmitch3 / 35

Cluster Pulling Remote Images?
@sudo_bmitch4 / 35

Worry About Upstream Image Changes?
@sudo_bmitch5 / 35

Build and Deploy Infrastructure Tolerant of
Upstream Outages?
@sudo_bmitch6 / 35

Production Resilience
@sudo_bmitch7 / 35

Faster Builds and Less Bandwidth
@sudo_bmitch11 / 35

Caching is the Easy Button
https://commons.wikimedia.org/wiki/File:Easy_button.JPG
@sudo_bmitch13 / 35

$Cache Implementation Either the dockerd CLI: dockerd --registry-mirror <cache-url> Or /etc/docker/daemon.json { "registry-mirrors": [ "<cache-url>" ] } Plus a registry: docker run -e REGISTRY_PROXY_REMOTEURL=<upstream-url> registry:2 @sudo_bmitch15 / 35$

So What's the Catch?
@sudo_bmitch21 / 35

Cache Limitations
The "registry-mirror" setting only applies to Docker Hub
Only caches pulls not pushes
Pulls still check the image manifest on Hub
Credentials are in the cache server
Docker implementation only supports one authentication method
@sudo_bmitch22 / 35

Options to Cache Other Registries
Con gure a squid HTTP caching proxy
Pull directly from the cache
Use DNS and TLS certs to send pulls to the proxy
@sudo_bmitch23 / 35

Running a Registry
Docker image
docker container run -p 5000:5000 registry:2
Harbor
Many Artifact Repositories
@sudo_bmitch28 / 35

$Manually Mirroring docker image pull ${image} docker image tag ${image} local-mirror:5000/${image} docker image push local-mirror:5000/${image} @sudo_bmitch29 / 35$

$Manual Mirror Script docker image pull "$localimg" docker image pull "$remoteimg" remoteid=$(docker image inspect "$remoteimg" --format '{.Id}') localid=$(docker image inspect "$localimg" --format '{.Id}') if [ "$remoteid" != "$localid" ]; then docker image tag "$localimg" "$localimg.$datestamp" docker image tag "$remoteimg" "$localimg" docker image push "$localimg.$datestamp" docker image push "$localimg" fi @sudo_bmitch30 / 35$

Why All the Complication?
@sudo_bmitch31 / 35

Advantages of Manually Mirroring
Over Automatically Syncing Repos:
Changes to images happen on your schedule
Backout option exists with breaking changes
Over Pull Through Cache
Those reasons plus...
Pushing locally built images to the registry
Upstream outage doesn't stop local builds/deploys
@sudo_bmitch32 / 35

$Risks of Manually Mirroring Images go stale if you do not automate the script Adding new images is an added process Recovering from a mirror outage requires populating images FROM line in images needs to point to mirror ARG REGISTRY=docker.io FROM ${REGISTRY}/alpine:3.9 ... docker build --build-arg REGISTRY=local-mirror:5000 . @sudo_bmitch33 / 35$

Summary
Both
Saves bandwidth
Faster builds
Pull Through Cache
Easy to create
Little maintenance
Managed Mirror
Control changes
Tolerate upstream outages
@sudo_bmitch34 / 35

Brandon Mitchell
Twitter: @sudo_bmitch
GitHub: sudo-bmitch
Thank You
github.com/sudo-bmitch/presentations
35 / 35

This document discusses Docker, including what it is, why it is used, and how it works. Docker provides lightweight software containers that package code and its dependencies so the application runs quickly and consistently on any computing infrastructure. It allows applications to be easily deployed and migrated across computing environments. The document outlines how Docker addresses issues like managing multiple software stacks and hardware environments by creating portable containers that can be run anywhere without reconfiguration. Examples of using Docker for microservices, DevOps, and data centers are also provided.

What Is A Docker Container? | Docker Container Tutorial For Beginners| Docker...Simplilearn

This presentation on Docker Container will help you understand what is Docker, the architecture of Docker, what is a Docker Container, how to create a Docker Container, benefits of Docker Container, basic commands of Containers and you will also see a demo on creating Docker Container. Docker is a very lightweight software container and containerization platform. Docker containers provide a way to run software in isolation. It is an open source platform that helps to package an application and its dependencies into a Docker container for the development and deployment of software and a Docker COntainer is a portable executable package which includes applications and their dependencies. With Docker Containers, applications can work efficiently in different computer environments. Below DevOps tools are explained in this Docker Container presentation: 1. What is Docker? 2. The architecture of Docker? 3. What is a Docker Container? 4. How to create a Docker Container? 5. Benefits of Docker Containers 6. Basic commands of Containers Simplilearn's DevOps Certification Training Course will prepare you for a career in DevOps, the fast-growing field that bridges the gap between software developers and operations. You’ll become an expert in the principles of continuous development and deployment, automation of configuration management, inter-team collaboration and IT service agility, using modern DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios. DevOps jobs are highly paid and in great demand, so start on your path today. Why learn DevOps? Simplilearn’s DevOps training course is designed to help you become a DevOps practitioner and apply the latest in DevOps methodology to automate your software development lifecycle right out of the class. You will master configuration management; continuous integration deployment, delivery and monitoring using DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios in a practical, hands-on and interactive approach. The DevOps training course focuses heavily on the use of Docker containers, a technology that is revolutionizing the way apps are deployed in the cloud today and is a critical skillset to master in the cloud age. After completing the DevOps training course you will achieve hands-on expertise in various aspects of the DevOps delivery model. The practical learning outcomes of this Devops training course are: An understanding of DevOps and the modern DevOps toolsets The ability to automate all aspects of a modern code delivery and deployment pipeline using: 1. Source code management tools 2. Build tools 3. Test automation tools 4. Containerization through Docker 5. Configuration management tools 6. Monitoring tools DevOps jobs are the third-highest tech role ranked by employer demand on Indeed.com but have the second-highest talent deficit. Learn more at https://www.simplilearn.com/cloud-computing/devops-practitioner-certification-training

Docker Container SecuritySuraj Khetani

What Is Docker? | What Is Docker And How It Works? | Docker Tutorial For Begi...Simplilearn

This presentation on Docker will help you understand DevOps tools, why Docker is needed, Docker vs Virtual Machine, what is Docker, how does a Docker work and components of Docker. Docker is a tool which is used to automate the deployment of the application in lightweight containers so that applications can work efficiently in different environments. A container is a software package that consists of all the dependencies required to run an application. Until now we have been running applications on virtual machines. Every virtual machine used to be the base of our application but now with the advent of Docker and containerization technologies, each application is run in a container like logical space. Now, let us get started and learn what exactly is Docker. Below topics are explained in this Docker presentation: 1. DevOps and its tools 2. What is Docker? 3. How does Docker work? 4. What are the components of Docker? Simplilearn's DevOps Certification Training Course will prepare you for a career in DevOps, the fast-growing field that bridges the gap between software developers and operations. You’ll become an expert in the principles of continuous development and deployment, automation of configuration management, inter-team collaboration and IT service agility, using modern DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios. DevOps jobs are highly paid and in great demand, so start on your path today. Why learn DevOps? Simplilearn’s DevOps training course is designed to help you become a DevOps practitioner and apply the latest in DevOps methodology to automate your software development lifecycle right out of the class. You will master configuration management; continuous integration deployment, delivery and monitoring using DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios in a practical, hands-on and interactive approach. The DevOps training course focuses heavily on the use of Docker containers, a technology that is revolutionizing the way apps are deployed in the cloud today and is a critical skillset to master in the cloud age. Who should take this course? DevOps career opportunities are thriving worldwide. DevOps was featured as one of the 11 best jobs in America for 2017, according to CBS News, and data from Payscale.com shows that DevOps Managers earn as much as $122,234 per year, with DevOps engineers making as much as $151,461. DevOps jobs are the third-highest tech role ranked by employer demand on Indeed.com but have the second-highest talent deficit. 1. This DevOps training course will be of benefit for the following professional roles: 2. Software Developers 3. Technical Project Managers 4. Architects 5. Operations Support 6. Deployment engineers 7. IT managers 8. Development managers Learn more at: https://www.simplilearn.com/

Docker multi-stage buildAlexei Ledenev

Introduction to Docker - IndiaOpsUGAjeet Singh Raina

- The document introduces Docker, explaining that it provides standardization for packaging software applications and dependencies to make them portable and help transition from monolithic to microservices architectures. - Docker uses operating system-level virtualization rather than hardware virtualization, allowing containers to start quickly while remaining isolated and using fewer resources than virtual machines. - The document covers Docker concepts like images, containers, and registries, and provides examples of common Docker commands for pulling images, running containers, and managing the Docker workflow of building, shipping, and running applications.

Managing PostgreSQL with AnsibleEDB

Docker Compose | Docker Compose Tutorial | Docker Tutorial For Beginners | De...Simplilearn

This presentation about Docker will help you learn what Docker and Docker compose is, benefits of Docker compose, differences between Docker compose and Docker swarm, basic commands of docker compose and finally, a demo on docker compose. Docker is a tool which runs containers, whereas Docker Compose is used for running multiple containers as a single service. With compose, containers run in isolation (but they interact with each other). After watching this video, you will able to create a YAML file of docker compose and run multiple containers at a time. Now, let us get started and understand how does a Docker compose work. Below are the topics covered in this Docker compose presentation: 1. What is Docker? 2. What is a Docker Compose? 3. Benefits of Docker compose 4. Docker Compose vs Docker Swarm 5. Basic commands of Docker 6. Demo Why learn DevOps? Simplilearn’s DevOps training course is designed to help you become a DevOps practitioner and apply the latest in DevOps methodology to automate your software development lifecycle right out of the class. You will master configuration management; continuous integration deployment, delivery and monitoring using DevOps tools such as Git, Docker, Jenkins, Puppet and Nagios in a practical, hands on and interactive approach. The Devops training course focuses heavily on the use of Docker containers, a technology that is revolutionizing the way apps are deployed in the cloud today and is a critical skillset to master in the cloud age. After completing the DevOps training course you will achieve hands on expertise in various aspects of the DevOps delivery model. The practical learning outcomes of this Devops training course are: An understanding of DevOps and the modern DevOps toolsets The ability to automate all aspects of a modern code delivery and deployment pipeline using: 1. Source code management tools 2. Build tools 3. Test automation tools 4. Containerization through Docker 5. Configuration management tools 6. Monitoring tools Who should take this course? DevOps career opportunities are thriving worldwide. DevOps was featured as one of the 11 best jobs in America for 2017, according to CBS News, and data from Payscale.com shows that DevOps Managers earn as much as $122,234 per year, with DevOps engineers making as much as $151,461. DevOps jobs are the third-highest tech role ranked by employer demand on Indeed.com but have the second-highest talent deficit. 1. This DevOps training course will be of benefit the following professional roles: 2. Software Developers 3. Technical Project Managers 4. Architects 5. Operations Support 6. Deployment engineers 7. IT managers 8. Development managers Learn more at https://www.simplilearn.com/cloud-computing/devops-practitioner-certification-training

Docker 101: Introduction to DockerDocker, Inc.

This document provides an introduction to Docker. It discusses why Docker is useful for isolation, being lightweight, simplicity, workflow, and community. It describes the Docker engine, daemon, and CLI. It explains how Docker Hub provides image storage and automated builds. It outlines the Docker installation process and common workflows like finding images, pulling, running, stopping, and removing containers and images. It promotes Docker for building local images and using host volumes.

Introduction to dockerInstruqt

Docker is a tool that allows users to package applications into containers to run on Linux servers. Containers provide isolation and resource sharing benefits compared to virtual machines. Docker simplifies deployment of containers by adding images, repositories and version control. Popular components include Dockerfiles to build images, Docker Hub for sharing images, and Docker Compose for defining multi-container apps. Docker has gained widespread adoption due to reducing complexity of managing containers across development and operations teams.

Presentation On Group Policy in Windows Server 2012 R2 By Barek-ITMd. Abdul Barek

This document provides instructions for creating a starter Group Policy Object (GPO) in 7 steps: 1) Open the Group Policy Management tool; 2) Expand the forest and domain; 3) Right click to create a new GPO or folder; 4) Name the new GPO; 5) Edit the GPO assignment; 6) Configure user configuration settings like the desktop; 7) Enable settings and apply the policy. It also describes how to back up an existing GPO and restore it from the backup.

Introduction to DockerLuong Vo

Docker allows applications to be packaged with all their dependencies and run consistently across computing environments. It provides isolation, security and portability for applications. This document discusses setting up an Eh Avatar application to run in Docker containers for Postgres, Redis and the application itself. It covers bringing up the dependency containers, building a custom Docker image for the application, and using Docker Compose to define and run the multi-container application. While this provides an introduction, there is still more to learn about optimizing Docker usage and avoiding common pitfalls.

Docker Swarm 0.2.0Docker, Inc.

Docker Introduction.pdfOKLABS

Docker introductionPhuc Nguyen

The document introduces Docker, a container platform. It discusses how Docker addresses issues with deploying different PHP projects that have varying version requirements by allowing each project to run isolated in its own container with specified dependencies. It then covers key Docker concepts like images, containers, linking, exposing ports, volumes, and Dockerfiles. The document highlights advantages of Docker like enabling applications to run anywhere without compatibility issues and making deployment more efficient.

Docker Networking | Container Network Model (CNM) | Docker Tutorial For Begin...Edureka!

** DevOps Training: https://www.edureka.co/devops ** This Edureka tutorial on Docker Networking will explain to you the fundamentals of Docker Networking with a hands-on. Below are the topics covered in the tutorial: 1. What is Docker? 2. Docker Networking 3. Goals of Docker Networking 4. Container Network Model (CNM) 5. Network Drivers 6. Hands-On Check our complete DevOps playlist here (includes all the videos mentioned in the video): http://goo.gl/O2vo13

From Zero to DockerAbhishek Verma

The document discusses Docker and containerization. It introduces Docker Enterprise Edition which provides end-to-end features for container apps along with enterprise grade security and support. It also discusses Docker Assemble, a tool that can build an optimized Docker container from source code without needing a Dockerfile by detecting frameworks, adding dependencies, and optimizing the image. The document demonstrates using Docker Assemble and deploying containers to Docker Universal Control Plane (UCP) for cluster management.

Docker, LinuX ContainerAraf Karsh Hamid

Introduzione a Docker (Maggio 2017) [ITA]Valerio Radice

Introduction to Docker storage, volume and imageejlp12

Docker storage drivers allow images and containers to be stored in different ways by implementing a pluggable storage driver interface. Common storage drivers include overlay2, aufs, devicemapper, and vfs. Images are composed of read-only layers stacked on top of each other, with containers adding a writable layer. Storage can be persisted using volumes, bind mounts, or tmpfs mounts. Strategies for managing persistent container data include host-based storage, volume plugins, and container storage platforms.

Kubernetes Deployment Tutorial | Kubernetes Tutorial For Beginners | Kubernet...Edureka!

( Kubernetes Certification Training: https://www.edureka.co/kubernetes-certification ) This Edureka tutorial on "Kubernetes Deployment Tutorial " will help you understand the various concepts related to Deployment in Kubernetes. The topics included in this session are: 1. What is Kubernetes? 2. What is a Pod? 3. Replication Controller & ReplicaSet 4. Deployment Controllers 5. Deployment Use-Cases DevOps Tutorial Blog Series: https://goo.gl/P0zAfF Follow us to never miss an update in the future. Instagram: https://www.instagram.com/edureka_learning/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

Docker BasicsEueung Mulyana

This document discusses containers, virtual machines, and Docker. It provides an overview of containers and how they differ from virtual machines by sharing the host operating system kernel and making more efficient use of system resources. The document then covers Docker specifically, explaining that Docker uses containerization to package applications and dependencies into standardized units called containers. It also provides examples of Docker commands to build custom images and run containers.

Docker란 무엇인가? : Docker 기본 사용법pyrasis

DCEU 18: Dockerfile Best PracticesDocker, Inc.

This document discusses best practices for writing Dockerfiles. It begins with a refresher on images, Dockerfile build processes, and areas for improvement. Examples are provided of optimizing a sample Dockerfile to improve build caching, reduce image size, and increase reproducibility. Specific techniques covered include ordering commands to leverage caching, using official base images, multi-stage builds, and build arguments. Benchmarks show the optimized Dockerfile builds faster and produces smaller images.

Dockers and kubernetesDr Ganesh Iyer

Docker NetworkingKingston Smiler

Docker networking allows containers to communicate in several ways. Containers can communicate using Docker's default bridge (Docker0), by binding container ports to the host's ports, or using the host's network stack directly. More advanced options include linking containers to share information, using overlay networks with technologies like Open vSwitch, or running containers across multiple hosts with tunnels. The document provides examples of setting up different Docker networking configurations and discusses which methods suit different communication requirements between containers, hosts, and external networks.

MySQL Monitoring using Prometheus & GrafanaYoungHeon (Roy) Kim

This document describes how to set up monitoring for MySQL databases using Prometheus and Grafana. It includes instructions for installing and configuring Prometheus and Alertmanager on a monitoring server to scrape metrics from node_exporter and mysql_exporter. Ansible playbooks are provided to automatically install the exporters and configure Prometheus. Finally, steps are outlined for creating Grafana dashboards to visualize the metrics and monitor MySQL performance.

쿠버네티스를 이용한 기능 브랜치별 테스트 서버 만들기 (GitOps CI/CD)충섭 김

어떻게 하면 배포 프로세스를 빠르게 개선할 수 있을까요? git branch를 푸시하고 개별 테스트 서버를 만드려면 어떻게 해야 할까요? 쿠버네티스와 GitOps, Argo CD를 이용한 배포 방법을 소개 합니다. Open Infrastructure & Cloud Native Days Korea 2019 발표자료 원본 슬라이드 다운로드 - http://bit.ly/subicura-gitops

DCSF19 Tips and Tricks of the Docker Captains Docker, Inc.

Brandon Mitchell, BoxBoat Docker Captain Brandon Mitchell will help you accelerate your adoption of Docker containers by delivering tips and tricks on getting the most out of Docker. Topics include managing disk usage, preventing subnet collisions, debugging container networking, understanding image layers, getting more value out of the default volume driver, and solving the UID/GID permission issues with volumes in a way that allows images to be portable from any developer laptop and to production.

Optimizing Your CI PipelinesSebastian Witowski

More Related Content

What's hot (20)

Docker 101: Introduction to DockerDocker, Inc.

Introduction to dockerInstruqt

Presentation On Group Policy in Windows Server 2012 R2 By Barek-ITMd. Abdul Barek

Introduction to DockerLuong Vo

Docker Swarm 0.2.0Docker, Inc.

Docker Introduction.pdfOKLABS

Docker introductionPhuc Nguyen

Docker Networking | Container Network Model (CNM) | Docker Tutorial For Begin...Edureka!

From Zero to DockerAbhishek Verma

Docker, LinuX ContainerAraf Karsh Hamid

Introduzione a Docker (Maggio 2017) [ITA]Valerio Radice

Introduction to Docker storage, volume and imageejlp12

Kubernetes Deployment Tutorial | Kubernetes Tutorial For Beginners | Kubernet...Edureka!

Docker BasicsEueung Mulyana

Docker란 무엇인가? : Docker 기본 사용법pyrasis

DCEU 18: Dockerfile Best PracticesDocker, Inc.

Dockers and kubernetesDr Ganesh Iyer

Docker NetworkingKingston Smiler

MySQL Monitoring using Prometheus & GrafanaYoungHeon (Roy) Kim

쿠버네티스를 이용한 기능 브랜치별 테스트 서버 만들기 (GitOps CI/CD)충섭 김

Docker 101: Introduction to DockerDocker, Inc.

Introduction to dockerInstruqt

Presentation On Group Policy in Windows Server 2012 R2 By Barek-ITMd. Abdul Barek

Introduction to DockerLuong Vo

Docker Swarm 0.2.0Docker, Inc.

Docker Introduction.pdfOKLABS

Docker introductionPhuc Nguyen

Docker Networking | Container Network Model (CNM) | Docker Tutorial For Begin...Edureka!

From Zero to DockerAbhishek Verma

Docker, LinuX ContainerAraf Karsh Hamid

Introduzione a Docker (Maggio 2017) [ITA]Valerio Radice

Introduction to Docker storage, volume and imageejlp12

Kubernetes Deployment Tutorial | Kubernetes Tutorial For Beginners | Kubernet...Edureka!

Docker BasicsEueung Mulyana

Docker란 무엇인가? : Docker 기본 사용법pyrasis

DCEU 18: Dockerfile Best PracticesDocker, Inc.

Dockers and kubernetesDr Ganesh Iyer

Docker NetworkingKingston Smiler

MySQL Monitoring using Prometheus & GrafanaYoungHeon (Roy) Kim

쿠버네티스를 이용한 기능 브랜치별 테스트 서버 만들기 (GitOps CI/CD)충섭 김

Similar to How to Use Mirroring and Caching to Optimize your Container Registry (20)

DCSF19 Tips and Tricks of the Docker Captains Docker, Inc.

Optimizing Your CI PipelinesSebastian Witowski

Learning Docker with ThomasThomas Tong, FRM, PMP

This document summarizes a presentation about using Docker for development. It discusses installing Docker, running a "Hello World" Docker image, building a custom Python Docker image, and composing a more complex Docker application with PHP, MySQL, and Apache. The benefits of Docker like lightweight containers, easy environment setup, and scalability are highlighted. Some challenges with scaling and orchestration are also mentioned, along with solutions like Docker Swarm and Kubernetes.

Into to Docker (Central PA Java User Group - 8/14/2017)Mike Melusky

This document provides an introduction to Docker, including what Docker is, how it differs from virtual machines, basic Docker commands, examples of running common applications like GitLab and JIRA in Docker containers, and considerations for when to use and not use Docker. Docker allows containerized execution of isolated applications, sharing resources for lighter weight usage than virtual machines. Examples demonstrate pulling public images and running containers from them to execute applications like Python, GitLab and JIRA.

5 Things I Wish I Knew About Gitlab CISebastian Witowski

The document discusses 5 things the author wishes they knew about Gitlab CI: 1. Jobs can be set as interruptible to stop long-running tasks. 2. Caching can be used and configured to pull or push cache between jobs to improve performance. 3. Slow tests can be split into separate jobs or run last to speed up pipelines. 4. Hidden jobs and anchors can be used to reuse configuration parts. 5. Self-hosted runners can save money and provide more flexibility compared to Gitlab shared runners.

Docker and Your Path to a Better Staging Environment - webinar by Gil TayarApplitools

** Full webinar recording here: https://youtu.be/cJqSr7ySTfo ** Staging environments are notoriously difficult to setup and maintain. Unless you have a top-notch DevOps team, staging environments are usually different from production environments, and because of that, are fraught with problems—from failing deployments, to out-of-disk-space errors, and various other errors. Even when the staging environment is great, it has one problem—there’s only one. If you want to test a feature branch, you have to “allocate time”, or alternatively install the feature branch and risk disrupting other testers. It’s time the testers took control! And build their own testing environments using Docker, Docker-Compose, and Kubernetes. In this talk, Sr. Software Architect Gil Tayar shows how to deploy an app on your local machine using Docker and Docker Compose, and run an E2E test on it. He also describes the necessary changes needed to make the application deployable in such a setup—turning it into a Twelve-Factor Application. Watch this hands-on session. and enjoy these key takeaways: Remind yourself why staging environments are problematic -- Learn what Docker is -- Quickly deploy an app that includes a frontend, backend service, and database, and run an E2E test on it -- Learn how Docker, Docker Compose and Kubernetes can help you easily build multiple ephemeral staging environments -- Enable you to help developers change their code so that it can be deployed using a Docker setup

20150317 firefox os_studymtg_engverNaoki Sekiguchi

Cloud RPI4 tomcat ARM64Jean-Frederic Clere

This document discusses running Kubernetes on Raspberry Pi 4 boards to create a low-cost Kubernetes cloud. It describes setting up the infrastructure including an HTTP server, DHCP server, and DNS registry. It then covers building a custom Raspberry Pi 4 kernel, installing it on the boards, and configuring WiFi. Next, it discusses deploying Kubernetes with one master node and two worker nodes. Finally, it demonstrates running a multi-container Tomcat application on the Kubernetes cluster.

Git submoduleOlaf Alders

Git submodules allow a repository to include a checkout of an external project as a subdirectory. Submodules maintain their own identity and commit information, so other developers cloning the main project can also easily clone the submodules. Partial checkouts are possible, allowing developers to choose which submodules to clone. When other developers clone a repository with submodules, they need to run additional commands to initialize and update the submodules.

20131015_demo_oshkJeff Yang

This document summarizes demos to be presented at the OpenStack Hong Kong Summit. It includes: 1) A demonstration of SmartCloud Orchestrator 2.3 capabilities including a virtual image library and SCO deployed on SoftLayer infrastructure. 2) A demonstration of SoftLayer integration with SCO and OpenStack, including provisioning, monitoring, and DevOps tools. 3) A presentation of best practices from a China Unicom production environment including OpenStack high availability, monitoring, and bare-metal provisioning.

Securité des containerRachid Zarouali

vBACD - Introduction to Opscode Chef - 2/29CloudStack - Open Source Cloud Computing Project

The shift to cloud computing means that organizations are undergoing a major shift as they develop scale-out infrastructure that can respond to apace of business change faster than ever before. Opscode Chef® is an open-source systems integration framework build specifically for automating the cloud by making it easy to deploy and scale servers and applications throughout your infrastructure. Join us for this session containing an introduction to Chef including: An Overview of Chef The Chef Architecture Cookbook Components System Integration Live demo launching a Java Stack on Amazon EC2, Rackspace, Ubuntu, and CentOS [Presented as part of the Open Source Build a Cloud program on 2/29/2012 - http://cloudstack.org/about-cloudstack/cloudstack-events.html?categoryid=6]

GitLab on OpenShiftConSol Consulting & Solutions Software GmbH

The document discusses installing and managing GitLab on OpenShift. It covers preparatory steps like installing required software and configuring permissions. It then describes installing GitLab using Helm charts, including composing a values file. The document discusses issues that may occur and how to fix them. It also covers upgrading GitLab, backup and restore processes, disaster recovery, and data migration.

Serverless containers … with source-to-imageJosef Adersberger

There will be a future where container workloads and serverless platforms are BFF. An essential building block on this way is Source2Image. It provides the magic of source code being transformed automatically into an executable container image containing all required runtime components. Think of it as a black box continuous integration server for containerized applications. The talk will introduce, showcase, and compare leading Source2Image open source projects.

Serverless Container with Source2ImageQAware GmbH

Serverless Computing 2019, November 2019, London: Talk by Josef Adersberger (@adersberger, CTO QAware) === Please download slides if blurred! === Abstract: There will be a future where container workloads and serverless platforms are BFF. An essential building block on this way is Source2Image. It provides the magic of source code being transformed automatically into an executable container image containing all required runtime components. Think of it as a black box continuous integration server for containerized applications. The talk will introduce, showcase, and compare leading Source2Image open source projects like Skaffold, OpenShift S2I, buildpacks.io, Draft, Knative Build, and Garden.

The Container Security Checklist LibbySchulze

This document is a summary of a webinar on securing container deployments. It lists several important items to consider when securing containers including: running builds separately from production clusters; treating containers as immutable; avoiding privileged containers; keeping hosts updated; encrypting secrets; and preventing container drift. The document provides instructions on how to provide feedback on the webinar series and lists upcoming webinar topics.

Lights, Camera, Docker: Streaming Video at DramaFeverbridgetkromhout

Bridget Kromhout gave a presentation on how her company DramaFever uses Docker for streaming video. They run Docker in production and have seen peak loads of tens of thousands of requests per second. They use Docker, AWS, and other technologies to build and deploy images automatically and scale their infrastructure elastically. Bridget discussed challenges they faced with Docker and solutions like changing the storage driver and registry configuration to address issues with builds and image pulls failing.

- Codemotion Rome 2015Codemotion

This document discusses IBM Bluemix and Docker. It provides an overview of Bluemix as an open standards cloud platform for building, running, and managing applications. It then discusses how Docker containers work and their benefits compared to virtual machines. Several demos are presented showing different scenarios for running a Node.js and CouchDB application locally and on Bluemix both traditionally and using Docker containers. References and documentation links are also provided.

Reusing your existing software on AndroidTetsuyuki Kobayashi

The document discusses running existing software on Android by either running the binary directly on Android, rebuilding the software for Android, or running the Android system on an existing Linux environment. It provides examples of copying dependency libraries to run an existing binary on Android. It also discusses creating an Android.mk file or using a configure script to rebuild software for the Android environment. Finally, it outlines a process to run the entire Android system framework within a chroot on an Ubuntu Linux system on the target hardware.

XPDDS18: A dive into kbuild - Cao jin, FujitsuThe Linux Foundation

Kernel developers may have experience in writing makefiles for the linux kernel. In many cases, maybe just adding lines like "obj-$(CONFIG_FOO) += foo.o" to a makefile. But, probably there is not many people really know what's going on behind this cool build system. In this talk, Cao jin will dive into the Kbuild internals. Starting from the basics of GNU Make, he will explain how Kbuild works, and in the end, produces vmlinux, bzImage, modules. The talk will also focus on some smart tricks used in Kbuild. At last, he will give a introduction about how Xen project is related with this config/build system.

DCSF19 Tips and Tricks of the Docker Captains Docker, Inc.

Optimizing Your CI PipelinesSebastian Witowski

Learning Docker with ThomasThomas Tong, FRM, PMP

Into to Docker (Central PA Java User Group - 8/14/2017)Mike Melusky

5 Things I Wish I Knew About Gitlab CISebastian Witowski

Docker and Your Path to a Better Staging Environment - webinar by Gil TayarApplitools

20150317 firefox os_studymtg_engverNaoki Sekiguchi

Cloud RPI4 tomcat ARM64Jean-Frederic Clere

Git submoduleOlaf Alders

20131015_demo_oshkJeff Yang

Securité des containerRachid Zarouali

vBACD - Introduction to Opscode Chef - 2/29CloudStack - Open Source Cloud Computing Project

GitLab on OpenShiftConSol Consulting & Solutions Software GmbH

Serverless containers … with source-to-imageJosef Adersberger

Serverless Container with Source2ImageQAware GmbH

The Container Security Checklist LibbySchulze

Lights, Camera, Docker: Streaming Video at DramaFeverbridgetkromhout

- Codemotion Rome 2015Codemotion

Reusing your existing software on AndroidTetsuyuki Kobayashi

XPDDS18: A dive into kbuild - Cao jin, FujitsuThe Linux Foundation

More from Docker, Inc. (20)

Containerize Your Game Server for the Best Multiplayer Experience Docker, Inc.

Raymond Arifianto, AccelByte and Mark Mandel, Google - We have been deploying containerized micro-services for our Game Backend Services for a while. Now we are tackling the challenge to scale up fleets of game dedicated servers in multiple regions, multiple data centers and multiple providers - some in bare metal, some in Cloud. So we leverage docker containerization to deploy Game Servers to achieve Portability, Fast Deployment and Predictability, enabling us to scale up to thousands of servers, on demand, without a sweat.

How to Improve Your Image Builds Using Advance Docker BuildDocker, Inc.

Nicholas Dille, Haufe-Lexware + Docker Captain - Docker continues to be the standard tool for building container images. For more than a year Docker ships with BuildKit as an alternative image builder, providing advanced features for secret and cache management. These features help to make image builds faster and more secure. In this session, Docker Captain Nicholas Dille will teach you how to use Buildkit features to your advantage.

Build & Deploy Multi-Container Applications to AWSDocker, Inc.

Lukonde Mwila, Entelect - As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Securing Your Containerized Applications with NGINXDocker, Inc.

How To Build and Run Node Apps with Docker and ComposeDocker, Inc.

Kathleen Juell, Digital Ocean - Containers are an essential part of today's microservice ecosystem, as they allow developers and operators to maintain standards of reliability and reproducibility in fast-paced deployment scenarios. And while there are best practices that extend across stacks in containerized environments, there are also things that make each stack distinct, starting with the application image itself. This talk will dive into some of these particularities, both at the image and service level, while also covering general best practices for building and running Node applications with database backends using Docker and Compose.

Hands-on Helm Docker, Inc.

Distributed Deep Learning with Docker at SalesforceDocker, Inc.

Jeff Hajewski, Salesforce - There is a wealth of information on building deep learning models with PyTorch or TensorFlow. Anyone interested in building a deep learning model is only a quick search away from a number of clear and well written tutorials that will take them from zero knowledge to having a working image classifier. But what happens when you need to deploy these models in a production setting? At Salesforce, we use TensorFlow models to help us provide customers with insights into their data, and we do this as close to real-time as possible. Designing these systems in a scalable manner requires overcoming a number of design challenges, but the core component is Docker. Docker enables us to design highly scalable systems by allowing us to focus on service interactions, rather than how our services will interact with the hardware. Docker is also at the core of our test infrastructure, allowing developers and data scientists to build and test the system in an end to end manner on their local machines. While some of this may sound complex, the core message is simplicity - Docker allows us to focus on the aspects of the system that matter, greatly simplifying our lives.

The First 10M Pulls: Building The Official Curl Image for Docker HubDocker, Inc.

James Fuller, webcomposite s.r.o. - Curl is the venerable (yet very modern) 'swiss army knife' command line tool and library for transferring data with URLs. Recently we (the Curl team) decided to build a release for Docker Hub. This talk will outline our current development workflow with respect to the docker image and provide insights on what it takes to build a docker image for mass public consumption. We are also keen to learn from users and other developers how we might improve and enhance the official curl docker image.

Monitoring in a Microservices WorldDocker, Inc.

Fabian Stäber, Instana - In recent years, we saw a great paradigm shift in software engineering away from static monolithic applications towards dynamic distributed horizontally scalable architectures. Docker is one of the key technologies enabling this development. This shift poses a lot of new challenges for application monitoring, ranging from practical issues (need for automation) to technical challenges (Docker networking) to organizational topics (blurring line between software engineers and operations) to fundamental questions (define what is an application). In this talk we show how Docker changed the way we do monitoring, how modern application monitoring systems work, and what future developments we expect.

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...Docker, Inc.

Clemente Biondo, Engineering Ingegneria Informatica - When the COVID 19 pandemic started, Engineering Ingegneria Informatica Group (1.25 billion euros of revenues, 65 offices around the world, 12.000 employees) was forced to put their digital transformation to the test in order to maintain operational continuity. In this session, Clemente Biondo, the Tech Lead of the Information Systems Department, will share how his company is reacting to this unforeseeable scenario and how Docker-driven digital transformation had paved the path for work to continue remotely. Clemente will discuss learnings moving from colocated teams, manual approaches, email based-business processes, and a monolithic application to a mature DevOps culture characterized by a distributed autonomous workforce and a continuous deployment process that deploys backward-compatible Docker containerized microservices into hybrid multi cloud datacenters an average of twice a day with zero-downtime. He will detail how they use Docker to unify dev, test and production environments, and as an efficient and automated mechanism for deploying applications. Lastly, Clemente shares how, in our darkest hour, he and others are working to shine their brightest light.

Predicting Space Weather with DockerDocker, Inc.

The document discusses how NOAA's Space Weather Prediction Center transitioned from a monolithic architecture to microservices using Docker. It describes how they started with a small verification project, then replaced their critical GOES satellite data source. This improved developers' morale and delivery speed. They encountered some security issues initially but learned from them. The transition was very successful and allowed them to quickly expand their mission to forecast aviation impacts using scientists' models packaged as Docker services.

Become a Docker Power User With Microsoft Visual Studio CodeDocker, Inc.

Brian Christner, 56k + Docker Captain - In this session, we will unlock the full potential of using Microsoft Visual Studio Code (VS Code) and Docker Desktop to turn you into a Docker Power User. When we expand and utilize the VS Code Docker plugin, we can take our projects and Docker skills to the next level. In addition to using VS Code, we streamline our Docker Desktop development workflow with less context switching and built-in shortcuts. You will learn how to bootstrap new projects, quickly write Dockerfiles utilizing templates, build, run, and interact with containers all from VS Code.

Monolithic to Microservices + Docker = SDLC on Steroids!Docker, Inc.

Ashish Sharma, SS&C Eze - SS&C Eze provides various products in the stock market domain. We spent the last couple of years building Eclipse which is an investment suite born in cloud. The journey so far has been very interesting. The very first version of the product were a bunch of monolithic windows services and deployed using Octopus tool. We successfully managed to bring all the monolithic problem to the cloud and created a nightmare for ourselves. We then started applying microservices architecture principles and started breaking the monolithic into small services. Very soon we realized that we need a better packaging/deployment tool. Docker looked like a magical solution to our problem. Since its adoption, It has not only solved the deployment problem for us but has made a deep impact on different aspects of SDLC. It allowed us to use heterogeneous technology stacks, simplified development environment setup, simplified our testing strategy, improved our speed of delivery, and made our developers more productive. In this talk I would like to share our experience of using Docker and its positive impact on our SDLC.

Kubernetes at Datadog ScaleDocker, Inc.

Kubernetes networking can be complex to scale due to issues like growing iptables rules, but newer solutions are helping. Pod networking uses CNI plugins like flannel or Calico to assign each pod an IP and allow communication. Service networking uses kube-proxy and iptables or IPVS for load balancing to pods. DNS is used to resolve service names to IPs. While Kubernetes networking brings flexibility, operators must learn the nuances of their specific CNI plugin and issues can arise, but the ecosystem adapts quickly to new needs and changes don't impact all workloads.

Labels, Labels, Labels Docker, Inc.

Andy Clemenko, StackRox - One underutilized, and amazing, thing about the docker image scheme is labels. Labels are a built in way to document all aspects about the image itself. Think about all the information that the tags inside your clothing carry. If you care to look you can find out everything about the garment. All that information can be very valuable. Now think about how we can leverage labels to carry similar information. We can even use the labels to contain Docker Compose or even Kubernetes Yaml. We can even include labels into the CI/CD process making things more secure and smoother. Come find out some fun techniques on how to leverage labels to do some fun and amazing things.

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment ModelDocker, Inc.

Micro Focus uses Docker Hub at scale to support its software delivery and deployment model. Some key points: - Docker Hub is used as the registry service for Micro Focus container images - It allows for optimized, secure, reliable and cost-effective software delivery through deployments and updates of container images to customers and partners - Micro Focus leverages features like private repositories, offline/online access, signing and scanning of images, and integration with CI/CD pipelines - Over 1,650 organizations, 450 repositories, and 18 teams are used on Docker Hub to manage access and deliver software from Micro Focus

Build & Deploy Multi-Container Applications to AWSDocker, Inc.

Lukonde Mwila, Entelect As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...Docker, Inc.

Elton Stoneman, Docker Captain + Container Consultant and Trainer How do you provide a SaaS offering when your product is a 10-year old Fortran app, currently built to run on Windows 10? With Docker and Kubernetes of course - and you can do it in a week (... to prototype level at least). In this session I'll walk through the processes and practicalities of taking an older Windows app, making it run in containers with Kubernetes, and then building a simple API wrapper to host the whole stack as a cloud-based SaaS product. There's a lot of technology here from a real world case study, and I'll focus on: - running Windows apps in Docker containers - building a .NET Core API which can run in Linux or Windows containers - running the stack in Kubernetes with Docker Desktop locally and AKS in the cloud - configuring AKS workloads in Azure to burst out to Azure Container Instances And there's a core theme to this session: Docker and Kubernetes are complex technologies, but they're the key to modern development. If you invest time learning them, they make projects like this simple, portable, fast and fun.

Developing with Docker for the Arm ArchitectureDocker, Inc.

This virtual meetup introduces the concepts and best practices of using Docker containers for software development for the Arm architecture across a variety of hardware systems. Using Docker Desktop on Windows or Mac, Amazon Web Services (AWS) A1 instances, and embedded Linux, we will demonstrate the latest Docker features to build, share, and run multi-architecture images with transparent support for Arm.

Sharing is Caring: How to Begin Speaking at ConferencesDocker, Inc.

For many, the idea of speaking in front of a bunch of strangers can be enough to prevent you from ever responding to a CFP. But don't let it! Speaking at conferences, meetups, or even at your own company is a fantastic way to share you knowledge, meet others, advance your career, and give back. Whether you are on the fence, have decided to take the plunge and submit a CFP, or have already even a few talks, this session is for you. Drawing on their experience reviewing DockerCon CFPs and prepping speakers (including themselves) for a variety of conferences, Jenny Burcio and Ashlynn Polini will outline tips and strategies for turning your idea into a winning proposal and ultimately a compelling talk. They will share how to submit and prepare for your first - or next - conference talk.

Containerize Your Game Server for the Best Multiplayer Experience Docker, Inc.

How to Improve Your Image Builds Using Advance Docker BuildDocker, Inc.

Build & Deploy Multi-Container Applications to AWSDocker, Inc.

Securing Your Containerized Applications with NGINXDocker, Inc.

How To Build and Run Node Apps with Docker and ComposeDocker, Inc.

Hands-on Helm Docker, Inc.

Distributed Deep Learning with Docker at SalesforceDocker, Inc.

The First 10M Pulls: Building The Official Curl Image for Docker HubDocker, Inc.

Monitoring in a Microservices WorldDocker, Inc.

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...Docker, Inc.

Predicting Space Weather with DockerDocker, Inc.

Become a Docker Power User With Microsoft Visual Studio CodeDocker, Inc.

Monolithic to Microservices + Docker = SDLC on Steroids!Docker, Inc.

Kubernetes at Datadog ScaleDocker, Inc.

Labels, Labels, Labels Docker, Inc.

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment ModelDocker, Inc.

Build & Deploy Multi-Container Applications to AWSDocker, Inc.

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...Docker, Inc.

Developing with Docker for the Arm ArchitectureDocker, Inc.

Sharing is Caring: How to Begin Speaking at ConferencesDocker, Inc.

Recently uploaded (20)

Build Your Own Copilot & Agents For DevsBrian McKeiver

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

This is a Quick Research Guide (QRG). QRGs include the following: - A brief, high-level overview of the QRG topic. - A milestone timeline for the QRG topic. - Links to various free online resource materials to provide a deeper dive into the QRG topic. - Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic. QRGs planned for the series: - Artificial Intelligence QRG - Quantum Computing QRG - Big Data Analytics QRG - Spacecraft Guidance, Navigation & Control QRG (coming 2026) - UK Home Computing & The Birth of ARM QRG (coming 2027) Any questions or comments? - Please contact Arthur Morgan at [email protected]. 100% human made.

Salesforce AI Associate 2 of 2 Certification.docxJosé Enrique López Rivera

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Cyber Awareness overview for 2025 month of securityriccardosl1

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Splunk Security Update | Public Sector Summit Germany 2025Splunk

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

tecnologias de las primeras civilizaciones.pdffjgm517

Automation Dreamin': Capture User Feedback From AnywhereLynda Kane

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Rock, Paper, Scissors: An Apex Map Learning JourneyLynda Kane

AI and Data Privacy in 2025: Global TrendsInData Labs

In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy. This infographic contains: -AI and data privacy: Key findings -Statistics on AI data privacy in the today’s world -Tips on how to overcome data privacy challenges -Benefits of AI data security investments. Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.

Learn the Basics of Agile Development: Your Step-by-Step GuideMarcel David

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025 https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/ Is AI just another technology, or does it fundamentally change the way we live and think? Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater. At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts. At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

Join this UiPath Community Berlin meetup to explore the Orchestrator API, Swagger interface, and the Test Manager API. Learn how to leverage these tools to streamline automation, enhance testing, and integrate more efficiently with UiPath. Perfect for developers, testers, and automation enthusiasts! 📕 Agenda Welcome & Introductions Orchestrator API Overview Exploring the Swagger Interface Test Manager API Highlights Streamlining Automation & Testing with APIs (Demo) Q&A and Open Discussion Perfect for developers, testers, and automation enthusiasts! 👉 Join our UiPath Community Berlin chapter: https://community.uipath.com/berlin/ This session streamed live on April 29, 2025, 18:00 CET. Check out all our upcoming UiPath Community sessions at https://community.uipath.com/events/.

Build Your Own Copilot & Agents For DevsBrian McKeiver

Into The Box Conference Keynote Day 1 (ITB2025)Ortus Solutions, Corp

Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan

Salesforce AI Associate 2 of 2 Certification.docxJosé Enrique López Rivera

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Impelsys Inc.

Cyber Awareness overview for 2025 month of securityriccardosl1

ThousandEyes Partner Innovation Updates for May 2025ThousandEyes

Splunk Security Update | Public Sector Summit Germany 2025Splunk

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfAbi john

tecnologias de las primeras civilizaciones.pdffjgm517

Automation Dreamin': Capture User Feedback From AnywhereLynda Kane

Buckeye Dreamin 2024: Assessing and Resolving Technical DebtLynda Kane

Automation Dreamin' 2022: Sharing Some Gratitude with Your UsersLynda Kane

Linux Professional Institute LPIC-1 Exam.pdfRHCSA Guru

Rock, Paper, Scissors: An Apex Map Learning JourneyLynda Kane

AI and Data Privacy in 2025: Global TrendsInData Labs

Learn the Basics of Agile Development: Your Step-by-Step GuideMarcel David

AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix

2025-05-Q4-2024-Investor-Presentation.pptxSamuele Fogagnolo

UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPathCommunity

How to Use Mirroring and Caching to Optimize your Container Registry

1. Caching Caching Demos Caching Limitations Caching Other Registries Caching Gitlab Demo Mirroring Manual Mirroring Summary Agenda @sudo_bmitch1 / 35

2. How to Use Mirroring and Caching to Optimize Your Image Registry Brandon Mitchell Twitter: @sudo_bmitch GitHub: sudo-bmitch 2 / 35

3. Ephemeral Build Server? @sudo_bmitch3 / 35

4. Cluster Pulling Remote Images? @sudo_bmitch4 / 35

5. Worry About Upstream Image Changes? @sudo_bmitch5 / 35

6. Build and Deploy Infrastructure Tolerant of Upstream Outages? @sudo_bmitch6 / 35

7. Production Resilience @sudo_bmitch7 / 35

8. Build Infrastructure @sudo_bmitch8 / 35

9. Build Outage @sudo_bmitch9 / 35

10. Build Resilience @sudo_bmitch10 / 35

11. Faster Builds and Less Bandwidth @sudo_bmitch11 / 35

12. Caching @sudo_bmitch12 / 35

13. Caching is the Easy Button https://commons.wikimedia.org/wiki/File:Easy_button.JPG @sudo_bmitch13 / 35

14. Cache Architecture @sudo_bmitch14 / 35

15. Cache Implementation Either the dockerd CLI: dockerd --registry-mirror <cache-url> Or /etc/docker/daemon.json { "registry-mirrors": [ "<cache-url>" ] } Plus a registry: docker run -e REGISTRY_PROXY_REMOTEURL=<upstream-url> registry:2 @sudo_bmitch15 / 35

16. @sudo_bmitch 00:00 16 / 35

17. @sudo_bmitch 00:00 17 / 35

18. @sudo_bmitch 00:00 18 / 35

19. @sudo_bmitch 00:00 19 / 35

20. @sudo_bmitch 00:00 20 / 35

21. So What's the Catch? @sudo_bmitch21 / 35

22. Cache Limitations The "registry-mirror" setting only applies to Docker Hub Only caches pulls not pushes Pulls still check the image manifest on Hub Credentials are in the cache server Docker implementation only supports one authentication method @sudo_bmitch22 / 35

23. Options to Cache Other Registries Con gure a squid HTTP caching proxy Pull directly from the cache Use DNS and TLS certs to send pulls to the proxy @sudo_bmitch23 / 35

24. @sudo_bmitch 00:00 24 / 35

25. I Want More @sudo_bmitch25 / 35

26. Mirroring @sudo_bmitch26 / 35

27. Mirror Architecture @sudo_bmitch27 / 35

28. Running a Registry Docker image docker container run -p 5000:5000 registry:2 Harbor Many Artifact Repositories @sudo_bmitch28 / 35

29. Manually Mirroring docker image pull ${image} docker image tag ${image} local-mirror:5000/${image} docker image push local-mirror:5000/${image} @sudo_bmitch29 / 35

30. Manual Mirror Script docker image pull "$localimg" docker image pull "$remoteimg" remoteid=$(docker image inspect "$remoteimg" --format '{.Id}') localid=$(docker image inspect "$localimg" --format '{.Id}') if [ "$remoteid" != "$localid" ]; then docker image tag "$localimg" "$localimg.$datestamp" docker image tag "$remoteimg" "$localimg" docker image push "$localimg.$datestamp" docker image push "$localimg" fi @sudo_bmitch30 / 35

31. Why All the Complication? @sudo_bmitch31 / 35

32. Advantages of Manually Mirroring Over Automatically Syncing Repos: Changes to images happen on your schedule Backout option exists with breaking changes Over Pull Through Cache Those reasons plus... Pushing locally built images to the registry Upstream outage doesn't stop local builds/deploys @sudo_bmitch32 / 35

33. Risks of Manually Mirroring Images go stale if you do not automate the script Adding new images is an added process Recovering from a mirror outage requires populating images FROM line in images needs to point to mirror ARG REGISTRY=docker.io FROM ${REGISTRY}/alpine:3.9 ... docker build --build-arg REGISTRY=local-mirror:5000 . @sudo_bmitch33 / 35

34. Summary Both Saves bandwidth Faster builds Pull Through Cache Easy to create Little maintenance Managed Mirror Control changes Tolerate upstream outages @sudo_bmitch34 / 35

35. Brandon Mitchell Twitter: @sudo_bmitch GitHub: sudo-bmitch Thank You github.com/sudo-bmitch/presentations 35 / 35

How to Use Mirroring and Caching to Optimize your Container Registry

Recommended

More Related Content

What's hot (20)

Similar to How to Use Mirroring and Caching to Optimize your Container Registry (20)

More from Docker, Inc. (20)

Recently uploaded (20)

How to Use Mirroring and Caching to Optimize your Container Registry