![Ā© Copyright 2020 Xilinx
RunX Runtime
ļ“Copy runX and /usr/share/runX to target
ļ“Enable it in containerdās config.toml
[plugins.linux]
runtime="/usr/sbin/runX"](https://image.slidesharecdn.com/runxlinaroconnect2020-200924214701/85/RunX-deploy-real-time-OSes-as-containers-at-the-edge-6-320.jpg)
![Ā© Copyright 2020 Xilinx
Yocto + RunX: Simplified setup
ļ“Local build setup (will eventually be in a xen distro config)
$ cat <<EOF >> conf/local.conf
MACHINE ??= "zcu102-zynqmp"
DISTRO = "poky"
BBMULTICONFIG ?= "pmu"
do_image[mcdepends] = "multiconfig::pmu:pmu-firmware:do_deploy"
IMAGE_FSTYPES += "tar.gz cpio.gz.u-boot jffs2"
DISTRO_FEATURES_append=" xen virtualization vmsep"
IMAGE_INSTALL_append = " busybox xen-tools zlib-dev runx"
IMAGE_INSTALL_append += " virtual/containerd virtual/runc"
ASSUME_PROVIDED += "iasl-native"
PACKAGECONFIG_remove_pn-xen += " sdl"
PREFERRED_PROVIDER_qemu-native = "xilinx-qemu-native"
PREFERRED_PROVIDER_nativesdk-qemu = "nativesdk-qemu-xilinx"
BUILDHISTORY_FEATURES ?= "image package sdk"
QB_DEFAULT_KERNEL="none"
QB_MEM = "-m 4096"
EOF
$ cat << EOF > conf/multiconfig/pmu.conf
MACHINE="microblaze-pmu"
DISTRO="xilinx-standalone"
TMPDIR="${TOPDIR}/pmutmp"
EOF](https://image.slidesharecdn.com/runxlinaroconnect2020-200924214701/85/RunX-deploy-real-time-OSes-as-containers-at-the-edge-9-320.jpg)
![Ā© Copyright 2020 Xilinx
containerd
RunX
[extra args] or
config.json
Linux
Container
Tarball w/ kernel,
ramdisk, & rootfs
1
2
Container Orchestration Framework
(e.g. Kubernetes)
OCI Image Spec Extensions:
- RESOURCE = DEVICE_DATA
- KERNEL
- RAMDISK
Xen
Provided ramdisk
Provided kernel
VM
Device Config
Heterogeneous
HW Resource
containerd āshimā
Vision: Accelerators & FPGAs](https://image.slidesharecdn.com/runxlinaroconnect2020-200924214701/85/RunX-deploy-real-time-OSes-as-containers-at-the-edge-18-320.jpg)
RunX: deploy real-time OSes as containers at the edge
- 1. Ā© Copyright 2020 Xilinx RunX Stefano Stabellini Bruce Ashfield Wesley Skeffington Brian Woods LVC20
- 2. Ā© Copyright 2020 Xilinx Introducing RunX ļ“ A new OCI-compatible containers runtime to start containers as Xen VMs ļ“ Written for Embedded ļ¬ Very simple ļ¬ Minimal overhead ļ¬ Real-Time support ļ¬ Accelerators support ļ¬ Secure by Default ļ“ New project started under the Linux Foundation Edge (LF-Edge) umbrella ļ¬ Early collaborationwith Zededa ļ¬ Permissive license (Apache v2) ļ¬ Open to contributions from the start ļ¬ All developmentusing a public mailing list: https://lists.lfedge.org/g/eve-runx
- 3. Ā© Copyright 2020 Xilinx RunX Linux Container xl create Container 1 2 Container Orchestration Framework (e.g. Kubernetes) Xen ramdisk kernel VM containerd containerd āshimā Introducing RunX
- 4. Ā© Copyright 2020 Xilinx RunX: implementation choices ļ“ Easy to Build: minimal build dependencies ļ¬ gcc,make, go ļ“ Easy to Run: minimal runtime dependencies ļ¬ (in addition to Xen,) bash, jq, socat, daemonize ļ“ No in-guest agents: minimal runtime overhead ļ¬ Provides a minimal Linux kernel and Busybox-based ramdiskfor booting regular containers as VMs ļ¬ Pristine container environment ļ“ Tiny Micro-VMs optimized for embedded ļ¬ A minimal environment ļ¬ No device emulation ļ¬ No in-guest firmware or bootloaders ļ“ OCI Runtime Spec compliant ļ¬ Developedtogetherwith ContainerD ļ¬ Should work with any container engines
- 5. Ā© Copyright 2020 Xilinx RunX (Cross)Build ļ“Cross-build requirements: ļ¬ cross-compilationtoolchain ļ¬ e.g. Linaro: https://releases.linaro.org/components/toolchain/binaries/latest-7/aarch64-linux-gnu ļ¬ golang compiler (soon to be removed) ļ¬ distro golang package expected to work $ export ARCH=aarch64 $ export GOROOT=/usr/lib/go-1.10 $ export CROSS_COMPILE=/path/to/aarch64-linux-gnu- $ ./build.sh
- 6. Ā© Copyright 2020 Xilinx RunX Runtime ļ“Copy runX and /usr/share/runX to target ļ“Enable it in containerdās config.toml [plugins.linux] runtime="/usr/sbin/runX"
- 7. Ā© Copyright 2020 Xilinx Yocto + RunX ļ“meta-virtualization provides the recipes for RunX, Xen and supporting components (containerd, etc) ļ“Why use Yocto / OE to build / deploy RunX ? ļ¬ Leverage the Yocto / OE core values ļ¬ Transition path from development to production ļ¬ Active community and integration with BSPs (e.g. meta-xilinx) ļ¬ Multiconfig builds ļ¬ Build host + guests + containers + firmware in a single platform ļ“Note: development and build directly with upstream projects is always possible
- 8. Ā© Copyright 2020 Xilinx Yocto + RunX: Simplified build ļ“Use master branches (there are no stable/released variants yet) $ git clone -b master http://git.yoctoproject.org/git/poky $ git clone -b master http://git.openembedded.org/meta-openembedded $ git clone -b master https://git.yoctoproject.org/git/meta-virtualization $ git clone -b master https://github.com/Xilinx/meta-xilinx.git $ . ./oe-init-build-env zcu102-zynqmp $ bitbake-layers add-layer $(readlink -f $PWD/../meta-openembedded/meta-oe) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-openembedded/meta-filesystems) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-openembedded/meta-python) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-openembedded/meta-networking) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-virtualization) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-xilinx/meta-xilinx-bsp) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-xilinx/meta-xilinx-contrib) $ bitbake-layers add-layer $(readlink -f $PWD/../meta-xilinx/meta-xilinx-standalone)
- 9. Ā© Copyright 2020 Xilinx Yocto + RunX: Simplified setup ļ“Local build setup (will eventually be in a xen distro config) $ cat <<EOF >> conf/local.conf MACHINE ??= "zcu102-zynqmp" DISTRO = "poky" BBMULTICONFIG ?= "pmu" do_image[mcdepends] = "multiconfig::pmu:pmu-firmware:do_deploy" IMAGE_FSTYPES += "tar.gz cpio.gz.u-boot jffs2" DISTRO_FEATURES_append=" xen virtualization vmsep" IMAGE_INSTALL_append = " busybox xen-tools zlib-dev runx" IMAGE_INSTALL_append += " virtual/containerd virtual/runc" ASSUME_PROVIDED += "iasl-native" PACKAGECONFIG_remove_pn-xen += " sdl" PREFERRED_PROVIDER_qemu-native = "xilinx-qemu-native" PREFERRED_PROVIDER_nativesdk-qemu = "nativesdk-qemu-xilinx" BUILDHISTORY_FEATURES ?= "image package sdk" QB_DEFAULT_KERNEL="none" QB_MEM = "-m 4096" EOF $ cat << EOF > conf/multiconfig/pmu.conf MACHINE="microblaze-pmu" DISTRO="xilinx-standalone" TMPDIR="${TOPDIR}/pmutmp" EOF
- 10. Ā© Copyright 2020 Xilinx Yocto + RunX: build steps ļ“Note: not all changes are merged upstream, but will be shortly # download and extract pmu files (optional: only if not using multiconfig): # Download: https://www.xilinx.com/member/forms/download/xef.html?filename=xilinx-zcu102-v2020.1-final.bsp&akdm=1 $ tar -O -xf xilinx-zcu102-v2020.1-final.bsp xilinx-zcu102-2020.1/pre-built/linux/images/pmu_rom_qemu_sha3.elf > pmu-rom.elf $ tar -O -xf xilinx-zcu102-v2020.1-final.bsp xilinx-zcu102-2020.1/pre-built/linux/images/pmufw.elf > pmufw.elf $ tar -O -xf xilinx-zcu102-v2020.1-final.bsp xilinx-zcu102-2020.1/pre-built/linux/images/system.dtb > system.dtb # copy files to deploy dir: $ cp pmufw.elf build/tmp/deploy/images/zcu102-zynqmp/pmu-zcu102-zynqmp.bin $ cp pmufw.elf build/tmp/deploy/images/zcu102-zynqmp/pmu-zcu102-zynqmp.elf $ cp pmu-rom.elf $BUILDDIR/tmp/deploy/images/zcu102-zynqmp/pmu-rom.elf $ cp system.dtb $BUILDDIR/tmp/deploy/images/zcu102-zynqmp/system.dtb # build the image(s) $ bitbake core-image-minimal $ bitbake xen-image-minimal
- 11. Ā© Copyright 2020 Xilinx Yocto + RunX: runtime steps ļ“Note: some on target configuration may be required (and will be automated in the future) # core-image-minimal as a sanity test. Works out of deployed artifacts by default: $ runqemu core-image-minimal slirp nographic # xen-minimal: requires manual u-boot config, or boot.scr support from image builder (https://gitlab.com/ViryaOS/imagebuilder) $ runqemu xen-image-minimal nographic slirp
- 12. Ā© Copyright 2020 Xilinx RunX Linux Container xl create Container 1 2 Container Orchestration Framework (e.g. Kubernetes) Xen ramdisk kernel VM containerd containerd āshimā RunX: Traditional Containers
- 13. Ā© Copyright 2020 Xilinx RunX Linux Container xl create Tarball w/ kernel, ramdisk, & rootfs 1 2 Container Orchestration Framework (e.g. Kubernetes) OCI Image Spec Extensions: - KERNEL - RAMDISK Xen Provided ramdisk Provided kernel VM containerd containerd āshimā RunX: Containers with a Kernel
- 14. Ā© Copyright 2020 Xilinx RunX Linux RTOS xl create RTOS packaged as a container 1 2 Container Orchestration Framework (e.g. Kubernetes) Xen VM containerd containerd āshimā RunX: Baremetal and RTOS Containers
- 15. Ā© Copyright 2020 Xilinx RunX: Containers with a Kernel ļ“ Support containers that come with their own Kernel and/or Ramdisk ļ¬ a specific versionof the Linux kernel ļ¬ a specific kernel configuration ļ¬ LinuxRT ļ“ Non-Linux OSes ļ¬ RTOSes ļ¬ Baremetal applications ļ¬ VxWorks ļ“ Kernel and Ramdisk are advertised using new OCI Image flags ļ¬ TBD; currently Implemented using Environmental Variables ļ¬ RUNX_KERNEL ļ¬ RUNX_RAMDISK ļ¬ Workwith CNCF to standardize the new labels
- 16. Ā© Copyright 2020 Xilinx containerd RunX + extra args Linux Container Tarball w/ kernel, ramdisk, & rootfs Container Orchestration Framework (e.g. Kubernetes) Xen Provided ramdisk Provided kernel VM Heterogeneous HW Resource containerd āshimā xl create 2 1 RunX: Device Assignment
- 17. Ā© Copyright 2020 Xilinx Device Assignment ļ“ Device Assignment support via XLCONF ļ“ Appends configurationoptions to the xl config file ļ“ It can be used for anything from device assignmentto changing vcpus and memory configurations ļ“ It can be used to set real-time configurations ļ“ It is set by the user/admin (not by the container)
- 18. Ā© Copyright 2020 Xilinx containerd RunX [extra args] or config.json Linux Container Tarball w/ kernel, ramdisk, & rootfs 1 2 Container Orchestration Framework (e.g. Kubernetes) OCI Image Spec Extensions: - RESOURCE = DEVICE_DATA - KERNEL - RAMDISK Xen Provided ramdisk Provided kernel VM Device Config Heterogeneous HW Resource containerd āshimā Vision: Accelerators & FPGAs
- 19. Ā© Copyright 2020 Xilinx Vision: Accelerators & FPGAs 1. Containers come with their own accelerator's binaries and data ļ¬ FPGAbitstreams ļ¬ Co-ProcessorKernels ļ¬ AIE Kernels 2. ContainerD calls to a service to program the accelerators 3. RunX assigns the accelerator's resources to the VM
- 20. Ā© Copyright 2020 Xilinx Demo
- 21. Ā© Copyright 2020 Xilinx containerd RunX + extra args Linux Baremetal Xen VM TTC Timer containerd āshimā xl create 2 1 RunX RTOS and Device Assignment Demo Baremetal Container with access to the physical TTC timer
- 22. Ā© Copyright 2020 Xilinx Thank You