[OpenStack 하반기 스터디] DPDK & OpenStack why?

Dec 21, 2015Download as PPTX, PDF1 like8,833 views

DPDK aims to improve network performance in OpenStack by reducing latency. The hypervisor was not designed for network functions and introduces bottlenecks through interrupts and copying. DPDK runs in userspace and uses poll mode drivers to bypass the kernel for packet processing, improving throughput. A proof of concept showed DPDK-accelerated Open vSwitch handled over 30Gbps of traffic with low CPU usage, compared to normal OVS which topped out at 10Gbps. While the test had limitations, DPDK offers potential to accelerate features like SR-IOV, VMQ, and offloads.

Why?
 Too many logical devices make “Latency” “Latency” “Latency”.
 Hypervisor wasn’t designated to support network functions!
 Device service routine works with Interrupt!
Linux Bridge
OVS Bridge
Namespace
Tap Device
Encapsulation
DVR
Neutron Node
OVSTunnel Bridge
External Bridge

Bottleneck ?
Networking
Application #2
Networking
Application #1
LPC?TCP? UDP?That’s ok. I assume it just “mem copy”.
Software Interrupt

Bottleneck ?
NIC : Buffer
Kernel
Device
Driver
Interrupt > Interrupt Service Routine > DPC
Networking
Application
APC > Networking Application
Interrupt

DPDK?
 Data Plan Developer Kit
 DPDK is a set of software libraries and Ethernet drivers (native and
virtualized) that run in Linux user space to boost packet processing
throughput on Intel® architecture.

Proof of
concept
 Hardware : IBM PureFlex
 Spec
 Host - 16core / 256G / 10g nic * 2ea
 Guest – 8core / 32G / virtio nic * 2ea
=> CPU Socket Isolation & NUMA
• Software
 Iperf
 dpdk-ovs
 virtio-net-pmd

Proof of
concept
Host
Guest
KVM KVM
dpdk-ovs
virtio-net-pmd
Guest
virtio-net-pmd
Iperf server Iperf client

Conclusion
0
10000
20000
30000
40000
non with DPDK
intr/sec
0
10
20
30
Bridge OVS OVS with
DPDK
Gbps/sec
cpu usage
Iperf server

Self-reflection
 Something strange..
 cause
 ShortTime
 Side effect
 Low experience

Acceleration
features
 SR-IOV
 VMQ / DVMQ
 RSS / vRSS
 Jumbo Frame
 Large Send Offload
 Checksum Offload
 RDMA
 DCB
 DatacenterTCP (ECN)
 RSC (Receive Segment Coalescing)
 NVGRE/VXLAN offload

1. Virtual networks and cloud platforms need to collaborate as companies extend their networks across public clouds. 2. NSX supports major public clouds like AWS and Azure, allowing customers to consistently manage networks and security across private and public clouds. 3. NSX aims to connect and secure applications across private and public multiple clouds by creating private networks within or across clouds and defining logical networking and security policies.

[2015-11월 정기 세미나] Cloud Native Platform - PivotalOpenStack Korea Community

[OpenStack Days Korea 2016] Track1 - Mellanox CloudX - Acceleration for Cloud...OpenStack Korea Community

1) Mellanox's CloudX platform enhances cloud performance through technologies like its Spectrum switch, ConnectX-4 adapters, and software solutions. 2) These solutions provide high-speed networking, efficient virtual networking through overlay acceleration, and data transfer technologies like RDMA. 3) CloudX reference architectures allow building efficient, high-performance, and scalable IaaS clouds using Mellanox interconnect solutions and off-the-shelf components.

[OpenStack Days Korea 2016] An SDN Pioneer's Vision of NetworkingOpenStack Korea Community

1. Networking is undergoing a third major transition driven by cloud computing, mobile devices, and software-defined networking. 2. Applications are becoming distributed across private and public clouds, making the application the new network as IT departments lose control over hardware. 3. The rise of containers is pushing networking down to the application level, requiring new approaches for provisioning, troubleshooting, and security at this more granular level.

[OpenStack 하반기 스터디] Interoperability with ML2: LinuxBridge, OVS and SDNOpenStack Korea Community

The document discusses integrating OpenStack Networking (Neutron) with Software Defined Networking (SDN) controllers. It describes how Neutron can use an SDN controller like ONOS instead of traditional mechanism drivers like Open vSwitch. The key components that would need to be modified are the mechanism driver, service plugin, and configuration. Five virtual machines or host machines running specific OpenStack and ONOS services are also needed to demonstrate the integration between Neutron and an SDN controller.

OpenStack KOREA 정기 세미나_OpenStack meet iNaaS SDN ControllerYongyoon Shin

OpenStack meet iNaaS SDN Controller The document discusses connecting the OpenStack cloud platform with the iNaaS SDN controller for virtual network management. It describes developing an iNaaS mechanism driver for the OpenStack Neutron ML2 plugin to enable network provisioning and control via the iNaaS controller. It also covers configuring DevStack and the ml2.conf file to use the custom driver and interface with iNaaS. A demo topology is shown integrating OpenStack, iNaaS and OpenFlow switches. Future work mentioned includes multi-domain support and high availability for iNaaS.

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화OpenStack Korea Community

Ceph is an open-source distributed storage system that provides object, block, and file storage. The document discusses optimizing Ceph for an all-flash configuration and analyzing performance issues when using Ceph on all-flash storage. It describes SK Telecom's testing of Ceph performance on VMs using all-flash SSDs and compares the results to a community Ceph version. SK Telecom also proposes their all-flash Ceph solution with custom hardware configurations and monitoring software.

[2015-11월 정기 세미나]K8s on openstackOpenStack Korea Community

This document discusses using plain Linux bridges for networking Docker containers on Kubernetes clusters deployed on OpenStack. It involves pre-allocating IP addresses on virtual machines, configuring Docker bridges to use the pre-allocated subnet, and allowing Kubernetes pods and containers to use the pre-allocated IP addresses for networking. The approach aims to provide a simple networking solution that is compatible with legacy systems.

[OpenStack 하반기 스터디] HA using DVROpenStack Korea Community

[OpenStack Days 2016] Track4 - OpenNSL으로 브로드콜 기반 네트,워크 스위치 제어하기OpenStack Korea Community

The document discusses configuring Broadcom-based network switches using OpenNSL. It provides an overview of the Open Compute Project (OCP), Facebook's Wedge switch hardware, the Open Network Linux (ONL) operating system, and the Broadcom Trident2 chip. It then demonstrates how to perform basic L2 switching and L3 routing functions using the OpenNSL API, such as learning MAC addresses, forwarding traffic, creating IP interfaces, and adding routes. OpenNSL provides an open-source hardware abstraction layer for programming Broadcom switching ASICs.

OpenStack and private cloudSK Telecom

[OpenStack Day in Korea 2015] Track 1-4 - VDI OpenStack? It Works!!!OpenStack Korea Community

This document discusses using OpenStack for VDI (Virtual Desktop Infrastructure). It provides an example of a large company, Ctrip, that uses OpenStack VDI for over 10,000 agents with over 200,000 daily connections. Key technical issues with OpenStack VDI are then outlined, including provisioning, connection protocols, cloud-init configuration, boot storms, and the need for automation. Automation is discussed as being critical but challenging for tasks like backups, password recovery, and resource management.

OpenStack Korea 2015 상반기스터디(devops) 스크립트로 오픈스택 설치하기 20150728jieun kim

※ 본 발표자료는 DevOps팀의 codetree님이 주도적으로 작성하신 shell script를 리뷰하여 작성하였습니다. [OpenStack Korea Community Study Group, DevOps] 2015년 상반기 두번째 스터디, DevOps Class "쉘 스크립트를 활용한 오픈스택 Kilo 설치 - 10분만에 끝내기" D2에서 진행한 스터디 마무리 발표, 2번째 발표에대한 자료입니다.

[OpenStack Days Korea 2016] Track4 - OpenStack with KubernetesOpenStack Korea Community

This document discusses Kubernetes and its integration with OpenStack. It begins with an introduction to Kubernetes and how it manages containerized applications across multiple hosts. It then compares virtualization and containers, describing the architecture and components of Kubernetes including pods, services, and rolling upgrades. The document outlines how Kubernetes is implemented in OpenStack using Nova Docker, Murano, and Magnum. It concludes with a Q&A section.

Cloud data center and openstackAndrew Yongjoon Kong

This document provides an overview of Kakaocorp's cloud and data center technologies and practices. It discusses Kakaocorp's use of OpenStack for its cloud computing platform, as well as its adoption of DevOps culture and tools like Chef configuration management. The document also describes Kakaocorp's centralized CMDB, monitoring, and deployment systems that form the control plane for its data center automation. Kakaocorp's integrated information service bus called KEMI is presented as well.

How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)VirtualTech Japan Inc.

How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月) 講師：佐々木健太郎（Rakuten）アジェンダ： - Logging Infrastructure for Private Cloud -- Private Cloud at Rakuten -- Logging Matters -- Log Management - Overview of Our Logging Infrastructure -- Event Logging Infrastructure --- Event Logs in OpenStack --- Event Logs in VMware -- Log storage for Event logs: Splunk -- Alerting and Reporting on Splunk -- Performance Logging Infrastructure -- Log Collector Requirements --- Log Collector: Fluentd, Metricbeat -- HVs and Storage Performance logs -- VMs Performance logs from Hypervisors -- Log streaming: Kafka -- Log storage for Performance logs: --- InfluxDB and Grafana - Summary

Cisco UCS loves Kubernetes, Docker and OpenStack KollaVikram G Hosakote

Vikram Hosakote from Cisco Systems gave a presentation at Red Hat Summit 2017 about Cisco UCS supporting Kubernetes, Docker, and OpenStack. He discussed what Cisco UCS, Docker, Kubernetes and OpenStack are. He described the OpenStack kolla-kubernetes project which uses Kubernetes to deploy and manage OpenStack services running in Docker containers. He explained Red Hat's role in providing the operating system, OpenStack packages, Docker images and support. He also discussed Cisco's efforts to upstream the kolla-kubernetes project to the OpenStack community.

DockerCon EU 2015: Docker Networking Deep DiveDocker, Inc.

with Jana Radhakrishnan, Lead Software Engineer at Docker, and David Tucker, Product Manager, Docker Docker Networking is a feature of Docker Engine that allows you to create virtual networks and attach containers to them so you can create the network topology that is right for your application. The networked containers can even span multiple hosts, so you don’t have to worry about what host your container lands on. They can seamlessly communicate with each other wherever they are - thus enabling true distributed applications. And Networking is pluggable, so you can use any third-party networking driver to power your networks without having to make any changes to your application. Read more: https://blog.docker.com/2015/11/docker-multi-host-networking-ga/ -- Docker is an open platform for developers and system administrators to build, ship and run distributed applications. With Docker, IT organizations shrink application delivery from months to minutes, frictionlessly move workloads between data centers and the cloud and can achieve up to 20X greater efficiency in their use of computing resources. Inspired by an active community and by transparent, open source innovation, Docker containers have been downloaded more than 700 million times and Docker is used by millions of developers across thousands of the world’s most innovative organizations, including eBay, Baidu, the BBC, Goldman Sachs, Groupon, ING, Yelp, and Spotify. Docker’s rapid adoption has catalyzed an active ecosystem, resulting in more than 180,000 “Dockerized” applications, over 40 Docker-related startups and integration partnerships with AWS, Cloud Foundry, Google, IBM, Microsoft, OpenStack, Rackspace, Red Hat and VMware. Learn more at www.docker.com

Linux Kernel DevelopmentLinuxCon ContainerCon CloudOpen China

Presentation delivered at LinuxCon China 2017 by Greg Kroah-Hartman. The Linux kernel is the largest collaborative software development projects ever. This talk will discuss exactly how Linux is developed, how fast it is happening, who is doing the work, and how we all stay sane keeping up with it. It will discuss the development model used, and how it differs from almost all "traditional" models of software development.

Trove Updates - Kilo EditionOpenStack Foundation

- Juno release of OpenStack Trove added support for Neutron networks, asynchronous MySQL replication, MongoDB clustering, and new datastores like PostgreSQL and Couchbase. - In Kilo, Trove specifications were moved to Gerrit for improved tracking and reviews. Initial implementations of CouchDB and Vertica were added, along with improvements to replication and clustering. - Kilo also focused on paying off technical debt, simplifying operations, and building out the community.

Role of sdn controllers in open stackopenstackindia

This document discusses the role of SDN controllers in OpenStack. It provides background on SDN controllers and OpenStack. SDN controllers can be integrated with OpenStack via the Neutron module to manage network flows and enable programmability. Several SDN controllers that integrate with Neutron are discussed, including OpenDaylight, OpenContrail, and ONOS. The document outlines how these controllers plug into Neutron and their current status in OpenStack. It provides guidance on how new SDN controllers can join OpenStack.

Orchestration Tool Roundup - Arthur Berezin & Trammell ScruggsCloud Native Day Tel Aviv

It’s no news that containers represent a portable unit of deployment, and OpenStack has proven an ideal environment for running container workloads. However, where it usually becomes more complex is that many times an application is often built out of multiple containers, as well as hybrid environments - diverse clouds, bare metal and even non-virtualized infrastructure. What’s more, setting up a cluster of container images can be fairly cumbersome because you need to make one container aware of another and expose intimate details that are required for them to communicate which is not trivial especially if they’re not on the same host. These scenarios have instigated the demand for some kind of orchestrator. The list of container orchestrators is growing fairly fast. This session will compare the different orchestration projects out there - from Heat to Kubernetes to Mesos & Cloudify - and help you choose the right tool for the job.

OpenStack QA Tooling & How to use it for Production Cloud Testing | Ghanshyam...Vietnam Open Infrastructure User Group

The document discusses OpenStack QA tools used for production cloud testing. It describes tools like Tempest for API and scenario testing, Patrole for RBAC testing, Stackviz for analyzing DevStack performance, and the OpenStack Health dashboard for viewing test status. It explains how these tools like Tempest and Patrole can run tests simultaneously in multiple workspaces on a Cloud Health Node to test different OpenStack sites without needing to upgrade the node for each site upgrade. The dashboard provides a view of test results from across workspaces.

OpenStack CinderDeepti Ramakrishna

Cinder provides persistent block storage volumes to OpenStack instances. It uses a plugin driver architecture that allows integration with various backend storage systems. When a volume is created, Cinder's scheduler determines which volume node to use based on the available storage and provisions the volume. The volume can then be attached to an instance to provide additional block-level storage. It also supports advanced features like snapshots, backups, and transferring volumes between projects.

Is OpenStack Neutron production ready for large scale deployments?Елена Ежова

The document discusses the results of testing the scalability of OpenStack Neutron in large deployments. Two hardware labs with 378 and 200 nodes were used. Rally and Shaker tools tested the control and data planes. Over 24500 VMs were launched on the 200-node lab with no loss of data plane connectivity. Near line-rate throughput was achieved in data plane tests. Some issues were encountered and fixed, such as bugs and Ceph failure. The outcomes indicate Neutron can scale to large deployments.

Openstack HAYong Luo

The document discusses OpenStack high availability (HA), performance tuning, and troubleshooting techniques. It covers HA concepts in OpenStack, including compute and controller node HA. It then discusses performance tuning and analyzing OpenStack logs for troubleshooting. It provides details on HA solutions for various OpenStack components like Nova, Glance, Keystone, Swift, Cinder and Neutron. It also covers techniques for optimizing performance in OpenStack like kernel tuning, huge pages, and KSM. Finally, it lists some common log locations for troubleshooting various OpenStack services.

[OpenStack Days Korea 2016] 아이디어 이코노미에서의 하이브리드 클라우드 전략OpenStack Korea Community

[OpenStack Days Korea 2016] Microsoft is Open!OpenStack Korea Community

More Related Content

What's hot (20)

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화OpenStack Korea Community

[2015-11월 정기 세미나]K8s on openstackOpenStack Korea Community

[OpenStack 하반기 스터디] HA using DVROpenStack Korea Community

[OpenStack Days 2016] Track4 - OpenNSL으로 브로드콜 기반 네트,워크 스위치 제어하기OpenStack Korea Community

OpenStack and private cloudSK Telecom

[OpenStack Day in Korea 2015] Track 1-4 - VDI OpenStack? It Works!!!OpenStack Korea Community

OpenStack Korea 2015 상반기스터디(devops) 스크립트로 오픈스택 설치하기 20150728jieun kim

[OpenStack Days Korea 2016] Track4 - OpenStack with KubernetesOpenStack Korea Community

Cloud data center and openstackAndrew Yongjoon Kong

How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)VirtualTech Japan Inc.

Cisco UCS loves Kubernetes, Docker and OpenStack KollaVikram G Hosakote

DockerCon EU 2015: Docker Networking Deep DiveDocker, Inc.

Linux Kernel DevelopmentLinuxCon ContainerCon CloudOpen China

Trove Updates - Kilo EditionOpenStack Foundation

Role of sdn controllers in open stackopenstackindia

Orchestration Tool Roundup - Arthur Berezin & Trammell ScruggsCloud Native Day Tel Aviv

OpenStack QA Tooling & How to use it for Production Cloud Testing | Ghanshyam...Vietnam Open Infrastructure User Group

OpenStack CinderDeepti Ramakrishna

Is OpenStack Neutron production ready for large scale deployments?Елена Ежова

Openstack HAYong Luo

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화OpenStack Korea Community

[2015-11월 정기 세미나]K8s on openstackOpenStack Korea Community

[OpenStack 하반기 스터디] HA using DVROpenStack Korea Community

[OpenStack Days 2016] Track4 - OpenNSL으로 브로드콜 기반 네트,워크 스위치 제어하기OpenStack Korea Community

OpenStack and private cloudSK Telecom

[OpenStack Day in Korea 2015] Track 1-4 - VDI OpenStack? It Works!!!OpenStack Korea Community

OpenStack Korea 2015 상반기스터디(devops) 스크립트로 오픈스택 설치하기 20150728jieun kim

[OpenStack Days Korea 2016] Track4 - OpenStack with KubernetesOpenStack Korea Community

Cloud data center and openstackAndrew Yongjoon Kong

How logging makes a private cloud a better cloud - OpenStack最新情報セミナー(2016年12月)VirtualTech Japan Inc.

Cisco UCS loves Kubernetes, Docker and OpenStack KollaVikram G Hosakote

DockerCon EU 2015: Docker Networking Deep DiveDocker, Inc.

Linux Kernel DevelopmentLinuxCon ContainerCon CloudOpen China

Trove Updates - Kilo EditionOpenStack Foundation

Role of sdn controllers in open stackopenstackindia

Orchestration Tool Roundup - Arthur Berezin & Trammell ScruggsCloud Native Day Tel Aviv

OpenStack QA Tooling & How to use it for Production Cloud Testing | Ghanshyam...Vietnam Open Infrastructure User Group

OpenStack CinderDeepti Ramakrishna

Is OpenStack Neutron production ready for large scale deployments?Елена Ежова

Openstack HAYong Luo

Viewers also liked (20)

[OpenStack Days Korea 2016] 아이디어 이코노미에서의 하이브리드 클라우드 전략OpenStack Korea Community

[OpenStack Days Korea 2016] Microsoft is Open!OpenStack Korea Community

[OpenStack Days Korea 2016] Innovating OpenStack Network with SDN solutionOpenStack Korea Community

[OpenStack Days Korea 2016] Track1 - Red Hat enterprise Linux OpenStack PlatformOpenStack Korea Community

This document discusses Red Hat's OpenStack platform. It provides an overview of OpenStack and what it is used for. It then discusses why Red Hat is well suited to provide an OpenStack platform, including that it is optimized to run on Red Hat Enterprise Linux and benefits from Red Hat's engineering resources and long term support. Key features of Red Hat's OpenStack platform are also summarized, such as performance, availability, security and manageability.

[OpenStack Days Korea 2016] How open HW and SW drives telco infrastucture inn...OpenStack Korea Community

Kang-Won Lee is a Senior Vice President at SKT's Corporate R&D Center who discussed SKT's work on 5G networks and open source/hardware projects. Some key points include: - SKT is working to make 5G networks virtualized, programmable, and flexible through projects like Mobile CORD. - They are developing disaggregated and virtualized RAN and EPC architectures using open source software and open hardware to improve scalability, reduce costs and promote flexibility. - SKT is involved in several open source and open hardware projects including All-Flash Ceph storage, T-CAP servers, and the Open Compute Project to help build software-defined data centers.

[OpenStack Days Korea 2016] 개회사OpenStack Korea Community

The document discusses the OpenStack Korea Community and its activities including holding OpenStack Days Korea every February, OpenStack Birthday Party every July, and technical seminars monthly. It provides details on the community's manager group, homepage, Facebook group, past celebration events, and sponsors for the 3rd OpenStack Days Korea conference in February 2016. The community has grown to over 4,700 members.

[OpenStack 하반기 스터디] Docker를 이용한 OpenStack 가상화OpenStack Korea Community

[OpenStack Days Korea 2016] Track1 - Monasca를 이용한 Cloud 모니터링OpenStack Korea Community

[2017년 5월 정기세미나] IBM에서 바라보는 OpenStack 이야기OpenStack Korea Community

[OpenStack Days Korea 2016] Track1 - 카카오는 오픈스택 기반으로 어떻게 5000VM을 운영하고 있을까?OpenStack Korea Community

[2017년 5월 정기세미나] Network with OpenStack - OpenStack Summit Boston PostOpenStack Korea Community

[OpenStack Days Korea 2016] Track2 - 데이터센터에 부는 오픈 소스 하드웨어 바람OpenStack Korea Community

[OpenStack Days Korea 2016] Track3 - Powered by OpenStack, Power to do more w...OpenStack Korea Community

[OpenStack Days Korea 2016] Track3 - 방송제작용 UHD 스트로지 구성 및 테스트OpenStack Korea Community

[OpenStack Days Korea 2016] Track2 - 아리스타 OpenStack 연동 및 CloudVision 솔루션 소개OpenStack Korea Community

[OpenStack Days Korea 2016] Track3 - OpenStack on 64-bit ARM with X-GeneOpenStack Korea Community

The document introduces AppliedMicro's X-Gene® processor technology. The X-Gene 1 and X-Gene 2 are server-on-a-chip solutions that integrate ARMv8 CPU cores, memory controllers, networking, storage and I/O interfaces while achieving high performance and low power. Benchmark results show the X-Gene processors providing competitive performance to Intel Xeon chips while using less power. The high-density, low-power X-Gene chips allow building scale-out servers that deliver significantly higher performance and lower costs than traditional scale-up servers for various workloads like web applications and databases.

[OpenStack Days Korea 2016] Track4 - Deep Drive: k8s with DockerOpenStack Korea Community

This document provides an overview of Kubernetes and its components. It discusses the Go programming language features used in Kubernetes. It also describes how Kubernetes is architected, including the kube-apiserver, kube-scheduler, Kubelet, reconciliation process, and networking with Flannel. The presenter is Anseungkyu who worked on OpenStack private clouds and is now the deputy representative for OpenStack Korea.

[OpenStack Days Korea 2016] Track4 - 오픈스택을 공부합시다 - 커뮤니티 스터디 분과 소개OpenStack Korea Community

[OpenStack Days Korea 2016] Track3 - 머신러닝과 오픈스택OpenStack Korea Community

[OpenStack Days Korea 2016] Track2 - OpenStack 기반 소프트웨어 정의 스토리지 기술OpenStack Korea Community

This document discusses software defined storage based on OpenStack. It provides background on the author's experience including medical image processing, Linux kernel development, and OpenStack components like Heat, SDN and OPNFV. It then discusses several OpenStack storage components - Cinder for block storage, Swift for object storage, and Manila for shared file systems. It explains how these components work, their APIs and plugins to interface with different backend storage systems. Finally, it compares Cinder, Swift and other technologies like Ceph.