SlideShare a Scribd company logo
Architektura systemu 
OpenContrail 
Michał Dubiel 
Kraków 2014
Plan 
• Cloud operating system 
– Why? 
• Network virtualization 
– Why it is important 
– OpenContrail solution 
• OpenContrail architecture 
– Goals, assumptions 
– Functional partitioning 
– Components
• Compute power 
• Storage 
• Networking 
CLOUD OPERATING SYSTEM
Operating System analogy 
• Resources in a typical server 
– CPU cores 
– Memory 
– Storage 
– Networking 
• Resources in a datacenter 
– Hardware machines 
– Storage appliances 
– Networking equipment
OpenStack 
source: openstack.org
Up to now quite missing 
source: openstack.org
• Virtual endpoints domination 
• Solutions 
NETWORK VIRTUALIZATION
Rack, servers, VMs 
VM VM VM VM 
hypervisor 
VM VM VM VM 
hypervisor 
VM VM VM VM 
hypervisor 
Server rack 
To spine switch
A wider view 
Clos network
Observations 
• Majority of network endpoints are virtual 
• Virtual networks dominate 
• Isolation between them has to be 
provided 
• While using the same physical network 
• Automatically
Solutions 
• Vlans 
– Default OpenStack approach 
– Limited, not flexible 
• Overlay networking 
– OpenContrail as a Neutron plugin 
– Flexible 
– Scalable
VLANs 
• VM’s interfaces placed on bridges 
– Each bridge for a virtual network 
• Difficult to manage 
• 4096 VLAN tags limit 
– Can be extended using Shortest Path Bridging 
• Physical switches have to contain the VN state
Overlay networking 
• “Old” technology, new for data-centers 
• Physical underlay network 
– IP fabric 
– No state of the virtual networks 
• Virtual overlay network 
– Holds state of the virtual networks 
– Dynamic tunnels (MPLSoGRE, VXLAN, etc.)
VM migration example 
VM1 VM2 
VM3 
Server 1 
VM4 VM5 
VM6 
Server 2 
Physical switch 
VM7 VM8 
VM9 
Server 3 
Virtual networks: 
1 2 
3 
S3 VM9 Payload 
Physical network:
VM migration example 
VM1 VM2 
VM3 
Server 1 
VM4 VM5 
Physical switch 
VM6 
VM9 Server 2 
VM7 VM8 
Server 3 
Virtual networks: 
1 2 
3 
S2 VM9 Payload 
Physical network:
Overlay networks advantages 
• “Knowledge” about network only in the 
software (vRouter) 
• Any switch works for IP fabric network 
– No configuration 
– Only speed matters 
– Low price 
• OpenContrail implementation is standards-based 
(MPLS, BGP, VXLAN, etc.)
• Goals 
• Nodes 
• Components 
OPENCONTRAIL ARCHITECTURE
Architecture goals 
• Scalability 
• Compatibility 
• Extensibility 
• Fault tolerance 
• Performance
“Think globally, act locally” 
• The system is physically distributed 
– No single point of failure 
– Scalability 
– Performance 
• Logically centralized control and management 
– Simplicity 
– Ease of use
Architecture overview 
Source: www.opencontrail.org
Configuration node 
Source: www.opencontrail.org
Configuration node components 
• Configuration API Server 
– Active/Active mode 
– Receives REST API calls 
– Publishes configuration to the IF-MAP Server 
– Receives configuration from other API Servers 
• Discovery Service 
– Active/Active mode 
– A Registry of all OpenContrail services 
– Provides REST API for publishing and querying of 
services
Configuration node components (2) 
• Schema Transformer 
– Active/Backup mode 
– Receives high-level configuration from IF-MAP Server 
– Transforms high-level constructs (eg. virtual network) 
to low-level (eg. routing instance) 
• IF-MAP Server 
– Active/Active mode 
– Publishes system configuration to Control nodes, 
Schema Transformer 
– All configuration comes from API Server (both high 
and low level)
Configuration node components (3) 
• Service Monitor 
– Active/Backup mode 
– Monitors service virtual machines (firewall, analyzer, 
etc.) 
– Calls nova API to control VMs 
• AMPQ Server (RabbitMQ) 
– Communication between system components 
• Persistent storage (Cassandra) 
– Receives and stores system configuration from the 
Configuration API Server
Configuration flow (user) 
1. User Request 
2. Original API Server 
3. RabbitMQ 
4. All API Servers 
5. Local IF-MAP Server 
6. Schema Transformer
Configuration flow (transformed) 
1. Schema Transformer 
2. Configuration API Server 
3. RabbitMQ 
4. All API Servers 
5. Local IF-MAP Server 
6. Control nodes and DNS
Controller node 
Source: www.opencontrail.org
Control node components 
• Controller 
– Active/Active mode 
– Receives configuration from IF-MAP Server 
– Exchanges XMPP messages with vRouter Agent 
– Federate with other nodes and physical switches via 
BGP/Netconf 
• DNS Service 
– Active/Active 
– Receives configuration from IF-MAP Server 
– Exchanges XMPP messages with vRouter Agent 
– Front-end only, backend using host native ‘named’
Compute node 
Nova 
Scheduler 
Contrail Control 
node 
Nova vif 
driver 
VM VM VM 
KVM 
Contrail 
Agent 
Contrail 
vRouter 
Nova 
compute 
Libvirt 
Kernel space 
TCP 
NetLink 
/dev/flow 
pkt 
QEMU 
TUN/TAP
Compute node components 
• vRouter Agent 
– Communication via XMPP with the Control node 
– Installation of forwarding state into vRouter 
– ARP, DHCP, DNS proxy 
• vRouter 
– Packet forwarding 
– Applying flow policies 
– Encapsulation, decapsulation
Agent <-> vRouter communication 
• NetLink 
– Routing entry, next-hop, flow, etc. synchronization 
– Uses RCU 
• /dev/flow 
– Shared memory for flow hash tables 
• pkt tap device 
– Flow discovery (first packet of a flow) 
– ARP, DHCP, DNS proxy
Analytics node 
Source: www.opencontrail.org
Analytics node components 
• API Server 
– REST API for querying analytics 
• Collector 
– Collects analytics information from all system nodes 
• Query Engine 
– Map-reduce over collected analytics 
– Executes queries 
• Rules Engine 
– Controls which events are collected by the Collector
Any questions?

More Related Content

PDF
NaaS in OpenStack - CloudCamp Moscow
Ilya Alekseyev
 
PDF
Function Mesh for Apache Pulsar, the Way for Simple Streaming Solutions
StreamNative
 
PDF
【EPN Seminar Nov.10.2015】 Services Function Chaining Architecture, Standardiz...
シスコシステムズ合同会社
 
PPTX
DEVNET-1175 OpenDaylight Service Function Chaining
Cisco DevNet
 
PPTX
VXLAN Practice Guide
Prasenjit Sarkar
 
PPTX
Traffic Control as a Service
Ofer Ben Yaacov
 
PPTX
Barak Perlman, ConteXtream - SFC (Service Function Chaining) Using Openstack ...
Cloud Native Day Tel Aviv
 
PDF
10 sdn-vir-6up
Sachin Siddappa
 
NaaS in OpenStack - CloudCamp Moscow
Ilya Alekseyev
 
Function Mesh for Apache Pulsar, the Way for Simple Streaming Solutions
StreamNative
 
【EPN Seminar Nov.10.2015】 Services Function Chaining Architecture, Standardiz...
シスコシステムズ合同会社
 
DEVNET-1175 OpenDaylight Service Function Chaining
Cisco DevNet
 
VXLAN Practice Guide
Prasenjit Sarkar
 
Traffic Control as a Service
Ofer Ben Yaacov
 
Barak Perlman, ConteXtream - SFC (Service Function Chaining) Using Openstack ...
Cloud Native Day Tel Aviv
 
10 sdn-vir-6up
Sachin Siddappa
 

What's hot (20)

PPTX
Juniper Network Automation for KrDAG
KwonSun Bae
 
PDF
VPNaaS in Neutron
Kazunori Takeuchi
 
PPTX
EYWA (Elastic load-balancing & high-availabilitY Wired virtual network Archit...
Jeong, Wookjae
 
PDF
【EPN Seminar Nov.10. 2015】 パネルディスカッション その2: BGP Peering Engineering Automatio...
シスコシステムズ合同会社
 
PDF
Service Chaining overview (English) 2015/10/05
Kentaro Ebisawa
 
PPTX
Introduction to vxlan
Mohammed Umair
 
PDF
An Overview of Linux Networking Options
Scott Lowe
 
PDF
Interconnecting Neutron and Network Operators' BGP VPNs
Thomas Morin
 
PPTX
Vxlan deep dive session rev0.5 final
KwonSun Bae
 
PPTX
Overview of Distributed Virtual Router (DVR) in Openstack/Neutron
vivekkonnect
 
PDF
Open Networking for Your OpenStack
Cumulus Networks
 
ODP
What's new in Neutron Juno
Jaume Devesa Gomez
 
PPTX
VLAN
Varsha Honde
 
PPTX
VXLAN Integration with CloudStack Advanced Zone
Yoshikazu Nojima
 
PDF
Cumulus Linux 2.5.4
Cumulus Networks
 
PPTX
Data centre networking at London School of Economics and Political Science - ...
Jisc
 
PPTX
DevOops - Lessons Learned from an OpenStack Network Architect
James Denton
 
PPTX
DEVNET-1006 Getting Started with OpenDayLight
Cisco DevNet
 
PPTX
L2 and L3 agent restructure
Rossella Sblendido
 
Juniper Network Automation for KrDAG
KwonSun Bae
 
VPNaaS in Neutron
Kazunori Takeuchi
 
EYWA (Elastic load-balancing & high-availabilitY Wired virtual network Archit...
Jeong, Wookjae
 
【EPN Seminar Nov.10. 2015】 パネルディスカッション その2: BGP Peering Engineering Automatio...
シスコシステムズ合同会社
 
Service Chaining overview (English) 2015/10/05
Kentaro Ebisawa
 
Introduction to vxlan
Mohammed Umair
 
An Overview of Linux Networking Options
Scott Lowe
 
Interconnecting Neutron and Network Operators' BGP VPNs
Thomas Morin
 
Vxlan deep dive session rev0.5 final
KwonSun Bae
 
Overview of Distributed Virtual Router (DVR) in Openstack/Neutron
vivekkonnect
 
Open Networking for Your OpenStack
Cumulus Networks
 
What's new in Neutron Juno
Jaume Devesa Gomez
 
VXLAN Integration with CloudStack Advanced Zone
Yoshikazu Nojima
 
Cumulus Linux 2.5.4
Cumulus Networks
 
Data centre networking at London School of Economics and Political Science - ...
Jisc
 
DevOops - Lessons Learned from an OpenStack Network Architect
James Denton
 
DEVNET-1006 Getting Started with OpenDayLight
Cisco DevNet
 
L2 and L3 agent restructure
Rossella Sblendido
 
Ad

Similar to PLNOG 13: Michał Dubiel: OpenContrail software architecture (20)

PDF
Software Defined Networks (SDN) na przykładzie rozwiązania OpenContrail.
Semihalf
 
PDF
OpenStack and OpenContrail for FreeBSD platform by Michał Dubiel
eurobsdcon
 
PDF
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...
nvirters
 
PPTX
Raga_SDN_NSX_1
Ranjith Kumar
 
PPTX
Secure Multi Tenant Cloud with OpenContrail
Priti Desai
 
PPTX
Open stack ha design & deployment kilo
Steven Li
 
PPTX
Network and Service Virtualization tutorial at ONUG Spring 2015
SDN Hub
 
PDF
Open stack networking_101_update_2014-os-meetups
yfauser
 
PPTX
OpenStack Networking and Automation
Adam Johnson
 
PPTX
Openstack Basic with Neutron
KwonSun Bae
 
PDF
Understanding network and service virtualization
SDN Hub
 
PDF
NSX: La Virtualizzazione di Rete e il Futuro della Sicurezza
VMUG IT
 
PDF
Agile OpenStack Networking with Cisco Solutions
Cisco DevNet
 
PPTX
Testing the limits of cloud networks
PLUMgrid
 
PDF
CloudStack - LinuxFest NorthWest
ke4qqq
 
PPTX
Virt july-2013-meetup
nvirters
 
PPT
CloudStack and SDN
Sebastien Goasguen
 
PPTX
Openstack meetup-pune-aug22-overview
rajdeep
 
PDF
DPDK Summit 2015 - RIFT.io - Tim Mortsolf
Jim St. Leger
 
PDF
Osnug meetup-tungsten fabric - overview.pptx
M.Qasim Arham
 
Software Defined Networks (SDN) na przykładzie rozwiązania OpenContrail.
Semihalf
 
OpenStack and OpenContrail for FreeBSD platform by Michał Dubiel
eurobsdcon
 
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...
nvirters
 
Raga_SDN_NSX_1
Ranjith Kumar
 
Secure Multi Tenant Cloud with OpenContrail
Priti Desai
 
Open stack ha design & deployment kilo
Steven Li
 
Network and Service Virtualization tutorial at ONUG Spring 2015
SDN Hub
 
Open stack networking_101_update_2014-os-meetups
yfauser
 
OpenStack Networking and Automation
Adam Johnson
 
Openstack Basic with Neutron
KwonSun Bae
 
Understanding network and service virtualization
SDN Hub
 
NSX: La Virtualizzazione di Rete e il Futuro della Sicurezza
VMUG IT
 
Agile OpenStack Networking with Cisco Solutions
Cisco DevNet
 
Testing the limits of cloud networks
PLUMgrid
 
CloudStack - LinuxFest NorthWest
ke4qqq
 
Virt july-2013-meetup
nvirters
 
CloudStack and SDN
Sebastien Goasguen
 
Openstack meetup-pune-aug22-overview
rajdeep
 
DPDK Summit 2015 - RIFT.io - Tim Mortsolf
Jim St. Leger
 
Osnug meetup-tungsten fabric - overview.pptx
M.Qasim Arham
 
Ad

Recently uploaded (20)

PPTX
Perkembangan Perangkat jaringan komputer dan telekomunikasi 3.pptx
Prayudha3
 
PPTX
Microsoft PowerPoint Student PPT slides.pptx
Garleys Putin
 
PPTX
Pengenalan perangkat Jaringan komputer pada teknik jaringan komputer dan tele...
Prayudha3
 
PPTX
B2B_Ecommerce_Internship_Simranpreet.pptx
LipakshiJindal
 
PDF
Latest Scam Shocking the USA in 2025.pdf
onlinescamreport4
 
PPTX
Slides Powerpoint: Eco Economic Epochs.pptx
Steven McGee
 
PDF
Slides: PDF Eco Economic Epochs for World Game (s) pdf
Steven McGee
 
PPTX
Artificial-Intelligence-in-Daily-Life (2).pptx
nidhigoswami335
 
PDF
Data Protection & Resilience in Focus.pdf
AmyPoblete3
 
PPTX
Unlocking Hope : How Crypto Recovery Services Can Reclaim Your Lost Funds
lionsgate network
 
PDF
The Internet of Things (IoT) refers to a vast network of interconnected devic...
chethana8182
 
PPTX
原版北不列颠哥伦比亚大学毕业证文凭UNBC成绩单2025年新版在线制作学位证书
e7nw4o4
 
PDF
UI/UX Developer Guide: Tools, Trends, and Tips for 2025
Penguin peak
 
PPTX
Parallel & Concurrent ...
yashpavasiya892
 
PPTX
How tech helps people in the modern era.
upadhyayaryan154
 
PPTX
The Monk and the Sadhurr and the story of how
BeshoyGirgis2
 
PPTX
LESSON-2-Roles-of-ICT-in-Teaching-for-learning_123922 (1).pptx
renavieramopiquero
 
PDF
LB# 820-1889_051-7370_C000.schematic.pdf
matheusalbuquerqueco3
 
PPTX
Blue and Dark Blue Modern Technology Presentation.pptx
ap177979
 
PPT
Transformaciones de las funciones elementales.ppt
rirosel211
 
Perkembangan Perangkat jaringan komputer dan telekomunikasi 3.pptx
Prayudha3
 
Microsoft PowerPoint Student PPT slides.pptx
Garleys Putin
 
Pengenalan perangkat Jaringan komputer pada teknik jaringan komputer dan tele...
Prayudha3
 
B2B_Ecommerce_Internship_Simranpreet.pptx
LipakshiJindal
 
Latest Scam Shocking the USA in 2025.pdf
onlinescamreport4
 
Slides Powerpoint: Eco Economic Epochs.pptx
Steven McGee
 
Slides: PDF Eco Economic Epochs for World Game (s) pdf
Steven McGee
 
Artificial-Intelligence-in-Daily-Life (2).pptx
nidhigoswami335
 
Data Protection & Resilience in Focus.pdf
AmyPoblete3
 
Unlocking Hope : How Crypto Recovery Services Can Reclaim Your Lost Funds
lionsgate network
 
The Internet of Things (IoT) refers to a vast network of interconnected devic...
chethana8182
 
原版北不列颠哥伦比亚大学毕业证文凭UNBC成绩单2025年新版在线制作学位证书
e7nw4o4
 
UI/UX Developer Guide: Tools, Trends, and Tips for 2025
Penguin peak
 
Parallel & Concurrent ...
yashpavasiya892
 
How tech helps people in the modern era.
upadhyayaryan154
 
The Monk and the Sadhurr and the story of how
BeshoyGirgis2
 
LESSON-2-Roles-of-ICT-in-Teaching-for-learning_123922 (1).pptx
renavieramopiquero
 
LB# 820-1889_051-7370_C000.schematic.pdf
matheusalbuquerqueco3
 
Blue and Dark Blue Modern Technology Presentation.pptx
ap177979
 
Transformaciones de las funciones elementales.ppt
rirosel211
 

PLNOG 13: Michał Dubiel: OpenContrail software architecture

  • 1. Architektura systemu OpenContrail Michał Dubiel Kraków 2014
  • 2. Plan • Cloud operating system – Why? • Network virtualization – Why it is important – OpenContrail solution • OpenContrail architecture – Goals, assumptions – Functional partitioning – Components
  • 3. • Compute power • Storage • Networking CLOUD OPERATING SYSTEM
  • 4. Operating System analogy • Resources in a typical server – CPU cores – Memory – Storage – Networking • Resources in a datacenter – Hardware machines – Storage appliances – Networking equipment
  • 6. Up to now quite missing source: openstack.org
  • 7. • Virtual endpoints domination • Solutions NETWORK VIRTUALIZATION
  • 8. Rack, servers, VMs VM VM VM VM hypervisor VM VM VM VM hypervisor VM VM VM VM hypervisor Server rack To spine switch
  • 9. A wider view Clos network
  • 10. Observations • Majority of network endpoints are virtual • Virtual networks dominate • Isolation between them has to be provided • While using the same physical network • Automatically
  • 11. Solutions • Vlans – Default OpenStack approach – Limited, not flexible • Overlay networking – OpenContrail as a Neutron plugin – Flexible – Scalable
  • 12. VLANs • VM’s interfaces placed on bridges – Each bridge for a virtual network • Difficult to manage • 4096 VLAN tags limit – Can be extended using Shortest Path Bridging • Physical switches have to contain the VN state
  • 13. Overlay networking • “Old” technology, new for data-centers • Physical underlay network – IP fabric – No state of the virtual networks • Virtual overlay network – Holds state of the virtual networks – Dynamic tunnels (MPLSoGRE, VXLAN, etc.)
  • 14. VM migration example VM1 VM2 VM3 Server 1 VM4 VM5 VM6 Server 2 Physical switch VM7 VM8 VM9 Server 3 Virtual networks: 1 2 3 S3 VM9 Payload Physical network:
  • 15. VM migration example VM1 VM2 VM3 Server 1 VM4 VM5 Physical switch VM6 VM9 Server 2 VM7 VM8 Server 3 Virtual networks: 1 2 3 S2 VM9 Payload Physical network:
  • 16. Overlay networks advantages • “Knowledge” about network only in the software (vRouter) • Any switch works for IP fabric network – No configuration – Only speed matters – Low price • OpenContrail implementation is standards-based (MPLS, BGP, VXLAN, etc.)
  • 17. • Goals • Nodes • Components OPENCONTRAIL ARCHITECTURE
  • 18. Architecture goals • Scalability • Compatibility • Extensibility • Fault tolerance • Performance
  • 19. “Think globally, act locally” • The system is physically distributed – No single point of failure – Scalability – Performance • Logically centralized control and management – Simplicity – Ease of use
  • 20. Architecture overview Source: www.opencontrail.org
  • 21. Configuration node Source: www.opencontrail.org
  • 22. Configuration node components • Configuration API Server – Active/Active mode – Receives REST API calls – Publishes configuration to the IF-MAP Server – Receives configuration from other API Servers • Discovery Service – Active/Active mode – A Registry of all OpenContrail services – Provides REST API for publishing and querying of services
  • 23. Configuration node components (2) • Schema Transformer – Active/Backup mode – Receives high-level configuration from IF-MAP Server – Transforms high-level constructs (eg. virtual network) to low-level (eg. routing instance) • IF-MAP Server – Active/Active mode – Publishes system configuration to Control nodes, Schema Transformer – All configuration comes from API Server (both high and low level)
  • 24. Configuration node components (3) • Service Monitor – Active/Backup mode – Monitors service virtual machines (firewall, analyzer, etc.) – Calls nova API to control VMs • AMPQ Server (RabbitMQ) – Communication between system components • Persistent storage (Cassandra) – Receives and stores system configuration from the Configuration API Server
  • 25. Configuration flow (user) 1. User Request 2. Original API Server 3. RabbitMQ 4. All API Servers 5. Local IF-MAP Server 6. Schema Transformer
  • 26. Configuration flow (transformed) 1. Schema Transformer 2. Configuration API Server 3. RabbitMQ 4. All API Servers 5. Local IF-MAP Server 6. Control nodes and DNS
  • 27. Controller node Source: www.opencontrail.org
  • 28. Control node components • Controller – Active/Active mode – Receives configuration from IF-MAP Server – Exchanges XMPP messages with vRouter Agent – Federate with other nodes and physical switches via BGP/Netconf • DNS Service – Active/Active – Receives configuration from IF-MAP Server – Exchanges XMPP messages with vRouter Agent – Front-end only, backend using host native ‘named’
  • 29. Compute node Nova Scheduler Contrail Control node Nova vif driver VM VM VM KVM Contrail Agent Contrail vRouter Nova compute Libvirt Kernel space TCP NetLink /dev/flow pkt QEMU TUN/TAP
  • 30. Compute node components • vRouter Agent – Communication via XMPP with the Control node – Installation of forwarding state into vRouter – ARP, DHCP, DNS proxy • vRouter – Packet forwarding – Applying flow policies – Encapsulation, decapsulation
  • 31. Agent <-> vRouter communication • NetLink – Routing entry, next-hop, flow, etc. synchronization – Uses RCU • /dev/flow – Shared memory for flow hash tables • pkt tap device – Flow discovery (first packet of a flow) – ARP, DHCP, DNS proxy
  • 32. Analytics node Source: www.opencontrail.org
  • 33. Analytics node components • API Server – REST API for querying analytics • Collector – Collects analytics information from all system nodes • Query Engine – Map-reduce over collected analytics – Executes queries • Rules Engine – Controls which events are collected by the Collector

Editor's Notes

  • #3: Cel (przedstawić architekture sofware’u, zachęcić do rozwijania) Temat Agenda Czas Dlaczego ja
  • #8: Dojdziemy do tego jak się OpenContrail integruje z OpenStackiem później Zastanówmy się jaki mamy tutaj problem w datacentrze zarządzanym przez OpenStacka
  • #11: - Top of rack - Są inne np. End-of-row
  • #12: Kto zna proste rozwiazanie VLAN?
  • #14: Migration example
  • #22: Doszliśmy do sedna sprawy, wiemy jak ma (od strony sieciowej działać system) jak to teraz zrealizować
  • #25: - Modele danych HIGH i LOW level