P4_tutorial.pdf

Copyright © 2018 – P4.org
P4 Language Tutorial
Slides: https://bit.ly/p4d2-2018-spring
Software Setup
◦ Download VM or copy from USB stick
◦ Import VM into VirtualBox or VMware Fusion
◦ Boot VM and login as user "p4" with passwd "p4"
◦ Open Terminal
◦ cd ~/tutorials; git pull

Goals
• Learn P4 Language
◦ Traditional applications
◦ Novel applications
• Learn P4 software tools
◦ P4 Compiler
◦ BMv2
◦ P4Runtime
• Learn about future technology trends
◦ Keynote by Arvind Krishnamurthy (Washington)
◦ Panel with representatives from ONF, Kaloom, and Keysight
• Networking (the other kind)
• Have fun!

Introduction to Data Plane Programming
Language Basics
Software Tools & P4 Runtime
Keynote (Arvind Krishnamurthy)
Monitoring & Debugging
Advanced Data Structures
Panel Discussion
Reception
Lunch
Break
Break

Instructors
Stephen Ibanez
Stanford
Mina Arashloo
Princeton
Brian O'Connor
ONF

Thank you
• Sedef Ozcana (P4.org)
• Rachel Everman (Barefoot)
• Arvind Krishnamurthy (Washington)
• Panelists
◦ Uyen Chau (ONF)
◦ Bochra Boughzala (Kaloom)
◦ Ben Pfaff (VMware)
◦ Chris Sommers (Keysight)
• TAs
◦ Santiago Bautista (ENS/Cornell)
◦ Sean Choi (Stanford)
◦ Theo Jepsen (Lugano)
◦ Sarah Tollman (Stanford)

What is Data Plane Programming?
• Why program the Data Plane?
7

Software Defined Networking (SDN)
8
• Main contributions
◦ OpenFlow = standardized protocol to interact with
switch
■ download flow table entries, query statistics, etc.
◦ OpenFlow = standardized model
■ match/action abstraction
◦ Concept of logically centralized control via a
single entity (“SDN controller”)
■ Simplifies control plane
• Issues
◦ Data-plane protocol evolution requires changes to
standards (12 → 40 OpenFlow match fields)
◦ Limited interoperability between vendors
(OpenFlow / netconf / JSON / XML variants)
◦ Limited programmability
SDN
Controller
Switch
Southbound
I/F
Northbound I/F
Control Function (“App”)
x n
x m
x 1

Switch OS
Run-time API
Driver
“This is how I know to
process packets”
(i.e. the ASIC datasheet
makes the rules)
Fixed-function ASIC
Status Quo: Bottom-up design
9
?
Network Demands

Switch OS
Run-time API
Driver
“This is how I want the
network to behave and how to
switch packets…”
(the user / controller
makes the rules)
P4 Programmable Device
A Better Approach: Top-down design
10
Network Demands
P4
Feedback

Benefits of Data Plane Programmability
• New Features – Add new protocols
• Reduce complexity – Remove unused protocols
• Efficient use of resources – flexible use of tables
• Greater visibility – New diagnostic techniques, telemetry, etc.
• SW style development – rapid design cycle, fast innovation, fix data
plane bugs in the field
• You keep your own ideas
Think programming rather than protocols…
11

Programmable Network Devices
• PISA: Flexible Match+Action ASICs
◦ Intel Flexpipe, Cisco Doppler, Cavium (Xpliant), Barefoot Tofino, …
• NPU
◦ EZchip, Netronome, …
• CPU
◦ Open Vswitch, eBPF, DPDK, VPP…
• FPGA
◦ Xilinx, Altera, …
These devices let us tell them how to process packets.
12

What can you do with P4?
• Layer 4 Load Balancer – SilkRoad[1]
• Low Latency Congestion Control – NDP[2]
• In-band Network Telemetry – INT[3]
• In-Network caching and coordination – NetCache[4] / NetChain[5]
• Aggregation for MapReduce Applications [7]
• … and much more
13
[1] Miao, Rui, et al. "SilkRoad: Making Stateful Layer-4 Load Balancing Fast and Cheap Using Switching ASICs." SIGCOMM, 2017.
[2] Handley, Mark, et al. "Re-architecting datacenter networks and stacks for low latency and high performance.” SIGCOMM, 2017.
[3] Kim, Changhoon, et al. "In-band network telemetry via programmable dataplanes.” SIGCOMM. 2015.
[4] Xin Jin et al. “NetCache: Balancing Key-Value Stores with Fast In-Network Caching.” To appear at SOSP 2017
[5] Jin, Xin, et al. "NetChain: Scale-Free Sub-RTT Coordination." NSDI, 2018.
[6] Dang, Huynh Tu, et al. "NetPaxos: Consensus at network speed.” SIGCOMM, 2015.
[7] Sapio, Amedeo, et al. "In-Network Computation is a Dumb Idea Whose Time Has Come." Hot Topics in Networks. ACM, 2017.

Brief History and Trivia
14
• May 2013: Initial idea and the name “P4”
• July 2014: First paper (SIGCOMM CCR)
• Aug 2014: First P414
Draft Specification (v0.9.8)
• Sep 2014: P414
Specification released (v1.0.0)
• Jan 2015: P414
v1.0.1
• Mar 2015: P414
v1.0.2
• Nov 2016: P414
v1.0.3
• May 2017: P414
v1.0.4
• Apr 2016: P416
– first commits
• Dec 2016: First P416
Draft Specification
• May 2017: P416
Specification released

P4_16 Data Plane Model
15

PISA: Protocol-Independent Switch Architecture
16
Programmable
Parser
Programmable
Deparser
Programmable Match-Action Pipeline
Programmer declares the
headers that should be
recognized and their order in
the packet
Programmer defines the
tables and the exact
processing algorithm
Programmer declares
how the output packet
will look on the wire

PISA in Action
• Packet is parsed into individual headers (parsed representation)
• Headers and intermediate results can be used for matching and
actions
• Headers can be modified, added or removed
• Packet is deparsed (serialized)
17
Programmable
Parser
Programmable
Deparser
Programmable Match-Action Pipeline

P416
Language Elements
18
Architecture
Description
Extern Libraries
Programmable blocks
and their interfaces
Support for specialized
components
Data Types
Bistrings, headers,
structures, arrays
Controls
Tables, Actions,
control flow
statements
Parsers
Expressions
Basic operations
and operators
State machine,
bitfield extraction

Community-Developed
P4_16 Approach
Term Explanation
P4 Target An embodiment of a specific hardware implementation
P4 Architecture
Provides an interface to program a target via some set of P4-programmable components,
externs, fixed components
19
P416
Language
P416
Core
Library
Vendor-supplied
Extern
Libraries
Architecture
Definition

Example Architectures and Targets
20
TM
TM
TM
V1Model
Anything
SimpleSumeSwitch
Portable Switch Architecture (PSA)

Programming a P4 Target
21
P4 Architecture
Model
P4 Compiler
Target-specific
configuration
binary
Data Plane
Tables
Extern
objects
Load
Target
Vendor supplied
P4 Program
User supplied
Control Plane
Add/remove
table entries
CPU port
Packet-in/out
Extern
control
RUNTIME

Lab 1: Basics
22

Before we start...
•Install VM image (Look for instructor with USB sticks)
•Please make sure that your VM is up to date
◦$ cd ~/tutorials && git pull
•We’ll be using several software tools pre-installed on the VM
◦Bmv2: a P4 software switch
◦p4c: the reference P4 compiler
◦Mininet: a lightweight network emulation environment
•Each directory contains a few scripts
◦$ make : compiles P4 program, execute on Bmv2 in Mininet, populate tables
◦*.py: send and receive test packets in Mininet
•Exercises
◦Each example comes with an incomplete implementation; your job is to finish it!
◦Look for “TODOs” (or peek at the P4 code in solution/ if you must)
23

V1Model Architecture
24
• Implemented on top of Bmv2’s simple_switch target
Traffic
Manager
Deparser
Checksum Verification /
Ingress Match-Action
Parser Checksum Update /
Egress Match-Action

V1Model Standard Metadata
25
struct standard_metadata_t {
bit<9> ingress_port;
bit<9> egress_spec;
bit<9> egress_port;
bit<32> clone_spec;
bit<32> instance_type;
bit<1> drop;
bit<16> recirculate_port;
bit<32> packet_length;
bit<32> enq_timestamp;
bit<19> enq_qdepth;
bit<32> deq_timedelta;
bit<19> deq_qdepth;
bit<48> ingress_global_timestamp;
bit<32> lf_field_list;
bit<16> mcast_grp;
bit<1> resubmit_flag;
bit<16> egress_rid;
bit<1> checksum_error;
}
• ingress_port - the port on which
the packet arrived
• egress_spec - the port to which
the packet should be sent to
• egress_port - the port that the
packet will be sent out of (read
only in egress pipeline)

P416
Program Template (V1Model)
26
#include <core.p4>
#include <v1model.p4>
/* HEADERS */
struct metadata { ... }
struct headers {
ethernet_t ethernet;
ipv4_t ipv4;
}
/* PARSER */
parser MyParser(packet_in packet,
out headers hdr,
inout metadata meta,
inout standard_metadata_t smeta) {
...
}
/* CHECKSUM VERIFICATION */
control MyVerifyChecksum(in headers hdr,
inout metadata meta) {
...
}
/* INGRESS PROCESSING */
control MyIngress(inout headers hdr,
inout standard_metadata_t std_meta) {
...
}
/* EGRESS PROCESSING */
control MyEgress(inout headers hdr,
...
}
/* CHECKSUM UPDATE */
control MyComputeChecksum(inout headers hdr,
...
}
/* DEPARSER */
control MyDeparser(inout headers hdr,
...
}
/* SWITCH */
V1Switch(
MyParser(),
MyVerifyChecksum(),
MyIngress(),
MyEgress(),
MyComputeChecksum(),
MyDeparser()
) main;

P416
Hello World (V1Model)
#include <core.p4>
struct metadata {}
struct headers {}
out headers hdr,
inout standard_metadata_t standard_metadata) {
state start { transition accept; }
}
control MyVerifyChecksum(inout headers hdr, inout metadata
meta) { apply { } }
apply {
if (standard_metadata.ingress_port == 1) {
standard_metadata.egress_spec = 2;
} else if (standard_metadata.ingress_port == 2) {
standard_metadata.egress_spec = 1;
}
}
}
apply { }
}
control MyComputeChecksum(inout headers hdr, inout metadata
meta) {
apply { }
}
control MyDeparser(packet_out packet, in headers hdr) {
apply { }
}
V1Switch(
MyParser(),
MyVerifyChecksum(),
MyIngress(),
MyEgress(),
MyComputeChecksum(),
MyDeparser()
) main;

P416
Hello World (V1Model)
#include <core.p4>
struct metadata {}
struct headers {}
parser MyParser(packet_in packet, out headers hdr,
state start { transition accept; }
}
control MyIngress(inout headers hdr, inout metadata meta,
action set_egress_spec(bit<9> port) {
standard_metadata.egress_spec = port;
}
table forward {
key = { standard_metadata.ingress_port: exact; }
actions = {
set_egress_spec;
NoAction;
}
size = 1024;
default_action = NoAction();
}
apply { forward.apply(); }
}
apply { }
}
control MyVerifyChecksum(inout headers hdr, inout metadata
meta) { apply { } }
control MyComputeChecksum(inout headers hdr, inout metadata
meta) { apply { } }
control MyDeparser(packet_out packet, in headers hdr) {
apply { }
}
V1Switch( MyParser(), MyVerifyChecksum(), MyIngress(),
MyEgress(), MyComputeChecksum(), MyDeparser() ) main;
Key Action ID Action Data
1 set_egress_spec ID 2
2 set_egress_spec ID 1

Running Example: Basic Forwarding
•We’ll use a simple application as a running example—a basic
router—to illustrate the main features of P416
•Basic router functionality:
◦Parse Ethernet and IPv4 headers from packet
◦Find destination in IPv4 routing table
◦Update source / destination MAC addresses
◦Decrement time-to-live (TTL) field
◦Set the egress port
◦Deparse headers back into a packet
•We’ve written some starter code for you (basic.p4) and
implemented a static control plane
29

Basic Forwarding: Topology
30
s1
h1
(10.0.1.1)
s3
s2
h2
(10.0.2.2)
h3
(10.0.3.3)

typedef bit<48> macAddr_t;
typedef bit<32> ip4Addr_t;
header ethernet_t {
macAddr_t r; dstAdd
macAddr_t srcAddr;
bit<16> etherType;
}
header ipv4_t {
bit<4> version;
bit<4> ihl;
bit<8> diffserv;
bit<16> totalLen;
bit<16> identification;
bit<3> flags;
bit<13> fragOffset;
bit<8> ttl;
bit<8> protocol;
bit<16> hdrChecksum;
ip4Addr_t srcAddr;
ip4Addr_t dstAddr;
}
P416
Types (Basic and Header Types)
31
Basic Types
• bit<n>: Unsigned integer (bitstring) of size n
• bit is the same as bit<1>
• int<n>: Signed integer of size n (>=2)
• varbit<n>: Variable-length bitstring
Header Types: Ordered collection of members
• Can contain bit<n>, int<n>, and varbit<n>
• Byte-aligned
• Can be valid or invalid
• Provides several operations to test and set validity bit:
isValid(), setValid(), and setInvalid()
Typedef: Alternative name for a type

/* Architecture */
struct standard_metadata_t {
bit<9> ingress_port;
bit<9> egress_spec;
bit<9> egress_port;
bit<32> clone_spec;
bit<32> instance_type;
bit<1> drop;
bit<16> recirculate_port;
bit<32> packet_length;
...
}
/* User program */
struct metadata {
...
}
struct headers {
ipv4_t ipv4;
}
P416
Types (Other Types)
32
Other useful types
• Struct: Unordered collection of members (with no
alignment restrictions)
• Header Stack: array of headers
• Header Union: one of several headers

P416
Parsers
• Parsers are functions that map packets
into headers and metadata, written in a
state machine style
• Every parser has three predefined states
◦ start
◦ accept
◦ reject
• Other states may be defined by the
programmer
• In each state, execute zero or more
statements, and then transition to
another state (loops are OK)
33
start
accept reject

/* From core.p4 */
extern packet_in {
void extract<T>(out T hdr);
void extract<T>(out T variableSizeHeader,
in bit<32> variableFieldSizeInBits);
T lookahead<T>();
void advance(in bit<32> sizeInBits);
bit<32> length();
}
/* User Program */
out headers hdr,
state start {
packet.extract(hdr.ethernet);
transition accept;
}
}
Parsers (V1Model)
34
MyParser
standard_meta
hdr
meta
packet_in
The platform Initializes
User Metadata to 0
meta

state start {
transition parse_ethernet;
}
state parse_ethernet {
packet.extract(hdr.ethernet);
transition select(hdr.ethernet.etherType) {
0x800: parse_ipv4;
default: accept;
}
}
Select Statement
35
P416
has a select statement that can be
used to branch in a parser
Similar to case statements in C or Java,
but without “fall-through behavior”—i.e.,
break statements are not needed
In parsers it is often necessary to branch
based on some of the bits just parsed
For example, etherType determines the
format of the rest of the packet
Match patterns can either be literals or
simple computations such as masks

Coding Break
36

P416
Controls
• Similar to C functions (without loops)
• Can declare variables, create tables, instantiate externs, etc.
• Functionality specified by code in apply statement
• Represent all kinds of processing that are expressible as DAG:
◦ Match-Action Pipelines
◦ Deparsers
◦ Additional forms of packet processing (updating checksums)
• Interfaces with other blocks are governed by user- and
architecture-specified types (typically headers and metadata)
37

/* Declarations region */
bit<48> tmp;
apply {
/* Control Flow */
tmp = hdr.ethernet.dstAddr;
hdr.ethernet.dstAddr = hdr.ethernet.srcAddr;
hdr.ethernet.srcAddr = tmp;
std_meta.egress_spec = std_meta.ingress_port;
}
}
Example: Reflector (V1Model)
Desired Behavior:
• Swap source and
destination MAC
addresses
• Bounce the packet back
out on the physical port
that it came into the
switch on

action swap_mac(inout bit<48> src,
inout bit<48> dst) {
bit<48> tmp = src;
src = dst;
dst = tmp;
}
apply {
swap_mac(hdr.ethernet.srcAddr,
hdr.ethernet.dstAddr);
std_meta.egress_spec = std_meta.ingress_port;
}
}
Example: Simple Actions
• Very similar to C functions
• Can be declared inside a control or
globally
• Parameters have type and direction
• Variables can be instantiated inside
• Many standard arithmetic and
logical operations are supported
◦ +, -, *
◦ ~, &, |, ^, >>, <<
◦ ==, !=, >, >=, <, <=
◦ No division/modulo
• Non-standard operations:
◦ Bit-slicing: [m:l] (works as l-value too)
◦ Bit Concatenation: ++

P416
Tables
• The fundamental unit of a Match-Action Pipeline
◦ Specifies what data to match on and match kind
◦ Specifies a list of possible actions
◦ Optionally specifies a number of table properties
■ Size
■ Default action
■ Static entries
■ etc.
• Each table contains one or more entries (rules)
• An entry contains:
◦ A specific key to match on
◦ A single action that is executed when a packet matches the entry
◦ Action data (possibly empty)
40

Directional
(DataPlane)
Parameters
Directionless
(Action
Data)
Parameters
Action
Code
Action
Execution
Tables: Match-Action Processing
41
Lookup Key
Key Action ID Action Data
Default
Action ID
Default
Action Data
Hit
Control Plane
Data
Headers and
Metadata
(Input)
Headers and
Metadata
(Output)
Action
ID
ID
Hit/Miss
Selector
Headers and Metadata

Example: IPv4_LPM Table
• Data Plane (P4) Program
◦ Defines the format of the table
■ Key Fields
■ Actions
■ Action Data
◦ Performs the lookup
◦ Executes the chosen action
• Control Plane (IP stack,
Routing protocols)
◦ Populates table entries with
specific information
■ Based on the configuration
■ Based on automatic discovery
■ Based on protocol calculations
42
Key Action Action Data
10.0.1.1/32 ipv4_forward dstAddr=00:00:00:00:01:01
port=1
10.0.1.2/32 drop
*` NoAction
10.0.1.1 10.0.1.2

table ipv4_lpm {
key = {
hdr.ipv4.dstAddr: lpm;
}
actions = {
ipv4_forward;
drop;
NoAction;
}
size = 1024;
default_action = NoAction();
}
IPv4_LPM Table
43

/* core.p4 */
match_kind {
exact,
ternary,
lpm
}
/* v1model.p4 */
match_kind {
range,
selector
}
/* Some other architecture */
match_kind {
regexp,
fuzzy
}
Match Kinds
44
• The type match_kind is special in P4
• The standard library (core.p4) defines
three standard match kinds
◦ Exact match
◦ Ternary match
◦ LPM match
• The architecture (v1model.p4) defines
two additional match kinds:
◦ range
◦ selector
• Other architectures may define (and
provide implementation for) additional
match kinds

/* core.p4 */
action NoAction() {
}
/* basic.p4 */
action drop() {
mark_to_drop();
}
/* basic.p4 */
action ipv4_forward(macAddr_t dstAddr,
bit<9> port) {
...
}
Defining Actions for L3 forwarding
45
• Actions can have two different
types of parameters
◦ Directional (from the Data Plane)
◦ Directionless (from the Control
Plane)
• Actions that are called directly:
◦ Only use directional parameters
• Actions used in tables:
◦ Typically use directionless
parameters
◦ May sometimes use directional
parameters too
Directional
(DataPlane)
Parameters
Directionless
(Action
Data)
Parameters
Action
Code
Action
Execution

table ipv4_lpm {
...
}
apply {
...
ipv4_lpm.apply();
...
}
}
Applying Tables in Controls
46

/* From core.p4 */
extern packet_out {
void emit<T>(in T hdr);
}
/* User Program */
control DeparserImpl(packet_out packet,
in headers hdr) {
apply {
...
packet.emit(hdr.ethernet);
...
}
}
P416
Deparsing
47
• Assembles the headers back
into a well-formed packet
• Expressed as a control function
◦No need for another construct!
• packet_out extern is defined in
core.p4: emit(hdr): serializes
header if it is valid
• Advantages:
• Makes deparsing explicit...
...but decouples from parsing

Coding Break
48

Basic Tunneling
49
•Add support for basic tunneling to the basic IP router
•Define a new header type (myTunnel) to encapsulate the IP packet
•myTunnel header includes:
○ proto_id : type of packet being encapsulated
○ dst_id : ID of destination host
•Modify the switch to perform routing using the myTunnel header

Basic Tunneling TODO List
• Define myTunnel_t header type and add to headers struct
• Update parser
• Define myTunnel_forward action
• Define myTunnel_exact table
• Update table application logic in MyIngress apply statement
• Update deparser
• Adding forwarding rules
50

Basic Forwarding: Topology
51
s1
h1
(10.0.1.1)
(dst_id: 1)
s3
s2
h2
(10.0.2.2)
(dst_id: 2)
h3
(10.0.3.3) (dst_id: 3)
1
2
3
1
2 3
1
2
3

Coding Break
52

FAQs
• Can I apply a table multiple times in my P4 Program?
◦ No (except via resubmit / recirculate)
• Can I modify table entries from my P4 Program?
◦ No (except for direct counters)
• What happens upon reaching the reject state of the parser?
◦ Architecture dependent
• How much of the packet can I parse?
◦ Architecture dependent
53

Fin!
54

P4→NetFPGA
• Prototype and evaluate P4 programs in real hardware!
• 4x10G network interfaces
• Special price for academic users :)
• https://github.com/NetFPGA/P4-NetFPGA-public/wiki
55

control MyIngress(...) {
table debug {
key = {
std_meta.egress_spec : exact;
}
actions = { }
}
apply {
...
debug.apply();
}
}
Debugging
56
• Bmv2 maintains logs that keep track of
how packets are processed in detail
• /tmp/p4s.s1.log
• /tmp/p4s.s2.log
• /tmp/p4s.s3.log
• Can manually add information to the
logs by using a dummy debug table that
reads headers and metadata of interest
•[15:16:48.145] [bmv2] [D]
[thread 4090] [96.0] [cxt 0]
Looking up key:
* std_meta.egress_spec : 2

Questions and Answers
57
https://bit.ly/join-p4-lang-slack
Join #d2-2018-spring channel
https://pigeonhole.at
Event code: P4D2
Questions for TAs
}
Questions for Panel
}

Copyright © 2018 – P4.org, ONF
Lab 2: P4Runtime
58

P4 Software Tools
59

Makefile: under the hood
60
test.p4
test.json
simple_switch_grpc
(BMv2)
P4Runtime server
Egress
Ingress
TM
Parser Deparser
Port Interface
L
o
g
D
e
b
u
g
p4c-bm2-ss
Packet
sniffer
Packet
generator
Linux Kernel
veth0..n
P4
Debugger
P4Runtime static controller
P4Runtime client
test.p4info
runtime.json
runtime.json
runtime.json
topology.json

Makefile: under the hood (in pseudocode)
61
P4C_ARGS = --p4runtime-file $(basename $@).p4info
--p4runtime-format text
RUN_SCRIPT = ../../utils/run_exercise.py
TOPO = topology.json
dirs:
mkdir -p build pcaps logs
build: for each P4 program, generate BMv2 json file
p4c-bm2-ss --p4v 16 $(P4C_ARGS) -o $@ $<
run: build, then [default target]
sudo python $(RUN_SCRIPT) -t $(TOPO)
stop: sudo mn -c
clean: stop, then
rm -f *.pcap
rm -rf build pcaps logs

Step 1: P4 Program compilation [build phase]
62
$ p4c-bm2-ss --p4v 16
-o test.json
--p4runtime-file test.p4info
--p4runtime-format text
test.p4
test.p4
test.json
p4c-bm2-ss
test.p4info

Step 2: run_exercise.py [run phase]
a. Create network based
on topology.json
b. Start
simple_switch_grpc
instance for each
switch
c. Use P4Runtime to
push the P4 program
(P4Info and BMv2
JSON)
d. Add the static rules
defined in runtime.json
63
simple_switch_grpc
(BMv2)
P4Runtime server (gRPC)
Egress
Ingress
TM
Parser Deparser
Port Interface
L
o
g
D
e
b
u
g
runtime.json
P4Runtime client (gRPC)
Linux Kernel
veth0..n
● P4Runtime server
address and port
● Path to BMv2 JSON
and P4Info to deploy
● Table entries

Step 3: Run the traffic generator and sniffer
In some exercises, this is
send.py and receive.py
In others, we use standard
Linux programs, like ping
In the p4runtime exercise,
we also run our own controller:
mycontroller.py instead of
the static one
64
simple_switch_grpc
(BMv2)
P4Runtime server
Egress
Ingress
TM
Parser Deparser
Port Interface
L
o
g
D
e
b
u
g
Packet
sniffer
Packet
generator
Linux Kernel
veth0..n
P4
Debugger
P4Runtime client

P4Runtime
• API overview
• Workflow
• Exercise - Tunneling
• Why P4Runtime?
65

Runtime control of P4 data planes
66
P4 Program
P4 Architecture
Model
P4 Compiler
Target-specific
configuration
binary
Control Plane
Data Plane
Tables
Extern
objects
Load
Vendor supplied
User supplied
Add/remove
table entries
CPU port
Packet-in/out
Extern
control
Focus of this
session

Existing approaches to runtime control
• P4 compiler auto-generated runtime APIs
◦ Program-dependent -- hard to provision new P4 program without restarting
the control plane!
• BMv2 CLI
◦ Program-independent, but target-specific -- control plane not portable!
• OpenFlow
◦ Target-independent, but protocol-dependent -- protocol headers and
actions baked in the specification!
• OCP Switch Abstraction Interface (SAI)
◦ Target-independent, but protocol-dependent
67

Why do we need another data plane control API?
68

Properties of a runtime control API
69
API Target-independent Protocol-independent
P4 compiler
auto-generated ✔ ✘
BMv2 CLI ✘ ✔
OpenFlow ✔ ✘
SAI ✔ ✘
P4Runtime ✔ ✔

Control plane
What is P4Runtime?
• Framework for runtime control of P4 targets
◦ Open-source API + server implementation
■ https://github.com/p4lang/PI
◦ Initial contribution by Google and Barefoot
• Work-in-progress by the p4.org API WG
◦ Draft of version 1.0 available
• Protobuf-based API definition
◦ p4runtime.proto
◦ gRPC transport
• P4 program-independent
◦ API doesn’t change with the P4 program
• Enables field-reconfigurability
◦ Ability to push new P4 program without recompiling the
software stack of target switches
70
p4runtime.proto
(API)
Program-independent
server (e.g. gRPC)
Target driver
P4 target

Protocol Buffers Basics
• Language for describing data for
serialization in a structured way
• Common binary wire-format
• Language-neutral
◦ Code generators for: Action Script, C,
C++, C#, Clojure, Lisp, D, Dart, Erlang,
Go, Haskell, Java, Javascript, Lua,
Objective C, OCaml, Perl, PHP, Python,
Ruby, Rust, Scala, Swift, Visual Basic, ...
• Platform-neutral
• Extensible and backwards compatible
• Strongly typed
71
syntax = "proto3";
message Person {
string name = 1;
int32 id = 2;
string email = 3;
enum PhoneType {
MOBILE = 0;
HOME = 1;
WORK = 2;
}
message PhoneNumber {
string number = 1;
PhoneType type = 2;
}
repeated PhoneNumber phone = 4;
}

gRPC Basics
● Use Protocol Buffers to define service API and messages
● Automatically generate native stubs in:
○ C / C++
○ C#
○ Dart
○ Go
○ Java
○ Node.js
○ PHP
○ Python
○ Ruby
● Transport over HTTP/2.0 and TLS
○ Efficient single TCP connection implementation that supports
bidirectional streaming
72

gRPC Service Example
73
More details here: https://grpc.io/docs/guides/
// The greeter service definition.
service Greeter {
// Sends a greeting
rpc SayHello (HelloRequest) returns (HelloReply) {}
}
// The request message containing the user's name.
message HelloRequest {
string name = 1;
}
// The response message containing the greetings
message HelloReply {
string message = 1;
}

P4Runtime Service
Enables a local or remote entity to load the pipeline/program,
send/receive packets, and read and write forwarding table entries,
counters, and other chip features.
service P4Runtime {
rpc Write(WriteRequest) returns (WriteResponse) {}
rpc Read(ReadRequest) returns (stream ReadResponse) {}
rpc SetForwardingPipelineConfig(SetForwardingPipelineConfigRequest)
returns (SetForwardingPipelineConfigResponse) {}
rpc GetForwardingPipelineConfig(GetForwardingPipelineConfigRequest)
returns (GetForwardingPipelineConfigResponse) {}
rpc StreamChannel(stream StreamMessageRequest)
returns (stream StreamMessageResponse) {}
}
74

P4Runtime Service
Protobuf Definition:
https://github.com/p4lang/PI/blob/master/proto/p4/v1/p4runtime.proto
Service Specification:
Working draft of version 1.0 is available now
https://p4.org/p4-spec/docs/P4Runtime-v1.0.0.pdf
75

P4Runtime Write Request
message WriteRequest {
uint64 device_id = 1;
uint64 role_id = 2;
Uint128 election_id = 3;
repeated Update updates = 4;
}
message Update {
enum Type {
UNSPECIFIED = 0;
INSERT = 1;
MODIFY = 2;
DELETE = 3;
}
Type type = 1;
Entity entity = 2;
}
message Entity {
oneof entity {
ExternEntry extern_entry = 1;
TableEntry table_entry = 2;
ActionProfileMember
action_profile_member = 3;
ActionProfileGroup
action_profile_group = 4;
MeterEntry meter_entry = 5;
DirectMeterEntry direct_meter_entry = 6;
CounterEntry counter_entry = 7;
DirectCounterEntry direct_counter_entry = 8;
PacketReplicationEngineEntry
packet_replication_engine_entry = 9;
ValueSetEntry value_set_entry = 10;
RegisterEntry register_entry = 11;
}
}
76

P4Runtime Table Entry
77
Full protobuf definition:
https://github.com/p4lang/PI/blob/master/proto/p4/p4runtime.proto
message TableEntry {
uint32 table_id;
repeated FieldMatch match;
Action action;
int32 priority;
...
}
message FieldMatch {
uint32 field_id;
message Exact {
bytes value;
}
message Ternary {
bytes value;
bytes mask;
}
...
oneof field_match_type {
Exact exact;
Ternary ternary;
...
}
}
message Action {
uint32 action_id;
message Param {
uint32 param_id;
bytes value;
}
repeated Param params;
}
p4runtime.proto simplified excerpts:
To add a table entry, the control
plane needs to know:
• IDs of P4 entities
◦ Tables, field matches, actions,
params, etc.
• Field matches for the
particular table
◦ Match type, bitwidth, etc.
• Parameters for the particular
action
• Other P4 program attributes

P4Runtime workflow
78
test.p4
test.json
Control plane
p4runtime.proto
P4Runtime server
BMv2 driver
BMv2
simple_switch
p4c-bm2-ss
(compiler)
P4Info
• Captures P4 program attributes
needed at runtime
◦ IDs for tables, actions, params, etc.
◦ Table structure, action parameters, etc.
• Protobuf-based format
• Target-independent compiler output
◦ Same P4Info for BMv2, ASIC, etc.
test.p4info
Full P4Info protobuf specification:
https://github.com/p4lang/PI/blob/master/proto/p4/config/v1/p4info.proto

P4Info example
79
...
action ipv4_forward(bit<48> dstAddr,
bit<9> port) {
/* Action implementation */
}
...
table ipv4_lpm {
key = {
}
actions = {
ipv4_forward;
...
}
...
}
basic_router.p4
actions {
id: 16786453
name: "ipv4_forward"
params {
id: 1
name: "dstAddr"
bitwidth: 48
...
id: 2
name: "port"
bitwidth: 9
}
}
...
tables {
id: 33581985
name: "ipv4_lpm"
match_fields {
id: 1
name: "hdr.ipv4.dstAddr"
bitwidth: 32
match_type: LPM
}
action_ref_id: 16786453
}
basic_router.p4info
P4 compiler

P4Runtime Table Entry Example
80
table_entry {
table_id: 33581985
match {
field_id: 1
lpm {
value: "n000001001"
prefix_len: 32
}
}
action {
action_id: 16786453
params {
param_id: 1
value: "000000000000000n"
}
params {
param_id: 2
value: "000007"
}
}
}
action ipv4_forward(bit<48> dstAddr,
bit<9> port) {
/* Action implementation */
}
table ipv4_lpm {
key = {
}
actions = {
ipv4_forward;
...
}
...
}
hdr.ipv4.dstAddr=10.0.1.1/32
-> ipv4_forward(00:00:00:00:00:10, 7)
basic_router.p4
Logical view of table entry
Protobuf message
Control plane
generates

P4Runtime SetPipelineConfig
message SetForwardingPipelineConfigRequest {
enum Action {
UNSPECIFIED = 0;
VERIFY = 1;
VERIFY_AND_SAVE = 2;
VERIFY_AND_COMMIT = 3;
COMMIT = 4;
RECONCILE_AND_COMMIT = 5;
}
uint64 device_id = 1;
uint64 role_id = 2;
Uint128 election_id = 3;
Action action = 4;
ForwardingPipelineConfig config = 5;
}
81
message ForwardingPipelineConfig {
config.P4Info p4info = 1;
// Target-specific P4 configuration.
bytes p4_device_config = 2;
}
test.
p4
json Control plane
P4Runtime server
BMv2 driver
BMv2 simple_switch_grpc
p4c-bm2-ss
(compiler)
p4info
Pipeline config
Pipeline config bits
SetPipelineConfig()

P4Runtime StreamChannel
message StreamMessageRequest {
oneof update {
MasterArbitrationUpdate
arbitration = 1;
PacketOut packet = 2;
}
}
message StreamMessageResponse {
oneof update {
MasterArbitrationUpdate
arbitration = 1;
PacketIn packet = 2;
}
}
// Packet sent from the controller to the switch.
message PacketOut {
bytes payload = 1;
// This will be based on P4 header annotated as
// @controller_header("packet_out").
// At most one P4 header can have this annotation.
repeated PacketMetadata metadata = 2;
}
// Packet sent from the switch to the controller.
message PacketIn {
bytes payload = 1;
// This will be based on P4 header annotated as
// @controller_header("packet_in").
// At most one P4 header can have this annotation.
repeated PacketMetadata metadata = 2;
}
82

P4Runtime Common Parameters
• device_id
◦ Specifies the specific forwarding chip or software bridge
◦ Set to 0 for single chip platforms
• role_id
◦ Corresponds to a role with specific capabilities (i.e. what operations, P4
entities, behaviors, etc. are in the scope of a given role)
◦ Role definition is currently agreed upon between control and data planes
offline
◦ Default role_id (0) has full pipeline access
• election_id
◦ P4Runtime supports mastership on a per-role basis
◦ Client with the highest election ID is referred to as the "master", while all
other clients are referred to as "slaves"
◦ Set to 0 for single instance controllers
83

Mastership Arbitration
• Upon connecting to the device, the client (e.g. controller)
needs to open a StreamChannel
• The client must advertise its role_id and election_id using a
MasterArbitrationUpdate message
◦ If role_id is not set, it implies the default role and will be granted full
pipeline access
◦ The election_id is opaque to the server and determined by the control
plane (can be omitted for single-instance control plane)
• The switch marks the client for each role with the highest
election_id as master
• Master can:
◦ Perform Write requests
◦ Receive PacketIn messages
◦ Send PacketOut messages 84

Remote control
85
P4Runtime
control server
Target driver
Vendor A
P4Runtime
control server
Target driver
Vendor B
P4Runtime
control server
Target driver
Vendor C
Remote control plane
OSPF BGP
P4-defined
custom protocol
etc.
table_entry {
table_id: 33581985
match {
field_id: 1
lpm {
value: "f000...
prefix_len: 8
}
}
action {
action_id: 16786453
params {
param_id: 1
value: "0000...
}
params {
param_id: 2
value: 7
}
}
}
Target-independent
protobuf format
p4info p4info p4info
p4info

Local control
86
P4Runtime
control server
Target driver
P4 target
Local control plane
OSPF BGP
P4-defined
protocol
etc.
table_entry {
table_id: 33581985
match {
field_id: 1
lpm {
value: "f000...
prefix_len: 8
}
}
action {
action_id: 16786453
params {
param_id: 1
value: "0000...
}
params {
param_id: 2
value: 7
}
}
}
Same
target-independent
protobuf format
p4info
p4info
P4Runtime can be used equally well
by a remote or local control plane

P4Runtime API recap
Things we covered:
• P4Runtime definition
• P4Info
• Table entries
• Set pipeline config
• Packet-in/out support
• Controller replication
◦Via master-slave arbitration
87
What we didn’t cover:
• How to control other P4 entities
◦ Externs, counters, meters
• Batched reads/writes
• Switch configuration
◦ Outside the P4Runtime scope
◦ Achieved with other mechanisms
■ e.g., OpenConfig and gNMI

P4Runtime exercise
88

Exercise Overview
89
mycontroller.py
Controller’s responsibilities:
1. Establish a gRPC connection to the
switches for the P4Runtime service
2. Push the P4 program to each switch
3. Write the tunnel forwarding rules:
a. myTunnel_ingress rule to
encapsulate packets on the ingress
switch
b. myTunnel_forward rule to
forward packets on the ingress
switch
c. myTunnel_egress rule to
decapsulate and forward packets
on the egress switch
4. Read the tunnel ingress and egress
counters every 2 seconds

Getting started
The source code has already been downloaded on your VM:
~/tutorials/exercises/p4runtime
You should start by reading the README.md
In this exercise, you will need to complete the
implementation of writeTunnelRules
in mycontroller.py
You will need two Terminal windows: one for
your dataplane network (Mininet) that you will
start using make, and the other is for your
controller program.
To find the source code:
https://github.com/p4lang/tutorials/
90

P4Runtime in the wild
91

P4Runtime-enabled Open Source SDN Stack
92
Stratum Stratum
Stratum Stratum Stratum
Inventory Global Orchestrator
dhcp SR
Control and Management Plane
SDN Control
Services
P4Runtime
spine.p4
spine.p4
leaf.p4 leaf.p4 leaf.p4
Configuration
Services
gNOI
Monitoring &
Telemetry
Services
OpenConfig
& gNMI
Admin &
Orchestration
Services
OSS / BSS

Some Pointers
https://stratumproject.org/
https://onosproject.org/
https://wiki.onosproject.org/display/ONOS/P4+brigade
93

Lab 3: Monitoring & Debugging

Monitoring & Debugging
s1
h1
(10.0.1.1)
s3
s2
h3
(10.0.3.3)
h2
(10.0.2.2)
h11
(10.0.1.11)
h22
(10.0.2.22)
Fine …
Congestion!
Hosts can infer
congestion:
● RTT
● Packet drops
● Dup Acks
Switches can
help!
95

Explicit Congestion Notification
TOS
97

Explicit Congestion Notification
•Explicit Congestion Notification
◦00: Non ECN-Capable Transport, Non-ECT
◦10: ECN Capable Transport, ECT(0)
◦01: ECN Capable Transport, ECT(1)
◦11: Congestion Encountered, CE
•For packets originating from ECT, ECN-capable switches set the
CE bit upon congestion
◦E.g., observed queue depth > threshold
98

Explicit Congestion Notification in P4
•The standard data for the V1Model includes the queue depth:
bit<19> standard_metadata.enq_qdepth
Traffic
Manager
Egress
Ingress
Measured here Available here
99

Coding Break
100

Multi-Route Inspection
s1
h1
(10.0.1.1)
s3
s2
h3
(10.0.3.3)
h2
(10.0.2.2)
h11
(10.0.1.11)
h22
(10.0.2.22)
pkt
Switch ID, queue
depth, … (anything)
The most verbose ECN
Packets carry their own logs!
101

Multi-Route Inspect: Packet Format
header mri_t {
bit<16> count;
}
header switch_t {
switchID_t swid;
qdepth_t qdepth;
}
struct headers {
ipv4_t ipv4;
ipv4_option_t ipv4_option;
mri_t mri;
switch_t[MAX_HOPS] swtraces;
}
• Header validity opertions:
o hdr.setValid(): add_header
o hdr.setInvalid(): remove_header
o hdr.isValid():test validity
• Header Stacks
o hdr[CNT] stk;
• Header Stacks in Parsers
o stk.next
o stk.last
o stk.lastIndex
• Header Stacks in Controls
o stk[i]
o stk.size
o stk.push_front(int count)
o stk.pop_front(int count)
102

/* Standard errors, defined in core.p4 */
error {
NoError, // no error
PacketTooShort, // not enough bits in packet for extract
NoMatch, // match expression has no matches
StackOutOfBounds, // reference to invalid element of a header stack
OverwritingHeader, // one header is extracted twice
HeaderTooShort, // extracting too many bits in a varbit field
ParserTimeout // parser execution time limit exceeded
}
/* Additional error added by the programmer */
error { IPv4BadHeader }
...
state parse_ipv4 {
packet.extract(hdr.ipv4);
verify(hdr.ipv4.version == 4, error.IPv4BadHeader);
transition accept;
}
Header verification
103

Coding Break
104

Questions and Answers
105
https://bit.ly/join-p4-lang-slack
Join #d2-2018-spring channel
https://pigeonhole.at
Event code: P4D2
Questions for TAs
}
Questions for Panel
}

Lab 4: Advanced Behavior
106

Source Routing
107
s1
h1
(10.0.1.1)
s3
s2
h3
(10.0.3.3)
h2
(10.0.2.2)
1
1
1
2 2
2
3
3
3
2,3,2,2,1, {payload}

Source Routing: Packet Format
108
#define MAX_HOPS 9
const bit<16> TYPE_IPV4 = 0x800;
const bit<16> TYPE_SRCROUTING = 0x1234;
header srcRoute_t {
bit<1> bos;
bit<15> port;
}
struct headers {
srcRoute_t[MAX_HOPS] srcRoutes;
ipv4_t ipv4;
}
• Parse source routes only if etherType is
0x1234
• The special value bos == 1 indicates the
“bottom of stack”
• Forward packets using source routes,
and also decrement IPv4 TTL
• Drop the packet if source routes are not
valid
• Hint: Use the next, pop_front primitives
packet.extract(hdr.srcRoutes.next)
hdr.srcRoutes.pop_front(1)

Coding Break
109

Calculator
110
s1
h1
(10.0.1.1)
2 + 4 = ?
2 + 4 = 6

Calculator: Packet Format
111
0 1 2 3
+----------------+----------------+----------------+---------------+
| P | 4 | Version | Op |
+----------------+----------------+----------------+---------------+
| Operand A |
+----------------+----------------+----------------+---------------+
| Operand B |
+----------------+----------------+----------------+---------------+
| Result |
+----------------+----------------+----------------+---------------+

Table Initializers
112
Can initialize tables with constant
entries
Must fully specify the value of all
action data, including values that are
normally supplied by the
control-plane
Hint: for the calculator, use a table
that matches on the op-code
table tbl {
key = { hdr.h.f : exact }
actions = { a1; a2; a3 }
entries = {
{ 0x01 } : a1(1);
{ 0x02 } : a1(2);
{ _ } : NoAction();
}
}

Coding Break
113

Simple Load Balancing
114
s1
h1
(10.0.1.1)
s3
s2
h3
(10.0.3.3)
h2
(10.0.2.2)
Virtual IP (10.0.0.1)
shared by h2 and h3
h1 → 10.0.0.1

Hashing (V1Model)
115
Computes the hash of data
(using algo) modulo max
and adds it to base
Uses type variables (like
C++ templates / Java
Generics) to allow hashing
primitive to be used with
many different types.
enum HashAlgorithm {
csum16,
xor16,
crc32,
crc32_custom,
crc16,
crc16_custom,
random,
identity
}
extern void hash<O, T, D, M>(
out O result,
in HashAlgorithm algo,
in T base,
in D data,
in M max);

Wrapping up & Next Steps
116

Why P416
?
• Clearly defined semantics
◦ You can describe what your data plane program is doing
• Expressive
◦ Supports a wide range of architectures through standard methodology
• High-level, Target-independent
◦ Uses conventional constructs
◦ Compiler manages the resources and deals with the hardware
• Type-safe
◦ Enforces good software design practices and eliminates “stupid” bugs
• Agility
◦ High-speed networking devices become as flexible as any software
• Insight
◦ Freely mixing packet headers and intermediate results
117

Things we covered
• The P4 ”world view”
◦ Protocol-Independent Packet Processing
◦ Language/Architecture Separation
◦ If you can interface with it, it can be used
• Key data types
• Constructs for packet parsing
◦ State machine-style programming
• Constructs for packet processing
◦ Actions, tables and controls
• Packet deparsing
• Architectures & Programs
118

Things we didn’t cover
• Mechanisms for modularity
◦ Instantiating and invoking parsers or controls
• Details of variable-length field processing
◦ Parsing and deparsing of options and TLVs
• Architecture definition constructs
◦ How these “templated” definitions are created
• Advanced features
◦ How to do learning, multicast, cloning, resubmitting
◦ Header unions
• Other architectures
• Control plane interface
119

The P4 Language Consortium
• Consortium of academic
and industry members
• Open source, evolving,
domain-specific language
• Permissive Apache license,
code on GitHub today
• Membership is free:
contributions are welcome
• Independent, set up as a
California nonprofit
120

P4_tutorial.pdf

Recommended

More Related Content

Similar to P4_tutorial.pdf (20)

Recently uploaded (20)

P4_tutorial.pdf