“p4alu” is a P4 program who would parse UDP packet with payload in "p4alu header format" and apply calculation.
This program is tested using BMv2 simple_switch P4 target.
zebra is an open source implementation as a successor of GNU Zebra and Quagga project. Together with openconfigd, it will work as data plane agnostic Network Operation Stack working with variable protocol / functional modules.
(Open) MPI, Parallel Computing, Life, the Universe, and EverythingJeff Squyres
This talk is a general discussion of the current state of Open MPI, and a deep dive on two new features:
1. The flexible process affinity system (I presented many of these slides at the Madrid EuroMPI'13 conference in September 2013).
2. The MPI-3 "MPI_T" tools interface.
I originally gave this talk at Lawrence Berkeley Labs on Thursday, November 7, 2013.
The document discusses configuring GTP tunnels on Linux using the libgtpnl library. Key points:
- Linux kernels since 4.7 include GTP tunnel endpoint functionality in the gtp.c driver
- Libgtpnl provides tools to configure GTP tunnels via netlink without a control plane
- Configuration involves creating veth interfaces, loopbacks, GTP devices, and tunnels between endpoints using TEIDs and IP addresses
Debugging is an essential part of Linux kernel development. In
user-space we have the support of the kernel and many debugging tools, tracking down a kernel bug, instead, can be very difficult if you don't know the proper methodologies. This talk will cover some techniques to understand how the kernel works, hunt down and fix kernel bugs in order to become a better kernel developer.
Open MPI Explorations in Process Affinity (EuroMPI'13 presentation)Jeff Squyres
The document discusses Open MPI's Locality-Aware Mapping Algorithm (LAMA) interface for controlling process placement on parallel machines. It describes how LAMA allows users to specify regular mapping patterns of processes to resources. It also outlines the three main steps in MPI process placement with LAMA: 1) mapping processes to resources, 2) ordering processes, and 3) binding processes during launch according to the mapping. The goal is to provide a mechanism for exploring different process placements to minimize communication costs.
This document discusses how to submit a Perl module to CPAN in 3 steps:
1. Generate the module files using h2xs and write documentation.
2. Post about the module on [email protected] to get feedback.
3. Upload the distribution files to PAUSE after testing and following the checklist.
By Masaki Arai, Fujitsu Laboratories Ltd.
For numerical calculation programs on supercomputers, the kernel part occupies 80% or more of the execution time in many cases. Therefore, the quality of the code generated by the compiler for these kernel parts is significant. We created a tool, which is called HCQC, to aid in the investigation of the quality of the code generated by the compiler for the kernel part. In this presentation, we report the details of HCQC and the results of evaluating the quality of GCC and LLVM when compiling the kernel part of benchmark programs using HCQC.
Masaki Arai Bio
In 1992, He joined Fujitsu Laboratories Ltd. His research interests are in the area of compiler optimizations and computer architectures. He joined Linaro as member engineer in 2017.
Email
[email protected]
For more info on The Linaro High Performance Computing (HPC) visit https://www.linaro.org/sig/hpc/
Scapy is a Python module for creating and sending network packets. It was released in 2011 and allows users to dissect, craft, and send packets at layers 2 through 7. Scapy can be used to analyze protocols like TCP/IP, send spoofed packets, and build new protocols. It represents packets as objects with fields that can be easily manipulated. Scapy provides tools for building, sending, dissecting, and binding packets to allow full control and inspection of network traffic.
This document provides an overview of a Scapy workshop that will cover topics including:
- Installing and using Scapy to forge, decode, send, and receive packets
- Creating basic packets like TCP, UDP, ICMP and modifying packet fields
- Advanced packet crafting including HTTP requests and DNS queries
- Using Scapy with Python for tasks like packet sniffing and parsing PCAP files
- Replaying and filtering captured packets
- The presenter's background and goals for the workshop
This document summarizes the history and future plans for optimizations to the Pharo virtual machine (VM). It discusses past improvements like Spur in Pharo 5 that provided 1.8x faster performance. Pharo 6 focused on compaction and minor optimizations. Future work in Pharo 7 could include an incremental garbage collector and optimizations from the Sista just-in-time compiler that aim to provide 1.5-5x faster performance. The goals are to balance program readability and performance.
Event Machine is a library for Ruby that provides event-driven I/O. It uses the reactor pattern to achieve high scalability, performance, and stability. Event Machine powers the backends of many large sites by enabling asynchronous programming and handling many concurrent connections efficiently. It can be used with tools like Rails, Thin, Goliath, MongoDB, and RabbitMQ to build highly scalable web applications. Benchmarks show that using Event Machine can process many more requests per second than a traditional Rails app due to its asynchronous and non-blocking nature.
Cilium - Fast IPv6 Container Networking with BPF and XDPThomas Graf
We present a new open source project which provides IPv6 networking for Linux Containers by generating programs for each individual container on the fly and then runs them as JITed BPF code in the kernel. By generating and compiling the code, the program is reduced to the minimally required feature set and then heavily optimised by the compiler as parameters become plain variables. The upcoming addition of the Express Data Plane (XDP) to the kernel will make this approach even more efficient as the programs will get invoked directly from the network driver.
Using the flipn stack for edge ai (flink, nifi, pulsar)Timothy Spann
The document summarizes a presentation about using the FLiPN stack (Flink, NiFi, Pulsar) for edge AI. It discusses the key components - Apache Flink for stream processing, Apache Pulsar for messaging and streaming, and Apache NiFi for dataflow. It provides an overview of their features and benefits. It also demonstrates integrating these technologies with edge devices like NVIDIA Jetson boards and deploying the streaming pipelines to StreamNative Cloud.
This document discusses using Pharo on Raspberry Pi devices. It provides information on running Pharo's ArmVM on Raspberry Pi, libraries for interacting with low-level GPIO pins, and tools for remote development of Pharo images running on Raspberry Pi from another Pharo image. The Pharo IoT project aims to provide higher-level abstractions and tools for remotely programming and debugging physical devices connected to Raspberry Pi boards.
Replacing iptables with eBPF in Kubernetes with CiliumMichal Rostecki
Cilium is an open source project which provides networking, security and load balancing for application services that are deployed using Linux container technologies by using the native eBPF technology in the Linux kernel. In this presentation we talked about:
- The evolution of the BPF filters and explained the advantages of eBPF Filters and its use cases today in Linux especially on how Cilium networking utilizes the eBPF Filters to secure the Kubernetes workload with increased performance when compared to legacy iptables.
- How Cilium uses SOCKMAP for layer 7 policy enforcement - How Cilium integrates with Istio and handles L7 Network Policies with Envoy Proxies.
- The new features since the last release such as running Kubernetes cluster without kube-proxy, providing clusterwide NetworkPolicies, providing fully distributed networking and security observability platform for cloud native workloads etc.
This document summarizes a talk about how the Go programming language helps performance at MediaMath and how to make Go code perform well. It discusses how Go has helped MediaMath transition to a microservices architecture and how features like Go routines, channels, testing and tooling make Go productive. It also provides tips on optimizing Go code like avoiding garbage collection, using pprof, considering GOMAXPROCS, and being aware of limitations of interfaces and defers. While Go has drawbacks like its opinionated nature, the document argues it is a fast and productive language according to benchmarks and has been widely adopted at MediaMath.
Escape the Walls of PaaS: Unlock the Power & Flexibility of DigitalOcean App ...DigitalOcean
Watch this Tech Talk: https://do.co/video_pdougherty
With DigitalOcean App Platform, you get out-of-the-box support for several programming languages and application frameworks. For those languages and frameworks that DigitalOcean doesn’t currently support, learn how you can utilize the Dockerfile mechanism and still benefit from a fully managed PaaS experience.
About the Presenter
Phil Dougherty is a Senior Product Manager at DigitalOcean focused on Kubernetes, container registry, and PaaS. With over 15 years of professional experience in data centers, networking, security, and automation, he has seen the evolution of scale out hosting platforms go from homegrown shell scripts on dedicated servers to multi-cloud micro service based architectures running on Kubernetes. In his free time he likes to ride motorcycles both on and off road, travel, and spend time in the great outdoors.
New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday
To learn more about DigitalOcean: https://www.digitalocean.com/
Follow us on Twitter: https://twitter.com/digitalocean
Like us on Facebook: https://www.facebook.com/DigitalOcean
Follow us on Instagram: https://www.instagram.com/thedigitalocean/
We're hiring: http://do.co/careers
BPF: Next Generation of Programmable DatapathThomas Graf
This session covers lessons learned while exploring BPF to provide a programmable datapath based on BPF and discusses options for OVS to leverage the technology.
BKK16-302: Android Optimizing Compiler: New Member Assimilation GuideLinaro
A tour of essential topics for working on the Android Optimizing Compiler, with a special emphasis on helping new engineers integrate and hit the ground running. Learn how to work on intrinsics, instruction simplification, platform specific optimizations, how to submit good patches, write Checker tests, analyse IR, take boot.oat measurements, and debug performance and execution issues with Streamline and GDB.
JANOG43 Forefront of SRv6, Open Source ImplementationsKentaro Ebisawa
Status of SRv6 Open Source Implementations including where you can find the source code. English slide comes after Japanese.
This is a session from JANOG43 "Forefront of SRv6" program held on 23 Jan 2019 @ Kohu Japan.
https://www.janog.gr.jp/meeting/janog43/program/srv6
* Introduction – Miya Kohno
* SRv6 Update – Clarence Filsfils
* SRv6 Mobile user plane Update – Satoru Matsushima
* SRv6 Open Source Implementation Update – Kentaro Ebisawa
* SRv6 Academy Update – Chunghan Lee
* Vendor Update (Huawei) – Ryuichi Takashima
* Vendor Update (Cisco) – Teppei Kamata
Flink Forward Berlin 2017: Dominik Bruhn - Deploying Flink Jobs as Docker Con...Flink Forward
This talk will focus on how to package, distribute and deploy Flink Jobs by leveraging existing docker technology: Previously deploying of Flink Jobs has been a manual job which leads into errors. In this talk, we present an approach which works well in an CI/CD environment by automating most steps: From the code of a Flink Job in a repository to a running Job on an YARN cluster.
This document provides an overview of RYU, including its environment setup, basic operations, application development, and RESTful API. RYU is an SDN framework written in Python that supports various protocols including OpenFlow. It uses a component-based architecture that allows network applications to register to receive events from the data path. Applications can then program flow entries by communicating with OpenFlow switches via the controller.
Network Test Automation - Net Ops Coding 2015Hiroshi Ota
1. The document discusses network test automation using tools like Serverspec, Infrataster, Lbspec, and Rspec-ssltls to test network configurations and connectivity. These tools use Ruby and RSpec to test servers, DNS, firewalls, load balancers, and SSL/TLS without requiring changes to production systems.
2. Examples are provided showing how to test server reachability, DNS entries, firewall rules, load balancer behavior, and SSL/TLS settings using the different tools. Tests can be run to check configurations without affecting live networks.
3. Running the RSpec tests produces results indicating how many examples passed and failed, allowing engineers to test network changes with confidence before deploying
Atsushi Hori
RIKEN
New portable and practical parallel execution model, Process in Process (PiP in short) will be presented. PiP tasks share the same virtual address space like the multi-thread model and privatized variables like the multi-process model. Because of this, PiP provides the best of two worlds, multi-process (MPI) and multi-thread (OpenMP). Researcher, System Software Development Team, RIKEN
Fluentd v1 will focus on providing a stable and pluggable architecture for log forwarding and processing. Key features include a new configuration format that allows embedding Ruby code, improved filtering and labeling of events, and an error stream for handling errors. Other potential improvements include multi-processing support, zero downtime restarts, an actor framework, and JRuby/Windows compatibility. td-agent2 will upgrade the core libraries and use the new v1 configuration by default.
PyCon TW 2018 - A Python Engineer Under Giant Umbrella (巨大保護傘下的 Python 碼農辛酸史) Kir Chou
The document discusses the use of Python in large companies from the perspective of a Python engineer. It covers three types of industries that use Python, three levels of Python expertise, and the speaker's experience working with Python in a large company. The speaker discusses how large companies differ from expectations, focusing more on internal infrastructure than specific libraries and requiring expertise beyond what can be gained from websites like Stack Overflow. The goal is to avoid mistakes made by focusing too much on job descriptions rather than real-world experience.
KKBOX is a music streaming service founded in 2004 that uses PHP and handles around 4000 API requests per second. It uses an event-driven asynchronous architecture and tools like Gitlab for code hosting and reviews, Gitlab CI for testing, and Slack for communication. The document discusses KKBOX's technologies and processes for code management, testing, deployment, and communication between teams.
This document provides an overview of a tutorial on building an SRv6-enabled fabric with P4 and ONOS. The tutorial consists of 4 exercises: 1) enabling packet I/O between the switch and control plane, 2) adding Ethernet bridging, 3) adding IPv6 routing, and 4) adding Segment Routing (SRv6). It introduces the software tools used, including P4Runtime for runtime control of P4 switches, Stratum as a P4Runtime server, and ONOS as the control plane. The goal is to learn how to program P4 switches and build full-stack network applications from a P4 program to an end-to-end solution.
The document discusses P4 support in ONOS. It provides an overview of the P4 language and P4Runtime framework, and then describes ONOS's PI framework for controlling P4 programmable switches. The PI framework models P4 pipelines and allows both pipeline-agnostic and pipeline-aware applications. It translates between ONOS abstractions and P4Runtime messages using a pipeline interpreter and driver behaviors defined in a pipeconf file. The document demonstrates how ONOS can deploy and program P4 pipelines using these components.
This document provides an overview of a Scapy workshop that will cover topics including:
- Installing and using Scapy to forge, decode, send, and receive packets
- Creating basic packets like TCP, UDP, ICMP and modifying packet fields
- Advanced packet crafting including HTTP requests and DNS queries
- Using Scapy with Python for tasks like packet sniffing and parsing PCAP files
- Replaying and filtering captured packets
- The presenter's background and goals for the workshop
This document summarizes the history and future plans for optimizations to the Pharo virtual machine (VM). It discusses past improvements like Spur in Pharo 5 that provided 1.8x faster performance. Pharo 6 focused on compaction and minor optimizations. Future work in Pharo 7 could include an incremental garbage collector and optimizations from the Sista just-in-time compiler that aim to provide 1.5-5x faster performance. The goals are to balance program readability and performance.
Event Machine is a library for Ruby that provides event-driven I/O. It uses the reactor pattern to achieve high scalability, performance, and stability. Event Machine powers the backends of many large sites by enabling asynchronous programming and handling many concurrent connections efficiently. It can be used with tools like Rails, Thin, Goliath, MongoDB, and RabbitMQ to build highly scalable web applications. Benchmarks show that using Event Machine can process many more requests per second than a traditional Rails app due to its asynchronous and non-blocking nature.
Cilium - Fast IPv6 Container Networking with BPF and XDPThomas Graf
We present a new open source project which provides IPv6 networking for Linux Containers by generating programs for each individual container on the fly and then runs them as JITed BPF code in the kernel. By generating and compiling the code, the program is reduced to the minimally required feature set and then heavily optimised by the compiler as parameters become plain variables. The upcoming addition of the Express Data Plane (XDP) to the kernel will make this approach even more efficient as the programs will get invoked directly from the network driver.
Using the flipn stack for edge ai (flink, nifi, pulsar)Timothy Spann
The document summarizes a presentation about using the FLiPN stack (Flink, NiFi, Pulsar) for edge AI. It discusses the key components - Apache Flink for stream processing, Apache Pulsar for messaging and streaming, and Apache NiFi for dataflow. It provides an overview of their features and benefits. It also demonstrates integrating these technologies with edge devices like NVIDIA Jetson boards and deploying the streaming pipelines to StreamNative Cloud.
This document discusses using Pharo on Raspberry Pi devices. It provides information on running Pharo's ArmVM on Raspberry Pi, libraries for interacting with low-level GPIO pins, and tools for remote development of Pharo images running on Raspberry Pi from another Pharo image. The Pharo IoT project aims to provide higher-level abstractions and tools for remotely programming and debugging physical devices connected to Raspberry Pi boards.
Replacing iptables with eBPF in Kubernetes with CiliumMichal Rostecki
Cilium is an open source project which provides networking, security and load balancing for application services that are deployed using Linux container technologies by using the native eBPF technology in the Linux kernel. In this presentation we talked about:
- The evolution of the BPF filters and explained the advantages of eBPF Filters and its use cases today in Linux especially on how Cilium networking utilizes the eBPF Filters to secure the Kubernetes workload with increased performance when compared to legacy iptables.
- How Cilium uses SOCKMAP for layer 7 policy enforcement - How Cilium integrates with Istio and handles L7 Network Policies with Envoy Proxies.
- The new features since the last release such as running Kubernetes cluster without kube-proxy, providing clusterwide NetworkPolicies, providing fully distributed networking and security observability platform for cloud native workloads etc.
This document summarizes a talk about how the Go programming language helps performance at MediaMath and how to make Go code perform well. It discusses how Go has helped MediaMath transition to a microservices architecture and how features like Go routines, channels, testing and tooling make Go productive. It also provides tips on optimizing Go code like avoiding garbage collection, using pprof, considering GOMAXPROCS, and being aware of limitations of interfaces and defers. While Go has drawbacks like its opinionated nature, the document argues it is a fast and productive language according to benchmarks and has been widely adopted at MediaMath.
Escape the Walls of PaaS: Unlock the Power & Flexibility of DigitalOcean App ...DigitalOcean
Watch this Tech Talk: https://do.co/video_pdougherty
With DigitalOcean App Platform, you get out-of-the-box support for several programming languages and application frameworks. For those languages and frameworks that DigitalOcean doesn’t currently support, learn how you can utilize the Dockerfile mechanism and still benefit from a fully managed PaaS experience.
About the Presenter
Phil Dougherty is a Senior Product Manager at DigitalOcean focused on Kubernetes, container registry, and PaaS. With over 15 years of professional experience in data centers, networking, security, and automation, he has seen the evolution of scale out hosting platforms go from homegrown shell scripts on dedicated servers to multi-cloud micro service based architectures running on Kubernetes. In his free time he likes to ride motorcycles both on and off road, travel, and spend time in the great outdoors.
New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday
To learn more about DigitalOcean: https://www.digitalocean.com/
Follow us on Twitter: https://twitter.com/digitalocean
Like us on Facebook: https://www.facebook.com/DigitalOcean
Follow us on Instagram: https://www.instagram.com/thedigitalocean/
We're hiring: http://do.co/careers
BPF: Next Generation of Programmable DatapathThomas Graf
This session covers lessons learned while exploring BPF to provide a programmable datapath based on BPF and discusses options for OVS to leverage the technology.
BKK16-302: Android Optimizing Compiler: New Member Assimilation GuideLinaro
A tour of essential topics for working on the Android Optimizing Compiler, with a special emphasis on helping new engineers integrate and hit the ground running. Learn how to work on intrinsics, instruction simplification, platform specific optimizations, how to submit good patches, write Checker tests, analyse IR, take boot.oat measurements, and debug performance and execution issues with Streamline and GDB.
JANOG43 Forefront of SRv6, Open Source ImplementationsKentaro Ebisawa
Status of SRv6 Open Source Implementations including where you can find the source code. English slide comes after Japanese.
This is a session from JANOG43 "Forefront of SRv6" program held on 23 Jan 2019 @ Kohu Japan.
https://www.janog.gr.jp/meeting/janog43/program/srv6
* Introduction – Miya Kohno
* SRv6 Update – Clarence Filsfils
* SRv6 Mobile user plane Update – Satoru Matsushima
* SRv6 Open Source Implementation Update – Kentaro Ebisawa
* SRv6 Academy Update – Chunghan Lee
* Vendor Update (Huawei) – Ryuichi Takashima
* Vendor Update (Cisco) – Teppei Kamata
Flink Forward Berlin 2017: Dominik Bruhn - Deploying Flink Jobs as Docker Con...Flink Forward
This talk will focus on how to package, distribute and deploy Flink Jobs by leveraging existing docker technology: Previously deploying of Flink Jobs has been a manual job which leads into errors. In this talk, we present an approach which works well in an CI/CD environment by automating most steps: From the code of a Flink Job in a repository to a running Job on an YARN cluster.
This document provides an overview of RYU, including its environment setup, basic operations, application development, and RESTful API. RYU is an SDN framework written in Python that supports various protocols including OpenFlow. It uses a component-based architecture that allows network applications to register to receive events from the data path. Applications can then program flow entries by communicating with OpenFlow switches via the controller.
Network Test Automation - Net Ops Coding 2015Hiroshi Ota
1. The document discusses network test automation using tools like Serverspec, Infrataster, Lbspec, and Rspec-ssltls to test network configurations and connectivity. These tools use Ruby and RSpec to test servers, DNS, firewalls, load balancers, and SSL/TLS without requiring changes to production systems.
2. Examples are provided showing how to test server reachability, DNS entries, firewall rules, load balancer behavior, and SSL/TLS settings using the different tools. Tests can be run to check configurations without affecting live networks.
3. Running the RSpec tests produces results indicating how many examples passed and failed, allowing engineers to test network changes with confidence before deploying
Atsushi Hori
RIKEN
New portable and practical parallel execution model, Process in Process (PiP in short) will be presented. PiP tasks share the same virtual address space like the multi-thread model and privatized variables like the multi-process model. Because of this, PiP provides the best of two worlds, multi-process (MPI) and multi-thread (OpenMP). Researcher, System Software Development Team, RIKEN
Fluentd v1 will focus on providing a stable and pluggable architecture for log forwarding and processing. Key features include a new configuration format that allows embedding Ruby code, improved filtering and labeling of events, and an error stream for handling errors. Other potential improvements include multi-processing support, zero downtime restarts, an actor framework, and JRuby/Windows compatibility. td-agent2 will upgrade the core libraries and use the new v1 configuration by default.
PyCon TW 2018 - A Python Engineer Under Giant Umbrella (巨大保護傘下的 Python 碼農辛酸史) Kir Chou
The document discusses the use of Python in large companies from the perspective of a Python engineer. It covers three types of industries that use Python, three levels of Python expertise, and the speaker's experience working with Python in a large company. The speaker discusses how large companies differ from expectations, focusing more on internal infrastructure than specific libraries and requiring expertise beyond what can be gained from websites like Stack Overflow. The goal is to avoid mistakes made by focusing too much on job descriptions rather than real-world experience.
KKBOX is a music streaming service founded in 2004 that uses PHP and handles around 4000 API requests per second. It uses an event-driven asynchronous architecture and tools like Gitlab for code hosting and reviews, Gitlab CI for testing, and Slack for communication. The document discusses KKBOX's technologies and processes for code management, testing, deployment, and communication between teams.
This document provides an overview of a tutorial on building an SRv6-enabled fabric with P4 and ONOS. The tutorial consists of 4 exercises: 1) enabling packet I/O between the switch and control plane, 2) adding Ethernet bridging, 3) adding IPv6 routing, and 4) adding Segment Routing (SRv6). It introduces the software tools used, including P4Runtime for runtime control of P4 switches, Stratum as a P4Runtime server, and ONOS as the control plane. The goal is to learn how to program P4 switches and build full-stack network applications from a P4 program to an end-to-end solution.
The document discusses P4 support in ONOS. It provides an overview of the P4 language and P4Runtime framework, and then describes ONOS's PI framework for controlling P4 programmable switches. The PI framework models P4 pipelines and allows both pipeline-agnostic and pipeline-aware applications. It translates between ONOS abstractions and P4Runtime messages using a pipeline interpreter and driver behaviors defined in a pipeconf file. The document demonstrates how ONOS can deploy and program P4 pipelines using these components.
Everything You Need to Know About the Intel® MPI LibraryIntel® Software
The document discusses tuning the Intel MPI library. It begins with an introduction to factors that impact MPI performance like CPUs, memory, network speed and job size. It notes that MPI libraries must make choices that may not be optimal for all applications. The document then outlines its plan to cover basic tuning techniques like profiling, hostfiles and process placement, as well as intermediate topics like point-to-point optimization and collective tuning. The goal is to help reduce time and memory usage of MPI applications.
The webinar discussed accelerating P4 and eBPF programs on Netronome SmartNIC hardware. It covered the Linux kernel infrastructure like TC and XDP that supports offloading eBPF programs. It also explained how the NFP architecture is optimized for network flow processing with its multi-core design and memory hierarchy. The webinar demonstrated how eBPF programs can be translated to run efficiently on the NFP hardware by handling maps and applying optimizations.
From Internet Explorer 6 to 11, from TYPO3 4.5 to 10.4, from 2011 to 2022 - often, projects with such a lifetime are rather relaunched than updated.
In this talk, we want to show you how we make sure our codebase works for the environment we are given and how we make sure no relaunches are needed.
Track4K in production at the University of Cape TownStephen Marquard
Track4K is an open-source video analysis and tracking system that post-processes a 4K video to track the presenter and generate a cropped version of the video using smooth panning movements.
This document provides an overview of eBPF/BPF and instructions for creating an eBPF program from scratch. It begins with explaining what eBPF/BPF is, its history and main ideas. It then covers how to build an eBPF program from the Linux kernel source code, including prerequisites, compilation steps, and modifying the makefile. The document also discusses how to program an eBPF program manually, analyzing the eBPF program and loader. It concludes with a promise of a quick demo.
This document discusses abstracting device configurations using NETCONF and YANG. It provides an overview of NETCONF, which allows configuration management through transactions using candidate configurations. YANG is introduced as a data modeling language used to model device configurations. The document demonstrates configuring NETCONF/YANG on a Cisco CSR1000v router, getting capabilities and models, converting models to Python code to generate JSON configuration, and sending the configuration to the device via XML RPC calls.
In Network Computing Prototype Using P4 at KSC/KREONET 2019Kentaro Ebisawa
Case Study of P4 applying to CAN (Control Area Network) data pre-processing using FPGA + Netcope P4 compiler.
Presented at KSC / KREONET WORKSHOP 2019 | DAY 1 Session 1: SDN/NFV/P4
http://www.ksc2019.re.kr/
This document provides instructions for students to implement the execution of map and reduce tasks on workers in a MapReduce system. It details expected outcomes such as deploying MapReduce applications to Azure Kubernetes and developing an HTTP interface. It also provides suggestions on implementing Python code wrappers to execute mapper and reducer functions, saving intermediate and final results, and delivering required code and demos.
This document discusses a proof-of-concept implementation of a RINA interior router using P4. The goals are to increase RINA credibility by providing a high-performance router implementation at a reasonable cost, and to understand limitations of current network programmability approaches. The implementation targets the BMv2 P4 software switch, demonstrating basic interior router functions for EFCP packets. Future work includes implementing the design on hardware and evaluating the feasibility of a border router.
Transferring Changes Between Perforce ServersPerforce
Transferring changes between two unrelated Perforce Servers can be a challenge. This talk explains how this can be done using a Python tool called PerforceTransfer. The concepts of this tool, its internal workings as well as its applications and limitations are explained.
The document describes a laboratory manual for Programming Laboratory - III. It contains 18 assignments divided into three groups - A, B, and C. The assignments include developing applications using a BeagleBone Black board to simulate operations like a lift and traffic lights, implementing a calculator using concurrent Lisp, applying software engineering methodologies to assignments, designing mathematical models, analyzing requirements and creating UML diagrams. It provides the setup instructions, relevant theory, and procedures to complete the assignments.
Migrating Apache Spark ML Jobs to Spark + Tensorflow on KubeflowDatabricks
This document summarizes Holden Karau's presentation on augmenting Spark ML pipelines with Kubeflow and TensorFlow. The presentation explored splitting a Spark ML pipeline into feature preparation in Spark and model training in TensorFlow, saving the Spark output in a TF-compatible format, and executing the components as part of a Kubeflow pipeline that uses the Spark operator. It noted challenges with Kubeflow's current stability but provided options for integrating Spark jobs using the operator or notebooks. The presentation concluded by discussing alternatives to this approach and some ending notes of caution.
This webinar explains why PISA chips are inevitable, provides overview of machine architecture of such switches, presents a brief primer on the P4 language with sample programs for a variety of networks and demonstrates a powerful network diagnostics application implemented in P4.
Programmability in SDNs is confined to the network control plane. The forwarding plane is still largely dictated by fixed-function switching chips. Our goal is to change that, and to allow programmers to define how packets are to be processed all the way down to the wire.
This is made possible by a new generation of high-performance forwarding chips. At the high-end, PISA (Protocol-Independent Switch Architecture) chips promise multi-Tb/s of packet processing. At the mid- and low-end of the performance spectrum, CPUs, GPUs, FPGAs, and NPUs already offer great flexibility with performance of a few tens to hundreds of Gb/s.
In addition to programmable forwarding chips, we also need a high-level language to dictate the forwarding behavior in a target independent fashion. "P4" (www.p4.org) is such a language. In P4, the programer declares how packets are to be processed, and a compiler generates a configuration for a PISA chip, or a programmable target in general. For example, the programmer might program the switch to be a top-of-rack switch, a firewall, or a load-balancer; and might add features to run automatic diagnostics and novel congestion control algorithms.
Apache Beam: Lote portátil y procesamiento de transmisiónGlobant
Speaker: Albert Ramírez Cerquera
Video: https://youtu.be/18Tbr1LZmtM
En esta charla, vemos cómo utilizar el modelo de programación Apache Beam para procesar datos por batch y en streaming. Además, se enseñará cómo se puede ejecutar Beam en ejecutores como Flink y Google Cloud Dataflow.
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Hay trabajos y hay carreras. Las oportunidades vienen a golpear la puerta cuando menos lo esperas. La decisión es tuya. Desde tener la oportunidad de hacer algo significativo día tras día, hasta estar rodeado de gente supremamente inteligente y motivada.
¿Estás listo?
Descúbre todas nuestras oportunidades acá: https://bit.ly/2PWKky9
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Síguenos en:
Facebook: https://www.facebook.com/Globant/
Twitter: https://twitter.com/Globant
Instagram: https://www.instagram.com/globantpics/
Linkedin: https://www.linkedin.com/company/globant
Visita nuestra página web: https://bit.ly/2XLVYQD
Two-level Just-in-Time Compilation with One Interpreter and One EngineYusuke Izawa
This document proposes a two-level just-in-time compilation approach using one interpreter and one engine. It finds that by providing different interpreter definitions to the RPython meta-tracing compiler, different kinds of compilers and compilations can be derived, such as tracing, method, and threaded code compilers. The key idea is an adaptive RPython system that performs multitier compilation by generating different interpreters from a generic interpreter and driving the RPython engine accordingly. This challenges the assumption in the JIT community that a meta-tracing compiler can only perform tracing compilation.
Comparison of SRv6 Extensions uSID, SRv6+, C-SRHKentaro Ebisawa
Comparing concept, SID and header format of compressed Segment Routing IPv6 proposals such as uSID, SRv6+, C-SRH. Slide presented at SRv6 Consortium @Tokyo on 23rd Aug 2019.
The document describes the design of p4srv6, a P4 program that implements SRv6 (Segment Routing for IPv6) functions. It discusses p4srv6's pipeline design based on the v1model.p4 architecture and includes details on the parser, ingress control, transit and end tables for SRv6, and handling of variable length SID lists. It also provides examples of configuring p4srv6 for GTP to SRv6 encapsulation and decapsulation.
SRv6 Mobile User Plane : Initial POC and ImplementationKentaro Ebisawa
SRv6 Mobile Uplane POC results and findings talked at ENOG55 @Nigata http://enog.jp/archives/2014
SRv6 functions: T.M.Tmap, End.M.GTP4.E using VPP and P4 on Tofino switch.
How to build and use GTPing to generate GTP traffic for testing without eNB, SPGW etc. This work was done as part of the preparation of SRv6 mobile user plane POC at SRv6 Consortium, Data plane Study Group, which is a group of people interested in SRv6.
Slides from ONOS/CORD meetup in Tokyo 2018. 20th April 2018.
http://www.e-side.co.jp/onoscordmeetup/#P4_2
Future Mobile User Plane is heavily discussed in many SDOs like 3GPP, IETF etc. and still not concreate. P4 lang is usefull to prototype such changing protocol on software switch and on ASIC/NPU.
This slide introudce one candidate for future Mobile User Plane protocol, SRv6 for Mobile User Plane and proto-type implemented in P4-14.
https://datatracker.ietf.org/doc/draft-ietf-dmm-srv6-mobile-uplane/
Moved to https://speakerdeck.com/ebiken/zebra-srv6-cli-on-linux-dataplane-enog-number-49
Introduction to SRv6, Linux SRv6 implementation and how to add SRv6 CLI to Zebra 2.0 Open Source Network Operation Stack.
Presented at ENOG (Echigo NOG) #49.
The document discusses requirements for network nodes in the hybrid cloud era. It notes that network nodes will need to have common interfaces regardless of location, provide a seamless experience for operators via CLI, and reduce learning costs. It then provides details on Zebra 2.0, an open source network operating stack, including its architecture, modules, scalable configuration system, and support for protocols like SRv6. It demos Zebra 2.0's SRv6 CLI functionality on a Linux dataplane.
AI and Data Privacy in 2025: Global TrendsInData Labs
In this infographic, we explore how businesses can implement effective governance frameworks to address AI data privacy. Understanding it is crucial for developing effective strategies that ensure compliance, safeguard customer trust, and leverage AI responsibly. Equip yourself with insights that can drive informed decision-making and position your organization for success in the future of data privacy.
This infographic contains:
-AI and data privacy: Key findings
-Statistics on AI data privacy in the today’s world
-Tips on how to overcome data privacy challenges
-Benefits of AI data security investments.
Keep up-to-date on how AI is reshaping privacy standards and what this entails for both individuals and organizations.
Generative Artificial Intelligence (GenAI) in BusinessDr. Tathagat Varma
My talk for the Indian School of Business (ISB) Emerging Leaders Program Cohort 9. In this talk, I discussed key issues around adoption of GenAI in business - benefits, opportunities and limitations. I also discussed how my research on Theory of Cognitive Chasms helps address some of these issues
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...Alan Dix
Talk at the final event of Data Fusion Dynamics: A Collaborative UK-Saudi Initiative in Cybersecurity and Artificial Intelligence funded by the British Council UK-Saudi Challenge Fund 2024, Cardiff Metropolitan University, 29th April 2025
https://alandix.com/academic/talks/CMet2025-AI-Changes-Everything/
Is AI just another technology, or does it fundamentally change the way we live and think?
Every technology has a direct impact with micro-ethical consequences, some good, some bad. However more profound are the ways in which some technologies reshape the very fabric of society with macro-ethical impacts. The invention of the stirrup revolutionised mounted combat, but as a side effect gave rise to the feudal system, which still shapes politics today. The internal combustion engine offers personal freedom and creates pollution, but has also transformed the nature of urban planning and international trade. When we look at AI the micro-ethical issues, such as bias, are most obvious, but the macro-ethical challenges may be greater.
At a micro-ethical level AI has the potential to deepen social, ethnic and gender bias, issues I have warned about since the early 1990s! It is also being used increasingly on the battlefield. However, it also offers amazing opportunities in health and educations, as the recent Nobel prizes for the developers of AlphaFold illustrate. More radically, the need to encode ethics acts as a mirror to surface essential ethical problems and conflicts.
At the macro-ethical level, by the early 2000s digital technology had already begun to undermine sovereignty (e.g. gambling), market economics (through network effects and emergent monopolies), and the very meaning of money. Modern AI is the child of big data, big computation and ultimately big business, intensifying the inherent tendency of digital technology to concentrate power. AI is already unravelling the fundamentals of the social, political and economic world around us, but this is a world that needs radical reimagining to overcome the global environmental and human challenges that confront us. Our challenge is whether to let the threads fall as they may, or to use them to weave a better future.
Massive Power Outage Hits Spain, Portugal, and France: Causes, Impact, and On...Aqusag Technologies
In late April 2025, a significant portion of Europe, particularly Spain, Portugal, and parts of southern France, experienced widespread, rolling power outages that continue to affect millions of residents, businesses, and infrastructure systems.
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...SOFTTECHHUB
I started my online journey with several hosting services before stumbling upon Ai EngineHost. At first, the idea of paying one fee and getting lifetime access seemed too good to pass up. The platform is built on reliable US-based servers, ensuring your projects run at high speeds and remain safe. Let me take you step by step through its benefits and features as I explain why this hosting solution is a perfect fit for digital entrepreneurs.
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveScyllaDB
Want to learn practical tips for designing systems that can scale efficiently without compromising speed?
Join us for a workshop where we’ll address these challenges head-on and explore how to architect low-latency systems using Rust. During this free interactive workshop oriented for developers, engineers, and architects, we’ll cover how Rust’s unique language features and the Tokio async runtime enable high-performance application development.
As you explore key principles of designing low-latency systems with Rust, you will learn how to:
- Create and compile a real-world app with Rust
- Connect the application to ScyllaDB (NoSQL data store)
- Negotiate tradeoffs related to data modeling and querying
- Manage and monitor the database for consistently low latencies
Increasing Retail Store Efficiency How can Planograms Save Time and Money.pptxAnoop Ashok
In today's fast-paced retail environment, efficiency is key. Every minute counts, and every penny matters. One tool that can significantly boost your store's efficiency is a well-executed planogram. These visual merchandising blueprints not only enhance store layouts but also save time and money in the process.
Quantum Computing Quick Research Guide by Arthur MorganArthur Morgan
This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
Dev Dives: Automate and orchestrate your processes with UiPath MaestroUiPathCommunity
This session is designed to equip developers with the skills needed to build mission-critical, end-to-end processes that seamlessly orchestrate agents, people, and robots.
📕 Here's what you can expect:
- Modeling: Build end-to-end processes using BPMN.
- Implementing: Integrate agentic tasks, RPA, APIs, and advanced decisioning into processes.
- Operating: Control process instances with rewind, replay, pause, and stop functions.
- Monitoring: Use dashboards and embedded analytics for real-time insights into process instances.
This webinar is a must-attend for developers looking to enhance their agentic automation skills and orchestrate robust, mission-critical processes.
👨🏫 Speaker:
Andrei Vintila, Principal Product Manager @UiPath
This session streamed live on April 29, 2025, 16:00 CET.
Check out all our upcoming Dev Dives sessions at https://community.uipath.com/dev-dives-automation-developer-2025/.
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungenpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-nomad-web-best-practices-und-verwaltung-von-multiuser-umgebungen/
HCL Nomad Web wird als die nächste Generation des HCL Notes-Clients gefeiert und bietet zahlreiche Vorteile, wie die Beseitigung des Bedarfs an Paketierung, Verteilung und Installation. Nomad Web-Client-Updates werden “automatisch” im Hintergrund installiert, was den administrativen Aufwand im Vergleich zu traditionellen HCL Notes-Clients erheblich reduziert. Allerdings stellt die Fehlerbehebung in Nomad Web im Vergleich zum Notes-Client einzigartige Herausforderungen dar.
Begleiten Sie Christoph und Marc, während sie demonstrieren, wie der Fehlerbehebungsprozess in HCL Nomad Web vereinfacht werden kann, um eine reibungslose und effiziente Benutzererfahrung zu gewährleisten.
In diesem Webinar werden wir effektive Strategien zur Diagnose und Lösung häufiger Probleme in HCL Nomad Web untersuchen, einschließlich
- Zugriff auf die Konsole
- Auffinden und Interpretieren von Protokolldateien
- Zugriff auf den Datenordner im Cache des Browsers (unter Verwendung von OPFS)
- Verständnis der Unterschiede zwischen Einzel- und Mehrbenutzerszenarien
- Nutzung der Client Clocking-Funktion
Procurement Insights Cost To Value Guide.pptxJon Hansen
Procurement Insights integrated Historic Procurement Industry Archives, serves as a powerful complement — not a competitor — to other procurement industry firms. It fills critical gaps in depth, agility, and contextual insight that most traditional analyst and association models overlook.
Learn more about this value- driven proprietary service offering here.
#StandardsGoals for 2025: Standards & certification roundup - Tech Forum 2025BookNet Canada
Book industry standards are evolving rapidly. In the first part of this session, we’ll share an overview of key developments from 2024 and the early months of 2025. Then, BookNet’s resident standards expert, Tom Richardson, and CEO, Lauren Stewart, have a forward-looking conversation about what’s next.
Link to recording, transcript, and accompanying resource: https://bnctechforum.ca/sessions/standardsgoals-for-2025-standards-certification-roundup/
Presented by BookNet Canada on May 6, 2025 with support from the Department of Canadian Heritage.
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan
This is a Quick Research Guide (QRG).
QRGs include the following:
- A brief, high-level overview of the QRG topic.
- A milestone timeline for the QRG topic.
- Links to various free online resource materials to provide a deeper dive into the QRG topic.
- Conclusion and a recommendation for at least two books available in the SJPL system on the QRG topic.
QRGs planned for the series:
- Artificial Intelligence QRG
- Quantum Computing QRG
- Big Data Analytics QRG
- Spacecraft Guidance, Navigation & Control QRG (coming 2026)
- UK Home Computing & The Birth of ARM QRG (coming 2027)
Any questions or comments?
- Please contact Arthur Morgan at [email protected].
100% human made.
Big Data Analytics Quick Research Guide by Arthur MorganArthur Morgan
p4alu: Arithmetic Logic Unit in P4
1. ~ p4alu ~
Arithmetic Logic Unit in P4
Kentaro Ebisawa | Ponto Networks, Inc.
[email protected]
Twitter: @ebiken
p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 1
2. • “p4alu” is an P4 program who would parse UDP packet with
payload in "p4alu header format" and apply calculation.
• This program is tested using BMv2 simple_switch P4 target.
• Source Code on GitHub
• https://github.com/ebiken/p4sandbox/tree/master/p4alu
• Generic P4 information in Japanese (日本語)
• How to Run P4 Behavior Model v2 (JAPANESE)
• https://www.slideshare.net/kentaroebisawa/how-to-run-p4-bmv2
p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 2
p4alu
3. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 3
ALU
Integer
Operand
Integer
Operand
Integer
Result
opCode
op1 op2
result
4. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 4
p4alu header format
Integer
Operand
Integer
Operand
Integer
Result
opCode
op1 op2
result
5. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 5
P4 parser
6. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 6
P4 action
7. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 7
P4 table & control
8. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 8
Setup netns based hosts
BMv2 running p4alu
9. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 9
Compile and Run on BMv2
10. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 10
Configure Tables via runtime_CLI
Forward Packet
from/to port#0 <-> port#1
Apply action based on opCode
• opCode: 1 => p4alu_add
• opCode: 2 => p4alu_sub
BMv2 Runtime CLI command format
11. p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 11
Packet Format (sending from host0)
• opCode: 0x01 => p4alu_add
• opCode: 0x02 => p4alu_sub
12. CuiShark by @slankdev | https://github.com/slankdev/cuishark
p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 12
packets after going through p4alu
op1 opCodeop2 result
13. CuiShark by @slankdev | https://github.com/slankdev/cuishark
p4alu ... Arithmetic Logic Unit in P4 | Software Router BoF @ IW2017 Japan | 2017/11/29 13
packets after going through p4alu
op1 opCodeop2 result