Interconnection Automation For All - Extended - MPS 2023

Agenda
1. Who are we?
2. What are we talking about?
3. What have we learned?
4. What is the solution?
5. What are we doing to help?
6. What can you do to help?
7. What else should we do?
8. Comments thinly veiled as questions.

Chris Grundemann
● 20+ years in networking
● Co-founder of IX-Denver
● OIX Director
● 8 patents in NetTech
● Co-founder and CSO at FullCtl
● 20+ years in software development
● Co-founder of UIX / ChIX
● OIX Director
● PeeringDB Maintainer
● Co-Founder and CTO at FullCtl
Matt “Grizz” Griswold

Sure, but why are you here?
● Age of Interconnection
● BGP is hard (for some)
● Lack of Standardization (for all)
● Lack of Automation (for many)
?

Age of Interconnection
● Peering managers on cruise ships
● Death of peering?

Age of Interconnection
● Cloud
● COVID
● Beyond LAN & WAN
● Digital Equity
● Security
● Reliability

But… BGP is hard (for some)
● For many, it’s a FLW, despite being a TLA
● Traditionally avoided by most
○ Enterprise
○ Public Sector
○ SMB (of course?)
● Also hard to find at
○ WISPS
○ FISPS
○ Electric Co-ops
● And now we have RPKI
○ Not getting easier…

Plus: Lack of Standardization
● Most networks heterogeneous
○ And Bespoke
● Unique policy requirements
○ TE, etc.
● Communities in use by ISP/IX/etc
○ More than just RTBH
● How-to request interconnection
○ Coordination can be painful
● LOAs
○ Don’t get us started…

And: Lack of Automation
● Almost nobody has “enough”
● Many lacking SoT
● Most lacking end-to-end flow
● Hard to automate w/out standard(s)
● Tough to test w/out lab (dev env)

On Automation…
A couple excerpts from:
2023 State of Network Automation Survey Results

How Automated Are We?
0%
-
Nothing is
automated,
everything
is always
done
manually.
100%
-
Everything is
automated,
nothing is
ever done
manually.

So, How Automated Are We?
0% - 20% = 24
30 - 40% = 17
50 - 60% = 20
70 - 80% = 17
90 - 100% = 0
50% and Below: 50
50% and Above: 37
Mean: 42.43%
Median: 40%

Expert? Yes Maybe No
Networking 65% 21% 14%
Interconnection 58% 19% 23%
Automation 27% 33% 40%
Automation Skills Gap?

Expert? Yes Maybe No
Networking 65% 21% 14%
Interconnection 58% 19% 23%
Automation 27% 33% 40%
73% Uncertain of
Automation Skills
Automation Skills Gap?

Bridging the Gap
Automation Fundamentals (Quick Primer)
How-To: Interconnection Automation

Summary of that Survey
78 Diverse Responses
40% of Network Automated (Median)
90% “Homebrewing” && 80% Using OSS (<31% $W)
94% Using Python && At Least 46% using Ansible
55% of Orgs have No Dedicated Automation Staff
73% of Respondents Uncertain of Automation Skills

Automation Fundamentals (Quick Primer)
● Software Defined Networking (SDN)
● Automation
● Orchestration
● Feedback
● Network Validation / Validation + Automation
● Network Observability
● Network Virtualization
● Network Function Virtualization (NFV)
● Infrastructure as Code (IaC) / Network as Code (NaC?)
● Intent Based Networking (IBN)
● NetDevOps –> Network, Development + Operations

How-To: Interconnection Automation
● Standardization
● Source(s) of Truth (SoT)
○ Leverage PeeringDB
● Orchestrate Operations
○ Provide Self-Service

Standardization
● Industry wide
○ Best Current Operational Practices (BCOP) - https://github.com/Open-IX/BCOP
○ Speaking of OIX: https://www.oix.org/standards-and-certifications/
○ BGP Communities
○ Cross-Connections
○ LOAs
○ Peering requests (more on this later…)
● Network Wide
○ Configurations
○ Policies
○ Procedures
○ Document >> Standardize >> Automate

Source(s) of Truth (SoTs, S’soT, idk…)

So… What are we (FullCtl) doing about interconnection?
● ixCtl
● PeerCtl
● PrefixCtl
● …you get the idea

So… What are we (FullCtl) doing about interconnection?
● ixCtl
● PeerCtl
● PrefixCtl
● …you get the idea
● Taking the best of all of “us” and embedding that knowledge into simple tools

FullCtl Suite
https://github.com/fullctl/
P
r
e
f
i
x
C
t
l
aaaCtl
DeviceCtl
PeerCtl
ixCtl

FullCtl Suite
● modern, modular, Unix philosophy services
● 100% API driven
● manage infrastructure
● automate provisioning
● source of truth for wider automation efforts
https://github.com/fullctl/

Foundations :: aaaCtl
https://github.com/fullctl/aaactl
Granular
Permissions
Fine grained user and role
permissions down to each
object level
Audit logs
Audit logs for other running
services.
Oauth
|
SAML
Integrates
with
existing
aaa
services.
Azure
AD,
Okta,
PeeringDB,
et
al
Oauth | SAML
Integrates with existing
aaa services.
Azure AD, Okta, PeeringDB,
etc

Foundations :: aaaCtl
● Authentication and Authorization gateway
○ Client - integrates with existing directories
○ Provider - can be used as a SoT
● RBAC permissioning
● Audit logging
https://github.com/fullctl/aaactl

Foundations :: DeviceCtl
● Source of truth for devices
● Bidirectional sync to other sources of truth
○ Netbox, Nautobot, Proprietary systems, etc
○ PeeringDB facilities, geoloc data
● Caching and verification
https://github.com/fullctl/devicectl

Metadata :: PrefixCtl
Used as a SoT for prefixes
Bidirectional sync
Attaches and updates metadata
● IRR
● RPKI status
● IP reputation
● Geoloc data
https://github.com/fullctl/prefixctl *OSS coming soon

ixCtl
An automation platform purpose built for internet exchange operators.
● modern, modular application
● 100% API driven
● connected networks get access to the PeerCtl dashboard
https://github.com/fullctl/ixctl

ixCtl turnkey route servers
1. Click “import” to pull baseline data on connected networks from PeeringDB
2. Hit “configure route server” and add basic info to generate secure
configurations
3. 1 time ansible (VM/BM) or helm (k8s) deploy for managed containers, or curl
into your own setup
4. enjoy karmic bliss, knowing that your route servers are automatically
contributing to the good of the internet!

ixCtl - Not “Just” Route Servers
● SoT for devices and ports
● Building graphs
● Manage members / IX-F output for PeeringDB, etc
● Allow member access to update mac address, max prefix, etc

ixCtl - Coming Soon
● Public Portal
● Client Portal
● LOA Generation
● AS112 Configuration
● Advanced Route Server Management
● Automated Switch Configuration
● $your_idea_here

PeerCtl
Interconnection automation and workflow management.
● modern, modular, Unix philosophy services
● 100% API driven
● Open Source or As A Service
https://github.com/fullctl/peerctl

PeerCtl
Peering Toolkit
1. You select an IX. PeerCtl shows you all of the possible peers at that location.
2. You select a peer. PeerCtl provides BGP configurations and email templates
to get connected.
3. You want more. PeerCtl shows you all of the other mutual exchanges where
you can interconnect with this peer.

PeerCtl - but wait, there’s more
● All kinds of “peers”
○ Bilateral, multilateral, PNI, transit, transport
● Source of truth for your Interconnection efforts
○ Sync with third party inventory via DeviceCtl
○ Stay virtual with PDB Ports
● Extensibility
○ PeerCtl BGP configurations are extensible and customizable with templates
○ Templates also allow you to extract peering data for other uses
○ Email templates with override also (and pdb contacts, etc)
● “show BGP summary”
○ View all sessions at once
● Import from network
○ Pull in existing BGP sessions

PeerCtl - Coming Soon
● Public Peering Portal
○ for third parties to use when requesting peering with your network
● “Where To Peer” Improvements
○ integrating traffic analysis to provide intelligent recommendations
● PeeringDB Integration Improvements
○ enable pushing updates to PeeringDB from PeerCtl
○ enable you to add networks to PeerCtl that are not listed in PeeringDB
● UX Improvements
○ enhanced alerting, along with interface design improvements

AutoPeer
Peering automation API
Zero Click Peering™

Joint Effort
● Meta
● FullCtl
● Cloudflare
● AWS
● Google

Ghost of Peering Past
Coordinated over email
In person meetings required at first (🍻)
Multiple emails exchanged per request

Peering API Goals
● Machine-to-Machine Configuration
● GOAL:
○ Reduce human time spent configuring
peering
○ Improve network latency
● REQUIREMENT:
○ (Security) PeeringDB OIDC support

Peering API, Future
● Proof of concept
● Keep it simple
● Establish definitions

Check it out!
Announcements Mailing List -
https://lists.20c.com/mailman3/lists/autopeer-announce.lists.20c.com
Developers Mailing List -
https://lists.20c.com/mailman3/lists/autopeer-dev.lists.20c.com/
Waiting on legal
https://github.com/grizz/autopeer

Wanna learn more?
Tune in this Friday (21 July) Morning:
https://netboxlabs.com/events/fullctl-netboxlabs-webinar/

Ready to Play?
Free account: https://account.fullctl.io (sign in with PeeringDB)
Contact us about a demo:
hello@fullctl.com

Not Alone
● PeeringDB
● NetBox (& Nautobot)
● Kentik [tooling/telemetry]
● BGPQ4
● Global Traceroute
● IXP Manager
● Peering Manager
● Rancid
https://openpipes.net

What can YOU do?
● Communicate
● Standardate
● Automate

What else can we do?
Time for comments thinly veiled as questions...
FullCtl.com

Interconnection Automation For All - Extended - MPS 2023

Recommended

More Related Content

Similar to Interconnection Automation For All - Extended - MPS 2023 (20)

Recently uploaded (19)

Interconnection Automation For All - Extended - MPS 2023