Scribd
Upload
46 views

SONiC Unit Test and Function Test Enhancement - Edgecore

This document discusses enhancing unit and function testing for SONiC. It describes Edgecore's testing workflow including end-to-end testing in development, hardware platform validations, and SONiC ecosystem integrations. It also discusses using GTest to create an unit testing framework for SONiC contributors to test features, reduce debugging work, and allow for easy test management. Examples are provided for testing ACL functionality across different components in SONiC.

Uploaded by

ngotu142
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
46 views

SONiC Unit Test and Function Test Enhancement - Edgecore

This document discusses enhancing unit and function testing for SONiC. It describes Edgecore's testing workflow including end-to-end testing in development, hardware platform validations, and SONiC ecosystem integrations. It also discusses using GTest to create an unit testing framework for SONiC contributors to test features, reduce debugging work, and allow for easy test management. Examples are provided for testing ACL functionality across different components in SONiC.

Uploaded by

ngotu142
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 22

SONiC unit test and function test enhancement

Taskin Ucpinar
EdgeCore
Testing at Edgecore
• End-to-end testing in development
workflow
• Coverages and Automation
• HW platform validations
• Pre-SI RAS, Performance testing
• Sonic ecosystem integrations
AS7712-32X AS9716-32D
AS7816-64X AS7212-54X AS6712-32X

AS7312-54XS AS4222-28PE

AS7326-56X AS7312-54X AS7712-32X

TO BE ANNOUNCED DURING
AS5712-54X AS7312-54XS AS7716-32X OCP

AS7116-54X AS7512-32X AS7716-32XB


▪ SONiC Feature Set Growth
▪ Rapid Development Environment
▪ Ensure Stability/Reliability
▪ Testing
▪ Interoperability
▪ Regression
▪ CI/CD
▪ Getting the full picture
▪ Completing the coverage
▪ Hardening
▪ Community Services
SONiC201705 BGP SONiC201709 VLAN

ECMP ACL Per/Den

LAG IPv6

LLDP Tunnel Decap

QoS - ECN Mirroring


..
QoS - RDMA .
.. BGP MP
.
One Image
Release SAI Version No of Features No of Ansible Tests

SONiC201705 0.9.4 18 9

SONiC201709 0.9.4 8 4

SONiC201712 1.0 7 2

SONiC201803 1.2 5 2

SONiC201807 1.3 3 0

SONiC201811 1.3 6 2

SONiC.201903 TBD 16 1

Total 63 20
▪ Test
units/components/functions/functionality
▪ Not only for testing, but for educational
purposes
▪ Independent on features/platforms
▪ Unit Tests: Typically implemented by
100% 68.3%
Coverage

Automation Hardening
A • Features
All Features with Tests
Missing Tests
• Coverage % Unknown • Stability Improvements
• Auto detect and execute
• Stability Unknown • Measure Coverage %
• Regression Testing
• New tests

Edgecore Community Labs

• Multiple Community Labs Across Globe


• SONiC Devices and Packet Generators
• Available to Edgecore Partners, Customers,
Community
Unit Test Software Architecture
Edgecore
Cloud
Build PyUnit
DevEnv
Tools
Test(s)
gcc/cc/gdb
make/autoconfig/pkg-
config
cmake
Source Code Dependencies
sonic-swss libnl
sonic-swsscommon python
… …

CI/CD PyUnit

Code Review Static Analysis Performance …


Regression UT Regression FT Test(s)
Than k You!
for example
ACL/CLI testing
How Gtest Works
Run gtest
Download and compile gtest into static library
Create gtest project
Create a test case – import source code and dependent packages
Add instrumentation code to source code to be tested
Run the test
Run gtest for SONiC
Test behavior before code modification
Modify code (add code, change code such as bug fixing)
Test behavior and compare with before
Gtest for SONiC
Our targets
Create an unit test framework for SONiC contributors as a developing and debugging tool
Reduce the work that contributors involve to run a test
Easy management interface
Gtest advantages
Run the exact same test repeatedly
Track the context state info when hitting a bug
Constraints of Gtest on SONiC
Use production language framework
Use Python/Go framework for code in languages such as Python/Go
Typically not cover complicated operations such as send/receive packets, database operations etc.
Also typically not cover script/shell code
SONiC
Gtest levels
Simulate referenced components or do component crossing test depending on
feature/developer requirements
Redis, SAI, socket, …
Gtest performance
More closer to real environment, more time to run
Import source code dependencies
Libraries, packages, …
Test code in container image
Container is not required to run gtest, but take effort to run on host directly
ACL Example

SONiC is composed of components such as each


has its own build and unit test code
ACL
Redis (Config) – SWSS/Orchagent – Redis (ASIC) – syncd – SAI
Swss-common/sairedis/hiredis reqired; SAI and Redis not necessary
3 levels
Mimic database and SAI
Use real database and mimic SAI
Use real database and virtual switch

You might also like