TestOn is the testing framework used at ONLAB to run nightly test of ONOS. This page describes the tests ran over the Segment Routing application.

<iframe src="https://onos-jenkins.onlab.us/job/USECASE_SegmentRouting/plot/getPlot?index=1&width=500&height=300" noborder="0" width="500" height="300" scrolling="yes" seamless="seamless"></iframe>

To install TestOn follow this link on the wiki.

A connectivity test is currently running nightly. The test consists of 3 Steps:

1. Configure and installs ONOS
2. Start mininet and check flow state
3. Test connectivity

The test runs for the following configurations of apps:

1. drivers,segmentrouting,openflow-base,netcfghostprovider,netcfglinksprovider

2. drivers,segmentrouting,openflow

The test runs for the following topologies:

1. 2x2 Leaf-Spine
2. 4x4 Leaf-Spine

The following are ideas for tests to be implemented:

1. [4/4] Full connectivity test (In-rack + Inter-rack) (including data plane failover)
2. [1/1] VLAN cross-connect
3. [0/5] Multicast (including data plane failover)
4. [0/5] vRouter integration
5. [0/4] Dynamic configuration
6. [1/4] Control plane failover

Below we describe these tests in detail

CASE101: Completed

• Description: Full connectivity test
• Topology: 2x2 Leaf-Spine Fabric
• Configuration: openflow
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall twice.
• Expect: All pings succeed

CASE102: Completed

• Description: Full connectivity test
• Topology: 2x2 Leaf-Spine Fabric
• Configuration: openflow-base, etc.
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall twice.
• Expect: All pings succeed

CASE103 : Completed

• Description: Link failover test on 2x2 fabric
• Topology: 2x2 Leaf-Spine Fabric
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, shut down a random spine link , execute pingall
• Expect: All pings succeed

CASE104 : Completed

• Description: Node failover test on 2x2 fabric
• Topology: 2x2 Leaf-Spine Fabric
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, shutdown a random spine, execute pingall, restart spine execute pingall
• Expect: All pings succeed

CASE201 : Completed

• Description: VLAN crossconnect connectivity
• Topology: Single Switch with qinq hosts
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall
• Expect: All pings succeed

CASE301

• Description: Multicast connectivity
• Topology: Single Switch with multicast src and dst hosts
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, send multicast traffic, expect traffic at end hosts
• Expect: All pings succeed

CASE302

• Description: Multicast connectivity on 2x2 fabric
• Topology: 2x2 Leaf-Spine with src and dst hosts
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, send multicast traffic, expect traffic at end hosts
• Expect: All pings succeed

CASE303

• Description: Multicast on fabric + Node failover test
• Topology: 2x2 Leaf-Spine with src and dst hosts
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, send multicast traffic, expect traffic at end hosts, shut down a random spine , execute pingall
• Expect: All pings succeed

CASE304

• Description: Multicast on fabric + Link failover test
• Topology: 2x2 Leaf-Spine with src and dst hosts
• Configuration: openflow-base, etc
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, send multicast traffic, expect traffic at end hosts, shut down a random spine link , execute pingall
• Expect: All pings succeed

CASE401

• Description: VRouter integration
• Topology: Single Switch chained to quagga and host
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, ping 8.8.8.8
• Expect: All pings succeed

CASE402

• Description: 2x2 Fabric VRouter integration
• Topology: 2x2 Leaf-spine chained to quagga and host
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, ping 8.8.8.8,
• Expect: All pings succeed

CASE403

• Description: 2x2 Fabric VRouter integration + link failover
• Topology: 2x2 Leaf-spine chained to quagga and host
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, ping 8.8.8.8, shut down a random spine link , execute pingall
• Expect: All pings succeed

CASE404

• Description: Fabric-VRouter integration + node failover
• Topology: 2x2 Leaf-spine chained to quagga and host
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, ping 8.8.8.8, shut down a random spine , execute pingall
• Expect: All pings succeed

CASE405 - Not implemented yet

• Description: Fabric-VRouter integration + quagga link failover
• Topology: Single switch connected to redundant quaggas
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, ping 8.8.8.8, shut down a random quagga link , execute pingall
• Expect: All pings succeed

CASE401

• Description: Dynamically add a host that doesn't belong to an existing subnet
• Topology: single switch
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, add a host via REST interface, execute pingall
• Expect: All pings succeed

CASE402

• Description: Dynamically add a host that belongs to an existing subnet
• Topology: single switch
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, add a host via REST interface, execute pingall
• Expect: All pings succeed

CASE503

• Description: Dynamically add a host that doesn't belong to an existing subnet
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, add a host via REST interface, execute pingall
• Expect: All pings succeed

CASE504

• Description: Dynamically add a host that belongs to an existing subnet
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect: flow count: undetermined group count: undetermined
• Do: Start topology, execute pingall, add a host via REST interface, execute pingall
• Expect: All pings succeed

CASE601 : Completed

• Description: Bring up LS connected to three controllers
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect flow count
• Do: Start topology, execute pingall
• Expect:Ping successfull

CASE602

• Description: Bring up LS connected to three controllers
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect flow count
• Do: Start topology, execute pingall, bring down a controller, pingall
• Expect:Ping successfull

CASE603

• Description: Bring up LS connected to three controllers
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect flow count
• Do: Start topology, execute pingall, bring down a controller and a node, pingall
• Expect:Ping successfull

CASE604

• Description: Bring up LS connected to three controllers
• Topology: 2x2 Leaf-spine
• Configuration: default
• Expect flow count
• Do: Start topology, execute pingall, bring down a controller and an interface, pingall
• Expect:Ping successfull