View Source

SRRouting at 22 Jan 2019 20:42:22

<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric2/lastSuccessfulBuild/artifact/SRRouting_onos-1.15_20-builds_graph.jpg", alt="SRRouting", style="width:525px;height:350px;border:0">

commit 0ad196273a07d3a9f35a3a193af01dec106a490e (HEAD -] onos-1.15, origin/onos-1.15)
Author: Harshada Chaundkar [harshada_chaundkar@comcast.com]
AuthorDate: Tue Jan 15 00:05:57 2019 +0000
Commit: Charles Chan [charles@opennetworking.org]
CommitDate: Tue Jan 22 18:44:18 2019 +0000

PacketProcessorWebResource cannot find PacketService when it become instantiated; changed debug logs to trace in FPMManager
--
(cherry picked from commit 0d7cf74b85729c4346ae53b441793c24af0a3102)

Case 101: Test link failures with IPv4 hosts - PASS

101.1 Constructing test variables - PASS
101.2 Apply cell to environment - PASS
101.3 Uninstalling Atomix - PASS
101.4 Uninstalling ONOS package - PASS
101.5 Creating ONOS package - PASS
101.6 Installing Atomix - PASS
101.7 Installing ONOS package - PASS
101.8 Set up ONOS secure SSH - PASS
101.9 Checking ONOS service - PASS
101.10 Starting ONOS CLI sessions - PASS
101.11 Checking ONOS nodes - PASS
101.12 Checking ONOS applications - PASS
101.13 Starting Mininet Topology - PASS
101.14 Verify host IP address assignment in ONOS - PASS
101.15 Verify IP address assignment from hosts - PASS
101.16 Verify reachability of connected internal IPv4 hosts - PASS
101.17 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
101.18 Verify host IP address assignment in ONOS - PASS
101.19 Verify IP address assignment from hosts - PASS
101.20 Verify reachability of connected internal IPv4 hosts - PASS
101.21 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
101.22 Verify host IP address assignment in ONOS - PASS
101.23 Verify IP address assignment from hosts - PASS
101.24 Verify reachability of connected internal IPv4 hosts - PASS
101.25 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
101.26 Verify host IP address assignment in ONOS - PASS
101.27 Verify IP address assignment from hosts - PASS
101.28 Verify reachability of connected internal IPv4 hosts - PASS
101.29 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
101.30 Verify host IP address assignment in ONOS - PASS
101.31 Verify IP address assignment from hosts - PASS
101.32 Verify reachability of connected internal IPv4 hosts - PASS
101.33 Stopping Mininet - PASS

Case 102: Test link failures with IPv6 hosts - PASS

102.1 Apply cell to environment - PASS
102.2 Uninstalling Atomix - PASS
102.3 Uninstalling ONOS package - PASS
102.4 Installing Atomix - PASS
102.5 Installing ONOS package - PASS
102.6 Set up ONOS secure SSH - PASS
102.7 Checking ONOS service - PASS
102.8 Starting ONOS CLI sessions - PASS
102.9 Checking ONOS nodes - PASS
102.10 Checking ONOS applications - PASS
102.11 Starting Mininet Topology - PASS
102.12 Verify host IP address assignment in ONOS - PASS
102.13 Verify IP address assignment from hosts - PASS
102.14 Verify reachability of connected internal IPv6 hosts - PASS
102.15 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
102.16 Verify host IP address assignment in ONOS - PASS
102.17 Verify IP address assignment from hosts - PASS
102.18 Verify reachability of connected internal IPv6 hosts - PASS
102.19 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
102.20 Verify host IP address assignment in ONOS - PASS
102.21 Verify IP address assignment from hosts - PASS
102.22 Verify reachability of connected internal IPv6 hosts - PASS
102.23 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
102.24 Verify host IP address assignment in ONOS - PASS
102.25 Verify IP address assignment from hosts - PASS
102.26 Verify reachability of connected internal IPv6 hosts - PASS
102.27 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
102.28 Verify host IP address assignment in ONOS - PASS
102.29 Verify IP address assignment from hosts - PASS
102.30 Verify reachability of connected internal IPv6 hosts - PASS
102.31 Stopping Mininet - PASS

Case 103: Test link failures with IPv4 and IPv6 hosts - PASS

103.1 Apply cell to environment - PASS
103.2 Uninstalling Atomix - PASS
103.3 Uninstalling ONOS package - PASS
103.4 Installing Atomix - PASS
103.5 Installing ONOS package - PASS
103.6 Set up ONOS secure SSH - PASS
103.7 Checking ONOS service - PASS
103.8 Starting ONOS CLI sessions - PASS
103.9 Checking ONOS nodes - PASS
103.10 Checking ONOS applications - PASS
103.11 Starting Mininet Topology - PASS
103.12 Verify host IP address assignment in ONOS - PASS
103.13 Verify IP address assignment from hosts - PASS
103.14 Verify reachability of connected internal IPv4 hosts - PASS
103.15 Verify reachability of connected internal IPv6 hosts - PASS
103.16 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
103.17 Verify host IP address assignment in ONOS - PASS
103.18 Verify IP address assignment from hosts - PASS
103.19 Verify reachability of connected internal IPv4 hosts - PASS
103.20 Verify reachability of connected internal IPv6 hosts - PASS
103.21 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
103.22 Verify host IP address assignment in ONOS - PASS
103.23 Verify IP address assignment from hosts - PASS
103.24 Verify reachability of connected internal IPv4 hosts - PASS
103.25 Verify reachability of connected internal IPv6 hosts - PASS
103.26 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
103.27 Verify host IP address assignment in ONOS - PASS
103.28 Verify IP address assignment from hosts - PASS
103.29 Verify reachability of connected internal IPv4 hosts - PASS
103.30 Verify reachability of connected internal IPv6 hosts - PASS
103.31 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
103.32 Verify host IP address assignment in ONOS - PASS
103.33 Verify IP address assignment from hosts - PASS
103.34 Verify reachability of connected internal IPv4 hosts - PASS
103.35 Verify reachability of connected internal IPv6 hosts - PASS
103.36 Stopping Mininet - PASS

Case 104: Test link failures with IPv4 hosts including external hosts - PASS

104.1 Apply cell to environment - PASS
104.2 Uninstalling Atomix - PASS
104.3 Uninstalling ONOS package - PASS
104.4 Installing Atomix - PASS
104.5 Installing ONOS package - PASS
104.6 Set up ONOS secure SSH - PASS
104.7 Checking ONOS service - PASS
104.8 Starting ONOS CLI sessions - PASS
104.9 Checking ONOS nodes - PASS
104.10 Checking ONOS applications - PASS
104.11 Starting Mininet Topology - PASS
104.12 Verify host IP address assignment in ONOS - PASS
104.13 Verify IP address assignment from hosts - PASS
104.14 Verify reachability of connected internal IPv4 hosts - PASS
104.15 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
104.16 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
104.17 Verify host IP address assignment in ONOS - PASS
104.18 Verify IP address assignment from hosts - PASS
104.19 Verify reachability of connected internal IPv4 hosts - PASS
104.20 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
104.21 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
104.22 Verify host IP address assignment in ONOS - PASS
104.23 Verify IP address assignment from hosts - PASS
104.24 Verify reachability of connected internal IPv4 hosts - PASS
104.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
104.26 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
104.27 Verify host IP address assignment in ONOS - PASS
104.28 Verify IP address assignment from hosts - PASS
104.29 Verify reachability of connected internal IPv4 hosts - PASS
104.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
104.31 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
104.32 Verify host IP address assignment in ONOS - PASS
104.33 Verify IP address assignment from hosts - PASS
104.34 Verify reachability of connected internal IPv4 hosts - PASS
104.35 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
104.36 Stopping Mininet - PASS

Case 105: Test link failures with IPv6 hosts including external hosts - FAIL

105.1 Apply cell to environment - PASS
105.2 Uninstalling Atomix - PASS
105.3 Uninstalling ONOS package - PASS
105.4 Installing Atomix - PASS
105.5 Installing ONOS package - PASS
105.6 Set up ONOS secure SSH - PASS
105.7 Checking ONOS service - PASS
105.8 Starting ONOS CLI sessions - PASS
105.9 Checking ONOS nodes - PASS
105.10 Checking ONOS applications - PASS
105.11 Starting Mininet Topology - PASS
105.12 Verify host IP address assignment in ONOS - PASS
105.13 Verify IP address assignment from hosts - PASS
105.14 Verify reachability of connected internal IPv6 hosts - PASS
105.15 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
105.16 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
105.17 Verify host IP address assignment in ONOS - PASS
105.18 Verify IP address assignment from hosts - PASS
105.19 Verify reachability of connected internal IPv6 hosts - FAIL

Verify reachability of connected internal IPv6 hosts: Fail

105.20 Stopping Mininet - PASS

Skipping the rest of this case.

Case 106: Test link failures with IPv4 and IPv6 hosts including external hosts - FAIL

106.1 Apply cell to environment - PASS
106.2 Uninstalling Atomix - PASS
106.3 Uninstalling ONOS package - PASS
106.4 Installing Atomix - PASS
106.5 Installing ONOS package - PASS
106.6 Set up ONOS secure SSH - PASS
106.7 Checking ONOS service - PASS
106.8 Starting ONOS CLI sessions - PASS
106.9 Checking ONOS nodes - PASS
106.10 Checking ONOS applications - PASS
106.11 Starting Mininet Topology - PASS
106.12 Verify host IP address assignment in ONOS - FAIL

Verify ONOS host IP failed

106.13 Stopping Mininet - PASS

Skipping the rest of this case.

Case 107: Test link failures with IPv4 hosts including external hosts configured with route-add command - PASS

107.1 Apply cell to environment - PASS
107.2 Uninstalling Atomix - PASS
107.3 Uninstalling ONOS package - PASS
107.4 Installing Atomix - PASS
107.5 Installing ONOS package - PASS
107.6 Set up ONOS secure SSH - PASS
107.7 Checking ONOS service - PASS
107.8 Starting ONOS CLI sessions - PASS
107.9 Checking ONOS nodes - PASS
107.10 Checking ONOS applications - PASS
107.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
107.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
107.13 Starting Mininet Topology - PASS
107.14 Verify host IP address assignment in ONOS - PASS
107.15 Verify IP address assignment from hosts - PASS
107.16 Verify reachability of connected internal IPv4 hosts - PASS
107.17 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
107.18 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
107.19 Verify host IP address assignment in ONOS - PASS
107.20 Verify IP address assignment from hosts - PASS
107.21 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
107.22 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
107.23 Verify host IP address assignment in ONOS - PASS
107.24 Verify IP address assignment from hosts - PASS
107.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
107.26 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
107.27 Verify host IP address assignment in ONOS - PASS
107.28 Verify IP address assignment from hosts - PASS
107.29 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
107.30 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
107.31 Verify host IP address assignment in ONOS - PASS
107.32 Verify IP address assignment from hosts - PASS
107.33 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
107.34 Stopping Mininet - PASS

Case 108: Test link failures with IPv6 hosts including external hosts configured with route-add command - PASS

108.1 Apply cell to environment - PASS
108.2 Uninstalling Atomix - PASS
108.3 Uninstalling ONOS package - PASS
108.4 Installing Atomix - PASS
108.5 Installing ONOS package - PASS
108.6 Set up ONOS secure SSH - PASS
108.7 Checking ONOS service - PASS
108.8 Starting ONOS CLI sessions - PASS
108.9 Checking ONOS nodes - PASS
108.10 Checking ONOS applications - PASS
108.11 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
108.12 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
108.13 Starting Mininet Topology - PASS
108.14 Verify host IP address assignment in ONOS - PASS
108.15 Verify IP address assignment from hosts - PASS
108.16 Verify reachability of connected internal IPv6 hosts - PASS
108.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
108.18 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
108.19 Verify host IP address assignment in ONOS - PASS
108.20 Verify IP address assignment from hosts - PASS
108.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
108.22 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
108.23 Verify host IP address assignment in ONOS - PASS
108.24 Verify IP address assignment from hosts - PASS
108.25 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
108.26 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
108.27 Verify host IP address assignment in ONOS - PASS
108.28 Verify IP address assignment from hosts - PASS
108.29 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
108.30 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
108.31 Verify host IP address assignment in ONOS - PASS
108.32 Verify IP address assignment from hosts - PASS
108.33 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
108.34 Stopping Mininet - PASS

Case 109: Test link failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - PASS

109.1 Apply cell to environment - PASS
109.2 Uninstalling Atomix - PASS
109.3 Uninstalling ONOS package - PASS
109.4 Installing Atomix - PASS
109.5 Installing ONOS package - PASS
109.6 Set up ONOS secure SSH - PASS
109.7 Checking ONOS service - PASS
109.8 Starting ONOS CLI sessions - PASS
109.9 Checking ONOS nodes - PASS
109.10 Checking ONOS applications - PASS
109.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
109.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
109.13 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
109.14 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
109.15 Starting Mininet Topology - PASS
109.16 Verify host IP address assignment in ONOS - PASS
109.17 Verify IP address assignment from hosts - PASS
109.18 Verify reachability of connected internal IPv4 hosts - PASS
109.19 Verify reachability of connected internal IPv6 hosts - PASS
109.20 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
109.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
109.22 Killing a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
109.23 Verify host IP address assignment in ONOS - PASS
109.24 Verify IP address assignment from hosts - PASS
109.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
109.26 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
109.27 Restoring a batch of links [['spine103', 'spine101'], ['leaf2', 'spine101'], ['leaf3', 'spine101'], ['leaf4', 'spine101'], ['leaf5', 'spine101']] - PASS
109.28 Verify host IP address assignment in ONOS - PASS
109.29 Verify IP address assignment from hosts - PASS
109.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
109.31 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
109.32 Killing a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
109.33 Verify host IP address assignment in ONOS - PASS
109.34 Verify IP address assignment from hosts - PASS
109.35 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
109.36 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
109.37 Restoring a batch of links [['spine104', 'spine102'], ['leaf2', 'spine102'], ['leaf3', 'spine102'], ['leaf4', 'spine102'], ['leaf5', 'spine102']] - PASS
109.38 Verify host IP address assignment in ONOS - PASS
109.39 Verify IP address assignment from hosts - PASS
109.40 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
109.41 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
109.42 Stopping Mininet - PASS

Case 201: Test switch failures with IPv4 hosts - FAIL

201.1 Apply cell to environment - PASS
201.2 Uninstalling Atomix - PASS
201.3 Uninstalling ONOS package - PASS
201.4 Installing Atomix - PASS
201.5 Installing ONOS package - PASS
201.6 Set up ONOS secure SSH - PASS
201.7 Checking ONOS service - PASS
201.8 Starting ONOS CLI sessions - PASS
201.9 Checking ONOS nodes - PASS
201.10 Checking ONOS applications - PASS
201.11 Starting Mininet Topology - PASS
201.12 Verify host IP address assignment in ONOS - PASS
201.13 Verify IP address assignment from hosts - PASS
201.14 Verify reachability of connected internal IPv4 hosts - PASS
201.15 Kill ['spine101'] - PASS
201.16 Verify host IP address assignment in ONOS - PASS
201.17 Verify IP address assignment from hosts - PASS
201.18 Verify reachability of connected internal IPv4 hosts - PASS
201.19 Recovering ['spine101'] - FAIL

Failed to recover switch?

201.20 Verify host IP address assignment in ONOS - PASS
201.21 Verify IP address assignment from hosts - PASS
201.22 Verify reachability of connected internal IPv4 hosts - PASS
201.23 Kill ['spine102'] - FAIL

Failed to kill switch?

201.24 Verify host IP address assignment in ONOS - FAIL

Verify ONOS host IP failed

201.25 Stopping Mininet - PASS

Skipping the rest of this case.

Case 202: Test switch failures with IPv6 hosts - FAIL

202.1 Apply cell to environment - PASS
202.2 Uninstalling Atomix - PASS
202.3 Uninstalling ONOS package - PASS
202.4 Installing Atomix - PASS
202.5 Installing ONOS package - PASS
202.6 Set up ONOS secure SSH - PASS
202.7 Checking ONOS service - PASS
202.8 Starting ONOS CLI sessions - PASS
202.9 Checking ONOS nodes - PASS
202.10 Checking ONOS applications - PASS
202.11 Starting Mininet Topology - PASS
202.12 Verify host IP address assignment in ONOS - PASS
202.13 Verify IP address assignment from hosts - PASS
202.14 Verify reachability of connected internal IPv6 hosts - PASS
202.15 Kill ['spine101'] - PASS
202.16 Verify host IP address assignment in ONOS - PASS
202.17 Verify IP address assignment from hosts - PASS
202.18 Verify reachability of connected internal IPv6 hosts - PASS
202.19 Recovering ['spine101'] - FAIL

Failed to recover switch?

202.20 Verify host IP address assignment in ONOS - PASS
202.21 Verify IP address assignment from hosts - PASS
202.22 Verify reachability of connected internal IPv6 hosts - FAIL

Verify reachability of connected internal IPv6 hosts: Fail

202.23 Stopping Mininet - PASS

Skipping the rest of this case.

Case 203: Test switch failures with IPv4 and IPv6 hosts - PASS

203.1 Apply cell to environment - PASS
203.2 Uninstalling Atomix - PASS
203.3 Uninstalling ONOS package - PASS
203.4 Installing Atomix - PASS
203.5 Installing ONOS package - PASS
203.6 Set up ONOS secure SSH - PASS
203.7 Checking ONOS service - PASS
203.8 Starting ONOS CLI sessions - PASS
203.9 Checking ONOS nodes - PASS
203.10 Checking ONOS applications - PASS
203.11 Starting Mininet Topology - PASS
203.12 Verify host IP address assignment in ONOS - PASS
203.13 Verify IP address assignment from hosts - PASS
203.14 Verify reachability of connected internal IPv4 hosts - PASS
203.15 Verify reachability of connected internal IPv6 hosts - PASS
203.16 Kill ['spine101'] - PASS
203.17 Verify host IP address assignment in ONOS - PASS
203.18 Verify IP address assignment from hosts - PASS
203.19 Verify reachability of connected internal IPv4 hosts - PASS
203.20 Verify reachability of connected internal IPv6 hosts - PASS
203.21 Recovering ['spine101'] - PASS
203.22 Verify host IP address assignment in ONOS - PASS
203.23 Verify IP address assignment from hosts - PASS
203.24 Verify reachability of connected internal IPv4 hosts - PASS
203.25 Verify reachability of connected internal IPv6 hosts - PASS
203.26 Kill ['spine102'] - PASS
203.27 Verify host IP address assignment in ONOS - PASS
203.28 Verify IP address assignment from hosts - PASS
203.29 Verify reachability of connected internal IPv4 hosts - PASS
203.30 Verify reachability of connected internal IPv6 hosts - PASS
203.31 Recovering ['spine102'] - PASS
203.32 Verify host IP address assignment in ONOS - PASS
203.33 Verify IP address assignment from hosts - PASS
203.34 Verify reachability of connected internal IPv4 hosts - PASS
203.35 Verify reachability of connected internal IPv6 hosts - PASS
203.36 Stopping Mininet - PASS

Case 204: Test switch failures with IPv4 hosts including external hosts - PASS

204.1 Apply cell to environment - PASS
204.2 Uninstalling Atomix - PASS
204.3 Uninstalling ONOS package - PASS
204.4 Installing Atomix - PASS
204.5 Installing ONOS package - PASS
204.6 Set up ONOS secure SSH - PASS
204.7 Checking ONOS service - PASS
204.8 Starting ONOS CLI sessions - PASS
204.9 Checking ONOS nodes - PASS
204.10 Checking ONOS applications - PASS
204.11 Starting Mininet Topology - PASS
204.12 Verify host IP address assignment in ONOS - PASS
204.13 Verify IP address assignment from hosts - PASS
204.14 Verify reachability of connected internal IPv4 hosts - PASS
204.15 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
204.16 Kill ['spine101'] - PASS
204.17 Verify host IP address assignment in ONOS - PASS
204.18 Verify IP address assignment from hosts - PASS
204.19 Verify reachability of connected internal IPv4 hosts - PASS
204.20 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
204.21 Recovering ['spine101'] - PASS
204.22 Verify host IP address assignment in ONOS - PASS
204.23 Verify IP address assignment from hosts - PASS
204.24 Verify reachability of connected internal IPv4 hosts - PASS
204.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
204.26 Kill ['spine102'] - PASS
204.27 Verify host IP address assignment in ONOS - PASS
204.28 Verify IP address assignment from hosts - PASS
204.29 Verify reachability of connected internal IPv4 hosts - PASS
204.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
204.31 Recovering ['spine102'] - PASS
204.32 Verify host IP address assignment in ONOS - PASS
204.33 Verify IP address assignment from hosts - PASS
204.34 Verify reachability of connected internal IPv4 hosts - PASS
204.35 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
204.36 Stopping Mininet - PASS

Case 205: Test switch failures with IPv6 hosts including external hosts - PASS

205.1 Apply cell to environment - PASS
205.2 Uninstalling Atomix - PASS
205.3 Uninstalling ONOS package - PASS
205.4 Installing Atomix - PASS
205.5 Installing ONOS package - PASS
205.6 Set up ONOS secure SSH - PASS
205.7 Checking ONOS service - PASS
205.8 Starting ONOS CLI sessions - PASS
205.9 Checking ONOS nodes - PASS
205.10 Checking ONOS applications - PASS
205.11 Starting Mininet Topology - PASS
205.12 Verify host IP address assignment in ONOS - PASS
205.13 Verify IP address assignment from hosts - PASS
205.14 Verify reachability of connected internal IPv6 hosts - PASS
205.15 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
205.16 Kill ['spine101'] - PASS
205.17 Verify host IP address assignment in ONOS - PASS
205.18 Verify IP address assignment from hosts - PASS
205.19 Verify reachability of connected internal IPv6 hosts - PASS
205.20 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
205.21 Recovering ['spine101'] - PASS
205.22 Verify host IP address assignment in ONOS - PASS
205.23 Verify IP address assignment from hosts - PASS
205.24 Verify reachability of connected internal IPv6 hosts - PASS
205.25 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
205.26 Kill ['spine102'] - PASS
205.27 Verify host IP address assignment in ONOS - PASS
205.28 Verify IP address assignment from hosts - PASS
205.29 Verify reachability of connected internal IPv6 hosts - PASS
205.30 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
205.31 Recovering ['spine102'] - PASS
205.32 Verify host IP address assignment in ONOS - PASS
205.33 Verify IP address assignment from hosts - PASS
205.34 Verify reachability of connected internal IPv6 hosts - PASS
205.35 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
205.36 Stopping Mininet - PASS

Case 206: Test switch failures with IPv4 and IPv6 hosts including external hosts - PASS

206.1 Apply cell to environment - PASS
206.2 Uninstalling Atomix - PASS
206.3 Uninstalling ONOS package - PASS
206.4 Installing Atomix - PASS
206.5 Installing ONOS package - PASS
206.6 Set up ONOS secure SSH - PASS
206.7 Checking ONOS service - PASS
206.8 Starting ONOS CLI sessions - PASS
206.9 Checking ONOS nodes - PASS
206.10 Checking ONOS applications - PASS
206.11 Starting Mininet Topology - PASS
206.12 Verify host IP address assignment in ONOS - PASS
206.13 Verify IP address assignment from hosts - PASS
206.14 Verify reachability of connected internal IPv4 hosts - PASS
206.15 Verify reachability of connected internal IPv6 hosts - PASS
206.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
206.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
206.18 Kill ['spine101'] - PASS
206.19 Verify host IP address assignment in ONOS - PASS
206.20 Verify IP address assignment from hosts - PASS
206.21 Verify reachability of connected internal IPv4 hosts - PASS
206.22 Verify reachability of connected internal IPv6 hosts - PASS
206.23 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
206.24 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
206.25 Recovering ['spine101'] - PASS
206.26 Verify host IP address assignment in ONOS - PASS
206.27 Verify IP address assignment from hosts - PASS
206.28 Verify reachability of connected internal IPv4 hosts - PASS
206.29 Verify reachability of connected internal IPv6 hosts - PASS
206.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
206.31 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
206.32 Kill ['spine102'] - PASS
206.33 Verify host IP address assignment in ONOS - PASS
206.34 Verify IP address assignment from hosts - PASS
206.35 Verify reachability of connected internal IPv4 hosts - PASS
206.36 Verify reachability of connected internal IPv6 hosts - PASS
206.37 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
206.38 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
206.39 Recovering ['spine102'] - PASS
206.40 Verify host IP address assignment in ONOS - PASS
206.41 Verify IP address assignment from hosts - PASS
206.42 Verify reachability of connected internal IPv4 hosts - PASS
206.43 Verify reachability of connected internal IPv6 hosts - PASS
206.44 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
206.45 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
206.46 Stopping Mininet - PASS

Case 207: Test switch failures with IPv4 hosts including external hosts configured with route-add command - PASS

207.1 Apply cell to environment - PASS
207.2 Uninstalling Atomix - PASS
207.3 Uninstalling ONOS package - PASS
207.4 Installing Atomix - PASS
207.5 Installing ONOS package - PASS
207.6 Set up ONOS secure SSH - PASS
207.7 Checking ONOS service - PASS
207.8 Starting ONOS CLI sessions - PASS
207.9 Checking ONOS nodes - PASS
207.10 Checking ONOS applications - PASS
207.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
207.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
207.13 Starting Mininet Topology - PASS
207.14 Verify host IP address assignment in ONOS - PASS
207.15 Verify IP address assignment from hosts - PASS
207.16 Verify reachability of connected internal IPv4 hosts - PASS
207.17 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
207.18 Kill ['spine101'] - PASS
207.19 Verify host IP address assignment in ONOS - PASS
207.20 Verify IP address assignment from hosts - PASS
207.21 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
207.22 Recovering ['spine101'] - PASS
207.23 Verify host IP address assignment in ONOS - PASS
207.24 Verify IP address assignment from hosts - PASS
207.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
207.26 Kill ['spine102'] - PASS
207.27 Verify host IP address assignment in ONOS - PASS
207.28 Verify IP address assignment from hosts - PASS
207.29 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
207.30 Recovering ['spine102'] - PASS
207.31 Verify host IP address assignment in ONOS - PASS
207.32 Verify IP address assignment from hosts - PASS
207.33 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
207.34 Stopping Mininet - PASS

Case 208: Test switch failures with IPv6 hosts including external hosts configured with route-add command - PASS

208.1 Apply cell to environment - PASS
208.2 Uninstalling Atomix - PASS
208.3 Uninstalling ONOS package - PASS
208.4 Installing Atomix - PASS
208.5 Installing ONOS package - PASS
208.6 Set up ONOS secure SSH - PASS
208.7 Checking ONOS service - PASS
208.8 Starting ONOS CLI sessions - PASS
208.9 Checking ONOS nodes - PASS
208.10 Checking ONOS applications - PASS
208.11 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
208.12 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
208.13 Starting Mininet Topology - PASS
208.14 Verify host IP address assignment in ONOS - PASS
208.15 Verify IP address assignment from hosts - PASS
208.16 Verify reachability of connected internal IPv6 hosts - PASS
208.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
208.18 Kill ['spine101'] - PASS
208.19 Verify host IP address assignment in ONOS - PASS
208.20 Verify IP address assignment from hosts - PASS
208.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
208.22 Recovering ['spine101'] - PASS
208.23 Verify host IP address assignment in ONOS - PASS
208.24 Verify IP address assignment from hosts - PASS
208.25 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
208.26 Kill ['spine102'] - PASS
208.27 Verify host IP address assignment in ONOS - PASS
208.28 Verify IP address assignment from hosts - PASS
208.29 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
208.30 Recovering ['spine102'] - PASS
208.31 Verify host IP address assignment in ONOS - PASS
208.32 Verify IP address assignment from hosts - PASS
208.33 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
208.34 Stopping Mininet - PASS

Case 209: Test switch failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - FAIL

209.1 Apply cell to environment - PASS
209.2 Uninstalling Atomix - PASS
209.3 Uninstalling ONOS package - PASS
209.4 Installing Atomix - PASS
209.5 Installing ONOS package - PASS
209.6 Set up ONOS secure SSH - PASS
209.7 Checking ONOS service - PASS
209.8 Starting ONOS CLI sessions - PASS
209.9 Checking ONOS nodes - PASS
209.10 Checking ONOS applications - PASS
209.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
209.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
209.13 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
209.14 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
209.15 Starting Mininet Topology - PASS
209.16 Verify host IP address assignment in ONOS - PASS
209.17 Verify IP address assignment from hosts - PASS
209.18 Verify reachability of connected internal IPv4 hosts - PASS
209.19 Verify reachability of connected internal IPv6 hosts - PASS
209.20 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
209.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
209.22 Kill ['spine101'] - PASS
209.23 Verify host IP address assignment in ONOS - PASS
209.24 Verify IP address assignment from hosts - PASS
209.25 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
209.26 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
209.27 Recovering ['spine101'] - FAIL

Failed to recover switch?

209.28 Verify host IP address assignment in ONOS - PASS
209.29 Verify IP address assignment from hosts - PASS
209.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
209.31 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
209.32 Kill ['spine102'] - FAIL

Failed to kill switch?

209.33 Verify host IP address assignment in ONOS - FAIL

Verify ONOS host IP failed

209.34 Stopping Mininet - PASS

Skipping the rest of this case.

Case 301: Test onos failures with IPv4 hosts - FAIL

301.1 Apply cell to environment - PASS
301.2 Uninstalling Atomix - PASS
301.3 Uninstalling ONOS package - PASS
301.4 Installing Atomix - PASS
301.5 Installing ONOS package - PASS
301.6 Set up ONOS secure SSH - PASS
301.7 Checking ONOS service - PASS
301.8 Starting ONOS CLI sessions - PASS
301.9 Checking ONOS nodes - PASS
301.10 Checking ONOS applications - PASS
301.11 Starting Mininet Topology - PASS
301.12 Verify host IP address assignment in ONOS - PASS
301.13 Verify IP address assignment from hosts - PASS
301.14 Verify reachability of connected internal IPv4 hosts - FAIL

Verify reachability of connected internal IPv4 hosts: Fail

301.15 Stopping Mininet - PASS

Skipping the rest of this case.

Case 302: Test onos failures with IPv6 hosts - PASS

302.1 Apply cell to environment - PASS
302.2 Uninstalling Atomix - PASS
302.3 Uninstalling ONOS package - PASS
302.4 Installing Atomix - PASS
302.5 Installing ONOS package - PASS
302.6 Set up ONOS secure SSH - PASS
302.7 Checking ONOS service - PASS
302.8 Starting ONOS CLI sessions - PASS
302.9 Checking ONOS nodes - PASS
302.10 Checking ONOS applications - PASS
302.11 Starting Mininet Topology - PASS
302.12 Verify host IP address assignment in ONOS - PASS
302.13 Verify IP address assignment from hosts - PASS
302.14 Verify reachability of connected internal IPv6 hosts - PASS
302.15 Killing ONOS instances with index(es): [0] - PASS
302.16 Check number of topology elements - PASS
302.17 Verify host IP address assignment in ONOS - PASS
302.18 Verify IP address assignment from hosts - PASS
302.19 Verify reachability of connected internal IPv6 hosts - PASS
302.20 Recovering ONOS instances with index(es): [0] - PASS
302.21 Checking if ONOS CLI is ready - PASS
302.22 Checking ONOS nodes - PASS
302.23 Check number of topology elements - PASS
302.24 Verify host IP address assignment in ONOS - PASS
302.25 Verify IP address assignment from hosts - PASS
302.26 Verify reachability of connected internal IPv6 hosts - PASS
302.27 Killing ONOS instances with index(es): [1] - PASS
302.28 Check number of topology elements - PASS
302.29 Verify host IP address assignment in ONOS - PASS
302.30 Verify IP address assignment from hosts - PASS
302.31 Verify reachability of connected internal IPv6 hosts - PASS
302.32 Recovering ONOS instances with index(es): [1] - PASS
302.33 Checking if ONOS CLI is ready - PASS
302.34 Checking ONOS nodes - PASS
302.35 Check number of topology elements - PASS
302.36 Verify host IP address assignment in ONOS - PASS
302.37 Verify IP address assignment from hosts - PASS
302.38 Verify reachability of connected internal IPv6 hosts - PASS
302.39 Killing ONOS instances with index(es): [2] - PASS
302.40 Check number of topology elements - PASS
302.41 Verify host IP address assignment in ONOS - PASS
302.42 Verify IP address assignment from hosts - PASS
302.43 Verify reachability of connected internal IPv6 hosts - PASS
302.44 Recovering ONOS instances with index(es): [2] - PASS
302.45 Checking if ONOS CLI is ready - PASS
302.46 Checking ONOS nodes - PASS
302.47 Check number of topology elements - PASS
302.48 Verify host IP address assignment in ONOS - PASS
302.49 Verify IP address assignment from hosts - PASS
302.50 Verify reachability of connected internal IPv6 hosts - PASS
302.51 Stopping Mininet - PASS

Case 303: Test onos failures with IPv4 and IPv6 hosts - PASS

303.1 Apply cell to environment - PASS
303.2 Uninstalling Atomix - PASS
303.3 Uninstalling ONOS package - PASS
303.4 Installing Atomix - PASS
303.5 Installing ONOS package - PASS
303.6 Set up ONOS secure SSH - PASS
303.7 Checking ONOS service - PASS
303.8 Starting ONOS CLI sessions - PASS
303.9 Checking ONOS nodes - PASS
303.10 Checking ONOS applications - PASS
303.11 Starting Mininet Topology - PASS
303.12 Verify host IP address assignment in ONOS - PASS
303.13 Verify IP address assignment from hosts - PASS
303.14 Verify reachability of connected internal IPv4 hosts - PASS
303.15 Verify reachability of connected internal IPv6 hosts - PASS
303.16 Killing ONOS instances with index(es): [0] - PASS
303.17 Check number of topology elements - PASS
303.18 Verify host IP address assignment in ONOS - PASS
303.19 Verify IP address assignment from hosts - PASS
303.20 Verify reachability of connected internal IPv4 hosts - PASS
303.21 Verify reachability of connected internal IPv6 hosts - PASS
303.22 Recovering ONOS instances with index(es): [0] - PASS
303.23 Checking if ONOS CLI is ready - PASS
303.24 Checking ONOS nodes - PASS
303.25 Check number of topology elements - PASS
303.26 Verify host IP address assignment in ONOS - PASS
303.27 Verify IP address assignment from hosts - PASS
303.28 Verify reachability of connected internal IPv4 hosts - PASS
303.29 Verify reachability of connected internal IPv6 hosts - PASS
303.30 Killing ONOS instances with index(es): [1] - PASS
303.31 Check number of topology elements - PASS
303.32 Verify host IP address assignment in ONOS - PASS
303.33 Verify IP address assignment from hosts - PASS
303.34 Verify reachability of connected internal IPv4 hosts - PASS
303.35 Verify reachability of connected internal IPv6 hosts - PASS
303.36 Recovering ONOS instances with index(es): [1] - PASS
303.37 Checking if ONOS CLI is ready - PASS
303.38 Checking ONOS nodes - PASS
303.39 Check number of topology elements - PASS
303.40 Verify host IP address assignment in ONOS - PASS
303.41 Verify IP address assignment from hosts - PASS
303.42 Verify reachability of connected internal IPv4 hosts - PASS
303.43 Verify reachability of connected internal IPv6 hosts - PASS
303.44 Killing ONOS instances with index(es): [2] - PASS
303.45 Check number of topology elements - PASS
303.46 Verify host IP address assignment in ONOS - PASS
303.47 Verify IP address assignment from hosts - PASS
303.48 Verify reachability of connected internal IPv4 hosts - PASS
303.49 Verify reachability of connected internal IPv6 hosts - PASS
303.50 Recovering ONOS instances with index(es): [2] - PASS
303.51 Checking if ONOS CLI is ready - PASS
303.52 Checking ONOS nodes - PASS
303.53 Check number of topology elements - PASS
303.54 Verify host IP address assignment in ONOS - PASS
303.55 Verify IP address assignment from hosts - PASS
303.56 Verify reachability of connected internal IPv4 hosts - PASS
303.57 Verify reachability of connected internal IPv6 hosts - PASS
303.58 Stopping Mininet - PASS

Case 304: Test onos failures with IPv4 hosts including external hosts - PASS

304.1 Apply cell to environment - PASS
304.2 Uninstalling Atomix - PASS
304.3 Uninstalling ONOS package - PASS
304.4 Installing Atomix - PASS
304.5 Installing ONOS package - PASS
304.6 Set up ONOS secure SSH - PASS
304.7 Checking ONOS service - PASS
304.8 Starting ONOS CLI sessions - PASS
304.9 Checking ONOS nodes - PASS
304.10 Checking ONOS applications - PASS
304.11 Starting Mininet Topology - PASS
304.12 Verify host IP address assignment in ONOS - PASS
304.13 Verify IP address assignment from hosts - PASS
304.14 Verify reachability of connected internal IPv4 hosts - PASS
304.15 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.16 Killing ONOS instances with index(es): [0] - PASS
304.17 Check number of topology elements - PASS
304.18 Verify host IP address assignment in ONOS - PASS
304.19 Verify IP address assignment from hosts - PASS
304.20 Verify reachability of connected internal IPv4 hosts - PASS
304.21 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.22 Recovering ONOS instances with index(es): [0] - PASS
304.23 Checking if ONOS CLI is ready - PASS
304.24 Checking ONOS nodes - PASS
304.25 Check number of topology elements - PASS
304.26 Verify host IP address assignment in ONOS - PASS
304.27 Verify IP address assignment from hosts - PASS
304.28 Verify reachability of connected internal IPv4 hosts - PASS
304.29 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.30 Killing ONOS instances with index(es): [1] - PASS
304.31 Check number of topology elements - PASS
304.32 Verify host IP address assignment in ONOS - PASS
304.33 Verify IP address assignment from hosts - PASS
304.34 Verify reachability of connected internal IPv4 hosts - PASS
304.35 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.36 Recovering ONOS instances with index(es): [1] - PASS
304.37 Checking if ONOS CLI is ready - PASS
304.38 Checking ONOS nodes - PASS
304.39 Check number of topology elements - PASS
304.40 Verify host IP address assignment in ONOS - PASS
304.41 Verify IP address assignment from hosts - PASS
304.42 Verify reachability of connected internal IPv4 hosts - PASS
304.43 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.44 Killing ONOS instances with index(es): [2] - PASS
304.45 Check number of topology elements - PASS
304.46 Verify host IP address assignment in ONOS - PASS
304.47 Verify IP address assignment from hosts - PASS
304.48 Verify reachability of connected internal IPv4 hosts - PASS
304.49 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.50 Recovering ONOS instances with index(es): [2] - PASS
304.51 Checking if ONOS CLI is ready - PASS
304.52 Checking ONOS nodes - PASS
304.53 Check number of topology elements - PASS
304.54 Verify host IP address assignment in ONOS - PASS
304.55 Verify IP address assignment from hosts - PASS
304.56 Verify reachability of connected internal IPv4 hosts - PASS
304.57 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
304.58 Stopping Mininet - PASS

Case 305: Test onos failures with IPv6 hosts including external hosts - PASS

305.1 Apply cell to environment - PASS
305.2 Uninstalling Atomix - PASS
305.3 Uninstalling ONOS package - PASS
305.4 Installing Atomix - PASS
305.5 Installing ONOS package - PASS
305.6 Set up ONOS secure SSH - PASS
305.7 Checking ONOS service - PASS
305.8 Starting ONOS CLI sessions - PASS
305.9 Checking ONOS nodes - PASS
305.10 Checking ONOS applications - PASS
305.11 Starting Mininet Topology - PASS
305.12 Verify host IP address assignment in ONOS - PASS
305.13 Verify IP address assignment from hosts - PASS
305.14 Verify reachability of connected internal IPv6 hosts - PASS
305.15 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.16 Killing ONOS instances with index(es): [0] - PASS
305.17 Check number of topology elements - PASS
305.18 Verify host IP address assignment in ONOS - PASS
305.19 Verify IP address assignment from hosts - PASS
305.20 Verify reachability of connected internal IPv6 hosts - PASS
305.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.22 Recovering ONOS instances with index(es): [0] - PASS
305.23 Checking if ONOS CLI is ready - PASS
305.24 Checking ONOS nodes - PASS
305.25 Check number of topology elements - PASS
305.26 Verify host IP address assignment in ONOS - PASS
305.27 Verify IP address assignment from hosts - PASS
305.28 Verify reachability of connected internal IPv6 hosts - PASS
305.29 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.30 Killing ONOS instances with index(es): [1] - PASS
305.31 Check number of topology elements - PASS
305.32 Verify host IP address assignment in ONOS - PASS
305.33 Verify IP address assignment from hosts - PASS
305.34 Verify reachability of connected internal IPv6 hosts - PASS
305.35 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.36 Recovering ONOS instances with index(es): [1] - PASS
305.37 Checking if ONOS CLI is ready - PASS
305.38 Checking ONOS nodes - PASS
305.39 Check number of topology elements - PASS
305.40 Verify host IP address assignment in ONOS - PASS
305.41 Verify IP address assignment from hosts - PASS
305.42 Verify reachability of connected internal IPv6 hosts - PASS
305.43 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.44 Killing ONOS instances with index(es): [2] - PASS
305.45 Check number of topology elements - PASS
305.46 Verify host IP address assignment in ONOS - PASS
305.47 Verify IP address assignment from hosts - PASS
305.48 Verify reachability of connected internal IPv6 hosts - PASS
305.49 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.50 Recovering ONOS instances with index(es): [2] - PASS
305.51 Checking if ONOS CLI is ready - PASS
305.52 Checking ONOS nodes - PASS
305.53 Check number of topology elements - PASS
305.54 Verify host IP address assignment in ONOS - PASS
305.55 Verify IP address assignment from hosts - PASS
305.56 Verify reachability of connected internal IPv6 hosts - PASS
305.57 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
305.58 Stopping Mininet - PASS

Case 306: Test onos failures with IPv4 and IPv6 hosts including external hosts - PASS

306.1 Apply cell to environment - PASS
306.2 Uninstalling Atomix - PASS
306.3 Uninstalling ONOS package - PASS
306.4 Installing Atomix - PASS
306.5 Installing ONOS package - PASS
306.6 Set up ONOS secure SSH - PASS
306.7 Checking ONOS service - PASS
306.8 Starting ONOS CLI sessions - PASS
306.9 Checking ONOS nodes - PASS
306.10 Checking ONOS applications - PASS
306.11 Starting Mininet Topology - PASS
306.12 Verify host IP address assignment in ONOS - PASS
306.13 Verify IP address assignment from hosts - PASS
306.14 Verify reachability of connected internal IPv4 hosts - PASS
306.15 Verify reachability of connected internal IPv6 hosts - PASS
306.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.18 Killing ONOS instances with index(es): [0] - PASS
306.19 Check number of topology elements - PASS
306.20 Verify host IP address assignment in ONOS - PASS
306.21 Verify IP address assignment from hosts - PASS
306.22 Verify reachability of connected internal IPv4 hosts - PASS
306.23 Verify reachability of connected internal IPv6 hosts - PASS
306.24 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.25 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.26 Recovering ONOS instances with index(es): [0] - PASS
306.27 Checking if ONOS CLI is ready - PASS
306.28 Checking ONOS nodes - PASS
306.29 Check number of topology elements - PASS
306.30 Verify host IP address assignment in ONOS - PASS
306.31 Verify IP address assignment from hosts - PASS
306.32 Verify reachability of connected internal IPv4 hosts - PASS
306.33 Verify reachability of connected internal IPv6 hosts - PASS
306.34 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.35 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.36 Killing ONOS instances with index(es): [1] - PASS
306.37 Check number of topology elements - PASS
306.38 Verify host IP address assignment in ONOS - PASS
306.39 Verify IP address assignment from hosts - PASS
306.40 Verify reachability of connected internal IPv4 hosts - PASS
306.41 Verify reachability of connected internal IPv6 hosts - PASS
306.42 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.43 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.44 Recovering ONOS instances with index(es): [1] - PASS
306.45 Checking if ONOS CLI is ready - PASS
306.46 Checking ONOS nodes - PASS
306.47 Check number of topology elements - PASS
306.48 Verify host IP address assignment in ONOS - PASS
306.49 Verify IP address assignment from hosts - PASS
306.50 Verify reachability of connected internal IPv4 hosts - PASS
306.51 Verify reachability of connected internal IPv6 hosts - PASS
306.52 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.53 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.54 Killing ONOS instances with index(es): [2] - PASS
306.55 Check number of topology elements - PASS
306.56 Verify host IP address assignment in ONOS - PASS
306.57 Verify IP address assignment from hosts - PASS
306.58 Verify reachability of connected internal IPv4 hosts - PASS
306.59 Verify reachability of connected internal IPv6 hosts - PASS
306.60 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.61 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.62 Recovering ONOS instances with index(es): [2] - PASS
306.63 Checking if ONOS CLI is ready - PASS
306.64 Checking ONOS nodes - PASS
306.65 Check number of topology elements - PASS
306.66 Verify host IP address assignment in ONOS - PASS
306.67 Verify IP address assignment from hosts - PASS
306.68 Verify reachability of connected internal IPv4 hosts - PASS
306.69 Verify reachability of connected internal IPv6 hosts - PASS
306.70 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
306.71 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
306.72 Stopping Mininet - PASS

Case 307: Test onos failures with IPv4 hosts including external hosts configured with route-add command - PASS

307.1 Apply cell to environment - PASS
307.2 Uninstalling Atomix - PASS
307.3 Uninstalling ONOS package - PASS
307.4 Installing Atomix - PASS
307.5 Installing ONOS package - PASS
307.6 Set up ONOS secure SSH - PASS
307.7 Checking ONOS service - PASS
307.8 Starting ONOS CLI sessions - PASS
307.9 Checking ONOS nodes - PASS
307.10 Checking ONOS applications - PASS
307.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
307.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
307.13 Starting Mininet Topology - PASS
307.14 Verify host IP address assignment in ONOS - PASS
307.15 Verify IP address assignment from hosts - PASS
307.16 Verify reachability of connected internal IPv4 hosts - PASS
307.17 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.18 Killing ONOS instances with index(es): [0] - PASS
307.19 Check number of topology elements - PASS
307.20 Verify host IP address assignment in ONOS - PASS
307.21 Verify IP address assignment from hosts - PASS
307.22 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.23 Recovering ONOS instances with index(es): [0] - PASS
307.24 Checking if ONOS CLI is ready - PASS
307.25 Checking ONOS nodes - PASS
307.26 Check number of topology elements - PASS
307.27 Verify host IP address assignment in ONOS - PASS
307.28 Verify IP address assignment from hosts - PASS
307.29 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.30 Killing ONOS instances with index(es): [1] - PASS
307.31 Check number of topology elements - PASS
307.32 Verify host IP address assignment in ONOS - PASS
307.33 Verify IP address assignment from hosts - PASS
307.34 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.35 Recovering ONOS instances with index(es): [1] - PASS
307.36 Checking if ONOS CLI is ready - PASS
307.37 Checking ONOS nodes - PASS
307.38 Check number of topology elements - PASS
307.39 Verify host IP address assignment in ONOS - PASS
307.40 Verify IP address assignment from hosts - PASS
307.41 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.42 Killing ONOS instances with index(es): [2] - PASS
307.43 Check number of topology elements - PASS
307.44 Verify host IP address assignment in ONOS - PASS
307.45 Verify IP address assignment from hosts - PASS
307.46 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.47 Recovering ONOS instances with index(es): [2] - PASS
307.48 Checking if ONOS CLI is ready - PASS
307.49 Checking ONOS nodes - PASS
307.50 Check number of topology elements - PASS
307.51 Verify host IP address assignment in ONOS - PASS
307.52 Verify IP address assignment from hosts - PASS
307.53 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
307.54 Stopping Mininet - PASS

Case 308: Test onos failures with IPv6 hosts including external hosts configured with route-add command - FAIL

308.1 Apply cell to environment - PASS
308.2 Uninstalling Atomix - PASS
308.3 Uninstalling ONOS package - PASS
308.4 Installing Atomix - PASS
308.5 Installing ONOS package - PASS
308.6 Set up ONOS secure SSH - PASS
308.7 Checking ONOS service - PASS
308.8 Starting ONOS CLI sessions - PASS
308.9 Checking ONOS nodes - PASS
308.10 Checking ONOS applications - PASS
308.11 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
308.12 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
308.13 Starting Mininet Topology - PASS
308.14 Verify host IP address assignment in ONOS - PASS
308.15 Verify IP address assignment from hosts - PASS
308.16 Verify reachability of connected internal IPv6 hosts - FAIL

Verify reachability of connected internal IPv6 hosts: Fail

308.17 Stopping Mininet - PASS

Skipping the rest of this case.

Case 309: Test onos failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - PASS

309.1 Apply cell to environment - PASS
309.2 Uninstalling Atomix - PASS
309.3 Uninstalling ONOS package - PASS
309.4 Installing Atomix - PASS
309.5 Installing ONOS package - PASS
309.6 Set up ONOS secure SSH - PASS
309.7 Checking ONOS service - PASS
309.8 Starting ONOS CLI sessions - PASS
309.9 Checking ONOS nodes - PASS
309.10 Checking ONOS applications - PASS
309.11 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.1.1 - PASS
309.12 Add static route for subnet 10.0.88.0/24 towards router interface 10.0.5.1 - PASS
309.13 Add static route for subnet 2000::8700/120 towards router interface 2000::101 - PASS
309.14 Add static route for subnet 2000::8700/120 towards router interface 2000::501 - PASS
309.15 Starting Mininet Topology - PASS
309.16 Verify host IP address assignment in ONOS - PASS
309.17 Verify IP address assignment from hosts - PASS
309.18 Verify reachability of connected internal IPv4 hosts - PASS
309.19 Verify reachability of connected internal IPv6 hosts - PASS
309.20 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.21 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.22 Killing ONOS instances with index(es): [0] - PASS
309.23 Check number of topology elements - PASS
309.24 Verify host IP address assignment in ONOS - PASS
309.25 Verify IP address assignment from hosts - PASS
309.26 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.27 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.28 Recovering ONOS instances with index(es): [0] - PASS
309.29 Checking if ONOS CLI is ready - PASS
309.30 Checking ONOS nodes - PASS
309.31 Check number of topology elements - PASS
309.32 Verify host IP address assignment in ONOS - PASS
309.33 Verify IP address assignment from hosts - PASS
309.34 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.35 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.36 Killing ONOS instances with index(es): [1] - PASS
309.37 Check number of topology elements - PASS
309.38 Verify host IP address assignment in ONOS - PASS
309.39 Verify IP address assignment from hosts - PASS
309.40 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.41 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.42 Recovering ONOS instances with index(es): [1] - PASS
309.43 Checking if ONOS CLI is ready - PASS
309.44 Checking ONOS nodes - PASS
309.45 Check number of topology elements - PASS
309.46 Verify host IP address assignment in ONOS - PASS
309.47 Verify IP address assignment from hosts - PASS
309.48 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.49 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.50 Killing ONOS instances with index(es): [2] - PASS
309.51 Check number of topology elements - PASS
309.52 Verify host IP address assignment in ONOS - PASS
309.53 Verify IP address assignment from hosts - PASS
309.54 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.55 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.56 Recovering ONOS instances with index(es): [2] - PASS
309.57 Checking if ONOS CLI is ready - PASS
309.58 Checking ONOS nodes - PASS
309.59 Check number of topology elements - PASS
309.60 Verify host IP address assignment in ONOS - PASS
309.61 Verify IP address assignment from hosts - PASS
309.62 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
309.63 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
309.64 Stopping Mininet - PASS

Case 601: Bring down all switches then recover - FAIL

601.1 Apply cell to environment - PASS
601.2 Uninstalling Atomix - PASS
601.3 Uninstalling ONOS package - PASS
601.4 Installing Atomix - PASS
601.5 Installing ONOS package - PASS
601.6 Set up ONOS secure SSH - PASS
601.7 Checking ONOS service - PASS
601.8 Starting ONOS CLI sessions - PASS
601.9 Checking ONOS nodes - PASS
601.10 Checking ONOS applications - PASS
601.11 Starting Mininet Topology - PASS
601.12 Verify host IP address assignment in ONOS - PASS
601.13 Verify IP address assignment from hosts - PASS
601.14 Verify reachability of connected internal IPv4 hosts - PASS
601.15 Verify reachability of connected internal IPv6 hosts - PASS
601.16 Stopping switches - iteration 1 - PASS
601.17 Check number of topology elements - PASS
601.18 Starting switches - iteration 1 - PASS
601.19 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers

601.20 Verify reachability of connected internal IPv4 hosts - FAIL

Verify reachability of connected internal IPv4 hosts: Fail

601.21 Stopping Mininet - PASS

Skipping the rest of this case.

Case 602: Drop a leaf switch that is paired and has a dual homed host. - PASS

602.1 Apply cell to environment - PASS
602.2 Uninstalling Atomix - PASS
602.3 Uninstalling ONOS package - PASS
602.4 Installing Atomix - PASS
602.5 Installing ONOS package - PASS
602.6 Set up ONOS secure SSH - PASS
602.7 Checking ONOS service - PASS
602.8 Starting ONOS CLI sessions - PASS
602.9 Checking ONOS nodes - PASS
602.10 Checking ONOS applications - PASS
602.11 Starting Mininet Topology - PASS
602.12 Verify host IP address assignment in ONOS - PASS
602.13 Verify IP address assignment from hosts - PASS
602.14 Verify reachability of connected internal IPv4 hosts - PASS
602.15 Verify reachability of connected internal IPv6 hosts - PASS
602.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
602.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
602.18 Disable a batch of ports - PASS
602.19 Kill ['leaf2'] - PASS
602.20 Verify locations of hosts ['h5v6', 'h5v4', 'h4v6', 'h4v4'] - PASS
602.21 Verify host IP address assignment in ONOS - PASS
602.22 Verify IP address assignment from hosts - PASS
602.23 Verify reachability of connected internal IPv4 hosts - PASS
602.24 Verify reachability of connected internal IPv6 hosts - PASS
602.25 Verify unreachability of disconnected internal IPv4 hosts - PASS
602.26 Verify unreachability of disconnected internal IPv6 hosts - PASS
602.27 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
602.28 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
602.29 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
602.30 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
602.31 Recovering ['leaf2'] - PASS
602.32 Verify locations of hosts ['h5v6', 'h5v4', 'h4v6', 'h4v4'] - PASS
602.33 Verify host IP address assignment in ONOS - PASS
602.34 Verify IP address assignment from hosts - PASS
602.35 Verify reachability of connected internal IPv4 hosts - PASS
602.36 Verify reachability of connected internal IPv6 hosts - PASS
602.37 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
602.38 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
602.39 Disable a batch of ports - PASS
602.40 Kill ['leaf4'] - PASS
602.41 Verify locations of hosts ['h10v4', 'h9v6', 'h10v6', 'h9v4'] - PASS
602.42 Verify host IP address assignment in ONOS - PASS
602.43 Verify IP address assignment from hosts - PASS
602.44 Verify reachability of connected internal IPv4 hosts - PASS
602.45 Verify reachability of connected internal IPv6 hosts - PASS
602.46 Verify unreachability of disconnected internal IPv4 hosts - PASS
602.47 Verify unreachability of disconnected internal IPv6 hosts - PASS
602.48 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
602.49 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
602.50 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
602.51 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
602.52 Recovering ['leaf4'] - PASS
602.53 Verify locations of hosts ['h10v4', 'h9v6', 'h10v6', 'h9v4'] - PASS
602.54 Verify host IP address assignment in ONOS - PASS
602.55 Verify IP address assignment from hosts - PASS
602.56 Verify reachability of connected internal IPv4 hosts - PASS
602.57 Verify reachability of connected internal IPv6 hosts - PASS
602.58 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
602.59 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
602.60 Stopping Mininet - PASS

Case 603: Drop hagg spine switch along with dass leaf switch. - FAIL

603.1 Apply cell to environment - PASS
603.2 Uninstalling Atomix - PASS
603.3 Uninstalling ONOS package - PASS
603.4 Installing Atomix - PASS
603.5 Installing ONOS package - PASS
603.6 Set up ONOS secure SSH - PASS
603.7 Checking ONOS service - PASS
603.8 Starting ONOS CLI sessions - PASS
603.9 Checking ONOS nodes - PASS
603.10 Checking ONOS applications - PASS
603.11 Starting Mininet Topology - PASS
603.12 Verify host IP address assignment in ONOS - PASS
603.13 Verify IP address assignment from hosts - PASS
603.14 Verify reachability of connected internal IPv4 hosts - PASS
603.15 Verify reachability of connected internal IPv6 hosts - PASS
603.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
603.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
603.18 Kill ['spine103'] - PASS
603.19 Verify host IP address assignment in ONOS - PASS
603.20 Verify IP address assignment from hosts - PASS
603.21 Verify reachability of connected internal IPv4 hosts - PASS
603.22 Verify reachability of connected internal IPv6 hosts - PASS
603.23 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
603.24 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
603.25 Kill ['leaf6'] - PASS
603.26 Verify host IP address assignment in ONOS - PASS
603.27 Verify IP address assignment from hosts - PASS
603.28 Verify reachability of connected internal IPv4 hosts - PASS
603.29 Verify reachability of connected internal IPv6 hosts - PASS
603.30 Verify unreachability of disconnected internal IPv4 hosts - PASS
603.31 Verify unreachability of disconnected internal IPv6 hosts - PASS
603.32 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
603.33 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
603.34 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
603.35 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
603.36 Recovering ['leaf6'] - PASS
603.37 Verify host IP address assignment in ONOS - PASS
603.38 Verify IP address assignment from hosts - PASS
603.39 Verify reachability of connected internal IPv4 hosts - PASS
603.40 Verify reachability of connected internal IPv6 hosts - PASS
603.41 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
603.42 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
603.43 Recovering ['spine103'] - FAIL

Failed to recover switch?

603.44 Verify host IP address assignment in ONOS - PASS
603.45 Verify IP address assignment from hosts - PASS
603.46 Verify reachability of connected internal IPv4 hosts - PASS
603.47 Verify reachability of connected internal IPv6 hosts - PASS
603.48 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
603.49 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
603.50 Kill ['spine104'] - FAIL

Failed to kill switch?

603.51 Verify host IP address assignment in ONOS - PASS
603.52 Verify IP address assignment from hosts - PASS
603.53 Verify reachability of connected internal IPv4 hosts - FAIL

Verify reachability of connected internal IPv4 hosts: Fail

603.54 Stopping Mininet - PASS

Skipping the rest of this case.

Case 604: Drop hagg spine switches. - PASS

604.1 Apply cell to environment - PASS
604.2 Uninstalling Atomix - PASS
604.3 Uninstalling ONOS package - PASS
604.4 Installing Atomix - PASS
604.5 Installing ONOS package - PASS
604.6 Set up ONOS secure SSH - PASS
604.7 Checking ONOS service - PASS
604.8 Starting ONOS CLI sessions - PASS
604.9 Checking ONOS nodes - PASS
604.10 Checking ONOS applications - PASS
604.11 Starting Mininet Topology - PASS
604.12 Verify host IP address assignment in ONOS - PASS
604.13 Verify IP address assignment from hosts - PASS
604.14 Verify reachability of connected internal IPv4 hosts - PASS
604.15 Verify reachability of connected internal IPv6 hosts - PASS
604.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
604.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
604.18 Kill ['spine103'] - PASS
604.19 Verify host IP address assignment in ONOS - PASS
604.20 Verify IP address assignment from hosts - PASS
604.21 Verify reachability of connected internal IPv4 hosts - PASS
604.22 Verify reachability of connected internal IPv6 hosts - PASS
604.23 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
604.24 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
604.25 Recovering ['spine103'] - PASS
604.26 Verify host IP address assignment in ONOS - PASS
604.27 Verify IP address assignment from hosts - PASS
604.28 Verify reachability of connected internal IPv4 hosts - PASS
604.29 Verify reachability of connected internal IPv6 hosts - PASS
604.30 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
604.31 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
604.32 Kill ['spine104'] - PASS
604.33 Verify host IP address assignment in ONOS - PASS
604.34 Verify IP address assignment from hosts - PASS
604.35 Verify reachability of connected internal IPv4 hosts - PASS
604.36 Verify reachability of connected internal IPv6 hosts - PASS
604.37 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
604.38 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
604.39 Recovering ['spine104'] - PASS
604.40 Verify host IP address assignment in ONOS - PASS
604.41 Verify IP address assignment from hosts - PASS
604.42 Verify reachability of connected internal IPv4 hosts - PASS
604.43 Verify reachability of connected internal IPv6 hosts - PASS
604.44 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
604.45 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
604.46 Stopping Mininet - PASS

Case 605: Drop one hagg and all leafs in big fabric - FAIL

605.1 Apply cell to environment - PASS
605.2 Uninstalling Atomix - PASS
605.3 Uninstalling ONOS package - PASS
605.4 Installing Atomix - PASS
605.5 Installing ONOS package - PASS
605.6 Set up ONOS secure SSH - PASS
605.7 Checking ONOS service - PASS
605.8 Starting ONOS CLI sessions - PASS
605.9 Checking ONOS nodes - PASS
605.10 Checking ONOS applications - PASS
605.11 Starting Mininet Topology - PASS
605.12 Verify host IP address assignment in ONOS - PASS
605.13 Verify IP address assignment from hosts - PASS
605.14 Verify reachability of connected internal IPv4 hosts - PASS
605.15 Verify reachability of connected internal IPv6 hosts - FAIL

Verify reachability of connected internal IPv6 hosts: Fail

605.16 Stopping Mininet - PASS

Skipping the rest of this case.

Case 606: Drop spine and paired leaf - FAIL

606.1 Apply cell to environment - PASS
606.2 Uninstalling Atomix - PASS
606.3 Uninstalling ONOS package - PASS
606.4 Installing Atomix - PASS
606.5 Installing ONOS package - PASS
606.6 Set up ONOS secure SSH - PASS
606.7 Checking ONOS service - PASS
606.8 Starting ONOS CLI sessions - PASS
606.9 Checking ONOS nodes - PASS
606.10 Checking ONOS applications - PASS
606.11 Starting Mininet Topology - PASS
606.12 Verify host IP address assignment in ONOS - PASS
606.13 Verify IP address assignment from hosts - PASS
606.14 Verify reachability of connected internal IPv4 hosts - PASS
606.15 Verify reachability of connected internal IPv6 hosts - PASS
606.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.18 Kill ['spine101'] - PASS
606.19 Verify host IP address assignment in ONOS - PASS
606.20 Verify IP address assignment from hosts - PASS
606.21 Verify reachability of connected internal IPv4 hosts - PASS
606.22 Verify reachability of connected internal IPv6 hosts - PASS
606.23 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.24 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.25 Kill ['leaf2'] - PASS
606.26 Kill ['leaf3'] - PASS
606.27 Verify host IP address assignment in ONOS - PASS
606.28 Verify IP address assignment from hosts - PASS
606.29 Verify reachability of connected internal IPv4 hosts - PASS
606.30 Verify reachability of connected internal IPv6 hosts - PASS
606.31 Verify unreachability of disconnected internal IPv4 hosts - PASS
606.32 Verify unreachability of disconnected internal IPv6 hosts - PASS
606.33 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.34 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.35 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
606.36 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
606.37 Recovering ['spine101'] - PASS
606.38 Verify host IP address assignment in ONOS - PASS
606.39 Verify IP address assignment from hosts - PASS
606.40 Verify reachability of connected internal IPv4 hosts - PASS
606.41 Verify reachability of connected internal IPv6 hosts - PASS
606.42 Verify unreachability of disconnected internal IPv4 hosts - PASS
606.43 Verify unreachability of disconnected internal IPv6 hosts - PASS
606.44 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.45 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.46 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
606.47 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
606.48 Recovering ['leaf3'] - PASS
606.49 Recovering ['leaf2'] - FAIL

Failed to recover switch?

606.50 Verify host IP address assignment in ONOS - PASS
606.51 Verify IP address assignment from hosts - PASS
606.52 Verify reachability of connected internal IPv4 hosts - PASS
606.53 Verify reachability of connected internal IPv6 hosts - PASS
606.54 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.55 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.56 Kill ['spine102'] - FAIL

Failed to kill switch?

606.57 Verify host IP address assignment in ONOS - PASS
606.58 Verify IP address assignment from hosts - PASS
606.59 Verify reachability of connected internal IPv4 hosts - PASS
606.60 Verify reachability of connected internal IPv6 hosts - PASS
606.61 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
606.62 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
606.63 Kill ['leaf4'] - FAIL

Failed to kill switch?

606.64 Kill ['leaf5'] - FAIL

Failed to kill switch?

606.65 Verify host IP address assignment in ONOS - PASS
606.66 Verify IP address assignment from hosts - FAIL

Verify network host IP failed

606.67 Verify reachability of connected internal IPv4 hosts - FAIL

Verify reachability of connected internal IPv4 hosts: Fail

606.68 Stopping Mininet - PASS

Skipping the rest of this case.

Case 620: Take down one of double links towards the spine - PASS

620.1 Apply cell to environment - PASS
620.2 Uninstalling Atomix - PASS
620.3 Uninstalling ONOS package - PASS
620.4 Installing Atomix - PASS
620.5 Installing ONOS package - PASS
620.6 Set up ONOS secure SSH - PASS
620.7 Checking ONOS service - PASS
620.8 Starting ONOS CLI sessions - PASS
620.9 Checking ONOS nodes - PASS
620.10 Checking ONOS applications - PASS
620.11 Starting Mininet Topology - PASS
620.12 Verify host IP address assignment in ONOS - PASS
620.13 Verify IP address assignment from hosts - PASS
620.14 Verify reachability of connected internal IPv4 hosts - PASS
620.15 Verify reachability of connected internal IPv6 hosts - PASS
620.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
620.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
620.18 Checking if number of groups for subnets in device of:0000000000000002 is as expected. - PASS
620.19 Checking if number of groups for subnets in device of:0000000000000003 is as expected. - PASS
620.20 Checking if number of groups for subnets in device of:0000000000000004 is as expected. - PASS
620.21 Checking if number of groups for subnets in device of:0000000000000005 is as expected. - PASS
620.22 Disable a batch of ports - PASS
620.23 Checking if number of groups for subnets in device of:0000000000000002 is as expected. - PASS
620.24 Checking if number of groups for subnets in device of:0000000000000003 is as expected. - PASS
620.25 Checking if number of groups for subnets in device of:0000000000000004 is as expected. - PASS
620.26 Checking if number of groups for subnets in device of:0000000000000005 is as expected. - PASS
620.27 Verify host IP address assignment in ONOS - PASS
620.28 Verify IP address assignment from hosts - PASS
620.29 Verify reachability of connected internal IPv4 hosts - PASS
620.30 Verify reachability of connected internal IPv6 hosts - PASS
620.31 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
620.32 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
620.33 Enable a batch of ports - PASS
620.34 Checking if number of groups for subnets in device of:0000000000000002 is as expected. - PASS
620.35 Checking if number of groups for subnets in device of:0000000000000003 is as expected. - PASS
620.36 Checking if number of groups for subnets in device of:0000000000000004 is as expected. - PASS
620.37 Checking if number of groups for subnets in device of:0000000000000005 is as expected. - PASS
620.38 Verify host IP address assignment in ONOS - PASS
620.39 Verify IP address assignment from hosts - PASS
620.40 Verify reachability of connected internal IPv4 hosts - PASS
620.41 Verify reachability of connected internal IPv6 hosts - PASS
620.42 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
620.43 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
620.44 Stopping Mininet - PASS

Case 621: Remove all the links in the network and restore all Links - PASS

621.1 Apply cell to environment - PASS
621.2 Uninstalling Atomix - PASS
621.3 Uninstalling ONOS package - PASS
621.4 Installing Atomix - PASS
621.5 Installing ONOS package - PASS
621.6 Set up ONOS secure SSH - PASS
621.7 Checking ONOS service - PASS
621.8 Starting ONOS CLI sessions - PASS
621.9 Checking ONOS nodes - PASS
621.10 Checking ONOS applications - PASS
621.11 Starting Mininet Topology - PASS
621.12 Verify host IP address assignment in ONOS - PASS
621.13 Verify IP address assignment from hosts - PASS
621.14 Verify reachability of connected internal IPv4 hosts - PASS
621.15 Verify reachability of connected internal IPv6 hosts - PASS
621.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.18 Killing a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.19 Disable a batch of ports - No Result
621.20 Verify host IP address assignment in ONOS - PASS
621.21 Verify IP address assignment from hosts - PASS
621.22 Verify reachability of connected internal IPv4 hosts - PASS
621.23 Verify reachability of connected internal IPv6 hosts - PASS
621.24 Verify unreachability of disconnected internal IPv4 hosts - PASS
621.25 Verify unreachability of disconnected internal IPv6 hosts - PASS
621.26 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.27 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.28 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
621.29 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
621.30 Restoring a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.31 Enable a batch of ports - PASS
621.32 Verify host IP address assignment in ONOS - PASS
621.33 Verify IP address assignment from hosts - PASS
621.34 Verify reachability of connected internal IPv4 hosts - PASS
621.35 Verify reachability of connected internal IPv6 hosts - PASS
621.36 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.37 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.38 Killing a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.39 Disable a batch of ports - No Result
621.40 Verify host IP address assignment in ONOS - PASS
621.41 Verify IP address assignment from hosts - PASS
621.42 Verify reachability of connected internal IPv4 hosts - PASS
621.43 Verify reachability of connected internal IPv6 hosts - PASS
621.44 Verify unreachability of disconnected internal IPv4 hosts - PASS
621.45 Verify unreachability of disconnected internal IPv6 hosts - PASS
621.46 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.47 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.48 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
621.49 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
621.50 Restoring a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.51 Enable a batch of ports - PASS
621.52 Verify host IP address assignment in ONOS - PASS
621.53 Verify IP address assignment from hosts - PASS
621.54 Verify reachability of connected internal IPv4 hosts - PASS
621.55 Verify reachability of connected internal IPv6 hosts - PASS
621.56 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.57 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.58 Killing a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.59 Disable a batch of ports - No Result
621.60 Verify host IP address assignment in ONOS - PASS
621.61 Verify IP address assignment from hosts - PASS
621.62 Verify reachability of connected internal IPv4 hosts - PASS
621.63 Verify reachability of connected internal IPv6 hosts - PASS
621.64 Verify unreachability of disconnected internal IPv4 hosts - PASS
621.65 Verify unreachability of disconnected internal IPv6 hosts - PASS
621.66 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.67 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.68 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
621.69 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
621.70 Restoring a batch of links [['spine101', 'spine103'], ['spine102', 'spine104'], ['spine103', 'leaf6'], ['spine103', 'leaf1'], ['spine104', 'leaf6'], ['spine104', 'leaf1'], ['spine101', 'leaf2'], ['spine101', 'leaf3'], ['spine101', 'leaf4'], ['spine101', 'leaf5'], ['spine102', 'leaf2'], ['spine102', 'leaf3'], ['spine102', 'leaf4'], ['spine102', 'leaf5'], ['leaf2', 'leaf3'], ['leaf4', 'leaf5']] - PASS
621.71 Enable a batch of ports - PASS
621.72 Verify host IP address assignment in ONOS - PASS
621.73 Verify IP address assignment from hosts - PASS
621.74 Verify reachability of connected internal IPv4 hosts - PASS
621.75 Verify reachability of connected internal IPv6 hosts - PASS
621.76 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
621.77 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
621.78 Stopping Mininet - PASS

Case 622: Take down all uplinks from a paired leaf switch - PASS

622.1 Apply cell to environment - PASS
622.2 Uninstalling Atomix - PASS
622.3 Uninstalling ONOS package - PASS
622.4 Installing Atomix - PASS
622.5 Installing ONOS package - PASS
622.6 Set up ONOS secure SSH - PASS
622.7 Checking ONOS service - PASS
622.8 Starting ONOS CLI sessions - PASS
622.9 Checking ONOS nodes - PASS
622.10 Checking ONOS applications - PASS
622.11 Starting Mininet Topology - PASS
622.12 Verify host IP address assignment in ONOS - PASS
622.13 Verify IP address assignment from hosts - PASS
622.14 Verify reachability of connected internal IPv4 hosts - PASS
622.15 Verify reachability of connected internal IPv6 hosts - PASS
622.16 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
622.17 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
622.18 Verify locations of hosts ['h5v6', 'h5v4', 'h4v6', 'h4v4'] - PASS
622.19 Killing a batch of links [['spine101', 'leaf2'], ['spine102', 'leaf2']] - PASS
622.20 Verify host IP address assignment in ONOS - PASS
622.21 Verify IP address assignment from hosts - PASS
622.22 Verify reachability of connected internal IPv4 hosts - PASS
622.23 Verify reachability of connected internal IPv6 hosts - PASS
622.24 Verify unreachability of disconnected internal IPv4 hosts - PASS
622.25 Verify unreachability of disconnected internal IPv6 hosts - PASS
622.26 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
622.27 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
622.28 Verify unreachability of disconnected internal IPv4 hosts to connected external IPv4 hosts - PASS
622.29 Verify unreachability of disconnected internal IPv6 hosts to connected external IPv6 hosts - PASS
622.30 Verify locations of hosts ['h5v6', 'h5v4', 'h4v6', 'h4v4'] - PASS
622.31 Restoring a batch of links [['spine101', 'leaf2'], ['spine102', 'leaf2']] - PASS
622.32 Verify host IP address assignment in ONOS - PASS
622.33 Verify IP address assignment from hosts - PASS
622.34 Verify reachability of connected internal IPv4 hosts - PASS
622.35 Verify reachability of connected internal IPv6 hosts - PASS
622.36 Verify reachability from connected internal IPv4 hosts to external IPv4 hosts - PASS
622.37 Verify reachability from connected internal IPv6 hosts to external IPv6 hosts - PASS
622.38 Verify locations of hosts ['h5v6', 'h5v4', 'h4v6', 'h4v4'] - PASS
622.39 Stopping Mininet - PASS

Case 630: Bring an instance down and drop a device - PASS

630.1 Apply cell to environment - PASS
630.2 Uninstalling Atomix - PASS
630.3 Uninstalling ONOS package - PASS
630.4 Installing Atomix - PASS
630.5 Installing ONOS package - PASS
630.6 Set up ONOS secure SSH - PASS
630.7 Checking ONOS service - PASS
630.8 Starting ONOS CLI sessions - PASS
630.9 Checking ONOS nodes - PASS
630.10 Checking ONOS applications - PASS
630.11 Starting Mininet Topology - PASS
630.12 Killing ONOS instances with index(es): [0] - PASS
630.13 Check number of topology elements - PASS
630.14 Kill ['spine101'] - PASS
630.15 Recovering ONOS instances with index(es): [0] - PASS
630.16 Checking if ONOS CLI is ready - PASS
630.17 Checking ONOS nodes - PASS
630.18 Check number of topology elements - PASS
630.19 Stopping Mininet - PASS

Case 640: Drop an ONOS instance and switch(es) at the same time - FAIL

640A: Drop ONOS1 and switch(es) spine101 at the same time - No Result

640.2 Apply cell to environment - PASS
640.3 Uninstalling Atomix - PASS
640.4 Uninstalling ONOS package - PASS
640.5 Installing Atomix - PASS
640.6 Installing ONOS package - PASS
640.7 Set up ONOS secure SSH - PASS
640.8 Checking ONOS service - PASS
640.9 Starting ONOS CLI sessions - PASS
640.10 Checking ONOS nodes - PASS
640.11 Checking ONOS applications - PASS
640.12 Starting Mininet Topology - PASS
640.13 Verify host IP address assignment in ONOS - PASS
640.14 Verify IP address assignment from hosts - PASS
640.15 Verify reachability of connected internal IPv4 hosts - PASS
640.16 Verify reachability of connected internal IPv6 hosts - PASS
640.17 Kill ONOS1: 10.192.21.201 - PASS
640.18 Kill ['spine101'] - PASS
640.19 Check number of topology elements - PASS
640.20 Verify host IP address assignment in ONOS - PASS
640.21 Verify IP address assignment from hosts - PASS
640.22 Verify reachability of connected internal IPv4 hosts - FAIL

Verify reachability of connected internal IPv4 hosts: Fail

640.23 Stopping Mininet - PASS

Skipping the rest of this case.

Case 641: Drop an ONOS instance and recover switch(es) at the same time - FAIL

641A: Drop ONOS1 and recover switch(es) spine101 at the same time - No Result

641.2 Apply cell to environment - PASS
641.3 Uninstalling Atomix - PASS
641.4 Uninstalling ONOS package - PASS
641.5 Installing Atomix - PASS
641.6 Installing ONOS package - PASS
641.7 Set up ONOS secure SSH - PASS
641.8 Checking ONOS service - PASS
641.9 Starting ONOS CLI sessions - PASS
641.10 Checking ONOS nodes - PASS
641.11 Checking ONOS applications - PASS
641.12 Starting Mininet Topology - PASS
641.13 Verify host IP address assignment in ONOS - PASS
641.14 Verify IP address assignment from hosts - PASS
641.15 Verify reachability of connected internal IPv4 hosts - PASS
641.16 Verify reachability of connected internal IPv6 hosts - PASS
641.17 Kill ['spine101'] - PASS
641.18 Verify host IP address assignment in ONOS - PASS
641.19 Verify IP address assignment from hosts - PASS
641.20 Verify reachability of connected internal IPv4 hosts - PASS
641.21 Verify reachability of connected internal IPv6 hosts - PASS
641.22 Kill ONOS1: 10.192.21.201 - PASS
641.23 Recovering ['spine101'] - PASS
641.24 Check number of topology elements - PASS
641.25 Verify host IP address assignment in ONOS - PASS
641.26 Verify IP address assignment from hosts - PASS
641.27 Verify reachability of connected internal IPv4 hosts - PASS
641.28 Verify reachability of connected internal IPv6 hosts - PASS
641.29 Recovering ONOS instances with index(es): [0] - PASS
641.30 Checking if ONOS CLI is ready - PASS
641.31 Checking ONOS nodes - PASS
641.32 Check number of topology elements - PASS
641.33 Verify host IP address assignment in ONOS - PASS
641.34 Verify IP address assignment from hosts - PASS
641.35 Verify reachability of connected internal IPv4 hosts - PASS
641.36 Verify reachability of connected internal IPv6 hosts - PASS
641.37 Stopping Mininet - PASS

641B: Drop ONOS2 and recover switch(es) spine103 at the same time - No Result

641.39 Apply cell to environment - PASS
641.40 Uninstalling Atomix - PASS
641.41 Uninstalling ONOS package - PASS
641.42 Installing Atomix - PASS
641.43 Installing ONOS package - PASS
641.44 Set up ONOS secure SSH - PASS
641.45 Checking ONOS service - PASS
641.46 Starting ONOS CLI sessions - PASS
641.47 Checking ONOS nodes - PASS
641.48 Checking ONOS applications - PASS
641.49 Starting Mininet Topology - PASS
641.50 Verify host IP address assignment in ONOS - PASS
641.51 Verify IP address assignment from hosts - PASS
641.52 Verify reachability of connected internal IPv4 hosts - PASS
641.53 Verify reachability of connected internal IPv6 hosts - PASS
641.54 Kill ['spine103'] - PASS
641.55 Verify host IP address assignment in ONOS - PASS
641.56 Verify IP address assignment from hosts - PASS
641.57 Verify reachability of connected internal IPv4 hosts - PASS
641.58 Verify reachability of connected internal IPv6 hosts - PASS
641.59 Kill ONOS2: 10.192.21.202 - PASS
641.60 Recovering ['spine103'] - PASS
641.61 Check number of topology elements - PASS
641.62 Verify host IP address assignment in ONOS - PASS
641.63 Verify IP address assignment from hosts - PASS
641.64 Verify reachability of connected internal IPv4 hosts - PASS
641.65 Verify reachability of connected internal IPv6 hosts - PASS
641.66 Recovering ONOS instances with index(es): [1] - PASS
641.67 Checking if ONOS CLI is ready - PASS
641.68 Checking ONOS nodes - PASS
641.69 Check number of topology elements - PASS
641.70 Verify host IP address assignment in ONOS - PASS
641.71 Verify IP address assignment from hosts - PASS
641.72 Verify reachability of connected internal IPv4 hosts - PASS
641.73 Verify reachability of connected internal IPv6 hosts - PASS
641.74 Stopping Mininet - PASS

641C: Drop ONOS3 and recover switch(es) leaf2 at the same time - No Result

641.76 Apply cell to environment - PASS
641.77 Uninstalling Atomix - PASS
641.78 Uninstalling ONOS package - PASS
641.79 Installing Atomix - PASS
641.80 Installing ONOS package - PASS
641.81 Set up ONOS secure SSH - PASS
641.82 Checking ONOS service - PASS
641.83 Starting ONOS CLI sessions - PASS
641.84 Checking ONOS nodes - PASS
641.85 Checking ONOS applications - PASS
641.86 Starting Mininet Topology - PASS
641.87 Verify host IP address assignment in ONOS - PASS
641.88 Verify IP address assignment from hosts - PASS
641.89 Verify reachability of connected internal IPv4 hosts - PASS
641.90 Verify reachability of connected internal IPv6 hosts - PASS
641.91 Disable a batch of ports - PASS
641.92 Kill ['leaf2'] - PASS
641.93 Verify host IP address assignment in ONOS - PASS
641.94 Verify IP address assignment from hosts - PASS
641.95 Verify reachability of connected internal IPv4 hosts - PASS
641.96 Verify reachability of connected internal IPv6 hosts - PASS
641.97 Verify unreachability of disconnected internal IPv4 hosts - PASS
641.98 Verify unreachability of disconnected internal IPv6 hosts - PASS
641.99 Kill ONOS3: 10.192.21.203 - PASS
641.100 Recovering ['leaf2'] - FAIL

Failed to recover switch?

641.101 Check number of topology elements - PASS
641.102 Verify host IP address assignment in ONOS - FAIL

Verify ONOS host IP failed

641.103 Stopping Mininet - PASS

Skipping the rest of this case.

Case 101: Test link failures with IPv4 hosts - PASS

Case 102: Test link failures with IPv6 hosts - PASS

Case 103: Test link failures with IPv4 and IPv6 hosts - PASS

Case 104: Test link failures with IPv4 hosts including external hosts - PASS

Case 105: Test link failures with IPv6 hosts including external hosts - FAIL

Case 106: Test link failures with IPv4 and IPv6 hosts including external hosts - FAIL

Case 107: Test link failures with IPv4 hosts including external hosts configured with route-add command - PASS

Case 108: Test link failures with IPv6 hosts including external hosts configured with route-add command - PASS

Case 109: Test link failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - PASS

Case 201: Test switch failures with IPv4 hosts - FAIL

Case 202: Test switch failures with IPv6 hosts - FAIL

Case 203: Test switch failures with IPv4 and IPv6 hosts - PASS

Case 204: Test switch failures with IPv4 hosts including external hosts - PASS

Case 205: Test switch failures with IPv6 hosts including external hosts - PASS

Case 206: Test switch failures with IPv4 and IPv6 hosts including external hosts - PASS

Case 207: Test switch failures with IPv4 hosts including external hosts configured with route-add command - PASS

Case 208: Test switch failures with IPv6 hosts including external hosts configured with route-add command - PASS

Case 209: Test switch failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - FAIL

Case 301: Test onos failures with IPv4 hosts - FAIL

Case 302: Test onos failures with IPv6 hosts - PASS

Case 303: Test onos failures with IPv4 and IPv6 hosts - PASS

Case 304: Test onos failures with IPv4 hosts including external hosts - PASS

Case 305: Test onos failures with IPv6 hosts including external hosts - PASS

Case 306: Test onos failures with IPv4 and IPv6 hosts including external hosts - PASS

Case 307: Test onos failures with IPv4 hosts including external hosts configured with route-add command - PASS

Case 308: Test onos failures with IPv6 hosts including external hosts configured with route-add command - FAIL

Case 309: Test onos failures with IPv4 and IPv6 hosts including external hosts configured with route-add command - PASS

Case 601: Bring down all switches then recover - FAIL

Case 602: Drop a leaf switch that is paired and has a dual homed host. - PASS

Case 603: Drop hagg spine switch along with dass leaf switch. - FAIL

Case 604: Drop hagg spine switches. - PASS

Case 605: Drop one hagg and all leafs in big fabric - FAIL

Case 606: Drop spine and paired leaf - FAIL

Case 620: Take down one of double links towards the spine - PASS

Case 621: Remove all the links in the network and restore all Links - PASS

Case 622: Take down all uplinks from a paired leaf switch - PASS

Case 630: Bring an instance down and drop a device - PASS

Case 640: Drop an ONOS instance and switch(es) at the same time - FAIL

Case 641: Drop an ONOS instance and recover switch(es) at the same time - FAIL

Case 642: Drop ONOS instance and links at the same time - FAIL