View Source

SRBridging at 03 Apr 2021 08:52:50

<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric4/lastSuccessfulBuild/artifact/SRBridging-stratum_master_20-builds_graph.jpg", alt="SRBridging-stratum", style="width:525px;height:350px;border:0">

commit 2b4de873e4033b7973b399d25cb8828a73bc2e24 (HEAD -] master, origin/master, origin/HEAD)
Author: Thomas Vachuska [tom@opennetworking.org]
AuthorDate: Tue Mar 30 16:31:34 2021 -0700
Commit: Charles Chan [charles@opennetworking.org]
CommitDate: Fri Apr 2 07:12:47 2021 +0000

Added mechanism for apps to easily add their own custom link/node/host highlighting wihout having to create a new UI extensions

Case 5: Bridging test between two untagged hosts on vlan-untagged port, with single ToR, stratum switches and 3 ONOS instances - FAIL

5.1 Constructing test variables - PASS
5.2 Apply cell to environment - PASS
5.3 Uninstalling Atomix - PASS
5.4 Uninstalling ONOS package - PASS
5.5 Building ONOS Docker image - PASS
5.6 Create Cluster Config - PASS
5.7 Installing Atomix via docker containers - PASS
5.8 Installing ONOS via docker containers - PASS
5.9 Set up ONOS secure SSH - PASS
5.10 Starting ONOS CLI sessions - PASS
5.11 Checking ONOS nodes - PASS
5.12 Checking ONOS applications - PASS
5.13 Set logging levels - PASS
5.14 Set ONOS configurations - PASS
5.15 Starting Mininet Topology - PASS
5.16 Configure switches in ONOS - PASS
5.17 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

5.18 Check whether all flow status are ADDED - PASS
5.19 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

5.20 Check number of topology elements - PASS
5.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE5 - FAIL

IP connectivity failed

5.22 Stopping Mininet - PASS
5.23 Copying karaf logs - PASS

Case 6: Bridging test between two untagged hosts on vlan-untagged port, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

6.1 Apply cell to environment - PASS
6.2 Uninstalling Atomix - PASS
6.3 Uninstalling ONOS package - PASS
6.4 Create Cluster Config - PASS
6.5 Installing Atomix via docker containers - PASS
6.6 Installing ONOS via docker containers - PASS
6.7 Set up ONOS secure SSH - PASS
6.8 Starting ONOS CLI sessions - PASS
6.9 Checking ONOS nodes - PASS
6.10 Checking ONOS applications - PASS
6.11 Set logging levels - PASS
6.12 Set ONOS configurations - PASS
6.13 Starting Mininet Topology - PASS
6.14 Configure switches in ONOS - PASS
6.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

6.16 Check whether all flow status are ADDED - PASS
6.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

6.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

6.19 Check number of topology elements - PASS
6.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE6 - FAIL

IP connectivity failed

6.21 Stopping Mininet - PASS
6.22 Copying karaf logs - PASS

Case 7: Bridging test between two untagged hosts on vlan-untagged port, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

7.1 Apply cell to environment - PASS
7.2 Uninstalling Atomix - PASS
7.3 Uninstalling ONOS package - PASS
7.4 Create Cluster Config - PASS
7.5 Installing Atomix via docker containers - PASS
7.6 Installing ONOS via docker containers - PASS
7.7 Set up ONOS secure SSH - PASS
7.8 Starting ONOS CLI sessions - PASS
7.9 Checking ONOS nodes - PASS
7.10 Checking ONOS applications - PASS
7.11 Set logging levels - PASS
7.12 Set ONOS configurations - PASS
7.13 Starting Mininet Topology - PASS
7.14 Configure switches in ONOS - PASS
7.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

7.16 Check whether all flow status are ADDED - PASS
7.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

7.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

7.19 Check number of topology elements - PASS
7.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE7 - FAIL

IP connectivity failed

7.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE7 - FAIL

IP connectivity failed

7.22 Stopping Mininet - PASS
7.23 Copying karaf logs - PASS

Case 8: Bridging test between two untagged hosts on vlan-untagged port, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

8.1 Apply cell to environment - PASS
8.2 Uninstalling Atomix - PASS
8.3 Uninstalling ONOS package - PASS
8.4 Create Cluster Config - PASS
8.5 Installing Atomix via docker containers - PASS
8.6 Installing ONOS via docker containers - PASS
8.7 Set up ONOS secure SSH - PASS
8.8 Starting ONOS CLI sessions - PASS
8.9 Checking ONOS nodes - PASS
8.10 Checking ONOS applications - PASS
8.11 Set logging levels - PASS
8.12 Set ONOS configurations - PASS
8.13 Starting Mininet Topology - PASS
8.14 Configure switches in ONOS - PASS
8.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

8.16 Check whether all flow status are ADDED - PASS
8.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

8.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

8.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

8.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

8.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

8.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE8 - FAIL

IP connectivity failed

8.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE8 - FAIL

IP connectivity failed

8.24 Stopping Mininet - PASS
8.25 Copying karaf logs - PASS

Case 15: Bridging test between two tagged hosts, with single ToR, stratum switches and 3 ONOS instances - FAIL

15.1 Apply cell to environment - PASS
15.2 Uninstalling Atomix - PASS
15.3 Uninstalling ONOS package - PASS
15.4 Create Cluster Config - PASS
15.5 Installing Atomix via docker containers - PASS
15.6 Installing ONOS via docker containers - PASS
15.7 Set up ONOS secure SSH - PASS
15.8 Starting ONOS CLI sessions - PASS
15.9 Checking ONOS nodes - PASS
15.10 Checking ONOS applications - PASS
15.11 Set logging levels - PASS
15.12 Set ONOS configurations - PASS
15.13 Starting Mininet Topology - PASS
15.14 Configure switches in ONOS - PASS
15.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

15.16 Check whether all flow status are ADDED - PASS
15.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

15.18 Check number of topology elements - PASS
15.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE15 - FAIL

IP connectivity failed

15.20 Stopping Mininet - PASS
15.21 Copying karaf logs - PASS

Case 16: Bridging test between two tagged hosts, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

16.1 Apply cell to environment - PASS
16.2 Uninstalling Atomix - PASS
16.3 Uninstalling ONOS package - PASS
16.4 Create Cluster Config - PASS
16.5 Installing Atomix via docker containers - PASS
16.6 Installing ONOS via docker containers - PASS
16.7 Set up ONOS secure SSH - PASS
16.8 Starting ONOS CLI sessions - PASS
16.9 Checking ONOS nodes - PASS
16.10 Checking ONOS applications - PASS
16.11 Set logging levels - PASS
16.12 Set ONOS configurations - PASS
16.13 Starting Mininet Topology - PASS
16.14 Configure switches in ONOS - PASS
16.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

16.16 Check whether all flow status are ADDED - PASS
16.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

16.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

16.19 Check number of topology elements - PASS
16.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE16 - FAIL

IP connectivity failed

16.21 Stopping Mininet - PASS
16.22 Copying karaf logs - PASS

Case 17: Bridging test between two tagged hosts, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

17.1 Apply cell to environment - PASS
17.2 Uninstalling Atomix - PASS
17.3 Uninstalling ONOS package - PASS
17.4 Create Cluster Config - PASS
17.5 Installing Atomix via docker containers - PASS
17.6 Installing ONOS via docker containers - PASS
17.7 Set up ONOS secure SSH - PASS
17.8 Starting ONOS CLI sessions - PASS
17.9 Checking ONOS nodes - PASS
17.10 Checking ONOS applications - PASS
17.11 Set logging levels - PASS
17.12 Set ONOS configurations - PASS
17.13 Starting Mininet Topology - PASS
17.14 Configure switches in ONOS - PASS
17.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

17.16 Check whether all flow status are ADDED - PASS
17.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

17.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

17.19 Check number of topology elements - PASS
17.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE17 - FAIL

IP connectivity failed

17.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE17 - FAIL

IP connectivity failed

17.22 Stopping Mininet - PASS
17.23 Copying karaf logs - PASS

Case 18: Bridging test between two tagged hosts, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

18.1 Apply cell to environment - PASS
18.2 Uninstalling Atomix - PASS
18.3 Uninstalling ONOS package - PASS
18.4 Create Cluster Config - PASS
18.5 Installing Atomix via docker containers - PASS
18.6 Installing ONOS via docker containers - PASS
18.7 Set up ONOS secure SSH - PASS
18.8 Starting ONOS CLI sessions - PASS
18.9 Checking ONOS nodes - PASS
18.10 Checking ONOS applications - PASS
18.11 Set logging levels - PASS
18.12 Set ONOS configurations - PASS
18.13 Starting Mininet Topology - PASS
18.14 Configure switches in ONOS - PASS
18.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

18.16 Check whether all flow status are ADDED - PASS
18.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

18.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

18.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

18.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

18.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

18.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE18 - FAIL

IP connectivity failed

18.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE18 - FAIL

IP connectivity failed

18.24 Stopping Mininet - PASS
18.25 Copying karaf logs - PASS

Case 25: Bridging test between two untagged hosts on vlan-native port, with single ToR, stratum switches and 3 ONOS instances - FAIL

25.1 Apply cell to environment - PASS
25.2 Uninstalling Atomix - PASS
25.3 Uninstalling ONOS package - PASS
25.4 Create Cluster Config - PASS
25.5 Installing Atomix via docker containers - PASS
25.6 Installing ONOS via docker containers - PASS
25.7 Set up ONOS secure SSH - PASS
25.8 Starting ONOS CLI sessions - PASS
25.9 Checking ONOS nodes - PASS
25.10 Checking ONOS applications - PASS
25.11 Set logging levels - PASS
25.12 Set ONOS configurations - PASS
25.13 Starting Mininet Topology - PASS
25.14 Configure switches in ONOS - PASS
25.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

25.16 Check whether all flow status are ADDED - PASS
25.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

25.18 Check number of topology elements - PASS
25.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE25 - FAIL

IP connectivity failed

25.20 Stopping Mininet - PASS
25.21 Copying karaf logs - PASS

Case 26: Bridging test between two untagged hosts on vlan-native port, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

26.1 Apply cell to environment - PASS
26.2 Uninstalling Atomix - PASS
26.3 Uninstalling ONOS package - PASS
26.4 Create Cluster Config - PASS
26.5 Installing Atomix via docker containers - PASS
26.6 Installing ONOS via docker containers - PASS
26.7 Set up ONOS secure SSH - PASS
26.8 Starting ONOS CLI sessions - PASS
26.9 Checking ONOS nodes - PASS
26.10 Checking ONOS applications - PASS
26.11 Set logging levels - PASS
26.12 Set ONOS configurations - PASS
26.13 Starting Mininet Topology - PASS
26.14 Configure switches in ONOS - PASS
26.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

26.16 Check whether all flow status are ADDED - PASS
26.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

26.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

26.19 Check number of topology elements - PASS
26.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE26 - FAIL

IP connectivity failed

26.21 Stopping Mininet - PASS
26.22 Copying karaf logs - PASS

Case 27: Bridging test between two untagged hosts on vlan-native port, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

27.1 Apply cell to environment - PASS
27.2 Uninstalling Atomix - PASS
27.3 Uninstalling ONOS package - PASS
27.4 Create Cluster Config - PASS
27.5 Installing Atomix via docker containers - PASS
27.6 Installing ONOS via docker containers - PASS
27.7 Set up ONOS secure SSH - PASS
27.8 Starting ONOS CLI sessions - PASS
27.9 Checking ONOS nodes - PASS
27.10 Checking ONOS applications - PASS
27.11 Set logging levels - PASS
27.12 Set ONOS configurations - PASS
27.13 Starting Mininet Topology - PASS
27.14 Configure switches in ONOS - PASS
27.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

27.16 Check whether all flow status are ADDED - PASS
27.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

27.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

27.19 Check number of topology elements - PASS
27.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE27 - FAIL

IP connectivity failed

27.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE27 - FAIL

IP connectivity failed

27.22 Stopping Mininet - PASS
27.23 Copying karaf logs - PASS

Case 28: Bridging test between two untagged hosts on vlan-native port, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

28.1 Apply cell to environment - PASS
28.2 Uninstalling Atomix - PASS
28.3 Uninstalling ONOS package - PASS
28.4 Create Cluster Config - PASS
28.5 Installing Atomix via docker containers - PASS
28.6 Installing ONOS via docker containers - PASS
28.7 Set up ONOS secure SSH - PASS
28.8 Starting ONOS CLI sessions - PASS
28.9 Checking ONOS nodes - PASS
28.10 Checking ONOS applications - PASS
28.11 Set logging levels - PASS
28.12 Set ONOS configurations - PASS
28.13 Starting Mininet Topology - PASS
28.14 Configure switches in ONOS - PASS
28.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

28.16 Check whether all flow status are ADDED - PASS
28.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

28.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

28.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

28.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

28.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

28.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE28 - FAIL

IP connectivity failed

28.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE28 - FAIL

IP connectivity failed

28.24 Stopping Mininet - PASS
28.25 Copying karaf logs - PASS

Case 35: Bridging test between two untagged hosts, one on vlan-untagged port and the other on vlan-native port, with single ToR, stratum switches and 3 ONOS instances - FAIL

35.1 Apply cell to environment - PASS
35.2 Uninstalling Atomix - PASS
35.3 Uninstalling ONOS package - PASS
35.4 Create Cluster Config - PASS
35.5 Installing Atomix via docker containers - PASS
35.6 Installing ONOS via docker containers - PASS
35.7 Set up ONOS secure SSH - PASS
35.8 Starting ONOS CLI sessions - PASS
35.9 Checking ONOS nodes - PASS
35.10 Checking ONOS applications - PASS
35.11 Set logging levels - PASS
35.12 Set ONOS configurations - PASS
35.13 Starting Mininet Topology - PASS
35.14 Configure switches in ONOS - PASS
35.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

35.16 Check whether all flow status are ADDED - PASS
35.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

35.18 Check number of topology elements - PASS
35.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE35 - FAIL

IP connectivity failed

35.20 Stopping Mininet - PASS
35.21 Copying karaf logs - PASS

Case 36: Bridging test between two untagged hosts, one on vlan-untagged port and the other on vlan-native port, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

36.1 Apply cell to environment - PASS
36.2 Uninstalling Atomix - PASS
36.3 Uninstalling ONOS package - PASS
36.4 Create Cluster Config - PASS
36.5 Installing Atomix via docker containers - PASS
36.6 Installing ONOS via docker containers - PASS
36.7 Set up ONOS secure SSH - PASS
36.8 Starting ONOS CLI sessions - PASS
36.9 Checking ONOS nodes - PASS
36.10 Checking ONOS applications - PASS
36.11 Set logging levels - PASS
36.12 Set ONOS configurations - PASS
36.13 Starting Mininet Topology - PASS
36.14 Configure switches in ONOS - PASS
36.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

36.16 Check whether all flow status are ADDED - PASS
36.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

36.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

36.19 Check number of topology elements - PASS
36.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE36 - FAIL

IP connectivity failed

36.21 Stopping Mininet - PASS
36.22 Copying karaf logs - PASS

Case 37: Bridging test between two untagged hosts, one on vlan-untagged port and the other on vlan-native port, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

37.1 Apply cell to environment - PASS
37.2 Uninstalling Atomix - PASS
37.3 Uninstalling ONOS package - PASS
37.4 Create Cluster Config - PASS
37.5 Installing Atomix via docker containers - PASS
37.6 Installing ONOS via docker containers - PASS
37.7 Set up ONOS secure SSH - PASS
37.8 Starting ONOS CLI sessions - PASS
37.9 Checking ONOS nodes - PASS
37.10 Checking ONOS applications - PASS
37.11 Set logging levels - PASS
37.12 Set ONOS configurations - PASS
37.13 Starting Mininet Topology - PASS
37.14 Configure switches in ONOS - PASS
37.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

37.16 Check whether all flow status are ADDED - PASS
37.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

37.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

37.19 Check number of topology elements - PASS
37.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE37 - FAIL

IP connectivity failed

37.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE37 - FAIL

IP connectivity failed

37.22 Stopping Mininet - PASS
37.23 Copying karaf logs - PASS

Case 38: Bridging test between two untagged hosts, one on vlan-untagged port and the other on vlan-native port, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

38.1 Apply cell to environment - PASS
38.2 Uninstalling Atomix - PASS
38.3 Uninstalling ONOS package - PASS
38.4 Create Cluster Config - PASS
38.5 Installing Atomix via docker containers - PASS
38.6 Installing ONOS via docker containers - PASS
38.7 Set up ONOS secure SSH - PASS
38.8 Starting ONOS CLI sessions - PASS
38.9 Checking ONOS nodes - PASS
38.10 Checking ONOS applications - PASS
38.11 Set logging levels - PASS
38.12 Set ONOS configurations - PASS
38.13 Starting Mininet Topology - PASS
38.14 Configure switches in ONOS - PASS
38.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

38.16 Check whether all flow status are ADDED - PASS
38.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

38.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

38.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

38.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

38.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

38.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE38 - FAIL

IP connectivity failed

38.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE38 - FAIL

IP connectivity failed

38.24 Stopping Mininet - PASS
38.25 Copying karaf logs - PASS

Case 45: Bridging test between untagged host and tagged host, with single ToR, stratum switches and 3 ONOS instances - FAIL

45.1 Apply cell to environment - PASS
45.2 Uninstalling Atomix - PASS
45.3 Uninstalling ONOS package - PASS
45.4 Create Cluster Config - PASS
45.5 Installing Atomix via docker containers - PASS
45.6 Installing ONOS via docker containers - PASS
45.7 Set up ONOS secure SSH - PASS
45.8 Starting ONOS CLI sessions - PASS
45.9 Checking ONOS nodes - PASS
45.10 Checking ONOS applications - PASS
45.11 Set logging levels - PASS
45.12 Set ONOS configurations - PASS
45.13 Starting Mininet Topology - PASS
45.14 Configure switches in ONOS - PASS
45.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

45.16 Check whether all flow status are ADDED - PASS
45.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

45.18 Check number of topology elements - PASS
45.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE45 - FAIL

IP connectivity failed

45.20 Stopping Mininet - PASS
45.21 Copying karaf logs - PASS

Case 46: Bridging test between untagged host and tagged host, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

46.1 Apply cell to environment - PASS
46.2 Uninstalling Atomix - PASS
46.3 Uninstalling ONOS package - PASS
46.4 Create Cluster Config - PASS
46.5 Installing Atomix via docker containers - PASS
46.6 Installing ONOS via docker containers - PASS
46.7 Set up ONOS secure SSH - PASS
46.8 Starting ONOS CLI sessions - PASS
46.9 Checking ONOS nodes - PASS
46.10 Checking ONOS applications - PASS
46.11 Set logging levels - PASS
46.12 Set ONOS configurations - PASS
46.13 Starting Mininet Topology - PASS
46.14 Configure switches in ONOS - PASS
46.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

46.16 Check whether all flow status are ADDED - PASS
46.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

46.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

46.19 Check number of topology elements - PASS
46.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE46 - FAIL

IP connectivity failed

46.21 Stopping Mininet - PASS
46.22 Copying karaf logs - PASS

Case 47: Bridging test between untagged host and tagged host, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

47.1 Apply cell to environment - PASS
47.2 Uninstalling Atomix - PASS
47.3 Uninstalling ONOS package - PASS
47.4 Create Cluster Config - PASS
47.5 Installing Atomix via docker containers - PASS
47.6 Installing ONOS via docker containers - PASS
47.7 Set up ONOS secure SSH - PASS
47.8 Starting ONOS CLI sessions - PASS
47.9 Checking ONOS nodes - PASS
47.10 Checking ONOS applications - PASS
47.11 Set logging levels - PASS
47.12 Set ONOS configurations - PASS
47.13 Starting Mininet Topology - PASS
47.14 Configure switches in ONOS - PASS
47.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

47.16 Check whether all flow status are ADDED - PASS
47.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

47.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

47.19 Check number of topology elements - PASS
47.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE47 - FAIL

IP connectivity failed

47.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE47 - FAIL

IP connectivity failed

47.22 Stopping Mininet - PASS
47.23 Copying karaf logs - PASS

Case 48: Bridging test between untagged host and tagged host, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

48.1 Apply cell to environment - PASS
48.2 Uninstalling Atomix - PASS
48.3 Uninstalling ONOS package - PASS
48.4 Create Cluster Config - PASS
48.5 Installing Atomix via docker containers - PASS
48.6 Installing ONOS via docker containers - PASS
48.7 Set up ONOS secure SSH - PASS
48.8 Starting ONOS CLI sessions - PASS
48.9 Checking ONOS nodes - PASS
48.10 Checking ONOS applications - PASS
48.11 Set logging levels - PASS
48.12 Set ONOS configurations - PASS
48.13 Starting Mininet Topology - PASS
48.14 Configure switches in ONOS - PASS
48.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

48.16 Check whether all flow status are ADDED - PASS
48.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

48.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

48.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

48.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

48.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

48.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE48 - FAIL

IP connectivity failed

48.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE48 - FAIL

IP connectivity failed

48.24 Stopping Mininet - PASS
48.25 Copying karaf logs - PASS

Case 55: Bridging test between two untagged hosts with different vlan id, with single ToR, stratum switches and 3 ONOS instances - FAIL

55.1 Apply cell to environment - PASS
55.2 Uninstalling Atomix - PASS
55.3 Uninstalling ONOS package - PASS
55.4 Create Cluster Config - PASS
55.5 Installing Atomix via docker containers - PASS
55.6 Installing ONOS via docker containers - PASS
55.7 Set up ONOS secure SSH - PASS
55.8 Starting ONOS CLI sessions - PASS
55.9 Checking ONOS nodes - PASS
55.10 Checking ONOS applications - PASS
55.11 Set logging levels - PASS
55.12 Set ONOS configurations - PASS
55.13 Starting Mininet Topology - PASS
55.14 Configure switches in ONOS - PASS
55.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

55.16 Check whether all flow status are ADDED - PASS
55.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

55.18 Check number of topology elements - PASS
55.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE55 - PASS
55.20 Stopping Mininet - PASS
55.21 Copying karaf logs - PASS

Case 56: Bridging test between two untagged hosts with different vlan id, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

56.1 Apply cell to environment - PASS
56.2 Uninstalling Atomix - PASS
56.3 Uninstalling ONOS package - PASS
56.4 Create Cluster Config - PASS
56.5 Installing Atomix via docker containers - PASS
56.6 Installing ONOS via docker containers - PASS
56.7 Set up ONOS secure SSH - PASS
56.8 Starting ONOS CLI sessions - PASS
56.9 Checking ONOS nodes - PASS
56.10 Checking ONOS applications - PASS
56.11 Set logging levels - PASS
56.12 Set ONOS configurations - PASS
56.13 Starting Mininet Topology - PASS
56.14 Configure switches in ONOS - PASS
56.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

56.16 Check whether all flow status are ADDED - PASS
56.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

56.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

56.19 Check number of topology elements - PASS
56.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE56 - PASS
56.21 Stopping Mininet - PASS
56.22 Copying karaf logs - PASS

Case 57: Bridging test between two untagged hosts with different vlan id, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

57.1 Apply cell to environment - PASS
57.2 Uninstalling Atomix - PASS
57.3 Uninstalling ONOS package - PASS
57.4 Create Cluster Config - PASS
57.5 Installing Atomix via docker containers - PASS
57.6 Installing ONOS via docker containers - PASS
57.7 Set up ONOS secure SSH - PASS
57.8 Starting ONOS CLI sessions - PASS
57.9 Checking ONOS nodes - PASS
57.10 Checking ONOS applications - PASS
57.11 Set logging levels - PASS
57.12 Set ONOS configurations - PASS
57.13 Starting Mininet Topology - PASS
57.14 Configure switches in ONOS - PASS
57.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

57.16 Check whether all flow status are ADDED - PASS
57.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

57.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

57.19 Check number of topology elements - PASS
57.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE57 - PASS
57.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE57 - PASS
57.22 Stopping Mininet - PASS
57.23 Copying karaf logs - PASS

Case 58: Bridging test between two untagged hosts with different vlan id, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

58.1 Apply cell to environment - PASS
58.2 Uninstalling Atomix - PASS
58.3 Uninstalling ONOS package - PASS
58.4 Create Cluster Config - PASS
58.5 Installing Atomix via docker containers - PASS
58.6 Installing ONOS via docker containers - PASS
58.7 Set up ONOS secure SSH - PASS
58.8 Starting ONOS CLI sessions - PASS
58.9 Checking ONOS nodes - PASS
58.10 Checking ONOS applications - PASS
58.11 Set logging levels - PASS
58.12 Set ONOS configurations - PASS
58.13 Starting Mininet Topology - PASS
58.14 Configure switches in ONOS - PASS
58.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

58.16 Check whether all flow status are ADDED - PASS
58.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

58.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

58.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

58.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

58.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

58.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE58 - PASS
58.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE58 - PASS
58.24 Stopping Mininet - PASS
58.25 Copying karaf logs - PASS

Case 65: Bridging test between two tagged hosts with different vlan id, with single ToR, stratum switches and 3 ONOS instances - FAIL

65.1 Apply cell to environment - PASS
65.2 Uninstalling Atomix - PASS
65.3 Uninstalling ONOS package - PASS
65.4 Create Cluster Config - PASS
65.5 Installing Atomix via docker containers - PASS
65.6 Installing ONOS via docker containers - PASS
65.7 Set up ONOS secure SSH - PASS
65.8 Starting ONOS CLI sessions - PASS
65.9 Checking ONOS nodes - PASS
65.10 Checking ONOS applications - PASS
65.11 Set logging levels - PASS
65.12 Set ONOS configurations - PASS
65.13 Starting Mininet Topology - PASS
65.14 Configure switches in ONOS - PASS
65.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

65.16 Check whether all flow status are ADDED - PASS
65.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

65.18 Check number of topology elements - PASS
65.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE65 - PASS
65.20 Stopping Mininet - PASS
65.21 Copying karaf logs - PASS

Case 66: Bridging test between two tagged hosts with different vlan id, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

66.1 Apply cell to environment - PASS
66.2 Uninstalling Atomix - PASS
66.3 Uninstalling ONOS package - PASS
66.4 Create Cluster Config - PASS
66.5 Installing Atomix via docker containers - PASS
66.6 Installing ONOS via docker containers - PASS
66.7 Set up ONOS secure SSH - PASS
66.8 Starting ONOS CLI sessions - PASS
66.9 Checking ONOS nodes - PASS
66.10 Checking ONOS applications - PASS
66.11 Set logging levels - PASS
66.12 Set ONOS configurations - PASS
66.13 Starting Mininet Topology - PASS
66.14 Configure switches in ONOS - PASS
66.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

66.16 Check whether all flow status are ADDED - PASS
66.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

66.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

66.19 Check number of topology elements - PASS
66.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE66 - PASS
66.21 Stopping Mininet - PASS
66.22 Copying karaf logs - PASS

Case 67: Bridging test between two tagged hosts with different vlan id, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

67.1 Apply cell to environment - PASS
67.2 Uninstalling Atomix - PASS
67.3 Uninstalling ONOS package - PASS
67.4 Create Cluster Config - PASS
67.5 Installing Atomix via docker containers - PASS
67.6 Installing ONOS via docker containers - PASS
67.7 Set up ONOS secure SSH - PASS
67.8 Starting ONOS CLI sessions - PASS
67.9 Checking ONOS nodes - PASS
67.10 Checking ONOS applications - PASS
67.11 Set logging levels - PASS
67.12 Set ONOS configurations - PASS
67.13 Starting Mininet Topology - PASS
67.14 Configure switches in ONOS - PASS
67.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

67.16 Check whether all flow status are ADDED - PASS
67.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

67.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

67.19 Check number of topology elements - PASS
67.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE67 - PASS
67.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE67 - PASS
67.22 Stopping Mininet - PASS
67.23 Copying karaf logs - PASS

Case 68: Bridging test between two tagged hosts with different vlan id, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

68.1 Apply cell to environment - PASS
68.2 Uninstalling Atomix - PASS
68.3 Uninstalling ONOS package - PASS
68.4 Create Cluster Config - PASS
68.5 Installing Atomix via docker containers - PASS
68.6 Installing ONOS via docker containers - PASS
68.7 Set up ONOS secure SSH - PASS
68.8 Starting ONOS CLI sessions - PASS
68.9 Checking ONOS nodes - PASS
68.10 Checking ONOS applications - PASS
68.11 Set logging levels - PASS
68.12 Set ONOS configurations - PASS
68.13 Starting Mininet Topology - PASS
68.14 Configure switches in ONOS - PASS
68.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

68.16 Check whether all flow status are ADDED - PASS
68.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

68.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

68.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

68.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

68.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

68.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE68 - PASS
68.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE68 - PASS
68.24 Stopping Mininet - PASS
68.25 Copying karaf logs - PASS

Case 75: Bridging test between untagged and tagged hosts with different vlan id, with single ToR, stratum switches and 3 ONOS instances - FAIL

75.1 Apply cell to environment - PASS
75.2 Uninstalling Atomix - PASS
75.3 Uninstalling ONOS package - PASS
75.4 Create Cluster Config - PASS
75.5 Installing Atomix via docker containers - PASS
75.6 Installing ONOS via docker containers - PASS
75.7 Set up ONOS secure SSH - PASS
75.8 Starting ONOS CLI sessions - PASS
75.9 Checking ONOS nodes - PASS
75.10 Checking ONOS applications - PASS
75.11 Set logging levels - PASS
75.12 Set ONOS configurations - PASS
75.13 Starting Mininet Topology - PASS
75.14 Configure switches in ONOS - PASS
75.15 Check whether the flow count is >= 20 - FAIL

Flow count looks wrong; found 3, expecting at least 20

75.16 Check whether all flow status are ADDED - PASS
75.17 Check whether the flow count of device device:leaf1 >= than 20 - FAIL

Flow count looks wrong: 3

75.18 Check number of topology elements - PASS
75.19 Verify full connectivity for [u'h1', u'h2'] with tag CASE75 - PASS
75.20 Stopping Mininet - PASS
75.21 Copying karaf logs - PASS

Case 76: Bridging test between untagged and tagged hosts with different vlan id, with dual-homed ToR, stratum switches and 3 ONOS instances - FAIL

76.1 Apply cell to environment - PASS
76.2 Uninstalling Atomix - PASS
76.3 Uninstalling ONOS package - PASS
76.4 Create Cluster Config - PASS
76.5 Installing Atomix via docker containers - PASS
76.6 Installing ONOS via docker containers - PASS
76.7 Set up ONOS secure SSH - PASS
76.8 Starting ONOS CLI sessions - PASS
76.9 Checking ONOS nodes - PASS
76.10 Checking ONOS applications - PASS
76.11 Set logging levels - PASS
76.12 Set ONOS configurations - PASS
76.13 Starting Mininet Topology - PASS
76.14 Configure switches in ONOS - PASS
76.15 Check whether the flow count is >= 74 - FAIL

Flow count looks wrong; found 6, expecting at least 74

76.16 Check whether all flow status are ADDED - PASS
76.17 Check whether the flow count of device device:leaf1 >= than 37 - FAIL

Flow count looks wrong: 6

76.18 Check whether the flow count of device device:leaf2 >= than 37 - FAIL

Flow count looks wrong: 6

76.19 Check number of topology elements - PASS
76.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE76 - PASS
76.21 Stopping Mininet - PASS
76.22 Copying karaf logs - PASS

Case 77: Bridging test between untagged and tagged hosts with different vlan id, with 2x2 leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

77.1 Apply cell to environment - PASS
77.2 Uninstalling Atomix - PASS
77.3 Uninstalling ONOS package - PASS
77.4 Create Cluster Config - PASS
77.5 Installing Atomix via docker containers - PASS
77.6 Installing ONOS via docker containers - PASS
77.7 Set up ONOS secure SSH - PASS
77.8 Starting ONOS CLI sessions - PASS
77.9 Checking ONOS nodes - PASS
77.10 Checking ONOS applications - PASS
77.11 Set logging levels - PASS
77.12 Set ONOS configurations - PASS
77.13 Starting Mininet Topology - PASS
77.14 Configure switches in ONOS - PASS
77.15 Check whether the flow count is >= 64 - FAIL

Flow count looks wrong; found 12, expecting at least 64

77.16 Check whether all flow status are ADDED - PASS
77.17 Check whether the flow count of device device:leaf1 >= than 32 - FAIL

Flow count looks wrong: 12

77.18 Check whether the flow count of device device:leaf2 >= than 32 - FAIL

Flow count looks wrong: 12

77.19 Check number of topology elements - PASS
77.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE77 - PASS
77.21 Verify full connectivity for [u'h3', u'h4'] with tag CASE77 - PASS
77.22 Stopping Mininet - PASS
77.23 Copying karaf logs - PASS

Case 78: Bridging test between untagged and tagged hosts with different vlan id, with 2x4 dual-homed leaf-spine topology, stratum switches and 3 ONOS instances - FAIL

78.1 Apply cell to environment - PASS
78.2 Uninstalling Atomix - PASS
78.3 Uninstalling ONOS package - PASS
78.4 Create Cluster Config - PASS
78.5 Installing Atomix via docker containers - PASS
78.6 Installing ONOS via docker containers - PASS
78.7 Set up ONOS secure SSH - PASS
78.8 Starting ONOS CLI sessions - PASS
78.9 Checking ONOS nodes - PASS
78.10 Checking ONOS applications - PASS
78.11 Set logging levels - PASS
78.12 Set ONOS configurations - PASS
78.13 Starting Mininet Topology - PASS
78.14 Configure switches in ONOS - PASS
78.15 Check whether the flow count is >= 212 - FAIL

Flow count looks wrong; found 18, expecting at least 212

78.16 Check whether all flow status are ADDED - PASS
78.17 Check whether the flow count of device device:leaf1 >= than 53 - FAIL

Flow count looks wrong: 18

78.18 Check whether the flow count of device device:leaf2 >= than 53 - FAIL

Flow count looks wrong: 18

78.19 Check whether the flow count of device device:leaf3 >= than 53 - FAIL

Flow count looks wrong: 18

78.20 Check whether the flow count of device device:leaf4 >= than 53 - FAIL

Flow count looks wrong: 18

78.21 Check number of topology elements - FAIL

Unexpected number of links, switches, and/or controllers: The number of links, switches, nodes, and SCCs does not match what was expected
ONOS sees 6 devices (6 expected) and 36 links (38 expected) and 3 controllers (3 expected) and 1 SCCs (1 expected)

78.22 Verify full connectivity for [u'h1', u'h2'] with tag CASE78 - PASS
78.23 Verify full connectivity for [u'h3', u'h4'] with tag CASE78 - PASS
78.24 Stopping Mininet - PASS
78.25 Copying karaf logs - PASS