View Source

SRDynamicConf at 11 Apr 2018 10:35:50

<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric3/lastSuccessfulBuild/artifact/SRDynamicConf_onos-1.12_20-builds_graph.jpg", alt="SRDynamicConf", style="width:525px;height:350px;border:0">

commit 4bd2d9a345bc409aa59855e57362240bfdd0b812 (HEAD -] onos-1.12, origin/onos-1.12)
Author: jaegonkim [jaegon77.kim@samsung.com]
AuthorDate: Sun Apr 1 16:36:36 2018 +0900
Commit: Thomas Vachuska [tom@opennetworking.org]
CommitDate: Tue Apr 10 22:28:46 2018 +0000

[ONOS-7570] ServiceNotFoundException(DriverService) in de-serializing DefaultGroup
--
(cherry picked from commit 9477a9df8120e7991db4b3ef0b09ae71450b99af)

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

13.1 Constructing test variables - No Result
13.2 Constructing test variables - PASS
13.3 Apply cell to environment - PASS
13.4 Uninstalling ONOS package - PASS
13.5 Creating ONOS package - PASS
13.6 Installing ONOS package - PASS
13.7 Set up ONOS secure SSH - PASS
13.8 Checking ONOS service - PASS
13.9 Starting ONOS CLI sessions - PASS
13.10 Starting Mininet Topology - PASS
13.11 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

13.12 Check whether all flow status are ADDED - PASS
13.13 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - FAIL

IP connectivity failed

13.14 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

13.15 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

13.16 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

13.17 Check whether all flow status are ADDED - PASS
13.18 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - FAIL

IP connectivity failed

13.19 Stopping Mininet - PASS
13.20 Copying karaf logs - PASS

Case 23: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

23.1 Apply cell to environment - PASS
23.2 Uninstalling ONOS package - PASS
23.3 Installing ONOS package - PASS
23.4 Set up ONOS secure SSH - PASS
23.5 Checking ONOS service - PASS
23.6 Starting ONOS CLI sessions - PASS
23.7 Starting Mininet Topology - PASS
23.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

23.9 Check whether all flow status are ADDED - PASS
23.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - FAIL

IP connectivity failed

23.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - FAIL

IP connectivity failed

23.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

23.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

23.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

23.15 Check whether all flow status are ADDED - PASS
23.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS
23.17 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - FAIL

IP connectivity failed

23.18 Stopping Mininet - PASS
23.19 Copying karaf logs - PASS

Case 33: Changing port configuration from untagged 10 to untagged 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

33.1 Apply cell to environment - PASS
33.2 Uninstalling ONOS package - PASS
33.3 Installing ONOS package - PASS
33.4 Set up ONOS secure SSH - PASS
33.5 Checking ONOS service - PASS
33.6 Starting ONOS CLI sessions - PASS
33.7 Starting Mininet Topology - PASS
33.8 Check whether the flow count is bigger than 104 - PASS
33.9 Check whether all flow status are ADDED - PASS
33.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_Before - PASS
33.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_Before - PASS
33.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
33.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
33.14 Check whether the flow count is bigger than 104 - PASS
33.15 Check whether all flow status are ADDED - FAIL

Flow status is wrong!

33.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_After - PASS
33.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_After - PASS
33.18 Stopping Mininet - PASS
33.19 Copying karaf logs - PASS

Case 43: Changing port configuration from untagged 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

43.1 Apply cell to environment - PASS
43.2 Uninstalling ONOS package - PASS
43.3 Installing ONOS package - PASS
43.4 Set up ONOS secure SSH - PASS
43.5 Checking ONOS service - PASS
43.6 Starting ONOS CLI sessions - PASS
43.7 Starting Mininet Topology - PASS
43.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

43.9 Check whether all flow status are ADDED - PASS
43.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE43_Before - FAIL

IP connectivity failed

43.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_Before - FAIL

IP connectivity failed

43.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

43.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

43.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

43.15 Check whether all flow status are ADDED - PASS
43.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_After - PASS
43.17 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE43_After - FAIL

IP connectivity failed

43.18 Stopping Mininet - PASS
43.19 Copying karaf logs - PASS

Case 53: Changing port configuration from untagged 10 to tagged 20 with native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

53.1 Apply cell to environment - PASS
53.2 Uninstalling ONOS package - PASS
53.3 Installing ONOS package - PASS
53.4 Set up ONOS secure SSH - PASS
53.5 Checking ONOS service - PASS
53.6 Starting ONOS CLI sessions - PASS
53.7 Starting Mininet Topology - PASS
53.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

53.9 Check whether all flow status are ADDED - PASS
53.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_Before - FAIL

IP connectivity failed

53.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_Before - FAIL

IP connectivity failed

53.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

53.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

53.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

53.15 Check whether all flow status are ADDED - PASS
53.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_After - FAIL

IP connectivity failed

53.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_After - FAIL

IP connectivity failed

53.18 Stopping Mininet - PASS
53.19 Copying karaf logs - PASS

Case 63: Changing port configuration from untagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

63.1 Apply cell to environment - PASS
63.2 Uninstalling ONOS package - PASS
63.3 Installing ONOS package - PASS
63.4 Set up ONOS secure SSH - PASS
63.5 Checking ONOS service - PASS
63.6 Starting ONOS CLI sessions - PASS
63.7 Starting Mininet Topology - PASS
63.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

63.9 Check whether all flow status are ADDED - PASS
63.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_Before - FAIL

IP connectivity failed

63.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_Before - FAIL

IP connectivity failed

63.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

63.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

63.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

63.15 Check whether all flow status are ADDED - PASS
63.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_After - FAIL

IP connectivity failed

63.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_After - FAIL

IP connectivity failed

63.18 Stopping Mininet - PASS
63.19 Copying karaf logs - PASS

Case 73: Changing port configuration from tagged 10 to untagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

73.1 Apply cell to environment - PASS
73.2 Uninstalling ONOS package - PASS
73.3 Installing ONOS package - PASS
73.4 Set up ONOS secure SSH - PASS
73.5 Checking ONOS service - PASS
73.6 Starting ONOS CLI sessions - PASS
73.7 Starting Mininet Topology - PASS
73.8 Check whether the flow count is bigger than 106 - PASS
73.9 Check whether all flow status are ADDED - PASS
73.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_Before - PASS
73.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_Before - PASS
73.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS
73.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS
73.14 Check whether the flow count is bigger than 106 - PASS
73.15 Check whether all flow status are ADDED - PASS
73.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_After - PASS
73.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_After - PASS
73.18 Stopping Mininet - PASS
73.19 Copying karaf logs - PASS

Case 83: Changing port configuration from tagged 20 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

83.1 Apply cell to environment - PASS
83.2 Uninstalling ONOS package - PASS
83.3 Installing ONOS package - PASS
83.4 Set up ONOS secure SSH - PASS
83.5 Checking ONOS service - PASS
83.6 Starting ONOS CLI sessions - PASS
83.7 Starting Mininet Topology - PASS
83.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

83.9 Check whether all flow status are ADDED - PASS
83.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_Before - FAIL

IP connectivity failed

83.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_Before - PASS
83.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

83.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

83.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

83.15 Check whether all flow status are ADDED - PASS
83.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_After - FAIL

IP connectivity failed

83.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_After - FAIL

IP connectivity failed

83.18 Stopping Mininet - PASS
83.19 Copying karaf logs - PASS

Case 93: Changing port configuration from tagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

93.1 Apply cell to environment - PASS
93.2 Uninstalling ONOS package - PASS
93.3 Installing ONOS package - PASS
93.4 Set up ONOS secure SSH - PASS
93.5 Checking ONOS service - PASS
93.6 Starting ONOS CLI sessions - PASS
93.7 Starting Mininet Topology - PASS
93.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

93.9 Check whether all flow status are ADDED - PASS
93.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_Before - FAIL

IP connectivity failed

93.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_Before - FAIL

IP connectivity failed

93.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

93.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

93.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

93.15 Check whether all flow status are ADDED - PASS
93.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_After - FAIL

IP connectivity failed

93.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_After - FAIL

IP connectivity failed

93.18 Stopping Mininet - PASS
93.19 Copying karaf logs - PASS

Case 103: Changing port configuration from tagged 10 and native 20 to untagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

103.1 Apply cell to environment - PASS
103.2 Uninstalling ONOS package - PASS
103.3 Installing ONOS package - PASS
103.4 Set up ONOS secure SSH - PASS
103.5 Checking ONOS service - PASS
103.6 Starting ONOS CLI sessions - PASS
103.7 Starting Mininet Topology - PASS
103.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

103.9 Check whether all flow status are ADDED - PASS
103.10 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE103_Before - FAIL

IP connectivity failed

103.11 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

103.12 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

103.13 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

103.14 Check whether all flow status are ADDED - PASS
103.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE103_After - FAIL

IP connectivity failed

103.16 Stopping Mininet - PASS
103.17 Copying karaf logs - PASS

Case 113: Changing port configuration from tagged 20 and native 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

113.1 Apply cell to environment - PASS
113.2 Uninstalling ONOS package - PASS
113.3 Installing ONOS package - PASS
113.4 Set up ONOS secure SSH - PASS
113.5 Checking ONOS service - PASS
113.6 Starting ONOS CLI sessions - PASS
113.7 Starting Mininet Topology - PASS
113.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

113.9 Check whether all flow status are ADDED - PASS
113.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_Before - FAIL

IP connectivity failed

113.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE113_Before - FAIL

IP connectivity failed

113.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

113.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

113.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

113.15 Check whether all flow status are ADDED - PASS
113.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_After - FAIL

IP connectivity failed

113.17 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE113_After - PASS
113.18 Stopping Mininet - PASS
113.19 Copying karaf logs - PASS

Case 123: Changing port configuration from tagged 20 and native 10 to tagged 20 and native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

123.1 Apply cell to environment - PASS
123.2 Uninstalling ONOS package - PASS
123.3 Installing ONOS package - PASS
123.4 Set up ONOS secure SSH - PASS
123.5 Checking ONOS service - PASS
123.6 Starting ONOS CLI sessions - PASS
123.7 Starting Mininet Topology - PASS
123.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

123.9 Check whether all flow status are ADDED - PASS
123.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE123_Before - FAIL

IP connectivity failed

123.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE123_Before - FAIL

IP connectivity failed

123.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

123.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

123.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

123.15 Check whether all flow status are ADDED - PASS
123.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE123_After - FAIL

IP connectivity failed

123.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE123_After - FAIL

IP connectivity failed

123.18 Stopping Mininet - PASS
123.19 Copying karaf logs - PASS

Case 133: Changing port configuration from tagged 20 and native 10 to tagged 120 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

133.1 Apply cell to environment - PASS
133.2 Uninstalling ONOS package - PASS
133.3 Installing ONOS package - PASS
133.4 Set up ONOS secure SSH - PASS
133.5 Checking ONOS service - PASS
133.6 Starting ONOS CLI sessions - PASS
133.7 Starting Mininet Topology - PASS
133.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

133.9 Check whether all flow status are ADDED - PASS
133.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE133_Before - FAIL

IP connectivity failed

133.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE133_Before - FAIL

IP connectivity failed

133.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

133.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

133.14 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

133.15 Check whether all flow status are ADDED - PASS
133.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE133_After - FAIL

IP connectivity failed

133.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE133_After - FAIL

IP connectivity failed

133.18 Stopping Mininet - PASS
133.19 Copying karaf logs - PASS

Case 143: Changing port configuration from untagged 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

143.1 Apply cell to environment - PASS
143.2 Uninstalling ONOS package - PASS
143.3 Installing ONOS package - PASS
143.4 Set up ONOS secure SSH - PASS
143.5 Checking ONOS service - PASS
143.6 Starting ONOS CLI sessions - PASS
143.7 Starting Mininet Topology - PASS
143.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

143.9 Check whether all flow status are ADDED - PASS
143.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE143_Before - FAIL

IP connectivity failed

143.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE143_Before - PASS
143.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

143.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

143.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

143.15 Check whether all flow status are ADDED - PASS
143.16 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE143_After - FAIL

IP connectivity failed

143.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE143_After - PASS
143.18 Stopping Mininet - PASS
143.19 Copying karaf logs - PASS

Case 153: Changing port configuration from untagged 10 to tagged 120, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

153.1 Apply cell to environment - PASS
153.2 Uninstalling ONOS package - PASS
153.3 Installing ONOS package - PASS
153.4 Set up ONOS secure SSH - PASS
153.5 Checking ONOS service - PASS
153.6 Starting ONOS CLI sessions - PASS
153.7 Starting Mininet Topology - PASS
153.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

153.9 Check whether all flow status are ADDED - PASS
153.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE153_Before - FAIL

IP connectivity failed

153.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE153_Before - PASS
153.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

153.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

153.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

153.15 Check whether all flow status are ADDED - PASS
153.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE153_After - FAIL

IP connectivity failed

153.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE153_After - PASS
153.18 Stopping Mininet - PASS
153.19 Copying karaf logs - PASS

Case 163: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

163.1 Apply cell to environment - PASS
163.2 Uninstalling ONOS package - PASS
163.3 Installing ONOS package - PASS
163.4 Set up ONOS secure SSH - PASS
163.5 Checking ONOS service - PASS
163.6 Starting ONOS CLI sessions - PASS
163.7 Starting Mininet Topology - PASS
163.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

163.9 Check whether all flow status are ADDED - PASS
163.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE163_Before - FAIL

IP connectivity failed

163.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE163_Before - PASS
163.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

163.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

163.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

163.15 Check whether all flow status are ADDED - PASS
163.16 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE163_After - FAIL

IP connectivity failed

163.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE163_After - PASS
163.18 Stopping Mininet - PASS
163.19 Copying karaf logs - PASS

Case 173: Changing port configuration from tagged 20 to tagged 120, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

173.1 Apply cell to environment - PASS
173.2 Uninstalling ONOS package - PASS
173.3 Installing ONOS package - PASS
173.4 Set up ONOS secure SSH - PASS
173.5 Checking ONOS service - PASS
173.6 Starting ONOS CLI sessions - PASS
173.7 Starting Mininet Topology - PASS
173.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

173.9 Check whether all flow status are ADDED - PASS
173.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE173_Before - FAIL

IP connectivity failed

173.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE173_Before - PASS
173.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

173.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

173.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

173.15 Check whether all flow status are ADDED - PASS
173.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE173_After - FAIL

IP connectivity failed

173.17 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE173_After - PASS
173.18 Stopping Mininet - PASS
173.19 Copying karaf logs - PASS

Case 183: Changing port configuration from tagged 20 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

183.1 Apply cell to environment - PASS
183.2 Uninstalling ONOS package - PASS
183.3 Installing ONOS package - PASS
183.4 Set up ONOS secure SSH - PASS
183.5 Checking ONOS service - PASS
183.6 Starting ONOS CLI sessions - PASS
183.7 Starting Mininet Topology - PASS
183.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

183.9 Check whether all flow status are ADDED - PASS
183.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE183_Before - FAIL

IP connectivity failed

183.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE183_Before - PASS
183.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

183.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

183.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

183.15 Check whether all flow status are ADDED - PASS
183.16 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE183_After - FAIL

IP connectivity failed

183.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE183_After - PASS
183.18 Stopping Mininet - PASS
183.19 Copying karaf logs - PASS

Case 193: Changing port configuration from tagged 20 and native 10 to untagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

193.1 Apply cell to environment - PASS
193.2 Uninstalling ONOS package - PASS
193.3 Installing ONOS package - PASS
193.4 Set up ONOS secure SSH - PASS
193.5 Checking ONOS service - PASS
193.6 Starting ONOS CLI sessions - PASS
193.7 Starting Mininet Topology - PASS
193.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

193.9 Check whether all flow status are ADDED - PASS
193.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE193_Before - FAIL

IP connectivity failed

193.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE193_Before - PASS
193.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

193.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

193.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

193.15 Check whether all flow status are ADDED - PASS
193.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE193_After - FAIL

IP connectivity failed

193.17 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE193_After - PASS
193.18 Stopping Mininet - PASS
193.19 Copying karaf logs - PASS

Case 203: Changing port configuration from tagged 20 and native 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

203.1 Apply cell to environment - PASS
203.2 Uninstalling ONOS package - PASS
203.3 Installing ONOS package - PASS
203.4 Set up ONOS secure SSH - PASS
203.5 Checking ONOS service - PASS
203.6 Starting ONOS CLI sessions - PASS
203.7 Starting Mininet Topology - PASS
203.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

203.9 Check whether all flow status are ADDED - PASS
203.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE203_Before - FAIL

IP connectivity failed

203.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE203_Before - PASS
203.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

203.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

203.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

203.15 Check whether all flow status are ADDED - PASS
203.16 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE203_After - FAIL

IP connectivity failed

203.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE203_After - PASS
203.18 Stopping Mininet - PASS
203.19 Copying karaf logs - PASS

Case 213: Changing port configuration from tagged 20 and native 10 to tagged 20 and native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

213.1 Apply cell to environment - PASS
213.2 Uninstalling ONOS package - PASS
213.3 Installing ONOS package - PASS
213.4 Set up ONOS secure SSH - PASS
213.5 Checking ONOS service - PASS
213.6 Starting ONOS CLI sessions - PASS
213.7 Starting Mininet Topology - PASS
213.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

213.9 Check whether all flow status are ADDED - PASS
213.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_Before - FAIL

IP connectivity failed

213.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_Before - PASS
213.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

213.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

213.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

213.15 Check whether all flow status are ADDED - PASS
213.16 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_After - FAIL

IP connectivity failed

213.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_After - PASS
213.18 Stopping Mininet - PASS
213.19 Copying karaf logs - PASS

Case 223: Changing port configuration from tagged 20 and native 10 to tagged 120 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

223.1 Apply cell to environment - PASS
223.2 Uninstalling ONOS package - PASS
223.3 Installing ONOS package - PASS
223.4 Set up ONOS secure SSH - PASS
223.5 Checking ONOS service - PASS
223.6 Starting ONOS CLI sessions - PASS
223.7 Starting Mininet Topology - PASS
223.8 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

223.9 Check whether all flow status are ADDED - PASS
223.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE223_Before - FAIL

IP connectivity failed

223.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE223_Before - PASS
223.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL

Flow count looks wrong.

223.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL

Flow count looks wrong.

223.14 Check whether the flow count is bigger than 106 - FAIL

Flow count looks wrong: False

223.15 Check whether all flow status are ADDED - PASS
223.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE223_After - FAIL

IP connectivity failed

223.17 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE223_After - PASS
223.18 Stopping Mininet - PASS
223.19 Copying karaf logs - PASS

Case 233: Consecutive configuration changes, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

233.1 Apply cell to environment - PASS
233.2 Uninstalling ONOS package - PASS
233.3 Installing ONOS package - PASS
233.4 Set up ONOS secure SSH - PASS
233.5 Checking ONOS service - PASS
233.6 Starting ONOS CLI sessions - PASS
233.7 Starting Mininet Topology - PASS
233.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

233.9 Check whether all flow status are ADDED - PASS
233.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_Before - FAIL

IP connectivity failed

233.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_Before - FAIL

IP connectivity failed

233.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.14 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.15 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_1 - FAIL

IP connectivity failed

233.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_1 - PASS
233.18 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.19 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_2 - FAIL

IP connectivity failed

233.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_2 - PASS
233.22 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.23 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.24 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_3 - FAIL

IP connectivity failed

233.25 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_3 - PASS
233.26 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.27 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.28 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_4 - FAIL

IP connectivity failed

233.29 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_4 - FAIL

IP connectivity failed

233.30 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.31 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.32 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_5 - FAIL

IP connectivity failed

233.33 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_5 - PASS
233.34 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.35 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.36 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_6 - FAIL

IP connectivity failed

233.37 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_6 - PASS
233.38 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

233.39 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

233.40 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

233.41 Check whether all flow status are ADDED - PASS
233.42 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_After - FAIL

IP connectivity failed

233.43 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_After - FAIL

IP connectivity failed

233.44 Stopping Mininet - PASS
233.45 Copying karaf logs - PASS

Case 243: Changing port configuration from 10.0.2.254/24 to 10.0.6.254/24, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

243.1 Apply cell to environment - PASS
243.2 Uninstalling ONOS package - PASS
243.3 Installing ONOS package - PASS
243.4 Set up ONOS secure SSH - PASS
243.5 Checking ONOS service - PASS
243.6 Starting ONOS CLI sessions - PASS
243.7 Starting Mininet Topology - PASS
243.8 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

243.9 Check whether all flow status are ADDED - PASS
243.10 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_Before - FAIL

IP connectivity failed

243.11 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong.

243.12 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong.

243.13 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: False

243.14 Check whether all flow status are ADDED - PASS
243.15 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_After - FAIL

IP connectivity failed

243.16 Stopping Mininet - PASS
243.17 Copying karaf logs - PASS