View Source

SRDynamicConf at 30 Oct 2020 16:55:04

<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric2/lastSuccessfulBuild/artifact/SRDynamicConf_onos-1.15_20-builds_graph.jpg", alt="SRDynamicConf", style="width:525px;height:350px;border:0">

commit 7898ceda95b0e27a048c9fcee5e5c8daa332a4d4 (HEAD -] onos-1.15, origin/onos-1.15)
Author: Jian Li [pyguni@gmail.com]
AuthorDate: Mon Oct 5 22:36:41 2020 +0900
Commit: Jian Li [pyguni@gmail.com]
CommitDate: Mon Oct 5 22:56:34 2020 +0900

Fix: make all openstack resource name optional

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

13.1 Constructing test variables - PASS
13.2 Apply cell to environment - PASS
13.3 Uninstalling Atomix - PASS
13.4 Uninstalling ONOS package - PASS
13.5 Creating ONOS package - PASS
13.6 Installing Atomix - PASS
13.7 Installing ONOS package - PASS
13.8 Set up ONOS secure SSH - PASS
13.9 Checking ONOS service - PASS
13.10 Starting ONOS CLI sessions - PASS
13.11 Checking ONOS nodes - PASS
13.12 Checking ONOS applications - PASS
13.13 Starting Mininet Topology - PASS
13.14 Check whether the flow count is bigger than 104 - PASS
13.15 Check whether all flow status are ADDED - PASS
13.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - PASS
13.17 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
13.18 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong: 18

13.19 Check whether the flow count is bigger than 104 - PASS
13.20 Check whether all flow status are ADDED - PASS
13.21 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - PASS
13.22 Stopping Mininet - PASS
13.23 Copying karaf logs - PASS

Case 23: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

23.1 Apply cell to environment - PASS
23.2 Uninstalling Atomix - PASS
23.3 Uninstalling ONOS package - PASS
23.4 Installing Atomix - PASS
23.5 Installing ONOS package - PASS
23.6 Set up ONOS secure SSH - PASS
23.7 Checking ONOS service - PASS
23.8 Starting ONOS CLI sessions - PASS
23.9 Checking ONOS nodes - PASS
23.10 Checking ONOS applications - PASS
23.11 Starting Mininet Topology - PASS
23.12 Check whether the flow count is bigger than 106 - PASS
23.13 Check whether all flow status are ADDED - PASS
23.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - PASS
23.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - PASS
23.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS
23.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS
23.18 Check whether the flow count is bigger than 106 - PASS
23.19 Check whether all flow status are ADDED - PASS
23.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS
23.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - PASS
23.22 Stopping Mininet - PASS
23.23 Copying karaf logs - PASS

Case 33: Changing port configuration from untagged 10 to untagged 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

33.1 Apply cell to environment - PASS
33.2 Uninstalling Atomix - PASS
33.3 Uninstalling ONOS package - PASS
33.4 Installing Atomix - PASS
33.5 Installing ONOS package - PASS
33.6 Set up ONOS secure SSH - PASS
33.7 Checking ONOS service - PASS
33.8 Starting ONOS CLI sessions - PASS
33.9 Checking ONOS nodes - PASS
33.10 Checking ONOS applications - PASS
33.11 Starting Mininet Topology - PASS
33.12 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: 78

33.13 Check whether all flow status are ADDED - PASS
33.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_Before - FAIL

IP connectivity failed

33.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_Before - FAIL

IP connectivity failed

33.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - FAIL

Flow count looks wrong: 18

33.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL

Flow count looks wrong: 18

33.18 Check whether the flow count is bigger than 104 - FAIL

Flow count looks wrong: 89

33.19 Check whether all flow status are ADDED - PASS
33.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_After - FAIL

IP connectivity failed

33.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_After - PASS
33.22 Stopping Mininet - PASS
33.23 Copying karaf logs - PASS

Case 43: Changing port configuration from untagged 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

43.1 Apply cell to environment - PASS
43.2 Uninstalling Atomix - PASS
43.3 Uninstalling ONOS package - PASS
43.4 Installing Atomix - PASS
43.5 Installing ONOS package - PASS
43.6 Set up ONOS secure SSH - PASS
43.7 Checking ONOS service - PASS
43.8 Starting ONOS CLI sessions - PASS
43.9 Checking ONOS nodes - PASS
43.10 Checking ONOS applications - PASS
43.11 Starting Mininet Topology - PASS
43.12 Check whether the flow count is bigger than 104 - PASS
43.13 Check whether all flow status are ADDED - PASS
43.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE43_Before - PASS
43.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_Before - PASS
43.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
43.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
43.18 Check whether the flow count is bigger than 104 - PASS
43.19 Check whether all flow status are ADDED - PASS
43.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_After - PASS
43.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE43_After - PASS
43.22 Stopping Mininet - PASS
43.23 Copying karaf logs - PASS

Case 53: Changing port configuration from untagged 10 to tagged 20 with native 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

53.1 Apply cell to environment - PASS
53.2 Uninstalling Atomix - PASS
53.3 Uninstalling ONOS package - PASS
53.4 Installing Atomix - PASS
53.5 Installing ONOS package - PASS
53.6 Set up ONOS secure SSH - PASS
53.7 Checking ONOS service - PASS
53.8 Starting ONOS CLI sessions - PASS
53.9 Checking ONOS nodes - PASS
53.10 Checking ONOS applications - PASS
53.11 Starting Mininet Topology - PASS
53.12 Check whether the flow count is bigger than 104 - PASS
53.13 Check whether all flow status are ADDED - PASS
53.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_Before - PASS
53.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_Before - PASS
53.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
53.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
53.18 Check whether the flow count is bigger than 104 - PASS
53.19 Check whether all flow status are ADDED - PASS
53.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_After - PASS
53.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_After - PASS
53.22 Stopping Mininet - PASS
53.23 Copying karaf logs - PASS

Case 63: Changing port configuration from untagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

63.1 Apply cell to environment - PASS
63.2 Uninstalling Atomix - PASS
63.3 Uninstalling ONOS package - PASS
63.4 Installing Atomix - PASS
63.5 Installing ONOS package - PASS
63.6 Set up ONOS secure SSH - PASS
63.7 Checking ONOS service - PASS
63.8 Starting ONOS CLI sessions - PASS
63.9 Checking ONOS nodes - PASS
63.10 Checking ONOS applications - PASS
63.11 Starting Mininet Topology - PASS
63.12 Check whether the flow count is bigger than 104 - PASS
63.13 Check whether all flow status are ADDED - PASS
63.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_Before - PASS
63.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_Before - PASS
63.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
63.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
63.18 Check whether the flow count is bigger than 104 - PASS
63.19 Check whether all flow status are ADDED - PASS
63.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_After - PASS
63.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_After - PASS
63.22 Stopping Mininet - PASS
63.23 Copying karaf logs - PASS

Case 73: Changing port configuration from tagged 10 to untagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

73.1 Apply cell to environment - PASS
73.2 Uninstalling Atomix - PASS
73.3 Uninstalling ONOS package - PASS
73.4 Installing Atomix - PASS
73.5 Installing ONOS package - PASS
73.6 Set up ONOS secure SSH - PASS
73.7 Checking ONOS service - PASS
73.8 Starting ONOS CLI sessions - PASS
73.9 Checking ONOS nodes - PASS
73.10 Checking ONOS applications - PASS
73.11 Starting Mininet Topology - PASS
73.12 Check whether the flow count is bigger than 106 - PASS
73.13 Check whether all flow status are ADDED - PASS
73.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_Before - PASS
73.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_Before - PASS
73.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS
73.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS
73.18 Check whether the flow count is bigger than 106 - PASS
73.19 Check whether all flow status are ADDED - PASS
73.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_After - PASS
73.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_After - PASS
73.22 Stopping Mininet - PASS
73.23 Copying karaf logs - PASS

Case 83: Changing port configuration from tagged 20 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

83.1 Apply cell to environment - PASS
83.2 Uninstalling Atomix - PASS
83.3 Uninstalling ONOS package - PASS
83.4 Installing Atomix - PASS
83.5 Installing ONOS package - PASS
83.6 Set up ONOS secure SSH - PASS
83.7 Checking ONOS service - PASS
83.8 Starting ONOS CLI sessions - PASS
83.9 Checking ONOS nodes - PASS
83.10 Checking ONOS applications - PASS
83.11 Starting Mininet Topology - PASS
83.12 Check whether the flow count is bigger than 104 - PASS
83.13 Check whether all flow status are ADDED - PASS
83.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_Before - PASS
83.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_Before - PASS
83.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
83.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
83.18 Check whether the flow count is bigger than 104 - PASS
83.19 Check whether all flow status are ADDED - PASS
83.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_After - PASS
83.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_After - PASS
83.22 Stopping Mininet - PASS
83.23 Copying karaf logs - PASS

Case 93: Changing port configuration from tagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

93.1 Apply cell to environment - PASS
93.2 Uninstalling Atomix - PASS
93.3 Uninstalling ONOS package - PASS
93.4 Installing Atomix - PASS
93.5 Installing ONOS package - PASS
93.6 Set up ONOS secure SSH - PASS
93.7 Checking ONOS service - PASS
93.8 Starting ONOS CLI sessions - PASS
93.9 Checking ONOS nodes - PASS
93.10 Checking ONOS applications - PASS
93.11 Starting Mininet Topology - PASS
93.12 Check whether the flow count is bigger than 106 - PASS
93.13 Check whether all flow status are ADDED - PASS
93.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_Before - PASS
93.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_Before - PASS
93.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS
93.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS
93.18 Check whether the flow count is bigger than 106 - PASS
93.19 Check whether all flow status are ADDED - PASS
93.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_After - PASS
93.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_After - PASS
93.22 Stopping Mininet - PASS
93.23 Copying karaf logs - PASS

Case 103: Changing port configuration from tagged 10 and native 20 to untagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

103.1 Apply cell to environment - PASS
103.2 Uninstalling Atomix - PASS
103.3 Uninstalling ONOS package - PASS
103.4 Installing Atomix - PASS
103.5 Installing ONOS package - PASS
103.6 Set up ONOS secure SSH - PASS
103.7 Checking ONOS service - PASS
103.8 Starting ONOS CLI sessions - PASS
103.9 Checking ONOS nodes - PASS
103.10 Checking ONOS applications - PASS
103.11 Starting Mininet Topology - PASS
103.12 Check whether the flow count is bigger than 104 - PASS
103.13 Check whether all flow status are ADDED - PASS
103.14 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE103_Before - PASS
103.15 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
103.16 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
103.17 Check whether the flow count is bigger than 104 - PASS
103.18 Check whether all flow status are ADDED - PASS
103.19 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE103_After - PASS
103.20 Stopping Mininet - PASS
103.21 Copying karaf logs - PASS

Case 113: Changing port configuration from tagged 20 and native 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

113.1 Apply cell to environment - PASS
113.2 Uninstalling Atomix - PASS
113.3 Uninstalling ONOS package - PASS
113.4 Installing Atomix - PASS
113.5 Installing ONOS package - PASS
113.6 Set up ONOS secure SSH - PASS
113.7 Checking ONOS service - PASS
113.8 Starting ONOS CLI sessions - PASS
113.9 Checking ONOS nodes - PASS
113.10 Checking ONOS applications - PASS
113.11 Starting Mininet Topology - PASS
113.12 Check whether the flow count is bigger than 104 - PASS
113.13 Check whether all flow status are ADDED - PASS
113.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_Before - PASS
113.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE113_Before - PASS
113.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
113.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
113.18 Check whether the flow count is bigger than 104 - PASS
113.19 Check whether all flow status are ADDED - PASS
113.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_After - PASS
113.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE113_After - PASS
113.22 Stopping Mininet - PASS
113.23 Copying karaf logs - PASS

Case 123: Changing port configuration from tagged 20 and native 10 to tagged 20 and native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL