1.15-SR Dynamic Config

commit 2b6073de47a41549a9120460515f9bd9398885a4 (HEAD -] onos-1.15, origin/onos-1.15)
Author: Charles Chan [rascov@gmail.com]
AuthorDate: Wed Apr 10 17:12:20 2019 -0700
Commit: Thomas Vachuska [tom@opennetworking.org]
CommitDate: Fri Apr 12 20:52:42 2019 +0000

Allowed apps to specify whether the existing component config value should be overridden

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

• 13.1 Constructing test variables - PASS
• 13.2 Apply cell to environment - PASS
• 13.3 Uninstalling Atomix - PASS
• 13.4 Uninstalling ONOS package - PASS
• 13.5 Creating ONOS package - PASS
• 13.6 Installing Atomix - PASS
• 13.7 Installing ONOS package - PASS
• 13.8 Set up ONOS secure SSH - PASS
• 13.9 Checking ONOS service - PASS
• 13.10 Starting ONOS CLI sessions - PASS
• 13.11 Checking ONOS nodes - PASS
• 13.12 Checking ONOS applications - PASS
• 13.13 Starting Mininet Topology - PASS
• 13.14 Check whether the flow count is bigger than 104 - PASS
• 13.15 Check whether all flow status are ADDED - PASS
• 13.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - PASS
• 13.17 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
• 13.18 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
• 13.19 Check whether the flow count is bigger than 104 - PASS
• 13.20 Check whether all flow status are ADDED - PASS
• 13.21 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - PASS
• 13.22 Stopping Mininet - PASS
• 13.23 Copying karaf logs - PASS

Case 23: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

• 23.1 Apply cell to environment - PASS
• 23.2 Uninstalling Atomix - PASS
• 23.3 Uninstalling ONOS package - PASS
• 23.4 Installing Atomix - PASS
• 23.5 Installing ONOS package - PASS
• 23.6 Set up ONOS secure SSH - PASS
• 23.7 Checking ONOS service - PASS
• 23.8 Starting ONOS CLI sessions - PASS
• 23.9 Checking ONOS nodes - PASS
• 23.10 Checking ONOS applications - PASS
• 23.11 Starting Mininet Topology - PASS
• 23.12 Check whether the flow count is bigger than 106 - PASS
• 23.13 Check whether all flow status are ADDED - PASS
• 23.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - PASS
• 23.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - FAIL
• IP connectivity failed
• 23.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS
• 23.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS
• 23.18 Check whether the flow count is bigger than 106 - PASS
• 23.19 Check whether all flow status are ADDED - PASS
• 23.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS
• 23.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - PASS
• 23.22 Stopping Mininet - PASS
• 23.23 Copying karaf logs - PASS

Case 33: Changing port configuration from untagged 10 to untagged 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

• 33.1 Apply cell to environment - PASS
• 33.2 Uninstalling Atomix - PASS
• 33.3 Uninstalling ONOS package - PASS
• 33.4 Installing Atomix - PASS
• 33.5 Installing ONOS package - PASS
• 33.6 Set up ONOS secure SSH - PASS
• 33.7 Checking ONOS service - PASS
• 33.8 Starting ONOS CLI sessions - PASS
• 33.9 Checking ONOS nodes - PASS
• 33.10 Checking ONOS applications - PASS
• 33.11 Starting Mininet Topology - PASS
• 33.12 Check whether the flow count is bigger than 104 - PASS
• 33.13 Check whether all flow status are ADDED - PASS
• 33.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_Before - FAIL
• IP connectivity failed
• 33.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_Before - FAIL
• IP connectivity failed
• 33.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
• 33.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
• 33.18 Check whether the flow count is bigger than 104 - PASS
• 33.19 Check whether all flow status are ADDED - PASS
• 33.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_After - PASS
• 33.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_After - PASS
• 33.22 Stopping Mininet - PASS
• 33.23 Copying karaf logs - PASS

Case 43: Changing port configuration from untagged 10 to tagged 20, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

• 43.1 Apply cell to environment - PASS
• 43.2 Uninstalling Atomix - PASS
• 43.3 Uninstalling ONOS package - PASS
• 43.4 Installing Atomix - PASS
• 43.5 Installing ONOS package - PASS
• 43.6 Set up ONOS secure SSH - PASS
• 43.7 Checking ONOS service - PASS
• 43.8 Starting ONOS CLI sessions - PASS
• 43.9 Checking ONOS nodes - PASS
• 43.10 Checking ONOS applications - PASS
• 43.11 Starting Mininet Topology - PASS
• 43.12 Check whether the flow count is bigger than 104 - PASS
• 43.13 Check whether all flow status are ADDED - PASS
• 43.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE43_Before - PASS
• 43.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_Before - PASS
• 43.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
• 43.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
• 43.18 Check whether the flow count is bigger than 104 - PASS
• 43.19 Check whether all flow status are ADDED - FAIL
• Flow status is wrong!
• 43.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE43_After - PASS
• 43.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE43_After - PASS
• 43.22 Stopping Mininet - PASS
• 43.23 Copying karaf logs - PASS

Case 53: Changing port configuration from untagged 10 to tagged 20 with native 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

• 53.1 Apply cell to environment - PASS
• 53.2 Uninstalling Atomix - PASS
• 53.3 Uninstalling ONOS package - PASS
• 53.4 Installing Atomix - PASS
• 53.5 Installing ONOS package - PASS
• 53.6 Set up ONOS secure SSH - PASS
• 53.7 Checking ONOS service - PASS
• 53.8 Starting ONOS CLI sessions - PASS
• 53.9 Checking ONOS nodes - PASS
• 53.10 Checking ONOS applications - PASS
• 53.11 Starting Mininet Topology - PASS
• 53.12 Check whether the flow count is bigger than 104 - PASS
• 53.13 Check whether all flow status are ADDED - PASS
• 53.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_Before - PASS
• 53.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_Before - PASS
• 53.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS
• 53.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS
• 53.18 Check whether the flow count is bigger than 104 - PASS
• 53.19 Check whether all flow status are ADDED - PASS
• 53.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_After - PASS
• 53.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_After - PASS
• 53.22 Stopping Mininet - PASS
• 53.23 Copying karaf logs - PASS

Case 63: Changing port configuration from untagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL