Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

HTML
<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric2/lastSuccessfulBuild/artifact/SRDynamicConf_onos-1.15_20-builds_graph.jpg", alt="SRDynamicConf", style="width:525px;height:350px;border:0">

commit 01b6e948f2df8df5654b80c87ab3f8f324371e41 421ad64d38343c7c43feac6fa4ebb6f41902ea47 (HEAD -] onos-1.15, origin/onos-1.15)
Author: Charles Chan pier [rascov@gmailpier@opennetworking.comorg]
AuthorDate: Fri Feb 14 13:23:57 2020 -0800Jun 12 18:48:37 2020 +0200
Commit: Charles Chan pier [charles@opennetworkingpier@opennetworking.org]
CommitDate: Sat Jun 20 0527 13:1853:01 17 2020 +0000
Phased recovery0200

[AETHER-77] onos-diagnostics-k8s

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

...

  • 13.1 Constructing test variables - PASS (tick)
  • 13.2 Apply cell to environment - PASS (tick)
  • 13.3 Uninstalling Atomix - PASS (tick)
  • 13.4 Uninstalling ONOS package - PASS (tick)
  • 13.5 Creating ONOS package - PASS (tick)
  • 13.6 Installing Atomix - PASS (tick)
  • 13.7 Installing ONOS package - PASS (tick)
  • 13.8 Set up ONOS secure SSH - PASS (tick)
  • 13.9 Checking ONOS service - PASS (tick)
  • 13.10 Starting ONOS CLI sessions - PASS (tick)
  • 13.11 Checking ONOS nodes - PASS (tick)
  • 13.12 Checking ONOS applications - PASS (tick)
  • 13.13 Starting Mininet Topology - PASS (tick)
  • 13.14 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.15 Check whether all flow status are ADDED - PASS (tick)
  • 13.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - PASS (tick)
  • 13.17 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 13.18 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 13.19 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.20 Check whether all flow status are ADDED - PASS (tick)
  • 13.21 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - PASS (tick)
  • 13.22 Stopping Mininet - PASS (tick)
  • 13.23 Copying karaf logs - PASS (tick)

Case 23: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 23.1 Apply cell to environment - PASS (tick)
  • 23.2 Uninstalling Atomix - PASS (tick)
  • 23.3 Uninstalling ONOS package - PASS (tick)
  • 23.4 Installing Atomix - PASS (tick)
  • 23.5 Installing ONOS package - PASS (tick)
  • 23.6 Set up ONOS secure SSH - PASS (tick)
  • 23.7 Checking ONOS service - PASS (tick)
  • 23.8 Starting ONOS CLI sessions - PASS (tick)
  • 23.9 Checking ONOS nodes - PASS (tick)
  • 23.10 Checking ONOS applications - PASS (tick)
  • 23.11 Starting Mininet Topology - PASS (tick)
  • 23.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 23.13 Check whether all flow status are ADDED - PASS (tick)
  • 23.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - PASS (tick)
  • 23.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - PASS (tick)
  • 23.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 23.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 23.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 23.19 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 23.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS (tick)
  • 23.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - PASS (tick)
  • 23.22 Stopping Mininet - PASS (tick)
  • 23.23 Copying karaf logs - PASS (tick)

Case 33: Changing port configuration from untagged 10 to untagged 110, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 33.1 Apply cell to environment - PASS (tick)
  • 33.2 Uninstalling Atomix - PASS (tick)
  • 33.3 Uninstalling ONOS package - PASS (tick)
  • 33.4 Installing Atomix - PASS (tick)
  • 33.5 Installing ONOS package - PASS (tick)
  • 33.6 Set up ONOS secure SSH - PASS (tick)
  • 33.7 Checking ONOS service - PASS (tick)
  • 33.8 Starting ONOS CLI sessions - PASS (tick)
  • 33.9 Checking ONOS nodes - PASS (tick)
  • 33.10 Checking ONOS applications - PASS (tick)
  • 33.11 Starting Mininet Topology - PASS (tick)
  • 33.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 33.13 Check whether all flow status are ADDED - PASS (tick)
  • 33.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_Before - PASS (tick)
  • 33.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_Before - PASS (tick)
  • 33.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 33.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 33.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 33.19 Check whether all flow status are ADDED - FAIL (error)
  • Flow status is wrong!
  • PASS (tick)
  • 33.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE33_After - PASS (tick)
  • 33.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE33_After - PASS (tick)
  • 33.22 Stopping Mininet - PASS (tick)
  • 33.23 Copying karaf logs - PASS (tick)

...

  • 113.1 Apply cell to environment - PASS (tick)
  • 113.2 Uninstalling Atomix - PASS (tick)
  • 113.3 Uninstalling ONOS package - PASS (tick)
  • 113.4 Installing Atomix - PASS (tick)
  • 113.5 Installing ONOS package - PASS (tick)
  • 113.6 Set up ONOS secure SSH - PASS (tick)
  • 113.7 Checking ONOS service - PASS (tick)
  • 113.8 Starting ONOS CLI sessions - PASS (tick)
  • 113.9 Checking ONOS nodes - PASS (tick)
  • 113.10 Checking ONOS applications - PASS (tick)
  • 113.11 Starting Mininet Topology - PASS (tick)
  • 113.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 113.13 Check whether all flow status are ADDED - PASS (tick)
  • 113.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_Before - PASS (tick)
  • 113.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE113_Before - PASS (tick)
  • 113.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 113.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - FAIL (error)
    • Flow count looks wrong: 18
  • PASS (tick)
  • 113.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 113.19 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 113.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_After - PASS (tick)
  • 113.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE113_After - PASS (tick)
  • 113.22 Stopping Mininet - PASS (tick)
  • 113.23 Copying karaf logs - PASS (tick)

...

  • 213.1 Apply cell to environment - PASS (tick)
  • 213.2 Uninstalling Atomix - PASS (tick)
  • 213.3 Uninstalling ONOS package - PASS (tick)
  • 213.4 Installing Atomix - PASS (tick)
  • 213.5 Installing ONOS package - PASS (tick)
  • 213.6 Set up ONOS secure SSH - PASS (tick)
  • 213.7 Checking ONOS service - PASS (tick)
  • 213.8 Starting ONOS CLI sessions - PASS (tick)
  • 213.9 Checking ONOS nodes - PASS (tick)
  • 213.10 Checking ONOS applications - PASS (tick)
  • 213.11 Starting Mininet Topology - PASS (tick)
  • 213.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.13 Check whether all flow status are ADDED - PASS (tick)
  • 213.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_Before - PASS (tick)
  • 213.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_Before - PASS (tick)
  • 213.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 213.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 213.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.19 Check whether all flow status are ADDED - PASS (tick)
  • 213.20 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_After - PASS (tick)
  • 213.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_After - PASS (tick)
  • 213.22 Stopping Mininet - PASS (tick)
  • 213.23 Copying karaf logs - PASS (tick)

Case 223: Changing port configuration from tagged 20 and native 10 to tagged 120 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 223.1 Apply cell to environment - PASS (tick)
  • 223.2 Uninstalling Atomix - PASS (tick)
  • 223.3 Uninstalling ONOS package - PASS (tick)
  • 223.4 Installing Atomix - PASS (tick)
  • 223.5 Installing ONOS package - PASS (tick)
  • 223.6 Set up ONOS secure SSH - PASS (tick)
  • 223.7 Checking ONOS service - PASS (tick)
  • 223.8 Starting ONOS CLI sessions - PASS (tick)
  • 223.9 Checking ONOS nodes - PASS (tick)
  • 223.10 Checking ONOS applications - PASS (tick)
  • 223.11 Starting Mininet Topology - PASS (tick)
  • 223.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.13 Check whether all flow status are ADDED - PASS (tick)
  • 223.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE223_Before - PASS (tick)
  • 223.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE223_Before - PASS (tick)
  • 223.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 223.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 223.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.19 Check whether all flow status are ADDED - FAIL (error)
  • Flow status is wrong!
  • PASS (tick)
  • 223.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE223_After - PASS (tick)
  • 223.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE223_After - PASS (tick)
  • 223.22 Stopping Mininet - PASS (tick)
  • 223.23 Copying karaf logs - PASS (tick)

Case 233: Consecutive configuration changes, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

  • 233.1 Apply cell to environment - PASS (tick)
  • 233.2 Uninstalling Atomix - PASS (tick)
  • 233.3 Uninstalling ONOS package - PASS (tick)
  • 233.4 Installing Atomix - PASS (tick)
  • 233.5 Installing ONOS package - PASS (tick)
  • 233.6 Set up ONOS secure SSH - PASS (tick)
  • 233.7 Checking ONOS service - PASS (tick)
  • 233.8 Starting ONOS CLI sessions - PASS (tick)
  • 233.9 Checking ONOS nodes - PASS (tick)
  • 233.10 Checking ONOS applications - PASS (tick)
  • 233.11 Starting Mininet Topology - PASS (tick)
  • 233.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.13 Check whether all flow status are ADDED - PASS (tick)
  • 233.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_Before - PASS (tick)
  • 233.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_Before - PASS (tick)
  • 233.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.18 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.19 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_1 - PASS (tick)
  • 233.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_1 - PASS (tick)
  • 233.22 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.23 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.24 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_2 - PASS (tick)
  • 233.25 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_2 - PASS (tick)
  • 233.26 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.27 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.28 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_3 - PASS (tick)
  • 233.29 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_3 - PASS (tick)
  • 233.30 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.31 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.32 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_4 - PASS (tick)
  • 233.33 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_4 - FAIL (error)
    • IP connectivity failed
  • 233.34 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.35 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.36 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_5 - PASS (tick)
  • 233.37 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_5 - PASS (tick)
  • 233.38 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.39 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.40 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_6 - PASS (tick)
  • 233.41 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_6 - PASS (tick)
  • 233.42 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.43 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.44 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.45 Check whether all flow status are ADDED - PASS (tick)
  • 233.46 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_After - PASS (tick)
  • 233.47 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_After - PASS (tick)
  • 233.48 Stopping Mininet - PASS (tick)
  • 233.49 Copying karaf logs - PASS (tick)

Case 243: Changing port configuration from 10.0.2.254/24 to 10.0.6.254/24, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

  • 243.1 Apply cell to environment - PASS (tick)
  • 243.2 Uninstalling Atomix - PASS (tick)
  • 243.3 Uninstalling ONOS package - PASS (tick)
  • 243.4 Installing Atomix - PASS (tick)
  • 243.5 Installing ONOS package - PASS (tick)
  • 243.6 Set up ONOS secure SSH - PASS (tick)
  • 243.7 Checking ONOS service - PASS (tick)
  • 243.8 Starting ONOS CLI sessions - PASS (tick)
  • 243.9 Checking ONOS nodes - PASS (tick)
  • 243.10 Checking ONOS applications - PASS (tick)
  • 243.11 Starting Mininet Topology - PASS (tick)
  • 243.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 243.13 Check whether all flow status are ADDED - PASS (tick)
  • 243.14 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_Before - FAIL (error)
    • IP connectivity failed
  • 243.15 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 243.16 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 243.17 Check whether the flow count is bigger than 104 - PASS (tick)
  • 243.18 Check whether all flow status are ADDED - PASS (tick)
  • 243.19 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_After - FAIL (error)
    • IP connectivity failed
  • 243.20 Stopping Mininet - PASS (tick)
  • 243.21 Copying karaf logs - PASS (tick)