Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
SRDynamic at 07 14 Nov 2020 12:3841:0604

HTML
<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric2/lastSuccessfulBuild/artifact/SRDynamic_onos-1.15_20-builds_graph.jpg", alt="SRDynamic", style="width:525px;height:350px;border:0">

commit 7898ceda95b0e27a048c9fcee5e5c8daa332a4d4 (HEAD -] onos-1.15, origin/onos-1.15)
Author: Jian Li [pyguni@gmail.com]
AuthorDate: Mon Oct 5 22:36:41 2020 +0900
Commit: Jian Li [pyguni@gmail.com]
CommitDate: Mon Oct 5 22:56:34 2020 +0900

Fix: make all openstack resource name optional

Case 1: Bridging and Routing sanity test with 2x2 Leaf-spineand 1 nodes. - FAIL

  • 1.1 Constructing test variables - PASS (tick)
  • 1.2 Apply cell to environment - PASS (tick)
  • 1.3 Uninstalling Atomix - PASS (tick)
  • 1.4 Uninstalling ONOS package - PASS (tick)
  • 1.5 Creating ONOS package - PASS (tick)
  • 1.6 Installing Atomix - PASS (tick)
  • 1.7 Installing ONOS package - PASS (tick)
  • 1.8 Set up ONOS secure SSH - PASS (tick)
  • 1.9 Checking ONOS service - PASS (tick)
  • 1.10 Starting ONOS CLI sessions - PASS (tick)
  • 1.11 Checking ONOS nodes - PASS (tick)
  • 1.12 Checking ONOS applications - PASS (tick)
  • 1.13 Starting Mininet Topology - PASS (tick)
  • 1.14 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.15 Check whether all flow status are ADDED - PASS (tick)
  • 1.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1 - FAIL (error)
    • IP connectivity failed
  • 1.17 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1 - PASS (tick)
  • 1.18 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1 - PASS (tick)
  • 1.19 Pushing new configuration - No Result (warning)
  • 1.20 Pushing new configuration - No Result (warning)
  • 1.21 Check whether the flow count is bigger than 140 - PASS (tick)
  • 1.22 Check whether all flow status are ADDED - PASS (tick)
  • 1.23 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', 'in1', 'out1'] with tag CASE1 - FAIL (error)
    • IP connectivity failed
  • 1.24 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1 - PASS (tick)
  • 1.25 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1 - PASS (tick)
  • 1.26 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE1 - PASS (tick)
  • 1.27 Stopping Mininet - PASS (tick)
  • 1.28 Copying karaf logs - PASS (tick)

Case 2: Bridging and Routing sanity test with 4x4 Leaf-spineand 1 nodes. - FAIL

  • 2.1 Apply cell to environment - PASS (tick)
  • 2.2 Uninstalling Atomix - PASS (tick)
  • 2.3 Uninstalling ONOS package - PASS (tick)
  • 2.4 Creating ONOS package - PASS (tick)
  • 2.5 Installing Atomix - PASS (tick)
  • 2.6 Installing ONOS package - PASS (tick)
  • 2.7 Set up ONOS secure SSH - PASS (tick)
  • 2.8 Checking ONOS service - PASS (tick)
  • 2.9 Starting ONOS CLI sessions - PASS (tick)
  • 2.10 Checking ONOS nodes - PASS (tick)
  • 2.11 Checking ONOS applications - PASS (tick)
  • 2.12 Starting Mininet Topology - PASS (tick)
  • 2.13 Check whether the flow count is bigger than 350 - PASS (tick)
  • 2.14 Check whether all flow status are ADDED - PASS (tick)
  • 2.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE2 - FAIL (error)
    • IP connectivity failed
  • 2.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2 - PASS (tick)
  • 2.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2 - PASS (tick)
  • 2.18 Pushing new configuration - No Result (warning)
  • 2.19 Pushing new configuration - No Result (warning)
  • 2.20 Check whether the flow count is bigger than 380 - PASS (tick)
  • 2.21 Check whether all flow status are ADDED - PASS (tick)
  • 2.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8', 'in1', 'out1'] with tag CASE2 - FAIL (error)
    • IP connectivity failed
  • 2.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2 - PASS (tick)
  • 2.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2 - PASS (tick)
  • 2.25 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE2 - PASS (tick)
  • 2.26 Stopping Mininet - PASS (tick)
  • 2.27 Copying karaf logs - PASS (tick)

Case 3: Bridging and Routing sanity test with single switchand 1 nodes. - FAIL

  • 3.1 Apply cell to environment - PASS (tick)
  • 3.2 Uninstalling Atomix - PASS (tick)
  • 3.3 Uninstalling ONOS package - PASS (tick)
  • 3.4 Creating ONOS package - PASS (tick)
  • 3.5 Installing Atomix - PASS (tick)
  • 3.6 Installing ONOS package - PASS (tick)
  • 3.7 Set up ONOS secure SSH - PASS (tick)
  • 3.8 Checking ONOS service - PASS (tick)
  • 3.9 Starting ONOS CLI sessions - PASS (tick)
  • 3.10 Checking ONOS nodes - PASS (tick)
  • 3.11 Checking ONOS applications - PASS (tick)
  • 3.12 Starting Mininet Topology - PASS (tick)
  • 3.13 Check whether the flow count is bigger than 15 - PASS (tick)
  • 3.14 Check whether all flow status are ADDED - PASS (tick)
  • 3.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE3 - PASS (tick)
  • 3.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3 - PASS (tick)
  • 3.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3 - PASS (tick)
  • 3.18 Pushing new configuration - No Result (warning)
  • 3.19 Pushing new configuration - No Result (warning)
  • 3.20 Check whether the flow count is bigger than 18 - PASS (tick)
  • 3.21 Check whether all flow status are ADDED - PASS (tick)
  • 3.22 Verify full connectivity for [u'h1', u'h2', 'in1', 'out1'] with tag CASE3 - FAIL (error)
    • IP connectivity failed
  • 3.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3 - PASS (tick)
  • 3.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3 - PASS (tick)
  • 3.25 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE3 - PASS (tick)
  • 3.26 Stopping Mininet - PASS (tick)
  • 3.27 Copying karaf logs - PASS (tick)

Case 4: Bridging and Routing sanity test with 2x2 Leaf-spineand 3 nodes. Also, killing the first Onos and removing the host cfg. - FAIL

  • 4.1 Apply cell to environment - PASS (tick)
  • 4.2 Uninstalling Atomix - PASS (tick)
  • 4.3 Uninstalling ONOS package - PASS (tick)
  • 4.4 Creating ONOS package - PASS (tick)
  • 4.5 Installing Atomix - PASS (tick)
  • 4.6 Installing ONOS package - PASS (tick)
  • 4.7 Set up ONOS secure SSH - PASS (tick)
  • 4.8 Checking ONOS service - PASS (tick)
  • 4.9 Starting ONOS CLI sessions - PASS (tick)
  • 4.10 Checking ONOS nodes - PASS (tick)
  • 4.11 Checking ONOS applications - PASS (tick)
  • 4.12 Starting Mininet Topology - PASS (tick)
  • 4.13 Check whether the flow count is bigger than 116 - PASS (tick)
  • 4.14 Check whether all flow status are ADDED - PASS (tick)
  • 4.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE4 - FAIL (error)
    • IP connectivity failed
  • 4.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4 - PASS (tick)
  • 4.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4 - PASS (tick)
  • 4.18 Pushing new configuration - No Result (warning)
  • 4.19 Pushing new configuration - No Result (warning)
  • 4.20 Check whether the flow count is bigger than 140 - PASS (tick)
  • 4.21 Check whether all flow status are ADDED - PASS (tick)
  • 4.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', 'in1', 'out1'] with tag CASE4 - FAIL (error)
    • IP connectivity failed
  • 4.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4 - PASS (tick)
  • 4.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4 - PASS (tick)
  • 4.25 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE4 - PASS (tick)
  • 4.26 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 4.27 Check number of topology elements - FAIL (error)
    • Unexpected number of links, switches, and/or controllers
  • 4.28 Removing host configuration - No Result (warning)
  • 4.29 Removing configuration - No Result (warning)
  • 4.30 Removing vlan configuration - No Result (warning)
  • 4.31 Check whether the flow count is bigger than 116 - PASS (tick)
  • 4.32 Check whether all flow status are ADDED - PASS (tick)
  • 4.33 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', 'in1', 'out1'] with tag CASE4_After - PASS (tick)
  • 4.34 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_After - PASS (tick)
  • 4.35 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_After - PASS (tick)
  • 4.36 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE4_After - PASS (tick)
  • 4.37 Stopping Mininet - PASS (tick)
  • 4.38 Copying karaf logs - PASS (tick)

Case 5: Bridging and Routing sanity test with 4x4 Leaf-spineand 3 nodes. Also, killing the first Onos and removing the host cfg. - FAIL

  • 5.1 Apply cell to environment - PASS (tick)
  • 5.2 Uninstalling Atomix - PASS (tick)
  • 5.3 Uninstalling ONOS package - PASS (tick)
  • 5.4 Creating ONOS package - PASS (tick)
  • 5.5 Installing Atomix - PASS (tick)
  • 5.6 Installing ONOS package - PASS (tick)
  • 5.7 Set up ONOS secure SSH - PASS (tick)
  • 5.8 Checking ONOS service - PASS (tick)
  • 5.9 Starting ONOS CLI sessions - PASS (tick)
  • 5.10 Checking ONOS nodes - PASS (tick)
  • 5.11 Checking ONOS applications - PASS (tick)
  • 5.12 Starting Mininet Topology - PASS (tick)
  • 5.13 Check whether the flow count is bigger than 350 - PASS (tick)
  • 5.14 Check whether all flow status are ADDED - PASS (tick)
  • 5.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE5 - FAIL (error)
    • IP connectivity failed
  • 5.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE5 - PASS (tick)
  • 5.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE5 - PASS (tick)
  • 5.18 Pushing new configuration - No Result (warning)
  • 5.19 Pushing new configuration - No Result (warning)
  • 5.20 Check whether the flow count is bigger than 380 - PASS (tick)
  • 5.21 Check whether all flow status are ADDED - PASS (tick)
  • 5.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8', 'in1', 'out1'] with tag CASE5 - FAIL (error)
    • IP connectivity failed
  • 5.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE5 - PASS (tick)
  • 5.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE5 - PASS (tick)
  • 5.25 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE5 - PASS (tick)
  • 5.26 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 5.27 Check number of topology elements - FAIL (error)
    • Unexpected number of links, switches, and/or controllers
  • 5.28 Removing host configuration - No Result (warning)
  • 5.29 Removing configuration - No Result (warning)
  • 5.30 Removing vlan configuration - No Result (warning)
  • 5.31 Check whether the flow count is bigger than 350 - PASS (tick)
  • 5.32 Check whether all flow status are ADDED - PASS (tick)
  • 5.33 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8', 'in1', 'out1'] with tag CASE5_After - PASS (tick)
  • 5.34 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE5_After - PASS (tick)
  • 5.35 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE5_After - PASS (tick)
  • 5.36 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE5_After - PASS (tick)
  • 5.37 Stopping Mininet - PASS (tick)
  • 5.38 Copying karaf logs - PASS (tick)

Case 6: Bridging and Routing sanity test with single switchand 3 nodes. Also, killing the first Onos and removing the host cfg. - FAIL

  • 6.1 Apply cell to environment - PASS (tick)
  • 6.2 Uninstalling Atomix - PASS (tick)
  • 6.3 Uninstalling ONOS package - PASS (tick)
  • 6.4 Creating ONOS package - PASS (tick)
  • 6.5 Installing Atomix - PASS (tick)
  • 6.6 Installing ONOS package - PASS (tick)
  • 6.7 Set up ONOS secure SSH - PASS (tick)
  • 6.8 Checking ONOS service - PASS (tick)
  • 6.9 Starting ONOS CLI sessions - PASS (tick)
  • 6.10 Checking ONOS nodes - PASS (tick)
  • 6.11 Checking ONOS applications - PASS (tick)
  • 6.12 Starting Mininet Topology - PASS (tick)
  • 6.13 Check whether the flow count is bigger than 15 - PASS (tick)
  • 6.14 Check whether all flow status are ADDED - PASS (tick)
  • 6.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE6 - PASS (tick)
  • 6.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE6 - PASS (tick)
  • 6.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE6 - PASS (tick)
  • 6.18 Pushing new configuration - No Result (warning)
  • 6.19 Pushing new configuration - No Result (warning)
  • 6.20 Check whether the flow count is bigger than 20 - PASS (tick)
  • 6.21 Check whether all flow status are ADDED - PASS (tick)
  • 6.22 Verify full connectivity for [u'h1', u'h2', 'in1', 'out1'] with tag CASE6 - FAIL (error)
    • IP connectivity failed
  • 6.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE6 - PASS (tick)
  • 6.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE6 - PASS (tick)
  • 6.25 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE6 - PASS (tick)
  • 6.26 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 6.27 Check number of topology elements - PASS (tick)
  • 6.28 Removing host configuration - No Result (warning)
  • 6.29 Removing configuration - No Result (warning)
  • 6.30 Removing vlan configuration - No Result (warning)
  • 6.31 Check whether the flow count is bigger than 15 - PASS (tick)
  • 6.32 Check whether all flow status are ADDED - PASS (tick)
  • 6.33 Verify full connectivity for [u'h1', u'h2', 'in1', 'out1'] with tag CASE6_After - PASS (tick)
  • 6.34 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE6_After - PASS (tick)
  • 6.35 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE6_After - PASS (tick)
  • 6.36 Verify full connectivity for ['olt1', 'vsg1'] with tag CASE6_After - PASS (tick)
  • 6.37 Stopping Mininet - PASS (tick)
  • 6.38 Copying karaf logs - PASS (tick)