Page History

...

<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric3/lastSuccessfulBuild/artifact/SRHighAvailability_onos-2.2_20-builds_graph.jpg", alt="SRHighAvailability", style="width:525px;height:350px;border:0">

commit 1d4756928df452b61a0d51919d9aab80b7447bfe bed5cd95ae3d05cd6170d427d581129e1d1d2e7a (HEAD -] onos-2.2, origin/onos-2.2)
Author: Robert MacDavid [robertmacdavid@gmail.comONOS Jenkins User [jenkins@onlab.us]
AuthorDate: Thu May 21 21:32:38 2020 -0400Fri Jun 12 18:48:05 2020 +0000
Commit: Carmelo Cascone [carmelo@opennetworking.orgONOS Jenkins User [jenkins@onlab.us]
CommitDate: Fri May 29 02:30:01 Jun 12 18:48:05 2020 +0000
Rewrite the SPGW P4 pipeline.
--
This commit makes two changes to the fabric.p4 source files:
1. Routing is now done on a metadata field instead of the ipv4 header.
Routing on the ipv4 header is incorrect if the packet is encapsulated
with an outer IPV4 header. The metadata field is updated each time the
ipv4 destination changes, or an outer header is added or removed. These
changes require no control plane modifications due to @name annotations.
2. The spgw control blocks have been rewritten to support the logical UP4
--
(cherry picked from commit bec6b6a7b0f33812c6f6904d9f9b629539446e79)

Starting snapshot 2.2.3-SNAPSHOT

Case 1: High Availability tests - ONOS failures 2x2 Leaf-spine - FAIL

...

Case 2: High Availability tests - ONOS random failures 2x2 Leaf-spine - FAIL

• 2.1 Apply cell to environment - PASS
• 2.2 Uninstalling Atomix - PASS
• 2.3 Uninstalling ONOS package - PASS
• 2.4 Creating ONOS package - PASS
• 2.5 Installing Atomix - PASS
• 2.6 Installing ONOS package - PASS
• 2.7 Set up ONOS secure SSH - PASS
• 2.8 Checking ONOS service - PASS
• 2.9 Starting ONOS CLI sessions - PASS
• 2.10 Checking ONOS nodes - PASS
• 2.11 Checking ONOS applications - PASS
• 2.12 Starting Mininet Topology - PASS
• 2.13 Check whether the flow count is bigger than 116 - PASS
• 2.14 Check whether all flow status are ADDED - PASS
• 2.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2 - FAIL
• IP connectivity failed
• 2.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2 - FAIL
• IP connectivity failed
• 2.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2 - FAIL
• IP connectivity failed
• 2.18 Killing ONOS instances with index(es): [2] - PASS
• 2.19 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 2.20 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure1 - FAIL
• IP connectivity failed
• 2.21 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure1 - FAIL
• IP connectivity failed
• 2.22 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure1 - FAIL
• IP connectivity failed
• 2.23 Recovering ONOS instances with index(es): [2] - PASS
• 2.24 Checking if ONOS CLI is ready - PASS
• 2.25 Checking ONOS nodes - PASS
• 2.26 Check number of topology elements - PASS
• 2.27 Check whether the flow count is bigger than 116 - PASS
• 2.28 Check whether all flow status are ADDED - PASS
• 2.29 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 2.30 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 2.31 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 2.32 Killing ONOS instances with index(es): [1] - PASS
• 2.33 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 2.34 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure2 - FAIL
• IP connectivity failed
• 2.35 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure2 - FAIL
• IP connectivity failed
• 2.36 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure2 - FAIL
• IP connectivity failed
• 2.37 Recovering ONOS instances with index(es): [1] - PASS
• 2.38 Checking if ONOS CLI is ready - PASS
• 2.39 Checking ONOS nodes - PASS
• 2.40 Check number of topology elements - PASS
• 2.41 Check whether the flow count is bigger than 116 - PASS
• 2.42 Check whether all flow status are ADDED - PASS
• 2.43 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 2.44 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 2.45 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 2.46 Killing ONOS instances with index(es): [1] - PASS
• 2.47 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 2.48 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure3 - FAIL
• IP connectivity failed
• 2.49 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure3 - FAIL
• IP connectivity failed
• 2.50 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure3 - FAIL
• IP connectivity failed
• 2.51 Recovering ONOS instances with index(es): [1] - PASS
• 2.52 Checking if ONOS CLI is ready - PASS
• 2.53 Checking ONOS nodes - PASS
• 2.54 Check number of topology elements - PASS
• 2.55 Check whether the flow count is bigger than 116 - PASS
• 2.56 Check whether all flow status are ADDED - PASS
• 2.57 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 2.58 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 2.59 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 2.60 Stopping Mininet - PASS
• 2.61 Copying karaf logs - PASS

Case 3: High Availability tests - ONOS failures 4x4 Leaf-spine - FAIL

• 3.1 Apply cell to environment - PASS
• 3.2 Uninstalling Atomix - PASS
• 3.3 Uninstalling ONOS package - PASS
• 3.4 Creating ONOS package - PASS
• 3.5 Installing Atomix - PASS
• 3.6 Installing ONOS package - PASS
• 3.7 Set up ONOS secure SSH - PASS
• 3.8 Checking ONOS service - PASS
• 3.9 Starting ONOS CLI sessions - PASS
• 3.10 Checking ONOS nodes - PASS
• 3.11 Checking ONOS applications - PASS
• 3.12 Starting Mininet Topology - PASS
• 3.13 Check whether the flow count is bigger than 350 - PASS
• 3.14 Check whether all flow status are ADDED - PASS
• 3.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3 - FAIL
• IP connectivity failed
• 3.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3 - FAIL
• IP connectivity failed
• 3.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3 - FAIL
• IP connectivity failed
• 3.18 Killing ONOS instances with index(es): [0] - PASS
• 3.19 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 3.20 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure1 - FAIL
• IP connectivity failed
• 3.21 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure1 - FAIL
• IP connectivity failed
• 3.22 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure1 - FAIL
• IP connectivity failed
• 3.23 Recovering ONOS instances with index(es): [0] - PASS
• 3.24 Checking if ONOS CLI is ready - PASS
• 3.25 Checking ONOS nodes - PASS
• 3.26 Check number of topology elements - PASS
• 3.27 Check whether the flow count is bigger than 350 - PASS
• 3.28 Check whether all flow status are ADDED - PASS
• 3.29 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 3.30 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 3.31 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 3.32 Killing ONOS instances with index(es): [1] - PASS
• 3.33 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 3.34 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure2 - FAIL
• IP connectivity failed
• 3.35 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure2 - FAIL
• IP connectivity failed
• 3.36 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure2 - FAIL
• IP connectivity failed
• 3.37 Recovering ONOS instances with index(es): [1] - PASS
• 3.38 Checking if ONOS CLI is ready - PASS
• 3.39 Checking ONOS nodes - PASS
• 3.40 Check number of topology elements - PASS
• 3.41 Check whether the flow count is bigger than 350 - PASS
• 3.42 Check whether all flow status are ADDED - PASS
• 3.43 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 3.44 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 3.45 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 3.46 Killing ONOS instances with index(es): [2] - PASS
• 3.47 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 3.48 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure3 - FAIL
• IP connectivity failed
• 3.49 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure3 - FAIL
• IP connectivity failed
• 3.50 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure3 - FAIL
• IP connectivity failed
• 3.51 Recovering ONOS instances with index(es): [2] - PASS
• 3.52 Checking if ONOS CLI is ready - PASS
• 3.53 Checking ONOS nodes - PASS
• 3.54 Check number of topology elements - PASS
• 3.55 Check whether the flow count is bigger than 350 - PASS
• 3.56 Check whether all flow status are ADDED - PASS
• 3.57 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 3.58 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 3.59 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 3.60 Stopping Mininet - PASS
• 3.61 Copying karaf logs - PASS

Case 4: High Availability tests - ONOS random failures 4x4 Leaf-spine - FAIL

• 4.1 Apply cell to environment - PASS
• 4.2 Uninstalling Atomix - PASS
• 4.3 Uninstalling ONOS package - PASS
• 4.4 Creating ONOS package - PASS
• 4.5 Installing Atomix - PASS
• 4.6 Installing ONOS package - PASS
• 4.7 Set up ONOS secure SSH - PASS
• 4.8 Checking ONOS service - PASS
• 4.9 Starting ONOS CLI sessions - PASS
• 4.10 Checking ONOS nodes - PASS
• 4.11 Checking ONOS applications - PASS
• 4.12 Starting Mininet Topology - PASS
• 4.13 Check whether the flow count is bigger than 350 - PASS
• 4.14 Check whether all flow status are ADDED - PASS
• 4.15 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4 - FAIL
• IP connectivity failed
• 4.16 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4 - FAIL
• IP connectivity failed
• 4.17 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4 - FAIL
• IP connectivity failed
• 4.18 Killing ONOS instances with index(es): [1] - PASS
• 4.19 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 4.20 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure1 - FAIL
• IP connectivity failed
• 4.21 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure1 - FAIL
• IP connectivity failed
• 4.22 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure1 - FAIL
• IP connectivity failed
• 4.23 Recovering ONOS instances with index(es): [1] - PASS
• 4.24 Checking if ONOS CLI is ready - PASS
• 4.25 Checking ONOS nodes - PASS
• 4.26 Check number of topology elements - PASS
• 4.27 Check whether the flow count is bigger than 350 - PASS
• 4.28 Check whether all flow status are ADDED - PASS
• 4.29 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 4.30 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 4.31 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery1 - FAIL
• IP connectivity failed
• 4.32 Killing ONOS instances with index(es): [1] - PASS
• 4.33 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 4.34 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure2 - FAIL
• IP connectivity failed
• 4.35 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure2 - FAIL
• IP connectivity failed
• 4.36 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure2 - FAIL
• IP connectivity failed
• 4.37 Recovering ONOS instances with index(es): [1] - PASS
• 4.38 Checking if ONOS CLI is ready - PASS
• 4.39 Checking ONOS nodes - PASS
• 4.40 Check number of topology elements - PASS
• 4.41 Check whether the flow count is bigger than 350 - PASS
• 4.42 Check whether all flow status are ADDED - PASS
• 4.43 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 4.44 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 4.45 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery2 - FAIL
• IP connectivity failed
• 4.46 Killing ONOS instances with index(es): [0] - PASS
• 4.47 Check number of topology elements - FAIL
• Unexpected number of links, switches, and/or controllers
• 4.48 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure3 - FAIL
• IP connectivity failed
• 4.49 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure3 - FAIL
• IP connectivity failed
• 4.50 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure3 - FAIL
• IP connectivity failed
• 4.51 Recovering ONOS instances with index(es): [0] - PASS
• 4.52 Checking if ONOS CLI is ready - PASS
• 4.53 Checking ONOS nodes - PASS
• 4.54 Check number of topology elements - PASS
• 4.55 Check whether the flow count is bigger than 350 - PASS
• 4.56 Check whether all flow status are ADDED - PASS
• 4.57 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 4.58 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 4.59 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery3 - FAIL
• IP connectivity failed
• 4.60 Stopping Mininet - PASS
• 4.61 Copying karaf logs - PASS

Case 5: High Availability tests - ONOS failures and Switch failures 2x2 Leaf-spine - No Result