Versions Compared

Old Version 31

changes.mady.by.user Jenkins Technical User

Saved on

compared with

New Version 48

changes.mady.by.user Jenkins Technical User

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

HTML
<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric3/lastSuccessfulBuild/artifact/SRHighAvailability_onos-2.2_20-builds_graph.jpg", alt="SRHighAvailability", style="width:525px;height:350px;border:0">

commit 1d4756928df452b61a0d51919d9aab80b7447bfe 4f4c5343660c8dae0f7fd0c00560e3bd0395ecb2 (HEAD -] onos-2.2, origin/onos-2.2)
Author: Robert MacDavid [robertmacdavid@gmailMatteo Scandolo [matteo.scandolo@gmail.com]
AuthorDate: Thu May 21 21:32:38 2020 -0400Fri Oct 23 10:17:00 2020 -0700
Commit: Carmelo Cascone [carmelo@opennetworkingPier Luigi Ventre [pier@opennetworking.org]
CommitDate: Fri May 29 02:30:01 Sat Oct 24 08:22:19 2020 +0000
Rewrite the SPGW P4 pipeline.
--
This commit makes two changes to the fabric.p4 source files:
1. Routing is now done on a metadata field instead of the ipv4 header.
Routing on the ipv4 header is incorrect if the packet is encapsulated
with an outer IPV4 header. The metadata field is updated each time the
ipv4 destination changes, or an outer header is added or removed. These
changes require no control plane modifications due to @name annotations.
2. The spgw control blocks have been rewritten to support the logical UP4
--
(cherry picked from commit bec6b6a7b0f33812c6f6904d9f9b629539446e79)

Case 1: High Availability tests - ONOS failures 2x2 Leaf-spine - FAIL


Adding helper method in RADIUS packet

Case 1: High Availability tests - ONOS failures 2x2 Leaf-spine - PASS

  • 1.1 Constructing test variables - PASS (tick)
  • 1.2 Apply cell to environment - PASS (tick)
  • 1.3 Uninstalling Atomix - PASS (tick)
  • 1.4 Uninstalling ONOS package - PASS (tick)
  • 1.5 Creating ONOS package - PASS (tick)
  • 1.6 Installing Atomix - PASS (tick)
  • 1.7 Installing ONOS package - PASS (tick)
  • 1.8 Set up ONOS secure SSH - PASS (tick)
  • 1.9 Checking ONOS service - PASS (tick)
  • 1.10 Starting ONOS CLI sessions - PASS (tick)
  • 1.11 Checking ONOS nodes - PASS (tick)
  • 1.12 Checking ONOS applications - PASS (tick)
  • 1.13 Set logging levels - PASS (tick)
  • 1.14 Set ONOS configurations - PASS (tick)
  • 1.15 Starting Mininet Topology - PASS (tick)
  • 1.16 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.17 Check whether all flow status are ADDED - PASS (tick)
  • 1.18 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1 - PASS (tick)
  • 1.19 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1 - PASS (tick)
  • 1.20 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1 - PASS (tick)
  • 1.21 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 1.22 Check number of topology elements - PASS (tick)
  • 1.23 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Failure1 - PASS (tick)
  • 1.24 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure1 - PASS (tick)
  • 1.25 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure1 - PASS (tick)
  • 1.26 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 1.27 Checking if ONOS CLI is ready - PASS (tick)
  • 1.28 Checking ONOS nodes - PASS (tick)
  • 1.29 Check number of topology elements - PASS (tick)
  • 1.30 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.31 Check whether all flow status are ADDED - PASS (tick)
  • 1.32 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Recovery1 - PASS (tick)
  • 1.33 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Recovery1 - PASS (tick)
  • 1.34 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Recovery1 - PASS (tick)
  • 1.35 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 1.36 Check number of topology elements - PASS (tick)
  • 1.37 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Failure2 - PASS (tick)
  • 1.38 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure2 - PASS (tick)
  • 1.39 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure2 - PASS (tick)
  • 1.40 Recovering ONOS instances with index(es): [1] - PASS (tick)
  • 1.41 Checking if ONOS CLI is ready - PASS (tick)
  • 1.42 Checking ONOS nodes - PASS (tick)
  • 1.43 Check number of topology elements - PASS (tick)
  • 1.44 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.45 Check whether all flow status are ADDED - PASS (tick)
  • 1.46 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Recovery2 - PASS (tick)
  • 1.47 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Recovery2 - PASS (tick)
  • 1.48 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Recovery2 - PASS (tick)
  • 1.49 Killing ONOS instances with index(es): [2] - PASS (tick)
  • 1.50 Check number of topology elements - PASS (tick)
  • 1.51 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Failure3 - PASS (tick)
  • 1.52 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure3 - PASS (tick)
  • 1.53 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure3 - PASS (tick)
  • 1.54 Recovering ONOS instances with index(es): [2] - PASS (tick)
  • 1.55 Checking if ONOS CLI is ready - PASS (tick)
  • 1.56 Checking ONOS nodes - PASS (tick)
  • 1.57 Check number of topology elements - PASS (tick)
  • 1.58 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.59 Check whether all flow status are ADDED - PASS (tick)
  • 1.60 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Recovery3 - PASS (tick)
  • 1.61 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Recovery3 - PASS (tick)
  • 1.62 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Recovery3 - PASS (tick)
  • 1.63 Stopping Mininet - PASS (tick)
  • 1.64 Copying karaf logs - PASS (tick)

Case 2: High Availability tests - ONOS random failures 2x2 Leaf-spine - PASS

  • 2.1 Apply cell to environment - PASS (tick)
  • 2.2 Uninstalling Atomix - PASS (tick)
  • 2.3 Uninstalling ONOS package - PASS (tick)
  • 2.4 Creating ONOS package - PASS (tick)
  • 2.5 Installing Atomix - PASS (tick)
  • 2.6 Installing ONOS package - PASS (tick)
  • 2.7 Set up ONOS secure SSH - PASS (tick)
  • 2.8 Checking ONOS service - PASS (tick)
  • 2.9 Starting ONOS CLI sessions - PASS (tick)
  • 2.10 Checking ONOS nodes - PASS (tick)
  • 2.11 Checking ONOS applications - PASS (tick)
  • 2.12 Set logging levels - PASS (tick)
  • 2.13 Set ONOS configurations - PASS (tick)
  • 2.14 Starting Mininet Topology - PASS (tick)
  • 2.15 Check whether the flow count is bigger than 116 - PASS (tick)
  • 2.16 Check whether all flow status are ADDED - PASS (tick)
  • 2.17 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2 - PASS (tick)
  • 2.18 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2 - PASS (tick)
  • 2.19 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2 - PASS (tick)
  • 2.20 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 2.21 Check number of topology elements - PASS (tick)
  • 2.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure1 - PASS (tick)
  • 2.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure1 - PASS (tick)
  • 2.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure1 - PASS (tick)
  • 2.25 Recovering ONOS instances with index(es): [1] - PASS (tick)
  • 2.26 Checking if ONOS CLI is ready - PASS (tick)
  • 2.27 Checking ONOS nodes - PASS (tick)
  • 2.28 Check number of topology elements - PASS (tick)
  • 2.29 Check whether the flow count is bigger than 116 - PASS (tick)
  • 2.30 Check whether all flow status are ADDED - PASS (tick)
  • 2.31 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery1 - PASS (tick)
  • 2.32 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery1 - PASS (tick)
  • 2.33 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery1 - PASS (tick)
  • 2.34 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 2.35 Check number of topology elements - PASS (tick)
  • 2.36 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure2 - PASS (tick)
  • 2.37 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure2 - PASS (tick)
  • 2.38 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure2 - PASS (tick)
  • 2.39 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 2.40 Checking if ONOS CLI is ready - PASS (tick)
  • 2.41 Checking ONOS nodes - PASS (tick)
  • 2.42 Check number of topology elements - PASS (tick)
  • 2.43 Check whether the flow count is bigger than 116 - PASS (tick)
  • 2.44 Check whether all flow status are ADDED - PASS (tick)
  • 2.45 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery2 - PASS (tick)
  • 2.46 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery2 - PASS (tick)
  • 2.47 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery2 - PASS (tick)
  • 2.48 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 2.49 Check number of topology elements - PASS (tick)
  • 2.50 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Failure3 - PASS (tick)
  • 2.51 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Failure3 - PASS (tick)
  • 2.52 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Failure3 - PASS (tick)
  • 2.53 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 2.54 Checking if ONOS CLI is ready - PASS (tick)
  • 2.55 Checking ONOS nodes - PASS (tick)
  • 2.56 Check number of topology elements - PASS (tick)
  • 2.57 Check whether the flow count is bigger than 116 - PASS (tick)
  • 2.58 Check whether all flow status are ADDED - PASS (tick)
  • 2.59 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE2_ONOS_Recovery3 - PASS (tick)
  • 2.60 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE2_ONOS_Recovery3 - PASS (tick)
  • 2.61 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE2_ONOS_Recovery3 - PASS (tick)
  • 2.62 Stopping Mininet - PASS (tick)
  • 2.63 Copying karaf logs - PASS (tick)

Case 3: High Availability tests - ONOS failures 4x4 Leaf-spine - PASS

  • 3.1 Apply cell to environment - PASS (tick)
  • 3.2 Uninstalling Atomix - PASS (tick)
  • 3.3 Uninstalling ONOS package - PASS (tick)
  • 3.4 Creating ONOS package - PASS (tick)
  • 3.5 Installing Atomix - PASS (tick)
  • 3.6 Installing ONOS package - PASS (tick)
  • 3.7 Set up ONOS secure SSH - PASS (tick)
  • 3.8 Checking ONOS service - PASS (tick)
  • 3.9 Starting ONOS CLI sessions - PASS (tick)
  • 3.10 Checking ONOS nodes - PASS (tick)
  • 3.11 Checking ONOS applications - PASS (tick)
  • 3.12 Set logging levels - PASS (tick)
  • 3.13 Set ONOS configurations - PASS (tick)
  • 3.14 Starting Mininet Topology - PASS (tick)
  • 3.15 Check whether the flow count is bigger than 350 - PASS (tick)
  • 3.16 Check whether all flow status are ADDED - PASS (tick)
  • 3.17 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3 - PASS (tick)
  • 3.18 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3 - PASS (tick)
  • 3.19 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3 - PASS (tick)
  • 3.20 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 3.21 Check number of topology elements - PASS (tick)
  • 3.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure1 - PASS (tick)
  • 3.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure1 - PASS (tick)
  • 3.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure1 - PASS (tick)
  • 3.25 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 3.26 Checking if ONOS CLI is ready - PASS (tick)
  • 3.27 Checking ONOS nodes - PASS (tick)
  • 3.28 Check number of topology elements - PASS (tick)
  • 3.29 Check whether the flow count is bigger than 350 - PASS (tick)
  • 3.30 Check whether all flow status are ADDED - PASS (tick)
  • 3.31 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery1 - PASS (tick)
  • 3.32 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery1 - PASS (tick)
  • 3.33 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery1 - PASS (tick)
  • 3.34 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 3.35 Check number of topology elements - PASS (tick)
  • 3.36 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure2 - PASS (tick)
  • 3.37 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure2 - PASS (tick)
  • 3.38 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure2 - PASS (tick)
  • 3.39 Recovering ONOS instances with index(es): [1] - PASS (tick)
  • 3.40 Checking if ONOS CLI is ready - PASS (tick)
  • 3.41 Checking ONOS nodes - PASS (tick)
  • 3.42 Check number of topology elements - PASS (tick)
  • 3.43 Check whether the flow count is bigger than 350 - PASS (tick)
  • 3.44 Check whether all flow status are ADDED - PASS (tick)
  • 3.45 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery2 - PASS (tick)
  • 3.46 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery2 - PASS (tick)
  • 3.47 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery2 - PASS (tick)
  • 3.48 Killing ONOS instances with index(es): [2] - PASS (tick)
  • 3.49 Check number of topology elements - PASS (tick)
  • 3.50 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Failure3 - PASS (tick)
  • 3.51 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Failure3 - PASS (tick)
  • 3.52 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Failure3 - PASS (tick)
  • 3.53 Recovering ONOS instances with index(es): [2] - PASS (tick)
  • 3.54 Checking if ONOS CLI is ready - PASS (tick)
  • 3.55 Checking ONOS nodes - PASS (tick)
  • 3.56 Check number of topology elements - PASS (tick)
  • 3.57 Check whether the flow count is bigger than 350 - PASS (tick)
  • 3.58 Check whether all flow status are ADDED - PASS (tick)
  • 3.59 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE3_ONOS_Recovery3 - PASS (tick)
  • 3.60 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE3_ONOS_Recovery3 - PASS (tick)
  • 3.61 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE3_ONOS_Recovery3 - PASS (tick)
  • 3.62 Stopping Mininet - PASS (tick)
  • 3.63 Copying karaf logs - PASS (tick)

Case 4: High Availability tests - ONOS random failures 4x4 Leaf-spine - PASS

  • 4.1 Apply cell to environment - PASS (tick)
  • 4.2 Uninstalling Atomix - PASS (tick)
  • 4.3 Uninstalling ONOS package - PASS (tick)
  • 4.4 Creating ONOS package - PASS (tick)
  • 4.5 Installing Atomix - PASS (tick)
  • 4.6 Installing ONOS package - PASS (tick)
  • 4.7 Set up ONOS secure SSH - PASS (tick)
  • 4.8 Checking ONOS service - PASS (tick)
  • 4.9 Starting ONOS CLI sessions - PASS (tick)
  • 4.10 Checking ONOS nodes - PASS (tick)
  • 4.11 Checking ONOS applications - PASS (tick)
  • 4.12 Set logging levels - PASS (tick)
  • 4.13 Set ONOS configurations - PASS (tick)
  • 4.14 Starting Mininet Topology - PASS (tick)
  • 4.15 Check whether the flow count is bigger than 350 - PASS (tick)
  • 4.16 Check whether all flow status are ADDED - PASS (tick)
  • 4.17 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4 - PASS (tick)
  • 4.18 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4 - PASS (tick)
  • 4.19 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4 - PASS (tick)
  • 4.20 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 4.21 Check number of topology elements - PASS (tick)
  • 4.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure1 - PASS (tick)
  • 4.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure1 - PASS (tick)
  • 4.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure1 - PASS (tick)
  • 4.25 Recovering ONOS instances with index(es): [1] - PASS (tick)
  • 4.26 Checking if ONOS CLI is ready - PASS (tick)
  • 4.27 Checking ONOS nodes - PASS (tick)
  • 4.28 Check number of topology elements - PASS (tick)
  • 4.29 Check whether the flow count is bigger than 350 - PASS (tick)
  • 4.30 Check whether all flow status are ADDED - PASS (tick)
  • 4.31 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery1 - PASS (tick)
  • 4.32 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery1 - PASS (tick)
  • 4.33 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery1 - PASS (tick)
  • 4.34 Killing ONOS instances with index(es): [2] - PASS (tick)
  • 4.35 Check number of topology elements - PASS (tick)
  • 4.36 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure2 - PASS (tick)
  • 4.37 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure2 - PASS (tick)
  • 4.38 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure2 - PASS (tick)
  • 4.39 Recovering ONOS instances with index(es): [2] - PASS (tick)
  • 4.40 Checking if ONOS CLI is ready - PASS (tick)
  • 4.41 Checking ONOS nodes - PASS (tick)
  • 4.42 Check number of topology elements - PASS (tick)
  • 4.43 Check whether the flow count is bigger than 350 - PASS (tick)
  • 4.44 Check whether all flow status are ADDED - PASS (tick)
  • 4.45 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery2 - PASS (tick)
  • 4.46 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery2 - PASS (tick)
  • 4.47 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery2 - PASS (tick)
  • 4.48 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 4.49 Check number of topology elements - PASS (tick)
  • 4.50 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Failure3 - PASS (tick)
  • 4.51 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Failure3 - PASS (tick)
  • 4.52 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Failure3 - PASS (tick)
  • 4.53 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 4.54 Checking if ONOS CLI is ready - PASS (tick)
  • 4.55 Checking ONOS nodes - PASS (tick)
  • 4.56 Check number of topology elements - PASS (tick)
  • 4.57 Check whether the flow count is bigger than 350 - PASS (tick)
  • 4.58 Check whether all flow status are ADDED - PASS (tick)
  • 4.59 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE4_ONOS_Recovery3 - PASS (tick)
  • 4.60 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE4_ONOS_Recovery3 - PASS (tick)
  • 4.61 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE4_ONOS_Recovery3 - PASS (tick)
  • 4.62 Stopping Mininet - PASS (tick)
  • 4.63 Copying karaf logs - PASS (tick)

Case 5: High Availability tests - ONOS failures and Switch failures 2x2 Leaf-spine - FAIL

  • 5.1 Apply cell to environment - PASS (tick)
  • 5.2 Uninstalling Atomix - PASS (tick)
  • 5.3 Uninstalling ONOS package - PASS (tick)
  • 5.4 Creating ONOS package - PASS (tick)
  • 5.5 Installing Atomix - PASS (tick)
  • 5.6 Installing ONOS package - PASS (tick)
  • 5.7 Set up ONOS secure SSH - PASS (tick)
  • 5.8 Checking ONOS service - PASS (tick)
  • 5.9 Starting ONOS CLI sessions - PASS (tick)
  • 5.10 Checking ONOS nodes - PASS (tick)
  • 5.11 Checking ONOS applications - PASS (tick)
  • 5.12 Set logging levels - PASS (tick)
  • 5.13 Set ONOS configurations - PASS (tick)
  • 5.14 Starting Mininet Topology - PASS (tick)
  • 5.15 Check whether the flow count is bigger than 116 - PASS (tick)
  • 5.16 Check whether all flow status are ADDED - PASS (tick)
  • 5.17 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE5 - PASS (tick)
  • 5.18 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE5 - PASS (tick)
  • 5.19 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE5 - PASS (tick)
  • 5.20 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 5.21 Check number of topology elements - PASS (tick)
  • 5.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE5_ONOS_Failure1 - PASS (tick)
  • 5.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE5_ONOS_Failure1 - PASS (tick)
  • 5.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE5_ONOS_Failure1 - PASS (tick)
  • 5.25 Kill ['spine101'] - PASS (tick)
  • 5.26 Stopping Mininet - PASS (tick)
  • 5.27 Copying karaf logs - PASS (tick)
    • Skipping the rest of this case. TestON instance has no attribute 'switchSleep'

Case 6: High Availability tests - ONOS random failures and Switch random failures 2x2 Leaf-spine - FAIL

  • 6.1 Apply cell to environment - PASS (tick)
  • 6.2 Uninstalling Atomix - PASS (tick)
  • 6.3 Uninstalling ONOS package - PASS (tick)
  • 6.4 Creating ONOS package - PASS (tick)
  • 6.5 Installing Atomix - PASS (tick)
  • 6.6 Installing ONOS package - PASS (tick)
  • 6.7 Set up ONOS secure SSH - PASS (tick)
  • 6.8 Checking ONOS service - PASS (tick)
  • 6.9 Starting ONOS CLI sessions - PASS (tick)
  • 6.10 Checking ONOS nodes - PASS (tick)
  • 6.11 Checking ONOS applications - PASS (tick)
  • 6.12 Set logging levels - PASS (tick)
  • 6.13 Set ONOS configurations - PASS (tick)
  • 6.14 Starting Mininet Topology - PASS (tick)
  • 6.15 Check whether the flow count is bigger than 116 - PASS (tick)
  • 6.16 Check whether all flow status are ADDED - PASS (tick)
  • 6.17 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE6 - PASS (tick)
  • 6.18 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE6 - PASS (tick)
  • 6.19 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE6 - PASS (tick)
  • 6.20 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 6.21 Check number of topology elements - PASS (tick)
  • 6.22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE6_ONOS_Failure1 - PASS (tick)
  • 6.23 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE6_ONOS_Failure1 - PASS (tick)
  • 6.24 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE6_ONOS_Failure1 - PASS (tick)
  • 6.25 Kill ['spine102'] - PASS (tick)
  • 6.26 Stopping Mininet - PASS (tick)
  • 6.27 Copying karaf logs - PASS (tick)
    • Skipping the rest of this case. TestON instance has no attribute 'switchSleep'

Case 7: High Availability tests - ONOS failures and Switch failures 4x4 Leaf-spine - FAIL

  • 7.1 Apply cell to environment - PASS (tick)
  • 7.2 Uninstalling Atomix - PASS (tick)
  • 7.3 Uninstalling ONOS package - PASS (tick)
  • 7.4 Creating ONOS package - PASS (tick)
  • 7.5 Installing Atomix - PASS (tick)
  • 7.6 Installing ONOS package - PASS (tick)
  • 7.7
  • 1.1 Constructing test variables - PASS (tick)
  • 1.2 Apply cell to environment - PASS (tick)
  • 1.3 Uninstalling Atomix - PASS (tick)
  • 1.4 Uninstalling ONOS package - PASS (tick)
  • 1.5 Creating ONOS package - PASS (tick)
  • 1.6 Installing Atomix - PASS (tick)
  • 1.7 Installing ONOS package - PASS (tick)
  • 1.8 Set up ONOS secure SSH - PASS (tick)
  • 1 7.9 8 Checking ONOS service - PASS (tick)
  • 1.10 Starting ONOS CLI sessions - PASS (tick)
  • 1.11 Checking ONOS nodes - PASS (tick)
  • 1.12 Checking ONOS applications - PASS (tick)
  • 1.13 Starting Mininet Topology 7.9 Starting ONOS CLI sessions - PASS (tick)
  • 1.14 Check whether the flow count is bigger than 116 7.10 Checking ONOS nodes - PASS (tick) 1.15 Check whether all flow status are ADDED
  • 7.11 Checking ONOS applications - PASS (tick)
  • 1.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1 - FAIL (error)
    • IP connectivity failed
  • 1.17 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1 - FAIL (error)
    • IP connectivity failed
  • 1.18 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1 - FAIL (error)
    • IP connectivity failed
  • 1.19 Killing ONOS instances with index(es): [0] - PASS (tick)
  • 1.20 Check number of topology elements - FAIL (error)
    • Unexpected number of links, switches, and/or controllers
  • 7.12 Set logging levels - PASS (tick)
  • 7.13 Set ONOS configurations - PASS (tick)
  • 7.14 Starting Mininet Topology - PASS (tick)
  • 7.15 Check whether the flow count is bigger than 350 - PASS (tick)
  • 7.16 Check whether all flow status are ADDED - PASS (tick)
  • 7.17 1.21 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE1_ONOS_Failure1 - FAIL (error)
    • IP connectivity failed
  • CASE7 - PASS (tick)
  • 7.18 1.22 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure1 - FAIL (error)
    • IP connectivity failed
  • CASE7 - PASS (tick)
  • 7.19 1.23 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure1 - FAIL (error)
    • IP connectivity failed
  • CASE7 - PASS (tick)
  • 7.20 Killing 1.24 Recovering ONOS instances with index(es): [0] - PASS (tick)
  • 1.25 Checking if ONOS CLI is ready - PASS (tick)
  • 1.26 Checking ONOS nodes - PASS (tick)
  • 1.27 Check number of topology elements - PASS (tick)
  • 1.28 Check whether the flow count is bigger than 116 ] - PASS (tick) 1
  • 7.29 Check whether all flow status are ADDED 21 Check number of topology elements - PASS (tick)
  • 1 7.30 22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Recovery1 - FAIL (error)
    • IP connectivity failed
  • 1.31 Verify full connectivity for [u'olt10', u'h5', u'h6', u'h7', u'vsg10h8'] with tag CASE1CASE7_ONOS_Recovery1 - FAIL (error)
    • IP connectivity failed
  • Failure1 - PASS (tick)
  • 7.23 1.32 Verify full connectivity for [u'olt5olt10', u'vsg5vsg10'] with tag CASE1CASE7_ONOS_Recovery1 - FAIL (error)
    • IP connectivity failed
  • 1.33 Killing ONOS instances with index(es): [1] - PASS (tick)
  • 1.34 Check number of topology elements - FAIL (error)
    • Unexpected number of links, switches, and/or controllers
  • Failure1 - PASS (tick)
  • 7.24 1.35 Verify full connectivity for [u'h1olt5', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Failure2 - FAIL (error)
    • IP connectivity failed
  • 1.36 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure2 - FAIL (error)
    • IP connectivity failed
  • 1.37 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure2 - FAIL (error)
    • IP connectivity failed
  • 1.38 Recovering ONOS instances with index(es): [1] - PASS (tick)
  • 1.39 Checking if ONOS CLI is ready - PASS (tick)
  • 1.40 Checking ONOS nodes - PASS (tick)
  • 1.41 Check number of topology elements - PASS (tick)
  • 1.42 Check whether the flow count is bigger than 116 - PASS (tick)
  • 1.43 Check whether all flow status are ADDED - PASS (tick)
  • 1.44 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE1_ONOS_Recovery2 - FAIL (error)
    • IP connectivity failed
  • 1.45 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Recovery2 - FAIL (error)
    • IP connectivity failed
  • 1.46 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Recovery2 - FAIL (error)
    • IP connectivity failed
  • 1.47 Killing ONOS instances with index(es): [2] - PASS (tick)
  • 1.48 Check number of topology elements - FAIL (error)
    • Unexpected number of links, switches, and/or controllers
  • 'vsg5'] with tag CASE7_ONOS_Failure1 - PASS (tick)
  • 7.25 Kill ['spine101'] - PASS (tick)
  • 7.26 Stopping Mininet - PASS (tick)
  • 7.27 Copying karaf logs - PASS (tick)
    • Skipping the rest of this case. TestON instance has no attribute 'switchSleep'

Case 8: High Availability tests - ONOS random failures and Switch random failures 4x4 Leaf-spine - FAIL

  • 8.1 Apply cell to environment - PASS (tick)
  • 8.2 Uninstalling Atomix - PASS (tick)
  • 8.3 Uninstalling ONOS package - PASS (tick)
  • 8.4 Creating ONOS package - PASS (tick)
  • 8.5 Installing Atomix - PASS (tick)
  • 8.6 Installing ONOS package - PASS (tick)
  • 8.7 Set up ONOS secure SSH - PASS (tick)
  • 8.8 Checking ONOS service - PASS (tick)
  • 8.9 Starting ONOS CLI sessions - PASS (tick)
  • 8.10 Checking ONOS nodes - PASS (tick)
  • 8.11 Checking ONOS applications - PASS (tick)
  • 8.12 Set logging levels - PASS (tick)
  • 8.13 Set ONOS configurations - PASS (tick)
  • 8.14 Starting Mininet Topology - PASS (tick)
  • 8.15 Check whether the flow count is bigger than 350 - PASS (tick)
  • 8.16 Check whether all flow status are ADDED - PASS (tick)
  • 8.17 1.49 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE1_ONOS_Failure3 - FAIL (error)
    • IP connectivity failed
  • CASE8 - PASS (tick)
  • 8.18 1.50 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1_ONOS_Failure3 - FAIL (error)
    • IP connectivity failed
  • CASE8 - PASS (tick)
  • 8.19 1.51 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1_ONOS_Failure3 - FAIL (error)
    • IP connectivity failed
  • CASE8 - PASS (tick)
  • 8.20 Killing 1.52 Recovering ONOS instances with index(es): [2] - PASS (tick)
  • 1.53 Checking if ONOS CLI is ready - PASS (tick)
  • 1.54 Checking ONOS nodes - PASS (tick)
  • 1.55 Check number of topology elements - PASS (tick)
  • 1.56 Check whether the flow count is bigger than 116 0] - PASS (tick) 1
  • 8.57 Check whether all flow status are ADDED 21 Check number of topology elements - PASS (tick)
  • 1 8.58 22 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] with tag CASE1CASE8_ONOS_Recovery3 Failure1 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 8.23 1.59 Verify full connectivity for [u'olt10', u'vsg10'] with tag CASE1CASE8_ONOS_Recovery3 - FAIL (error)
    • IP connectivity failed
  • Failure1 - PASS (tick)
  • 8.24 1.60 Verify full connectivity for [u'olt5', u'vsg5'] with tag CASE1CASE8_ONOS_Recovery3 Failure1 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 8.25 Kill ['spine104'] - PASS (tick)
  • 8.26 1.61 Stopping Mininet - PASS (tick)
  • 1 8.62 27 Copying karaf logs - PASS (tick)

...

    • Skipping the rest of this case. TestON instance has no attribute 'switchSleep'