View Source

SRHighAvailability at 15 Jan 2017 15:28:59

Case 1: High Availability tests - ONOS failures with 2x2 Leaf-spine - FAIL

1.1 Constructing test variables - PASS
1.2 Create and Apply cell file - PASS
1.3 Create and Install ONOS package - PASS
1.4 Starting ONOS service - PASS
1.5 Checking if ONOS CLI is ready - PASS
1.6 Starting Mininet Topology - PASS
1.7 Check whether the flow count is bigger than 116 - PASS
1.8 Check whether all flow status are ADDED - PASS
1.9 Connectivity for [u'h1', u'h2', u'h3', u'h4'] - PASS
1.10 Connectivity for [u'olt10', u'vsg10'] - PASS
1.11 Connectivity for [u'olt5', u'vsg5'] - PASS
1.12 Killing ONOS instance - PASS
1.13 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Failure1 - PASS
1.14 Connectivity for [u'olt10', u'vsg10'] CASE1_Failure1 - PASS
1.15 Connectivity for [u'olt5', u'vsg5'] CASE1_Failure1 - PASS
1.16 Recovering ONOS instance - PASS
1.17 Checking if ONOS CLI is ready - PASS
1.18 Checking ONOS nodes - PASS
1.19 Check whether the flow count is bigger than 116 - PASS
1.20 Check whether all flow status are ADDED - PASS
1.21 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Recovery1 - PASS
1.22 Connectivity for [u'olt10', u'vsg10'] CASE1_Recovery1 - PASS
1.23 Connectivity for [u'olt5', u'vsg5'] CASE1_Recovery1 - PASS
1.24 Killing ONOS instance - FAIL

Failed to turn off ONOS Instance

1.25 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Failure2 - FAIL

IP connectivity failed

1.26 Connectivity for [u'olt10', u'vsg10'] CASE1_Failure2 - PASS
1.27 Connectivity for [u'olt5', u'vsg5'] CASE1_Failure2 - PASS
1.28 Recovering ONOS instance - FAIL

ONOS service did not start properly

1.29 Checking if ONOS CLI is ready - PASS
1.30 Checking ONOS nodes - PASS
1.31 Check whether the flow count is bigger than 116 - FAIL

Flow count looks wrong: False

1.32 Check whether all flow status are ADDED - PASS
1.33 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Recovery2 - FAIL

IP connectivity failed

1.34 Connectivity for [u'olt10', u'vsg10'] CASE1_Recovery2 - PASS
1.35 Connectivity for [u'olt5', u'vsg5'] CASE1_Recovery2 - PASS
1.36 Killing ONOS instance - PASS
1.37 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Failure3 - FAIL

IP connectivity failed

1.38 Connectivity for [u'olt10', u'vsg10'] CASE1_Failure3 - PASS
1.39 Connectivity for [u'olt5', u'vsg5'] CASE1_Failure3 - PASS
1.40 Recovering ONOS instance - PASS
1.41 Checking if ONOS CLI is ready - PASS
1.42 Checking ONOS nodes - PASS
1.43 Check whether the flow count is bigger than 116 - PASS
1.44 Check whether all flow status are ADDED - PASS
1.45 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE1_Recovery3 - FAIL

IP connectivity failed

1.46 Connectivity for [u'olt10', u'vsg10'] CASE1_Recovery3 - PASS
1.47 Connectivity for [u'olt5', u'vsg5'] CASE1_Recovery3 - PASS

Case 2: High Availability tests - ONOS random failures with 2x2 Leaf-spine - PASS

2.1 Create and Apply cell file - PASS
2.2 Create and Install ONOS package - PASS
2.3 Starting ONOS service - PASS
2.4 Checking if ONOS CLI is ready - PASS
2.5 Starting Mininet Topology - PASS
2.6 Check whether the flow count is bigger than 116 - PASS
2.7 Check whether all flow status are ADDED - PASS
2.8 Connectivity for [u'h1', u'h2', u'h3', u'h4'] - PASS
2.9 Connectivity for [u'olt10', u'vsg10'] - PASS
2.10 Connectivity for [u'olt5', u'vsg5'] - PASS
2.11 Killing ONOS instance - PASS
2.12 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Failure1 - PASS
2.13 Connectivity for [u'olt10', u'vsg10'] CASE2_Failure1 - PASS
2.14 Connectivity for [u'olt5', u'vsg5'] CASE2_Failure1 - PASS
2.15 Recovering ONOS instance - PASS
2.16 Checking if ONOS CLI is ready - PASS
2.17 Checking ONOS nodes - PASS
2.18 Check whether the flow count is bigger than 116 - PASS
2.19 Check whether all flow status are ADDED - PASS
2.20 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Recovery1 - PASS
2.21 Connectivity for [u'olt10', u'vsg10'] CASE2_Recovery1 - PASS
2.22 Connectivity for [u'olt5', u'vsg5'] CASE2_Recovery1 - PASS
2.23 Killing ONOS instance - PASS
2.24 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Failure2 - PASS
2.25 Connectivity for [u'olt10', u'vsg10'] CASE2_Failure2 - PASS
2.26 Connectivity for [u'olt5', u'vsg5'] CASE2_Failure2 - PASS
2.27 Recovering ONOS instance - PASS
2.28 Checking if ONOS CLI is ready - PASS
2.29 Checking ONOS nodes - PASS
2.30 Check whether the flow count is bigger than 116 - PASS
2.31 Check whether all flow status are ADDED - PASS
2.32 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Recovery2 - PASS
2.33 Connectivity for [u'olt10', u'vsg10'] CASE2_Recovery2 - PASS
2.34 Connectivity for [u'olt5', u'vsg5'] CASE2_Recovery2 - PASS
2.35 Killing ONOS instance - PASS
2.36 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Failure3 - PASS
2.37 Connectivity for [u'olt10', u'vsg10'] CASE2_Failure3 - PASS
2.38 Connectivity for [u'olt5', u'vsg5'] CASE2_Failure3 - PASS
2.39 Recovering ONOS instance - PASS
2.40 Checking if ONOS CLI is ready - PASS
2.41 Checking ONOS nodes - PASS
2.42 Check whether the flow count is bigger than 116 - PASS
2.43 Check whether all flow status are ADDED - PASS
2.44 Connectivity for [u'h1', u'h2', u'h3', u'h4'] CASE2_Recovery3 - PASS
2.45 Connectivity for [u'olt10', u'vsg10'] CASE2_Recovery3 - PASS
2.46 Connectivity for [u'olt5', u'vsg5'] CASE2_Recovery3 - PASS

Case 3: High Availability tests - ONOS failures with 4x4 Leaf-spine - FAIL

3.1 Create and Apply cell file - PASS
3.2 Create and Install ONOS package - PASS
3.3 Starting ONOS service - PASS
3.4 Checking if ONOS CLI is ready - PASS
3.5 Starting Mininet Topology - PASS
3.6 Check whether the flow count is bigger than 350 - PASS
3.7 Check whether all flow status are ADDED - PASS
3.8 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] - PASS
3.9 Connectivity for [u'olt10', u'vsg10'] - PASS
3.10 Connectivity for [u'olt5', u'vsg5'] - PASS
3.11 Killing ONOS instance - PASS
3.12 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Failure1 - PASS
3.13 Connectivity for [u'olt10', u'vsg10'] CASE3_Failure1 - PASS
3.14 Connectivity for [u'olt5', u'vsg5'] CASE3_Failure1 - PASS
3.15 Recovering ONOS instance - FAIL

ONOS service did not start properly

3.16 Checking if ONOS CLI is ready - PASS
3.17 Checking ONOS nodes - PASS
3.18 Check whether the flow count is bigger than 350 - PASS
3.19 Check whether all flow status are ADDED - PASS
3.20 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Recovery1 - PASS
3.21 Connectivity for [u'olt10', u'vsg10'] CASE3_Recovery1 - PASS
3.22 Connectivity for [u'olt5', u'vsg5'] CASE3_Recovery1 - PASS
3.23 Killing ONOS instance - PASS
3.24 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Failure2 - PASS
3.25 Connectivity for [u'olt10', u'vsg10'] CASE3_Failure2 - PASS
3.26 Connectivity for [u'olt5', u'vsg5'] CASE3_Failure2 - PASS
3.27 Recovering ONOS instance - FAIL

ONOS service did not start properly

3.28 Checking if ONOS CLI is ready - PASS
3.29 Checking ONOS nodes - PASS
3.30 Check whether the flow count is bigger than 350 - PASS
3.31 Check whether all flow status are ADDED - PASS
3.32 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Recovery2 - FAIL

IP connectivity failed

3.33 Connectivity for [u'olt10', u'vsg10'] CASE3_Recovery2 - PASS
3.34 Connectivity for [u'olt5', u'vsg5'] CASE3_Recovery2 - PASS
3.35 Killing ONOS instance - PASS
3.36 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Failure3 - FAIL

IP connectivity failed

3.37 Connectivity for [u'olt10', u'vsg10'] CASE3_Failure3 - PASS
3.38 Connectivity for [u'olt5', u'vsg5'] CASE3_Failure3 - PASS
3.39 Recovering ONOS instance - FAIL

ONOS service did not start properly

3.40 Checking if ONOS CLI is ready - PASS
3.41 Checking ONOS nodes - PASS
3.42 Check whether the flow count is bigger than 350 - PASS
3.43 Check whether all flow status are ADDED - PASS
3.44 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE3_Recovery3 - FAIL

IP connectivity failed

3.45 Connectivity for [u'olt10', u'vsg10'] CASE3_Recovery3 - PASS
3.46 Connectivity for [u'olt5', u'vsg5'] CASE3_Recovery3 - PASS

Case 4: High Availability tests - ONOS random failures with 4x4 Leaf-spine - PASS

4.1 Create and Apply cell file - PASS
4.2 Create and Install ONOS package - PASS
4.3 Starting ONOS service - PASS
4.4 Checking if ONOS CLI is ready - PASS
4.5 Starting Mininet Topology - PASS
4.6 Check whether the flow count is bigger than 350 - PASS
4.7 Check whether all flow status are ADDED - PASS
4.8 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] - PASS
4.9 Connectivity for [u'olt10', u'vsg10'] - PASS
4.10 Connectivity for [u'olt5', u'vsg5'] - PASS
4.11 Killing ONOS instance - PASS
4.12 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Failure1 - PASS
4.13 Connectivity for [u'olt10', u'vsg10'] CASE4_Failure1 - PASS
4.14 Connectivity for [u'olt5', u'vsg5'] CASE4_Failure1 - PASS
4.15 Recovering ONOS instance - PASS
4.16 Checking if ONOS CLI is ready - PASS
4.17 Checking ONOS nodes - PASS
4.18 Check whether the flow count is bigger than 350 - PASS
4.19 Check whether all flow status are ADDED - PASS
4.20 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Recovery1 - PASS
4.21 Connectivity for [u'olt10', u'vsg10'] CASE4_Recovery1 - PASS
4.22 Connectivity for [u'olt5', u'vsg5'] CASE4_Recovery1 - PASS
4.23 Killing ONOS instance - PASS
4.24 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Failure2 - PASS
4.25 Connectivity for [u'olt10', u'vsg10'] CASE4_Failure2 - PASS
4.26 Connectivity for [u'olt5', u'vsg5'] CASE4_Failure2 - PASS
4.27 Recovering ONOS instance - PASS
4.28 Checking if ONOS CLI is ready - PASS
4.29 Checking ONOS nodes - PASS
4.30 Check whether the flow count is bigger than 350 - PASS
4.31 Check whether all flow status are ADDED - PASS
4.32 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Recovery2 - PASS
4.33 Connectivity for [u'olt10', u'vsg10'] CASE4_Recovery2 - PASS
4.34 Connectivity for [u'olt5', u'vsg5'] CASE4_Recovery2 - PASS
4.35 Killing ONOS instance - PASS
4.36 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Failure3 - PASS
4.37 Connectivity for [u'olt10', u'vsg10'] CASE4_Failure3 - PASS
4.38 Connectivity for [u'olt5', u'vsg5'] CASE4_Failure3 - PASS
4.39 Recovering ONOS instance - PASS
4.40 Checking if ONOS CLI is ready - PASS
4.41 Checking ONOS nodes - PASS
4.42 Check whether the flow count is bigger than 350 - PASS
4.43 Check whether all flow status are ADDED - PASS
4.44 Connectivity for [u'h1', u'h2', u'h3', u'h4', u'h5', u'h6', u'h7', u'h8'] CASE4_Recovery3 - PASS
4.45 Connectivity for [u'olt10', u'vsg10'] CASE4_Recovery3 - PASS
4.46 Connectivity for [u'olt5', u'vsg5'] CASE4_Recovery3 - PASS