VPLSfailsafe at 28 Jul 2017 22:38:46
commit 29718e6904f9d5ddc0d9043e2448900d5cad522a (HEAD, origin/master, origin/HEAD, master)
Author: Jordan Halterman [jordan@onlab.us]
AuthorDate: Thu Jul 20 13:24:33 2017 -0700
Commit: Jordan Halterman [jordan@opennetworking.org]
CommitDate: Fri Jul 28 16:54:48 2017 -0700
[ONOS-6841] Sustained primitive throughput tests
Case 1: Setting up test environment - PASS
Setup the test environment including installing ONOS, starting Mininet and ONOScli sessions.
- 1.1 Create cell file - No Result
- 1.2 Applying cell variable to environment - No Result
- 1.3 Starting Mininet - PASS
- 1.4 Creating ONOS package - PASS
- 1.5 Installing ONOS package - PASS
- 1.6 Set up ONOS secure SSH - PASS
- 1.7 Checking if ONOS is up yet - PASS
- 1.8 Starting ONOS CLI sessions - PASS
- 1.9 Activate apps defined in the params file - No Result
- 1.10 Set ONOS configurations - No Result
- 1.11 App Ids check - PASS
Case 2: - FAIL
- 2.1 Discover hosts using pings - No Result
- 2.2 Load VPLS configurations - PASS
- 2.3 Check VPLS configurations - PASS
- 2.4 Check interface configurations - PASS
- 2.5 Check network configurations for vpls application - PASS
- 2.6 Check vpls app configurations - PASS
- 2.7 Check connectivity - FAIL
- Connectivity is not as expected
- 2.8 Loading vpls configuration in case any configuration was missed. - PASS
Case 50: Check connectivity before running all other tests. - FAIL
- 50.1 Check intent states - FAIL
- Not all Intents in installed state
- 50.2 Testing connectivity... - FAIL
- Connectivity is NOT as expected.
Case 100: Bring down one host at a time and test connectivity. - FAIL
- 100.1 Kill link between s1 and h1. - PASS
- 100.2 Check intent states - FAIL
- Not all Intents in installed state
- 100.3 Testing connectivity... - FAIL
- 100.4 Re-adding link between s1 and h1. - PASS
- 100.5 Discover h1 using ping. - No Result
- 100.6 Check intent states - FAIL
- Not all Intents in installed state
- 100.7 Testing connectivity... - FAIL
- 100.8 Kill link between s2 and h2. - PASS
- 100.9 Check intent states - FAIL
- Not all Intents in installed state
- 100.10 Testing connectivity... - FAIL
- 100.11 Re-adding link between s2 and h2. - PASS
- 100.12 Discover h2 using ping. - No Result
- 100.13 Check intent states - FAIL
- Not all Intents in installed state
- 100.14 Testing connectivity... - FAIL
- 100.15 Kill link between s3 and h3. - PASS
- 100.16 Check intent states - FAIL
- Not all Intents in installed state
- 100.17 Testing connectivity... - PASS
- 100.18 Re-adding link between s3 and h3. - PASS
- 100.19 Discover h3 using ping. - No Result
- 100.20 Check intent states - FAIL
- Not all Intents in installed state
- 100.21 Testing connectivity... - FAIL
- 100.22 Kill link between s4 and h4. - PASS
- 100.23 Check intent states - FAIL
- Not all Intents in installed state
- 100.24 Testing connectivity... - PASS
- 100.25 Re-adding link between s4 and h4. - PASS
- 100.26 Discover h4 using ping. - No Result
- 100.27 Check intent states - FAIL
- Not all Intents in installed state
- 100.28 Testing connectivity... - FAIL
- 100.29 Kill link between s5 and h5. - PASS
- 100.30 Check intent states - FAIL
- Not all Intents in installed state
- 100.31 Testing connectivity... - FAIL
- 100.32 Re-adding link between s5 and h5. - PASS
- 100.33 Discover h5 using ping. - No Result
- 100.34 Check intent states - FAIL
- Not all Intents in installed state
- 100.35 Testing connectivity... - FAIL
- 100.36 Kill link between s6 and h6. - PASS
- 100.37 Check intent states - FAIL
- Not all Intents in installed state
- 100.38 Testing connectivity... - FAIL
- 100.39 Re-adding link between s6 and h6. - PASS
- 100.40 Discover h6 using ping. - No Result
- 100.41 Check intent states - FAIL
- Not all Intents in installed state
- 100.42 Testing connectivity... - FAIL
- Connectivity is NOT as expected.
Case 200: Bring down one switch at a time and test connectivity. - FAIL
- 200.1 Delete s5. - PASS
- 200.2 Check intent states - FAIL
- Not all Intents in installed state
- 200.3 Testing connectivity... - FAIL
- 200.4 Add s5. - PASS
- 200.5 Reconnecting links on s5. - No Result
- 200.6 Check intent states - FAIL
- Not all Intents in installed state
- 200.7 Testing connectivity... - FAIL
- 200.8 Delete s6. - FAIL
- 200.9 Check intent states - FAIL
- Not all Intents in installed state
- 200.10 Testing connectivity... - FAIL
- 200.11 Add s6. - FAIL
- 200.12 Reconnecting links on s6. - No Result
- 200.13 Check intent states - FAIL
- Not all Intents in installed state
- 200.14 Testing connectivity... - FAIL
- Connectivity is NOT as expected.
Case 300: Stop one ONOS node at a time and test connectivity. - FAIL
- 300.1 Stop ONOS node 0. - PASS
- 300.2 Testing connectivity... - FAIL
- 300.3 Restart ONOS node 0 and checking status of restart. - PASS
- 300.4 Checking ONOS nodes. - FAIL
- Apps are NOT the same across all nodes.
- 300.5 Check intent states - FAIL
- Not all Intents in installed state
- 300.6 Testing connectivity... - FAIL
- 300.7 Stop ONOS node 1. - PASS
- 300.8 Testing connectivity... - FAIL
- 300.9 Restart ONOS node 1 and checking status of restart. - PASS
- 300.10 Checking ONOS nodes. - FAIL
- Apps are NOT the same across all nodes.
- 300.11 Check intent states - FAIL
- Not all Intents in installed state
- 300.12 Testing connectivity... - FAIL
- 300.13 Stop ONOS node 2. - PASS
- 300.14 Testing connectivity... - FAIL
- 300.15 Restart ONOS node 2 and checking status of restart. - PASS
- 300.16 Checking ONOS nodes. - FAIL
- Apps are NOT the same across all nodes.
- 300.17 Check intent states - FAIL
- Not all Intents in installed state
- 300.18 Testing connectivity... - FAIL
- Connectivity is NOT as expected.
Case 310: Kill one ONOS node at a time and test connectivity. - FAIL
- 310.1 Killing ONOS node 1. - PASS
- 310.2 Waiting for ONOS to restart. - No Result
- 310.3 Check intent states - PASS
- 310.4 Testing connectivity... - FAIL
- 310.5 Killing ONOS node 2. - PASS
- 310.6 Waiting for ONOS to restart. - No Result
- 310.7 Check intent states - FAIL
- Not all Intents in installed state
- 310.8 Testing connectivity... - FAIL
- 310.9 Killing ONOS node 3. - PASS
- 310.10 Waiting for ONOS to restart. - No Result
- 310.11 Check intent states - FAIL
- Not all Intents in installed state
- 310.12 Testing connectivity... - FAIL
- Connectivity is NOT as expected.