Test Results - HA

**************************************

Test Plan for HA Test Cases

Test HATestSanity

************************************

Result summary for Testcase1

ONOS HA Sanity test - initialization

Removing raft logs

Uninstalling ONOS

commit 0ad84ec76d0152c08d1a40352e334abe2c5e3d8e (HEAD, origin/master, origin/HEAD, master)

Author: alshabib [alshabibi.ali@gmail.com]

AuthorDate: Wed Dec 3 22:48:01 2014 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Thu Dec 4 06:58:29 2014 +0000

setting periodic calls to reasonable intervals

Result: Pass

Result summary for Testcase2

Assigning switches to controllers

Switch mastership assigned correctly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.9497690201 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase3

Adding host intents

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase5

Setting up and gathering data for current state

Switch roles are consistent across all ONOS nodes

Intents are consistent across all ONOS nodes

Flow count is consistent across all ONOS nodes

Result: Pass

Result summary for Testcase6

Wait 60 seconds instead of inducing a failure

Result: Pass

Result summary for Testcase7

Switch roles are consistent across all ONOS nodes

Mastership of Switches was not changed

Intents are consistent across all ONOS nodes

Intents are consistent with before failure

No changes were found in the flow tables

No loss of dataplane connectivity

Constant State Tests Passed

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.7168049812 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase9

Turn off a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.5463490486 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase10

Restore a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6344950199 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase11

Killing a switch to ensure it is discovered correctly

Deleting s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6773281097 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase12

Adding a switch to ensure it is discovered correctly

Adding back s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6022200584 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase13

Test Cleanup

Result: Pass

Test HATestMinorityRestart

************************************

Result summary for Testcase1

ONOS HA test: Restart minority of ONOS nodes - initialization

Removing raft logs

Uninstalling ONOS

commit 0ad84ec76d0152c08d1a40352e334abe2c5e3d8e (HEAD, origin/master, origin/HEAD, master)

Author: alshabib [alshabibi.ali@gmail.com]

AuthorDate: Wed Dec 3 22:48:01 2014 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Thu Dec 4 06:58:29 2014 +0000

setting periodic calls to reasonable intervals

Result: Pass

Result summary for Testcase2

Assigning switches to controllers

Switch mastership assigned correctly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.860311985 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase3

Adding host intents

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase5

Setting up and gathering data for current state

Switch roles are consistent across all ONOS nodes

Intents are consistent across all ONOS nodes

Flow count is consistent across all ONOS nodes

Result: Pass

Result summary for Testcase6

Killing 3 ONOS nodes

Result: Pass

Result summary for Testcase7

Switch roles are consistent across all ONOS nodes

Mastership of some switches changed

Intents are consistent across all ONOS nodes

No changes were found in the flow tables

Loss of dataplane connectivity detected

Constant state tests failed

Result: Failed

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.7526500225 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have not been installed correctly, pings failed.

Intents have not been installed correctly, pings failed.

Result: Failed

Result summary for Testcase9

Turn off a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6413149834 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have not been installed correctly, pings failed.

Intents have not been installed correctly, pings failed.

Result: Failed

Result summary for Testcase10

Restore a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.4892890453 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have not been installed correctly, pings failed.

Intents have not been installed correctly, pings failed.

Result: Failed

Result summary for Testcase11

Killing a switch to ensure it is discovered correctly

Deleting s28

Result: Failed

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6920700073 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have not been installed correctly, pings failed.

Intents have not been installed correctly, pings failed.

Result: Failed

Result summary for Testcase12

Adding a switch to ensure it is discovered correctly

Adding back s28

Result: Failed

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.5783560276 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have not been installed correctly, pings failed.

Intents have not been installed correctly, pings failed.

Result: Failed

Result summary for Testcase13

Test Cleanup

Result: Pass

Test HATestClusterRestart

************************************

Result summary for Testcase1

ONOS HA test: Restart all ONOS nodes - initialization

Removing raft logs

Uninstalling ONOS

commit 0ad84ec76d0152c08d1a40352e334abe2c5e3d8e (HEAD, origin/master, origin/HEAD, master)

Author: alshabib [alshabibi.ali@gmail.com]

AuthorDate: Wed Dec 3 22:48:01 2014 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Thu Dec 4 06:58:29 2014 +0000

setting periodic calls to reasonable intervals

Result: Pass

Result summary for Testcase2

Assigning switches to controllers

Switch mastership assigned correctly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.9308488369 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase3

Adding host intents

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase5

Setting up and gathering data for current state

Switch roles are consistent across all ONOS nodes

Intents are consistent across all ONOS nodes

Flow count is consistent across all ONOS nodes

Result: Pass

Result summary for Testcase6

Restart entire ONOS cluster

Result: Pass

Result summary for Testcase7

Switch roles are consistent across all ONOS nodes

Mastership of some switches changed

Intents are consistent across all ONOS nodes

No changes were found in the flow tables

Loss of dataplane connectivity detected

Constant state tests failed

Result: Failed

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

hosts from ONOS7 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

hosts from ONOS7 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

hosts from ONOS7 is inconsistent with ONOS1

ONOS nodes have different views of hosts

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.824390173 seconds, 3 tries

Topology Check Test NOT successful

Result: Failed

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase9

Turn off a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 65.1134359837 seconds, 3 tries

Topology Check Test NOT successful

Result: Failed

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase10

Restore a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.6174900532 seconds, 3 tries

Topology Check Test NOT successful

Result: Failed

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase11

Killing a switch to ensure it is discovered correctly

Deleting s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.6235849857 seconds, 3 tries

Topology Check Test NOT successful

Result: Failed

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase12

Adding a switch to ensure it is discovered correctly

Adding back s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

hosts from ONOS2 is inconsistent with ONOS1

hosts from ONOS3 is inconsistent with ONOS1

hosts from ONOS4 is inconsistent with ONOS1

hosts from ONOS5 is inconsistent with ONOS1

hosts from ONOS6 is inconsistent with ONOS1

ONOS nodes have different views of hosts

Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 63.9758648872 seconds, 3 tries

Topology Check Test NOT successful

Result: Failed

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase13

Test Cleanup

Result: Pass

Test SingleInstanceHATestRestart

************************************

Result summary for Testcase1

ONOS Single node cluster restart HA test - initialization

Removing raft logs

Uninstalling ONOS

commit 0ad84ec76d0152c08d1a40352e334abe2c5e3d8e (HEAD, origin/master, origin/HEAD, master)

Author: alshabib [alshabibi.ali@gmail.com]

AuthorDate: Wed Dec 3 22:48:01 2014 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Thu Dec 4 06:58:29 2014 +0000

setting periodic calls to reasonable intervals

Result: Pass

Result summary for Testcase2

Assigning switches to controllers

Switch mastership assigned correctly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 1.01480102539 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase3

Adding host intents

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase5

Setting up and gathering data for current state

Result: Pass

Result summary for Testcase6

Restart ONOS node

Result: Pass

Result summary for Testcase7

Switch roles are consistent across all ONOS nodes

Mastership of Switches was not changed

Intents are consistent across all ONOS nodes

No changes were found in the flow tables

Loss of dataplane connectivity detected

Constant State Tests Passed

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.983502149582 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase9

Turn off a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.942887067795 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase10

Restore a link to ensure that Link Discovery is working properly

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.933655977249 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase11

Killing a switch to ensure it is discovered correctly

Deleting s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.899029970169 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase12

Adding a switch to ensure it is discovered correctly

Adding back s28

Result: Pass

Result summary for Testcase8

Compare ONOS Topology view to Mininet topology

Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.927198171616 seconds, 1 tries

ONOS topology view matches Mininet topology

Result: Pass

Result summary for Testcase4

Ping across added host intents

Intents have been installed correctly and verified by pings

Result: Pass

Result summary for Testcase13

Test Cleanup

Result: Pass