Have questions? Stuck? Please check our FAQ for some common questions and answers.

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 121 Next »

**************************************

Jenkins test result for 11:36 on Dec 15, 2014.

Test Plan for HA Test Cases

  • HATestSanity - Results: 24 Passed, 0 Failed
  • HATestMinorityRestart - Results: 14 Passed, 9 Failed
  • HATestClusterRestart - Results: 23 Passed, 1 Failed
  • SingleInstanceHATestRestart - Results: 24 Passed, 0 Failed

    • Test HATestSanity

    ************************************

    Result summary for Testcase1

    ONOS HA Sanity test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit ddb7772971b33af75bd1d37ab5e9be4c311e5861 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Thu Dec 11 19:39:04 2014 -0800

    Commit: Gerrit Code Review [gerrit@onlab.us]

    CommitDate: Mon Dec 15 18:13:01 2014 +0000

    LinkManager: log only if link actually disappeared

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 14 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 14.1072189808 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase14

    Result: Pass

    Result summary for Testcase6

    Wait 60 seconds instead of inducing a failure

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.5562410355 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    Intents are consistent with before failure

    No changes were found in the flow tables

    No loss of dataplane connectivity

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.5857820511 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.437541008 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.387349844 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.4913370609 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestMinorityRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart minority of ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit ddb7772971b33af75bd1d37ab5e9be4c311e5861 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Thu Dec 11 19:39:04 2014 -0800

    Commit: Gerrit Code Review [gerrit@onlab.us]

    CommitDate: Mon Dec 15 18:13:01 2014 +0000

    LinkManager: log only if link actually disappeared

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.9004528522 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase6

    Killing 3 ONOS nodes

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.5495500565 seconds, 3 tries

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of some switches changed

    Intents are consistent across all ONOS nodes

    The Intents changed during failure

    Changes were found in the flow tables

    Loss of dataplane connectivity detected

    Constant state tests failed

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.3826670647 seconds, 3 tries

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    hosts from ONOS3 is inconsistent with ONOS1

    hosts from ONOS4 is inconsistent with ONOS1

    hosts from ONOS5 is inconsistent with ONOS1

    hosts from ONOS6 is inconsistent with ONOS1

    hosts from ONOS7 is inconsistent with ONOS1

    ONOS nodes have different views of hosts

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 64.7933430672 seconds, 3 tries

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.4090070724 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6870279312 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestClusterRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart all ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit ddb7772971b33af75bd1d37ab5e9be4c311e5861 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Thu Dec 11 19:39:04 2014 -0800

    Commit: Gerrit Code Review [gerrit@onlab.us]

    CommitDate: Mon Dec 15 18:13:01 2014 +0000

    LinkManager: log only if link actually disappeared

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.9955720901 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase6

    Restart entire ONOS cluster

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.9399929047 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of some switches changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Loss of dataplane connectivity detected

    Constant state tests failed

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.6953110695 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.5375740528 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.611538887 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 13 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance): 13.7664191723 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test SingleInstanceHATestRestart

    ************************************

    Result summary for Testcase1

    ONOS Single node cluster restart HA test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit ddb7772971b33af75bd1d37ab5e9be4c311e5861 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Thu Dec 11 19:39:04 2014 -0800

    Commit: Gerrit Code Review [gerrit@onlab.us]

    CommitDate: Mon Dec 15 18:13:01 2014 +0000

    LinkManager: log only if link actually disappeared

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 1.07733201981 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Result: Pass

    Result summary for Testcase6

    Restart ONOS node

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 1.02249407768 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.930999994278 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.926119804382 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.927114009857 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 0.916398048401 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    • No labels