Have questions? Stuck? Please check our FAQ for some common questions and answers.

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 42 Next »

**************************************

Jenkins test result for 01:18 on Dec 02, 2014.

Test Plan for HA Test Cases

  • HATestSanity - Results: 23 Passed, 0 Failed
  • HATestMinorityRestart - Results: 18 Passed, 5 Failed
  • HATestClusterRestart - Results: 22 Passed, 1 Failed
  • SingleInstanceHATestRestart - Results: 18 Passed, 5 Failed
  • Test HATestSanity

    ************************************

    Result summary for Testcase1

    ONOS HA Sanity test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit b9125562d44bdec21da1614824eb790dc927a108 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Mon Dec 1 23:28:22 2014 -0800

    Commit: Yuta Higuchi [y-higuchi@onlab.us]

    CommitDate: Tue Dec 2 08:24:17 2014 +0000

    GossipLinkStore: removedLinks could be accessed concurrently by advertisement

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 7.26783108711 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase6

    Wait 60 seconds instead of inducing a failure

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    Intents are consistent with before failure

    No changes were found in the flow tables

    No loss of dataplane connectivity

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.84395718575 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.94132614136 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.85850787163 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.87242412567 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.78839015961 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestMinorityRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart minority of ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit b9125562d44bdec21da1614824eb790dc927a108 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Mon Dec 1 23:28:22 2014 -0800

    Commit: Yuta Higuchi [y-higuchi@onlab.us]

    CommitDate: Tue Dec 2 08:24:17 2014 +0000

    GossipLinkStore: removedLinks could be accessed concurrently by advertisement

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 7.24383807182 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase6

    Killing 3 ONOS nodes

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of some switches changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Loss of dataplane connectivity detected

    Constant state tests failed

    Result: Failed

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.75656795502 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.76076793671 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.71774601936 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.86361694336 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Failed

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.9725279808 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestClusterRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart all ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit b9125562d44bdec21da1614824eb790dc927a108 (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Mon Dec 1 23:28:22 2014 -0800

    Commit: Yuta Higuchi [y-higuchi@onlab.us]

    CommitDate: Tue Dec 2 08:24:17 2014 +0000

    GossipLinkStore: removedLinks could be accessed concurrently by advertisement

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 7.34847187996 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase6

    Restart entire ONOS cluster

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of some switches changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Loss of dataplane connectivity detected

    Constant state tests failed

    Result: Failed

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 7.05821585655 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.72722506523 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.66072583199 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.85044693947 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 7 seconds to read the topology from ONOS): 6.79980301857 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test SingleInstanceHATestRestart

    ************************************

    Result summary for Testcase1

    ONOS Single node cluster restart HA test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit bd1aee1e86589c3230707f7e1ef6fd292748bbca (HEAD, origin/master, origin/HEAD, master)

    Author: Yuta HIGUCHI [y-higuchi@ak.jp.nec.com]

    AuthorDate: Mon Dec 1 20:05:47 2014 -0800

    Commit: Yuta Higuchi [y-higuchi@onlab.us]

    CommitDate: Tue Dec 2 08:36:51 2014 +0000

    Attempt to fix nested exception

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 1.05242109299 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Result: Pass

    Result summary for Testcase6

    Restart ONOS node

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Loss of dataplane connectivity detected

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 63.6474499702 seconds, 6 tries

    Giving up on topology convergence

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 28 bidirectional links and ONOS has 57 unidirectional links

    ONOS1 links view is incorrect

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 63.4226150513 seconds, 6 tries

    Giving up on topology convergence

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 63.4215271473 seconds, 6 tries

    Giving up on topology convergence

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 27 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 61.823125124 seconds, 6 tries

    Giving up on topology convergence

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s28

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 59 unidirectional links

    ONOS1 links view is incorrect

    Very crass estimate for topology discovery/convergence(note it takes about 1 seconds to read the topology from each ONOS instance): 63.3486740589 seconds, 6 tries

    Giving up on topology convergence

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    • No labels