Have questions? Stuck? Please check our FAQ for some common questions and answers.

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 195 Next »

ONOS-HA

**************************************

Jenkins test result for 02:49 on Feb 03, 2015.

Test Plan for HA Test Cases

  • HATestSanity - Results: 25 Passed, 0 Failed
  • HATestMinorityRestart - Results: 20 Passed, 5 Failed
  • HATestClusterRestart - Results: 0 Passed, 0 Failed
  • HATestSingleInstanceRestart - Results: 26 Passed, 0 Failed
  • Test HATestSanity

    ************************************

    Result summary for Testcase1

    ONOS HA Sanity test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit 45c9fe54028d5487bd2abd530e71e149fbc46304 (HEAD, origin/master, origin/HEAD, master)

    Author: Simon Hunt [simon@onlab.us]

    AuthorDate: Mon Feb 2 19:06:29 2015 -0800

    Commit: Simon Hunt [simon@onlab.us]

    CommitDate: Mon Feb 2 19:06:29 2015 -0800

    GUI -- Updated 'simple' scenario, and minor enhancement to mock server.

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.9211189747 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase14

    Leadership election tests passed( consistent view of leader across listeners and a leader was elected )

    Result: Pass

    Result summary for Testcase6

    Wait 60 seconds instead of inducing a failure

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.2723109722 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    Intents are consistent with before failure

    No changes were found in the flow tables

    No loss of dataplane connectivity

    Leadership election tests passed( consistent view of leader across listeners and a new leader was re-elected if applicable )

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase15

    Check that Leadership Election is still functional

    Leadership election tests passed( consistent view of leader across listeners and a new leader was elected when the old leader resigned )

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.3302199841 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.3839120865 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s5

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.2296881676 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s5

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.0790410042 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestMinorityRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart minority of ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit 45c9fe54028d5487bd2abd530e71e149fbc46304 (HEAD, origin/master, origin/HEAD, master)

    Author: Simon Hunt [simon@onlab.us]

    AuthorDate: Mon Feb 2 19:06:29 2015 -0800

    Commit: Simon Hunt [simon@onlab.us]

    CommitDate: Mon Feb 2 19:06:29 2015 -0800

    GUI -- Updated 'simple' scenario, and minor enhancement to mock server.

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.4462900162 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Switch roles are consistent across all ONOS nodes

    Intents are consistent across all ONOS nodes

    Flow count is consistent across all ONOS nodes

    Result: Pass

    Result summary for Testcase14

    Leadership election tests passed( consistent view of leader across listeners and a leader was elected )

    Result: Pass

    Result summary for Testcase6

    Killing 3 ONOS nodes

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.4367370605 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of some switches changed

    Intents are consistent across all ONOS nodes

    The Intents changed during failure

    Changes were found in the flow tables

    Loss of dataplane connectivity detected

    Leadership election tests passed( consistent view of leader across listeners and a new leader was re-elected if applicable )

    Constant state tests failed

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase15

    Check that Leadership Election is still functional

    Leadership election tests passed( consistent view of leader across listeners and a new leader was elected when the old leader resigned )

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.2508380413 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 16.1476209164 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s5

    Failed to kill switch?

    Result: Failed

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS1 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS2 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS2 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS3 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS3 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS4 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS4 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS5 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS5 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS6 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS6 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS7 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS7 links view is incorrect

    ONOS shows 2 SCCs

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS1 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS2 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS2 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS3 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS3 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS4 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS4 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS5 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS5 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS6 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS6 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS7 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS7 links view is incorrect

    ONOS shows 2 SCCs

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS1 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS1 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS2 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS2 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS3 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS3 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS4 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS4 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS5 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS5 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS6 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS6 links view is incorrect

    Switches in MN but not in ONOS:

    []

    Switches in ONOS but not in MN:

    [u'0000000000005000']

    ONOS7 Switches view is incorrect

    Mininet has 26 bidirectional links and ONOS has 55 unidirectional links

    ONOS7 links view is incorrect

    ONOS shows 2 SCCs

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 71.768445015 seconds, 3 tries

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have not been installed correctly, pings failed.

    Intents have not been installed correctly, pings failed.

    Result: Failed

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s5

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS2 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS3 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS4 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS5 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS6 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS7 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS2 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS3 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS4 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS5 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS6 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS7 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS1 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS2 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS3 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS4 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS5 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS6 links view is incorrect

    Mininet has 29 bidirectional links and ONOS has 60 unidirectional links

    ONOS7 links view is incorrect

    Very crass estimate for topology discovery/convergence( note it takes about 16 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 72.4485218525 seconds, 3 tries

    Topology Check Test NOT successful

    Result: Failed

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    Test HATestClusterRestart

    ************************************

    Result summary for Testcase1

    ONOS HA test: Restart all ONOS nodes - initialization

    Removing raft logs

    Uninstalling ONOS

    commit aaa5657d83b863389244eb1a81a26049df5cb35b (HEAD, master)

    Author: Jonathan Hart [jono@onlab.us]

    AuthorDate: Wed Jan 28 21:56:35 2015 -0800

    Commit: Jonathan Hart [jono@onlab.us]

    CommitDate: Fri Jan 30 19:10:49 2015 +0000

    Implement anti-entropy for the EventuallyConsistentMap.

    ONOS2 didn't start!

    ONOS2 didn't start!

    Test startup NOT successful

    Test HATestSingleInstanceRestart

    ************************************

    Result summary for Testcase1

    ONOS Single node cluster restart HA test - initialization

    Removing raft logs

    Uninstalling ONOS

    commit 45c9fe54028d5487bd2abd530e71e149fbc46304 (HEAD, origin/master, origin/HEAD, master)

    Author: Simon Hunt [simon@onlab.us]

    AuthorDate: Mon Feb 2 19:06:29 2015 -0800

    Commit: Simon Hunt [simon@onlab.us]

    CommitDate: Mon Feb 2 19:06:29 2015 -0800

    GUI -- Updated 'simple' scenario, and minor enhancement to mock server.

    Result: Pass

    Result summary for Testcase2

    Assigning switches to controllers

    Switch mastership assigned correctly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.44956493378 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase5

    Setting up and gathering data for current state

    Result: Pass

    Result summary for Testcase14

    Leadership election tests passed( consistent view of leader across listeners and a leader was elected )

    Result: Pass

    Result summary for Testcase6

    Restart ONOS node

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.44387793541 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase3

    Adding host intents

    Result: Pass

    Result summary for Testcase7

    Switch roles are consistent across all ONOS nodes

    Mastership of Switches was not changed

    Intents are consistent across all ONOS nodes

    No changes were found in the flow tables

    Leadership election tests passed( consistent view of leader across listeners and a new leader was re-elected if applicable )

    Constant State Tests Passed

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase15

    Check that Leadership Election is still functional

    Leadership election tests passed( There is no leader after the old leader resigned )

    Result: Pass

    Result summary for Testcase9

    Turn off a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.31861495972 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase10

    Restore a link to ensure that Link Discovery is working properly

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.36622595787 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase11

    Killing a switch to ensure it is discovered correctly

    Deleting s5

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.31219315529 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase12

    Adding a switch to ensure it is discovered correctly

    Adding back s5

    Result: Pass

    Result summary for Testcase8

    Compare ONOS Topology view to Mininet topology

    Very crass estimate for topology discovery/convergence( note it takes about 1 seconds for the test to make all the cli calls to fetch the topology from each ONOS instance ): 1.35506796837 seconds, 1 tries

    ONOS topology view matches Mininet topology

    Result: Pass

    Result summary for Testcase4

    Ping across added host intents

    Intents have been installed correctly and verified by pings

    Result: Pass

    Result summary for Testcase13

    Test Cleanup

    Result: Pass

    • No labels