Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published from Jenkins build: https://jenkins.onosproject.org/job/SR-pipeline-1.12/233/

...

commit 74b354556ee81ee5896db8fc3fcfd3462a35d722 (HEAD -] onos-1.12, origin/onos-1.12)
Author: Charles Chan [rascov@gmail.com]
AuthorDate: Thu Aug 16 21:02:34 2018 -0700
Commit: Charles Chan [charles@opennetworking.org]
CommitDate: Fri Aug 17 17:44:35 2018 +0000

Do not queue VERIFY objectives

Case 5: Bridging test between two untagged hosts on vlan-untagged port, with single ToR and 3 ONOS instances -

...

PASS

  • 5.1 Constructing test variables - PASS (tick)
  • 5.2 Apply cell to environment - PASS (tick)
  • 5.3 Uninstalling ONOS package - PASS (tick)
  • 5.4 Creating ONOS package - PASS (tick)
  • 5.5 Installing ONOS package - PASS (tick)
  • 5.6 Set up ONOS secure SSH - PASS (tick)
  • 5.7 Checking ONOS service - PASS (tick)
  • 5.8 Starting ONOS CLI sessions - PASS (tick)
  • 5.9 Checking ONOS nodes - PASS (tick)
  • 5.10 Checking ONOS applications - PASS (tick)
  • 5.11 Starting Mininet Topology - PASS (tick)
  • 5.12 Check whether the flow count is bigger than 28 - FAIL (error)
  • Flow count looks wrong: False
  • PASS (tick)
  • 5.13 Check whether all flow status are ADDED - PASS (tick)
  • 5.14 Check whether the flow count of device of:0000000000000001 is bigger than 28 - FAIL (error)
  • Flow count looks wrong.
  • PASS (tick)
  • 5.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE5 - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 5.16 Stopping Mininet - PASS (tick)
  • 5.17 Copying karaf logs - PASS (tick)

...

  • 15.1 Apply cell to environment - PASS (tick)
  • 15.2 Uninstalling ONOS package - PASS (tick)
  • 15.3 Installing ONOS package - PASS (tick)
  • 15.4 Set up ONOS secure SSH - PASS (tick)
  • 15.5 Checking ONOS service - PASS (tick)
  • 15.6 Starting ONOS CLI sessions - PASS (tick)
  • 15.7 Checking ONOS nodes - PASS (tick)
  • 15.8 Checking ONOS applications - PASS (tick)
  • 15.9 Starting Mininet Topology - PASS (tick)
  • 15.10 Check whether the flow count is bigger than 28 - PASS (tick)
  • 15.11 Check whether all flow status are ADDED - PASS (tick)
  • 15.12 Check whether the flow count of device of:0000000000000001 is bigger than 28 - PASS (tick)
  • 15.13 Verify full connectivity for [u'h1', u'h2'] with tag CASE15 - PASS (tick)
  • 15.14 Stopping Mininet - PASS (tick)
  • 15.15 Copying karaf logs - PASS (tick)

Case 16: Bridging test between two tagged hosts, with dual-homed ToR and 3 ONOS instances -

...

FAIL

  • 16.1 Apply cell to environment - PASS (tick)
  • 16.2 Uninstalling ONOS package - PASS (tick)
  • 16.3 Installing ONOS package - PASS (tick)
  • 16.4 Set up ONOS secure SSH - PASS (tick)
  • 16.5 Checking ONOS service - PASS (tick)
  • 16.6 Starting ONOS CLI sessions - PASS (tick)
  • 16.7 Checking ONOS nodes - PASS (tick)FAIL (error)
    • Not all ONOS nodes are in READY state
  • 16.8 Checking ONOS applications - PASS (tick)
  • 16.9 Starting Mininet Topology - PASS (tick)
  • 16.10 Check whether the flow count is bigger than 74 - PASS (tick)
  • 16.11 Check whether all flow status are ADDED - PASS (tick)
  • 16.12 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 16.13 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 16.14 Verify full connectivity for [u'h1', u'h2'] with tag CASE16 - PASS (tick)
  • 16.15 Stopping Mininet - PASS (tick)
  • 16.16 Copying karaf logs - PASS (tick)

...

  • 18.1 Apply cell to environment - PASS (tick)
  • 18.2 Uninstalling ONOS package - PASS (tick)
  • 18.3 Installing ONOS package - PASS (tick)
  • 18.4 Set up ONOS secure SSH - PASS (tick)
  • 18.5 Checking ONOS service - PASS (tick)
  • 18.6 Starting ONOS CLI sessions - PASS (tick)
  • 18.7 Checking ONOS nodes - PASS (tick)
  • 18.8 Checking ONOS applications - PASS (tick)
  • 18.9 Starting Mininet Topology - PASS (tick)
  • 18.10 Check whether the flow count is bigger than 212 - PASS (tick)
  • 18.11 Check whether all flow status are ADDED - PASS (tick)
  • 18.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 18.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 18.14 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 18.15 Check whether the flow count of device of:0000000000000004 is bigger than 53 - PASS (tick)
  • 18.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE18 - PASS (tick)
  • 18.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE18 - PASS (tick)
  • 18.18 Stopping Mininet - PASS (tick)
  • 18.19 Copying karaf logs - PASS (tick)

Case 25: Bridging test between two untagged hosts on vlan-native port, with single ToR and 3 ONOS instances -

...

PASS

  • 25.1 Apply cell to environment - PASS (tick)
  • 25.2 Uninstalling ONOS package - PASS (tick)
  • 25.3 Installing ONOS package - PASS (tick)
  • 25.4 Set up ONOS secure SSH - PASS (tick)
  • 25.5 Checking ONOS service - PASS (tick)
  • 25.6 Starting ONOS CLI sessions - PASS (tick)
  • 25.7 Checking ONOS nodes - PASS (tick)
  • 25.8 Checking ONOS applications - PASS (tick)
  • 25.9 Starting Mininet Topology - PASS (tick)
  • 25.10 Check whether the flow count is bigger than 28 - FAIL (error)
  • Flow count looks wrong: False
  • PASS (tick)
  • 25.11 Check whether all flow status are ADDED - PASS (tick)
  • 25.12 Check whether the flow count of device of:0000000000000001 is bigger than 28 - FAIL (error)
  • Flow count looks wrong.
  • PASS (tick)
  • 25.13 Verify full connectivity for [u'h1', u'h2'] with tag CASE25 - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 25.14 Stopping Mininet - PASS (tick)
  • 25.15 Copying karaf logs - PASS (tick)

...

  • 26.1 Apply cell to environment - PASS (tick)
  • 26.2 Uninstalling ONOS package - PASS (tick)
  • 26.3 Installing ONOS package - PASS (tick)
  • 26.4 Set up ONOS secure SSH - PASS (tick)
  • 26.5 Checking ONOS service - PASS (tick)
  • 26.6 Starting ONOS CLI sessions - PASS (tick)
  • 26.7 Checking ONOS nodes - PASS (tick)
  • 26.8 Checking ONOS applications - PASS (tick)
  • 26.9 Starting Mininet Topology - PASS (tick)
  • 26.10 Check whether the flow count is bigger than 74 - PASS (tick)
  • 26.11 Check whether all flow status are ADDED - PASS (tick)
  • 26.12 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 26.13 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 26.14 Verify full connectivity for [u'h1', u'h2'] with tag CASE26 - PASS (tick)
  • 26.15 Stopping Mininet - PASS (tick)
  • 26.16 Copying karaf logs - PASS (tick)

Case 27: Bridging test between two untagged hosts on vlan-native port, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 27.1 Apply cell to environment - PASS (tick)
  • 27.2 Uninstalling ONOS package - PASS (tick)
  • 27.3 Installing ONOS package - PASS (tick)
  • 27.4 Set up ONOS secure SSH - PASS (tick)
  • 27.5 Checking ONOS service - PASS (tick)
  • 27.6 Starting ONOS CLI sessions - PASS (tick)
  • 27.7 Checking ONOS nodes - PASS (tick)
  • 27.8 Checking ONOS applications - PASS (tick)
  • 27.9 Starting Mininet Topology - PASS (tick)
  • 27.10 Check whether the flow count is bigger than 74 - FAIL (error)
  • Flow count looks wrong: False
  • PASS (tick)
  • 27.11 Check whether all flow status are ADDED - PASS (tick)
  • 27.12 Check whether the flow count of device of:0000000000000001 is bigger than 37 - FAIL (error)
  • Flow count looks wrong.
  • PASS (tick)
  • 27.13 Check whether the flow count of device of:0000000000000002 is bigger than 37 - FAIL (error)
    • Flow count looks wrong.
  • PASS (tick)
  • 27.14 Verify full connectivity for [u'h1', u'h2'] with tag CASE27 - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 27.15 Verify full connectivity for [u'h3', u'h4'] with tag CASE27 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 27.16 Stopping Mininet - PASS (tick)
  • 27.17 Copying karaf logs - PASS (tick)

...

  • 37.1 Apply cell to environment - PASS (tick)
  • 37.2 Uninstalling ONOS package - PASS (tick)
  • 37.3 Installing ONOS package - PASS (tick)
  • 37.4 Set up ONOS secure SSH - PASS (tick)
  • 37.5 Checking ONOS service - PASS (tick)
  • 37.6 Starting ONOS CLI sessions - PASS (tick)
  • 37.7 Checking ONOS nodes - PASS (tick)
  • 37.8 Checking ONOS applications - PASS (tick)
  • 37.9 Starting Mininet Topology - PASS (tick)
  • 37.10 Check whether the flow count is bigger than 74 - PASS (tick)
  • 37.11 Check whether all flow status are ADDED - PASS (tick)
  • 37.12 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 37.13 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 37.14 Verify full connectivity for [u'h1', u'h2'] with tag CASE37 - PASS (tick)
  • 37.15 Verify full connectivity for [u'h3', u'h4'] with tag CASE37 - PASS (tick)
  • 37.16 Stopping Mininet - PASS (tick)
  • 37.17 Copying karaf logs - PASS (tick)

Case 38: Bridging test between two untagged hosts, one on vlan-untagged port and the other on vlan-native port, with 2x4 dual-homed leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 38.1 Apply cell to environment - PASS (tick)
  • 38.2 Uninstalling ONOS package - PASS (tick)
  • 38.3 Installing ONOS package - PASS (tick)
  • 38.4 Set up ONOS secure SSH - PASS (tick)
  • 38.5 Checking ONOS service - PASS (tick)
  • 38.6 Starting ONOS CLI sessions - PASS (tick)
  • 38.7 Checking ONOS nodes - PASS (tick)FAIL (error)
    • Not all ONOS nodes are in READY state
  • 38.8 Checking ONOS applications - PASS (tick)
  • 38.9 Starting Mininet Topology - PASS (tick)
  • 38.10 Check whether the flow count is bigger than 212 - PASS (tick)
  • 38.11 Check whether all flow status are ADDED - PASS (tick)
  • 38.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 38.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 38.14 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 38.15 Check whether the flow count of device of:0000000000000004 is bigger than 53 - PASS (tick)
  • 38.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE38 - PASS (tick)
  • 38.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE38 - PASS (tick)
  • 38.18 Stopping Mininet - PASS (tick)
  • 38.19 Copying karaf logs - PASS (tick)

...

  • 48.1 Apply cell to environment - PASS (tick)
  • 48.2 Uninstalling ONOS package - PASS (tick)
  • 48.3 Installing ONOS package - PASS (tick)
  • 48.4 Set up ONOS secure SSH - PASS (tick)
  • 48.5 Checking ONOS service - PASS (tick)
  • 48.6 Starting ONOS CLI sessions - PASS (tick)
  • 48.7 Checking ONOS nodes - PASS (tick)
  • 48.8 Checking ONOS applications - PASS (tick)
  • 48.9 Starting Mininet Topology - PASS (tick)
  • 48.10 Check whether the flow count is bigger than 212 - PASS (tick)
  • 48.11 Check whether all flow status are ADDED - PASS (tick)
  • 48.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 48.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 48.14 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 48.15 Check whether the flow count of device of:0000000000000004 is bigger than 53 - PASS (tick)
  • 48.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE48 - PASS (tick)
  • 48.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE48 - PASS (tick)
  • 48.18 Stopping Mininet - PASS (tick)
  • 48.19 Copying karaf logs - PASS (tick)

Case 55: Bridging test between two untagged hosts with different vlan id, with single ToR and 3 ONOS instances -

...

FAIL

  • 55.1 Apply cell to environment - PASS (tick)
  • 55.2 Uninstalling ONOS package - PASS (tick)
  • 55.3 Installing ONOS package - PASS (tick)
  • 55.4 Set up ONOS secure SSH - PASS (tick)
  • 55.5 Checking ONOS service - PASS (tick)
  • 55.6 Starting ONOS CLI sessions - PASS (tick)
  • 55.7 Checking ONOS nodes - PASS (tick)
  • 55.8 Checking ONOS applications - PASS (tick)
  • 55.9 Starting Mininet Topology - PASS (tick)
  • 55.10 Check whether the flow count is bigger than 28 - PASS (tick)FAIL (error)
    • Flow count looks wrong: False
  • 55.11 Check whether all flow status are ADDED - PASS (tick)
  • 55.12 Check whether the flow count of device of:0000000000000001 is bigger than 28 - PASS (tick)FAIL (error)
    • Flow count looks wrong.
  • 55.13 Verify full connectivity for [u'h1', u'h2'] with tag CASE55 - PASS (tick)
  • 55.14 Stopping Mininet - PASS (tick)
  • 55.15 Copying karaf logs - PASS (tick)

...

  • 75.1 Apply cell to environment - PASS (tick)
  • 75.2 Uninstalling ONOS package - PASS (tick)
  • 75.3 Installing ONOS package - PASS (tick)
  • 75.4 Set up ONOS secure SSH - PASS (tick)
  • 75.5 Checking ONOS service - PASS (tick)
  • 75.6 Starting ONOS CLI sessions - PASS (tick)
  • 75.7 Checking ONOS nodes - PASS (tick)
  • 75.8 Checking ONOS applications - PASS (tick)
  • 75.9 Starting Mininet Topology - PASS (tick)
  • 75.10 Check whether the flow count is bigger than 28 - PASS (tick)
  • 75.11 Check whether all flow status are ADDED - PASS (tick)
  • 75.12 Check whether the flow count of device of:0000000000000001 is bigger than 28 - PASS (tick)
  • 75.13 Verify full connectivity for [u'h1', u'h2'] with tag CASE75 - PASS (tick)
  • 75.14 Stopping Mininet - PASS (tick)
  • 75.15 Copying karaf logs - PASS (tick)

Case 76: Bridging test between untagged and tagged hosts with different vlan id, with dual-homed ToR and 3 ONOS instances -

...

FAIL

  • 76.1 Apply cell to environment - PASS (tick)
  • 76.2 Uninstalling ONOS package - PASS (tick)
  • 76.3 Installing ONOS package - PASS (tick)
  • 76.4 Set up ONOS secure SSH - PASS (tick)
  • 76.5 Checking ONOS service - PASS (tick)
  • 76.6 Starting ONOS CLI sessions - PASS (tick)
  • 76.7 Checking ONOS nodes - PASS (tick)FAIL (error)
    • Not all ONOS nodes are in READY state
  • 76.8 Checking ONOS applications - PASS (tick)
  • 76.9 Starting Mininet Topology - PASS (tick)
  • 76.10 Check whether the flow count is bigger than 74 - PASS (tick)
  • 76.11 Check whether all flow status are ADDED - PASS (tick)
  • 76.12 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 76.13 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 76.14 Verify full connectivity for [u'h1', u'h2'] with tag CASE76 - PASS (tick)
  • 76.15 Stopping Mininet - PASS (tick)
  • 76.16 Copying karaf logs - PASS (tick)

...