Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published from Jenkins build: https://jenkins.onosproject.org/job/SR-pipeline-1.15/1146/

...

  • 5.1 Constructing test variables - PASS (tick)
  • 5.2 Apply cell to environment - PASS (tick)
  • 5.3 Uninstalling Atomix - PASS (tick)
  • 5.4 Uninstalling ONOS package - PASS (tick)
  • 5.5 Creating ONOS package - PASS (tick)
  • 5.6 Installing Atomix - PASS (tick)
  • 5.7 Installing ONOS package - PASS (tick)
  • 5.8 Set up ONOS secure SSH - PASS (tick)
  • 5.9 Checking ONOS service - PASS (tick)
  • 5.10 Starting ONOS CLI sessions - PASS (tick)
  • 5.11 Checking ONOS nodes - PASS (tick)
  • 5.12 Checking ONOS applications - PASS (tick)
  • 5.13 Starting Mininet Topology - PASS (tick)
  • 5.14 Check whether the flow count is bigger than 28 - PASS (tick)
  • 5.15 Check whether all flow status are ADDED - PASS (tick)
  • 5.16 Check whether the flow count of device of:0000000000000001 is bigger than 28 - PASS (tick)
  • 5.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE5 - PASS (tick)
  • 5.18 Stopping Mininet - PASS (tick)
  • 5.19 Copying karaf logs - PASS (tick)

Case 6: Bridging test between two untagged hosts on vlan-untagged port, with dual-homed ToR and 3 ONOS instances -

...

PASS

  • 6.1 Apply cell to environment - PASS (tick)
  • 6.2 Uninstalling Atomix - PASS (tick)
  • 6.3 Uninstalling ONOS package - PASS (tick)
  • 6.4 Installing Atomix - PASS (tick)
  • 6.5 Installing ONOS package - PASS (tick)
  • 6.6 Set up ONOS secure SSH - PASS (tick)
  • 6.7 Checking ONOS service - PASS (tick)
  • 6.8 Starting ONOS CLI sessions - PASS (tick)
  • 6.9 Checking ONOS nodes - PASS (tick)
  • 6.10 Checking ONOS applications - PASS (tick)
  • 6.11 Starting Mininet Topology - PASS (tick)
  • 6.12 Check whether the flow count is bigger than 74 - PASS (tick)
  • 6.13 Check whether all flow status are ADDED - PASS (tick)
  • 6.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 6.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 6.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE6 - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 6.17 Stopping Mininet - PASS (tick)
  • 6.18 Copying karaf logs - PASS (tick)

Case 7: Bridging test between two untagged hosts on vlan-untagged port, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 7.1 Apply cell to environment - PASS (tick)
  • 7.2 Uninstalling Atomix - PASS (tick)
  • 7.3 Uninstalling ONOS package - PASS (tick)
  • 7.4 Installing Atomix - PASS (tick)
  • 7.5 Installing ONOS package - PASS (tick)
  • 7.6 Set up ONOS secure SSH - PASS (tick)
  • 7.7 Checking ONOS service - PASS (tick)
  • 7.8 Starting ONOS CLI sessions - PASS (tick)
  • 7.9 Checking ONOS nodes - PASS (tick)
  • 7.10 Checking ONOS applications - PASS (tick)
  • 7.11 Starting Mininet Topology - PASS (tick)
  • 7.12 Check whether the flow count is bigger than 74 - PASS (tick)
  • 7.13 Check whether all flow status are ADDED - PASS (tick)
  • 7.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 7.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 7.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE7 - PASS (tick)
  • 7.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE7 - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 7.18 Stopping Mininet - PASS (tick)
  • 7.19 Copying karaf logs - PASS (tick)

...

  • 17.1 Apply cell to environment - PASS (tick)
  • 17.2 Uninstalling Atomix - PASS (tick)
  • 17.3 Uninstalling ONOS package - PASS (tick)
  • 17.4 Installing Atomix - PASS (tick)
  • 17.5 Installing ONOS package - PASS (tick)
  • 17.6 Set up ONOS secure SSH - PASS (tick)
  • 17.7 Checking ONOS service - PASS (tick)
  • 17.8 Starting ONOS CLI sessions - PASS (tick)
  • 17.9 Checking ONOS nodes - PASS (tick)
  • 17.10 Checking ONOS applications - PASS (tick)
  • 17.11 Starting Mininet Topology - PASS (tick)
  • 17.12 Check whether the flow count is bigger than 74 - PASS (tick)
  • 17.13 Check whether all flow status are ADDED - PASS (tick)
  • 17.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 17.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 17.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE17 - PASS (tick)
  • 17.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE17 - PASS (tick)
  • 17.18 Stopping Mininet - PASS (tick)
  • 17.19 Copying karaf logs - PASS (tick)

Case 18: Bridging test between two tagged hosts, with 2x4 dual-homed leaf-spine topology and 3 ONOS instances -

...

PASS

  • 18.1 Apply cell to environment - PASS (tick)
  • 18.2 Uninstalling Atomix - PASS (tick)
  • 18.3 Uninstalling ONOS package - PASS (tick)
  • 18.4 Installing Atomix - PASS (tick)
  • 18.5 Installing ONOS package - PASS (tick)
  • 18.6 Set up ONOS secure SSH - PASS (tick)
  • 18.7 Checking ONOS service - PASS (tick)
  • 18.8 Starting ONOS CLI sessions - PASS (tick)
  • 18.9 Checking ONOS nodes - PASS (tick)
  • 18.10 Checking ONOS applications - PASS (tick)
  • 18.11 Starting Mininet Topology - PASS (tick)
  • 18.12 Check whether the flow count is bigger than 212 - PASS (tick)
  • 18.13 Check whether all flow status are ADDED - PASS (tick)
  • 18.14 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 18.15 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL (error)
  • Flow count looks wrong: 18
  • PASS (tick)
  • 18.16 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 18.17 Check whether the flow count of device of:0000000000000004 is bigger than 53 - FAIL (error)
  • Flow count looks wrong: 18
  • PASS (tick)
  • 18.18 Verify full connectivity for [u'h1', u'h2'] with tag CASE18 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 18.19 Verify full connectivity for [u'h3', u'h4'] with tag CASE18 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 18.20 Stopping Mininet - PASS (tick)
  • 18.21 Copying karaf logs - PASS (tick)

...

  • 25.1 Apply cell to environment - PASS (tick)
  • 25.2 Uninstalling Atomix - PASS (tick)
  • 25.3 Uninstalling ONOS package - PASS (tick)
  • 25.4 Installing Atomix - PASS (tick)
  • 25.5 Installing ONOS package - PASS (tick)
  • 25.6 Set up ONOS secure SSH - PASS (tick)
  • 25.7 Checking ONOS service - PASS (tick)
  • 25.8 Starting ONOS CLI sessions - PASS (tick)
  • 25.9 Checking ONOS nodes - PASS (tick)
  • 25.10 Checking ONOS applications - PASS (tick)
  • 25.11 Starting Mininet Topology - PASS (tick)
  • 25.12 Check whether the flow count is bigger than 28 - PASS (tick)
  • 25.13 Check whether all flow status are ADDED - PASS (tick)
  • 25.14 Check whether the flow count of device of:0000000000000001 is bigger than 28 - PASS (tick)
  • 25.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE25 - PASS (tick)
  • 25.16 Stopping Mininet - PASS (tick)
  • 25.17 Copying karaf logs - PASS (tick)

Case 26: Bridging test between two untagged hosts on vlan-native port, with dual-homed ToR and 3 ONOS instances -

...

FAIL

  • 26.1 Apply cell to environment - PASS (tick)
  • 26.2 Uninstalling Atomix - PASS (tick)
  • 26.3 Uninstalling ONOS package - PASS (tick)
  • 26.4 Installing Atomix - PASS (tick)
  • 26.5 Installing ONOS package - PASS (tick)
  • 26.6 Set up ONOS secure SSH - PASS (tick)
  • 26.7 Checking ONOS service - PASS (tick)
  • 26.8 Starting ONOS CLI sessions - PASS (tick)
  • 26.9 Checking ONOS nodes - PASS (tick)
  • 26.10 Checking ONOS applications - PASS (tick)
  • 26.11 Starting Mininet Topology - PASS (tick)
  • 26.12 Check whether the flow count is bigger than 74 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 32
  • 26.13 Check whether all flow status are ADDED - PASS (tick)
  • 26.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 16
  • 26.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 16
  • 26.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE26 - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 26.17 Stopping Mininet - PASS (tick)
  • 26.18 Copying karaf logs - PASS (tick)

...

  • 27.1 Apply cell to environment - PASS (tick)
  • 27.2 Uninstalling Atomix - PASS (tick)
  • 27.3 Uninstalling ONOS package - PASS (tick)
  • 27.4 Installing Atomix - PASS (tick)
  • 27.5 Installing ONOS package - PASS (tick)
  • 27.6 Set up ONOS secure SSH - PASS (tick)
  • 27.7 Checking ONOS service - PASS (tick)
  • 27.8 Starting ONOS CLI sessions - PASS (tick)
  • 27.9 Checking ONOS nodes - PASS (tick)
  • 27.10 Checking ONOS applications - PASS (tick)
  • 27.11 Starting Mininet Topology - PASS (tick)
  • 27.12 Check whether the flow count is bigger than 74 - PASS (tick)
  • 27.13 Check whether all flow status are ADDED - PASS (tick)
  • 27.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 27.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 27.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE27 - PASS (tick)
  • 27.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE27 - PASS (tick)
  • 27.18 Stopping Mininet - PASS (tick)
  • 27.19 Copying karaf logs - PASS (tick)

Case 28: Bridging test between two untagged hosts on vlan-native port, with 2x4 dual-homed leaf-spine topology and 3 ONOS instances -

...

PASS

  • 28.1 Apply cell to environment - PASS (tick)
  • 28.2 Uninstalling Atomix - PASS (tick)
  • 28.3 Uninstalling ONOS package - PASS (tick)
  • 28.4 Installing Atomix - PASS (tick)
  • 28.5 Installing ONOS package - PASS (tick)
  • 28.6 Set up ONOS secure SSH - PASS (tick)
  • 28.7 Checking ONOS service - PASS (tick)
  • 28.8 Starting ONOS CLI sessions - PASS (tick)
  • 28.9 Checking ONOS nodes - PASS (tick)
  • 28.10 Checking ONOS applications - PASS (tick)
  • 28.11 Starting Mininet Topology - PASS (tick)
  • 28.12 Check whether the flow count is bigger than 212 - PASS (tick)
  • 28.13 Check whether all flow status are ADDED - PASS (tick)
  • 28.14 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 28.15 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 28.16 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 28.17 Check whether the flow count of device of:0000000000000004 is bigger than 53 - FAIL (error)
    • Flow count looks wrong: 18
  • PASS (tick)
  • 28.18 Verify full connectivity for [u'h1', u'h2'] with tag CASE28 - PASS (tick)
  • 28.19 Verify full connectivity for [u'h3', u'h4'] with tag CASE28 - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 28.20 Stopping Mininet - PASS (tick)
  • 28.21 Copying karaf logs - PASS (tick)

...

  • 67.1 Apply cell to environment - PASS (tick)
  • 67.2 Uninstalling Atomix - PASS (tick)
  • 67.3 Uninstalling ONOS package - PASS (tick)
  • 67.4 Installing Atomix - PASS (tick)
  • 67.5 Installing ONOS package - PASS (tick)
  • 67.6 Set up ONOS secure SSH - PASS (tick)
  • 67.7 Checking ONOS service - PASS (tick)
  • 67.8 Starting ONOS CLI sessions - PASS (tick)
  • 67.9 Checking ONOS nodes - PASS (tick)
  • 67.10 Checking ONOS applications - PASS (tick)
  • 67.11 Starting Mininet Topology - PASS (tick)
  • 67.12 Check whether the flow count is bigger than 74 - PASS (tick)
  • 67.13 Check whether all flow status are ADDED - PASS (tick)
  • 67.14 Check whether the flow count of device of:0000000000000001 is bigger than 37 - PASS (tick)
  • 67.15 Check whether the flow count of device of:0000000000000002 is bigger than 37 - PASS (tick)
  • 67.16 Verify full connectivity for [u'h1', u'h2'] with tag CASE67 - PASS (tick)
  • 67.17 Verify full connectivity for [u'h3', u'h4'] with tag CASE67 - PASS (tick)
  • 67.18 Stopping Mininet - PASS (tick)
  • 67.19 Copying karaf logs - PASS (tick)

Case 68: Bridging test between two tagged hosts with different vlan id, with 2x4 dual-homed leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 68.1 Apply cell to environment - PASS (tick)
  • 68.2 Uninstalling Atomix - PASS (tick)
  • 68.3 Uninstalling ONOS package - PASS (tick)
  • 68.4 Installing Atomix - PASS (tick)
  • 68.5 Installing ONOS package - PASS (tick)
  • 68.6 Set up ONOS secure SSH - PASS (tick)
  • 68.7 Checking ONOS service - PASS (tick)
  • 68.8 Starting ONOS CLI sessions - PASS (tick)
  • 68.9 Checking ONOS nodes - PASS (tick)
  • 68.10 Checking ONOS applications - PASS (tick)
  • 68.11 Starting Mininet Topology - PASS (tick)
  • 68.12 Check whether the flow count is bigger than 212 - PASS (tick)
  • 68.13 Check whether all flow status are ADDED - PASS (tick)
  • 68.14 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 68.15 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 68.16 Check whether the flow count of device of:0000000000000003 is bigger than 53 - PASS (tick)
  • 68.17 Check whether the flow count of device of:0000000000000004 is bigger than 53 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 18
  • 68.18 Verify full connectivity for [u'h1', u'h2'] with tag CASE68 - PASS (tick)
  • 68.19 Verify full connectivity for [u'h3', u'h4'] with tag CASE68 - PASS (tick)
  • 68.20 Stopping Mininet - PASS (tick)
  • 68.21 Copying karaf logs - PASS (tick)

...