Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published from Jenkins build: https://jenkins.onosproject.org/job/SR-pipeline-1.15/1352/

...

  • 13.1 Constructing test variables - PASS (tick)
  • 13.2 Apply cell to environment - PASS (tick)
  • 13.3 Uninstalling Atomix - PASS (tick)
  • 13.4 Uninstalling ONOS package - PASS (tick)
  • 13.5 Creating ONOS package - PASS (tick)
  • 13.6 Installing Atomix - PASS (tick)
  • 13.7 Installing ONOS package - PASS (tick)
  • 13.8 Set up ONOS secure SSH - PASS (tick)
  • 13.9 Checking ONOS service - PASS (tick)
  • 13.10 Starting ONOS CLI sessions - PASS (tick)
  • 13.11 Checking ONOS nodes - PASS (tick)
  • 13.12 Checking ONOS applications - PASS (tick)
  • 13.13 Starting Mininet Topology - PASS (tick)
  • 13.14 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.15 Check whether all flow status are ADDED - PASS (tick)
  • 13.16 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - PASS (tick)
  • 13.17 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 13.18 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 13.19 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.20 Check whether all flow status are ADDED - PASS (tick)
  • 13.21 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - PASS (tick)
  • 13.22 Stopping Mininet - PASS (tick)
  • 13.23 Copying karaf logs - PASS (tick)

Case 23: Changing port configuration from untagged 10 to tagged 20 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 23.1 Apply cell to environment - PASS (tick)
  • 23.2 Uninstalling Atomix - PASS (tick)
  • 23.3 Uninstalling ONOS package - PASS (tick)
  • 23.4 Installing Atomix - PASS (tick)
  • 23.5 Installing ONOS package - PASS (tick)
  • 23.6 Set up ONOS secure SSH - PASS (tick)
  • 23.7 Checking ONOS service - PASS (tick)
  • 23.8 Starting ONOS CLI sessions - PASS (tick)
  • 23.9 Checking ONOS nodes - PASS (tick)
  • 23.10 Checking ONOS applications - PASS (tick)
  • 23.11 Starting Mininet Topology - PASS (tick)
  • 23.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 23.13 Check whether all flow status are ADDED - PASS (tick)
  • 23.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - PASS (tick)
  • 23.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - PASS (tick)
  • 23.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 23.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 23.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 23.19 Check whether all flow status are ADDED - FAIL (error)
  • Flow status is wrong!
  • PASS (tick)
  • 23.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS (tick)
  • 23.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - PASS (tick)
  • 23.22 Stopping Mininet - PASS (tick)
  • 23.23 Copying karaf logs - PASS (tick)

...

  • 63.1 Apply cell to environment - PASS (tick)
  • 63.2 Uninstalling Atomix - PASS (tick)
  • 63.3 Uninstalling ONOS package - PASS (tick)
  • 63.4 Installing Atomix - PASS (tick)
  • 63.5 Installing ONOS package - PASS (tick)
  • 63.6 Set up ONOS secure SSH - PASS (tick)
  • 63.7 Checking ONOS service - PASS (tick)
  • 63.8 Starting ONOS CLI sessions - PASS (tick)
  • 63.9 Checking ONOS nodes - PASS (tick)
  • 63.10 Checking ONOS applications - PASS (tick)
  • 63.11 Starting Mininet Topology - PASS (tick)
  • 63.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.13 Check whether all flow status are ADDED - PASS (tick)
  • 63.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_Before - PASS (tick)
  • 63.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_Before - PASS (tick)
  • 63.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 63.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 63.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.19 Check whether all flow status are ADDED - PASS (tick)
  • 63.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_After - PASS (tick)
  • 63.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_After - PASS (tick)
  • 63.22 Stopping Mininet - PASS (tick)
  • 63.23 Copying karaf logs - PASS (tick)

Case 73: Changing port configuration from tagged 10 to untagged 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 73.1 Apply cell to environment - PASS (tick)
  • 73.2 Uninstalling Atomix - PASS (tick)
  • 73.3 Uninstalling ONOS package - PASS (tick)
  • 73.4 Installing Atomix - PASS (tick)
  • 73.5 Installing ONOS package - PASS (tick)
  • 73.6 Set up ONOS secure SSH - PASS (tick)FAIL (error)
    • Failed to secure ssh
  • 73.7 Checking ONOS service - PASS (tick)
  • 73.8 Starting ONOS CLI sessions - PASS (tick)
  • 73.9 Checking ONOS nodes - PASS (tick)
  • 73.10 Checking ONOS applications - PASS (tick)
  • 73.11 Starting Mininet Topology - PASS (tick)
  • 73.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 73.13 Check whether all flow status are ADDED - PASS (tick)
  • 73.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_Before - PASS (tick)
  • 73.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_Before - PASS (tick)
  • 73.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 73.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 73.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 73.19 Check whether all flow status are ADDED - PASS (tick)
  • 73.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_After - PASS (tick)
  • 73.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_After - PASS (tick)
  • 73.22 Stopping Mininet - PASS (tick)
  • 73.23 Copying karaf logs - PASS (tick)

...

  • 113.1 Apply cell to environment - PASS (tick)
  • 113.2 Uninstalling Atomix - PASS (tick)
  • 113.3 Uninstalling ONOS package - PASS (tick)
  • 113.4 Installing Atomix - PASS (tick)
  • 113.5 Installing ONOS package - PASS (tick)
  • 113.6 Set up ONOS secure SSH - FAIL (error)
    • Failed to secure ssh
  • PASS (tick)
  • 113.7 Checking ONOS service - PASS (tick)
  • 113.8 Starting ONOS CLI sessions - PASS (tick)
  • 113.9 Checking ONOS nodes - PASS (tick)
  • 113.10 Checking ONOS applications - PASS (tick)
  • 113.11 Starting Mininet Topology - PASS (tick)
  • 113.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 113.13 Check whether all flow status are ADDED - PASS (tick)
  • 113.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_Before - PASS (tick)
  • 113.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE113_Before - PASS (tick)
  • 113.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 113.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 113.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 113.19 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 113.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE113_After - PASS (tick)
  • 113.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE113_After - PASS (tick)
  • 113.22 Stopping Mininet - PASS (tick)
  • 113.23 Copying karaf logs - PASS (tick)

...

  • 163.1 Apply cell to environment - PASS (tick)
  • 163.2 Uninstalling Atomix - PASS (tick)
  • 163.3 Uninstalling ONOS package - PASS (tick)
  • 163.4 Installing Atomix - PASS (tick)
  • 163.5 Installing ONOS package - PASS (tick)
  • 163.6 Set up ONOS secure SSH - PASS (tick)
  • 163.7 Checking ONOS service - PASS (tick)
  • 163.8 Starting ONOS CLI sessions - PASS (tick)
  • 163.9 Checking ONOS nodes - PASS (tick)
  • 163.10 Checking ONOS applications - PASS (tick)
  • 163.11 Starting Mininet Topology - PASS (tick)
  • 163.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 163.13 Check whether all flow status are ADDED - PASS (tick)
  • 163.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE163_Before - PASS (tick)
  • 163.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE163_Before - PASS (tick)
  • 163.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 163.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 163.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 163.19 Check whether all flow status are ADDED - PASS (tick)
  • 163.20 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE163_After - PASS (tick)
  • 163.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE163_After - PASS (tick)
  • 163.22 Stopping Mininet - PASS (tick)
  • 163.23 Copying karaf logs - PASS (tick)

Case 173: Changing port configuration from tagged 20 to tagged 120, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 173.1 Apply cell to environment - PASS (tick)
  • 173.2 Uninstalling Atomix - PASS (tick)
  • 173.3 Uninstalling ONOS package - PASS (tick)
  • 173.4 Installing Atomix - PASS (tick)
  • 173.5 Installing ONOS package - PASS (tick)
  • 173.6 Set up ONOS secure SSH - PASS (tick)FAIL (error)
    • Failed to secure ssh
  • 173.7 Checking ONOS service - PASS (tick)
  • 173.8 Starting ONOS CLI sessions - PASS (tick)
  • 173.9 Checking ONOS nodes - PASS (tick)
  • 173.10 Checking ONOS applications - PASS (tick)
  • 173.11 Starting Mininet Topology - PASS (tick)
  • 173.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 173.13 Check whether all flow status are ADDED - PASS (tick)
  • 173.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE173_Before - PASS (tick)
  • 173.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE173_Before - PASS (tick)
  • 173.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 173.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 173.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 173.19 Check whether all flow status are ADDED - PASS (tick)
  • 173.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE173_After - PASS (tick)
  • 173.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE173_After - PASS (tick)
  • 173.22 Stopping Mininet - PASS (tick)
  • 173.23 Copying karaf logs - PASS (tick)

...

  • 203.1 Apply cell to environment - PASS (tick)
  • 203.2 Uninstalling Atomix - PASS (tick)
  • 203.3 Uninstalling ONOS package - PASS (tick)
  • 203.4 Installing Atomix - PASS (tick)
  • 203.5 Installing ONOS package - PASS (tick)
  • 203.6 Set up ONOS secure SSH - PASS (tick)
  • 203.7 Checking ONOS service - PASS (tick)
  • 203.8 Starting ONOS CLI sessions - PASS (tick)
  • 203.9 Checking ONOS nodes - PASS (tick)
  • 203.10 Checking ONOS applications - PASS (tick)
  • 203.11 Starting Mininet Topology - PASS (tick)
  • 203.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 203.13 Check whether all flow status are ADDED - PASS (tick)
  • 203.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE203_Before - PASS (tick)
  • 203.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE203_Before - PASS (tick)
  • 203.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 203.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 203.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 203.19 Check whether all flow status are ADDED - PASS (tick)
  • 203.20 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE203_After - PASS (tick)
  • 203.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE203_After - PASS (tick)
  • 203.22 Stopping Mininet - PASS (tick)
  • 203.23 Copying karaf logs - PASS (tick)

Case 213: Changing port configuration from tagged 20 and native 10 to tagged 20 and native 110, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 213.1 Apply cell to environment - PASS (tick)
  • 213.2 Uninstalling Atomix - PASS (tick)
  • 213.3 Uninstalling ONOS package - PASS (tick)
  • 213.4 Installing Atomix - PASS (tick)
  • 213.5 Installing ONOS package - PASS (tick)
  • 213.6 Set up ONOS secure SSH - PASS (tick)FAIL (error)
    • Failed to secure ssh
  • 213.7 Checking ONOS service - PASS (tick)
  • 213.8 Starting ONOS CLI sessions - PASS (tick)
  • 213.9 Checking ONOS nodes - PASS (tick)
  • 213.10 Checking ONOS applications - PASS (tick)
  • 213.11 Starting Mininet Topology - PASS (tick)
  • 213.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.13 Check whether all flow status are ADDED - PASS (tick)
  • 213.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_Before - PASS (tick)
  • 213.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_Before - PASS (tick)
  • 213.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 213.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 213.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.19 Check whether all flow status are ADDED - PASS (tick)
  • 213.20 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_After - PASS (tick)
  • 213.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_After - PASS (tick)
  • 213.22 Stopping Mininet - PASS (tick)
  • 213.23 Copying karaf logs - PASS (tick)

Case 223: Changing port configuration from tagged 20 and native 10 to tagged 120 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 223.1 Apply cell to environment - PASS (tick)
  • 223.2 Uninstalling Atomix - PASS (tick)
  • 223.3 Uninstalling ONOS package - PASS (tick)
  • 223.4 Installing Atomix - PASS (tick)
  • 223.5 Installing ONOS package - PASS (tick)
  • 223.6 Set up ONOS secure SSH - PASS (tick)
  • 223.7 Checking ONOS service - PASS (tick)
  • 223.8 Starting ONOS CLI sessions - PASS (tick)
  • 223.9 Checking ONOS nodes - PASS (tick)
  • 223.10 Checking ONOS applications - PASS (tick)
  • 223.11 Starting Mininet Topology - PASS (tick)
  • 223.12 Check whether the flow count is bigger than 106 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 93
  • 223.13 Check whether all flow status are ADDED - PASS (tick)
  • 223.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE223_Before - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 223.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE223_Before - PASS (tick)
  • 223.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 17
  • 223.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 36
  • 223.18 Check whether the flow count is bigger than 106 - PASS (tick)FAIL (error)
    • Flow count looks wrong: 98
  • 223.19 Check whether all flow status are ADDED - PASS (tick)
  • 223.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE223_After - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 223.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE223_After - PASS (tick)
  • 223.22 Stopping Mininet - PASS (tick)
  • 223.23 Copying karaf logs - PASS (tick)

...