Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published from Jenkins build: https://jenkins.onosproject.org/job/SR-pipeline-1.11/86/

...

HTML
<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric/lastSuccessfulBuild/artifact/SRDynamicConf_onos-1.11_20-builds_graph.jpg", alt="SRDynamicConf", style="width:525px;height:350px;border:0">

commit 05acc713ac764f932179172528665c5ee6efe99c b784adb3987ace3d09cd851fff6bf9384ed32371 (HEAD -] onos-1.11, origin/onos-1.11)
Author: ONOS Jenkins User [jenkins@onlab.usRay Milkey [ray@opennetworking.org]
AuthorDate: Tue Mar 27 17:38:17 2018 +0000Mon Apr 2 15:33:07 2018 -0700
Commit: ONOS Jenkins User [jenkins@onlab.usRay Milkey [ray@opennetworking.org]
CommitDate: Tue Mar 27 17:38:17 Apr 3 19:12:27 2018 +0000
Starting snapshot 1.11.3-SNAPSHOT
Upgrade fasterXML libraries for OS-9

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 13.1 Constructing test variables - No Result (warning)
  • 13.2 Constructing test variables - PASS (tick)
  • 13.3 Apply cell to environment - PASS (tick)
  • 13.4 Uninstalling ONOS package - PASS (tick)
  • 13.5 Creating ONOS package - PASS (tick)
  • 13.6 Installing ONOS package - PASS (tick)
  • 13.7 Set up ONOS secure SSH - PASS (tick)
  • 13.8 Checking ONOS service - PASS (tick)
  • 13.9 Starting ONOS CLI sessions - PASS (tick)
  • 13.10 Starting Mininet Topology - PASS (tick)
  • 13.11 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.12 Check whether all flow status are ADDED - PASS (tick)
  • 13.13 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_Before - PASS (tick)
  • 13.14 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 13.15 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 13.16 Check whether the flow count is bigger than 104 - PASS (tick)
  • 13.17 Check whether all flow status are ADDED - PASS (tick)
  • 13.18 Verify full connectivity for [u'h1', u'h2', u'h3', u'h4'] with tag CASE13_After - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 13.19 Stopping Mininet - PASS (tick)
  • 13.20 Copying karaf logs - PASS (tick)

...

  • 53.1 Apply cell to environment - PASS (tick)
  • 53.2 Uninstalling ONOS package - PASS (tick)
  • 53.3 Installing ONOS package - PASS (tick)
  • 53.4 Set up ONOS secure SSH - PASS (tick)
  • 53.5 Checking ONOS service - PASS (tick)
  • 53.6 Starting ONOS CLI sessions - PASS (tick)
  • 53.7 Starting Mininet Topology - PASS (tick)
  • 53.8 Check whether the flow count is bigger than 104 - PASS (tick)
  • 53.9 Check whether all flow status are ADDED - PASS (tick)
  • 53.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_Before - PASS (tick)
  • 53.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_Before - PASS (tick)
  • 53.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 53.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 53.14 Check whether the flow count is bigger than 104 - PASS (tick)
  • 53.15 Check whether all flow status are ADDED - FAIL (error)
    • Flow status is wrong!
  • PASS (tick)
  • 53.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_After - PASS (tick)
  • 53.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_After - FAIL (error)
    • IP connectivity failed
  • 53.18 Stopping Mininet - PASS (tick)
  • 53.19 Copying karaf logs - PASS (tick)

...

  • 63.1 Apply cell to environment - PASS (tick)
  • 63.2 Uninstalling ONOS package - PASS (tick)
  • 63.3 Installing ONOS package - PASS (tick)
  • 63.4 Set up ONOS secure SSH - PASS (tick)
  • 63.5 Checking ONOS service - PASS (tick)
  • 63.6 Starting ONOS CLI sessions - PASS (tick)
  • 63.7 Starting Mininet Topology - PASS (tick)
  • 63.8 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.9 Check whether all flow status are ADDED - PASS (tick)
  • 63.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_Before - PASS (tick)
  • 63.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_Before - PASS (tick)
  • 63.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 63.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 63.14 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.15 Check whether all flow status are ADDED - FAIL (error)
    • Flow status is wrong!
  • PASS (tick)
  • 63.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_After - PASS (tick)
  • 63.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_After - FAIL (error)
    • IP connectivity failed
  • 63.18 Stopping Mininet - PASS (tick)
  • 63.19 Copying karaf logs - PASS (tick)

Case 73: Changing port configuration from tagged 10 to untagged 10, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 73.1 Apply cell to environment - PASS (tick)
  • 73.2 Uninstalling ONOS package - PASS (tick)
  • 73.3 Installing ONOS package - PASS (tick)
  • 73.4 Set up ONOS secure SSH - PASS (tick)
  • 73.5 Checking ONOS service - PASS (tick)
  • 73.6 Starting ONOS CLI sessions - PASS (tick)
  • 73.7 Starting Mininet Topology - PASS (tick)
  • 73.8 Check whether the flow count is bigger than 106 - PASS (tick)
  • 73.9 Check whether all flow status are ADDED - PASS (tick)
  • 73.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_Before - PASS (tick)
  • 73.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_Before - PASS (tick)
  • 73.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 73.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 73.14 Check whether the flow count is bigger than 106 - PASS (tick)
  • 73.15 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 73.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE73_After - PASS (tick)
  • 73.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE73_After - PASS (tick)FAIL (error)
    • IP connectivity failed
  • 73.18 Stopping Mininet - PASS (tick)
  • 73.19 Copying karaf logs - PASS (tick)

...

  • 83.1 Apply cell to environment - PASS (tick)
  • 83.2 Uninstalling ONOS package - PASS (tick)
  • 83.3 Installing ONOS package - PASS (tick)
  • 83.4 Set up ONOS secure SSH - PASS (tick)
  • 83.5 Checking ONOS service - PASS (tick)
  • 83.6 Starting ONOS CLI sessions - PASS (tick)
  • 83.7 Starting Mininet Topology - PASS (tick)
  • 83.8 Check whether the flow count is bigger than 104 - PASS (tick)
  • 83.9 Check whether all flow status are ADDED - PASS (tick)
  • 83.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_Before - PASS (tick)
  • 83.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_Before - PASS (tick)
  • 83.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 83.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 83.14 Check whether the flow count is bigger than 104 - PASS (tick)
  • 83.15 Check whether all flow status are ADDED - PASS (tick)
  • 83.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE83_After - PASS (tick)
  • 83.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE83_After - PASS (tick)
  • 83.18 Stopping Mininet - PASS (tick)
  • 83.19 Copying karaf logs - PASS (tick)

Case 93: Changing port configuration from tagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 93.1 Apply cell to environment - PASS (tick)
  • 93.2 Uninstalling ONOS package - PASS (tick)
  • 93.3 Installing ONOS package - PASS (tick)
  • 93.4 Set up ONOS secure SSH - PASS (tick)
  • 93.5 Checking ONOS service - PASS (tick)
  • 93.6 Starting ONOS CLI sessions - PASS (tick)
  • 93.7 Starting Mininet Topology - PASS (tick)
  • 93.8 Check whether the flow count is bigger than 106 - PASS (tick)
  • 93.9 Check whether all flow status are ADDED - PASS (tick)
  • 93.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_Before - PASS (tick)
  • 93.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_Before - PASS (tick)
  • 93.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 93.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 93.14 Check whether the flow count is bigger than 106 - PASS (tick)
  • 93.15 Check whether all flow status are ADDED - FAIL (error)
    • Flow status is wrong!
  • PASS (tick)
  • 93.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE93_After - PASS (tick)
  • 93.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE93_After - PASS (tick)
  • 93.18 Stopping Mininet - PASS (tick)
  • 93.19 Copying karaf logs - PASS (tick)

...

  • 223.1 Apply cell to environment - PASS (tick)
  • 223.2 Uninstalling ONOS package - PASS (tick)
  • 223.3 Installing ONOS package - PASS (tick)
  • 223.4 Set up ONOS secure SSH - PASS (tick)
  • 223.5 Checking ONOS service - PASS (tick)
  • 223.6 Starting ONOS CLI sessions - PASS (tick)
  • 223.7 Starting Mininet Topology - PASS (tick)
  • 223.8 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.9 Check whether all flow status are ADDED - PASS (tick)
  • 223.10 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE223_Before - PASS (tick)
  • 223.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE223_Before - PASS (tick)
  • 223.12 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 223.13 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 223.14 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.15 Check whether all flow status are ADDED - PASS (tick)
  • 223.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE223_After - PASS (tick)
  • 223.17 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE223_After - PASS (tick)
  • 223.18 Stopping Mininet - PASS (tick)
  • 223.19 Copying karaf logs - PASS (tick)

Case 233: Consecutive configuration changes, with 2x2 leaf-spine topology and 3 ONOS instances -

...

PASS

  • 233.1 Apply cell to environment - PASS (tick)
  • 233.2 Uninstalling ONOS package - PASS (tick)
  • 233.3 Installing ONOS package - PASS (tick)
  • 233.4 Set up ONOS secure SSH - PASS (tick)
  • 233.5 Checking ONOS service - PASS (tick)
  • 233.6 Starting ONOS CLI sessions - PASS (tick)
  • 233.7 Starting Mininet Topology - PASS (tick)
  • 233.8 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.9 Check whether all flow status are ADDED - PASS (tick)
  • 233.10 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_Before - PASS (tick)
  • 233.11 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_Before - PASS (tick)
  • 233.12 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.13 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.14 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.15 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.16 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_1 - PASS (tick)
  • 233.17 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_1 - PASS (tick)
  • 233.18 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.19 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_2 - PASS (tick)
  • 233.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_2 - PASS (tick)
  • 233.22 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.23 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.24 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_3 - PASS (tick)
  • 233.25 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_3 - PASS (tick)
  • 233.26 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.27 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.28 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_4 - PASS (tick)
  • 233.29 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_4 - PASS (tick)
  • 233.30 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.31 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.32 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_5 - PASS (tick)
  • 233.33 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_5 - PASS (tick)
  • 233.34 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.35 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.36 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_6 - PASS (tick)
  • 233.37 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_6 - PASS (tick)
  • 233.38 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.39 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.40 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.41 Check whether all flow status are ADDED - PASS (tick)
  • 233.42 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_After - PASS (tick)
  • 233.43 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_After - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 233.44 Stopping Mininet - PASS (tick)
  • 233.45 Copying karaf logs - PASS (tick)

...