Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published from Jenkins build: https://jenkins.onosproject.org/job/SR-pipeline-2.0/1109/

...

HTML
<img src="https://jenkins.onosproject.org/view/QA/job/postjob-Fabric3/lastSuccessfulBuild/artifact/SRDynamicConf_onos-2.0_20-builds_graph.jpg", alt="SRDynamicConf", style="width:525px;height:350px;border:0">

commit 5854f2bf57e1f96d45624755b3302a56ecba17d1 1990278de6f59d84cd81aebe84135050122b056b (HEAD -] onos-2.0, origin/onos-2.0)
Author: Harshada Chaundkar [Harshada_Chaundkar@comcast.comThomas Vachuska [tom@opennetworking.org]
AuthorDate: Fri Mar 8 14:15:53 2019 -0500Mon Apr 15 09:42:24 2019 -0700
Commit: Charles Chan Thomas Vachuska [rascov@gmailtom@opennetworking.comorg]
CommitDate: Mon Mar 11 Apr 15 09:3746:08 35 2019 -0700
Fixed potential NPE in packet-stats for ipv4 tcp packets
Replaced test mock with existing adapter in archetypes.

Case 13: Changing port configuration from untagged 10 to tagged 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

...

  • 23.1 Apply cell to environment - PASS (tick)
  • 23.2 Uninstalling Atomix - PASS (tick)
  • 23.3 Uninstalling ONOS package - PASS (tick)
  • 23.4 Installing Atomix - PASS (tick)
  • 23.5 Installing ONOS package - PASS (tick)
  • 23.6 Set up ONOS secure SSH - PASS (tick)
  • 23.7 Checking ONOS service - PASS (tick)
  • 23.8 Starting ONOS CLI sessions - PASS (tick)
  • 23.9 Checking ONOS nodes - PASS (tick)
  • 23.10 Checking ONOS applications - PASS (tick)
  • 23.11 Starting Mininet Topology - PASS (tick)
  • 23.12 Check whether the flow count is bigger than 106 - FAIL (error)
  • Flow count looks wrong: 96
  • PASS (tick)
  • 23.13 Check whether all flow status are ADDED - PASS (tick)
  • 23.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE23_Before - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 23.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_Before - FAIL (error)
    • IP connectivity failed
  • PASS (tick)
  • 23 23.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - FAIL (error)
  • Flow count looks wrong: 45
  • PASS (tick)
  • 23.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - FAIL (error)
    • Flow count looks wrong: 19
  • PASS (tick)
  • 23.18 Check whether the flow count is bigger than 106 - FAIL (error)
    • Flow count looks wrong: 97
  • PASS (tick)
  • 23.19 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 23.20 Verify full connectivity for [u'h1', u'h2'] with tag CASE23_After - PASS (tick)
  • 23.21 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE23_After - FAIL (error)
  • IP connectivity failed
  • PASS (tick)
  • 23.22 Stopping Mininet - PASS (tick)
  • 23.23 Copying karaf logs - PASS (tick)

...

  • 53.1 Apply cell to environment - PASS (tick)
  • 53.2 Uninstalling Atomix - PASS (tick)
  • 53.3 Uninstalling ONOS package - PASS (tick)
  • 53.4 Installing Atomix - PASS (tick)
  • 53.5 Installing ONOS package - PASS (tick)
  • 53.6 Set up ONOS secure SSH - PASS (tick)
  • 53.7 Checking ONOS service - PASS (tick)
  • 53.8 Starting ONOS CLI sessions - PASS (tick)
  • 53.9 Checking ONOS nodes - PASS (tick)
  • 53.10 Checking ONOS applications - PASS (tick)
  • 53.11 Starting Mininet Topology - PASS (tick)
  • 53.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 53.13 Check whether all flow status are ADDED - PASS (tick)
  • 53.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_Before - PASS (tick)
  • 53.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_Before - PASS (tick)
  • 53.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 53.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 53.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 53.19 Check whether all flow status are ADDED - PASS (tick)
  • 53.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE53_After - PASS (tick)
  • 53.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE53_After - PASS (tick)
  • 53.22 Stopping Mininet - PASS (tick)
  • 53.23 Copying karaf logs - PASS (tick)

Case 63: Changing port configuration from untagged 10 to tagged 120 with native 110, with 2x2 leaf-spine topology and 3 ONOS instances -

...

FAIL

  • 63.1 Apply cell to environment - PASS (tick)
  • 63.2 Uninstalling Atomix - PASS (tick)
  • 63.3 Uninstalling ONOS package - PASS (tick)
  • 63.4 Installing Atomix - PASS (tick)
  • 63.5 Installing ONOS package - PASS (tick)
  • 63.6 Set up ONOS secure SSH - PASS (tick)
  • 63.7 Checking ONOS service - PASS (tick)
  • 63.8 Starting ONOS CLI sessions - PASS (tick)
  • 63.9 Checking ONOS nodes - PASS (tick)
  • 63.10 Checking ONOS applications - PASS (tick)
  • 63.11 Starting Mininet Topology - PASS (tick)
  • 63.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.13 Check whether all flow status are ADDED - PASS (tick)
  • 63.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_Before - PASS (tick)
  • 63.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_Before - PASS (tick)
  • 63.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 63.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 63.18 Check whether the flow count is bigger than 104 - PASS (tick)
  • 63.19 Check whether all flow status are ADDED - PASS (tick)FAIL (error)
    • Flow status is wrong!
  • 63.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE63_After - PASS (tick)
  • 63.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE63_After - PASS (tick)
  • 63.22 Stopping Mininet - PASS (tick)
  • 63.23 Copying karaf logs - PASS (tick)

...

  • 213.1 Apply cell to environment - PASS (tick)
  • 213.2 Uninstalling Atomix - PASS (tick)
  • 213.3 Uninstalling ONOS package - PASS (tick)
  • 213.4 Installing Atomix - PASS (tick)
  • 213.5 Installing ONOS package - PASS (tick)
  • 213.6 Set up ONOS secure SSH - PASS (tick)
  • 213.7 Checking ONOS service - PASS (tick)
  • 213.8 Starting ONOS CLI sessions - PASS (tick)
  • 213.9 Checking ONOS nodes - PASS (tick)
  • 213.10 Checking ONOS applications - PASS (tick)
  • 213.11 Starting Mininet Topology - PASS (tick)
  • 213.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.13 Check whether all flow status are ADDED - PASS (tick)
  • 213.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_Before - PASS (tick)
  • 213.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_Before - PASS (tick)
  • 213.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 213.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 213.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 213.19 Check whether all flow status are ADDED - PASS (tick)
  • 213.20 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE213_After - PASS (tick)
  • 213.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE213_After - PASS (tick)
  • 213.22 Stopping Mininet - PASS (tick)
  • 213.23 Copying karaf logs - PASS (tick)

Case 223: Changing port configuration from tagged 20 and native 10 to tagged 120 and native 10, with 2x2 leaf-spine topology and 3 ONOS instances - PASS

  • 223.1 Apply cell to environment - PASS (tick)
  • 223.2 Uninstalling Atomix - PASS (tick)
  • 223.3 Uninstalling ONOS package - PASS (tick)
  • 223.4 Installing Atomix - PASS (tick)
  • 223.5 Installing ONOS package - PASS (tick)
  • 223.6 Set up ONOS secure SSH - PASS (tick)
  • 223.7 Checking ONOS service - PASS (tick)
  • 223.8 Starting ONOS CLI sessions - PASS (tick)
  • 223.9 Checking ONOS nodes - PASS (tick)
  • 223.10 Checking ONOS applications - PASS (tick)
  • 223.11 Starting Mininet Topology - PASS (tick)
  • 223.12 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.13 Check whether all flow status are ADDED - PASS (tick)
  • 223.14 Verify full connectivity for [u'h1', u'h3', u'h4'] with tag CASE223_Before - PASS (tick)
  • 223.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE223_Before - PASS (tick)
  • 223.16 Check whether the flow count of device of:0000000000000001 is bigger than 53 - PASS (tick)
  • 223.17 Check whether the flow count of device of:0000000000000002 is bigger than 53 - PASS (tick)
  • 223.18 Check whether the flow count is bigger than 106 - PASS (tick)
  • 223.19 Check whether all flow status are ADDED - PASS (tick)
  • 223.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE223_After - PASS (tick)
  • 223.21 Verify full connectivity for [u'h1', u'h2', u'h3'] with tag CASE223_After - PASS (tick)
  • 223.22 Stopping Mininet - PASS (tick)
  • 223.23 Copying karaf logs - PASS (tick)

Case 233: Consecutive configuration changes, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

  • 233.1 Apply cell to environment - PASS (tick)
  • 233.2 Uninstalling Atomix - PASS (tick)
  • 233.3 Uninstalling ONOS package - PASS (tick)
  • 233.4 Installing Atomix - PASS (tick)
  • 233.5 Installing ONOS package - PASS (tick)
  • 233.6 Set up ONOS secure SSH - PASS (tick)
  • 233.7 Checking ONOS service - PASS (tick)
  • 233.8 Starting ONOS CLI sessions - PASS (tick)
  • 233.9 Checking ONOS nodes - PASS (tick)
  • 233.10 Checking ONOS applications - PASS (tick)
  • 233.11 Starting Mininet Topology - PASS (tick)
  • 233.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.13 Check whether all flow status are ADDED - PASS (tick)
  • 233.14 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_Before - PASS (tick)
  • 233.15 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_Before - PASS (tick)
  • 233.16 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.17 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.18 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.19 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.20 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_1 - PASS (tick)
  • 233.21 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_1 - PASS (tick)
  • 233.22 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.23 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.24 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_2 - PASS (tick)
  • 233.25 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_2 - PASS (tick)
  • 233.26 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.27 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.28 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_3 - PASS (tick)
  • 233.29 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_3 - PASS (tick)
  • 233.30 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.31 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.32 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_4 - PASS (tick)
  • 233.33 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_4 - FAIL (error)
    • IP connectivity failed
  • 233.34 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.35 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.36 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_5 - PASS (tick)
  • 233.37 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_5 - PASS (tick)
  • 233.38 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.39 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.40 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_6 - PASS (tick)
  • 233.41 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_6 - PASS (tick)
  • 233.42 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 233.43 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 233.44 Check whether the flow count is bigger than 104 - PASS (tick)
  • 233.45 Check whether all flow status are ADDED - PASS (tick)
  • 233.46 Verify full connectivity for [u'h3', u'h4'] with tag CASE233_After - PASS (tick)
  • 233.47 Verify full connectivity for [u'h1', u'h2'] with tag CASE233_After - PASS (tick)
  • 233.48 Stopping Mininet - PASS (tick)
  • 233.49 Copying karaf logs - PASS (tick)

Case 243: Changing port configuration from 10.0.2.254/24 to 10.0.6.254/24, with 2x2 leaf-spine topology and 3 ONOS instances - FAIL

  • 243.1 Apply cell to environment - PASS (tick)
  • 243.2 Uninstalling Atomix - PASS (tick)
  • 243.3 Uninstalling ONOS package - PASS (tick)
  • 243.4 Installing Atomix - PASS (tick)
  • 243.5 Installing ONOS package - PASS (tick)
  • 243.6 Set up ONOS secure SSH - PASS (tick)
  • 243.7 Checking ONOS service - PASS (tick)
  • 243.8 Starting ONOS CLI sessions - PASS (tick)
  • 243.9 Checking ONOS nodes - PASS (tick)
  • 243.10 Checking ONOS applications - PASS (tick)
  • 243.11 Starting Mininet Topology - PASS (tick)
  • 243.12 Check whether the flow count is bigger than 104 - PASS (tick)
  • 243.13 Check whether all flow status are ADDED - PASS (tick)
  • 243.14 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_Before - FAIL (error)
    • IP connectivity failed
  • 243.15 Check whether the flow count of device of:0000000000000001 is bigger than 52 - PASS (tick)
  • 243.16 Check whether the flow count of device of:0000000000000002 is bigger than 52 - PASS (tick)
  • 243.17 Check whether the flow count is bigger than 104 - PASS (tick)
  • 243.18 Check whether all flow status are ADDED - PASS (tick)
  • 243.19 Verify full connectivity for [u'h1', u'h2', u'h5'] with tag CASE243_After - FAIL (error)
    • IP connectivity failed
  • 243.20 Stopping Mininet - PASS (tick)
  • 243.21 Copying karaf logs - PASS (tick)