Test Results - Perf and Scale-out

**************************************

Test TopoPerfNext

************************************

Result summary for Testcase1

Setting up test environment

Commit information -

commit bb920fdd5ac627ca53f430d334df98837cbccde7 (HEAD, origin/master, origin/HEAD, master)

Author: Simon Hunt [simon@onlab.us]

AuthorDate: Thu Jan 22 17:06:32 2015 -0800

Commit: Simon Hunt [simon@onlab.us]

CommitDate: Thu Jan 22 17:06:39 2015 -0800

GUI -- Added ability to define an alternate port for WS - used to connect to mock web-socket server. Topo view can use query string '?wsport=8123' for example.

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 12

Cluster size: 1 node(s)

Switch add - End-to-end latency: Avg: 522 ms Std Deviation: 502.5 ms

Switch add - OFP-to-Graph latency: Note: results are not accurate to sub-millisecond. Any sub-millisecond results are rounded to 0 ms.

Avg: 13 ms Std Deviation: 0.0 ms

Switch add - TCP-to-OFP latency: Avg: 7 ms Std Deviation: 0.0 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 12

Cluster size: 1 node(s)

Test IntentPerfNext

************************************

Result summary for Testcase1

Commit information -

commit bb920fdd5ac627ca53f430d334df98837cbccde7 (HEAD, origin/master, origin/HEAD, master)

Author: Simon Hunt [simon@onlab.us]

AuthorDate: Thu Jan 22 17:06:32 2015 -0800

Commit: Simon Hunt [simon@onlab.us]

CommitDate: Thu Jan 22 17:06:39 2015 -0800

GUI -- Added ability to define an alternate port for WS - used to connect to mock web-socket server. Topo view can use query string '?wsport=8123' for example.

Result: Pass

Result summary for Testcase2

Single intent add latency test

Single intent add latency -

Avg: 4 ms

Std Deviation: 1.1 ms

Result: Pass

Result summary for Testcase3

Single intent reroute latency -

Avg: 130 ms

Std Deviation: 3.2 ms

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1000 intents

Avg of batch installation latency : 372 ms

Std Deviation of batch installation latency : 63.261557769 ms

Avg of batch withdraw latency : 932 ms

Std Deviation of batch withdraw latency : 68.4626599138 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 3

Result: Pass

Result summary for Testcase2

Single intent add latency test

Single intent add latency -

Avg: 9 ms

Std Deviation: 3.9 ms

Result: Pass

Result summary for Testcase3

Single intent reroute latency -

Avg: 132 ms

Std Deviation: 1.1 ms

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1000 intents

Avg of batch installation latency : 4140 ms

Std Deviation of batch installation latency : 1555.82896804 ms

Avg of batch withdraw latency : 7621 ms

Std Deviation of batch withdraw latency : 1745.51595542 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 5

Result: Pass

Result summary for Testcase2

Single intent add latency test

Single intent add latency -

Avg: 3 ms

Std Deviation: 1.3 ms

Result: Pass

Result summary for Testcase3

Single intent reroute latency -

Avg: 80 ms

Std Deviation: 1.6 ms

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1000 intents

Avg of batch installation latency : 3803 ms

Std Deviation of batch installation latency : 890.565488265 ms

Avg of batch withdraw latency : 8521 ms

Std Deviation of batch withdraw latency : 1619.1144356 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 7

Result: Pass

Result summary for Testcase2

Single intent add latency test

Single intent add latency -

Avg: 2 ms

Std Deviation: 0.5 ms

Result: Pass

Result summary for Testcase3

Single intent reroute latency -

Avg: 58 ms

Std Deviation: 3.1 ms

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1000 intents