Master - Perf and Scale-out

**************************************

Test TopoPerfNext

************************************

Result summary for Testcase1

Setting up test environment

Commit information -

commit 11c30ac6d391dd39e6d8a8c2fc8997b3e50c9067 (HEAD, origin/master, origin/HEAD, master)

Author: sangho [sangho@onlab.us]

AuthorDate: Thu Jan 22 14:30:55 2015 -0800

Commit: alshabib [alshabibi.ali@gmail.com]

CommitDate: Thu Jan 29 09:35:06 2015 -0800

Add a new method sendMsg(OFMessage msg, TableType type) in OpenFlowSwitch interface to support multiple-table aware FlowRuleService.

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 22.17 ms End-to-end Std dev: 1.95 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 14.86 ms

Port down ofp-to-graph 12.57 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 3

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 24.63 ms End-to-end Std dev: 2.29 ms

- Node 2 Summary -

End-to-end Avg: 22.94 ms End-to-end Std dev: 2.7 ms

- Node 3 Summary -

End-to-end Avg: 22.33 ms End-to-end Std dev: 2.54 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 16.71 ms

Port down ofp-to-graph 12.43 ms

- Node 2 Summary -

Port up ofp-to-graph 17.0 ms

Port down ofp-to-graph 12.71 ms

- Node 3 Summary -

Port up ofp-to-graph 17.0 ms

Port down ofp-to-graph 12.62 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 5

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 24.13 ms End-to-end Std dev: 2.52 ms

- Node 2 Summary -

End-to-end Avg: 22.0 ms End-to-end Std dev: 2.85 ms

- Node 3 Summary -

End-to-end Avg: 21.26 ms End-to-end Std dev: 2.64 ms

- Node 4 Summary -

End-to-end Avg: 21.03 ms End-to-end Std dev: 2.35 ms

- Node 5 Summary -

End-to-end Avg: 20.79 ms End-to-end Std dev: 2.21 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 17.0 ms

Port down ofp-to-graph 13.14 ms

- Node 2 Summary -

Port up ofp-to-graph 16.93 ms

Port down ofp-to-graph 13.36 ms

- Node 3 Summary -

Port up ofp-to-graph 17.14 ms

Port down ofp-to-graph 13.38 ms

- Node 4 Summary -

Port up ofp-to-graph 17.14 ms

Port down ofp-to-graph 13.39 ms

- Node 5 Summary -

Port up ofp-to-graph 17.23 ms

Port down ofp-to-graph 13.6 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 7

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 27.0 ms End-to-end Std dev: 6.32 ms

- Node 2 Summary -

End-to-end Avg: 23.79 ms End-to-end Std dev: 5.62 ms

- Node 3 Summary -

End-to-end Avg: 22.57 ms End-to-end Std dev: 4.98 ms

- Node 4 Summary -

End-to-end Avg: 22.11 ms End-to-end Std dev: 4.44 ms

- Node 5 Summary -

End-to-end Avg: 21.77 ms End-to-end Std dev: 4.08 ms

- Node 6 Summary -

End-to-end Avg: 21.64 ms End-to-end Std dev: 3.76 ms

- Node 7 Summary -

End-to-end Avg: 21.63 ms End-to-end Std dev: 3.51 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 18.29 ms

Port down ofp-to-graph 12.71 ms

- Node 2 Summary -

Port up ofp-to-graph 18.57 ms

Port down ofp-to-graph 12.93 ms

- Node 3 Summary -

Port up ofp-to-graph 18.67 ms

Port down ofp-to-graph 12.9 ms

- Node 4 Summary -

Port up ofp-to-graph 18.75 ms

Port down ofp-to-graph 13.11 ms

- Node 5 Summary -

Port up ofp-to-graph 18.77 ms

Port down ofp-to-graph 13.09 ms

- Node 6 Summary -

Port up ofp-to-graph 18.79 ms

Port down ofp-to-graph 13.05 ms

- Node 7 Summary -

Port up ofp-to-graph 18.8 ms

Port down ofp-to-graph 13.08 ms

Result: Pass

Test IntentPerfNext

************************************

Result summary for Testcase1

Commit information -

commit 11c30ac6d391dd39e6d8a8c2fc8997b3e50c9067 (HEAD, origin/master, origin/HEAD, master)

Author: sangho [sangho@onlab.us]

AuthorDate: Thu Jan 22 14:30:55 2015 -0800

Commit: alshabib [alshabibi.ali@gmail.com]

CommitDate: Thu Jan 29 09:35:06 2015 -0800

Add a new method sendMsg(OFMessage msg, TableType type) in OpenFlowSwitch interface to support multiple-table aware FlowRuleService.

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 6 ms

Std Deviation of batch installation latency : 0.489897948557 ms

Avg of batch withdraw latency of size 1: 5 ms

Std Deviation of batch withdraw latency : 0.979795897113 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 10 ms

Std Deviation of batch installation latency : 4.65725240888 ms

Avg of batch withdraw latency of size 10: 12 ms

Std Deviation of batch withdraw latency : 8.11726554943 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 30 ms

Std Deviation of batch installation latency : 28.3465851363 ms

Avg of batch withdraw latency of size 100: 46 ms

Std Deviation of batch withdraw latency : 49.1263224306 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 115 ms

Std Deviation of batch installation latency : 154.02787897 ms

Avg of batch withdraw latency of size 1000: 266 ms

Std Deviation of batch withdraw latency : 384.333640864 ms

Increasing batch intent size to 2000

Result: Pass

Result summary for Testcase5

Increasing cluster size to 3

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 12 ms

Std Deviation of batch installation latency : 2.4819347292 ms

Avg of batch withdraw latency of size 1: 11 ms

Std Deviation of batch withdraw latency : 2.93938769134 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 19 ms

Std Deviation of batch installation latency : 9.3914855055 ms

Avg of batch withdraw latency of size 10: 19 ms

Std Deviation of batch withdraw latency : 8.4403791384 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 214 ms

Std Deviation of batch installation latency : 299.347616586 ms

Avg of batch withdraw latency of size 100: 304 ms

Std Deviation of batch withdraw latency : 471.357029107 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 1035 ms

Std Deviation of batch installation latency : 1522.37588246 ms

Avg of batch withdraw latency of size 1000: 1957 ms

Std Deviation of batch withdraw latency : 2982.26680564 ms

Increasing batch intent size to 2000

Result: Pass

Result summary for Testcase5

Increasing cluster size to 5

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 11 ms

Std Deviation of batch installation latency : 2.03960780544 ms

Avg of batch withdraw latency of size 1: 14 ms

Std Deviation of batch withdraw latency : 4.62168800332 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 19 ms

Std Deviation of batch installation latency : 10.618851162 ms

Avg of batch withdraw latency of size 10: 22 ms

Std Deviation of batch withdraw latency : 11.6687617167 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 294 ms

Std Deviation of batch installation latency : 417.924948073 ms

Avg of batch withdraw latency of size 100: 242 ms

Std Deviation of batch withdraw latency : 347.488679272 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 909 ms

Std Deviation of batch installation latency : 1244.81570825 ms

Avg of batch withdraw latency of size 1000: 2428 ms

Std Deviation of batch withdraw latency : 3900.07256215 ms

Increasing batch intent size to 2000

Result: Pass

Result summary for Testcase5

Increasing cluster size to 7

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 13 ms

Std Deviation of batch installation latency : 1.6 ms

Avg of batch withdraw latency of size 1: 12 ms

Std Deviation of batch withdraw latency : 2.57681974535 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 18 ms

Std Deviation of batch installation latency : 6.24179461373 ms

Avg of batch withdraw latency of size 10: 23 ms

Std Deviation of batch withdraw latency : 16.3768128767 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 196 ms

Std Deviation of batch installation latency : 280.886691271 ms

Avg of batch withdraw latency of size 100: 210 ms

Std Deviation of batch withdraw latency : 284.547000609 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 17347 ms

Std Deviation of batch installation latency : 46345.9152858 ms

Avg of batch withdraw latency of size 1000: 3810 ms

Std Deviation of batch withdraw latency : 10487.7013258 ms

Increasing batch intent size to 2000

Result: Pass