Master - Perf and Scale-out

**************************************

Test TopoPerfNext

************************************

Result summary for Testcase1

Setting up test environment

Commit information -

commit 8eddc0d5cf62666a0f7e64e2f46ecc6b8eb2039d (HEAD, origin/master, origin/HEAD, master)

Author: Ayaka Koshibe [ayaka@onlab.us]

AuthorDate: Mon Feb 2 18:07:29 2015 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Tue Feb 3 23:47:31 2015 +0000

NullLinkProviders join network islands deterministically.

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 20.86 ms End-to-end Std dev: 3.4 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 15.57 ms

Port down ofp-to-graph 12.86 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 3

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 23.25 ms End-to-end Std dev: 2.33 ms

- Node 2 Summary -

End-to-end Avg: 22.0 ms End-to-end Std dev: 2.4 ms

- Node 3 Summary -

End-to-end Avg: 21.58 ms End-to-end Std dev: 2.34 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 16.29 ms

Port down ofp-to-graph 12.57 ms

- Node 2 Summary -

Port up ofp-to-graph 16.71 ms

Port down ofp-to-graph 12.57 ms

- Node 3 Summary -

Port up ofp-to-graph 16.86 ms

Port down ofp-to-graph 12.76 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 5

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 23.43 ms End-to-end Std dev: 2.44 ms

- Node 2 Summary -

End-to-end Avg: 21.93 ms End-to-end Std dev: 2.74 ms

- Node 3 Summary -

End-to-end Avg: 21.33 ms End-to-end Std dev: 2.61 ms

- Node 4 Summary -

End-to-end Avg: 21.07 ms End-to-end Std dev: 2.59 ms

- Node 5 Summary -

End-to-end Avg: 21.06 ms End-to-end Std dev: 2.55 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 16.71 ms

Port down ofp-to-graph 13.14 ms

- Node 2 Summary -

Port up ofp-to-graph 17.29 ms

Port down ofp-to-graph 13.29 ms

- Node 3 Summary -

Port up ofp-to-graph 17.43 ms

Port down ofp-to-graph 13.14 ms

- Node 4 Summary -

Port up ofp-to-graph 17.5 ms

Port down ofp-to-graph 13.21 ms

- Node 5 Summary -

Port up ofp-to-graph 17.51 ms

Port down ofp-to-graph 13.23 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 7

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 21.63 ms End-to-end Std dev: 1.58 ms

- Node 2 Summary -

End-to-end Avg: 20.44 ms End-to-end Std dev: 1.84 ms

- Node 3 Summary -

End-to-end Avg: 19.92 ms End-to-end Std dev: 1.78 ms

- Node 4 Summary -

End-to-end Avg: 19.81 ms End-to-end Std dev: 1.7 ms

- Node 5 Summary -

End-to-end Avg: 19.68 ms End-to-end Std dev: 1.63 ms

- Node 6 Summary -

End-to-end Avg: 19.67 ms End-to-end Std dev: 1.55 ms

- Node 7 Summary -

End-to-end Avg: 19.68 ms End-to-end Std dev: 1.51 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 17.0 ms

Port down ofp-to-graph 12.0 ms

- Node 2 Summary -

Port up ofp-to-graph 17.5 ms

Port down ofp-to-graph 12.43 ms

- Node 3 Summary -

Port up ofp-to-graph 17.33 ms

Port down ofp-to-graph 12.62 ms

- Node 4 Summary -

Port up ofp-to-graph 17.36 ms

Port down ofp-to-graph 12.68 ms

- Node 5 Summary -

Port up ofp-to-graph 17.29 ms

Port down ofp-to-graph 12.74 ms

- Node 6 Summary -

Port up ofp-to-graph 17.29 ms

Port down ofp-to-graph 12.88 ms

- Node 7 Summary -

Port up ofp-to-graph 17.39 ms

Port down ofp-to-graph 12.88 ms

Result: Pass

Test IntentPerfNext

************************************

Result summary for Testcase1

Commit information -

commit 8eddc0d5cf62666a0f7e64e2f46ecc6b8eb2039d (HEAD, origin/master, origin/HEAD, master)

Author: Ayaka Koshibe [ayaka@onlab.us]

AuthorDate: Mon Feb 2 18:07:29 2015 -0800

Commit: Gerrit Code Review [gerrit@onlab.us]

CommitDate: Tue Feb 3 23:47:31 2015 +0000

NullLinkProviders join network islands deterministically.

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 6.0 ms

Std Deviation of batch installation latency : 0.8 ms

Avg of batch withdraw latency of size 1: 7.0 ms

Std Deviation of batch withdraw latency : 3.72 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 11.0 ms

Std Deviation of batch installation latency : 5.04 ms

Avg of batch withdraw latency of size 10: 15.0 ms

Std Deviation of batch withdraw latency : 8.91 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 27.0 ms

Std Deviation of batch installation latency : 24.88 ms

Avg of batch withdraw latency of size 100: 49.0 ms

Std Deviation of batch withdraw latency : 50.91 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 108.0 ms

Std Deviation of batch installation latency : 148.39 ms

Avg of batch withdraw latency of size 1000: 275.0 ms

Std Deviation of batch withdraw latency : 395.78 ms

Increasing batch intent size to 2000

Avg of batch installation latency of size 2000: 270.0 ms

Std Deviation of batch installation latency : 349.9 ms

Avg of batch withdraw latency of size 2000: 719.0 ms

Std Deviation of batch withdraw latency : 955.77 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 3

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 15.0 ms

Std Deviation of batch installation latency : 5.0 ms

Avg of batch withdraw latency of size 1: 13.0 ms

Std Deviation of batch withdraw latency : 2.28 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 17.0 ms

Std Deviation of batch installation latency : 4.64 ms

Avg of batch withdraw latency of size 10: 20.0 ms

Std Deviation of batch withdraw latency : 8.22 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 209.0 ms

Std Deviation of batch installation latency : 292.26 ms

Avg of batch withdraw latency of size 100: 304.0 ms

Std Deviation of batch withdraw latency : 427.3 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 767.0 ms

Std Deviation of batch installation latency : 1074.18 ms

Avg of batch withdraw latency of size 1000: 1861.0 ms

Std Deviation of batch withdraw latency : 2758.04 ms

Increasing batch intent size to 2000

Avg of batch installation latency of size 2000: 4149.0 ms

Std Deviation of batch installation latency : 7310.82 ms

Avg of batch withdraw latency of size 2000: 6298.0 ms

Std Deviation of batch withdraw latency : 10186.62 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 5

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 1.0 ms

Std Deviation of batch installation latency : 0.0 ms

Avg of batch withdraw latency of size 1: 1.0 ms

Std Deviation of batch withdraw latency : 0.0 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 108.0 ms

Std Deviation of batch installation latency : 309.03 ms

Avg of batch withdraw latency of size 10: 319.0 ms

Std Deviation of batch withdraw latency : 795.48 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 3655.0 ms

Std Deviation of batch installation latency : 5963.97 ms

Avg of batch withdraw latency of size 100: 2513.0 ms

Std Deviation of batch withdraw latency : 4810.5 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 17729.0 ms

Std Deviation of batch installation latency : 36594.79 ms

Avg of batch withdraw latency of size 1000: 11706.0 ms

Std Deviation of batch withdraw latency : 26632.92 ms

Increasing batch intent size to 2000

Avg of batch installation latency of size 2000: 38142.0 ms

Std Deviation of batch installation latency : 64461.85 ms

Avg of batch withdraw latency of size 2000: 33673.0 ms

Std Deviation of batch withdraw latency : 68901.28 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 7

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)