1.0 - Perf and Scale-out

**************************************

Test TopoPerfNext

************************************

Result summary for Testcase1

Setting up test environment

Commit information -

-bash: cd: /home/admin/onos: No such file or directory

fatal: Not a git repository (or any of the parent directories): .git

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 22.83 ms End-to-end Std dev: 4.45 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 15.43 ms

Port down ofp-to-graph 12.67 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 3

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 29.38 ms End-to-end Std dev: 2.96 ms

- Node 2 Summary -

End-to-end Avg: 26.63 ms End-to-end Std dev: 4.39 ms

- Node 3 Summary -

End-to-end Avg: 25.04 ms End-to-end Std dev: 4.31 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 16.57 ms

Port down ofp-to-graph 12.29 ms

- Node 2 Summary -

Port up ofp-to-graph 16.86 ms

Port down ofp-to-graph 13.0 ms

- Node 3 Summary -

Port up ofp-to-graph 16.95 ms

Port down ofp-to-graph 13.29 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 5

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 24.63 ms End-to-end Std dev: 1.58 ms

- Node 2 Summary -

End-to-end Avg: 22.63 ms End-to-end Std dev: 2.42 ms

- Node 3 Summary -

End-to-end Avg: 22.17 ms End-to-end Std dev: 2.72 ms

- Node 4 Summary -

End-to-end Avg: 21.97 ms End-to-end Std dev: 2.46 ms

- Node 5 Summary -

End-to-end Avg: 21.77 ms End-to-end Std dev: 2.27 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 18.0 ms

Port down ofp-to-graph 12.86 ms

- Node 2 Summary -

Port up ofp-to-graph 18.14 ms

Port down ofp-to-graph 13.21 ms

- Node 3 Summary -

Port up ofp-to-graph 18.14 ms

Port down ofp-to-graph 13.24 ms

- Node 4 Summary -

Port up ofp-to-graph 18.14 ms

Port down ofp-to-graph 13.14 ms

- Node 5 Summary -

Port up ofp-to-graph 18.17 ms

Port down ofp-to-graph 13.26 ms

Result: Pass

Result summary for Testcase6

Increasing cluster size to 7

Result: Pass

Result summary for Testcase2

Latency of adding one switch to controller

First 2 iterations ignored for jvm warmup time

Total iterations of test: 10

- Node 1 Summary -

End-to-end Avg: 26.88 ms End-to-end Std dev: 2.03 ms

- Node 2 Summary -

End-to-end Avg: 24.56 ms End-to-end Std dev: 3.26 ms

- Node 3 Summary -

End-to-end Avg: 23.75 ms End-to-end Std dev: 3.09 ms

- Node 4 Summary -

End-to-end Avg: 23.31 ms End-to-end Std dev: 3.04 ms

- Node 5 Summary -

End-to-end Avg: 23.1 ms End-to-end Std dev: 2.92 ms

- Node 6 Summary -

End-to-end Avg: 23.21 ms End-to-end Std dev: 2.87 ms

- Node 7 Summary -

End-to-end Avg: 23.14 ms End-to-end Std dev: 2.8 ms

Result: Pass

Result summary for Testcase3

Port enable / disable latency

Simulated by ifconfig up / down

Total iterations of test: 10

- Node 1 Summary -

Port up ofp-to-graph 18.43 ms

Port down ofp-to-graph 12.43 ms

- Node 2 Summary -

Port up ofp-to-graph 18.43 ms

Port down ofp-to-graph 12.71 ms

- Node 3 Summary -

Port up ofp-to-graph 18.57 ms

Port down ofp-to-graph 12.76 ms

- Node 4 Summary -

Port up ofp-to-graph 18.54 ms

Port down ofp-to-graph 12.82 ms

- Node 5 Summary -

Port up ofp-to-graph 18.51 ms

Port down ofp-to-graph 12.94 ms

- Node 6 Summary -

Port up ofp-to-graph 18.52 ms

Port down ofp-to-graph 12.98 ms

- Node 7 Summary -

Port up ofp-to-graph 18.55 ms

Port down ofp-to-graph 13.04 ms

Result: Pass

Test IntentPerfNext

************************************

Result summary for Testcase1

Commit information -

-bash: cd: /home/admin/onos: No such file or directory

fatal: Not a git repository (or any of the parent directories): .git

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 7.0 ms

Std Deviation of batch installation latency : 2.61 ms

Avg of single installation latency of size 1: 7.0 ms

Std Deviation of single installation latency : 2.608 ms

Avg of batch withdraw latency of size 1: 6.8 ms

Std Deviation of batch withdraw latency : 1.72 ms

Avg of single withdraw latency of size 1: 6.8 ms

Std Deviation of single withdraw latency : 1.72 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 14.2 ms

Std Deviation of batch installation latency : 2.48 ms

Avg of single installation latency of size 10: 1.0 ms

Std Deviation of single installation latency : 0.0 ms

Avg of batch withdraw latency of size 10: 23.6 ms

Std Deviation of batch withdraw latency : 6.86 ms

Avg of single withdraw latency of size 10: 1.8 ms

Std Deviation of single withdraw latency : 0.748 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 51.0 ms

Std Deviation of batch installation latency : 7.69 ms

Avg of single installation latency of size 100: 0.0 ms

Std Deviation of single installation latency : 0.0 ms

Avg of batch withdraw latency of size 100: 117.6 ms

Std Deviation of batch withdraw latency : 21.95 ms

Avg of single withdraw latency of size 100: 0.6 ms

Std Deviation of single withdraw latency : 0.49 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 362.4 ms

Std Deviation of batch installation latency : 37.92 ms

Avg of single installation latency of size 1000: 0.0 ms

Std Deviation of single installation latency : 0.0 ms

Avg of batch withdraw latency of size 1000: 920.2 ms

Std Deviation of batch withdraw latency : 44.05 ms

Avg of single withdraw latency of size 1000: 0.0 ms

Std Deviation of single withdraw latency : 0.0 ms

Increasing batch intent size to 2000

Avg of batch installation latency of size 2000: 958.6 ms

Std Deviation of batch installation latency : 56.11 ms

Avg of single installation latency of size 2000: 0.0 ms

Std Deviation of single installation latency : 0.0 ms

Avg of batch withdraw latency of size 2000: 2572.8 ms

Std Deviation of batch withdraw latency : 83.9 ms

Avg of single withdraw latency of size 2000: 1.0 ms

Std Deviation of single withdraw latency : 0.0 ms

Result: Pass

Result summary for Testcase5

Increasing cluster size to 3

Result: Pass

Result summary for Testcase4

Batch intent installation test of 1 intent(s)

Avg of batch installation latency of size 1: 13.4 ms

Std Deviation of batch installation latency : 5.35 ms

Avg of single installation latency of size 1: 13.4 ms

Std Deviation of single installation latency : 5.352 ms

Avg of batch withdraw latency of size 1: 13.0 ms

Std Deviation of batch withdraw latency : 4.2 ms

Avg of single withdraw latency of size 1: 13.0 ms

Std Deviation of single withdraw latency : 4.195 ms

Increasing batch intent size to 10

Avg of batch installation latency of size 10: 34.8 ms

Std Deviation of batch installation latency : 34.19 ms

Avg of single installation latency of size 10: 3.2 ms

Std Deviation of single installation latency : 3.429 ms

Avg of batch withdraw latency of size 10: 33.8 ms

Std Deviation of batch withdraw latency : 10.19 ms

Avg of single withdraw latency of size 10: 2.8 ms

Std Deviation of single withdraw latency : 0.98 ms

Increasing batch intent size to 100

Avg of batch installation latency of size 100: 562.0 ms

Std Deviation of batch installation latency : 310.02 ms

Avg of single installation latency of size 100: 5.0 ms

Std Deviation of single installation latency : 3.098 ms

Avg of batch withdraw latency of size 100: 433.0 ms

Std Deviation of batch withdraw latency : 250.73 ms

Avg of single withdraw latency of size 100: 3.6 ms

Std Deviation of single withdraw latency : 2.653 ms

Increasing batch intent size to 1000

Avg of batch installation latency of size 1000: 2537.8 ms

Std Deviation of batch installation latency : 1518.8 ms

Avg of single installation latency of size 1000: 2.0 ms

Std Deviation of single installation latency : 1.414 ms

Avg of batch withdraw latency of size 1000: 9997.0 ms

Std Deviation of batch withdraw latency : 1656.25 ms

Avg of single withdraw latency of size 1000: 9.6 ms

Std Deviation of single withdraw latency : 1.625 ms

Increasing batch intent size to 2000