Page History

Results at a Glance:

The purpose of this page is to track performance trend and regression through the last 20 Jenkins builds(nightly) on a subset of the full performance evaluation metrics. Refer to the regular performance test plans for test methodologies. Child pages have the full result details on the latest build. Note that results in this tracking can fluctuate from build to build, due to various of experiments and changes made in onos.

Switch-up Latency - Last 50 builds SwitchUp Latency test (5-node cluster):

Chart

stacked	true
showShapes	false
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency (ms)
xLabel	Build#
height	250

Switch-down Latency - Last 50 builds SwitchDown Latency test (5-node cluster):

Chart

stacked	true
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(ms)
xLabel	Build#
height	250

Port-up Latency - Last 50 builds PortUp Latency test (5-node cluster):

Chart

stacked	true
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(ms)
xLabel	Build#
height	250

Port-down Latency - Last 50 builds PortDown Latency test (5-node cluster):

Chart

stacked	true
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(ms)
xLabel	Build#
height	250

Intent install Latency - Last 50 builds "IntentInstallLat" (5-node cluster; 100 intents as batch size):

Note: Starting from build #29, NewDistributedFlowRuleStore is used and backup is enabled.

Chart

width	1200
type	bar
yLabel	Latency (ms)
xLabel	Build#
height	250

Intent withdraw Latency - Last 50 builds "IntentWithdrawLat" (5-node cluster; 100 intents as batch size):

Note: Starting from build #29, NewDistributedFlowRuleStore is used and backup is enabled.

Chart

width	1200
type	bar
yLabel	Latency (ms)
xLabel	Build#
height	250

Intent Re-route Latency - Last 50 builds "IntentRerouteLat" (5-node cluster; 100 intents as batch size):

Note: Starting from build #29, NewDistributedFlowRuleStore is used and backup is enabled.

Chart

width	1200
type	bar
yLabel	Latency (ms)
xLabel	Build#
height	250

Intent Throughput - Last 50 builds "IntentEventTP" test (5-node cluster with neighbors=4):

Note: Starting from build #81, NewDistributedFlowRuleStore is used and backup is enabled.

Chart

width	1200
type	bar
yLabel	Throughput (Ops/sec)
xLabel	Build#
height	250

Scale Topo Test - Last 50 builds "scaleTopo" test (3-node cluster with scale = 20)

Chart

stacked	true
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(s)
xLabel	Build#
height	250

Flow Throughput - Last 50 builds "flowTP1g" tests (5-node cluster with neighbors=4):

Note: Starting from build #90, NewDistributedFlowRuleStore is used and backup is enabled.

Chart

width	1200
type	bar
yLabel	Throughput (000s Ops/sec)
xLabel	Build#
height	250

Cbench - Last 50 builds "CbenchBM" (single-node, throughput mode):

cbench command: cbench -c localhost -p 6633 -m 1000 -l 20 -s 16 -M 100000 -w 10 -D 5000 -t

Chart

width	1200
type	bar
yLabel	Throughput (Responses/sec)
xLabel	Build#
height	250

Single Bench Flow Latency Test (Post) - Last 50 builds SingleBenchFlow Latency test:

Chart

tables	1,3,5
stacked	true
columns	1,4,5
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(ms)
xLabel	Build#
height	250

Single Bench Flow Latency Test (Del) - Last 50 builds SingleBenchFlow Latency test:

Chart

stacked	true
columns	1,7,8
width	1200
dataOrientation	vertical
type	bar
yLabel	Latency(ms)
xLabel	Build#
height	250

Host add Latency - Last 50 builds HostAdd Latency test (5-node cluster):

Chart

showShapes	false
width	1200
type	bar
yLabel	Latency (ms)
xLabel	Build#
height	250

Page tree

Versions Compared

Old Version 1

New Version Current

Key

Results at a Glance:

Switch-up Latency - Last 50 builds SwitchUp Latency test (5-node cluster):

Switch-down Latency - Last 50 builds SwitchDown Latency test (5-node cluster):

Port-up Latency - Last 50 builds PortUp Latency test (5-node cluster):

Port-down Latency - Last 50 builds PortDown Latency test (5-node cluster):

Intent install Latency - Last 50 builds "IntentInstallLat" (5-node cluster; 100 intents as batch size):

Intent withdraw Latency - Last 50 builds "IntentWithdrawLat" (5-node cluster; 100 intents as batch size):

Intent Re-route Latency - Last 50 builds "IntentRerouteLat" (5-node cluster; 100 intents as batch size):

Intent Throughput - Last 50 builds "IntentEventTP" test (5-node cluster with neighbors=4):

Scale Topo Test - Last 50 builds "scaleTopo" test (3-node cluster with scale = 20)

Flow Throughput - Last 50 builds "flowTP1g" tests (5-node cluster with neighbors=4):

Cbench - Last 50 builds "CbenchBM" (single-node, throughput mode):

Single Bench Flow Latency Test (Post) - Last 50 builds SingleBenchFlow Latency test:

Single Bench Flow Latency Test (Del) - Last 50 builds SingleBenchFlow Latency test:

Host add Latency - Last 50 builds HostAdd Latency test (5-node cluster):