1. Results of measuring performance of Mesos Marathon¶
- Abstract
 This document includes performance test results for Mesos as a container platform for Docker with Marathon. All tests have been performed regarding Measuring performance of container cluster systems
1.1. Environment description¶
1.1.1. Cluster description¶
3 master nodes with Mesos, Marathon and Zookeeper
189 mesos slaves nodes
1.1.2. Software versions¶
Mesos - 0.27.0
Marathon - 0.15.2
Zookeeper - 3.4.5
Docker - 1.10.2
1.1.3. Running options¶
Marathon extra options are “-Xmx2048m –max_tasks_per_offer 20”
1.1.4. Hardware configuration of each server¶
server  | 
vendor,model  | 
HP,DL380 Gen9  | 
operating_system  | 
3.13.0-76-generic 
Ubuntu-trusty 
x86_64 
 | 
|
CPU  | 
vendor,model  | 
Intel,E5-2680 v3  | 
processor_count  | 
2  | 
|
core_count  | 
12  | 
|
frequency_MHz  | 
2500  | 
|
RAM  | 
vendor,model  | 
HP,752369-081  | 
amount_MB  | 
262144  | 
|
NETWORK  | 
interface_name  | 
p1p1  | 
vendor,model  | 
Intel,X710 Dual Port  | 
|
bandwidth  | 
10G  | 
|
STORAGE  | 
dev_name  | 
/dev/sda  | 
vendor,model  | 
raid10 - HP P840 
12 disks EH0600JEDHE 
 | 
|
SSD/HDD  | 
HDD  | 
|
size  | 
3,6TB  | 
1.1.5. Network scheme and part of configuration of hardware network switches¶
Network scheme of the environment:
Here is the part of switch configuration for each switch port which connected to p1p1.603 interface of a server:
switchport mode trunk
switchport trunk native vlan 600
switchport trunk allowed vlan 600-602,630-649
spanning-tree port type edge trunk
spanning-tree bpduguard enable
no snmp trap link-status
1.2. Results¶
1.2.1. Test create¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
6.15  | 
6.15  | 
6.15  | 
6.15  | 
1  | 
100  | 
6.09  | 
6.09  | 
6.09  | 
6.09  | 
1  | 
500  | 
14.18  | 
14.18  | 
14.18  | 
14.18  | 
2  | 
50  | 
6.08  | 
6.1  | 
6.09  | 
6.09  | 
2  | 
100  | 
6.09  | 
6.12  | 
6.11  | 
6.105  | 
2  | 
500  | 
20.3  | 
22.27  | 
21.29  | 
21.285  | 
4  | 
50  | 
6.15  | 
16.2  | 
11.66  | 
12.155  | 
4  | 
100  | 
6.24  | 
16.19  | 
10.24  | 
9.26  | 
4  | 
500  | 
28.39  | 
38.42  | 
33.13  | 
32.86  | 
8  | 
50  | 
8.11  | 
12.24  | 
10.16  | 
10.16  | 
8  | 
100  | 
6.46  | 
16.25  | 
12.08  | 
13.185  | 
8  | 
500  | 
29.12  | 
83.03  | 
58.19  | 
58.06  | 
16  | 
50  | 
8.12  | 
20.36  | 
12.88  | 
13.22  | 
16  | 
100  | 
9.02  | 
26.39  | 
19.3  | 
20.28  | 
16  | 
500  | 
130.43  | 
453.85  | 
296.59  | 
320.07  | 
Graph for test create, concurrency 1
Graph for test create, concurrency 2
Graph for test create, concurrency 4
Graph for test create, concurrency 8
Graph for test create, concurrency 16
1.2.2. Test delete¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
0.01  | 
0.01  | 
0.01  | 
0.01  | 
1  | 
100  | 
0.01  | 
0.01  | 
0.01  | 
0.01  | 
1  | 
500  | 
0.01  | 
0.01  | 
0.01  | 
0.01  | 
2  | 
50  | 
0.01  | 
0.02  | 
0.01  | 
0.01  | 
2  | 
100  | 
0.02  | 
0.02  | 
0.02  | 
0.02  | 
2  | 
500  | 
0.01  | 
0.02  | 
0.01  | 
0.01  | 
4  | 
50  | 
0.02  | 
0.03  | 
0.03  | 
0.03  | 
4  | 
100  | 
0.02  | 
0.03  | 
0.03  | 
0.03  | 
4  | 
500  | 
0.02  | 
0.04  | 
0.03  | 
0.04  | 
8  | 
50  | 
0.04  | 
0.05  | 
0.04  | 
0.04  | 
8  | 
100  | 
0.04  | 
0.05  | 
0.05  | 
0.05  | 
8  | 
500  | 
0.05  | 
0.07  | 
0.06  | 
0.07  | 
16  | 
50  | 
0.12  | 
0.13  | 
0.12  | 
0.12  | 
16  | 
100  | 
0.09  | 
0.11  | 
0.1  | 
0.1  | 
16  | 
500  | 
0.13  | 
0.15  | 
0.14  | 
0.14  | 
Graph for test delete, concurrency 1
Graph for test delete, concurrency 2
Graph for test delete, concurrency 4
Graph for test delete, concurrency 8
Graph for test delete, concurrency 16
1.2.3. Test restart¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
500  | 
28.63  | 
28.63  | 
28.63  | 
28.63  | 
2  | 
50  | 
8.51  | 
8.53  | 
8.52  | 
8.52  | 
2  | 
100  | 
14.47  | 
16.59  | 
15.53  | 
15.53  | 
2  | 
500  | 
28.81  | 
30.83  | 
29.82  | 
29.82  | 
4  | 
50  | 
10.56  | 
12.53  | 
11.07  | 
10.59  | 
4  | 
100  | 
12.74  | 
28.65  | 
18.19  | 
15.69  | 
4  | 
500  | 
63.31  | 
75.2  | 
68.69  | 
68.12  | 
8  | 
50  | 
12.75  | 
22.68  | 
17.18  | 
16.64  | 
8  | 
100  | 
26.73  | 
38.87  | 
31.54  | 
30.755  | 
8  | 
500  | 
433.62  | 
441.69  | 
439.17  | 
439.505  | 
16  | 
50  | 
19.36  | 
30.86  | 
23.32  | 
22.73  | 
16  | 
100  | 
45.8  | 
63.07  | 
51.96  | 
51.35  | 
16  | 
500  | 
605.63  | 
1204.02  | 
709.46  | 
646.73  | 
Graph for test restart, concurrency 2
Graph for test restart, concurrency 4
Graph for test restart, concurrency 8
Graph for test restart, concurrency 16
1.2.4. Test update_cpu¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
12.51  | 
12.51  | 
12.51  | 
12.51  | 
1  | 
100  | 
12.56  | 
12.56  | 
12.56  | 
12.56  | 
1  | 
500  | 
22.63  | 
22.63  | 
22.63  | 
22.63  | 
2  | 
50  | 
6.51  | 
8.49  | 
7.5  | 
7.5  | 
2  | 
100  | 
14.53  | 
16.58  | 
15.55  | 
15.555  | 
2  | 
500  | 
20.73  | 
26.72  | 
23.73  | 
23.725  | 
4  | 
50  | 
8.52  | 
14.56  | 
11.52  | 
11.5  | 
4  | 
100  | 
14.6  | 
71.14  | 
30.77  | 
18.67  | 
4  | 
500  | 
47.03  | 
55.09  | 
50.56  | 
50.06  | 
8  | 
50  | 
8.56  | 
26.71  | 
16.61  | 
16.59  | 
8  | 
100  | 
18.65  | 
32.73  | 
24.67  | 
24.655  | 
8  | 
500  | 
219.0  | 
249.28  | 
239.4  | 
243.815  | 
16  | 
50  | 
16.63  | 
32.78  | 
22.68  | 
22.68  | 
16  | 
100  | 
37.56  | 
44.87  | 
41.58  | 
40.95  | 
16  | 
500  | 
610.82  | 
1205.25  | 
883.32  | 
736.29  | 
Graph for test update_cpu, concurrency 1
Graph for test update_cpu, concurrency 2
Graph for test update_cpu, concurrency 4
Graph for test update_cpu, concurrency 8
Graph for test update_cpu, concurrency 16
1.2.5. Test update_disk¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
10.48  | 
10.48  | 
10.48  | 
10.48  | 
1  | 
100  | 
16.59  | 
16.59  | 
16.59  | 
16.59  | 
1  | 
500  | 
26.65  | 
26.65  | 
26.65  | 
26.65  | 
2  | 
50  | 
8.52  | 
12.56  | 
10.54  | 
10.54  | 
2  | 
100  | 
14.56  | 
26.61  | 
20.59  | 
20.585  | 
2  | 
500  | 
26.67  | 
28.68  | 
27.68  | 
27.675  | 
4  | 
50  | 
10.56  | 
20.55  | 
14.05  | 
12.555  | 
4  | 
100  | 
12.59  | 
20.63  | 
17.6  | 
18.59  | 
4  | 
500  | 
53.01  | 
55.1  | 
53.58  | 
53.1  | 
8  | 
50  | 
10.67  | 
26.75  | 
19.66  | 
19.635  | 
8  | 
100  | 
15.18  | 
20.68  | 
17.99  | 
17.705  | 
8  | 
500  | 
395.82  | 
441.34  | 
415.5  | 
402.97  | 
16  | 
50  | 
15.0  | 
32.79  | 
24.62  | 
24.705  | 
16  | 
100  | 
44.19  | 
50.94  | 
47.14  | 
46.995  | 
16  | 
500  | 
426.87  | 
1204.53  | 
731.92  | 
610.83  | 
Graph for test update_disk, concurrency 1
Graph for test update_disk, concurrency 2
Graph for test update_disk, concurrency 4
Graph for test update_disk, concurrency 8
Graph for test update_disk, concurrency 16
1.2.6. Test update_instances¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
600.05  | 
600.05  | 
600.05  | 
600.05  | 
1  | 
100  | 
16.17  | 
16.17  | 
16.17  | 
16.17  | 
1  | 
500  | 
600.31  | 
600.31  | 
600.31  | 
600.31  | 
2  | 
50  | 
10.12  | 
600.11  | 
305.12  | 
305.115  | 
2  | 
100  | 
14.16  | 
600.19  | 
307.18  | 
307.175  | 
2  | 
500  | 
600.72  | 
601.09  | 
600.9  | 
600.905  | 
4  | 
50  | 
10.13  | 
600.17  | 
452.65  | 
600.155  | 
4  | 
100  | 
14.18  | 
600.36  | 
308.75  | 
310.225  | 
4  | 
500  | 
39.4  | 
602.01  | 
461.02  | 
601.33  | 
8  | 
50  | 
20.24  | 
600.4  | 
323.46  | 
336.595  | 
8  | 
100  | 
18.23  | 
600.79  | 
169.8  | 
28.68  | 
8  | 
500  | 
150.94  | 
603.91  | 
546.72  | 
603.255  | 
16  | 
50  | 
14.25  | 
600.72  | 
276.17  | 
32.375  | 
16  | 
100  | 
24.24  | 
601.53  | 
351.71  | 
601.0  | 
16  | 
500  | 
603.1  | 
1206.38  | 
1016.9  | 
1203.81  | 
Graph for test update_instances, concurrency 1
Graph for test update_instances, concurrency 2
Graph for test update_instances, concurrency 4
Graph for test update_instances, concurrency 8
Graph for test update_instances, concurrency 16
1.2.7. Test update_mem¶
CONCURRENCY  | 
NODES_NUMBER_PER_APPLICATION  | 
APPLICATION_OPERATION (sec)  | 
|||
|---|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
median  | 
||
1  | 
50  | 
8.58  | 
8.58  | 
8.58  | 
8.58  | 
1  | 
100  | 
10.55  | 
10.55  | 
10.55  | 
10.55  | 
1  | 
500  | 
22.68  | 
22.68  | 
22.68  | 
22.68  | 
2  | 
50  | 
10.46  | 
10.48  | 
10.47  | 
10.47  | 
2  | 
100  | 
10.54  | 
14.5  | 
12.52  | 
12.52  | 
2  | 
500  | 
26.6  | 
26.76  | 
26.68  | 
26.68  | 
4  | 
50  | 
10.51  | 
10.55  | 
10.54  | 
10.54  | 
4  | 
100  | 
10.57  | 
18.65  | 
16.59  | 
18.575  | 
4  | 
500  | 
56.96  | 
69.29  | 
63.66  | 
64.2  | 
8  | 
50  | 
18.61  | 
22.74  | 
21.16  | 
20.695  | 
8  | 
100  | 
15.1  | 
26.77  | 
21.26  | 
20.7  | 
8  | 
500  | 
294.84  | 
304.16  | 
300.42  | 
300.86  | 
16  | 
50  | 
13.92  | 
24.67  | 
19.78  | 
21.645  | 
16  | 
100  | 
39.57  | 
49.03  | 
41.95  | 
41.24  | 
16  | 
500  | 
498.57  | 
1204.44  | 
666.49  | 
624.195  | 
Graph for test update_mem, concurrency 1
Graph for test update_mem, concurrency 2
Graph for test update_mem, concurrency 4
Graph for test update_mem, concurrency 8
Graph for test update_mem, concurrency 16
1.2.8. Test health check¶
CONTAINERS_COUNT  | 
HEALTH_CHECK_INTERVAL_DEVIATION (sec)  | 
|||
|---|---|---|---|---|
minimum  | 
maximum  | 
average  | 
95%  | 
|
2500  | 
0.00  | 
0.12  | 
0.02  | 
0.04  |