You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2019-06-19 - 05:39

Intel(R) Xeon(R) CPU E31220L @ 2.20GHz, Linux 3.18.43-rt46-fulldebug (Profile)

Latency plot of system in rack #b, slot #0
Note that this system runs a non-optimized debug kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
The worst-case latency is about 3.40 times higher under graphics load.
Results of all systems with accelerated graphics are combined on this summary graph.
Characteristics of the highest latencies:
System rackbslot0.osadl.org (updated Wed Jun 19, 2019 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2516827737,20sleep00-21swapper/011:55:520
2532126734,10sleep20-21swapper/211:57:422
2374726225,29sleep30-21swapper/311:53:143
2525626035,19sleep10-21swapper/111:56:531
17652560,1sleep1201ktimersoftd/114:35:511
249099490,2rtkit-daemon26586-21modprobe14:12:223
143232460,1sleep041ktimersoftd/016:43:190
143232460,1sleep041ktimersoftd/016:43:190
323412350,1sleep1201ktimersoftd/116:47:011
323412350,1sleep1201ktimersoftd/116:47:011
2554699349,14cyclictest31047-21sshd16:31:212
2552699341,29cyclictest0-21swapper/012:33:070
2552699341,29cyclictest0-21swapper/012:33:070
249099340,3rtkit-daemon2489-21rtkit-daemon13:22:330
2554699331,28cyclictest0-21swapper/212:02:032
25526993319,11cyclictest0-21swapper/012:44:380
25526993318,12cyclictest0-21swapper/012:50:370
249099330,3rtkit-daemon2489-21rtkit-daemon13:03:230
249099330,3rtkit-daemon2489-21rtkit-daemon12:38:490
249099330,3rtkit-daemon2489-21rtkit-daemon12:28:250
249099330,3rtkit-daemon2489-21rtkit-daemon12:17:060
249099330,3rtkit-daemon2489-21rtkit-daemon12:03:010
2554699328,21cyclictest20465-21kworker/2:116:27:332
2554699328,20cyclictest10206-21kworker/2:016:07:542
25546993217,9cyclictest24490-21sshd17:02:192
25546993212,17cyclictest0-21swapper/214:47:052
2554699321,28cyclictest0-21swapper/212:51:002
25526993218,11cyclictest0-21swapper/013:13:240
25526993218,11cyclictest0-21swapper/013:08:550
2552699321,27cyclictest0-21swapper/012:58:260
2552699321,21cyclictest0-21swapper/013:33:330
2552699321,12cyclictest0-21swapper/012:08:100
249099320,3rtkit-daemon2489-21rtkit-daemon13:57:530
249099320,3rtkit-daemon2489-21rtkit-daemon13:50:510
249099320,3rtkit-daemon2489-21rtkit-daemon13:39:070
249099320,3rtkit-daemon2489-21rtkit-daemon13:29:520
249099320,3rtkit-daemon2489-21rtkit-daemon13:23:250
249099320,3rtkit-daemon2489-21rtkit-daemon12:23:270
249099320,3rtkit-daemon2489-21rtkit-daemon12:05:490
249099320,2rtkit-daemon2489-21rtkit-daemon13:10:212
2555699313,24cyclictest0-21swapper/312:28:053
2555699312,25cyclictest200481sshd15:46:433
2555699311,20cyclictest181752modprobe16:26:313
2554699311,27cyclictest0-21swapper/212:57:172
2554699311,26cyclictest0-21swapper/212:20:372
2553699310,28cyclictest10175-21kworker/1:015:31:591
2553699310,19cyclictest20690-21kworker/1:014:50:101
25526993123,5cyclictest0-21swapper/015:22:060
2552699311,13cyclictest0-21swapper/013:44:380
2552699311,10cyclictest41ktimersoftd/014:01:060
249099310,3rtkit-daemon2489-21rtkit-daemon15:18:383
249099310,3rtkit-daemon2489-21rtkit-daemon14:59:283
249099310,3rtkit-daemon2489-21rtkit-daemon12:18:470
249099310,2rtkit-daemon2489-21rtkit-daemon16:46:593
249099310,2rtkit-daemon2489-21rtkit-daemon16:46:593
249099310,2rtkit-daemon2489-21rtkit-daemon14:43:501
249099310,2rtkit-daemon2489-21rtkit-daemon12:53:180
115042310,1sleep211878-21modprobe17:27:402
49132301,6sleep10-21swapper/113:11:221
41762300,3sleep041ktimersoftd/015:41:430
315852301,6sleep10-21swapper/113:57:521
312412301,6sleep20-21swapper/213:00:432
255812300,2sleep011-21rcuc/015:32:410
25556993022,4cyclictest17423-21modprobe17:20:403
2554699309,18cyclictest27-21rcuc/214:50:082
2554699307,11cyclictest2276-21kworker/2:416:22:162
25546993010,10cyclictest29-21ksoftirqd/216:38:302
2553699301,26cyclictest0-21swapper/116:52:361
2553699301,25cyclictest0-21swapper/117:14:521
2552699309,4cyclictest90950irq/25-em114:04:260
2552699303,24cyclictest11-21rcuc/016:27:480
25526993022,5cyclictest90950irq/25-em114:20:560
2552699302,25cyclictest0-21swapper/016:32:280
2552699302,25cyclictest0-21swapper/016:07:180
2552699301,9cyclictest41ktimersoftd/017:15:000
2552699301,25cyclictest0-21swapper/015:02:220
254292301,6sleep10-21swapper/113:45:231
249099300,3rtkit-daemon2489-21rtkit-daemon16:18:583
249099300,2rtkit-daemon0-21swapper/315:23:213
17602301,6sleep10-21swapper/113:05:321
45482291,6sleep10-21swapper/112:13:561
285332291,6sleep20-21swapper/213:51:432
25556992920,5cyclictest10203-21sshd16:14:433
25556992913,4cyclictest91050irq/26-p4p1-rx-15:31:013
2555699291,24cyclictest0-21swapper/313:16:013
2555699291,23cyclictest31997-21sshd14:19:453
2554699299,16cyclictest0-21swapper/215:18:232
2554699298,18cyclictest2616-21kworker/2:214:59:572
2554699297,12cyclictest27-21rcuc/216:49:422
2554699295,13cyclictest0-21swapper/215:51:332
2554699294,19cyclictest0-21swapper/216:02:292
2554699293,23cyclictest0-21swapper/212:27:512
2554699292,24cyclictest0-21swapper/214:21:532
2554699291,24cyclictest0-21swapper/213:45:562
2554699291,24cyclictest0-21swapper/213:31:572
2554699291,24cyclictest0-21swapper/213:14:142
2554699291,24cyclictest0-21swapper/212:14:152
2553699299,16cyclictest0-21swapper/113:16:331
2553699295,18cyclictest0-21swapper/115:34:471
2553699292,23cyclictest0-21swapper/116:57:571
25536992913,12cyclictest12279-21kworker/1:116:22:171
25526992922,4cyclictest12052-21sshd14:28:590
25526992921,5cyclictest0-21swapper/015:16:020
2552699291,9cyclictest0-21swapper/017:25:370
2552699291,4cyclictest6990-21bash16:50:080
249099290,3rtkit-daemon2489-21rtkit-daemon15:14:573
249099290,2rtkit-daemon2489-21rtkit-daemon15:08:543
249099290,2rtkit-daemon19318-21sshd14:33:423
195322291,6sleep10-21swapper/112:41:541
15552291,6sleep20-21swapper/212:09:472
25556992821,4cyclictest27048-21modprobe16:42:323
25556992821,4cyclictest0-21swapper/316:10:443
2555699282,23cyclictest0-21swapper/316:33:193
2555699281,23cyclictest998-21sshd15:48:203
2554699289,16cyclictest0-21swapper/213:07:182
2554699289,16cyclictest0-21swapper/212:38:192
2554699288,17cyclictest25161-21kworker/2:317:10:582
2554699288,16cyclictest0-21swapper/214:09:272
2554699287,11cyclictest27808-21kworker/2:414:02:552
2554699287,11cyclictest0-21swapper/216:03:322
2554699285,18cyclictest0-21swapper/215:45:262
2554699284,18cyclictest0-21swapper/214:41:552
25546992810,15cyclictest0-21swapper/212:03:232
2554699281,24cyclictest0-21swapper/213:25:302
2554699281,23cyclictest0-21swapper/213:39:572
2554699281,23cyclictest0-21swapper/213:35:182
2554699281,23cyclictest0-21swapper/212:28:542
2554699281,16cyclictest3919-21kworker/2:116:57:062
2553699289,8cyclictest0-21swapper/112:31:521
2553699283,13cyclictest14194-21kworker/1:117:19:151
25536992813,12cyclictest29672-21kworker/1:216:37:101
2553699281,4cyclictest0-21swapper/116:07:091
2553699281,24cyclictest23506-21modprobe14:23:431
2553699281,23cyclictest0-21swapper/116:32:471
2553699281,23cyclictest0-21swapper/115:56:341
2553699281,23cyclictest0-21swapper/115:56:341
25526992822,3cyclictest0-21swapper/017:18:210
2552699282,9cyclictest0-21swapper/015:23:480
2552699282,8cyclictest0-21swapper/016:36:480
2552699282,10cyclictest0-21swapper/014:48:140
25526992813,3cyclictest90950irq/25-em114:12:450
2552699281,9cyclictest0-21swapper/015:33:200
249099280,3rtkit-daemon2489-21rtkit-daemon16:29:443
249099280,3rtkit-daemon1220-21nfsd17:24:503
25556992713,4cyclictest91050irq/26-p4p1-rx-17:00:113
25556992712,4cyclictest91050irq/26-p4p1-rx-14:01:343
2555699271,22cyclictest122750nfsd14:15:123
2555699271,22cyclictest0-21swapper/313:55:453
2555699271,22cyclictest0-21swapper/312:38:343
2554699279,15cyclictest0-21swapper/215:55:112
2554699279,15cyclictest0-21swapper/215:55:112
2554699279,15cyclictest0-21swapper/215:14:072
2554699279,15cyclictest0-21swapper/215:11:342
2554699278,16cyclictest0-21swapper/215:05:472
2554699276,18cyclictest29-21ksoftirqd/217:07:482
2554699274,18cyclictest0-21swapper/215:27:172
2554699274,17cyclictest0-21swapper/216:36:352
2554699274,15cyclictest0-21swapper/215:41:072
25546992712,4cyclictest12505-21kworker/2:314:05:332
25546992711,12cyclictest28873-21sshd15:32:502
2554699271,23cyclictest0-21swapper/213:53:362
2554699271,22cyclictest0-21swapper/213:19:132
2554699271,22cyclictest0-21swapper/212:33:252
2554699271,22cyclictest0-21swapper/212:33:252
2553699279,15cyclictest0-21swapper/115:49:591
2553699279,15cyclictest0-21swapper/115:17:551
2553699272,21cyclictest0-21swapper/116:09:581
2553699272,12cyclictest0-21swapper/112:25:041
25536992711,12cyclictest0-21swapper/113:30:531
2553699271,23cyclictest8360-21kworker/1:314:38:371
2553699271,23cyclictest0-21swapper/115:41:081
2553699271,22cyclictest5361-21modprobe14:28:411
2553699271,14cyclictest0-21swapper/115:21:551
2553699270,23cyclictest4406-21kworker/1:415:25:021
2552699273,6cyclictest3-21ksoftirqd/015:49:570
2552699272,9cyclictest0-21swapper/014:56:120
2552699272,9cyclictest0-21swapper/014:39:150
2552699272,12cyclictest0-21swapper/014:17:240
25526992712,12cyclictest90950irq/25-em116:12:010
2552699271,9cyclictest1568-21runrttasks17:03:260
2552699271,8cyclictest11659-21sshd15:53:260
2552699271,8cyclictest11659-21sshd15:53:260
2552699271,3cyclictest13573-21bash15:05:020
2552699271,24cyclictest0-21swapper/016:56:470
249099270,2rtkit-daemon2489-21rtkit-daemon17:14:533
249099270,2rtkit-daemon2489-21rtkit-daemon16:02:063
249099270,2rtkit-daemon2489-21rtkit-daemon15:35:013
249099270,2rtkit-daemon2489-21rtkit-daemon14:31:073
25556992618,5cyclictest15484-21modprobe16:50:313
2555699261,22cyclictest14582kworker/u8:217:12:493
2555699261,22cyclictest0-21swapper/312:34:443
2555699261,22cyclictest0-21swapper/312:34:443
2555699261,21cyclictest825350sshd14:56:133
2555699261,21cyclictest353150munin-node16:52:583
2555699261,21cyclictest0-21swapper/313:18:103
2555699261,21cyclictest0-21swapper/313:11:013
2555699261,21cyclictest0-21swapper/313:03:293
2555699261,15cyclictest0-21swapper/313:29:453
2554699269,7cyclictest0-21swapper/215:33:182
2554699266,14cyclictest0-21swapper/214:13:272
2554699262,21cyclictest0-21swapper/217:15:542
25546992612,11cyclictest27-21rcuc/214:28:212
2554699261,22cyclictest0-21swapper/212:44:532
2554699261,21cyclictest0-21swapper/214:33:562
2553699265,11cyclictest18011-21kworker/1:015:03:591
2553699265,11cyclictest10094-21kworker/1:116:42:061
2553699264,18cyclictest4406-21kworker/1:415:47:341
2553699264,17cyclictest0-21swapper/113:38:381
2553699264,11cyclictest5103-21kworker/1:016:23:471
2553699263,18cyclictest0-21swapper/112:08:281
2553699262,13cyclictest0-21swapper/113:48:181
25536992618,5cyclictest21-21ksoftirqd/113:37:161
25536992612,11cyclictest10964-21kworker/1:315:01:591
2553699261,21cyclictest0-21swapper/113:19:201
2553699261,15cyclictest0-21swapper/116:00:591
2553699261,14cyclictest31353-21kworker/1:114:09:431
2553699260,16cyclictest19-21rcuc/115:08:351
2552699262,8cyclictest41ktimersoftd/017:00:010
2552699261,9cyclictest0-21swapper/014:34:530
2552699261,4cyclictest9561-21systemd-cgroups15:59:030
2552699261,4cyclictest30722-21sshd16:19:560
2552699260,8cyclictest29011-21sshd15:44:130
2552699260,4cyclictest816-21sshd17:08:240
2552699260,4cyclictest22549-21sshd16:40:540
249099260,2rtkit-daemon2489-21rtkit-daemon14:05:261
2555699253,18cyclictest0-21swapper/313:24:303
2555699253,18cyclictest0-21swapper/312:59:293
25556992510,10cyclictest2342-21Xorg12:56:023
2555699251,21cyclictest122450nfsd14:24:293
2555699251,20cyclictest91050irq/26-p4p1-rx-12:13:113
2555699251,20cyclictest0-21swapper/312:09:253
2554699258,14cyclictest0-21swapper/216:43:572
2554699258,14cyclictest0-21swapper/216:43:572
2554699255,17cyclictest0-21swapper/214:23:482
25546992511,11cyclictest28947-21kworker/2:217:19:092
2554699251,21cyclictest0-21swapper/214:53:082
2553699259,13cyclictest0-21swapper/112:53:061
2553699252,19cyclictest0-21swapper/114:14:241
2553699252,19cyclictest0-21swapper/112:47:261
2553699251,21cyclictest0-21swapper/113:26:091
2553699251,21cyclictest0-21swapper/112:06:101
2553699251,20cyclictest0-21swapper/117:03:521
2553699251,14cyclictest19815-21kworker/1:117:09:421
2552699252,7cyclictest41ktimersoftd/014:44:240
2552699252,13cyclictest3-21ksoftirqd/014:23:010
25526992518,4cyclictest41ktimersoftd/016:16:000
25526992515,7cyclictest8819-21kworker/0:315:09:340
249099250,2rtkit-daemon2489-21rtkit-daemon15:55:043
249099250,2rtkit-daemon2489-21rtkit-daemon15:55:043
249099250,2rtkit-daemon2489-21rtkit-daemon14:07:473
188402251,7sleep30-21swapper/315:42:243
2555699244,17cyclictest0-21swapper/313:51:593
2555699243,18cyclictest0-21swapper/312:04:303
2555699243,17cyclictest0-21swapper/313:43:113
2555699243,17cyclictest0-21swapper/312:48:283
2555699243,17cyclictest0-21swapper/312:29:253
2555699241,19cyclictest1119350swap17:03:063
2555699241,19cyclictest0-21swapper/312:18:253
2554699248,13cyclictest23092-21kworker/2:416:13:002
2553699242,9cyclictest0-21swapper/114:21:481
2553699242,11cyclictest6338-21sshd16:54:211
2553699242,11cyclictest31353-21kworker/1:114:02:221
25536992418,3cyclictest21-21ksoftirqd/116:13:071
25536992417,4cyclictest21-21ksoftirqd/112:20:011
25536992410,11cyclictest0-21swapper/112:33:101
25536992410,11cyclictest0-21swapper/112:33:101
2553699241,11cyclictest0-21swapper/114:56:391
249099240,2rtkit-daemon0-21swapper/314:48:333
249099240,1rtkit-daemon20379-21sshd14:45:123
2555699237,13cyclictest361ktimersoftd/314:40:453
2555699236,13cyclictest361ktimersoftd/316:07:123
2555699233,17cyclictest0-21swapper/312:45:273
2555699233,17cyclictest0-21swapper/312:02:583
2555699233,16cyclictest0-21swapper/313:38:293
2555699231,18cyclictest0-21swapper/313:33:163
2553699232,18cyclictest0-21swapper/111:59:311
2553699232,11cyclictest30018-21kworker/1:317:23:321
2553699231,19cyclictest0-21swapper/112:48:121
2553699231,18cyclictest0-21swapper/113:01:431
2555699229,10cyclictest361ktimersoftd/315:03:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional