You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 17:57
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of system in rack #9, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack9slot0.osadl.org (updated Fri Sep 30, 2022 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2744021180,1sleep0589-21systemd-journal11:44:580
3036521040,2sleep12894099cyclictest09:46:351
2700821000,2sleep12894099cyclictest10:47:351
88992800,1sleep18874-21bash10:19:571
204072770,0sleep1241rcuc/109:32:561
249792760,0sleep30-21swapper/311:31:383
72082740,1sleep30-21swapper/312:27:293
48072720,0sleep20-21swapper/210:08:562
107392720,1sleep110738-21bash11:57:051
97802700,0sleep30-21swapper/310:59:353
94042700,0sleep30-21swapper/309:47:213
119152700,1sleep30-21swapper/311:48:213
284972690,0sleep20-21swapper/212:28:572
134382690,0sleep20-21swapper/210:57:382
227632680,1sleep3421rcuc/312:32:593
38792660,0sleep03874-21seq12:31:390
235922660,0sleep20-21swapper/211:49:092
68082650,0sleep10-21swapper/109:23:181
255112650,0sleep025508-21sshd12:11:110
317512640,0sleep20-21swapper/211:36:302
271122620,3sleep02893699cyclictest10:01:370
210552620,0sleep10-21swapper/109:43:461
162952620,1sleep216300-21bash11:42:072
75312610,0sleep10-21swapper/109:58:091
38762600,1sleep33834-21cp09:59:593
215002590,0sleep21-21systemd12:32:532
269682580,0sleep10-21swapper/110:58:331
223712580,0sleep30-21swapper/312:35:073
88702570,0sleep30-21swapper/311:23:563
128592570,1sleep0589-21systemd-journal12:38:570
28949995644,2cyclictest1663-21nfsd09:34:293
280612560,1sleep2790-21dbus-daemon11:51:372
2837425541,8sleep30-21swapper/307:05:353
172152550,0sleep30-21swapper/311:17:513
282232530,0sleep30-21swapper/309:29:053
222422530,0sleep1241rcuc/109:17:531
2840825224,9sleep00-21swapper/007:06:010
28949995147,1cyclictest1663-21nfsd10:36:123
2867025123,8sleep20-21swapper/207:09:152
2865225137,8sleep10-21swapper/107:09:021
235512480,2sleep32894999cyclictest10:05:453
28949994743,3cyclictest31648-21systemd-cgroups11:43:093
294272450,0sleep00-21swapper/010:21:250
51572430,2sleep02893699cyclictest11:23:410
28949994239,2cyclictest22335-21kworker/u8:210:34:013
28949994138,2cyclictest1660-21nfsd09:24:073
28949993835,0cyclictest0-21swapper/309:13:333
28949993734,0cyclictest0-21swapper/307:55:093
28949993733,3cyclictest0-21swapper/308:27:093
28949993632,3cyclictest44-21ksoftirqd/310:40:573
28949993532,0cyclictest795-21nscd09:17:553
28949993429,2cyclictest1-21systemd10:44:533
28949993410,3cyclictest16544-21sshd12:04:073
28949993331,0cyclictest0-21swapper/311:51:313
28949993229,2cyclictest1663-21nfsd12:17:573
28949993128,2cyclictest0-21swapper/310:49:453
28949993128,2cyclictest0-21swapper/310:14:153
28949993028,0cyclictest0-21swapper/309:34:473
28949993027,2cyclictest0-21swapper/307:19:313
28949993026,3cyclictest794-21systemd-logind10:16:253
44102280,1sleep0141rcuc/011:19:120
28949992725,1cyclictest0-21swapper/309:57:033
279132270,1sleep327907-21sshd10:23:323
28949992622,3cyclictest1663-21nfsd10:55:373
28949992620,5cyclictest0-21swapper/310:25:033
3292240,1sleep0790-21dbus-daemon10:47:580
2894699240,20cyclictest0-21swapper/210:26:492
28949992321,0cyclictest0-21swapper/311:37:593
28949992320,2cyclictest22074-21grepconf.sh12:06:373
170762230,1sleep017048-21sshd09:10:590
57842220,0sleep00-21swapper/012:07:420
28949992218,3cyclictest0-21swapper/312:23:453
28949992218,3cyclictest0-21swapper/308:10:433
244962220,1sleep235-21ksoftirqd/212:02:272
219032220,0sleep30-21swapper/311:57:513
142312220,1sleep0141rcuc/010:11:430
76432210,0sleep20-21swapper/209:14:452
281942210,0sleep2331rcuc/209:24:432
134302210,1sleep01663-21nfsd09:34:390
44402200,1sleep24424-21sshd12:22:552
28949992018,0cyclictest86950irq/25-em109:51:173
28949992017,2cyclictest0-21swapper/308:07:313
28949992014,2cyclictest0-21swapper/309:44:213
28940992017,2cyclictest1663-21nfsd09:49:471
264642200,0sleep00-21swapper/011:27:220
248832200,0sleep30-21swapper/311:05:093
188382200,1sleep2331rcuc/210:42:352
181892200,0sleep118192-21systemd-cgroups10:38:091
28949991916,0cyclictest0-21swapper/311:12:293
252352190,0sleep20-21swapper/212:37:342
167212190,0sleep216713-21sshd11:57:302
163542190,0sleep20-21swapper/209:13:092
152822190,2sleep22894699cyclictest10:46:482
143272190,1sleep10-21swapper/111:46:191
28946991813,3cyclictest14444-21sshd09:21:392
267332180,0sleep12005-21runrttasks11:27:231
28949991714,0cyclictest0-21swapper/308:20:353
28949991712,4cyclictest20778-21bash11:26:593
28946991715,1cyclictest20664-21bash12:08:442
28946991713,3cyclictest12961-21bash09:43:132
279762170,0sleep2331rcuc/210:32:172
249952170,0sleep20-21swapper/211:27:162
243532170,0sleep20-21swapper/209:57:062
2893699160,1cyclictest4985-21grepconf.sh11:12:380
2894699151,3cyclictest121rcu_sched09:37:282
28946991513,1cyclictest0-21swapper/210:52:502
2894699150,14cyclictest7575-21bash10:19:542
28940991512,2cyclictest5062-21kworker/1:212:30:451
2893699156,1cyclictest9-21ksoftirqd/009:40:500
2893699155,1cyclictest9-21ksoftirqd/010:57:520
28936991513,1cyclictest9-21ksoftirqd/011:31:300
28936991513,1cyclictest9-21ksoftirqd/009:55:370
28936991513,1cyclictest9-21ksoftirqd/009:19:310
28949991412,0cyclictest0-21swapper/312:12:053
28946991412,1cyclictest27880-21systemd-cgroups12:13:352
2894699140,13cyclictest0-21swapper/210:17:592
28940991412,1cyclictest26-21ksoftirqd/110:59:511
2894099140,2cyclictest17848-21systemd12:10:391
2893699143,10cyclictest790-21dbus-daemon11:57:090
2893699141,1cyclictest121rcu_sched09:25:450
28936991411,2cyclictest9-21ksoftirqd/007:44:300
28936991411,2cyclictest25120-21sd-pam09:46:130
2893699140,1cyclictest24985-21sshd10:29:530
2893699140,1cyclictest121rcu_sched10:49:460
2893699140,1cyclictest111rcu_preempt09:20:230
28946991312,0cyclictest86950irq/25-em108:44:552
28946991311,1cyclictest35-21ksoftirqd/209:30:562
28946991310,2cyclictest35-21ksoftirqd/210:12:142
2894699130,2cyclictest9695-21kworker/2:211:00:432
2894699130,12cyclictest24053-21kworker/2:212:15:012
28940991311,1cyclictest26-21ksoftirqd/110:06:151
2894099130,12cyclictest16206-21bash10:09:441
2893699135,4cyclictest794-21systemd-logind11:01:090
28936991311,1cyclictest9-21ksoftirqd/011:41:300
28936991311,1cyclictest9-21ksoftirqd/011:37:450
28936991311,1cyclictest9-21ksoftirqd/011:04:500
28936991311,1cyclictest9-21ksoftirqd/010:27:330
28936991311,1cyclictest9-21ksoftirqd/010:17:280
28936991311,1cyclictest9-21ksoftirqd/010:07:540
28936991311,1cyclictest9-21ksoftirqd/009:49:500
28936991310,1cyclictest9-21ksoftirqd/012:03:330
2893699130,11cyclictest13039-21kworker/0:710:39:210
2894699129,1cyclictest35-21ksoftirqd/211:34:132
2894699126,3cyclictest0-21swapper/207:25:232
28946991210,1cyclictest35-21ksoftirqd/210:04:312
28946991210,1cyclictest35-21ksoftirqd/209:44:472
28946991210,1cyclictest27260-21bash11:20:432
28946991210,1cyclictest0-21swapper/208:54:562
2894699120,11cyclictest8053-21kworker/2:411:05:442
2894099129,1cyclictest26-21ksoftirqd/112:37:021
2894099129,1cyclictest26-21ksoftirqd/112:06:061
2894099129,1cyclictest0-21swapper/111:22:201
2894099128,1cyclictest26-21ksoftirqd/112:21:021
2894099128,1cyclictest26-21ksoftirqd/111:31:021
2894099121,10cyclictest873-21polkitd11:09:561
28940991210,1cyclictest26-21ksoftirqd/111:41:291
28940991210,1cyclictest26-21ksoftirqd/110:29:311
2894099120,11cyclictest3888-21kworker/1:009:36:251
2894099120,11cyclictest21111-21kworker/1:412:26:091
2894099120,11cyclictest1384-21kworker/1:109:26:181
2893699128,1cyclictest9-21ksoftirqd/011:51:340
28936991210,1cyclictest9-21ksoftirqd/012:27:520
28936991210,1cyclictest9-21ksoftirqd/009:29:440
2893699120,1cyclictest0-21swapper/012:14:540
2893699120,11cyclictest437-21kworker/0:108:37:590
2893699120,11cyclictest14428-21kworker/0:210:41:130
2894999119,1cyclictest0-21swapper/307:28:323
2894999117,3cyclictest19264-21kworker/3:207:10:013
2894999110,10cyclictest0-21swapper/308:41:503
2894999110,10cyclictest0-21swapper/307:18:403
2894699119,1cyclictest35-21ksoftirqd/211:09:442
2894699119,1cyclictest35-21ksoftirqd/210:35:292
2894699119,1cyclictest35-21ksoftirqd/209:49:512
2894699117,1cyclictest35-21ksoftirqd/211:14:522
2894099119,1cyclictest31098-21sshd09:59:451
2894099119,1cyclictest26-21ksoftirqd/110:40:121
2894099119,1cyclictest26-21ksoftirqd/110:15:501
2894099118,2cyclictest26-21ksoftirqd/111:49:461
2894099118,1cyclictest26-21ksoftirqd/112:17:171
28940991110,0cyclictest0-21swapper/109:04:481
2894099110,2cyclictest589-21systemd-journal11:06:021
2894099110,1cyclictest1220-21systemd-cgroups09:09:531
2894099110,10cyclictest8252-21ntp_states11:34:511
2894099110,10cyclictest21256-21kworker/1:611:14:471
2894099110,10cyclictest14611-21systemd10:51:091
2894099110,10cyclictest0-21swapper/107:28:161
2893699119,1cyclictest9-21ksoftirqd/012:19:550
2893699116,1cyclictest953-21munin-run08:19:300
2893699110,9cyclictest0-21swapper/007:39:030
2894999100,9cyclictest0-21swapper/309:09:223
2894999100,9cyclictest0-21swapper/308:52:243
2894999100,0cyclictest0-21swapper/308:14:463
2894699109,0cyclictest0-21swapper/208:14:592
2894699100,9cyclictest0-21swapper/208:54:282
2894699100,0cyclictest0-21swapper/208:34:362
2894099109,0cyclictest0-21swapper/108:49:001
2894099109,0cyclictest0-21swapper/108:32:441
2894099103,1cyclictest18866-21expr07:49:451
2894099100,9cyclictest25610-21sshd10:29:551
2894099100,9cyclictest0-21swapper/108:58:111
2894099100,0cyclictest0-21swapper/108:25:251
2894099100,0cyclictest0-21swapper/108:17:101
2893699100,9cyclictest0-21swapper/008:50:070
2893699100,9cyclictest0-21swapper/008:07:080
2893699100,9cyclictest0-21swapper/008:01:190
262712100,1sleep1842-21NetworkManager12:00:221
289499998,0cyclictest0-21swapper/309:01:213
289499998,0cyclictest0-21swapper/308:32:253
289469998,0cyclictest0-21swapper/209:07:502
289469990,8cyclictest0-21swapper/207:58:292
289469990,0cyclictest0-21swapper/207:43:582
289409998,0cyclictest0-21swapper/108:40:311
289369998,0cyclictest0-21swapper/007:21:360
289369996,1cyclictest2336-21idleruntime-cro07:19:300
289369990,0cyclictest0-21swapper/009:01:090
289369990,0cyclictest0-21swapper/007:30:320
289499987,0cyclictest86950irq/25-em107:59:513
289499980,8cyclictest0-21swapper/307:41:333
289499980,4cyclictest0-21swapper/308:45:213
289499980,3cyclictest0-21swapper/307:34:483
289469987,0cyclictest0-21swapper/208:34:222
289469980,7cyclictest0-21swapper/207:12:082
289469980,0cyclictest0-21swapper/207:23:592
289409987,0cyclictest13617-21kworker/1:208:00:211
289409987,0cyclictest0-21swapper/108:08:141
289409987,0cyclictest0-21swapper/107:17:281
289409982,3cyclictest0-21swapper/107:37:461
289409981,3cyclictest15321-21latency_hist07:44:301
289369987,0cyclictest0-21swapper/009:09:230
13562284,3sleep20-21swapper/208:40:532
289499973,3cyclictest2005-21runrttasks08:54:433
289499973,3cyclictest0-21swapper/307:49:413
289499970,6cyclictest0-21swapper/308:35:023
289499970,3cyclictest0-21swapper/307:31:053
289499970,1cyclictest15239-40dnf07:44:313
289469975,1cyclictest1288-21grep07:14:502
289469973,3cyclictest3256-21kworker/u8:008:21:232
289469973,2cyclictest0-21swapper/207:49:472
289469971,2cyclictest0-21swapper/207:44:502
289469970,7cyclictest0-21swapper/208:06:352
289469970,4cyclictest0-21swapper/207:37:212
289469970,3cyclictest0-21swapper/209:03:492
289469970,3cyclictest0-21swapper/207:30:252
289469970,1cyclictest4544-21grep08:24:442
289469970,1cyclictest29424-21irqstats08:09:492
289409973,3cyclictest0-21swapper/108:59:471
289409973,3cyclictest0-21swapper/108:13:501
289409973,3cyclictest0-21swapper/107:30:521
289409972,2cyclictest0-21swapper/107:54:471
289409970,6cyclictest3356-21fw_conntrack07:19:481
289409970,2cyclictest0-21swapper/107:09:491
289369976,0cyclictest0-21swapper/008:28:160
289369974,0cyclictest437-21kworker/0:107:25:230
289369970,1cyclictest30669-21switchtime07:09:590
289369970,1cyclictest22070-21ntp_states07:54:500
289369970,1cyclictest1868-21grep08:19:460
289369970,1cyclictest1663-21nfsd08:55:040
19065270,1sleep00-21swapper/007:49:470
289469960,4cyclictest0-21swapper/207:59:462
289409964,1cyclictest13617-21kworker/1:208:52:431
289409962,2cyclictest0-21swapper/108:19:491
289409961,2cyclictest0-21swapper/107:44:311
289409960,0cyclictest0-21swapper/108:35:311
289369960,5cyclictest0-21swapper/008:39:480
289369960,5cyclictest0-21swapper/008:29:310
289369960,0cyclictest0-21swapper/008:44:550
289369960,0cyclictest0-21swapper/008:10:070
289369960,0cyclictest0-21swapper/007:44:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional