You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 16:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Mar 23, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29623991329,80cyclictest11564-21sshd10:25:561
222872720,2sleep02961199cyclictest12:28:010
63732630,1sleep56358-21bash10:20:005
279852590,0sleep40-21swapper/409:10:314
286832580,2sleep22962999cyclictest09:55:142
2961199570,56cyclictest6408-21kworker/0:310:25:570
2925325429,9sleep70-21swapper/707:03:517
135622540,1sleep2321ktimersoftd/210:05:312
29654995315,37cyclictest11712-21systemd10:25:576
43052510,1sleep34306-21id10:17:583
29629995110,23cyclictest0-21swapper/210:25:572
2928725127,9sleep10-21swapper/107:04:171
2916025026,8sleep00-21swapper/007:02:320
213452500,0sleep30-21swapper/310:37:363
213452500,0sleep30-21swapper/310:37:363
162212500,0sleep60-21swapper/611:55:566
71752480,1sleep37169-21sshd11:44:073
312232470,0sleep50-21swapper/511:15:345
171352460,1sleep22962999cyclictest10:54:092
131842460,1sleep613160-21cp09:20:506
80222450,1sleep58023-21systemd-cgroups09:44:445
80222450,1sleep58023-21systemd-cgroups09:44:445
326372450,0sleep30-21swapper/309:27:283
324122450,0sleep1231rcuc/111:00:411
227502450,1sleep122726-21bash10:56:241
200222450,0sleep50-21swapper/510:43:075
161692450,1sleep316170-21bash10:11:173
60112430,0sleep70-21swapper/711:29:067
2929724324,15sleep20-21swapper/207:04:262
200842430,0sleep20-21swapper/210:00:192
148072430,2sleep2321ktimersoftd/212:16:262
126602430,0sleep20-21swapper/210:29:422
194242410,0sleep00-21swapper/010:52:230
77602400,0sleep50-21swapper/509:22:175
302142400,0sleep20-21swapper/210:15:482
30012400,0sleep50-21swapper/509:33:155
2929224029,8sleep60-21swapper/607:04:226
2929024028,9sleep40-21swapper/407:04:204
2924224028,9sleep50-21swapper/507:03:415
2699024028,8sleep30-21swapper/307:01:473
181502400,0sleep60-21swapper/612:01:406
158972400,1sleep615894-21grepconf.sh10:54:056
306322390,0sleep30-21swapper/311:15:323
200752390,0sleep40-21swapper/409:56:364
196022390,0sleep20-21swapper/209:07:412
69042380,0sleep10-21swapper/111:57:111
62352380,0sleep4481ktimersoftd/412:29:014
29646993837,1cyclictest5223-21kworker/5:410:25:565
254242380,0sleep10-21swapper/110:32:131
129132380,0sleep40-21swapper/412:35:024
277062360,1sleep52964699cyclictest12:24:385
2965899330,32cyclictest20408-21kworker/7:310:25:567
29640993029,1cyclictest7144-21kworker/4:210:25:574
277332300,0sleep50-21swapper/511:50:585
29611992519,1cyclictest9-21ksoftirqd/012:26:260
29611992419,4cyclictest9-21ksoftirqd/010:20:050
29611992318,4cyclictest9-21ksoftirqd/011:33:530
29611992318,4cyclictest9-21ksoftirqd/011:20:190
29636992220,1cyclictest11772-21sshd10:25:573
2961199225,1cyclictest9-21ksoftirqd/009:35:580
29611992210,4cyclictest9-21ksoftirqd/011:29:530
29611992117,4cyclictest9-21ksoftirqd/011:40:370
29611992117,4cyclictest0-21swapper/009:45:050
29611992117,4cyclictest0-21swapper/009:45:050
29611992116,5cyclictest31908-21kworker/0:509:13:530
29611992116,5cyclictest18433-21kworker/u16:009:53:450
2965899200,4cyclictest0-21swapper/709:14:227
29611992015,5cyclictest0-21swapper/008:10:050
29611992014,6cyclictest9-21ksoftirqd/010:50:170
29611992014,6cyclictest9-21ksoftirqd/010:38:490
29611992014,6cyclictest9-21ksoftirqd/010:38:490
29611992012,3cyclictest9-21ksoftirqd/012:32:000
29611992011,9cyclictest9-21ksoftirqd/010:11:390
2964699194,5cyclictest19342-21nscd11:54:435
29611991916,3cyclictest9-21ksoftirqd/011:03:130
29611991915,4cyclictest9-21ksoftirqd/011:13:290
29611991914,1cyclictest9-21ksoftirqd/012:02:350
29611991914,1cyclictest9-21ksoftirqd/011:54:200
29611991913,1cyclictest9-21ksoftirqd/011:48:190
29611991913,1cyclictest9-21ksoftirqd/011:24:370
268992190,0sleep70-21swapper/709:32:457
2964699187,5cyclictest0-21swapper/507:11:395
2964699183,10cyclictest0-21swapper/512:18:525
2961199189,4cyclictest9-21ksoftirqd/007:38:530
2961199188,9cyclictest9-21ksoftirqd/010:07:090
29611991816,1cyclictest9-21ksoftirqd/009:21:560
29611991815,2cyclictest9-21ksoftirqd/011:01:060
29611991813,5cyclictest0-21swapper/009:02:050
29611991813,5cyclictest0-21swapper/007:54:290
29611991813,1cyclictest2942-21kworker/0:210:42:030
29611991811,6cyclictest9-21ksoftirqd/009:59:390
2961199181,3cyclictest9-21ksoftirqd/012:20:580
71642170,1sleep4481ktimersoftd/409:27:534
2964699176,0cyclictest0-21swapper/509:05:395
29646991713,3cyclictest57-21ksoftirqd/509:20:035
29646991712,5cyclictest0-21swapper/512:30:045
2961199178,9cyclictest9-21ksoftirqd/011:07:370
2961199177,5cyclictest9-21ksoftirqd/008:04:590
2961199176,0cyclictest0-21swapper/008:53:530
29611991716,1cyclictest9-21ksoftirqd/009:16:390
29611991715,1cyclictest9-21ksoftirqd/010:33:140
29611991715,1cyclictest9-21ksoftirqd/010:04:270
29611991712,5cyclictest0-21swapper/008:39:330
29611991712,4cyclictest9-21ksoftirqd/011:42:190
29611991712,0cyclictest0-21swapper/008:50:570
29611991711,6cyclictest9-21ksoftirqd/012:00:030
29611991711,6cyclictest9-21ksoftirqd/009:27:070
29611991710,6cyclictest9-21ksoftirqd/012:06:440
192622170,1sleep1241ktimersoftd/109:19:171
57952160,1sleep7797-21sshd09:16:437
2964699160,4cyclictest0-21swapper/508:21:235
29629991615,1cyclictest0-21swapper/210:45:392
2961199164,12cyclictest9-21ksoftirqd/009:46:590
29611991614,1cyclictest9-21ksoftirqd/012:12:110
29611991612,4cyclictest9-21ksoftirqd/008:24:430
29611991612,4cyclictest0-21swapper/007:48:570
29611991612,4cyclictest0-21swapper/007:48:570
29611991611,5cyclictest0-21swapper/008:18:350
29611991611,0cyclictest1674-21kworker/0:309:06:570
29611991611,0cyclictest0-21swapper/007:22:570
29611991610,5cyclictest9-21ksoftirqd/009:37:090
29611991610,1cyclictest9-21ksoftirqd/008:56:530
29658991513,1cyclictest73-21ksoftirqd/709:31:257
29654991513,1cyclictest65-21ksoftirqd/609:44:396
29654991513,1cyclictest65-21ksoftirqd/609:44:396
29654991511,3cyclictest65-21ksoftirqd/609:55:126
2964699154,5cyclictest31943-21kworker/5:210:52:335
2964699153,11cyclictest15401-21systemd-cgroups09:13:295
29646991512,1cyclictest57-21ksoftirqd/511:40:445
2964699150,15cyclictest0-21swapper/512:12:175
2964099150,14cyclictest0-21swapper/409:32:574
29636991513,1cyclictest41-21ksoftirqd/311:02:393
29636991511,3cyclictest41-21ksoftirqd/311:38:023
2961199159,1cyclictest9-21ksoftirqd/007:07:250
2961199154,6cyclictest29941-21kworker/0:107:26:570
29611991513,1cyclictest9-21ksoftirqd/010:27:350
29611991510,5cyclictest9-21ksoftirqd/007:58:010
29611991510,1cyclictest10605-21kworker/0:208:35:450
143172150,2sleep52964699cyclictest09:28:185
111752150,0sleep50-21swapper/511:35:045
327272140,0sleep20-21swapper/211:00:422
29654991412,1cyclictest65-21ksoftirqd/610:07:196
2964699148,5cyclictest12185-21bash11:10:455
2964699144,6cyclictest0-21swapper/511:06:055
2964699142,6cyclictest0-21swapper/509:58:015
29646991413,1cyclictest57-21ksoftirqd/510:37:265
29646991413,1cyclictest57-21ksoftirqd/510:37:265
29646991411,2cyclictest57-21ksoftirqd/509:56:365
2964699140,14cyclictest0-21swapper/510:06:355
2964099140,2cyclictest7434-21systemd12:21:374
29636991412,1cyclictest41-21ksoftirqd/312:31:043
29636991412,1cyclictest41-21ksoftirqd/311:58:113
29636991412,1cyclictest41-21ksoftirqd/311:27:193
29636991412,1cyclictest41-21ksoftirqd/310:13:213
2963699140,11cyclictest0-21swapper/312:10:513
29629991412,1cyclictest33-21ksoftirqd/209:13:452
2961199149,5cyclictest9-21ksoftirqd/007:17:070
2961199143,6cyclictest9-21ksoftirqd/008:28:270
29611991410,4cyclictest9-21ksoftirqd/007:13:410
2961199141,13cyclictest0-21swapper/008:11:490
29072140,0sleep70-21swapper/709:40:467
265592140,1sleep526560-21grepconf.sh10:32:175
262182140,0sleep20-21swapper/212:16:582
247912140,0sleep60-21swapper/610:43:246
312202130,2sleep72965899cyclictest12:32:177
2965899132,5cyclictest15441-21bash10:39:107
2965899132,5cyclictest15441-21bash10:39:107
29658991311,1cyclictest73-21ksoftirqd/710:02:367
29658991310,2cyclictest9886-21kworker/7:211:34:097
29658991310,2cyclictest30214-21bash11:43:347
2965499132,5cyclictest18014-21sshd10:33:426
2964699138,5cyclictest26342-21bash11:18:595
2964699138,5cyclictest0-21swapper/511:59:395
2964699138,5cyclictest0-21swapper/510:09:395
2964699138,5cyclictest0-21swapper/508:43:475
2964699138,5cyclictest0-21swapper/507:45:455
2964699138,5cyclictest0-21swapper/507:22:195
2964699138,5cyclictest0-21swapper/507:07:475
2964699138,0cyclictest0-21swapper/510:47:395
2964699138,0cyclictest0-21swapper/507:27:395
2964699137,5cyclictest11286-21sshd12:06:505
2964699137,5cyclictest0-21swapper/512:05:145
2964699137,5cyclictest0-21swapper/511:28:575
2964699132,5cyclictest0-21swapper/508:25:215
2964699132,5cyclictest0-21swapper/507:17:015
2964699132,0cyclictest0-21swapper/507:31:395
29646991312,1cyclictest57-21ksoftirqd/511:43:195
29646991312,1cyclictest1-21systemd09:50:475
29646991311,1cyclictest57-21ksoftirqd/512:32:185
29646991311,1cyclictest57-21ksoftirqd/511:01:145
2964699131,6cyclictest0-21swapper/509:09:495
2964699130,8cyclictest0-21swapper/510:28:295
2964099136,5cyclictest23189-21sshd10:46:594
29640991311,1cyclictest49-21ksoftirqd/411:13:444
29640991311,1cyclictest49-21ksoftirqd/410:06:374
2963699138,3cyclictest41-21ksoftirqd/311:00:213
29636991312,1cyclictest41-21ksoftirqd/311:18:593
29636991311,1cyclictest41-21ksoftirqd/312:21:023
29636991311,1cyclictest41-21ksoftirqd/309:23:363
2962999133,4cyclictest19050-21sshd11:20:272
29629991311,1cyclictest33-21ksoftirqd/212:07:462
2961199138,5cyclictest29941-21kworker/0:107:33:490
2961199138,5cyclictest0-21swapper/008:43:150
2961199138,0cyclictest0-21swapper/007:43:130
14012130,0sleep70-21swapper/712:08:067
7332120,0sleep6732-21systemd-cgroups12:32:246
38152120,2sleep42964099cyclictest12:00:504
37722129,1sleep125-21ksoftirqd/111:17:391
2965899129,2cyclictest29497-21sshd12:22:507
2965899124,5cyclictest17132-21grepconf.sh11:12:487
2965899123,5cyclictest13881-21sshd10:48:217
29658991210,1cyclictest73-21ksoftirqd/711:39:457
29658991210,1cyclictest73-21ksoftirqd/711:18:177
29658991210,1cyclictest73-21ksoftirqd/711:07:147
2965899120,11cyclictest686-21dbus-daemon09:44:047
2965899120,11cyclictest686-21dbus-daemon09:44:047
2965499128,1cyclictest87950irq/25-em1-rx-010:16:086
2965499125,1cyclictest691-21systemd-logind11:04:126
2965499124,5cyclictest17933-21bash09:37:496
2965499122,4cyclictest27346-21sshd09:23:286
2965499122,4cyclictest2016-21sshd11:19:276
2965499122,4cyclictest19614-21sshd10:50:376
2965499122,4cyclictest15262-21grep11:09:016
2965499122,4cyclictest1-21systemd09:57:406
2965499122,4cyclictest0-21swapper/610:18:266
29654991210,1cyclictest65-21ksoftirqd/612:15:336
2965499120,11cyclictest691-21systemd-logind11:42:356
2965499120,11cyclictest686-21dbus-daemon11:12:476
2965499120,11cyclictest25175-21kworker/6:410:27:356
2964699128,0cyclictest0-21swapper/508:37:135
2964699127,5cyclictest0-21swapper/510:12:035
2964699127,5cyclictest0-21swapper/508:58:355
2964699127,5cyclictest0-21swapper/508:53:075
2964699127,5cyclictest0-21swapper/508:46:455
2964699127,5cyclictest0-21swapper/507:47:375
2964699127,5cyclictest0-21swapper/507:47:375
2964699127,0cyclictest0-21swapper/508:27:235
2964699127,0cyclictest0-21swapper/508:07:215
2964699127,0cyclictest0-21swapper/508:04:175
2964699127,0cyclictest0-21swapper/507:40:115
2964699121,5cyclictest0-21swapper/507:52:055
2964699120,5cyclictest0-21swapper/511:25:555
2964099122,4cyclictest19245-21sshd10:03:564
29640991210,1cyclictest718-21avahi-daemon10:41:404
29640991210,1cyclictest49-21ksoftirqd/411:31:374
29640991210,1cyclictest49-21ksoftirqd/410:35:544
29636991211,1cyclictest41-21ksoftirqd/312:16:053
29636991211,1cyclictest41-21ksoftirqd/310:50:493
29636991211,1cyclictest41-21ksoftirqd/309:32:433
29636991211,1cyclictest41-21ksoftirqd/309:15:103
29636991210,1cyclictest41-21ksoftirqd/312:01:593
29636991210,1cyclictest41-21ksoftirqd/311:35:153
29636991210,1cyclictest41-21ksoftirqd/311:09:003
29636991210,1cyclictest41-21ksoftirqd/310:43:583
29636991210,1cyclictest41-21ksoftirqd/310:34:253
29636991210,1cyclictest41-21ksoftirqd/310:05:183
2963699120,11cyclictest1829-21cat09:51:483
2963699120,11cyclictest14258-21sshd09:09:333
2962999122,4cyclictest686-21dbus-daemon12:22:202
2962999122,4cyclictest3643-21grepconf.sh09:23:582
2962999122,4cyclictest0-21swapper/211:50:492
2962999122,4cyclictest0-21swapper/209:29:252
29629991211,1cyclictest33-21ksoftirqd/211:37:252
29629991211,1cyclictest33-21ksoftirqd/211:24:302
29629991211,1cyclictest33-21ksoftirqd/211:13:202
29629991210,1cyclictest33-21ksoftirqd/211:01:382
2962999120,2cyclictest28491-21systemctl10:21:192
2962999120,11cyclictest3772-21kworker/2:309:44:522
2962999120,11cyclictest3772-21kworker/2:309:44:522
2962399122,4cyclictest24727-21sshd11:48:531
2962399122,4cyclictest22359-21systemd11:24:221
29623991210,1cyclictest0-21swapper/110:48:431
2962399121,5cyclictest21920-21cp09:52:551
2962399120,2cyclictest5478-21grepconf.sh10:14:211
2962399120,1cyclictest16751-21sshd11:01:391
215182120,1sleep321519-21bash12:22:203
80382110,0sleep40-21swapper/411:42:164
2965899119,1cyclictest73-21ksoftirqd/710:32:277
2965899119,1cyclictest22438-21iostat_ios11:46:537
2965899113,4cyclictest11404-21sshd11:01:217
2965899112,4cyclictest27801-21sshd12:02:087
2965899112,4cyclictest0-21swapper/710:26:577
2965899112,4cyclictest0-21swapper/709:50:017
2965899110,10cyclictest12470-21sshd10:51:587
2965899110,1cyclictest0-21swapper/710:10:337
2965499119,1cyclictest0-21swapper/610:04:126
2965499114,6cyclictest885-21polkitd09:47:176
2965499112,4cyclictest15481-21sshd12:23:546
29654991110,1cyclictest0-21swapper/611:26:496
2965499111,4cyclictest20571-21systemd11:48:386
2965499111,4cyclictest18586-21systemd-cgroups12:16:386
2965499111,10cyclictest0-21swapper/609:36:226
2965499110,11cyclictest16116-21kworker/6:009:28:346
2965499110,10cyclictest19302-21systemd11:41:106
2965499110,10cyclictest17714-21kworker/6:511:24:176
2964699116,0cyclictest0-21swapper/507:58:135
2964699110,0cyclictest0-21swapper/509:36:455
2964699110,0cyclictest0-21swapper/508:34:575
2964099119,1cyclictest49-21ksoftirqd/410:37:534
2964099119,1cyclictest49-21ksoftirqd/410:37:534
2964099118,3cyclictest49-21ksoftirqd/410:29:514
2964099118,2cyclictest49-21ksoftirqd/410:55:484
2964099118,2cyclictest28836-21sshd11:39:494
2964099113,2cyclictest24717-21grep11:00:134
2964099112,6cyclictest885-21polkitd10:14:284
2964099112,4cyclictest0-21swapper/409:51:524
29640991110,1cyclictest49-21ksoftirqd/412:05:134
29640991110,1cyclictest49-21ksoftirqd/411:51:524
2964099111,4cyclictest8090-21sshd12:17:494
2964099111,4cyclictest22920-21sshd09:38:074
2964099111,4cyclictest0-21swapper/412:07:404
2964099111,4cyclictest0-21swapper/411:06:454
2964099111,4cyclictest0-21swapper/411:04:074
2964099110,1cyclictest0-21swapper/411:50:284
2963699119,1cyclictest41-21ksoftirqd/312:35:133
2963699119,1cyclictest41-21ksoftirqd/311:50:033
2963699119,1cyclictest41-21ksoftirqd/309:37:233
2963699119,1cyclictest1-21systemd09:48:323
2963699118,1cyclictest41-21ksoftirqd/309:45:503
2963699118,1cyclictest41-21ksoftirqd/309:45:503
2963699117,1cyclictest41-21ksoftirqd/309:20:493
29636991110,1cyclictest41-21ksoftirqd/309:58:333
2963699110,1cyclictest0-21swapper/311:51:413
2962999114,4cyclictest8513-21sshd10:36:532
2962999114,4cyclictest8513-21sshd10:36:532
2962999113,7cyclictest686-21dbus-daemon11:42:592
2962999112,4cyclictest30587-21bash11:34:182
2962999112,4cyclictest0-21swapper/209:35:132
2962999111,4cyclictest3705-21bash09:38:542
2962999111,4cyclictest31516-21sshd10:49:242
2962999111,4cyclictest28860-21sshd12:32:092
2962999111,4cyclictest17436-21bash11:09:082
2962999111,4cyclictest14963-21sshd10:11:122
2962999111,4cyclictest0-21swapper/211:31:312
2962999110,11cyclictest9026-21kworker/2:212:26:512
2962999110,10cyclictest5080-21grepconf.sh11:53:202
2962999110,10cyclictest0-21swapper/209:46:572
2962999110,1cyclictest0-21swapper/212:06:282
2962399119,1cyclictest25-21ksoftirqd/111:43:011
2962399118,2cyclictest4308-21systemctl12:04:351
2962399114,6cyclictest20481-21sshd09:15:421
2962399113,5cyclictest29955-21grepconf.sh11:32:201
2962399112,3cyclictest0-21swapper/109:08:061
29623991110,1cyclictest25-21ksoftirqd/109:23:181
2962399111,4cyclictest17926-21sshd11:37:151
2962399110,5cyclictest8074-21systemd12:32:501
2962399110,5cyclictest12631-21grep12:12:281
2962399110,10cyclictest6700-21kworker/1:411:52:101
2962399110,10cyclictest5621-21kworker/1:210:46:211
2962399110,10cyclictest29471-21grepconf.sh11:11:441
2962399110,10cyclictest21519-21sshd09:56:421
2962399110,10cyclictest20331-21kworker/1:110:18:021
2962399110,10cyclictest14578-21kworker/1:011:27:441
105842110,0sleep31-21systemd10:29:353
2965899108,1cyclictest73-21ksoftirqd/711:59:027
2965899108,1cyclictest73-21ksoftirqd/708:31:357
2965899102,5cyclictest10390-21bash11:53:397
2965899102,4cyclictest10191-21bash09:56:037
2965899102,4cyclictest1-21systemd09:07:347
2965899102,3cyclictest0-21swapper/712:20:457
2965899100,6cyclictest20022-21systemd11:01:507
2965899100,5cyclictest686-21dbus-daemon10:46:137
2965499107,2cyclictest8220-21rm10:36:526
2965499107,2cyclictest8220-21rm10:36:526
2965499103,4cyclictest7922-21bash12:06:426
2965499103,3cyclictest686-21dbus-daemon09:07:046
2965499100,9cyclictest15929-21kworker/6:211:58:206
2965499100,8cyclictest0-21swapper/612:26:576
2965499100,4cyclictest25768-21sshd11:32:056
2965499100,10cyclictest2258-21kworker/6:309:11:526
2965499100,10cyclictest0-21swapper/607:51:376
2964099109,1cyclictest0-21swapper/407:51:474
2964099108,1cyclictest49-21ksoftirqd/409:11:594
2964099106,1cyclictest49-21ksoftirqd/409:18:114
2964099102,5cyclictest30347-21sshd11:22:564
2964099101,4cyclictest0-21swapper/410:19:414
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional