You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 17:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun May 31, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2342421070,0sleep5551rcuc/512:35:005
292652760,2sleep0101ktimersoftd/010:36:010
39132600,1sleep341-21ksoftirqd/310:58:473
244225644,9sleep70-21swapper/707:06:047
70302540,1sleep315-21kswork09:53:433
290082540,2sleep0277899cyclictest11:50:340
290082540,2sleep0277899cyclictest11:50:340
205922520,2sleep7281699cyclictest09:19:037
76262510,1sleep11-21systemd10:29:051
47682510,0sleep70-21swapper/709:38:417
242125038,8sleep40-21swapper/407:05:454
260862490,0sleep00-21swapper/012:03:310
141262490,0sleep10-21swapper/111:19:511
165432480,0sleep5551rcuc/511:27:325
24082460,0sleep60-21swapper/608:03:436
229424634,9sleep30-21swapper/307:04:003
45842450,0sleep5561ktimersoftd/510:49:285
291862450,0sleep3391rcuc/309:25:083
283212450,0sleep00-21swapper/009:25:050
26692450,0sleep30-21swapper/312:28:173
243352450,0sleep30-21swapper/311:07:283
123712450,0sleep50-21swapper/512:23:155
57902440,0sleep60-21swapper/611:15:406
121292440,1sleep5758-21runrttasks11:04:495
287322430,1sleep12771-21cyclictest10:22:571
258324322,7sleep60-21swapper/607:07:556
249022430,2sleep2278299cyclictest11:18:402
172232430,0sleep20-21swapper/209:09:052
143182430,0sleep30-21swapper/312:38:183
254224230,9sleep00-21swapper/007:07:250
233042420,1sleep023307-21bash11:53:540
210112420,0sleep70-21swapper/711:35:117
138122420,0sleep20-21swapper/211:44:032
120912420,0sleep70-21swapper/711:40:167
98082410,0sleep10-21swapper/112:36:081
45352410,0sleep10-21swapper/110:08:311
138312410,1sleep413835-21grep09:46:394
65192400,2sleep6280999cyclictest11:19:246
260424028,9sleep50-21swapper/507:08:105
230124025,11sleep10-21swapper/107:04:061
227812400,0sleep70-21swapper/712:16:207
166622400,0sleep20-21swapper/209:56:072
297202390,0sleep50-21swapper/509:17:495
292602390,0sleep20-21swapper/210:37:552
254562390,0sleep30-21swapper/309:51:033
236023928,8sleep20-21swapper/207:04:552
298792380,0sleep60-21swapper/611:41:196
56112370,0sleep00-21swapper/009:53:400
240892370,0sleep10-21swapper/111:46:341
105792360,0sleep10-21swapper/110:08:471
106862340,2sleep4280099cyclictest11:47:414
280399232,6cyclictest31899-21sshd10:17:325
280099227,1cyclictest49-21ksoftirqd/412:23:074
280099224,4cyclictest49-21ksoftirqd/410:20:384
280399212,4cyclictest30297-21sshd09:23:255
280099215,1cyclictest49-21ksoftirqd/409:38:204
280099215,1cyclictest49-21ksoftirqd/409:24:594
280099214,3cyclictest49-21ksoftirqd/411:58:144
280099214,1cyclictest49-21ksoftirqd/412:00:364
2800992111,1cyclictest49-21ksoftirqd/409:30:394
2800992111,1cyclictest49-21ksoftirqd/409:30:394
2800992110,1cyclictest49-21ksoftirqd/411:23:394
280399204,5cyclictest11758-21sshd09:44:375
280399203,6cyclictest721-21dbus-daemon11:14:495
280399203,5cyclictest9578-21bash09:23:585
280399203,5cyclictest4286-21cp10:21:305
280399202,4cyclictest0-21swapper/512:26:525
280399201,3cyclictest5153-21systemd-cgroups10:58:505
280099207,3cyclictest49-21ksoftirqd/410:51:024
280099206,3cyclictest49-21ksoftirqd/410:58:414
280099206,2cyclictest49-21ksoftirqd/411:10:254
280099206,2cyclictest49-21ksoftirqd/411:10:254
280099204,3cyclictest49-21ksoftirqd/411:08:064
280099203,3cyclictest49-21ksoftirqd/412:08:374
278299204,9cyclictest6264-21bash11:28:462
280399194,5cyclictest23678-21grepconf.sh11:20:265
280399193,6cyclictest9688-21rm10:25:305
280399193,5cyclictest22539-21sshd11:12:575
280399193,5cyclictest22539-21sshd11:12:575
280399193,5cyclictest21228-21sshd10:11:185
280399193,5cyclictest18484-21grep10:29:445
280399193,5cyclictest13712-21grep12:28:495
280399193,4cyclictest2949-21systemd11:39:435
280399193,2cyclictest27702-21sshd10:07:595
280399192,6cyclictest22436-21sshd11:29:405
280399192,5cyclictest32751-21sshd09:42:105
280399192,3cyclictest721-21dbus-daemon10:34:015
280099199,4cyclictest49-21ksoftirqd/411:48:564
280099199,4cyclictest49-21ksoftirqd/411:48:564
280099197,1cyclictest49-21ksoftirqd/410:28:424
280099196,1cyclictest49-21ksoftirqd/409:48:584
280099195,3cyclictest49-21ksoftirqd/409:42:564
280099195,1cyclictest49-21ksoftirqd/410:34:144
280099194,3cyclictest49-21ksoftirqd/412:33:584
280099194,1cyclictest49-21ksoftirqd/410:40:504
2800991915,1cyclictest49-21ksoftirqd/412:04:434
2782991910,6cyclictest859-21gdbus12:01:492
2816991816,1cyclictest73-21ksoftirqd/710:42:307
2816991814,3cyclictest73-21ksoftirqd/710:34:017
280399184,5cyclictest7015-21sshd09:33:145
280399184,5cyclictest7015-21sshd09:33:145
280399184,4cyclictest4439-21bash10:42:035
280399183,6cyclictest721-21dbus-daemon09:55:115
280399183,5cyclictest721-21dbus-daemon09:10:555
280399183,5cyclictest23750-21grepconf.sh11:44:385
280399183,5cyclictest17046-21bash09:52:275
280399182,3cyclictest2169-21sshd10:43:465
280399182,3cyclictest1-21systemd12:03:545
280399182,2cyclictest10504-21grepconf.sh12:11:545
280399182,2cyclictest1-21systemd11:51:335
280399182,2cyclictest1-21systemd11:51:335
280099187,3cyclictest49-21ksoftirqd/411:17:044
280099186,1cyclictest49-21ksoftirqd/410:00:524
280099184,1cyclictest49-21ksoftirqd/411:30:424
280099184,1cyclictest49-21ksoftirqd/410:11:144
280099183,3cyclictest49-21ksoftirqd/410:03:564
280099183,3cyclictest49-21ksoftirqd/409:17:504
280099183,1cyclictest49-21ksoftirqd/411:43:004
2800991815,1cyclictest49-21ksoftirqd/412:30:384
278299180,2cyclictest24326-21sshd10:28:182
140702180,0sleep10-21swapper/112:32:401
2816991715,1cyclictest73-21ksoftirqd/712:08:527
280399173,6cyclictest23571-21bash10:56:125
280399173,5cyclictest669-21avahi-daemon12:16:155
280399172,7cyclictest1805-21sshd09:38:315
280399172,6cyclictest32110-21sshd11:35:505
280399172,4cyclictest31418-21nfsd409:58:485
280399171,4cyclictest0-21swapper/511:54:145
280399171,3cyclictest1016-21sshd12:00:085
280099177,1cyclictest49-21ksoftirqd/410:23:544
280099175,1cyclictest49-21ksoftirqd/409:08:444
280099174,2cyclictest49-21ksoftirqd/411:22:004
2800991715,1cyclictest49-21ksoftirqd/412:25:374
2800991714,2cyclictest49-21ksoftirqd/410:44:044
280099171,1cyclictest49-21ksoftirqd/409:53:594
280099170,3cyclictest49-21ksoftirqd/411:33:504
280099170,1cyclictest131rcu_sched09:22:164
280099170,1cyclictest0-21swapper/412:14:284
2816991614,1cyclictest73-21ksoftirqd/709:58:577
281699160,15cyclictest19476-21kworker/7:311:27:207
280099167,3cyclictest49-21ksoftirqd/410:13:474
280099160,2cyclictest131rcu_sched10:55:134
142702160,1sleep114269-21grep10:38:501
132272160,0sleep2321ktimersoftd/209:37:162
42842150,1sleep64208-21sshd10:06:366
283052150,0sleep20-21swapper/212:37:132
281699158,4cyclictest73-21ksoftirqd/711:08:427
281699158,4cyclictest73-21ksoftirqd/711:08:427
2816991514,1cyclictest73-21ksoftirqd/711:02:407
2816991514,1cyclictest73-21ksoftirqd/710:08:557
2816991513,1cyclictest73-21ksoftirqd/712:00:507
2816991513,1cyclictest73-21ksoftirqd/711:45:317
2816991513,1cyclictest73-21ksoftirqd/711:20:427
2816991513,1cyclictest73-21ksoftirqd/710:44:397
2816991513,1cyclictest73-21ksoftirqd/710:32:207
2794991513,1cyclictest0-21swapper/310:42:503
269242150,0sleep30-21swapper/309:09:463
151482150,0sleep6631rcuc/609:50:266
296022140,0sleep00-21swapper/011:20:460
289852140,2sleep0277899cyclictest09:23:210
281699148,3cyclictest73-21ksoftirqd/709:45:287
2816991413,1cyclictest73-21ksoftirqd/711:15:557
2816991413,1cyclictest73-21ksoftirqd/710:52:297
2816991413,1cyclictest73-21ksoftirqd/709:54:507
2816991412,1cyclictest73-21ksoftirqd/711:56:287
2816991412,1cyclictest73-21ksoftirqd/711:31:177
2816991412,1cyclictest73-21ksoftirqd/710:21:547
2816991411,3cyclictest73-21ksoftirqd/709:26:237
2816991411,2cyclictest73-21ksoftirqd/709:48:497
281699140,14cyclictest29682-21kworker/7:309:38:257
2800991412,1cyclictest49-21ksoftirqd/409:08:314
2794991412,1cyclictest41-21ksoftirqd/309:37:073
2794991410,1cyclictest41-21ksoftirqd/310:02:243
278299144,7cyclictest15329-21bash09:50:262
2781991412,1cyclictest25-21ksoftirqd/111:49:421
2781991412,1cyclictest25-21ksoftirqd/111:49:421
199872140,1sleep619973-21cp12:04:576
14282140,0sleep31379-21sshd09:42:143
126382140,0sleep10-21swapper/111:12:221
126382140,0sleep10-21swapper/111:12:221
58992130,0sleep10-21swapper/109:53:411
281699139,3cyclictest73-21ksoftirqd/712:35:357
2816991312,1cyclictest73-21ksoftirqd/710:04:577
2816991312,1cyclictest73-21ksoftirqd/709:14:517
2816991311,1cyclictest73-21ksoftirqd/712:18:497
2816991311,1cyclictest73-21ksoftirqd/711:04:497
2816991311,1cyclictest73-21ksoftirqd/710:56:277
2816991311,1cyclictest73-21ksoftirqd/710:23:487
2816991311,1cyclictest73-21ksoftirqd/710:16:527
280999139,3cyclictest65-21ksoftirqd/611:59:356
280999139,3cyclictest65-21ksoftirqd/611:46:096
280999137,3cyclictest65-21ksoftirqd/611:52:206
280999137,3cyclictest65-21ksoftirqd/611:52:206
2809991311,1cyclictest65-21ksoftirqd/612:28:396
2809991311,1cyclictest65-21ksoftirqd/611:25:476
280512130,1sleep2721-21dbus-daemon11:37:302
2800991312,1cyclictest16073-21kworker/4:007:50:464
2800991312,1cyclictest16073-21kworker/4:007:45:244
2800991312,1cyclictest16073-21kworker/4:007:42:064
279499139,3cyclictest41-21ksoftirqd/310:19:183
2794991312,1cyclictest41-21ksoftirqd/311:11:303
2794991312,1cyclictest41-21ksoftirqd/311:11:303
279499130,2cyclictest1-21systemd12:22:303
278299138,2cyclictest0-21swapper/211:07:062
278299135,7cyclictest3446-21grep12:22:432
278299135,7cyclictest18253-21grepconf.sh10:09:122
278299134,8cyclictest22807-21bash09:47:112
278299134,8cyclictest21377-21grepconf.sh11:53:492
278299134,8cyclictest21172-21bash12:25:332
278299134,8cyclictest10956-21bash10:42:272
278299132,1cyclictest0-21swapper/209:32:072
278299132,1cyclictest0-21swapper/209:32:072
2782991310,2cyclictest16403-21grepconf.sh10:53:522
278299130,2cyclictest19424-21cp12:31:042
2781991311,1cyclictest25-21ksoftirqd/109:37:521
278199130,13cyclictest0-21swapper/111:24:331
278199130,12cyclictest25410-21grepconf.sh10:54:241
277899133,4cyclictest709-21systemd-logind12:16:000
277899130,12cyclictest26923-21bash10:39:340
152682130,1sleep01-21systemd11:27:270
2816991210,1cyclictest73-21ksoftirqd/712:29:187
2816991210,1cyclictest73-21ksoftirqd/711:48:437
2816991210,1cyclictest73-21ksoftirqd/711:48:437
2816991210,1cyclictest73-21ksoftirqd/709:29:237
2816991210,1cyclictest73-21ksoftirqd/709:29:237
2816991210,1cyclictest709-21systemd-logind12:05:417
281699120,11cyclictest20033-21kworker/7:312:23:377
280999126,3cyclictest85150irq/25-em1-rx-010:34:306
2809991211,1cyclictest65-21ksoftirqd/611:13:026
2809991211,1cyclictest65-21ksoftirqd/611:13:026
2809991210,1cyclictest65-21ksoftirqd/610:13:386
280999120,11cyclictest23017-21systemd12:27:356
279499125,4cyclictest0-21swapper/310:47:023
2794991210,1cyclictest41-21ksoftirqd/312:05:183
2794991210,1cyclictest41-21ksoftirqd/311:53:433
2794991210,1cyclictest27240-21turbostat12:18:303
278299125,6cyclictest721-21dbus-daemon12:11:322
278299124,7cyclictest29828-21systemd11:52:322
278299124,7cyclictest29828-21systemd11:52:322
278299124,7cyclictest28089-21bash10:22:542
278299124,7cyclictest26921-21sshd12:03:342
278299124,7cyclictest25391-21sshd10:04:002
278299124,7cyclictest24284-21grepconf.sh10:30:042
278299124,7cyclictest22430-21bash11:14:432
278299124,7cyclictest21841-21grep11:11:012
278299124,7cyclictest21841-21grep11:11:012
278299124,7cyclictest20474-21grep10:48:362
278299124,7cyclictest20411-21systemctl09:17:162
278299124,7cyclictest16300-21bash10:59:282
278299124,7cyclictest14723-21grepconf.sh10:14:362
278299124,7cyclictest14581-21bash09:39:102
278299124,2cyclictest32014-21grep12:14:572
278299120,3cyclictest27416-21systemd11:39:142
278299120,2cyclictest5674-21bash11:26:532
278299120,11cyclictest28871-21systemd09:19:332
278299120,11cyclictest2736-21systemd10:45:402
278299120,1cyclictest756-21sshd09:23:452
278199127,5cyclictest25-21ksoftirqd/110:15:451
2781991210,1cyclictest25-21ksoftirqd/111:37:221
2781991210,1cyclictest25-21ksoftirqd/111:17:391
2781991210,1cyclictest25-21ksoftirqd/109:59:341
2781991210,1cyclictest25-21ksoftirqd/109:40:451
2781991210,1cyclictest1-21systemd09:30:411
2781991210,1cyclictest1-21systemd09:30:411
278199120,2cyclictest15154-21bash09:16:581
277832120,0sleep30-21swapper/310:04:083
277899129,2cyclictest9-21ksoftirqd/011:09:410
277899129,2cyclictest9-21ksoftirqd/011:09:410
277899122,4cyclictest730-21NetworkManager12:09:000
277899122,4cyclictest31352-21sshd12:33:390
277899122,4cyclictest0-21swapper/011:36:370
2778991210,1cyclictest9-21ksoftirqd/009:43:470
277899120,5cyclictest16917-21sshd10:16:390
277899120,2cyclictest721-21dbus-daemon11:48:170
277899120,2cyclictest31151-21bash12:07:320
281699110,1cyclictest1-21systemd09:09:467
280999119,1cyclictest65-21ksoftirqd/609:23:536
280999114,4cyclictest28322-21bash10:48:576
280999114,4cyclictest10511-21egrep10:38:426
280999113,5cyclictest17880-21id11:35:006
280999113,4cyclictest24982-21rm12:14:326
280999113,4cyclictest0-21swapper/609:15:346
280999112,5cyclictest857-21polkitd10:28:326
280999112,5cyclictest385-21sshd09:36:326
280999112,5cyclictest11173-21sshd09:53:526
2809991110,1cyclictest65-21ksoftirqd/610:02:016
280999110,10cyclictest3631-21sshd12:37:406
280999110,10cyclictest26225-21sshd11:01:586
280099119,1cyclictest49-21ksoftirqd/407:23:314
2800991110,1cyclictest27292-21kworker/4:108:59:354
2800991110,1cyclictest16073-21kworker/4:008:23:314
2800991110,1cyclictest16073-21kworker/4:008:14:424
2800991110,1cyclictest16073-21kworker/4:007:38:284
279499119,1cyclictest41-21ksoftirqd/310:54:423
279499119,1cyclictest41-21ksoftirqd/310:50:323
279499119,1cyclictest41-21ksoftirqd/309:18:373
279499117,1cyclictest41-21ksoftirqd/312:28:593
279499116,4cyclictest3394-21systemd-cgroups11:24:503
279499111,4cyclictest0-21swapper/309:17:403
279499110,10cyclictest464-21systemd-journal11:28:403
278299112,2cyclictest0-21swapper/208:46:242
278299110,2cyclictest32525-21grepconf.sh09:58:512
278199119,1cyclictest25-21ksoftirqd/112:02:211
278199119,1cyclictest25-21ksoftirqd/110:58:541
278199119,1cyclictest25-21ksoftirqd/109:44:081
278199119,1cyclictest0-21swapper/111:07:381
278199112,5cyclictest11779-21sshd09:24:061
2781991110,1cyclictest25-21ksoftirqd/109:20:581
2781991110,1cyclictest0-21swapper/110:24:261
278199110,11cyclictest0-21swapper/109:10:021
277899119,1cyclictest9-21ksoftirqd/010:59:310
277899119,1cyclictest0-21swapper/010:04:340
277899114,6cyclictest30777-21nscd09:37:000
277899111,4cyclictest15099-21sshd09:59:420
277899111,4cyclictest0-21swapper/011:28:440
277899110,5cyclictest30198-21sshd10:26:430
277899110,5cyclictest27274-21bash10:56:260
277899110,5cyclictest19514-21bash09:50:420
277899110,1cyclictest0-21swapper/011:15:020
272382110,0sleep30-21swapper/309:30:373
272382110,0sleep30-21swapper/309:30:373
260672110,0sleep30-21swapper/312:10:553
247042110,0sleep00-21swapper/011:39:040
206202110,0sleep30-21swapper/312:01:183
280999109,1cyclictest65-21ksoftirqd/610:11:436
280999109,1cyclictest65-21ksoftirqd/609:44:276
280999108,1cyclictest65-21ksoftirqd/612:18:436
280999108,1cyclictest65-21ksoftirqd/610:57:526
280999108,1cyclictest65-21ksoftirqd/610:25:126
280999108,1cyclictest65-21ksoftirqd/610:18:596
280999108,1cyclictest65-21ksoftirqd/609:22:316
280999106,1cyclictest0-21swapper/609:32:596
280999106,1cyclictest0-21swapper/609:32:596
280999105,1cyclictest25593-21sshd10:47:016
280999104,3cyclictest9022-21grep11:28:526
280999104,3cyclictest3356-21sshd09:42:216
280999100,9cyclictest5414-21kworker/6:109:08:386
280999100,4cyclictest12348-21bash11:06:456
280999100,10cyclictest0-21swapper/607:33:526
280399102,5cyclictest5819-21hddtemp_smartct08:08:445
280099109,1cyclictest27292-21kworker/4:108:56:074
280099109,1cyclictest27292-21kworker/4:108:47:274
280099109,1cyclictest16073-21kworker/4:008:00:504
2800991010,0cyclictest16073-21kworker/4:007:29:384
279499108,1cyclictest41-21ksoftirqd/311:44:083
279499103,4cyclictest27114-21sshd10:37:483
279499103,3cyclictest16885-21grepconf.sh09:44:553
279499102,5cyclictest3073-21systemd10:28:513
279499102,4cyclictest5718-21systemd11:34:173
279499100,9cyclictest28729-21kworker/3:110:10:533
278299103,1cyclictest752-21snmpd07:09:292
278299103,1cyclictest0-21swapper/208:55:152
278299102,2cyclictest28434-21idleruntime-cro07:53:312
278299102,1cyclictest16625-21unixbench_singl07:28:522
278199109,1cyclictest25-21ksoftirqd/112:23:521
278199109,1cyclictest25-21ksoftirqd/110:34:341
278199109,1cyclictest0-21swapper/112:11:291
278199108,1cyclictest25-21ksoftirqd/112:05:591
278199108,1cyclictest25-21ksoftirqd/110:51:361
278199104,3cyclictest32653-21sshd09:53:231
278199103,4cyclictest7786-21bash12:17:211
278199103,4cyclictest721-21dbus-daemon10:44:291
278199102,4cyclictest903-21bash12:18:471
277899109,1cyclictest0-21swapper/012:19:020
277899108,1cyclictest9-21ksoftirqd/010:19:180
277899108,1cyclictest9-21ksoftirqd/009:13:310
277899103,1cyclictest709-21systemd-logind11:07:180
277899100,4cyclictest20519-21sshd12:33:020
277899100,4cyclictest1-21systemd10:51:260
277899100,4cyclictest0-21swapper/009:16:530
277899100,10cyclictest17148-21kworker/0:209:32:050
277899100,10cyclictest17148-21kworker/0:209:32:050
28169990,0cyclictest0-21swapper/707:33:467
28099997,1cyclictest65-21ksoftirqd/611:54:016
28099990,9cyclictest6974-21kworker/6:012:08:316
28039994,5cyclictest0-21swapper/507:22:115
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional