You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 07:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Mar 28, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138402860,0sleep70-21swapper/722:21:387
267392820,0sleep60-21swapper/622:48:286
197422720,0sleep30-21swapper/322:18:133
320562520,0sleep50-21swapper/523:57:305
84832490,0sleep20-21swapper/222:02:432
84832490,0sleep20-21swapper/222:02:432
210524925,9sleep50-21swapper/519:02:215
207092490,0sleep30-21swapper/323:41:593
81032470,1sleep6258299cyclictest23:33:536
44322470,0sleep30-21swapper/300:21:553
211972470,0sleep40-21swapper/421:26:254
218024523,8sleep40-21swapper/419:03:164
11592440,0sleep00-21swapper/023:31:390
109732440,0sleep30-21swapper/300:35:253
83062430,1sleep18300-21sshd21:55:211
3231224331,8sleep30-21swapper/319:01:393
322602430,0sleep20-21swapper/221:34:242
318152430,0sleep30-21swapper/323:29:413
269422430,0sleep70-21swapper/722:13:057
280202420,0sleep60-21swapper/600:15:586
268272420,1sleep6631rcuc/600:32:316
18262420,0sleep50-21swapper/522:39:385
63042410,0sleep60-21swapper/623:39:216
293622410,0sleep10-21swapper/122:22:281
161724127,9sleep60-21swapper/619:01:506
30082400,0sleep00-21swapper/023:11:200
238424028,9sleep70-21swapper/719:06:077
222822400,0sleep60-21swapper/622:20:176
260102390,0sleep60-21swapper/623:16:236
227223927,8sleep00-21swapper/019:04:320
213423928,8sleep20-21swapper/219:02:422
213323926,9sleep10-21swapper/119:02:411
204402390,0sleep00-21swapper/023:14:090
13792390,0sleep50-21swapper/521:23:215
114492390,0sleep30-21swapper/322:01:083
114492390,0sleep30-21swapper/322:01:083
293922380,0sleep30-21swapper/323:18:203
172582380,0sleep60-21swapper/622:57:096
172582380,0sleep60-21swapper/622:57:096
67102370,0sleep40-21swapper/400:16:364
66432370,0sleep10-21swapper/100:20:171
211832370,2sleep5257699cyclictest21:35:395
5022360,0sleep50-21swapper/523:48:175
5022360,0sleep50-21swapper/523:48:175
43932360,0sleep70-21swapper/700:18:157
119342360,0sleep10-21swapper/122:40:141
256599259,1cyclictest49-21ksoftirqd/421:53:384
2565992510,2cyclictest49-21ksoftirqd/422:22:064
254299259,1cyclictest25-21ksoftirqd/100:30:031
256599249,1cyclictest49-21ksoftirqd/400:15:194
2565992410,2cyclictest49-21ksoftirqd/423:41:154
256599238,1cyclictest49-21ksoftirqd/422:02:004
256599238,1cyclictest49-21ksoftirqd/422:02:004
256599237,1cyclictest49-21ksoftirqd/421:56:364
256599237,1cyclictest49-21ksoftirqd/421:56:364
2565992311,3cyclictest49-21ksoftirqd/423:12:394
2565992310,3cyclictest49-21ksoftirqd/400:09:524
254299237,1cyclictest25-21ksoftirqd/123:08:481
256599228,3cyclictest49-21ksoftirqd/423:18:264
256599228,3cyclictest49-21ksoftirqd/421:32:304
256599228,1cyclictest49-21ksoftirqd/421:16:274
256599228,1cyclictest49-21ksoftirqd/421:16:274
256599227,3cyclictest49-21ksoftirqd/422:35:174
256599226,3cyclictest49-21ksoftirqd/422:16:444
256599226,3cyclictest49-21ksoftirqd/422:14:514
2565992215,4cyclictest49-21ksoftirqd/421:45:244
2565992211,1cyclictest49-21ksoftirqd/400:24:464
2565992210,3cyclictest49-21ksoftirqd/423:06:424
254299226,4cyclictest25-21ksoftirqd/123:50:391
254299226,4cyclictest25-21ksoftirqd/123:50:391
324972210,1sleep732500-21kworker/u16:222:09:447
324972210,1sleep732500-21kworker/u16:222:09:447
314352210,2sleep6258299cyclictest21:17:386
314352210,2sleep6258299cyclictest21:17:386
256599218,1cyclictest49-21ksoftirqd/423:52:234
256599217,3cyclictest49-21ksoftirqd/400:31:514
256599216,2cyclictest49-21ksoftirqd/400:29:114
2565992117,1cyclictest49-21ksoftirqd/422:42:564
2565992110,3cyclictest49-21ksoftirqd/421:10:054
2542992117,1cyclictest25-21ksoftirqd/121:31:531
2542992110,2cyclictest25-21ksoftirqd/122:12:061
256599209,3cyclictest49-21ksoftirqd/400:01:344
256599206,3cyclictest49-21ksoftirqd/423:57:144
256599206,1cyclictest49-21ksoftirqd/423:30:484
256599206,1cyclictest49-21ksoftirqd/423:00:544
256599206,1cyclictest49-21ksoftirqd/423:00:544
256599206,1cyclictest49-21ksoftirqd/422:30:324
256599205,3cyclictest49-21ksoftirqd/423:46:454
256599205,3cyclictest49-21ksoftirqd/423:46:454
256599204,3cyclictest49-21ksoftirqd/423:04:214
2565992016,3cyclictest49-21ksoftirqd/423:23:144
2565992016,1cyclictest49-21ksoftirqd/421:51:264
2565992016,1cyclictest49-21ksoftirqd/421:38:034
2565992010,1cyclictest49-21ksoftirqd/422:47:174
2557992015,2cyclictest41-21ksoftirqd/322:48:343
254299208,3cyclictest25-21ksoftirqd/121:20:561
254299208,3cyclictest25-21ksoftirqd/121:20:561
254299207,3cyclictest25-21ksoftirqd/100:04:081
2542992018,2cyclictest25-21ksoftirqd/100:10:181
2542992017,2cyclictest25-21ksoftirqd/121:27:241
2542992016,4cyclictest25-21ksoftirqd/121:39:171
2542992016,1cyclictest25-21ksoftirqd/100:22:311
2542992015,4cyclictest25-21ksoftirqd/121:59:581
2542992015,4cyclictest25-21ksoftirqd/121:59:581
256599194,3cyclictest49-21ksoftirqd/422:09:584
256599194,3cyclictest49-21ksoftirqd/422:09:584
256599194,3cyclictest49-21ksoftirqd/421:30:524
256599193,2cyclictest49-21ksoftirqd/422:41:244
2565991915,3cyclictest49-21ksoftirqd/423:46:094
2542991915,1cyclictest25-21ksoftirqd/122:02:401
2542991915,1cyclictest25-21ksoftirqd/122:02:401
2542991914,2cyclictest25-21ksoftirqd/122:47:551
2542991914,2cyclictest25-21ksoftirqd/122:33:241
256599187,3cyclictest49-21ksoftirqd/422:53:374
256599182,3cyclictest49-21ksoftirqd/423:34:254
2565991814,3cyclictest49-21ksoftirqd/421:11:434
2557991817,1cyclictest41-21ksoftirqd/322:25:183
254299188,2cyclictest25-21ksoftirqd/122:41:471
2542991817,1cyclictest25-21ksoftirqd/121:11:391
2542991816,1cyclictest25-21ksoftirqd/122:30:031
2542991815,3cyclictest25-21ksoftirqd/122:16:431
2542991815,2cyclictest25-21ksoftirqd/123:02:521
2542991814,3cyclictest25-21ksoftirqd/123:20:021
2542991814,3cyclictest25-21ksoftirqd/121:43:441
2542991814,1cyclictest121rcu_preempt21:10:271
2542991813,3cyclictest25-21ksoftirqd/100:32:041
2542991813,2cyclictest25-21ksoftirqd/123:27:501
163582180,2sleep3255799cyclictest22:27:183
797-21170,12sshd87950irq/25-em1-rx-023:26:476
274892170,0sleep60-21swapper/623:25:446
2557991713,3cyclictest41-21ksoftirqd/321:32:363
2557991713,1cyclictest41-21ksoftirqd/323:26:193
2549991715,1cyclictest22695-21sshd21:15:212
2542991715,1cyclictest25-21ksoftirqd/123:37:461
2542991715,1cyclictest25-21ksoftirqd/123:25:351
2542991715,1cyclictest25-21ksoftirqd/123:00:291
2542991715,1cyclictest25-21ksoftirqd/123:00:291
2542991715,1cyclictest25-21ksoftirqd/100:11:361
2542991714,1cyclictest25-21ksoftirqd/121:48:441
2542991713,3cyclictest25-21ksoftirqd/123:58:141
2542991712,4cyclictest25-21ksoftirqd/121:22:211
2542991712,3cyclictest25-21ksoftirqd/122:06:271
2542991712,3cyclictest25-21ksoftirqd/122:06:271
254299171,1cyclictest121rcu_preempt23:44:481
253499170,10cyclictest0-21swapper/020:11:550
173012170,0sleep60-21swapper/621:53:586
259099160,16cyclictest0-21swapper/723:56:227
2557991615,1cyclictest41-21ksoftirqd/323:47:303
2557991615,1cyclictest41-21ksoftirqd/323:47:303
2557991615,1cyclictest41-21ksoftirqd/323:16:123
2557991615,1cyclictest41-21ksoftirqd/321:26:503
2557991615,1cyclictest41-21ksoftirqd/300:28:193
2557991614,1cyclictest41-21ksoftirqd/323:04:323
2557991614,1cyclictest41-21ksoftirqd/321:49:173
2557991614,1cyclictest41-21ksoftirqd/321:19:013
2557991614,1cyclictest41-21ksoftirqd/321:19:013
254299165,2cyclictest25-21ksoftirqd/122:51:281
2542991615,1cyclictest25-21ksoftirqd/123:52:071
2542991615,1cyclictest25-21ksoftirqd/123:32:031
2542991614,1cyclictest25-21ksoftirqd/123:13:501
2534991610,2cyclictest0-21swapper/019:10:270
2582991513,1cyclictest65-21ksoftirqd/622:30:066
257699158,6cyclictest1565-21sshd00:06:545
2565991515,0cyclictest7784-21kworker/4:120:02:194
2565991514,1cyclictest7784-21kworker/4:120:47:434
2557991514,1cyclictest41-21ksoftirqd/322:52:363
2557991514,1cyclictest41-21ksoftirqd/322:07:103
2557991514,1cyclictest41-21ksoftirqd/322:07:103
2557991513,1cyclictest41-21ksoftirqd/323:53:253
2557991513,1cyclictest41-21ksoftirqd/323:34:403
2557991513,1cyclictest41-21ksoftirqd/322:59:423
2557991513,1cyclictest41-21ksoftirqd/322:59:423
2557991513,1cyclictest41-21ksoftirqd/322:44:523
2557991513,1cyclictest41-21ksoftirqd/321:56:073
2557991513,1cyclictest41-21ksoftirqd/321:41:143
2557991513,1cyclictest41-21ksoftirqd/321:08:353
2557991513,1cyclictest41-21ksoftirqd/300:04:203
2557991512,1cyclictest41-21ksoftirqd/321:11:533
253499155,3cyclictest0-21swapper/020:51:090
253499155,3cyclictest0-21swapper/019:56:530
253499153,9cyclictest0-21swapper/019:50:210
2534991513,1cyclictest9-21ksoftirqd/000:28:520
229122150,0sleep70-21swapper/700:11:507
61852140,0sleep50-21swapper/522:04:305
61852140,0sleep50-21swapper/522:04:305
2582991414,0cyclictest0-21swapper/621:34:006
2582991412,1cyclictest65-21ksoftirqd/623:02:546
2576991414,0cyclictest0-21swapper/523:20:235
2557991413,1cyclictest41-21ksoftirqd/322:14:583
2557991413,1cyclictest41-21ksoftirqd/300:11:393
2557991412,1cyclictest41-21ksoftirqd/323:56:473
2557991412,1cyclictest41-21ksoftirqd/323:38:373
2557991412,1cyclictest41-21ksoftirqd/323:07:523
2557991412,1cyclictest41-21ksoftirqd/322:39:163
2557991412,1cyclictest41-21ksoftirqd/322:31:313
2557991412,1cyclictest41-21ksoftirqd/322:02:173
2557991412,1cyclictest41-21ksoftirqd/322:02:173
2557991412,1cyclictest41-21ksoftirqd/321:42:143
2557991412,1cyclictest41-21ksoftirqd/321:21:473
2557991412,1cyclictest41-21ksoftirqd/300:17:543
2557991412,1cyclictest41-21ksoftirqd/300:06:283
2549991412,1cyclictest33-21ksoftirqd/223:25:492
2549991412,1cyclictest33-21ksoftirqd/200:07:012
2549991410,3cyclictest33-21ksoftirqd/222:56:592
2549991410,3cyclictest33-21ksoftirqd/222:56:592
253499149,4cyclictest17717-21fschecks_time22:51:400
253499148,5cyclictest492-21systemd-journal23:38:200
156872140,0sleep7686-21dbus-daemon23:13:527
2631321310,1sleep665-21ksoftirqd/622:22:186
259099132,5cyclictest18528-21sshd23:40:057
259099132,5cyclictest17013-21bash22:40:327
2590991311,1cyclictest73-21ksoftirqd/721:27:267
257699136,6cyclictest57-21ksoftirqd/522:23:425
257699133,4cyclictest5813-21sshd21:47:415
257699131,4cyclictest30104-21systemd-cgroups00:27:085
2565991313,0cyclictest7784-21kworker/4:119:15:514
2549991312,1cyclictest33-21ksoftirqd/223:05:142
2549991311,1cyclictest33-21ksoftirqd/222:37:162
2549991311,1cyclictest33-21ksoftirqd/222:21:382
254999131,11cyclictest30693-21grep22:50:362
253499139,1cyclictest9-21ksoftirqd/023:21:140
253499138,5cyclictest32338-21bash21:38:050
253499138,1cyclictest28851-21kworker/0:022:19:380
253499136,6cyclictest24913-21systemd23:44:080
253499133,10cyclictest0-21swapper/021:30:010
253499133,1cyclictest25755-21kworker/0:422:11:550
2534991312,1cyclictest9-21ksoftirqd/000:08:240
253499130,10cyclictest0-21swapper/020:32:390
91732120,0sleep665-21ksoftirqd/621:31:156
83562120,0sleep58353-21sshd21:46:045
259099122,5cyclictest4425-21sd-pam22:28:317
259099122,4cyclictest5615-21sshd23:26:217
259099122,4cyclictest26437-21sshd22:48:277
259099122,4cyclictest14410-21sd-pam23:17:287
2590991210,1cyclictest686-21dbus-daemon21:52:067
2590991210,1cyclictest24713-21sshd21:58:067
2590991210,1cyclictest24713-21sshd21:58:067
259099120,2cyclictest31514-21grepconf.sh21:13:577
259099120,12cyclictest0-21swapper/721:45:377
259099120,11cyclictest27619-21kworker/7:023:47:247
259099120,11cyclictest27619-21kworker/7:023:47:247
259099120,11cyclictest27541-21kworker/7:200:36:257
259099120,11cyclictest12380-21kworker/7:422:55:027
259099120,11cyclictest0-21swapper/722:16:427
258299122,4cyclictest885-21polkitd22:01:596
258299122,4cyclictest885-21polkitd22:01:596
258299122,4cyclictest4575-21sshd21:56:556
258299122,4cyclictest4575-21sshd21:56:556
258299122,4cyclictest18325-21sshd00:07:546
2582991212,0cyclictest0-21swapper/623:56:226
2582991210,1cyclictest65-21ksoftirqd/623:16:496
258299120,12cyclictest13258-21kworker/6:522:11:066
258299120,12cyclictest13258-21kworker/6:522:11:066
258299120,11cyclictest2405-21rm22:52:366
257699126,2cyclictest26657-21systemd-cgroups00:36:205
257699124,4cyclictest686-21dbus-daemon21:06:455
257699122,4cyclictest686-21dbus-daemon23:36:575
257699122,4cyclictest686-21dbus-daemon23:09:165
257699122,4cyclictest15792-21sshd21:37:065
257699122,4cyclictest15216-21sshd00:05:565
257699122,4cyclictest14578-21sd-pam21:20:275
257699122,4cyclictest14578-21sd-pam21:20:275
257699122,4cyclictest0-21swapper/523:00:335
257699122,4cyclictest0-21swapper/523:00:335
257699121,5cyclictest0-21swapper/523:33:055
257699120,11cyclictest21687-21bash23:23:285
257699120,11cyclictest16067-21kworker/5:023:55:575
2565991212,0cyclictest7784-21kworker/4:119:31:374
2565991212,0cyclictest7784-21kworker/4:119:29:534
2565991211,1cyclictest7784-21kworker/4:120:52:454
2565991210,1cyclictest49-21ksoftirqd/419:46:264
254999129,2cyclictest33-21ksoftirqd/200:21:392
254999129,1cyclictest13550irq/24-ahci[00021:06:422
254999125,4cyclictest23787-21sshd22:14:482
254999122,4cyclictest403-21sshd23:29:452
2549991210,1cyclictest33-21ksoftirqd/200:12:282
2549991210,1cyclictest1-21systemd22:54:572
254999121,5cyclictest18435-21bash21:54:022
2542991211,1cyclictest14702-21kworker/1:219:32:561
253499128,3cyclictest1-21systemd21:17:370
253499128,3cyclictest1-21systemd21:17:370
253499127,4cyclictest492-21systemd-journal22:43:400
253499126,3cyclictest4622-21grepconf.sh22:50:580
253499125,4cyclictest0-21swapper/021:06:210
253499125,4cyclictest0-21swapper/020:54:470
253499125,4cyclictest0-21swapper/020:29:570
253499125,4cyclictest0-21swapper/019:55:190
253499125,4cyclictest0-21swapper/019:40:450
253499125,4cyclictest0-21swapper/019:17:230
253499125,4cyclictest0-21swapper/019:15:210
253499123,6cyclictest0-21swapper/019:32:510
253499123,5cyclictest5095-21grepconf.sh23:54:090
253499123,5cyclictest0-21swapper/000:00:140
2534991211,1cyclictest9-21ksoftirqd/023:01:380
2534991210,1cyclictest9-21ksoftirqd/022:35:300
2534991210,1cyclictest9-21ksoftirqd/021:47:300
2534991210,1cyclictest9-21ksoftirqd/000:23:380
253499120,9cyclictest0-21swapper/020:17:250
253499120,9cyclictest0-21swapper/019:45:490
253499120,5cyclictest0-21swapper/021:13:310
253499120,11cyclictest8162-21bash22:06:300
253499120,11cyclictest8162-21bash22:06:300
253499120,11cyclictest0-21swapper/023:26:450
315522110,2sleep2254999cyclictest21:28:472
291022110,1sleep729073-21sshd22:33:397
259099113,7cyclictest31103-21bash23:07:167
259099112,4cyclictest887-21gdbus21:47:427
259099110,5cyclictest24883-21grep23:32:577
259099110,11cyclictest7431-21kworker/7:321:10:587
259099110,11cyclictest10115-21kworker/7:123:01:457
259099110,10cyclictest18224-21sshd00:28:207
258299119,1cyclictest784-21runrttasks00:22:536
258299112,4cyclictest20029-21sshd21:09:286
258299111,4cyclictest26691-21sshd21:11:486
258299111,4cyclictest15218-21sshd21:24:106
258299110,11cyclictest25686-21kworker/6:323:57:596
258299110,11cyclictest22897-21kworker/6:022:35:396
258299110,1cyclictest0-21swapper/623:43:476
257699119,1cyclictest57-21ksoftirqd/522:41:385
257699119,1cyclictest57-21ksoftirqd/521:28:385
257699119,1cyclictest2372-21systemd23:01:525
257699113,7cyclictest718-21avahi-daemon23:13:055
257699112,4cyclictest0-21swapper/522:32:545
257699111,4cyclictest686-21dbus-daemon00:12:455
257699111,4cyclictest31048-21perl00:21:405
257699111,4cyclictest15173-21systemd21:14:545
257699110,11cyclictest22100-21kworker/5:022:15:275
257699110,10cyclictest18978-21kworker/5:422:19:015
257699110,1cyclictest0-21swapper/522:30:585
2565991111,0cyclictest7784-21kworker/4:120:01:054
2565991111,0cyclictest7784-21kworker/4:119:19:194
2565991110,1cyclictest7784-21kworker/4:120:28:394
254999119,1cyclictest33-21ksoftirqd/223:51:262
254999119,1cyclictest33-21ksoftirqd/223:51:262
254999119,1cyclictest33-21ksoftirqd/221:37:382
254999119,1cyclictest33-21ksoftirqd/200:29:132
254999116,1cyclictest33-21ksoftirqd/222:18:472
254999112,4cyclictest31530-21sshd21:56:402
254999112,4cyclictest31530-21sshd21:56:402
254999112,4cyclictest0-21swapper/223:14:452
2549991110,1cyclictest33-21ksoftirqd/223:32:042
2549991110,1cyclictest33-21ksoftirqd/221:23:422
2549991110,1cyclictest0-21swapper/221:46:582
254999111,5cyclictest23953-21kworker/u16:122:32:432
254999110,5cyclictest686-21dbus-daemon00:02:332
254999110,5cyclictest1597-21sd-pam22:45:132
254999110,11cyclictest0-21swapper/223:56:522
254999110,1cyclictest0-21swapper/223:17:182
254999110,1cyclictest0-21swapper/200:34:522
2542991110,1cyclictest21310-21kworker/1:121:01:301
2542991110,1cyclictest14702-21kworker/1:219:22:521
253499119,1cyclictest9-21ksoftirqd/022:39:440
253499119,1cyclictest9-21ksoftirqd/021:32:430
253499119,1cyclictest9-21ksoftirqd/000:32:570
253499118,2cyclictest30168-21sshd00:03:000
253499116,5cyclictest15605-21kworker/u16:023:23:140
253499115,0cyclictest0-21swapper/020:37:310
253499114,4cyclictest0-21swapper/020:02:410
253499114,4cyclictest0-21swapper/019:26:170
253499113,4cyclictest11200-21bash21:59:130
253499113,4cyclictest11200-21bash21:59:130
253499112,9cyclictest0-21swapper/019:28:090
253499111,10cyclictest0-21swapper/022:02:370
253499111,10cyclictest0-21swapper/022:02:370
253499111,10cyclictest0-21swapper/000:17:520
253499110,11cyclictest2220-21kworker/0:122:59:450
253499110,11cyclictest2220-21kworker/0:122:59:450
253499110,1cyclictest10747-21sshd22:21:290
253499110,1cyclictest0-21swapper/020:56:270
226732110,0sleep20-21swapper/223:42:062
178502110,0sleep2321ktimersoftd/222:29:182
128882110,0sleep60-21swapper/621:40:446
259099109,1cyclictest0-21swapper/721:39:117
259099104,3cyclictest686-21dbus-daemon23:57:037
259099104,2cyclictest9447-21awk22:56:437
259099104,2cyclictest9447-21awk22:56:437
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional