You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 03:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Apr 22, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1810621100,0sleep0111rcuc/021:26:020
1250821010,1sleep557-21ksoftirqd/522:17:495
65942790,1sleep76591-21sshd23:44:577
41662730,0sleep30-21swapper/321:58:493
212622700,1sleep557-21ksoftirqd/523:47:355
91902550,1sleep79189-21grepconf.sh23:07:487
327512540,0sleep20-21swapper/221:11:462
298482500,2sleep056499cyclictest21:39:470
25212490,0sleep30-21swapper/322:32:043
238272490,1sleep11-21systemd23:34:421
238272490,1sleep11-21systemd23:34:421
4012480,0sleep40-21swapper/421:54:494
325122480,0sleep70-21swapper/722:00:217
31324825,8sleep30-21swapper/319:08:333
302962480,2sleep358899cyclictest21:54:403
250162480,0sleep40-21swapper/423:01:134
164552480,1sleep01-21systemd21:51:570
3253024725,8sleep40-21swapper/419:05:224
268802470,2sleep157299cyclictest21:13:371
249282460,0sleep30-21swapper/321:20:523
216542460,0sleep70-21swapper/723:12:137
158422460,0sleep30-21swapper/322:12:263
79472450,1sleep47934-21bash22:30:294
247762450,0sleep20-21swapper/223:53:252
152282450,0sleep50-21swapper/523:50:555
10752450,0sleep60-21swapper/622:58:026
205942440,0sleep20-21swapper/223:56:532
69042430,0sleep40-21swapper/423:05:454
228862430,0sleep10-21swapper/121:26:191
223092430,0sleep20-21swapper/200:17:352
132282430,1sleep613225-21systemd22:08:376
3259824230,8sleep50-21swapper/519:06:035
3200824225,12sleep10-21swapper/119:05:191
139762420,0sleep00-21swapper/021:14:490
46742410,0sleep70-21swapper/700:33:267
33424130,8sleep60-21swapper/619:08:526
107862410,1sleep010787-21bash21:57:170
106082410,0sleep40-21swapper/422:00:584
95342400,0sleep10-21swapper/123:50:351
258112400,0sleep30-21swapper/321:17:163
188852400,2sleep762299cyclictest22:14:307
80472390,0sleep00-21swapper/023:31:520
80472390,0sleep00-21swapper/023:31:520
3271123927,8sleep00-21swapper/019:07:340
326992390,0sleep10-21swapper/122:56:051
3268723928,8sleep70-21swapper/719:07:177
3259523928,8sleep20-21swapper/219:06:002
221762390,0sleep70-21swapper/722:18:237
87572380,0sleep10-21swapper/123:46:511
239402380,0sleep50-21swapper/521:33:525
194482380,0sleep00-21swapper/000:17:250
327542360,0sleep30-21swapper/322:24:353
588992513,2cyclictest41-21ksoftirqd/300:24:583
588992414,1cyclictest41-21ksoftirqd/323:20:143
60599223,5cyclictest32244-21grepconf.sh23:10:565
67082210,13sleep685150irq/25-em1-rx-023:28:066
60599210,10cyclictest6048-21grepconf.sh22:52:445
58899217,1cyclictest41-21ksoftirqd/323:31:203
58899217,1cyclictest41-21ksoftirqd/323:31:203
588992111,1cyclictest41-21ksoftirqd/323:15:103
60599200,8cyclictest11606-21grepconf.sh21:51:395
60599200,3cyclictest15672-21grepconf.sh21:38:575
60599200,2cyclictest31215-21grepconf.sh22:46:445
58899207,2cyclictest41-21ksoftirqd/300:04:463
588992013,4cyclictest41-21ksoftirqd/322:07:573
60599190,6cyclictest0-21swapper/522:01:055
58899198,3cyclictest41-21ksoftirqd/321:34:293
60599180,8cyclictest18405-21bash23:38:035
60599180,7cyclictest6103-21bash22:34:115
60599180,3cyclictest25803-21bash22:20:225
60599180,2cyclictest29484-21sshd23:03:255
60599180,11cyclictest10675-21id23:17:115
60599180,1cyclictest23376-21sshd21:11:065
60599180,1cyclictest0-21swapper/521:41:155
60599180,1cyclictest0-21swapper/521:41:155
58899187,1cyclictest41-21ksoftirqd/323:49:023
58899185,1cyclictest41-21ksoftirqd/300:10:143
58899184,3cyclictest41-21ksoftirqd/323:00:183
588991816,1cyclictest41-21ksoftirqd/300:15:193
588991814,4cyclictest41-21ksoftirqd/300:26:523
588991814,1cyclictest41-21ksoftirqd/321:48:593
588991812,3cyclictest41-21ksoftirqd/323:26:033
588991810,1cyclictest41-21ksoftirqd/322:35:163
588991810,1cyclictest41-21ksoftirqd/322:35:163
58899181,2cyclictest41-21ksoftirqd/300:31:563
58899181,1cyclictest121rcu_preempt21:42:243
58899181,1cyclictest121rcu_preempt21:42:243
58899180,2cyclictest0-21swapper/323:52:413
60599172,5cyclictest0-21swapper/522:42:535
60599170,7cyclictest721-21dbus-daemon22:05:345
60599170,2cyclictest25419-21systemd22:25:555
60599170,2cyclictest1-21systemd21:26:315
60599170,2cyclictest1-21systemd00:21:305
60599170,1cyclictest721-21dbus-daemon23:32:035
60599170,1cyclictest721-21dbus-daemon23:32:035
60599170,1cyclictest721-21dbus-daemon00:19:175
58899176,1cyclictest41-21ksoftirqd/322:59:193
58899176,1cyclictest41-21ksoftirqd/322:04:373
58899175,2cyclictest41-21ksoftirqd/323:12:073
58899174,2cyclictest41-21ksoftirqd/323:43:593
588991715,1cyclictest41-21ksoftirqd/323:35:113
588991715,1cyclictest41-21ksoftirqd/321:35:563
588991715,1cyclictest401ktimersoftd/321:26:163
588991714,1cyclictest41-21ksoftirqd/322:28:023
588991713,1cyclictest41-21ksoftirqd/322:41:093
58899171,1cyclictest121rcu_preempt23:05:183
58899170,1cyclictest121rcu_preempt23:56:243
60599160,6cyclictest721-21dbus-daemon00:37:395
60599160,2cyclictest7429-21sshd23:05:475
60599160,2cyclictest7260-21bash21:16:115
60599160,2cyclictest28113-21grep00:30:595
60599160,2cyclictest17055-21grep21:24:125
60599160,2cyclictest1069-21sshd23:20:195
60599160,1cyclictest0-21swapper/523:43:395
598991613,2cyclictest25500-21sshd23:10:334
59899161,14cyclictest13069-21kworker/4:523:34:064
59899161,14cyclictest13069-21kworker/4:523:34:064
58899167,1cyclictest41-21ksoftirqd/300:35:453
588991614,1cyclictest41-21ksoftirqd/322:15:133
588991614,1cyclictest41-21ksoftirqd/321:14:193
588991613,1cyclictest41-21ksoftirqd/322:51:313
588991611,4cyclictest41-21ksoftirqd/322:45:363
34272160,0sleep1231rcuc/100:03:251
293562160,0sleep60-21swapper/621:47:066
614991514,1cyclictest65-21ksoftirqd/600:13:016
614991513,1cyclictest65-21ksoftirqd/600:37:136
60599151,7cyclictest1872-21httpd22:56:385
60599150,2cyclictest23216-21bash23:57:025
60599150,1cyclictest721-21dbus-daemon21:46:175
598991512,2cyclictest49-21ksoftirqd/400:31:514
588991513,1cyclictest41-21ksoftirqd/300:05:203
580991514,1cyclictest33-21ksoftirqd/222:59:582
164252150,0sleep40-21swapper/400:11:374
60599140,3cyclictest26167-21systemd00:29:055
598991413,1cyclictest0-21swapper/423:44:494
598991412,1cyclictest49-21ksoftirqd/421:43:114
598991412,1cyclictest49-21ksoftirqd/421:43:114
598991412,1cyclictest49-21ksoftirqd/421:21:504
598991412,1cyclictest49-21ksoftirqd/400:17:484
57299149,1cyclictest31048-21sshd23:42:341
572991410,1cyclictest25-21ksoftirqd/122:06:301
47162140,0sleep10-21swapper/122:37:471
47162140,0sleep10-21swapper/122:37:471
259042140,1sleep725906-21grepconf.sh22:53:557
224532140,1sleep222449-21sshd23:12:162
209772140,0sleep10-21swapper/122:23:531
62299139,1cyclictest73-21ksoftirqd/700:06:327
622991310,2cyclictest31215-21sshd21:34:177
62299130,12cyclictest25115-21sshd23:32:527
62299130,12cyclictest25115-21sshd23:32:527
62299130,12cyclictest0-21swapper/721:13:407
61499139,1cyclictest65-21ksoftirqd/621:40:306
61499139,1cyclictest65-21ksoftirqd/621:40:306
614991312,1cyclictest65-21ksoftirqd/622:49:586
614991312,1cyclictest65-21ksoftirqd/600:34:126
614991311,1cyclictest65-21ksoftirqd/600:03:346
60599130,6cyclictest721-21dbus-daemon23:28:145
60599130,3cyclictest11903-21grep21:55:225
598991312,1cyclictest49-21ksoftirqd/422:11:004
598991311,1cyclictest49-21ksoftirqd/423:39:514
59899130,3cyclictest15654-21systemd21:25:534
580991310,2cyclictest33-21ksoftirqd/223:03:132
56499130,12cyclictest0-21swapper/000:03:120
37312130,1sleep73730-21bash22:32:087
326212130,1sleep432625-21cpuspeed_turbos20:05:104
314512130,0sleep70-21swapper/720:59:587
310162130,0sleep60-21swapper/600:25:326
246042130,1sleep41-21systemd22:07:234
195922130,0sleep40-21swapper/400:24:584
194922130,1sleep219469-21rm23:43:482
161802130,0sleep00-21swapper/000:34:070
151642130,0sleep60-21swapper/621:33:216
130692130,0sleep40-21swapper/422:29:014
8692120,0sleep10-21swapper/122:41:151
62299128,1cyclictest73-21ksoftirqd/722:58:457
62299124,5cyclictest14661-21bash23:54:447
622991210,1cyclictest8107-21sshd22:49:117
622991210,1cyclictest73-21ksoftirqd/722:29:467
622991210,1cyclictest73-21ksoftirqd/700:14:587
622991210,1cyclictest73-21ksoftirqd/700:03:197
622991210,1cyclictest20248-21systemd-cgroups23:28:547
62299120,11cyclictest20172-21id21:55:537
62299120,11cyclictest15171-21bash00:22:497
61499123,6cyclictest18664-21rm00:24:566
614991211,1cyclictest65-21ksoftirqd/622:23:306
614991210,1cyclictest65-21ksoftirqd/623:09:156
614991210,1cyclictest65-21ksoftirqd/600:18:186
61499120,2cyclictest4305-21sshd21:12:036
61499120,2cyclictest3130-21grepconf.sh21:51:096
60599120,8cyclictest3453-21bash22:11:425
60599120,3cyclictest8576-21grepconf.sh00:11:085
60599120,2cyclictest2611-21id22:35:445
60599120,2cyclictest2611-21id22:35:445
60599120,11cyclictest9241-21sshd00:00:025
59899128,3cyclictest49-21ksoftirqd/422:38:014
59899128,3cyclictest49-21ksoftirqd/422:38:014
59899126,3cyclictest49-21ksoftirqd/422:42:444
598991211,1cyclictest49-21ksoftirqd/422:54:464
598991211,1cyclictest49-21ksoftirqd/400:04:384
598991210,1cyclictest49-21ksoftirqd/423:48:134
598991210,1cyclictest49-21ksoftirqd/423:25:144
598991210,1cyclictest49-21ksoftirqd/422:55:204
598991210,1cyclictest49-21ksoftirqd/400:35:534
598991210,1cyclictest49-21ksoftirqd/400:21:344
588991211,1cyclictest41-21ksoftirqd/320:06:543
588991210,1cyclictest41-21ksoftirqd/319:54:583
58099128,3cyclictest33-21ksoftirqd/222:37:582
58099128,3cyclictest33-21ksoftirqd/222:37:582
58099122,8cyclictest3261-21bash21:54:592
58099122,5cyclictest4993-21bash22:45:142
580991211,1cyclictest33-21ksoftirqd/223:17:202
580991211,1cyclictest33-21ksoftirqd/222:16:462
580991211,1cyclictest33-21ksoftirqd/221:21:292
580991211,1cyclictest33-21ksoftirqd/200:34:412
580991211,1cyclictest33-21ksoftirqd/200:03:232
580991210,2cyclictest33-21ksoftirqd/222:31:352
57299122,4cyclictest721-21dbus-daemon21:19:261
57299122,4cyclictest32439-21sshd00:12:341
57299122,4cyclictest0-21swapper/123:19:401
572991210,1cyclictest25-21ksoftirqd/121:33:531
57299120,2cyclictest1-21systemd22:33:311
56499122,4cyclictest8695-21sshd21:16:160
56499122,4cyclictest6749-21systemd-cgroups23:28:060
56499122,4cyclictest6379-21bash22:02:370
56499122,4cyclictest5022-21systemd-cgroups23:07:330
56499122,4cyclictest0-21swapper/022:37:180
56499122,4cyclictest0-21swapper/022:37:180
564991211,1cyclictest9-21ksoftirqd/023:35:540
564991210,1cyclictest9-21ksoftirqd/022:56:290
56499121,5cyclictest2258-21bash00:29:350
56499121,5cyclictest16726-21bash00:07:540
56499120,1cyclictest0-21swapper/022:48:350
31572120,0sleep4481ktimersoftd/423:50:144
154352120,1sleep09-21ksoftirqd/000:20:540
72092110,0sleep20-21swapper/222:02:402
62299119,1cyclictest73-21ksoftirqd/722:39:097
62299119,1cyclictest73-21ksoftirqd/722:39:097
62299119,1cyclictest73-21ksoftirqd/721:45:517
62299119,1cyclictest73-21ksoftirqd/721:40:337
62299119,1cyclictest73-21ksoftirqd/721:40:337
62299119,1cyclictest73-21ksoftirqd/700:16:187
62299116,2cyclictest73-21ksoftirqd/721:25:417
622991110,1cyclictest73-21ksoftirqd/721:36:267
61499119,1cyclictest7027-21grepconf.sh22:02:396
61499119,1cyclictest65-21ksoftirqd/623:12:396
61499119,1cyclictest65-21ksoftirqd/623:04:376
61499119,1cyclictest65-21ksoftirqd/622:53:146
61499119,1cyclictest65-21ksoftirqd/622:37:576
61499119,1cyclictest65-21ksoftirqd/622:37:576
61499119,1cyclictest65-21ksoftirqd/621:21:296
61499119,1cyclictest65-21ksoftirqd/621:14:596
61499113,5cyclictest24369-21sshd23:57:076
614991110,1cyclictest65-21ksoftirqd/623:23:246
614991110,1cyclictest0-21swapper/623:30:286
614991110,1cyclictest0-21swapper/623:30:286
61499110,1cyclictest0-21swapper/621:25:366
60599118,3cyclictest0-21swapper/520:40:095
60599114,6cyclictest24542-21sshd00:06:265
60599110,1cyclictest2064-21timerwakeupswit20:05:205
59899119,1cyclictest49-21ksoftirqd/422:45:524
59899119,1cyclictest49-21ksoftirqd/422:15:464
59899119,1cyclictest49-21ksoftirqd/421:55:524
59899119,1cyclictest49-21ksoftirqd/400:07:494
598991110,1cyclictest49-21ksoftirqd/423:17:004
598991110,1cyclictest49-21ksoftirqd/421:49:114
588991110,1cyclictest41-21ksoftirqd/319:24:573
58099116,5cyclictest33-21ksoftirqd/223:06:352
58099113,5cyclictest14279-21systemd22:42:032
58099112,6cyclictest21138-21bash23:25:122
58099112,6cyclictest0-21swapper/221:48:532
58099112,5cyclictest9539-21id00:22:292
580991110,1cyclictest33-21ksoftirqd/223:36:392
580991110,1cyclictest33-21ksoftirqd/221:15:572
58099110,10cyclictest5209-21systemd-cgroups21:36:262
58099110,1cyclictest174442sleep221:29:482
58099110,1cyclictest0-21swapper/222:24:022
57299119,1cyclictest25-21ksoftirqd/123:19:581
57299119,1cyclictest25-21ksoftirqd/123:02:451
57299119,1cyclictest25-21ksoftirqd/121:55:561
57299112,4cyclictest0-21swapper/123:11:481
57299111,6cyclictest10882-21sshd00:16:551
57299111,4cyclictest0-21swapper/122:47:031
56499119,1cyclictest9-21ksoftirqd/023:04:560
56499113,7cyclictest11335-21id22:25:110
56499112,4cyclictest4616-21sshd22:15:260
564991110,1cyclictest9-21ksoftirqd/022:41:040
564991110,1cyclictest0-21swapper/021:40:310
564991110,1cyclictest0-21swapper/021:40:310
56499111,6cyclictest0-21swapper/022:10:160
56499111,4cyclictest721-21dbus-daemon21:46:190
56499111,4cyclictest27100-21sshd23:57:160
56499110,5cyclictest28530-21cp23:23:480
56499110,11cyclictest0-21swapper/023:11:570
56499110,1cyclictest16541-21sshd21:33:260
62299109,1cyclictest73-21ksoftirqd/723:55:097
62299109,1cyclictest73-21ksoftirqd/723:46:297
62299109,1cyclictest73-21ksoftirqd/723:36:587
62299109,1cyclictest73-21ksoftirqd/700:35:207
62299108,1cyclictest73-21ksoftirqd/723:19:447
62299108,1cyclictest73-21ksoftirqd/723:00:167
62299108,1cyclictest73-21ksoftirqd/722:08:207
62299108,1cyclictest73-21ksoftirqd/721:15:347
62299108,1cyclictest1-21systemd22:41:277
62299104,2cyclictest32724-21kill21:52:547
62299103,4cyclictest27790-21systemd-cgroups22:20:297
62299100,9cyclictest7099-21kworker/7:221:19:597
61499109,1cyclictest65-21ksoftirqd/623:46:026
61499109,1cyclictest65-21ksoftirqd/621:58:396
61499108,1cyclictest65-21ksoftirqd/623:40:126
61499108,1cyclictest65-21ksoftirqd/623:16:356
61499108,1cyclictest65-21ksoftirqd/622:41:006
61499108,1cyclictest65-21ksoftirqd/622:18:266
61499108,1cyclictest65-21ksoftirqd/600:06:586
61499104,5cyclictest766-21bash21:38:046
61499104,5cyclictest25144-21grepconf.sh22:25:546
61499104,1cyclictest721-21dbus-daemon23:50:476
61499103,4cyclictest27028-21sshd22:31:376
61499102,5cyclictest17121-21cp23:36:056
60599103,6cyclictest752-21snmpd21:09:355
60599103,6cyclictest752-21snmpd21:01:265
60599103,6cyclictest752-21snmpd20:21:075
60599103,6cyclictest26740-21cat20:50:135
60599100,9cyclictest23848-21/usr/sbin/munin19:50:145
60599100,1cyclictest758-21runrttasks20:49:445
60599100,1cyclictest0-21swapper/520:35:125
59899109,1cyclictest49-21ksoftirqd/421:35:114
59899108,1cyclictest49-21ksoftirqd/422:20:044
59899104,3cyclictest0-21swapper/421:30:454
598991010,0cyclictest0-21swapper/423:57:004
59899100,9cyclictest5364-21kworker/4:421:16:224
59899100,1cyclictest0-21swapper/421:11:094
58899109,1cyclictest41-21ksoftirqd/320:34:573
58899108,1cyclictest41-21ksoftirqd/321:09:583
58899108,1cyclictest41-21ksoftirqd/320:15:163
58899108,1cyclictest41-21ksoftirqd/320:00:163
58899108,1cyclictest41-21ksoftirqd/319:39:583
58899108,1cyclictest41-21ksoftirqd/319:25:193
58099109,1cyclictest33-21ksoftirqd/222:10:432
58099108,2cyclictest33-21ksoftirqd/223:22:512
58099108,2cyclictest33-21ksoftirqd/200:39:402
58099104,5cyclictest27750-21sshd00:10:212
58099104,1cyclictest0-21swapper/223:46:502
58099103,4cyclictest30246-21sshd22:52:162
58099103,4cyclictest14977-21grepconf.sh00:09:422
58099103,3cyclictest705-21nscd23:32:492
58099103,3cyclictest705-21nscd23:32:492
58099103,1cyclictest0-21swapper/222:05:072
58099102,5cyclictest26721-21grepconf.sh21:32:072
58099100,4cyclictest14630-21sshd21:50:022
58099100,10cyclictest13550irq/24-ahci[00021:43:312
58099100,10cyclictest13550irq/24-ahci[00021:43:312
58099100,10cyclictest0-21swapper/222:29:142
57299109,1cyclictest0-21swapper/122:26:061
57299109,1cyclictest0-21swapper/122:03:491
57299108,1cyclictest25-21ksoftirqd/123:57:151
57299108,1cyclictest25-21ksoftirqd/123:08:291
57299108,1cyclictest25-21ksoftirqd/121:23:231
57299107,2cyclictest28325-21sshd21:48:571
57299104,2cyclictest12343-21systemd22:12:141
57299103,6cyclictest32316-21sshd22:17:041
57299103,4cyclictest3147-21cp21:36:181
57299102,4cyclictest721-21dbus-daemon21:54:431
57299102,3cyclictest0-21swapper/122:53:161
57299101,4cyclictest2974-21bash00:27:431
57299100,3cyclictest857-21polkitd23:25:201
56499108,1cyclictest9-21ksoftirqd/023:16:330
56499108,1cyclictest9-21ksoftirqd/000:35:040
56499103,6cyclictest5139-21sshd23:52:150
56499102,7cyclictest709-21systemd-logind22:05:340
56499100,4cyclictest721-21dbus-daemon22:31:460
56499100,4cyclictest27032-21kworker/u16:200:10:050
56499100,10cyclictest3446-21kworker/0:523:45:010
56499100,10cyclictest0-21swapper/023:42:300
56499100,10cyclictest0-21swapper/022:50:220
6229997,1cyclictest73-21ksoftirqd/700:25:407
6229996,2cyclictest8857-21sshd23:20:467
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional