You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 00:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Jun 17, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32672980,0sleep30-21swapper/310:30:413
225572840,0sleep40-21swapper/410:31:544
48462770,0sleep2311rcuc/211:49:452
213142760,1sleep121283-21sshd11:19:321
251902730,0sleep025184-21systemd-cgroups11:08:100
289512710,0sleep60-21swapper/612:20:256
311402620,1sleep71-21systemd11:45:427
311402620,1sleep71-21systemd11:45:427
2614426027,19sleep30-21swapper/307:04:293
130912600,1sleep613090-21grepconf.sh12:00:066
10272570,16sleep685150irq/25-em1-rx-009:55:446
19612550,0sleep10-21swapper/109:59:311
324952540,1sleep032496-21systemd-cgroups10:30:300
151742530,1sleep715177-21kworker/u16:209:15:167
93912510,1sleep6758-21runrttasks11:30:516
67752510,0sleep30-21swapper/309:14:483
176142510,0sleep20-21swapper/212:06:032
256382500,0sleep10-21swapper/107:03:221
106132500,1sleep310595-21sshd11:13:023
87342490,1sleep31-21systemd12:05:323
2625324925,8sleep00-21swapper/007:06:020
224952480,0sleep00-21swapper/011:00:250
9712460,0sleep5551rcuc/510:36:195
279802460,1sleep427970-21sshd10:01:104
277282460,0sleep6758-21runrttasks09:32:376
228402460,0sleep222839-21sshd11:06:122
157782460,0sleep7711rcuc/709:47:127
9462450,0sleep30-21swapper/310:05:263
275672450,0sleep3721-21dbus-daemon11:23:513
205672450,0sleep40-21swapper/409:56:544
165302450,0sleep50-21swapper/509:24:275
76522440,1sleep557-21ksoftirqd/510:59:345
296812440,0sleep00-21swapper/009:40:240
271082440,1sleep72659299cyclictest10:16:437
231132440,0sleep60-21swapper/609:36:056
94112430,0sleep50-21swapper/512:34:415
34652430,0sleep10-21swapper/110:42:001
310782430,0sleep30-21swapper/311:08:293
149482430,0sleep70-21swapper/709:52:487
106152430,0sleep00-21swapper/012:21:150
301432420,0sleep50-21swapper/509:19:475
297012420,0sleep40-21swapper/411:32:014
2625924229,9sleep60-21swapper/607:06:086
218752420,2sleep42657099cyclictest12:15:584
21332420,0sleep50-21swapper/511:39:555
66762410,0sleep20-21swapper/208:23:142
324432410,0sleep032440-21systemd-cgroups12:08:410
130162410,1sleep313015-21grep11:32:563
2631524028,9sleep40-21swapper/407:06:464
2615724028,8sleep70-21swapper/707:04:417
188972400,0sleep21-21systemd10:54:352
2627523927,8sleep50-21swapper/507:06:155
2615223928,8sleep20-21swapper/207:04:362
85162380,0sleep50-21swapper/512:27:045
235852380,1sleep665-21ksoftirqd/611:48:536
172902370,2sleep12654299cyclictest12:06:021
26542992813,1cyclictest25-21ksoftirqd/111:13:071
2655099240,6cyclictest0-21swapper/211:22:492
2654299246,3cyclictest25-21ksoftirqd/111:10:411
26542992410,1cyclictest25-21ksoftirqd/110:13:081
2656299237,1cyclictest41-21ksoftirqd/311:22:253
2655099230,9cyclictest27649-21systemd09:19:382
2655099230,6cyclictest709-21systemd-logind10:37:302
2655099230,10cyclictest721-21dbus-daemon12:14:472
2655099230,10cyclictest1-21systemd10:28:422
2654299239,1cyclictest25-21ksoftirqd/109:15:291
26542992313,4cyclictest25-21ksoftirqd/112:27:291
26542992310,3cyclictest25-21ksoftirqd/109:12:511
2656299224,3cyclictest41-21ksoftirqd/310:22:253
26562992211,1cyclictest131rcu_sched09:19:113
2655099220,9cyclictest8934-21sshd09:43:052
2655099220,9cyclictest32641-21bash11:32:112
2655099220,8cyclictest13549-21id11:01:522
2655099220,6cyclictest0-21swapper/212:10:292
2655099220,10cyclictest26973-21grepconf.sh10:01:072
2654299226,2cyclictest25-21ksoftirqd/111:38:041
26542992211,1cyclictest25-21ksoftirqd/110:48:441
26542992211,1cyclictest25-21ksoftirqd/110:36:481
8972210,1sleep4896-21grepconf.sh10:34:184
287122210,1sleep428714-21grep11:02:464
26592992112,1cyclictest73-21ksoftirqd/711:48:577
26562992110,3cyclictest41-21ksoftirqd/310:23:003
2655099213,8cyclictest22651-21cp11:09:562
2655099210,7cyclictest857-21polkitd10:14:522
2655099210,7cyclictest28042-21grepconf.sh11:43:372
2655099210,7cyclictest28042-21grepconf.sh11:43:372
2655099210,6cyclictest1228-21sshd11:42:012
2655099210,10cyclictest30682-21sshd10:11:152
2654299218,5cyclictest25-21ksoftirqd/110:18:211
26542992110,4cyclictest25-21ksoftirqd/112:31:021
26562992010,0cyclictest121rcu_preempt09:42:033
2655099200,9cyclictest3381-21bash12:32:262
2655099200,9cyclictest25761-21sshd11:35:322
2655099200,8cyclictest709-21systemd-logind11:27:162
2655099200,8cyclictest4884-21cp09:27:322
2655099200,7cyclictest8894-21kill09:39:042
2655099200,7cyclictest15656-21sshd09:54:382
2655099200,5cyclictest0-21swapper/212:23:002
2655099200,5cyclictest0-21swapper/209:48:502
2655099200,10cyclictest21827-21bash09:30:252
2654299207,1cyclictest25-21ksoftirqd/111:48:051
2654299206,2cyclictest25-21ksoftirqd/112:36:111
2654299205,3cyclictest25-21ksoftirqd/112:10:531
2654299205,1cyclictest3025-21sshd09:23:411
26542992017,2cyclictest25-21ksoftirqd/110:03:351
26542992010,1cyclictest25-21ksoftirqd/111:43:021
26542992010,1cyclictest25-21ksoftirqd/111:43:021
105462200,1sleep710544-21sshd10:59:447
31962190,1sleep03188-21bash09:21:580
26592991916,3cyclictest73-21ksoftirqd/709:31:387
26585991914,4cyclictest29916-21systemd10:22:396
2656299196,1cyclictest41-21ksoftirqd/311:29:103
2656299196,1cyclictest41-21ksoftirqd/310:08:093
2656299195,1cyclictest41-21ksoftirqd/310:40:433
2656299193,3cyclictest41-21ksoftirqd/309:43:043
26562991915,1cyclictest464-21systemd-journal10:54:183
26562991911,1cyclictest41-21ksoftirqd/310:58:393
2655099192,6cyclictest756-21sshd10:18:022
2655099190,8cyclictest669-21avahi-daemon12:00:452
2655099190,8cyclictest30985-21sshd10:07:202
2655099190,7cyclictest7470-21awk10:23:112
2655099190,6cyclictest730-21NetworkManager10:47:002
2655099190,6cyclictest27217-21sshd11:13:562
2655099190,6cyclictest12083-21sshd12:19:232
2655099190,6cyclictest0-21swapper/210:40:202
2655099190,6cyclictest0-21swapper/209:16:382
2655099190,10cyclictest1-21systemd11:56:592
2654299197,3cyclictest25-21ksoftirqd/109:46:241
2654299197,2cyclictest25-21ksoftirqd/111:26:541
2654299196,3cyclictest25-21ksoftirqd/109:20:131
2654299194,1cyclictest25-21ksoftirqd/111:06:321
2654299194,1cyclictest131rcu_sched12:14:231
2654299193,2cyclictest25-21ksoftirqd/110:28:091
2654299193,1cyclictest25-21ksoftirqd/109:31:161
26542991913,3cyclictest25-21ksoftirqd/111:28:181
26542991913,3cyclictest25-21ksoftirqd/109:40:311
2653599190,18cyclictest14924-21kworker/0:510:50:270
26592991814,1cyclictest73-21ksoftirqd/711:38:177
2659299180,2cyclictest73-21ksoftirqd/710:01:427
2656299189,1cyclictest41-21ksoftirqd/311:51:283
2656299186,3cyclictest41-21ksoftirqd/309:51:243
2656299186,1cyclictest41-21ksoftirqd/309:59:293
2656299184,3cyclictest41-21ksoftirqd/310:47:523
26562991816,1cyclictest41-21ksoftirqd/312:11:063
26562991815,1cyclictest41-21ksoftirqd/310:49:463
26562991815,1cyclictest41-21ksoftirqd/309:32:253
26562991814,1cyclictest41-21ksoftirqd/312:25:243
26562991811,1cyclictest41-21ksoftirqd/309:55:033
2655099180,7cyclictest8937-21sshd09:35:132
2655099180,7cyclictest6670-21sshd09:08:262
2655099180,6cyclictest28794-21sshd12:33:472
2654299188,3cyclictest25-21ksoftirqd/111:53:271
2654299187,1cyclictest25-21ksoftirqd/110:57:551
2654299187,1cyclictest25-21ksoftirqd/110:45:111
2654299186,1cyclictest25-21ksoftirqd/110:24:321
2654299185,3cyclictest25-21ksoftirqd/110:53:091
26542991817,1cyclictest25-21ksoftirqd/109:33:501
2659299175,1cyclictest73-21ksoftirqd/711:12:487
2659299173,1cyclictest464-21systemd-journal12:15:077
26592991715,1cyclictest73-21ksoftirqd/710:27:107
26592991712,2cyclictest73-21ksoftirqd/712:03:107
2659299171,2cyclictest73-21ksoftirqd/709:39:567
2659299171,1cyclictest131rcu_sched09:23:097
2656299173,1cyclictest41-21ksoftirqd/312:34:483
2656299173,1cyclictest41-21ksoftirqd/310:17:243
2656299172,1cyclictest41-21ksoftirqd/312:15:433
26562991716,1cyclictest41-21ksoftirqd/311:39:083
26562991714,3cyclictest41-21ksoftirqd/309:24:343
26562991713,1cyclictest41-21ksoftirqd/311:06:093
26562991713,1cyclictest41-21ksoftirqd/309:33:233
26562991712,2cyclictest41-21ksoftirqd/310:35:263
2656299170,1cyclictest121rcu_preempt11:57:173
2655099170,7cyclictest14821-21bash10:48:182
2654299176,1cyclictest25-21ksoftirqd/110:09:061
2654299175,3cyclictest25-21ksoftirqd/111:33:301
2654299175,2cyclictest25-21ksoftirqd/112:00:201
26542991715,1cyclictest25-21ksoftirqd/112:19:161
26542991714,3cyclictest25-21ksoftirqd/109:48:171
26542991713,1cyclictest25-21ksoftirqd/109:54:391
26535991715,1cyclictest9-21ksoftirqd/010:56:480
2653599171,2cyclictest131rcu_sched10:37:440
117722170,1sleep449-21ksoftirqd/412:09:254
26592991614,1cyclictest73-21ksoftirqd/712:36:437
26592991614,1cyclictest73-21ksoftirqd/712:25:187
26592991614,1cyclictest73-21ksoftirqd/711:59:547
26592991614,1cyclictest73-21ksoftirqd/710:21:047
26592991613,3cyclictest73-21ksoftirqd/709:19:257
26592991613,2cyclictest73-21ksoftirqd/712:11:487
2659299160,1cyclictest73-21ksoftirqd/711:23:577
2659299160,1cyclictest121rcu_preempt10:48:517
26562991614,1cyclictest464-21systemd-journal09:12:193
26562991614,1cyclictest41-21ksoftirqd/312:31:033
26562991614,1cyclictest41-21ksoftirqd/312:19:303
26562991614,1cyclictest41-21ksoftirqd/311:45:373
26562991614,1cyclictest41-21ksoftirqd/311:45:373
215842160,0sleep40-21swapper/409:15:374
2659299158,4cyclictest73-21ksoftirqd/710:08:167
26592991514,1cyclictest73-21ksoftirqd/710:54:397
26592991514,1cyclictest73-21ksoftirqd/710:47:437
26592991514,1cyclictest73-21ksoftirqd/710:34:047
26592991513,1cyclictest73-21ksoftirqd/712:28:247
26592991513,1cyclictest73-21ksoftirqd/712:18:347
26592991513,1cyclictest73-21ksoftirqd/711:55:147
26592991513,1cyclictest73-21ksoftirqd/711:32:457
26592991513,1cyclictest73-21ksoftirqd/709:12:127
26592991513,1cyclictest464-21systemd-journal11:07:017
2659299150,1cyclictest0-21swapper/710:39:097
2659299150,0cyclictest121rcu_preempt09:34:187
26562991513,1cyclictest41-21ksoftirqd/312:01:033
26562991513,1cyclictest41-21ksoftirqd/309:07:543
2653599157,5cyclictest9-21ksoftirqd/011:39:170
26535991513,1cyclictest9-21ksoftirqd/010:14:180
185702150,0sleep40-21swapper/412:37:124
327552140,1sleep032753-21bash10:24:370
26592991412,1cyclictest73-21ksoftirqd/711:36:237
26592991412,1cyclictest73-21ksoftirqd/710:28:147
26592991412,1cyclictest73-21ksoftirqd/709:53:117
26592991410,3cyclictest73-21ksoftirqd/711:18:497
26592991410,1cyclictest73-21ksoftirqd/710:04:067
2659299140,1cyclictest13803-21sshd11:13:097
26578991413,1cyclictest57-21ksoftirqd/509:43:155
26578991410,1cyclictest57-21ksoftirqd/511:46:295
26578991410,1cyclictest57-21ksoftirqd/511:46:295
26578991410,1cyclictest57-21ksoftirqd/509:36:355
2657899140,13cyclictest24218-21kworker/5:210:54:125
26542991413,1cyclictest28097-21kworker/1:007:38:031
26535991413,1cyclictest9-21ksoftirqd/011:19:560
26535991413,1cyclictest9-21ksoftirqd/010:21:230
26535991412,1cyclictest9-21ksoftirqd/012:15:410
26535991412,1cyclictest9-21ksoftirqd/012:02:400
26535991412,1cyclictest9-21ksoftirqd/010:01:090
26535991412,1cyclictest9-21ksoftirqd/009:50:350
26535991412,1cyclictest9-21ksoftirqd/009:47:310
26535991412,1cyclictest9-21ksoftirqd/009:33:490
26535991412,1cyclictest9-21ksoftirqd/009:17:030
206972140,0sleep50-21swapper/511:15:365
18682140,5sleep40-21swapper/411:14:234
77342130,0sleep50-21swapper/511:22:495
26585991311,1cyclictest65-21ksoftirqd/612:03:176
2658599130,12cyclictest18845-21bash11:02:106
26578991311,1cyclictest57-21ksoftirqd/511:30:185
26578991311,1cyclictest57-21ksoftirqd/510:40:265
26578991311,1cyclictest57-21ksoftirqd/509:13:415
2657899130,12cyclictest30807-21kworker/5:009:28:115
26570991311,1cyclictest49-21ksoftirqd/410:40:374
2655099130,5cyclictest0-21swapper/207:43:102
26535991312,1cyclictest9-21ksoftirqd/009:27:010
26535991311,2cyclictest9-21ksoftirqd/012:29:350
26535991311,1cyclictest9-21ksoftirqd/012:07:270
26535991311,1cyclictest9-21ksoftirqd/010:07:580
26535991311,1cyclictest9-21ksoftirqd/009:53:200
26535991311,1cyclictest9-21ksoftirqd/009:08:140
2653599130,12cyclictest22460-21kworker/0:210:05:360
253882130,0sleep60-21swapper/610:24:116
252042130,0sleep225206-21tr08:58:052
26592991210,1cyclictest73-21ksoftirqd/708:32:537
2658599129,2cyclictest32001-21systemd10:43:446
2658599125,4cyclictest24557-21grepconf.sh11:39:186
2658599125,4cyclictest19520-21systemd09:49:136
2658599123,5cyclictest709-21systemd-logind10:51:206
26585991210,1cyclictest65-21ksoftirqd/610:01:536
26585991210,1cyclictest65-21ksoftirqd/609:27:526
2658599120,11cyclictest967-21grep10:57:276
2657899129,2cyclictest57-21ksoftirqd/512:20:055
2657899129,2cyclictest23746-21grep10:04:465
2657899128,1cyclictest57-21ksoftirqd/512:04:405
2657899128,1cyclictest57-21ksoftirqd/510:24:515
2657899128,1cyclictest57-21ksoftirqd/510:18:505
26578991211,1cyclictest57-21ksoftirqd/511:37:115
26578991211,1cyclictest57-21ksoftirqd/510:28:115
26578991210,1cyclictest57-21ksoftirqd/511:56:365
26578991210,1cyclictest57-21ksoftirqd/511:51:035
26578991210,1cyclictest57-21ksoftirqd/511:11:595
26578991210,1cyclictest57-21ksoftirqd/510:17:245
26578991210,1cyclictest57-21ksoftirqd/510:02:515
2657899120,11cyclictest1074-21kworker/5:212:29:555
2657899120,11cyclictest10688-21sshd09:48:415
2657899120,11cyclictest10494-21sshd10:46:145
2657099129,2cyclictest9791-21systemd10:27:064
2657099129,2cyclictest19294-21bash10:43:024
2657099122,4cyclictest28766-21bash12:22:294
2657099122,4cyclictest20922-21sshd09:43:414
2657099122,4cyclictest12089-21bash10:10:114
26570991210,1cyclictest49-21ksoftirqd/409:39:194
26570991210,1cyclictest49-21ksoftirqd/409:24:384
26570991210,1cyclictest464-21systemd-journal11:18:084
2657099121,5cyclictest15250-21grep10:48:214
2657099120,2cyclictest874-21grepconf.sh11:47:434
2657099120,2cyclictest874-21grepconf.sh11:47:434
2657099120,2cyclictest19588-21bash12:27:434
2657099120,11cyclictest6394-21kworker/4:311:58:514
26562991211,1cyclictest41-21ksoftirqd/309:02:533
26542991212,0cyclictest19585-21kworker/1:108:31:571
26542991211,1cyclictest25-21ksoftirqd/108:47:531
2653599122,4cyclictest17693-21sshd11:15:240
26535991210,1cyclictest9-21ksoftirqd/011:57:540
26535991210,1cyclictest9-21ksoftirqd/011:33:120
2653599120,2cyclictest13605-21sshd12:33:000
2653599120,2cyclictest131rcu_sched11:52:290
2653599120,11cyclictest10970-21systemd-cgroups11:46:230
2653599120,11cyclictest10970-21systemd-cgroups11:46:230
226922120,1sleep022669-21bash12:24:030
2658599119,1cyclictest65-21ksoftirqd/612:31:086
2658599119,1cyclictest65-21ksoftirqd/610:41:566
2658599118,1cyclictest65-21ksoftirqd/611:36:106
2658599117,3cyclictest65-21ksoftirqd/611:47:306
2658599117,3cyclictest65-21ksoftirqd/611:47:306
2658599113,5cyclictest30389-21bash09:14:186
2658599113,3cyclictest85150irq/25-em1-rx-011:54:266
2658599110,11cyclictest0-21swapper/611:05:196
2658599110,10cyclictest17040-21systemd-cgroups09:45:246
2657899119,1cyclictest57-21ksoftirqd/511:24:065
2657899119,1cyclictest57-21ksoftirqd/510:08:105
2657899119,1cyclictest57-21ksoftirqd/509:39:295
2657899112,5cyclictest0-21swapper/511:03:495
26578991110,1cyclictest57-21ksoftirqd/510:48:585
2657899110,1cyclictest1-21systemd12:16:345
2657099119,1cyclictest49-21ksoftirqd/409:12:204
2657099112,4cyclictest568-21sshd10:15:094
2657099112,4cyclictest30961-21grep09:51:524
2657099111,4cyclictest9761-21sshd11:05:214
2657099111,4cyclictest20579-21sshd10:18:144
2657099111,4cyclictest10984-21sshd11:27:004
2657099110,5cyclictest1-21systemd11:53:074
2657099110,10cyclictest3976-21kworker/4:510:54:164
2657099110,1cyclictest709-21systemd-logind11:36:384
2657099110,1cyclictest0-21swapper/411:12:504
2655099110,10cyclictest24791-21sed08:57:532
26542991111,0cyclictest28097-21kworker/1:007:47:031
26542991110,1cyclictest25-21ksoftirqd/107:52:541
26542991110,1cyclictest19585-21kworker/1:109:06:471
2653599119,1cyclictest9-21ksoftirqd/011:22:570
2653599119,1cyclictest9-21ksoftirqd/011:05:450
2653599119,1cyclictest9-21ksoftirqd/010:39:470
2653599119,1cyclictest0-21swapper/011:30:470
26535991110,1cyclictest9-21ksoftirqd/010:45:330
2658599109,1cyclictest65-21ksoftirqd/610:07:556
2658599108,1cyclictest65-21ksoftirqd/609:08:056
2658599107,2cyclictest65-21ksoftirqd/611:19:306
2658599103,6cyclictest0-21swapper/609:38:396
2658599103,4cyclictest9721-21sshd12:25:146
2658599103,4cyclictest26885-21kworker/u16:311:25:136
2658599102,5cyclictest32736-21sshd11:14:186
2658599102,4cyclictest7645-21systemd12:13:106
2658599102,4cyclictest1-21systemd10:13:196
2658599100,9cyclictest831-21kworker/6:010:33:066
2658599100,9cyclictest24794-21kworker/6:610:06:066
2658599100,9cyclictest18353-21kworker/6:211:09:106
2657899107,3cyclictest57-21ksoftirqd/511:58:505
2657899107,1cyclictest19339-21sshd12:09:595
2657899102,0cyclictest0-21swapper/507:52:295
2657099108,1cyclictest28676-21iostat_ios10:03:094
2657099104,3cyclictest709-21systemd-logind09:17:544
2657099103,4cyclictest19613-21systemd12:31:294
2657099102,3cyclictest26557-21sshd09:28:404
2657099101,4cyclictest709-21systemd-logind11:52:134
2657099100,4cyclictest15437-21sshd12:03:584
2656299109,1cyclictest41-21ksoftirqd/307:42:533
2656299108,1cyclictest41-21ksoftirqd/308:47:533
2656299108,1cyclictest41-21ksoftirqd/307:17:533
2655099100,9cyclictest24925-21ls07:58:142
2655099100,9cyclictest0-21swapper/207:18:092
2655099100,5cyclictest0-21swapper/208:12:272
2654299109,1cyclictest28097-21kworker/1:007:22:471
2654299109,1cyclictest28097-21kworker/1:007:08:351
2654299109,1cyclictest19585-21kworker/1:108:23:271
2654299109,1cyclictest19585-21kworker/1:107:58:511
2654299109,1cyclictest19585-21kworker/1:107:55:131
2654299108,1cyclictest25-21ksoftirqd/108:52:531
26542991010,0cyclictest19585-21kworker/1:108:16:111
2653599108,1cyclictest9-21ksoftirqd/009:28:010
265859994,1cyclictest0-21swapper/609:17:556
265859992,4cyclictest2989-21sshd12:34:136
265859990,5cyclictest20161-21sshd12:08:046
265859990,1cyclictest0-21swapper/610:28:526
265789997,1cyclictest57-21ksoftirqd/509:54:505
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional