You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 07:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Jul 03, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2135021060,0sleep40-21swapper/422:18:424
2135021060,0sleep40-21swapper/422:18:424
1447421050,0sleep71-21systemd21:16:547
180592860,0sleep718058-21sshd00:34:377
36912770,0sleep70-21swapper/722:44:327
309022730,1sleep230899-21systemd-cgroups22:48:042
261722680,0sleep10-21swapper/100:31:191
300592640,0sleep60-21swapper/600:33:246
301542620,0sleep20-21swapper/223:05:182
278362550,0sleep00-21swapper/000:17:560
106662520,1sleep710648-21bash00:22:447
263072510,0sleep30-21swapper/323:08:473
263072510,0sleep30-21swapper/323:08:473
196262510,0sleep60-21swapper/623:29:246
189692510,1sleep21-21systemd21:57:342
59292500,0sleep20-21swapper/223:43:542
2067325026,8sleep60-21swapper/619:04:026
119232500,0sleep50-21swapper/521:28:135
288832480,0sleep60-21swapper/622:36:306
2079624825,8sleep50-21swapper/519:05:375
2065824824,9sleep00-21swapper/019:03:480
264922470,0sleep10-21swapper/122:45:541
301312460,0sleep40-21swapper/423:10:564
301312460,0sleep40-21swapper/423:10:564
267512460,1sleep4721-21dbus-daemon21:27:164
167172460,0sleep60-21swapper/621:45:446
130502460,0sleep20-21swapper/200:01:402
130502460,0sleep20-21swapper/200:01:402
253822450,0sleep50-21swapper/522:55:285
162272450,0sleep70-21swapper/723:56:097
42602440,1sleep54261-21grep00:10:405
302382440,0sleep70-21swapper/700:27:407
27422430,0sleep10-21swapper/122:34:571
134292430,0sleep5551rcuc/522:23:565
129472430,0sleep30-21swapper/323:25:133
127582430,1sleep51-21systemd22:47:035
54492420,0sleep50-21swapper/523:17:145
125322420,0sleep112526-21sshd00:15:091
116602420,0sleep00-21swapper/022:31:440
304552410,0sleep50-21swapper/521:15:565
235862410,0sleep10-21swapper/122:47:391
212052410,0sleep70-21swapper/722:57:147
2087424128,9sleep70-21swapper/719:06:437
192562410,0sleep20-21swapper/223:25:362
154912410,0sleep20-21swapper/200:26:552
81522400,2sleep42104799cyclictest22:29:314
29792400,1sleep22103899cyclictest22:38:432
238722400,0sleep30-21swapper/323:42:593
2059424027,9sleep30-21swapper/319:02:553
238912390,0sleep50-21swapper/500:04:085
2072623926,9sleep40-21swapper/419:04:404
136412390,0sleep20-21swapper/222:22:092
136412390,0sleep20-21swapper/222:22:092
107132390,0sleep60-21swapper/622:06:436
257012380,0sleep2752-21snmpd21:07:202
2086823827,8sleep10-21swapper/119:06:371
2061523826,9sleep20-21swapper/219:03:102
266982370,2sleep22103899cyclictest22:32:342
115842370,0sleep30-21swapper/323:13:363
303782360,0sleep70-21swapper/720:17:377
219712360,0sleep10-21swapper/121:57:411
179552270,0sleep60-21swapper/621:24:466
21062992312,3cyclictest73-21ksoftirqd/723:28:557
2106299226,3cyclictest73-21ksoftirqd/700:21:327
2106299217,1cyclictest73-21ksoftirqd/723:52:167
2106299216,3cyclictest73-21ksoftirqd/722:34:267
21062992111,1cyclictest73-21ksoftirqd/721:27:437
2106299208,3cyclictest73-21ksoftirqd/723:17:107
2106299208,1cyclictest73-21ksoftirqd/723:47:187
21062992011,3cyclictest73-21ksoftirqd/721:08:037
2106299199,1cyclictest73-21ksoftirqd/700:10:287
2106299198,3cyclictest73-21ksoftirqd/723:38:147
2106299198,3cyclictest73-21ksoftirqd/700:05:157
2106299198,2cyclictest73-21ksoftirqd/721:40:217
2106299198,1cyclictest73-21ksoftirqd/723:01:287
2106299198,1cyclictest73-21ksoftirqd/722:40:367
2106299198,1cyclictest73-21ksoftirqd/721:59:267
2106299197,3cyclictest73-21ksoftirqd/700:12:297
2106299197,1cyclictest73-21ksoftirqd/721:52:307
2106299196,3cyclictest73-21ksoftirqd/723:23:577
2106299196,3cyclictest73-21ksoftirqd/722:22:077
2106299196,3cyclictest73-21ksoftirqd/722:22:077
2106299196,2cyclictest73-21ksoftirqd/722:26:467
2106299191,3cyclictest7154-21sshd22:04:357
164282190,0sleep20-21swapper/222:47:162
308732180,0sleep60-21swapper/600:25:556
2106299188,3cyclictest73-21ksoftirqd/722:10:307
2106299188,3cyclictest73-21ksoftirqd/721:36:367
2106299188,1cyclictest73-21ksoftirqd/723:03:427
2106299187,4cyclictest73-21ksoftirqd/723:34:267
2106299187,3cyclictest73-21ksoftirqd/722:48:097
21062991815,3cyclictest711rcuc/721:19:507
21062991815,1cyclictest73-21ksoftirqd/722:32:197
324442170,0sleep10-21swapper/121:46:441
315942170,2sleep22103899cyclictest23:39:382
243872170,0sleep6631rcuc/621:09:326
2106299177,3cyclictest73-21ksoftirqd/721:49:577
2106299171,3cyclictest73-21ksoftirqd/721:26:127
2106299171,2cyclictest73-21ksoftirqd/723:57:467
2106299171,2cyclictest73-21ksoftirqd/723:57:467
21053991716,1cyclictest57-21ksoftirqd/523:08:485
21053991716,1cyclictest57-21ksoftirqd/523:08:485
21038991715,2cyclictest33-21ksoftirqd/222:16:142
21038991715,2cyclictest33-21ksoftirqd/222:16:142
314022160,0sleep50-21swapper/521:46:405
225762160,0sleep10-21swapper/121:15:281
223812160,0sleep60-21swapper/622:43:436
2106299167,3cyclictest73-21ksoftirqd/721:43:567
2106299166,3cyclictest73-21ksoftirqd/723:09:347
2106299166,3cyclictest73-21ksoftirqd/723:09:347
2106299166,1cyclictest73-21ksoftirqd/723:21:137
2106299161,1cyclictest0-21swapper/722:13:217
2106299161,1cyclictest0-21swapper/722:13:217
21056991614,1cyclictest65-21ksoftirqd/622:52:126
21056991613,1cyclictest65-21ksoftirqd/623:27:036
2104799169,6cyclictest10388-21sshd22:12:214
2104799169,6cyclictest10388-21sshd22:12:214
21044991612,3cyclictest41-21ksoftirqd/322:42:383
2102999162,12cyclictest24579-21bash21:34:420
309692150,2sleep630970-21bash00:08:176
259442150,1sleep425942-21sshd23:31:474
21056991514,1cyclictest65-21ksoftirqd/623:37:226
21056991514,1cyclictest65-21ksoftirqd/622:55:476
21056991514,1cyclictest65-21ksoftirqd/600:14:286
21056991513,1cyclictest65-21ksoftirqd/623:59:376
21056991513,1cyclictest65-21ksoftirqd/623:59:376
21056991513,1cyclictest65-21ksoftirqd/623:54:576
21056991513,1cyclictest65-21ksoftirqd/622:27:306
21056991513,1cyclictest65-21ksoftirqd/621:41:166
21056991511,1cyclictest65-21ksoftirqd/623:48:136
21056991511,1cyclictest65-21ksoftirqd/623:20:566
21044991513,1cyclictest41-21ksoftirqd/300:24:223
21044991512,2cyclictest31161-21sshd21:46:393
2103899159,4cyclictest33-21ksoftirqd/221:48:542
21038991513,1cyclictest33-21ksoftirqd/221:36:152
2103899150,14cyclictest27863-21kworker/2:321:27:312
46742140,1sleep51-21systemd23:20:585
2105699149,1cyclictest65-21ksoftirqd/621:56:146
2105699146,4cyclictest65-21ksoftirqd/623:09:596
2105699146,4cyclictest65-21ksoftirqd/623:09:596
21056991413,1cyclictest65-21ksoftirqd/622:08:006
21056991412,2cyclictest65-21ksoftirqd/600:29:466
21056991412,1cyclictest65-21ksoftirqd/623:06:336
21056991412,1cyclictest65-21ksoftirqd/623:01:336
21056991412,1cyclictest65-21ksoftirqd/622:22:296
21056991412,1cyclictest65-21ksoftirqd/622:19:116
21056991412,1cyclictest65-21ksoftirqd/622:19:116
21056991412,1cyclictest65-21ksoftirqd/622:16:096
21056991412,1cyclictest65-21ksoftirqd/622:16:096
21056991412,1cyclictest65-21ksoftirqd/621:58:496
21056991412,1cyclictest65-21ksoftirqd/621:48:136
21056991412,1cyclictest65-21ksoftirqd/621:34:186
21056991412,1cyclictest65-21ksoftirqd/600:21:216
21056991412,1cyclictest65-21ksoftirqd/600:05:236
21056991411,1cyclictest65-21ksoftirqd/621:28:306
2105699141,12cyclictest366-21jbd2/sda2-823:42:326
2105399143,2cyclictest0-21swapper/521:57:535
2104799145,2cyclictest13721-21grep21:18:454
21044991412,1cyclictest41-21ksoftirqd/321:07:393
21038991412,2cyclictest33-21ksoftirqd/222:24:022
21038991412,1cyclictest33-21ksoftirqd/223:13:252
21038991412,1cyclictest33-21ksoftirqd/221:43:112
21038991412,1cyclictest33-21ksoftirqd/200:06:002
21038991411,3cyclictest33-21ksoftirqd/222:28:262
2103599140,13cyclictest10278-21sshd23:46:151
2102999149,3cyclictest9-21ksoftirqd/023:17:250
21029991412,1cyclictest9-21ksoftirqd/023:35:230
21029991412,1cyclictest9-21ksoftirqd/022:54:120
21029991412,1cyclictest9-21ksoftirqd/022:22:480
267402130,0sleep30-21swapper/322:13:133
267402130,0sleep30-21swapper/322:13:133
224132130,0sleep522406-21sshd21:17:245
211642130,1sleep321142-21bash00:00:133
211642130,1sleep321142-21bash00:00:133
21056991312,1cyclictest65-21ksoftirqd/623:16:226
21056991312,1cyclictest65-21ksoftirqd/622:40:076
21056991311,1cyclictest65-21ksoftirqd/621:21:146
21056991311,1cyclictest65-21ksoftirqd/621:13:106
2105399133,3cyclictest22716-21sshd22:49:345
2105399132,5cyclictest5601-21bash23:30:335
21053991311,1cyclictest57-21ksoftirqd/521:39:535
2105399130,7cyclictest0-21swapper/523:34:315
2105399130,10cyclictest31581-21sshd21:12:175
2104799139,4cyclictest0-21swapper/422:42:534
2104799134,3cyclictest24407-21systemctl23:14:224
2104799134,2cyclictest721-21dbus-daemon21:33:024
2104799132,10cyclictest7944-21sshd00:05:074
21044991311,1cyclictest41-21ksoftirqd/322:36:513
21044991311,1cyclictest41-21ksoftirqd/322:04:123
21044991310,2cyclictest721-21dbus-daemon00:04:553
21044991310,2cyclictest41-21ksoftirqd/321:32:343
21038991311,1cyclictest33-21ksoftirqd/223:53:172
21038991310,2cyclictest33-21ksoftirqd/223:10:252
21038991310,2cyclictest33-21ksoftirqd/223:10:252
21038991310,2cyclictest33-21ksoftirqd/200:29:122
2103599134,4cyclictest9522-21sshd23:59:301
2103599134,4cyclictest9522-21sshd23:59:301
2103599130,12cyclictest13238-21sshd23:21:291
2103599130,1cyclictest0-21swapper/121:36:081
21029991311,1cyclictest9-21ksoftirqd/022:13:570
21029991311,1cyclictest9-21ksoftirqd/022:13:570
2102999130,1cyclictest131rcu_sched22:36:510
195472130,0sleep4471rcuc/421:30:374
189312130,0sleep10-21swapper/123:37:041
169442130,0sleep00-21swapper/000:05:390
36492120,0sleep31-21systemd21:54:463
2106299121,2cyclictest73-21ksoftirqd/721:02:407
21056991210,1cyclictest65-21ksoftirqd/623:34:006
2105399129,2cyclictest19792-21systemd22:39:455
2105399128,3cyclictest464-21systemd-journal23:01:515
2105399122,4cyclictest29356-21sshd22:05:545
21053991211,1cyclictest57-21ksoftirqd/522:34:535
21053991210,1cyclictest57-21ksoftirqd/523:59:595
21053991210,1cyclictest57-21ksoftirqd/523:59:595
21053991210,1cyclictest57-21ksoftirqd/522:09:395
2105399120,11cyclictest5589-21bash00:16:425
2105399120,11cyclictest15207-21systemd00:36:345
2104799125,2cyclictest846-21grep23:55:144
2104799124,2cyclictest709-21systemd-logind22:38:184
2104799123,8cyclictest27567-21grep23:07:044
2104799122,4cyclictest9489-21systemd-cgroups21:51:134
2104799122,4cyclictest6659-21/usr/sbin/munin23:32:314
2104799122,4cyclictest6092-21bash22:48:314
2104799122,4cyclictest14756-21sshd21:55:264
21047991210,1cyclictest0-21swapper/421:08:554
2104799120,8cyclictest0-21swapper/420:12:294
2104799120,12cyclictest9832-21kworker/4:322:10:184
2104799120,12cyclictest27286-21kworker/4:100:00:334
2104799120,12cyclictest27286-21kworker/4:100:00:334
2104799120,12cyclictest19127-21kworker/4:022:57:404
2104799120,11cyclictest7983-21systemd23:22:594
2104799120,11cyclictest29193-21kworker/4:022:05:104
2104799120,11cyclictest24187-21sshd21:13:394
2104799120,1cyclictest0-21swapper/419:12:344
21044991210,1cyclictest41-21ksoftirqd/322:38:133
21044991210,1cyclictest41-21ksoftirqd/322:20:133
21044991210,1cyclictest41-21ksoftirqd/322:20:133
21044991210,1cyclictest41-21ksoftirqd/321:37:333
21044991210,1cyclictest41-21ksoftirqd/321:28:063
21044991210,1cyclictest41-21ksoftirqd/300:32:133
21044991210,1cyclictest12403-21systemd-cgroups00:09:063
2103899127,3cyclictest33-21ksoftirqd/223:18:352
2103899124,5cyclictest6312-21systemd22:02:322
21038991211,1cyclictest33-21ksoftirqd/223:47:422
21038991211,1cyclictest33-21ksoftirqd/221:24:562
21038991211,1cyclictest33-21ksoftirqd/221:13:122
21038991211,1cyclictest33-21ksoftirqd/200:20:292
21038991210,1cyclictest709-21systemd-logind22:55:032
2103899120,12cyclictest3721-21kworker/2:300:15:192
2103599122,4cyclictest1-21systemd00:07:351
2103599122,4cyclictest0-21swapper/121:27:281
21035991210,1cyclictest25-21ksoftirqd/123:07:381
21035991210,1cyclictest25-21ksoftirqd/123:07:381
21035991210,1cyclictest25-21ksoftirqd/123:05:201
21035991210,1cyclictest25-21ksoftirqd/122:57:391
21035991210,1cyclictest25-21ksoftirqd/100:36:451
2102999129,3cyclictest9-21ksoftirqd/000:33:590
2102999122,4cyclictest17131-21systemd-cgroups00:27:010
21029991211,1cyclictest9-21ksoftirqd/023:51:170
21029991211,1cyclictest9-21ksoftirqd/021:12:410
21029991210,1cyclictest9-21ksoftirqd/023:05:170
21029991210,1cyclictest9-21ksoftirqd/021:32:090
2102999120,11cyclictest8068-21systemd-cgroups23:02:070
2102999120,11cyclictest12031-21sshd23:13:380
199022120,1sleep3401ktimersoftd/321:17:143
2106299114,1cyclictest73-21ksoftirqd/720:58:197
2106299114,1cyclictest73-21ksoftirqd/720:58:197
2106299114,1cyclictest73-21ksoftirqd/720:53:597
2106299114,1cyclictest73-21ksoftirqd/720:51:117
2106299114,1cyclictest73-21ksoftirqd/720:42:197
2106299114,1cyclictest73-21ksoftirqd/720:02:357
2106299114,1cyclictest73-21ksoftirqd/720:02:357
2106299114,1cyclictest73-21ksoftirqd/719:51:167
2106299114,1cyclictest73-21ksoftirqd/719:46:047
2106299114,1cyclictest73-21ksoftirqd/719:34:117
2106299114,1cyclictest73-21ksoftirqd/719:18:377
2106299114,1cyclictest73-21ksoftirqd/719:16:017
2106299111,2cyclictest0-21swapper/720:07:347
2105699119,1cyclictest65-21ksoftirqd/621:07:196
2105399114,4cyclictest15520-21sshd23:02:305
2105399112,7cyclictest31392-21sshd21:33:075
2105399112,4cyclictest9790-21sshd23:40:155
21053991110,1cyclictest57-21ksoftirqd/500:18:325
2105399110,5cyclictest13788-21bash23:54:055
2105399110,11cyclictest21943-21kworker/5:123:48:375
2105399110,10cyclictest6419-21sshd00:22:325
2105399110,10cyclictest1-21systemd00:29:105
2104799114,2cyclictest22993-21grepconf.sh00:25:274
2104799114,1cyclictest21231-21sshd21:40:134
2104799113,3cyclictest20088-21bash23:44:504
2104799112,4cyclictest694-21nscd22:22:294
2104799112,3cyclictest0-21swapper/420:01:254
2104799111,4cyclictest31946-21sshd00:18:124
2104799110,11cyclictest16623-21kworker/4:321:45:374
2104499119,1cyclictest41-21ksoftirqd/323:54:393
2104499119,1cyclictest41-21ksoftirqd/323:48:423
2104499119,1cyclictest41-21ksoftirqd/323:30:263
2104499119,1cyclictest41-21ksoftirqd/323:07:073
2104499119,1cyclictest41-21ksoftirqd/322:53:453
2104499119,1cyclictest41-21ksoftirqd/322:31:153
2104499119,1cyclictest41-21ksoftirqd/322:09:043
2104499119,1cyclictest41-21ksoftirqd/321:22:253
2104499119,1cyclictest41-21ksoftirqd/300:20:523
2104499119,1cyclictest41-21ksoftirqd/300:14:093
2104499119,1cyclictest32139-21sshd22:48:083
2104499118,3cyclictest41-21ksoftirqd/323:01:503
21044991110,1cyclictest41-21ksoftirqd/323:34:533
21044991110,1cyclictest41-21ksoftirqd/321:17:343
2104499110,10cyclictest18203-21kworker/3:422:24:143
2103899119,1cyclictest33-21ksoftirqd/221:55:002
2103899119,1cyclictest33-21ksoftirqd/221:17:472
2103899117,3cyclictest33-21ksoftirqd/200:08:052
2103899110,11cyclictest372-21kworker/2:223:36:012
2103899110,11cyclictest14128-21kworker/2:400:35:322
2103599119,1cyclictest25-21ksoftirqd/121:17:311
2103599119,1cyclictest0-21swapper/123:54:171
2103599113,7cyclictest4676-21grepconf.sh22:29:171
2103599112,4cyclictest18731-21sshd21:24:491
2103599112,4cyclictest17376-21bash00:17:241
2103599111,4cyclictest8691-21sshd23:23:021
2103599111,4cyclictest10002-21sshd22:12:201
2103599111,4cyclictest10002-21sshd22:12:201
2103599111,4cyclictest0-21swapper/123:31:371
2103599110,5cyclictest20746-21grepconf.sh23:14:091
2103599110,11cyclictest11894-21kworker/1:421:47:541
2103599110,10cyclictest6724-21sshd22:52:291
2103599110,10cyclictest0-21swapper/100:07:121
2102999119,2cyclictest670-21rs:main0
2102999119,1cyclictest9-21ksoftirqd/022:07:390
2102999119,1cyclictest9-21ksoftirqd/021:44:100
2102999119,1cyclictest22154-21sshd00:29:080
2102999117,1cyclictest9-21ksoftirqd/023:11:020
2102999117,1cyclictest9-21ksoftirqd/023:11:020
2102999114,3cyclictest22906-21sshd22:43:450
21029991110,1cyclictest9-21ksoftirqd/023:52:320
21029991110,1cyclictest9-21ksoftirqd/023:42:330
21029991110,1cyclictest9-21ksoftirqd/021:54:160
21029991110,1cyclictest9-21ksoftirqd/021:24:460
21029991110,1cyclictest16510-21kworker/0:322:37:450
21029991110,1cyclictest15-21kswork23:58:160
21029991110,1cyclictest15-21kswork23:58:160
21029991110,1cyclictest1-21systemd21:49:540
2102999110,11cyclictest0-21swapper/022:50:080
311042108,1sleep125-21ksoftirqd/122:17:281
311042108,1sleep125-21ksoftirqd/122:17:281
2106299103,1cyclictest73-21ksoftirqd/719:53:257
2106299103,1cyclictest73-21ksoftirqd/719:37:577
2106299103,1cyclictest73-21ksoftirqd/719:27:527
2106299103,1cyclictest73-21ksoftirqd/719:23:077
2105399108,1cyclictest57-21ksoftirqd/523:47:125
2105399102,7cyclictest25354-21sshd21:56:055
2105399102,5cyclictest18098-21sshd23:23:365
2105399101,5cyclictest12887-21perl21:47:315
2105399100,7cyclictest11757-21sshd22:16:195
2105399100,7cyclictest11757-21sshd22:16:195
2105399100,4cyclictest12327-21sshd22:31:465
2105399100,1cyclictest0-21swapper/521:25:135
2104799108,1cyclictest49-21ksoftirqd/422:52:364
2104799108,1cyclictest49-21ksoftirqd/421:57:304
2104799107,2cyclictest3589-21bash23:18:584
2104799102,3cyclictest23387-21sshd23:50:514
2104799100,4cyclictest0-21swapper/400:14:334
2104799100,10cyclictest11059-21kworker/4:000:28:294
2104499108,1cyclictest41-21ksoftirqd/323:39:003
2104499108,1cyclictest41-21ksoftirqd/321:48:393
2104499107,1cyclictest41-21ksoftirqd/322:02:133
2104499105,3cyclictest41-21ksoftirqd/323:21:443
2103899108,1cyclictest33-21ksoftirqd/221:40:152
2103899107,2cyclictest33-21ksoftirqd/222:58:362
2103599108,1cyclictest25-21ksoftirqd/123:37:261
2103599108,1cyclictest25-21ksoftirqd/121:41:071
2103599101,4cyclictest19398-21sshd22:24:171
2103599100,9cyclictest0-21swapper/122:39:181
2103599100,4cyclictest4710-21sshd00:22:261
2103599100,4cyclictest25757-21sshd21:54:101
2103599100,4cyclictest11618-21systemd-cgroups23:52:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional