You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 03:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Sat Jun 27, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5076521120,109pltrace0-21swapper/319:08:373
2289521060,98pltrace0-21swapper/619:05:206
228952900,76pltrace0-21swapper/519:05:245
412352890,2pltrace0-21swapper/723:23:027
228952890,81pltrace0-21swapper/119:06:361
2270852850,0pltrace0-21swapper/219:38:012
507652730,48pltrace0-21swapper/719:08:047
490027157,10sleep20-21swapper/219:05:472
280825844,10sleep00-21swapper/019:05:050
492225743,10sleep40-21swapper/419:06:054
2122752550,9pltrace78-21ksoftirqd/723:08:047
67032510,1sleep00-21swapper/022:51:220
1648152500,1pltrace0-21swapper/721:20:207
3061652480,7pltrace78-21ksoftirqd/700:29:497
3167152460,0pltrace0-21swapper/723:19:517
3061652450,3pltrace0-21swapper/700:30:057
1696852450,0pltrace0-21swapper/722:28:027
412352430,7pltrace78-21ksoftirqd/723:27:397
1696852430,9pltrace78-21ksoftirqd/722:32:377
864752420,7pltrace78-21ksoftirqd/723:30:437
742852420,7pltrace78-21ksoftirqd/722:54:457
2611552420,9pltrace78-21ksoftirqd/722:41:147
3041752410,8pltrace78-21ksoftirqd/721:33:507
1648152410,6pltrace0-21swapper/721:18:487
1275752410,2pltrace78-21ksoftirqd/721:50:477
1200052400,2pltrace12004-21pltrace-run22:58:021
785952390,6pltrace78-21ksoftirqd/700:05:397
773152390,9pltrace78-21ksoftirqd/722:18:187
3041752390,6pltrace78-21ksoftirqd/721:35:287
742852380,7pltrace78-21ksoftirqd/722:55:177
3068352380,7pltrace78-21ksoftirqd/722:47:407
1275752380,7pltrace78-21ksoftirqd/721:49:077
2611552370,6pltrace78-21ksoftirqd/722:39:147
1733652370,3pltrace0-21swapper/721:56:537
1733652370,3pltrace0-21swapper/721:56:537
335852360,1pltrace0-21swapper/700:00:037
2191852360,7pltrace78-21ksoftirqd/722:02:087
2191852360,7pltrace78-21ksoftirqd/722:02:087
730152350,6pltrace78-21ksoftirqd/700:38:117
1200052350,8pltrace78-21ksoftirqd/723:02:347
1697852340,10pltrace78-21ksoftirqd/700:15:327
1697852340,0pltrace0-21swapper/700:13:247
1317152340,0pltrace0-21swapper/723:35:147
773152330,9pltrace78-21ksoftirqd/722:21:197
706452330,0pltrace0-21swapper/720:08:197
2122752330,1pltrace0-21swapper/723:11:447
730152320,0pltrace0-21swapper/300:38:033
706452300,0pltrace0-21swapper/720:10:167
3103052300,0pltrace0-21swapper/722:08:157
335852290,6pltrace78-21ksoftirqd/723:59:127
318752270,3pltrace0-21swapper/722:13:177
3124752270,0pltrace0-21swapper/723:53:137
2671352260,0pltrace0-21swapper/723:48:127
2100852260,4pltrace0-21swapper/721:27:507
541099240,16cyclictest0-21swapper/523:48:445
541099240,1cyclictest0-21swapper/522:05:205
540599240,13cyclictest0-21swapper/400:19:404
538499230,22cyclictest0-21swapper/021:18:530
538499230,12cyclictest0-21swapper/000:02:020
538499228,2cyclictest0-21swapper/020:35:280
538499220,21cyclictest0-21swapper/021:37:350
2936152210,13pltrace29538-21basename20:50:002
5414992011,8cyclictest0-21swapper/600:23:406
541499200,4cyclictest0-21swapper/623:19:396
538499201,2cyclictest0-21swapper/021:14:390
541099199,3cyclictest14195-21gltestperf23:00:155
541099191,12cyclictest0-21swapper/519:51:095
541499189,3cyclictest0-21swapper/622:23:066
5414991810,2cyclictest1066-13audispd19:30:016
541499180,14cyclictest0-21swapper/620:12:516
541099181,1cyclictest0-21swapper/522:02:305
541099181,1cyclictest0-21swapper/522:02:305
541099180,1cyclictest0-21swapper/500:05:515
2100852180,12pltrace23017-21fschecks_time21:25:151
1696852180,13pltrace17828-21seq22:30:001
541799171,15cyclictest0-21swapper/720:26:137
541499176,5cyclictest0-21swapper/623:08:046
5414991713,3cyclictest1146-21snmpd00:12:246
541499170,7cyclictest0-21swapper/622:49:436
541499170,1cyclictest0-21swapper/621:14:416
5410991712,4cyclictest0-21swapper/523:41:055
541099170,14cyclictest0-21swapper/523:28:545
5405991711,4cyclictest0-21swapper/400:03:334
5405991711,3cyclictest0-21swapper/421:33:024
539699170,2cyclictest30850-21ssh22:07:392
539699170,12cyclictest0-21swapper/221:46:392
5392991711,5cyclictest0-21swapper/123:54:411
539299171,15cyclictest0-21swapper/120:39:241
539299171,15cyclictest0-21swapper/100:01:531
3068352170,12pltrace31368-21ssh22:44:350
814052160,6pltrace54-21ksoftirqd/421:10:144
541499166,5cyclictest0-21swapper/622:37:376
5414991611,4cyclictest0-21swapper/623:25:386
5414991611,4cyclictest0-21swapper/620:50:006
541099165,3cyclictest0-21swapper/500:34:065
5410991613,2cyclictest0-21swapper/523:38:205
5410991611,3cyclictest0-21swapper/519:18:415
541099160,2cyclictest2149-21ssh21:36:055
541099160,15cyclictest0-21swapper/500:03:065
5405991611,4cyclictest0-21swapper/421:00:004
5405991611,3cyclictest0-21swapper/422:36:014
5405991611,3cyclictest0-21swapper/422:30:104
5405991611,2cyclictest0-21swapper/419:43:014
540599160,4cyclictest0-21swapper/422:10:394
5401991611,3cyclictest0-21swapper/321:03:373
539699161,7cyclictest0-21swapper/222:57:492
539699160,8cyclictest0-21swapper/222:19:032
5392991611,3cyclictest0-21swapper/119:58:421
538499161,4cyclictest0-21swapper/019:10:220
538499160,4cyclictest0-21swapper/022:49:360
538499160,15cyclictest26993-21munin-run22:40:010
538499160,15cyclictest0-21swapper/019:24:020
318752160,4pltrace3469-21chrt22:13:410
3167152160,10pltrace54-21ksoftirqd/423:18:244
3061652160,4pltrace31025-21ssh00:28:590
2828352160,1pltrace0-21swapper/219:48:322
2607452160,0pltrace0-21swapper/700:23:147
145252160,0pltrace0-21swapper/719:59:147
1263652160,0pltrace0-21swapper/720:20:067
5417991512,2cyclictest0-21swapper/721:08:027
541799151,3cyclictest0-21swapper/720:19:307
541799150,3cyclictest0-21swapper/720:04:087
541799150,14cyclictest0-21swapper/723:43:237
541499156,3cyclictest0-21swapper/621:00:196
541499150,8cyclictest0-21swapper/623:21:096
541499150,14cyclictest0-21swapper/620:07:546
541099159,1cyclictest0-21swapper/520:42:205
5410991512,2cyclictest0-21swapper/523:57:365
5410991512,2cyclictest0-21swapper/523:30:245
5410991510,4cyclictest0-21swapper/519:10:325
5410991510,3cyclictest0-21swapper/520:22:095
541099151,4cyclictest0-21swapper/500:36:425
541099150,7cyclictest0-21swapper/520:33:085
541099150,14cyclictest0-21swapper/520:15:215
541099150,11cyclictest0-21swapper/500:11:275
540599159,3cyclictest0-21swapper/400:20:454
5405991513,1cyclictest0-21swapper/423:55:124
5405991510,3cyclictest0-21swapper/419:51:034
540599150,7cyclictest0-21swapper/421:56:154
540599150,7cyclictest0-21swapper/421:56:154
540599150,14cyclictest22066-21ssh23:09:314
540599150,14cyclictest0-21swapper/423:46:144
540599150,14cyclictest0-21swapper/422:56:264
540599150,14cyclictest0-21swapper/420:48:024
540599150,14cyclictest0-21swapper/419:38:594
540599150,1cyclictest0-21swapper/423:35:564
5401991511,3cyclictest0-21swapper/320:28:193
540199150,7cyclictest0-21swapper/323:38:473
540199150,7cyclictest0-21swapper/323:18:103
540199150,14cyclictest0-21swapper/322:05:093
540199150,14cyclictest0-21swapper/300:05:113
540199150,13cyclictest0-21swapper/322:17:423
5396991510,3cyclictest0-21swapper/221:21:112
539699150,7cyclictest0-21swapper/223:22:022
539699150,7cyclictest0-21swapper/222:34:192
539699150,7cyclictest0-21swapper/200:28:362
539699150,14cyclictest3731-21idleruntime-cro22:50:012
539699150,14cyclictest0-21swapper/223:54:052
539699150,13cyclictest0-21swapper/221:34:292
5392991510,3cyclictest0-21swapper/123:48:201
5392991510,3cyclictest0-21swapper/100:20:091
539299150,8cyclictest4415-21munin-run21:40:001
539299150,8cyclictest0-21swapper/122:22:271
539299150,14cyclictest0-21swapper/119:26:431
539299150,14cyclictest0-21swapper/119:16:591
538499151,3cyclictest0-21swapper/021:33:260
538499150,7cyclictest0-21swapper/021:53:300
538499150,7cyclictest0-21swapper/020:02:080
538499150,14cyclictest0-21swapper/023:56:380
538499150,14cyclictest0-21swapper/022:19:570
538499150,14cyclictest0-21swapper/000:37:420
327552150,9pltrace6309-21awk21:40:171
327552150,4pltrace6631-21switchtime21:40:210
327552150,10pltrace54-21ksoftirqd/421:40:204
3068352150,3pltrace31363-21ssh22:44:362
3041752150,5pltrace2567-21ssh21:36:503
2100852150,5pltrace1178-21runrttasks21:25:186
1821152150,6pltrace54-21ksoftirqd/420:30:124
1733652150,11pltrace54-21ksoftirqd/421:54:554
1733652150,1pltrace18265-21latency_hist21:55:001
1696852150,11pltrace54-21ksoftirqd/422:29:524
145252150,4pltrace2834-21perl20:00:133
5414991412,1cyclictest0-21swapper/623:48:496
5414991412,1cyclictest0-21swapper/621:21:586
541499141,12cyclictest0-21swapper/623:14:256
541499141,12cyclictest0-21swapper/622:01:276
541499141,12cyclictest0-21swapper/622:01:276
541499140,3cyclictest0-21swapper/620:42:496
541499140,1cyclictest0-21swapper/622:32:046
541499140,1cyclictest0-21swapper/600:19:356
541099148,2cyclictest1047-21NetworkManager00:23:575
541099147,1cyclictest0-21swapper/521:55:135
541099147,1cyclictest0-21swapper/521:55:135
541099146,2cyclictest0-21swapper/521:31:135
5410991413,1cyclictest0-21swapper/521:50:405
5410991412,2cyclictest0-21swapper/522:41:015
5410991412,1cyclictest0-21swapper/521:10:115
541099141,12cyclictest0-21swapper/519:26:055
541099140,14cyclictest0-21swapper/522:15:555
541099140,13cyclictest3348-21ssh22:49:095
541099140,13cyclictest0-21swapper/522:55:065
541099140,13cyclictest0-21swapper/519:45:015
541099140,1cyclictest0-21swapper/523:10:395
541099140,1cyclictest0-21swapper/522:23:515
541099140,1cyclictest0-21swapper/520:13:315
540599149,2cyclictest0-21swapper/420:04:364
5405991412,1cyclictest0-21swapper/423:41:274
5405991412,1cyclictest0-21swapper/421:46:294
540599140,7cyclictest0-21swapper/419:32:384
540599140,2cyclictest0-21swapper/400:06:004
540599140,14cyclictest0-21swapper/422:45:354
540599140,13cyclictest0-21swapper/421:16:324
540599140,13cyclictest0-21swapper/420:10:084
5401991412,1cyclictest0-21swapper/323:00:543
540199140,7cyclictest0-21swapper/320:15:573
540199140,14cyclictest0-21swapper/321:31:033
540199140,13cyclictest0-21swapper/322:02:273
540199140,13cyclictest0-21swapper/322:02:273
540199140,13cyclictest0-21swapper/319:45:533
540199140,1cyclictest0-21swapper/323:45:263
540199140,1cyclictest0-21swapper/321:59:233
540199140,1cyclictest0-21swapper/321:59:233
539699141,12cyclictest0-21swapper/222:25:092
539699140,7cyclictest0-21swapper/223:56:402
539699140,6cyclictest7681-21ssh00:02:402
539699140,13cyclictest0-21swapper/220:43:102
539699140,12cyclictest0-21swapper/221:11:592
539699140,1cyclictest0-21swapper/223:35:142
5392991413,1cyclictest0-21swapper/123:16:331
5392991410,3cyclictest0-21swapper/120:54:101
539299141,12cyclictest0-21swapper/119:14:071
539299140,3cyclictest0-21swapper/123:06:221
539299140,3cyclictest0-21swapper/121:03:381
539299140,14cyclictest0-21swapper/123:36:181
539299140,14cyclictest0-21swapper/100:35:241
539299140,13cyclictest0-21swapper/121:30:471
539299140,13cyclictest0-21swapper/120:25:041
539299140,1cyclictest0-21swapper/121:13:301
5384991412,1cyclictest0-21swapper/023:54:380
538499140,7cyclictest0-21swapper/000:23:510
538499140,13cyclictest0-21swapper/023:25:000
3167152140,2pltrace31893-21ssh23:18:240
3061652140,11pltrace54-21ksoftirqd/400:29:184
2270852140,2pltrace0-21swapper/719:40:187
2100852140,5pltrace0-21swapper/221:25:172
1697852140,4pltrace18802-21sh00:15:133
159522140,0sleep00-21swapper/022:25:430
1263652140,4pltrace15382-21chrt20:22:382
1200052140,6pltrace0-21swapper/623:01:246
5417991312,1cyclictest0-21swapper/721:41:417
5417991312,1cyclictest0-21swapper/721:12:427
541499138,3cyclictest0-21swapper/623:41:296
5414991312,1cyclictest0-21swapper/622:16:126
5414991312,1cyclictest0-21swapper/621:40:266
5414991311,1cyclictest0-21swapper/600:25:056
541499130,13cyclictest0-21swapper/622:51:406
541499130,13cyclictest0-21swapper/600:08:346
541499130,12cyclictest0-21swapper/622:59:226
541499130,12cyclictest0-21swapper/620:50:196
541099136,1cyclictest0-21swapper/521:25:185
5410991312,1cyclictest0-21swapper/522:30:495
5410991312,1cyclictest0-21swapper/521:19:545
5410991311,2cyclictest0-21swapper/523:54:515
5410991310,2cyclictest0-21swapper/522:54:585
541099130,13cyclictest0-21swapper/521:48:245
541099130,13cyclictest0-21swapper/500:27:235
541099130,12cyclictest0-21swapper/520:00:395
540599139,3cyclictest0-21swapper/419:20:054
540599138,3cyclictest0-21swapper/423:00:164
5405991312,1cyclictest0-21swapper/423:20:534
5405991312,1cyclictest0-21swapper/422:20:594
5405991312,1cyclictest0-21swapper/421:27:134
5405991312,1cyclictest0-21swapper/400:11:434
540599130,13cyclictest0-21swapper/422:51:154
540599130,12cyclictest0-21swapper/400:35:414
540599130,1cyclictest0-21swapper/423:26:334
540599130,1cyclictest0-21swapper/421:23:594
540199138,3cyclictest0-21swapper/323:59:383
540199138,3cyclictest0-21swapper/321:20:443
5401991312,1cyclictest0-21swapper/323:50:563
5401991312,1cyclictest0-21swapper/323:06:343
5401991312,1cyclictest0-21swapper/322:50:033
5401991312,1cyclictest0-21swapper/321:44:493
5401991311,1cyclictest0-21swapper/323:11:453
5401991311,1cyclictest0-21swapper/321:15:213
540199130,13cyclictest0-21swapper/322:10:233
540199130,13cyclictest0-21swapper/321:27:493
539699138,2cyclictest0-21swapper/219:26:352
5396991311,1cyclictest0-21swapper/200:21:422
5396991310,2cyclictest2405-21ssh21:36:332
539699130,12cyclictest0-21swapper/222:24:192
539699130,12cyclictest0-21swapper/220:35:432
539299137,5cyclictest0-21swapper/120:34:571
539299137,4cyclictest0-21swapper/123:59:471
5392991312,1cyclictest0-21swapper/123:44:331
5392991312,1cyclictest0-21swapper/123:26:541
5392991312,1cyclictest0-21swapper/123:21:141
5392991312,1cyclictest0-21swapper/122:36:141
5392991311,1cyclictest0-21swapper/100:14:211
539299130,13cyclictest0-21swapper/123:31:361
539299130,13cyclictest0-21swapper/123:11:511
539299130,13cyclictest0-21swapper/122:52:061
539299130,13cyclictest0-21swapper/122:33:001
539299130,13cyclictest0-21swapper/122:09:411
539299130,13cyclictest0-21swapper/121:22:051
539299130,13cyclictest0-21swapper/100:19:511
539299130,12cyclictest0-21swapper/122:10:181
5384991312,1cyclictest0-21swapper/023:40:520
5384991312,1cyclictest0-21swapper/021:47:130
5384991311,1cyclictest0-21swapper/021:56:070
5384991311,1cyclictest0-21swapper/021:56:070
5384991311,1cyclictest0-21swapper/000:08:240
538499130,13cyclictest0-21swapper/023:09:560
538499130,13cyclictest0-21swapper/020:30:180
538499130,13cyclictest0-21swapper/000:19:240
538499130,13cyclictest0-21swapper/000:13:540
538499130,1cyclictest0-21swapper/023:14:380
538499130,1cyclictest0-21swapper/000:32:410
534752130,4pltrace0-21swapper/121:05:161
412352130,4pltrace0-21swapper/323:27:243
327552130,9pltrace0-21swapper/221:40:262
318752130,5pltrace0-21swapper/522:13:515
3167152130,5pltrace0-21swapper/523:18:325
3061652130,7pltrace0-21swapper/300:29:253
2936152130,1pltrace29879-21sshd20:50:042
2644952130,5pltrace54-21ksoftirqd/423:15:004
2219952130,10pltrace25232-21timerandwakeup23:45:200
2100852130,5pltrace23325-21ssh21:25:160
1733652130,1pltrace18577-21sh21:55:011
1733652130,1pltrace18577-21sh21:55:011
1713552130,6pltrace0-21swapper/019:29:560
1317152130,5pltrace0-21swapper/623:34:126
1200052130,6pltrace0-21swapper/123:01:121
1200052130,6pltrace0-21swapper/023:01:070
541799126,5cyclictest0-21swapper/719:11:407
541499126,5cyclictest0-21swapper/620:25:496
541499126,5cyclictest0-21swapper/620:19:516
5414991211,1cyclictest0-21swapper/621:45:276
5414991211,1cyclictest0-21swapper/600:38:226
541499120,12cyclictest0-21swapper/600:30:356
541099128,1cyclictest0-21swapper/520:28:055
541099122,8cyclictest0-21swapper/521:05:135
5410991211,1cyclictest0-21swapper/521:41:075
5410991210,1cyclictest0-21swapper/520:49:285
5410991210,1cyclictest0-21swapper/519:42:165
541099120,11cyclictest0-21swapper/523:05:285
540599128,3cyclictest1146-21snmpd19:12:074
540599126,5cyclictest0-21swapper/421:03:494
540599124,7cyclictest15688-21grep19:25:154
5405991211,1cyclictest0-21swapper/423:30:464
5405991211,1cyclictest0-21swapper/422:41:524
5405991211,1cyclictest0-21swapper/419:55:164
5405991210,1cyclictest0-21swapper/422:16:464
5405991210,1cyclictest0-21swapper/422:06:244
5405991210,1cyclictest0-21swapper/420:40:554
540599120,11cyclictest0-21swapper/420:15:594
540599120,1cyclictest0-21swapper/421:08:464
540199129,2cyclictest1146-21snmpd22:40:043
540199129,2cyclictest0-21swapper/321:55:013
540199128,3cyclictest1438-21timerwakeupswit22:45:223
540199126,3cyclictest0-21swapper/322:35:463
540199122,8cyclictest0-21swapper/319:52:393
540199122,8cyclictest0-21swapper/319:17:473
5401991211,1cyclictest0-21swapper/322:23:013
5401991211,1cyclictest0-21swapper/300:30:263
5401991211,1cyclictest0-21swapper/300:22:113
539699128,2cyclictest0-21swapper/222:35:282
539699126,5cyclictest0-21swapper/221:58:152
539699126,5cyclictest0-21swapper/221:58:152
5396991211,1cyclictest0-21swapper/223:01:242
5396991211,1cyclictest0-21swapper/221:16:002
539699120,11cyclictest0-21swapper/219:18:392
539699120,11cyclictest0-21swapper/219:14:102
539299120,11cyclictest0-21swapper/119:23:161
539299120,1cyclictest0-21swapper/120:22:101
539299120,1cyclictest0-21swapper/120:10:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional