You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 04:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Jun 30, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25210521270,114pltrace0-21swapper/719:09:087
25210521220,118pltrace0-21swapper/519:09:115
27997521090,93pltrace0-21swapper/619:10:006
25210521080,105pltrace0-21swapper/219:08:152
25210521050,102pltrace0-21swapper/119:09:031
2305021010,0sleep10-21swapper/123:18:561
2521052790,54pltrace0-21swapper/319:08:533
2779927144,8sleep40-21swapper/419:07:174
2789625945,10sleep00-21swapper/019:08:410
2382252500,3pltrace26090-21sed00:30:217
313152480,7pltrace78-21ksoftirqd/721:18:427
2395852470,9pltrace78-21ksoftirqd/722:47:187
1436652470,9pltrace78-21ksoftirqd/723:13:537
63952450,8pltrace78-21ksoftirqd/722:58:517
2805252420,4pltrace0-21swapper/723:26:497
2171752420,5pltrace78-21ksoftirqd/721:39:237
1296052420,0pltrace0-21swapper/722:00:127
182952410,4pltrace0-21swapper/700:05:197
525452400,8pltrace78-21ksoftirqd/723:00:447
2699352400,7pltrace78-21ksoftirqd/721:43:027
983652390,8pltrace78-21ksoftirqd/723:07:187
2672552360,1pltrace0-21swapper/222:14:512
1504452360,3pltrace18505-21ssh00:22:347
2832652350,5pltrace0-21swapper/700:35:187
2067552320,13pltrace78-21ksoftirqd/723:50:327
871252310,4pltrace0-21swapper/722:32:247
1296052310,6pltrace78-21ksoftirqd/721:59:527
3106852270,2pltrace0-21swapper/721:12:317
2523552270,0pltrace0-21swapper/723:55:147
1401052270,0pltrace0-21swapper/722:39:437
348952260,5pltrace78-21ksoftirqd/722:25:167
28244992617,8cyclictest0-21swapper/620:26:566
2395852260,7pltrace0-21swapper/722:44:597
2267952260,7pltrace0-21swapper/720:55:147
1219852260,4pltrace0-21swapper/721:24:557
2823799241,16cyclictest0-21swapper/520:11:495
1219852240,5pltrace78-21ksoftirqd/721:29:387
63952230,6pltrace78-21ksoftirqd/722:55:017
1152652230,0pltrace0-21swapper/720:35:127
2822899220,15cyclictest0-21swapper/323:51:383
2171752220,2pltrace23396-21irqstats_LOC21:35:161
204372220,1sleep5601rcuc/523:49:215
1431152220,1pltrace0-21swapper/220:39:502
348952210,6pltrace0-21swapper/722:24:557
2823399211,19cyclictest0-21swapper/400:00:054
2822899200,7cyclictest0-21swapper/323:48:023
2824999190,18cyclictest0-21swapper/700:25:567
28233991914,4cyclictest0-21swapper/400:20:004
28228991914,4cyclictest0-21swapper/322:54:093
28228991912,1cyclictest0-21swapper/300:18:343
2822899191,3cyclictest0-21swapper/322:58:093
2822899191,3cyclictest0-21swapper/320:57:063
2822899190,15cyclictest0-21swapper/322:05:353
2822899190,1cyclictest0-21swapper/322:13:353
2823399181,15cyclictest0-21swapper/400:31:184
2821199180,16cyclictest29833-21tune2fs22:50:150
2523552180,14pltrace54-21ksoftirqd/423:57:024
765952170,3pltrace0-21swapper/719:29:597
28249991712,3cyclictest0-21swapper/719:40:497
2824999170,2cyclictest0-21swapper/723:38:057
28244991711,5cyclictest0-21swapper/619:40:316
28244991711,3cyclictest0-21swapper/623:21:046
28233991711,5cyclictest0-21swapper/419:38:104
2822899178,3cyclictest0-21swapper/321:20:573
2822899170,13cyclictest0-21swapper/323:01:303
2822399171,15cyclictest0-21swapper/223:34:282
2822399170,16cyclictest0-21swapper/222:32:072
28211991711,5cyclictest0-21swapper/022:45:330
2719252170,3pltrace0-21swapper/720:05:067
1601952170,4pltrace0-21swapper/719:45:057
2828352160,5pltrace0-21swapper/221:05:212
2824499161,8cyclictest0-21swapper/622:37:516
2824499160,8cyclictest0-21swapper/623:50:086
28237991611,4cyclictest0-21swapper/523:10:015
2823799161,8cyclictest0-21swapper/523:33:165
2823799161,8cyclictest0-21swapper/521:28:285
2823799161,14cyclictest0-21swapper/520:30:505
2823399161,7cyclictest0-21swapper/400:11:334
2823399161,4cyclictest0-21swapper/423:42:384
2823399160,4cyclictest0-21swapper/419:45:374
28228991613,2cyclictest0-21swapper/323:16:243
28228991612,1cyclictest0-21swapper/323:26:263
28228991612,1cyclictest0-21swapper/323:07:393
28228991610,3cyclictest0-21swapper/322:30:053
2822899160,15cyclictest0-21swapper/322:18:263
2822899160,13cyclictest0-21swapper/321:55:463
2822899160,12cyclictest0-21swapper/319:18:453
2822399161,7cyclictest0-21swapper/221:19:452
2822399160,15cyclictest0-21swapper/220:11:102
28217991610,5cyclictest0-21swapper/123:23:131
2821799161,4cyclictest0-21swapper/123:09:311
2821799160,8cyclictest0-21swapper/120:15:101
2821199161,4cyclictest0-21swapper/020:03:380
2821199160,8cyclictest0-21swapper/021:04:570
2821199160,15cyclictest0-21swapper/019:21:270
2395852160,1pltrace0-21swapper/322:48:293
1296052160,12pltrace54-21ksoftirqd/422:00:214
1219852160,13pltrace0-21swapper/221:25:222
1152652160,2pltrace0-21swapper/620:35:136
2824999150,8cyclictest0-21swapper/720:01:137
2824999150,7cyclictest0-21swapper/723:45:507
2824499150,8cyclictest0-21swapper/623:16:496
2824499150,7cyclictest0-21swapper/622:31:596
2824499150,7cyclictest0-21swapper/622:15:296
2824499150,7cyclictest0-21swapper/619:36:546
2824499150,7cyclictest0-21swapper/600:08:396
2824499150,4cyclictest0-21swapper/622:43:516
2824499150,14cyclictest0-21swapper/621:34:286
2823799150,7cyclictest0-21swapper/520:26:025
2823799150,7cyclictest0-21swapper/500:02:325
2823799150,14cyclictest0-21swapper/520:36:475
28233991510,4cyclictest0-21swapper/420:40:144
28233991510,3cyclictest0-21swapper/422:52:394
2823399151,7cyclictest0-21swapper/420:50:384
2823399150,3cyclictest0-21swapper/419:30:094
2823399150,14cyclictest7045-21ssh22:27:004
2823399150,14cyclictest0-21swapper/422:39:314
2822899150,8cyclictest0-21swapper/321:47:073
2822899150,4cyclictest0-21swapper/323:56:023
2822899150,14cyclictest0-21swapper/320:54:303
28223991511,3cyclictest1178-21runrttasks23:20:132
28223991511,3cyclictest0-21swapper/220:56:272
2822399151,3cyclictest0-21swapper/220:06:252
2822399150,8cyclictest0-21swapper/222:28:262
2822399150,8cyclictest0-21swapper/220:33:562
2822399150,7cyclictest0-21swapper/223:47:562
2822399150,4cyclictest0-21swapper/222:54:542
2822399150,14cyclictest0-21swapper/222:00:522
2822399150,14cyclictest0-21swapper/221:48:532
2822399150,14cyclictest0-21swapper/221:39:432
2821799159,5cyclictest0-21swapper/122:51:121
2821799159,5cyclictest0-21swapper/122:15:501
28217991512,2cyclictest31245-21sh21:44:001
2821799150,8cyclictest0-21swapper/121:20:091
2821799150,8cyclictest0-21swapper/100:19:521
2821799150,7cyclictest0-21swapper/100:26:071
2821799150,3cyclictest0-21swapper/122:30:291
2821799150,14cyclictest0-21swapper/123:53:021
2821199150,7cyclictest0-21swapper/023:35:020
2821199150,14cyclictest0-21swapper/021:05:450
2821199150,13cyclictest0-21swapper/021:17:540
270802150,1sleep10-21swapper/122:46:351
2672552150,4pltrace0-21swapper/522:15:165
2672552150,3pltrace0-21swapper/222:15:182
2171752150,9pltrace23677-21netstat21:35:185
208852150,3pltrace0-21swapper/719:20:247
2067552150,12pltrace0-21swapper/023:52:510
1929652150,13pltrace0-21swapper/222:40:512
767252140,5pltrace0-21swapper/221:22:142
624152140,10pltrace54-21ksoftirqd/423:39:074
622752140,6pltrace9807-21sh00:12:511
3085752140,1pltrace30861-21pltrace-run19:14:504
2824999149,3cyclictest0-21swapper/720:26:537
28244991413,1cyclictest0-21swapper/623:28:146
2824499140,13cyclictest0-21swapper/623:31:196
2824499140,13cyclictest0-21swapper/620:59:516
2824499140,13cyclictest0-21swapper/600:30:546
2824499140,1cyclictest0-21swapper/623:38:466
2824499140,1cyclictest0-21swapper/622:27:516
2824499140,1cyclictest0-21swapper/621:42:216
2823799149,2cyclictest0-21swapper/522:42:065
28237991413,1cyclictest0-21swapper/523:57:125
28237991413,1cyclictest0-21swapper/523:04:065
28237991413,1cyclictest0-21swapper/522:35:075
28237991413,1cyclictest0-21swapper/521:51:445
28237991413,1cyclictest0-21swapper/521:51:445
28237991413,1cyclictest0-21swapper/500:17:275
2823799140,8cyclictest0-21swapper/519:19:235
2823799140,7cyclictest0-21swapper/520:21:245
2823799140,7cyclictest0-21swapper/519:49:285
2823799140,14cyclictest0-21swapper/522:31:045
2823799140,1cyclictest0-21swapper/522:07:365
2823399149,4cyclictest28195-21sed22:15:144
28233991412,1cyclictest0-21swapper/422:12:484
28233991412,1cyclictest0-21swapper/421:56:184
28233991412,1cyclictest0-21swapper/400:28:094
28233991411,2cyclictest0-21swapper/423:05:314
2823399141,12cyclictest0-21swapper/423:54:294
2823399140,8cyclictest0-21swapper/420:29:114
2823399140,7cyclictest0-21swapper/419:51:164
2823399140,7cyclictest0-21swapper/400:36:524
2823399140,13cyclictest0-21swapper/420:00:534
2823399140,1cyclictest0-21swapper/422:56:024
2823399140,1cyclictest0-21swapper/400:22:104
28228991413,1cyclictest0-21swapper/323:32:063
28228991413,1cyclictest0-21swapper/300:38:103
28228991412,1cyclictest0-21swapper/322:21:313
28228991412,1cyclictest0-21swapper/321:51:533
28228991412,1cyclictest0-21swapper/321:51:533
2822899140,14cyclictest0-21swapper/323:20:463
2822899140,14cyclictest0-21swapper/300:12:353
2822899140,13cyclictest0-21swapper/322:42:533
2822899140,1cyclictest0-21swapper/323:36:283
2822899140,1cyclictest0-21swapper/322:37:033
2822899140,1cyclictest0-21swapper/321:27:163
2822899140,1cyclictest0-21swapper/321:15:273
28223991413,1cyclictest0-21swapper/223:27:192
28223991413,1cyclictest0-21swapper/221:11:292
28223991413,1cyclictest0-21swapper/200:13:282
2822399140,7cyclictest0-21swapper/223:00:392
2822399140,7cyclictest0-21swapper/222:37:592
2822399140,3cyclictest0-21swapper/219:25:032
2822399140,14cyclictest0-21swapper/222:55:452
2822399140,14cyclictest0-21swapper/200:28:512
2822399140,14cyclictest0-21swapper/200:24:092
2822399140,13cyclictest0-21swapper/222:45:332
2822399140,1cyclictest0-21swapper/223:53:442
28217991413,1cyclictest0-21swapper/123:25:021
28217991413,1cyclictest0-21swapper/121:45:181
2821799140,9cyclictest0-21swapper/123:04:401
2821799140,7cyclictest0-21swapper/123:35:561
2821799140,3cyclictest0-21swapper/119:20:241
2821799140,14cyclictest0-21swapper/100:39:211
2821799140,1cyclictest0-21swapper/121:17:561
2821799140,1cyclictest0-21swapper/121:13:051
28211991412,1cyclictest0-21swapper/022:35:080
28211991412,1cyclictest0-21swapper/021:48:010
28211991412,1cyclictest0-21swapper/021:27:080
2821199140,14cyclictest0-21swapper/022:41:270
2821199140,13cyclictest0-21swapper/022:27:310
2821199140,13cyclictest0-21swapper/000:20:320
2821199140,13cyclictest0-21swapper/000:05:190
2821199140,1cyclictest0-21swapper/021:30:120
2438452140,5pltrace0-21swapper/320:04:223
188842140,1sleep238-21ksoftirqd/223:14:492
1880952140,7pltrace0-21swapper/019:54:190
1436652140,6pltrace54-21ksoftirqd/423:12:174
1296052140,8pltrace15634-21chrt22:00:325
1296052140,5pltrace0-21swapper/122:00:341
1296052140,2pltrace1146-21snmpd22:00:250
1155152140,4pltrace12983-21grep23:40:130
1152652140,0pltrace0-21swapper/720:34:567
767252130,6pltrace0-21swapper/021:22:180
622752130,5pltrace0-21swapper/600:12:546
622752130,5pltrace0-21swapper/500:12:545
2979652130,1pltrace0-21swapper/000:02:110
2832652130,4pltrace0-21swapper/500:37:495
2824999137,5cyclictest78-21ksoftirqd/700:04:397
2824999135,7cyclictest0-21swapper/723:20:217
28249991312,1cyclictest0-21swapper/719:10:237
2824999130,12cyclictest0-21swapper/720:41:277
28244991312,1cyclictest0-21swapper/623:47:506
28244991312,1cyclictest0-21swapper/622:56:306
28244991312,1cyclictest0-21swapper/622:49:236
2824499130,7cyclictest0-21swapper/621:15:266
2824499130,13cyclictest0-21swapper/622:03:246
2824499130,13cyclictest0-21swapper/621:12:346
2824499130,12cyclictest0-21swapper/623:00:046
2824499130,12cyclictest0-21swapper/600:28:036
2824499130,12cyclictest0-21swapper/600:21:016
2824499130,1cyclictest0-21swapper/622:21:136
28237991312,1cyclictest0-21swapper/523:38:165
28237991312,1cyclictest0-21swapper/523:17:425
28237991312,1cyclictest0-21swapper/523:07:115
28237991312,1cyclictest0-21swapper/522:55:415
2823799130,13cyclictest0-21swapper/521:58:125
28233991312,1cyclictest0-21swapper/423:19:504
28233991311,1cyclictest0-21swapper/423:31:394
28233991311,1cyclictest0-21swapper/422:23:004
28233991311,1cyclictest0-21swapper/421:40:164
2823399130,13cyclictest0-21swapper/423:22:544
2823399130,13cyclictest0-21swapper/422:43:344
2823399130,13cyclictest0-21swapper/421:36:224
2823399130,1cyclictest0-21swapper/423:46:524
2823399130,1cyclictest0-21swapper/422:31:254
2822899138,4cyclictest0-21swapper/300:34:523
2822899138,2cyclictest0-21swapper/321:06:303
28228991312,1cyclictest0-21swapper/323:12:023
28228991312,1cyclictest0-21swapper/320:19:453
28228991311,1cyclictest0-21swapper/320:42:163
2822899130,13cyclictest0-21swapper/300:02:423
2822899130,1cyclictest0-21swapper/319:35:533
2822399137,3cyclictest0-21swapper/222:24:262
28223991311,1cyclictest0-21swapper/223:18:352
2822399130,13cyclictest0-21swapper/200:33:332
2822399130,12cyclictest0-21swapper/222:05:442
28217991312,1cyclictest0-21swapper/122:44:341
28217991312,1cyclictest0-21swapper/122:22:421
28217991312,1cyclictest0-21swapper/122:12:591
28217991312,1cyclictest0-21swapper/100:02:361
28217991310,2cyclictest0-21swapper/121:50:551
28217991310,2cyclictest0-21swapper/121:50:551
2821799130,13cyclictest0-21swapper/123:11:551
2821799130,13cyclictest0-21swapper/121:33:391
2821799130,12cyclictest0-21swapper/119:25:241
2821799130,1cyclictest0-21swapper/122:56:321
28211991312,1cyclictest0-21swapper/023:31:280
2821199130,13cyclictest0-21swapper/023:13:010
2821199130,12cyclictest0-21swapper/019:56:250
2267952130,4pltrace0-21swapper/120:55:241
2067552130,5pltrace0-21swapper/523:50:465
1943952130,5pltrace0-21swapper/300:25:453
1880952130,0pltrace0-21swapper/319:53:323
1710452130,0pltrace0-21swapper/720:49:257
1436652130,5pltrace0-21swapper/623:12:326
1219852130,4pltrace14980-21ssh21:25:466
595352120,10pltrace0-21swapper/120:28:331
487552120,5pltrace0-21swapper/019:28:470
348952120,1pltrace7704-21ssh22:28:095
316752120,5pltrace0-21swapper/020:23:380
2998852120,5pltrace0-21swapper/120:13:271
2828352120,5pltrace0-21swapper/621:05:346
2824999127,4cyclictest78-21ksoftirqd/722:17:307
2824999126,5cyclictest78-21ksoftirqd/722:08:047
2824999125,6cyclictest0-21swapper/721:52:227
2824999125,6cyclictest0-21swapper/721:52:227
2824999123,7cyclictest0-21swapper/723:16:107
28249991211,1cyclictest0-21swapper/700:10:437
2824999120,5cyclictest0-21swapper/700:16:067
2824999120,12cyclictest0-21swapper/723:41:057
2824999120,11cyclictest0-21swapper/722:13:297
2824999120,11cyclictest0-21swapper/719:31:357
2824499125,5cyclictest28567-21cut20:05:146
28244991211,1cyclictest0-21swapper/623:06:426
28244991211,1cyclictest0-21swapper/622:51:106
28244991211,1cyclictest0-21swapper/620:20:266
28244991210,1cyclictest0-21swapper/622:05:116
28244991210,1cyclictest0-21swapper/621:46:146
2824499120,11cyclictest0-21swapper/620:04:406
2823799127,3cyclictest0-21swapper/522:49:575
2823799126,5cyclictest0-21swapper/520:49:175
2823799126,5cyclictest0-21swapper/519:20:425
2823799122,8cyclictest0-21swapper/520:04:015
28237991211,1cyclictest0-21swapper/521:12:525
2823799120,11cyclictest0-21swapper/523:40:025
2823399126,5cyclictest3806-21ntpq00:05:234
28233991211,1cyclictest0-21swapper/423:27:174
28233991211,1cyclictest0-21swapper/421:23:454
28233991211,1cyclictest0-21swapper/421:17:364
28228991211,1cyclictest0-21swapper/320:26:043
28228991211,1cyclictest0-21swapper/319:20:153
28228991211,1cyclictest0-21swapper/300:21:583
2822899120,11cyclictest0-21swapper/322:25:293
2822899120,11cyclictest0-21swapper/320:33:113
2822899120,11cyclictest0-21swapper/320:05:223
2822899120,11cyclictest0-21swapper/319:14:483
2822899120,1cyclictest0-21swapper/320:21:523
2822399126,3cyclictest0-21swapper/223:09:102
28223991211,1cyclictest0-21swapper/221:56:392
28223991211,1cyclictest0-21swapper/221:32:032
28223991211,1cyclictest0-21swapper/200:35:392
2822399120,11cyclictest0-21swapper/220:46:532
28217991211,1cyclictest0-21swapper/121:26:411
28217991211,1cyclictest0-21swapper/100:24:281
2821799121,5cyclictest1055-13auditd19:40:021
2821799120,12cyclictest0-21swapper/121:56:581
2821799120,11cyclictest0-21swapper/122:26:591
2821199128,2cyclictest0-21swapper/023:27:130
2821199127,2cyclictest0-21swapper/021:35:250
2821199127,2cyclictest0-21swapper/020:43:350
28211991210,1cyclictest0-21swapper/023:05:050
2821199120,12cyclictest0-21swapper/023:16:050
2821199120,11cyclictest0-21swapper/020:48:360
2821199120,1cyclictest0-21swapper/023:24:010
2267952120,6pltrace0-21swapper/020:55:270
2267952120,4pltrace0-21swapper/520:55:255
2213552120,2pltrace24838-21chrt22:10:346
2171752120,5pltrace0-21swapper/621:35:206
1756052120,6pltrace54-21ksoftirqd/422:05:254
1673052120,8pltrace54-21ksoftirqd/421:34:274
1431152120,2pltrace14713-21/usr/sbin/munin20:40:126
1152652120,4pltrace0-21swapper/120:35:161
1064552120,2pltrace14436-21sh00:18:246
1044652120,3pltrace13062-21chrt19:37:410
3162752110,7pltrace314-21uniq21:45:135
2824999115,5cyclictest78-21ksoftirqd/721:45:207
2824999114,6cyclictest0-21swapper/719:50:167
2824999114,6cyclictest0-21swapper/719:15:207
28249991110,1cyclictest0-21swapper/721:30:167
28249991110,1cyclictest0-21swapper/721:08:257
2824999110,11cyclictest0-21swapper/723:30:537
2824999110,11cyclictest0-21swapper/720:53:127
2824999110,1cyclictest0-21swapper/719:57:497
2824499115,5cyclictest0-21swapper/620:34:566
2824499112,7cyclictest0-21swapper/623:44:476
28244991110,1cyclictest0-21swapper/621:52:436
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional