You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 19:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Fri Mar 13, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16262521200,112pltrace0-21swapper/707:05:227
19048521090,105pltrace0-21swapper/607:10:006
16262521050,101pltrace0-21swapper/307:05:133
10722940,1sleep50-21swapper/510:25:165
1904852870,83pltrace0-21swapper/207:07:452
1626252760,67pltrace0-21swapper/507:05:105
1899226955,10sleep10-21swapper/107:05:381
1909125945,10sleep00-21swapper/007:06:420
1905625945,10sleep40-21swapper/407:06:134
1759452320,2pltrace0-21swapper/710:00:097
168422300,0sleep2361rcuc/211:50:202
116052290,0sleep70-21swapper/707:50:147
28742280,0sleep20-21swapper/209:30:152
256952270,0pltrace0-21swapper/208:31:092
2490852240,6pltrace25500-21date09:15:017
1949999241,16cyclictest0-21swapper/511:49:275
1417152220,0pltrace0-21swapper/711:49:477
1948599180,17cyclictest0-21swapper/210:40:122
19476991815,2cyclictest0-21swapper/008:58:160
1759452180,12pltrace17604-21chrt09:56:145
3092252170,13pltrace54-21ksoftirqd/412:18:014
19508991711,5cyclictest0-21swapper/712:26:487
19508991711,3cyclictest0-21swapper/708:04:047
1949199171,15cyclictest0-21swapper/410:48:424
1948999171,4cyclictest0-21swapper/310:00:263
1948599170,16cyclictest0-21swapper/211:31:212
1948599170,10cyclictest3352-21netstat12:25:182
1092952170,0pltrace0-21swapper/708:47:347
19508991611,3cyclictest0-21swapper/707:24:067
19508991611,2cyclictest0-21swapper/712:11:277
1949999161,8cyclictest0-21swapper/512:08:525
1949199160,8cyclictest0-21swapper/408:13:114
1948999161,3cyclictest0-21swapper/308:31:593
1948999160,15cyclictest0-21swapper/311:08:103
1948999160,15cyclictest0-21swapper/308:36:143
1948599160,15cyclictest0-21swapper/208:01:322
19480991612,3cyclictest0-21swapper/110:31:031
1948099161,4cyclictest0-21swapper/108:27:511
1948099160,15cyclictest0-21swapper/112:29:061
19476991611,4cyclictest0-21swapper/011:18:430
19476991611,4cyclictest0-21swapper/010:18:170
19476991611,3cyclictest0-21swapper/011:37:320
19476991611,3cyclictest0-21swapper/011:08:400
1947699161,8cyclictest0-21swapper/012:19:150
1947699161,8cyclictest0-21swapper/011:52:020
1947699161,8cyclictest0-21swapper/008:34:300
1947699161,7cyclictest0-21swapper/009:18:140
1947699161,4cyclictest0-21swapper/010:32:270
1947699160,15cyclictest0-21swapper/010:40:300
1947699160,15cyclictest0-21swapper/009:26:020
1947699160,15cyclictest0-21swapper/009:06:310
706652150,4pltrace9762-21uptime07:45:217
535352150,2pltrace0-21swapper/708:37:137
3048152150,3pltrace0-21swapper/709:25:157
3048152150,2pltrace0-21swapper/709:23:117
2876852150,6pltrace0-21swapper/310:20:193
2706252150,2pltrace0-21swapper/711:13:307
19508991510,3cyclictest0-21swapper/709:36:447
1950899150,7cyclictest0-21swapper/712:01:497
1950899150,7cyclictest0-21swapper/708:54:157
1950899150,14cyclictest0-21swapper/710:36:547
1950899150,14cyclictest0-21swapper/709:30:587
1950899150,1cyclictest0-21swapper/710:34:187
1949999150,8cyclictest0-21swapper/510:52:435
1949999150,7cyclictest0-21swapper/509:28:455
1949999150,2cyclictest0-21swapper/512:10:205
1949999150,14cyclictest0-21swapper/509:53:435
1949999150,14cyclictest0-21swapper/507:50:005
1949199150,8cyclictest0-21swapper/408:44:304
1949199150,7cyclictest0-21swapper/411:52:544
1949199150,7cyclictest0-21swapper/410:40:424
1949199150,14cyclictest0-21swapper/412:31:514
1949199150,14cyclictest0-21swapper/411:12:314
1949199150,14cyclictest0-21swapper/409:40:154
19489991512,2cyclictest0-21swapper/312:33:253
19489991511,3cyclictest0-21swapper/307:34:303
1948999151,7cyclictest0-21swapper/309:00:453
1948999150,8cyclictest0-21swapper/312:27:203
1948999150,4cyclictest0-21swapper/308:45:143
1948999150,3cyclictest0-21swapper/307:36:113
1948999150,14cyclictest0-21swapper/311:41:203
1948599156,8cyclictest1146-21snmpd12:01:472
19485991510,4cyclictest0-21swapper/211:45:562
19485991510,4cyclictest0-21swapper/210:47:192
1948599150,5cyclictest0-21swapper/212:12:332
1948599150,4cyclictest0-21swapper/209:10:492
1948599150,4cyclictest0-21swapper/208:22:342
1948599150,14cyclictest0-21swapper/212:08:362
1948599150,14cyclictest0-21swapper/208:13:112
1948099159,5cyclictest0-21swapper/112:14:091
1948099150,8cyclictest0-21swapper/110:44:181
1948099150,8cyclictest0-21swapper/108:03:321
1948099150,14cyclictest0-21swapper/108:14:091
1947699151,8cyclictest0-21swapper/010:06:140
1947699151,13cyclictest0-21swapper/009:01:490
1947699150,8cyclictest0-21swapper/012:25:180
1947699150,7cyclictest3664-21latency_hist11:30:000
1947699150,5cyclictest0-21swapper/011:32:150
1947699150,14cyclictest0-21swapper/012:30:090
1947699150,14cyclictest0-21swapper/007:13:000
1947699150,13cyclictest29890-21tail07:25:140
814252140,4pltrace10474-21sort08:45:215
706652140,1pltrace0-21swapper/307:45:203
3110452140,3pltrace78-21ksoftirqd/707:26:167
2832052140,1pltrace28322-21tee07:21:103
2769352140,7pltrace28477-21cpu09:20:115
2660752140,1pltrace26611-21pltrace-run08:16:095
2148552140,8pltrace0-21swapper/311:01:383
19508991412,1cyclictest0-21swapper/711:20:167
1950899140,8cyclictest0-21swapper/711:37:207
1950899140,8cyclictest0-21swapper/708:43:427
1950899140,7cyclictest0-21swapper/712:09:367
1950899140,7cyclictest0-21swapper/708:32:147
1950899140,6cyclictest0-21swapper/708:21:177
1950899140,13cyclictest0-21swapper/712:35:137
19503991412,1cyclictest0-21swapper/612:23:226
19503991411,2cyclictest0-21swapper/611:54:046
1949999149,2cyclictest0-21swapper/511:07:145
1949999140,7cyclictest0-21swapper/510:23:325
1949999140,7cyclictest0-21swapper/509:11:305
19491991411,2cyclictest1478-21lldpd12:06:504
1949199141,12cyclictest0-21swapper/407:36:284
1948999140,7cyclictest0-21swapper/312:17:423
1948999140,13cyclictest0-21swapper/312:03:353
1948999140,13cyclictest0-21swapper/311:10:553
1948999140,1cyclictest0-21swapper/310:50:113
1948599149,4cyclictest0-21swapper/209:57:562
1948599148,5cyclictest0-21swapper/210:00:082
19485991413,1cyclictest0-21swapper/210:28:222
19485991410,4cyclictest0-21swapper/211:17:062
1948599140,4cyclictest0-21swapper/209:27:422
1948599140,3cyclictest0-21swapper/210:05:422
1948599140,14cyclictest0-21swapper/208:36:102
1948599140,14cyclictest0-21swapper/207:30:182
1948599140,13cyclictest13440-21sed08:50:212
1948099140,8cyclictest0-21swapper/108:08:051
1948099140,3cyclictest0-21swapper/108:49:441
1947699144,9cyclictest6727-21needreboot10:35:160
1947699141,6cyclictest0-21swapper/010:20:050
1947699141,12cyclictest0-21swapper/008:06:010
1947699141,12cyclictest0-21swapper/007:31:360
1947699140,5cyclictest706652pltrace07:45:110
1947699140,4cyclictest0-21swapper/012:05:070
1947699140,3cyclictest0-21swapper/009:22:140
1947699140,13cyclictest0-21swapper/011:14:360
1947699140,13cyclictest0-21swapper/008:42:250
1947699140,13cyclictest0-21swapper/008:22:440
1480452140,3pltrace1146-21snmpd09:56:081
1309252140,0pltrace0-21swapper/710:47:337
706652130,9pltrace54-21ksoftirqd/407:45:114
473052130,10pltrace54-21ksoftirqd/410:35:194
365752130,5pltrace0-21swapper/109:33:251
365752130,3pltrace54-21ksoftirqd/409:33:124
2598452130,3pltrace0-21swapper/710:11:367
2598452130,3pltrace0-21swapper/710:11:367
2256552130,8pltrace24344-21kernelversion12:05:143
2210852130,5pltrace0-21swapper/109:07:331
1975852130,4pltrace0-21swapper/711:56:217
1950899133,8cyclictest0-21swapper/710:05:537
19508991310,2cyclictest19601-21crond09:05:017
19508991310,2cyclictest0-21swapper/711:25:197
1950899130,7cyclictest0-21swapper/708:07:557
1950899130,12cyclictest0-21swapper/711:02:407
1950899130,12cyclictest0-21swapper/709:47:357
1950399133,4cyclictest29056-21fschecks_count09:20:136
1950399133,3cyclictest20313-21sh07:10:116
1950399130,1cyclictest0-21swapper/608:02:236
1949999139,3cyclictest1178-21runrttasks08:35:585
1949999130,2cyclictest0-21swapper/510:35:205
1949999130,12cyclictest0-21swapper/511:33:425
1949199133,9cyclictest0-21swapper/410:08:294
19491991312,1cyclictest0-21swapper/411:28:344
19491991310,2cyclictest1146-21snmpd11:15:054
1949199130,13cyclictest0-21swapper/411:05:154
1949199130,12cyclictest0-21swapper/408:46:514
1948999139,3cyclictest0-21swapper/312:14:493
1948999139,3cyclictest0-21swapper/310:58:483
1948999139,3cyclictest0-21swapper/310:19:113
19489991311,1cyclictest0-21swapper/311:50:153
1948999131,11cyclictest0-21swapper/308:20:003
1948999130,12cyclictest0-21swapper/309:06:453
1948599135,7cyclictest1178-21runrttasks09:02:182
1948599133,9cyclictest7786-21hostname07:45:122
1948599133,9cyclictest3761-21sed10:30:162
1948599133,9cyclictest24980-21expr08:15:122
1948599133,8cyclictest31816-21timerandwakeup08:25:212
1948599132,9cyclictest6631-21wc10:35:152
19485991312,1cyclictest0-21swapper/210:50:142
19485991310,2cyclictest0-21swapper/212:32:182
1948599130,12cyclictest0-21swapper/211:11:462
1948599130,12cyclictest0-21swapper/207:20:172
1948599130,11cyclictest21281-21grep11:00:202
1948599130,11cyclictest15019-21grep07:55:202
1948599130,11cyclictest13006-21grep09:50:112
1948599130,11cyclictest10972-21taskset08:46:412
1948099139,2cyclictest0-21swapper/109:54:461
1948099138,4cyclictest0-21swapper/109:47:131
1948099138,2cyclictest0-21swapper/107:13:551
1948099137,5cyclictest0-21swapper/111:35:531
1948099137,5cyclictest0-21swapper/110:38:271
1948099133,8cyclictest0-21swapper/112:06:561
1948099130,12cyclictest0-21swapper/112:35:101
1948099130,12cyclictest0-21swapper/111:58:381
1948099130,12cyclictest0-21swapper/110:06:531
1948099130,12cyclictest0-21swapper/109:01:151
1947699134,7cyclictest18371-21fschecks_time11:55:120
1947699133,9cyclictest16467-21expr08:00:110
19476991310,3cyclictest0-21swapper/009:14:380
1947699131,6cyclictest0-21swapper/010:50:180
1947699131,10cyclictest12950-21cut08:50:180
1947699130,8cyclictest32590-21expr10:25:100
1947699130,8cyclictest2813752pltrace12:11:100
1947699130,7cyclictest1201652pltrace09:46:110
1947699130,7cyclictest0-21swapper/011:05:000
1947699130,13cyclictest0-21swapper/010:45:270
1947699130,12cyclictest0-21swapper/012:23:220
1947699130,11cyclictest9138-21cpuspeed_turbos08:45:130
1947699130,11cyclictest4166-21cut08:35:130
1947699130,11cyclictest3116-21head07:35:130
1947699130,11cyclictest30394-21expr08:25:140
1947699130,11cyclictest24103-21tr10:10:100
1947699130,11cyclictest24103-21tr10:10:100
1947699130,11cyclictest13669-21expr07:55:110
1947699130,11cyclictest12458-21grep07:50:200
1264152130,5pltrace0-21swapper/507:53:535
1138552130,5pltrace0-21swapper/111:41:111
923152120,1pltrace9514-21idleruntime-cro09:45:001
473052120,7pltrace0-21swapper/510:33:095
427852120,5pltrace0-21swapper/107:36:311
365752120,9pltrace54-21ksoftirqd/409:35:104
3092252120,4pltrace0-21swapper/112:18:061
302252120,5pltrace0-21swapper/111:27:261
302252120,4pltrace0-21swapper/511:27:285
2769352120,5pltrace0-21swapper/309:20:413
1950899128,2cyclictest0-21swapper/708:11:447
19508991210,1cyclictest0-21swapper/710:50:287
1950899120,5cyclictest0-21swapper/710:18:087
1950899120,11cyclictest0-21swapper/712:15:097
1950899120,11cyclictest0-21swapper/710:59:137
1950899120,11cyclictest0-21swapper/709:40:567
1950899120,11cyclictest0-21swapper/709:16:357
1950399129,2cyclictest12815-21sshd10:45:226
1950399128,3cyclictest1064-13audispd08:45:006
1950399123,3cyclictest25472-21sh11:10:126
19503991211,1cyclictest0-21swapper/611:15:226
19503991211,1cyclictest0-21swapper/609:27:426
19503991210,2cyclictest0-21swapper/609:02:276
19503991210,1cyclictest0-21swapper/611:20:436
1950399120,2cyclictest0-21swapper/612:12:336
1950399120,12cyclictest0-21swapper/612:26:176
1950399120,11cyclictest0-21swapper/611:58:366
1950399120,11cyclictest0-21swapper/611:44:116
1950399120,11cyclictest0-21swapper/611:09:136
1950399120,11cyclictest0-21swapper/611:00:596
1950399120,11cyclictest0-21swapper/609:53:286
1950399120,11cyclictest0-21swapper/608:15:396
1950399120,11cyclictest0-21swapper/607:26:466
1950399120,1cyclictest0-21swapper/608:55:296
19499991211,1cyclictest0-21swapper/510:40:205
1949999121,11cyclictest0-21swapper/509:37:595
1949999120,12cyclictest0-21swapper/508:55:205
1949999120,11cyclictest0-21swapper/510:07:475
1949199127,3cyclictest0-21swapper/409:07:034
1949199126,5cyclictest0-21swapper/408:24:144
19491991211,1cyclictest0-21swapper/408:01:094
1949199120,11cyclictest0-21swapper/410:26:174
1949199120,11cyclictest0-21swapper/408:18:194
1949199120,1cyclictest0-21swapper/411:44:564
1948999129,2cyclictest1064-13audispd10:30:003
1948999126,5cyclictest0-21swapper/308:00:163
19489991211,1cyclictest0-21swapper/307:42:223
1948999120,11cyclictest0-21swapper/310:40:333
1948999120,11cyclictest0-21swapper/308:44:143
1948999120,1cyclictest0-21swapper/309:47:213
1948599129,2cyclictest1066-13audispd07:45:012
1948599126,5cyclictest0-21swapper/209:49:072
1948599123,8cyclictest7434-21expr11:35:142
1948599123,8cyclictest14902-21expr08:55:122
1948599122,9cyclictest27110-21expr10:15:102
1948599121,6cyclictest0-21swapper/209:35:102
1948599120,6cyclictest859652pltrace11:40:122
1948599120,12cyclictest0-21swapper/207:25:262
1948599120,11cyclictest6985-21head08:40:132
1948599120,11cyclictest19873-21cut08:05:132
1948599120,10cyclictest8238-21cut12:35:132
1948599120,10cyclictest7179-21wget09:40:102
1948599120,10cyclictest30895-21expr11:20:112
1948599120,10cyclictest30206-21perl10:20:122
1948599120,10cyclictest27323-21cat09:15:212
1948599120,10cyclictest22510-21irqstats_TLB07:15:022
1948599120,10cyclictest2232-21/usr/sbin/munin07:35:122
1948599120,10cyclictest21030-21cat09:05:142
1948599120,10cyclictest11457-21head07:50:132
1948099126,5cyclictest0-21swapper/111:21:071
19480991211,1cyclictest0-21swapper/107:25:191
1947699127,4cyclictest1055-13auditd09:45:010
1947699123,7cyclictest1066-13audispd11:49:590
1947699120,7cyclictest706652pltrace07:45:000
1947699120,11cyclictest8897-21tr12:35:160
1947699120,11cyclictest22603-21head08:10:140
1947699120,11cyclictest0-21swapper/012:04:260
1947699120,11cyclictest0-21swapper/010:55:290
1947699120,11cyclictest0-21swapper/008:15:120
1947699120,10cyclictest9367-21egrep11:40:110
1947699120,10cyclictest5034-21grep09:35:120
1947699120,10cyclictest30801-21grep11:20:100
1947699120,10cyclictest23046-21grep07:15:010
1947699120,10cyclictest18497-21grep10:00:080
1947699120,10cyclictest1696-21cpuspeed_turbos09:30:120
1947699120,1cyclictest0-21swapper/009:50:150
1823752120,9pltrace54-21ksoftirqd/408:05:124
1696252120,5pltrace0-21swapper/511:53:295
1371652120,7pltrace1178-21runrttasks08:55:393
1309252120,4pltrace0-21swapper/310:48:243
859652110,1pltrace0-21swapper/711:41:107
688652110,8pltrace54-21ksoftirqd/412:35:294
409752110,1pltrace6409-21switchtime12:30:191
409752110,1pltrace0-21swapper/512:30:515
2984752110,6pltrace78-21ksoftirqd/711:19:207
2876852110,8pltrace1146-21snmpd10:17:564
2210852110,7pltrace54-21ksoftirqd/409:10:004
19508991110,1cyclictest0-21swapper/707:58:417
19508991110,1cyclictest0-21swapper/707:11:057
1950899110,11cyclictest0-21swapper/709:52:027
1950899110,11cyclictest0-21swapper/707:36:307
1950899110,1cyclictest0-21swapper/712:20:597
1950899110,1cyclictest0-21swapper/709:08:587
1950399119,2cyclictest0-21swapper/607:38:066
1950399119,1cyclictest0-21swapper/611:45:006
1950399119,1cyclictest0-21swapper/610:27:086
1950399118,2cyclictest1054-21irqbalance08:14:356
1950399117,3cyclictest4603-21cut09:35:106
1950399115,5cyclictest21560-21sort12:00:146
1950399114,5cyclictest1086-21tr11:25:116
1950399112,3cyclictest7941-21perl09:40:126
19503991110,1cyclictest0-21swapper/612:17:336
19503991110,1cyclictest0-21swapper/609:19:176
19503991110,1cyclictest0-21swapper/608:51:176
19503991110,1cyclictest0-21swapper/608:05:376
1950399110,11cyclictest0-21swapper/610:30:526
1950399110,11cyclictest0-21swapper/610:01:146
1950399110,11cyclictest0-21swapper/608:47:046
1950399110,11cyclictest0-21swapper/608:33:576
1950399110,11cyclictest0-21swapper/607:41:016
1950399110,11cyclictest0-21swapper/607:33:436
1950399110,11cyclictest0-21swapper/607:22:436
1950399110,11cyclictest0-21swapper/607:16:056
1950399110,1cyclictest0-21swapper/610:38:286
1950399110,1cyclictest0-21swapper/609:33:426
1950399110,1cyclictest0-21swapper/607:51:326
1949999119,1cyclictest0-21swapper/511:35:525
1949999119,1cyclictest0-21swapper/510:46:395
1949999118,2cyclictest1064-13audispd09:01:005
1949999117,3cyclictest1146-21snmpd12:16:285
19499991110,1cyclictest0-21swapper/511:55:475
19499991110,1cyclictest0-21swapper/511:20:395
19499991110,1cyclictest0-21swapper/508:30:095
19499991110,1cyclictest0-21swapper/508:23:305
19499991110,1cyclictest0-21swapper/507:36:535
1949999110,11cyclictest0-21swapper/512:39:385
1949999110,11cyclictest0-21swapper/508:44:535
1949999110,11cyclictest0-21swapper/507:23:175
1949999110,1cyclictest0-21swapper/512:23:575
1949999110,1cyclictest0-21swapper/508:54:065
1949999110,1cyclictest0-21swapper/507:18:065
1949199119,1cyclictest0-21swapper/412:25:224
1949199119,1cyclictest0-21swapper/409:56:364
1949199119,1cyclictest0-21swapper/409:27:274
1949199119,1cyclictest0-21swapper/408:33:324
1949199117,2cyclictest0-21swapper/408:27:134
1949199116,4cyclictest0-21swapper/409:02:304
1949199113,3cyclictest32348-21timerwakeupswit11:20:204
19491991110,1cyclictest0-21swapper/410:52:474
19491991110,1cyclictest0-21swapper/410:30:264
19491991110,1cyclictest0-21swapper/409:15:484
19491991110,1cyclictest0-21swapper/407:40:264
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional