You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 17:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Jun 10, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19017521250,116pltrace0-21swapper/307:10:013
16231521230,94pltrace0-21swapper/607:05:276
16231521070,103pltrace0-21swapper/507:05:185
19017521040,57pltrace0-21swapper/707:08:217
16231521040,96pltrace0-21swapper/207:06:402
1623152950,68pltrace0-21swapper/107:05:011
1892026341,17sleep40-21swapper/407:06:384
2638652600,9pltrace78-21ksoftirqd/711:38:527
1885925945,10sleep00-21swapper/007:05:470
127782460,0sleep10-21swapper/111:24:111
2638652450,13pltrace78-21ksoftirqd/711:40:507
2905352430,8pltrace78-21ksoftirqd/709:53:087
1935199410,2cyclictest78-21ksoftirqd/709:35:037
328552390,6pltrace78-21ksoftirqd/711:52:367
328552350,8pltrace78-21ksoftirqd/711:49:007
3229352350,9pltrace78-21ksoftirqd/711:11:487
1223352350,8pltrace78-21ksoftirqd/712:01:167
1992552340,9pltrace78-21ksoftirqd/710:20:147
1989252340,7pltrace78-21ksoftirqd/710:56:427
1992552330,6pltrace78-21ksoftirqd/710:18:187
615452310,7pltrace78-21ksoftirqd/710:39:157
1666152300,6pltrace0-21swapper/712:39:277
2829752290,1pltrace0-21swapper/107:22:461
1642552280,6pltrace78-21ksoftirqd/711:29:047
1223352280,5pltrace78-21ksoftirqd/711:59:327
2565652260,0pltrace0-21swapper/712:16:287
816052230,1pltrace8163-21grep11:17:465
1933999230,22cyclictest0-21swapper/510:30:205
2123652220,1pltrace21238-21tee11:32:466
1934499220,1cyclictest0-21swapper/607:25:196
1933999210,1cyclictest0-21swapper/511:00:195
3216952180,0pltrace0-21swapper/708:28:517
1934499181,16cyclictest0-21swapper/607:41:256
1666152180,13pltrace17331-21sh12:39:250
704052170,0pltrace0-21swapper/707:43:097
328552170,11pltrace7571-21chrt11:52:220
19344991711,4cyclictest7242-21strings08:40:156
1934499171,8cyclictest0-21swapper/607:21:526
1933999174,13cyclictest0-21swapper/511:29:385
19339991714,2cyclictest1178-21runrttasks10:42:505
1933999171,8cyclictest0-21swapper/512:37:225
1933999171,2cyclictest0-21swapper/511:54:435
1933999170,17cyclictest0-21swapper/511:40:205
1932599171,15cyclictest0-21swapper/210:03:392
1668952170,13pltrace17246-21ssh12:04:082
2816452160,11pltrace0-21swapper/211:04:102
255652160,13pltrace0-21swapper/508:33:195
1935199160,15cyclictest0-21swapper/710:45:557
1935199160,15cyclictest0-21swapper/707:50:527
1934499160,8cyclictest0-21swapper/607:50:286
1933999167,7cyclictest1055-13auditd07:25:005
1933599160,4cyclictest0-21swapper/409:52:024
1933599160,15cyclictest0-21swapper/408:04:154
1932999161,8cyclictest0-21swapper/312:37:083
1932999161,14cyclictest0-21swapper/311:54:053
19325991610,5cyclictest0-21swapper/211:30:242
1932599161,8cyclictest0-21swapper/212:18:432
1932599160,4cyclictest0-21swapper/209:27:502
1931699160,2cyclictest0-21swapper/010:42:280
1931699160,15cyclictest0-21swapper/011:48:540
177852160,1pltrace0-21swapper/609:58:596
177852160,1pltrace0-21swapper/609:58:596
812752150,8pltrace78-21ksoftirqd/708:43:097
671152150,7pltrace0-21swapper/009:31:040
425352150,5pltrace0-21swapper/207:40:212
2905352150,0pltrace0-21swapper/009:55:210
2905352150,0pltrace0-21swapper/009:55:210
2829752150,1pltrace28298-21sed07:22:457
1935199159,5cyclictest0-21swapper/708:08:117
19351991510,4cyclictest0-21swapper/707:50:007
1935199151,3cyclictest0-21swapper/711:08:107
1935199150,8cyclictest0-21swapper/709:10:317
1935199150,14cyclictest0-21swapper/712:09:597
1935199150,14cyclictest0-21swapper/710:09:057
1935199150,14cyclictest0-21swapper/709:07:107
1935199150,14cyclictest0-21swapper/708:39:127
1935199150,14cyclictest0-21swapper/707:59:267
19344991510,4cyclictest0-21swapper/608:49:486
1934499151,3cyclictest0-21swapper/607:12:006
1934499151,13cyclictest0-21swapper/610:50:006
1934499150,8cyclictest0-21swapper/612:18:486
1934499150,8cyclictest0-21swapper/607:49:466
1934499150,14cyclictest0-21swapper/611:35:546
1934499150,14cyclictest0-21swapper/610:13:106
1934499150,14cyclictest0-21swapper/609:01:396
1933999155,6cyclictest3774-21cat09:25:105
1933999150,7cyclictest0-21swapper/509:54:145
1933999150,7cyclictest0-21swapper/509:40:205
1933999150,14cyclictest62-21ksoftirqd/510:39:075
1933999150,14cyclictest0-21swapper/510:29:485
1933999150,14cyclictest0-21swapper/509:35:375
1933599150,8cyclictest0-21swapper/412:09:424
1933599150,14cyclictest0-21swapper/407:55:464
1933599150,1cyclictest0-21swapper/410:28:304
1932999156,5cyclictest0-21swapper/307:30:133
1932999150,7cyclictest0-21swapper/311:05:023
1932999150,14cyclictest0-21swapper/311:12:383
1932999150,14cyclictest0-21swapper/310:47:173
1932999150,14cyclictest0-21swapper/308:50:283
19325991511,3cyclictest0-21swapper/207:30:592
1932599151,3cyclictest0-21swapper/210:06:482
1932599150,8cyclictest2719-21ssh09:23:532
1932599150,8cyclictest0-21swapper/209:57:512
1932599150,8cyclictest0-21swapper/209:57:512
1932599150,7cyclictest0-21swapper/212:23:162
1932599150,4cyclictest0-21swapper/209:12:472
1932599150,14cyclictest0-21swapper/207:39:172
1932099150,3cyclictest0-21swapper/107:27:261
1932099150,2cyclictest15759-21ssh09:38:111
1932099150,13cyclictest0-21swapper/111:35:391
1932099150,13cyclictest0-21swapper/110:40:341
1931699151,8cyclictest0-21swapper/012:12:470
1931699151,13cyclictest0-21swapper/011:40:570
1931699150,7cyclictest0-21swapper/012:20:190
1931699150,7cyclictest0-21swapper/011:31:000
1931699150,4cyclictest0-21swapper/007:22:440
1931699150,14cyclictest0-21swapper/009:21:200
1540252150,3pltrace16263-21cpuspeed_turbos08:00:110
3108052140,4pltrace31143-21sshd07:28:352
2438552140,9pltrace28716-21ssh10:27:342
2438552140,8pltrace28688-21ssh10:27:300
19351991413,1cyclictest0-21swapper/711:34:337
19351991413,1cyclictest0-21swapper/707:12:457
1935199140,7cyclictest0-21swapper/708:53:097
1935199140,3cyclictest0-21swapper/708:16:477
1935199140,14cyclictest0-21swapper/712:31:327
1935199140,14cyclictest0-21swapper/710:51:307
1935199140,13cyclictest0-21swapper/709:47:137
1935199140,1cyclictest0-21swapper/711:19:497
1934499147,6cyclictest0-21swapper/611:17:166
1934499141,12cyclictest0-21swapper/609:50:146
1934499140,8cyclictest0-21swapper/612:39:376
1934499140,7cyclictest0-21swapper/607:34:286
1934499140,3cyclictest0-21swapper/608:52:476
1934499140,14cyclictest0-21swapper/612:08:556
1934499140,14cyclictest0-21swapper/611:22:276
1934499140,13cyclictest0-21swapper/609:26:496
1934499140,1cyclictest0-21swapper/610:36:486
1934499140,1cyclictest0-21swapper/610:02:386
1934499140,1cyclictest0-21swapper/609:20:136
1933999149,3cyclictest0-21swapper/510:59:195
19339991413,1cyclictest0-21swapper/511:33:315
19339991412,1cyclictest18620-21ssh12:05:145
1933999140,7cyclictest0-21swapper/510:17:215
1933999140,7cyclictest0-21swapper/508:18:185
1933999140,6cyclictest0-21swapper/509:10:005
1933999140,3cyclictest0-21swapper/512:31:235
1933999140,14cyclictest62-21ksoftirqd/510:48:595
1933999140,13cyclictest0-21swapper/507:16:425
1933999140,1cyclictest601rcuc/511:58:375
1933999140,1cyclictest0-21swapper/511:22:405
1933999140,1cyclictest0-21swapper/510:21:575
1933999140,1cyclictest0-21swapper/509:22:035
19335991413,1cyclictest0-21swapper/411:53:014
1933599140,7cyclictest0-21swapper/409:25:284
1933599140,7cyclictest0-21swapper/409:11:464
1933599140,3cyclictest0-21swapper/411:42:204
1933599140,3cyclictest0-21swapper/408:45:164
1933599140,14cyclictest0-21swapper/412:27:114
1933599140,14cyclictest0-21swapper/411:05:154
1933599140,14cyclictest0-21swapper/410:40:294
1933599140,13cyclictest0-21swapper/411:27:554
1933599140,13cyclictest0-21swapper/407:48:354
1933599140,1cyclictest0-21swapper/412:30:154
1933599140,1cyclictest0-21swapper/410:35:474
1932999149,3cyclictest0-21swapper/310:54:043
1932999146,5cyclictest0-21swapper/308:00:013
19329991412,1cyclictest0-21swapper/309:22:423
19329991411,2cyclictest0-21swapper/311:45:013
1932999141,9cyclictest191rcu_preempt11:40:543
1932999140,8cyclictest0-21swapper/312:09:243
1932999140,8cyclictest0-21swapper/309:27:043
1932999140,8cyclictest0-21swapper/307:27:463
1932999140,14cyclictest0-21swapper/310:06:143
1932999140,1cyclictest0-21swapper/311:55:223
1932999140,1cyclictest0-21swapper/310:34:243
1932999140,1cyclictest0-21swapper/309:50:413
1932599149,2cyclictest0-21swapper/208:30:002
1932599140,8cyclictest0-21swapper/211:27:422
1932599140,7cyclictest0-21swapper/209:54:512
1932099140,3cyclictest0-21swapper/109:12:491
1932099140,1cyclictest0-21swapper/112:09:141
1932099140,1cyclictest0-21swapper/108:15:261
19316991412,1cyclictest0-21swapper/012:34:210
19316991411,2cyclictest0-21swapper/007:33:490
1931699140,14cyclictest0-21swapper/012:02:460
1931699140,14cyclictest0-21swapper/011:01:340
1931699140,14cyclictest0-21swapper/010:31:470
1931699140,13cyclictest0-21swapper/011:13:530
1931699140,13cyclictest0-21swapper/009:17:570
1931699140,13cyclictest0-21swapper/008:55:000
1931699140,1cyclictest0-21swapper/010:45:520
1931699140,1cyclictest0-21swapper/009:43:520
1931699140,1cyclictest0-21swapper/009:11:470
1668952140,0pltrace0-21swapper/612:02:566
1649152140,5pltrace0-21swapper/308:58:553
1642552140,8pltrace16981-21ssh11:29:101
1548152140,8pltrace54-21ksoftirqd/410:15:004
1548152140,8pltrace17945-21cut10:15:142
1548152140,6pltrace16958-21/usr/sbin/munin10:15:100
1548152140,1pltrace0-21swapper/610:15:126
1540252140,3pltrace16452-21expr08:00:122
671152130,5pltrace0-21swapper/209:31:052
403052130,2pltrace7828-21ssh11:16:531
2816452130,1pltrace0-21swapper/611:04:086
2187952130,0pltrace0-21swapper/707:15:027
1935199137,5cyclictest0-21swapper/709:34:147
1935199137,5cyclictest0-21swapper/708:24:597
19351991312,1cyclictest0-21swapper/711:21:077
19351991312,1cyclictest0-21swapper/711:01:317
19351991312,1cyclictest0-21swapper/710:31:457
1935199130,13cyclictest0-21swapper/712:25:527
1935199130,13cyclictest0-21swapper/710:25:447
1935199130,13cyclictest0-21swapper/709:29:257
1935199130,13cyclictest0-21swapper/709:23:247
1935199130,1cyclictest0-21swapper/712:21:307
1935199130,1cyclictest0-21swapper/709:55:387
1935199130,1cyclictest0-21swapper/709:55:387
19344991312,1cyclictest0-21swapper/612:22:316
19344991312,1cyclictest0-21swapper/611:57:556
19344991312,1cyclictest0-21swapper/609:14:536
19344991311,1cyclictest0-21swapper/611:06:456
19344991310,2cyclictest32119-21ssh11:44:586
1934499130,13cyclictest0-21swapper/610:50:346
1934499130,13cyclictest0-21swapper/609:42:246
1934499130,1cyclictest0-21swapper/612:34:216
1934499130,1cyclictest0-21swapper/612:25:366
19339991312,1cyclictest62-21ksoftirqd/511:36:065
19339991312,1cyclictest0-21swapper/510:06:345
19339991312,1cyclictest0-21swapper/510:00:155
19339991312,1cyclictest0-21swapper/507:40:135
19339991311,1cyclictest20469-21ssh10:54:285
19339991310,2cyclictest5787-21latency12:25:135
19339991310,2cyclictest1178-21runrttasks09:32:245
1933999130,13cyclictest0-21swapper/512:12:425
1933999130,13cyclictest0-21swapper/511:11:205
1933999130,1cyclictest0-21swapper/512:21:555
1933999130,1cyclictest0-21swapper/512:15:465
19335991312,1cyclictest0-21swapper/411:20:584
19335991312,1cyclictest0-21swapper/410:07:564
19335991312,1cyclictest0-21swapper/409:31:114
1933599130,6cyclictest0-21swapper/412:00:124
1933599130,13cyclictest0-21swapper/410:52:084
1933599130,13cyclictest0-21swapper/409:46:544
1933599130,13cyclictest0-21swapper/409:39:174
1933599130,12cyclictest0-21swapper/412:24:034
1933599130,12cyclictest0-21swapper/410:22:514
1933599130,1cyclictest0-21swapper/407:41:364
1932999136,4cyclictest46-21ksoftirqd/309:45:133
1932999136,2cyclictest0-21swapper/312:15:213
19329991312,1cyclictest0-21swapper/312:02:203
19329991312,1cyclictest0-21swapper/311:18:373
19329991312,1cyclictest0-21swapper/310:39:063
19329991312,1cyclictest0-21swapper/309:38:523
19329991310,2cyclictest1146-21snmpd10:02:223
1932999130,13cyclictest0-21swapper/312:11:343
1932999130,13cyclictest0-21swapper/311:28:103
1932999130,13cyclictest0-21swapper/311:04:413
1932999130,13cyclictest0-21swapper/310:59:013
1932999130,12cyclictest0-21swapper/312:34:243
1932999130,12cyclictest0-21swapper/311:31:243
1932999130,1cyclictest0-21swapper/310:28:253
1932599138,4cyclictest10598-21load11:20:162
1932599138,4cyclictest0-21swapper/209:40:012
19325991312,1cyclictest0-21swapper/212:08:152
19325991312,1cyclictest0-21swapper/211:46:432
1932599130,13cyclictest0-21swapper/211:11:452
1932599130,13cyclictest0-21swapper/210:46:102
1932599130,13cyclictest0-21swapper/209:15:502
1932599130,1cyclictest0-21swapper/210:31:072
1932099138,3cyclictest0-21swapper/110:05:001
19320991312,1cyclictest0-21swapper/110:45:221
19320991311,1cyclictest0-21swapper/111:54:401
1932099130,13cyclictest0-21swapper/112:28:401
1932099130,13cyclictest0-21swapper/111:10:571
1932099130,13cyclictest0-21swapper/110:56:231
1932099130,13cyclictest0-21swapper/109:57:171
1932099130,13cyclictest0-21swapper/109:57:171
1932099130,13cyclictest0-21swapper/109:41:351
1932099130,12cyclictest0-21swapper/108:08:531
1932099130,1cyclictest0-21swapper/109:24:251
19316991312,1cyclictest0-21swapper/010:57:120
19316991312,1cyclictest0-21swapper/010:23:120
19316991312,1cyclictest0-21swapper/009:45:580
19316991312,1cyclictest0-21swapper/009:38:210
19316991312,1cyclictest0-21swapper/009:25:340
1931699130,13cyclictest0-21swapper/010:00:420
1931699130,12cyclictest0-21swapper/012:05:510
1901752130,6pltrace0-21swapper/007:11:100
1548152130,1pltrace0-21swapper/310:15:093
1548152130,1pltrace0-21swapper/010:15:010
1543752130,1pltrace0-21swapper/210:51:092
1540252130,7pltrace1178-21runrttasks08:00:163
1540252130,3pltrace16047-21aten_r4power_vo08:00:117
146352130,5pltrace3623-21swap07:35:201
671152120,8pltrace10479-21ssh09:31:091
403052120,3pltrace0-21swapper/211:16:592
3216952120,8pltrace78-21ksoftirqd/708:30:197
3216952120,1pltrace0-21swapper/008:28:210
2209252120,5pltrace0-21swapper/009:09:190
19351991211,1cyclictest0-21swapper/710:42:257
1935199120,12cyclictest0-21swapper/708:56:517
1935199120,11cyclictest0-21swapper/709:03:167
1934499129,2cyclictest8588-21cut10:05:146
1934499129,2cyclictest12809-21expr09:35:106
1934499126,5cyclictest0-21swapper/609:19:166
19344991211,1cyclictest0-21swapper/608:35:216
19344991210,1cyclictest0-21swapper/611:50:096
19344991210,1cyclictest0-21swapper/611:46:156
1934499120,12cyclictest0-21swapper/610:29:316
1934499120,11cyclictest0-21swapper/608:59:306
1933999129,2cyclictest22827-21missed_timers08:10:165
1933999127,4cyclictest1055-17auditd09:20:005
1933999127,3cyclictest0-21swapper/507:26:375
1933999126,5cyclictest0-21swapper/510:13:415
19339991211,1cyclictest0-21swapper/509:58:095
19339991211,1cyclictest0-21swapper/509:58:095
19339991211,1cyclictest0-21swapper/509:46:205
19339991211,1cyclictest0-21swapper/508:00:245
19339991210,1cyclictest0-21swapper/509:10:115
1933999120,11cyclictest0-21swapper/511:45:115
1933999120,11cyclictest0-21swapper/508:23:375
1933599129,2cyclictest1055-17auditd10:00:004
1933599129,2cyclictest1055-17auditd10:00:004
19335991211,1cyclictest0-21swapper/412:13:354
19335991211,1cyclictest0-21swapper/411:30:314
19335991211,1cyclictest0-21swapper/410:56:314
1933599120,6cyclictest0-21swapper/407:31:474
1933599120,5cyclictest0-21swapper/410:45:064
1932999129,2cyclictest31003-21cut09:55:103
1932999129,2cyclictest31003-21cut09:55:103
1932999129,2cyclictest27189-21kernelversion07:20:163
1932999129,2cyclictest24881-21switchtime07:15:193
1932999128,2cyclictest0-21swapper/308:18:003
1932999126,2cyclictest0-21swapper/307:40:133
1932999125,4cyclictest46-21ksoftirqd/310:11:563
1932999124,7cyclictest1055-13auditd08:10:003
1932999122,8cyclictest0-21swapper/311:20:353
19329991211,1cyclictest0-21swapper/311:39:503
19329991211,1cyclictest0-21swapper/309:40:593
19329991211,1cyclictest0-21swapper/309:32:043
19329991211,1cyclictest0-21swapper/309:18:293
19329991211,1cyclictest0-21swapper/309:11:323
19329991211,1cyclictest0-21swapper/309:07:483
1932599128,3cyclictest1478-21lldpd08:43:192
1932599127,2cyclictest0-21swapper/212:26:242
19325991211,1cyclictest0-21swapper/212:32:332
1932599120,12cyclictest0-21swapper/212:39:112
1932599120,11cyclictest0-21swapper/209:04:102
1932599120,11cyclictest0-21swapper/207:48:432
1932099129,2cyclictest10203-21cat07:50:001
19320991211,1cyclictest0-21swapper/112:23:481
1932099120,4cyclictest7154-21sshd10:39:351
1932099120,4cyclictest1146-21snmpd09:45:421
1932099120,12cyclictest0-21swapper/112:15:521
1932099120,12cyclictest0-21swapper/111:47:421
1932099120,12cyclictest0-21swapper/111:42:021
1931699129,2cyclictest0-21swapper/007:27:520
19316991211,1cyclictest0-21swapper/012:26:540
19316991211,1cyclictest0-21swapper/011:07:140
19316991211,1cyclictest0-21swapper/010:07:490
19316991210,1cyclictest0-21swapper/010:52:500
19316991210,1cyclictest0-21swapper/010:36:290
1931699120,1cyclictest0-21swapper/007:16:400
1558552120,4pltrace0-21swapper/209:42:342
1548152120,8pltrace54-21ksoftirqd/410:15:034
1543752120,1pltrace19170-21ssh10:51:061
1091152120,5pltrace0-21swapper/108:49:081
533952110,4pltrace0-21swapper/208:38:502
19351991110,1cyclictest0-21swapper/712:14:037
19351991110,1cyclictest0-21swapper/710:13:177
19351991110,1cyclictest0-21swapper/708:46:007
19351991110,1cyclictest0-21swapper/707:39:377
1935199110,11cyclictest0-21swapper/708:11:217
1934499119,1cyclictest0-21swapper/609:07:266
1934499118,2cyclictest27433-21cut08:20:116
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional