You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 14:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Fri Apr 24, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19896521120,108pltrace0-21swapper/307:10:003
17107521010,97pltrace0-21swapper/207:05:162
1710752970,89pltrace0-21swapper/107:06:241
1710752910,74pltrace0-21swapper/507:07:595
1989652880,41pltrace0-21swapper/707:08:117
1710752850,81pltrace0-21swapper/607:05:146
1973625945,10sleep00-21swapper/007:06:020
1763125743,10sleep40-21swapper/407:05:094
836952270,1pltrace8374-21pltrace-run10:38:025
2404652190,0pltrace0-21swapper/710:12:597
2018899190,8cyclictest0-21swapper/111:43:021
2018899190,3cyclictest0-21swapper/110:39:531
2018899190,13cyclictest0-21swapper/108:45:341
773752180,13pltrace1146-21snmpd12:34:215
2019999180,17cyclictest0-21swapper/411:15:184
20188991811,2cyclictest1146-21snmpd10:43:291
3133552170,4pltrace0-21swapper/709:24:187
2020499170,14cyclictest0-21swapper/508:52:195
2019999171,15cyclictest0-21swapper/410:48:374
2019399171,15cyclictest0-21swapper/212:37:432
2019399171,15cyclictest0-21swapper/212:37:432
2018499171,6cyclictest15-21ksoftirqd/008:23:450
1989652170,0pltrace0-21swapper/707:10:147
103652170,15pltrace0-21swapper/511:25:475
836952160,12pltrace54-21ksoftirqd/410:40:234
2512252160,11pltrace54-21ksoftirqd/411:10:294
2020799165,4cyclictest28315-21grep10:15:126
20207991611,3cyclictest0-21swapper/609:49:116
2020799161,14cyclictest0-21swapper/611:53:076
2020799160,15cyclictest0-21swapper/611:27:456
2020799160,1cyclictest0-21swapper/611:15:206
20204991611,4cyclictest0-21swapper/511:04:445
20204991611,4cyclictest0-21swapper/508:46:225
2020499161,14cyclictest0-21swapper/509:40:205
2020499160,15cyclictest0-21swapper/512:22:475
20199991611,3cyclictest0-21swapper/409:06:104
2019999160,15cyclictest0-21swapper/408:01:424
20193991611,3cyclictest0-21swapper/212:01:362
2019399161,8cyclictest0-21swapper/212:31:552
2019399161,7cyclictest0-21swapper/210:53:452
2019399160,15cyclictest0-21swapper/210:57:372
20188991611,3cyclictest0-21swapper/107:23:551
2018499162,5cyclictest15-21ksoftirqd/008:58:260
2018499161,8cyclictest0-21swapper/011:07:050
2018499161,4cyclictest0-21swapper/010:37:020
2018499161,14cyclictest0-21swapper/008:44:110
2018499160,15cyclictest0-21swapper/010:59:560
944852150,10pltrace54-21ksoftirqd/411:41:464
3195352150,2pltrace0-21swapper/707:32:037
2620352150,10pltrace54-21ksoftirqd/412:08:584
2275652150,12pltrace54-21ksoftirqd/407:13:384
2020799154,4cyclictest21813-21aten_r4power_en10:05:106
20207991511,3cyclictest0-21swapper/609:11:566
2020799150,8cyclictest0-21swapper/609:27:166
2020799150,8cyclictest0-21swapper/609:16:176
2020799150,14cyclictest0-21swapper/610:52:446
2020799150,14cyclictest0-21swapper/610:44:296
2020799150,14cyclictest0-21swapper/609:01:026
20204991512,2cyclictest0-21swapper/508:25:155
20204991510,3cyclictest0-21swapper/507:59:325
2020499150,7cyclictest0-21swapper/510:42:525
2020499150,14cyclictest0-21swapper/508:23:185
20199991513,1cyclictest0-21swapper/407:30:164
20199991510,4cyclictest16541-21ls09:55:104
2019999150,8cyclictest0-21swapper/407:45:354
2019999150,14cyclictest0-21swapper/411:22:144
20193991511,3cyclictest0-21swapper/211:42:322
20193991510,4cyclictest0-21swapper/211:02:462
2019399150,8cyclictest0-21swapper/212:12:332
2019399150,7cyclictest0-21swapper/211:28:112
2019399150,7cyclictest0-21swapper/210:24:432
2019399150,4cyclictest0-21swapper/209:43:472
2019399150,3cyclictest0-21swapper/210:09:192
2019399150,14cyclictest0-21swapper/211:18:082
2019399150,14cyclictest0-21swapper/208:21:302
2019399150,14cyclictest0-21swapper/208:18:002
20188991512,2cyclictest1146-21snmpd09:29:321
20188991511,2cyclictest0-21swapper/109:50:161
20188991510,3cyclictest0-21swapper/111:20:201
2018899150,9cyclictest0-21swapper/109:33:381
2018899150,14cyclictest0-21swapper/112:37:401
2018899150,14cyclictest0-21swapper/112:37:401
2018899150,14cyclictest0-21swapper/112:33:431
2018899150,14cyclictest0-21swapper/110:01:061
2018499150,8cyclictest0-21swapper/011:16:050
2018499150,8cyclictest0-21swapper/009:55:210
2018499150,3cyclictest0-21swapper/010:11:540
35122140,0sleep30-21swapper/310:30:103
3240852140,3pltrace0-21swapper/510:25:105
20212991411,2cyclictest1146-21snmpd10:00:577
20212991411,2cyclictest1134-21rsyslogd11:55:007
2021299140,13cyclictest0-21swapper/710:46:147
2021299140,13cyclictest0-21swapper/709:45:117
2020799147,6cyclictest1146-21snmpd11:01:356
2020799147,6cyclictest1146-21snmpd10:33:316
2020799146,7cyclictest26823-21taskset12:10:136
2020799146,7cyclictest1146-21snmpd07:15:286
2020799146,7cyclictest0-21swapper/612:15:136
2020799140,8cyclictest0-21swapper/610:56:086
2020799140,2cyclictest0-21swapper/607:50:506
2020799140,13cyclictest0-21swapper/609:20:536
2020499141,12cyclictest0-21swapper/511:19:125
2020499140,6cyclictest0-21swapper/508:07:025
2020499140,13cyclictest0-21swapper/509:57:165
2020499140,13cyclictest0-21swapper/507:50:005
2020499140,1cyclictest0-21swapper/509:25:205
2019999141,12cyclictest0-21swapper/409:13:364
2019999140,7cyclictest0-21swapper/410:19:184
2019999140,14cyclictest0-21swapper/408:55:154
2019999140,13cyclictest0-21swapper/407:50:104
20197991413,1cyclictest0-21swapper/312:30:183
20197991413,1cyclictest0-21swapper/307:45:023
20197991411,2cyclictest1146-21snmpd10:46:133
2019799140,13cyclictest0-21swapper/310:25:143
2019399149,3cyclictest0-21swapper/207:48:422
2019399140,3cyclictest0-21swapper/210:15:172
2018899145,2cyclictest0-21swapper/111:39:021
2018899141,12cyclictest0-21swapper/109:42:461
2018899140,8cyclictest0-21swapper/112:21:101
2018899140,3cyclictest0-21swapper/109:37:441
2018899140,3cyclictest0-21swapper/109:37:441
2018899140,13cyclictest0-21swapper/111:14:231
2018899140,13cyclictest0-21swapper/107:50:241
2018499148,2cyclictest2188252pltrace08:10:390
2018499146,4cyclictest15-21ksoftirqd/010:00:100
2018499146,2cyclictest0-21swapper/012:40:000
2018499146,2cyclictest0-21swapper/012:40:000
2018499144,4cyclictest15-21ksoftirqd/011:55:210
2018499143,4cyclictest15-21ksoftirqd/012:09:150
2018499140,3cyclictest0-21swapper/009:22:170
2018499140,3cyclictest0-21swapper/007:45:050
2018499140,13cyclictest0-21swapper/009:10:210
2018499140,13cyclictest0-21swapper/007:35:190
2018499140,12cyclictest0-21swapper/010:24:280
103652140,11pltrace54-21ksoftirqd/411:26:134
450752130,0pltrace0-21swapper/509:37:295
450752130,0pltrace0-21swapper/509:37:295
3177552130,10pltrace1146-21snmpd12:21:204
2961952130,9pltrace54-21ksoftirqd/410:20:184
2745652130,9pltrace78-21ksoftirqd/708:22:367
2683552130,4pltrace28774-21ntpq10:15:161
2620352130,5pltrace0-21swapper/512:09:105
2021299136,6cyclictest1146-21snmpd08:03:317
20212991310,2cyclictest10830-21sed10:40:217
2020799136,6cyclictest0-21swapper/610:10:166
2020799136,6cyclictest0-21swapper/607:35:216
2020799135,6cyclictest0-21swapper/610:25:126
2020799134,7cyclictest0-21swapper/607:25:116
2020799134,4cyclictest5867-21sed08:35:216
2020799133,8cyclictest0-21swapper/607:31:496
2020799133,4cyclictest6535-21wc09:35:186
2020799133,4cyclictest6535-21wc09:35:186
2020799133,4cyclictest2451-21wc08:30:156
2020799132,4cyclictest16403-21seq07:59:446
20207991310,2cyclictest0-21swapper/608:17:246
2020799130,13cyclictest0-21swapper/611:21:106
2020799130,12cyclictest0-21swapper/611:42:466
2020799130,12cyclictest0-21swapper/608:21:146
2020499133,8cyclictest0-21swapper/507:23:585
20204991312,1cyclictest0-21swapper/509:30:215
20204991311,1cyclictest0-21swapper/512:29:185
2020499130,2cyclictest0-21swapper/511:44:175
2020499130,13cyclictest0-21swapper/510:23:565
2020499130,12cyclictest0-21swapper/512:37:145
2020499130,12cyclictest0-21swapper/512:37:145
2020499130,12cyclictest0-21swapper/511:21:475
2020499130,1cyclictest0-21swapper/509:51:235
20199991310,2cyclictest1047-21NetworkManager11:39:594
20197991312,1cyclictest0-21swapper/311:13:043
2019799130,13cyclictest0-21swapper/309:09:323
2019399138,3cyclictest0-21swapper/209:45:242
2019399132,10cyclictest40-1kworker/2:0H+kblockd@
blk_mq_requeue_work
09:10:002
2019399130,6cyclictest0-21swapper/207:13:322
2019399130,13cyclictest0-21swapper/208:30:232
2019399130,12cyclictest0-21swapper/212:28:462
2019399130,12cyclictest0-21swapper/212:19:342
2019399130,12cyclictest0-21swapper/208:49:432
2018899137,5cyclictest0-21swapper/108:57:371
2018899136,2cyclictest0-21swapper/112:17:371
20188991312,1cyclictest0-21swapper/108:08:031
2018899130,13cyclictest0-21swapper/111:50:201
2018899130,12cyclictest0-21swapper/108:25:161
2018899130,1cyclictest0-21swapper/111:59:241
2018499137,2cyclictest25759-21cpu11:10:110
2018499136,4cyclictest15-21ksoftirqd/009:40:110
2018499136,4cyclictest15-21ksoftirqd/008:25:130
2018499135,4cyclictest15-21ksoftirqd/011:51:360
2018499133,9cyclictest0-21swapper/012:20:000
2018499133,4cyclictest15-21ksoftirqd/012:14:090
2018499133,4cyclictest15-21ksoftirqd/007:33:240
20184991310,2cyclictest23638-21basename07:15:010
20184991310,2cyclictest0-21swapper/008:30:450
2018499130,12cyclictest0-21swapper/011:39:440
2018499130,12cyclictest0-21swapper/010:15:470
2018499130,12cyclictest0-21swapper/009:30:450
1951952130,0pltrace0-21swapper/011:00:080
1287052130,9pltrace54-21ksoftirqd/409:50:134
512752120,8pltrace54-21ksoftirqd/407:38:514
3240852120,1pltrace0-21swapper/110:25:111
3177552120,4pltrace0-21swapper/312:21:593
2854752120,5pltrace0-21swapper/209:21:292
2745652120,5pltrace0-21swapper/108:22:501
2404652120,4pltrace25499-21gltestperf10:10:135
234252120,5pltrace0-21swapper/507:36:365
2341352120,3pltrace25277-21/usr/sbin/munin12:05:161
2275652120,5pltrace0-21swapper/507:13:285
2188252120,5pltrace0-21swapper/208:10:402
2021299125,6cyclictest464-21/usr/sbin/munin10:25:177
2021299125,6cyclictest24123-21/usr/sbin/munin07:15:127
2021299125,6cyclictest1474-21lldpd12:11:457
20212991210,1cyclictest14609-21timerwakeupswit11:45:227
20212991210,1cyclictest0-21swapper/709:18:367
20212991210,1cyclictest0-21swapper/707:42:427
2020799125,6cyclictest0-21swapper/608:05:176
2020799125,1cyclictest0-21swapper/612:35:116
2020799125,1cyclictest0-21swapper/612:35:116
2020799125,1cyclictest0-21swapper/608:50:126
2020799124,4cyclictest20782-21grep07:10:106
2020799124,2cyclictest22877-21aten_r4power_cu11:05:126
2020799124,1cyclictest0-21swapper/610:20:196
2020799123,4cyclictest4590-21cpuspeed_turbos11:30:116
2020799123,4cyclictest21322-21cat12:00:106
2020799123,2cyclictest22466-21aten_r4power_po08:10:106
2020799123,2cyclictest0-21swapper/608:40:156
2020799122,4cyclictest7217-21kernelversion10:35:166
2020799122,4cyclictest16091-21idleruntime08:55:146
2020799122,3cyclictest25758-21aten_r4power_vo11:10:116
2020799121,10cyclictest0-21swapper/610:46:086
2020799120,5cyclictest18845-21users08:00:216
2020799120,5cyclictest17116-21sed09:55:116
2020799120,5cyclictest13519-21grep11:45:146
2020799120,5cyclictest1178-21runrttasks10:03:506
2020799120,4cyclictest8008-21cut11:35:146
2020799120,4cyclictest602-21sshd08:28:246
2020799120,4cyclictest28970-21chrt07:20:246
2020799120,4cyclictest24860-21tail12:05:146
2020799120,11cyclictest0-21swapper/612:30:386
2020499126,5cyclictest0-21swapper/510:00:155
2020499126,5cyclictest0-21swapper/508:15:515
2020499126,4cyclictest0-21swapper/508:04:235
20204991211,1cyclictest0-21swapper/508:37:245
2020499120,11cyclictest0-21swapper/511:34:235
2020499120,1cyclictest0-21swapper/511:48:185
2020499120,1cyclictest0-21swapper/508:31:345
2020499120,1cyclictest0-21swapper/508:11:495
2020499120,1cyclictest0-21swapper/507:27:275
2019999128,2cyclictest15831-21strings10:50:164
2019999126,3cyclictest0-21swapper/407:17:024
2019999123,8cyclictest0-21swapper/408:05:424
20199991211,1cyclictest0-21swapper/412:36:264
20199991211,1cyclictest0-21swapper/412:36:264
20199991211,1cyclictest0-21swapper/409:01:244
20199991210,1cyclictest0-21swapper/410:59:074
2019999120,12cyclictest0-21swapper/408:19:194
2019999120,11cyclictest0-21swapper/409:25:174
2019999120,11cyclictest0-21swapper/409:15:114
2019999120,11cyclictest0-21swapper/407:59:434
2019799128,3cyclictest3647-21ntp_kernel_err09:30:173
2019799128,3cyclictest12414-21latency07:50:143
20197991211,1cyclictest0-21swapper/312:39:223
20197991211,1cyclictest0-21swapper/312:39:223
20197991211,1cyclictest0-21swapper/308:11:053
20197991211,1cyclictest0-21swapper/307:20:253
2019799120,2cyclictest0-21swapper/311:21:583
2019799120,1cyclictest0-21swapper/309:39:203
2019799120,1cyclictest0-21swapper/309:39:203
2019799120,1cyclictest0-21swapper/308:04:273
2019399126,5cyclictest0-21swapper/209:35:172
2019399126,5cyclictest0-21swapper/209:35:172
2019399126,5cyclictest0-21swapper/209:27:082
2019399126,3cyclictest0-21swapper/212:08:152
2019399123,8cyclictest0-21swapper/209:33:322
2019399123,8cyclictest0-21swapper/207:29:502
2019399120,11cyclictest0-21swapper/207:50:202
2018899129,2cyclictest0-21swapper/111:47:461
2018899126,5cyclictest0-21swapper/112:03:421
2018899126,5cyclictest0-21swapper/110:07:191
2018899123,3cyclictest0-21swapper/108:10:271
2018499129,2cyclictest6445-21vmstat11:30:200
2018499129,2cyclictest3409-21cut10:30:100
2018499129,2cyclictest26388-21hostname09:15:110
2018499129,2cyclictest21854-21basename10:05:100
2018499129,2cyclictest16824-21aten_r4power_cu08:00:110
2018499129,2cyclictest1324-21fschecks_time10:25:120
2018499129,2cyclictest13138-21expr11:45:120
2018499129,2cyclictest1146-21snmpd09:36:500
2018499129,2cyclictest1146-21snmpd09:36:500
2018499128,2cyclictest0-21swapper/008:19:450
2018499127,2cyclictest15-21ksoftirqd/008:45:140
2018499126,5cyclictest0-21swapper/007:25:220
2018499125,4cyclictest15-21ksoftirqd/012:20:200
2018499125,4cyclictest15-21ksoftirqd/011:20:100
20184991211,1cyclictest0-21swapper/012:35:000
2018499120,11cyclictest0-21swapper/010:52:020
1780952120,6pltrace19332-21hwlatdetect11:55:142
1565952120,5pltrace0-21swapper/209:53:512
1223652120,8pltrace54-21ksoftirqd/411:45:134
836952110,4pltrace0-21swapper/210:40:342
2021299119,1cyclictest0-21swapper/712:03:467
2021299118,2cyclictest25967-21grep12:05:217
2021299118,2cyclictest13486-21cp07:53:017
2021299117,3cyclictest623-21timerwakeupswit11:20:217
2021299117,3cyclictest1146-21snmpd07:39:347
2021299116,4cyclictest78-21ksoftirqd/708:45:187
2021299114,6cyclictest1055-13auditd11:13:247
20212991110,1cyclictest0-21swapper/712:22:147
20212991110,1cyclictest0-21swapper/711:44:517
20212991110,1cyclictest0-21swapper/711:05:307
20212991110,1cyclictest0-21swapper/708:58:247
20212991110,1cyclictest0-21swapper/708:43:407
20212991110,1cyclictest0-21swapper/708:30:347
20212991110,1cyclictest0-21swapper/707:48:277
2021299111,3cyclictest29695-21/usr/sbin/munin07:25:137
2021299110,5cyclictest1146-21snmpd08:13:347
2021299110,4cyclictest29846-21cut12:15:117
2021299110,4cyclictest19201-21fschecks_time11:55:147
2021299110,11cyclictest0-21swapper/712:29:317
2021299110,11cyclictest0-21swapper/711:31:447
2021299110,11cyclictest0-21swapper/710:31:307
2021299110,11cyclictest0-21swapper/708:08:427
2021299110,1cyclictest0-21swapper/712:39:047
2021299110,1cyclictest0-21swapper/712:39:047
2021299110,1cyclictest0-21swapper/710:50:077
2021299110,1cyclictest0-21swapper/710:18:327
2021299110,1cyclictest0-21swapper/710:06:237
2021299110,1cyclictest0-21swapper/707:20:467
2020799113,2cyclictest0-21swapper/609:40:106
2020799113,1cyclictest0-21swapper/612:25:116
2020799110,6cyclictest9515-21taskset08:45:086
2020799110,5cyclictest21031-21tr09:05:136
2020799110,4cyclictest8792-21cstates07:45:116
2020799110,4cyclictest856-21idleruntime12:20:156
2020799110,4cyclictest6250-21expr07:40:136
2020799110,4cyclictest2559-21tr09:30:126
2020799110,4cyclictest18628-21expr11:55:126
2020799110,4cyclictest13589-21cpuspeed_turbos09:50:116
20204991110,1cyclictest0-21swapper/512:18:355
20204991110,1cyclictest0-21swapper/510:17:565
20204991110,1cyclictest0-21swapper/510:08:145
20204991110,1cyclictest0-21swapper/509:16:075
20204991110,1cyclictest0-21swapper/507:50:565
2020499110,11cyclictest0-21swapper/511:50:345
2020499110,11cyclictest0-21swapper/510:47:545
2019999119,1cyclictest0-21swapper/408:32:254
2019999117,2cyclictest0-21swapper/409:37:544
2019999117,2cyclictest0-21swapper/409:37:544
2019999115,5cyclictest0-21swapper/410:06:584
2019999115,5cyclictest0-21swapper/409:34:484
2019999115,5cyclictest0-21swapper/407:44:384
2019999113,7cyclictest29966-21expr07:25:124
2019999112,8cyclictest0-21swapper/411:57:474
20199991110,1cyclictest0-21swapper/411:52:044
20199991110,1cyclictest0-21swapper/411:02:214
20199991110,1cyclictest0-21swapper/409:43:314
20199991110,1cyclictest0-21swapper/408:40:314
2019999110,11cyclictest0-21swapper/409:21:404
2019999110,1cyclictest0-21swapper/408:12:114
2019799118,2cyclictest7708-21smart_sda10:35:213
2019799118,2cyclictest4487-21timerandwakeup12:25:203
2019799118,2cyclictest0-21swapper/310:00:583
2019799117,3cyclictest22079-21gltestperf12:00:113
20197991110,1cyclictest0-21swapper/311:42:033
20197991110,1cyclictest0-21swapper/311:17:163
20197991110,1cyclictest0-21swapper/310:44:443
20197991110,1cyclictest0-21swapper/310:23:023
20197991110,1cyclictest0-21swapper/309:26:323
20197991110,1cyclictest0-21swapper/309:23:473
20197991110,1cyclictest0-21swapper/307:36:273
20197991110,1cyclictest0-21swapper/307:12:003
2019799110,11cyclictest0-21swapper/312:18:573
2019799110,11cyclictest0-21swapper/312:14:253
2019799110,11cyclictest0-21swapper/311:51:453
2019799110,11cyclictest0-21swapper/311:49:293
2019799110,11cyclictest0-21swapper/311:38:193
2019799110,11cyclictest0-21swapper/311:06:353
2019799110,11cyclictest0-21swapper/310:16:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional