You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 21:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue May 05, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12400521400,129pltrace0-21swapper/207:08:282
12400521010,85pltrace0-21swapper/607:05:576
2514252970,0pltrace0-21swapper/110:35:091
1240052970,90pltrace0-21swapper/107:07:341
1467229156,9sleep50-21swapper/507:08:235
1828252850,2pltrace0-21swapper/409:10:094
1464327459,11sleep30-21swapper/307:07:573
1525852690,1pltrace0-21swapper/607:10:076
959952630,55pltrace0-21swapper/707:05:067
1461326040,16sleep00-21swapper/007:07:310
1471825844,10sleep40-21swapper/407:09:024
106852370,3pltrace0-21swapper/710:50:127
389252320,0pltrace0-21swapper/710:59:467
2387752300,1pltrace681rcuc/609:20:096
2387752300,1pltrace681rcuc/609:20:096
218052300,2pltrace0-21swapper/711:50:187
2900752280,0pltrace0-21swapper/711:40:177
1496599253,11cyclictest0-21swapper/310:20:263
1996852230,15pltrace54-21ksoftirqd/408:17:194
1497499231,12cyclictest0-21swapper/508:30:215
1497499230,12cyclictest0-21swapper/507:36:535
1495499216,8cyclictest17421-21taskset11:19:301
150252200,7pltrace1178-21runrttasks08:43:177
1497499200,20cyclictest0-21swapper/510:30:195
2343452190,0pltrace0-21swapper/711:30:277
1894052190,7pltrace0-21swapper/712:20:517
1506952190,6pltrace0-21swapper/711:19:587
1044952190,0pltrace0-21swapper/710:05:237
3223652180,0pltrace0-21swapper/709:39:207
1718052180,0pltrace0-21swapper/708:12:217
1498299181,2cyclictest0-21swapper/709:25:387
1498299181,2cyclictest0-21swapper/709:25:387
1497499180,11cyclictest0-21swapper/507:42:265
1496999180,18cyclictest0-21swapper/412:17:304
1335452180,0pltrace0-21swapper/712:10:117
2275752170,0pltrace0-21swapper/708:22:137
14977991711,5cyclictest0-21swapper/610:50:026
14974991711,5cyclictest0-21swapper/509:04:575
14965991712,2cyclictest0-21swapper/310:45:193
14965991711,5cyclictest0-21swapper/312:19:373
14959991711,5cyclictest0-21swapper/211:51:272
14954991711,5cyclictest0-21swapper/111:08:241
14954991710,6cyclictest1055-17auditd11:15:001
1453352170,0pltrace0-21swapper/710:19:427
1498299161,8cyclictest0-21swapper/709:16:027
1498299161,8cyclictest0-21swapper/709:16:027
14977991611,3cyclictest0-21swapper/608:50:016
1497799161,14cyclictest0-21swapper/610:13:426
14974991611,3cyclictest0-21swapper/512:32:235
14974991611,3cyclictest0-21swapper/512:32:235
14974991611,3cyclictest0-21swapper/512:05:045
14974991611,3cyclictest0-21swapper/509:13:395
14974991610,5cyclictest0-21swapper/509:05:515
1497499161,4cyclictest0-21swapper/508:49:565
1497499160,9cyclictest0-21swapper/509:45:275
1497499160,15cyclictest0-21swapper/510:20:345
1497499160,15cyclictest0-21swapper/507:34:295
1496999161,3cyclictest0-21swapper/409:08:064
1496999160,15cyclictest0-21swapper/407:49:054
14965991611,3cyclictest0-21swapper/309:31:183
1496599160,8cyclictest0-21swapper/308:43:243
1496599160,1cyclictest0-21swapper/308:28:233
14959991611,4cyclictest0-21swapper/210:35:262
14959991611,3cyclictest0-21swapper/208:55:072
14959991611,3cyclictest0-21swapper/208:10:182
1495999161,14cyclictest0-21swapper/211:33:082
1495999160,15cyclictest0-21swapper/208:32:042
14954991611,4cyclictest0-21swapper/110:12:571
1495499160,15cyclictest0-21swapper/110:16:341
1495499160,11cyclictest0-21swapper/110:03:241
1495099162,7cyclictest0-21swapper/009:30:560
14950991611,3cyclictest0-21swapper/009:44:240
1495099161,14cyclictest0-21swapper/010:00:220
1495099161,14cyclictest0-21swapper/007:47:000
1495099160,15cyclictest0-21swapper/010:54:260
1227352160,3pltrace14706-21sed11:14:595
1157452160,1pltrace0-21swapper/508:03:495
668052150,11pltrace54-21ksoftirqd/411:01:214
496752150,2pltrace0-21swapper/711:57:097
3111452150,12pltrace54-21ksoftirqd/408:37:394
2730252150,10pltrace54-21ksoftirqd/412:39:314
2621852150,2pltrace28805-21cat11:40:005
1888752150,11pltrace54-21ksoftirqd/407:15:574
15732150,8sleep60-21swapper/611:47:076
1498299150,8cyclictest0-21swapper/708:47:247
1498299150,8cyclictest0-21swapper/707:16:167
1498299150,8cyclictest0-21swapper/707:13:227
1498299150,7cyclictest0-21swapper/709:44:187
1498299150,14cyclictest0-21swapper/712:08:527
1497799159,5cyclictest0-21swapper/608:33:596
14977991510,3cyclictest0-21swapper/611:07:546
14977991510,3cyclictest0-21swapper/607:24:146
1497799150,7cyclictest0-21swapper/608:01:536
1497799150,7cyclictest0-21swapper/607:59:586
1497799150,4cyclictest0-21swapper/608:11:536
1497799150,3cyclictest0-21swapper/609:08:156
1497799150,14cyclictest0-21swapper/612:09:106
1497799150,14cyclictest0-21swapper/610:43:326
1497799150,14cyclictest0-21swapper/610:24:476
1497499159,3cyclictest0-21swapper/512:39:445
14974991512,2cyclictest0-21swapper/507:59:165
14974991510,3cyclictest0-21swapper/509:50:425
1497499150,7cyclictest0-21swapper/512:28:595
1497499150,7cyclictest0-21swapper/512:28:595
1497499150,7cyclictest0-21swapper/511:51:015
1497499150,14cyclictest0-21swapper/512:03:225
1497499150,14cyclictest0-21swapper/507:16:495
1496999150,7cyclictest0-21swapper/412:14:144
1496999150,7cyclictest0-21swapper/411:50:274
1496999150,7cyclictest0-21swapper/409:33:564
1496999150,14cyclictest0-21swapper/411:23:054
1496999150,14cyclictest0-21swapper/411:19:474
14965991511,3cyclictest0-21swapper/311:22:353
1496599151,13cyclictest0-21swapper/309:12:363
1496599150,7cyclictest0-21swapper/309:07:253
1496599150,14cyclictest0-21swapper/310:56:253
1496599150,14cyclictest0-21swapper/307:53:233
1496599150,14cyclictest0-21swapper/307:33:023
14959991510,3cyclictest0-21swapper/208:38:222
1495999150,7cyclictest0-21swapper/212:38:292
1495999150,14cyclictest0-21swapper/212:06:002
1495999150,14cyclictest0-21swapper/209:55:222
1495999150,14cyclictest0-21swapper/209:30:202
1495499156,8cyclictest25826-21crond11:35:001
1495499155,5cyclictest19747-21ntp_states09:10:181
1495499150,7cyclictest0-21swapper/110:55:141
1495499150,4cyclictest0-21swapper/107:58:401
1495499150,14cyclictest0-21swapper/109:50:011
1495499150,14cyclictest0-21swapper/109:36:201
1495499150,11cyclictest0-21swapper/107:31:321
14950991511,3cyclictest1047-21NetworkManager10:15:010
1495099150,14cyclictest0-21swapper/010:09:070
1495099150,14cyclictest0-21swapper/007:26:570
1323852150,10pltrace54-21ksoftirqd/410:12:214
3071652140,3pltrace396-21chrt10:46:350
2451452140,0pltrace0-21swapper/712:34:287
2451452140,0pltrace0-21swapper/712:34:287
2235952140,8pltrace215-1kworker/0:1H+kblockd@
blk_mq_run_work_fn
10:35:010
2235952140,7pltrace24907-21sed10:35:010
1996852140,8pltrace0-21swapper/008:17:420
1506952140,9pltrace15104-21/usr/sbin/munin11:15:095
1498299145,7cyclictest1055-13auditd08:20:007
14982991413,1cyclictest0-21swapper/710:45:187
1498299140,7cyclictest0-21swapper/709:47:187
1498299140,7cyclictest0-21swapper/709:02:247
1498299140,3cyclictest0-21swapper/711:47:017
1498299140,13cyclictest0-21swapper/712:03:017
1498299140,13cyclictest0-21swapper/709:22:297
1498299140,13cyclictest0-21swapper/709:22:297
1498299140,13cyclictest0-21swapper/707:44:487
1497799141,12cyclictest0-21swapper/607:15:526
1497799140,7cyclictest0-21swapper/609:30:056
1497799140,14cyclictest0-21swapper/609:10:216
1497799140,13cyclictest0-21swapper/609:19:556
1497799140,13cyclictest0-21swapper/609:19:556
1497499149,3cyclictest0-21swapper/510:29:075
14974991410,3cyclictest0-21swapper/508:15:165
1497499140,7cyclictest0-21swapper/509:20:015
1497499140,7cyclictest0-21swapper/509:20:015
1497499140,1cyclictest0-21swapper/510:35:225
1496999148,5cyclictest0-21swapper/410:25:344
1496999141,12cyclictest0-21swapper/411:26:274
1496999140,13cyclictest0-21swapper/407:36:144
1496999140,1cyclictest0-21swapper/409:39:244
14965991410,1cyclictest0-21swapper/309:41:133
1496599140,8cyclictest0-21swapper/310:31:313
1496599140,7cyclictest0-21swapper/311:29:263
1496599140,7cyclictest0-21swapper/310:04:573
1496599140,7cyclictest0-21swapper/309:02:233
1496599140,3cyclictest0-21swapper/312:30:473
1496599140,3cyclictest0-21swapper/312:30:473
1496599140,1cyclictest0-21swapper/309:39:293
14959991411,2cyclictest1478-21lldpd07:38:542
1495999141,12cyclictest0-21swapper/211:10:332
1495999140,3cyclictest0-21swapper/207:55:532
1495499145,7cyclictest0-21swapper/107:20:141
1495499143,4cyclictest1089-21dbus-daemon11:40:001
1495499140,11cyclictest0-21swapper/110:28:001
1495099149,3cyclictest0-21swapper/008:44:220
1495099140,8cyclictest0-21swapper/011:45:250
1495099140,7cyclictest0-21swapper/011:00:260
3071652130,5pltrace0-21swapper/210:46:412
2945152130,0pltrace0-21swapper/709:34:217
2900752130,10pltrace0-21swapper/111:42:461
2725052130,8pltrace54-21ksoftirqd/407:33:534
2621852130,8pltrace0-21swapper/511:40:065
2621852130,1pltrace28641-21grep11:40:007
2167652130,3pltrace23707-21sed07:20:222
1498299137,5cyclictest0-21swapper/707:27:307
1498299130,12cyclictest0-21swapper/712:25:287
1498299130,12cyclictest0-21swapper/712:25:287
1498299130,12cyclictest0-21swapper/708:55:247
1497799137,5cyclictest0-21swapper/610:03:366
1497799136,6cyclictest0-21swapper/611:00:086
14977991312,1cyclictest0-21swapper/607:45:216
14977991310,2cyclictest1146-21snmpd12:35:106
1497499130,13cyclictest0-21swapper/510:53:215
1497499130,12cyclictest0-21swapper/512:22:595
1497499130,12cyclictest0-21swapper/509:24:005
1497499130,12cyclictest0-21swapper/509:24:005
14969991312,1cyclictest0-21swapper/411:35:194
1496999130,2cyclictest1178-21runrttasks10:30:334
1496999130,12cyclictest0-21swapper/410:16:454
1496999130,12cyclictest0-21swapper/409:00:094
1496599136,4cyclictest46-21ksoftirqd/311:50:123
14965991312,1cyclictest0-21swapper/311:33:273
1496599131,11cyclictest0-21swapper/308:05:453
1496599130,13cyclictest0-21swapper/310:40:013
1496599130,13cyclictest0-21swapper/308:03:283
1495999130,12cyclictest0-21swapper/210:59:272
1495999130,12cyclictest0-21swapper/207:12:532
1495499138,3cyclictest0-21swapper/107:15:561
1495499137,5cyclictest0-21swapper/109:25:181
1495499137,5cyclictest0-21swapper/109:25:181
1495499136,6cyclictest1478-21lldpd11:47:271
1495499135,1cyclictest0-21swapper/110:55:001
1495499134,4cyclictest4195-21http_loadtime07:45:151
1495499133,4cyclictest22398-21cat11:25:221
1495499133,4cyclictest13514-21cpu12:10:101
1495499133,4cyclictest1133-21rs:main1
1495499131,5cyclictest0-21swapper/112:33:281
1495499131,5cyclictest0-21swapper/112:33:281
1495499130,3cyclictest346-21cat08:35:181
1495499130,13cyclictest0-21swapper/108:23:001
1495499130,12cyclictest0-21swapper/107:28:211
1495499130,1cyclictest0-21swapper/112:00:261
1495499130,1cyclictest0-21swapper/110:40:171
14950991312,1cyclictest0-21swapper/009:35:170
14950991312,1cyclictest0-21swapper/008:05:170
14950991311,1cyclictest0-21swapper/011:40:150
1495099131,11cyclictest0-21swapper/012:06:570
1495099130,12cyclictest0-21swapper/011:54:280
1495099130,1cyclictest0-21swapper/008:39:260
986352120,5pltrace0-21swapper/008:57:250
968852120,5pltrace0-21swapper/510:01:555
775552120,4pltrace0-21swapper/612:04:246
3111452120,5pltrace0-21swapper/508:37:455
2725052120,3pltrace29306-21vmstat07:30:227
2666252120,7pltrace0-21swapper/609:29:426
2666252120,7pltrace0-21swapper/609:29:416
262552120,5pltrace0-21swapper/509:40:355
2108952120,3pltrace21490-21expr09:15:122
2108952120,3pltrace21490-21expr09:15:122
2064452120,4pltrace0-21swapper/511:27:535
1996852120,4pltrace0-21swapper/608:17:466
1506952120,5pltrace0-21swapper/011:15:100
1498299127,4cyclictest1064-13audispd12:40:007
1498299122,8cyclictest0-21swapper/708:08:497
14982991210,1cyclictest0-21swapper/710:02:137
1497799129,2cyclictest0-21swapper/607:29:536
1497799127,4cyclictest0-21swapper/610:25:566
1497799127,4cyclictest0-21swapper/607:52:216
1497799126,5cyclictest0-21swapper/610:07:276
14977991210,1cyclictest0-21swapper/610:35:126
14977991210,1cyclictest0-21swapper/609:40:376
1497499129,2cyclictest17110-21gltestperf12:15:135
1497499126,3cyclictest0-21swapper/509:28:065
1497499126,3cyclictest0-21swapper/509:28:065
1497499120,1cyclictest0-21swapper/509:36:575
1496999126,5cyclictest0-21swapper/407:50:084
1496999122,6cyclictest1055-13auditd09:58:274
14969991211,1cyclictest0-21swapper/411:45:124
1496999120,11cyclictest0-21swapper/409:47:404
1496999120,1cyclictest0-21swapper/410:41:344
1496599129,2cyclictest22370-21cat09:15:163
1496599129,2cyclictest22370-21cat09:15:163
1496599129,2cyclictest22234-21expr12:25:133
1496599129,2cyclictest22234-21expr12:25:133
1496599129,1cyclictest0-21swapper/312:24:353
1496599127,2cyclictest46-21ksoftirqd/307:20:143
1496599126,5cyclictest0-21swapper/312:35:503
1496599126,5cyclictest0-21swapper/312:07:273
1496599126,5cyclictest0-21swapper/311:46:243
1496599126,5cyclictest0-21swapper/309:51:433
1496599126,5cyclictest0-21swapper/307:56:413
1496599126,5cyclictest0-21swapper/307:48:323
1496599125,4cyclictest46-21ksoftirqd/311:55:153
1496599125,4cyclictest46-21ksoftirqd/308:20:223
14965991211,1cyclictest0-21swapper/307:17:393
14965991210,1cyclictest0-21swapper/311:35:143
1496599120,12cyclictest0-21swapper/309:45:053
1496599120,11cyclictest0-21swapper/307:14:063
1496599120,1cyclictest0-21swapper/308:36:493
1496599120,1cyclictest0-21swapper/307:41:363
1495999127,3cyclictest0-21swapper/212:14:492
1495999127,3cyclictest0-21swapper/211:46:272
14959991211,1cyclictest0-21swapper/211:02:272
14959991211,1cyclictest0-21swapper/210:03:122
1495999120,11cyclictest0-21swapper/212:19:302
1495999120,11cyclictest0-21swapper/209:42:282
1495999120,1cyclictest0-21swapper/212:24:312
1495499128,3cyclictest0-21swapper/108:58:371
1495499124,3cyclictest23177-21fschecks_time10:30:131
1495499124,2cyclictest2382-21cpuspeed_turbos11:50:121
1495499124,2cyclictest152672chrt07:10:111
1495499123,2cyclictest5966-21date07:50:011
1495499123,2cyclictest0-21swapper/108:30:161
1495499122,4cyclictest7880-21tune2fs08:50:131
1495499122,4cyclictest29867-21expr09:30:111
1495499122,4cyclictest21811-21aten_r4power_po12:25:111
1495499122,4cyclictest21811-21aten_r4power_po12:25:111
1495499122,3cyclictest84-21kauditd12:16:341
1495499122,3cyclictest32282-21sendmail_mailqu10:45:181
14954991210,1cyclictest0-21swapper/108:10:031
1495499121,4cyclictest12826-21taskset10:09:501
1495499121,3cyclictest0-21swapper/108:05:191
1495499121,2cyclictest0-21swapper/108:45:131
1495499120,5cyclictest573-21cpuspeed_turbos07:40:111
1495499120,5cyclictest26882-21sed08:25:171
1495499120,5cyclictest24339-21cstates09:20:131
1495499120,5cyclictest24339-21cstates09:20:131
1495499120,5cyclictest19940-21taskset08:15:001
1495499120,5cyclictest1178-21runrttasks08:01:191
1495499120,4cyclictest7974-21missed_timers11:00:171
1495499120,4cyclictest7191-21cut09:55:131
1495499120,4cyclictest6159-21grep09:50:091
1495499120,4cyclictest5086-21cpu11:55:131
1495499120,4cyclictest27645-21expr12:35:111
1495499120,4cyclictest22560-21pltrace09:15:171
1495499120,4cyclictest22560-21pltrace09:15:171
1495499120,4cyclictest16853-21aten_r4power_po10:20:101
1495499120,4cyclictest1605-21aten_r4power_vo08:40:121
1495499120,4cyclictest1178-21runrttasks12:05:091
1495499120,2cyclictest262552pltrace09:40:081
1495099128,3cyclictest29098-21fschecks_time08:30:130
1495099128,3cyclictest1146-21snmpd12:17:310
1495099127,4cyclictest624-21grep07:40:110
1495099126,5cyclictest0-21swapper/011:20:570
1495099126,5cyclictest0-21swapper/008:13:580
1495099126,5cyclictest0-21swapper/007:54:570
1495099126,3cyclictest0-21swapper/011:57:100
14950991211,1cyclictest0-21swapper/012:00:220
1495099120,12cyclictest0-21swapper/010:29:360
1495099120,11cyclictest0-21swapper/012:35:390
1437952120,0pltrace0-21swapper/208:07:362
2621852110,5pltrace0-21swapper/011:40:000
2554152110,8pltrace0-21swapper/508:27:455
2554152110,6pltrace78-21ksoftirqd/708:25:237
2172652110,1pltrace23984-21taskset12:28:090
2172652110,1pltrace23984-21taskset12:28:090
1498299116,4cyclictest12555-21gltestperf08:00:157
1498299116,3cyclictest0-21swapper/710:21:477
1498299116,3cyclictest0-21swapper/709:10:567
1498299115,5cyclictest0-21swapper/710:31:507
14982991110,1cyclictest0-21swapper/711:24:397
1498299110,11cyclictest0-21swapper/710:42:137
1498299110,11cyclictest0-21swapper/707:39:557
1498299110,1cyclictest0-21swapper/711:01:007
1498299110,1cyclictest0-21swapper/710:36:047
1497799119,2cyclictest0-21swapper/612:18:596
1497799117,2cyclictest0-21swapper/612:30:406
1497799117,2cyclictest0-21swapper/612:30:406
1497799116,4cyclictest0-21swapper/612:22:566
1497799116,4cyclictest0-21swapper/609:39:156
1497799116,3cyclictest0-21swapper/611:18:426
14977991110,1cyclictest0-21swapper/612:13:576
14977991110,1cyclictest0-21swapper/611:11:576
14977991110,1cyclictest0-21swapper/610:46:416
14977991110,1cyclictest0-21swapper/608:54:106
14977991110,1cyclictest0-21swapper/608:42:016
1497799110,11cyclictest0-21swapper/612:29:016
1497799110,11cyclictest0-21swapper/612:29:016
1497799110,11cyclictest0-21swapper/611:56:286
1497799110,11cyclictest0-21swapper/611:44:496
1497799110,11cyclictest0-21swapper/610:17:326
1497799110,11cyclictest0-21swapper/608:23:346
1497799110,11cyclictest0-21swapper/607:41:386
1497799110,1cyclictest0-21swapper/611:54:126
1497799110,1cyclictest0-21swapper/611:21:016
1497799110,1cyclictest0-21swapper/607:32:046
1497499116,4cyclictest0-21swapper/511:31:385
1497499116,2cyclictest0-21swapper/507:51:235
1497499116,2cyclictest0-21swapper/507:45:595
14974991110,1cyclictest0-21swapper/512:10:265
14974991110,1cyclictest0-21swapper/510:19:305
1497499110,11cyclictest0-21swapper/508:42:135
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional