You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 01:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Jul 08, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32444521130,105pltrace0-21swapper/107:07:201
2827521130,109pltrace0-21swapper/507:10:015
32444521090,104pltrace0-21swapper/207:07:492
32444521080,100pltrace0-21swapper/607:09:176
3181252790,0pltrace0-21swapper/212:35:012
251327157,10sleep30-21swapper/307:05:483
270726440,20sleep00-21swapper/007:08:340
278826248,10sleep70-21swapper/707:09:467
257025743,10sleep40-21swapper/407:06:374
2974152520,7pltrace78-21ksoftirqd/709:35:297
2528152520,8pltrace78-21ksoftirqd/709:33:017
299099470,2cyclictest5909-21latency_hist09:10:011
2684952430,3pltrace0-21swapper/711:20:287
290052410,6pltrace78-21ksoftirqd/710:21:227
3131152390,3pltrace78-21ksoftirqd/711:25:337
412052380,8pltrace78-21ksoftirqd/712:05:547
1406452370,10pltrace78-21ksoftirqd/711:41:447
1112252360,6pltrace78-21ksoftirqd/709:17:247
1112252360,6pltrace78-21ksoftirqd/709:17:247
3202952350,1pltrace0-21swapper/012:00:010
3181252350,8pltrace78-21ksoftirqd/712:38:447
2754752350,3pltrace78-21ksoftirqd/711:56:447
1633252350,7pltrace78-21ksoftirqd/709:20:207
1633252350,7pltrace78-21ksoftirqd/709:20:207
1752552340,7pltrace78-21ksoftirqd/712:20:457
1752552340,7pltrace78-21ksoftirqd/712:20:457
163052340,9pltrace78-21ksoftirqd/709:41:127
1255852340,1pltrace15894-21ssh10:31:447
3202952320,0pltrace0-21swapper/712:02:527
2653452310,0pltrace0-21swapper/710:10:437
2308552310,6pltrace78-21ksoftirqd/711:54:457
742252300,0pltrace0-21swapper/710:25:137
2653452300,1pltrace26536-21tee10:10:007
888652290,2pltrace0-21swapper/711:36:177
994052230,2pltrace0-21swapper/709:50:017
2528152230,2pltrace25367-21latency_hist09:30:007
298699210,16cyclictest0-21swapper/010:01:380
300999200,12cyclictest0-21swapper/409:20:194
300999200,12cyclictest0-21swapper/409:20:194
299999200,1cyclictest0-21swapper/311:40:063
2239552200,12pltrace24073-21load10:05:166
300999190,2cyclictest0-21swapper/407:12:074
299099199,4cyclictest1055-17auditd09:40:001
1255852190,0pltrace0-21swapper/710:35:007
301999180,17cyclictest4950-21ls11:30:156
300999181,4cyclictest0-21swapper/412:23:064
300999181,4cyclictest0-21swapper/412:23:064
568452170,0pltrace0-21swapper/707:15:057
3269252170,3pltrace0-21swapper/709:03:387
300999173,12cyclictest0-21swapper/410:10:004
3009991714,2cyclictest1063-17auditd08:15:004
298699171,8cyclictest0-21swapper/010:31:030
298699170,15cyclictest26111-21ssh11:19:100
2684952170,13pltrace0-21swapper/111:24:451
1488752170,11pltrace17455-21sshd07:32:117
481552160,0pltrace0-21swapper/708:10:127
3025991610,5cyclictest0-21swapper/710:50:547
302599160,8cyclictest0-21swapper/708:38:307
302599160,8cyclictest0-21swapper/708:03:267
302599160,2cyclictest1280-21ssh10:16:087
3015991611,3cyclictest0-21swapper/512:20:005
3015991611,3cyclictest0-21swapper/512:20:005
3015991611,3cyclictest0-21swapper/511:35:465
301599161,3cyclictest0-21swapper/509:29:085
301599160,3cyclictest0-21swapper/509:52:395
301599160,3cyclictest0-21swapper/507:42:285
301599160,15cyclictest0-21swapper/511:42:085
301599160,15cyclictest0-21swapper/510:11:115
3009991611,3cyclictest0-21swapper/409:07:224
300999160,8cyclictest0-21swapper/407:38:464
300999160,4cyclictest0-21swapper/407:26:134
300999160,2cyclictest0-21swapper/409:15:214
300999160,2cyclictest0-21swapper/409:15:214
300999160,15cyclictest0-21swapper/411:27:314
2999991610,3cyclictest0-21swapper/312:25:063
299999161,4cyclictest0-21swapper/312:10:573
299999161,14cyclictest0-21swapper/310:03:323
299999160,15cyclictest0-21swapper/312:16:213
299999160,15cyclictest0-21swapper/312:16:213
299999160,15cyclictest0-21swapper/311:00:223
2995991613,2cyclictest9603-21ssh09:12:212
2990991610,5cyclictest0-21swapper/109:55:121
299099161,14cyclictest0-21swapper/107:28:161
2986991612,2cyclictest0-21swapper/010:50:110
2986991611,3cyclictest0-21swapper/009:42:250
298699161,8cyclictest0-21swapper/008:52:270
298699161,3cyclictest0-21swapper/012:16:340
298699161,3cyclictest0-21swapper/012:16:330
298699161,14cyclictest0-21swapper/012:12:160
298699161,14cyclictest0-21swapper/011:08:160
298699160,4cyclictest2827-21ssh10:19:540
298699160,15cyclictest0-21swapper/011:40:150
263002160,1sleep1281rcuc/110:42:271
2528152160,11pltrace54-21ksoftirqd/409:34:094
2239052160,11pltrace54-21ksoftirqd/411:15:244
1306352160,12pltrace54-21ksoftirqd/412:19:074
1306352160,12pltrace54-21ksoftirqd/412:19:074
994052150,12pltrace54-21ksoftirqd/409:54:324
3025991511,2cyclictest0-21swapper/708:58:427
302599150,14cyclictest0-21swapper/711:31:587
302599150,14cyclictest0-21swapper/708:24:377
302599150,14cyclictest0-21swapper/708:06:177
301999150,14cyclictest0-21swapper/612:00:026
301999150,14cyclictest0-21swapper/611:40:076
301999150,14cyclictest0-21swapper/610:45:436
301999150,1cyclictest0-21swapper/610:57:036
3015991512,2cyclictest0-21swapper/510:05:095
301599150,7cyclictest0-21swapper/511:45:505
301599150,14cyclictest0-21swapper/511:53:325
301599150,14cyclictest0-21swapper/511:27:495
301599150,14cyclictest0-21swapper/509:02:485
301599150,14cyclictest0-21swapper/507:14:165
3009991510,4cyclictest0-21swapper/410:32:004
300999150,8cyclictest0-21swapper/410:04:094
300999150,4cyclictest0-21swapper/409:25:384
300999150,14cyclictest0-21swapper/411:04:004
300999150,14cyclictest0-21swapper/409:37:094
300999150,14cyclictest0-21swapper/408:30:484
2999991513,1cyclictest0-21swapper/311:07:393
299999150,8cyclictest0-21swapper/310:32:453
299999150,7cyclictest0-21swapper/310:35:153
299999150,7cyclictest0-21swapper/309:48:093
299999150,3cyclictest0-21swapper/308:19:373
299999150,14cyclictest0-21swapper/311:34:043
299999150,14cyclictest0-21swapper/310:56:573
299999150,14cyclictest0-21swapper/307:56:323
299999150,14cyclictest0-21swapper/307:47:353
299599150,14cyclictest0-21swapper/210:05:182
2990991510,3cyclictest0-21swapper/112:36:131
2990991510,3cyclictest0-21swapper/108:55:041
299099151,3cyclictest0-21swapper/107:21:581
299099150,8cyclictest0-21swapper/108:50:011
299099150,14cyclictest0-21swapper/112:29:331
299099150,14cyclictest0-21swapper/112:13:301
299099150,14cyclictest0-21swapper/111:25:181
299099150,14cyclictest0-21swapper/111:11:491
299099150,14cyclictest0-21swapper/108:27:331
299099150,1cyclictest0-21swapper/110:09:441
2986991511,3cyclictest0-21swapper/008:32:150
2986991510,3cyclictest0-21swapper/010:44:090
2986991510,3cyclictest0-21swapper/009:00:480
298699150,4cyclictest0-21swapper/009:12:380
298699150,2cyclictest0-21swapper/012:25:120
298699150,14cyclictest0-21swapper/012:06:090
298699150,14cyclictest0-21swapper/010:00:010
298699150,14cyclictest0-21swapper/008:14:320
2667552150,11pltrace54-21ksoftirqd/412:30:434
2239552150,5pltrace0-21swapper/310:05:133
2239052150,0pltrace0-21swapper/711:15:017
1823952150,0pltrace0-21swapper/710:00:107
1112252150,11pltrace0-21swapper/109:16:141
1112252150,11pltrace0-21swapper/109:16:141
994052140,6pltrace0-21swapper/309:54:403
3160852140,11pltrace54-21ksoftirqd/408:01:414
302599149,3cyclictest0-21swapper/707:20:347
302599148,5cyclictest0-21swapper/709:59:567
302599140,7cyclictest0-21swapper/709:14:387
302599140,7cyclictest0-21swapper/707:11:087
302599140,3cyclictest0-21swapper/712:10:367
302599140,3cyclictest0-21swapper/707:52:077
302599140,1cyclictest0-21swapper/712:27:277
302599140,1cyclictest0-21swapper/711:46:007
302599140,1cyclictest0-21swapper/710:41:337
3019991413,1cyclictest0-21swapper/611:17:376
3019991413,1cyclictest0-21swapper/611:07:356
3019991413,1cyclictest0-21swapper/610:28:246
3019991412,1cyclictest0-21swapper/612:06:016
301999140,14cyclictest0-21swapper/612:32:356
301999140,13cyclictest0-21swapper/611:54:516
301999140,1cyclictest0-21swapper/612:20:266
301999140,1cyclictest0-21swapper/612:20:266
301999140,1cyclictest0-21swapper/612:18:206
301999140,1cyclictest0-21swapper/612:18:206
301999140,1cyclictest0-21swapper/609:37:536
301999140,1cyclictest0-21swapper/608:25:216
301599140,8cyclictest0-21swapper/507:48:355
301599140,7cyclictest0-21swapper/512:29:415
301599140,7cyclictest0-21swapper/510:52:405
301599140,3cyclictest0-21swapper/509:16:405
301599140,3cyclictest0-21swapper/509:16:405
301599140,13cyclictest0-21swapper/510:19:305
301599140,13cyclictest0-21swapper/510:04:475
301599140,12cyclictest0-21swapper/508:49:365
300999149,4cyclictest0-21swapper/407:32:584
300999140,7cyclictest0-21swapper/408:26:374
300999140,3cyclictest0-21swapper/410:40:394
300999140,14cyclictest0-21swapper/411:31:124
300999140,13cyclictest0-21swapper/410:25:094
300999140,13cyclictest0-21swapper/410:24:184
300999140,13cyclictest0-21swapper/410:15:114
300999140,13cyclictest0-21swapper/409:55:204
300999140,13cyclictest0-21swapper/407:53:534
300999140,1cyclictest0-21swapper/412:00:114
300999140,1cyclictest0-21swapper/409:46:364
2999991413,1cyclictest0-21swapper/312:23:353
2999991413,1cyclictest0-21swapper/312:23:353
299999140,13cyclictest0-21swapper/312:07:043
299999140,1cyclictest0-21swapper/312:35:433
299999140,1cyclictest0-21swapper/310:51:473
2995991413,1cyclictest0-21swapper/212:17:052
2995991413,1cyclictest0-21swapper/212:17:052
2995991413,1cyclictest0-21swapper/209:40:422
299599140,14cyclictest0-21swapper/212:33:562
299599140,14cyclictest0-21swapper/212:22:362
299599140,14cyclictest0-21swapper/212:22:362
299599140,13cyclictest0-21swapper/211:08:232
299599140,1cyclictest0-21swapper/210:57:552
299599140,1cyclictest0-21swapper/209:15:462
299599140,1cyclictest0-21swapper/209:15:452
2990991413,1cyclictest0-21swapper/112:16:411
2990991413,1cyclictest0-21swapper/112:16:411
2990991413,1cyclictest0-21swapper/110:28:421
2990991413,1cyclictest0-21swapper/109:34:561
2990991411,2cyclictest0-21swapper/109:25:031
299099140,14cyclictest0-21swapper/109:49:401
299099140,14cyclictest0-21swapper/109:10:191
299099140,1cyclictest0-21swapper/110:00:491
299099140,1cyclictest0-21swapper/109:40:261
2986991412,1cyclictest0-21swapper/012:37:140
2986991411,2cyclictest0-21swapper/008:36:380
298699140,7cyclictest0-21swapper/011:11:370
298699140,7cyclictest0-21swapper/007:49:370
298699140,14cyclictest0-21swapper/011:56:170
298699140,14cyclictest0-21swapper/010:36:360
298699140,14cyclictest0-21swapper/010:11:400
298699140,13cyclictest0-21swapper/011:30:210
298699140,1cyclictest0-21swapper/012:23:290
298699140,1cyclictest0-21swapper/012:23:290
298699140,1cyclictest0-21swapper/009:34:360
298699140,1cyclictest0-21swapper/009:21:590
298699140,1cyclictest0-21swapper/009:21:590
2684952140,10pltrace54-21ksoftirqd/411:24:324
2239552140,5pltrace0-21swapper/010:05:130
217252140,1sleep00-21swapper/011:47:410
1596752140,5pltrace0-21swapper/108:33:311
888652130,7pltrace12427-21ssh11:37:453
888652130,4pltrace0-21swapper/611:37:466
742252130,7pltrace0-21swapper/210:26:222
742252130,3pltrace10510-21sh10:26:183
439852130,5pltrace0-21swapper/110:56:231
439852130,5pltrace0-21swapper/010:56:230
412052130,5pltrace0-21swapper/112:06:351
3084452130,5pltrace0-21swapper/310:15:373
302599137,5cyclictest78-21ksoftirqd/711:00:007
302599136,6cyclictest16352-21/usr/sbin/munin08:30:197
302599136,6cyclictest0-21swapper/712:35:007
3025991312,1cyclictest0-21swapper/709:50:537
302599130,12cyclictest0-21swapper/708:50:517
302599130,12cyclictest0-21swapper/707:27:167
3019991312,1cyclictest0-21swapper/611:57:276
3019991312,1cyclictest0-21swapper/610:44:556
3019991312,1cyclictest0-21swapper/609:32:236
3019991312,1cyclictest0-21swapper/609:29:376
3019991312,1cyclictest0-21swapper/609:23:196
3019991312,1cyclictest0-21swapper/609:23:196
3019991312,1cyclictest0-21swapper/609:15:036
3019991312,1cyclictest0-21swapper/609:15:036
301999130,1cyclictest0-21swapper/609:47:266
301599138,3cyclictest0-21swapper/508:34:005
301599137,5cyclictest0-21swapper/509:13:135
3015991310,2cyclictest1478-21lldpd10:40:105
301599130,12cyclictest0-21swapper/511:23:585
301599130,12cyclictest0-21swapper/508:40:185
3009991312,1cyclictest0-21swapper/412:07:284
3009991312,1cyclictest0-21swapper/411:56:174
3009991312,1cyclictest0-21swapper/411:46:154
3009991312,1cyclictest0-21swapper/410:11:524
3009991312,1cyclictest0-21swapper/409:11:574
3009991312,1cyclictest0-21swapper/408:51:144
3009991310,2cyclictest1478-21lldpd07:49:074
300999130,13cyclictest0-21swapper/411:55:004
300999130,13cyclictest0-21swapper/411:07:144
300999130,13cyclictest0-21swapper/410:52:594
300999130,13cyclictest0-21swapper/410:49:454
300999130,1cyclictest0-21swapper/412:36:564
299999133,8cyclictest0-21swapper/309:00:003
2999991312,1cyclictest0-21swapper/309:39:443
299999130,13cyclictest0-21swapper/310:10:393
299999130,12cyclictest0-21swapper/310:45:103
2995991312,1cyclictest0-21swapper/211:53:272
2995991312,1cyclictest0-21swapper/211:39:322
2995991312,1cyclictest0-21swapper/208:00:182
299599130,13cyclictest0-21swapper/212:28:542
299599130,13cyclictest0-21swapper/211:49:052
299599130,13cyclictest0-21swapper/210:45:432
299599130,13cyclictest0-21swapper/209:55:352
299599130,1cyclictest0-21swapper/210:50:092
299099138,3cyclictest0-21swapper/111:41:321
2990991312,1cyclictest0-21swapper/110:48:261
2990991312,1cyclictest0-21swapper/109:54:511
299099130,12cyclictest0-21swapper/109:01:091
299099130,1cyclictest0-21swapper/109:23:071
299099130,1cyclictest0-21swapper/109:23:071
298699137,3cyclictest0-21swapper/008:43:000
2986991312,1cyclictest0-21swapper/010:49:040
298699130,13cyclictest0-21swapper/011:27:460
298699130,13cyclictest0-21swapper/009:54:500
298699130,12cyclictest0-21swapper/009:29:490
298699130,12cyclictest0-21swapper/007:18:380
2882252130,0pltrace0-21swapper/707:56:287
2684952130,6pltrace0-21swapper/011:24:420
2667552130,7pltrace0-21swapper/112:30:551
2667552130,1pltrace0-21swapper/312:30:533
2239052130,5pltrace0-21swapper/111:15:361
1808352130,5pltrace0-21swapper/110:36:361
1344152130,5pltrace0-21swapper/111:05:531
107602130,2sleep4531ktimers/407:20:154
1039252130,5pltrace0-21swapper/608:24:456
742252120,6pltrace0-21swapper/010:26:220
412052120,5pltrace0-21swapper/212:06:362
370252120,4pltrace5926-21rm11:30:235
3269252120,0pltrace0-21swapper/309:01:213
311052120,5pltrace0-21swapper/609:07:586
311052120,4pltrace0-21swapper/209:07:572
302599128,1cyclictest0-21swapper/710:46:207
302599126,3cyclictest0-21swapper/711:04:017
302599125,6cyclictest0-21swapper/711:14:027
302599125,6cyclictest0-21swapper/711:05:177
3025991211,1cyclictest0-21swapper/708:29:267
302599120,1cyclictest0-21swapper/708:43:127
301999129,2cyclictest22349-21ssh11:49:116
3019991211,1cyclictest0-21swapper/610:11:536
3019991211,1cyclictest0-21swapper/609:57:486
301999120,1cyclictest0-21swapper/611:20:356
301599127,3cyclictest0-21swapper/508:20:115
301599126,5cyclictest0-21swapper/509:43:195
301599123,8cyclictest0-21swapper/508:35:385
3015991210,1cyclictest0-21swapper/510:25:525
301599120,12cyclictest0-21swapper/512:39:275
301599120,11cyclictest0-21swapper/511:04:055
301599120,11cyclictest0-21swapper/508:28:295
300999126,5cyclictest0-21swapper/409:02:064
300999126,3cyclictest0-21swapper/411:10:134
300999120,11cyclictest0-21swapper/408:59:204
300999120,11cyclictest0-21swapper/407:16:194
299999128,3cyclictest0-21swapper/309:26:223
299999128,3cyclictest0-21swapper/308:46:573
299999128,2cyclictest0-21swapper/307:15:073
299999127,4cyclictest0-21swapper/311:26:433
299999127,3cyclictest0-21swapper/309:56:023
299999127,3cyclictest0-21swapper/308:27:513
2999991211,1cyclictest0-21swapper/311:24:293
2999991211,1cyclictest0-21swapper/309:31:283
2999991210,1cyclictest0-21swapper/309:24:213
2999991210,1cyclictest0-21swapper/309:24:213
299999120,11cyclictest0-21swapper/308:50:013
2995991211,1cyclictest0-21swapper/212:13:412
2995991211,1cyclictest0-21swapper/211:19:462
299599120,1cyclictest0-21swapper/210:10:092
299599120,1cyclictest0-21swapper/209:30:492
299599120,1cyclictest0-21swapper/208:48:332
299599120,1cyclictest0-21swapper/208:40:552
2990352120,5pltrace0-21swapper/208:59:352
299099126,3cyclictest2600-21rm10:51:401
2990991211,1cyclictest0-21swapper/111:50:561
2990991211,1cyclictest0-21swapper/110:16:331
299099120,11cyclictest0-21swapper/108:14:281
299099120,11cyclictest0-21swapper/107:56:011
299099120,11cyclictest0-21swapper/107:18:071
298699127,3cyclictest0-21swapper/009:37:580
298699126,4cyclictest0-21swapper/011:01:080
298699120,12cyclictest0-21swapper/007:53:240
2667552120,1pltrace0-21swapper/512:30:525
2308552120,6pltrace0-21swapper/011:52:450
202052120,5pltrace0-21swapper/308:06:443
1808352120,4pltrace0-21swapper/610:36:366
1767352120,8pltrace78-21ksoftirqd/707:38:147
1767352120,5pltrace0-21swapper/307:39:023
888652110,7pltrace54-21ksoftirqd/411:40:004
760552110,4pltrace78-21ksoftirqd/708:15:167
3160852110,6pltrace32320-21expr08:00:110
302599115,5cyclictest0-21swapper/712:17:417
302599115,5cyclictest0-21swapper/712:17:417
302599115,5cyclictest0-21swapper/709:05:157
301999118,2cyclictest1146-21snmpd08:36:576
3019991110,1cyclictest0-21swapper/609:00:586
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional