You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 14:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Apr 07, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22458521150,106pltrace0-21swapper/307:09:563
19670521150,107pltrace0-21swapper/207:06:402
22458521030,56pltrace0-21swapper/707:07:387
1967052980,94pltrace0-21swapper/507:06:455
1967052930,90pltrace0-21swapper/607:06:536
1967052810,73pltrace0-21swapper/107:06:161
2251827143,10sleep00-21swapper/007:07:530
2258025844,10sleep40-21swapper/407:08:474
308232310,1sleep50-21swapper/507:20:165
2287899230,16cyclictest0-21swapper/410:35:594
276992200,1sleep00-21swapper/007:15:140
1650452200,4pltrace0-21swapper/710:50:177
1650452200,4pltrace0-21swapper/710:50:177
490552190,13pltrace7492-21awk07:35:215
2489652180,12pltrace0-21swapper/711:05:347
2489652180,12pltrace0-21swapper/711:05:347
2489652180,0pltrace0-21swapper/711:04:517
2489652180,0pltrace0-21swapper/711:04:517
22882991812,5cyclictest0-21swapper/512:20:065
2286599180,14cyclictest0-21swapper/110:59:401
2286599180,14cyclictest0-21swapper/110:59:401
1433652180,4pltrace0-21swapper/708:47:207
1093152180,3pltrace0-21swapper/710:37:427
1029652180,0pltrace0-21swapper/712:34:057
2489652170,12pltrace1146-21snmpd11:03:010
2489652170,12pltrace1146-21snmpd11:03:010
22887991714,2cyclictest2481-21taskset10:21:076
22878991711,3cyclictest0-21swapper/408:45:514
2287899171,4cyclictest0-21swapper/408:06:534
2287899170,16cyclictest0-21swapper/411:28:474
2287399172,6cyclictest1146-21snmpd10:37:413
2286599170,13cyclictest0-21swapper/109:08:011
2286199171,8cyclictest0-21swapper/008:15:290
1542752170,0pltrace0-21swapper/709:48:357
1155252170,7pltrace54-21ksoftirqd/408:44:244
598052160,3pltrace0-21swapper/708:35:037
490552160,13pltrace54-21ksoftirqd/407:35:134
3218252160,2pltrace0-21swapper/710:21:047
3155152160,0pltrace0-21swapper/712:16:037
2768552160,13pltrace0-21swapper/611:10:126
2289099166,9cyclictest1055-17auditd07:30:017
22890991611,4cyclictest0-21swapper/711:52:137
22890991611,4cyclictest0-21swapper/711:45:007
2289099160,15cyclictest0-21swapper/707:22:537
2289099160,11cyclictest0-21swapper/707:18:507
22887991613,2cyclictest27825-21/usr/sbin/munin08:15:216
22887991613,2cyclictest1478-21lldpd11:34:336
22887991613,2cyclictest1178-21runrttasks12:30:346
22887991613,2cyclictest10429-21cat10:35:226
2288799161,14cyclictest0-21swapper/612:19:186
2288799160,2cyclictest0-21swapper/610:40:156
2288799160,15cyclictest0-21swapper/608:37:446
2288799160,15cyclictest0-21swapper/607:20:076
2288299161,8cyclictest0-21swapper/512:28:165
2287899161,4cyclictest0-21swapper/407:45:384
2287899161,4cyclictest0-21swapper/407:45:384
2287899160,2cyclictest0-21swapper/410:40:124
2287899160,15cyclictest0-21swapper/407:58:204
2287399160,14cyclictest0-21swapper/312:32:083
22869991611,3cyclictest0-21swapper/211:56:052
2286999160,4cyclictest0-21swapper/212:17:382
22865991610,5cyclictest0-21swapper/108:25:121
2286599161,7cyclictest0-21swapper/108:30:211
2286599160,13cyclictest0-21swapper/110:45:171
2286199165,10cyclictest0-21swapper/007:15:000
2286199161,8cyclictest0-21swapper/009:14:520
2286199161,4cyclictest0-21swapper/009:23:400
2286199161,14cyclictest0-21swapper/008:01:010
2286199160,2cyclictest0-21swapper/010:40:180
1605152160,3pltrace0-21swapper/707:56:077
1542752160,12pltrace54-21ksoftirqd/409:47:194
1047852160,3pltrace0-21swapper/707:44:027
598052150,11pltrace54-21ksoftirqd/408:35:294
257152150,13pltrace0-21swapper/610:25:116
2289099157,7cyclictest1478-21lldpd09:22:317
22890991510,4cyclictest0-21swapper/711:29:377
2289099151,12cyclictest0-21swapper/711:10:117
2289099150,8cyclictest0-21swapper/710:00:497
2289099150,5cyclictest2711-21/usr/sbin/munin07:30:227
2289099150,14cyclictest0-21swapper/712:29:577
2288799159,5cyclictest0-21swapper/612:39:346
2288799154,1cyclictest0-21swapper/612:24:506
22887991513,1cyclictest31971-21unixbench_singl10:15:226
22887991513,1cyclictest28382-21latency10:10:146
22887991513,1cyclictest27701-21latency12:05:166
22887991513,1cyclictest24793-21/usr/sbin/munin09:05:166
22887991513,1cyclictest1146-21snmpd07:48:416
22887991513,1cyclictest1146-21snmpd07:48:416
22887991513,1cyclictest10780-21ntpq08:40:166
22887991512,2cyclictest17874-21cpuspeed_turbos08:55:106
22887991512,2cyclictest13775-21df_inode09:45:136
22887991512,2cyclictest1146-21snmpd09:27:436
2288799151,3cyclictest0-21swapper/610:30:216
2288799150,14cyclictest0-21swapper/612:10:576
2288799150,14cyclictest0-21swapper/611:52:046
2288799150,14cyclictest0-21swapper/608:05:596
2288799150,14cyclictest0-21swapper/607:14:466
2288299150,8cyclictest0-21swapper/511:14:585
2288299150,8cyclictest0-21swapper/509:19:595
2288299150,7cyclictest0-21swapper/509:57:225
2288299150,7cyclictest0-21swapper/508:57:005
2288299150,4cyclictest0-21swapper/510:27:415
2288299150,14cyclictest0-21swapper/509:45:345
2288299150,14cyclictest0-21swapper/509:01:395
22878991514,1cyclictest0-21swapper/411:13:224
2287899150,14cyclictest0-21swapper/411:50:014
2287899150,14cyclictest0-21swapper/410:26:384
2287899150,14cyclictest0-21swapper/407:53:414
2287899150,14cyclictest0-21swapper/407:53:414
2287399154,6cyclictest26614-21pltrace-run10:07:083
2287399150,7cyclictest0-21swapper/311:11:123
2286999150,8cyclictest0-21swapper/211:46:012
2286999150,7cyclictest0-21swapper/210:39:202
2286999150,4cyclictest0-21swapper/210:54:022
2286999150,4cyclictest0-21swapper/210:54:022
2286999150,3cyclictest0-21swapper/211:35:192
2286999150,14cyclictest9456-21strings12:30:152
2286999150,14cyclictest0-21swapper/209:28:312
2286999150,14cyclictest0-21swapper/207:17:392
2286599158,6cyclictest1146-21snmpd12:01:351
2286599151,3cyclictest0-21swapper/110:20:531
2286599150,8cyclictest10693-21latency_hist07:45:001
2286599150,4cyclictest0-21swapper/107:12:001
2286599150,14cyclictest0-21swapper/111:17:571
2286599150,14cyclictest0-21swapper/108:37:271
22861991510,3cyclictest0-21swapper/010:34:540
2286199150,7cyclictest0-21swapper/012:11:170
2286199150,7cyclictest0-21swapper/011:25:130
2286199150,7cyclictest0-21swapper/010:23:170
2286199150,4cyclictest0-21swapper/011:42:030
2286199150,4cyclictest0-21swapper/008:20:440
2286199150,14cyclictest0-21swapper/012:15:470
2272352150,4pltrace0-21swapper/009:03:340
2164652150,2pltrace0-21swapper/708:03:527
535552140,6pltrace54-21ksoftirqd/410:30:184
490552140,6pltrace0-21swapper/707:35:207
3218252140,6pltrace32375-21runrttasks10:19:472
2661052140,9pltrace1146-21snmpd10:09:220
2661052140,11pltrace54-21ksoftirqd/410:08:324
2289099145,8cyclictest1146-21snmpd12:10:087
2289099143,3cyclictest29218-21nfs4_client08:15:177
2289099143,10cyclictest0-21swapper/708:22:157
22890991410,4cyclictest0-21swapper/712:00:427
2289099140,14cyclictest0-21swapper/711:35:177
2289099140,10cyclictest0-21swapper/710:05:277
2289099140,1cyclictest0-21swapper/710:56:167
2289099140,1cyclictest0-21swapper/710:56:167
22887991413,1cyclictest10336-21cat11:35:116
22887991413,1cyclictest0-21swapper/611:49:046
22887991411,2cyclictest18524-21ntpq10:50:176
22887991411,2cyclictest18524-21ntpq10:50:176
22887991411,2cyclictest1146-21snmpd12:26:436
22887991410,1cyclictest191rcu_preempt10:58:336
22887991410,1cyclictest191rcu_preempt10:58:336
2288299145,8cyclictest0-21swapper/510:33:445
22882991411,2cyclictest0-21swapper/511:40:015
2288299141,12cyclictest0-21swapper/511:47:565
2288299140,8cyclictest0-21swapper/512:04:035
2288299140,7cyclictest0-21swapper/509:43:025
2288299140,7cyclictest0-21swapper/508:42:315
2288299140,3cyclictest0-21swapper/508:07:535
2288299140,14cyclictest0-21swapper/512:30:135
2288299140,13cyclictest0-21swapper/510:37:475
2288299140,1cyclictest0-21swapper/511:30:185
2287899149,3cyclictest0-21swapper/408:04:084
22878991411,2cyclictest1055-17auditd09:10:004
22878991410,3cyclictest1055-17auditd12:20:004
2287899140,8cyclictest0-21swapper/407:42:024
2287399140,13cyclictest0-21swapper/309:48:473
2287399140,1cyclictest0-21swapper/310:15:133
22869991413,1cyclictest0-21swapper/210:10:132
22869991411,2cyclictest0-21swapper/208:59:012
2286999141,11cyclictest14552-21crond08:50:012
2286999140,7cyclictest0-21swapper/208:20:482
2286999140,3cyclictest0-21swapper/208:01:302
2286999140,3cyclictest0-21swapper/207:35:572
2286999140,13cyclictest0-21swapper/208:50:162
2286599146,1cyclictest0-21swapper/108:05:201
2286599141,12cyclictest0-21swapper/111:40:581
2286599141,12cyclictest0-21swapper/109:58:411
2286599140,8cyclictest0-21swapper/110:40:121
2286599140,7cyclictest22948-21latency_hist09:05:011
2286599140,11cyclictest0-21swapper/112:13:111
22861991410,3cyclictest1146-21snmpd08:14:170
2286199140,8cyclictest0-21swapper/009:26:020
2286199140,7cyclictest0-21swapper/009:15:150
2286199140,3cyclictest0-21swapper/007:35:150
2272352140,0pltrace0-21swapper/709:05:117
2164652140,3pltrace0-21swapper/708:05:147
1650452140,10pltrace54-21ksoftirqd/410:50:474
1650452140,10pltrace54-21ksoftirqd/410:50:474
79952130,2pltrace812-21runrttasks11:17:145
2723552130,4pltrace0-21swapper/208:16:182
257152130,5pltrace0-21swapper/710:26:417
2316552130,10pltrace54-21ksoftirqd/412:00:014
2289099136,6cyclictest1146-21snmpd08:26:297
2289099133,9cyclictest0-21swapper/709:27:277
2289099133,9cyclictest0-21swapper/709:02:227
2289099133,4cyclictest26583-21basename12:05:117
2289099133,4cyclictest15674-21cpuspeed_turbos11:45:127
2289099132,10cyclictest0-21swapper/709:37:297
22890991312,1cyclictest0-21swapper/708:10:187
22890991311,2cyclictest0-21swapper/710:43:297
2289099130,4cyclictest1146-21snmpd11:22:527
2289099130,13cyclictest0-21swapper/711:31:447
2289099130,12cyclictest0-21swapper/710:17:327
2289099130,12cyclictest0-21swapper/709:10:007
2288799136,4cyclictest0-21swapper/611:03:106
2288799136,4cyclictest0-21swapper/611:03:106
22887991312,1cyclictest0-21swapper/611:20:136
22887991312,1cyclictest0-21swapper/609:30:116
22887991312,1cyclictest0-21swapper/607:17:126
22887991311,1cyclictest0-21swapper/612:00:016
22887991311,1cyclictest0-21swapper/607:56:356
22887991310,2cyclictest25475-21timerandwakeup12:00:216
2288799130,13cyclictest0-21swapper/611:40:196
2288799130,12cyclictest0-21swapper/609:59:046
2288299137,5cyclictest0-21swapper/509:20:575
2288299130,6cyclictest0-21swapper/509:30:005
2288299130,12cyclictest0-21swapper/508:52:245
2287899133,8cyclictest0-21swapper/409:21:004
2287899130,13cyclictest0-21swapper/407:27:394
2287899130,12cyclictest0-21swapper/411:09:014
2287899130,12cyclictest0-21swapper/411:09:004
2287899130,12cyclictest0-21swapper/408:53:014
2287399139,3cyclictest26659-21awk08:10:213
2287399137,5cyclictest8277-21switchtime08:35:213
2287399131,3cyclictest18790-21if_eth008:55:143
2287399130,7cyclictest0-21swapper/311:35:283
2287399130,6cyclictest0-21swapper/311:15:513
2287399130,13cyclictest0-21swapper/311:45:153
2287399130,12cyclictest0-21swapper/310:25:493
2287399130,12cyclictest0-21swapper/309:02:013
2287399130,12cyclictest0-21swapper/308:46:393
2286999137,5cyclictest0-21swapper/211:40:012
2286999137,5cyclictest0-21swapper/210:28:482
2286999130,12cyclictest0-21swapper/211:34:402
2286999130,12cyclictest0-21swapper/210:30:182
2286999130,12cyclictest0-21swapper/209:07:022
2286599139,1cyclictest0-21swapper/109:33:431
2286599136,3cyclictest0-21swapper/111:56:021
2286599134,5cyclictest0-21swapper/108:42:031
2286599130,7cyclictest0-21swapper/112:25:331
2286599130,7cyclictest0-21swapper/110:32:031
2286599130,13cyclictest0-21swapper/111:52:081
2286599130,13cyclictest0-21swapper/107:20:471
2286599130,12cyclictest0-21swapper/110:52:331
2286599130,12cyclictest0-21swapper/110:52:331
2286599130,12cyclictest0-21swapper/110:37:391
2286599130,12cyclictest0-21swapper/109:52:021
2286199139,3cyclictest0-21swapper/007:51:310
2286199139,3cyclictest0-21swapper/007:51:310
2286199130,12cyclictest0-21swapper/009:58:330
1542752130,6pltrace0-21swapper/009:47:260
750952120,5pltrace0-21swapper/012:31:230
706952120,9pltrace54-21ksoftirqd/409:36:054
706952120,5pltrace0-21swapper/009:36:120
490552120,1pltrace0-21swapper/107:35:191
427952120,0pltrace0-21swapper/209:31:222
33852120,5pltrace0-21swapper/508:26:105
3155152120,4pltrace0-21swapper/112:16:281
3001952120,2pltrace1146-21snmpd08:17:163
2316552120,1pltrace0-21swapper/012:00:130
2289099124,3cyclictest11851-21gltestperf12:35:137
2289099122,9cyclictest0-21swapper/711:57:577
2289099122,4cyclictest5061-21cpuspeed_turbos09:30:117
2289099122,4cyclictest10893-21processes08:40:177
22890991211,1cyclictest0-21swapper/711:15:137
2289099121,4cyclictest19132-21ntpq08:55:167
2289099121,2cyclictest0-21swapper/710:10:127
2289099121,2cyclictest0-21swapper/709:50:117
2289099121,2cyclictest0-21swapper/709:15:117
2289099121,10cyclictest0-21swapper/710:45:127
2289099120,5cyclictest4830-21if_err_eth008:30:137
2289099120,5cyclictest14828-21gltestperf07:50:137
2289099120,5cyclictest14828-21gltestperf07:50:137
2289099120,5cyclictest1146-21snmpd07:12:107
2289099120,4cyclictest4552-21grep12:20:227
2289099120,4cyclictest16905-21tail08:50:217
2289099120,4cyclictest12422-21tr07:45:177
2289099120,4cyclictest12422-21tr07:45:177
2289099120,2cyclictest0-21swapper/710:30:117
2288799129,2cyclictest30305-21nfs4_client09:15:166
2288799129,2cyclictest1178-21runrttasks07:39:586
2288799129,2cyclictest0-21swapper/609:40:006
2288799127,1cyclictest191rcu_preempt10:00:126
22887991211,1cyclictest0-21swapper/611:05:126
22887991211,1cyclictest0-21swapper/611:05:126
22887991211,1cyclictest0-21swapper/610:05:116
22887991211,1cyclictest0-21swapper/608:50:176
22887991211,1cyclictest0-21swapper/608:30:106
22887991211,1cyclictest0-21swapper/607:50:166
22887991211,1cyclictest0-21swapper/607:50:166
22887991211,1cyclictest0-21swapper/607:25:166
22887991210,1cyclictest0-21swapper/608:15:016
2288799121,7cyclictest21731-21sed09:00:156
2288799121,2cyclictest32586-21gltestperf09:20:146
2288799120,7cyclictest9146-21tune2fs07:40:156
2288799120,11cyclictest0-21swapper/609:11:096
2288799120,11cyclictest0-21swapper/608:00:466
2288799120,1cyclictest0-21swapper/608:26:396
2288299129,2cyclictest0-21swapper/507:44:325
2288299127,2cyclictest0-21swapper/507:29:075
2288299126,5cyclictest0-21swapper/512:18:515
2288299126,3cyclictest0-21swapper/508:13:455
2288299120,12cyclictest0-21swapper/511:20:065
2288299120,11cyclictest0-21swapper/508:00:015
2288299120,11cyclictest0-21swapper/507:57:265
2287899127,3cyclictest0-21swapper/409:10:554
22878991211,1cyclictest0-21swapper/411:34:434
2287899120,12cyclictest0-21swapper/412:01:074
2287899120,12cyclictest0-21swapper/407:12:454
2287899120,1cyclictest0-21swapper/410:24:364
2287399126,5cyclictest4868-21taskset07:31:523
2287399122,6cyclictest0-21swapper/310:52:073
2287399122,6cyclictest0-21swapper/310:52:073
2287399122,4cyclictest18523-21sed07:55:193
2287399121,5cyclictest6834-21needreboot07:35:163
2287399120,5cyclictest0-21swapper/310:56:023
2287399120,5cyclictest0-21swapper/310:56:023
2287399120,11cyclictest0-21swapper/310:20:043
2287399120,1cyclictest0-21swapper/312:05:493
2287399120,1cyclictest0-21swapper/309:34:063
2286999127,3cyclictest0-21swapper/209:00:552
2286999126,5cyclictest0-21swapper/211:18:212
22869991211,1cyclictest0-21swapper/209:23:262
2286599129,2cyclictest1178-21runrttasks08:53:311
2286599128,1cyclictest0-21swapper/109:21:351
2286599127,4cyclictest0-21swapper/110:15:591
2286599126,5cyclictest0-21swapper/110:11:531
2286599125,2cyclictest1146-21snmpd12:21:271
2286599125,2cyclictest1146-21snmpd10:04:501
22865991211,1cyclictest0-21swapper/111:49:031
2286599120,11cyclictest0-21swapper/107:25:271
2286199129,2cyclictest1-21systemd11:00:010
2286199129,2cyclictest1-21systemd11:00:010
2286199129,2cyclictest0-21swapper/008:56:520
2286199128,3cyclictest0-21swapper/010:52:480
2286199128,3cyclictest0-21swapper/010:52:480
2286199126,3cyclictest0-21swapper/009:34:070
22861991210,1cyclictest0-21swapper/007:40:240
2286199120,11cyclictest0-21swapper/011:54:320
2286199120,11cyclictest0-21swapper/008:29:020
2100452120,4pltrace0-21swapper/709:58:407
1605152120,4pltrace0-21swapper/107:55:411
1433652120,9pltrace1146-21snmpd08:48:260
985352110,5pltrace54-21ksoftirqd/409:40:324
3001952110,7pltrace54-21ksoftirqd/408:20:014
2531752110,7pltrace54-21ksoftirqd/407:15:144
2489652110,3pltrace0-21swapper/211:03:062
2489652110,3pltrace0-21swapper/211:03:062
2289099111,2cyclictest0-21swapper/709:40:117
2288799118,2cyclictest16679-21fschecks_count09:50:126
2288799118,1cyclictest191rcu_preempt11:15:136
22887991110,1cyclictest0-21swapper/611:25:226
22887991110,1cyclictest0-21swapper/608:45:146
22887991110,1cyclictest0-21swapper/608:20:146
22887991110,1cyclictest0-21swapper/607:30:146
2288799110,6cyclictest0-21swapper/610:45:116
2288799110,4cyclictest10797-21seq09:40:116
2288299117,3cyclictest23439-21fschecks_time11:00:145
2288299117,3cyclictest23439-21fschecks_time11:00:145
2288299116,2cyclictest0-21swapper/510:55:575
2288299116,2cyclictest0-21swapper/510:55:565
2288299116,2cyclictest0-21swapper/508:32:095
2288299114,6cyclictest1055-13auditd10:09:385
22882991110,1cyclictest0-21swapper/511:05:035
22882991110,1cyclictest0-21swapper/511:05:035
22882991110,1cyclictest0-21swapper/507:15:185
22882991110,1cyclictest0-21swapper/507:10:465
2288299110,11cyclictest0-21swapper/508:17:195
2288299110,11cyclictest0-21swapper/507:52:525
2288299110,11cyclictest0-21swapper/507:52:525
2288299110,1cyclictest0-21swapper/511:55:535
2288299110,1cyclictest0-21swapper/511:41:485
2288299110,1cyclictest0-21swapper/510:52:445
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional