You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 06:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Apr 06, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
341922621020,0sleep50-21swapper/500:17:335
341922621020,0sleep50-21swapper/500:17:335
29570612970,1sleep72957063-21tr21:02:447
271713599590,57cyclictest650-21systemd-journal23:22:217
2717126995754,2cyclictest3319470-21kworker/u16:5+flush-8:023:37:355
271669625746,8sleep60-21swapper/619:00:336
2717126995451,2cyclictest3358796-21kworker/u16:2+events_unbound00:02:235
2717126995250,2cyclictest2807197-21kworker/u16:0+flush-8:021:12:365
2717126995048,2cyclictest3358796-21kworker/u16:2+events_unbound00:12:515
2717126995048,2cyclictest2998276-21kworker/u16:0+events_unbound21:57:355
2717127994945,3cyclictest3319470-21kworker/u16:5+flush-8:023:57:206
2717126994947,2cyclictest2984048-21kworker/u16:1+events_unbound22:07:355
2717127994846,2cyclictest2726571-21kworker/u16:4+events_unbound19:17:216
2717126994846,2cyclictest2984048-21kworker/u16:1+events_unbound21:37:355
2717126994846,2cyclictest2984048-21kworker/u16:1+events_unbound21:37:355
2717126994846,2cyclictest2726571-21kworker/u16:4+flush-8:019:12:475
2717126994644,2cyclictest3310675-21kworker/u16:2+events_unbound23:32:475
2717135994539,5cyclictest2883207-21latency_hist20:27:217
2717126994543,2cyclictest3166637-21kworker/u16:3+flush-8:022:37:215
2717126994543,2cyclictest2962087-21kworker/u16:5+events_unbound21:32:475
2717135994439,4cyclictest3394397-21latency_hist00:07:217
2717127994442,2cyclictest2962087-21kworker/u16:5+events_unbound22:12:206
2717127994441,2cyclictest2962087-21kworker/u16:5+flush-8:022:17:356
2717126994442,2cyclictest3106233-21kworker/u16:2+events_unbound22:57:115
2717126994442,2cyclictest3106233-21kworker/u16:2+events_unbound22:57:115
2717126994439,2cyclictest2807197-21kworker/u16:0+events_unbound20:37:355
2717127994341,2cyclictest3416133-21kworker/u16:4+events_unbound00:22:356
2717127994341,2cyclictest2962087-21kworker/u16:5+flush-8:021:12:216
2717127994340,2cyclictest2635520-21kworker/u16:3+events_unbound19:42:366
2717127994339,3cyclictest2746491-21kworker/u16:1+flush-8:019:37:216
2717126994341,2cyclictest3358796-21kworker/u16:2+events_unbound00:01:195
2717126994341,2cyclictest3213374-21kworker/u16:4+events_unbound23:09:045
2717126994340,2cyclictest2962087-21kworker/u16:5+events_unbound21:22:345
2717126994240,2cyclictest3213153-21kworker/u16:3+events_unbound23:16:515
2717126994239,2cyclictest3416132-21kworker/u16:3+events_unbound00:22:235
271668524232,7sleep40-21swapper/419:00:224
271666824232,7sleep50-21swapper/519:00:075
27117922423,32sleep70-21swapper/718:57:457
2717127994138,2cyclictest3213374-21kworker/u16:4+events_unbound23:12:396
2717127994138,2cyclictest3213153-21kworker/u16:3+events_unbound23:22:396
2717126994139,2cyclictest3213374-21kworker/u16:4+events_unbound23:04:035
2717126994139,2cyclictest2984048-21kworker/u16:1+events_unbound21:47:465
2717126994139,2cyclictest2984048-21kworker/u16:1+events_unbound21:29:485
2717126994139,2cyclictest2962086-21kworker/u16:4+events_unbound21:08:595
2717126994038,2cyclictest2998276-21kworker/u16:0+events_unbound21:57:195
2717126994038,2cyclictest2984048-21kworker/u16:1+events_unbound22:41:275
2717126994038,2cyclictest2864101-21kworker/u16:1+events_unbound21:03:445
2717126994037,2cyclictest2787685-21kworker/u16:4+events_unbound20:07:355
2717126994037,2cyclictest2746491-21kworker/u16:1+flush-8:019:47:365
2717127993937,2cyclictest3247878-21kworker/u16:0+flush-8:023:03:166
2717127993937,2cyclictest3106233-21kworker/u16:2+flush-8:022:47:516
2717126993937,2cyclictest3247878-21kworker/u16:0+events_unbound23:18:355
2717126993937,2cyclictest3141984-21kworker/u16:0+events_unbound22:44:525
2717126993937,2cyclictest2984048-21kworker/u16:1+events_unbound22:04:525
2717126993937,2cyclictest2746491-21kworker/u16:1+events_unbound19:52:245
2717126993936,2cyclictest3213374-21kworker/u16:4+flush-8:022:57:405
2717127993836,2cyclictest3319470-21kworker/u16:5+flush-8:023:47:506
2717127993836,2cyclictest3319470-21kworker/u16:5+flush-8:023:42:556
2717127993836,2cyclictest3247878-21kworker/u16:0+flush-8:023:17:566
2717127993836,2cyclictest2998276-21kworker/u16:0+flush-8:021:22:386
2717127993835,3cyclictest3213374-21kworker/u16:4+flush-8:000:07:376
2717127993835,2cyclictest3106233-21kworker/u16:2+flush-8:022:32:366
2717126993836,2cyclictest3358796-21kworker/u16:2+events_unbound23:54:325
2717126993836,2cyclictest3319470-21kworker/u16:5+events_unbound00:31:075
2717126993836,2cyclictest3247878-21kworker/u16:0+events_unbound23:27:115
2717126993836,2cyclictest2984048-21kworker/u16:1+events_unbound21:20:445
2717126993835,2cyclictest3213374-21kworker/u16:4+flush-8:023:42:315
2717126993835,2cyclictest3213153-21kworker/u16:3+flush-8:023:27:315
2717127993735,2cyclictest3319470-21kworker/u16:5+flush-8:023:33:196
2717127993735,2cyclictest2746491-21kworker/u16:1+flush-8:019:52:476
2717126993735,2cyclictest3106233-21kworker/u16:2+events_unbound22:18:395
2717126993735,2cyclictest2826180-21kworker/u16:2+events_unbound20:12:405
2717126993734,2cyclictest3213374-21kworker/u16:4+flush-8:000:07:315
2717127993634,2cyclictest3416132-21kworker/u16:3+events_unbound00:17:546
2717127993634,2cyclictest3416132-21kworker/u16:3+events_unbound00:17:546
2717127993634,2cyclictest2962087-21kworker/u16:5+flush-8:021:42:496
2717127993634,2cyclictest2716874-21kworker/u16:0+flush-8:019:07:216
2717127993633,2cyclictest2864101-21kworker/u16:1+flush-8:021:02:406
2717126993634,2cyclictest3106233-21kworker/u16:2+flush-8:022:47:475
2717126993634,2cyclictest2984048-21kworker/u16:1+events_unbound22:13:405
2717126993634,2cyclictest2864101-21kworker/u16:1+events_unbound20:32:345
2717135993530,4cyclictest2998236-21latency_hist21:22:217
2717127993533,2cyclictest2864101-21kworker/u16:1+flush-8:020:22:366
2717127993532,2cyclictest2984048-21kworker/u16:1+flush-8:021:57:276
2717126993533,2cyclictest2962087-21kworker/u16:5+events_unbound21:44:565
2717127993432,2cyclictest2998276-21kworker/u16:0+events_unbound21:52:456
2717127993432,2cyclictest2826180-21kworker/u16:2+flush-8:020:17:386
2717126993432,2cyclictest3286284-21kworker/u16:1+events_unbound23:50:285
2717126993432,2cyclictest3141984-21kworker/u16:0+events_unbound22:28:005
2717126993432,2cyclictest2864101-21kworker/u16:1+events_unbound20:47:435
2717126993432,2cyclictest2807197-21kworker/u16:0+flush-8:020:42:435
2717126993432,2cyclictest2746491-21kworker/u16:1+events_unbound19:27:515
2717135993330,2cyclictest3187288-21ntpq22:37:477
2717135993328,4cyclictest3166211-21latency_hist22:32:217
2717127993331,2cyclictest3106233-21kworker/u16:2+events_unbound22:57:036
2717127993331,2cyclictest3106233-21kworker/u16:2+events_unbound22:57:036
2717127993331,2cyclictest2998276-21kworker/u16:0+flush-8:021:42:156
2717127993331,2cyclictest2998276-21kworker/u16:0+flush-8:021:42:156
2717127993331,2cyclictest2826180-21kworker/u16:2+flush-8:019:57:376
2717127993331,2cyclictest2807197-21kworker/u16:0+flush-8:021:12:386
2717127993330,2cyclictest3106233-21kworker/u16:2+flush-8:022:22:366
2717135993227,4cyclictest3082225-21latency_hist21:57:217
271713599320,30cyclictest124-21kswapd000:17:217
271713599320,30cyclictest124-21kswapd000:17:217
2717127993230,2cyclictest2962087-21kworker/u16:5+flush-8:021:32:376
2717127993230,2cyclictest2759214-21kworker/u16:0+flush-8:019:27:166
2717127993229,2cyclictest3166637-21kworker/u16:3+flush-8:022:37:316
2717127993229,2cyclictest2962087-21kworker/u16:5+flush-8:022:07:226
2717127993229,2cyclictest2726571-21kworker/u16:4+flush-8:019:17:376
2717126993230,2cyclictest2826180-21kworker/u16:2+events_unbound20:17:355
2717126993230,2cyclictest2787685-21kworker/u16:4+flush-8:019:37:495
2717126993229,2cyclictest2864101-21kworker/u16:1+events_unbound20:22:345
2717127993130,1cyclictest2962087-21kworker/u16:5+events_unbound22:16:446
2717127993129,2cyclictest2984048-21kworker/u16:1+events_unbound21:18:596
2717127993129,2cyclictest2962087-21kworker/u16:5+events_unbound21:47:236
2717127993028,2cyclictest2998276-21kworker/u16:0+flush-8:021:27:556
2717127993028,2cyclictest2726571-21kworker/u16:4+flush-8:019:12:176
2717127993027,2cyclictest2902409-21kworker/u16:3+events_unbound20:52:366
2717126993028,2cyclictest3141984-21kworker/u16:0+events_unbound22:22:515
2717126993028,2cyclictest2716874-21kworker/u16:0+flush-8:019:07:405
2717121993028,2cyclictest2962087-21kworker/u16:5+flush-8:021:27:214
2717135992923,5cyclictest2854600-21latency_hist20:12:217
2717126992927,2cyclictest2902409-21kworker/u16:3+flush-8:020:52:445
2717126992926,2cyclictest2635520-21kworker/u16:3+events_unbound19:32:405
2717135992822,5cyclictest2921417-21latency_hist20:47:227
2717135992822,5cyclictest2778097-21latency_hist19:32:217
271713599280,27cyclictest3058249-21latency_hist21:47:217
2717127992826,2cyclictest3247878-21kworker/u16:0+events_unbound23:11:526
2717127992826,2cyclictest3213153-21kworker/u16:3+flush-8:023:27:416
2717127992825,2cyclictest2635520-21kworker/u16:3+flush-8:019:37:386
2717126992826,2cyclictest2726571-21kworker/u16:4+events_unbound19:17:355
2717127992726,1cyclictest3319470-21kworker/u16:5+events_unbound23:41:526
2717127992725,2cyclictest3213374-21kworker/u16:4+events_unbound23:59:516
2717127992624,2cyclictest3213374-21kworker/u16:4+events_unbound22:57:386
2717127992624,2cyclictest3141984-21kworker/u16:0+events_unbound22:28:516
2717127992624,2cyclictest2902409-21kworker/u16:3+flush-8:020:57:476
2717127992624,2cyclictest2902409-21kworker/u16:3+flush-8:020:57:476
2717126992623,2cyclictest2826180-21kworker/u16:2+flush-8:020:02:225
2717127992523,2cyclictest3416133-21kworker/u16:4+events_unbound00:30:126
2717127992523,2cyclictest2864101-21kworker/u16:1+flush-8:020:47:216
2717126992523,2cyclictest2826180-21kworker/u16:2+flush-8:019:57:495
2717121992523,2cyclictest3319470-21kworker/u16:5+flush-8:000:32:204
271713599240,22cyclictest2950188-21sed21:02:217
271713599240,22cyclictest2950188-21sed21:02:217
32062472220,0chrt0-21swapper/422:47:404
28170702220,0sleep72817069-21cstates19:52:337
271713599220,20cyclictest3335650-21grep23:42:377
2717127992220,2cyclictest2984048-21kworker/u16:1+events_unbound22:42:436
2717127992219,2cyclictest3358796-21kworker/u16:2+events_unbound00:12:316
2717126992220,2cyclictest2746491-21kworker/u16:1+events_unbound19:26:525
2717135992115,5cyclictest2986194-21latency_hist21:17:217
2717127992119,2cyclictest3319470-21kworker/u16:5+events_unbound00:04:116
2717127992119,2cyclictest2787685-21kworker/u16:4+flush-8:019:47:496
2717127992119,2cyclictest2787685-21kworker/u16:4+events_unbound20:07:436
2717126992018,2cyclictest2787685-21kworker/u16:4+events_unbound19:44:335
2717121992015,4cyclictest2962087-21kworker/u16:5+flush-8:021:37:324
2717121992015,4cyclictest2962087-21kworker/u16:5+flush-8:021:37:324
2717135991915,3cyclictest1267-21snmpd19:14:477
2717135991914,4cyclictest3322330-21latency_hist23:37:207
2717126991917,2cyclictest2635520-21kworker/u16:3+flush-8:019:02:445
2717135991812,5cyclictest2835532-21latency_hist20:02:217
2717126991816,2cyclictest2807197-21kworker/u16:0+flush-8:020:27:505
2717121991715,2cyclictest3106233-21kworker/u16:2+flush-8:023:02:204
34436182160,1chrt3443617-21sh00:27:377
28865012160,0sleep60-21swapper/620:27:416
271713599169,6cyclictest0-21swapper/723:22:507
2717135991615,0cyclictest0-21swapper/719:32:477
2717135991614,2cyclictest124-21kswapd000:17:157
2717127991614,2cyclictest2807197-21kworker/u16:0+events_unbound20:35:086
2717126991614,2cyclictest2807197-21kworker/u16:0+flush-8:020:57:365
2717126991614,2cyclictest2807197-21kworker/u16:0+flush-8:020:57:365
271712199160,13cyclictest0-21swapper/422:19:304
271713599158,6cyclictest0-21swapper/722:07:357
2717135991512,2cyclictest0-21swapper/723:47:217
2717135991510,4cyclictest3271161-21ntpq23:12:477
2717127991513,2cyclictest2864101-21kworker/u16:1+flush-8:020:48:236
2717127991513,2cyclictest2807197-21kworker/u16:0+events_unbound20:37:396
2717121991513,2cyclictest0-21swapper/421:13:074
271713599147,6cyclictest0-21swapper/723:27:357
271713599147,6cyclictest0-21swapper/723:10:197
271713599147,6cyclictest0-21swapper/721:08:497
271713599146,7cyclictest0-21swapper/721:42:007
271713599146,7cyclictest0-21swapper/721:42:007
271713599145,8cyclictest0-21swapper/722:48:007
271713599145,8cyclictest0-21swapper/722:42:347
271713599145,8cyclictest0-21swapper/720:30:077
2717135991411,2cyclictest0-21swapper/719:42:437
2717121991413,1cyclictest0-21swapper/422:12:144
2717121991412,2cyclictest0-21swapper/423:18:464
2717121991412,2cyclictest0-21swapper/421:18:294
2717121991412,2cyclictest0-21swapper/421:04:274
271712199140,1cyclictest0-21swapper/422:28:384
271712199140,1cyclictest0-21swapper/420:04:234
271712199140,14cyclictest0-21swapper/423:52:494
271712199140,14cyclictest0-21swapper/423:28:044
271713599139,3cyclictest3235243-21ntpq22:57:487
271713599139,3cyclictest3127267-21ntpq22:12:497
271713599139,3cyclictest2807198-21/usr/sbin/munin19:47:437
271713599139,3cyclictest1267-21snmpd20:54:477
271713599139,3cyclictest0-21swapper/723:52:387
271713599136,6cyclictest6053-21gmain23:37:307
271713599136,6cyclictest0-21swapper/723:02:507
271713599136,6cyclictest0-21swapper/722:52:347
271713599136,6cyclictest0-21swapper/722:52:347
271713599136,6cyclictest0-21swapper/722:23:067
271713599136,6cyclictest0-21swapper/722:17:557
271713599136,6cyclictest0-21swapper/722:02:577
271713599136,6cyclictest0-21swapper/721:47:257
271713599136,6cyclictest0-21swapper/721:27:517
271713599136,6cyclictest0-21swapper/721:23:357
271713599136,6cyclictest0-21swapper/700:23:207
271713599136,6cyclictest0-21swapper/700:07:277
271713599135,7cyclictest0-21swapper/722:00:547
271713599135,7cyclictest0-21swapper/721:34:337
271713599134,8cyclictest3375145-21kthreadcore23:57:427
271713599134,8cyclictest3166690-21/usr/sbin/munin22:32:437
2717135991310,2cyclictest2788719-21perl19:37:357
271713599130,2cyclictest2854991-21/usr/sbin/munin20:12:337
271713599130,2cyclictest2730232-21irqstats19:07:257
271713599130,12cyclictest2930927-21latency_hist20:52:217
271713599130,11cyclictest2753986-21kthreadcore19:17:437
2717121991312,1cyclictest0-21swapper/423:49:024
2717121991312,1cyclictest0-21swapper/422:37:474
2717121991312,1cyclictest0-21swapper/422:23:074
2717121991312,1cyclictest0-21swapper/400:19:184
2717121991312,1cyclictest0-21swapper/400:19:184
2717121991312,1cyclictest0-21swapper/400:13:384
2717121991311,2cyclictest0-21swapper/419:09:314
271712199130,1cyclictest0-21swapper/423:33:454
271712199130,13cyclictest0-21swapper/422:15:524
271712199130,13cyclictest0-21swapper/421:59:284
271712199130,0cyclictest0-21swapper/421:54:074
271713599128,3cyclictest2864524-21/usr/sbin/munin20:17:387
271713599128,3cyclictest2763913-21tr19:22:407
271713599128,3cyclictest1267-21snmpd20:33:197
2717135991212,0cyclictest0-21swapper/719:02:367
2717135991210,1cyclictest2911882-21awk20:42:217
271712799120,1cyclictest0-21swapper/620:14:006
271712199129,3cyclictest0-21swapper/420:53:444
2717121991211,1cyclictest0-21swapper/423:45:154
2717121991211,1cyclictest0-21swapper/423:37:324
2717121991211,1cyclictest0-21swapper/421:11:234
2717121991211,1cyclictest0-21swapper/420:32:364
2717121991210,2cyclictest0-21swapper/422:54:294
2717121991210,2cyclictest0-21swapper/422:54:294
271713599110,10cyclictest2841080-21kthreadcore20:02:427
271712799119,2cyclictest2787685-21kworker/u16:4+events_unbound20:04:476
271712199119,2cyclictest0-21swapper/400:24:594
271712199118,2cyclictest2787685-21kworker/u16:4+flush-8:019:58:144
271712199111,2cyclictest0-21swapper/400:09:354
2717121991110,1cyclictest0-21swapper/420:52:004
2717121991110,1cyclictest0-21swapper/420:46:104
2717121991110,1cyclictest0-21swapper/420:40:204
2717121991110,1cyclictest0-21swapper/420:23:094
2717121991110,1cyclictest0-21swapper/419:52:154
2717121991110,1cyclictest0-21swapper/419:05:164
2717121991110,1cyclictest0-21swapper/400:04:104
271712199110,3cyclictest0-21swapper/421:34:124
271712199110,11cyclictest0-21swapper/421:00:594
271712199110,11cyclictest0-21swapper/421:00:594
271712199110,11cyclictest0-21swapper/420:11:574
271712199110,11cyclictest0-21swapper/419:20:244
271712199109,1cyclictest0-21swapper/420:28:494
271712199108,2cyclictest0-21swapper/423:26:114
271712199108,2cyclictest0-21swapper/422:06:434
271712199102,2cyclictest0-21swapper/419:32:004
271712199100,3cyclictest0-21swapper/423:04:534
271712199100,2cyclictest0-21swapper/423:15:474
271712199100,2cyclictest0-21swapper/422:43:344
271712199100,0cyclictest0-21swapper/419:26:524
27171219998,1cyclictest0-21swapper/423:07:354
27171219998,1cyclictest0-21swapper/421:45:074
27171219998,1cyclictest0-21swapper/419:45:474
27171219998,1cyclictest0-21swapper/419:13:474
27171219991,2cyclictest0-21swapper/423:58:214
27171219990,4cyclictest3176381-21chrt22:33:534
27171219990,4cyclictest3068107-21taskset21:48:174
27171219990,4cyclictest2873608-21chrt20:21:384
27171219990,4cyclictest2863860-21chrt20:13:374
27171219990,4cyclictest2797049-21taskset19:39:404
27171219990,3cyclictest2818398-21taskset19:52:384
27171219990,1cyclictest0-21swapper/421:29:034
27171219980,2cyclictest27873942sleep419:33:554
27171279950,5cyclictest0-21swapper/619:28:236
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional