You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 11:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Wed Sep 02, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276839725948,7sleep50-21swapper/519:05:405
2768973994237,4cyclictest3103789-21latency_hist21:49:357
2768962994240,2cyclictest3384657-21kworker/u16:1+events_unbound00:30:084
2768962994139,2cyclictest3162408-21kworker/u16:0+events_unbound23:04:364
27686102405,30sleep70-21swapper/719:08:397
2768962993936,2cyclictest2985720-21kworker/u16:3+events_unbound21:19:374
2768962993936,2cyclictest2985720-21kworker/u16:3+events_unbound21:19:374
2768973993736,0cyclictest0-21swapper/722:29:377
2768973993734,2cyclictest3513071-21cut00:34:577
2768973993732,3cyclictest5701-21gnome-shell21:58:337
2768962993734,2cyclictest3308972-21kworker/u16:3+events_unbound00:14:514
2768962993734,2cyclictest3140364-21kworker/u16:4+events_unbound22:19:374
2768962993634,2cyclictest3396802-21kworker/u16:5+events_unbound00:25:444
2768962993634,2cyclictest3396802-21kworker/u16:5+events_unbound00:01:444
2768962993633,2cyclictest2839858-21kworker/u16:2+events_unbound20:49:374
276848323625,8sleep40-21swapper/419:06:514
2768973993533,1cyclictest3250682-21ssh22:49:377
2768973993532,2cyclictest3370794-21ssh23:36:457
276845723525,7sleep60-21swapper/619:06:296
2768962993432,2cyclictest3297553-21kworker/u16:1+events_unbound23:22:214
2768962993432,2cyclictest2985720-21kworker/u16:3+events_unbound21:52:174
2768962993432,2cyclictest2976584-21kworker/u16:0+events_unbound21:47:184
2768962993431,2cyclictest3284030-21kworker/u16:2+events_unbound23:13:454
2768973993332,0cyclictest0-21swapper/722:46:457
2768968993330,2cyclictest3333946-21kworker/u16:0+flush-8:023:44:346
2768962993331,2cyclictest3308972-21kworker/u16:3+events_unbound23:50:454
2768962993331,2cyclictest3162408-21kworker/u16:0+events_unbound22:36:164
2768973993231,0cyclictest0-21swapper/700:17:497
2768973993230,1cyclictest3455834-21ssh00:11:017
2768973993230,1cyclictest3275151-21ssh22:59:377
2768973993230,1cyclictest0-21swapper/721:35:217
2768968993228,3cyclictest2839858-21kworker/u16:2+flush-8:020:59:356
2768962993230,2cyclictest3077014-21kworker/u16:1+events_unbound22:30:534
2768962993230,2cyclictest3077014-21kworker/u16:1+events_unbound22:06:494
2768973993130,0cyclictest0-21swapper/721:50:447
2768973993128,2cyclictest2800861-21ntpq19:20:007
2768973993127,3cyclictest3066915-21ssh21:34:057
2768964993129,2cyclictest2985720-21kworker/u16:3+flush-8:021:50:235
2768962993129,2cyclictest3396802-21kworker/u16:5+events_unbound00:36:254
2768962993129,2cyclictest3384657-21kworker/u16:1+events_unbound23:59:174
2768962993129,2cyclictest3308972-21kworker/u16:3+events_unbound00:12:054
2768962993129,2cyclictest3284030-21kworker/u16:2+events_unbound23:43:294
2768962993129,2cyclictest3077014-21kworker/u16:1+events_unbound22:41:324
2768962993129,2cyclictest3005049-21kworker/u16:1+events_unbound21:16:454
2768973993029,0cyclictest0-21swapper/723:45:467
2768968993027,2cyclictest2937118-21kworker/u16:1+flush-8:020:44:346
2768962993028,2cyclictest3284030-21kworker/u16:2+events_unbound23:46:454
2768962993028,2cyclictest3235790-21kworker/u16:4+flush-8:022:49:444
2768962993028,2cyclictest3224094-21kworker/u16:2+events_unbound22:47:534
2768962993028,2cyclictest3112722-21kworker/u16:2+events_unbound22:16:204
2768962993028,2cyclictest3015452-21kworker/u16:5+events_unbound22:01:384
2768962993028,2cyclictest3015452-21kworker/u16:5+events_unbound22:01:384
2768962993028,2cyclictest3005049-21kworker/u16:1+events_unbound21:13:204
2768962993028,2cyclictest2976584-21kworker/u16:0+events_unbound21:38:414
2768973992928,0cyclictest0-21swapper/722:18:017
2768973992928,0cyclictest0-21swapper/721:24:447
2768973992926,2cyclictest3006194-21diskmemload00:23:257
2768973992925,3cyclictest3151000-21ssh22:06:377
2768973992924,4cyclictest3140329-21latency_hist22:04:347
2768973992924,4cyclictest3140329-21latency_hist22:04:347
2768964992926,3cyclictest3336263-21kworker/u16:4+events_unbound23:34:485
2768962992927,2cyclictest3308972-21kworker/u16:3+events_unbound23:19:084
2768962992927,2cyclictest3308972-21kworker/u16:3+events_unbound00:23:044
2768962992927,2cyclictest3162408-21kworker/u16:0+events_unbound22:24:564
2768973992827,0cyclictest0-21swapper/723:27:407
2768973992826,1cyclictest0-21swapper/719:24:547
2768973992818,1cyclictest0-21swapper/723:49:587
2768962992826,2cyclictest3384657-21kworker/u16:1+events_unbound00:07:284
2768962992826,2cyclictest3284030-21kworker/u16:2+events_unbound23:36:414
2768962992826,2cyclictest3284030-21kworker/u16:2+events_unbound23:01:284
2768962992826,2cyclictest3077014-21kworker/u16:1+events_unbound22:11:214
2768962992826,2cyclictest2985720-21kworker/u16:3+events_unbound21:56:084
2768962992826,2cyclictest2976584-21kworker/u16:0+events_unbound21:27:404
2768962992826,2cyclictest2868914-21kworker/u16:5+events_unbound20:36:454
2768973992726,0cyclictest0-21swapper/722:42:217
2768973992726,0cyclictest0-21swapper/722:13:417
2768973992726,0cyclictest0-21swapper/719:56:447
2768973992726,0cyclictest0-21swapper/719:56:447
2768973992726,0cyclictest0-21swapper/719:49:367
2768973992726,0cyclictest0-21swapper/719:34:467
2768964992725,2cyclictest3015452-21kworker/u16:5+events_unbound22:04:485
2768964992725,2cyclictest2976584-21kworker/u16:0+flush-8:021:49:305
2768962992725,2cyclictest3308972-21kworker/u16:3+events_unbound23:34:054
2768962992725,2cyclictest3284030-21kworker/u16:2+events_unbound23:26:254
2768962992725,2cyclictest3077014-21kworker/u16:1+events_unbound22:56:574
2768962992725,2cyclictest3042885-21kworker/u16:2+events_unbound21:32:044
2768962992725,2cyclictest2976584-21kworker/u16:0+events_unbound21:41:014
2768962992724,2cyclictest2860535-21kworker/u16:0+flush-8:019:54:454
2768962992724,2cyclictest2860535-21kworker/u16:0+flush-8:019:54:454
2768973992625,0cyclictest0-21swapper/722:25:137
2768973992625,0cyclictest0-21swapper/721:44:347
2768973992625,0cyclictest0-21swapper/719:14:557
2768973992624,1cyclictest0-21swapper/720:06:447
2768973992623,2cyclictest3432573-21ssh00:03:087
2768973992623,2cyclictest3039675-21ssh21:19:597
2768973992623,2cyclictest3039675-21ssh21:19:597
2768973992620,5cyclictest2957471-21latency_hist20:44:347
2768964992624,2cyclictest3336263-21kworker/u16:4+events_unbound23:54:495
2768964992624,2cyclictest3308972-21kworker/u16:3+events_unbound00:39:335
2768962992624,2cyclictest2714579-21kworker/u16:0+events_unbound19:31:454
2768962992624,2cyclictest2714579-21kworker/u16:0+events_unbound19:28:454
2768973992524,0cyclictest0-21swapper/723:11:057
2768973992524,0cyclictest0-21swapper/722:38:217
2768973992524,0cyclictest0-21swapper/720:55:257
2768973992524,0cyclictest0-21swapper/700:06:007
2768968992523,2cyclictest3336263-21kworker/u16:4+events_unbound23:44:486
2768964992523,2cyclictest3005049-21kworker/u16:1+events_unbound21:09:495
2768962992523,2cyclictest2839858-21kworker/u16:2+flush-8:020:59:504
2768962992522,2cyclictest2868914-21kworker/u16:5+events_unbound20:19:454
2768962992522,2cyclictest2839858-21kworker/u16:2+flush-8:020:44:454
2768973992423,0cyclictest0-21swapper/723:21:057
2768973992422,1cyclictest3321542-21ssh23:15:487
2768973992422,1cyclictest0-21swapper/722:22:417
2768962992422,2cyclictest2757678-21kworker/u16:3+events_unbound19:17:464
2768962992422,2cyclictest2714579-21kworker/u16:0+events_unbound19:42:454
2768973992322,0cyclictest0-21swapper/723:56:497
2768973992322,0cyclictest0-21swapper/723:40:577
2768973992322,0cyclictest0-21swapper/723:08:137
2768973992322,0cyclictest0-21swapper/721:13:367
2768973992322,0cyclictest0-21swapper/720:59:377
2768964992321,2cyclictest3284030-21kworker/u16:2+flush-8:023:49:295
2768964992321,2cyclictest2976584-21kworker/u16:0+events_unbound21:39:495
2768964992320,2cyclictest3284030-21kworker/u16:2+events_unbound23:29:455
2768964992320,2cyclictest2868914-21kworker/u16:5+flush-8:020:29:355
2768962992321,2cyclictest2880114-21kworker/u16:0+events_unbound20:13:444
2768962992321,2cyclictest2757678-21kworker/u16:3+events_unbound19:10:464
2768973992221,0cyclictest0-21swapper/723:33:127
2768973992221,0cyclictest0-21swapper/719:44:567
2768973992220,1cyclictest3506474-21ssh00:34:287
2768968992218,3cyclictest2839858-21kworker/u16:2+flush-8:021:04:356
2768964992220,2cyclictest3396802-21kworker/u16:5+flush-8:000:14:345
2768964992219,2cyclictest2850586-21kworker/u16:4+events_unbound19:49:405
2768962992220,2cyclictest1787889-21kworker/u16:1+events_unbound19:21:454
2768973992120,0cyclictest0-21swapper/722:56:417
2768973992120,0cyclictest0-21swapper/720:51:467
2768973992120,0cyclictest0-21swapper/720:00:097
2768973992119,1cyclictest3028507-21ssh21:15:517
2768973992119,1cyclictest2905516-21kthreadcore20:14:557
2768968992118,3cyclictest3384657-21kworker/u16:1+events_unbound00:05:016
2768964992119,2cyclictest3308972-21kworker/u16:3+events_unbound23:14:575
2768964992119,2cyclictest3211328-21kworker/u16:3+events_unbound22:44:485
2768964992119,2cyclictest3162408-21kworker/u16:0+flush-8:022:14:455
2768964992118,2cyclictest2937118-21kworker/u16:1+flush-8:020:49:405
2768962992119,2cyclictest3005049-21kworker/u16:1+events_unbound21:05:124
2768962992119,2cyclictest2829717-21kworker/u16:1+events_unbound19:35:104
2768962992118,2cyclictest2829717-21kworker/u16:1+events_unbound19:59:554
2768968992018,2cyclictest3235790-21kworker/u16:4+flush-8:023:14:506
2768964992018,2cyclictest3250377-21kworker/u16:5+events_unbound22:54:525
2768964992018,2cyclictest3162408-21kworker/u16:0+flush-8:022:59:495
2768964992018,2cyclictest3112722-21kworker/u16:2+events_unbound22:28:255
2768964992018,2cyclictest2880114-21kworker/u16:0+flush-8:020:09:505
2768964992017,2cyclictest2757678-21kworker/u16:3+events_unbound19:29:405
2768962992018,2cyclictest2880114-21kworker/u16:0+events_unbound20:33:444
2768962992018,2cyclictest2757678-21kworker/u16:3+events_unbound19:53:444
2768973991917,1cyclictest0-21swapper/700:26:217
2768973991916,2cyclictest2896857-21kthreadcore20:09:577
2768968991917,2cyclictest3284030-21kworker/u16:2+events_unbound23:24:466
2768964991917,2cyclictest3297553-21kworker/u16:1+events_unbound23:09:375
2768964991917,2cyclictest2985720-21kworker/u16:3+events_unbound21:15:005
2768964991917,2cyclictest2757678-21kworker/u16:3+events_unbound19:17:035
2768962991917,2cyclictest2839858-21kworker/u16:2+events_unbound20:56:454
2768964991816,2cyclictest3396802-21kworker/u16:5+events_unbound23:59:485
2768964991816,2cyclictest3336263-21kworker/u16:4+events_unbound23:53:255
2768964991816,2cyclictest3336263-21kworker/u16:4+events_unbound00:06:255
2768964991816,2cyclictest3308972-21kworker/u16:3+flush-8:023:29:295
2768964991816,2cyclictest3308972-21kworker/u16:3+events_unbound00:22:565
2768964991816,2cyclictest3235790-21kworker/u16:4+events_unbound22:49:585
2768964991816,2cyclictest2985720-21kworker/u16:3+events_unbound21:00:325
2768964991816,2cyclictest2880114-21kworker/u16:0+events_unbound20:27:235
2768964991816,2cyclictest2868914-21kworker/u16:5+events_unbound20:22:265
2768964991816,2cyclictest2839858-21kworker/u16:2+events_unbound20:04:505
2768968991715,2cyclictest3112722-21kworker/u16:2+flush-8:022:30:056
2768968991713,3cyclictest3336263-21kworker/u16:4+flush-8:023:50:056
2768964991715,2cyclictest3384657-21kworker/u16:1+events_unbound00:30:455
2768964991715,2cyclictest3308972-21kworker/u16:3+flush-8:000:15:045
2768964991715,2cyclictest3042885-21kworker/u16:2+events_unbound21:30:325
2768964991715,2cyclictest2976584-21kworker/u16:0+flush-8:021:35:025
2768964991715,2cyclictest2880114-21kworker/u16:0+events_unbound20:15:005
2768964991715,2cyclictest1787889-21kworker/u16:1+events_unbound19:25:085
2768964991714,2cyclictest3284030-21kworker/u16:2+flush-8:023:19:455
2768964991714,2cyclictest2839858-21kworker/u16:2+events_unbound20:44:405
2768962991715,2cyclictest2880114-21kworker/u16:0+flush-8:020:15:044
2768973991615,0cyclictest0-21swapper/720:30:057
2768964991614,2cyclictest3284030-21kworker/u16:2+flush-8:023:40:205
2768964991614,2cyclictest3077014-21kworker/u16:1+events_unbound22:43:575
2768964991614,2cyclictest3077014-21kworker/u16:1+events_unbound22:29:575
2768964991614,2cyclictest3005049-21kworker/u16:1+flush-8:021:20:005
2768964991614,2cyclictest3005049-21kworker/u16:1+flush-8:021:20:005
2768964991614,2cyclictest2757678-21kworker/u16:3+flush-8:019:19:405
276897399150,14cyclictest0-21swapper/720:34:577
2768968991513,2cyclictest3015452-21kworker/u16:5+events_unbound22:10:046
2768968991513,2cyclictest2880114-21kworker/u16:0+flush-8:020:05:006
2768968991513,2cyclictest2860535-21kworker/u16:0+events_unbound19:54:546
2768968991513,2cyclictest2860535-21kworker/u16:0+events_unbound19:54:546
276896899150,15cyclictest0-21swapper/600:04:256
2768964991513,2cyclictest3211328-21kworker/u16:3+flush-8:022:34:505
2768964991513,2cyclictest3077014-21kworker/u16:1+flush-8:022:04:295
2768964991513,2cyclictest3077014-21kworker/u16:1+flush-8:022:04:295
2768964991513,2cyclictest2985720-21kworker/u16:3+events_unbound21:25:025
2768964991513,2cyclictest2829717-21kworker/u16:1+events_unbound19:36:505
2768962991513,2cyclictest2839858-21kworker/u16:2+flush-8:020:05:034
276897399140,1cyclictest0-21swapper/719:39:587
276896899143,10cyclictest3058333-21cut21:29:526
2768968991413,1cyclictest0-21swapper/622:54:546
2768968991412,2cyclictest3250377-21kworker/u16:5+flush-8:022:49:496
276896899140,13cyclictest0-21swapper/620:29:506
2768964991412,2cyclictest3472225-21kworker/u16:0+events_unbound00:26:005
2768964991412,2cyclictest2985720-21kworker/u16:3+events_unbound21:56:165
2768964991412,2cyclictest2839858-21kworker/u16:2+events_unbound20:54:485
276896899139,3cyclictest3019693-21cat21:14:536
2768964991311,2cyclictest2839858-21kworker/u16:2+events_unbound20:40:325
2768964991311,2cyclictest2839858-21kworker/u16:2+events_unbound19:55:455
2768964991311,2cyclictest2839858-21kworker/u16:2+events_unbound19:55:455
2768964991311,2cyclictest2714579-21kworker/u16:0+events_unbound19:45:315
276897399124,6cyclictest5704-21gmain19:29:567
2768973991211,0cyclictest0-21swapper/721:05:037
276896899128,3cyclictest2890647-21cat20:09:516
2768968991211,1cyclictest0-21swapper/623:19:586
2768968991211,1cyclictest0-21swapper/622:23:416
2768968991211,1cyclictest0-21swapper/600:23:496
2768968991211,1cyclictest0-21swapper/600:16:526
276896899120,1cyclictest0-21swapper/621:22:216
276896899120,1cyclictest0-21swapper/621:22:216
276896899120,12cyclictest0-21swapper/623:07:026
276896899120,12cyclictest0-21swapper/622:42:466
276896899120,12cyclictest0-21swapper/619:35:286
276896499129,2cyclictest3235790-21kworker/u16:4+events_unbound23:04:385
2768964991210,2cyclictest3140364-21kworker/u16:4+flush-8:022:20:105
2768964991210,2cyclictest3015452-21kworker/u16:5+events_unbound22:10:015
2768964991210,2cyclictest2829717-21kworker/u16:1+events_unbound20:00:245
2768962991211,1cyclictest0-21swapper/419:48:574
276897399117,3cyclictest5988-21gmain20:20:047
276897399117,3cyclictest1277-21snmpd19:11:237
276897399115,5cyclictest6387-21gmain20:25:007
276897399115,5cyclictest5907-21gmain20:46:127
2768968991110,1cyclictest0-21swapper/621:54:506
2768968991110,1cyclictest0-21swapper/621:53:156
2768968991110,1cyclictest0-21swapper/621:41:076
2768968991110,1cyclictest0-21swapper/620:15:036
2768968991110,1cyclictest0-21swapper/619:27:456
2768968991110,1cyclictest0-21swapper/600:36:356
276896899110,1cyclictest0-21swapper/619:39:446
276896899110,11cyclictest0-21swapper/623:57:486
276896899110,11cyclictest0-21swapper/622:06:116
276896899110,11cyclictest0-21swapper/620:27:586
276896899110,11cyclictest0-21swapper/600:12:376
2768964991110,1cyclictest0-21swapper/519:13:085
276896499110,1cyclictest0-21swapper/519:40:335
276896299119,2cyclictest2839858-21kworker/u16:2+events_unbound20:40:074
2768962991110,1cyclictest0-21swapper/420:26:094
276896899109,1cyclictest0-21swapper/619:09:376
276896899108,2cyclictest2839858-21kworker/u16:2+flush-8:020:44:506
276896899108,2cyclictest2714579-21kworker/u16:0+events_unbound19:44:506
276896899107,2cyclictest2938431-21/usr/sbin/munin20:34:576
276896899106,3cyclictest3007970-21kthreadcore21:09:506
276896899106,3cyclictest2874342-21cut19:59:546
276896899105,4cyclictest3300533-21cat23:09:496
276896899105,1cyclictest0-21swapper/623:34:546
276896899100,9cyclictest3247803-21grep22:45:056
276896899100,9cyclictest3214344-21grep22:34:466
276896899100,9cyclictest3191608-21cut22:24:526
276896899100,9cyclictest3068439-21hwlatdetect21:34:486
276896899100,9cyclictest3000492-21cut21:04:526
276896899100,10cyclictest0-21swapper/619:20:496
276896499108,2cyclictest2868914-21kworker/u16:5+events_unbound20:37:445
27689689998,1cyclictest0-21swapper/600:24:366
27689689996,2cyclictest2909281-21/usr/sbin/munin20:19:526
27689689991,7cyclictest3133687-21kthreadcore21:59:556
27689689991,7cyclictest3133687-21kthreadcore21:59:556
27689689991,7cyclictest0-21swapper/621:24:526
27689689990,8cyclictest3349418-21irqcore23:29:506
27689689990,8cyclictest2968317-21hwlatdetect20:49:496
27689689990,8cyclictest0-21swapper/622:14:506
27689689990,3cyclictest3281890-21kthreadcore22:59:536
27689689990,3cyclictest3096361-21cut21:44:546
27689649997,2cyclictest2985720-21kworker/u16:3+flush-8:021:04:535
27689689987,1cyclictest0-21swapper/619:14:366
27689689986,2cyclictest86-21ksoftirqd/600:32:506
27689689985,2cyclictest0-21swapper/619:29:546
27689689975,1cyclictest0-21swapper/619:49:476
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional