You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 22:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Thu Jul 23, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324188625722,30sleep70-21swapper/707:05:187
324191125343,7sleep50-21swapper/507:05:405
324216724433,8sleep40-21swapper/407:09:164
3242485994338,4cyclictest3782966-21missed_timers11:09:457
3242485994337,5cyclictest3401422-21latency_hist08:29:237
3242485994136,4cyclictest3391719-21latency_hist08:24:227
3242476993937,2cyclictest3882298-21kworker/u16:4+flush-8:012:24:165
3242485993837,0cyclictest0-21swapper/710:46:507
3242485993735,1cyclictest3479204-21diskmemload11:18:017
324197723726,8sleep60-21swapper/607:06:386
3242485993633,2cyclictest3994825-21ssh12:38:497
3242485993534,0cyclictest0-21swapper/711:38:307
3242476993431,2cyclictest3449118-21kworker/u16:2+flush-8:010:29:415
3242485993332,0cyclictest0-21swapper/712:03:467
3242485993331,1cyclictest3540372-21ssh09:33:497
3242485993329,2cyclictest3588407-21ssh09:51:557
3242485993231,0cyclictest0-21swapper/712:21:207
3242485993231,0cyclictest0-21swapper/710:02:507
3242485993231,0cyclictest0-21swapper/709:11:347
3242485993231,0cyclictest0-21swapper/707:44:467
3242485993230,1cyclictest3479204-21diskmemload09:57:187
3242485993230,1cyclictest0-21swapper/712:17:257
3242476993230,2cyclictest3919345-21kworker/u16:1+flush-8:012:19:175
3242476993230,2cyclictest3449118-21kworker/u16:2+flush-8:010:24:575
3242485993130,0cyclictest0-21swapper/710:36:337
3242485993129,1cyclictest0-21swapper/711:20:137
3242485993029,0cyclictest0-21swapper/707:09:377
3242485993028,1cyclictest0-21swapper/710:15:347
3242485992928,0cyclictest0-21swapper/711:58:327
3242485992928,0cyclictest0-21swapper/710:30:187
3242485992927,1cyclictest3479204-21diskmemload10:51:537
3242476992927,2cyclictest3808459-21kworker/u16:0+flush-8:011:49:465
3242485992827,0cyclictest0-21swapper/710:44:147
3242485992827,0cyclictest0-21swapper/709:35:587
3242476992826,2cyclictest3401664-21kworker/u16:3+events_unbound09:16:495
3242476992825,2cyclictest3562217-21kworker/u16:3+flush-8:009:59:295
3242485992726,0cyclictest0-21swapper/712:28:247
3242485992726,0cyclictest0-21swapper/711:07:257
3242485992726,0cyclictest0-21swapper/711:07:257
3242485992726,0cyclictest0-21swapper/710:07:537
3242485992726,0cyclictest0-21swapper/709:28:267
3242485992725,1cyclictest3920102-21ssh12:06:547
3242485992725,1cyclictest3858101-21ssh11:40:417
3242485992721,5cyclictest648-21systemd-journal07:24:227
3242485992721,5cyclictest3343197-21latency_hist07:59:237
3242476992726,1cyclictest3515696-21kworker/u16:1+events_unbound09:26:585
3242476992725,2cyclictest3449118-21kworker/u16:2+flush-8:010:46:585
3242485992625,0cyclictest0-21swapper/712:10:547
3242485992625,0cyclictest0-21swapper/711:28:147
3242485992624,1cyclictest3638434-21ssh10:13:297
3242476992624,2cyclictest3785710-21kworker/u16:3+flush-8:011:19:495
3242476992624,2cyclictest3688118-21kworker/u16:5+flush-8:010:34:495
3242476992624,2cyclictest3661612-21kworker/u16:0+flush-8:011:05:135
3242476992624,2cyclictest3661612-21kworker/u16:0+flush-8:011:05:135
3242476992624,2cyclictest3449118-21kworker/u16:2+events_unbound10:19:375
3242471992624,2cyclictest3661612-21kworker/u16:0+flush-8:011:04:224
3242485992524,0cyclictest0-21swapper/711:04:027
3242485992524,0cyclictest0-21swapper/710:58:427
3242485992524,0cyclictest0-21swapper/709:22:177
3242476992523,2cyclictest3661612-21kworker/u16:0+flush-8:011:12:135
3242476992523,2cyclictest3562217-21kworker/u16:3+events_unbound10:14:365
3242476992523,2cyclictest1776159-21kworker/u16:3+events_unbound07:09:495
3242476992522,2cyclictest3252054-21kworker/u16:4+flush-8:007:24:415
3242485992423,0cyclictest0-21swapper/711:46:297
3242485992423,0cyclictest0-21swapper/707:59:417
3242485992423,0cyclictest0-21swapper/707:38:337
3242485992423,0cyclictest0-21swapper/707:38:337
324248099244,19cyclictest0-21swapper/610:44:386
3242476992422,2cyclictest3725022-21kworker/u16:3+flush-8:010:53:585
3242476992422,2cyclictest3640063-21kworker/u16:1+events_unbound11:02:215
3242476992421,2cyclictest3785710-21kworker/u16:3+events_unbound12:29:345
3242485992322,0cyclictest0-21swapper/712:33:377
3242485992322,0cyclictest0-21swapper/711:52:567
3242485992322,0cyclictest0-21swapper/709:40:147
3242485992321,1cyclictest3565660-21ssh09:44:257
3242480992321,2cyclictest3528315-21kworker/u16:0+events_unbound09:50:536
3242480992321,2cyclictest3449118-21kworker/u16:2+events_unbound09:12:136
3242476992321,2cyclictest3449118-21kworker/u16:2+events_unbound09:35:505
3242485992221,0cyclictest0-21swapper/711:31:577
3242485992221,0cyclictest0-21swapper/710:20:417
3242485992219,2cyclictest3333519-21munin-run07:54:237
3242480992220,2cyclictest3785710-21kworker/u16:3+events_unbound12:18:186
3242480992220,2cyclictest3449118-21kworker/u16:2+events_unbound10:42:546
3242476992220,2cyclictest3808459-21kworker/u16:0+flush-8:011:40:335
3242476992220,2cyclictest3540822-21kworker/u16:4+flush-8:009:44:515
3242480992120,1cyclictest3449118-21kworker/u16:2+events_unbound09:34:306
3242480992119,2cyclictest3808459-21kworker/u16:0+events_unbound11:56:546
3242480992119,2cyclictest3640063-21kworker/u16:1+events_unbound10:57:416
3242476992119,2cyclictest3808459-21kworker/u16:0+events_unbound12:27:335
3242476992119,2cyclictest3785710-21kworker/u16:3+flush-8:011:44:395
3242476992119,2cyclictest3785710-21kworker/u16:3+flush-8:011:19:135
3242476992119,2cyclictest3640063-21kworker/u16:1+events_unbound11:34:575
3242476992119,2cyclictest3528315-21kworker/u16:0+flush-8:010:05:505
3242476992119,2cyclictest3515696-21kworker/u16:1+flush-8:009:31:015
3242476992118,2cyclictest3342190-21kworker/u16:1+flush-8:008:24:355
3242476992118,2cyclictest1776159-21kworker/u16:3+flush-8:007:29:415
3242471992117,3cyclictest3342190-21kworker/u16:1+flush-8:009:18:194
3242480992018,2cyclictest3808459-21kworker/u16:0+events_unbound11:44:556
3242480992017,2cyclictest3342190-21kworker/u16:1+events_unbound08:24:286
3242480992015,1cyclictest201rcu_preempt09:18:206
3242476992018,2cyclictest3882298-21kworker/u16:4+flush-8:012:37:125
3242476992018,2cyclictest3540822-21kworker/u16:4+flush-8:009:41:265
3242476992018,2cyclictest3528315-21kworker/u16:0+flush-8:010:12:095
3242476992018,2cyclictest3449118-21kworker/u16:2+flush-8:009:57:495
3242476992018,2cyclictest3449118-21kworker/u16:2+flush-8:009:53:535
3242480991917,2cyclictest3882298-21kworker/u16:4+events_unbound12:26:566
3242480991917,2cyclictest3323807-21kworker/u16:0+events_unbound08:14:286
3242480991917,2cyclictest3323807-21kworker/u16:0+events_unbound07:49:456
3242480991916,2cyclictest3252054-21kworker/u16:4+events_unbound07:54:286
3242476991917,2cyclictest3808459-21kworker/u16:0+events_unbound11:54:475
3242476991917,2cyclictest3342190-21kworker/u16:1+flush-8:009:10:055
3242476991916,2cyclictest3252054-21kworker/u16:4+flush-8:008:04:305
3242476991915,3cyclictest3252054-21kworker/u16:4+flush-8:007:14:545
390900921815,2sleep43882298-21kworker/u16:4+events_unbound12:03:584
324248599180,16cyclictest0-21swapper/708:14:467
3242480991816,2cyclictest3661612-21kworker/u16:0+events_unbound10:31:386
3242480991816,2cyclictest3449118-21kworker/u16:2+events_unbound10:22:426
3242480991816,1cyclictest3391428-21kworker/u16:2+events_unbound08:29:296
3242476991817,1cyclictest3661612-21kworker/u16:0+events_unbound10:57:495
3242476991816,2cyclictest3882298-21kworker/u16:4+events_unbound12:07:495
3242476991816,2cyclictest3661612-21kworker/u16:0+events_unbound10:39:255
3242476991816,2cyclictest3391428-21kworker/u16:2+flush-8:008:29:505
324247199180,1cyclictest0-21swapper/412:19:554
324247199180,1cyclictest0-21swapper/409:34:224
3242485991716,0cyclictest0-21swapper/708:44:337
3242485991716,0cyclictest0-21swapper/708:31:507
3242485991715,1cyclictest0-21swapper/707:24:467
3242480991715,2cyclictest3882298-21kworker/u16:4+events_unbound12:20:216
3242480991715,2cyclictest3808459-21kworker/u16:0+events_unbound12:00:336
3242480991715,2cyclictest3762066-21kworker/u16:2+events_unbound11:13:376
3242480991715,2cyclictest3342190-21kworker/u16:1+events_unbound08:05:466
3242480991715,2cyclictest3323807-21kworker/u16:0+events_unbound08:11:136
3242476991715,2cyclictest3323807-21kworker/u16:0+flush-8:008:09:385
324247199170,1cyclictest0-21swapper/411:54:034
324247199170,14cyclictest0-21swapper/412:12:024
3242485991615,0cyclictest0-21swapper/708:58:347
3242485991614,1cyclictest0-21swapper/710:28:577
3242485991614,1cyclictest0-21swapper/708:49:337
3242485991611,3cyclictest6561-21fwupd09:18:177
324248599160,14cyclictest0-21swapper/708:59:467
3242480991614,2cyclictest3562217-21kworker/u16:3+events_unbound10:19:216
3242480991614,2cyclictest3401664-21kworker/u16:3+events_unbound08:58:506
3242476991614,2cyclictest3919345-21kworker/u16:1+flush-8:012:13:505
3242476991614,2cyclictest3785710-21kworker/u16:3+flush-8:011:24:465
3242476991614,2cyclictest3449118-21kworker/u16:2+events_unbound09:23:295
3242476991614,2cyclictest3416715-21kworker/u16:4+flush-8:008:49:535
3242476991614,2cyclictest3323807-21kworker/u16:0+events_unbound08:19:355
3242471991613,2cyclictest3910282-21diskstats12:04:374
324247199160,16cyclictest0-21swapper/410:52:064
324247199160,15cyclictest3652512-21iostat_ios10:19:374
324247199160,14cyclictest0-21swapper/411:22:504
3242480991513,2cyclictest3449118-21kworker/u16:2+events_unbound10:01:226
3242480991513,2cyclictest3416715-21kworker/u16:4+events_unbound08:43:336
3242480991513,2cyclictest3401664-21kworker/u16:3+events_unbound08:36:066
3242480991513,2cyclictest3342190-21kworker/u16:1+events_unbound08:21:586
3242480991512,2cyclictest3401664-21kworker/u16:3+events_unbound08:49:256
3242476991513,2cyclictest3785710-21kworker/u16:3+flush-8:012:01:325
3242476991513,2cyclictest3416715-21kworker/u16:4+flush-8:008:46:495
3242476991512,2cyclictest3808459-21kworker/u16:0+events_unbound11:29:255
3242476991512,2cyclictest3401664-21kworker/u16:3+flush-8:008:39:445
3242471991513,2cyclictest0-21swapper/412:35:034
3242471991512,3cyclictest0-21swapper/411:14:204
324247199150,1cyclictest0-21swapper/410:10:474
324247199150,14cyclictest0-21swapper/410:14:254
324247199150,14cyclictest0-21swapper/408:29:254
3242485991412,1cyclictest0-21swapper/708:39:417
3242485991412,1cyclictest0-21swapper/707:14:497
324248099149,5cyclictest3628457-21kthreadcore10:09:396
3242480991413,1cyclictest3910443-21fschecks_time12:04:386
3242480991413,1cyclictest3757318-21tr10:59:436
3242480991413,1cyclictest0-21swapper/609:55:216
3242480991413,1cyclictest0-21swapper/609:26:496
3242480991412,2cyclictest3323807-21kworker/u16:0+events_unbound08:48:546
3242480991412,2cyclictest3313903-21kworker/u16:2+events_unbound07:46:496
3242480991412,2cyclictest3295120-21kworker/u16:1+events_unbound07:36:536
3242480991412,2cyclictest3295120-21kworker/u16:1+events_unbound07:36:536
3242480991412,2cyclictest3252054-21kworker/u16:4+events_unbound07:16:476
3242480991412,2cyclictest1776159-21kworker/u16:3+events_unbound07:29:576
3242480991412,1cyclictest3690166-21cat10:34:386
3242480991411,1cyclictest201rcu_preempt09:29:516
324248099140,14cyclictest0-21swapper/608:59:376
3242471991413,1cyclictest0-21swapper/412:16:464
3242471991413,1cyclictest0-21swapper/410:00:234
3242471991413,1cyclictest0-21swapper/409:21:554
324247199140,1cyclictest0-21swapper/411:24:254
324248599139,3cyclictest1302-21snmpd09:06:307
324248599137,5cyclictest6124-21gmain07:32:017
324248099139,1cyclictest681rcuog/412:34:396
324248099136,4cyclictest86-21ksoftirqd/611:14:366
3242480991312,1cyclictest3923531-21kthreadcore12:09:406
3242480991311,2cyclictest3401664-21kworker/u16:3+events_unbound09:09:156
3242480991311,2cyclictest3313903-21kworker/u16:2+events_unbound07:43:026
3242480991311,2cyclictest1776159-21kworker/u16:3+events_unbound07:19:316
3242480991311,1cyclictest3971075-21cpuspeed12:29:326
3242480991311,1cyclictest3825092-21kthreadcore11:29:396
3242480991311,1cyclictest3769848-21grep11:04:446
3242480991311,1cyclictest3769848-21grep11:04:446
3242480991311,1cyclictest3733967-21ntpq10:49:466
3242480991311,1cyclictest3504863-21expr09:19:356
3242480991311,1cyclictest3250863-21latency07:09:446
324248099130,13cyclictest0-21swapper/611:24:546
324248099130,13cyclictest0-21swapper/610:05:556
324248099130,10cyclictest3804088-21kthreadcore11:19:436
3242476991311,2cyclictest3323807-21kworker/u16:0+events_unbound08:34:505
3242471991312,1cyclictest0-21swapper/412:30:574
3242471991312,1cyclictest0-21swapper/411:07:234
3242471991312,1cyclictest0-21swapper/411:07:234
3242471991312,1cyclictest0-21swapper/409:55:114
3242471991312,1cyclictest0-21swapper/409:29:104
3242471991312,1cyclictest0-21swapper/408:22:094
3242471991312,1cyclictest0-21swapper/407:21:374
324247199130,13cyclictest0-21swapper/410:05:354
324247199130,13cyclictest0-21swapper/408:57:004
324247199130,13cyclictest0-21swapper/407:10:354
324247199130,0cyclictest0-21swapper/409:46:214
324248599129,2cyclictest3362596-21munin-run08:09:227
324248599129,2cyclictest1302-21snmpd08:37:127
324248599129,2cyclictest1302-21snmpd08:12:087
324248599128,3cyclictest6233-21gvfs-afc-volume07:39:367
324248099129,2cyclictest3844706-21ntpq11:34:466
324248099125,3cyclictest86-21ksoftirqd/609:39:406
3242480991211,1cyclictest3874018-21irqcore11:49:386
3242480991211,1cyclictest3669544-21grep10:24:436
3242480991211,1cyclictest3565887-21cpuspeed_turbos09:44:366
3242480991211,1cyclictest3345867-21cat07:59:396
3242480991211,1cyclictest3278326-21kthreadcore07:24:406
3242480991211,1cyclictest0-21swapper/611:39:246
324247699129,2cyclictest3252054-21kworker/u16:4+flush-8:008:14:445
3242476991210,2cyclictest3449118-21kworker/u16:2+events_unbound09:04:505
3242476991210,2cyclictest3313903-21kworker/u16:2+flush-8:007:59:385
324247199129,3cyclictest0-21swapper/411:39:144
324247199128,3cyclictest3334685-21cat07:54:394
324247199124,3cyclictest3893938-21sendmail_mailst11:54:484
324247199124,2cyclictest0-21swapper/409:09:424
324247199123,4cyclictest3676849-21tune2fs10:29:364
324247199123,4cyclictest3364283-21kthreadcore08:09:394
3242471991211,1cyclictest0-21swapper/412:26:134
3242471991211,1cyclictest0-21swapper/411:31:504
3242471991211,1cyclictest0-21swapper/409:49:584
3242471991211,1cyclictest0-21swapper/408:19:004
3242471991211,1cyclictest0-21swapper/407:40:324
3242471991211,1cyclictest0-21swapper/407:31:044
3242471991211,1cyclictest0-21swapper/407:26:214
3242471991210,2cyclictest0-21swapper/410:45:474
324247199120,8cyclictest3344032-21expr07:59:344
324247199120,12cyclictest0-21swapper/407:35:484
324247199120,12cyclictest0-21swapper/407:35:484
324247699119,2cyclictest3401664-21kworker/u16:3+flush-8:008:59:395
3242476991110,1cyclictest0-21swapper/507:52:135
3242476991110,1cyclictest0-21swapper/507:42:075
324247699110,11cyclictest0-21swapper/507:21:565
324247699110,0cyclictest0-21swapper/507:56:285
324247199119,2cyclictest0-21swapper/408:08:264
324247199118,2cyclictest3416715-21kworker/u16:4+flush-8:008:35:214
324247199116,4cyclictest3795329-21grep11:14:454
324247199113,4cyclictest3865688-21grep11:44:424
324247199113,3cyclictest3431631-21cut08:44:354
3242471991110,1cyclictest0-21swapper/411:40:494
3242471991110,1cyclictest0-21swapper/410:39:294
3242471991110,1cyclictest0-21swapper/408:43:264
3242471991110,1cyclictest0-21swapper/407:50:004
3242471991110,1cyclictest0-21swapper/407:16:534
324247199109,1cyclictest0-21swapper/409:02:124
324247199109,1cyclictest0-21swapper/407:46:504
324247199100,9cyclictest0-21swapper/409:39:484
32424769997,2cyclictest3416715-21kworker/u16:4+events_unbound08:55:335
32424719998,1cyclictest0-21swapper/410:34:454
32424719994,4cyclictest3546897-21kthreadcore09:34:424
32424719984,3cyclictest3441180-21forks08:49:364
32424719983,4cyclictest3742327-21tr10:54:404
32424719983,4cyclictest3672016-21cut10:24:444
32424719983,4cyclictest3395674-21cut08:24:414
32424769973,3cyclictest3314699-21grep07:44:365
32424769973,3cyclictest3295607-21cat07:34:365
32424769973,3cyclictest3295607-21cat07:34:365
32424719972,4cyclictest3471610-21cut09:04:394
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional