You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 13:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Dec 18, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
390297425241,8sleep40-21swapper/407:06:124
390292624837,8sleep50-21swapper/507:05:335
390303324613,29sleep70-21swapper/707:07:037
3903504994135,5cyclictest4004548-21latency_hist07:59:367
390321823525,7sleep60-21swapper/607:09:356
3903504993428,5cyclictest152018-21latency_hist10:54:357
3903504993428,5cyclictest152018-21latency_hist10:54:357
3903504993325,7cyclictest220175-21latency_hist11:29:357
3903499993028,2cyclictest4180204-21kworker/u16:4+events_unbound10:42:455
3903499992927,2cyclictest3985147-21kworker/u16:1+events_unbound08:10:055
3903494992927,2cyclictest2429023-21kworker/u16:3+flush-8:008:19:354
3903499992826,2cyclictest4072728-21kworker/u16:1+events_unbound09:48:115
3903499992826,2cyclictest4062612-21kworker/u16:0+events_unbound08:26:555
3903499992826,2cyclictest4062612-21kworker/u16:0+events_unbound08:26:555
3903499992826,2cyclictest2429023-21kworker/u16:3+events_unbound07:19:365
3903494992826,2cyclictest4014480-21kworker/u16:4+flush-8:008:49:364
3903494992826,2cyclictest3946485-21kworker/u16:2+events_unbound07:39:594
3903499992725,2cyclictest4179857-21kworker/u16:2+events_unbound10:00:055
3903499992725,2cyclictest4179857-21kworker/u16:2+events_unbound10:00:055
3903499992725,2cyclictest4072728-21kworker/u16:1+events_unbound08:48:455
3903499992725,2cyclictest3946485-21kworker/u16:2+events_unbound08:00:545
3903499992724,2cyclictest4122717-21kworker/u16:0+flush-8:009:19:365
3903499992724,2cyclictest160592-21kworker/u16:3+events_unbound10:59:455
3903494992724,2cyclictest152399-21kworker/u16:0+events_unbound11:04:584
3903504992620,5cyclictest3985114-21latency_hist07:49:367
3903499992624,2cyclictest4180204-21kworker/u16:4+events_unbound10:36:475
3903499992624,2cyclictest225494-21kworker/u16:3+events_unbound12:18:215
3903499992624,2cyclictest103543-21kworker/u16:3+events_unbound10:30:035
3903499992623,2cyclictest4180204-21kworker/u16:4+flush-8:010:24:465
3903499992623,2cyclictest249385-21kworker/u16:4+events_unbound12:34:365
3903494992624,2cyclictest4180204-21kworker/u16:4+flush-8:011:04:354
3903494992523,2cyclictest84144-21kworker/u16:1+events_unbound10:19:574
3903494992523,2cyclictest180243-21kworker/u16:1+events_unbound11:34:544
3903499992422,2cyclictest3946485-21kworker/u16:2+events_unbound07:56:545
3903499992422,2cyclictest3927997-21kworker/u16:0+events_unbound07:25:105
3903499992422,2cyclictest34294-21kworker/u16:5+events_unbound09:54:385
3903499992422,2cyclictest307314-21kworker/u16:2+events_unbound12:28:055
3903499992422,2cyclictest307314-21kworker/u16:2+events_unbound12:28:055
3903494992422,2cyclictest3884940-21kworker/u16:5+events_unbound07:14:494
3903504992318,4cyclictest650-21systemd-journal09:19:307
3903504992318,4cyclictest3994842-21latency_hist07:54:367
390350499230,21cyclictest200698-21latency_hist11:19:357
3903499992321,2cyclictest4111776-21kworker/u16:5+events_unbound09:01:505
3903499992321,2cyclictest249385-21kworker/u16:4+flush-8:011:53:015
3903494992321,2cyclictest4014480-21kworker/u16:4+flush-8:008:20:034
3903494992321,2cyclictest15855-21kworker/u16:0+events_unbound09:45:064
3903499992220,2cyclictest54664-21kworker/u16:0+events_unbound10:07:585
3903499992220,2cyclictest4179857-21kworker/u16:2+events_unbound10:57:465
3903499992220,2cyclictest4072728-21kworker/u16:1+events_unbound09:12:025
3903499992220,2cyclictest225494-21kworker/u16:3+flush-8:011:55:045
3903499992220,2cyclictest152399-21kworker/u16:0+flush-8:012:04:175
3903494992220,2cyclictest3927997-21kworker/u16:0+events_unbound07:19:594
3903494992220,2cyclictest2429023-21kworker/u16:3+flush-8:008:04:314
3903504992116,4cyclictest650-21systemd-journal08:54:367
3903499992119,2cyclictest84144-21kworker/u16:1+events_unbound10:53:105
3903499992119,2cyclictest84144-21kworker/u16:1+events_unbound10:53:105
3903499992119,2cyclictest3946485-21kworker/u16:2+flush-8:007:48:595
3903494992118,2cyclictest2429023-21kworker/u16:3+flush-8:009:29:354
3903494992117,3cyclictest180243-21kworker/u16:1+flush-8:011:29:484
3903504992014,5cyclictest3913134-21latency_hist07:14:367
3903499992018,2cyclictest317429-21kworker/u16:0+events_unbound12:22:585
3903499992018,2cyclictest180243-21kworker/u16:1+events_unbound11:37:385
3903499992018,2cyclictest180243-21kworker/u16:1+events_unbound11:20:515
3903499992017,2cyclictest152399-21kworker/u16:0+flush-8:012:04:455
3903494992018,2cyclictest84144-21kworker/u16:1+events_unbound10:54:544
3903494992018,2cyclictest4072728-21kworker/u16:1+flush-8:009:39:504
3903504991915,3cyclictest1267-21snmpd07:15:407
3903499991917,2cyclictest4180204-21kworker/u16:4+flush-8:009:29:515
3903499991917,2cyclictest4180204-21kworker/u16:4+events_unbound09:43:015
3903499991917,2cyclictest3985147-21kworker/u16:1+events_unbound07:54:115
3903499991917,2cyclictest3964702-21kworker/u16:0+events_unbound07:41:065
3903499991917,2cyclictest3946485-21kworker/u16:2+events_unbound08:05:005
3903499991917,2cyclictest3838908-21kworker/u16:1+events_unbound07:10:035
3903499991917,2cyclictest2429023-21kworker/u16:3+events_unbound08:50:585
3903499991916,2cyclictest84144-21kworker/u16:1+events_unbound10:44:385
3903494991917,2cyclictest4111776-21kworker/u16:5+events_unbound08:54:584
3903494991916,3cyclictest152399-21kworker/u16:0+flush-8:011:10:014
3903504991814,3cyclictest1267-21snmpd09:33:377
3903499991816,2cyclictest180243-21kworker/u16:1+events_unbound11:11:385
3903499991816,2cyclictest152399-21kworker/u16:0+events_unbound11:49:105
3903499991815,2cyclictest2429023-21kworker/u16:3+events_unbound07:29:385
3903504991713,3cyclictest1267-21snmpd12:35:297
3903504991711,5cyclictest4140955-21latency_hist09:09:357
390350499170,16cyclictest0-21swapper/707:30:007
3903499991715,2cyclictest54664-21kworker/u16:0+events_unbound10:14:425
3903499991715,2cyclictest4180204-21kworker/u16:4+events_unbound10:11:425
3903499991715,2cyclictest4179857-21kworker/u16:2+flush-8:010:20:055
3903499991715,2cyclictest4014480-21kworker/u16:4+flush-8:008:24:065
3903499991715,2cyclictest307314-21kworker/u16:2+events_unbound12:33:105
3903499991715,2cyclictest152399-21kworker/u16:0+flush-8:011:40:135
3903499991714,2cyclictest2429023-21kworker/u16:3+flush-8:007:34:515
3903499991714,2cyclictest2429023-21kworker/u16:3+flush-8:007:34:515
3903494991715,2cyclictest54664-21kworker/u16:0+flush-8:010:14:534
3903494991715,2cyclictest4179857-21kworker/u16:2+events_unbound09:59:574
3903494991715,2cyclictest4179857-21kworker/u16:2+events_unbound09:59:574
3903494991715,2cyclictest225494-21kworker/u16:3+flush-8:012:24:584
3903494991715,2cyclictest225494-21kworker/u16:3+flush-8:012:24:584
3903494991714,2cyclictest249385-21kworker/u16:4+flush-8:011:49:574
3903504991612,3cyclictest1267-21snmpd09:02:137
390350499160,1cyclictest0-21swapper/708:35:017
3903499991614,2cyclictest4111776-21kworker/u16:5+events_unbound09:04:425
3903499991614,2cyclictest4014480-21kworker/u16:4+flush-8:008:30:375
3903499991614,2cyclictest180243-21kworker/u16:1+events_unbound11:17:305
3903499991614,2cyclictest152399-21kworker/u16:0+events_unbound11:28:295
3903494991614,2cyclictest2429023-21kworker/u16:3+flush-8:007:44:534
3903494991614,2cyclictest2429023-21kworker/u16:3+events_unbound07:25:004
3903494991614,2cyclictest103543-21kworker/u16:3+flush-8:010:30:054
3903494991613,2cyclictest4180204-21kworker/u16:4+flush-8:009:29:534
3903504991512,2cyclictest0-21swapper/710:39:577
390350499150,14cyclictest0-21swapper/709:10:027
390350499150,13cyclictest0-21swapper/712:10:007
390350499150,13cyclictest0-21swapper/712:00:017
390350499150,13cyclictest0-21swapper/709:44:587
3903501991512,2cyclictest0-21swapper/611:40:016
3903499991513,2cyclictest4180204-21kworker/u16:4+events_unbound11:08:035
3903499991513,2cyclictest4111776-21kworker/u16:5+events_unbound09:15:495
3903499991513,2cyclictest4111776-21kworker/u16:5+events_unbound08:56:055
3903499991513,2cyclictest3946485-21kworker/u16:2+events_unbound08:15:555
3903499991513,2cyclictest249385-21kworker/u16:4+flush-8:012:13:205
3903494991513,2cyclictest3838908-21kworker/u16:1+flush-8:007:09:544
3903494991512,2cyclictest4180204-21kworker/u16:4+flush-8:009:34:514
3903494991511,3cyclictest128103-21kthreadcore10:39:554
3903504991413,0cyclictest0-21swapper/709:55:027
3903504991412,1cyclictest0-21swapper/710:44:587
3903504991411,2cyclictest327117-21awk12:24:347
390350499140,1cyclictest0-21swapper/709:34:597
390350499140,1cyclictest0-21swapper/708:19:587
390350499140,13cyclictest0-21swapper/710:24:597
390350499140,12cyclictest1267-21snmpd10:23:087
390350499140,12cyclictest0-21swapper/707:25:007
390350199140,14cyclictest0-21swapper/609:06:456
390349999149,4cyclictest4073894-21iostat_ios08:34:535
3903499991412,2cyclictest4180204-21kworker/u16:4+events_unbound09:38:565
3903499991412,2cyclictest2429023-21kworker/u16:3+events_unbound07:20:355
3903499991412,2cyclictest210804-21kworker/u16:2+events_unbound11:33:475
3903494991413,1cyclictest0-21swapper/412:05:594
3903494991412,2cyclictest225494-21kworker/u16:3+flush-8:012:00:054
390350499139,3cyclictest337208-21/usr/sbin/munin12:29:557
390350499139,3cyclictest1267-21snmpd11:12:487
390350499139,3cyclictest1267-21snmpd10:18:027
390350499139,3cyclictest1267-21snmpd10:12:327
390350499139,3cyclictest1267-21snmpd08:52:457
390350499136,6cyclictest0-21swapper/711:19:477
390350499136,6cyclictest0-21swapper/709:23:467
390350499136,6cyclictest0-21swapper/708:25:357
390350499136,6cyclictest0-21swapper/708:25:357
390350499135,7cyclictest0-21swapper/712:07:467
390350499130,4cyclictest3960501-21kthreadcore07:34:567
390350499130,4cyclictest3960501-21kthreadcore07:34:567
390350499130,2cyclictest25689-21/usr/sbin/munin09:49:587
390350199130,1cyclictest0-21swapper/608:07:476
3903499991311,2cyclictest4072728-21kworker/u16:1+flush-8:008:42:345
3903499991311,2cyclictest4072728-21kworker/u16:1+events_unbound09:26:105
3903494991312,1cyclictest0-21swapper/410:35:304
3903494991312,1cyclictest0-21swapper/409:09:544
3903494991312,1cyclictest0-21swapper/409:00:364
390349499130,13cyclictest0-21swapper/412:20:584
390349499130,12cyclictest0-21swapper/411:44:434
390350499129,2cyclictest0-21swapper/712:24:547
390350499129,2cyclictest0-21swapper/712:24:547
390350499128,3cyclictest1267-21snmpd11:31:227
390350499128,3cyclictest1267-21snmpd11:02:217
390350499128,3cyclictest1267-21snmpd10:36:457
390350499128,3cyclictest1267-21snmpd10:34:037
390350499128,3cyclictest1267-21snmpd10:00:027
390350499128,3cyclictest1267-21snmpd10:00:027
390350499128,3cyclictest1267-21snmpd09:29:227
390350499128,3cyclictest1267-21snmpd08:16:577
390350499127,4cyclictest3975076-21sshd-session07:40:107
390350499125,6cyclictest0-21swapper/708:32:417
390350499121,9cyclictest0-21swapper/707:19:587
390350499120,11cyclictest1267-21snmpd09:44:297
390350499120,10cyclictest316429-21ntpq12:15:007
390350499120,10cyclictest253375-21tr11:44:547
390350499120,10cyclictest1267-21snmpd11:35:437
390350199129,2cyclictest176076-21kthreadcore11:04:576
3903501991211,1cyclictest0-21swapper/611:49:466
3903501991211,1cyclictest0-21swapper/609:40:486
3903501991211,1cyclictest0-21swapper/607:09:566
390350199120,1cyclictest0-21swapper/612:07:356
390350199120,1cyclictest0-21swapper/610:40:246
390350199120,1cyclictest0-21swapper/609:30:526
390350199120,11cyclictest0-21swapper/612:09:476
390350199120,0cyclictest0-21swapper/608:26:336
390350199120,0cyclictest0-21swapper/608:26:336
390349999120,1cyclictest0-21swapper/509:51:085
390349499128,3cyclictest66129-21cut10:09:534
3903494991211,1cyclictest0-21swapper/412:38:094
3903494991211,1cyclictest0-21swapper/411:40:274
3903494991211,1cyclictest0-21swapper/408:53:494
3903494991211,1cyclictest0-21swapper/408:40:064
3903494991211,1cyclictest0-21swapper/408:31:074
3903494991211,1cyclictest0-21swapper/407:55:004
3903494991211,1cyclictest0-21swapper/407:52:484
3903494991210,2cyclictest210804-21kworker/u16:2+flush-8:011:25:014
390349499120,1cyclictest0-21swapper/412:18:554
390349499120,1cyclictest0-21swapper/409:54:404
390349499120,12cyclictest0-21swapper/409:19:214
390350499117,3cyclictest1267-21snmpd07:59:467
390350499116,4cyclictest268495-21sshd-session11:50:557
390350499110,2cyclictest0-21swapper/708:39:527
390350499110,10cyclictest4014652-21/usr/sbin/munin08:04:567
390350499110,10cyclictest1267-21snmpd08:46:007
3903501991110,1cyclictest0-21swapper/612:23:026
3903501991110,1cyclictest0-21swapper/611:32:076
3903501991110,1cyclictest0-21swapper/611:20:556
3903501991110,1cyclictest0-21swapper/610:15:016
3903501991110,1cyclictest0-21swapper/610:10:276
3903501991110,1cyclictest0-21swapper/609:35:466
3903501991110,1cyclictest0-21swapper/609:01:526
3903501991110,1cyclictest0-21swapper/608:40:356
3903501991110,1cyclictest0-21swapper/608:10:006
3903501991110,1cyclictest0-21swapper/608:00:426
3903501991110,1cyclictest0-21swapper/607:51:246
3903501991110,1cyclictest0-21swapper/607:20:396
390350199110,1cyclictest0-21swapper/609:48:226
390350199110,11cyclictest0-21swapper/612:38:386
390350199110,11cyclictest0-21swapper/612:31:526
390350199110,11cyclictest0-21swapper/611:45:216
390350199110,11cyclictest0-21swapper/610:47:116
390350199110,11cyclictest0-21swapper/609:18:546
390350199110,11cyclictest0-21swapper/608:52:246
390350199110,11cyclictest0-21swapper/607:46:496
390350199110,11cyclictest0-21swapper/607:37:506
390350199110,11cyclictest0-21swapper/607:37:506
390350199110,10cyclictest0-21swapper/609:25:016
390350199110,0cyclictest0-21swapper/612:27:276
390350199110,0cyclictest0-21swapper/612:27:276
390350199110,0cyclictest0-21swapper/610:58:226
390350199110,0cyclictest0-21swapper/608:45:196
390350199110,0cyclictest0-21swapper/608:33:396
390349499119,2cyclictest180244-21kworker/u16:5+events_unbound11:19:534
3903494991110,1cyclictest0-21swapper/411:14:364
3903494991110,1cyclictest0-21swapper/408:28:544
3903494991110,1cyclictest0-21swapper/408:28:544
3903494991110,1cyclictest0-21swapper/408:10:464
390350499106,3cyclictest1267-21snmpd10:56:307
390350499106,3cyclictest1267-21snmpd08:09:357
390350499105,4cyclictest249701-21cut11:44:357
390350499104,5cyclictest64364-21latency_hist10:09:357
390350499100,8cyclictest0-21swapper/711:04:537
390350199109,1cyclictest0-21swapper/612:00:486
390350199109,1cyclictest0-21swapper/611:56:236
390350199109,1cyclictest0-21swapper/610:00:406
390350199109,1cyclictest0-21swapper/610:00:406
390350199109,1cyclictest0-21swapper/609:14:006
390350199109,1cyclictest0-21swapper/608:59:306
390350199109,1cyclictest0-21swapper/608:14:446
390350199106,3cyclictest3947291-21cat07:29:516
390350199100,0cyclictest0-21swapper/609:55:476
390349499109,1cyclictest0-21swapper/411:57:294
390349499109,1cyclictest0-21swapper/408:37:534
390349499108,2cyclictest4180204-21kworker/u16:4+flush-8:010:25:004
39035049996,2cyclictest1267-21snmpd11:54:587
39035019998,1cyclictest0-21swapper/611:25:206
39035019998,1cyclictest0-21swapper/608:35:516
39035019997,1cyclictest0-21swapper/609:49:546
39035019997,1cyclictest0-21swapper/609:19:546
39035019996,2cyclictest0-21swapper/610:19:536
39035019995,3cyclictest104584-21cat10:29:516
39034949997,2cyclictest4179857-21kworker/u16:2+events_unbound10:49:354
39034949997,2cyclictest2429023-21kworker/u16:3+flush-8:007:29:564
39035019988,0cyclictest0-21swapper/611:02:476
39035019986,1cyclictest0-21swapper/612:14:486
39035019984,3cyclictest231808-21cut11:34:536
39035019983,4cyclictest97192-21grep10:24:536
39035019983,4cyclictest4050260-21grep08:19:546
39035019983,4cyclictest182366-21cat11:09:516
39035019983,4cyclictest147708-21cut10:49:546
39035019983,4cyclictest147708-21cut10:49:546
39035019983,4cyclictest113592-21cat10:34:476
39034949987,1cyclictest0-21swapper/412:10:154
39034949987,1cyclictest0-21swapper/408:08:344
39034949986,2cyclictest3884940-21kworker/u16:5+flush-8:007:35:014
39034949986,2cyclictest3884940-21kworker/u16:5+flush-8:007:35:014
39034949985,2cyclictest4161612-21irqcore09:19:524
39034949984,3cyclictest337276-21cpuspeed12:29:464
39034949984,3cyclictest28586-21kthreadcore09:49:524
39034949983,4cyclictest56288-21cut10:04:514
39034949983,4cyclictest4140196-21switchtime09:05:024
39034949983,4cyclictest150724-21cut10:49:564
39034949983,4cyclictest150724-21cut10:49:564
39035019975,1cyclictest0-21swapper/610:04:506
39035019973,3cyclictest3995370-21sort07:54:486
39035019973,3cyclictest3914468-21grep07:14:386
39035019972,4cyclictest3936932-21cpuspeed_turbos07:24:486
39035019972,4cyclictest191740-21expr11:14:486
39035019970,6cyclictest3971356-21kthreadcore07:39:566
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional