You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 05:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue Sep 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
415144621000,0sleep40-21swapper/400:04:554
415144621000,0sleep40-21swapper/400:04:554
41748952950,1sleep50-21swapper/500:14:425
36071502570,0sleep73607153-21cut20:05:057
348766825746,8sleep40-21swapper/419:07:504
348765025545,7sleep50-21swapper/519:07:355
348755725218,29sleep70-21swapper/719:06:177
3488099994943,5cyclictest3520879-21latency_hist19:24:437
3488083994745,2cyclictest3931774-21kworker/u16:4+events_unbound23:34:574
3488083994644,2cyclictest4162923-21kworker/u16:2+events_unbound00:24:554
3488083994038,2cyclictest3907604-21kworker/u16:2+flush-8:023:14:424
3488083993937,2cyclictest3846711-21kworker/u16:3+events_unbound22:15:054
3488099993733,3cyclictest3992550-21latency_hist22:59:427
3488099993731,5cyclictest3705685-21latency_hist20:59:437
348809999370,35cyclictest3895290-21latency_hist22:19:427
41274502350,1sleep74127451-21sh23:54:567
348809999340,32cyclictest645-21systemd-journal21:09:437
3488083993432,2cyclictest3449134-21kworker/u16:0+flush-8:019:29:434
348768823221,8sleep60-21swapper/619:08:086
3488083993129,2cyclictest3907604-21kworker/u16:2+events_unbound22:27:534
3488083993129,2cyclictest3893196-21kworker/u16:1+events_unbound22:50:044
3488083993129,2cyclictest3802720-21kworker/u16:2+flush-8:021:49:424
3488083993129,2cyclictest3771647-21kworker/u16:0+flush-8:022:14:424
3488083993129,2cyclictest3618679-21kworker/u16:0+events_unbound20:59:574
37342642290,1chrt3734259-21ssh21:10:117
3488083992927,2cyclictest4053435-21kworker/u16:3+flush-8:023:55:234
3488083992927,2cyclictest3771647-21kworker/u16:0+flush-8:022:20:124
3488083992926,2cyclictest3771647-21kworker/u16:0+flush-8:021:34:424
39294052280,1chrt3929404-21ssh22:30:257
3488083992826,2cyclictest4123815-21kworker/u16:1+events_unbound00:00:534
3488083992826,2cyclictest3907604-21kworker/u16:2+events_unbound23:40:204
3488090992725,2cyclictest3449134-21kworker/u16:0+events_unbound19:19:575
3488083992725,2cyclictest3771647-21kworker/u16:0+events_unbound21:26:534
3488091992624,2cyclictest3589257-21kworker/u16:3+events_unbound20:19:576
37068572250,1sleep50-21swapper/520:59:595
3488099992520,4cyclictest3834524-21latency_hist21:54:437
3488091992523,2cyclictest3539553-21kworker/u16:4+events_unbound19:59:596
3488091992522,2cyclictest3695617-21kworker/u16:2+events_unbound21:19:496
3488091992522,2cyclictest3695617-21kworker/u16:2+events_unbound21:19:496
3488083992524,1cyclictest3893196-21kworker/u16:1+events_unbound23:05:114
3488083992523,2cyclictest3907604-21kworker/u16:2+events_unbound23:49:444
3488083992523,2cyclictest3725257-21kworker/u16:4+flush-8:021:49:594
3488090992422,2cyclictest4147618-21kworker/u16:5+events_unbound00:05:155
3488090992422,2cyclictest4147618-21kworker/u16:5+events_unbound00:05:155
3488083992423,1cyclictest3929388-21kworker/u16:0+events_unbound22:45:014
3488083992423,1cyclictest3929388-21kworker/u16:0+events_unbound22:45:014
3488083992422,2cyclictest4053435-21kworker/u16:3+events_unbound23:28:404
3488091992321,2cyclictest3647084-21kworker/u16:1+events_unbound20:55:066
3488091992320,2cyclictest3725257-21kworker/u16:4+events_unbound21:29:496
3488090992321,2cyclictest3893196-21kworker/u16:1+events_unbound23:06:475
3488090992321,2cyclictest3893196-21kworker/u16:1+events_unbound22:22:525
3488090992321,2cyclictest3802720-21kworker/u16:2+events_unbound21:49:335
3488090992321,2cyclictest3771647-21kworker/u16:0+events_unbound22:14:405
3488083992321,2cyclictest3893196-21kworker/u16:1+events_unbound22:58:194
3488083992321,2cyclictest3725257-21kworker/u16:4+events_unbound21:20:204
3488083992321,2cyclictest3725257-21kworker/u16:4+events_unbound21:20:204
3488091992220,2cyclictest3893196-21kworker/u16:1+events_unbound22:55:216
3488090992220,2cyclictest4075241-21kworker/u16:0+events_unbound23:38:155
3488090992220,2cyclictest3893196-21kworker/u16:1+events_unbound22:53:165
3488090992220,2cyclictest3893196-21kworker/u16:1+events_unbound22:26:125
3488090992220,2cyclictest3695617-21kworker/u16:2+events_unbound21:24:285
3488090992220,2cyclictest3695617-21kworker/u16:2+events_unbound21:24:285
3488090992220,2cyclictest3647084-21kworker/u16:1+events_unbound21:18:485
3488090992220,2cyclictest27204-21kworker/u16:0+events_unbound00:35:155
3488083992220,2cyclictest4053435-21kworker/u16:3+events_unbound00:14:554
3488083992220,2cyclictest3907604-21kworker/u16:2+events_unbound23:17:534
3488083992219,2cyclictest3893196-21kworker/u16:1+flush-8:022:29:494
3488090992119,2cyclictest4187183-21kworker/u16:4+events_unbound00:22:035
3488090992119,2cyclictest4175275-21kworker/u16:1+events_unbound00:18:205
3488090992119,2cyclictest4123815-21kworker/u16:1+events_unbound00:02:445
3488090992119,2cyclictest4051818-21kworker/u16:0+events_unbound23:24:365
3488090992119,2cyclictest3907604-21kworker/u16:2+events_unbound23:17:085
3488090992119,2cyclictest3893196-21kworker/u16:1+events_unbound23:10:515
3488090992119,2cyclictest3893196-21kworker/u16:1+events_unbound22:36:375
3488090992119,2cyclictest3893196-21kworker/u16:1+events_unbound22:18:565
3488090992119,2cyclictest3802720-21kworker/u16:2+events_unbound21:57:425
3488090992119,2cyclictest3771647-21kworker/u16:0+events_unbound21:27:405
3488090992119,2cyclictest3618679-21kworker/u16:0+events_unbound20:44:565
3488090992118,2cyclictest4053435-21kworker/u16:3+events_unbound23:54:455
3488090992118,2cyclictest3618679-21kworker/u16:0+events_unbound21:04:485
3488083992119,2cyclictest4053435-21kworker/u16:3+events_unbound23:48:404
3488083992119,2cyclictest3931774-21kworker/u16:4+events_unbound23:32:404
3488083992119,2cyclictest3907604-21kworker/u16:2+events_unbound22:40:534
3488083992119,2cyclictest3893196-21kworker/u16:1+events_unbound23:21:524
3488083992119,2cyclictest3802720-21kworker/u16:2+events_unbound21:57:534
3488083992119,2cyclictest3579376-21kworker/u16:2+flush-8:020:30:144
3488083992119,2cyclictest3579376-21kworker/u16:2+flush-8:020:05:084
3488091992018,2cyclictest3647084-21kworker/u16:1+events_unbound20:52:196
3488091992017,2cyclictest3520578-21kworker/u16:1+events_unbound19:54:506
3488091992017,2cyclictest3520578-21kworker/u16:1+events_unbound19:54:506
3488090992018,2cyclictest4075241-21kworker/u16:0+events_unbound23:50:595
3488090992018,2cyclictest3907604-21kworker/u16:2+events_unbound23:43:215
3488090992018,2cyclictest3907604-21kworker/u16:2+events_unbound22:44:165
3488090992018,2cyclictest3862366-21kworker/u16:1+events_unbound22:07:245
3488090992018,2cyclictest3771647-21kworker/u16:0+events_unbound21:53:325
3488090992018,2cyclictest3762-21kworker/u16:5+events_unbound00:26:275
3488090992018,2cyclictest3520578-21kworker/u16:1+events_unbound19:45:535
3488083992018,2cyclictest4053435-21kworker/u16:3+events_unbound00:12:524
3488083992018,2cyclictest3725257-21kworker/u16:4+events_unbound21:19:334
3488099991915,3cyclictest1274-21snmpd21:21:147
3488099991915,3cyclictest1274-21snmpd21:21:147
3488091991917,2cyclictest3893196-21kworker/u16:1+flush-8:022:25:386
3488091991917,2cyclictest3771647-21kworker/u16:0+events_unbound22:08:156
3488091991917,2cyclictest3725257-21kworker/u16:4+flush-8:021:50:296
3488091991917,2cyclictest3618679-21kworker/u16:0+events_unbound20:24:566
3488091991917,2cyclictest3539553-21kworker/u16:4+events_unbound19:43:266
3488091991917,2cyclictest2530695-21kworker/u16:4+flush-8:019:14:586
3488090991917,2cyclictest3907604-21kworker/u16:2+events_unbound23:01:055
3488090991917,2cyclictest3907604-21kworker/u16:2+events_unbound22:45:155
3488090991917,2cyclictest3907604-21kworker/u16:2+events_unbound22:45:155
3488090991917,2cyclictest3907604-21kworker/u16:2+events_unbound22:31:565
3488090991917,2cyclictest3802720-21kworker/u16:2+events_unbound22:02:315
3488090991917,2cyclictest3771647-21kworker/u16:0+events_unbound21:43:535
3488090991917,2cyclictest3725257-21kworker/u16:4+events_unbound21:31:055
3488090991917,2cyclictest3520578-21kworker/u16:1+events_unbound19:56:535
3488090991917,2cyclictest3520578-21kworker/u16:1+events_unbound19:56:535
3488083991917,2cyclictest3569262-21kworker/u16:0+flush-8:020:01:134
3488083991917,2cyclictest2530695-21kworker/u16:4+flush-8:019:14:424
3488083991917,2cyclictest2530695-21kworker/u16:4+flush-8:019:14:424
3488099991814,3cyclictest1274-21snmpd19:58:007
3488099991814,3cyclictest1274-21snmpd19:58:007
3488091991816,2cyclictest4053435-21kworker/u16:3+events_unbound00:14:366
3488091991816,2cyclictest27204-21kworker/u16:0+events_unbound00:30:596
3488090991816,2cyclictest4053435-21kworker/u16:3+events_unbound23:27:245
3488090991816,2cyclictest3931774-21kworker/u16:4+events_unbound23:30:515
3488090991816,2cyclictest3785955-21kworker/u16:1+events_unbound21:38:545
3488090991816,2cyclictest2530695-21kworker/u16:4+events_unbound19:19:325
3488090991815,2cyclictest4053435-21kworker/u16:3+events_unbound00:29:465
3488083991816,2cyclictest3907604-21kworker/u16:2+events_unbound23:04:404
3488083991816,2cyclictest3893196-21kworker/u16:1+events_unbound22:34:524
3488083991816,2cyclictest3785955-21kworker/u16:1+events_unbound21:39:574
3488083991816,2cyclictest3725257-21kworker/u16:4+events_unbound21:36:084
3488083991816,2cyclictest3521084-21kworker/u16:2+flush-8:019:35:054
39150552170,0sleep73915058-21cut22:25:047
348809999170,1cyclictest0-21swapper/720:00:087
348809999170,1cyclictest0-21swapper/719:15:087
3488091991715,2cyclictest3618679-21kworker/u16:0+flush-8:020:45:126
3488091991715,2cyclictest3618679-21kworker/u16:0+events_unbound21:03:476
3488091991715,2cyclictest3520578-21kworker/u16:1+events_unbound19:39:106
3488091991715,2cyclictest3424093-21kworker/u16:3+flush-8:019:14:326
3488091991715,2cyclictest3424093-21kworker/u16:3+flush-8:019:14:326
3488091991714,2cyclictest3618679-21kworker/u16:0+events_unbound20:14:506
3488090991715,2cyclictest3929388-21kworker/u16:0+events_unbound22:57:455
3488090991715,2cyclictest3695617-21kworker/u16:2+events_unbound21:11:195
3488090991715,2cyclictest3647084-21kworker/u16:1+events_unbound20:56:535
3488090991715,2cyclictest3579376-21kworker/u16:2+events_unbound20:08:175
3488090991715,2cyclictest3520578-21kworker/u16:1+events_unbound19:38:535
3488083991715,2cyclictest4053435-21kworker/u16:3+events_unbound00:24:004
3488083991715,2cyclictest3424093-21kworker/u16:3+flush-8:019:14:484
3488099991611,4cyclictest645-21systemd-journal23:04:437
3488099991610,5cyclictest645-21systemd-journal20:19:437
348809999160,14cyclictest0-21swapper/719:45:067
3488091991614,2cyclictest4175275-21kworker/u16:1+events_unbound00:15:176
3488091991614,2cyclictest4075241-21kworker/u16:0+events_unbound23:59:546
3488091991614,2cyclictest3907604-21kworker/u16:2+events_unbound23:04:576
3488091991614,2cyclictest3907604-21kworker/u16:2+events_unbound23:02:356
3488091991614,2cyclictest3725257-21kworker/u16:4+events_unbound21:19:376
3488091991614,2cyclictest3695617-21kworker/u16:2+events_unbound21:06:516
3488091991614,2cyclictest3589257-21kworker/u16:3+events_unbound20:06:346
3488091991614,2cyclictest3579376-21kworker/u16:2+flush-8:020:35:086
3488091991614,2cyclictest3520578-21kworker/u16:1+flush-8:019:54:376
3488091991614,2cyclictest3520578-21kworker/u16:1+events_unbound19:31:396
3488091991613,2cyclictest3647084-21kworker/u16:1+events_unbound20:29:516
3488090991614,2cyclictest3931774-21kworker/u16:4+events_unbound23:46:045
3488090991614,2cyclictest3579376-21kworker/u16:2+events_unbound20:13:165
3488083991614,2cyclictest27204-21kworker/u16:0+events_unbound00:31:404
3488099991512,2cyclictest4162688-21munin-run00:09:417
3488099991512,2cyclictest4162688-21munin-run00:09:417
3488099991512,2cyclictest0-21swapper/722:05:127
3488099991510,4cyclictest30149-21latency_hist00:34:427
3488091991514,1cyclictest0-21swapper/600:21:256
3488091991513,2cyclictest4147618-21kworker/u16:5+events_unbound00:05:116
3488091991513,2cyclictest4147618-21kworker/u16:5+events_unbound00:05:116
3488091991513,2cyclictest3931774-21kworker/u16:4+events_unbound23:36:256
3488091991513,2cyclictest3929388-21kworker/u16:0+flush-8:022:40:036
3488091991513,2cyclictest3929388-21kworker/u16:0+events_unbound22:38:016
3488091991513,2cyclictest3893196-21kworker/u16:1+events_unbound23:19:416
3488091991513,2cyclictest3771647-21kworker/u16:0+events_unbound21:47:126
3488091991513,2cyclictest3771647-21kworker/u16:0+events_unbound21:44:036
3488091991513,2cyclictest3647084-21kworker/u16:1+events_unbound21:10:106
348809199150,15cyclictest86-21ksoftirqd/622:20:016
3488090991513,2cyclictest3589257-21kworker/u16:3+events_unbound20:26:285
3488090991513,2cyclictest3589257-21kworker/u16:3+events_unbound20:16:575
3488090991513,2cyclictest3579376-21kworker/u16:2+events_unbound20:30:245
3488090991513,2cyclictest3569262-21kworker/u16:0+events_unbound20:01:335
3488090991513,2cyclictest3569262-21kworker/u16:0+events_unbound19:51:545
3488090991513,2cyclictest3424093-21kworker/u16:3+events_unbound19:30:245
3488090991513,2cyclictest3424093-21kworker/u16:3+events_unbound19:27:175
3488083991513,2cyclictest3762-21kworker/u16:5+events_unbound00:38:444
3488083991513,2cyclictest3725257-21kworker/u16:4+events_unbound21:13:324
348809999148,5cyclictest3872265-21cat22:09:577
348809999148,5cyclictest3686231-21latency_hist20:49:437
348809999148,4cyclictest4188338-21cat00:19:597
3488099991410,3cyclictest1274-21snmpd23:03:437
348809999140,1cyclictest0-21swapper/719:10:077
348809999140,1cyclictest0-21swapper/719:10:077
3488091991413,1cyclictest0-21swapper/623:54:086
3488091991413,1cyclictest0-21swapper/623:30:016
3488091991413,1cyclictest0-21swapper/623:20:146
3488091991412,2cyclictest3802720-21kworker/u16:2+events_unbound22:00:026
3488091991412,2cyclictest3725257-21kworker/u16:4+events_unbound21:38:276
3488091991412,2cyclictest3618679-21kworker/u16:0+events_unbound20:42:396
3488090991412,2cyclictest3647084-21kworker/u16:1+events_unbound20:38:375
3488090991412,2cyclictest3618679-21kworker/u16:0+events_unbound20:41:355
3488083991413,1cyclictest0-21swapper/422:01:314
3488083991412,2cyclictest3695617-21kworker/u16:2+flush-8:021:09:434
348808399140,14cyclictest0-21swapper/422:09:344
348809999139,3cyclictest1274-21snmpd20:53:407
3488099991310,2cyclictest1274-21snmpd00:01:487
348809999130,3cyclictest4056010-21cut23:25:007
348809999130,2cyclictest4088493-21ssh23:37:247
348809999130,11cyclictest1274-21snmpd19:37:097
348809199135,7cyclictest1-21systemd22:49:426
348809199135,7cyclictest1-21systemd22:49:426
3488091991313,0cyclictest0-21swapper/623:40:446
3488091991312,1cyclictest0-21swapper/623:48:476
3488091991312,1cyclictest0-21swapper/623:25:086
3488091991312,1cyclictest0-21swapper/623:10:286
3488091991312,1cyclictest0-21swapper/622:31:126
3488091991311,2cyclictest4053435-21kworker/u16:3+events_unbound23:57:516
3488091991311,2cyclictest3771647-21kworker/u16:0+events_unbound21:29:126
3488091991311,2cyclictest3520578-21kworker/u16:1+events_unbound19:27:116
348809199130,13cyclictest0-21swapper/622:50:276
348809199130,13cyclictest0-21swapper/622:17:206
348809199130,13cyclictest0-21swapper/622:11:306
348809199130,13cyclictest0-21swapper/621:59:036
3488090991311,2cyclictest3539553-21kworker/u16:4+events_unbound19:42:535
3488090991310,2cyclictest3632564-21cut20:20:005
3488090991310,2cyclictest3494804-21cut19:10:025
3488090991310,2cyclictest3494804-21cut19:10:025
3488083991312,1cyclictest0-21swapper/419:51:084
3488083991311,2cyclictest3695617-21kworker/u16:2+flush-8:020:54:384
3488083991311,2cyclictest3520578-21kworker/u16:1+flush-8:019:45:064
348809999129,2cyclictest1274-21snmpd23:51:567
348809999129,2cyclictest1274-21snmpd21:14:507
348809999129,2cyclictest0-21swapper/723:19:427
348809999129,2cyclictest0-21swapper/720:39:437
348809999128,3cyclictest5923-21gmain00:35:117
348809999128,3cyclictest1274-21snmpd22:42:467
348809999128,3cyclictest1274-21snmpd22:36:037
348809999128,3cyclictest1274-21snmpd21:24:567
348809999128,3cyclictest1274-21snmpd19:31:037
348809999127,4cyclictest4103208-21cat23:44:587
348809999127,4cyclictest3968150-21latency_hist22:49:427
348809999127,4cyclictest3968150-21latency_hist22:49:427
348809999126,5cyclictest4174843-21latency_hist00:14:427
3488099991210,1cyclictest3821502-21ssh21:48:017
348809999120,2cyclictest4178136-21grep00:15:017
348809999120,2cyclictest3714284-21sed21:00:077
348809999120,1cyclictest4028740-21ssh23:14:057
348809999120,10cyclictest1274-21snmpd20:36:467
3488090991210,2cyclictest3695617-21kworker/u16:2+events_unbound20:51:275
3488083991211,1cyclictest0-21swapper/420:26:084
3488083991211,1cyclictest0-21swapper/420:17:094
3488083991211,1cyclictest0-21swapper/419:56:584
3488083991211,1cyclictest0-21swapper/419:56:584
3488083991210,2cyclictest3579376-21kworker/u16:2+flush-8:020:20:084
3488083991210,2cyclictest3520578-21kworker/u16:1+flush-8:019:30:114
348808399120,1cyclictest0-21swapper/420:14:284
348808399120,12cyclictest0-21swapper/419:21:484
348809999119,1cyclictest3637671-21munin-run20:24:437
348809999119,1cyclictest0-21swapper/723:30:097
348809999118,2cyclictest1274-21snmpd21:42:237
348809999118,2cyclictest1274-21snmpd21:34:447
348809999118,2cyclictest1274-21snmpd21:34:357
348809999117,3cyclictest1274-21snmpd22:04:037
348809999117,3cyclictest1274-21snmpd19:54:157
348809999116,4cyclictest3896577-21cat22:19:587
348809999116,4cyclictest18026-21latency_hist00:29:427
348809999110,1cyclictest4100140-21ssh23:41:267
348809999110,10cyclictest1274-21snmpd21:58:577
348809199119,2cyclictest3520578-21kworker/u16:1+events_unbound19:44:566
348809199117,2cyclictest4053435-21kworker/u16:3+events_unbound00:24:476
348809199110,2cyclictest3615752-21grep20:10:046
348809999108,1cyclictest0-21swapper/723:19:577
348809999107,2cyclictest5997-21gmain20:10:117
348809999104,4cyclictest3656240-21processes20:30:107
348809999100,8cyclictest1274-21snmpd20:26:167
348809199108,2cyclictest3449134-21kworker/u16:0+events_unbound19:20:116
348808399108,2cyclictest3579376-21kworker/u16:2+events_unbound20:40:124
34880999996,2cyclictest1274-21snmpd19:29:247
34880999994,4cyclictest3969061-21expr22:49:557
34880999993,5cyclictest1318-21dockerd19:40:067
34880919998,1cyclictest0-21swapper/600:37:116
34880839987,1cyclictest0-21swapper/420:57:314
34880839987,1cyclictest0-21swapper/420:46:474
34880839986,2cyclictest3539553-21kworker/u16:4+flush-8:019:39:584
34880839985,2cyclictest0-21swapper/420:35:044
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional