You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 07:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sun Sep 06, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
379725926049,8sleep40-21swapper/419:06:384
379717425519,31sleep70-21swapper/719:05:297
379743824535,7sleep50-21swapper/519:09:125
3797745994135,5cyclictest648-21systemd-journal23:49:177
3797745994035,4cyclictest206905-21latency_hist23:39:177
3797745993731,5cyclictest3927897-21latency_hist20:14:187
3797745993731,4cyclictest304498-21latency_hist00:19:177
3797744993735,2cyclictest121754-21kworker/u16:2+events_unbound00:01:526
3797744993634,2cyclictest12120-21kworker/u16:3+events_unbound22:26:326
379742123626,7sleep60-21swapper/619:08:576
3797744993533,2cyclictest48630-21kworker/u16:1+events_unbound22:41:446
3797744993533,2cyclictest121754-21kworker/u16:2+events_unbound23:15:256
3797744993529,6cyclictest168068-21kworker/u16:4+events_unbound23:20:076
3797744993432,2cyclictest4006004-21kworker/u16:0+events_unbound22:35:216
3797744993432,2cyclictest3889316-21kworker/u16:4+events_unbound20:28:246
3797745993328,4cyclictest4193251-21latency_hist22:14:187
3797744993331,2cyclictest4006004-21kworker/u16:0+events_unbound23:09:006
3797744993331,2cyclictest267888-21kworker/u16:0+events_unbound00:24:156
3797744993331,2cyclictest194772-21kworker/u16:3+events_unbound23:55:396
3797744993330,2cyclictest4132417-21kworker/u16:2+events_unbound22:14:236
3797744993230,2cyclictest3798232-21kworker/u16:1+events_unbound19:37:256
3797744993129,2cyclictest73432-21kworker/u16:2+events_unbound22:46:046
3797744993129,2cyclictest4116996-21kworker/u16:4+events_unbound21:51:526
3797744993129,2cyclictest4006004-21kworker/u16:0+events_unbound21:55:006
3797744993129,2cyclictest3907640-21kworker/u16:5+events_unbound20:01:166
3797744993129,2cyclictest3821251-21kworker/u16:2+events_unbound19:27:256
3797744993129,2cyclictest3798232-21kworker/u16:1+events_unbound19:20:256
3797744993129,2cyclictest267888-21kworker/u16:0+events_unbound00:15:316
3797744993128,2cyclictest4006004-21kworker/u16:0+events_unbound20:54:216
3797744993028,2cyclictest48630-21kworker/u16:1+events_unbound23:49:336
3797744993028,2cyclictest4132417-21kworker/u16:2+events_unbound22:01:336
3797744992927,2cyclictest3860971-21kworker/u16:2+events_unbound20:31:256
3797744992927,2cyclictest121754-21kworker/u16:2+events_unbound23:25:416
3797734992927,2cyclictest4072716-21kworker/u16:2+flush-8:021:25:024
3797744992826,2cyclictest85586-21kworker/u16:3+events_unbound22:52:186
3797744992826,2cyclictest3907640-21kworker/u16:5+events_unbound20:08:246
3797744992826,2cyclictest3880216-21kworker/u16:0+events_unbound19:51:296
3797744992826,2cyclictest3840394-21kworker/u16:3+events_unbound19:41:246
3797744992826,2cyclictest338876-21kworker/u16:1+events_unbound00:37:106
3797744992826,2cyclictest267888-21kworker/u16:0+events_unbound00:12:276
3797734992826,2cyclictest3798232-21kworker/u16:1+events_unbound19:42:404
357262280,1chrt35724-21ssh22:28:017
3797744992725,2cyclictest3907640-21kworker/u16:5+events_unbound20:11:376
3797744992725,2cyclictest194772-21kworker/u16:3+events_unbound23:40:146
3797734992725,2cyclictest4006004-21kworker/u16:0+events_unbound21:08:454
3797744992624,2cyclictest4043957-21kworker/u16:1+events_unbound21:21:356
3797744992624,2cyclictest4006004-21kworker/u16:0+events_unbound21:01:176
3797744992624,2cyclictest3889316-21kworker/u16:4+events_unbound20:53:176
3797744992624,2cyclictest267888-21kworker/u16:0+events_unbound00:32:276
3797744992624,2cyclictest267888-21kworker/u16:0+events_unbound00:27:106
3797744992624,2cyclictest267888-21kworker/u16:0+events_unbound00:27:106
3797734992624,2cyclictest3889316-21kworker/u16:4+events_unbound20:48:084
3797734992624,2cyclictest3128538-21kworker/u16:4+events_unbound19:26:524
3797734992623,2cyclictest121754-21kworker/u16:2+events_unbound23:39:254
3797744992523,2cyclictest85586-21kworker/u16:3+events_unbound23:03:466
3797744992523,2cyclictest85586-21kworker/u16:3+events_unbound23:03:466
3797744992523,2cyclictest48630-21kworker/u16:1+events_unbound23:47:306
3797744992523,2cyclictest48630-21kworker/u16:1+events_unbound23:13:186
3797744992523,2cyclictest48630-21kworker/u16:1+events_unbound22:58:156
3797744992523,2cyclictest4006004-21kworker/u16:0+events_unbound21:42:106
3797744992523,2cyclictest4006004-21kworker/u16:0+events_unbound21:42:106
3797744992523,2cyclictest4006004-21kworker/u16:0+events_unbound21:06:486
3797744992523,2cyclictest3889316-21kworker/u16:4+events_unbound20:19:486
3797744992523,2cyclictest3860971-21kworker/u16:2+events_unbound20:15:166
3797744992523,2cyclictest121754-21kworker/u16:2+flush-8:023:30:156
3797744992523,2cyclictest121754-21kworker/u16:2+events_unbound23:39:106
3797744992523,2cyclictest121754-21kworker/u16:2+events_unbound00:06:266
3797734992523,2cyclictest3880216-21kworker/u16:0+flush-8:019:54:344
3797744992422,2cyclictest4144554-21kworker/u16:5+events_unbound22:07:156
3797744992422,2cyclictest4007275-21kworker/u16:3+events_unbound21:13:246
3797744992422,2cyclictest3947496-21kworker/u16:1+events_unbound20:35:376
3797744992422,2cyclictest3798232-21kworker/u16:1+events_unbound19:29:526
3797744992421,2cyclictest4006004-21kworker/u16:0+events_unbound21:34:276
3797734992422,2cyclictest4006004-21kworker/u16:0+events_unbound21:19:424
3797744992321,2cyclictest4193635-21kworker/u16:1+flush-8:022:20:066
3797744992321,2cyclictest4193635-21kworker/u16:1+flush-8:022:20:066
3797744992321,2cyclictest4132417-21kworker/u16:2+events_unbound22:14:156
3797744992321,2cyclictest4116996-21kworker/u16:4+events_unbound21:48:026
3797744992321,2cyclictest4072716-21kworker/u16:2+events_unbound21:28:436
3797744992321,2cyclictest4006004-21kworker/u16:0+events_unbound21:18:236
3797734992321,2cyclictest4006004-21kworker/u16:0+events_unbound20:54:234
3797734992321,2cyclictest3860971-21kworker/u16:2+events_unbound20:18:044
3797734992321,2cyclictest3798232-21kworker/u16:1+events_unbound19:10:174
3797734992320,2cyclictest48630-21kworker/u16:1+events_unbound23:24:304
3797744992220,2cyclictest3889316-21kworker/u16:4+events_unbound20:42:536
3797744992220,2cyclictest3880216-21kworker/u16:0+events_unbound19:57:216
3797744992220,2cyclictest3100680-21kworker/u16:0+flush-8:019:09:456
3797734992220,2cyclictest4006004-21kworker/u16:0+events_unbound22:59:514
3797734992220,2cyclictest4006004-21kworker/u16:0+events_unbound22:59:514
3797734992220,2cyclictest4006004-21kworker/u16:0+events_unbound21:02:124
3797734992220,2cyclictest121754-21kworker/u16:2+flush-8:023:14:134
3797745992116,4cyclictest4005625-21latency_hist20:54:187
3797744992119,2cyclictest3889316-21kworker/u16:4+events_unbound20:45:126
3797744992119,2cyclictest3128538-21kworker/u16:4+events_unbound19:17:536
3797739992117,3cyclictest3798232-21kworker/u16:1+events_unbound19:14:205
3797734992119,2cyclictest58504-21kworker/u16:4+events_unbound22:39:374
3797734992119,2cyclictest3860971-21kworker/u16:2+flush-8:021:09:334
3797734992119,2cyclictest3798232-21kworker/u16:1+events_unbound19:21:084
3797745992014,5cyclictest3879204-21latency_hist19:49:197
3797744992018,2cyclictest4132417-21kworker/u16:2+events_unbound22:29:576
3797744992018,2cyclictest3840394-21kworker/u16:3+events_unbound19:47:376
3797739992018,2cyclictest194772-21kworker/u16:3+flush-8:000:10:225
3797739992017,3cyclictest48630-21kworker/u16:1+flush-8:023:04:435
3797734992018,2cyclictest4116996-21kworker/u16:4+events_unbound21:40:194
3797734992018,2cyclictest4116996-21kworker/u16:4+events_unbound21:40:194
3797734992018,2cyclictest3907640-21kworker/u16:5+events_unbound20:20:444
3797734992018,2cyclictest3860971-21kworker/u16:2+events_unbound19:50:524
3797734992018,2cyclictest3100680-21kworker/u16:0+events_unbound19:16:324
3797734992018,2cyclictest267888-21kworker/u16:0+flush-8:000:14:444
3797745991913,5cyclictest4168857-21latency_hist22:04:187
3797744991917,2cyclictest4072716-21kworker/u16:2+events_unbound21:31:396
3797734991917,2cyclictest4006004-21kworker/u16:0+events_unbound22:35:144
3797734991917,2cyclictest3798232-21kworker/u16:1+events_unbound19:36:054
3797734991917,2cyclictest194772-21kworker/u16:3+flush-8:023:59:444
379774599180,17cyclictest0-21swapper/722:19:427
379774599180,17cyclictest0-21swapper/722:19:427
379774599180,16cyclictest0-21swapper/719:54:427
3797734991816,2cyclictest3907640-21kworker/u16:5+events_unbound20:07:434
3797734991816,2cyclictest3889316-21kworker/u16:4+flush-8:020:30:044
3797734991816,2cyclictest3860971-21kworker/u16:2+events_unbound20:12:084
3797734991816,2cyclictest3840308-21kworker/u16:0+events_unbound19:33:354
3797734991816,2cyclictest194772-21kworker/u16:3+events_unbound00:33:514
3797734991815,2cyclictest3840394-21kworker/u16:3+events_unbound19:44:314
3797745991716,0cyclictest0-21swapper/723:14:337
3797745991716,0cyclictest0-21swapper/723:04:437
3797745991714,2cyclictest1277-21snmpd20:55:327
3797745991714,2cyclictest1277-21snmpd20:32:057
379774599170,15cyclictest8920-21ssh22:14:427
3797734991715,2cyclictest4116996-21kworker/u16:4+events_unbound21:44:334
3797734991715,2cyclictest4006004-21kworker/u16:0+events_unbound22:14:294
3797734991715,2cyclictest3947496-21kworker/u16:1+events_unbound20:28:394
3797734991715,2cyclictest3889316-21kworker/u16:4+events_unbound20:35:044
3797734991715,2cyclictest121754-21kworker/u16:2+events_unbound23:44:564
3797734991715,2cyclictest121754-21kworker/u16:2+events_unbound00:04:544
3797734991713,3cyclictest4007275-21kworker/u16:3+flush-8:021:14:444
3797745991612,3cyclictest1277-21snmpd20:02:077
3797745991611,4cyclictest4181066-21latency_hist22:09:197
379774599160,14cyclictest1277-21snmpd20:21:047
3797739991614,2cyclictest4132417-21kworker/u16:2+flush-8:022:30:195
379773999160,15cyclictest0-21swapper/520:24:385
3797734991614,2cyclictest4006004-21kworker/u16:0+flush-8:022:04:364
3797734991614,2cyclictest4006004-21kworker/u16:0+events_unbound21:29:574
3797734991614,2cyclictest3947496-21kworker/u16:1+events_unbound20:41:474
3797734991614,2cyclictest3889316-21kworker/u16:4+events_unbound20:51:234
3797745991512,2cyclictest1277-21snmpd23:01:157
3797745991512,2cyclictest1277-21snmpd23:01:157
379774599150,2cyclictest4129146-21ssh21:44:417
379774599150,13cyclictest0-21swapper/720:39:447
379773999150,14cyclictest3883182-21kthreadcore19:49:385
379773999150,14cyclictest0-21swapper/500:14:385
3797734991513,2cyclictest121754-21kworker/u16:2+events_unbound00:09:334
3797734991512,2cyclictest4006004-21kworker/u16:0+flush-8:022:49:294
3797734991512,2cyclictest146199-21kworker/u16:3+events_unbound23:14:274
379774599149,4cyclictest194731-21latency_hist23:34:187
3797745991413,0cyclictest0-21swapper/723:24:447
3797745991412,1cyclictest0-21swapper/719:29:417
3797745991410,3cyclictest1277-21snmpd23:14:097
3797745991410,3cyclictest1277-21snmpd20:47:597
379774599140,1cyclictest0-21swapper/721:39:437
379774599140,1cyclictest0-21swapper/721:39:437
3797739991413,1cyclictest0-21swapper/522:36:445
3797739991413,1cyclictest0-21swapper/500:07:335
3797739991411,2cyclictest207583-21cpuspeed_turbos23:39:295
379773999140,1cyclictest0-21swapper/523:46:355
379773999140,1cyclictest0-21swapper/523:20:435
379773999140,14cyclictest0-21swapper/522:21:275
379773999140,14cyclictest0-21swapper/522:21:275
379773999140,14cyclictest0-21swapper/521:27:325
379773999140,14cyclictest0-21swapper/500:30:435
3797734991412,2cyclictest4132417-21kworker/u16:2+events_unbound22:30:094
3797734991412,2cyclictest4132417-21kworker/u16:2+events_unbound22:19:514
3797734991412,2cyclictest4132417-21kworker/u16:2+events_unbound22:19:514
3797734991412,2cyclictest4116996-21kworker/u16:4+events_unbound21:49:244
3797734991412,2cyclictest3798232-21kworker/u16:1+events_unbound19:59:404
379774599138,3cyclictest1277-21snmpd20:17:557
379774599137,5cyclictest648-21systemd-journal19:14:197
379774599137,5cyclictest3976511-21latency_hist20:39:197
379774599137,5cyclictest243491-21latency_hist23:54:187
379774599137,4cyclictest1277-21snmpd23:54:407
379774599130,2cyclictest107612-21sh22:55:447
379774599130,1cyclictest0-21swapper/719:24:447
379774599130,11cyclictest1277-21snmpd21:19:307
379773999139,3cyclictest3929071-21cat20:14:345
3797739991312,1cyclictest0-21swapper/522:49:595
3797739991312,1cyclictest0-21swapper/522:40:225
3797739991312,1cyclictest0-21swapper/521:59:135
3797739991312,1cyclictest0-21swapper/521:34:475
3797739991312,1cyclictest0-21swapper/500:29:095
3797739991312,1cyclictest0-21swapper/500:29:095
379773999130,1cyclictest0-21swapper/521:51:305
379773999130,13cyclictest0-21swapper/521:10:115
379773999130,13cyclictest0-21swapper/520:39:365
379773999130,12cyclictest0-21swapper/519:13:325
379773999130,0cyclictest0-21swapper/522:17:495
3797734991312,1cyclictest0-21swapper/422:27:474
3797734991312,1cyclictest0-21swapper/422:10:084
3797734991311,2cyclictest4007275-21kworker/u16:3+events_unbound21:38:004
3797734991311,2cyclictest4006004-21kworker/u16:0+events_unbound22:57:444
3797734991311,2cyclictest219182-21kworker/u16:5+events_unbound23:55:174
3797734991311,2cyclictest168068-21kworker/u16:4+events_unbound23:21:054
3797734991311,1cyclictest0-21swapper/422:44:394
3797734991310,2cyclictest4132417-21kworker/u16:2+flush-8:021:59:284
379773499130,13cyclictest0-21swapper/423:30:044
379774599129,2cyclictest1277-21snmpd22:32:207
379774599129,2cyclictest1277-21snmpd21:27:007
379774599129,2cyclictest1277-21snmpd21:00:387
379774599128,3cyclictest1277-21snmpd23:39:377
379774599128,3cyclictest1277-21snmpd22:47:577
379774599128,3cyclictest1277-21snmpd19:43:467
379774599127,4cyclictest5611-21ssh-agent21:29:357
379774599127,4cyclictest1277-21snmpd19:49:407
379774599126,5cyclictest6175-21gvfs-afc-volume00:09:467
3797745991210,1cyclictest0-21swapper/722:39:437
379774599120,1cyclictest0-21swapper/700:24:467
379774599120,1cyclictest0-21swapper/700:24:467
379774599120,11cyclictest4155885-21ssh21:57:527
379774599120,11cyclictest351949-21ssh00:36:567
379774599120,11cyclictest168243-21ssh23:20:167
379774599120,11cyclictest1277-21snmpd21:08:577
379773999126,6cyclictest0-21swapper/520:09:345
3797739991211,1cyclictest0-21swapper/523:31:555
3797739991211,1cyclictest0-21swapper/522:56:465
3797739991211,1cyclictest0-21swapper/522:09:475
3797739991211,1cyclictest0-21swapper/521:23:545
3797739991211,1cyclictest0-21swapper/520:32:315
379773999120,1cyclictest0-21swapper/519:39:515
379773999120,12cyclictest0-21swapper/523:26:435
379773999120,0cyclictest0-21swapper/521:46:365
3797734991211,1cyclictest0-21swapper/421:58:004
3797734991211,1cyclictest0-21swapper/400:21:184
3797734991210,2cyclictest48630-21kworker/u16:1+events_unbound23:52:294
379774599119,1cyclictest0-21swapper/700:29:467
379774599118,2cyclictest0-21swapper/720:04:417
379774599118,2cyclictest0-21swapper/700:19:187
379774599117,3cyclictest1277-21snmpd19:15:247
3797745991110,0cyclictest0-21swapper/719:34:297
3797745991110,0cyclictest0-21swapper/719:22:217
379774599110,1cyclictest4045176-21ssh21:10:557
379774599110,1cyclictest0-21swapper/723:59:337
379774599110,1cyclictest0-21swapper/721:18:467
379774599110,10cyclictest58867-21ssh22:35:447
379774599110,10cyclictest1277-21snmpd20:28:147
3797739991110,1cyclictest0-21swapper/521:41:435
3797739991110,1cyclictest0-21swapper/521:41:435
3797739991110,1cyclictest0-21swapper/521:16:395
3797739991110,1cyclictest0-21swapper/520:55:035
3797739991110,1cyclictest0-21swapper/520:01:465
3797739991110,1cyclictest0-21swapper/500:34:405
379773999110,11cyclictest0-21swapper/520:37:155
379773999110,11cyclictest0-21swapper/520:19:545
379773999110,0cyclictest0-21swapper/519:37:305
379773499119,2cyclictest4006004-21kworker/u16:0+flush-8:023:05:024
379774599105,4cyclictest95220-21rm22:50:217
379774599105,4cyclictest6175-21gvfs-afc-volume21:49:357
379774599100,9cyclictest0-21swapper/700:07:327
379774599100,1cyclictest0-21swapper/721:34:567
379773999109,1cyclictest0-21swapper/521:30:225
379773999109,1cyclictest0-21swapper/519:48:515
379773999109,1cyclictest0-21swapper/519:20:385
379773499108,2cyclictest194772-21kworker/u16:3+events_unbound00:27:554
379773499108,2cyclictest194772-21kworker/u16:3+events_unbound00:27:554
379773499106,3cyclictest338876-21kworker/u16:1+flush-8:000:34:384
37977399998,1cyclictest0-21swapper/523:03:325
37977399998,1cyclictest0-21swapper/523:03:325
37977399998,1cyclictest0-21swapper/522:01:165
37977399995,3cyclictest257001-21cat23:59:345
37977399992,4cyclictest195271-21cat23:34:295
37977399991,5cyclictest4170413-21sed22:04:345
37977399990,8cyclictest83124-21chrt22:45:315
37977349997,2cyclictest121754-21kworker/u16:2+events_unbound23:34:344
37977399986,1cyclictest232647-21/usr/sbin/munin23:49:345
37977399986,1cyclictest0-21swapper/523:09:395
37977399986,1cyclictest0-21swapper/519:24:315
37977399984,3cyclictest3992618-21kthreadcore20:44:375
37977399984,3cyclictest147348-21cat23:14:335
37977399983,4cyclictest244982-21irqcore23:54:345
37977399980,7cyclictest0-21swapper/519:29:385
37977399975,1cyclictest0-21swapper/520:49:335
37977399975,1cyclictest0-21swapper/500:19:315
37977399973,3cyclictest4026515-21sed21:04:375
37977399973,3cyclictest4017462-21cut20:59:355
37977399973,3cyclictest3890101-21cat19:54:345
37977399972,4cyclictest3909401-21fschecks_count20:04:325
37977399972,4cyclictest31385-21grep22:24:385
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional