You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 10:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Thu Mar 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134286821010,1sleep71342866-21cut23:38:497
11582332720,1sleep71158231-21ssh22:19:157
73562325848,7sleep50-21swapper/519:01:375
73557525546,6sleep40-21swapper/419:00:564
736053995452,2cyclictest1087620-21kworker/u16:1+flush-8:023:24:024
736053995249,2cyclictest1087620-21kworker/u16:1+events_unbound22:59:044
8646262500,0sleep7864627-21expr20:08:457
736055994947,2cyclictest1220984-21kworker/u16:3+events_unbound23:38:585
736055994947,2cyclictest1185788-21kworker/u16:2+events_unbound23:04:055
736053994946,2cyclictest1087620-21kworker/u16:1+events_unbound21:53:324
736055994745,2cyclictest1400100-21kworker/u16:4+events_unbound00:09:025
736053994745,2cyclictest1278138-21kworker/u16:0+events_unbound23:13:504
736053994744,2cyclictest1185788-21kworker/u16:2+flush-8:022:53:584
736053994744,2cyclictest1087620-21kworker/u16:1+events_unbound00:23:464
73555024737,7sleep60-21swapper/619:00:346
736053994644,2cyclictest989929-21kworker/u16:1+events_unbound21:13:484
736053994644,2cyclictest1087620-21kworker/u16:1+events_unbound00:29:064
736053994643,2cyclictest735817-21kworker/u16:2+flush-8:019:18:484
736056994542,2cyclictest825673-21kworker/u16:2+flush-8:021:04:086
736053994542,2cyclictest854244-21kworker/u16:1+events_unbound20:38:474
736055994442,2cyclictest1087620-21kworker/u16:1+events_unbound23:16:035
736053994341,2cyclictest1220984-21kworker/u16:3+events_unbound23:58:434
736053994340,2cyclictest989929-21kworker/u16:1+events_unbound21:28:474
736055994240,2cyclictest1185788-21kworker/u16:2+events_unbound22:43:585
736053994240,2cyclictest1184894-21kworker/u16:0+events_unbound22:43:324
736053994240,2cyclictest1184894-21kworker/u16:0+events_unbound22:43:324
736053994240,2cyclictest1089037-21kworker/u16:5+events_unbound22:23:484
736053994240,2cyclictest1089037-21kworker/u16:5+events_unbound22:18:554
736053994240,2cyclictest1089037-21kworker/u16:5+events_unbound22:14:064
736053994239,2cyclictest1087620-21kworker/u16:1+events_unbound22:43:464
7357482422,36sleep70-21swapper/719:03:247
736055994139,2cyclictest969310-21kworker/u16:4+events_unbound21:21:595
736055994139,2cyclictest969310-21kworker/u16:4+events_unbound21:21:595
736055994139,2cyclictest1278138-21kworker/u16:0+events_unbound23:45:395
736055994139,2cyclictest1278138-21kworker/u16:0+events_unbound00:26:065
736055994139,2cyclictest1278138-21kworker/u16:0+events_unbound00:22:225
736055994139,2cyclictest1087663-21kworker/u16:4+events_unbound22:31:025
736053994139,2cyclictest825673-21kworker/u16:2+flush-8:020:58:584
736055994038,2cyclictest969310-21kworker/u16:4+flush-8:021:03:585
736055994038,2cyclictest735817-21kworker/u16:2+flush-8:019:08:565
736055994038,2cyclictest735817-21kworker/u16:2+flush-8:019:08:565
736055994038,2cyclictest1087663-21kworker/u16:4+events_unbound22:06:115
736053994038,2cyclictest1087620-21kworker/u16:1+flush-8:023:53:474
736053994038,2cyclictest1062418-21kworker/u16:2+flush-8:021:43:564
736053994037,2cyclictest989929-21kworker/u16:1+flush-8:021:18:484
736053994037,2cyclictest989929-21kworker/u16:1+flush-8:021:18:484
736053994037,2cyclictest1185788-21kworker/u16:2+events_unbound23:03:464
8733862390,0chrt0-21swapper/620:13:336
736055993937,2cyclictest989929-21kworker/u16:1+events_unbound21:18:105
736055993937,2cyclictest930646-21kworker/u16:0+events_unbound21:41:355
736055993937,2cyclictest825673-21kworker/u16:2+flush-8:020:04:005
736055993937,2cyclictest777992-21kworker/u16:3+flush-8:019:54:015
736055993937,2cyclictest777992-21kworker/u16:3+flush-8:019:54:015
736055993937,2cyclictest777992-21kworker/u16:3+events_unbound20:23:465
736055993937,2cyclictest1400100-21kworker/u16:4+events_unbound00:17:345
736055993937,2cyclictest1278138-21kworker/u16:0+events_unbound23:11:195
736055993937,2cyclictest1185788-21kworker/u16:2+flush-8:022:59:075
736055993937,2cyclictest1087620-21kworker/u16:1+events_unbound22:08:495
736055993937,2cyclictest1062418-21kworker/u16:2+flush-8:021:48:585
736055993937,2cyclictest1062418-21kworker/u16:2+flush-8:021:44:015
736055993937,2cyclictest1050381-21kworker/u16:3+events_unbound21:36:115
736060993834,3cyclictest1400016-21updatedb00:03:317
736055993836,2cyclictest930646-21kworker/u16:0+events_unbound21:26:545
736055993836,2cyclictest1184894-21kworker/u16:0+events_unbound22:34:565
736055993836,2cyclictest1087620-21kworker/u16:1+events_unbound23:37:585
736055993836,2cyclictest1087620-21kworker/u16:1+events_unbound22:56:595
736055993836,2cyclictest1087620-21kworker/u16:1+events_unbound22:49:385
736053993837,1cyclictest1220984-21kworker/u16:3+events_unbound23:12:304
736053993836,2cyclictest806490-21kworker/u16:1+events_unbound19:43:474
736053993835,2cyclictest1400100-21kworker/u16:4+events_unbound00:08:434
736055993735,2cyclictest1087620-21kworker/u16:1+flush-8:023:23:595
736055993734,2cyclictest1089037-21kworker/u16:5+flush-8:022:03:325
736055993734,2cyclictest1089037-21kworker/u16:5+flush-8:022:03:325
736053993735,2cyclictest989929-21kworker/u16:1+events_unbound21:38:514
736053993735,2cyclictest825673-21kworker/u16:2+flush-8:020:08:274
736055993634,2cyclictest989929-21kworker/u16:1+events_unbound21:29:545
736055993634,2cyclictest930646-21kworker/u16:0+events_unbound21:12:245
736055993634,2cyclictest854244-21kworker/u16:1+flush-8:020:33:575
736055993634,2cyclictest1087620-21kworker/u16:1+flush-8:000:28:535
736055993634,2cyclictest1087620-21kworker/u16:1+events_unbound21:55:105
736053993634,2cyclictest1278138-21kworker/u16:0+events_unbound00:07:234
736053993633,2cyclictest760382-21kworker/u16:1+flush-8:019:23:594
736055993533,2cyclictest1087620-21kworker/u16:1+events_unbound23:54:275
736055993533,2cyclictest1087620-21kworker/u16:1+events_unbound22:22:225
736060993429,4cyclictest1076638-21latency_hist21:48:337
736055993432,2cyclictest959013-21kworker/u16:3+events_unbound20:57:025
736055993432,2cyclictest854244-21kworker/u16:1+events_unbound20:08:535
736055993432,2cyclictest777992-21kworker/u16:3+events_unbound19:58:575
736055993432,2cyclictest1278138-21kworker/u16:0+events_unbound00:05:275
736055993432,2cyclictest1087620-21kworker/u16:1+events_unbound23:19:125
736055993432,2cyclictest1087620-21kworker/u16:1+events_unbound22:15:145
736055993431,2cyclictest825673-21kworker/u16:2+events_unbound20:28:425
736053993432,2cyclictest825673-21kworker/u16:2+flush-8:020:18:554
736053993432,2cyclictest1087620-21kworker/u16:1+events_unbound22:51:394
736053993432,2cyclictest1087620-21kworker/u16:1+events_unbound21:54:104
736053993431,2cyclictest825673-21kworker/u16:2+flush-8:020:33:474
736056993331,2cyclictest930646-21kworker/u16:0+flush-8:021:43:586
736055993331,2cyclictest777992-21kworker/u16:3+flush-8:019:43:565
736055993331,2cyclictest1278138-21kworker/u16:0+events_unbound00:01:585
736055993331,2cyclictest1220984-21kworker/u16:3+events_unbound23:49:125
736053993331,2cyclictest1278138-21kworker/u16:0+events_unbound23:38:554
736053993331,2cyclictest1087663-21kworker/u16:4+events_unbound21:59:074
736053993331,2cyclictest1087663-21kworker/u16:4+events_unbound21:59:074
736053993330,2cyclictest854244-21kworker/u16:1+flush-8:020:43:474
736055993230,2cyclictest1087620-21kworker/u16:1+flush-8:023:29:035
736055993230,2cyclictest1087620-21kworker/u16:1+events_unbound22:42:065
736055993230,2cyclictest1087620-21kworker/u16:1+events_unbound22:42:065
736055993229,2cyclictest1089037-21kworker/u16:5+flush-8:022:23:565
736053993229,2cyclictest777992-21kworker/u16:3+flush-8:019:53:514
736053993229,2cyclictest777992-21kworker/u16:3+flush-8:019:53:514
736053993229,2cyclictest1220984-21kworker/u16:3+events_unbound23:18:454
736053993229,2cyclictest1087620-21kworker/u16:1+events_unbound22:08:354
736055993129,2cyclictest717097-21kworker/u16:0+flush-8:019:13:435
736053993129,2cyclictest959013-21kworker/u16:3+events_unbound20:58:324
736053993129,2cyclictest1278138-21kworker/u16:0+events_unbound00:18:234
736053993129,2cyclictest1220984-21kworker/u16:3+flush-8:023:34:004
736053993129,2cyclictest1087663-21kworker/u16:4+events_unbound22:04:064
73606099300,28cyclictest1400016-21updatedb00:03:347
736055993028,2cyclictest825673-21kworker/u16:2+events_unbound21:00:115
736053993028,2cyclictest1220984-21kworker/u16:3+events_unbound23:51:194
736053993028,2cyclictest1050381-21kworker/u16:3+events_unbound21:34:394
736053993027,2cyclictest717097-21kworker/u16:0+events_unbound19:14:434
11234882300,1chrt1123489-21sh22:06:257
736055992926,2cyclictest854244-21kworker/u16:1+events_unbound20:43:465
736053992927,2cyclictest969310-21kworker/u16:4+flush-8:021:04:104
736053992927,2cyclictest969310-21kworker/u16:4+events_unbound21:13:114
736053992927,2cyclictest735817-21kworker/u16:2+events_unbound19:33:334
736053992927,2cyclictest1400100-21kworker/u16:4+events_unbound00:19:554
736053992927,2cyclictest1278138-21kworker/u16:0+events_unbound23:45:104
736053992927,2cyclictest1185788-21kworker/u16:2+events_unbound22:34:434
8009712280,1chrt800972-21kthreadcore19:33:517
736055992826,2cyclictest854244-21kworker/u16:1+events_unbound20:14:025
736053992826,2cyclictest989929-21kworker/u16:1+events_unbound21:24:144
736053992826,2cyclictest1087620-21kworker/u16:1+flush-8:023:29:304
736055992725,2cyclictest777992-21kworker/u16:3+events_unbound19:28:595
736053992724,2cyclictest854244-21kworker/u16:1+events_unbound20:09:034
736055992624,2cyclictest825673-21kworker/u16:2+flush-8:019:48:485
736055992624,2cyclictest825673-21kworker/u16:2+events_unbound20:43:115
736055992624,2cyclictest806490-21kworker/u16:1+events_unbound19:38:125
736053992624,2cyclictest735817-21kworker/u16:2+flush-8:019:08:334
736053992624,2cyclictest735817-21kworker/u16:2+flush-8:019:08:334
736053992624,2cyclictest1087663-21kworker/u16:4+events_unbound22:30:364
12329322260,1sleep686-21ksoftirqd/622:53:366
11363422260,1chrt1136343-21ssh22:13:147
736060992516,3cyclictest1088650-21latency_hist21:53:327
736056992522,2cyclictest1278138-21kworker/u16:0+flush-8:023:38:536
736055992523,2cyclictest854244-21kworker/u16:1+events_unbound20:51:305
736055992523,2cyclictest777992-21kworker/u16:3+events_unbound19:41:125
736055992422,2cyclictest735817-21kworker/u16:2+events_unbound19:26:525
736055992422,2cyclictest735817-21kworker/u16:2+events_unbound19:04:125
736053992421,2cyclictest777992-21kworker/u16:3+events_unbound20:28:474
736056992320,2cyclictest777992-21kworker/u16:3+flush-8:019:38:596
736055992321,2cyclictest854244-21kworker/u16:1+events_unbound20:21:125
736056992219,2cyclictest1087663-21kworker/u16:4+flush-8:022:13:276
736055992220,2cyclictest735817-21kworker/u16:2+events_unbound19:21:165
736060992116,4cyclictest650-21systemd-journal19:08:327
736053992118,2cyclictest825673-21kworker/u16:2+events_unbound20:23:524
736060991913,5cyclictest980797-21latency_hist21:08:337
736060991911,7cyclictest0-21swapper/722:53:327
736060991811,6cyclictest0-21swapper/723:03:577
736056991816,2cyclictest1087620-21kworker/u16:1+flush-8:023:58:276
736053991715,2cyclictest777992-21kworker/u16:3+flush-8:019:58:504
736060991613,2cyclictest1267-21snmpd22:14:217
736060991612,3cyclictest1267-21snmpd21:10:197
736060991611,4cyclictest0-21swapper/719:53:597
736060991611,4cyclictest0-21swapper/719:53:597
736053991614,2cyclictest777992-21kworker/u16:3+events_unbound19:38:534
736053991613,2cyclictest825673-21kworker/u16:2+events_unbound20:13:454
73606099159,5cyclictest863852-21latency_hist20:08:337
73606099159,5cyclictest1267-21snmpd19:48:507
73606099156,8cyclictest0-21swapper/723:26:117
73606099156,8cyclictest0-21swapper/722:56:037
73606099155,9cyclictest0-21swapper/722:25:237
73606099154,9cyclictest0-21swapper/723:20:187
73606099154,10cyclictest1440709-21kthreadcore00:18:517
73606099154,10cyclictest1433559-21users00:14:047
73606099154,10cyclictest1325385-21taskset23:29:037
73606099154,10cyclictest0-21swapper/723:56:247
73606099152,6cyclictest6045-21gmain23:16:267
736060991510,4cyclictest0-21swapper/719:38:587
736060991510,4cyclictest0-21swapper/719:13:337
73606099149,4cyclictest994019-21cat21:13:487
73606099149,4cyclictest0-21swapper/722:28:447
73606099149,4cyclictest0-21swapper/720:48:557
73606099147,6cyclictest96-21ksoftirqd/721:28:447
73606099147,6cyclictest0-21swapper/723:09:047
73606099145,8cyclictest0-21swapper/723:53:027
73606099145,8cyclictest0-21swapper/722:59:087
73606099145,8cyclictest0-21swapper/722:44:347
73606099145,8cyclictest0-21swapper/722:41:137
73606099145,8cyclictest0-21swapper/722:41:137
73606099145,8cyclictest0-21swapper/721:53:457
73606099145,8cyclictest0-21swapper/721:40:027
73606099145,8cyclictest0-21swapper/700:29:547
73606099145,8cyclictest0-21swapper/700:27:007
73606099144,9cyclictest0-21swapper/721:35:567
73606099143,10cyclictest1413332-21ssh00:08:477
736060991412,1cyclictest0-21swapper/720:23:507
736060991411,2cyclictest1267-21snmpd19:58:597
73606099141,11cyclictest796001-21ntpq19:28:567
73606099140,2cyclictest1193461-21ntpq22:33:597
73606099140,2cyclictest1109759-21awk21:59:027
73606099140,2cyclictest1109759-21awk21:59:027
73606099140,2cyclictest0-21swapper/723:36:037
736056991413,1cyclictest1089037-21kworker/u16:5+flush-8:022:18:276
736056991413,1cyclictest0-21swapper/623:24:216
736056991413,1cyclictest0-21swapper/623:08:076
736056991413,1cyclictest0-21swapper/622:26:486
736056991413,1cyclictest0-21swapper/621:28:196
73605699140,1cyclictest0-21swapper/623:59:216
73605699140,0cyclictest0-21swapper/600:09:556
736053991411,2cyclictest854244-21kworker/u16:1+flush-8:020:48:584
73606099138,4cyclictest962223-21grep20:58:517
73606099138,4cyclictest0-21swapper/720:33:557
73606099138,4cyclictest0-21swapper/720:28:477
73606099136,6cyclictest921593-21cut20:38:437
73606099135,7cyclictest883030-21date20:18:337
73606099134,8cyclictest0-21swapper/721:19:107
73606099134,8cyclictest0-21swapper/721:19:107
73606099133,9cyclictest1353863-21kthreadcore23:43:517
73606099130,4cyclictest769946-21kthreadcore19:18:507
73606099130,3cyclictest1019598-21cut21:23:517
73606099130,2cyclictest818343-21cat19:43:507
73606099130,1cyclictest0-21swapper/719:08:347
73606099130,1cyclictest0-21swapper/719:08:347
73606099130,11cyclictest932071-21sed20:43:497
736056991312,1cyclictest0-21swapper/623:51:006
736056991312,1cyclictest0-21swapper/622:52:116
736056991312,1cyclictest0-21swapper/622:42:256
736056991312,1cyclictest0-21swapper/622:42:256
736056991312,1cyclictest0-21swapper/622:03:476
736056991312,1cyclictest0-21swapper/620:59:006
736056991312,1cyclictest0-21swapper/619:25:116
73605699130,1cyclictest0-21swapper/620:42:266
73605699130,13cyclictest0-21swapper/623:30:306
73605699130,13cyclictest0-21swapper/622:19:056
73605699130,13cyclictest0-21swapper/600:07:526
73605699130,0cyclictest0-21swapper/620:28:536
73605699130,0cyclictest0-21swapper/619:43:576
736053991310,2cyclictest735817-21kworker/u16:2+flush-8:019:33:394
73606099125,6cyclictest892186-21sshd-session20:20:107
73606099120,4cyclictest781650-21grep19:23:517
736056991211,1cyclictest0-21swapper/623:38:326
736056991211,1cyclictest0-21swapper/621:41:156
736056991211,1cyclictest0-21swapper/620:02:246
736056991211,1cyclictest0-21swapper/619:20:376
73606099113,6cyclictest950938-21awk20:53:487
73605699119,2cyclictest825673-21kworker/u16:2+flush-8:020:44:036
736056991110,1cyclictest0-21swapper/622:44:186
736056991110,1cyclictest0-21swapper/622:34:326
736056991110,1cyclictest0-21swapper/622:00:006
736056991110,1cyclictest0-21swapper/622:00:006
736056991110,1cyclictest0-21swapper/621:13:116
736056991110,1cyclictest0-21swapper/620:26:406
736056991110,1cyclictest0-21swapper/620:22:166
736056991110,1cyclictest0-21swapper/619:16:036
73605699110,11cyclictest0-21swapper/619:55:376
73605699110,11cyclictest0-21swapper/619:55:376
73605699110,11cyclictest0-21swapper/619:48:416
73605399110,1cyclictest0-21swapper/419:50:084
73605699109,1cyclictest0-21swapper/622:32:386
73605699109,1cyclictest0-21swapper/620:15:386
73605699109,1cyclictest0-21swapper/619:09:066
73605699109,1cyclictest0-21swapper/619:09:066
73605699109,1cyclictest0-21swapper/600:30:246
73605699109,1cyclictest0-21swapper/600:24:156
73605699108,2cyclictest0-21swapper/619:29:466
7360569998,1cyclictest0-21swapper/623:01:586
7360569998,1cyclictest0-21swapper/621:17:076
7360569998,1cyclictest0-21swapper/620:56:576
7360569998,1cyclictest0-21swapper/620:52:516
7360569996,2cyclictest1400100-21kworker/u16:4+flush-8:000:18:386
7360539995,3cyclictest736984-21tune2fs19:03:454
7360569987,1cyclictest0-21swapper/623:20:156
7360569987,1cyclictest0-21swapper/621:31:576
7360569987,1cyclictest0-21swapper/621:22:486
7360569987,1cyclictest0-21swapper/621:22:486
7360569987,1cyclictest0-21swapper/620:37:526
7360569987,1cyclictest0-21swapper/600:14:016
7360569976,1cyclictest0-21swapper/623:14:066
7360569976,1cyclictest0-21swapper/619:36:516
7360569975,2cyclictest1087663-21kworker/u16:4+flush-8:021:53:546
7360569973,1cyclictest681rcuog/423:48:326
7360569971,1cyclictest0-21swapper/621:53:006
7360569970,6cyclictest739385-21cut19:03:486
7360569965,1cyclictest0-21swapper/620:06:496
7360569961,2cyclictest0-21swapper/621:34:516
7360569952,2cyclictest12688752sleep623:08:366
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional