You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 08:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Mon Jan 12, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113763727463,8sleep40-21swapper/419:03:394
11365232562,48sleep70-21swapper/719:03:267
1138244994540,4cyclictest1863162-21latency_hist00:27:597
113789824232,7sleep60-21swapper/619:07:186
18429642410,1sleep60-21swapper/600:18:186
1138244994034,5cyclictest1789910-21latency_hist23:57:587
1138240993936,2cyclictest1545894-21kworker/u16:2+flush-8:023:48:236
1138244993529,5cyclictest650-21systemd-journal23:52:587
1138235993533,2cyclictest1545894-21kworker/u16:2+events_unbound00:13:275
1138235993533,2cyclictest1545894-21kworker/u16:2+events_unbound00:13:275
113782123525,7sleep50-21swapper/519:06:135
1138235993432,2cyclictest1589900-21kworker/u16:3+flush-8:000:33:245
1138235993432,2cyclictest1319773-21kworker/u16:2+events_unbound21:12:355
17903682330,1chrt1790370-21sh23:58:077
1138244993328,4cyclictest1306790-21latency_hist20:32:597
1138235993331,2cyclictest1589900-21kworker/u16:3+events_unbound23:26:105
1138235993331,2cyclictest1544113-21kworker/u16:1+events_unbound23:13:065
1138235993331,2cyclictest1411416-21kworker/u16:3+events_unbound22:11:305
1138235993331,2cyclictest1119860-21kworker/u16:2+events_unbound19:14:095
1138235993230,2cyclictest1544113-21kworker/u16:1+flush-8:023:30:195
1138235993230,2cyclictest1460629-21kworker/u16:0+events_unbound22:23:265
1138235993130,1cyclictest1411416-21kworker/u16:3+events_unbound21:56:025
1138235993129,2cyclictest1589900-21kworker/u16:3+flush-8:000:28:155
1138235993129,2cyclictest1589900-21kworker/u16:3+events_unbound00:20:235
1138235993128,2cyclictest1161360-21kworker/u16:4+events_unbound19:18:145
1138235993028,2cyclictest1589900-21kworker/u16:3+events_unbound23:36:065
1138235993028,2cyclictest1589900-21kworker/u16:3+events_unbound23:36:065
1138235993028,2cyclictest1589900-21kworker/u16:3+events_unbound23:00:305
1138235993028,2cyclictest1545894-21kworker/u16:2+events_unbound23:40:315
1138235993028,2cyclictest1545894-21kworker/u16:2+events_unbound22:50:355
1138235993028,2cyclictest1545894-21kworker/u16:2+events_unbound00:26:295
1138235993028,2cyclictest1319773-21kworker/u16:2+flush-8:021:43:425
1138235993028,2cyclictest1319773-21kworker/u16:2+events_unbound20:46:205
1138235993028,2cyclictest1319773-21kworker/u16:2+events_unbound20:40:285
1138235993028,2cyclictest1248896-21kworker/u16:1+events_unbound20:16:325
1138235993028,2cyclictest1219593-21kworker/u16:4+events_unbound20:03:205
1138235993028,2cyclictest1219593-21kworker/u16:4+events_unbound19:55:535
12781732290,1chrt1278175-21cpuspeed_turbos20:18:097
1138235992927,2cyclictest3817920-21kworker/u16:1+events_unbound19:40:485
1138235992927,2cyclictest3817920-21kworker/u16:1+events_unbound19:24:215
1138235992927,2cyclictest1799158-21kworker/u16:4+events_unbound00:01:555
1138235992927,2cyclictest1589900-21kworker/u16:3+flush-8:023:10:315
1138235992927,2cyclictest1589900-21kworker/u16:3+events_unbound23:51:105
1138235992927,2cyclictest1589900-21kworker/u16:3+events_unbound00:05:505
1138235992927,2cyclictest1545894-21kworker/u16:2+events_unbound22:47:305
1138235992927,2cyclictest1545894-21kworker/u16:2+events_unbound22:39:065
1138235992927,2cyclictest1411416-21kworker/u16:3+flush-8:022:16:155
1138235992927,2cyclictest1355329-21kworker/u16:1+flush-8:021:13:275
1138235992927,2cyclictest1277788-21kworker/u16:3+events_unbound20:26:535
1138235992927,2cyclictest1258602-21kworker/u16:2+events_unbound20:12:335
1138235992927,2cyclictest1248896-21kworker/u16:1+events_unbound20:21:175
1138235992927,2cyclictest1199086-21kworker/u16:0+flush-8:019:48:325
1138235992826,2cyclictest1544113-21kworker/u16:1+events_unbound23:20:185
1138235992826,2cyclictest1544113-21kworker/u16:1+events_unbound22:36:145
1138235992826,2cyclictest1460629-21kworker/u16:0+events_unbound22:31:175
1138235992826,2cyclictest1355329-21kworker/u16:1+events_unbound21:35:115
1138235992826,2cyclictest1355329-21kworker/u16:1+events_unbound21:35:115
1138235992826,2cyclictest1291812-21kworker/u16:4+events_unbound20:34:275
1138235992826,2cyclictest1199086-21kworker/u16:0+events_unbound21:04:485
1138235992725,2cyclictest1545894-21kworker/u16:2+events_unbound22:22:235
1138235992725,2cyclictest1544113-21kworker/u16:1+events_unbound22:55:215
1138235992725,2cyclictest1544113-21kworker/u16:1+events_unbound22:55:215
1138235992725,2cyclictest1460629-21kworker/u16:0+events_unbound22:03:395
1138235992725,2cyclictest1319773-21kworker/u16:2+events_unbound21:30:385
1138235992725,2cyclictest1319773-21kworker/u16:2+events_unbound20:50:485
1138235992725,2cyclictest1219593-21kworker/u16:4+events_unbound20:01:295
1138235992725,2cyclictest1199086-21kworker/u16:0+events_unbound19:44:335
1138235992724,2cyclictest1460629-21kworker/u16:0+events_unbound21:58:115
1138244992620,5cyclictest1435741-21latency_hist21:32:587
1138235992624,2cyclictest1813489-21kworker/u16:0+flush-8:000:08:505
1138235992624,2cyclictest1411416-21kworker/u16:3+events_unbound21:49:195
1138235992624,2cyclictest1291812-21kworker/u16:4+events_unbound20:54:235
1138235992624,2cyclictest1291812-21kworker/u16:4+events_unbound20:54:235
1138235992624,2cyclictest1277788-21kworker/u16:3+events_unbound20:31:215
1138230992623,2cyclictest1291812-21kworker/u16:4+flush-8:021:13:524
17439642250,1sleep40-21swapper/423:38:174
1138235992523,2cyclictest1319773-21kworker/u16:2+events_unbound21:01:055
1138235992523,2cyclictest1199086-21kworker/u16:0+events_unbound19:34:295
1138235992522,2cyclictest3817920-21kworker/u16:1+flush-8:019:28:245
1138235992422,2cyclictest1544113-21kworker/u16:1+flush-8:023:46:015
1138235992422,2cyclictest1109076-21kworker/u16:3+events_unbound19:09:285
1138244992318,4cyclictest1716724-21latency_hist23:27:587
1138235992119,2cyclictest1355329-21kworker/u16:1+events_unbound21:38:175
1138244991919,0cyclictest0-21swapper/700:13:287
1138244991919,0cyclictest0-21swapper/700:13:287
1138244991914,4cyclictest1267-21snmpd19:54:037
1138244991913,5cyclictest1258219-21latency_hist20:07:587
113824499180,10cyclictest1447975-21ssh21:37:587
113824499180,10cyclictest1447975-21ssh21:37:587
113824499172,14cyclictest0-21swapper/700:09:157
1138244991713,3cyclictest1374708-21diskmemload22:36:517
1138244991712,4cyclictest1753317-21latency_hist23:42:587
1138230991714,3cyclictest0-21swapper/400:14:124
1138230991714,3cyclictest0-21swapper/400:14:124
113823099170,15cyclictest0-21swapper/420:38:224
113824499164,11cyclictest0-21swapper/721:18:487
1138244991613,2cyclictest1267-21snmpd21:44:267
1138244991612,3cyclictest1267-21snmpd20:26:517
1138244991611,4cyclictest1522643-21cat22:08:147
113824499160,15cyclictest1521340-21latency_hist22:07:587
1138240991614,2cyclictest1319773-21kworker/u16:2+flush-8:020:38:236
1138235991614,2cyclictest1544113-21kworker/u16:1+events_unbound23:04:085
1138235991614,2cyclictest1291812-21kworker/u16:4+flush-8:021:18:405
113824499158,6cyclictest0-21swapper/722:13:277
113824499156,8cyclictest0-21swapper/721:56:167
113824499154,10cyclictest1725893-21ntp_offset23:28:267
1138244991513,1cyclictest0-21swapper/721:08:187
1138244991513,1cyclictest0-21swapper/720:38:207
1138244991512,2cyclictest0-21swapper/723:17:597
113824499150,4cyclictest1354328-21ntpq20:53:257
113824499150,4cyclictest1354328-21ntpq20:53:257
113824099150,2cyclictest0-21swapper/621:51:576
113824499147,6cyclictest0-21swapper/722:17:587
113824499145,8cyclictest0-21swapper/721:26:387
113824499144,4cyclictest1879970-21cut00:33:187
1138244991411,2cyclictest1628233-21ntpq22:48:257
1138244991411,2cyclictest0-21swapper/722:23:277
1138244991411,2cyclictest0-21swapper/721:12:597
1138244991410,3cyclictest96-21ksoftirqd/720:33:137
113824099140,1cyclictest0-21swapper/622:35:006
113824099140,14cyclictest0-21swapper/621:44:336
1138235991412,2cyclictest1545894-21kworker/u16:2+events_unbound23:57:225
113823099145,8cyclictest0-21swapper/421:38:254
1138230991413,1cyclictest0-21swapper/423:43:284
1138230991413,1cyclictest0-21swapper/421:08:104
113823099140,14cyclictest0-21swapper/419:48:244
113824499139,3cyclictest1373778-21ntpq21:03:247
113824499139,3cyclictest1267-21snmpd20:52:017
113824499139,3cyclictest1220643-21cat19:48:147
113824499138,4cyclictest1805307-21grep00:03:177
113824499138,4cyclictest1473682-21cat21:48:117
113824499136,6cyclictest0-21swapper/723:01:057
113824499136,6cyclictest0-21swapper/722:38:327
113824499136,6cyclictest0-21swapper/721:58:037
113824499136,6cyclictest0-21swapper/721:41:537
113824499136,6cyclictest0-21swapper/700:21:257
113824499136,5cyclictest1268298-21/usr/sbin/munin20:13:117
113824499135,7cyclictest0-21swapper/723:04:347
113824499135,7cyclictest0-21swapper/722:54:037
113824499135,7cyclictest0-21swapper/722:54:037
113824499135,7cyclictest0-21swapper/722:30:157
113824499135,7cyclictest0-21swapper/700:28:127
113824499134,8cyclictest924-21NetworkManager23:14:297
113824499134,8cyclictest1730298-21ip_192.168.114.23:33:147
113824499134,8cyclictest1730298-21ip_192.168.114.23:33:147
113824499134,8cyclictest0-21swapper/723:08:067
113824499130,6cyclictest1616047-21ssh22:43:287
113824499130,4cyclictest1217600-21kthreadcore19:43:207
113824499130,4cyclictest1150955-21grep19:13:037
1138240991312,1cyclictest0-21swapper/623:58:526
1138240991312,1cyclictest0-21swapper/623:33:296
1138240991312,1cyclictest0-21swapper/623:33:296
1138240991312,1cyclictest0-21swapper/623:13:566
1138240991312,1cyclictest0-21swapper/622:52:396
1138240991312,1cyclictest0-21swapper/622:25:236
1138240991312,1cyclictest0-21swapper/622:21:366
1138240991312,1cyclictest0-21swapper/621:53:416
1138240991312,1cyclictest0-21swapper/621:38:246
1138240991312,1cyclictest0-21swapper/621:20:356
1138240991312,1cyclictest0-21swapper/600:08:576
1138240991312,1cyclictest0-21swapper/600:04:516
113824099130,13cyclictest0-21swapper/623:54:556
113824099130,13cyclictest0-21swapper/623:25:456
113824099130,13cyclictest0-21swapper/600:25:596
113824099130,12cyclictest0-21swapper/623:08:066
1138235991311,2cyclictest1319773-21kworker/u16:2+flush-8:021:24:015
113823099139,3cyclictest1589900-21kworker/u16:3+flush-8:022:33:534
1138230991312,1cyclictest0-21swapper/423:23:364
113823099130,1cyclictest0-21swapper/423:55:264
113823099130,1cyclictest0-21swapper/423:35:354
113823099130,1cyclictest0-21swapper/423:35:354
113823099130,1cyclictest0-21swapper/423:13:404
113823099130,13cyclictest0-21swapper/423:05:474
113823099130,13cyclictest0-21swapper/422:49:514
113823099130,13cyclictest0-21swapper/421:32:084
113823099130,13cyclictest0-21swapper/421:22:034
113823099130,13cyclictest0-21swapper/419:56:264
113824499129,2cyclictest0-21swapper/719:17:597
113824499128,3cyclictest1326591-21/usr/sbin/munin20:43:117
113824499128,3cyclictest1200758-21cat19:38:107
113824499127,5cyclictest6045-21gmain19:33:157
113824499124,7cyclictest1757189-21grep23:43:187
113824499123,3cyclictest1182324-21kthreadcore19:28:177
113824499120,4cyclictest1246462-21kthreadcore19:58:217
113824499120,2cyclictest1179735-21ntpq19:23:237
1138240991211,1cyclictest0-21swapper/623:43:066
1138240991211,1cyclictest0-21swapper/623:41:126
1138240991211,1cyclictest0-21swapper/623:21:496
1138240991211,1cyclictest0-21swapper/622:56:356
1138240991211,1cyclictest0-21swapper/622:56:356
1138240991211,1cyclictest0-21swapper/622:06:376
1138240991211,1cyclictest0-21swapper/621:59:126
1138240991211,1cyclictest0-21swapper/620:50:286
1138240991211,1cyclictest0-21swapper/619:26:456
1138240991211,1cyclictest0-21swapper/619:08:476
113824099120,1cyclictest0-21swapper/621:02:556
113824099120,1cyclictest0-21swapper/619:34:296
113824099120,12cyclictest0-21swapper/622:15:556
1138230991211,1cyclictest0-21swapper/423:01:504
1138230991211,1cyclictest0-21swapper/422:31:534
1138230991211,1cyclictest0-21swapper/422:24:004
1138230991211,1cyclictest0-21swapper/421:44:264
1138230991211,1cyclictest0-21swapper/421:25:594
1138230991211,1cyclictest0-21swapper/420:18:404
1138230991211,1cyclictest0-21swapper/400:07:444
1138230991210,2cyclictest0-21swapper/422:57:544
1138230991210,2cyclictest0-21swapper/422:57:544
1138230991210,2cyclictest0-21swapper/421:57:314
113823099120,12cyclictest0-21swapper/421:52:004
113824499117,3cyclictest1258715-21cat20:08:127
113824499114,6cyclictest0-21swapper/721:01:447
113824499110,9cyclictest0-21swapper/719:08:187
1138240991110,1cyclictest0-21swapper/620:32:306
1138240991110,1cyclictest0-21swapper/619:44:536
1138240991110,1cyclictest0-21swapper/600:30:056
1138240991110,1cyclictest0-21swapper/600:13:136
1138240991110,1cyclictest0-21swapper/600:13:136
113824099110,11cyclictest0-21swapper/620:54:446
113824099110,11cyclictest0-21swapper/620:54:446
113824099110,11cyclictest0-21swapper/620:22:346
113824099110,11cyclictest0-21swapper/619:55:276
113824099110,11cyclictest0-21swapper/619:39:416
113824099110,11cyclictest0-21swapper/619:31:576
113823099119,2cyclictest0-21swapper/420:28:364
1138230991110,1cyclictest0-21swapper/421:06:074
1138230991110,1cyclictest0-21swapper/420:45:004
113823099110,1cyclictest0-21swapper/420:51:474
113823099110,1cyclictest0-21swapper/420:04:004
113823099110,11cyclictest0-21swapper/421:02:014
113823099110,11cyclictest0-21swapper/420:53:494
113823099110,11cyclictest0-21swapper/420:53:494
113823099110,11cyclictest0-21swapper/420:01:384
113823099110,11cyclictest0-21swapper/419:14:304
113824099109,1cyclictest0-21swapper/623:00:226
113824099109,1cyclictest0-21swapper/622:38:476
113824099109,1cyclictest0-21swapper/622:29:106
113824099109,1cyclictest0-21swapper/621:26:256
113824099109,1cyclictest0-21swapper/620:24:566
113824099109,1cyclictest0-21swapper/620:00:396
113823099109,1cyclictest0-21swapper/423:49:184
113823099109,1cyclictest0-21swapper/422:08:434
113823099108,2cyclictest0-21swapper/422:14:234
113823099103,3cyclictest1139226-21cat19:08:134
113823099103,2cyclictest16099182sleep422:43:204
113823099102,8cyclictest0-21swapper/420:16:384
113823099102,8cyclictest0-21swapper/400:19:134
113823099100,3cyclictest1448002-21sd-close21:37:584
113823099100,3cyclictest1448002-21sd-close21:37:584
113823099100,3cyclictest0-21swapper/422:01:264
113823099100,3cyclictest0-21swapper/419:34:024
113823099100,2cyclictest0-21swapper/400:28:164
11382409998,1cyclictest0-21swapper/621:10:586
11382409998,1cyclictest0-21swapper/620:37:146
11382409998,1cyclictest0-21swapper/600:36:236
11382309998,1cyclictest0-21swapper/422:22:074
11382309990,4cyclictest1800630-21taskset00:00:134
11382309990,4cyclictest1519544-21taskset22:04:404
11382309990,4cyclictest1316176-21chrt20:33:534
11382309990,4cyclictest1209556-21taskset19:40:084
11382309990,4cyclictest1170687-21taskset19:18:534
11382309990,3cyclictest1886307-21chrt00:35:314
11382309990,3cyclictest1726825-21chrt23:29:034
11382309990,3cyclictest1679862-21taskset23:12:284
11382309990,3cyclictest1605279-21chrt22:39:584
11382309990,3cyclictest1190400-21chrt19:32:554
11382309990,3cyclictest1180375-21chrt19:23:344
11382309990,3cyclictest0-21swapper/420:23:114
11382409987,1cyclictest0-21swapper/621:32:246
11382409987,1cyclictest0-21swapper/621:14:456
11382409987,1cyclictest0-21swapper/620:05:236
11382409987,1cyclictest0-21swapper/619:50:056
11382409987,1cyclictest0-21swapper/619:21:336
11382309985,3cyclictest0-21swapper/419:43:024
11382309981,1cyclictest681rcuog/423:18:074
11382309981,1cyclictest681rcuog/400:23:294
11382309980,3cyclictest1824026-21taskset00:08:304
11382309980,2cyclictest1267655-21chrt20:09:334
11382409976,1cyclictest0-21swapper/622:46:406
11382409976,1cyclictest0-21swapper/622:10:146
11382409975,2cyclictest1199086-21kworker/u16:0+flush-8:020:43:246
11382409965,1cyclictest0-21swapper/623:31:356
11382409965,1cyclictest0-21swapper/623:04:096
11382409964,1cyclictest0-21swapper/621:35:256
11382409964,1cyclictest0-21swapper/621:35:256
11382409962,3cyclictest1148224-21interrupts19:13:006
11382409950,4cyclictest1365923-21chrt21:03:116
11382409950,4cyclictest1268829-21chrt20:13:116
11382409950,4cyclictest1259351-21taskset20:08:156
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional