You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 07:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Mon Mar 16, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15974512970,0sleep40-21swapper/423:49:064
15403192950,1sleep60-21swapper/623:24:076
965942995752,4cyclictest1662884-21latency_hist00:18:447
96544625242,7sleep50-21swapper/519:00:435
96594299480,46cyclictest1365288-21latency_hist22:13:447
965941994442,2cyclictest1662436-21kworker/u16:1+flush-8:000:19:136
96545424434,7sleep40-21swapper/419:00:504
96540924434,7sleep60-21swapper/619:00:126
965942994338,4cyclictest1293868-21latency_hist21:43:447
965942994038,1cyclictest1198707-21diskmemload23:09:327
9653532393,31sleep70-21swapper/718:59:247
965941993836,2cyclictest956538-21kworker/u16:3+flush-8:021:53:596
965942993731,5cyclictest1686629-21latency_hist00:28:447
965942993630,5cyclictest1222433-21latency_hist21:13:457
965941993633,2cyclictest893711-21kworker/u16:0+events_unbound20:03:456
965941993633,2cyclictest1459660-21kworker/u16:1+flush-8:022:59:026
965941993633,2cyclictest1459660-21kworker/u16:1+flush-8:022:59:026
965942993530,4cyclictest1084084-21latency_hist20:03:447
965932993432,2cyclictest956538-21kworker/u16:3+events_unbound19:08:484
965932993430,3cyclictest1422447-21kworker/u16:5+flush-8:022:55:154
965942993328,4cyclictest1033-21rs:main7
965941993331,2cyclictest956538-21kworker/u16:3+events_unbound19:29:146
965941993331,2cyclictest956538-21kworker/u16:3+events_unbound19:29:146
965942993231,0cyclictest0-21swapper/700:31:337
965942993129,1cyclictest1471815-21ssh22:57:257
965937993129,2cyclictest1422447-21kworker/u16:5+events_unbound23:46:385
965942993029,0cyclictest0-21swapper/720:19:047
965942993024,5cyclictest1026801-21latency_hist19:33:457
965942993024,5cyclictest1026801-21latency_hist19:33:457
965941993028,2cyclictest956538-21kworker/u16:3+events_unbound22:14:286
965941993028,2cyclictest253419-21kworker/u16:1+events_unbound19:23:126
965937993028,2cyclictest1459660-21kworker/u16:1+flush-8:022:58:055
965941992927,2cyclictest956538-21kworker/u16:3+events_unbound19:11:366
965937992927,2cyclictest956538-21kworker/u16:3+events_unbound21:54:265
965937992927,2cyclictest956538-21kworker/u16:3+events_unbound19:11:275
965942992826,1cyclictest1421889-21ssh22:34:107
965941992826,2cyclictest1234737-21kworker/u16:1+flush-8:021:49:346
965937992826,2cyclictest893711-21kworker/u16:0+events_unbound20:13:455
965937992826,2cyclictest893711-21kworker/u16:0+events_unbound20:13:455
12565222280,1chrt1256520-21ssh21:25:317
965941992725,2cyclictest956538-21kworker/u16:3+events_unbound20:18:366
965941992725,2cyclictest956538-21kworker/u16:3+events_unbound20:18:366
965941992725,2cyclictest956538-21kworker/u16:3+events_unbound19:40:536
965941992725,2cyclictest1103559-21kworker/u16:2+flush-8:020:39:006
965941992725,2cyclictest1103559-21kworker/u16:2+events_unbound20:20:006
965937992725,2cyclictest1662436-21kworker/u16:1+events_unbound00:19:035
965942992625,0cyclictest0-21swapper/720:56:047
965942992625,0cyclictest0-21swapper/719:50:207
965942992625,0cyclictest0-21swapper/719:21:367
965942992625,0cyclictest0-21swapper/719:17:287
965941992624,2cyclictest956538-21kworker/u16:3+flush-8:021:29:276
965941992624,2cyclictest253419-21kworker/u16:1+events_unbound19:25:056
965941992624,2cyclictest1436828-21kworker/u16:0+flush-8:022:49:226
965941992624,2cyclictest1422447-21kworker/u16:5+flush-8:000:09:376
965941992624,2cyclictest1413237-21kworker/u16:4+events_unbound23:14:246
965941992624,2cyclictest1316822-21kworker/u16:5+events_unbound21:59:386
965941992624,2cyclictest1199175-21kworker/u16:2+flush-8:021:14:076
965941992624,2cyclictest1103559-21kworker/u16:2+events_unbound20:48:246
965941992624,2cyclictest1103559-21kworker/u16:2+events_unbound20:37:046
965941992623,2cyclictest956538-21kworker/u16:3+events_unbound19:33:536
965937992624,2cyclictest956538-21kworker/u16:3+events_unbound19:17:125
965937992624,2cyclictest893711-21kworker/u16:0+events_unbound20:01:195
965937992624,2cyclictest1179693-21kworker/u16:4+events_unbound20:57:045
965937992624,2cyclictest1103559-21kworker/u16:2+events_unbound20:37:325
965937992623,2cyclictest1103559-21kworker/u16:2+events_unbound20:43:455
14006862260,1chrt1400684-21ssh22:28:227
965942992525,0cyclictest0-21swapper/720:11:527
965942992524,0cyclictest0-21swapper/722:49:037
965942992524,0cyclictest0-21swapper/721:03:457
965942992522,2cyclictest1316693-21rm21:51:547
96594299250,24cyclictest1434561-21ssh22:39:367
965941992523,2cyclictest893711-21kworker/u16:0+events_unbound20:10:246
965941992523,2cyclictest893711-21kworker/u16:0+events_unbound19:56:256
965941992523,2cyclictest1662436-21kworker/u16:1+events_unbound00:29:016
965941992523,2cyclictest1579602-21kworker/u16:3+events_unbound23:55:496
965941992523,2cyclictest1179693-21kworker/u16:4+events_unbound20:58:246
965941992523,2cyclictest1103559-21kworker/u16:2+events_unbound20:52:076
965941992523,2cyclictest1094003-21kworker/u16:1+events_unbound21:00:046
965941992523,2cyclictest1094003-21kworker/u16:1+events_unbound21:00:046
965941992523,2cyclictest1094003-21kworker/u16:1+events_unbound20:32:446
965937992523,2cyclictest956538-21kworker/u16:3+events_unbound19:50:285
965937992523,2cyclictest956538-21kworker/u16:3+events_unbound19:30:045
965937992523,2cyclictest956538-21kworker/u16:3+events_unbound19:30:045
965937992523,2cyclictest893711-21kworker/u16:0+events_unbound19:43:575
965937992523,2cyclictest1459660-21kworker/u16:1+events_unbound23:14:005
965937992523,2cyclictest1398649-21kworker/u16:2+flush-8:022:38:595
965942992423,0cyclictest0-21swapper/721:03:217
965942992423,0cyclictest0-21swapper/721:03:217
965942992423,0cyclictest0-21swapper/719:27:537
965941992422,2cyclictest956538-21kworker/u16:3+events_unbound19:52:046
965937992422,2cyclictest956538-21kworker/u16:3+events_unbound19:21:285
965937992422,2cyclictest253419-21kworker/u16:1+events_unbound19:05:115
965937992422,2cyclictest1422447-21kworker/u16:5+flush-8:022:59:325
965937992422,2cyclictest1422447-21kworker/u16:5+flush-8:022:59:325
965937992422,2cyclictest1422447-21kworker/u16:5+events_unbound23:24:415
965932992422,2cyclictest1436828-21kworker/u16:0+events_unbound22:44:084
965932992421,2cyclictest956538-21kworker/u16:3+flush-8:021:58:584
965942992320,2cyclictest1640730-21irqcore00:09:017
96594299230,21cyclictest1044817-21wc19:39:067
965932992321,2cyclictest1094003-21kworker/u16:1+events_unbound21:08:564
965942992221,0cyclictest0-21swapper/720:06:297
965942992221,0cyclictest0-21swapper/719:12:107
965941992220,2cyclictest1422447-21kworker/u16:5+events_unbound23:49:266
965937992220,2cyclictest956538-21kworker/u16:3+events_unbound19:33:575
965937992220,2cyclictest1246367-21kworker/u16:4+events_unbound21:38:545
965937992220,2cyclictest1199175-21kworker/u16:2+flush-8:021:19:085
965937992220,2cyclictest1036022-21kworker/u16:2+events_unbound19:41:425
965942992120,0cyclictest0-21swapper/720:34:107
96594299210,19cyclictest1577371-21ssh23:39:307
96594299210,19cyclictest1577371-21ssh23:39:307
965941992119,2cyclictest893711-21kworker/u16:0+events_unbound20:00:246
965937992119,2cyclictest253419-21kworker/u16:1+events_unbound19:25:035
965937992119,2cyclictest1544315-21kworker/u16:0+events_unbound23:39:215
965937992119,2cyclictest1544315-21kworker/u16:0+events_unbound23:39:215
965937992119,2cyclictest1246367-21kworker/u16:4+events_unbound21:34:265
965937992119,2cyclictest1094003-21kworker/u16:1+events_unbound20:11:465
965937992119,2cyclictest1074549-21kworker/u16:4+events_unbound20:04:325
965932992118,3cyclictest1544315-21kworker/u16:0+flush-8:000:03:394
14231292210,1chrt0-21swapper/622:35:356
965942992020,0cyclictest0-21swapper/720:32:527
965942992018,1cyclictest0-21swapper/720:49:007
965941992018,2cyclictest956538-21kworker/u16:3+events_unbound19:45:426
965941992018,2cyclictest1316605-21kworker/u16:2+events_unbound22:09:296
965937992018,2cyclictest1603743-21kworker/u16:2+events_unbound00:14:005
965937992018,2cyclictest1603743-21kworker/u16:2+events_unbound00:09:035
965937992018,2cyclictest1422447-21kworker/u16:5+events_unbound22:49:115
965937992018,2cyclictest1103559-21kworker/u16:2+events_unbound20:47:105
965937992018,2cyclictest1094003-21kworker/u16:1+events_unbound21:00:265
965937992018,2cyclictest1094003-21kworker/u16:1+events_unbound21:00:265
965942991915,3cyclictest1267-21snmpd21:57:367
965937991917,2cyclictest956538-21kworker/u16:3+events_unbound21:58:575
965937991917,2cyclictest1103559-21kworker/u16:2+events_unbound20:53:065
965937991917,2cyclictest1094003-21kworker/u16:1+events_unbound20:26:065
965932991917,2cyclictest956538-21kworker/u16:3+events_unbound21:54:084
96594299188,9cyclictest0-21swapper/722:04:077
96594299188,9cyclictest0-21swapper/721:19:087
965942991813,4cyclictest107-21kcompactd022:19:417
965941991816,2cyclictest893711-21kworker/u16:0+events_unbound19:14:486
965941991816,2cyclictest253419-21kworker/u16:1+events_unbound19:03:596
965941991816,2cyclictest1103559-21kworker/u16:2+events_unbound20:24:466
965937991816,2cyclictest1685373-21kworker/u16:2+events_unbound00:26:175
965937991816,2cyclictest1316605-21kworker/u16:2+flush-8:022:13:175
965937991816,2cyclictest1246367-21kworker/u16:4+flush-8:021:50:095
965937991816,2cyclictest1094003-21kworker/u16:1+events_unbound20:22:415
965942991712,4cyclictest1543894-21latency_hist23:28:447
965941991715,2cyclictest1413237-21kworker/u16:4+events_unbound22:39:096
965937991715,2cyclictest956538-21kworker/u16:3+events_unbound19:57:385
965937991715,2cyclictest1341517-21kworker/u16:0+events_unbound22:04:105
965937991714,2cyclictest1103559-21kworker/u16:2+flush-8:020:28:505
965942991616,0cyclictest0-21swapper/720:45:427
965942991615,0cyclictest0-21swapper/720:17:187
965942991615,0cyclictest0-21swapper/720:17:187
965942991614,1cyclictest0-21swapper/723:49:057
965941991614,2cyclictest956538-21kworker/u16:3+events_unbound21:05:156
965941991614,2cyclictest1685373-21kworker/u16:2+events_unbound00:26:286
965941991614,2cyclictest1199175-21kworker/u16:2+flush-8:021:09:076
965937991614,2cyclictest1422447-21kworker/u16:5+events_unbound23:06:015
965932991614,2cyclictest1246367-21kworker/u16:4+events_unbound21:34:004
96594299158,6cyclictest0-21swapper/721:14:077
96594299157,7cyclictest0-21swapper/723:44:097
96594299156,7cyclictest0-21swapper/722:44:027
965942991515,0cyclictest0-21swapper/720:25:077
965942991511,3cyclictest1267-21snmpd21:46:007
96594299150,1cyclictest0-21swapper/700:01:047
96594299150,13cyclictest0-21swapper/719:04:107
965941991513,2cyclictest1422447-21kworker/u16:5+events_unbound23:05:406
965941991513,2cyclictest1365083-21kworker/u16:1+events_unbound22:23:416
965941991513,2cyclictest1282373-21kworker/u16:0+flush-8:021:39:066
965937991513,2cyclictest956538-21kworker/u16:3+events_unbound22:25:445
965937991513,2cyclictest1579602-21kworker/u16:3+flush-8:023:59:035
965937991513,2cyclictest1234737-21kworker/u16:1+events_unbound21:44:345
965937991512,2cyclictest1246367-21kworker/u16:4+events_unbound21:28:565
965932991514,1cyclictest0-21swapper/421:17:184
965932991513,2cyclictest1074549-21kworker/u16:4+events_unbound19:59:004
96594299147,6cyclictest0-21swapper/723:05:337
96594299146,7cyclictest0-21swapper/722:29:077
96594299146,7cyclictest0-21swapper/721:34:037
96594299146,7cyclictest0-21swapper/700:07:107
965942991414,0cyclictest0-21swapper/700:19:247
965941991413,1cyclictest0-21swapper/623:29:036
965941991412,2cyclictest1459660-21kworker/u16:1+events_unbound23:48:416
965941991412,2cyclictest1422447-21kworker/u16:5+events_unbound00:04:046
965941991412,1cyclictest1299960-21kthreadcore21:44:046
96594199140,1cyclictest0-21swapper/621:34:086
96594199140,1cyclictest0-21swapper/600:01:046
965937991413,1cyclictest0-21swapper/521:05:185
965937991413,1cyclictest0-21swapper/500:32:185
965937991412,2cyclictest1422447-21kworker/u16:5+flush-8:023:34:185
965937991412,2cyclictest1422447-21kworker/u16:5+events_unbound23:50:005
965937991412,2cyclictest1422447-21kworker/u16:5+events_unbound23:19:035
96593799140,1cyclictest0-21swapper/521:13:015
96593799140,14cyclictest0-21swapper/522:47:375
96593299149,4cyclictest1247529-21cat21:23:594
965932991413,1cyclictest0-21swapper/423:41:054
965932991413,1cyclictest0-21swapper/423:41:054
965932991413,1cyclictest0-21swapper/421:46:384
965932991412,2cyclictest1365083-21kworker/u16:1+flush-8:022:18:444
965932991411,2cyclictest1422447-21kworker/u16:5+flush-8:023:53:544
96593299140,1cyclictest0-21swapper/422:10:354
96593299140,14cyclictest0-21swapper/423:11:174
96593299140,14cyclictest0-21swapper/422:36:554
96593299140,14cyclictest0-21swapper/422:20:414
96593299140,14cyclictest0-21swapper/400:20:584
96593299140,14cyclictest0-21swapper/400:06:184
96593299140,13cyclictest0-21swapper/419:04:084
96594299139,3cyclictest1267-21snmpd19:56:457
96594299136,6cyclictest0-21swapper/723:53:557
96594299136,6cyclictest0-21swapper/722:58:597
96594299136,6cyclictest0-21swapper/722:58:597
96594299136,6cyclictest0-21swapper/722:14:047
96594299136,6cyclictest0-21swapper/721:59:007
96594299136,6cyclictest0-21swapper/721:31:077
96594299134,8cyclictest1522083-21cut23:19:017
96594299134,8cyclictest0-21swapper/723:34:187
965942991312,1cyclictest1198707-21diskmemload23:15:107
965942991312,0cyclictest0-21swapper/719:34:007
965941991311,2cyclictest956538-21kworker/u16:3+events_unbound22:24:456
965941991311,2cyclictest1413237-21kworker/u16:4+events_unbound23:09:486
965941991310,2cyclictest1544315-21kworker/u16:0+flush-8:023:33:486
96594199130,1cyclictest0-21swapper/622:06:176
965937991312,1cyclictest0-21swapper/521:26:355
965937991311,2cyclictest1412858-21kworker/u16:0+events_unbound22:34:145
965937991311,2cyclictest1398649-21kworker/u16:2+events_unbound22:29:115
965937991311,2cyclictest1365083-21kworker/u16:1+events_unbound22:13:565
965937991311,2cyclictest1199175-21kworker/u16:2+events_unbound21:15:405
96593799130,13cyclictest0-21swapper/523:58:335
96593799130,13cyclictest0-21swapper/500:04:525
965932991312,1cyclictest0-21swapper/423:00:244
965932991312,1cyclictest0-21swapper/423:00:244
965932991312,1cyclictest0-21swapper/422:49:324
965932991312,1cyclictest0-21swapper/422:30:464
965932991312,1cyclictest0-21swapper/421:42:414
965932991312,1cyclictest0-21swapper/420:24:014
965932991311,2cyclictest956538-21kworker/u16:3+flush-8:019:54:104
965932991311,2cyclictest1103559-21kworker/u16:2+flush-8:020:19:004
96593299130,13cyclictest0-21swapper/421:19:124
96593299130,13cyclictest0-21swapper/400:12:374
96594299128,3cyclictest1267-21snmpd19:44:547
96594199129,2cyclictest1398649-21kworker/u16:2+events_unbound22:28:486
965941991211,1cyclictest0-21swapper/622:56:256
965941991210,2cyclictest1603743-21kworker/u16:2+flush-8:000:14:086
965937991211,1cyclictest0-21swapper/523:30:585
965937991210,2cyclictest1341517-21kworker/u16:0+events_unbound22:19:445
965932991211,1cyclictest0-21swapper/423:47:234
965932991211,1cyclictest0-21swapper/423:26:164
965932991211,1cyclictest0-21swapper/422:43:044
965932991211,1cyclictest0-21swapper/421:50:344
965932991211,1cyclictest0-21swapper/421:07:414
965932991211,1cyclictest0-21swapper/400:31:224
96593299120,1cyclictest0-21swapper/420:07:564
96593299120,1cyclictest0-21swapper/419:37:124
96593299120,12cyclictest0-21swapper/419:20:104
96594199119,2cyclictest1544315-21kworker/u16:0+events_unbound23:39:076
96594199119,2cyclictest1544315-21kworker/u16:0+events_unbound23:39:076
96594199119,2cyclictest1246367-21kworker/u16:4+events_unbound21:26:566
96594199119,2cyclictest1221273-21kworker/u16:0+events_unbound21:23:376
965937991110,1cyclictest0-21swapper/523:09:225
965932991110,1cyclictest0-21swapper/423:15:324
965932991110,1cyclictest0-21swapper/419:51:134
96594299100,1cyclictest0-21swapper/720:39:107
96594199109,1cyclictest0-21swapper/622:45:236
96594199108,2cyclictest1459660-21kworker/u16:1+events_unbound23:23:176
96593299109,1cyclictest0-21swapper/423:22:004
96593299109,1cyclictest0-21swapper/420:57:454
96593299109,1cyclictest0-21swapper/420:36:284
9659329998,1cyclictest0-21swapper/423:36:494
9659329998,1cyclictest0-21swapper/420:30:104
9659329998,1cyclictest0-21swapper/419:32:284
9659329998,1cyclictest0-21swapper/419:32:284
9659329998,1cyclictest0-21swapper/419:17:394
9659329998,1cyclictest0-21swapper/400:25:044
9659329998,1cyclictest0-21swapper/400:16:434
9659329987,1cyclictest0-21swapper/421:28:494
9659329986,1cyclictest0-21swapper/420:49:024
9659329985,2cyclictest0-21swapper/419:39:024
9659329984,3cyclictest1104586-21irqcore20:14:014
9659329984,3cyclictest1104586-21irqcore20:14:014
9659329984,3cyclictest1098441-21cut20:09:044
9659329983,4cyclictest1393885-21grep22:24:034
9659329983,4cyclictest1345835-21cut22:04:024
9659329983,4cyclictest1192704-21cat20:59:024
9659329983,4cyclictest1192704-21cat20:59:024
9659329983,4cyclictest1163246-21cut20:44:024
9659329983,4cyclictest1053880-21cut19:44:054
9659329983,4cyclictest1012426-21cut19:24:034
9659329972,4cyclictest1152932-21grep20:39:024
9659329962,1cyclictest681rcuog/423:29:394
9659329961,1cyclictest201rcu_preempt23:03:584
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional