You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 21:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Tue Mar 31, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
204550225747,7sleep60-21swapper/607:01:266
204550024636,7sleep40-21swapper/407:01:244
2045888994441,2cyclictest2497113-21kworker/u16:4+events_unbound10:47:586
2045888994440,3cyclictest2287864-21kworker/u16:3+events_unbound09:37:586
2045888994340,2cyclictest2164365-21kworker/u16:4+events_unbound09:17:586
204540924232,7sleep50-21swapper/507:00:055
20454292406,30sleep70-21swapper/707:00:237
204589399370,36cyclictest124-21kswapd010:53:067
2045881993735,2cyclictest2400054-21kworker/u16:3+events_unbound10:12:555
2045893993432,1cyclictest2666458-21sh11:42:537
2045881993432,2cyclictest2605578-21kworker/u16:3+events_unbound11:23:055
23839822330,1chrt0-21swapper/609:43:046
2045875993330,2cyclictest2642199-21kworker/u16:5+events_unbound11:38:044
2045888993230,2cyclictest2145400-21kworker/u16:1+flush-8:009:28:146
2045881993230,2cyclictest2287864-21kworker/u16:3+flush-8:009:43:055
2045881993230,2cyclictest2070637-21kworker/u16:2+events_unbound07:13:085
2045875993229,2cyclictest2145400-21kworker/u16:1+flush-8:009:02:594
2045881993129,2cyclictest2377597-21kworker/u16:1+events_unbound09:58:105
2045875993129,2cyclictest2377597-21kworker/u16:1+events_unbound09:47:564
2045888992925,3cyclictest2605578-21kworker/u16:3+flush-8:012:23:006
2045881992927,2cyclictest2688595-21kworker/u16:0+events_unbound11:53:055
2045875992927,2cyclictest2497113-21kworker/u16:4+flush-8:010:47:534
2045875992927,2cyclictest2421818-21kworker/u16:2+events_unbound11:03:014
2045893992828,0cyclictest0-21swapper/712:11:427
2045893992822,5cyclictest650-21systemd-journal10:12:437
204589399280,27cyclictest2097032-21pool-gnome-soft07:24:437
2045881992826,2cyclictest2605578-21kworker/u16:3+flush-8:011:28:085
25675232270,1chrt2567524-21sh10:59:357
204589399270,25cyclictest2368558-21kthreadcore09:38:027
2045881992725,2cyclictest2605578-21kworker/u16:3+events_unbound11:38:005
2045881992725,2cyclictest2377597-21kworker/u16:1+events_unbound09:53:095
2045881992725,2cyclictest2164365-21kworker/u16:4+flush-8:009:33:065
2045875992725,2cyclictest2377597-21kworker/u16:1+flush-8:009:53:004
2045893992624,1cyclictest2279053-21diskmemload10:43:047
2045893992624,1cyclictest0-21swapper/712:02:537
2045888992622,3cyclictest2145400-21kworker/u16:1+flush-8:008:08:096
2045881992624,2cyclictest2605578-21kworker/u16:3+events_unbound11:57:545
2045881992623,2cyclictest2145400-21kworker/u16:1+events_unbound09:27:565
2045875992623,2cyclictest2605578-21kworker/u16:3+events_unbound11:28:024
2045893992525,0cyclictest0-21swapper/709:43:047
2045893992520,4cyclictest2399973-21latency_hist09:52:437
2045888992523,2cyclictest2421818-21kworker/u16:2+flush-8:010:28:036
2045888992523,2cyclictest2421818-21kworker/u16:2+flush-8:010:28:036
2045881992523,2cyclictest2400054-21kworker/u16:3+flush-8:010:32:585
2045881992523,2cyclictest2164365-21kworker/u16:4+flush-8:009:08:055
2045875992523,2cyclictest2145400-21kworker/u16:1+events_unbound08:13:074
2045893992421,1cyclictest0-21swapper/712:13:087
2045881992422,2cyclictest2630124-21kworker/u16:1+events_unbound11:45:535
2045881992422,2cyclictest2497113-21kworker/u16:4+flush-8:011:03:075
2045881992422,2cyclictest2385521-21kworker/u16:2+flush-8:009:48:065
2045881992422,2cyclictest2164365-21kworker/u16:4+events_unbound10:03:155
2045875992422,2cyclictest2164365-21kworker/u16:4+events_unbound09:18:084
2045875992421,2cyclictest2421818-21kworker/u16:2+flush-8:011:13:064
2045893992323,0cyclictest0-21swapper/709:33:587
2045893992322,1cyclictest0-21swapper/710:18:007
2045888992321,2cyclictest2007565-21kworker/u16:0+flush-8:007:18:096
2045888992320,2cyclictest2666038-21kworker/u16:2+events_unbound12:27:566
2045881992321,2cyclictest2579013-21kworker/u16:1+events_unbound11:08:085
2045881992321,2cyclictest2497113-21kworker/u16:4+events_unbound11:01:545
2045881992321,2cyclictest2164365-21kworker/u16:4+flush-8:008:33:025
2045881992321,2cyclictest2164365-21kworker/u16:4+flush-8:008:33:025
2045881992321,2cyclictest2145400-21kworker/u16:1+flush-8:008:23:065
2045881992321,2cyclictest2145400-21kworker/u16:1+events_unbound08:47:585
2045881992321,2cyclictest2107042-21kworker/u16:0+events_unbound08:03:005
2045875992321,2cyclictest2164365-21kworker/u16:4+flush-8:009:43:064
2045893992222,0cyclictest0-21swapper/711:53:177
2045893992221,1cyclictest0-21swapper/711:40:097
2045893992218,3cyclictest96-21ksoftirqd/711:12:457
204589399220,21cyclictest124-21kswapd011:33:077
2045881992220,2cyclictest2534246-21kworker/u16:0+events_unbound10:53:055
2045881992220,2cyclictest2412524-21kworker/u16:0+events_unbound10:21:145
2045881992220,2cyclictest2164365-21kworker/u16:4+flush-8:008:32:385
2045881992219,2cyclictest2045641-21kworker/u16:1+flush-8:007:08:005
2045881992218,2cyclictest2164365-21kworker/u16:4+events_unbound09:06:545
2045875992220,2cyclictest2666038-21kworker/u16:2+flush-8:012:08:164
2045875992220,2cyclictest2630124-21kworker/u16:1+events_unbound11:47:544
2045875992220,2cyclictest2630124-21kworker/u16:1+events_unbound11:47:544
2045893992119,1cyclictest2279053-21diskmemload11:27:587
2045893992118,2cyclictest1267-21snmpd11:25:297
2045881992119,2cyclictest2472942-21kworker/u16:1+events_unbound10:32:145
2045881992119,2cyclictest2472942-21kworker/u16:1+events_unbound10:32:145
2045881992119,2cyclictest2412524-21kworker/u16:0+events_unbound10:08:065
2045881992119,2cyclictest2145400-21kworker/u16:1+flush-8:008:13:005
2045881992119,2cyclictest2070637-21kworker/u16:2+events_unbound07:47:595
2045881992119,2cyclictest2070637-21kworker/u16:2+events_unbound07:47:595
2045893992020,0cyclictest0-21swapper/709:28:107
2045893992019,0cyclictest0-21swapper/707:43:107
2045888992018,2cyclictest2534246-21kworker/u16:0+flush-8:010:58:546
2045888992018,2cyclictest2421818-21kworker/u16:2+events_unbound11:13:076
2045888992018,2cyclictest2107042-21kworker/u16:0+events_unbound08:12:586
2045881992018,2cyclictest2605578-21kworker/u16:3+events_unbound12:25:125
2045881992018,2cyclictest2579013-21kworker/u16:1+events_unbound11:13:115
2045881992018,2cyclictest2400054-21kworker/u16:3+flush-8:010:43:095
2045881992018,2cyclictest2164365-21kworker/u16:4+events_unbound09:12:555
2045875992018,2cyclictest2070637-21kworker/u16:2+events_unbound07:18:014
2045893991919,0cyclictest0-21swapper/710:28:537
2045893991919,0cyclictest0-21swapper/710:28:537
2045893991913,5cyclictest2173909-21latency_hist08:07:437
2045881991917,2cyclictest2642198-21kworker/u16:4+events_unbound11:37:385
2045881991917,2cyclictest2472942-21kworker/u16:1+events_unbound10:26:545
2045881991917,2cyclictest2145400-21kworker/u16:1+events_unbound09:23:035
2045881991917,2cyclictest2107042-21kworker/u16:0+events_unbound08:08:085
2045881991917,2cyclictest2070637-21kworker/u16:2+events_unbound07:58:085
2045893991818,0cyclictest0-21swapper/709:24:497
2045893991812,5cyclictest2250376-21latency_hist08:47:437
204589399180,17cyclictest2580134-21sh11:05:337
204589399180,17cyclictest2301466-21ssh09:09:307
2045888991816,2cyclictest2666038-21kworker/u16:2+events_unbound11:53:126
2045881991816,2cyclictest2666038-21kworker/u16:2+events_unbound12:17:425
2045881991816,2cyclictest2127362-21kworker/u16:3+events_unbound07:53:025
2045881991815,2cyclictest2287864-21kworker/u16:3+events_unbound09:38:005
2045875991816,2cyclictest2472942-21kworker/u16:1+events_unbound10:28:064
2045875991816,2cyclictest2472942-21kworker/u16:1+events_unbound10:28:064
2045875991816,2cyclictest2412524-21kworker/u16:0+events_unbound10:18:104
2045875991815,2cyclictest2666038-21kworker/u16:2+flush-8:012:17:534
204589399178,8cyclictest0-21swapper/709:18:087
2045893991716,0cyclictest0-21swapper/712:31:427
204589399170,1cyclictest0-21swapper/707:28:087
204589399170,16cyclictest0-21swapper/710:48:067
2045888991714,2cyclictest2070637-21kworker/u16:2+events_unbound07:52:586
2045881991716,1cyclictest2605578-21kworker/u16:3+events_unbound12:11:335
2045881991715,2cyclictest2688595-21kworker/u16:0+events_unbound12:18:095
2045881991715,2cyclictest2164365-21kworker/u16:4+flush-8:008:17:595
2045875991715,2cyclictest2666038-21kworker/u16:2+events_unbound12:02:594
2045875991715,2cyclictest2605578-21kworker/u16:3+flush-8:012:23:064
2045875991715,2cyclictest2145400-21kworker/u16:1+events_unbound08:53:074
2045875991714,3cyclictest2421818-21kworker/u16:2+flush-8:010:43:064
204589399167,8cyclictest0-21swapper/710:03:057
2045893991616,0cyclictest0-21swapper/711:51:467
2045893991616,0cyclictest0-21swapper/711:51:467
2045893991616,0cyclictest0-21swapper/710:27:337
2045893991615,0cyclictest0-21swapper/707:53:047
2045893991614,1cyclictest0-21swapper/708:08:027
2045893991613,2cyclictest2279053-21diskmemload10:08:077
2045893991611,4cyclictest2231213-21latency_hist08:37:437
2045893991611,4cyclictest2231213-21latency_hist08:37:437
204589399160,15cyclictest2315320-21ssh09:17:417
2045881991614,2cyclictest2145400-21kworker/u16:1+flush-8:008:53:085
2045881991613,2cyclictest2164365-21kworker/u16:4+flush-8:008:38:035
2045875991614,2cyclictest2421818-21kworker/u16:2+events_unbound11:18:104
2045875991614,2cyclictest2421818-21kworker/u16:2+events_unbound10:38:064
204589399157,7cyclictest0-21swapper/711:17:557
204589399157,7cyclictest0-21swapper/711:08:077
204589399157,7cyclictest0-21swapper/710:38:027
2045893991512,2cyclictest0-21swapper/708:37:437
2045893991512,2cyclictest0-21swapper/707:33:057
204589399150,14cyclictest2290488-21ssh09:06:387
2045888991514,1cyclictest0-21swapper/608:48:056
2045888991513,2cyclictest2605578-21kworker/u16:3+events_unbound11:28:126
2045888991513,2cyclictest2472942-21kworker/u16:1+flush-8:010:37:426
2045881991513,2cyclictest2164365-21kworker/u16:4+events_unbound09:19:345
2045881991513,2cyclictest2097149-21kworker/u16:4+flush-8:007:32:595
2045881991513,2cyclictest2087843-21kworker/u16:3+flush-8:007:24:495
2045875991513,2cyclictest2097149-21kworker/u16:4+events_unbound07:27:574
204589399146,7cyclictest0-21swapper/712:19:267
204589399145,8cyclictest6045-21gmain11:57:567
2045893991414,0cyclictest0-21swapper/709:58:417
2045893991413,1cyclictest2279053-21diskmemload09:55:577
2045888991413,1cyclictest0-21swapper/612:02:376
2045888991413,1cyclictest0-21swapper/610:26:466
2045888991413,1cyclictest0-21swapper/610:18:446
2045888991413,1cyclictest0-21swapper/610:08:486
2045888991410,3cyclictest2145400-21kworker/u16:1+flush-8:009:23:086
204588899140,1cyclictest0-21swapper/611:38:056
204588899140,1cyclictest0-21swapper/609:55:526
2045881991412,2cyclictest2534246-21kworker/u16:0+events_unbound11:19:575
2045875991413,1cyclictest0-21swapper/411:10:034
2045875991413,1cyclictest0-21swapper/409:12:454
2045875991411,2cyclictest2400054-21kworker/u16:3+flush-8:009:58:014
2045875991410,3cyclictest2107042-21kworker/u16:0+flush-8:007:48:094
2045875991410,3cyclictest2107042-21kworker/u16:0+flush-8:007:48:094
204587599140,1cyclictest0-21swapper/411:00:264
204587599140,1cyclictest0-21swapper/410:54:264
204587599140,14cyclictest0-21swapper/409:08:114
204587599140,14cyclictest0-21swapper/407:25:054
204589399139,3cyclictest96-21ksoftirqd/708:22:577
204589399139,3cyclictest1267-21snmpd08:53:577
204589399139,3cyclictest1267-21snmpd07:57:447
204589399137,5cyclictest2193048-21latency_hist08:17:447
204589399135,7cyclictest0-21swapper/712:23:007
2045888991312,1cyclictest0-21swapper/611:45:556
2045888991312,1cyclictest0-21swapper/610:38:366
204588899130,1cyclictest0-21swapper/612:07:596
204588899130,1cyclictest0-21swapper/609:33:096
204588899130,13cyclictest0-21swapper/612:15:236
204588899130,13cyclictest0-21swapper/611:24:096
204588899130,13cyclictest0-21swapper/610:12:446
204588899130,13cyclictest0-21swapper/610:02:296
204588899130,13cyclictest0-21swapper/609:08:076
204588899130,13cyclictest0-21swapper/608:33:076
204588899130,13cyclictest0-21swapper/608:33:076
2045881991311,2cyclictest2688595-21kworker/u16:0+events_unbound12:30:305
2045881991311,2cyclictest2666038-21kworker/u16:2+events_unbound12:05:175
204588199130,1cyclictest0-21swapper/507:42:585
2045875991312,1cyclictest0-21swapper/412:31:144
2045875991312,1cyclictest0-21swapper/412:01:454
2045875991312,1cyclictest0-21swapper/411:45:124
2045875991312,1cyclictest0-21swapper/411:23:364
2045875991312,1cyclictest0-21swapper/410:26:414
2045875991312,1cyclictest0-21swapper/408:18:314
2045875991311,2cyclictest2164365-21kworker/u16:4+flush-8:009:33:114
2045875991311,2cyclictest2145400-21kworker/u16:1+events_unbound08:28:064
204587599130,1cyclictest0-21swapper/411:33:234
204587599130,13cyclictest0-21swapper/411:53:154
204589399129,2cyclictest1267-21snmpd07:40:117
204589399129,2cyclictest1267-21snmpd07:13:317
204589399128,3cyclictest1267-21snmpd08:47:577
204589399128,3cyclictest1267-21snmpd07:49:477
204589399128,3cyclictest1267-21snmpd07:49:477
204589399126,5cyclictest6184-21gvfs-afc-volume08:27:547
204589399125,6cyclictest0-21swapper/710:32:477
204589399120,1cyclictest0-21swapper/707:17:597
2045888991211,1cyclictest0-21swapper/612:06:536
2045888991211,1cyclictest0-21swapper/611:20:136
2045888991211,1cyclictest0-21swapper/611:10:266
2045888991211,1cyclictest0-21swapper/611:04:366
2045888991211,1cyclictest0-21swapper/609:49:156
2045888991211,1cyclictest0-21swapper/607:48:016
2045888991211,1cyclictest0-21swapper/607:48:016
2045888991211,1cyclictest0-21swapper/607:45:206
2045888991211,1cyclictest0-21swapper/607:28:376
204588899120,0cyclictest0-21swapper/607:04:306
2045881991210,2cyclictest2630124-21kworker/u16:1+events_unbound11:49:085
2045881991210,2cyclictest2630124-21kworker/u16:1+events_unbound11:49:085
2045881991210,2cyclictest2472942-21kworker/u16:1+events_unbound10:38:535
2045881991210,2cyclictest2070637-21kworker/u16:2+events_unbound07:37:495
2045881991210,2cyclictest2045641-21kworker/u16:1+events_unbound07:03:025
204587599129,2cyclictest2287864-21kworker/u16:3+events_unbound09:37:564
204587599129,2cyclictest2007565-21kworker/u16:0+flush-8:007:03:004
204587599128,3cyclictest2165500-21cat08:02:594
2045875991211,1cyclictest0-21swapper/412:14:224
2045875991211,1cyclictest0-21swapper/408:08:264
2045875991211,1cyclictest0-21swapper/407:09:094
204587599120,1cyclictest0-21swapper/407:55:024
204587599120,1cyclictest0-21swapper/407:38:294
204587599120,12cyclictest0-21swapper/408:33:584
204587599120,12cyclictest0-21swapper/408:33:584
204587599120,12cyclictest0-21swapper/407:17:124
204589399117,3cyclictest1267-21snmpd08:57:547
2045893991110,0cyclictest0-21swapper/707:07:507
204589399110,9cyclictest0-21swapper/707:03:007
204589399110,10cyclictest2199999-21tr08:18:067
204588899119,2cyclictest2642199-21kworker/u16:5+events_unbound11:33:056
204588899119,2cyclictest2045641-21kworker/u16:1+flush-8:007:13:406
2045888991110,1cyclictest0-21swapper/608:25:136
2045888991110,1cyclictest0-21swapper/608:22:426
2045888991110,1cyclictest0-21swapper/607:36:596
204588899110,11cyclictest0-21swapper/607:59:126
204588899110,0cyclictest0-21swapper/609:00:326
204588199119,2cyclictest2497113-21kworker/u16:4+events_unbound10:48:235
204588199119,2cyclictest2145400-21kworker/u16:1+events_unbound08:43:055
2045881991110,1cyclictest0-21swapper/507:20:355
204588199110,11cyclictest0-21swapper/507:28:475
2045875991110,1cyclictest0-21swapper/409:23:384
204587599110,11cyclictest0-21swapper/407:35:484
204588899109,1cyclictest0-21swapper/610:44:356
204588899109,1cyclictest0-21swapper/609:05:166
204588899108,2cyclictest2164365-21kworker/u16:4+flush-8:009:13:216
204588899108,2cyclictest2026517-21kworker/u16:3+events_unbound07:07:476
204588199108,2cyclictest2263749-21kworker/u16:2+events_unbound09:02:185
204587599109,1cyclictest0-21swapper/410:36:284
204587599109,1cyclictest0-21swapper/410:16:464
20458889998,1cyclictest0-21swapper/608:52:586
20458889998,1cyclictest0-21swapper/608:30:256
20458889998,1cyclictest0-21swapper/608:07:156
20458889994,4cyclictest2088905-21cat07:22:596
20458889990,6cyclictest2546707-21irqcore10:52:596
20458759998,1cyclictest0-21swapper/408:26:154
20458759998,1cyclictest0-21swapper/408:00:334
20458759995,3cyclictest2127236-21tune2fs07:42:574
20458889987,1cyclictest0-21swapper/607:39:396
20458889986,2cyclictest2164365-21kworker/u16:4+flush-8:008:38:086
20458889986,1cyclictest0-21swapper/611:47:576
20458889986,1cyclictest0-21swapper/611:47:576
20458889986,1cyclictest0-21swapper/608:42:576
20458889983,4cyclictest2428621-21cut10:03:016
20458759984,3cyclictest2232115-21df08:37:574
20458759983,4cyclictest2259556-21awk08:48:114
20458759983,4cyclictest2242195-21tr08:42:564
20458889975,1cyclictest0-21swapper/612:17:546
20458759974,2cyclictest2436963-21cpuspeed_turbos10:07:564
20458759973,3cyclictest2341310-21kthreadcore09:28:014
20458759970,6cyclictest2424803-21cpuspeed_turbos10:02:544
20458759970,6cyclictest2270543-21fschecks_time08:57:584
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional