You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 13:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sun Mar 15, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25832912970,1sleep72583289-21awk08:38:467
2398111996256,5cyclictest2611882-21latency_hist08:53:467
2398106996157,3cyclictest3016048-21kworker/u16:2+flush-8:011:58:465
30924612550,0sleep73092462-21cat12:14:067
239759125343,7sleep40-21swapper/407:00:294
2398108994947,2cyclictest2631052-21kworker/u16:0+events_unbound09:44:166
239755324838,7sleep60-21swapper/606:59:596
2398108994543,2cyclictest3085087-21kworker/u16:3+flush-8:012:09:186
2398108994543,2cyclictest2370536-21kworker/u16:2+flush-8:007:29:136
2398108994543,2cyclictest2370536-21kworker/u16:2+flush-8:007:29:136
239767524534,8sleep50-21swapper/507:01:425
239811199440,42cyclictest2655054-21latency_hist09:13:477
2398108994442,2cyclictest2898453-21kworker/u16:3+flush-8:011:09:216
2398108994442,2cyclictest2847887-21kworker/u16:2+events_unbound10:49:176
2398108994442,2cyclictest2751289-21kworker/u16:1+events_unbound10:46:236
26732722430,1sleep60-21swapper/609:19:086
2398111994337,5cyclictest2468653-21latency_hist07:38:477
2398108994341,2cyclictest2847887-21kworker/u16:2+flush-8:010:59:146
2398106994340,2cyclictest3098775-21kworker/u16:2+flush-8:012:33:415
2398108994240,2cyclictest2978132-21kworker/u16:0+events_unbound11:30:146
2398108994139,2cyclictest3040516-21kworker/u16:3+events_unbound11:54:416
2398108994139,2cyclictest2458893-21kworker/u16:3+events_unbound08:04:176
23976032415,31sleep70-21swapper/707:00:407
2398108994038,2cyclictest3085087-21kworker/u16:3+events_unbound12:14:246
2398108994038,2cyclictest2847887-21kworker/u16:2+flush-8:010:39:156
2398111993933,5cyclictest650-21systemd-journal11:38:467
2398111993933,5cyclictest3028057-21latency_hist11:48:467
2398108993937,2cyclictest3016048-21kworker/u16:2+events_unbound12:02:216
2398108993937,2cyclictest2832419-21kworker/u16:3+flush-8:010:28:466
2398108993937,2cyclictest2751289-21kworker/u16:1+flush-8:010:34:166
2398111993833,4cyclictest2943675-21latency_hist11:13:467
2398108993836,2cyclictest3016048-21kworker/u16:2+flush-8:011:44:376
2398108993836,2cyclictest2992092-21kworker/u16:1+events_unbound11:36:096
2398108993836,2cyclictest2847887-21kworker/u16:2+events_unbound11:20:376
2398108993836,2cyclictest2370536-21kworker/u16:2+events_unbound09:32:586
2398108993836,2cyclictest2370536-21kworker/u16:2+events_unbound09:26:086
2398108993835,2cyclictest2787901-21kworker/u16:0+flush-8:010:28:516
2398106993836,2cyclictest2751289-21kworker/u16:1+flush-8:010:49:235
2398101993836,2cyclictest3016048-21kworker/u16:2+flush-8:011:59:174
2398108993735,2cyclictest3098775-21kworker/u16:2+events_unbound12:26:076
2398108993735,2cyclictest2751289-21kworker/u16:1+events_unbound10:10:476
2398108993735,2cyclictest2631052-21kworker/u16:0+events_unbound09:41:526
2398106993734,2cyclictest2898453-21kworker/u16:3+flush-8:011:18:465
2398106993733,3cyclictest2370536-21kworker/u16:2+flush-8:007:49:185
239811199360,34cyclictest124-21kswapd011:25:477
2398108993634,2cyclictest2992092-21kworker/u16:1+events_unbound12:29:306
2398108993634,2cyclictest2751289-21kworker/u16:1+events_unbound10:20:356
2398108993634,2cyclictest2751289-21kworker/u16:1+events_unbound10:01:246
2398108993634,2cyclictest2370536-21kworker/u16:2+events_unbound09:14:166
2398111993531,3cyclictest2554755-21sed08:23:467
2398108993533,2cyclictest2978132-21kworker/u16:0+events_unbound12:23:316
2398108993533,2cyclictest2898453-21kworker/u16:3+events_unbound11:07:066
2398108993533,2cyclictest2898453-21kworker/u16:3+events_unbound10:56:096
2398108993533,2cyclictest2898453-21kworker/u16:3+events_unbound10:56:096
2398108993533,2cyclictest2554479-21kworker/u16:3+flush-8:008:29:146
2398108993532,2cyclictest2458893-21kworker/u16:3+events_unbound07:49:006
2398108993532,2cyclictest2370536-21kworker/u16:2+flush-8:008:38:576
2398106993533,2cyclictest2397866-21kworker/u16:1+flush-8:007:19:185
2398106993532,2cyclictest2370536-21kworker/u16:2+events_unbound09:24:015
2398101993532,2cyclictest2856235-21kworker/u16:4+flush-8:010:34:584
2398108993432,2cyclictest2898453-21kworker/u16:3+events_unbound11:16:356
2398108993331,2cyclictest2978481-21kworker/u16:6+events_unbound11:41:126
2398108993331,2cyclictest2787901-21kworker/u16:0+events_unbound10:14:536
2398108993331,2cyclictest2787901-21kworker/u16:0+events_unbound10:14:536
2398108993331,2cyclictest2772284-21kworker/u16:4+events_unbound10:08:116
2398108993331,2cyclictest2751289-21kworker/u16:1+events_unbound11:25:266
2398108993331,2cyclictest2487924-21kworker/u16:0+events_unbound08:11:586
2398108993331,2cyclictest2370536-21kworker/u16:2+flush-8:009:34:146
2398108993331,2cyclictest2370536-21kworker/u16:2+flush-8:009:34:146
2398106993330,2cyclictest2370536-21kworker/u16:2+flush-8:009:49:045
2398101993332,1cyclictest2978132-21kworker/u16:0+events_unbound11:44:554
2398101993330,2cyclictest2772284-21kworker/u16:4+flush-8:010:08:424
2398108993230,2cyclictest3016048-21kworker/u16:2+events_unbound12:05:116
2398108993230,2cyclictest2992092-21kworker/u16:1+events_unbound11:50:516
2398108993230,2cyclictest2677868-21kworker/u16:3+flush-8:009:54:206
2398108993230,2cyclictest2677868-21kworker/u16:3+events_unbound09:48:486
2398108993230,2cyclictest2397866-21kworker/u16:1+events_unbound07:43:476
2398108993230,2cyclictest2370536-21kworker/u16:2+events_unbound09:09:126
2398108993230,2cyclictest2370536-21kworker/u16:2+events_unbound08:00:186
2398106993230,2cyclictest2370536-21kworker/u16:2+flush-8:008:44:135
2398108993129,2cyclictest2487924-21kworker/u16:0+events_unbound08:46:576
29936372300,1chrt0-21swapper/411:34:034
2398108993028,2cyclictest2397866-21kworker/u16:1+events_unbound07:45:586
2398108993028,2cyclictest2397866-21kworker/u16:1+events_unbound07:28:276
2398108993028,2cyclictest2370536-21kworker/u16:2+flush-8:009:04:126
25982912290,1chrt2598292-21kthreadcore08:44:077
2398108992927,2cyclictest2602365-21kworker/u16:1+events_unbound08:52:236
2398108992927,2cyclictest2458893-21kworker/u16:3+events_unbound07:57:036
2398108992927,2cyclictest2370536-21kworker/u16:2+events_unbound07:38:026
2398108992926,2cyclictest2370536-21kworker/u16:2+events_unbound08:59:026
27795892280,1chrt2779590-21kthreadcore10:04:067
2398108992826,2cyclictest2487924-21kworker/u16:0+events_unbound08:25:586
2398108992826,2cyclictest2397866-21kworker/u16:1+events_unbound07:20:466
2398106992826,2cyclictest2898453-21kworker/u16:3+flush-8:011:25:515
2398106992826,2cyclictest2847887-21kworker/u16:2+flush-8:010:58:415
2398106992826,2cyclictest2847887-21kworker/u16:2+flush-8:010:58:415
2398106992826,2cyclictest2612272-21kworker/u16:3+flush-8:008:58:415
28814872270,1chrt2881485-21ssh10:44:537
27021092270,1chrt2702110-21ssh09:31:447
2398108992725,2cyclictest875378-21kworker/u16:3+events_unbound07:08:066
2398108992725,2cyclictest2612272-21kworker/u16:3+events_unbound08:57:346
2398108992725,2cyclictest2397866-21kworker/u16:1+flush-8:007:09:056
2398108992725,2cyclictest2370536-21kworker/u16:2+events_unbound08:37:096
2398101992725,2cyclictest2458893-21kworker/u16:3+flush-8:007:33:464
2398101992725,2cyclictest2458893-21kworker/u16:3+flush-8:007:33:464
31222272260,1chrt3122228-21ssh12:25:047
2398111992621,4cyclictest3052061-21latency_hist11:58:467
2398106992624,2cyclictest2487924-21kworker/u16:0+flush-8:008:49:185
2398106992623,2cyclictest2992092-21kworker/u16:1+events_unbound11:59:015
2398111992523,1cyclictest2440113-21sed07:23:467
239811199250,24cyclictest2679256-21cat09:23:477
2398108992523,2cyclictest2544702-21kworker/u16:1+events_unbound08:21:196
2398108992523,2cyclictest2487924-21kworker/u16:0+events_unbound08:17:136
2398106992523,2cyclictest2554479-21kworker/u16:3+flush-8:008:28:465
2398101992522,2cyclictest2751289-21kworker/u16:1+flush-8:011:19:154
2398111992419,4cyclictest2487720-21latency_hist07:48:477
2398108992422,2cyclictest2397866-21kworker/u16:1+events_unbound07:17:036
2398106992422,2cyclictest2978481-21kworker/u16:6+events_unbound11:29:015
2398106992422,2cyclictest2751289-21kworker/u16:1+flush-8:010:14:185
2398106992422,2cyclictest2751289-21kworker/u16:1+flush-8:010:14:185
2398106992421,2cyclictest2847887-21kworker/u16:2+flush-8:010:58:565
2398106992321,2cyclictest2370536-21kworker/u16:2+flush-8:009:39:215
2398106992321,2cyclictest2370536-21kworker/u16:2+flush-8:009:14:175
2398106992220,2cyclictest2388091-21kworker/u16:0+flush-8:007:29:105
2398106992220,2cyclictest2388091-21kworker/u16:0+flush-8:007:29:105
2398106992220,2cyclictest2370536-21kworker/u16:2+flush-8:009:59:215
2398101992220,2cyclictest2832419-21kworker/u16:3+flush-8:010:24:214
2398106992118,2cyclictest2992092-21kworker/u16:1+flush-8:012:19:155
2398101992119,2cyclictest2847887-21kworker/u16:2+flush-8:010:44:174
2398106992018,2cyclictest2978132-21kworker/u16:0+flush-8:011:39:005
2398101992016,3cyclictest2487924-21kworker/u16:0+flush-8:008:34:134
2398106991917,2cyclictest2388091-21kworker/u16:0+flush-8:007:04:125
2398111991815,2cyclictest1267-21snmpd11:00:167
2398106991816,2cyclictest2898453-21kworker/u16:3+flush-8:011:19:305
239811199169,6cyclictest0-21swapper/711:19:017
2398111991613,2cyclictest0-21swapper/709:24:137
2398111991611,4cyclictest2525980-21latency_hist08:08:467
2398111991611,4cyclictest2430444-21latency_hist07:18:467
2398111991610,5cyclictest3016015-21latency_hist11:43:467
2398101991613,2cyclictest2458893-21kworker/u16:3+flush-8:008:04:044
239811199158,6cyclictest0-21swapper/710:19:027
2398106991513,2cyclictest2751289-21kworker/u16:1+events_unbound11:09:135
2398106991513,2cyclictest2370536-21kworker/u16:2+flush-8:009:33:585
2398106991513,2cyclictest2370536-21kworker/u16:2+flush-8:009:33:585
2398106991513,2cyclictest2370536-21kworker/u16:2+flush-8:009:19:025
2398106991513,2cyclictest2370536-21kworker/u16:2+flush-8:007:44:125
2398101991513,2cyclictest2388091-21kworker/u16:0+flush-8:007:13:424
239810199150,1cyclictest0-21swapper/409:29:214
239811199149,4cyclictest2531381-21grep08:09:087
239811199147,6cyclictest0-21swapper/712:21:137
239811199147,6cyclictest0-21swapper/711:14:177
239811199147,6cyclictest0-21swapper/710:54:487
239811199147,6cyclictest0-21swapper/710:54:487
239811199146,7cyclictest0-21swapper/709:14:007
239811199145,8cyclictest0-21swapper/709:36:387
239811199145,8cyclictest0-21swapper/709:36:387
239811199141,3cyclictest2856474-21ntp_states10:34:157
2398111991411,2cyclictest2886408-21kthreadcore10:49:067
2398111991411,2cyclictest0-21swapper/710:14:147
2398111991411,2cyclictest0-21swapper/710:14:147
239811199140,13cyclictest1267-21snmpd09:00:227
2398106991413,1cyclictest0-21swapper/512:05:535
2398106991412,2cyclictest2978132-21kworker/u16:0+events_unbound12:24:105
2398106991412,2cyclictest2751289-21kworker/u16:1+flush-8:010:34:015
239810699140,1cyclictest0-21swapper/510:10:015
239810699140,14cyclictest0-21swapper/509:30:455
239810699140,14cyclictest0-21swapper/509:13:065
2398101991413,1cyclictest0-21swapper/412:22:274
2398101991413,1cyclictest0-21swapper/412:15:504
2398101991413,1cyclictest0-21swapper/412:09:124
2398101991413,1cyclictest0-21swapper/411:33:444
2398101991413,1cyclictest0-21swapper/409:57:244
2398101991413,1cyclictest0-21swapper/409:50:574
239810199140,14cyclictest0-21swapper/411:51:424
239810199140,14cyclictest0-21swapper/411:13:144
239810199140,14cyclictest0-21swapper/409:16:164
239811199139,3cyclictest96-21ksoftirqd/709:03:597
239811199139,3cyclictest2440415-21/usr/sbin/munin07:24:017
239811199139,3cyclictest1267-21snmpd10:31:217
239811199138,4cyclictest2497543-21cat07:53:477
239811199136,6cyclictest0-21swapper/712:04:267
239811199136,6cyclictest0-21swapper/711:49:237
239811199136,6cyclictest0-21swapper/710:39:377
239811199136,6cyclictest0-21swapper/710:24:367
239811199136,6cyclictest0-21swapper/710:09:007
239811199136,6cyclictest0-21swapper/709:54:547
239811199136,6cyclictest0-21swapper/709:39:137
239811199135,7cyclictest0-21swapper/712:29:167
239811199135,7cyclictest0-21swapper/711:59:307
239811199135,7cyclictest0-21swapper/711:05:497
239811199135,7cyclictest0-21swapper/709:58:477
239811199135,6cyclictest0-21swapper/711:28:477
239811199134,8cyclictest3081617-21kthreadcore12:09:077
239811199134,8cyclictest2730013-21cut09:44:047
2398111991310,2cyclictest2555680-21perl08:23:597
2398111991310,2cyclictest2497667-21/usr/sbin/munin07:54:157
239811199130,11cyclictest2470276-21kthreadcore07:39:037
2398106991312,1cyclictest0-21swapper/510:25:185
2398106991312,1cyclictest0-21swapper/509:04:075
2398106991311,2cyclictest2370536-21kworker/u16:2+events_unbound09:48:465
239810699130,0cyclictest0-21swapper/511:45:525
239810199139,3cyclictest2399108-21cat07:04:054
2398101991312,1cyclictest0-21swapper/411:15:274
2398101991312,1cyclictest0-21swapper/409:44:294
2398101991312,1cyclictest0-21swapper/409:09:384
239810199130,13cyclictest0-21swapper/410:16:484
239810199130,13cyclictest0-21swapper/410:16:484
239811199129,2cyclictest2544112-21ntpq08:14:127
239811199129,2cyclictest0-21swapper/707:29:027
239811199129,2cyclictest0-21swapper/707:29:027
239811199128,3cyclictest5944-21gmain08:54:097
239811199128,3cyclictest1267-21snmpd08:40:547
239811199128,3cyclictest1267-21snmpd07:59:027
239811199128,3cyclictest1267-21snmpd07:05:077
239811199125,6cyclictest0-21swapper/709:48:597
239811199120,11cyclictest2411871-21grep07:08:597
2398106991211,1cyclictest0-21swapper/511:06:185
2398106991211,1cyclictest0-21swapper/510:47:415
2398106991211,1cyclictest0-21swapper/510:23:065
2398106991211,1cyclictest0-21swapper/509:01:455
2398106991210,2cyclictest2388091-21kworker/u16:0+flush-8:007:09:445
239810699120,0cyclictest0-21swapper/511:34:215
2398101991211,1cyclictest0-21swapper/410:18:514
2398101991211,1cyclictest0-21swapper/409:24:564
2398101991211,1cyclictest0-21swapper/408:32:174
239810199120,1cyclictest0-21swapper/407:57:354
239811199110,3cyclictest2568817-21kthreadcore08:29:057
239810699119,2cyclictest2787901-21kworker/u16:0+flush-8:010:29:535
2398106991110,1cyclictest0-21swapper/508:39:035
2398106991110,1cyclictest0-21swapper/508:13:495
2398106991110,1cyclictest0-21swapper/508:05:375
239810199119,2cyclictest2978245-21kworker/u16:4+events_unbound11:26:004
2398101991110,1cyclictest0-21swapper/412:28:554
2398101991110,1cyclictest0-21swapper/412:04:474
2398101991110,1cyclictest0-21swapper/410:54:104
2398101991110,1cyclictest0-21swapper/410:54:104
2398101991110,1cyclictest0-21swapper/408:53:344
2398101991110,1cyclictest0-21swapper/408:13:404
2398101991110,1cyclictest0-21swapper/407:44:024
2398101991110,1cyclictest0-21swapper/407:24:484
239810199110,1cyclictest0-21swapper/408:03:354
239810199110,11cyclictest0-21swapper/408:21:524
239810199110,11cyclictest0-21swapper/408:17:464
239810199110,11cyclictest0-21swapper/407:37:444
239810699109,1cyclictest0-21swapper/512:14:435
239810699109,1cyclictest0-21swapper/512:10:185
239810699109,1cyclictest0-21swapper/510:40:555
239810699109,1cyclictest0-21swapper/510:05:365
239810699109,1cyclictest0-21swapper/509:54:435
239810699109,1cyclictest0-21swapper/508:22:115
239810699109,1cyclictest0-21swapper/507:57:355
239810699109,1cyclictest0-21swapper/507:13:555
239810699108,2cyclictest2554479-21kworker/u16:3+flush-8:008:29:035
239810699107,2cyclictest2458893-21kworker/u16:3+flush-8:007:59:265
239810699100,10cyclictest0-21swapper/507:39:375
239810199109,1cyclictest0-21swapper/411:05:594
239810199109,1cyclictest0-21swapper/410:01:404
239810199109,1cyclictest0-21swapper/409:35:494
239810199109,1cyclictest0-21swapper/409:35:494
239810199109,1cyclictest0-21swapper/408:25:584
23981069998,1cyclictest0-21swapper/511:50:175
23981069998,1cyclictest0-21swapper/508:34:475
23981069998,1cyclictest0-21swapper/508:11:465
23981069998,1cyclictest0-21swapper/507:24:195
23981019998,1cyclictest0-21swapper/411:42:434
23981019998,1cyclictest0-21swapper/411:03:374
23981019998,1cyclictest0-21swapper/408:58:174
23981019987,1cyclictest0-21swapper/410:49:454
23981019987,1cyclictest0-21swapper/409:20:314
23981019987,1cyclictest0-21swapper/409:05:134
23981019987,1cyclictest0-21swapper/408:46:564
23981019987,1cyclictest0-21swapper/407:22:454
23981019986,2cyclictest2370536-21kworker/u16:2+flush-8:008:43:474
23981019980,7cyclictest0-21swapper/407:51:364
23981069976,1cyclictest0-21swapper/507:37:245
23981019976,1cyclictest0-21swapper/410:29:534
23981019976,1cyclictest0-21swapper/407:39:474
23981019976,1cyclictest0-21swapper/407:14:244
23981019972,1cyclictest0-21swapper/408:58:504
23981019965,1cyclictest0-21swapper/410:12:234
23981019960,5cyclictest5755-21JS21:50:164
23981019960,2cyclictest0-21swapper/411:53:484
23981019960,1cyclictest0-21swapper/410:38:554
23981019950,5cyclictest0-21swapper/412:24:034
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional