You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 20:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sun May 31, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1684397996260,2cyclictest2268560-21kworker/u16:3+events_unbound12:27:195
168401625848,7sleep40-21swapper/407:05:374
1684397995755,2cyclictest2341130-21kworker/u16:2+events_unbound12:02:125
1684397995452,2cyclictest2169454-21kworker/u16:5+flush-8:011:52:235
1684397995351,2cyclictest972153-21kworker/u16:2+flush-8:011:42:095
168386525342,7sleep50-21swapper/507:03:305
1684397995149,2cyclictest2305954-21kworker/u16:0+events_unbound12:32:265
1684397995149,2cyclictest2124041-21kworker/u16:0+events_unbound11:27:115
1684397995149,2cyclictest2124041-21kworker/u16:0+events_unbound11:12:265
1684409994846,1cyclictest1918623-21diskmemload12:07:277
1684409994846,1cyclictest1918623-21diskmemload12:07:277
1684395994744,2cyclictest2124041-21kworker/u16:0+flush-8:011:03:334
1684397994643,2cyclictest2124041-21kworker/u16:0+events_unbound11:22:085
1684409994541,2cyclictest2350481-21users12:02:307
1684397994543,2cyclictest972153-21kworker/u16:2+events_unbound11:47:235
1684395994543,2cyclictest1752622-21kworker/u16:1+flush-8:008:16:544
1684409994239,2cyclictest2294732-21kthreadcore11:42:127
1684397994139,2cyclictest972153-21kworker/u16:2+events_unbound11:19:125
1684397994139,2cyclictest2169454-21kworker/u16:5+events_unbound11:02:225
1684395994138,2cyclictest972153-21kworker/u16:2+flush-8:008:26:544
1684397994038,2cyclictest2305954-21kworker/u16:0+events_unbound11:57:135
1684397994038,2cyclictest2268560-21kworker/u16:3+events_unbound12:14:435
1684397994038,2cyclictest1880200-21kworker/u16:0+events_unbound09:34:295
1684397994037,2cyclictest1752622-21kworker/u16:1+flush-8:008:17:215
168440999380,36cyclictest1940811-21ssh09:13:297
168440999380,36cyclictest1930593-21latency_hist09:11:547
1684397993836,2cyclictest972153-21kworker/u16:2+events_unbound09:15:365
1684397993836,2cyclictest2305954-21kworker/u16:0+events_unbound12:10:235
1684397993836,2cyclictest2305954-21kworker/u16:0+events_unbound12:10:235
1684397993836,2cyclictest2268560-21kworker/u16:3+events_unbound12:22:125
1684397993836,2cyclictest1880200-21kworker/u16:0+events_unbound09:58:085
1684397993835,2cyclictest2124041-21kworker/u16:0+events_unbound10:52:365
16800152382,30sleep70-21swapper/707:02:197
1684409993734,2cyclictest2414065-21df12:32:087
1684397993735,2cyclictest972153-21kworker/u16:2+events_unbound10:43:315
1684397993735,2cyclictest2365102-21kworker/u16:1+events_unbound12:20:405
1684397993735,2cyclictest2268560-21kworker/u16:3+events_unbound11:33:155
1684397993735,2cyclictest2024440-21kworker/u16:1+events_unbound10:18:245
1684397993735,2cyclictest1880200-21kworker/u16:0+events_unbound10:03:135
1684397993735,2cyclictest1880200-21kworker/u16:0+events_unbound09:08:495
1684395993735,2cyclictest2268560-21kworker/u16:3+events_unbound12:21:544
1684397993634,2cyclictest972153-21kworker/u16:2+flush-8:010:35:565
1684397993634,2cyclictest972153-21kworker/u16:2+flush-8:007:07:235
1684397993634,2cyclictest972153-21kworker/u16:2+events_unbound11:01:165
1684397993634,2cyclictest972153-21kworker/u16:2+events_unbound09:48:535
1684397993634,2cyclictest972153-21kworker/u16:2+events_unbound08:36:565
1684397993634,2cyclictest2169454-21kworker/u16:5+events_unbound10:50:095
1684397993634,2cyclictest2169454-21kworker/u16:5+events_unbound10:50:095
1684397993632,2cyclictest1880200-21kworker/u16:0+events_unbound09:28:205
1684397993533,2cyclictest972153-21kworker/u16:2+events_unbound10:38:455
1684397993533,2cyclictest2124041-21kworker/u16:0+events_unbound11:09:575
1684395993532,2cyclictest1850393-21kworker/u16:3+flush-8:009:01:544
1684409993431,2cyclictest1851359-21munin-run08:31:547
1684409993431,2cyclictest1793716-21perf08:01:547
1684397993432,2cyclictest972153-21kworker/u16:2+events_unbound09:38:205
1684397993432,2cyclictest972153-21kworker/u16:2+events_unbound09:25:525
1684397993432,2cyclictest2024440-21kworker/u16:1+events_unbound09:53:445
1684395993432,2cyclictest1674589-21kworker/u16:0+flush-8:007:21:544
1684409993331,1cyclictest1918623-21diskmemload10:35:087
1684409993331,1cyclictest1918623-21diskmemload10:08:487
1684409993331,1cyclictest1918623-21diskmemload10:08:487
1684409993331,1cyclictest0-21swapper/712:27:097
1684401993331,2cyclictest2063312-21kworker/u16:3+events_unbound10:47:096
1684401993331,2cyclictest2063312-21kworker/u16:3+events_unbound10:47:096
1684401993327,6cyclictest1880200-21kworker/u16:0+events_unbound10:02:266
1684397993331,2cyclictest972153-21kworker/u16:2+events_unbound10:28:495
1684397993331,2cyclictest1880200-21kworker/u16:0+events_unbound10:08:575
1684397993331,2cyclictest1880200-21kworker/u16:0+events_unbound10:08:575
1684395993331,2cyclictest2305954-21kworker/u16:0+flush-8:012:12:204
22814442320,1chrt2281445-21df11:37:067
1684409993231,0cyclictest0-21swapper/712:01:047
1684409993230,1cyclictest1918623-21diskmemload10:39:247
1684409993230,1cyclictest1918623-21diskmemload10:13:047
1684397993230,2cyclictest972153-21kworker/u16:2+events_unbound09:21:285
1684397993229,2cyclictest2063312-21kworker/u16:3+events_unbound10:11:555
1684395993230,2cyclictest2268560-21kworker/u16:3+flush-8:012:32:094
1684409993129,1cyclictest2207219-21ssh11:05:047
1684401993129,2cyclictest1752622-21kworker/u16:1+events_unbound08:02:096
1684401993129,2cyclictest1674589-21kworker/u16:0+events_unbound07:37:086
1684401993129,2cyclictest1674589-21kworker/u16:0+events_unbound07:22:236
1684397993129,2cyclictest972153-21kworker/u16:2+events_unbound09:03:295
1684397993129,2cyclictest2268560-21kworker/u16:3+flush-8:011:37:105
1684397993128,2cyclictest972153-21kworker/u16:2+events_unbound07:56:585
1684397993028,2cyclictest972153-21kworker/u16:2+events_unbound08:33:335
1684397993028,2cyclictest1821591-21kworker/u16:4+events_unbound08:27:335
1684395993028,2cyclictest972153-21kworker/u16:2+events_unbound07:41:554
1684395993028,2cyclictest2169454-21kworker/u16:5+events_unbound11:32:124
24064212290,1chrt0-21swapper/612:27:146
1684409992928,0cyclictest0-21swapper/711:56:037
1684409992928,0cyclictest0-21swapper/711:21:087
1684409992928,0cyclictest0-21swapper/710:25:247
1684409992927,1cyclictest1918623-21diskmemload12:17:117
1684409992926,2cyclictest1954823-21cat09:21:557
1684397992927,2cyclictest2024440-21kworker/u16:1+events_unbound10:24:355
1684397992927,2cyclictest1990680-21kworker/u16:3+events_unbound09:46:295
1684397992926,2cyclictest1674589-21kworker/u16:0+events_unbound07:52:055
1684395992926,2cyclictest972153-21kworker/u16:2+events_unbound10:22:144
22319742280,1chrt2231972-21ssh11:16:147
1684409992826,1cyclictest1918623-21diskmemload10:49:567
1684409992826,1cyclictest1918623-21diskmemload10:49:567
1684395992826,2cyclictest2169454-21kworker/u16:5+events_unbound11:57:194
1684409992726,0cyclictest0-21swapper/712:16:037
1684409992725,1cyclictest1918623-21diskmemload11:09:437
1684397992725,2cyclictest1709170-21kworker/u16:4+events_unbound07:35:055
1684395992725,2cyclictest972153-21kworker/u16:2+flush-8:010:37:204
1684395992725,2cyclictest972153-21kworker/u16:2+flush-8:009:56:494
1684395992724,2cyclictest972153-21kworker/u16:2+flush-8:009:46:554
1684395992724,2cyclictest2341130-21kworker/u16:2+flush-8:012:02:234
168387722717,7sleep60-21swapper/607:03:396
1684409992625,0cyclictest0-21swapper/709:51:497
1684409992625,0cyclictest0-21swapper/709:24:087
1684409992624,1cyclictest1918623-21diskmemload09:37:337
1684401992624,2cyclictest972153-21kworker/u16:2+events_unbound08:22:216
1684401992624,2cyclictest2305954-21kworker/u16:0+events_unbound11:56:166
1684397992624,2cyclictest1752622-21kworker/u16:1+flush-8:007:43:035
1684397992623,2cyclictest1752622-21kworker/u16:1+events_unbound08:06:295
1684395992624,2cyclictest2124041-21kworker/u16:0+events_unbound11:37:274
1684409992520,4cyclictest1870572-21latency_hist08:41:547
1684401992523,2cyclictest1850393-21kworker/u16:3+events_unbound09:07:166
1684397992522,2cyclictest1880200-21kworker/u16:0+events_unbound08:56:565
1684395992523,2cyclictest972153-21kworker/u16:2+events_unbound11:17:194
1684395992522,2cyclictest2124041-21kworker/u16:0+flush-8:011:27:084
1684409992421,2cyclictest1774468-21latency_hist07:51:557
1684409992419,4cyclictest2123617-21latency_hist10:31:547
1684401992422,2cyclictest972153-21kworker/u16:2+events_unbound10:31:296
1684401992422,2cyclictest972153-21kworker/u16:2+events_unbound08:27:226
1684401992422,2cyclictest2389107-21kworker/u16:4+events_unbound12:35:596
1684401992422,2cyclictest1880200-21kworker/u16:0+events_unbound09:28:446
1684397992422,2cyclictest1674589-21kworker/u16:0+events_unbound07:39:055
1684409992322,0cyclictest0-21swapper/709:33:437
1684409992322,0cyclictest0-21swapper/707:36:517
168440999230,21cyclictest2310675-21grep11:47:157
1684401992321,2cyclictest972153-21kworker/u16:2+events_unbound07:17:166
1684401992321,2cyclictest2169454-21kworker/u16:5+events_unbound11:20:016
1684401992321,2cyclictest2169454-21kworker/u16:5+events_unbound11:08:596
1684401992321,2cyclictest1943077-21kworker/u16:1+events_unbound09:18:036
1684401992321,2cyclictest1674589-21kworker/u16:0+events_unbound07:36:496
1684401992319,2cyclictest1880200-21kworker/u16:0+events_unbound09:50:476
1684395992321,2cyclictest2124041-21kworker/u16:0+flush-8:011:08:044
1684401992220,2cyclictest972153-21kworker/u16:2+events_unbound10:57:176
1684401992220,2cyclictest972153-21kworker/u16:2+events_unbound10:38:496
1684401992220,2cyclictest972153-21kworker/u16:2+events_unbound08:51:496
1684401992220,2cyclictest2024440-21kworker/u16:1+events_unbound10:22:166
1684401992220,2cyclictest1990680-21kworker/u16:3+events_unbound09:45:286
1684397992220,2cyclictest972153-21kworker/u16:2+events_unbound07:20:045
1684397992220,2cyclictest1752622-21kworker/u16:1+events_unbound08:23:085
1684395992220,2cyclictest972153-21kworker/u16:2+flush-8:008:47:204
1684395992220,2cyclictest1990680-21kworker/u16:3+flush-8:009:37:124
1684409992120,0cyclictest0-21swapper/710:04:417
1684409992120,0cyclictest0-21swapper/709:45:077
1684409992119,1cyclictest0-21swapper/710:58:217
1684401992119,2cyclictest972153-21kworker/u16:2+events_unbound10:43:016
1684401992119,2cyclictest972153-21kworker/u16:2+events_unbound10:20:136
1684401992119,2cyclictest972153-21kworker/u16:2+events_unbound07:52:256
1684401992119,2cyclictest2341130-21kworker/u16:2+events_unbound12:04:096
1684401992119,2cyclictest2268560-21kworker/u16:3+events_unbound12:19:166
1684401992119,2cyclictest2124041-21kworker/u16:0+events_unbound11:24:006
1684401992118,3cyclictest1674589-21kworker/u16:0+flush-8:007:27:206
1684397992119,2cyclictest1850393-21kworker/u16:3+events_unbound08:44:085
1684395992119,2cyclictest1674589-21kworker/u16:0+flush-8:007:57:234
1684409992019,0cyclictest0-21swapper/710:45:327
1684409992014,5cyclictest2256449-21latency_hist11:26:537
1684401992018,2cyclictest972153-21kworker/u16:2+events_unbound10:34:086
1684401992018,2cyclictest972153-21kworker/u16:2+events_unbound10:15:576
1684401992018,2cyclictest972153-21kworker/u16:2+events_unbound10:01:066
1684401992018,2cyclictest2305954-21kworker/u16:0+events_unbound12:23:156
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound12:14:396
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound12:08:206
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound12:08:206
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound11:51:516
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound11:43:286
1684401992018,2cyclictest2268560-21kworker/u16:3+events_unbound11:36:206
1684397992018,2cyclictest1752622-21kworker/u16:1+events_unbound08:10:085
1684397992018,2cyclictest1752622-21kworker/u16:1+events_unbound08:10:085
1684397992018,2cyclictest1674589-21kworker/u16:0+events_unbound07:27:045
1684395992018,2cyclictest972153-21kworker/u16:2+flush-8:008:52:334
1684395992018,2cyclictest972153-21kworker/u16:2+flush-8:008:52:334
1684395992018,2cyclictest972153-21kworker/u16:2+flush-8:008:27:154
1684395992018,2cyclictest2305954-21kworker/u16:0+events_unbound11:47:194
1684395992018,2cyclictest1674589-21kworker/u16:0+flush-8:007:31:504
1684395992017,2cyclictest1990680-21kworker/u16:3+flush-8:009:42:134
1684409991916,1cyclictest1918623-21diskmemload10:52:197
1684409991914,4cyclictest635-21systemd-journal08:26:497
1684401991917,2cyclictest972153-21kworker/u16:2+events_unbound11:28:296
1684401991917,2cyclictest972153-21kworker/u16:2+events_unbound09:16:446
1684401991917,2cyclictest972153-21kworker/u16:2+events_unbound08:42:116
1684401991917,2cyclictest2305954-21kworker/u16:0+events_unbound11:58:516
1684401991917,2cyclictest2124041-21kworker/u16:0+events_unbound10:55:286
1684397991917,2cyclictest972153-21kworker/u16:2+events_unbound07:16:415
1684395991917,2cyclictest972153-21kworker/u16:2+flush-8:010:27:094
1684395991917,2cyclictest972153-21kworker/u16:2+events_unbound10:58:184
168439599190,18cyclictest0-21swapper/410:10:274
168439599190,18cyclictest0-21swapper/410:10:274
1684409991816,1cyclictest2259040-21ssh11:27:137
1684409991815,2cyclictest2036159-21ssh09:52:177
168440999180,16cyclictest2280725-21ssh11:36:547
1684401991816,2cyclictest2268560-21kworker/u16:3+events_unbound11:39:486
1684401991816,2cyclictest2169454-21kworker/u16:5+events_unbound11:14:236
1684401991816,2cyclictest1850393-21kworker/u16:3+events_unbound09:05:036
1684401991816,2cyclictest1752622-21kworker/u16:1+events_unbound08:17:146
1684401991816,2cyclictest1752622-21kworker/u16:1+events_unbound07:46:046
1684401991816,2cyclictest1674589-21kworker/u16:0+events_unbound07:47:206
1684395991816,2cyclictest1880200-21kworker/u16:0+events_unbound10:03:054
1684395991815,3cyclictest1880200-21kworker/u16:0+events_unbound09:22:224
1684409991715,1cyclictest0-21swapper/707:17:207
168440999170,1cyclictest0-21swapper/708:57:187
1684401991715,2cyclictest2124041-21kworker/u16:0+events_unbound11:05:166
1684401991715,2cyclictest1880200-21kworker/u16:0+events_unbound10:08:166
1684401991715,2cyclictest1880200-21kworker/u16:0+events_unbound10:08:166
1684401991715,2cyclictest1880200-21kworker/u16:0+events_unbound09:33:236
1684401991715,2cyclictest1752622-21kworker/u16:1+events_unbound08:13:046
1684397991715,2cyclictest972153-21kworker/u16:2+flush-8:008:53:325
1684397991715,2cyclictest972153-21kworker/u16:2+flush-8:008:53:325
1684397991715,2cyclictest1674589-21kworker/u16:0+flush-8:007:47:195
1684395991715,2cyclictest1850393-21kworker/u16:3+flush-8:009:27:204
1684395991714,2cyclictest2341130-21kworker/u16:2+events_unbound12:07:074
1684395991714,2cyclictest2341130-21kworker/u16:2+events_unbound12:07:074
1684395991713,3cyclictest1752622-21kworker/u16:1+flush-8:007:42:204
1684409991615,0cyclictest0-21swapper/712:23:527
1684409991614,1cyclictest0-21swapper/708:12:097
1684409991613,2cyclictest0-21swapper/709:56:557
168440999160,14cyclictest1707227-21latency_hist07:16:547
168440999160,14cyclictest0-21swapper/707:27:197
1684401991614,2cyclictest972153-21kworker/u16:2+events_unbound08:38:036
1684397991614,2cyclictest972153-21kworker/u16:2+events_unbound08:47:185
1684397991614,2cyclictest1752622-21kworker/u16:1+events_unbound08:15:565
1684395991614,2cyclictest2268560-21kworker/u16:3+events_unbound11:52:264
1684395991614,2cyclictest2124041-21kworker/u16:0+events_unbound10:53:034
1684395991614,2cyclictest2024440-21kworker/u16:1+events_unbound10:00:044
1684395991614,2cyclictest1850393-21kworker/u16:3+events_unbound09:12:054
1684409991514,0cyclictest0-21swapper/708:06:047
1684409991514,0cyclictest0-21swapper/707:42:127
168440999150,14cyclictest1860988-21turbostat08:36:547
1684401991513,2cyclictest972153-21kworker/u16:2+events_unbound07:57:576
1684401991512,2cyclictest1895411-21cut08:52:146
1684401991512,2cyclictest1895411-21cut08:52:146
1684397991513,2cyclictest1674589-21kworker/u16:0+events_unbound07:24:325
1684395991513,2cyclictest1821591-21kworker/u16:4+events_unbound08:37:144
168440999149,4cyclictest1918622-21latency_hist09:06:547
1684409991413,0cyclictest0-21swapper/708:47:127
1684409991410,3cyclictest1234-21snmpd07:41:037
168440199148,5cyclictest1960438-21kthreadcore09:22:136
1684401991412,2cyclictest972153-21kworker/u16:2+events_unbound07:16:516
1684401991412,2cyclictest2024440-21kworker/u16:1+events_unbound09:54:576
1684401991412,2cyclictest1821591-21kworker/u16:4+events_unbound08:36:526
1684401991412,2cyclictest1752622-21kworker/u16:1+events_unbound08:10:556
1684401991412,2cyclictest1752622-21kworker/u16:1+events_unbound08:10:556
1684401991411,2cyclictest1906878-21kthreadcore08:57:146
1684395991412,2cyclictest972153-21kworker/u16:2+flush-8:009:17:164
1684395991412,2cyclictest2124041-21kworker/u16:0+events_unbound11:25:044
168439599140,14cyclictest0-21swapper/410:12:194
168439599140,13cyclictest0-21swapper/410:47:204
168439599140,13cyclictest0-21swapper/410:47:204
16926862130,0sleep71692688-21cat07:07:167
1684409991311,1cyclictest1918623-21diskmemload09:27:057
1684395991312,1cyclictest0-21swapper/411:12:384
1684395991312,1cyclictest0-21swapper/410:21:434
1684395991311,2cyclictest972153-21kworker/u16:2+events_unbound09:02:194
1684395991311,2cyclictest972153-21kworker/u16:2+events_unbound07:07:184
1684395991311,2cyclictest2063312-21kworker/u16:3+events_unbound10:42:284
1684395991311,2cyclictest1880200-21kworker/u16:0+flush-8:009:32:174
1684395991311,2cyclictest1752622-21kworker/u16:1+flush-8:008:02:224
168439599130,6cyclictest0-21swapper/407:47:094
168440999128,3cyclictest1234-21snmpd07:53:337
168440999128,3cyclictest1234-21snmpd07:25:187
168440999124,7cyclictest5975-21gmain08:42:197
1684401991210,2cyclictest972153-21kworker/u16:2+events_unbound09:39:426
1684395991211,1cyclictest0-21swapper/412:25:574
1684395991210,2cyclictest1752622-21kworker/u16:1+events_unbound08:07:164
1684395991210,2cyclictest1752622-21kworker/u16:1+events_unbound08:07:164
168440999118,2cyclictest1234-21snmpd10:17:127
168440999118,2cyclictest1234-21snmpd08:08:527
168440999118,2cyclictest1234-21snmpd08:08:527
168440999117,3cyclictest5822-21gmain08:17:157
168440999115,4cyclictest6382-21gvfs-afc-volume08:52:157
168440999115,4cyclictest6382-21gvfs-afc-volume08:52:157
168440199119,2cyclictest1657666-21kworker/u16:1+events_unbound07:10:046
168439599119,2cyclictest1674589-21kworker/u16:0+events_unbound07:52:074
168439599118,2cyclictest972153-21kworker/u16:2+events_unbound09:07:044
168439599118,2cyclictest2305954-21kworker/u16:0+events_unbound12:26:594
168439599110,11cyclictest0-21swapper/408:34:404
168439599107,2cyclictest1870963-21/usr/sbin/munin08:42:234
168439599106,3cyclictest1698782-21cat07:12:104
16843959990,8cyclictest0-21swapper/407:32:144
16843959983,4cyclictest2130507-21tr10:32:154
16843959975,2cyclictest1709170-21kworker/u16:4+events_unbound07:22:074
16843959973,3cyclictest1822990-21cpuspeed08:17:064
16843959960,1cyclictest0-21swapper/411:45:424
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional