You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 06:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Apr 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38213912970,1sleep73821393-21date23:34:557
323616325835,7sleep40-21swapper/419:08:414
3236530994946,2cyclictest3403017-21kworker/u16:1+events_unbound20:40:095
3236530994340,2cyclictest3235958-21kworker/u16:2+flush-8:020:20:105
32361002425,32sleep70-21swapper/719:07:487
37947752410,0sleep73794776-21sh23:20:287
3236535994138,2cyclictest3403552-21kworker/u16:2+events_unbound20:34:576
3236535994038,2cyclictest3541702-21kworker/u16:1+events_unbound22:25:086
3236535993937,2cyclictest3557779-21kworker/u16:2+events_unbound21:50:256
3236535993836,2cyclictest3964330-21kworker/u16:3+events_unbound00:34:526
3236539993630,5cyclictest3869819-21latency_hist23:54:557
3236539993630,5cyclictest3259414-21latency_hist19:19:567
3236535993633,2cyclictest3557779-21kworker/u16:2+events_unbound21:54:586
3236535993630,6cyclictest3495238-21kworker/u16:0+events_unbound22:06:486
3236530993633,2cyclictest3794055-21kworker/u16:0+flush-8:023:29:565
323619223626,7sleep60-21swapper/619:09:076
3236535993533,2cyclictest3855136-21kworker/u16:6+events_unbound23:52:166
3236535993533,2cyclictest3557779-21kworker/u16:2+events_unbound22:43:306
3236535993532,2cyclictest3422685-21kworker/u16:0+events_unbound20:50:116
323614623524,8sleep50-21swapper/519:08:265
3236535993432,2cyclictest3870090-21kworker/u16:0+events_unbound00:10:286
3236535993432,2cyclictest3541702-21kworker/u16:1+events_unbound22:18:296
3236535993432,2cyclictest3403552-21kworker/u16:2+events_unbound21:14:086
3236530993432,2cyclictest3891616-21kworker/u16:2+events_unbound00:15:085
3236535993331,2cyclictest3891616-21kworker/u16:2+events_unbound00:03:326
3236535993331,2cyclictest3870090-21kworker/u16:0+events_unbound00:07:176
3236535993331,2cyclictest3794055-21kworker/u16:0+events_unbound23:32:336
3236535993331,2cyclictest3676311-21kworker/u16:3+events_unbound23:29:456
3236535993331,2cyclictest3557779-21kworker/u16:2+events_unbound22:51:456
3236535993331,2cyclictest3557779-21kworker/u16:2+events_unbound22:11:296
3236535993331,2cyclictest3541702-21kworker/u16:1+events_unbound22:21:136
3236535993331,2cyclictest3541702-21kworker/u16:1+events_unbound21:38:026
3236535993331,2cyclictest3529601-21kworker/u16:2+events_unbound21:33:426
3236535993331,2cyclictest3516824-21kworker/u16:3+events_unbound21:29:106
3236530993330,2cyclictest3818622-21kworker/u16:1+events_unbound23:39:575
3236535993230,2cyclictest3833472-21kworker/u16:5+events_unbound23:43:446
3236535993230,2cyclictest3818622-21kworker/u16:1+events_unbound23:45:086
3236535993230,2cyclictest3676311-21kworker/u16:3+events_unbound23:24:386
3236535993230,2cyclictest3640437-21kworker/u16:5+events_unbound22:36:106
3236535993230,2cyclictest3591626-21kworker/u16:3+events_unbound22:03:136
3236535993230,2cyclictest3557779-21kworker/u16:2+events_unbound21:48:206
3236535993230,2cyclictest3346210-21kworker/u16:3+events_unbound20:40:216
3236530993230,2cyclictest3676311-21kworker/u16:3+events_unbound23:20:095
3236530993230,2cyclictest3557779-21kworker/u16:2+events_unbound22:55:255
3236535993129,2cyclictest3891616-21kworker/u16:2+events_unbound00:16:286
3236535993129,2cyclictest3676311-21kworker/u16:3+events_unbound22:46:536
3236535993129,2cyclictest3640437-21kworker/u16:5+events_unbound22:33:226
3236535993129,2cyclictest3640437-21kworker/u16:5+events_unbound22:33:226
3236535993129,2cyclictest3495238-21kworker/u16:0+events_unbound21:44:176
3236535993129,2cyclictest3461366-21kworker/u16:1+events_unbound21:23:526
3236535993129,2cyclictest3422685-21kworker/u16:0+events_unbound20:59:386
3236535993128,2cyclictest3346210-21kworker/u16:3+events_unbound20:29:566
3236530993129,2cyclictest3235958-21kworker/u16:2+events_unbound20:04:575
3236535993028,2cyclictest3891616-21kworker/u16:2+events_unbound00:26:536
3236535993028,2cyclictest3760921-21kworker/u16:4+events_unbound23:16:326
3236535993028,2cyclictest3676311-21kworker/u16:3+events_unbound23:04:296
3236535993028,2cyclictest3557779-21kworker/u16:2+events_unbound23:11:336
3236535993028,2cyclictest3557779-21kworker/u16:2+events_unbound23:09:456
3236535993028,2cyclictest3235958-21kworker/u16:2+events_unbound20:00:566
3236535993028,2cyclictest2522455-21kworker/u16:7+events_unbound19:23:056
3236530993028,2cyclictest3891616-21kworker/u16:2+events_unbound00:10:095
3236535992927,2cyclictest3403552-21kworker/u16:2+events_unbound21:19:186
3236535992927,2cyclictest3346210-21kworker/u16:3+flush-8:020:25:156
3236535992927,2cyclictest3346210-21kworker/u16:3+flush-8:020:15:256
3236535992927,2cyclictest3235958-21kworker/u16:2+events_unbound20:20:256
3236535992926,2cyclictest3346210-21kworker/u16:3+events_unbound20:10:056
3236530992928,1cyclictest3870090-21kworker/u16:0+events_unbound00:20:105
36720282280,1chrt3672029-21kthreadcore22:30:207
36720282280,1chrt3672029-21kthreadcore22:30:207
3236535992826,2cyclictest3891616-21kworker/u16:2+flush-8:000:39:366
3236535992826,2cyclictest3891616-21kworker/u16:2+flush-8:000:20:156
3236535992826,2cyclictest3833472-21kworker/u16:5+events_unbound23:55:276
3236535992826,2cyclictest3833472-21kworker/u16:5+events_unbound23:55:276
3236530992826,2cyclictest3557779-21kworker/u16:2+events_unbound22:37:565
3236530992826,2cyclictest3529601-21kworker/u16:2+events_unbound21:34:585
3236530992825,2cyclictest3891616-21kworker/u16:2+events_unbound00:35:005
3236539992726,0cyclictest0-21swapper/722:27:407
3236539992724,1cyclictest3943737-21ssh00:25:097
3236530992725,2cyclictest3557779-21kworker/u16:2+events_unbound21:59:065
3236530992724,2cyclictest3235958-21kworker/u16:2+events_unbound19:55:105
3236535992624,2cyclictest3676311-21kworker/u16:3+events_unbound22:57:386
3236535992624,2cyclictest3403552-21kworker/u16:2+events_unbound21:00:116
3236530992624,2cyclictest3855136-21kworker/u16:6+events_unbound00:00:185
3236530992624,2cyclictest3833471-21kworker/u16:4+events_unbound23:50:095
3236530992624,2cyclictest3557779-21kworker/u16:2+flush-8:023:09:275
3236530992624,2cyclictest3557779-21kworker/u16:2+events_unbound22:30:175
3236530992624,2cyclictest3557779-21kworker/u16:2+events_unbound22:30:175
3236530992624,2cyclictest3403552-21kworker/u16:2+events_unbound21:10:135
3236530992624,2cyclictest2522455-21kworker/u16:7+events_unbound19:24:515
3236539992523,1cyclictest3904024-21ssh00:05:587
3236535992523,2cyclictest3557779-21kworker/u16:2+events_unbound23:37:306
3236535992523,2cyclictest3235958-21kworker/u16:2+events_unbound19:44:066
3236530992523,2cyclictest3794055-21kworker/u16:0+events_unbound23:25:125
3236530992522,2cyclictest3461366-21kworker/u16:1+events_unbound21:25:105
3236539992423,0cyclictest0-21swapper/721:09:187
3236539992423,0cyclictest0-21swapper/721:09:187
3236539992423,0cyclictest0-21swapper/720:32:577
3236535992422,2cyclictest3278715-21kworker/u16:0+events_unbound19:55:206
3236530992422,2cyclictest3591626-21kworker/u16:3+events_unbound22:08:045
3236530992422,2cyclictest3557779-21kworker/u16:2+flush-8:023:00:215
3236530992418,5cyclictest3245891-21kworker/u16:1+flush-8:019:19:565
33441272230,1sleep576-21ksoftirqd/520:00:175
3236539992322,0cyclictest0-21swapper/722:35:247
3236539992322,0cyclictest0-21swapper/720:49:187
3236539992322,0cyclictest0-21swapper/719:29:137
3236539992320,2cyclictest3449682-21grep20:55:187
3236535992321,2cyclictest3235958-21kworker/u16:2+events_unbound19:17:106
3236530992321,2cyclictest3640437-21kworker/u16:5+flush-8:022:25:055
3236530992321,2cyclictest3541702-21kworker/u16:1+events_unbound21:40:095
3236530992321,2cyclictest3495238-21kworker/u16:0+events_unbound21:46:055
3236539992221,0cyclictest0-21swapper/722:42:197
3236539992221,0cyclictest0-21swapper/721:50:427
3236539992220,1cyclictest3843203-21ssh23:40:387
3236535992220,2cyclictest3422685-21kworker/u16:0+flush-8:021:06:046
3236535992220,2cyclictest3422685-21kworker/u16:0+flush-8:021:06:046
3236530992220,2cyclictest3557779-21kworker/u16:2+flush-8:021:54:505
3236530992220,2cyclictest3516824-21kworker/u16:3+events_unbound21:32:065
3236539992120,0cyclictest0-21swapper/722:51:337
3236539992120,0cyclictest0-21swapper/722:17:257
3236539992120,0cyclictest0-21swapper/722:11:377
3236539992120,0cyclictest0-21swapper/722:02:047
3236539992120,0cyclictest0-21swapper/721:02:107
3236539992120,0cyclictest0-21swapper/720:39:137
3236539992120,0cyclictest0-21swapper/720:28:537
3236539992120,0cyclictest0-21swapper/720:19:267
3236539992120,0cyclictest0-21swapper/719:46:257
3236539992116,4cyclictest3652110-21latency_hist22:24:557
3236539992115,5cyclictest3772962-21latency_hist23:14:557
3236535992119,2cyclictest3235958-21kworker/u16:2+events_unbound19:10:236
3236530992119,2cyclictest3818622-21kworker/u16:1+events_unbound23:45:125
3236530992119,2cyclictest3640437-21kworker/u16:5+events_unbound22:20:255
3236530992118,2cyclictest3557779-21kworker/u16:2+events_unbound22:15:045
3236539992019,0cyclictest0-21swapper/720:52:407
3236539992019,0cyclictest0-21swapper/720:42:407
3236539992019,0cyclictest0-21swapper/720:23:387
3236539992019,0cyclictest0-21swapper/720:11:247
3236539992019,0cyclictest0-21swapper/720:08:497
3236539992019,0cyclictest0-21swapper/720:04:027
3236539992018,1cyclictest3976433-21ssh00:35:317
3236539992018,1cyclictest3482753-21latency_hist21:14:557
3236539992018,1cyclictest0-21swapper/722:57:597
3236530992018,2cyclictest3676311-21kworker/u16:3+events_unbound22:47:565
3236530992018,2cyclictest3495238-21kworker/u16:0+events_unbound22:13:055
3236530992018,2cyclictest3403552-21kworker/u16:2+events_unbound21:19:055
3236530992018,2cyclictest3403552-21kworker/u16:2+events_unbound21:00:135
3236539991918,0cyclictest0-21swapper/719:58:097
3236539991918,0cyclictest0-21swapper/719:52:167
3236539991918,0cyclictest0-21swapper/719:42:567
3236539991915,3cyclictest1234-21snmpd21:41:227
3236539991914,4cyclictest3268953-21latency_hist19:24:557
3236535991917,2cyclictest2522455-21kworker/u16:7+flush-8:019:34:056
3236525991915,3cyclictest2522455-21kworker/u16:7+flush-8:021:05:124
3236525991915,3cyclictest2522455-21kworker/u16:7+flush-8:021:05:124
3236539991817,0cyclictest0-21swapper/722:07:217
3236539991815,2cyclictest3832045-21ssh23:37:287
3236535991815,2cyclictest3235958-21kworker/u16:2+flush-8:019:34:566
3236535991815,2cyclictest3235958-21kworker/u16:2+flush-8:019:34:566
3236530991816,2cyclictest3818622-21kworker/u16:1+events_unbound00:05:255
3236530991816,2cyclictest3591626-21kworker/u16:3+events_unbound22:00:255
3236530991816,2cyclictest3557779-21kworker/u16:2+events_unbound23:36:025
3236530991816,2cyclictest3557779-21kworker/u16:2+events_unbound23:10:245
3236530991816,2cyclictest3557779-21kworker/u16:2+events_unbound22:44:465
3236530991816,2cyclictest3495238-21kworker/u16:0+events_unbound21:20:275
3236530991816,2cyclictest2522455-21kworker/u16:7+flush-8:019:50:185
3236539991716,0cyclictest0-21swapper/723:15:357
3236535991715,2cyclictest3235958-21kworker/u16:2+events_unbound19:47:026
3236525991716,1cyclictest3557779-21kworker/u16:2+events_unbound22:02:024
323652599170,7cyclictest0-21swapper/422:46:304
3236539991615,0cyclictest0-21swapper/719:32:127
3236539991615,0cyclictest0-21swapper/719:11:207
3236539991612,3cyclictest3938115-21kthreadcore00:20:187
3236530991614,2cyclictest3870090-21kworker/u16:0+flush-8:000:25:165
3236530991614,2cyclictest3461366-21kworker/u16:1+flush-8:021:07:575
3236530991614,2cyclictest3461366-21kworker/u16:1+flush-8:021:07:575
3236530991614,2cyclictest3245891-21kworker/u16:1+events_unbound19:14:515
3236539991512,2cyclictest0-21swapper/721:55:237
3236535991513,2cyclictest3235958-21kworker/u16:2+events_unbound20:07:276
3236530991513,2cyclictest3760921-21kworker/u16:4+events_unbound23:18:045
3236530991513,2cyclictest2522455-21kworker/u16:7+events_unbound19:32:055
323652599150,14cyclictest0-21swapper/422:19:574
34175412140,0sleep40-21swapper/420:40:144
323653999149,4cyclictest3881962-21latency_hist23:59:557
323653999149,4cyclictest3881962-21latency_hist23:59:557
3236539991413,0cyclictest0-21swapper/723:45:297
3236539991413,0cyclictest0-21swapper/719:39:327
3236539991413,0cyclictest0-21swapper/719:39:327
3236539991412,1cyclictest3760077-21ssh23:08:277
3236535991412,2cyclictest2522455-21kworker/u16:7+events_unbound20:47:006
3236530991412,2cyclictest3855136-21kworker/u16:6+events_unbound23:55:045
3236530991412,2cyclictest3855136-21kworker/u16:6+events_unbound23:55:045
323653099140,1cyclictest0-21swapper/500:32:265
3236525991413,1cyclictest0-21swapper/423:45:054
3236525991413,1cyclictest0-21swapper/423:13:334
3236525991413,1cyclictest0-21swapper/422:40:364
3236525991413,1cyclictest0-21swapper/400:07:294
3236525991412,2cyclictest3235958-21kworker/u16:2+events_unbound19:20:084
323652599140,1cyclictest0-21swapper/421:20:024
323652599140,14cyclictest0-21swapper/421:47:104
323653999138,4cyclictest3506864-21latency_hist21:24:557
3236539991313,0cyclictest0-21swapper/721:32:537
3236539991313,0cyclictest0-21swapper/700:19:227
3236539991311,1cyclictest3966068-21ssh00:33:437
3236539991311,1cyclictest0-21swapper/723:25:187
323653099138,4cyclictest3270126-21cat19:25:115
3236530991311,2cyclictest2522455-21kworker/u16:7+events_unbound20:25:575
3236530991310,2cyclictest3403017-21kworker/u16:1+events_unbound20:44:575
3236525991312,1cyclictest0-21swapper/423:29:484
3236525991312,1cyclictest0-21swapper/422:09:524
3236525991312,1cyclictest0-21swapper/421:37:144
3236525991312,1cyclictest0-21swapper/421:10:354
3236525991312,1cyclictest0-21swapper/400:29:524
3236525991311,2cyclictest3855136-21kworker/u16:6+flush-8:023:49:564
323652599130,13cyclictest0-21swapper/422:51:574
323653999129,2cyclictest3508593-21irqstats21:25:127
323653999126,5cyclictest6382-21gvfs-afc-volume00:12:327
3236539991210,1cyclictest0-21swapper/723:00:097
3236530991211,1cyclictest0-21swapper/522:51:045
3236525991211,1cyclictest0-21swapper/421:58:404
3236525991211,1cyclictest0-21swapper/420:58:274
3236525991211,1cyclictest0-21swapper/419:12:204
323652599120,1cyclictest0-21swapper/420:23:554
323653999117,3cyclictest1234-21snmpd22:45:427
323653999117,3cyclictest1234-21snmpd21:15:107
323653999115,5cyclictest6382-21gvfs-afc-volume23:59:587
3236539991111,0cyclictest0-21swapper/721:47:547
323653599119,2cyclictest3235958-21kworker/u16:2+events_unbound19:26:506
3236535991110,1cyclictest0-21swapper/619:54:386
323653099119,2cyclictest3288291-21kworker/u16:3+flush-8:019:39:555
323653099119,2cyclictest3288291-21kworker/u16:3+flush-8:019:39:555
323653099119,2cyclictest2522455-21kworker/u16:7+flush-8:020:10:275
323653099119,2cyclictest2522455-21kworker/u16:7+events_unbound19:45:205
3236530991110,1cyclictest0-21swapper/520:51:335
3236530991110,1cyclictest0-21swapper/520:39:255
3236530991110,1cyclictest0-21swapper/519:42:495
3236525991110,1cyclictest0-21swapper/421:28:524
3236525991110,1cyclictest0-21swapper/420:10:024
3236525991110,1cyclictest0-21swapper/419:59:104
3236525991110,1cyclictest0-21swapper/419:46:234
35300752100,1sleep40-21swapper/421:33:034
323653999105,4cyclictest3541149-21rm21:36:117
323653099108,2cyclictest2522455-21kworker/u16:7+events_unbound20:34:555
323652599109,1cyclictest0-21swapper/420:46:184
323652599109,1cyclictest0-21swapper/420:35:544
323652599109,1cyclictest0-21swapper/419:29:504
32365259997,2cyclictest3794055-21kworker/u16:0+flush-8:023:30:274
32365259997,2cyclictest3495238-21kworker/u16:0+flush-8:021:54:554
32365259996,2cyclictest0-21swapper/419:35:074
32365259996,2cyclictest0-21swapper/419:35:074
32365259985,2cyclictest5827-21JS15:59:264
32365259985,2cyclictest0-21swapper/419:30:094
32365259984,3cyclictest3300537-21kthreadcore19:40:134
32365259983,4cyclictest6331-21gdbus21:44:554
32365259983,4cyclictest3319504-21tr19:50:114
32365259976,1cyclictest0-21swapper/422:29:534
32365259973,3cyclictest827-21dbus-daemon22:14:554
32365259972,4cyclictest3246509-21sed19:14:574
32365259965,1cyclictest0-21swapper/421:19:534
32365259964,1cyclictest0-21swapper/420:08:014
32365259963,2cyclictest37951172sleep423:21:074
32365259963,2cyclictest37501322sleep423:05:124
32365259963,2cyclictest3393606-21chrt20:27:484
32365259963,1cyclictest991rcuop/723:39:214
32365259962,3cyclictest827-21dbus-daemon23:59:544
32365259962,3cyclictest827-21dbus-daemon23:59:544
32365259962,3cyclictest1079-21lldpd00:32:124
32365259960,4cyclictest3930798-21taskset00:19:564
32365259960,2cyclictest0-21swapper/423:17:004
32365259960,1cyclictest0-21swapper/421:04:334
32365259960,1cyclictest0-21swapper/420:02:364
32365259960,1cyclictest0-21swapper/400:35:324
32365309953,2cyclictest2522455-21kworker/u16:7+events_unbound20:55:065
32365309952,3cyclictest0-21swapper/520:15:005
32365259952,2cyclictest3557779-21kworker/u16:2+events_unbound22:14:564
32365259950,5cyclictest0-21swapper/422:35:064
32365259950,5cyclictest0-21swapper/400:15:244
32365259950,4cyclictest3907527-21chrt00:10:104
32365259950,4cyclictest3892502-21taskset00:02:014
32365259950,4cyclictest3842441-21taskset23:40:214
32365259950,4cyclictest3739045-21chrt23:00:144
32365259950,4cyclictest3664640-21taskset22:30:014
32365259950,4cyclictest3664640-21taskset22:30:014
32365259950,4cyclictest3441476-21chrt20:50:324
32365259950,4cyclictest3365397-21chrt20:14:584
32365259950,3cyclictest0-21swapper/420:30:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional