You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 15:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sun Jul 05, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205219825520,30sleep70-21swapper/707:08:017
205203524938,8sleep40-21swapper/407:05:424
2052538994846,2cyclictest2336250-21kworker/u16:7+events_unbound10:24:134
2052538994744,2cyclictest2621049-21kworker/u16:1+events_unbound11:53:494
2052538994240,2cyclictest2424865-21kworker/u16:2+events_unbound10:33:304
2052551994136,4cyclictest2338758-21latency_hist09:28:477
2052551994034,5cyclictest2202005-21latency_hist08:23:487
2052547993933,6cyclictest2559632-21kworker/u16:2+events_unbound11:20:146
2052538993937,2cyclictest2606241-21kworker/u16:0+events_unbound11:48:464
2052538993937,2cyclictest2336250-21kworker/u16:7+events_unbound11:03:224
2052551993832,5cyclictest2400182-21latency_hist09:53:477
2052547993836,2cyclictest2336250-21kworker/u16:7+events_unbound11:00:536
2052538993836,2cyclictest2559632-21kworker/u16:2+flush-8:011:13:474
2052538993836,2cyclictest2559632-21kworker/u16:2+events_unbound11:22:374
2052538993836,2cyclictest2336250-21kworker/u16:7+events_unbound10:11:094
2052538993835,2cyclictest2621049-21kworker/u16:1+events_unbound12:21:264
2052547993735,2cyclictest2559632-21kworker/u16:2+events_unbound11:18:386
2052547993734,2cyclictest2535109-21kworker/u16:0+events_unbound10:56:026
2052538993735,2cyclictest2373340-21kworker/u16:3+events_unbound09:47:184
2052547993634,2cyclictest2606241-21kworker/u16:0+events_unbound12:11:016
2052547993634,2cyclictest2336250-21kworker/u16:7+events_unbound10:50:106
2052538993634,2cyclictest2606241-21kworker/u16:0+events_unbound12:09:544
2052538993634,2cyclictest2559632-21kworker/u16:2+events_unbound11:06:574
2052538993634,2cyclictest2535109-21kworker/u16:0+events_unbound10:49:454
2052538993634,2cyclictest2422559-21kworker/u16:1+events_unbound10:41:464
2052538993634,2cyclictest2373340-21kworker/u16:3+events_unbound09:51:544
2052538993634,2cyclictest2311642-21kworker/u16:1+events_unbound09:32:274
2052547993534,1cyclictest2336250-21kworker/u16:7+events_unbound10:30:266
2052547993533,2cyclictest2706738-21kworker/u16:4+events_unbound12:05:386
2052547993533,2cyclictest2621049-21kworker/u16:1+events_unbound12:25:306
2052547993533,2cyclictest2621049-21kworker/u16:1+events_unbound11:31:386
2052547993533,2cyclictest2606241-21kworker/u16:0+events_unbound11:45:506
2052547993533,2cyclictest2581869-21kworker/u16:3+events_unbound11:09:336
2052547993533,2cyclictest2363408-21kworker/u16:0+events_unbound09:59:496
2052547993533,2cyclictest2311642-21kworker/u16:1+events_unbound09:21:586
2052547993533,2cyclictest2311642-21kworker/u16:1+events_unbound09:21:586
2052547993533,2cyclictest2201675-21kworker/u16:4+events_unbound09:11:426
2052538993534,1cyclictest2621049-21kworker/u16:1+events_unbound11:31:304
2052538993533,2cyclictest2790180-21kworker/u16:0+events_unbound12:34:494
2052538993533,2cyclictest2743902-21kworker/u16:2+events_unbound12:28:384
2052538993533,2cyclictest2743902-21kworker/u16:2+events_unbound12:17:024
2052538993533,2cyclictest2373340-21kworker/u16:3+events_unbound10:00:384
2052538993533,2cyclictest2280073-21kworker/u16:0+events_unbound09:16:024
2052547993432,2cyclictest2743902-21kworker/u16:2+events_unbound12:31:016
2052547993432,2cyclictest2743902-21kworker/u16:2+events_unbound12:15:306
2052547993432,2cyclictest2422559-21kworker/u16:1+events_unbound10:46:186
2052538993432,2cyclictest2706738-21kworker/u16:4+events_unbound12:06:374
2052538993432,2cyclictest2336250-21kworker/u16:7+events_unbound09:57:424
2052538993432,2cyclictest2311642-21kworker/u16:1+events_unbound09:20:144
2052538993432,2cyclictest2311642-21kworker/u16:1+events_unbound09:20:144
2052547993332,1cyclictest2621049-21kworker/u16:1+events_unbound11:43:276
2052547993331,2cyclictest2682436-21kworker/u16:3+events_unbound11:56:536
2052547993331,2cyclictest2422559-21kworker/u16:1+events_unbound10:20:346
2052547993331,2cyclictest2336250-21kworker/u16:7+events_unbound09:33:346
2052547993331,2cyclictest2336250-21kworker/u16:7+events_unbound09:24:306
2052538993331,2cyclictest2706738-21kworker/u16:4+events_unbound11:59:334
2052538993331,2cyclictest2621049-21kworker/u16:1+events_unbound12:33:334
2052538993331,2cyclictest2559632-21kworker/u16:2+events_unbound11:34:304
2052538993331,2cyclictest2559632-21kworker/u16:2+events_unbound11:16:494
2052538993331,2cyclictest2422559-21kworker/u16:1+events_unbound10:33:494
2052538993331,2cyclictest2422559-21kworker/u16:1+events_unbound10:04:544
2052538993331,2cyclictest2336250-21kworker/u16:7+events_unbound10:20:304
2052538993331,2cyclictest2336250-21kworker/u16:7+events_unbound10:16:184
2052538993331,2cyclictest2314120-21kworker/u16:2+events_unbound09:35:154
2052538993331,2cyclictest2314120-21kworker/u16:2+events_unbound09:24:464
2052538993330,2cyclictest2621049-21kworker/u16:1+events_unbound11:48:484
2052547993230,2cyclictest2621049-21kworker/u16:1+events_unbound12:22:346
2052547993230,2cyclictest2606241-21kworker/u16:0+events_unbound11:26:496
2052547993230,2cyclictest2422559-21kworker/u16:1+events_unbound10:24:246
2052547993230,2cyclictest2422559-21kworker/u16:1+events_unbound10:06:026
2052547993230,2cyclictest2373340-21kworker/u16:3+events_unbound09:50:556
2052547993230,2cyclictest2363408-21kworker/u16:0+events_unbound09:56:066
2052547993230,2cyclictest2336250-21kworker/u16:7+flush-8:009:37:216
2052547993230,2cyclictest2336250-21kworker/u16:7+events_unbound10:11:546
2052547993230,2cyclictest2280073-21kworker/u16:0+flush-8:009:15:066
2052547993230,2cyclictest2085586-21kworker/u16:2+events_unbound08:19:186
2052542993230,2cyclictest2424865-21kworker/u16:2+events_unbound10:39:255
2052538993230,2cyclictest2535109-21kworker/u16:0+events_unbound10:55:464
2052538993230,2cyclictest2363408-21kworker/u16:0+events_unbound09:40:184
2052538993230,2cyclictest2085586-21kworker/u16:2+events_unbound08:19:144
2052538993230,2cyclictest2042258-21kworker/u16:3+flush-8:007:34:164
2052547993129,2cyclictest2581869-21kworker/u16:3+events_unbound11:05:466
2052547993129,2cyclictest2424865-21kworker/u16:2+events_unbound10:38:176
2052538993129,2cyclictest2559632-21kworker/u16:2+events_unbound11:43:234
2052538993129,2cyclictest2424865-21kworker/u16:2+events_unbound10:48:254
2052538993028,2cyclictest2559632-21kworker/u16:2+events_unbound11:26:234
2052538993028,2cyclictest2280073-21kworker/u16:0+events_unbound09:12:024
2052547992927,2cyclictest2706738-21kworker/u16:4+events_unbound12:02:466
2052547992927,2cyclictest2606241-21kworker/u16:0+events_unbound11:50:066
2052538992927,2cyclictest1980128-21kworker/u16:0+flush-8:007:18:424
2052547992826,2cyclictest2790180-21kworker/u16:0+events_unbound12:36:026
2052547992826,2cyclictest2606241-21kworker/u16:0+events_unbound11:36:496
2052547992826,2cyclictest2336250-21kworker/u16:7+events_unbound10:17:506
2052547992824,3cyclictest2422559-21kworker/u16:1+flush-8:010:39:056
2052542992826,2cyclictest2581869-21kworker/u16:3+events_unbound11:12:275
2052542992826,2cyclictest2085586-21kworker/u16:2+events_unbound07:55:315
2052551992726,0cyclictest0-21swapper/708:49:027
2052547992725,2cyclictest2373340-21kworker/u16:3+events_unbound09:44:526
2052542992725,2cyclictest2336250-21kworker/u16:7+events_unbound10:46:295
2052542992725,2cyclictest2314120-21kworker/u16:2+flush-8:009:24:255
2052542992725,2cyclictest2042258-21kworker/u16:3+events_unbound07:48:235
2052542992724,2cyclictest2424865-21kworker/u16:2+flush-8:010:28:575
2052538992725,2cyclictest2201675-21kworker/u16:4+events_unbound08:42:574
205200722716,7sleep50-21swapper/507:05:195
2052547992624,2cyclictest2363408-21kworker/u16:0+flush-8:009:39:296
2052547992624,2cyclictest2135952-21kworker/u16:1+events_unbound08:29:186
2052547992624,2cyclictest2085586-21kworker/u16:2+events_unbound08:18:476
2052542992624,2cyclictest2706738-21kworker/u16:4+events_unbound12:09:485
2052542992624,2cyclictest2706738-21kworker/u16:4+events_unbound12:07:005
2052542992624,2cyclictest2559632-21kworker/u16:2+events_unbound11:05:355
2052542992624,2cyclictest2373340-21kworker/u16:3+events_unbound09:46:045
2052538992624,2cyclictest2042258-21kworker/u16:3+events_unbound07:28:474
2052538992623,2cyclictest2085586-21kworker/u16:2+flush-8:008:08:574
2052542992523,2cyclictest2706738-21kworker/u16:4+events_unbound12:14:385
2052542992523,2cyclictest2621049-21kworker/u16:1+events_unbound12:03:125
2052542992523,2cyclictest2336250-21kworker/u16:7+events_unbound11:03:125
2052542992523,2cyclictest2336250-21kworker/u16:7+events_unbound10:19:515
2052542992523,2cyclictest2311642-21kworker/u16:1+events_unbound09:29:455
2052542992523,2cyclictest2135952-21kworker/u16:1+events_unbound08:28:025
2052542992523,2cyclictest2042258-21kworker/u16:3+events_unbound07:26:345
2052542992523,2cyclictest1980128-21kworker/u16:0+events_unbound07:38:105
2052542992522,2cyclictest2422559-21kworker/u16:1+flush-8:010:33:535
2052551992422,1cyclictest0-21swapper/708:09:067
2052542992422,2cyclictest2706738-21kworker/u16:4+events_unbound12:21:325
2052542992422,2cyclictest2621049-21kworker/u16:1+events_unbound11:32:055
2052542992422,2cyclictest2422559-21kworker/u16:1+events_unbound10:51:405
2052542992422,2cyclictest2336250-21kworker/u16:7+events_unbound10:04:015
2052542992422,2cyclictest2280073-21kworker/u16:0+events_unbound09:08:415
2052542992422,2cyclictest2221649-21kworker/u16:3+events_unbound08:40:425
2052542992422,2cyclictest2182577-21kworker/u16:0+events_unbound08:32:275
2052542992422,2cyclictest2135952-21kworker/u16:1+events_unbound08:00:425
2052542992422,2cyclictest2085586-21kworker/u16:2+events_unbound07:50:425
2052542992421,2cyclictest2559632-21kworker/u16:2+events_unbound11:23:555
2052551992322,0cyclictest0-21swapper/711:38:247
2052551992322,0cyclictest0-21swapper/709:29:027
2052551992321,1cyclictest0-21swapper/711:44:187
2052551992312,10cyclictest0-21swapper/707:19:127
2052542992321,2cyclictest2621049-21kworker/u16:1+events_unbound12:33:535
2052542992321,2cyclictest2559632-21kworker/u16:2+events_unbound11:18:035
2052542992321,2cyclictest2269787-21kworker/u16:1+events_unbound09:01:425
2052542992321,2cyclictest2221649-21kworker/u16:3+events_unbound08:47:465
2052542992321,2cyclictest2042258-21kworker/u16:3+events_unbound07:41:315
2052542992321,2cyclictest2042258-21kworker/u16:3+events_unbound07:16:185
2052542992321,2cyclictest2042258-21kworker/u16:3+events_unbound07:13:385
2052542992320,2cyclictest2336250-21kworker/u16:7+events_unbound10:08:565
2052538992321,2cyclictest2269787-21kworker/u16:1+flush-8:008:58:424
2052551992221,0cyclictest0-21swapper/710:34:017
2052547992220,2cyclictest2085586-21kworker/u16:2+events_unbound07:52:306
2052542992220,2cyclictest2606241-21kworker/u16:0+flush-8:011:19:135
2052542992220,2cyclictest2422559-21kworker/u16:1+events_unbound10:03:415
2052542992220,2cyclictest2182577-21kworker/u16:0+events_unbound08:20:325
2052542992220,2cyclictest2135952-21kworker/u16:1+events_unbound08:35:475
2052542992220,2cyclictest2042258-21kworker/u16:3+events_unbound07:22:435
2052538992220,2cyclictest2221649-21kworker/u16:3+events_unbound08:46:434
2052538992220,2cyclictest2085586-21kworker/u16:2+events_unbound08:15:574
205207422212,7sleep60-21swapper/607:06:166
205255199210,19cyclictest2670009-21latency_hist11:43:477
205255199210,19cyclictest2172903-21cat08:08:477
2052547992119,2cyclictest2269787-21kworker/u16:1+events_unbound09:03:386
2052547992119,2cyclictest2042258-21kworker/u16:3+events_unbound07:32:306
2052547992119,2cyclictest1980128-21kworker/u16:0+events_unbound07:38:316
2052542992119,2cyclictest2221649-21kworker/u16:3+events_unbound08:58:075
2052542992119,2cyclictest2201675-21kworker/u16:4+events_unbound09:10:365
2052542992119,2cyclictest2163524-21kworker/u16:3+events_unbound08:05:185
2052542992119,2cyclictest2042258-21kworker/u16:3+events_unbound07:29:555
2052538992119,2cyclictest1980128-21kworker/u16:0+events_unbound07:48:314
2052551992017,2cyclictest2301849-21awk09:13:467
2052551992014,5cyclictest650-21systemd-journal11:28:477
2052542992018,2cyclictest2621049-21kworker/u16:1+flush-8:012:24:195
2052542992018,2cyclictest2231612-21kworker/u16:0+flush-8:008:49:425
2052542992018,2cyclictest2201675-21kworker/u16:4+flush-8:009:19:305
2052542992018,2cyclictest2201675-21kworker/u16:4+flush-8:009:19:305
2052542992018,2cyclictest2135952-21kworker/u16:1+events_unbound08:12:225
2052538992018,2cyclictest2135952-21kworker/u16:1+events_unbound07:57:584
2052551991913,5cyclictest2792505-21latency_hist12:33:477
205255199190,17cyclictest2117095-21kthreadcore07:39:067
2052547991917,2cyclictest2153233-21kworker/u16:0+events_unbound07:59:266
2052547991917,2cyclictest2042258-21kworker/u16:3+events_unbound07:43:386
2052542991917,2cyclictest2606241-21kworker/u16:0+events_unbound11:38:525
2052542991917,2cyclictest2424865-21kworker/u16:2+events_unbound10:24:525
2052538991917,2cyclictest2280073-21kworker/u16:0+flush-8:009:04:024
2052538991917,2cyclictest2221649-21kworker/u16:3+flush-8:008:59:264
2052538991917,2cyclictest2182577-21kworker/u16:0+events_unbound08:31:584
2052538991917,2cyclictest2085586-21kworker/u16:2+events_unbound08:04:214
2052538991917,2cyclictest2085586-21kworker/u16:2+events_unbound07:50:384
2052551991816,1cyclictest0-21swapper/712:04:147
2052547991816,2cyclictest2280073-21kworker/u16:0+events_unbound09:06:396
2052547991816,2cyclictest2221649-21kworker/u16:3+events_unbound08:50:386
2052547991816,2cyclictest2085586-21kworker/u16:2+events_unbound08:05:396
2052542991816,2cyclictest2606241-21kworker/u16:0+flush-8:011:50:385
2052538991816,2cyclictest2231612-21kworker/u16:0+events_unbound08:53:384
2052538991816,2cyclictest2042258-21kworker/u16:3+flush-8:007:19:034
2052551991714,2cyclictest124-21kswapd012:27:547
2052551991712,4cyclictest2412457-21latency_hist09:58:467
2052547991715,2cyclictest2135952-21kworker/u16:1+events_unbound08:34:196
2052547991715,2cyclictest2135952-21kworker/u16:1+events_unbound08:09:026
2052547991715,2cyclictest2042258-21kworker/u16:3+events_unbound07:22:476
2052547991715,2cyclictest1980128-21kworker/u16:0+events_unbound07:45:396
2052542991714,2cyclictest2422559-21kworker/u16:1+flush-8:010:18:475
2052538991715,2cyclictest2201675-21kworker/u16:4+events_unbound08:34:214
2052538991715,2cyclictest2153233-21kworker/u16:0+events_unbound08:03:344
2052538991715,2cyclictest1998327-21kworker/u16:1+events_unbound07:10:584
2052551991613,2cyclictest0-21swapper/709:19:107
2052551991613,2cyclictest0-21swapper/709:19:107
2052551991612,3cyclictest1278-21snmpd10:07:177
205255199160,14cyclictest2229939-21cut08:34:097
2052542991614,2cyclictest2363408-21kworker/u16:0+events_unbound09:39:515
2052542991614,2cyclictest2085586-21kworker/u16:2+events_unbound08:17:195
2052551991513,1cyclictest2531860-21ssh10:44:097
2052551991513,1cyclictest0-21swapper/712:09:137
205255199150,14cyclictest0-21swapper/710:14:097
2052547991513,2cyclictest2135952-21kworker/u16:1+events_unbound08:27:586
2052538991512,2cyclictest2085586-21kworker/u16:2+flush-8:007:29:044
205255199149,4cyclictest1278-21snmpd07:15:377
2052551991413,0cyclictest0-21swapper/711:24:017
2052551991413,0cyclictest0-21swapper/710:25:567
2052551991412,1cyclictest2694520-21ssh11:53:477
205255199140,12cyclictest1278-21snmpd08:27:247
2052547991412,2cyclictest2221649-21kworker/u16:3+flush-8:008:54:026
2052547991412,2cyclictest2221649-21kworker/u16:3+events_unbound08:41:376
2052547991412,2cyclictest2085586-21kworker/u16:2+events_unbound07:55:576
2052542991413,1cyclictest0-21swapper/512:30:075
2052542991412,2cyclictest2621049-21kworker/u16:1+events_unbound11:44:325
205254299140,13cyclictest0-21swapper/510:54:115
2052538991412,2cyclictest1980128-21kworker/u16:0+events_unbound07:40:384
205255199139,3cyclictest1278-21snmpd08:31:577
205255199139,3cyclictest1278-21snmpd08:02:447
205255199138,3cyclictest1278-21snmpd09:15:377
2052551991310,2cyclictest0-21swapper/710:54:017
2052551991310,2cyclictest0-21swapper/708:43:477
2052547991311,2cyclictest2221649-21kworker/u16:3+flush-8:008:44:156
2052547991311,2cyclictest2085586-21kworker/u16:2+events_unbound07:24:396
2052547991311,2cyclictest2042258-21kworker/u16:3+events_unbound07:16:576
2052542991312,1cyclictest0-21swapper/509:53:535
2052542991312,1cyclictest0-21swapper/509:51:125
205254299130,13cyclictest0-21swapper/509:37:485
205255199129,2cyclictest1278-21snmpd11:59:507
205255199129,2cyclictest1278-21snmpd10:29:547
205255199128,3cyclictest1278-21snmpd12:23:457
205255199126,5cyclictest6341-21gvfs-afc-volume07:49:067
2052551991211,0cyclictest0-21swapper/707:44:047
2052551991210,1cyclictest2804755-21awk12:38:467
2052551991210,1cyclictest2584550-21ssh11:08:497
205255199120,2cyclictest2706963-21latency_hist11:58:467
205255199120,2cyclictest2470855-21sed10:19:177
205255199120,2cyclictest2386411-21ssh09:46:067
205255199120,11cyclictest1278-21snmpd12:18:247
205255199120,11cyclictest1278-21snmpd09:00:427
205255199120,10cyclictest2609114-21ssh11:18:527
205254799120,4cyclictest2061158-21ntpq07:09:116
205255199119,1cyclictest0-21swapper/708:44:177
205255199118,2cyclictest1278-21snmpd09:58:507
205255199118,2cyclictest1278-21snmpd07:30:197
205255199118,2cyclictest0-21swapper/710:39:137
205255199118,2cyclictest0-21swapper/709:33:587
205255199117,3cyclictest5963-21gmain08:14:097
205255199110,3cyclictest2596933-21ssh11:13:567
205255199110,1cyclictest2568500-21ssh10:59:117
205255199110,10cyclictest1278-21snmpd07:10:587
205254299119,2cyclictest2682436-21kworker/u16:3+events_unbound11:56:375
2052538991110,1cyclictest0-21swapper/408:26:434
205255199109,1cyclictest2374658-21ssh09:42:067
205255199107,2cyclictest0-21swapper/711:04:067
205255199104,5cyclictest6341-21gvfs-afc-volume10:08:527
205255199100,9cyclictest2545811-21ssh10:51:077
205255199100,8cyclictest1278-21snmpd09:04:137
205255199100,8cyclictest1278-21snmpd07:34:077
205255199100,3cyclictest1069-21runrttasks08:54:457
205254299108,2cyclictest2221649-21kworker/u16:3+events_unbound09:14:215
20525519996,2cyclictest1278-21snmpd07:58:027
20525519995,3cyclictest1278-21snmpd07:25:437
20525429983,4cyclictest2646772-21cat11:34:035
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional