You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 01:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Tue Jun 09, 2026 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27146042940,1sleep72714605-21sh23:20:217
215563125228,7sleep40-21swapper/419:06:094
215551824232,7sleep50-21swapper/519:04:345
2155950994138,2cyclictest2188380-21kworker/u16:1+events_unbound20:21:204
21555772415,31sleep70-21swapper/719:05:247
2155957993837,0cyclictest0-21swapper/723:39:307
2155957993836,1cyclictest2701494-21ssh23:13:167
2155951993836,2cyclictest2507539-21kworker/u16:2+events_unbound22:16:205
2155951993835,2cyclictest2630915-21kworker/u16:3+events_unbound22:56:225
2155957993634,1cyclictest0-21swapper/723:07:367
2155952993633,2cyclictest2823827-21kworker/u16:2+events_unbound00:16:226
2155951993634,2cyclictest2630915-21kworker/u16:3+events_unbound23:16:205
2155951993632,4cyclictest2188380-21kworker/u16:1+flush-8:019:26:205
2155950993634,2cyclictest1454642-21kworker/u16:4+events_unbound19:21:204
2155950993633,2cyclictest2472122-21kworker/u16:0+events_unbound21:51:234
2155957993534,0cyclictest0-21swapper/723:57:587
2155957993533,1cyclictest0-21swapper/722:41:317
2155952993533,2cyclictest2188380-21kworker/u16:1+flush-8:019:51:506
2155950993533,2cyclictest2751268-21kworker/u16:0+events_unbound00:36:024
2155957993433,0cyclictest0-21swapper/721:46:207
2155957993432,1cyclictest2390168-21diskmemload22:17:317
2155957993432,1cyclictest0-21swapper/700:10:467
2155957993431,2cyclictest2617802-21ssh22:39:187
2155957993431,1cyclictest2821786-21ssh00:02:317
2155952993431,2cyclictest2528246-21kworker/u16:3+events_unbound22:31:236
2155951993432,2cyclictest2823827-21kworker/u16:2+events_unbound00:35:515
2155951993432,2cyclictest2630915-21kworker/u16:3+events_unbound23:18:355
2155950993432,2cyclictest2594878-21kworker/u16:2+events_unbound22:35:024
2155957993332,0cyclictest0-21swapper/722:26:037
2155952993331,2cyclictest2712780-21kworker/u16:1+events_unbound23:26:086
2155952993331,2cyclictest2227078-21kworker/u16:3+events_unbound21:16:076
2155951993331,2cyclictest2881782-21kworker/u16:3+events_unbound00:29:265
2155951993330,2cyclictest2227078-21kworker/u16:3+flush-8:020:31:475
2155950993331,2cyclictest2607278-21kworker/u16:1+events_unbound22:45:024
2155950993331,2cyclictest2227078-21kworker/u16:3+events_unbound21:26:074
2155957993230,1cyclictest2797831-21ssh23:52:477
2155957993229,2cyclictest2473619-21ssh21:39:427
2155951993230,2cyclictest2188380-21kworker/u16:1+events_unbound22:03:035
2155951993229,2cyclictest2450694-21kworker/u16:4+events_unbound21:36:325
2155950993230,2cyclictest2751268-21kworker/u16:0+events_unbound23:39:474
2155950993230,2cyclictest2712831-21kworker/u16:2+events_unbound23:54:314
2155950993230,2cyclictest2676946-21kworker/u16:0+events_unbound23:03:034
2155950993230,2cyclictest2630915-21kworker/u16:3+flush-8:023:26:154
2155950993230,2cyclictest2630915-21kworker/u16:3+events_unbound23:34:354
2155950993230,2cyclictest2528246-21kworker/u16:3+flush-8:022:37:024
2155950993230,2cyclictest2450694-21kworker/u16:4+flush-8:021:31:594
2155950993229,2cyclictest2188380-21kworker/u16:1+events_unbound22:16:304
2155957993130,0cyclictest0-21swapper/723:29:187
2155957993130,0cyclictest0-21swapper/722:01:107
2155957993130,0cyclictest0-21swapper/721:31:107
2155952993129,2cyclictest2712831-21kworker/u16:2+events_unbound23:28:276
2155951993129,2cyclictest2655073-21kworker/u16:4+events_unbound23:09:265
2155951993129,2cyclictest2188380-21kworker/u16:1+events_unbound21:48:315
2155950993129,2cyclictest2528246-21kworker/u16:3+flush-8:022:03:394
2155950993129,2cyclictest2188380-21kworker/u16:1+events_unbound21:15:304
2155950993129,2cyclictest2188380-21kworker/u16:1+events_unbound21:08:304
2155957993029,0cyclictest0-21swapper/723:33:307
2155957993029,0cyclictest0-21swapper/722:32:307
2155957993029,0cyclictest0-21swapper/722:04:527
2155957993029,0cyclictest0-21swapper/721:18:187
2155957993028,1cyclictest2845956-21ssh00:12:477
2155957993028,1cyclictest2845956-21ssh00:12:477
2155952993028,2cyclictest2630915-21kworker/u16:3+events_unbound23:16:516
2155951993028,2cyclictest2823827-21kworker/u16:2+events_unbound00:20:305
2155951993028,2cyclictest2763355-21kworker/u16:4+events_unbound23:45:025
2155951993028,2cyclictest2751268-21kworker/u16:0+events_unbound23:59:515
2155951993028,2cyclictest2607278-21kworker/u16:1+events_unbound23:01:235
2155951993027,2cyclictest2528246-21kworker/u16:3+events_unbound22:34:315
2155950993028,2cyclictest2567874-21kworker/u16:0+events_unbound22:25:314
2155950993028,2cyclictest2450694-21kworker/u16:4+flush-8:021:41:554
2155957992928,0cyclictest0-21swapper/723:42:357
2155957992928,0cyclictest0-21swapper/723:22:517
215595799290,28cyclictest2461902-21ssh21:35:167
2155952992926,2cyclictest2294190-21kworker/u16:2+flush-8:020:36:206
2155951992927,2cyclictest2751268-21kworker/u16:0+events_unbound23:49:305
2155950992927,2cyclictest2712831-21kworker/u16:2+flush-8:023:42:554
2155950992927,2cyclictest2712780-21kworker/u16:1+events_unbound23:17:034
2155950992927,2cyclictest2630915-21kworker/u16:3+events_unbound22:55:354
2155950992927,2cyclictest2188380-21kworker/u16:1+flush-8:019:51:164
2155950992926,2cyclictest2528246-21kworker/u16:3+events_unbound22:31:024
2155957992827,0cyclictest0-21swapper/721:50:407
2155957992827,0cyclictest0-21swapper/721:23:547
2155957992827,0cyclictest0-21swapper/721:15:517
2155957992826,1cyclictest0-21swapper/722:27:587
2155952992827,1cyclictest2188380-21kworker/u16:1+events_unbound22:17:036
2155952992826,2cyclictest2655073-21kworker/u16:4+events_unbound23:15:316
2155952992825,2cyclictest2594878-21kworker/u16:2+events_unbound22:41:236
2155951992826,2cyclictest2823827-21kworker/u16:2+events_unbound00:15:315
2155951992826,2cyclictest2823827-21kworker/u16:2+events_unbound00:15:315
2155951992826,2cyclictest2799716-21kworker/u16:4+flush-8:000:03:265
2155951992826,2cyclictest2528246-21kworker/u16:3+events_unbound22:10:115
2155951992826,2cyclictest2332761-21kworker/u16:0+events_unbound21:31:025
2155951992826,2cyclictest2332761-21kworker/u16:0+events_unbound21:18:515
2155951992826,2cyclictest2227078-21kworker/u16:3+events_unbound21:25:005
2155951992825,2cyclictest2799716-21kworker/u16:4+events_unbound00:06:205
2155951992825,2cyclictest2117573-21kworker/u16:2+flush-8:019:11:215
2155950992826,2cyclictest2507539-21kworker/u16:2+events_unbound21:57:274
2155957992726,0cyclictest0-21swapper/723:51:077
2155952992725,2cyclictest2751268-21kworker/u16:0+events_unbound23:59:436
2155952992725,2cyclictest2227078-21kworker/u16:3+flush-8:021:16:316
2155952992725,2cyclictest2188380-21kworker/u16:1+events_unbound22:15:316
2155951992725,2cyclictest2797385-21kworker/u16:1+events_unbound23:54:585
2155951992725,2cyclictest2472122-21kworker/u16:0+flush-8:021:51:515
2155951992725,2cyclictest2188380-21kworker/u16:1+events_unbound22:21:195
2155950992725,2cyclictest2823827-21kworker/u16:2+events_unbound00:22:104
2155950992725,2cyclictest2712780-21kworker/u16:1+events_unbound23:28:104
2155950992725,2cyclictest2450694-21kworker/u16:4+flush-8:021:36:394
2155957992625,0cyclictest0-21swapper/722:52:267
2155952992624,2cyclictest2567874-21kworker/u16:0+events_unbound22:28:316
2155951992624,2cyclictest2857501-21kworker/u16:1+events_unbound00:24:075
2155951992624,2cyclictest2712780-21kworker/u16:1+events_unbound23:23:265
2155951992624,2cyclictest2567874-21kworker/u16:0+events_unbound22:45:315
2155951992624,2cyclictest2188380-21kworker/u16:1+flush-8:021:11:205
2155950992624,2cyclictest2823827-21kworker/u16:2+events_unbound00:07:264
2155950992623,2cyclictest2676946-21kworker/u16:0+events_unbound23:11:294
2155950992623,2cyclictest2217466-21kworker/u16:0+events_unbound19:36:354
23906352250,1chrt2390633-21ssh21:06:307
2155957992524,0cyclictest0-21swapper/722:12:187
2155957992524,0cyclictest0-21swapper/721:53:327
2155957992524,0cyclictest0-21swapper/720:10:357
2155957992523,1cyclictest0-21swapper/700:34:327
2155957992522,2cyclictest2667564-21ssh23:01:277
2155952992523,2cyclictest2630915-21kworker/u16:3+flush-8:023:36:306
2155952992523,2cyclictest2450694-21kworker/u16:4+flush-8:021:31:476
2155952992519,6cyclictest2507539-21kworker/u16:2+events_unbound22:07:356
2155951992523,2cyclictest2712831-21kworker/u16:2+events_unbound23:30:425
2155951992523,2cyclictest2227078-21kworker/u16:3+events_unbound20:11:495
2155951992523,2cyclictest2188380-21kworker/u16:1+flush-8:020:26:415
2155951992523,2cyclictest2188380-21kworker/u16:1+events_unbound22:26:505
2155950992523,2cyclictest2823827-21kworker/u16:2+events_unbound00:30:224
2155950992523,2cyclictest2751268-21kworker/u16:0+flush-8:023:59:484
2155950992523,2cyclictest2751268-21kworker/u16:0+events_unbound00:13:554
2155950992523,2cyclictest2751268-21kworker/u16:0+events_unbound00:13:554
2155950992523,2cyclictest2676946-21kworker/u16:0+flush-8:023:07:004
2155957992423,0cyclictest0-21swapper/700:25:397
2155957992422,1cyclictest2883820-21ssh00:31:077
2155952992423,1cyclictest2824174-21kworker/u16:3+events_unbound00:15:566
2155952992423,1cyclictest2824174-21kworker/u16:3+events_unbound00:15:566
2155952992422,2cyclictest2655073-21kworker/u16:4+events_unbound22:57:196
2155952992422,2cyclictest2630915-21kworker/u16:3+flush-8:022:47:026
2155952992422,2cyclictest2607278-21kworker/u16:1+events_unbound22:40:366
2155951992422,2cyclictest2630915-21kworker/u16:3+events_unbound23:33:125
2155951992422,2cyclictest2630915-21kworker/u16:3+events_unbound22:54:355
2155951992422,2cyclictest2594878-21kworker/u16:2+events_unbound22:49:125
2155951992422,2cyclictest2450694-21kworker/u16:4+events_unbound21:42:345
2155951992422,2cyclictest2188380-21kworker/u16:1+events_unbound22:25:025
2155950992422,2cyclictest2607278-21kworker/u16:1+events_unbound22:47:584
2155950992422,2cyclictest2227078-21kworker/u16:3+events_unbound21:20:354
2155950992422,2cyclictest2188380-21kworker/u16:1+events_unbound21:49:204
2155950992421,2cyclictest2332761-21kworker/u16:0+flush-8:021:01:304
2155957992322,0cyclictest0-21swapper/723:00:547
2155957992322,0cyclictest0-21swapper/720:15:367
215595799230,21cyclictest2235371-21ldconfig19:41:457
2155952992321,2cyclictest2763355-21kworker/u16:4+events_unbound23:44:316
2155952992321,2cyclictest2630915-21kworker/u16:3+events_unbound22:55:316
2155951992321,2cyclictest2567874-21kworker/u16:0+events_unbound22:38:105
2155951992321,2cyclictest2507539-21kworker/u16:2+events_unbound21:57:355
2155951992321,2cyclictest2227078-21kworker/u16:3+events_unbound21:36:115
2155951992321,2cyclictest2227078-21kworker/u16:3+events_unbound21:13:365
2155951992321,2cyclictest2188380-21kworker/u16:1+flush-8:019:26:395
2155950992321,2cyclictest2751268-21kworker/u16:0+events_unbound00:05:354
214618222312,7sleep60-21swapper/619:01:226
2155957992221,0cyclictest0-21swapper/719:48:367
2155957992220,1cyclictest0-21swapper/722:48:337
2155957992220,1cyclictest0-21swapper/719:06:317
2155952992220,2cyclictest2823827-21kworker/u16:2+events_unbound00:35:026
2155952992220,2cyclictest2823827-21kworker/u16:2+events_unbound00:08:436
2155952992220,2cyclictest2797385-21kworker/u16:1+events_unbound00:06:086
2155952992220,2cyclictest2712831-21kworker/u16:2+events_unbound23:35:276
2155952992220,2cyclictest2426341-21kworker/u16:2+events_unbound21:27:156
2155952992220,2cyclictest2294190-21kworker/u16:2+flush-8:020:31:156
2155952992220,2cyclictest2227078-21kworker/u16:3+events_unbound21:24:276
2155952992220,2cyclictest2188380-21kworker/u16:1+flush-8:019:56:456
2155951992220,2cyclictest1454642-21kworker/u16:4+flush-8:019:16:415
2155950992220,2cyclictest2857501-21kworker/u16:1+events_unbound00:17:464
2155950992220,2cyclictest2528246-21kworker/u16:3+events_unbound22:09:464
2155957992120,0cyclictest0-21swapper/722:10:447
2155957992120,0cyclictest0-21swapper/720:01:457
2155952992119,2cyclictest2751268-21kworker/u16:0+flush-8:000:27:076
2155952992119,2cyclictest2751268-21kworker/u16:0+events_unbound23:51:546
2155952992119,2cyclictest2607278-21kworker/u16:1+events_unbound23:07:506
2155952992119,2cyclictest2472122-21kworker/u16:0+events_unbound21:52:436
2155952992119,2cyclictest2188380-21kworker/u16:1+events_unbound21:47:276
2155952992119,2cyclictest2188380-21kworker/u16:1+events_unbound20:21:356
2155951992119,2cyclictest2751268-21kworker/u16:0+events_unbound23:37:115
2155951992119,2cyclictest2332761-21kworker/u16:0+events_unbound20:46:075
2155951992118,2cyclictest2294190-21kworker/u16:2+events_unbound20:36:275
2155950992119,2cyclictest2751268-21kworker/u16:0+events_unbound23:49:354
2155950992119,2cyclictest2607278-21kworker/u16:1+events_unbound23:00:324
2155950992119,2cyclictest2227078-21kworker/u16:3+events_unbound21:27:354
2155950992119,2cyclictest2188380-21kworker/u16:1+events_unbound22:13:324
2155952992018,2cyclictest2823827-21kworker/u16:2+events_unbound00:25:476
2155952992018,2cyclictest2607278-21kworker/u16:1+events_unbound23:05:556
2155952992018,2cyclictest2528246-21kworker/u16:3+events_unbound22:22:306
2155952992018,2cyclictest2507539-21kworker/u16:2+events_unbound21:57:116
2155952992018,2cyclictest2450694-21kworker/u16:4+events_unbound21:45:436
2155952992018,2cyclictest2188380-21kworker/u16:1+events_unbound21:10:356
2155952992017,2cyclictest2227078-21kworker/u16:3+flush-8:020:06:456
2155951992018,2cyclictest2217466-21kworker/u16:0+events_unbound19:46:355
2155957991918,0cyclictest0-21swapper/719:56:097
2155957991915,3cyclictest1234-21snmpd20:53:087
2155957991915,3cyclictest1234-21snmpd20:53:087
2155951991917,2cyclictest2294190-21kworker/u16:2+events_unbound20:26:075
2155951991917,2cyclictest2227078-21kworker/u16:3+events_unbound19:55:595
2155951991916,2cyclictest1454177-21kworker/u16:0+flush-8:019:08:355
2155950991917,2cyclictest2188380-21kworker/u16:1+flush-8:020:21:464
2155957991817,0cyclictest0-21swapper/719:57:217
2155957991817,0cyclictest0-21swapper/719:26:097
2155952991816,2cyclictest1454177-21kworker/u16:0+events_unbound19:11:476
2155952991815,2cyclictest2712831-21kworker/u16:2+flush-8:023:46:386
2155950991816,2cyclictest2188380-21kworker/u16:1+events_unbound19:41:344
2155957991715,1cyclictest2303500-21sshd-session20:19:367
2155952991715,2cyclictest2450694-21kworker/u16:4+events_unbound21:37:036
2155952991715,2cyclictest2188380-21kworker/u16:1+flush-8:020:11:426
2155951991715,2cyclictest2227078-21kworker/u16:3+events_unbound20:56:075
2155951991715,2cyclictest2227078-21kworker/u16:3+events_unbound20:56:075
2155950991715,2cyclictest2227078-21kworker/u16:3+flush-8:020:56:464
2155957991615,0cyclictest0-21swapper/700:17:177
215595799160,14cyclictest0-21swapper/719:31:467
2155952991614,2cyclictest2332761-21kworker/u16:0+events_unbound20:41:456
2155952991614,2cyclictest2294190-21kworker/u16:2+flush-8:020:36:366
2155952991614,2cyclictest2217466-21kworker/u16:0+events_unbound19:46:466
2155952991614,2cyclictest2188380-21kworker/u16:1+events_unbound20:51:416
2155952991614,2cyclictest2188380-21kworker/u16:1+events_unbound20:51:416
2155951991614,2cyclictest2227078-21kworker/u16:3+events_unbound20:57:215
2155951991614,2cyclictest2188380-21kworker/u16:1+events_unbound19:45:365
2155951991614,2cyclictest2188380-21kworker/u16:1+events_unbound19:33:315
2155950991614,2cyclictest2294190-21kworker/u16:2+events_unbound20:26:484
2155957991514,0cyclictest0-21swapper/720:57:277
2155952991513,2cyclictest2188380-21kworker/u16:1+events_unbound22:02:556
2155950991513,2cyclictest2332761-21kworker/u16:0+flush-8:020:56:204
2155950991513,2cyclictest2332761-21kworker/u16:0+flush-8:020:56:204
2155950991513,2cyclictest2227078-21kworker/u16:3+events_unbound20:31:354
2155950991513,2cyclictest2117573-21kworker/u16:2+events_unbound19:26:374
2155950991513,2cyclictest2117573-21kworker/u16:2+events_unbound19:21:434
215595799149,4cyclictest2351663-21latency_hist20:46:207
215595799140,13cyclictest951ktimers/720:36:347
2155952991412,2cyclictest2217466-21kworker/u16:0+flush-8:019:41:486
2155952991411,2cyclictest2188380-21kworker/u16:1+events_unbound19:36:276
2155951991412,1cyclictest2358244-21kthreadcore20:46:405
2155950991412,2cyclictest2351851-21kworker/u16:4+events_unbound20:46:344
215595099140,14cyclictest0-21swapper/420:42:054
215595799139,3cyclictest1234-21snmpd19:17:447
2155957991312,0cyclictest0-21swapper/720:26:447
2155952991311,2cyclictest2188380-21kworker/u16:1+flush-8:019:26:496
2155952991311,2cyclictest2117573-21kworker/u16:2+flush-8:019:21:476
215595199131,6cyclictest2218371-21sed19:36:375
2155950991311,2cyclictest2117573-21kworker/u16:2+events_unbound19:13:274
2155950991310,2cyclictest2294190-21kworker/u16:2+flush-8:020:36:524
215595099130,1cyclictest0-21swapper/420:04:434
215595799129,2cyclictest1234-21snmpd20:21:317
215595799128,3cyclictest1234-21snmpd21:04:177
215595799127,4cyclictest5975-21gmain20:31:347
2155957991210,1cyclictest0-21swapper/719:36:457
215595299129,2cyclictest2227078-21kworker/u16:3+flush-8:020:56:446
2155950991211,1cyclictest0-21swapper/420:12:174
215595799118,2cyclictest1234-21snmpd19:26:507
215595799117,3cyclictest1234-21snmpd20:49:497
215595799111,9cyclictest951ktimers/719:11:307
215595299119,2cyclictest2227078-21kworker/u16:3+events_unbound21:01:456
2155952991110,1cyclictest0-21swapper/619:08:106
215595299110,11cyclictest0-21swapper/620:18:576
2155951991110,1cyclictest0-21swapper/521:03:425
2155951991110,1cyclictest0-21swapper/520:20:395
2155951991110,1cyclictest0-21swapper/520:09:465
215595199110,11cyclictest0-21swapper/519:59:315
215595099118,2cyclictest2188380-21kworker/u16:1+events_unbound19:31:344
215595299107,2cyclictest2211934-21grep19:31:406
215595099109,1cyclictest0-21swapper/419:10:294
215595099108,2cyclictest2227078-21kworker/u16:3+events_unbound20:06:274
215595099108,1cyclictest0-21swapper/419:51:384
215595099107,3cyclictest2255918-21kworker/u16:0+events_unbound19:56:384
21559529996,2cyclictest0-21swapper/620:46:346
21559529994,4cyclictest2266513-21irqcore20:01:396
21559529994,4cyclictest2179460-21grep19:16:326
21559519984,3cyclictest2273149-21cut20:01:445
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional