You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 16:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Thu Sep 18, 2025 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32127215910,104sleep232172-21switchtime06:57:072
3159921487,22sleep00-21swapper/006:56:480
4599911635,74cyclictest0-21swapper/009:22:020
4599911622,26cyclictest10463-21latency_hist09:06:220
459991143,31cyclictest0-21swapper/011:56:380
459991113,31cyclictest24881-21if_eth010:27:290
4709911096,10cyclictest15702-21kworker/u17:0+ext4-rsv-conversion10:21:511
4709911096,10cyclictest15702-21kworker/u17:0+ext4-rsv-conversion10:21:511
459991103,30cyclictest19693-21ssh12:06:470
4709910994,8cyclictest0-21swapper/112:26:401
4599910940,61cyclictest356-21runrttasks09:51:390
4599910940,61cyclictest356-21runrttasks09:51:390
459991083,30cyclictest10241-21/usr/sbin/munin10:56:460
459991083,30cyclictest10241-21/usr/sbin/munin10:56:460
459991083,28cyclictest24860-21apt-get11:21:310
459991073,27cyclictest31091-21apt-config12:26:220
4599910622,27cyclictest14480-21kworker/u17:0+rpciod11:46:450
4599910622,27cyclictest14480-21kworker/u17:0+rpciod11:46:450
4599910548,51cyclictest12930-21kworker/u17:2+rpciod12:01:580
459991054,39cyclictest12721-21ssh11:01:310
4599910539,58cyclictest0-21swapper/009:56:400
2757621050,7sleep30-21swapper/311:26:213
470991044,78cyclictest356-21runrttasks10:26:581
459991042,28cyclictest9735-21wc07:26:540
459991042,28cyclictest9735-21wc07:26:540
4769910357,41cyclictest444-21cyclictest10:01:352
459991034,35cyclictest356-21runrttasks08:06:530
459991034,27cyclictest1073-21cstates10:41:450
459991033,38cyclictest25160-21latency_hist12:16:220
4599910331,11cyclictest0-21swapper/007:46:230
459991024,36cyclictest10938-21fschecks_count09:06:470
4599910241,54cyclictest25544-21apt-key08:16:240
459991023,39cyclictest6027-21latency_hist08:56:230
459991023,38cyclictest16111-21grep10:12:070
459991023,38cyclictest16111-21grep10:12:070
459991023,33cyclictest18160-21cut10:16:410
459991023,33cyclictest18160-21cut10:16:410
459991013,48cyclictest5252-21grep11:41:550
459991013,36cyclictest24005-21apt-key10:26:240
459991013,36cyclictest24005-21apt-key10:26:240
459991013,31cyclictest648-21ssh09:46:240
459991004,36cyclictest5923-21/usr/sbin/munin07:16:490
459991004,36cyclictest5923-21/usr/sbin/munin07:16:490
459991004,34cyclictest2216-21munin-node07:06:290
459991003,37cyclictest10940-21latency11:51:500
459991003,33cyclictest27989-21wc10:31:560
459991003,33cyclictest27989-21wc10:31:560
459991003,32cyclictest22431-21ntpq09:26:500
459991003,32cyclictest12374-21/usr/sbin/munin07:36:480
459991003,32cyclictest12374-21/usr/sbin/munin07:36:480
4599910028,65cyclictest0-21swapper/009:46:370
470999910,64cyclictest31035-21apt-get11:31:371
45999994,33cyclictest0-21swapper/009:16:340
45999993,35cyclictest8300-21timerandwakeup07:21:530
45999993,35cyclictest28290-21awk09:36:500
45999993,23cyclictest18839-21cstates11:11:380
45999992,37cyclictest22405-21mailstats11:16:580
208522990,5sleep10-21swapper/111:15:001
45999984,33cyclictest21931-21latency_hist08:06:230
45999984,29cyclictest30605-21/usr/sbin/munin10:37:140
45999984,29cyclictest30605-21/usr/sbin/munin10:37:140
459999841,50cyclictest13760-21sh10:08:190
45999983,38cyclictest3026-21/usr/sbin/munin08:46:480
45999983,38cyclictest17227-21/usr/sbin/munin07:51:560
45999983,35cyclictest305-21latency_hist07:01:250
45999983,34cyclictest7241-21grep08:56:590
45999983,34cyclictest7241-21grep08:56:590
45999983,32cyclictest15818-21cstates11:06:380
459999832,8cyclictest0-21swapper/008:27:390
459999830,8cyclictest0-21swapper/007:11:590
45999982,35cyclictest31746-21cstates12:26:580
45999982,22cyclictest17642fschecks_count11:36:420
459999818,21cyclictest10829-21taskset10:03:100
47099973,75cyclictest30350-21apt-get10:36:491
47099973,75cyclictest30350-21apt-get10:36:491
459999743,48cyclictest28369-21ntp_kernel_pll_11:26:470
45999973,40cyclictest7407-21/usr/sbin/munin10:51:480
45999973,36cyclictest32165-21grep08:36:230
45999973,32cyclictest25190-21ls09:31:500
45999973,32cyclictest25190-21ls09:31:500
45999964,35cyclictest13768-21fschecks_count09:11:430
45999964,28cyclictest30465-21apt-get11:31:250
459999636,52cyclictest0-21swapper/012:16:370
45999963,36cyclictest27524-21cstates08:21:400
45999963,34cyclictest1169-21latency_hist08:41:220
45999962,35cyclictest3939-21cpuspeed10:46:400
45999962,35cyclictest3939-21cpuspeed10:46:400
3178629612,55sleep131790-21kernelversion06:56:531
459999535,53cyclictest0-21swapper/008:17:480
459999533,54cyclictest0-21swapper/008:41:320
459999533,54cyclictest0-21swapper/008:41:320
45999953,31cyclictest15816-21fschecks_count07:46:460
47699943,31cyclictest30429-21ssh09:41:332
45999944,33cyclictest11365-21grep07:31:520
45999933,34cyclictest356-21runrttasks07:56:570
476999246,40cyclictest356-21runrttasks11:15:472
476999143,41cyclictest22439-21mailstats11:16:582
470999120,53cyclictest24860-21apt-get11:21:391
476999037,42cyclictest0-21swapper/209:56:232
476999037,42cyclictest0-21swapper/209:56:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional