You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 03:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Mon Jul 14, 2025 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26619213615,85sleep026711-21unixbench_singl07:01:370
27040211716,59sleep227065-21munin-run07:05:472
27183991023,75cyclictest17750-21apt-get12:31:110
271839910162,8cyclictest181rcu_preempt10:12:460
27199999944,47cyclictest0-21swapper/210:35:482
27199999841,13cyclictest356-21runrttasks09:21:562
27199999836,13cyclictest0-21swapper/211:11:072
27199999836,13cyclictest0-21swapper/211:11:072
271112989,60sleep127119-21ls07:05:501
27199999640,50cyclictest29081-21latency_hist10:55:482
2719999963,32cyclictest31753-21latency_hist11:00:482
27199999576,15cyclictest27174-21cyclictest12:06:122
27199999576,15cyclictest27174-21cyclictest12:06:122
2719999953,38cyclictest27189-21ssh11:51:022
2719999953,38cyclictest14249-21grep10:26:292
2719999953,38cyclictest14249-21grep10:26:292
2719999953,33cyclictest24891-21uname11:46:222
2719999953,31cyclictest22392-21grep11:41:252
2719999953,29cyclictest19168-21grep08:16:242
27199999527,12cyclictest0-21swapper/212:31:352
27199999526,16cyclictest0-21swapper/207:16:172
2719999943,39cyclictest1990-21cut07:26:082
2719999943,35cyclictest8857-21runrttasks12:15:492
2719999943,35cyclictest8857-21runrttasks12:15:492
2719999943,34cyclictest5530-21wc09:11:222
2719999943,34cyclictest31163-21latency_hist08:55:492
2719999943,34cyclictest19987-21grep10:36:582
2719999943,33cyclictest8203-21latency_hist07:45:502
27199999428,12cyclictest0-21swapper/211:06:252
27199999428,11cyclictest0-21swapper/212:21:102
2719999942,36cyclictest29399-21/usr/sbin/munin07:11:022
2719999933,35cyclictest356-21runrttasks11:21:332
2719999933,34cyclictest19595-21ssh11:37:002
2719999933,34cyclictest19595-21ssh11:37:002
2719999933,33cyclictest31645-21latency_hist10:00:502
2719999933,33cyclictest31645-21latency_hist10:00:502
2719999932,35cyclictest18901-21grep09:36:232
160792930,7sleep30-21swapper/310:31:073
2719999924,32cyclictest14820-21grep08:05:492
2719999923,37cyclictest24985-21grep10:46:222
2719999923,37cyclictest15567-21fschecks_time09:31:092
2719999923,37cyclictest15567-21fschecks_time09:31:092
2719999923,34cyclictest13522-21sh11:26:142
2719999923,34cyclictest13522-21sh11:26:142
2719999923,33cyclictest24032-21ssh10:45:502
2719999914,35cyclictest7591-21fschecks_time09:16:102
2719999914,35cyclictest7591-21fschecks_time09:16:102
2719999913,36cyclictest3574-21df_inode07:31:092
2719999913,34cyclictest15575-21processes08:06:222
2719999913,33cyclictest32613-21ntp_kernel_err11:01:162
2719999912,37cyclictest21767-21wc09:41:242
2719999912,37cyclictest21767-21wc09:41:242
2719999912,34cyclictest27558-21fschecks_count07:06:072
2719999912,33cyclictest8571-21timerwakeupswit11:16:262
27187999144,10cyclictest181rcu_preempt12:02:541
27183999155,7cyclictest181rcu_preempt12:01:240
2719999903,30cyclictest29496-21latency_hist08:50:482
2719999902,42cyclictest13290-21latency_hist08:00:502
2719999902,39cyclictest2531-21kernelversion09:06:112
2719999893,39cyclictest2350-21fschecks_time10:06:102
27199998929,12cyclictest0-21swapper/208:21:202
2719999892,37cyclictest1162-21mailstats09:01:222
2719999892,36cyclictest9223-21fschecks_count12:16:092
2719999884,29cyclictest28021-21latency_hist08:45:502
2719999883,37cyclictest24102-21latency09:46:142
2719999883,34cyclictest10459-21kernelversion07:51:122
2719999883,34cyclictest10459-21kernelversion07:51:122
2719999883,33cyclictest432-21latency_hist09:00:492
2719999883,33cyclictest432-21latency_hist09:00:492
2719999883,32cyclictest8814-21fschecks_time07:46:352
2719999882,36cyclictest23490-21netstat08:31:172
2719999873,37cyclictest22051-21mailstats08:26:212
2719999873,36cyclictest8342-21cut10:16:472
2719999873,36cyclictest8342-21cut10:16:472
2719999873,34cyclictest26519-21fschecks_count09:51:082
2719999873,33cyclictest356-21runrttasks07:36:092
2719999873,33cyclictest27128-21timerwakeupswit08:41:252
2719999872,34cyclictest16235-21netstat11:31:172
2719999863,36cyclictest12758-21ls09:26:072
2719999862,34cyclictest5700-21timerandwakeup10:11:242
27183998654,8cyclictest181rcu_preempt07:46:280
2719999853,33cyclictest24939-21fschecks_time08:36:122
27187998520,44cyclictest31-21ksoftirqd/108:16:131
2719999843,36cyclictest18107-21cat08:15:492
2719999833,33cyclictest356-21runrttasks10:20:572
27187998365,13cyclictest27174-21cyclictest09:01:141
27187998358,19cyclictest8340-21sh12:14:501
27187998358,19cyclictest8340-21sh12:14:501
27187998351,10cyclictest181rcu_preempt07:10:521
27183998360,17cyclictest4987-21latency_hist07:35:500
2718399835,53cyclictest15-21ksoftirqd/009:06:010
27187998233,13cyclictest181rcu_preempt12:26:051
27183998259,17cyclictest378-21rs:main0
27183998248,7cyclictest181rcu_preempt10:05:590
27183998235,38cyclictest4536-21modprobe11:10:460
2718399822,27cyclictest30615-21ntp_kernel_err11:56:160
27187998163,11cyclictest18363-21ntp_kernel_err12:31:461
27187998153,8cyclictest181rcu_preempt07:31:241
27183998164,11cyclictest331-21dbus-daemon11:35:480
27187998065,10cyclictest27174-21cyclictest10:35:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional