You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 16:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Wed Dec 03, 2025 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82539911752,7cyclictest0-21swapper/019:30:150
82729911366,41cyclictest9107-21sh22:45:042
82729911366,41cyclictest9107-21sh22:45:042
82539911338,15cyclictest0-21swapper/019:28:420
82539911338,15cyclictest0-21swapper/019:28:420
82539911034,20cyclictest15869-21modprobe21:08:390
8253991103,33cyclictest32554-21ps23:24:110
8253991103,33cyclictest32554-21ps23:24:110
82539910654,44cyclictest0-21swapper/021:09:220
82539910645,13cyclictest20393-21unixbench_multi21:14:160
82539910440,12cyclictest0-21swapper/020:44:160
8253991023,35cyclictest8245-21cyclictest19:08:440
8272991003,50cyclictest10996-21ssh22:48:562
827299983,37cyclictest24138-21fschecks_time19:54:032
827299972,39cyclictest24747-21ssh21:22:562
827299972,39cyclictest24747-21ssh21:22:562
8265999773,14cyclictest0-21swapper/122:38:421
825399964,44cyclictest11246-21ntpq21:54:100
825399964,44cyclictest11246-21ntpq21:54:100
752729611,58sleep17581-21timerandwakeup19:04:271
827299947,80cyclictest0-21swapper/220:53:512
827299922,70cyclictest2218-21ssh00:23:582
758329210,40sleep20-21swapper/219:04:282
827299913,34cyclictest22477-21/usr/sbin/munin22:14:182
825399914,30cyclictest1681-21ssh00:23:400
8272999045,37cyclictest15890-21diskmemload21:14:112
827299893,38cyclictest28457-21munin-run23:18:412
827299892,40cyclictest8052-21sendmail-msp23:38:402
827299892,40cyclictest8052-21sendmail-msp23:38:402
8272998847,36cyclictest8245-21cyclictest22:32:472
827299876,56cyclictest6241-21sshd20:38:592
8272998734,45cyclictest0-21swapper/219:43:422
827299873,37cyclictest17577-21wc19:34:072
8272998639,40cyclictest1769-21ssh00:23:422
827299863,35cyclictest1542-21latency20:24:072
827299863,33cyclictest27624-21/usr/sbin/munin20:04:092
827299863,31cyclictest355-21runrttasks21:02:092
827299863,29cyclictest355-21runrttasks19:52:192
827299862,32cyclictest30264-21ssh00:15:562
827299862,26cyclictest1733-21kworker/u19:3+rpciod21:58:512
827299856,62cyclictest28947-21apt-get23:18:562
827299853,39cyclictest30963-21taskset22:28:292
827299853,38cyclictest19226-21modprobe22:08:392
827299853,35cyclictest19967-21/usr/sbin/munin23:03:582
827299853,35cyclictest19967-21/usr/sbin/munin23:03:582
827299853,34cyclictest14677-21unixbench_singl19:24:172
827299853,34cyclictest14677-21unixbench_singl19:24:172
827299853,34cyclictest11487-21df23:43:582
827299853,28cyclictest14697-21cstates21:04:402
827299852,37cyclictest14980-21grep22:54:172
827299852,37cyclictest14980-21grep22:54:172
827299852,29cyclictest3224-21grep23:29:162
8272998521,51cyclictest0-21swapper/220:13:422
827299844,32cyclictest13274-21/usr/sbin/munin21:58:412
827299844,32cyclictest13274-21/usr/sbin/munin21:58:412
827299843,38cyclictest4554-21rm22:38:412
827299843,35cyclictest31422-21taskset21:33:592
827299843,24cyclictest8069-21fschecks_time20:44:042
827299842,37cyclictest20965-21fschecks_count19:45:032
8272998423,54cyclictest0-21swapper/220:14:052
827299842,30cyclictest22755-21latency_hist00:03:412
8265998468,9cyclictest0-21swapper/123:34:131
8265998468,9cyclictest0-21swapper/123:34:131
827299833,37cyclictest5906-21chrt20:38:422
827299833,37cyclictest5906-21chrt20:38:422
827299833,35cyclictest7827-21latency_hist22:43:432
827299833,34cyclictest7580-21latency_hist00:33:432
827299833,34cyclictest15344-21grep23:49:192
827299833,32cyclictest15879-21apt-get21:08:452
827299823,37cyclictest8981-21head00:34:172
827299823,34cyclictest548-21rm23:24:192
827299823,34cyclictest548-21rm23:24:192
827299823,31cyclictest23199-21fschecks_count00:04:032
827299822,35cyclictest8709-21unixbench_multi21:49:192
124302820,6sleep00-21swapper/022:50:210
827299813,37cyclictest17209-21cut22:59:042
827299813,34cyclictest9945-21ssh23:40:412
827299813,23cyclictest32495-21/usr/sbin/munin20:19:092
827299812,33cyclictest17282-21cpu23:53:562
827299812,33cyclictest17282-21cpu23:53:562
827299812,28cyclictest9798-21latency_hist19:13:442
8265998165,12cyclictest22106-21kworker/u17:0-rpciod22:29:011
8265998160,11cyclictest0-21swapper/100:03:401
8253998162,13cyclictest9862-21ssh23:40:260
8253998159,15cyclictest7772-21latency_hist00:33:430
827299803,27cyclictest23301-21/usr/sbin/munin23:09:062
827299803,27cyclictest10641-21/usr/sbin/munin19:14:002
8253998065,9cyclictest15890-21diskmemload00:04:040
8253998040,23cyclictest19905-21ssh23:03:570
8253998040,23cyclictest19905-21ssh23:03:570
8272997958,14cyclictest28559-21fschecks_time21:29:032
827299793,38cyclictest25669-21ssh22:19:002
827299793,38cyclictest25669-21ssh22:19:002
827299793,36cyclictest2244-21grep21:39:072
827299793,22cyclictest4820-21ssh21:43:572
827299793,22cyclictest4820-21ssh21:43:572
827299792,34cyclictest12119-21/usr/sbin/munin19:19:112
827299792,28cyclictest2926-21grep20:29:022
827299792,28cyclictest2926-21grep20:29:022
827299792,26cyclictest20128-21ntpq22:09:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional