You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-02 - 20:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7.osadl.org (updated Sun Nov 02, 2025 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15028991123,30cyclictest7393-21apt-get08:24:120
150289911223,25cyclictest0-21swapper/009:23:480
15028991107,93cyclictest9742-21apt-get08:29:150
150289911036,11cyclictest0-21swapper/007:34:010
150289911036,11cyclictest0-21swapper/007:34:010
150289911034,8cyclictest0-21swapper/011:48:170
150289911034,8cyclictest0-21swapper/011:48:170
150289911023,13cyclictest0-21swapper/007:44:330
15028991094,31cyclictest14368-21latency_hist08:44:000
15028991093,48cyclictest26642-21proc_pri11:14:330
15028991092,48cyclictest20794-21apt-get09:04:130
15028991092,48cyclictest20794-21apt-get09:04:130
150289910834,15cyclictest15018-21cyclictest08:21:200
150289910722,11cyclictest0-21swapper/011:04:200
150289910722,11cyclictest0-21swapper/011:04:200
150289910636,7cyclictest0-21swapper/009:59:370
15028991062,29cyclictest23974-21unixbench_multi09:09:350
15028991043,35cyclictest352-21runrttasks11:38:450
15028991043,35cyclictest19822-21kernelversion08:59:240
15028991043,35cyclictest16185-21/usr/sbin/munin08:49:250
15028991043,35cyclictest16185-21/usr/sbin/munin08:49:250
15028991043,34cyclictest29604-21/usr/sbin/munin12:19:220
15028991043,33cyclictest352-21runrttasks11:10:340
15028991043,33cyclictest352-21runrttasks11:10:340
15028991042,35cyclictest25931-21grep07:39:360
150289910422,15cyclictest0-21swapper/008:14:270
2864821030,8sleep00-21swapper/007:49:150
15028991033,42cyclictest352-21runrttasks08:04:310
15028991033,39cyclictest9680-21cron11:43:570
15028991033,32cyclictest14636-21cpu08:44:180
15028991032,35cyclictest12799-21fschecks_time09:49:200
15028991024,34cyclictest352-21runrttasks09:37:110
150289910240,14cyclictest4812-21sh12:31:200
15028991023,40cyclictest13835-21unixbench_singl11:49:370
15028991023,37cyclictest21193-21cat07:24:320
15028991023,37cyclictest21193-21cat07:24:320
15028991023,34cyclictest31687-21/usr/sbin/munin10:24:360
15028991023,33cyclictest29111-21/usr/sbin/munin10:19:340
15028991023,32cyclictest15466-21grep07:09:210
15028991023,29cyclictest352-21runrttasks12:00:500
15028991023,29cyclictest352-21runrttasks12:00:500
15028991023,22cyclictest24308-21/usr/sbin/munin12:09:280
1486621026,15sleep10-21swapper/107:08:521
15028991014,34cyclictest31774-21/usr/sbin/munin07:59:350
15028991013,37cyclictest17795-21/usr/sbin/munin08:54:190
15028991013,35cyclictest24479-21ls07:34:340
15028991013,35cyclictest2195-21/usr/sbin/munin11:29:590
15028991013,34cyclictest1563-21cstates09:29:160
15028991013,34cyclictest10867-21unixbench_singl09:44:380
150289910124,19cyclictest0-21swapper/010:30:290
150289910124,19cyclictest0-21swapper/010:30:290
15028991012,35cyclictest17113-21uname07:14:080
15028991012,35cyclictest17113-21uname07:14:080
15028991012,33cyclictest26097-21latency_hist10:14:010
15028991012,27cyclictest4689-21sh10:34:170
15028991004,36cyclictest14933-21latency_hist10:54:010
15028991004,36cyclictest14933-21latency_hist10:54:010
15028991004,35cyclictest7142-21/usr/sbin/munin10:39:340
15028991003,33cyclictest352-21runrttasks11:23:340
15028991003,33cyclictest352-21runrttasks11:23:340
15028991002,35cyclictest27694-21unixbench_singl12:14:370
1503499993,75cyclictest7896-21apt-get08:24:121
1502899994,31cyclictest15043-21latency_hist07:09:020
15028999935,10cyclictest23023-21ssh10:07:090
1502899993,23cyclictest9726-21latency_hist09:44:010
1502899993,22cyclictest27056-21/usr/sbin/munin10:14:310
1502899992,33cyclictest15493-21fschecks_count10:54:200
1502899984,40cyclictest21860-21unixbench_singl12:04:330
1502899983,37cyclictest352-21runrttasks07:20:160
1502899983,37cyclictest352-21runrttasks07:20:160
1502899982,39cyclictest352-21runrttasks08:10:400
1502899982,38cyclictest16418-21ssh09:55:080
1502899982,34cyclictest11735-21latency08:34:240
1502899973,35cyclictest32495-21head11:24:390
1502899973,35cyclictest32495-21head11:24:390
1502899973,33cyclictest17875-21ssh10:59:160
1502899963,33cyclictest352-21runrttasks07:57:160
1502899953,36cyclictest6888-21switchtime12:34:330
1502899943,33cyclictest423-21grep12:24:210
1502899943,33cyclictest423-21grep12:24:210
15034999372,13cyclictest299-21systemd-logind09:53:581
1502899932,34cyclictest25618-21/usr/sbin/munin09:14:280
15028999213,29cyclictest32459-21sshd09:25:200
1502899903,35cyclictest352-21runrttasks11:57:390
1502899893,33cyclictest11082-21ssh10:45:160
1494528911,43sleep214888-21latency_hist07:09:022
15034998872,10cyclictest207-21systemd-journal09:33:581
15034998866,15cyclictest15018-21cyclictest12:19:351
15041998765,15cyclictest299-21systemd-logind11:33:582
15034998754,8cyclictest181rcu_preempt10:24:341
15041998662,18cyclictest10132-21sh11:44:192
15041998662,18cyclictest10132-21sh11:44:192
15041998539,13cyclictest181rcu_preempt07:45:302
1504199842,42cyclictest39-21ksoftirqd/212:04:322
15034998452,12cyclictest181rcu_preempt12:24:161
15034998452,12cyclictest181rcu_preempt12:24:161
1504199836,42cyclictest39-21ksoftirqd/209:14:362
15041998350,11cyclictest25107-21munin-run07:38:592
15041998350,10cyclictest181rcu_preempt07:54:092
15041998345,16cyclictest181rcu_preempt11:34:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional