You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 03:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Tue Jul 01, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
109942117711,1155sleep211029-1kworker/2:2H23:29:572
109942117711,1155sleep211029-1kworker/2:2H23:29:572
23744292611,871sleep323788-21unin-run00:14:383
11940264616,616sleep111960-21users20:05:161
23201262117,587sleep123268-21/usr/sbin/munin18:59:521
23201262117,587sleep123268-21/usr/sbin/munin18:59:521
29095242771,330sleep329255-21unixbench_multi21:00:123
24067242715,396sleep324159-21fschecks_time22:30:003
24067242715,396sleep324159-21fschecks_time22:30:003
31624233061,139sleep30-21swapper/321:09:583
2661322969,272sleep326639-21latency_hist20:54:393
6158227615,199sleep36198-21ntp_kernel_pll_23:15:043
20123225512,229sleep020131-21ntp_states18:50:100
97282225113,53sleep30-21swapper/321:44:403
14561222011,197sleep314638-21switchtime23:40:083
2248622179,192sleep322547-21latency20:40:373
23822221650,55sleep30-21swapper/320:44:573
31247221443,151sleep331250-21cron21:09:373
29600221022,167sleep129671-21sort19:20:041
21673220613,128sleep321809-21unixbench_singl00:05:133
27946219011,168sleep1370-21snmpd20:57:271
281652184113,55sleep328143-21latency_hist20:59:393
24759217815,107sleep324897-21sed00:15:103
1405217520,140sleep01424-21idleruntime-cro19:34:370
14702217336,119sleep30-21swapper/320:15:123
14702217336,119sleep30-21swapper/320:15:123
22517217115,136sleep322598-21fschecks_time22:24:593
4889216734,111sleep30-21swapper/323:10:113
11059216530,115sleep30-21swapper/320:04:583
1758215914,130sleep31886-21unixbench_multi23:00:093
23054215616,20sleep30-21swapper/318:59:463
23054215616,20sleep30-21swapper/318:59:463
22304215520,113sleep022367-21cut20:40:340
1510521548,132sleep315164-21find22:00:113
28078215258,59sleep30-21swapper/319:15:013
3619214614,115sleep13658-21ntp_kernel_pll_19:40:041
28290214614,117sleep00-21swapper/022:44:070
2927821418,121sleep329322-21ntpq22:45:193
20688214163,57sleep321030-21cyclictest00:04:403
12923214115,108sleep30-21swapper/323:35:073
21036214019,101sleep30-21swapper/322:20:023
276721395,12sleep00-21swapper/023:05:030
19101213916,16sleep30-21swapper/323:59:393
11648213929,89sleep30-21swapper/321:50:013
19281213869,20sleep30-21swapper/320:30:073
15596213833,93sleep315644-21awk23:44:533
15596213833,93sleep315644-21awk23:44:533
26098213412,63sleep326224-21latency_hist19:09:403
19672213412,20sleep30-21swapper/322:15:053
267121308,58sleep32747-21mailstats21:20:123
2332421297,105sleep00-21swapper/022:25:120
30740212813,99sleep130853-21unixbench_singl21:05:151
30027212814,50sleep30-21swapper/319:20:143
29673212815,94sleep20-21swapper/219:20:052
16743212615,51sleep30-21swapper/322:05:123
16743212615,51sleep30-21swapper/322:05:123
24163212514,97sleep024201-21idleruntime22:30:010
24163212514,97sleep024201-21idleruntime22:30:010
26781212410,75sleep31-21systemd22:39:373
19483212411,96sleep219595-21timerwakeupswit20:30:102
22556212311,93sleep022583-21sort18:59:390
10731212311,61sleep30-21swapper/320:04:383
13823212222,74sleep213974-21unixbench_singl21:55:172
3105121219,72sleep331131-21timerandwakeup22:50:123
3087821210,13sleep20-21swapper/221:05:152
2377821207,85sleep20-21swapper/220:44:562
931421188,75sleep39352-21ls23:25:013
931421188,75sleep39352-21ls23:25:013
20378211823,71sleep120513-21grep18:50:151
7517211717,80sleep07032-21apt-get23:19:490
7466211722,50sleep30-21swapper/321:35:103
389211710,73sleep3410-21irqstats19:30:003
1147211714,68sleep31235-21mailstats21:15:113
26734211523,50sleep30-21swapper/319:10:043
13052211554,40sleep30-21swapper/321:54:543
18788211420,59sleep30-21swapper/322:11:503
22161211322,69sleep121650-21apt-get20:39:501
25577211220,65sleep10-21swapper/100:19:531
12220211249,16sleep30-21swapper/323:34:393
12220211249,16sleep30-21swapper/323:34:393
694321117,90sleep3370-21snmpd19:50:073
18468211119,75sleep218625-21tail23:55:062
30085210720,70sleep030136-21fschecks_count21:05:020
25500210525,48sleep125521-21apt-get22:34:511
29752210224,58sleep229838-21grep21:04:392
26009210213,74sleep226074-21mailstats22:35:082
21473210214,74sleep121589-21cat22:20:121
20991210212,75sleep020350-21/usr/sbin/munin20:35:080
14279210214,71sleep00-21swapper/023:40:010
11702210218,61sleep00-21swapper/023:30:240
11702210218,61sleep00-21swapper/023:30:240
1607621016,79sleep00-21swapper/023:45:060
1607621016,79sleep00-21swapper/023:45:060
2959229928,48sleep229756-21unixbench_multi22:45:262
2845929917,64sleep028528-21/usr/sbin/munin19:15:100
2034929933,32sleep10-21swapper/120:34:491
13152990,11sleep10-21swapper/121:15:121
1044929916,63sleep210508-21/usr/sbin/munin21:45:112
973829817,65sleep29762-21kernelversion20:00:042
1943529813,67sleep119533-21fschecks_time23:59:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional