You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 00:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Thu Nov 27, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
773274376,7419sleep331655-21kworker/3:209:49:533
15499228576,2838sleep213993-21kworker/2:212:21:532
10827251922,481sleep310833-21cat06:58:423
10827251922,481sleep310833-21cat06:58:423
18999247517,440sleep019030-21/usr/sbin/munin10:48:420
9585242312,289sleep39724-21unixbench_singl08:33:523
4461241631,301sleep34547-21cut08:19:063
4461241631,301sleep34547-21cut08:19:063
16264238812,361sleep216300-21ntpq07:13:472
303572370334,22sleep230359-21sshd09:42:532
13411235011,227sleep313513-21timerandwakeup12:13:503
309522344162,155sleep30-21swapper/309:43:433
309522344162,155sleep30-21swapper/309:43:433
85812327148,119sleep312086-21cyclictest11:58:483
85812327148,119sleep312086-21cyclictest11:58:483
25141229471,207sleep3225-21systemd-journal07:43:213
14449228981,193sleep314557-21cut12:18:393
13177226316,232sleep113221-21ntpq12:13:441
11926226224,227sleep35666-21snmpd10:27:533
6914225779,89sleep30-21swapper/311:53:433
17922225417,86sleep317942-21sh09:03:203
8972241113,20sleep30-21swapper/308:08:403
19646223821,198sleep119655-21/usr/sbin/munin10:49:071
231872234102,22sleep30-21swapper/311:03:233
14309223229,43sleep314357-21fschecks_time10:34:403
18964223119,50sleep319112-21unixbench_singl09:03:523
4554223035,130sleep34647-21grep10:03:423
6090222111,194sleep26171-21sshd08:23:532
6090222111,194sleep26171-21sshd08:23:532
24632221726,137sleep324683-21sort09:23:433
6387221570,30sleep30-21swapper/310:08:473
31872200118,15sleep30-21swapper/309:58:453
32455219948,137sleep332494-21cat11:33:203
22582219610,171sleep322635-21sendmail_mailqu07:33:523
22582219610,171sleep322635-21sendmail_mailqu07:33:523
21538218820,146sleep30-21swapper/309:13:423
307218611,118sleep30-21swapper/311:33:363
2805821799,158sleep328112-21processes09:33:533
18939217944,18sleep30-21swapper/310:48:413
24547217817,145sleep124560-21fschecks_count09:23:411
496821718,47sleep30-21swapper/311:48:343
15078217181,63sleep30-21swapper/308:53:303
1735121680,23sleep312086-21cyclictest12:28:233
1259521649,137sleep312719-21/usr/sbin/munin08:43:533
1259521649,137sleep312719-21/usr/sbin/munin08:43:533
2856216115,56sleep10-21swapper/108:13:471
17645216010,121sleep30-21swapper/310:43:483
9753215841,50sleep30-21swapper/312:03:413
30222215443,39sleep30-21swapper/311:23:503
30222215443,39sleep30-21swapper/311:23:503
16425215426,81sleep316503-21switchtime07:13:533
3822215214,123sleep23834-21vmstat09:58:562
11995215251,73sleep112008-21modprobe07:03:201
11995215251,73sleep112008-21modprobe07:03:201
2655721508,70sleep30-21swapper/309:28:483
18578215014,121sleep218462-21sh10:48:282
15343214931,97sleep015345-21cron10:38:200
9859214511,117sleep110004-21unixbench_singl10:18:501
2850621448,11sleep10-21swapper/109:33:591
1333621415,12sleep30-21swapper/310:30:563
1333621415,12sleep30-21swapper/310:30:563
2051621399,88sleep30-21swapper/307:28:353
13990213821,39sleep113505-21/usr/sbin/munin08:48:481
5624213212,91sleep30-21swapper/308:23:423
5624213212,91sleep30-21swapper/308:23:423
20240212911,83sleep320302-21uname09:08:493
768721288,38sleep30-21swapper/310:13:393
23779212824,20sleep30-21swapper/311:03:433
23779212824,20sleep30-21swapper/311:03:433
31712212720,67sleep30-21swapper/308:03:353
1839221275,12sleep30-21swapper/307:19:423
1610721257,12sleep30-21swapper/310:38:523
12870212412,44sleep30-21swapper/307:03:513
2796121235,35sleep30-21swapper/307:49:433
2796121235,35sleep30-21swapper/307:49:433
8713212118,86sleep18814-21timerandwakeup11:58:501
8713212118,86sleep18814-21timerandwakeup11:58:501
29926212117,63sleep30-21swapper/307:58:233
3993212010,80sleep30-21swapper/311:43:503
2162821207,99sleep321771-21latency_hist10:58:223
12804212016,85sleep212867-21find07:03:502
14554211931,74sleep314578-21kernelversion07:08:443
22914211836,51sleep222906-21apt-get09:18:382
2027621178,40sleep30-21swapper/307:28:223
1745321169,94sleep317445-21apt-get12:28:363
1255521168,73sleep312562-21munin-run12:13:223
7604211512,17sleep00-21swapper/010:13:360
2818621146,72sleep30-21swapper/311:18:423
20225211213,71sleep120242-21awk07:28:201
1121211217,75sleep11220-21latency_hist09:53:221
8634211120,34sleep30-21swapper/308:33:233
26680210933,65sleep30-21swapper/307:48:133
23524210731,36sleep323630-21cat09:18:553
18711210721,64sleep20-21swapper/212:33:202
14750210512,76sleep014790-21ntp_kernel_pll_12:18:440
30536210424,64sleep130583-21awk07:58:451
25701210422,65sleep025717-21cut07:43:460
601021030,11sleep10-21swapper/108:23:511
601021030,11sleep10-21swapper/108:23:511
1819210238,29sleep30-21swapper/309:53:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional