You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 23:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Wed Sep 17, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
884244129,4333sleep029653-21kworker/u8:112:07:580
190222178817,1756sleep219023-21ntp_states07:57:582
1156028138,792sleep011550-21apt-get09:17:500
1156028138,792sleep011550-21apt-get09:17:500
5743259511,569sleep15753-21ntpq08:57:561
2838722807,196sleep028450-21cpuspeed11:52:440
29585225718,218sleep029740-21unixbench_multi10:13:010
14357225569,62sleep014440-21awk11:08:070
18185225010,226sleep2362-21snmpd11:21:462
3872224352,22sleep00-21swapper/007:12:300
27446223775,143sleep027553-21fschecks_time10:07:480
23740221519,183sleep023796-21latency08:13:020
23740221519,183sleep023796-21latency08:13:020
17457220419,160sleep017461-21cron09:37:280
2310422008,64sleep00-21swapper/011:37:100
2310422008,64sleep00-21swapper/011:37:100
2045421918,18sleep00-21swapper/011:27:530
10593217615,42sleep010675-21fschecks_time10:57:500
29782217322,125sleep229875-21fschecks_time08:32:502
24926217211,146sleep025055-21unixbench_multi09:58:070
2615621689,147sleep026167-21apt.systemd.dai11:46:100
15201216810,17sleep00-21swapper/011:12:310
2707821668,135sleep00-21swapper/008:22:590
32430216511,140sleep032443-21awk08:38:170
10446216411,22sleep00-21swapper/009:12:570
15438216320,41sleep00-21swapper/007:47:460
15438216320,41sleep00-21swapper/007:47:460
699121619,26sleep00-21swapper/009:02:520
5925215915,124sleep00-21swapper/012:22:520
3072215911,21sleep00-21swapper/010:32:550
2998215915,55sleep33073-21grep12:12:583
1089621569,11sleep30-21swapper/307:32:513
737721548,134sleep07425-21latency12:27:520
506921548,18sleep05138-21cat07:13:020
31793215310,125sleep031847-21latency_hist10:22:290
3064021515,12sleep00-21swapper/008:33:290
30052215123,107sleep130146-21fschecks_time11:57:501
22951215111,119sleep00-21swapper/008:12:290
1979121497,12sleep00-21swapper/008:02:030
23712214670,64sleep023730-21kernelversion11:37:500
9395214518,107sleep00-21swapper/012:33:010
2246214416,111sleep32308-21/usr/sbin/munin08:47:493
4977214225,97sleep15015-21munin-run08:57:281
71221416,11sleep00-21swapper/010:25:480
8418214019,27sleep00-21swapper/009:07:440
1519721409,22sleep00-21swapper/007:47:300
1519721409,22sleep00-21swapper/007:47:300
1002121406,11sleep00-21swapper/010:55:240
829213923,96sleep1351-21apt-get12:07:391
21474213723,88sleep10-21swapper/111:32:301
431721367,12sleep00-21swapper/008:52:590
2862321368,53sleep00-21swapper/008:27:550
629621335,11sleep00-21swapper/008:59:040
14433213212,17sleep00-21swapper/009:27:300
8248212915,99sleep18276-21users10:48:021
8248212915,99sleep18276-21users10:48:021
9671212819,90sleep19677-21ntp_states07:28:051
9671212819,90sleep19677-21ntp_states07:28:051
27132212511,71sleep00-21swapper/011:48:000
14721212510,102sleep014728-21df_inode09:27:470
736921249,17sleep00-21swapper/010:47:410
736921249,17sleep00-21swapper/010:47:410
21837212423,81sleep121354-21apt-get11:32:391
21837212423,81sleep121354-21apt-get11:32:391
993221230,8sleep30-21swapper/312:37:273
23421212311,96sleep122942-21apt-get08:12:341
23421212311,96sleep122942-21apt-get08:12:341
1914321238,77sleep019230-21sort11:23:010
552721218,101sleep05556-21munin-run10:42:280
920721197,77sleep09203-21apt-get07:27:440
920721197,77sleep09203-21apt-get07:27:440
7362211917,84sleep17393-21awk07:22:281
7362211917,84sleep17393-21awk07:22:281
1978821198,18sleep00-21swapper/009:42:570
2302221187,14sleep00-21swapper/009:52:580
9915211622,74sleep29931-21modprobe12:37:272
28134211621,19sleep30-21swapper/311:52:313
610021148,64sleep00-21swapper/007:17:420
610021148,64sleep00-21swapper/007:17:420
3265721145,98sleep00-21swapper/012:05:520
3265721145,98sleep00-21swapper/012:05:520
2188121125,96sleep00-21swapper/009:49:150
2188121125,96sleep00-21swapper/009:49:150
15927211115,77sleep316002-21/usr/sbin/munin11:12:593
1196921115,95sleep00-21swapper/007:36:560
765721106,13sleep00-21swapper/007:22:470
10632211018,77sleep210485-21latency_hist07:32:342
10632211018,77sleep210485-21latency_hist07:32:342
4508210916,78sleep34542-21irqstats10:37:513
6190210861,26sleep00-21swapper/010:42:520
2552121087,12sleep00-21swapper/008:17:580
30598210674,17sleep00-21swapper/011:58:010
16745210616,77sleep316798-21cat07:52:293
16745210616,77sleep316798-21cat07:52:293
1206721067,62sleep00-21swapper/011:02:460
2692521045,29sleep00-21swapper/010:05:460
1657210425,55sleep01816-21tail07:03:010
20876210322,26sleep30-21swapper/309:47:443
20876210322,26sleep30-21swapper/309:47:443
1903621037,58sleep00-21swapper/009:42:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional