You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 07:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Mon Oct 20, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1347425167,497sleep013521-21ntpq22:40:590
15403236816,330sleep015504-21latency_hist00:30:360
32099234012,200sleep032165-21fschecks_time23:40:540
106232324127,178sleep010754-21grep22:31:070
3582227715,244sleep00-21swapper/022:10:560
20783227323,228sleep220927-21grep21:21:082
9376226814,232sleep29407-21fschecks_count19:06:082
21264226396,149sleep021305-21fschecks_time23:06:100
4727225124,215sleep04225-21/usr/sbin/munin23:56:040
11998225123,213sleep112062-21find22:36:041
1453722405,10sleep00-21swapper/021:01:160
2517622217,205sleep2195-21jbd2/mmcblk2p2-19:55:212
10533221538,161sleep010538-21modprobe19:10:340
15328221443,149sleep015470-21unixbench_multi19:21:280
2169221312,116sleep01-21systemd20:25:350
2169221312,116sleep01-21systemd20:25:350
4010220840,33sleep03984-40mandb23:55:360
4010220840,33sleep03984-40mandb23:55:360
7105220728,139sleep07195-21mailstats22:21:050
7105220728,139sleep07195-21mailstats22:21:050
20636220614,171sleep020078-21/usr/sbin/munin21:21:060
2764321959,171sleep027709-21date21:45:370
19395219515,159sleep00-21swapper/023:00:530
17516219412,159sleep00-21swapper/022:55:370
30852219118,153sleep030995-21grep20:11:100
16523219120,148sleep030986-1kworker/0:2H21:10:360
28622218597,20sleep00-21swapper/020:05:530
8684218314,154sleep08773-21grep20:45:370
93421809,158sleep01018-21cat22:01:070
93421809,158sleep01018-21cat22:01:070
12497217816,142sleep012554-21awk19:15:350
23885217219,98sleep00-21swapper/021:31:070
2418217111,145sleep02444-21latency_hist23:50:350
24902217017,132sleep124938-21fschecks_time21:35:571
22258216910,136sleep00-21swapper/019:45:380
22904216710,76sleep00-21swapper/023:10:590
6375215349,90sleep06525-21latency_hist22:20:370
10427215323,113sleep010465-21sendmail00:15:340
10427215323,113sleep010465-21sendmail00:15:340
17758215188,48sleep016946-21/usr/sbin/munin21:11:210
1407821519,129sleep014121-21gpgv19:20:350
20748214616,107sleep320959-21apt-config23:05:373
18637214614,102sleep00-21swapper/021:15:530
13369214232,14sleep00-21swapper/021:00:350
13369214232,14sleep00-21swapper/021:00:350
31725214086,31sleep00-21swapper/023:40:340
1746621379,93sleep017512-21wc19:30:360
1746621379,93sleep017512-21wc19:30:360
191121327,13sleep00-21swapper/022:05:510
7334213117,95sleep37352-21/usr/sbin/munin00:05:483
11103213123,87sleep111120-21fschecks_count00:16:201
628021306,112sleep00-21swapper/000:01:050
14383213016,98sleep114523-21sed22:45:371
7345212818,33sleep10-21swapper/120:40:461
18372212611,69sleep00-21swapper/019:31:130
2682221238,82sleep026829-21munin-run20:00:360
4974212230,66sleep35116-21head23:56:073
2625221229,19sleep00-21swapper/023:21:040
15238212131,68sleep315320-21cat19:21:273
32305211621,75sleep332391-21/usr/sbin/munin20:16:053
3219211414,80sleep13361-21latency_hist22:10:371
4739210911,52sleep00-21swapper/020:31:280
9297210713,81sleep19334-21sed20:45:591
19073210739,52sleep019202-21latency_hist23:00:370
32358210632,62sleep00-21swapper/021:58:280
1907210520,42sleep20-21swapper/222:05:492
16045210541,52sleep016092-21ntpq00:31:010
24541210420,63sleep124589-21latency_hist21:35:361
2190210412,25sleep32274-21memory22:05:583
2164210419,67sleep32166-21cron20:25:343
2164210419,67sleep32166-21cron20:25:343
16932210416,69sleep117060-21/usr/sbin/munin19:26:141
16932210416,69sleep117060-21/usr/sbin/munin19:26:141
5826210210,16sleep00-21swapper/020:35:520
30638210214,72sleep130697-21processes20:11:071
2851210217,47sleep00-21swapper/020:25:590
16936210218,66sleep116450-21apt-get21:10:461
9389210113,74sleep19391-21sshd22:27:161
27547210112,72sleep00-21swapper/023:25:560
841421008,16sleep00-21swapper/022:26:140
29516210014,71sleep129553-21fschecks_count21:50:541
29516210014,71sleep129553-21fschecks_count21:50:541
1149521008,57sleep0362-21snmpd20:52:280
16782990,8sleep20-21swapper/222:05:362
16782990,8sleep20-21swapper/222:05:362
82142987,15sleep00-21swapper/000:06:090
5672986,11sleep10-21swapper/123:42:161
425029811,28sleep20-21swapper/223:55:502
252362979,49sleep00-21swapper/021:36:040
2242229714,67sleep122551-21awk21:26:081
2241029716,65sleep20-21swapper/223:10:362
2173829711,46sleep00-21swapper/021:25:540
344829611,68sleep23567-21users23:51:102
344829611,68sleep23567-21users23:51:102
2892429615,29sleep00-21swapper/021:47:510
2519029645,40sleep0362-21snmpd19:55:310
875829536,34sleep28857-21gpgv19:05:362
43412958,24sleep30-21swapper/320:30:553
3092629513,68sleep031081-21gpgv21:55:380
3092629513,68sleep031081-21gpgv21:55:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional