You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 14:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Mon Nov 03, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21883210207,1001sleep021924-21ntpq21:00:170
23731259747,523sleep023919-21latency_hist22:49:480
23731259747,523sleep023919-21latency_hist22:49:480
139724008,381sleep01437-21ntpq19:55:120
139724008,381sleep01437-21ntpq19:55:120
2179823498,328sleep021888-21apt-config22:44:470
683723186,300sleep06873-21ntpq21:55:130
21272230737,257sleep021312-21latency19:15:140
25730230024,263sleep00-21swapper/019:30:040
29298228620,246sleep229292-21apt-get21:25:022
17900226715,157sleep017969-21latency_hist00:14:470
15449226569,181sleep215450-21ntp_states00:05:172
11967225562,125sleep012022-21fschecks_count23:55:050
11967225562,125sleep012022-21fschecks_count23:55:050
18626224856,132sleep00-21swapper/020:50:160
18626224856,132sleep00-21swapper/020:50:160
2589622479,198sleep025926-21kernelversion22:55:090
6919221925,92sleep36938-21idleruntime-cro20:14:453
20949221767,132sleep020985-21munin-plugin-st00:24:450
1400922149,115sleep014156-21latency_hist22:19:480
532022138,190sleep35326-21ntpq21:50:153
31670221270,53sleep00-21swapper/023:14:470
29368220822,150sleep00-21swapper/021:25:040
19411220012,175sleep219413-21grep19:10:032
2150321904,173sleep00-21swapper/000:25:090
2142218978,93sleep02271-21timerwakeupswit21:40:190
5613218717,48sleep00-21swapper/023:34:500
14088218149,50sleep00-21swapper/000:00:180
16544217031,103sleep00-21swapper/019:00:250
29105216720,129sleep229108-21/usr/sbin/munin23:05:122
1990721656,94sleep00-21swapper/020:54:560
6119216124,117sleep16135-21modprobe21:54:451
30960216157,89sleep00-21swapper/023:10:190
19879216144,21sleep00-21swapper/019:10:180
1066621599,137sleep010702-21ntp_kernel_err23:50:120
1337215710,64sleep01351-21needreboot23:20:120
5340214728,81sleep01-21systemd23:34:460
890821436,12sleep10-21swapper/122:00:271
23169214350,54sleep023225-21fschecks_time21:05:140
2411821429,120sleep024147-21latency_hist00:34:460
31916214023,78sleep00-21swapper/019:50:070
28139213921,54sleep00-21swapper/019:35:250
28139213921,54sleep00-21swapper/019:35:250
17735213851,76sleep01714-1kworker/0:1H20:48:300
28446213742,77sleep00-21swapper/023:04:460
10100213610,112sleep010245-21latency_hist20:24:480
2439721358,110sleep00-21swapper/022:50:250
22632213519,44sleep322662-21awk22:45:153
22632213519,44sleep322662-21awk22:45:153
9254213110,80sleep09326-21mailstats23:45:160
18726212924,82sleep118760-21munin-plugin-st19:09:461
18223212918,90sleep118279-21fschecks_count00:15:051
23157212823,87sleep323166-21forks21:05:133
1630421288,61sleep016408-21date00:09:470
477721248,75sleep04891-21sed20:05:170
1587121208,14sleep20-21swapper/222:25:112
25408211917,82sleep00-21swapper/019:29:480
25408211917,82sleep00-21swapper/019:29:480
1155921190,8sleep10-21swapper/123:54:451
27509211730,19sleep00-21swapper/021:19:480
2927211616,82sleep13082-21cut21:44:481
1629121159,48sleep01-21systemd20:44:460
7707211213,81sleep17748-21systemd-run21:59:461
25020211118,70sleep325063-21ntp_offset21:10:183
17134211143,45sleep117154-21sh19:04:451
1432121118,92sleep014356-21fschecks_count22:20:080
15100211019,76sleep215117-21uniq20:40:082
8680210714,74sleep38791-21cat22:00:253
1899721079,23sleep20-21swapper/219:09:512
31525210620,62sleep131670-21sed21:30:181
28118210643,46sleep00-21swapper/021:20:120
27835210627,64sleep327914-21fschecks_time21:20:073
16681210629,55sleep00-21swapper/022:25:250
18599210530,63sleep018667-21modprobe22:34:460
26384210419,64sleep126521-21head19:30:171
11557210441,21sleep00-21swapper/022:10:150
29763210319,69sleep329800-21wc21:25:163
18406210311,75sleep018444-21latency00:15:080
13540210312,17sleep30-21swapper/320:35:043
8509210112,77sleep08597-21wc23:44:470
8509210112,77sleep08597-21wc23:44:470
5328210127,62sleep05366-21processes21:50:160
10803210118,61sleep110315-21/usr/sbin/munin20:25:171
7771210021,23sleep30-21swapper/321:59:483
32546210048,15sleep032630-21perl21:35:060
18488210014,71sleep318519-21nfs_client20:50:113
18488210014,71sleep318519-21nfs_client20:50:113
1275921007,61sleep10-21swapper/122:15:041
1195129916,66sleep211960-21df_inode23:55:032
1195129916,66sleep211960-21df_inode23:55:032
3003229825,60sleep030081-21systemd-run19:44:460
2149929719,38sleep10-21swapper/121:00:021
1919029726,52sleep00-21swapper/022:35:100
3187729615,68sleep331913-21cpu19:50:063
1472429620,14sleep00-21swapper/020:39:460
186522945,33sleep00-21swapper/019:08:480
1846129313,67sleep318462-21sshd19:06:253
1791129328,29sleep10-21swapper/120:49:481
25242928,31sleep00-21swapper/023:25:010
1754729012,61sleep217603-21/usr/sbin/munin22:30:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional