You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 10:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Mon Apr 06, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
187952236163,23sleep10-21swapper/119:06:141
189222203167,24sleep20-21swapper/219:07:522
171262201163,25sleep30-21swapper/319:05:073
171282200163,25sleep00-21swapper/019:05:090
2326621050,5sleep21917299cyclictest00:10:192
324762520,1sleep30-21swapper/300:30:223
19172995148,2cyclictest0-21swapper/200:26:192
253842500,2sleep00-21swapper/020:35:140
19172994113,25cyclictest26994-21df19:25:132
1917299381,21cyclictest13520-21awk23:50:012
1917299376,21cyclictest17068-21ls21:30:122
1917299361,4cyclictest87350irq/126-enp1s0-19:10:222
17892360,4sleep31917899cyclictest20:55:123
1917299359,22cyclictest6818-21grep19:50:242
1917299351,5cyclictest15727-21nfs4_client21:25:202
1917299348,22cyclictest3480-21/usr/sbin/munin21:00:012
1917299341,24cyclictest32480-21chrt23:17:342
1917299341,22cyclictest26885-21chrt20:38:102
19172993410,21cyclictest13177-21hddtemp_smartct21:20:162
1917299334,3cyclictest87350irq/126-enp1s0-22:45:202
1917299332,5cyclictest4675-21diskstats22:15:142
1917299332,3cyclictest12050irq/123-ahci[0022:05:012
1917299331,7cyclictest15219-21cat22:40:022
1917299331,4cyclictest9040-21sed21:10:202
1917299331,29cyclictest4346-21cut21:00:172
1917299321,5cyclictest29787-21kworker/u8:022:08:232
1917299321,5cyclictest26551-21cat19:25:012
1917299321,5cyclictest19754-21sshd00:00:292
1917299321,5cyclictest0-21swapper/223:40:122
1917299321,5cyclictest0-21swapper/223:40:122
1917299321,4cyclictest11986-21ntp_states22:30:212
1917299321,4cyclictest11986-21ntp_states22:30:212
19172993214,15cyclictest2114-21awk23:20:252
19172993212,17cyclictest17287-21sort23:55:242
1917299319,19cyclictest29636-21cat20:45:112
1917299319,18cyclictest25354-21gltestperf00:15:152
1917299314,3cyclictest87350irq/126-enp1s0-23:50:252
1917299314,3cyclictest87350irq/126-enp1s0-00:20:232
1917299311,6cyclictest0-21swapper/220:30:242
1917299311,5cyclictest9447-21latency_hist20:00:002
1917299311,5cyclictest2762-21awk00:35:272
1917299311,3cyclictest87350irq/126-enp1s0-20:20:012
1917299311,3cyclictest87350irq/126-enp1s0-20:20:012
1917299311,3cyclictest1089-21cstates19:40:112
1917299306,21cyclictest4174-21timerwakeupswit23:25:252
1917299305,22cyclictest0-21swapper/200:10:012
1917299304,13cyclictest9980-21cstates20:00:122
1917299302,3cyclictest21293-21/usr/sbin/munin21:40:192
1917299301,4cyclictest7063-21grep22:20:142
1917299301,4cyclictest31665-21/usr/sbin/munin20:50:132
1917299301,4cyclictest20357-21/usr/sbin/munin21:35:232
1917299301,3cyclictest827-21runrttasks22:28:432
1917299301,3cyclictest19392-21memory20:20:172
1917299301,3cyclictest15237-21/usr/sbin/munin20:10:232
1917299301,3cyclictest1032-21latency_hist00:35:012
19172993011,4cyclictest21643-21missed_timers20:25:192
1917299299,17cyclictest29841-21cut19:30:182
1917299293,5cyclictest21854-21smart_sda19:15:032
1917299291,6cyclictest0-21swapper/222:50:192
1917299291,5cyclictest3109-21grep19:45:122
1917299291,5cyclictest0-21swapper/221:50:172
1917299291,4cyclictest7159-21/usr/sbin/munin23:35:112
1917299291,4cyclictest2833-21/usr/sbin/munin22:10:162
1917299291,4cyclictest23400-21/usr/sbin/munin22:55:262
1917299291,4cyclictest15314-21/usr/sbin/munin22:40:122
1917299291,4cyclictest10644-21df21:15:142
1917299291,3cyclictest23494-21/usr/sbin/munin21:45:222
19172992913,13cyclictest24797-21hwlatdetect23:00:162
19172992912,14cyclictest5912-21/usr/sbin/munin21:05:142
19172992910,16cyclictest13865-21basename20:10:002
19172992910,15cyclictest27563-21cat20:40:122
1916599290,22cyclictest0-21swapper/122:00:071
1916099292,14cyclictest21694-21munin-run22:55:010
1917299286,18cyclictest26938-21gltestperf23:05:162
1917299282,3cyclictest87650irq/129-enp1s0-19:35:172
1917299281,4cyclictest29194-21/usr/sbin/munin23:10:172
1917299281,3cyclictest27886-21/usr/sbin/munin21:55:122
1916099280,13cyclictest16066-21awk20:15:010
75592270,2sleep11916599cyclictest23:35:141
1917299271,3cyclictest6564-21chrt23:30:382
1916599271,6cyclictest0-21swapper/122:24:061
1917899261,11cyclictest0-21swapper/322:47:293
1916599261,11cyclictest0-21swapper/121:20:251
19165992610,3cyclictest21615-21smart_sda00:05:221
1916099261,12cyclictest24250-21awk19:20:010
1917899251,6cyclictest28567-21smartctl21:55:143
1916599252,6cyclictest31228-40dnf20:47:291
1916599251,21cyclictest29492-21df_inode00:25:141
1916599251,11cyclictest27037-21latency_hist20:40:021
1916599241,5cyclictest0-21swapper/121:38:241
1916599241,4cyclictest0-21swapper/123:49:481
1916599241,11cyclictest26943-21expr19:25:131
1916599241,11cyclictest15637-21cat22:40:121
1916599241,11cyclictest0-21swapper/123:32:111
1916599240,8cyclictest0-21swapper/122:27:041
1916599240,3cyclictest0-21swapper/121:54:511
19160992415,3cyclictest1676-1kworker/u9:200:28:000
87312230,2sleep00-21swapper/023:35:250
1917899231,9cyclictest0-21swapper/323:16:533
1917899231,5cyclictest0-21swapper/300:37:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional