You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 21:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sat Aug 08, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
315652236161,25sleep00-21swapper/007:07:270
316052233163,57sleep30-21swapper/307:07:583
314852202166,24sleep20-21swapper/207:06:242
298052201166,24sleep10-21swapper/107:05:071
2628321430,5sleep23186399cyclictest11:50:012
666921410,4sleep13185799cyclictest11:05:061
1297921390,4sleep33187099cyclictest08:50:193
31863998783,3cyclictest0-21swapper/210:52:542
62672520,1sleep10-21swapper/109:50:131
3185399401,28cyclictest977-21/usr/sbin/munin08:25:160
3185399401,27cyclictest808-21snmpd10:33:210
3185399383,10cyclictest1011450kworker/u8:211:05:160
3185399381,25cyclictest2059-21taskset10:55:010
3185399379,13cyclictest30931-21munin-run08:20:010
3185399379,13cyclictest30931-21munin-run08:20:010
3185399371,6cyclictest3364-21open_files10:55:250
3185399371,22cyclictest30852-21/usr/sbin/munin12:00:190
3185399371,22cyclictest17054-21/usr/sbin/munin10:15:210
3185399362,18cyclictest17024-21/usr/sbin/munin07:45:230
3185399351,4cyclictest23274-21chrt10:28:200
3185399351,20cyclictest827-21runrttasks12:10:240
3186399341,18cyclictest0-21swapper/207:13:392
3185399349,12cyclictest11734-21/usr/sbin/munin12:30:260
3185399344,27cyclictest30021-21awk10:45:010
3185399343,3cyclictest12050irq/123-ahci[0009:00:020
211562340,1sleep10-21swapper/107:55:191
3186399331,13cyclictest0-21swapper/210:45:032
3185399337,22cyclictest23165-21pluginstate11:40:220
3185399337,22cyclictest23165-21pluginstate11:40:220
3185399336,12cyclictest13966-21awk08:55:010
3185399335,3cyclictest87550irq/128-enp1s0-07:42:500
3185399333,3cyclictest87550irq/128-enp1s0-11:10:250
3185399331,5cyclictest12435-21awk10:05:020
3185399331,4cyclictest0-21swapper/012:20:280
3185399331,3cyclictest87350irq/126-enp1s0-09:40:010
3185399331,2cyclictest0-21swapper/011:59:110
3185399329,19cyclictest909-21sssd_nss09:45:010
3185399328,21cyclictest3854-21/usr/sbin/munin09:45:240
3185399326,13cyclictest26765-21/usr/sbin/munin08:10:190
3185399325,3cyclictest25842-21/usr/sbin/munin10:35:200
3185399321,3cyclictest810-21sshd07:36:370
3185399321,3cyclictest609-21/usr/sbin/munin12:05:260
3185399321,28cyclictest17667-21/usr/sbin/munin11:30:240
3185399319,19cyclictest22362-21/usr/sbin/munin08:00:130
3185399316,12cyclictest21836-21munin-run11:40:010
3185399312,6cyclictest20832-21/usr/sbin/munin09:10:190
3185399312,3cyclictest5101-21/usr/sbin/munin12:15:180
3185399311,6cyclictest8597-21diskstats09:55:140
3185399311,3cyclictest23842-21/usr/sbin/munin09:15:180
31853993113,15cyclictest10840-21ntp_offset08:45:210
3185399311,14cyclictest17444-21munin-run11:30:010
31853993110,18cyclictest7861-21expr08:40:120
31853993110,18cyclictest18651-21cpu09:05:130
3187099304,9cyclictest7658-21needreboot11:05:213
3185399309,18cyclictest6981-21acpi07:25:120
3185399309,17cyclictest9772-21grep07:30:170
3185399308,19cyclictest3118-21sort07:15:160
3185399307,20cyclictest4782-21/usr/sbin/munin07:20:190
3185399302,4cyclictest29392-21/usr/sbin/munin09:30:010
3185399302,4cyclictest29392-21/usr/sbin/munin09:30:010
3185399302,3cyclictest14116-21/usr/sbin/munin10:05:260
3185399301,4cyclictest30840-21/usr/sbin/munin09:30:240
3185399301,4cyclictest13990-21/usr/sbin/munin12:35:140
3185399301,3cyclictest25473-21/usr/sbin/munin08:05:190
31853993013,14cyclictest32469-21grep07:10:150
31853993010,17cyclictest27049-21tail11:50:170
31853993010,17cyclictest13545-21cat11:20:140
3187099297,12cyclictest827-21runrttasks12:13:263
3187099296,13cyclictest579-21systemd-journal12:20:213
31870992913,8cyclictest25685-21sed11:45:253
31870992912,3cyclictest5646-21grep11:00:233
3186399291,13cyclictest0-21swapper/209:26:032
3186399291,13cyclictest0-21swapper/209:26:032
3185399297,19cyclictest11196-21expr11:15:140
3185399292,3cyclictest4458-21/usr/sbin/munin08:30:230
3185399291,4cyclictest6963-21memory09:50:190
3185399291,4cyclictest4639-21/usr/sbin/munin11:00:130
3185399291,4cyclictest26686-21/usr/sbin/munin09:20:260
3185399291,4cyclictest18293-21/usr/sbin/munin07:50:120
3185399291,3cyclictest31269-21/usr/sbin/munin10:45:220
3185399291,3cyclictest25478-21/usr/sbin/munin11:45:240
3185399291,3cyclictest20021-21/usr/sbin/munin10:20:170
3185399291,3cyclictest17862-21/usr/sbin/munin09:00:260
3187099281,15cyclictest27417-21/usr/sbin/munin09:25:233
3187099281,15cyclictest27417-21/usr/sbin/munin09:25:233
3187099281,13cyclictest10443-21/usr/sbin/munin10:00:163
3187099280,21cyclictest401ktimersoftd/311:10:193
3186399281,13cyclictest0-21swapper/208:29:232
3185399288,17cyclictest20356-21expr07:55:130
3185399281,4cyclictest9893-21entropy12:25:150
3185399281,4cyclictest15692-21/usr/sbin/munin10:10:190
3185399281,3cyclictest6081-21hwlatdetect08:35:160
3185399281,3cyclictest31322-21/usr/sbin/munin08:20:120
3187099275,14cyclictest0-21swapper/311:25:253
3187099274,5cyclictest0-21swapper/311:30:233
3187099274,14cyclictest24104-21cut11:45:013
3187099274,14cyclictest24104-21cut11:45:003
3187099271,15cyclictest30929-21ls08:20:013
3187099271,15cyclictest30929-21ls08:20:013
3187099271,13cyclictest29619-21/usr/sbin/munin09:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional