You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sun Jul 12, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
274812238163,24sleep10-21swapper/119:09:071
274782238166,24sleep30-21swapper/319:09:063
272312233161,59sleep00-21swapper/019:05:520
272232203166,24sleep20-21swapper/219:05:462
1613121630,4sleep22764399cyclictest22:20:222
27643991091,3cyclictest0-21swapper/222:47:242
95222590,1sleep00-21swapper/019:40:120
27643995955,3cyclictest0-21swapper/220:41:422
27643995653,2cyclictest0-21swapper/220:35:572
309392510,5sleep12763899cyclictest22:55:161
65102500,2sleep30-21swapper/319:30:273
46872420,4sleep1221ktimersoftd/120:40:241
27649994210,25cyclictest463-21/usr/sbin/munin19:20:273
2764399421,30cyclictest22198-21/usr/sbin/munin21:20:232
2764399412,24cyclictest25541-21grep23:55:232
2764399403,31cyclictest30832-40dnf20:26:362
2764999381,26cyclictest18163-21users21:10:273
2764399381,27cyclictest18773-21/usr/sbin/munin22:25:272
2764999371,32cyclictest31989-21sh19:15:253
2764999371,23cyclictest0-21swapper/300:00:173
2764399371,23cyclictest11323-21latency_hist19:45:022
2764399370,27cyclictest10596-21/usr/sbin/munin22:10:202
2764399370,27cyclictest10596-21/usr/sbin/munin22:10:202
2764999363,29cyclictest30832-40dnf20:26:373
2764999361,32cyclictest24405-21/usr/sbin/munin23:55:243
27643993634,1cyclictest0-21swapper/222:07:002
2764399361,25cyclictest7258-21ntpq22:00:222
2764399361,22cyclictest20352-21/usr/sbin/munin20:05:232
2764399361,22cyclictest15956-21/usr/sbin/munin23:35:142
2764999351,30cyclictest5261-21/usr/sbin/munin00:25:263
2764999351,21cyclictest24348-21fschecks_time22:40:173
2764999351,20cyclictest9430-21latency_hist00:35:013
2764999351,20cyclictest9430-21latency_hist00:35:013
2764399351,23cyclictest4947-21missed_timers21:55:222
2764399351,23cyclictest13415-21/usr/sbin/munin23:30:152
2764399351,21cyclictest804-21abrt-dump-journ23:05:012
2764999342,29cyclictest17810-21/usr/sbin/munin23:40:163
2764399341,23cyclictest24076-21memory21:25:172
141692340,1sleep10-21swapper/122:15:231
27649993313,14cyclictest0-21swapper/323:15:193
2764999331,29cyclictest27558-21/usr/sbin/munin21:35:213
2763199335,13cyclictest0-21swapper/020:55:020
2764999321,28cyclictest25982-21/usr/sbin/munin22:45:143
2764999321,27cyclictest19392-21/usr/sbin/munin22:30:223
2764999321,22cyclictest1228-21/usr/sbin/munin23:00:193
2764399324,19cyclictest22595-21netstat22:35:202
2764399322,22cyclictest32-21ksoftirqd/200:00:072
291812310,1sleep30-21swapper/319:10:253
2764999311,27cyclictest30384-21/usr/sbin/munin22:55:273
2764999311,26cyclictest0-21swapper/323:28:343
2764999311,22cyclictest580-21sshd20:31:343
2764999311,18cyclictest12171-21/usr/sbin/munin21:00:263
2764399312,25cyclictest27287-21diskstats20:20:142
2764399311,26cyclictest32418-21ntp_states20:30:232
2764399311,26cyclictest31581-21tune2fs00:10:152
2764399311,26cyclictest16573-21/usr/sbin/munin21:10:282
2764399311,26cyclictest14819-21ntp_states19:50:222
2764399311,18cyclictest9806-21if_err_enp2s023:20:162
2764399311,18cyclictest9806-21if_err_enp2s023:20:162
2764399311,17cyclictest87350irq/126-enp1s0-21:45:222
2764399311,17cyclictest827-21runrttasks00:20:352
27643993110,17cyclictest21352-21crond22:35:012
2764399310,20cyclictest0-21swapper/223:10:232
85462300,5sleep12763899cyclictest22:05:121
2764999309,18cyclictest4811-21timerwakeupswit20:40:253
2764999309,18cyclictest11735-21cstates19:45:133
2764999302,24cyclictest1461-21grep00:15:153
27649993013,14cyclictest31957-21/usr/sbin/munin21:45:153
27649993012,15cyclictest4623-21/usr/sbin/munin23:10:243
2764999301,13cyclictest0-21swapper/322:07:123
27649993011,16cyclictest21310-21df_inode21:20:143
27649993010,17cyclictest27617-21hddtemp_smartct20:20:173
27649993010,17cyclictest17916-21if_enp1s022:25:183
2764999300,28cyclictest0-21swapper/320:03:123
2764399307,20cyclictest18758-21head20:00:162
2764399301,26cyclictest20036-21smart_sda21:15:272
2764399301,25cyclictest31341-21/usr/sbin/munin21:40:252
27643993012,14cyclictest13185-21turbostat.cron23:30:012
2764399301,17cyclictest20007-21/usr/sbin/munin23:45:122
2764399301,16cyclictest0-21swapper/222:15:112
2764999299,17cyclictest24926-21cstates20:15:123
2764999299,17cyclictest14161-21timerandwakeup22:15:233
2764999298,18cyclictest20439-21cpuspeed_turbos20:05:133
2764999298,18cyclictest10924-21unixbench_singl19:40:253
2764999292,23cyclictest29890-21ntp_states00:05:213
2764999292,23cyclictest16685-21ntp_states23:35:223
2764999291,25cyclictest4105-21/usr/sbin/munin00:20:213
2764999291,25cyclictest31029-21/usr/sbin/munin00:10:183
2764999291,24cyclictest4438-40dnf19:26:223
2764999291,20cyclictest0-21swapper/322:50:273
2764999290,27cyclictest0-21swapper/323:05:243
2764399292,23cyclictest8528-21ntp_states00:30:212
2764399292,23cyclictest8528-21ntp_states00:30:212
2764399292,23cyclictest3115-21diskstats19:25:172
2764399291,25cyclictest29007-21/usr/sbin/munin22:50:192
2764399291,25cyclictest28188-21/usr/sbin/munin21:35:152
2764399291,24cyclictest31554-21uname19:15:192
2764399291,24cyclictest31373-21strings22:55:212
2764399291,24cyclictest28503-21cut19:10:152
2764399291,24cyclictest24582-21/usr/sbin/munin22:40:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional