You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 23:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Fri May 08, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272252240163,24sleep30-21swapper/307:08:223
271672237162,25sleep20-21swapper/207:07:352
270262236162,23sleep10-21swapper/107:05:461
271752235159,24sleep00-21swapper/007:07:420
27447991091,3cyclictest0-21swapper/209:30:232
274479910392,9cyclictest0-21swapper/208:57:412
274479910197,3cyclictest0-21swapper/208:15:542
51182530,1sleep20-21swapper/212:25:122
247532530,2sleep10-21swapper/108:15:131
28372510,4sleep339-21rcuc/309:50:223
269512500,2sleep30-21swapper/308:20:123
2745499421,28cyclictest8202-21/usr/sbin/munin10:05:153
2745499421,25cyclictest958-21/usr/sbin/munin08:35:133
249142420,4sleep39-21rcu_preempt08:15:153
2745499411,32cyclictest5374-21/usr/sbin/munin08:45:233
2745499411,26cyclictest19802-21/usr/sbin/munin11:45:133
2744299411,30cyclictest18208-21gltestperf11:40:151
2744299411,27cyclictest8202-21/usr/sbin/munin10:05:201
2745499409,22cyclictest7571-21/usr/sbin/munin08:50:233
2744299407,23cyclictest18338-21latency_hist09:15:021
2744299407,23cyclictest18338-21latency_hist09:15:021
2744299401,29cyclictest473-21perl11:00:151
2744299401,29cyclictest11355-21/usr/sbin/munin07:45:121
2745499398,22cyclictest19539-21entropy10:30:153
2744299396,22cyclictest15470-21/usr/sbin/munin10:20:151
2744299391,34cyclictest9768-21gltestperf07:40:141
2744299391,31cyclictest11442-21cat12:40:001
2744299391,28cyclictest5659-21sed07:30:171
2744299391,24cyclictest1594-21/usr/sbin/munin09:50:191
27442993910,21cyclictest11734-21latency_hist09:00:011
2745499388,20cyclictest22964-21/usr/sbin/munin09:25:243
2745499387,20cyclictest26396-21/usr/sbin/munin12:00:193
2744299381,2cyclictest0-21swapper/109:55:171
2744299381,28cyclictest15402-21/usr/sbin/munin11:35:161
2744299381,24cyclictest1537-21crond08:05:011
2744299381,24cyclictest1537-21crond08:05:011
2744299381,24cyclictest0-21swapper/110:47:401
2744299375,21cyclictest0-21swapper/111:10:121
2744299373,24cyclictest8814-21/usr/sbin/munin11:20:251
2745499362,30cyclictest30530-21/usr/sbin/munin07:15:123
2745499361,24cyclictest658-21latency_hist08:35:023
2744299367,26cyclictest23-21ksoftirqd/108:45:071
2744299361,32cyclictest24951-21awk09:30:011
2744299361,24cyclictest30803-21/usr/sbin/munin12:10:151
2744299361,24cyclictest27983-21/usr/sbin/munin10:50:221
2744299361,24cyclictest20154-21entropy11:45:151
2744299361,24cyclictest17136-21tr10:25:101
27435993610,13cyclictest22744-21munin-run09:25:010
2745499354,21cyclictest0-21swapper/309:25:013
2745499351,4cyclictest5995-21/usr/sbin/munin10:00:143
2745499351,24cyclictest1402-21cat09:50:023
2744299356,20cyclictest18790-21expr09:15:131
2744299353,23cyclictest87350irq/126-enp1s0-10:35:121
2744299353,14cyclictest0-21swapper/109:35:241
2744299352,30cyclictest1122-21taskset09:47:101
2744299351,27cyclictest0-21swapper/107:28:201
2744299351,23cyclictest12050irq/123-ahci[0011:55:021
2744299350,1cyclictest0-21swapper/108:00:011
2745499343,22cyclictest12050irq/123-ahci[0011:45:023
2745499341,7cyclictest27360-21/usr/sbin/munin09:35:203
2745499341,6cyclictest9769-21/usr/sbin/munin08:55:163
2745499340,17cyclictest3177-21/usr/sbin/munin08:40:183
2744299345,17cyclictest13218-21grep10:15:131
27442993418,13cyclictest22341-21grep09:20:261
2744299341,3cyclictest26838-21cpuspeed_turbos08:20:121
2744299341,30cyclictest8587-21ls11:20:011
2744299341,2cyclictest24486-21sed08:15:021
2744299341,29cyclictest827-21runrttasks11:58:341
2744299341,24cyclictest4058-21awk12:20:211
2744299341,23cyclictest545-21/usr/sbin/munin12:15:171
2744299341,21cyclictest12362-21ls10:15:001
2744299341,18cyclictest7230-21/usr/sbin/munin12:30:221
2744299341,18cyclictest0-21swapper/109:45:021
27442993410,21cyclictest32493-21latency_hist07:20:021
2745499337,14cyclictest0-21swapper/308:10:223
2745499332,3cyclictest87350irq/126-enp1s0-10:40:313
2745499332,27cyclictest20503-21diskstats08:05:143
2745499332,17cyclictest16370-21/usr/sbin/munin09:10:213
2745499332,17cyclictest16370-21/usr/sbin/munin09:10:213
2745499331,5cyclictest0-21swapper/312:05:113
2745499331,20cyclictest5035-21/usr/sbin/munin12:25:143
2744299338,17cyclictest0-21swapper/108:35:161
2744299332,28cyclictest5848-21irqstats12:25:161
2744299331,8cyclictest30533-21sshd10:55:151
2744299331,6cyclictest13551-21/usr/sbin/munin07:50:121
2744299331,29cyclictest9093-21cat07:40:001
2744299331,29cyclictest5142-21latency_hist08:45:011
2744299331,22cyclictest29613-21gltestperf08:25:151
2744299331,21cyclictest13545-21df11:30:131
2744299331,21cyclictest13545-21df11:30:131
2745499323,19cyclictest17968-21sed10:25:183
2745499321,17cyclictest27130-21latency_hist09:35:023
2745499321,17cyclictest16140-21diskmemload11:13:373
2745499321,17cyclictest0-21swapper/312:30:223
2745499320,5cyclictest0-21swapper/310:55:023
2744299324,19cyclictest87650irq/129-enp1s0-07:20:161
2744299322,26cyclictest7065-21ntp_states10:00:221
2744299322,26cyclictest3449-21grep11:05:221
2744299321,28cyclictest31884-21if_enp1s008:30:161
2744299321,28cyclictest0-21swapper/107:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional