You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 23:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Apr 22, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166092940,3sleep00-21swapper/010:57:060
75022700,4chrt0-21swapper/311:57:233
75022700,4chrt0-21swapper/311:57:233
291622690,3chrt0-21swapper/308:37:123
291622690,3chrt0-21swapper/308:37:123
293602670,2chrt29359-21ntp_states10:02:241
293602670,2chrt29359-21ntp_states10:02:241
293602670,2chrt29359-21ntp_states10:02:241
64102660,1chrt0-21swapper/009:02:170
64102660,1chrt0-21swapper/009:02:170
64102660,1chrt0-21swapper/009:02:170
263772650,3chrt0-21swapper/311:22:183
263772650,3chrt0-21swapper/311:22:183
263772650,3chrt0-21swapper/311:22:183
254122570,2sleep016-21ksoftirqd/011:17:280
254122570,2sleep016-21ksoftirqd/011:17:280
254122570,2sleep016-21ksoftirqd/011:17:280
54552530,3sleep15457-21grep08:57:281
54552530,3sleep15457-21grep08:57:281
244112530,2sleep124593-21gltestperf11:17:181
244112530,2sleep124593-21gltestperf11:17:181
244112530,2sleep124593-21gltestperf11:17:181
205772510,2sleep30-21swapper/312:32:203
116832510,2chrt11682-21irqstats10:42:201
116832510,2chrt11682-21irqstats10:42:201
116832510,2chrt11682-21irqstats10:42:201
56122490,3chrt0-21swapper/311:52:203
56122490,3chrt0-21swapper/311:52:203
100642480,2sleep30-21swapper/310:37:233
100642480,2sleep30-21swapper/310:37:233
100642480,2sleep30-21swapper/310:37:233
52812470,3sleep05285-21switchtime08:57:270
52812470,3sleep05285-21switchtime08:57:270
30024994622,22cyclictest16265-21ntp_kernel_pll_09:27:231
30024994622,22cyclictest16265-21ntp_kernel_pll_09:27:231
246982460,4sleep30-21swapper/311:17:193
246982460,4sleep30-21swapper/311:17:193
246982460,4sleep30-21swapper/311:17:193
326862440,2sleep00-21swapper/011:37:260
326862440,2sleep00-21swapper/011:37:260
326862440,2sleep00-21swapper/011:37:260
30024994422,20cyclictest31825-21ntp_offset08:42:241
30024994422,20cyclictest31825-21ntp_offset08:42:241
105442440,2sleep20-21swapper/212:07:152
105442440,2sleep20-21swapper/212:07:152
105442440,2sleep20-21swapper/212:07:152
30024994310,30cyclictest0-21swapper/109:54:341
30024994310,30cyclictest0-21swapper/109:54:341
3002499401,12cyclictest23750-21ntp_states09:47:221
3002499401,12cyclictest23750-21ntp_states09:47:221
3002499401,12cyclictest23750-21ntp_states09:47:221
3002499388,28cyclictest10409-21cat12:07:071
3002499388,28cyclictest10409-21cat12:07:071
3002499388,28cyclictest10409-21cat12:07:071
30024993829,7cyclictest19754-21kernelversion09:37:191
30024993829,7cyclictest19754-21kernelversion09:37:191
30024993829,7cyclictest19754-21kernelversion09:37:191
3002499381,9cyclictest26893-21ntp_states11:22:241
3002499381,9cyclictest26893-21ntp_states11:22:241
3002499381,9cyclictest26893-21ntp_states11:22:241
3002499381,7cyclictest18983-21sshd09:36:221
3002499381,7cyclictest18983-21sshd09:36:221
3002499381,11cyclictest19418-21ntp_states11:02:231
3002499381,11cyclictest19418-21ntp_states11:02:231
30024993718,17cyclictest0-21swapper/109:57:271
30024993718,17cyclictest0-21swapper/109:57:271
3002499371,7cyclictest1505-21grep08:47:251
3002499371,7cyclictest14499-21sort07:57:171
3002499371,7cyclictest14499-21sort07:57:171
3002499361,9cyclictest749-21runrttasks10:22:011
3002499361,9cyclictest749-21runrttasks10:22:011
30024993619,15cyclictest4346-21sed11:47:261
30024993619,15cyclictest4346-21sed11:47:261
3002499361,8cyclictest28506-21/usr/sbin/munin08:32:281
3002499361,8cyclictest28506-21/usr/sbin/munin08:32:281
3002499361,7cyclictest700-21192.168.115.40-manager10:13:031
3002499361,7cyclictest700-21192.168.115.40-manager10:13:031
3002499361,7cyclictest23816-21sshd11:14:231
3002499361,7cyclictest23816-21sshd11:14:231
3002499361,7cyclictest23362-21sshd12:41:231
3002499361,7cyclictest23362-21sshd12:41:231
3002499361,7cyclictest23362-21sshd12:41:231
3002499361,6cyclictest23067-21sshd08:18:231
3002499361,6cyclictest23067-21sshd08:18:231
3002499361,6cyclictest19480-21sshd12:29:221
3002499361,6cyclictest19480-21sshd12:29:221
3002499361,6cyclictest19480-21sshd12:29:221
3002499361,5cyclictest21439-21sshd08:16:231
3002499361,5cyclictest21439-21sshd08:16:231
3002499361,10cyclictest3944-21awk07:27:261
3002499360,6cyclictest4156-21taskset08:57:061
30018993628,6cyclictest19369-21netstat11:02:220
30018993628,6cyclictest19369-21netstat11:02:220
22992360,3chrt0-21swapper/311:42:273
22992360,3chrt0-21swapper/311:42:273
3002499356,7cyclictest8356-21cut10:32:261
3002499355,6cyclictest7051-21cut11:57:181
3002499355,6cyclictest7051-21cut11:57:181
3002499351,9cyclictest6891-21df_inode07:37:151
3002499351,9cyclictest6891-21df_inode07:37:151
3002499351,9cyclictest22645-21taskset09:45:201
3002499351,9cyclictest22645-21taskset09:45:201
3002499351,9cyclictest15012-21/usr/sbin/munin12:17:221
3002499351,9cyclictest15012-21/usr/sbin/munin12:17:221
3002499351,8cyclictest9408-21ntp_states07:42:221
3002499351,8cyclictest9408-21ntp_states07:42:221
3002499351,7cyclictest21693-21unixbench_multi11:07:261
3002499351,7cyclictest21693-21unixbench_multi11:07:261
3002499351,7cyclictest21693-21unixbench_multi11:07:261
3002499351,7cyclictest15355-21awk09:27:061
3002499351,7cyclictest15355-21awk09:27:061
3002499351,6cyclictest30707-21sshd08:40:231
3002499351,6cyclictest30707-21sshd08:40:231
3002499351,6cyclictest26156-21netstat08:27:231
3002499351,6cyclictest26156-21netstat08:27:231
3002499351,6cyclictest21496-21sshd12:36:201
3002499351,11cyclictest7328-21unixbench-2d09:02:261
3002499351,11cyclictest7328-21unixbench-2d09:02:261
3002499351,11cyclictest7328-21unixbench-2d09:02:261
3002499351,10cyclictest749-21runrttasks10:27:271
3002499351,10cyclictest749-21runrttasks10:27:271
3002499351,10cyclictest749-21runrttasks10:27:271
3002499351,10cyclictest19637-21sh08:12:041
3002499351,10cyclictest16301-21grep08:02:171
3002499351,10cyclictest16301-21grep08:02:171
3002499351,10cyclictest10691-21open_inodes09:12:241
3002499350,8cyclictest1738-21kernelversion11:42:201
3002499350,8cyclictest1738-21kernelversion11:42:201
30018993521,12cyclictest550-21cron12:37:040
82842340,2chrt0-21swapper/207:40:222
82842340,2chrt0-21swapper/207:40:222
323942340,2sleep30-21swapper/311:37:213
323942340,2sleep30-21swapper/311:37:213
323942340,2sleep30-21swapper/311:37:213
3002499341,9cyclictest5123-21fschecks_time07:32:171
3002499341,9cyclictest5123-21fschecks_time07:32:171
3002499341,9cyclictest29843-21/usr/sbin/munin11:32:191
3002499341,9cyclictest29843-21/usr/sbin/munin11:32:191
3002499341,9cyclictest16152-21/usr/sbin/munin12:22:231
3002499341,9cyclictest16152-21/usr/sbin/munin12:22:231
3002499341,9cyclictest16152-21/usr/sbin/munin12:22:231
3002499341,8cyclictest14117-21chrt12:17:071
3002499341,8cyclictest14117-21chrt12:17:071
3002499341,7cyclictest749-21runrttasks09:21:471
3002499341,7cyclictest749-21runrttasks09:21:471
3002499341,7cyclictest749-21runrttasks09:21:471
3002499341,7cyclictest5703-21ntpq11:52:231
3002499341,7cyclictest5703-21ntpq11:52:231
3002499341,7cyclictest28490-21irqstats11:27:191
3002499341,7cyclictest28490-21irqstats11:27:191
3002499341,7cyclictest28490-21irqstats11:27:191
3002499341,7cyclictest11189-21gzip07:47:221
3002499341,6cyclictest32611-21/usr/sbin/munin10:12:171
3002499341,6cyclictest32611-21/usr/sbin/munin10:12:171
3002499341,6cyclictest13774-21/usr/sbin/munin10:47:221
3002499341,6cyclictest13774-21/usr/sbin/munin10:47:221
3002499341,6cyclictest13774-21/usr/sbin/munin10:47:221
30024993412,20cyclictest8338-21grep09:07:171
3002499341,11cyclictest17098-21grep10:57:181
3002499341,11cyclictest17098-21grep10:57:181
3002499341,10cyclictest15862-21swap10:52:261
3002499341,10cyclictest14087-21cat07:57:071
3002499340,7cyclictest5274-21sshd10:25:551
3002499340,7cyclictest5274-21sshd10:25:551
3002499340,6cyclictest12002-21sshd12:09:231
3002499340,6cyclictest12002-21sshd12:09:231
3002499340,6cyclictest12002-21sshd12:09:231
3002499331,9cyclictest25408-21taskset08:27:131
3002499331,9cyclictest25408-21taskset08:27:131
3002499331,6cyclictest1050-21awk11:42:061
3002499331,6cyclictest1050-21awk11:42:061
3002499331,6cyclictest1050-21awk11:42:061
3002499330,9cyclictest10569-21/usr/sbin/munin10:37:271
3002499330,9cyclictest10569-21/usr/sbin/munin10:37:271
3002499330,9cyclictest10569-21/usr/sbin/munin10:37:271
30018993328,4cyclictest572-21cups-browsed10:22:250
30018993328,4cyclictest572-21cups-browsed10:22:250
30018993328,3cyclictest3414-21gltestperf11:47:170
30018993327,4cyclictest547-21rs:main0
30018993327,4cyclictest547-21rs:main0
30018993327,4cyclictest547-21rs:main0
30018993327,3cyclictest0-21swapper/010:47:290
30018993327,3cyclictest0-21swapper/010:47:290
30018993327,3cyclictest0-21swapper/010:47:290
30018993326,5cyclictest18229-21fschecks_count12:27:180
30018993326,5cyclictest18229-21fschecks_count12:27:180
30018993326,5cyclictest18229-21fschecks_count12:27:180
30018993325,6cyclictest17146-21threads08:02:270
30018993325,6cyclictest17146-21threads08:02:270
30018993325,6cyclictest14024-21cron07:57:050
30018993324,7cyclictest15662-21fschecks_count09:27:170
291972330,3sleep20-21swapper/211:27:272
291972330,3sleep20-21swapper/211:27:272
291972330,3sleep20-21swapper/211:27:272
302712310,3chrt0-21swapper/310:07:043
302712310,3chrt0-21swapper/310:07:043
302712310,3chrt0-21swapper/310:07:043
30018993126,4cyclictest572-21cups-browsed09:57:250
30018993126,4cyclictest572-21cups-browsed09:57:250
30018993126,3cyclictest30008-21cyclictest09:37:180
30018993126,3cyclictest30008-21cyclictest09:37:180
30018993126,3cyclictest30008-21cyclictest09:37:180
30018993125,5cyclictest15576-21latency_hist09:27:160
30018993125,4cyclictest0-21swapper/008:22:040
30018993125,4cyclictest0-21swapper/008:22:040
30018993124,5cyclictest17475-21latency_hist09:32:160
30018993124,5cyclictest17475-21latency_hist09:32:160
30018993123,6cyclictest9768-21latency_hist09:12:080
30018993122,7cyclictest23198-21processes11:12:250
30018993122,7cyclictest23198-21processes11:12:250
30018993122,7cyclictest22790-21latency_hist09:47:050
30018993122,7cyclictest22790-21latency_hist09:47:050
30018993024,4cyclictest617-21lldpd10:42:280
30018993024,4cyclictest617-21lldpd10:42:280
30018993024,4cyclictest617-21lldpd10:42:280
30018993023,5cyclictest7659-21fschecks_time10:32:180
30018993023,5cyclictest3213-21fschecks_count11:47:160
30018993023,5cyclictest30262-21latency_hist10:07:040
30018993023,5cyclictest30262-21latency_hist10:07:040
30018993023,5cyclictest30262-21latency_hist10:07:040
30018993023,5cyclictest12002-21sshd12:09:230
30018993023,5cyclictest12002-21sshd12:09:230
30018993023,5cyclictest12002-21sshd12:09:230
30018992924,3cyclictest0-21swapper/012:07:040
30018992924,3cyclictest0-21swapper/012:07:040
30018992924,3cyclictest0-21swapper/012:07:040
30018992923,4cyclictest6708-21runrttasks10:27:270
30018992923,4cyclictest6708-21runrttasks10:27:270
30018992923,4cyclictest6708-21runrttasks10:27:270
30018992922,5cyclictest9922-21/usr/sbin/munin09:12:220
30018992921,6cyclictest26400-21fschecks_time11:22:180
30018992921,6cyclictest26400-21fschecks_time11:22:180
30018992921,6cyclictest26400-21fschecks_time11:22:180
30018992921,6cyclictest17706-21gltestperf09:32:180
30018992921,6cyclictest17706-21gltestperf09:32:180
16192290,1sleep01620-21/usr/sbin/munin08:47:260
32402280,2sleep03352-21mailstats08:52:250
30018992825,2cyclictest0-21swapper/007:47:220
30018992822,4cyclictest30008-21cyclictest07:36:110
30018992822,4cyclictest30008-21cyclictest07:36:110
137152280,3sleep30-21swapper/310:47:203
137152280,3sleep30-21swapper/310:47:203
137152280,3sleep30-21swapper/310:47:203
30018992721,5cyclictest23496-21kernelversion09:47:180
30018992721,5cyclictest23496-21kernelversion09:47:180
30018992721,5cyclictest23496-21kernelversion09:47:180
30018992721,4cyclictest0-21swapper/012:37:210
30018992721,4cyclictest0-21swapper/012:37:210
30018992721,4cyclictest0-21swapper/012:37:210
30018992721,4cyclictest0-21swapper/008:42:050
30018992721,4cyclictest0-21swapper/008:42:050
30018992720,5cyclictest2002-21cut10:17:170
30018992720,5cyclictest2002-21cut10:17:170
89442260,3sleep30-21swapper/307:42:163
89442260,3sleep30-21swapper/307:42:163
30018992621,3cyclictest0-21swapper/008:12:040
30018992621,2cyclictest0-21swapper/011:52:260
30018992621,2cyclictest0-21swapper/011:52:260
30018992619,5cyclictest16505-21gltestperf12:22:170
30018992619,5cyclictest16505-21gltestperf12:22:170
30018992619,5cyclictest16505-21gltestperf12:22:170
199312250,3sleep30-21swapper/311:02:283
199312250,3sleep30-21swapper/311:02:283
30018992421,2cyclictest25683-21kworker/u10:1-rpciod08:23:000
30018992421,2cyclictest25683-21kworker/u10:1-rpciod08:23:000
30018992420,2cyclictest0-21swapper/011:32:210
30018992420,2cyclictest0-21swapper/011:32:210
30018992419,3cyclictest0-21swapper/010:57:180
30018992419,3cyclictest0-21swapper/010:57:180
30018992419,3cyclictest0-21swapper/010:12:150
30018992419,3cyclictest0-21swapper/010:12:150
30018992418,4cyclictest25588-21ntp_kernel_pll_09:52:220
30018992418,4cyclictest25588-21ntp_kernel_pll_09:52:220
30018992418,4cyclictest0-21swapper/011:47:180
30018992418,4cyclictest0-21swapper/011:47:180
43952230,4sleep20-21swapper/208:57:172
43952230,4sleep20-21swapper/208:57:172
30018992319,2cyclictest0-21swapper/008:42:250
30018992319,2cyclictest0-21swapper/008:42:250
30018992318,3cyclictest0-21swapper/009:17:260
30018992318,3cyclictest0-21swapper/009:17:260
30018992318,3cyclictest0-21swapper/009:17:260
30018992318,3cyclictest0-21swapper/007:57:170
30018992318,3cyclictest0-21swapper/007:57:170
30018992318,3cyclictest0-21swapper/007:37:150
30018992318,3cyclictest0-21swapper/007:37:150
30018992317,4cyclictest0-21swapper/012:22:050
30018992317,4cyclictest0-21swapper/012:22:050
30018992317,4cyclictest0-21swapper/008:12:250
30018992317,4cyclictest0-21swapper/008:12:250
30018992317,3cyclictest0-21swapper/012:12:270
30018992317,3cyclictest0-21swapper/012:12:270
30018992316,5cyclictest8066-21unixbench_singl11:57:290
30018992316,5cyclictest8066-21unixbench_singl11:57:290
30018992316,4cyclictest0-21swapper/008:32:270
30018992316,4cyclictest0-21swapper/008:32:270
256622230,3sleep20-21swapper/208:27:182
256622230,3sleep20-21swapper/208:27:182
30018992218,2cyclictest0-21swapper/010:42:040
30018992218,2cyclictest0-21swapper/010:42:040
30018992218,2cyclictest0-21swapper/010:42:040
30018992217,3cyclictest0-21swapper/008:27:280
30018992217,3cyclictest0-21swapper/008:27:280
30018992214,6cyclictest612-21ntp_kernel_err10:12:210
30018992214,6cyclictest612-21ntp_kernel_err10:12:210
30018992116,3cyclictest0-21swapper/007:27:200
30018992115,4cyclictest0-21swapper/011:27:250
30018992115,4cyclictest0-21swapper/011:27:250
30018992115,4cyclictest0-21swapper/011:27:250
30018992115,4cyclictest0-21swapper/007:42:250
30018992115,4cyclictest0-21swapper/007:42:250
305412200,4sleep30-21swapper/311:32:233
305412200,4sleep30-21swapper/311:32:233
3003999191,16cyclictest4565-21chrt07:30:223
3003999188,7cyclictest431rcuc/310:45:043
3003999188,7cyclictest431rcuc/310:45:043
3003999188,7cyclictest431rcuc/310:45:043
129942180,3sleep30-21swapper/309:17:283
129942180,3sleep30-21swapper/309:17:283
129942180,3sleep30-21swapper/309:17:283
3003999171,12cyclictest15392-21chrt10:52:193
3003999171,11cyclictest8768-21chrt09:07:233
30039991710,4cyclictest147872sleep309:22:263
30039991710,4cyclictest147872sleep309:22:263
3003199171,12cyclictest20343-21chrt08:12:182
3003199171,12cyclictest20343-21chrt08:12:182
100292170,3sleep20-21swapper/210:37:222
100292170,3sleep20-21swapper/210:37:222
100292170,3sleep20-21swapper/210:37:222
3003999163,9cyclictest0-21swapper/310:13:233
3003999163,9cyclictest0-21swapper/310:13:233
3003999161,12cyclictest11166-21chrt12:07:203
3003999161,12cyclictest11166-21chrt12:07:203
3003999161,12cyclictest11166-21chrt12:07:203
3003999161,11cyclictest5543-21taskset10:27:143
3003999161,11cyclictest5543-21taskset10:27:143
3003999161,10cyclictest25845-21chrt08:27:193
3003999161,10cyclictest25845-21chrt08:27:193
3003999161,10cyclictest24099-21chrt08:22:203
3003999161,10cyclictest24099-21chrt08:22:203
3003999161,10cyclictest22541-21chrt11:12:173
3003999161,10cyclictest22541-21chrt11:12:173
3003999160,13cyclictest1484-21chrt08:47:253
3003199163,9cyclictest0-21swapper/209:37:222
3003199163,9cyclictest0-21swapper/209:37:222
3003199163,9cyclictest0-21swapper/209:37:222
3003199162,6cyclictest0-21swapper/211:57:122
3003199162,6cyclictest0-21swapper/211:57:122
3003199162,11cyclictest351rcuc/210:10:332
3003199162,11cyclictest351rcuc/210:10:332
3003199161,13cyclictest13288-21chrt12:12:252
3003199161,13cyclictest13288-21chrt12:12:252
3003199161,12cyclictest27899-21chrt11:27:112
3003199161,12cyclictest27899-21chrt11:27:112
3003199161,12cyclictest27899-21chrt11:27:112
3003199161,12cyclictest24594-21chrt11:17:182
3003199161,12cyclictest24594-21chrt11:17:182
3003199161,12cyclictest24594-21chrt11:17:182
3003199161,12cyclictest17349-21chrt10:57:202
3003199161,12cyclictest17349-21chrt10:57:202
3003199161,10cyclictest5757-21chrt10:27:172
3003199161,10cyclictest5757-21chrt10:27:172
3003199161,10cyclictest5757-21chrt10:27:172
3003199161,10cyclictest4183-21chrt10:22:192
3003199161,10cyclictest4183-21chrt10:22:192
30031991610,4cyclictest183352chrt09:32:262
30031991610,4cyclictest183352chrt09:32:262
3003999151,8cyclictest0-21swapper/311:17:113
3003999151,8cyclictest0-21swapper/311:17:113
3003999151,6cyclictest0-21swapper/310:32:153
3003999151,6cyclictest0-21swapper/310:32:153
3003999151,6cyclictest0-21swapper/310:32:153
3003999151,11cyclictest29952-21chrt08:37:243
3003999151,11cyclictest29952-21chrt08:37:243
3003999151,11cyclictest18228-21chrt12:27:183
3003999151,11cyclictest18228-21chrt12:27:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional