You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Apr 24, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
348121020,2sleep30-21swapper/307:52:273
348121020,2sleep30-21swapper/307:52:273
269102970,3sleep20-21swapper/208:57:182
269102970,3sleep20-21swapper/208:57:182
34962930,2sleep10-21swapper/110:47:201
34962930,2sleep10-21swapper/110:47:201
142052930,3sleep30-21swapper/308:22:223
142052930,3sleep30-21swapper/308:22:223
142052930,3sleep30-21swapper/308:22:223
299812870,4sleep20-21swapper/210:32:182
299812870,4sleep20-21swapper/210:32:182
242782850,2sleep20-21swapper/211:42:242
242782850,2sleep20-21swapper/211:42:242
110182830,3sleep111021-21timerwakeupswit12:32:281
110182830,3sleep111021-21timerwakeupswit12:32:281
10012800,2sleep20-21swapper/212:07:212
10012800,2sleep20-21swapper/212:07:212
182692730,3chrt0-21swapper/208:32:262
182692730,3chrt0-21swapper/208:32:262
21912700,3sleep20-21swapper/209:17:202
21912700,3sleep20-21swapper/209:17:202
99162670,2sleep010084-21gltestperf08:12:190
80112660,2chrt8010-21sed10:57:291
80112660,2chrt8010-21sed10:57:291
180732640,4chrt0-21swapper/311:27:183
250332620,2sleep30-21swapper/308:52:173
250332620,2sleep30-21swapper/308:52:173
167002570,2chrt16668-21/usr/sbin/munin09:57:151
167002570,2chrt16668-21/usr/sbin/munin09:57:151
54452560,2chrt0-21swapper/209:27:172
54452560,2chrt0-21swapper/209:27:172
54452560,2chrt0-21swapper/209:27:172
114592540,2chrt11462-21grep09:42:190
114592540,2chrt11462-21grep09:42:190
324652530,1sleep132572-21mailstats10:37:281
324652530,1sleep132572-21mailstats10:37:281
124342530,3sleep20-21swapper/208:17:272
124342530,3sleep20-21swapper/208:17:272
124342530,3sleep20-21swapper/208:17:272
227222510,3sleep20-21swapper/208:47:092
227222510,3sleep20-21swapper/208:47:092
318992500,3sleep130961-21/usr/sbin/munin07:42:281
318992500,3sleep130961-21/usr/sbin/munin07:42:281
234652500,3chrt0-21swapper/308:47:233
234652500,3chrt0-21swapper/308:47:233
38072490,3chrt0-21swapper/210:47:252
38072490,3chrt0-21swapper/210:47:252
64192480,2sleep16421-21grep12:22:191
64192480,2sleep16421-21grep12:22:191
268022460,3sleep20-21swapper/210:22:252
268022460,3sleep20-21swapper/210:22:252
69662430,3sleep20-21swapper/208:02:272
69662430,3sleep20-21swapper/208:02:272
69662430,3sleep20-21swapper/208:02:272
302662410,2sleep130270-21latency_hist09:07:141
302662410,2sleep130270-21latency_hist09:07:141
123272400,2sleep20-21swapper/209:42:292
123272400,2sleep20-21swapper/209:42:292
325792390,3sleep20-21swapper/210:37:282
325792390,3sleep20-21swapper/210:37:282
62922380,2sleep06381-21fschecks_time12:22:190
62922380,2sleep06381-21fschecks_time12:22:190
117272380,3sleep30-21swapper/309:42:223
117272380,3sleep30-21swapper/309:42:223
2009699368,11cyclictest15800-21taskset11:21:080
2009699368,11cyclictest15800-21taskset11:21:080
111052350,2sleep111218-21df09:42:171
75512340,3chrt0-21swapper/212:23:412
75512340,3chrt0-21swapper/212:23:412
175352340,3sleep20-21swapper/209:57:242
175352340,3sleep20-21swapper/209:57:242
175352340,3sleep20-21swapper/209:57:242
20103993327,4cyclictest20080-21cyclictest08:07:291
20096993329,3cyclictest19626-21cron11:32:060
20096993329,3cyclictest19626-21cron11:32:060
20096993329,3cyclictest19626-21cron11:32:060
20096993324,7cyclictest16960-21fschecks_time09:57:170
20096993324,7cyclictest16960-21fschecks_time09:57:170
20096993324,7cyclictest16960-21fschecks_time09:57:170
104352330,1sleep2351rcuc/212:32:212
104352330,1sleep2351rcuc/212:32:212
20103993226,4cyclictest22026-21threads08:42:291
20103993226,4cyclictest22026-21threads08:42:291
20103993226,4cyclictest1346-21avahi-daemon09:37:271
20103993226,4cyclictest1346-21avahi-daemon09:37:271
20103993223,6cyclictest550-21cron11:57:061
20103993223,6cyclictest550-21cron11:57:061
20096993224,6cyclictest29074-21/usr/sbin/munin07:37:240
20096993224,6cyclictest29074-21/usr/sbin/munin07:37:240
187662320,2sleep30-21swapper/311:27:273
187662320,2sleep30-21swapper/311:27:273
187662320,2sleep30-21swapper/311:27:273
56072310,3sleep20-21swapper/210:52:242
56072310,3sleep20-21swapper/210:52:242
20103993125,4cyclictest23352-21cron11:42:061
20103993125,4cyclictest23352-21cron11:42:061
20103993125,4cyclictest12764-21latency_hist09:47:061
20103993125,4cyclictest12764-21latency_hist09:47:061
20103993123,6cyclictest558-21cpuspeed12:07:181
20103993123,6cyclictest558-21cpuspeed12:07:181
20103993122,7cyclictest24885-21netstat10:17:221
20103993122,7cyclictest24885-21netstat10:17:221
2009699317,5cyclictest21678-21gzip08:42:240
2009699317,5cyclictest21678-21gzip08:42:240
20096993123,6cyclictest7071-21threads08:02:280
20096993123,6cyclictest7071-21threads08:02:280
20096993123,6cyclictest7071-21threads08:02:280
20096993121,8cyclictest0-21swapper/011:40:330
20096993121,8cyclictest0-21swapper/011:40:330
20096993117,10cyclictest0-21swapper/011:14:320
20096993117,10cyclictest0-21swapper/011:14:320
20103993024,5cyclictest10076-21fschecks_count12:32:191
20103993024,4cyclictest14534-21switchtime08:22:271
20103993024,4cyclictest14534-21switchtime08:22:271
20103993024,4cyclictest14534-21switchtime08:22:271
20096993023,5cyclictest17360-21grep11:22:290
10052300,1sleep032214-21/usr/sbin/munin09:12:290
10052300,1sleep032214-21/usr/sbin/munin09:12:290
61962290,3sleep20-21swapper/209:27:252
61962290,3sleep20-21swapper/209:27:252
327122290,3sleep30-21swapper/310:37:293
327122290,3sleep30-21swapper/310:37:293
20103992922,6cyclictest545-21in:imuxsock11:32:201
20103992922,6cyclictest545-21in:imuxsock11:32:201
20103992922,6cyclictest545-21in:imuxsock11:32:201
20103992922,5cyclictest24029-21unixbench-2d08:47:301
20103992922,5cyclictest24029-21unixbench-2d08:47:301
2009699293,10cyclictest29408-21taskset10:30:000
2009699293,10cyclictest29408-21taskset10:30:000
20096992922,5cyclictest30985-21sshd12:02:130
20096992922,5cyclictest30985-21sshd12:02:130
20096992922,5cyclictest0-21swapper/008:57:280
20096992922,5cyclictest0-21swapper/008:57:280
20096992921,6cyclictest5603-21netstat10:52:240
20096992921,6cyclictest5603-21netstat10:52:240
87382280,3sleep30-21swapper/308:07:273
20103992824,2cyclictest0-21swapper/110:32:171
20103992824,2cyclictest0-21swapper/110:32:171
20103992823,4cyclictest20080-21cyclictest12:12:291
20103992821,5cyclictest5782-21gltestperf09:27:201
20103992821,5cyclictest5782-21gltestperf09:27:201
20103992821,5cyclictest23607-21sshd10:12:351
20103992821,5cyclictest23607-21sshd10:12:351
20103992820,6cyclictest6224-21cut08:02:191
20103992820,6cyclictest6224-21cut08:02:191
20103992820,6cyclictest6224-21cut08:02:191
2009699287,10cyclictest23887-21fw_packets11:42:200
2009699287,10cyclictest23887-21fw_packets11:42:200
2009699284,8cyclictest2766-21taskset10:46:320
2009699284,8cyclictest2766-21taskset10:46:320
20096992824,3cyclictest20080-21cyclictest07:42:280
20096992824,3cyclictest20080-21cyclictest07:42:280
20096992823,3cyclictest700-21192.168.115.40-manager11:33:320
20096992823,3cyclictest700-21192.168.115.40-manager11:33:320
20096992823,3cyclictest700-21192.168.115.40-manager11:33:320
20096992822,5cyclictest28083-21fschecks_count10:27:180
20096992822,5cyclictest28083-21fschecks_count10:27:180
20096992822,5cyclictest23860-21switchtime08:47:290
20096992822,5cyclictest23860-21switchtime08:47:290
20096992821,5cyclictest8541-21kernelversion12:27:210
20096992821,5cyclictest8541-21kernelversion12:27:210
20096992821,5cyclictest20080-21cyclictest12:18:130
20096992821,5cyclictest20080-21cyclictest12:18:130
2009699282,10cyclictest5834-21gltestperf09:27:200
2009699282,10cyclictest5834-21gltestperf09:27:200
20096992820,6cyclictest31014-21needreboot09:07:250
20096992820,6cyclictest31014-21needreboot09:07:250
20096992820,6cyclictest31014-21needreboot09:07:250
20096992819,7cyclictest14215-21needreboot08:22:230
20096992819,7cyclictest14215-21needreboot08:22:230
20096992819,7cyclictest14215-21needreboot08:22:230
20096992818,8cyclictest0-21swapper/007:29:260
20096992814,8cyclictest90-1pr/ttyS011:02:320
20096992814,8cyclictest90-1pr/ttyS011:02:320
20096992814,8cyclictest90-1pr/ttyS011:02:320
20096992810,5cyclictest22807-21irqstats10:12:210
20096992810,5cyclictest22807-21irqstats10:12:210
162352280,3sleep10-21swapper/111:22:171
20103992721,5cyclictest26868-21sshd07:30:361
20103992719,6cyclictest16835-21ntp_kernel_err11:22:241
20103992719,6cyclictest10840-21sort08:12:281
20096992722,3cyclictest700-21192.168.115.40-manager09:24:590
20096992722,3cyclictest700-21192.168.115.40-manager09:24:590
20096992722,3cyclictest700-21192.168.115.40-manager09:24:590
20096992721,5cyclictest934-21kernelversion07:47:210
20096992721,5cyclictest934-21kernelversion07:47:210
20096992719,6cyclictest700-21192.168.115.40-manager09:55:000
20096992719,6cyclictest700-21192.168.115.40-manager09:55:000
20096992719,5cyclictest171ktimers/010:41:010
20096992719,5cyclictest171ktimers/010:41:010
20096992718,7cyclictest0-21swapper/012:15:330
20096992710,15cyclictest700-21192.168.115.40-manager09:17:210
20096992710,15cyclictest700-21192.168.115.40-manager09:17:210
306622260,2sleep20-21swapper/210:32:262
306622260,2sleep20-21swapper/210:32:262
255522260,1sleep2351rcuc/208:52:242
255522260,1sleep2351rcuc/208:52:242
20103992622,2cyclictest0-21swapper/108:02:061
20103992622,2cyclictest0-21swapper/108:02:061
20103992621,3cyclictest0-21swapper/110:42:271
20103992621,3cyclictest0-21swapper/110:42:271
20103992619,5cyclictest749-21runrttasks11:47:191
20103992619,5cyclictest4780-21kernelversion12:17:211
20103992619,5cyclictest4780-21kernelversion12:17:211
20103992619,5cyclictest27090-21kernelversion08:57:201
20103992619,5cyclictest27090-21kernelversion08:57:201
2009699265,7cyclictest18587-21/usr/sbin/munin10:02:280
2009699265,7cyclictest18587-21/usr/sbin/munin10:02:280
20096992619,5cyclictest700-21192.168.115.40-manager09:36:290
20096992619,5cyclictest700-21192.168.115.40-manager09:36:290
20096992619,5cyclictest431-21/usr/sbin/munin12:07:190
20096992619,4cyclictest700-21192.168.115.40-manager12:11:330
20096992619,4cyclictest700-21192.168.115.40-manager12:11:330
20096992617,7cyclictest0-21swapper/007:33:560
20096992615,9cyclictest3651-21kworker/u10:1+rpciod08:17:270
20096992615,9cyclictest3651-21kworker/u10:1+rpciod08:17:270
20096992615,9cyclictest3651-21kworker/u10:1+rpciod08:17:270
20096992613,11cyclictest700-21192.168.115.40-manager09:38:290
20096992613,11cyclictest700-21192.168.115.40-manager09:38:290
20096992613,11cyclictest700-21192.168.115.40-manager09:38:290
20096992612,11cyclictest17507-21/usr/sbin/munin08:32:180
20096992612,11cyclictest17507-21/usr/sbin/munin08:32:180
15052260,2sleep20-21swapper/207:47:282
15052260,2sleep20-21swapper/207:47:282
20103992521,3cyclictest20080-21cyclictest10:07:241
20103992521,3cyclictest20080-21cyclictest10:07:241
20103992521,3cyclictest20080-21cyclictest10:07:241
20103992521,2cyclictest0-21swapper/111:07:181
20103992521,2cyclictest0-21swapper/111:07:181
20103992521,2cyclictest0-21swapper/111:07:181
20103992519,3cyclictest0-21swapper/111:27:281
20103992519,3cyclictest0-21swapper/111:27:281
20103992519,3cyclictest0-21swapper/111:27:281
20103992519,3cyclictest0-21swapper/110:02:191
20103992519,3cyclictest0-21swapper/110:02:191
20103992518,5cyclictest30188-21ls07:37:281
20103992518,5cyclictest30188-21ls07:37:281
20103992518,5cyclictest1154-21ntp_kernel_err07:47:241
20103992518,5cyclictest1154-21ntp_kernel_err07:47:241
20103992516,7cyclictest12278-21ls08:17:221
20103992516,7cyclictest12278-21ls08:17:221
20103992516,7cyclictest12278-21ls08:17:221
2010399251,14cyclictest30986-21tail10:32:281
2010399251,14cyclictest30986-21tail10:32:281
2010399250,6cyclictest130142grep12:37:301
2010399250,6cyclictest130142grep12:37:301
2010399250,6cyclictest130142grep12:37:301
20096992520,3cyclictest0-21swapper/010:32:280
20096992520,3cyclictest0-21swapper/010:32:280
20096992520,2cyclictest0-21swapper/007:57:190
20096992520,2cyclictest0-21swapper/007:57:190
20096992516,7cyclictest8935-21threads08:07:280
20096992516,7cyclictest0-21swapper/011:49:330
20096992516,7cyclictest0-21swapper/011:49:330
20096992516,6cyclictest0-21swapper/007:55:270
20096992516,6cyclictest0-21swapper/007:55:270
20096992514,9cyclictest0-21swapper/009:04:280
20096992514,9cyclictest0-21swapper/009:04:280
20096992512,3cyclictest90-1pr/ttyS010:51:300
20096992512,3cyclictest90-1pr/ttyS010:51:300
20096992510,12cyclictest601-21snmpd10:09:460
20096992510,12cyclictest601-21snmpd10:09:460
20096992510,12cyclictest601-21snmpd10:09:460
200602250,3sleep020058-21sensors_temp08:37:270
200602250,3sleep020058-21sensors_temp08:37:270
33782240,2chrt0-21swapper/312:12:283
20103992419,3cyclictest0-21swapper/110:52:261
20103992419,3cyclictest0-21swapper/110:52:261
20103992419,2cyclictest0-21swapper/109:17:191
20103992419,2cyclictest0-21swapper/109:17:191
20103992418,5cyclictest30597-21fschecks_time09:07:201
20103992418,5cyclictest30597-21fschecks_time09:07:201
20103992418,5cyclictest30597-21fschecks_time09:07:201
20103992417,5cyclictest13475-21kernelversion09:47:211
20103992417,5cyclictest13475-21kernelversion09:47:211
20103992417,5cyclictest13475-21kernelversion09:47:211
20103992416,6cyclictest8673-21ls12:27:221
2009699249,12cyclictest25468-21ntp_offset08:52:220
2009699249,12cyclictest25468-21ntp_offset08:52:220
20096992419,3cyclictest0-21swapper/012:02:200
20096992413,9cyclictest0-21swapper/010:20:010
20096992413,9cyclictest0-21swapper/010:20:010
20096992412,9cyclictest16621-21sed08:27:290
20096992412,2cyclictest181rcu_preempt10:57:550
20096992412,2cyclictest181rcu_preempt10:57:550
20096992411,10cyclictest14188-21awk09:47:280
20096992411,10cyclictest14188-21awk09:47:280
20096992411,10cyclictest14188-21awk09:47:280
122582240,3chrt0-21swapper/111:12:121
122582240,3chrt0-21swapper/111:12:121
246662231,2sleep30-21swapper/310:17:203
246662231,2sleep30-21swapper/310:17:203
20105992315,4cyclictest262022sleep207:27:262
20103992318,3cyclictest0-21swapper/110:22:291
20103992318,3cyclictest0-21swapper/110:22:291
20103992318,3cyclictest0-21swapper/107:52:251
20103992318,3cyclictest0-21swapper/107:52:251
20103992317,5cyclictest25715-21switchtime08:52:251
20103992317,5cyclictest25715-21switchtime08:52:251
2009699238,11cyclictest12152-21ls12:37:200
2009699238,11cyclictest12152-21ls12:37:200
2009699238,11cyclictest12152-21ls12:37:200
20096992318,3cyclictest0-21swapper/011:07:200
20096992318,3cyclictest0-21swapper/011:07:200
20096992315,6cyclictest0-21swapper/011:52:330
20096992315,6cyclictest0-21swapper/011:52:330
20096992314,3cyclictest181rcu_preempt12:36:030
20096992314,3cyclictest181rcu_preempt12:36:030
2010599221,11cyclictest0-21swapper/211:22:352
20103992218,2cyclictest0-21swapper/111:42:251
20103992218,2cyclictest0-21swapper/108:37:251
20103992218,2cyclictest0-21swapper/108:37:251
20103992217,4cyclictest15195-21switchtime11:17:271
20103992217,3cyclictest26346-21systemctl11:47:281
20103992217,3cyclictest26346-21systemctl11:47:281
20103992217,3cyclictest0-21swapper/111:57:261
20103992217,3cyclictest0-21swapper/111:57:261
20103992217,3cyclictest0-21swapper/107:32:191
20103992216,4cyclictest0-21swapper/108:27:261
20103992214,6cyclictest4507-21grep09:22:271
20103992214,6cyclictest4507-21grep09:22:271
20103992214,6cyclictest4507-21grep09:22:271
20103992116,4cyclictest8608-21unixbench_singl09:32:291
20103992116,4cyclictest8608-21unixbench_singl09:32:291
20103992115,4cyclictest0-21swapper/108:32:251
20103992115,4cyclictest0-21swapper/108:32:251
20103992015,3cyclictest0-21swapper/111:17:071
20103992015,3cyclictest0-21swapper/111:17:071
20103992014,4cyclictest0-21swapper/110:01:541
20103992014,4cyclictest0-21swapper/110:01:541
20103992014,4cyclictest0-21swapper/110:01:541
20103992013,4cyclictest0-21swapper/112:10:361
20103992013,4cyclictest0-21swapper/112:10:361
2010599193,12cyclictest0-21swapper/212:02:352
2010599193,12cyclictest0-21swapper/212:02:352
2010599193,11cyclictest0-21swapper/211:37:352
2010599193,11cyclictest0-21swapper/211:37:352
2010399199,8cyclictest32466-21perl09:12:181
2010399199,8cyclictest32466-21perl09:12:181
2010599183,9cyclictest0-21swapper/210:14:352
2010599183,9cyclictest0-21swapper/210:14:352
2010599181,12cyclictest14674-21chrt11:17:202
2010599181,12cyclictest14674-21chrt11:17:202
2010699172,11cyclictest0-21swapper/308:37:213
2010699172,11cyclictest0-21swapper/308:37:213
2010699171,12cyclictest24048-21taskset11:42:213
2010699171,12cyclictest24048-21taskset11:42:213
2010699171,11cyclictest10800-21chrt11:07:203
2010699171,11cyclictest10800-21chrt11:07:203
2010699171,10cyclictest30742-21chrt09:07:203
2010699171,10cyclictest30742-21chrt09:07:203
2010699171,10cyclictest30742-21chrt09:07:203
2010599178,5cyclictest32862sleep212:12:272
2010599172,10cyclictest19467-21taskset10:02:272
2010599172,10cyclictest19467-21taskset10:02:272
2010599171,11cyclictest4904-21chrt07:57:252
2010599171,11cyclictest4904-21chrt07:57:252
2010599171,11cyclictest10234-21chrt08:12:202
2010599171,10cyclictest29315-21taskset07:37:192
2010599171,10cyclictest29315-21taskset07:37:192
2010699163,9cyclictest306612sleep312:00:033
2010699163,9cyclictest306612sleep312:00:033
2010699163,9cyclictest0-21swapper/309:23:353
2010699163,9cyclictest0-21swapper/309:23:353
2010699163,9cyclictest0-21swapper/309:23:353
2010699163,10cyclictest0-21swapper/311:13:353
2010699163,10cyclictest0-21swapper/311:13:353
2010699161,13cyclictest777-21chrt09:12:273
2010699161,13cyclictest777-21chrt09:12:273
2010699161,11cyclictest7670-21chrt10:57:273
2010699161,11cyclictest7670-21chrt10:57:273
2010699161,11cyclictest6201-21chrt12:22:173
2010699161,11cyclictest6201-21chrt12:22:173
2010699161,11cyclictest27827-21taskset10:27:123
2010699161,11cyclictest27827-21taskset10:27:123
2010699161,11cyclictest27059-21chrt08:57:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional