You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Sep 04, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1463421130,2chrt14633-21irqstats00:09:231
121302980,2chrt12124-21gzip21:09:240
121302980,2chrt12124-21gzip21:09:240
267762820,3sleep20-21swapper/220:24:072
267762820,3sleep20-21swapper/220:24:072
265912780,3chrt0-21swapper/223:14:282
159612580,2sleep30-21swapper/319:54:213
1266995842,12cyclictest0-21swapper/000:04:120
1266995842,12cyclictest0-21swapper/000:04:120
94022570,3chrt0-21swapper/222:29:222
326482530,4chrt0-21swapper/322:04:223
326482530,4chrt0-21swapper/322:04:223
1266995244,6cyclictest0-21swapper/000:04:200
87182490,3sleep20-21swapper/222:27:372
247502450,2chrt0-21swapper/000:34:340
249812440,3sleep10-21swapper/100:37:251
28222420,3sleep20-21swapper/220:44:252
28222420,3sleep20-21swapper/220:44:252
204212410,2sleep00-21swapper/020:04:280
204212410,2sleep00-21swapper/020:04:280
37102400,1sleep03713-21tr22:14:240
37102400,1sleep03713-21tr22:14:240
266752380,3sleep00-21swapper/023:14:300
118342380,3sleep10-21swapper/121:09:211
118342380,3sleep10-21swapper/121:09:211
74832370,4sleep00-21swapper/022:24:210
60282370,2sleep30-21swapper/322:19:263
60282370,2sleep30-21swapper/322:19:263
271222370,7sleep0171ktimers/021:49:240
271222370,7sleep0171ktimers/021:49:240
1266993731,4cyclictest201rcuc/022:39:590
1266993731,4cyclictest201rcuc/022:39:590
73292360,3sleep20-21swapper/223:49:262
312842360,1sleep131447-21head21:59:311
312842360,1sleep131447-21head21:59:311
29482360,3sleep20-21swapper/223:39:212
29482360,3sleep20-21swapper/223:39:212
29482360,3sleep20-21swapper/223:39:212
236142360,1sleep123737-21timerandwakeup21:39:291
236142360,1sleep123737-21timerandwakeup21:39:291
1266993629,5cyclictest19523-21sendmail00:24:070
1266993629,5cyclictest19523-21sendmail00:24:070
1266993629,5cyclictest19523-21sendmail00:24:070
1266993614,5cyclictest201rcuc/020:14:590
1266993614,5cyclictest201rcuc/020:14:590
140352350,2sleep00-21swapper/019:49:200
140352350,2sleep00-21swapper/019:49:200
140372340,3sleep30-21swapper/321:14:253
140372340,3sleep30-21swapper/321:14:253
128099342,22cyclictest12154-21taskset00:04:132
128099342,22cyclictest12154-21taskset00:04:132
1277993426,6cyclictest1255-21cyclictest23:39:181
1277993426,6cyclictest1255-21cyclictest23:39:181
1277993426,6cyclictest1255-21cyclictest23:39:181
1277993425,6cyclictest749-21runrttasks19:29:321
1266993427,5cyclictest17394-21processes22:49:280
1266993427,5cyclictest17394-21processes22:49:280
1277993314,14cyclictest12919-21gzip00:04:261
1266993326,5cyclictest31410-21needreboot20:34:230
1266993326,5cyclictest1255-21cyclictest20:59:270
1266993324,7cyclictest25066-21threads23:09:280
1266993324,7cyclictest25066-21threads23:09:280
1277993227,4cyclictest21949-21gltestperf00:29:211
1277993227,4cyclictest21949-21gltestperf00:29:211
1266993225,5cyclictest201rcuc/023:45:250
1266993224,6cyclictest8531-21fschecks_time19:34:210
1266993211,7cyclictest16-21ksoftirqd/000:44:080
1266993211,7cyclictest16-21ksoftirqd/000:44:080
1266993211,7cyclictest16-21ksoftirqd/000:44:080
5262310,2sleep10-21swapper/120:39:231
5262310,2sleep10-21swapper/120:39:231
208372310,3sleep10-21swapper/100:24:301
182892310,11sleep1281ktimers/121:24:321
182892310,11sleep1281ktimers/121:24:321
1277993124,5cyclictest19153-21cut21:29:221
1277993124,5cyclictest1255-21cyclictest20:44:301
1277993124,5cyclictest1255-21cyclictest20:44:301
1266993126,3cyclictest1255-21cyclictest19:39:170
1266993126,3cyclictest1255-21cyclictest19:39:170
1277993024,4cyclictest5962-21fschecks_count20:54:191
1277993024,4cyclictest5962-21fschecks_count20:54:191
1277993024,4cyclictest26792-21wc20:24:071
1277993024,4cyclictest26792-21wc20:24:071
126699305,5cyclictest201rcuc/021:18:380
126699305,5cyclictest201rcuc/021:18:380
126699305,5cyclictest201rcuc/019:29:170
1266993023,5cyclictest21019-21cut21:34:250
1266993023,5cyclictest21019-21cut21:34:250
1266993023,4cyclictest0-21swapper/022:04:290
1266993023,4cyclictest0-21swapper/022:04:290
1266993022,6cyclictest28033-21fschecks_time23:19:210
1266993022,6cyclictest28033-21fschecks_time23:19:210
1277992923,4cyclictest25836-21kernelversion00:39:241
1277992923,4cyclictest25836-21kernelversion00:39:241
1277992923,4cyclictest25836-21kernelversion00:39:241
1277992920,6cyclictest13139-21gltestperf22:39:211
1277992920,6cyclictest13139-21gltestperf22:39:211
1277992919,6cyclictest601-21snmpd21:36:301
1277992919,6cyclictest601-21snmpd21:36:301
126699296,19cyclictest171ktimers/020:25:420
1266992923,5cyclictest6291-21switchtime22:19:290
1266992923,5cyclictest6291-21switchtime22:19:290
1266992923,4cyclictest14678-21systemd-journal21:32:360
1266992922,5cyclictest9580-21kernelversion22:29:230
1266992922,5cyclictest29889-21fschecks_time23:24:210
1266992922,5cyclictest29889-21fschecks_time23:24:210
1266992922,5cyclictest14385-21fschecks_time00:09:200
1266992921,6cyclictest10094-21kernelversion21:04:240
1266992921,6cyclictest10094-21kernelversion21:04:240
1266992921,5cyclictest26110-21sshd21:47:360
1266992921,5cyclictest26110-21sshd21:47:360
1266992920,7cyclictest25651-21latency20:19:230
1266992920,7cyclictest25651-21latency20:19:230
1266992912,6cyclictest16-21ksoftirqd/023:04:030
1266992912,6cyclictest16-21ksoftirqd/023:04:030
1266992910,7cyclictest16-21ksoftirqd/021:26:150
1266992910,7cyclictest16-21ksoftirqd/021:26:150
1277992823,4cyclictest11247-21idleruntime-cro21:09:071
1277992823,4cyclictest11247-21idleruntime-cro21:09:071
1277992823,3cyclictest1255-21cyclictest20:29:241
1277992823,3cyclictest1255-21cyclictest20:29:241
1277992822,3cyclictest0-21swapper/121:54:071
1277992822,3cyclictest0-21swapper/121:54:071
1277992821,5cyclictest1255-21cyclictest19:49:091
1277992821,5cyclictest12311-21sshd22:35:361
1277992821,5cyclictest12311-21sshd22:35:361
1277992821,4cyclictest8765-21gltestperf23:54:241
1277992821,4cyclictest8765-21gltestperf23:54:241
1277992821,4cyclictest0-21swapper/119:34:301
1277992817,4cyclictest0-21swapper/119:49:221
1277992817,4cyclictest0-21swapper/119:49:221
1277992814,4cyclictest90-1pr/ttyS022:32:091
1266992820,6cyclictest1687-21netstat23:34:300
1266992820,6cyclictest1687-21netstat23:34:300
1266992820,5cyclictest0-21swapper/020:04:080
1266992820,5cyclictest0-21swapper/020:04:080
1266992813,4cyclictest181rcu_preempt20:52:390
1266992813,3cyclictest181rcu_preempt20:54:280
1266992813,3cyclictest181rcu_preempt20:54:280
1266992811,3cyclictest201rcuc/020:12:080
1266992811,3cyclictest201rcuc/020:12:080
1277992722,3cyclictest735-21systemd-logind00:04:081
1277992722,3cyclictest735-21systemd-logind00:04:081
1277992722,3cyclictest0-21swapper/122:19:281
1277992722,3cyclictest0-21swapper/122:19:281
1277992721,4cyclictest4859-21fschecks_count23:44:211
1277992721,4cyclictest31917-21idleruntime23:29:211
1277992721,4cyclictest31917-21idleruntime23:29:211
1277992721,4cyclictest0-21swapper/121:44:261
1277992721,4cyclictest0-21swapper/121:44:261
1277992720,4cyclictest0-21swapper/122:44:311
1277992720,4cyclictest0-21swapper/122:44:311
1277992719,7cyclictest16335-21gltestperf00:14:211
126699279,3cyclictest171ktimers/020:34:070
126699279,3cyclictest171ktimers/020:34:070
126699278,5cyclictest201rcuc/000:33:070
126699278,5cyclictest201rcuc/000:33:070
126699273,7cyclictest171ktimers/020:40:530
126699273,7cyclictest171ktimers/020:40:530
1266992720,4cyclictest0-21swapper/021:19:290
1266992720,4cyclictest0-21swapper/021:19:290
1266992720,2cyclictest181rcu_preempt00:14:200
1266992718,7cyclictest1554-21/usr/sbin/munin22:09:220
1266992718,7cyclictest1554-21/usr/sbin/munin22:09:220
1266992713,3cyclictest90-1pr/ttyS019:47:010
1277992620,4cyclictest32712-21missed_timers22:04:231
1277992620,4cyclictest32712-21missed_timers22:04:231
1277992619,5cyclictest7842-21fschecks_count20:59:201
1277992619,5cyclictest18188-21latency19:59:241
1277992619,5cyclictest18188-21latency19:59:241
1277992617,7cyclictest2263-21netstat22:09:271
1277992617,7cyclictest2263-21netstat22:09:271
126699265,18cyclictest201rcuc/023:05:170
126699264,5cyclictest171ktimers/020:48:430
126699264,5cyclictest171ktimers/020:48:430
1266992621,3cyclictest0-21swapper/021:39:310
1266992621,3cyclictest0-21swapper/021:39:310
1266992620,4cyclictest0-21swapper/021:59:290
1266992620,4cyclictest0-21swapper/021:59:290
1266992619,4cyclictest0-21swapper/022:34:310
1266992619,4cyclictest0-21swapper/022:34:310
1266992617,7cyclictest171ktimers/023:30:070
1266992617,7cyclictest171ktimers/023:30:070
1266992613,3cyclictest90-1pr/ttyS021:54:210
1277992518,5cyclictest26281-21gltestperf23:14:241
1277992517,6cyclictest4144-21ntp_kernel_pll_22:14:291
1277992517,6cyclictest4144-21ntp_kernel_pll_22:14:291
1277992517,5cyclictest15181-21latency_hist21:19:141
1277992517,5cyclictest15181-21latency_hist21:19:141
126699257,4cyclictest201rcuc/023:39:320
126699257,4cyclictest201rcuc/023:39:320
126699257,4cyclictest201rcuc/023:39:320
126699253,5cyclictest171ktimers/023:55:220
126699253,5cyclictest171ktimers/023:55:220
1266992517,6cyclictest18455-21/usr/sbin/munin22:54:310
1266992517,6cyclictest18455-21/usr/sbin/munin22:54:310
1266992513,2cyclictest181rcu_preempt22:44:250
1266992513,2cyclictest181rcu_preempt22:44:250
1266992512,7cyclictest90-1pr/ttyS023:52:580
1277992420,2cyclictest0-21swapper/123:49:181
1277992418,4cyclictest16112-21systemctl21:19:291
1277992418,4cyclictest16112-21systemctl21:19:291
1277992417,5cyclictest30991-21cut20:34:191
1277992417,4cyclictest0-21swapper/123:09:181
1277992417,4cyclictest0-21swapper/123:09:181
126699244,4cyclictest201rcuc/000:26:230
1277992319,2cyclictest0-21swapper/123:09:071
1277992319,2cyclictest0-21swapper/120:09:301
1277992319,2cyclictest0-21swapper/120:09:301
1277992318,4cyclictest29810-21fschecks_count23:24:211
1277992318,4cyclictest29810-21fschecks_count23:24:211
1277992318,3cyclictest0-21swapper/119:39:191
1277992318,3cyclictest0-21swapper/119:39:191
1277992317,3cyclictest0-21swapper/123:19:321
1277992317,3cyclictest0-21swapper/123:19:321
1277992316,5cyclictest18370-21kernelversion00:19:231
1277992316,5cyclictest18370-21kernelversion00:19:231
1277992316,5cyclictest18370-21kernelversion00:19:231
1277992315,6cyclictest28575-21fschecks_time21:54:231
127799231,13cyclictest1300-21gltestperf23:34:251
127799231,13cyclictest1300-21gltestperf23:34:251
1266992316,2cyclictest181rcu_preempt19:54:290
299322220,3sleep20-21swapper/223:24:212
299322220,3sleep20-21swapper/223:24:212
128199221,10cyclictest0-21swapper/300:04:133
128199221,10cyclictest0-21swapper/300:04:133
1277992217,3cyclictest0-21swapper/120:04:221
1277992217,3cyclictest0-21swapper/120:04:221
1277992216,4cyclictest0-21swapper/122:24:291
1277992215,5cyclictest4491-21latency20:49:231
1277992215,5cyclictest20981-21needreboot22:59:241
1277992215,5cyclictest20981-21needreboot22:59:241
1277992116,3cyclictest0-21swapper/119:54:311
1277992113,6cyclictest19058-21sort22:54:281
1277992113,6cyclictest19058-21sort22:54:281
275452200,3sleep20-21swapper/220:24:232
1277992014,3cyclictest0-21swapper/120:24:291
1277992014,3cyclictest0-21swapper/120:14:221
1277992014,3cyclictest0-21swapper/120:14:221
188312190,2sleep20-21swapper/222:54:262
188312190,2sleep20-21swapper/222:54:262
1277991915,2cyclictest0-21swapper/122:49:221
1277991915,2cyclictest0-21swapper/122:49:221
128199182,9cyclictest0-21swapper/323:45:363
128199182,9cyclictest0-21swapper/319:44:363
128199181,13cyclictest8372-21chrt19:34:193
128199181,12cyclictest22030-21taskset21:34:353
128199181,12cyclictest22030-21taskset21:34:353
212772170,3sleep20-21swapper/221:34:262
212772170,3sleep20-21swapper/221:34:262
128199178,4cyclictest206302chrt21:34:073
128199173,9cyclictest0-21swapper/320:49:363
128199173,9cyclictest0-21swapper/320:41:363
128199173,9cyclictest0-21swapper/320:41:363
128199171,12cyclictest3217-21taskset22:14:073
128199171,12cyclictest3217-21taskset22:14:073
128199171,12cyclictest0-21swapper/321:19:203
128199171,12cyclictest0-21swapper/321:19:203
128199171,11cyclictest31809-21chrt23:29:213
128199171,11cyclictest31809-21chrt23:29:213
128199171,11cyclictest29069-21chrt21:54:293
128199171,11cyclictest11698-21chrt22:34:293
128199171,11cyclictest11698-21chrt22:34:293
128199171,10cyclictest0-21swapper/300:04:203
128099173,10cyclictest0-21swapper/222:50:372
128099173,10cyclictest0-21swapper/222:50:372
1280991711,5cyclictest351rcuc/223:55:502
1280991711,5cyclictest351rcuc/223:55:502
113432170,3sleep20-21swapper/222:34:242
113432170,3sleep20-21swapper/222:34:242
128199169,4cyclictest223072chrt23:04:203
128199169,4cyclictest176792sleep319:59:213
128199169,4cyclictest176792sleep319:59:213
128199163,9cyclictest0-21swapper/323:50:363
128199163,9cyclictest0-21swapper/320:14:363
128199163,9cyclictest0-21swapper/320:14:363
128199163,9cyclictest0-21swapper/300:34:363
128199161,11cyclictest22889-21taskset00:29:313
128199161,11cyclictest22889-21taskset00:29:313
128199161,11cyclictest17418-21taskset21:24:223
128199161,11cyclictest17418-21taskset21:24:223
128199161,11cyclictest0-21swapper/320:24:243
128199161,11cyclictest0-21swapper/319:54:143
128199161,11cyclictest0-21swapper/319:54:143
128199161,11cyclictest0-21swapper/319:39:273
128199161,11cyclictest0-21swapper/319:39:273
128199161,10cyclictest9543-21taskset22:29:233
128199161,10cyclictest3553-21chrt22:14:233
128199161,10cyclictest3553-21chrt22:14:233
128199161,10cyclictest28337-21chrt23:19:243
128199161,10cyclictest28337-21chrt23:19:243
128199161,10cyclictest15006-21chrt22:44:223
128199161,10cyclictest15006-21chrt22:44:223
128199161,10cyclictest10868-21chrt21:04:323
128199161,10cyclictest10868-21chrt21:04:323
128099163,9cyclictest0-21swapper/220:59:362
128099163,9cyclictest0-21swapper/200:30:362
128099163,9cyclictest0-21swapper/200:30:362
128099163,9cyclictest0-21swapper/200:25:372
128099161,12cyclictest9357-21taskset19:34:302
128099161,11cyclictest26484-21taskset21:49:182
128099161,11cyclictest26484-21taskset21:49:182
128099161,11cyclictest18787-21chrt19:59:312
128099161,11cyclictest18787-21chrt19:59:312
140612150,3sleep20-21swapper/222:39:312
140612150,3sleep20-21swapper/222:39:312
128199151,10cyclictest30818-21taskset21:59:243
128199151,10cyclictest30818-21taskset21:59:243
128199151,10cyclictest26215-21taskset20:19:303
128199151,10cyclictest26215-21taskset20:19:303
128199151,10cyclictest22211-21chrt20:09:293
128199151,10cyclictest22211-21chrt20:09:293
128199151,10cyclictest20938-21chrt20:05:593
128199151,10cyclictest20938-21chrt20:05:593
128199151,10cyclictest19199-21chrt22:54:313
128199151,10cyclictest19199-21chrt22:54:313
128199151,10cyclictest1731-21chrt23:34:313
128199151,10cyclictest1731-21chrt23:34:313
128099159,4cyclictest248062sleep223:09:262
128099159,4cyclictest248062sleep223:09:262
128099153,9cyclictest0-21swapper/220:34:362
128099152,8cyclictest0-21swapper/200:04:252
128099151,8cyclictest0-21swapper/200:44:122
128099151,8cyclictest0-21swapper/200:44:122
128099151,8cyclictest0-21swapper/200:44:122
128099151,7cyclictest0-21swapper/221:09:132
128099151,7cyclictest0-21swapper/221:09:132
128099151,12cyclictest0-21swapper/222:09:312
128099151,12cyclictest0-21swapper/222:09:312
128099151,11cyclictest5701-21taskset22:19:212
128099151,11cyclictest5701-21taskset22:19:212
128099151,11cyclictest32129-21chrt23:29:242
128099151,11cyclictest32129-21chrt23:29:242
128099151,11cyclictest0-21swapper/219:59:132
128099151,10cyclictest22683-21chrt23:04:232
128099151,10cyclictest0-21swapper/221:44:362
128099151,10cyclictest0-21swapper/221:44:362
128099151,10cyclictest0-21swapper/221:29:362
62372141,2sleep20-21swapper/223:47:132
294032140,3sleep20-21swapper/221:54:322
143962140,3sleep30-21swapper/300:09:213
128199149,3cyclictest28412chrt23:39:183
128199149,3cyclictest28412chrt23:39:183
128199149,3cyclictest28412chrt23:39:183
128199141,9cyclictest7824-21chrt22:24:243
128199141,9cyclictest29372-21chrt20:29:233
128199141,9cyclictest29372-21chrt20:29:233
128199141,9cyclictest17869-21chrt00:19:183
128199141,9cyclictest17869-21chrt00:19:183
128199141,9cyclictest17869-21chrt00:19:183
128199141,8cyclictest7678-21chrt20:59:143
128199141,8cyclictest7678-21chrt20:59:143
128199141,11cyclictest0-21swapper/321:44:093
128199141,11cyclictest0-21swapper/321:44:093
128199141,10cyclictest26422-21taskset21:49:153
128199141,10cyclictest26422-21taskset21:49:153
128199141,10cyclictest20321-21chrt22:59:183
128199141,10cyclictest20321-21chrt22:59:183
128199141,10cyclictest0-21swapper/323:09:203
128199141,10cyclictest0-21swapper/323:09:203
128099141,9cyclictest32556-21chrt22:04:212
128099141,9cyclictest32556-21chrt22:04:212
128099141,9cyclictest16025-21taskset00:14:182
128099141,11cyclictest12156-21taskset19:44:192
128099141,11cyclictest0-21swapper/220:09:222
128099141,11cyclictest0-21swapper/220:09:222
128099141,10cyclictest5934-21chrt20:54:182
128099141,10cyclictest5934-21chrt20:54:182
128099141,10cyclictest0-21swapper/221:59:232
128099141,10cyclictest0-21swapper/221:59:232
128099141,10cyclictest0-21swapper/221:09:232
128099141,10cyclictest0-21swapper/221:09:232
128099141,10cyclictest0-21swapper/220:04:282
128099141,10cyclictest0-21swapper/220:04:282
128199138,3cyclictest277892chrt21:50:153
128199138,3cyclictest277892chrt21:50:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional