You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 11:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Mar 18, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3120221310,3sleep20-21swapper/222:01:492
3120221310,3sleep20-21swapper/222:01:492
173922700,3chrt0-21swapper/221:26:392
173922700,3chrt0-21swapper/221:26:392
126322690,3sleep10-21swapper/121:11:511
126322690,3sleep10-21swapper/121:11:511
126322690,3sleep10-21swapper/121:11:511
235062680,1sleep023509-21if_eth021:41:450
235062680,1sleep023509-21if_eth021:41:450
235062680,1sleep023509-21if_eth021:41:450
32068996756,6cyclictest11184-21iwlist00:01:460
32068996756,6cyclictest11184-21iwlist00:01:460
176612660,2sleep117660-21ntpq22:51:491
176612660,2sleep117660-21ntpq22:51:491
54842620,2sleep20-21swapper/220:51:542
54842620,2sleep20-21swapper/220:51:542
115972570,2sleep111601-21latency_hist21:11:311
123062540,2sleep012490-21awk22:36:530
123062540,2sleep012490-21awk22:36:530
123062540,2sleep012490-21awk22:36:530
21052530,2sleep12286-21idleruntime22:11:461
78942520,3chrt0-21swapper/321:01:323
78942520,3chrt0-21swapper/321:01:323
32068995043,4cyclictest0-21swapper/000:01:390
32068995043,4cyclictest0-21swapper/000:01:390
32068995043,4cyclictest0-21swapper/000:01:390
251032480,3sleep30-21swapper/323:11:493
251032480,3sleep30-21swapper/323:11:493
47912470,2sleep10-21swapper/120:51:451
47912470,2sleep10-21swapper/120:51:451
207682470,3sleep30-21swapper/320:06:533
207682470,3sleep30-21swapper/320:06:533
21292460,1sleep016-21ksoftirqd/020:44:530
21292460,1sleep016-21ksoftirqd/020:44:530
32068994516,3cyclictest0-21swapper/021:36:530
32068994516,3cyclictest0-21swapper/021:36:530
32068994317,24cyclictest0-21swapper/023:21:550
32068994317,24cyclictest0-21swapper/023:21:550
59282400,2sleep30-21swapper/320:55:533
59282400,2sleep30-21swapper/320:55:533
3207499404,27cyclictest10622-21chrt00:01:373
3207499404,27cyclictest10622-21chrt00:01:373
3207499404,27cyclictest10622-21chrt00:01:373
32068994015,2cyclictest0-21swapper/020:56:420
32068994015,2cyclictest0-21swapper/020:56:420
314932400,3sleep10-21swapper/120:36:461
314932400,3sleep10-21swapper/120:36:461
229182400,2sleep122920-21date21:41:341
229182400,2sleep122920-21date21:41:341
291042390,1sleep029204-21/usr/sbin/munin21:56:450
291042390,1sleep029204-21/usr/sbin/munin21:56:450
32074993821,12cyclictest120112sleep300:02:033
32074993821,12cyclictest120112sleep300:02:033
3207399382,28cyclictest10598-21taskset00:01:362
3207399382,28cyclictest10598-21taskset00:01:362
3207399382,28cyclictest10598-21taskset00:01:362
181432380,1sleep018273-21fschecks_time20:01:440
181432380,1sleep018273-21fschecks_time20:01:440
163222380,5sleep00-21swapper/000:16:420
163222380,5sleep00-21swapper/000:16:420
163222380,5sleep00-21swapper/000:16:420
145052370,2sleep114507-21grep19:51:431
32072993629,6cyclictest22300-21latency_hist23:06:311
32072993629,6cyclictest22300-21latency_hist23:06:311
265082360,2sleep30-21swapper/320:21:523
265082360,2sleep30-21swapper/320:21:523
32072993527,6cyclictest16052-21threads22:46:521
32072993527,6cyclictest16052-21threads22:46:521
32068993527,6cyclictest4470-21netstat22:16:480
32068993527,6cyclictest4470-21netstat22:16:480
28032350,2chrt0-21swapper/220:46:432
28032350,2chrt0-21swapper/220:46:432
148562350,3sleep00-21swapper/000:11:430
315662340,3sleep032062-21cyclictest22:01:550
315662340,3sleep032062-21cyclictest22:01:550
32072993327,4cyclictest0-21swapper/122:31:531
32072993327,4cyclictest0-21swapper/122:31:531
32072993323,8cyclictest14937-21kernelversion00:11:451
32068993327,3cyclictest32062-21cyclictest20:31:550
227992330,1sleep122998-21unixbench_singl20:11:541
18302330,3sleep00-21swapper/023:36:460
18302330,3sleep00-21swapper/023:36:460
18302330,3sleep00-21swapper/023:36:460
137552330,2sleep013757-21latency22:41:470
137552330,2sleep013757-21latency22:41:470
137552330,2sleep013757-21latency22:41:470
32072993225,5cyclictest10328-21idleruntime-cro19:41:311
32072993225,5cyclictest10328-21idleruntime-cro19:41:311
32072993126,3cyclictest28229-21kworker/u9:1-xprtiod00:01:501
32072993126,3cyclictest28229-21kworker/u9:1-xprtiod00:01:501
32068993124,5cyclictest19093-21gltestperf22:56:440
32068993124,5cyclictest19093-21gltestperf22:56:440
32068993122,7cyclictest22766-21threads20:11:530
130972310,3sleep00-21swapper/019:46:480
32072993026,2cyclictest0-21swapper/123:41:311
32072993026,2cyclictest0-21swapper/123:41:311
32072993026,2cyclictest0-21swapper/123:41:311
32072993025,3cyclictest0-21swapper/123:56:311
32072993025,3cyclictest0-21swapper/123:56:311
32072993023,5cyclictest2745-21fschecks_time20:46:431
32072993023,5cyclictest2745-21fschecks_time20:46:431
32068993023,5cyclictest6328-21needreboot22:21:470
32068993023,5cyclictest6328-21needreboot22:21:470
32068993023,5cyclictest24309-21kernelversion00:36:460
32068993023,5cyclictest24309-21kernelversion00:36:460
32068993023,5cyclictest24309-21kernelversion00:36:460
32068993022,6cyclictest32062-21cyclictest00:35:280
32068993022,6cyclictest32062-21cyclictest00:35:280
32068993021,7cyclictest550-21cron23:36:310
32068993021,7cyclictest550-21cron23:36:310
184902300,2sleep118651-21cat00:21:461
184902300,2sleep118651-21cat00:21:461
32072992924,3cyclictest25294-21head21:46:451
32072992923,3cyclictest0-21swapper/100:01:321
32072992923,3cyclictest0-21swapper/100:01:321
32072992923,3cyclictest0-21swapper/100:01:321
32072992922,5cyclictest4093-21threads19:21:521
32072992922,5cyclictest4093-21threads19:21:521
32072992922,5cyclictest26676-21unixbench_multi20:21:531
32072992922,5cyclictest26676-21unixbench_multi20:21:531
32072992922,5cyclictest22423-21kernelversion00:31:491
32072992922,5cyclictest22423-21kernelversion00:31:491
32072992921,5cyclictest20779-21ntp_kernel_err00:26:501
32072992921,5cyclictest20779-21ntp_kernel_err00:26:501
32068992922,5cyclictest15542-21kernelversion22:46:450
32068992922,5cyclictest15542-21kernelversion22:46:450
32068992921,6cyclictest9238-21latency_hist22:31:340
32068992921,6cyclictest9238-21latency_hist22:31:340
32072992823,4cyclictest32062-21cyclictest19:41:421
32072992823,4cyclictest32062-21cyclictest19:41:421
32072992822,4cyclictest26568-21gltestperf23:16:451
32072992822,4cyclictest26568-21gltestperf23:16:451
32072992821,5cyclictest25304-21sshd00:39:531
32072992821,5cyclictest25304-21sshd00:39:531
32072992821,5cyclictest25304-21sshd00:39:531
32072992821,5cyclictest12416-21/usr/sbin/munin19:46:481
32072992820,6cyclictest30347-21ls20:31:541
32072992820,6cyclictest14364-21needreboot21:16:461
32072992820,6cyclictest14364-21needreboot21:16:461
32072992820,6cyclictest13669-21kernelversion22:41:461
32072992820,6cyclictest13669-21kernelversion22:41:461
32072992820,6cyclictest13669-21kernelversion22:41:461
32072992721,5cyclictest23950-21sshd23:08:531
32072992721,5cyclictest23950-21sshd23:08:531
32072992721,5cyclictest20391-21kernelversion20:06:471
32072992721,5cyclictest20391-21kernelversion20:06:471
32072992721,4cyclictest0-21swapper/122:41:331
32072992721,4cyclictest0-21swapper/122:41:331
32072992721,4cyclictest0-21swapper/122:41:331
32072992720,5cyclictest24379-21/usr/sbin/munin23:11:481
32072992720,5cyclictest24379-21/usr/sbin/munin23:11:481
32068992722,3cyclictest0-21swapper/021:46:530
32068992722,3cyclictest0-21swapper/021:46:530
32068992722,3cyclictest0-21swapper/020:01:310
32068992722,3cyclictest0-21swapper/020:01:310
32068992721,4cyclictest0-21swapper/021:26:400
32068992721,4cyclictest0-21swapper/021:26:400
32068992720,5cyclictest3416-21fschecks_count23:41:430
32068992720,5cyclictest3416-21fschecks_count23:41:430
32068992720,5cyclictest3416-21fschecks_count23:41:430
32068992720,5cyclictest27758-21sshd23:19:530
32068992720,5cyclictest27758-21sshd23:19:530
32068992718,7cyclictest2244-21ls19:16:530
64392260,20sleep0700-21192.168.115.40-manager23:47:360
64392260,20sleep0700-21192.168.115.40-manager23:47:360
32072992621,3cyclictest0-21swapper/122:21:321
32072992621,3cyclictest0-21swapper/122:21:321
32072992620,4cyclictest32062-21cyclictest23:31:421
32072992620,4cyclictest32062-21cyclictest23:31:421
32072992620,4cyclictest0-21swapper/120:41:421
32072992620,4cyclictest0-21swapper/120:41:421
32068992620,5cyclictest5299-21switchtime20:51:530
32068992620,5cyclictest5299-21switchtime20:51:530
32068992620,5cyclictest17645-21ntp_offset22:51:480
32068992620,5cyclictest17645-21ntp_offset22:51:480
32068992619,5cyclictest550-21cron19:56:310
32072992520,4cyclictest30259-21grep23:26:431
32072992520,4cyclictest30259-21grep23:26:431
32072992520,3cyclictest0-21swapper/100:06:531
32072992520,3cyclictest0-21swapper/100:06:531
32072992519,5cyclictest32062-21cyclictest23:41:441
32072992519,5cyclictest32062-21cyclictest23:41:441
32072992519,5cyclictest32062-21cyclictest23:41:441
32072992519,5cyclictest24105-21kernelversion20:16:461
32072992519,5cyclictest24105-21kernelversion20:16:461
32072992519,5cyclictest24105-21kernelversion20:16:461
32072992519,4cyclictest30927-21idleruntime22:01:461
32072992519,4cyclictest30927-21idleruntime22:01:461
32072992518,5cyclictest20174-21rt-features21:31:511
32072992518,5cyclictest20174-21rt-features21:31:511
32068992520,4cyclictest32062-21cyclictest20:26:530
32068992520,4cyclictest32062-21cyclictest20:26:530
32068992520,3cyclictest0-21swapper/023:06:540
32068992520,3cyclictest0-21swapper/023:06:540
32068992518,5cyclictest28015-21unixbench_singl21:51:530
32068992518,5cyclictest28015-21unixbench_singl21:51:530
32068992517,6cyclictest8791-21netstat21:01:500
32068992517,6cyclictest8791-21netstat21:01:500
32068992517,6cyclictest20087-21grep20:06:440
32068992517,6cyclictest20087-21grep20:06:440
32072992419,3cyclictest0-21swapper/123:26:531
32072992419,3cyclictest0-21swapper/120:56:541
32072992419,3cyclictest0-21swapper/120:56:541
32072992418,4cyclictest2844-21idleruntime-cro19:21:311
32072992418,3cyclictest0-21swapper/122:26:531
32072992418,3cyclictest0-21swapper/122:26:531
32072992415,7cyclictest18444-21sort21:26:511
32072992415,7cyclictest18444-21sort21:26:511
32068992420,3cyclictest19097-21cron21:31:310
32068992420,3cyclictest19097-21cron21:31:310
32068992420,2cyclictest0-21swapper/020:16:440
32068992420,2cyclictest0-21swapper/020:16:440
32068992420,2cyclictest0-21swapper/020:16:440
32068992419,3cyclictest0-21swapper/022:11:450
32068992418,5cyclictest839-21processes22:06:530
32068992418,5cyclictest839-21processes22:06:530
32068992418,4cyclictest749-21runrttasks20:21:500
32068992418,4cyclictest749-21runrttasks20:21:500
32068992418,3cyclictest0-21swapper/020:36:470
32068992418,3cyclictest0-21swapper/020:36:470
32068992416,6cyclictest9523-21fschecks_count22:31:440
32068992416,6cyclictest9523-21fschecks_count22:31:440
32068992411,3cyclictest0-21swapper/021:36:410
32072992319,3cyclictest32062-21cyclictest21:51:511
32072992319,3cyclictest32062-21cyclictest21:51:511
32072992319,2cyclictest0-21swapper/123:01:311
32072992319,2cyclictest0-21swapper/123:01:311
32072992318,3cyclictest29846-21tail21:56:531
32072992318,3cyclictest29846-21tail21:56:531
32072992318,3cyclictest0-21swapper/121:26:421
32072992318,3cyclictest0-21swapper/121:26:421
32072992318,3cyclictest0-21swapper/121:01:471
32072992318,3cyclictest0-21swapper/121:01:471
32068992319,3cyclictest32062-21cyclictest23:54:240
32068992319,3cyclictest32062-21cyclictest23:54:240
32068992318,3cyclictest0-21swapper/021:11:470
32068992318,3cyclictest0-21swapper/021:11:470
32068992318,3cyclictest0-21swapper/021:11:470
32068992318,3cyclictest0-21swapper/019:41:530
32068992318,3cyclictest0-21swapper/019:41:530
32068992318,3cyclictest0-21swapper/000:06:450
32068992318,3cyclictest0-21swapper/000:06:450
32068992317,5cyclictest7886-21timerwakeupswit19:31:520
32068992317,5cyclictest7886-21timerwakeupswit19:31:520
32068992316,5cyclictest547-21rs:main0
32068992316,5cyclictest547-21rs:main0
32068992316,5cyclictest10156-21fschecks_time21:06:440
32068992313,8cyclictest142-21systemd-journal19:21:430
32068992313,8cyclictest142-21systemd-journal19:21:430
170702230,4sleep20-21swapper/222:51:422
170702230,4sleep20-21swapper/222:51:422
32072992216,4cyclictest0-21swapper/121:41:431
32072992216,4cyclictest0-21swapper/121:41:431
32072992215,5cyclictest18753-21ntp_kernel_pll_20:01:491
32072992215,5cyclictest18753-21ntp_kernel_pll_20:01:491
32068992218,2cyclictest0-21swapper/000:26:440
32068992218,2cyclictest0-21swapper/000:26:440
32068992217,3cyclictest0-21swapper/023:01:480
32068992217,3cyclictest0-21swapper/023:01:480
32068992215,5cyclictest19080-21wc00:21:530
32068992215,5cyclictest19080-21wc00:21:530
130822220,3sleep30-21swapper/319:46:473
125292220,3sleep20-21swapper/219:46:422
3207399213,11cyclictest0-21swapper/200:01:462
3207399213,11cyclictest0-21swapper/200:01:462
32072992115,4cyclictest0-21swapper/119:31:531
32072992115,4cyclictest0-21swapper/119:31:531
32072992115,4cyclictest0-21swapper/100:16:531
32072992115,4cyclictest0-21swapper/100:16:531
32072992115,4cyclictest0-21swapper/100:16:531
32072992112,7cyclictest6361-21unixbench_singl23:46:551
32072992112,7cyclictest6361-21unixbench_singl23:46:551
32068992117,2cyclictest0-21swapper/023:11:440
32068992117,2cyclictest0-21swapper/023:11:440
32068992117,2cyclictest0-21swapper/021:31:520
32068992117,2cyclictest0-21swapper/019:26:490
32068992116,3cyclictest0-21swapper/019:36:470
32068992116,3cyclictest0-21swapper/019:36:470
32068992112,7cyclictest2502-21wc20:46:410
32068992112,7cyclictest2502-21wc20:46:410
83962200,4chrt0-21swapper/319:35:533
83962200,4chrt0-21swapper/319:35:533
3207499202,12cyclictest14905-21chrt21:16:513
3207499202,12cyclictest14905-21chrt21:16:513
3207399203,11cyclictest0-21swapper/219:21:532
3207399203,11cyclictest0-21swapper/219:21:532
3207399201,13cyclictest13493-21chrt22:41:452
3207399201,13cyclictest13493-21chrt22:41:452
3207399201,13cyclictest13493-21chrt22:41:452
32072992015,4cyclictest6541-21systemctl22:21:501
32072992015,4cyclictest6541-21systemctl22:21:501
32072992015,3cyclictest0-21swapper/119:56:451
32072992015,3cyclictest0-21swapper/119:56:451
3207299201,10cyclictest27370-21/usr/sbin/munin20:26:461
3207299201,10cyclictest27370-21/usr/sbin/munin20:26:461
32068992014,4cyclictest0-21swapper/023:26:500
224022200,3sleep20-21swapper/223:06:372
224022200,3sleep20-21swapper/223:06:372
3207499191,13cyclictest12891-21chrt21:11:533
3207499191,13cyclictest12891-21chrt21:11:533
3207499191,13cyclictest12891-21chrt21:11:533
3207399191,13cyclictest7056-21chrt19:31:422
3207399191,13cyclictest7056-21chrt19:31:422
3207399191,12cyclictest15683-21chrt00:11:542
3207399191,12cyclictest12084-21chrt21:11:442
3207399191,12cyclictest12084-21chrt21:11:442
3207399191,12cyclictest12084-21chrt21:11:442
3207399190,13cyclictest20068-21chrt21:31:502
3207399190,13cyclictest20068-21chrt21:31:502
32072991915,2cyclictest0-21swapper/122:06:471
32072991915,2cyclictest0-21swapper/122:06:471
32072991914,3cyclictest0-21swapper/121:46:531
32072991914,3cyclictest0-21swapper/121:46:531
3207299191,11cyclictest4947-21/usr/sbin/munin19:26:451
3207499181,12cyclictest16720-21chrt00:16:453
3207499181,12cyclictest16720-21chrt00:16:453
3207499181,12cyclictest16720-21chrt00:16:453
32073991811,4cyclictest133562chrt00:06:512
32073991811,4cyclictest133562chrt00:06:512
3207399181,13cyclictest12348-21chrt19:46:382
3207399181,13cyclictest12348-21chrt19:46:382
3207399181,12cyclictest27398-21chrt23:16:542
3207399181,12cyclictest27398-21chrt23:16:542
3207399181,12cyclictest23002-21taskset20:11:542
3207499171,12cyclictest30163-21chrt21:59:533
3207499171,12cyclictest30163-21chrt21:59:533
3207499171,12cyclictest25682-21chrt21:46:503
3207499171,12cyclictest25682-21chrt21:46:503
3207499171,11cyclictest17945-21chrt21:26:443
3207499171,11cyclictest17945-21chrt21:26:443
3207499171,11cyclictest1683-21chrt23:36:453
3207499171,11cyclictest1683-21chrt23:36:453
3207499171,11cyclictest1683-21chrt23:36:453
3207499171,11cyclictest0-21swapper/322:06:553
3207499171,11cyclictest0-21swapper/322:06:553
3207499171,11cyclictest0-21swapper/320:41:503
3207499171,11cyclictest0-21swapper/320:41:503
3207399178,5cyclictest299012sleep223:26:392
3207399178,5cyclictest299012sleep223:26:392
3207399177,5cyclictest204902sleep200:26:452
3207399177,5cyclictest204902sleep200:26:452
3207399171,12cyclictest28358-21chrt20:26:542
3207399171,12cyclictest28358-21chrt20:26:542
3207399171,11cyclictest4227-21chrt22:16:442
3207399171,11cyclictest4227-21chrt22:16:442
3207399171,11cyclictest30107-21taskset20:31:522
3207399171,10cyclictest0-21swapper/221:41:412
3207399171,10cyclictest0-21swapper/221:41:412
172612170,3sleep30-21swapper/322:51:433
172612170,3sleep30-21swapper/322:51:433
3207499163,10cyclictest0-21swapper/319:21:533
3207499163,10cyclictest0-21swapper/319:21:533
3207499162,8cyclictest0-21swapper/320:01:413
3207499162,8cyclictest0-21swapper/320:01:413
3207499161,11cyclictest7451-21chrt23:51:443
3207499161,11cyclictest7451-21chrt23:51:443
3207499161,11cyclictest27237-21chrt21:51:453
3207499161,11cyclictest27237-21chrt21:51:453
3207499161,11cyclictest26817-21chrt23:16:473
3207499161,11cyclictest26817-21chrt23:16:473
3207499161,11cyclictest18777-21chrt20:01:503
3207499161,11cyclictest18777-21chrt20:01:503
3207499161,11cyclictest11618-21chrt19:41:523
3207499161,11cyclictest11618-21chrt19:41:523
3207499161,11cyclictest0-21swapper/323:46:463
3207499161,11cyclictest0-21swapper/323:46:463
3207499161,11cyclictest0-21swapper/323:06:473
3207499161,11cyclictest0-21swapper/323:06:473
3207499161,10cyclictest5088-21chrt23:46:423
3207499161,10cyclictest5088-21chrt23:46:423
3207499160,12cyclictest5626-21taskset19:26:493
3207399168,5cyclictest272852sleep220:26:392
3207399168,5cyclictest272852sleep220:26:392
3207399163,9cyclictest0-21swapper/221:57:362
3207399163,9cyclictest0-21swapper/221:57:362
3207399162,8cyclictest0-21swapper/222:11:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional