You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 19:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu May 14, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
554621230,3sleep20-21swapper/212:17:302
554621230,3sleep20-21swapper/212:17:302
768221130,2sleep30-21swapper/308:02:373
768221130,2sleep30-21swapper/308:02:373
273612800,3chrt0-21swapper/007:27:410
273612800,3chrt0-21swapper/007:27:410
170422710,3chrt17045-21fschecks_time08:27:380
261002680,3chrt0-21swapper/310:17:403
261002680,3chrt0-21swapper/310:17:403
181702670,3chrt0-21swapper/311:22:403
181702670,3chrt0-21swapper/311:22:403
181702670,3chrt0-21swapper/311:22:403
300122660,3sleep20-21swapper/210:27:442
300122660,3sleep20-21swapper/210:27:442
15722660,3sleep00-21swapper/010:37:470
15722660,3sleep00-21swapper/010:37:470
112192650,3sleep30-21swapper/309:37:403
144102620,3sleep30-21swapper/311:12:393
144102620,3sleep30-21swapper/311:12:393
103482620,2sleep20-21swapper/208:07:472
45172580,3sleep30-21swapper/312:12:453
45172580,3sleep30-21swapper/312:12:453
291182570,2chrt0-21swapper/311:52:393
291182570,2chrt0-21swapper/311:52:393
291182570,2chrt0-21swapper/311:52:393
144592570,3sleep014298-21/usr/sbin/munin09:47:380
89642560,3sleep20-21swapper/210:57:472
89642560,3sleep20-21swapper/210:57:472
13962560,4sleep20-21swapper/209:12:392
13962560,4sleep20-21swapper/209:12:392
72482550,2sleep07247-21if_eth009:27:400
72482550,2sleep07247-21if_eth009:27:400
62162460,4sleep30-21swapper/307:57:433
62162460,4sleep30-21swapper/307:57:433
21191994619,5cyclictest24131-21latency_hist08:47:300
21191994619,5cyclictest24131-21latency_hist08:47:300
21191994619,5cyclictest24131-21latency_hist08:47:300
290682450,3sleep20-21swapper/208:57:472
142962430,4sleep20-21swapper/212:37:482
142962430,4sleep20-21swapper/212:37:482
48462420,2sleep00-21swapper/010:47:400
48462420,2sleep00-21swapper/010:47:400
258442420,6sleep125849-21gltestperf10:17:381
258442420,6sleep125849-21gltestperf10:17:381
2119199411,3cyclictest213102df11:32:350
2119199411,3cyclictest213102df11:32:350
2119199411,3cyclictest213102df11:32:350
285372390,9sleep0171ktimers/010:22:470
285372390,9sleep0171ktimers/010:22:470
285372390,9sleep0171ktimers/010:22:470
21191993917,6cyclictest5736-21tune2fs07:57:370
21191993917,6cyclictest5736-21tune2fs07:57:370
7772380,1chrt776-21sendmail_mailtr07:42:451
7772380,1chrt776-21sendmail_mailtr07:42:451
305612380,2sleep30-21swapper/310:27:493
305612380,2sleep30-21swapper/310:27:493
124152360,3sleep20-21swapper/211:07:402
17162350,3sleep30-21swapper/312:07:263
17162350,3sleep30-21swapper/312:07:263
17162350,3sleep30-21swapper/312:07:263
17162350,3sleep30-21swapper/312:07:263
21192993326,5cyclictest29184-21kernelversion11:52:401
21192993326,5cyclictest29184-21kernelversion11:52:401
21192993325,6cyclictest31505-21latency_hist09:07:251
21192993325,6cyclictest31505-21latency_hist09:07:251
21192993325,6cyclictest31505-21latency_hist09:07:251
21192993219,4cyclictest181rcu_preempt08:42:411
21192993219,4cyclictest181rcu_preempt08:42:411
21192993219,4cyclictest181rcu_preempt08:42:411
21192993123,7cyclictest28702-21fschecks_count07:32:361
21192993123,7cyclictest28702-21fschecks_count07:32:361
21192993122,7cyclictest7743-21fschecks_time12:22:371
21192993122,7cyclictest7743-21fschecks_time12:22:371
21191993126,4cyclictest21190-21cyclictest12:22:450
21191993126,4cyclictest21190-21cyclictest12:22:450
12932310,2sleep01291-21users12:02:490
12932310,2sleep01291-21users12:02:490
12932310,2sleep01291-21users12:02:490
12932310,2sleep01291-21users12:02:490
226622300,4sleep30-21swapper/310:07:433
226622300,4sleep30-21swapper/310:07:433
2119299308,11cyclictest29-21ksoftirqd/112:13:331
2119299308,11cyclictest29-21ksoftirqd/112:13:331
21192993023,5cyclictest4306-21/usr/sbin/munin10:47:431
21192993023,5cyclictest4306-21/usr/sbin/munin10:47:431
21192993023,5cyclictest32691-21latency_hist12:02:381
21192993023,5cyclictest32691-21latency_hist12:02:381
21192993023,5cyclictest32691-21latency_hist12:02:381
21192993023,5cyclictest31838-21needreboot10:32:431
21192993023,5cyclictest31838-21needreboot10:32:431
21192993018,4cyclictest181rcu_preempt07:47:391
21192993018,4cyclictest181rcu_preempt07:47:391
21191993024,5cyclictest15191-21cut08:22:370
21191993024,5cyclictest15191-21cut08:22:370
21191993024,5cyclictest15191-21cut08:22:370
21191993024,4cyclictest7292-21cron12:22:250
21191993024,4cyclictest7292-21cron12:22:250
21191993023,5cyclictest940-21latency_hist09:12:250
21191993023,5cyclictest940-21latency_hist09:12:250
21191993023,5cyclictest12219-21cat09:42:250
21191993022,6cyclictest28632-21/usr/sbin/munin11:52:430
21191993022,6cyclictest28632-21/usr/sbin/munin11:52:430
21191993022,6cyclictest28632-21/usr/sbin/munin11:52:430
21191993022,6cyclictest1884-21netstat09:12:450
21191993022,6cyclictest1884-21netstat09:12:450
2119299299,11cyclictest0-21swapper/111:02:331
2119299299,11cyclictest0-21swapper/111:02:331
21192992920,7cyclictest4286-21needreboot07:52:421
21192992920,7cyclictest4286-21needreboot07:52:421
21192992916,7cyclictest90-1pr/ttyS011:37:561
21192992916,7cyclictest90-1pr/ttyS011:37:561
98482280,2sleep09850-21unixbench-2d09:32:470
2119299289,12cyclictest90-1pr/ttyS010:29:491
2119299289,12cyclictest90-1pr/ttyS010:29:491
2119299288,10cyclictest29-21ksoftirqd/109:48:121
2119299288,10cyclictest29-21ksoftirqd/109:48:121
21192992819,7cyclictest32530-21processes09:07:451
21192992819,7cyclictest32530-21processes09:07:451
21192992817,4cyclictest181rcu_preempt09:32:481
21192992814,4cyclictest181rcu_preempt11:03:351
21192992814,4cyclictest181rcu_preempt11:03:351
21192992814,4cyclictest181rcu_preempt11:03:351
21192992813,7cyclictest90-1pr/ttyS010:47:341
21192992813,7cyclictest90-1pr/ttyS010:47:341
21191992824,3cyclictest10890-21systemctl11:02:460
21191992824,3cyclictest10890-21systemctl11:02:460
21191992824,3cyclictest10890-21systemctl11:02:460
21191992821,5cyclictest7737-21head08:02:370
21191992821,5cyclictest7737-21head08:02:370
21191992821,5cyclictest21190-21cyclictest11:43:450
21191992821,5cyclictest21190-21cyclictest11:43:450
21191992821,5cyclictest21190-21cyclictest11:43:450
2119299277,10cyclictest29-21ksoftirqd/112:12:051
2119299277,10cyclictest29-21ksoftirqd/112:12:051
2119299276,9cyclictest29-21ksoftirqd/110:37:571
2119299276,9cyclictest29-21ksoftirqd/110:37:571
21192992722,3cyclictest90-1pr/ttyS008:37:531
21192992722,3cyclictest90-1pr/ttyS008:37:531
21192992720,2cyclictest181rcu_preempt09:45:501
21192992720,2cyclictest181rcu_preempt09:45:501
21192992719,2cyclictest181rcu_preempt08:32:361
21192992718,2cyclictest181rcu_preempt11:12:391
21192992718,2cyclictest181rcu_preempt11:12:391
21192992715,3cyclictest181rcu_preempt07:37:371
21192992715,3cyclictest181rcu_preempt07:37:371
21192992710,3cyclictest0-21swapper/108:17:441
21192992710,3cyclictest0-21swapper/108:17:441
21191992722,3cyclictest0-21swapper/007:57:250
21191992722,3cyclictest0-21swapper/007:57:250
21191992721,4cyclictest30216-21sed09:02:390
21191992721,4cyclictest30216-21sed09:02:390
21191992721,4cyclictest30216-21sed09:02:390
21191992720,5cyclictest10153-21ntp_kernel_pll_12:27:420
21191992720,5cyclictest10153-21ntp_kernel_pll_12:27:420
21191992720,5cyclictest10153-21ntp_kernel_pll_12:27:420
209012270,3sleep021190-21cyclictest10:02:460
209012270,3sleep021190-21cyclictest10:02:460
209012270,3sleep021190-21cyclictest10:02:460
149972270,3sleep0171ktimers/009:47:420
149972270,3sleep0171ktimers/009:47:420
63302260,2sleep10-21swapper/107:57:451
63302260,2sleep10-21swapper/107:57:451
2119299268,4cyclictest90-1pr/ttyS010:05:541
2119299268,4cyclictest90-1pr/ttyS010:05:541
2119299268,4cyclictest90-1pr/ttyS010:05:541
2119299267,12cyclictest29-21ksoftirqd/107:28:311
2119299267,12cyclictest29-21ksoftirqd/107:28:311
2119299267,10cyclictest29-21ksoftirqd/109:30:361
2119299267,10cyclictest29-21ksoftirqd/109:30:361
2119299262,7cyclictest275022/usr/sbin/munin10:22:361
2119299262,7cyclictest275022/usr/sbin/munin10:22:361
2119299262,7cyclictest275022/usr/sbin/munin10:22:361
21192992622,3cyclictest8118-21ntp_offset08:02:421
21192992622,3cyclictest8118-21ntp_offset08:02:421
21192992619,5cyclictest21190-21cyclictest09:20:201
21192992619,5cyclictest21190-21cyclictest09:20:201
21192992618,2cyclictest181rcu_preempt08:57:381
21192992617,7cyclictest25436-21cat07:22:391
21192992617,3cyclictest181rcu_preempt09:22:451
21192992617,3cyclictest181rcu_preempt09:22:451
21192992616,3cyclictest181rcu_preempt12:34:041
21192992616,3cyclictest181rcu_preempt12:34:041
21192992616,3cyclictest181rcu_preempt12:34:041
21192992616,2cyclictest181rcu_preempt08:51:371
21192992616,2cyclictest181rcu_preempt08:51:371
21192992613,4cyclictest181rcu_preempt12:07:401
21192992613,4cyclictest181rcu_preempt12:07:401
21192992613,4cyclictest181rcu_preempt12:07:401
21192992613,4cyclictest181rcu_preempt12:07:401
21192992610,4cyclictest181rcu_preempt10:08:231
21192992610,4cyclictest181rcu_preempt10:08:231
21191992621,4cyclictest21190-21cyclictest09:43:490
21191992621,3cyclictest0-21swapper/012:17:250
21191992621,3cyclictest0-21swapper/012:17:250
21191992620,4cyclictest729-21dbus-daemon08:22:250
21191992620,4cyclictest729-21dbus-daemon08:22:250
21191992620,4cyclictest13651-21/usr/sbin/munin11:12:330
21191992619,5cyclictest32288-21latency_hist12:02:270
21191992619,5cyclictest32288-21latency_hist12:02:270
21191992619,5cyclictest32288-21latency_hist12:02:270
21191992619,5cyclictest2985-21kernelversion10:42:390
21191992619,5cyclictest2985-21kernelversion10:42:390
21191992618,6cyclictest6953-21ntp_kernel_pll_10:52:430
21191992618,6cyclictest6953-21ntp_kernel_pll_10:52:430
21191992618,6cyclictest32471-21cut07:42:370
21191992618,6cyclictest32471-21cut07:42:370
21191992617,7cyclictest21873-21sort11:32:400
21191992614,9cyclictest330-21cron10:37:250
21191992614,9cyclictest330-21cron10:37:250
2119199261,10cyclictest302362/usr/sbin/munin10:27:470
2119199261,10cyclictest302362/usr/sbin/munin10:27:470
118472260,4sleep20-21swapper/208:12:412
21194992518,5cyclictest57522sleep309:22:463
21194992518,5cyclictest57522sleep309:22:463
21192992520,3cyclictest0-21swapper/111:32:371
21192992519,3cyclictest0-21swapper/111:47:391
21192992519,3cyclictest0-21swapper/111:47:391
21192992519,3cyclictest0-21swapper/111:47:391
21192992518,5cyclictest21190-21cyclictest11:57:021
21192992518,5cyclictest21190-21cyclictest11:57:021
21192992518,5cyclictest21190-21cyclictest11:57:021
21192992517,6cyclictest13055-21unixbench_multi11:07:471
21192992517,3cyclictest181rcu_preempt12:27:401
21192992517,3cyclictest181rcu_preempt12:27:401
21192992517,3cyclictest181rcu_preempt12:27:401
21192992517,3cyclictest181rcu_preempt08:52:371
21192992517,3cyclictest181rcu_preempt08:52:371
21192992517,3cyclictest181rcu_preempt08:09:081
21192992517,2cyclictest181rcu_preempt10:15:301
21192992514,4cyclictest181rcu_preempt12:21:011
21192992514,4cyclictest181rcu_preempt12:21:011
21192992513,2cyclictest181rcu_preempt09:12:461
21192992513,2cyclictest181rcu_preempt09:12:461
21191992520,4cyclictest19519-21systemctl08:32:440
21191992520,4cyclictest1346-21avahi-daemon11:17:360
21191992520,4cyclictest1346-21avahi-daemon11:17:360
21191992520,3cyclictest0-21swapper/012:37:470
21191992520,3cyclictest0-21swapper/012:37:470
21191992520,3cyclictest0-21swapper/010:12:250
21191992520,3cyclictest0-21swapper/010:12:250
21191992520,3cyclictest0-21swapper/008:07:430
21191992520,2cyclictest0-21swapper/008:52:470
21191992520,2cyclictest0-21swapper/008:52:470
21191992519,3cyclictest0-21swapper/009:52:390
21191992518,4cyclictest0-21swapper/009:17:470
21191992518,4cyclictest0-21swapper/009:17:470
21191992517,6cyclictest29092-21ls07:32:390
21191992517,6cyclictest29092-21ls07:32:390
225042240,3chrt0-21swapper/308:42:373
225042240,3chrt0-21swapper/308:42:373
225042240,3chrt0-21swapper/308:42:373
2119299244,11cyclictest29-21ksoftirqd/108:28:331
21192992418,5cyclictest18246-21ntp_offset11:22:421
21192992418,5cyclictest18246-21ntp_offset11:22:421
21192992418,5cyclictest18246-21ntp_offset11:22:421
21192992418,3cyclictest0-21swapper/108:27:251
21192992418,3cyclictest0-21swapper/108:27:251
21192992418,3cyclictest0-21swapper/108:27:251
21192992416,6cyclictest10817-21fschecks_time09:37:371
21192992415,2cyclictest181rcu_preempt09:53:231
21192992411,11cyclictest13260-21df_inode12:37:381
21192992411,11cyclictest13260-21df_inode12:37:381
21191992419,3cyclictest23657-21/usr/sbin/munin10:12:450
21191992419,3cyclictest0-21swapper/008:57:380
21191992418,5cyclictest23980-21sendmail_mailst11:37:450
21191992418,5cyclictest23980-21sendmail_mailst11:37:450
21191992418,3cyclictest0-21swapper/011:12:380
21191992418,3cyclictest0-21swapper/011:12:380
21191992417,5cyclictest26393-21sshd07:26:220
21191992416,6cyclictest8907-21processes10:57:460
21191992416,6cyclictest8907-21processes10:57:460
21192992319,2cyclictest0-21swapper/111:17:451
21192992319,2cyclictest0-21swapper/111:17:451
21192992318,3cyclictest0-21swapper/110:52:391
21192992318,3cyclictest0-21swapper/110:52:391
21192992316,2cyclictest181rcu_preempt08:12:421
21192992314,2cyclictest181rcu_preempt11:47:451
2119299231,13cyclictest20880-21runrttasks11:30:421
2119299231,13cyclictest20880-21runrttasks11:30:421
2119299231,13cyclictest20880-21runrttasks11:30:421
2119199238,12cyclictest14678-21systemd-journal08:52:250
2119199238,12cyclictest14678-21systemd-journal08:52:250
21191992318,3cyclictest0-21swapper/012:32:460
21191992318,3cyclictest0-21swapper/012:32:460
21191992318,3cyclictest0-21swapper/012:32:460
21191992318,3cyclictest0-21swapper/010:22:240
21191992318,3cyclictest0-21swapper/010:22:240
21191992318,3cyclictest0-21swapper/007:37:430
21191992318,3cyclictest0-21swapper/007:37:430
21191992317,3cyclictest0-21swapper/008:37:400
21191992317,3cyclictest0-21swapper/008:37:400
21191992316,5cyclictest28490-21latency_hist11:52:260
21191992316,5cyclictest28490-21latency_hist11:52:260
21191992316,5cyclictest28490-21latency_hist11:52:260
39502220,2sleep20-21swapper/209:17:452
39502220,2sleep20-21swapper/209:17:452
257982220,3sleep2351rcuc/211:42:452
257982220,3sleep2351rcuc/211:42:452
257982220,3sleep2351rcuc/211:42:452
21191992218,2cyclictest0-21swapper/009:57:380
21191992216,4cyclictest0-21swapper/009:22:460
21191992216,4cyclictest0-21swapper/009:22:460
21191992216,4cyclictest0-21swapper/008:12:360
21191992212,8cyclictest550-21cron07:52:240
21191992212,8cyclictest550-21cron07:52:240
21192992114,2cyclictest181rcu_preempt09:57:481
21191992116,3cyclictest0-21swapper/011:27:250
21191992116,3cyclictest0-21swapper/011:27:250
21191992116,3cyclictest0-21swapper/011:27:250
2119499201,13cyclictest11877-21chrt12:32:393
2119499201,13cyclictest11877-21chrt12:32:393
2119499201,13cyclictest11877-21chrt12:32:393
21191992015,3cyclictest0-21swapper/012:07:450
21191992015,3cyclictest0-21swapper/012:07:450
183432200,4sleep30-21swapper/309:57:383
2119399191,12cyclictest17267-21chrt08:27:402
2119499181,12cyclictest8446-21chrt12:22:463
2119499181,12cyclictest8446-21chrt12:22:463
2119499181,12cyclictest3343-21taskset10:42:443
2119499181,12cyclictest3343-21taskset10:42:443
2119399189,5cyclictest16315-21chrt08:24:232
2119399189,5cyclictest16315-21chrt08:24:232
2119399189,5cyclictest16315-21chrt08:24:232
2119399183,9cyclictest0-21swapper/212:09:232
2119399183,9cyclictest0-21swapper/212:09:232
2119399181,12cyclictest26269-21chrt10:17:432
2119399181,12cyclictest26269-21chrt10:17:432
145052180,3sleep20-21swapper/211:12:422
145052180,3sleep20-21swapper/211:12:422
2119499172,11cyclictest19840-21taskset11:27:393
2119499172,11cyclictest19840-21taskset11:27:393
2119499172,11cyclictest19840-21taskset11:27:393
2119499171,12cyclictest10303-21chrt11:02:383
2119499171,12cyclictest10303-21chrt11:02:383
2119499171,12cyclictest10303-21chrt11:02:383
2119499171,11cyclictest0-21swapper/308:12:393
2119399172,11cyclictest0-21swapper/210:02:462
2119399172,11cyclictest0-21swapper/210:02:462
2119399172,11cyclictest0-21swapper/210:02:462
2119399172,10cyclictest0-21swapper/210:42:372
2119399172,10cyclictest0-21swapper/210:42:372
2119399171,11cyclictest31330-21chrt11:57:442
2119399171,11cyclictest31330-21chrt11:57:442
2119399171,11cyclictest31330-21chrt11:57:442
2119399171,11cyclictest21392-21taskset08:37:452
2119399171,11cyclictest21392-21taskset08:37:452
2119399171,11cyclictest12549-21chrt12:32:462
2119399171,11cyclictest12549-21chrt12:32:462
2119399171,11cyclictest12549-21chrt12:32:462
2119399171,10cyclictest27917-21chrt08:57:312
2119399171,10cyclictest27917-21chrt08:57:312
2119399171,10cyclictest2103-21chrt12:07:372
2119399171,10cyclictest2103-21chrt12:07:372
2119399171,10cyclictest2103-21chrt12:07:372
2119399171,10cyclictest2103-21chrt12:07:372
2119499169,4cyclictest294472chrt11:52:433
2119499169,4cyclictest294472chrt11:52:433
2119499169,4cyclictest294472chrt11:52:433
2119499162,9cyclictest0-21swapper/309:19:233
2119499162,9cyclictest0-21swapper/309:19:233
2119499161,12cyclictest7163-21chrt10:52:453
2119499161,12cyclictest7163-21chrt10:52:453
2119499161,12cyclictest6513-21chrt10:52:373
2119499161,11cyclictest21931-21chrt10:07:353
2119499161,11cyclictest21931-21chrt10:07:353
2119499161,11cyclictest21931-21chrt10:07:353
2119499161,11cyclictest12705-21taskset09:42:393
2119499161,11cyclictest12705-21taskset09:42:393
2119499161,11cyclictest0-21swapper/312:27:393
2119499161,11cyclictest0-21swapper/312:27:393
2119499161,11cyclictest0-21swapper/312:27:393
2119499161,11cyclictest0-21swapper/309:02:393
2119499161,11cyclictest0-21swapper/309:02:393
2119499161,11cyclictest0-21swapper/309:02:393
2119499161,10cyclictest5748-21chrt12:17:353
2119499161,10cyclictest5748-21chrt12:17:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional