You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 06:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Apr 29, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
97221190,3sleep30-21swapper/319:47:303
97221190,3sleep30-21swapper/319:47:303
2093521160,3sleep10-21swapper/122:07:291
2093521160,3sleep10-21swapper/122:07:291
113452870,1sleep10-21swapper/100:37:111
140062760,2sleep30-21swapper/323:17:223
140062760,2sleep30-21swapper/323:17:223
19722750,4chrt1973-21cron00:12:111
19722750,4chrt1973-21cron00:12:111
19722750,4chrt1973-21cron00:12:111
127562640,2sleep30-21swapper/300:37:343
127562640,2sleep30-21swapper/300:37:343
240372590,3sleep20-21swapper/223:42:302
240372590,3sleep20-21swapper/223:42:302
175362590,2sleep30-21swapper/323:27:113
175362590,2sleep30-21swapper/323:27:113
175362590,2sleep30-21swapper/323:27:113
103502580,2chrt10353-21sort23:07:220
103502580,2chrt10353-21sort23:07:220
103502580,2chrt10353-21sort23:07:220
165962530,4chrt0-21swapper/123:22:261
165962530,4chrt0-21swapper/123:22:261
165962530,4chrt0-21swapper/123:22:261
78192490,2sleep2351rcuc/221:32:292
78192490,2sleep2351rcuc/221:32:292
19563994632,11cyclictest0-21swapper/000:02:170
19563994632,11cyclictest0-21swapper/000:02:170
238572420,2sleep023960-21memory23:42:280
238572420,2sleep023960-21memory23:42:280
19563994135,4cyclictest30450-21cat19:42:100
19563994135,4cyclictest30450-21cat19:42:100
19563993932,4cyclictest0-21swapper/000:02:310
19563993932,4cyclictest0-21swapper/000:02:310
46292380,2sleep04633-21tail21:22:340
46292380,2sleep04633-21tail21:22:340
104572380,3sleep00-21swapper/020:12:310
104572380,3sleep00-21swapper/020:12:310
1956599374,21cyclictest30720-21chrt00:02:152
1956599374,21cyclictest30720-21chrt00:02:152
19564993529,4cyclictest1648-21ntpd20:37:331
19564993529,4cyclictest1648-21ntpd20:37:331
19563993527,6cyclictest6921-21cron21:32:100
19563993527,6cyclictest6921-21cron21:32:100
169052350,3sleep20-21swapper/221:57:252
169052350,3sleep20-21swapper/221:57:252
19564993429,4cyclictest15571-21gltestperf20:27:251
19564993427,5cyclictest749-21runrttasks21:37:211
19564993427,5cyclictest749-21runrttasks21:37:211
19563993429,3cyclictest32111-21needreboot22:37:280
19563993429,3cyclictest32111-21needreboot22:37:280
19563993428,4cyclictest23744-21latency_hist22:17:100
19564993329,3cyclictest4148-21fschecks_time19:57:231
19564993329,3cyclictest4148-21fschecks_time19:57:231
19564993326,5cyclictest3513-21netstat22:47:281
19564993326,5cyclictest3513-21netstat22:47:281
19564993326,5cyclictest18885-21latency_hist20:37:171
19563993327,4cyclictest142-21systemd-journal22:32:110
19563993327,4cyclictest142-21systemd-journal22:32:110
19563993326,5cyclictest27451-21gltestperf23:52:240
19563993326,5cyclictest27451-21gltestperf23:52:240
194932330,3sleep20-21swapper/220:37:262
194932330,3sleep20-21swapper/220:37:262
1956699321,21cyclictest30746-21chrt00:02:163
1956699321,21cyclictest30746-21chrt00:02:163
19565993222,5cyclictest67822sleep220:02:322
19565993222,5cyclictest67822sleep220:02:322
19564993227,4cyclictest13243-21timerwakeupswit23:12:341
19563993226,4cyclictest545-21in:imuxsock21:37:120
19563993226,4cyclictest545-21in:imuxsock21:37:120
19563993217,3cyclictest700-21192.168.115.40-manager23:19:010
19563993217,3cyclictest700-21192.168.115.40-manager23:19:010
187462320,2sleep30-21swapper/322:02:253
187462320,2sleep30-21swapper/322:02:253
187462320,2sleep30-21swapper/322:02:253
100392320,3sleep20-21swapper/200:32:262
72412310,3sleep00-21swapper/022:57:290
72412310,3sleep00-21swapper/022:57:290
72412310,3sleep00-21swapper/022:57:290
56072310,2sleep05603-21cron20:02:100
56072310,2sleep05603-21cron20:02:100
19564993127,3cyclictest2480-21kworker/u9:1-xprtiod00:02:111
19564993127,3cyclictest2480-21kworker/u9:1-xprtiod00:02:111
19564993126,4cyclictest572-21cups-browsed23:52:311
19564993126,4cyclictest572-21cups-browsed23:52:311
19564993126,3cyclictest7011-21interrupts22:57:251
19564993126,3cyclictest7011-21interrupts22:57:251
19564993126,3cyclictest7011-21interrupts22:57:251
19564993125,4cyclictest1315-21latency_hist21:17:111
19564993125,4cyclictest1315-21latency_hist21:17:111
19564993124,5cyclictest12169-21netstat20:17:281
19564993124,5cyclictest12169-21netstat20:17:281
19563993126,4cyclictest25611-21idleruntime-cro22:22:100
19563993126,4cyclictest25611-21idleruntime-cro22:22:100
283682300,3sleep20-21swapper/222:27:282
283682300,3sleep20-21swapper/222:27:282
19564993024,5cyclictest2341-21sshd22:44:041
19564993024,5cyclictest2341-21sshd22:44:041
19564993024,5cyclictest2341-21sshd22:44:041
19564993024,4cyclictest32524-21latency_hist19:47:201
19564993024,4cyclictest29006-21fschecks_time19:37:251
19564993024,4cyclictest29006-21fschecks_time19:37:251
19564993023,5cyclictest23371-21needreboot20:47:291
19563993026,2cyclictest0-21swapper/020:22:110
19563993026,2cyclictest0-21swapper/020:22:110
19563993024,4cyclictest18064-21switchtime20:32:320
19563993024,4cyclictest10637-21gltestperf23:07:240
19563993024,4cyclictest10637-21gltestperf23:07:240
19563993024,4cyclictest10637-21gltestperf23:07:240
19563993024,4cyclictest0-21swapper/000:22:110
19563993024,4cyclictest0-21swapper/000:22:110
19563993024,4cyclictest0-21swapper/000:22:110
19563993023,5cyclictest28924-21missed_timers21:02:270
19563993023,5cyclictest28924-21missed_timers21:02:270
19563993023,5cyclictest19993-21sshd22:07:040
19563993023,5cyclictest19993-21sshd22:07:040
19563993023,5cyclictest19993-21sshd22:07:040
19563993022,6cyclictest22475-21latency_hist20:47:100
19563993022,6cyclictest22475-21latency_hist20:47:100
19563993022,6cyclictest20440-21fschecks_time22:07:240
19563993022,6cyclictest20440-21fschecks_time22:07:240
276222290,8sleep127627-21unixbench_multi20:57:351
276222290,8sleep127627-21unixbench_multi20:57:351
19564992924,4cyclictest572-21cups-browsed20:07:311
19564992924,4cyclictest572-21cups-browsed20:07:311
19564992924,4cyclictest19559-21cyclictest23:17:271
19564992924,4cyclictest19559-21cyclictest23:17:271
19563992924,4cyclictest11319-21cron00:37:100
19563992923,4cyclictest20608-21systemctl20:42:110
19563992923,4cyclictest20608-21systemctl20:42:110
19563992923,4cyclictest19793-21fschecks_count23:32:230
19563992923,4cyclictest19793-21fschecks_count23:32:230
19563992922,5cyclictest1975-21cron00:12:110
19563992922,5cyclictest1975-21cron00:12:110
19563992922,5cyclictest1975-21cron00:12:110
19563992922,5cyclictest18020-21fschecks_time23:27:250
19563992922,5cyclictest18020-21fschecks_time23:27:250
19563992920,7cyclictest12856-21ntp_kernel_pll_23:12:300
163732290,3sleep20-21swapper/223:22:232
163732290,3sleep20-21swapper/223:22:232
163732290,3sleep20-21swapper/223:22:232
70972280,3chrt0-21swapper/200:22:332
70972280,3chrt0-21swapper/200:22:332
45112280,4sleep14512-21/usr/sbin/munin00:17:261
45112280,4sleep14512-21/usr/sbin/munin00:17:261
45112280,4sleep14512-21/usr/sbin/munin00:17:261
197702280,3sleep10-21swapper/123:32:231
197702280,3sleep10-21swapper/123:32:231
19564992823,3cyclictest0-21swapper/122:42:111
19564992823,3cyclictest0-21swapper/122:42:111
19564992822,5cyclictest31167-21gltestperf00:02:251
19564992822,5cyclictest31167-21gltestperf00:02:251
19564992822,5cyclictest13253-21kernelversion21:47:251
19564992822,5cyclictest13253-21kernelversion21:47:251
19564992822,4cyclictest30969-21gltestperf19:42:241
19564992822,3cyclictest0-21swapper/122:02:101
19564992822,3cyclictest0-21swapper/122:02:101
19564992821,5cyclictest550-21cron23:47:241
19564992821,5cyclictest550-21cron23:47:241
19563992823,3cyclictest0-21swapper/019:22:110
19563992822,5cyclictest32640-21missed_timers21:12:290
19563992822,5cyclictest32640-21missed_timers21:12:290
19563992822,5cyclictest2806-21ntp_kernel_pll_19:52:300
19563992822,5cyclictest16240-21timerandwakeup20:27:340
19563992822,4cyclictest28079-21latency_hist21:02:100
19563992822,4cyclictest28079-21latency_hist21:02:100
19564992721,4cyclictest24683-21sshd23:43:041
19564992721,4cyclictest24683-21sshd23:43:041
19564992720,5cyclictest9730-21sshd23:03:041
19564992720,5cyclictest9730-21sshd23:03:041
19564992720,5cyclictest9730-21sshd23:03:041
19564992720,5cyclictest28070-21sed22:27:251
19564992720,5cyclictest28070-21sed22:27:251
19564992719,6cyclictest1-21systemd19:48:211
19564992719,6cyclictest1-21systemd19:48:211
19563992722,4cyclictest9378-21tail21:37:230
19563992722,4cyclictest9378-21tail21:37:230
19563992722,4cyclictest1287-21gltestperf22:42:260
19563992722,4cyclictest1287-21gltestperf22:42:260
19563992722,4cyclictest1287-21gltestperf22:42:260
19563992721,5cyclictest7898-21fschecks_count20:07:230
19563992721,5cyclictest7898-21fschecks_count20:07:230
19563992721,4cyclictest729-21dbus-daemon19:48:330
19563992721,4cyclictest729-21dbus-daemon19:48:330
19563992721,4cyclictest22632-21unixbench-2d23:37:340
19563992721,4cyclictest22632-21unixbench-2d23:37:340
19563992721,4cyclictest14965-21gltestperf21:52:250
19563992721,4cyclictest14965-21gltestperf21:52:250
19563992721,4cyclictest14965-21gltestperf21:52:250
19563992720,5cyclictest27946-21threads19:32:320
19563992720,5cyclictest27946-21threads19:32:320
19563992720,4cyclictest0-21swapper/021:22:100
19563992720,4cyclictest0-21swapper/021:22:100
19563992720,4cyclictest0-21swapper/021:22:100
19563992719,6cyclictest16696-21processes23:22:290
19563992719,6cyclictest16696-21processes23:22:290
19563992719,6cyclictest16696-21processes23:22:290
19564992621,3cyclictest31048-21systemctl21:07:331
19564992621,3cyclictest31048-21systemctl21:07:331
19564992620,5cyclictest9841-21fschecks_time20:12:241
19564992620,5cyclictest9841-21fschecks_time20:12:241
19564992620,4cyclictest3114-21systemctl00:12:331
19564992620,4cyclictest3114-21systemctl00:12:331
19564992620,4cyclictest19559-21cyclictest00:27:321
19564992620,4cyclictest19559-21cyclictest00:27:321
19564992620,4cyclictest19559-21cyclictest00:27:321
19564992619,5cyclictest6351-21kernelversion20:02:251
19564992619,5cyclictest6351-21kernelversion20:02:251
19564992619,5cyclictest11914-21idleruntime00:37:241
19564992619,5cyclictest11914-21idleruntime00:37:241
19563992622,3cyclictest26852-21sshd23:52:030
19563992622,3cyclictest26852-21sshd23:52:030
19563992621,4cyclictest6371-21latency_hist22:57:120
19563992621,4cyclictest6371-21latency_hist22:57:120
19563992621,4cyclictest13469-21ntp_kernel_err21:47:280
19563992621,4cyclictest13469-21ntp_kernel_err21:47:280
19563992621,3cyclictest31486-21proc_pri19:42:310
19563992621,3cyclictest31486-21proc_pri19:42:310
19563992620,5cyclictest30427-21rt-features22:32:330
19563992620,5cyclictest30427-21rt-features22:32:330
19563992620,4cyclictest0-21swapper/020:22:260
19563992620,4cyclictest0-21swapper/020:22:260
19563992620,4cyclictest0-21swapper/000:27:110
19563992620,4cyclictest0-21swapper/000:27:110
19563992619,5cyclictest550-21cron00:37:190
19563992619,5cyclictest550-21cron00:37:190
19563992619,2cyclictest238572sed19:22:260
19563992619,2cyclictest238572sed19:22:260
19563992619,2cyclictest238572sed19:22:260
156652260,2sleep30-21swapper/320:27:263
19564992521,2cyclictest0-21swapper/120:42:341
19564992521,2cyclictest0-21swapper/120:42:341
19564992520,4cyclictest6447-21kernelversion00:22:261
19564992520,4cyclictest6447-21kernelversion00:22:261
19564992520,4cyclictest12539-21latency_hist21:47:101
19564992520,4cyclictest12539-21latency_hist21:47:101
19564992520,4cyclictest12539-21latency_hist21:47:101
19564992520,3cyclictest0-21swapper/123:27:251
19564992520,3cyclictest0-21swapper/123:27:251
19564992519,5cyclictest3060-21switchtime19:52:331
19564992518,5cyclictest24790-21cut20:52:231
19564992518,5cyclictest24790-21cut20:52:231
19564992518,5cyclictest15920-21sshd21:52:551
19564992518,5cyclictest15920-21sshd21:52:551
19564992518,5cyclictest15920-21sshd21:52:551
19563992520,3cyclictest24893-21gltestperf20:52:240
19563992520,3cyclictest24893-21gltestperf20:52:240
19563992519,4cyclictest0-21swapper/000:12:330
19563992519,4cyclictest0-21swapper/000:12:330
1956599241,14cyclictest4717-21chrt19:57:302
1956599241,14cyclictest4717-21chrt19:57:302
19564992420,2cyclictest0-21swapper/122:12:331
19564992420,2cyclictest0-21swapper/119:32:311
19564992420,2cyclictest0-21swapper/119:32:311
19564992419,3cyclictest0-21swapper/122:18:301
19564992419,3cyclictest0-21swapper/122:18:301
19564992419,3cyclictest0-21swapper/121:27:111
19564992419,3cyclictest0-21swapper/121:27:111
1956499241,7cyclictest183612/usr/sbin/munin22:02:301
1956499241,7cyclictest183612/usr/sbin/munin22:02:301
1956499241,7cyclictest183612/usr/sbin/munin22:02:301
19564992417,4cyclictest0-21swapper/119:27:271
19564992417,4cyclictest0-21swapper/119:27:271
19564992416,6cyclictest0-21swapper/121:32:291
19564992416,6cyclictest0-21swapper/121:32:291
19563992420,3cyclictest6652-21wc20:02:310
19563992420,3cyclictest6652-21wc20:02:310
19563992419,3cyclictest0-21swapper/019:27:240
19563992419,3cyclictest0-21swapper/019:27:240
19563992418,5cyclictest17206-21ntp_kernel_pll_21:57:290
19563992418,5cyclictest17206-21ntp_kernel_pll_21:57:290
19563992418,4cyclictest11263-21gltestperf21:42:250
19563992418,4cyclictest11263-21gltestperf21:42:250
19563992418,4cyclictest11263-21gltestperf21:42:250
19563992417,5cyclictest0-21swapper/020:47:240
19564992318,3cyclictest26998-21unixbench-2d22:22:341
19564992318,3cyclictest26998-21unixbench-2d22:22:341
19564992317,4cyclictest31258-21latency_hist22:37:121
19564992317,4cyclictest31258-21latency_hist22:37:121
19564992317,3cyclictest0-21swapper/120:27:141
19564992317,3cyclictest0-21swapper/120:27:141
19563992317,4cyclictest0-21swapper/022:52:230
19563992317,4cyclictest0-21swapper/022:22:230
19563992317,4cyclictest0-21swapper/022:22:230
19564992218,2cyclictest0-21swapper/123:07:241
19564992218,2cyclictest0-21swapper/123:07:241
19564992218,2cyclictest0-21swapper/123:07:241
19564992218,2cyclictest0-21swapper/121:27:331
19564992218,2cyclictest0-21swapper/121:27:331
19564992217,3cyclictest0-21swapper/123:37:321
19564992217,3cyclictest0-21swapper/123:37:321
19564992217,3cyclictest0-21swapper/122:52:251
19564992217,3cyclictest0-21swapper/122:52:251
19564992214,6cyclictest1527-21/usr/sbin/munin21:17:311
19564992214,6cyclictest1527-21/usr/sbin/munin21:17:311
19564992214,6cyclictest1527-21/usr/sbin/munin21:17:311
19563992217,3cyclictest0-21swapper/000:27:240
19563992217,3cyclictest0-21swapper/000:27:240
19563992217,3cyclictest0-21swapper/000:27:240
19563992216,4cyclictest0-21swapper/021:07:320
19563992216,4cyclictest0-21swapper/021:07:320
19563992210,10cyclictest3355-21sed22:47:260
158872220,3sleep20-21swapper/220:27:292
19564992116,3cyclictest22995-21latency_hist19:22:111
88862200,3sleep20-21swapper/223:02:252
88862200,3sleep20-21swapper/223:02:252
88862200,3sleep20-21swapper/223:02:252
19564992015,2cyclictest0-21swapper/121:07:111
19564992015,2cyclictest0-21swapper/121:07:111
24602190,3sleep20-21swapper/221:17:332
24602190,3sleep20-21swapper/221:17:332
24602190,3sleep20-21swapper/221:17:332
1956599193,9cyclictest0-21swapper/221:02:012
1956599193,9cyclictest0-21swapper/221:02:012
1956599193,9cyclictest0-21swapper/219:55:012
1956599191,12cyclictest25299-21taskset20:52:292
1956599191,12cyclictest25299-21taskset20:52:292
19564991911,6cyclictest24860-21latency_hist19:27:101
19564991911,6cyclictest24860-21latency_hist19:27:101
19564991911,6cyclictest24860-21latency_hist19:27:101
174302190,3sleep30-21swapper/320:32:243
19566991810,6cyclictest31422-21chrt00:02:283
19566991810,6cyclictest31422-21chrt00:02:283
1956599184,8cyclictest0-21swapper/200:02:222
1956599184,8cyclictest0-21swapper/200:02:222
1956599181,12cyclictest10558-21chrt23:07:242
1956599181,12cyclictest10558-21chrt23:07:242
1956599181,12cyclictest10558-21chrt23:07:242
13472180,3chrt0-21swapper/200:07:342
13472180,3chrt0-21swapper/200:07:342
13472180,3chrt0-21swapper/200:07:342
1956699171,10cyclictest24368-21chrt23:42:343
1956699171,10cyclictest24368-21chrt23:42:343
1956599172,11cyclictest13387-21chrt00:42:192
1956599172,11cyclictest13387-21chrt00:42:192
1956599171,12cyclictest15104-21taskset21:52:272
1956599171,12cyclictest15104-21taskset21:52:272
1956599171,12cyclictest15104-21taskset21:52:272
1956599171,11cyclictest4038-21chrt00:17:192
1956599171,11cyclictest4038-21chrt00:17:192
1956599171,11cyclictest23959-21chrt20:47:352
1956599171,11cyclictest21843-21chrt19:17:262
1956699161,12cyclictest3387-21chrt19:53:003
1956699161,10cyclictest4557-21chrt19:57:273
1956699161,10cyclictest4557-21chrt19:57:273
1956599168,5cyclictest289102sleep219:37:252
1956599168,5cyclictest289102sleep219:37:252
1956599162,11cyclictest0-21swapper/220:22:142
1956599162,11cyclictest0-21swapper/220:22:142
1956599161,11cyclictest6491-21taskset21:27:342
1956599161,11cyclictest6491-21taskset21:27:342
1956599161,11cyclictest25828-21taskset19:27:312
1956599161,11cyclictest25828-21taskset19:27:312
1956599161,11cyclictest24061-21chrt22:17:232
1956599161,11cyclictest24061-21chrt22:17:232
1956599161,11cyclictest12577-21taskset21:47:122
1956599161,11cyclictest12577-21taskset21:47:122
1956599161,11cyclictest12577-21taskset21:47:122
1956599161,10cyclictest624-21chrt19:47:252
1956599161,10cyclictest624-21chrt19:47:252
1956599161,10cyclictest32508-21chrt21:12:272
1956599161,10cyclictest32508-21chrt21:12:272
1956599160,12cyclictest31217-21taskset19:42:262
1956599160,12cyclictest31217-21taskset19:42:262
1956699158,4cyclictest0-21swapper/322:17:323
1956699158,4cyclictest0-21swapper/322:17:323
1956699153,8cyclictest128192chrt21:47:213
1956699153,8cyclictest128192chrt21:47:213
1956699153,8cyclictest128192chrt21:47:213
1956699151,9cyclictest11393-21taskset20:17:173
1956699151,9cyclictest11393-21taskset20:17:173
1956699151,12cyclictest27049-21chrt19:32:223
1956699151,12cyclictest27049-21chrt19:32:223
1956699151,11cyclictest3463-21chrt22:47:273
1956699151,11cyclictest3463-21chrt22:47:273
1956699151,10cyclictest5452-21chrt22:52:333
1956699151,10cyclictest5452-21chrt22:52:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional