You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 04:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Jul 17, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
256842920,3sleep20-21swapper/220:38:412
256842920,3sleep20-21swapper/220:38:412
169042720,3sleep016909-21unixbench_singl20:13:460
169042720,3sleep016909-21unixbench_singl20:13:460
112212720,3sleep20-21swapper/219:58:452
112212720,3sleep20-21swapper/219:58:452
112212720,3sleep20-21swapper/219:58:452
15462710,11sleep016-21ksoftirqd/019:33:430
15462710,11sleep016-21ksoftirqd/019:33:430
232662690,3sleep30-21swapper/320:33:353
232662690,3sleep30-21swapper/320:33:353
15442690,3sleep30-21swapper/323:53:433
15442690,3sleep30-21swapper/323:53:433
184872680,3sleep00-21swapper/000:38:430
184872680,3sleep00-21swapper/000:38:430
127782650,4sleep30-21swapper/320:03:443
127782650,4sleep30-21swapper/320:03:443
40542640,4sleep30-21swapper/322:33:433
40542640,4sleep30-21swapper/322:33:433
40542640,4sleep30-21swapper/322:33:433
178212640,1sleep00-21swapper/000:38:340
178212640,1sleep00-21swapper/000:38:340
205452620,2chrt0-21swapper/323:18:373
205452620,2chrt0-21swapper/323:18:373
211002610,3sleep20-21swapper/220:28:242
211002610,3sleep20-21swapper/220:28:242
139252610,3sleep30-21swapper/320:08:353
139252610,3sleep30-21swapper/320:08:353
89322600,3chrt0-21swapper/219:53:432
89322600,3chrt0-21swapper/219:53:432
271112580,2chrt27112-21/usr/sbin/munin22:08:440
271112580,2chrt27112-21/usr/sbin/munin22:08:440
26006995853,3cyclictest0-21swapper/000:03:270
26006995853,3cyclictest0-21swapper/000:03:270
120392580,4sleep30-21swapper/322:53:493
120392580,4sleep30-21swapper/322:53:493
120392580,4sleep30-21swapper/322:53:493
116582570,1sleep00-21swapper/022:53:460
116582570,1sleep00-21swapper/022:53:460
116582570,1sleep00-21swapper/022:53:460
145262550,1sleep00-21swapper/023:03:350
145262550,1sleep00-21swapper/023:03:350
145262550,1sleep00-21swapper/023:03:350
24242540,3chrt0-21swapper/319:38:283
24242540,3chrt0-21swapper/319:38:283
214572540,2chrt0-21swapper/220:28:362
214572540,2chrt0-21swapper/220:28:362
323472530,2chrt0-21swapper/222:23:372
323472530,2chrt0-21swapper/222:23:372
275392530,2sleep30-21swapper/322:08:473
275392530,2sleep30-21swapper/322:08:473
20542520,2sleep30-21swapper/322:28:413
20542520,2sleep30-21swapper/322:28:413
20542520,2sleep30-21swapper/322:28:413
241962510,2sleep20-21swapper/223:28:372
241962510,2sleep20-21swapper/223:28:372
58682490,3sleep30-21swapper/300:03:573
58682490,3sleep30-21swapper/300:03:573
247212480,3chrt0-21swapper/322:03:363
247212480,3chrt0-21swapper/322:03:363
108632480,3chrt0-21swapper/222:53:362
108632480,3chrt0-21swapper/222:53:362
316102440,3chrt0-21swapper/220:53:442
154832430,2sleep0171ktimers/021:38:370
154832430,2sleep0171ktimers/021:38:370
154832430,2sleep0171ktimers/021:38:370
94022420,3sleep00-21swapper/022:48:390
94022420,3sleep00-21swapper/022:48:390
94022420,3sleep00-21swapper/022:48:390
311992400,1sleep2351rcuc/222:18:472
311992400,1sleep2351rcuc/222:18:472
311992400,1sleep2351rcuc/222:18:472
26006994031,7cyclictest550-21cron21:03:220
26006994031,7cyclictest550-21cron21:03:220
251232400,2sleep025251-21grep20:38:360
251232400,2sleep025251-21grep20:38:360
236772400,3sleep30-21swapper/323:28:223
236772400,3sleep30-21swapper/323:28:223
26006993929,7cyclictest700-21192.168.115.40-manager23:21:070
26006993929,7cyclictest700-21192.168.115.40-manager23:21:070
26006993929,7cyclictest0-21swapper/000:03:380
26006993929,7cyclictest0-21swapper/000:03:380
2601199381,21cyclictest4415-21chrt00:03:272
2601199381,21cyclictest4415-21chrt00:03:272
136362380,4sleep113655-21latency_hist20:08:261
136362380,4sleep113655-21latency_hist20:08:261
26006993729,6cyclictest7930-21cron19:53:230
26006993729,6cyclictest7930-21cron19:53:230
209832370,2sleep20-21swapper/223:18:442
209832370,2sleep20-21swapper/223:18:442
26006993630,4cyclictest10534-21kernelversion19:58:370
26006993630,4cyclictest10534-21kernelversion19:58:370
26006993630,4cyclictest10534-21kernelversion19:58:370
26006993627,7cyclictest4162-21latency_hist19:43:220
305812350,3sleep20-21swapper/219:23:442
305812350,3sleep20-21swapper/219:23:442
26010993527,6cyclictest7743-21fschecks_count21:18:371
26010993527,6cyclictest7743-21fschecks_count21:18:371
26010993527,6cyclictest7743-21fschecks_count21:18:371
26006993527,6cyclictest14290-21gltestperf00:28:360
164932350,3sleep20-21swapper/223:08:352
164932350,3sleep20-21swapper/223:08:352
164932350,3sleep20-21swapper/223:08:352
26010993427,5cyclictest22303-21gltestperf23:23:351
26010993427,5cyclictest22303-21gltestperf23:23:351
2600699348,4cyclictest0-21swapper/022:33:590
2600699348,4cyclictest0-21swapper/022:33:590
2600699348,4cyclictest0-21swapper/022:33:590
26010993325,6cyclictest18410-21needreboot00:38:411
26010993325,6cyclictest18410-21needreboot00:38:411
26010993324,7cyclictest2706-21fschecks_count19:38:341
177842330,1sleep017949-21if_err_eth020:18:380
177842330,1sleep017949-21if_err_eth020:18:380
26010993226,5cyclictest31783-21unixbench-2d20:53:451
26010993226,4cyclictest15338-21fschecks_time21:38:361
26010993226,4cyclictest15338-21fschecks_time21:38:361
26010993226,4cyclictest15338-21fschecks_time21:38:361
26006993226,5cyclictest10691-21kernelversion00:18:380
26006993226,5cyclictest10691-21kernelversion00:18:380
26006993220,8cyclictest0-21swapper/021:08:340
26006993220,8cyclictest0-21swapper/021:08:340
26010993126,4cyclictest10373-21kworker/u9:3-xprtiod00:03:331
26010993126,4cyclictest10373-21kworker/u9:3-xprtiod00:03:331
26010993125,4cyclictest7314-21timerandwakeup19:48:471
26010993125,4cyclictest7314-21timerandwakeup19:48:471
26010993125,4cyclictest0-21swapper/123:02:061
26010993125,4cyclictest0-21swapper/123:02:061
26010993125,4cyclictest0-21swapper/123:02:061
26006993124,5cyclictest28344-21sshd20:45:520
26006993124,5cyclictest15572-21cat20:13:270
26006993124,5cyclictest15572-21cat20:13:270
26006993123,5cyclictest0-21swapper/020:28:450
26006993123,5cyclictest0-21swapper/020:28:450
2601299301,20cyclictest4425-21taskset00:03:283
2601299301,20cyclictest4425-21taskset00:03:283
26010993024,5cyclictest28662-21timerandwakeup23:38:451
26010993024,5cyclictest28662-21timerandwakeup23:38:451
26010993023,6cyclictest749-21runrttasks21:13:241
26010993023,6cyclictest749-21runrttasks21:13:241
26010993023,5cyclictest26002-21cyclictest19:58:021
26010993023,5cyclictest26002-21cyclictest19:58:021
26010993023,5cyclictest20699-21/usr/sbin/munin21:53:341
26010993021,7cyclictest12410-21latency_hist22:58:341
26010993021,7cyclictest12410-21latency_hist22:58:341
26010993021,7cyclictest12410-21latency_hist22:58:341
2600699304,8cyclictest0-21swapper/022:07:540
2600699304,8cyclictest0-21swapper/022:07:540
2600699303,13cyclictest5140-21chrt21:09:260
2600699303,13cyclictest5140-21chrt21:09:260
2600699303,11cyclictest3277-21cpuspeed22:33:330
2600699303,11cyclictest3277-21cpuspeed22:33:330
2600699303,11cyclictest3277-21cpuspeed22:33:330
26006993023,5cyclictest16182-21latency_hist23:08:270
26006993023,5cyclictest16182-21latency_hist23:08:270
26006993023,5cyclictest16182-21latency_hist23:08:270
26006993023,5cyclictest1346-21avahi-daemon23:43:460
26006993023,5cyclictest1346-21avahi-daemon23:43:460
26006993023,5cyclictest1346-21avahi-daemon23:43:460
157392300,2sleep30-21swapper/300:33:313
157392300,2sleep30-21swapper/300:33:313
63962290,3sleep20-21swapper/219:48:362
63962290,3sleep20-21swapper/219:48:362
2601299296,19cyclictest281912chrt20:43:523
26010992924,4cyclictest545-21in:imuxsock20:43:221
26010992924,4cyclictest545-21in:imuxsock20:43:221
26010992923,4cyclictest18109-21latency_hist23:13:261
26010992923,4cyclictest18109-21latency_hist23:13:261
26010992923,4cyclictest18109-21latency_hist23:13:261
26010992923,3cyclictest0-21swapper/122:53:371
26010992923,3cyclictest0-21swapper/122:53:371
26010992922,5cyclictest1422-21sshd20:59:511
26010992922,5cyclictest1422-21sshd20:59:511
26010992920,7cyclictest18414-21mailstats20:18:451
26010992920,7cyclictest18414-21mailstats20:18:451
2600699299,9cyclictest32249-21taskset20:58:120
2600699297,13cyclictest13621-21taskset00:27:090
2600699297,13cyclictest13621-21taskset00:27:090
2600699296,8cyclictest0-21swapper/022:20:280
2600699296,8cyclictest0-21swapper/022:20:280
2600699296,8cyclictest0-21swapper/022:20:280
2600699296,15cyclictest2331-21chrt23:57:010
2600699296,15cyclictest2331-21chrt23:57:010
2600699294,11cyclictest30951-21taskset19:27:520
2600699294,11cyclictest30951-21taskset19:27:520
2600699294,11cyclictest19426-21chrt20:23:310
2600699294,11cyclictest19426-21chrt20:23:310
2600699293,13cyclictest12660-21chrt21:29:080
2600699293,13cyclictest12660-21chrt21:29:080
26006992924,3cyclictest0-21swapper/021:58:350
26006992924,3cyclictest0-21swapper/021:58:350
26006992923,5cyclictest24106-21switchtime20:33:450
26006992923,5cyclictest24106-21switchtime20:33:450
197302290,2sleep119857-21sed21:48:481
197302290,2sleep119857-21sed21:48:481
26010992822,3cyclictest0-21swapper/122:53:231
26010992821,5cyclictest26002-21cyclictest20:29:361
26010992821,5cyclictest26002-21cyclictest20:29:361
26010992819,7cyclictest24233-21timerwakeupswit20:33:461
26010992819,7cyclictest24233-21timerwakeupswit20:33:461
2601099281,5cyclictest28301-21df_inode22:13:351
2600699288,2cyclictest0-21swapper/021:20:270
2600699288,2cyclictest0-21swapper/021:20:270
2600699288,2cyclictest0-21swapper/021:20:270
2600699287,3cyclictest0-21swapper/023:16:570
2600699287,3cyclictest0-21swapper/023:16:570
2600699285,11cyclictest22894-21sendmail_mailst23:23:420
2600699285,11cyclictest22894-21sendmail_mailst23:23:420
26006992822,5cyclictest6573-21sshd22:40:520
26006992822,5cyclictest6573-21sshd22:40:520
26006992821,5cyclictest32285-21gltestperf22:23:370
26006992821,5cyclictest32285-21gltestperf22:23:370
26006992820,6cyclictest8642-21kernelversion19:53:380
26006992820,6cyclictest8642-21kernelversion19:53:380
26006992819,6cyclictest700-21192.168.115.40-manager22:15:350
26006992819,6cyclictest700-21192.168.115.40-manager22:15:350
56412270,4sleep20-21swapper/219:43:462
56412270,4sleep20-21swapper/219:43:462
47172270,3sleep30-21swapper/321:08:453
47172270,3sleep30-21swapper/321:08:453
300272270,3sleep20-21swapper/222:18:342
300272270,3sleep20-21swapper/222:18:342
2601299272,21cyclictest0-21swapper/300:23:343
2601299272,21cyclictest0-21swapper/300:23:343
2601299271,7cyclictest8869-21taskset21:19:023
2601299271,7cyclictest8869-21taskset21:19:023
2601299271,7cyclictest8869-21taskset21:19:023
2601299271,7cyclictest32084-21taskset20:56:033
26010992723,3cyclictest21456-21ntp_offset21:53:421
26010992723,3cyclictest21456-21ntp_offset21:53:421
26010992722,4cyclictest26002-21cyclictest00:04:231
26010992722,4cyclictest26002-21cyclictest00:04:231
26010992722,4cyclictest16490-21needreboot00:33:401
26010992722,4cyclictest16490-21needreboot00:33:401
26010992722,3cyclictest976-21kworker/u9:2-xprtiod22:43:231
26010992722,3cyclictest976-21kworker/u9:2-xprtiod22:43:231
26010992721,4cyclictest12451-21gltestperf00:23:371
26010992721,4cyclictest12451-21gltestperf00:23:371
26010992721,4cyclictest12451-21gltestperf00:23:371
2600699276,2cyclictest0-21swapper/021:52:350
2600699276,2cyclictest0-21swapper/021:52:350
2600699276,2cyclictest0-21swapper/021:52:350
2600699275,10cyclictest27373-21runrttasks23:38:120
2600699275,10cyclictest27373-21runrttasks23:38:120
2600699272,11cyclictest25183-21taskset23:29:040
2600699272,11cyclictest25183-21taskset23:29:040
26006992720,5cyclictest30126-21sshd20:49:510
26006992720,5cyclictest30126-21sshd20:49:510
26006992720,5cyclictest16202-21idleruntime00:33:360
26006992720,5cyclictest13565-21latency_hist20:08:230
26006992720,5cyclictest13565-21latency_hist20:08:230
26006992720,5cyclictest0-21swapper/022:48:230
26006992720,5cyclictest0-21swapper/022:48:230
26006992713,12cyclictest0-21swapper/022:01:350
26006992713,12cyclictest0-21swapper/022:01:350
26006992713,12cyclictest0-21swapper/022:01:350
130602270,3chrt0-21swapper/200:23:452
130602270,3chrt0-21swapper/200:23:452
130602270,3chrt0-21swapper/200:23:452
2601299261,9cyclictest12904-21chrt21:32:173
2601299261,9cyclictest12904-21chrt21:32:173
2601299261,8cyclictest8371-21chrt22:44:443
2601299261,8cyclictest8371-21chrt22:44:443
2601299261,8cyclictest1704-21chrt21:03:223
2601299261,8cyclictest1704-21chrt21:03:223
2601299261,8cyclictest11289-21chrt21:28:313
2601299261,8cyclictest11289-21chrt21:28:313
2601299261,6cyclictest6488-21chrt22:39:463
2601299261,6cyclictest6488-21chrt22:39:463
2601299261,5cyclictest759-21chrt23:53:313
2601299261,5cyclictest759-21chrt23:53:313
2601299261,5cyclictest32615-21chrt19:30:203
2601299261,5cyclictest32615-21chrt19:30:203
2601299261,5cyclictest32615-21chrt19:30:203
2601299261,5cyclictest29763-21chrt22:17:353
2601299261,5cyclictest29763-21chrt22:17:353
2601299261,5cyclictest25211-21chrt23:29:273
2601299261,5cyclictest25211-21chrt23:29:273
2601299261,5cyclictest13691-21chrt00:27:443
2601299261,5cyclictest13691-21chrt00:27:443
2601299261,5cyclictest13691-21chrt00:27:443
2601299261,3cyclictest0-21swapper/320:03:243
2601299261,3cyclictest0-21swapper/320:03:243
2601299261,3cyclictest0-21swapper/320:03:243
26010992621,4cyclictest26002-21cyclictest22:28:371
26010992621,4cyclictest26002-21cyclictest22:28:371
26010992621,4cyclictest26002-21cyclictest22:28:371
26010992621,3cyclictest0-21swapper/122:03:221
26010992621,3cyclictest0-21swapper/122:03:221
26010992621,3cyclictest0-21swapper/122:03:221
26010992621,3cyclictest0-21swapper/121:48:231
26010992621,3cyclictest0-21swapper/121:48:231
26010992620,4cyclictest26002-21cyclictest00:13:341
26010992619,5cyclictest31853-21kernelversion23:48:381
26010992619,5cyclictest31853-21kernelversion23:48:381
2600699263,10cyclictest18335-21taskset21:44:390
2600699263,10cyclictest18335-21taskset21:44:390
26006992621,3cyclictest26002-21cyclictest19:33:180
26006992621,3cyclictest26002-21cyclictest19:33:180
26006992621,3cyclictest26002-21cyclictest19:33:180
2600699262,11cyclictest358-21runrttasks23:51:110
2600699262,11cyclictest358-21runrttasks23:51:110
26006992620,3cyclictest700-21192.168.115.40-manager00:29:390
26006992620,3cyclictest700-21192.168.115.40-manager00:09:390
26006992620,3cyclictest700-21192.168.115.40-manager00:09:390
26006992619,5cyclictest13974-21ntp_kernel_err21:33:560
26006992619,5cyclictest13974-21ntp_kernel_err21:33:560
26006992619,5cyclictest0-21swapper/023:43:370
26006992615,9cyclictest700-21192.168.115.40-manager21:26:340
26006992615,9cyclictest700-21192.168.115.40-manager21:26:340
176512260,2sleep30-21swapper/320:18:363
176512260,2sleep30-21swapper/320:18:363
2601299252,4cyclictest0-21swapper/322:58:463
2601299252,4cyclictest0-21swapper/322:58:463
2601299252,4cyclictest0-21swapper/322:58:463
2601299251,9cyclictest1199-21chrt22:28:243
2601299251,9cyclictest1199-21chrt22:28:243
2601299251,8cyclictest27137-21chrt23:35:103
2601299251,8cyclictest27137-21chrt23:35:103
2601299251,8cyclictest19034-21chrt00:38:573
2601299251,8cyclictest19034-21chrt00:38:573
2601299251,8cyclictest17264-21taskset23:08:443
2601299251,8cyclictest17264-21taskset23:08:443
2601299251,8cyclictest17264-21taskset23:08:443
2601299251,7cyclictest14644-21chrt21:35:223
2601299251,7cyclictest14644-21chrt21:35:223
2601299251,6cyclictest20784-21chrt20:24:473
2601299251,6cyclictest20784-21chrt20:24:473
2601299251,5cyclictest30818-21chrt23:44:183
2601299251,5cyclictest30818-21chrt23:44:183
2601299251,5cyclictest30818-21chrt23:44:183
2601299251,5cyclictest15945-21chrt23:05:233
2601299251,5cyclictest15945-21chrt23:05:233
2601299251,5cyclictest15945-21chrt23:05:233
2601299251,5cyclictest0-21swapper/321:58:263
2601299251,5cyclictest0-21swapper/321:58:263
2601299251,4cyclictest96812sleep319:56:413
2601299251,4cyclictest96812sleep319:56:413
2601299251,4cyclictest80652sleep300:13:173
2601299251,4cyclictest80652sleep300:13:173
2601299251,4cyclictest0-21swapper/321:08:283
2601299251,4cyclictest0-21swapper/321:08:283
2601299250,4cyclictest97332sleep300:15:263
2601299250,4cyclictest97332sleep300:15:263
2601199255,9cyclictest0-21swapper/200:03:352
2601199255,9cyclictest0-21swapper/200:03:352
26010992521,3cyclictest5085-21/usr/sbin/munin22:38:351
26010992520,3cyclictest0-21swapper/121:28:441
26010992520,3cyclictest0-21swapper/121:28:441
26010992520,3cyclictest0-21swapper/120:08:361
26010992520,3cyclictest0-21swapper/120:08:361
26010992519,4cyclictest24216-21gltestperf23:28:371
26010992519,4cyclictest24216-21gltestperf23:28:371
26010992518,5cyclictest11379-21unixbench_multi00:18:461
26010992518,5cyclictest11379-21unixbench_multi00:18:461
26010992517,6cyclictest32271-21sort19:28:441
26010992517,6cyclictest32271-21sort19:28:441
26010992517,6cyclictest32271-21sort19:28:441
26010992517,6cyclictest1529-21ntp_offset23:53:421
26010992517,6cyclictest1529-21ntp_offset23:53:421
26010992517,6cyclictest1-21systemd21:27:521
26010992517,6cyclictest1-21systemd21:27:521
26006992521,2cyclictest0-21swapper/000:18:220
26006992521,2cyclictest0-21swapper/000:18:220
26006992520,3cyclictest0-21swapper/019:43:450
26006992520,3cyclictest0-21swapper/019:43:450
26006992519,4cyclictest17565-21unixbench-2d23:08:470
26006992519,4cyclictest17565-21unixbench-2d23:08:470
26006992519,4cyclictest17565-21unixbench-2d23:08:470
26006992518,5cyclictest28518-21sendmail_mailtr23:38:440
164822250,2sleep1281ktimers/120:13:431
164822250,2sleep1281ktimers/120:13:431
109972250,3sleep30-21swapper/322:53:373
109972250,3sleep30-21swapper/322:53:373
301682240,2sleep20-21swapper/223:43:412
301682240,2sleep20-21swapper/223:43:412
301682240,2sleep20-21swapper/223:43:412
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional