You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 10:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Wed Jan 07, 2026 00:44:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1227521060,2chrt12274-21perl21:45:361
1227521060,2chrt12274-21perl21:45:361
291752990,1sleep00-21swapper/019:35:450
291752990,1sleep00-21swapper/019:35:450
79912960,4sleep30-21swapper/320:05:473
79912960,4sleep30-21swapper/320:05:473
303672780,4chrt0-21swapper/200:00:362
303672780,4chrt0-21swapper/200:00:362
81722700,2chrt8171-21if_wlan023:00:400
77512680,2chrt7750-21grep20:05:440
77512680,2chrt7750-21grep20:05:440
258302640,3chrt0-21swapper/322:20:433
258302640,3chrt0-21swapper/322:20:433
258302640,3chrt0-21swapper/322:20:433
85882620,3sleep00-21swapper/021:35:380
85882620,3sleep00-21swapper/021:35:380
85882620,3sleep00-21swapper/021:35:380
13892620,3chrt1391-21grep22:40:460
13892620,3chrt1391-21grep22:40:460
291482600,2chrt29149-21tail22:30:381
291482600,2chrt29149-21tail22:30:381
93052580,3sleep20-21swapper/200:30:402
93052580,3sleep20-21swapper/200:30:402
18825995644,9cyclictest30080-21/usr/sbin/munin00:00:370
18825995644,9cyclictest30080-21/usr/sbin/munin00:00:370
237612550,3sleep20-21swapper/222:15:402
237612550,3sleep20-21swapper/222:15:402
208622530,2chrt0-21swapper/219:15:372
64522490,1sleep05195-21/usr/sbin/munin00:20:490
64522490,1sleep05195-21/usr/sbin/munin00:20:490
64522490,1sleep05195-21/usr/sbin/munin00:20:490
1882599492,26cyclictest30634-21/usr/sbin/munin00:00:390
294162480,2sleep20-21swapper/221:05:322
294162480,2sleep20-21swapper/221:05:322
116382470,1sleep00-21swapper/023:10:370
116382470,1sleep00-21swapper/023:10:370
59102460,4chrt0-21swapper/200:20:432
59102460,4chrt0-21swapper/200:20:432
59102460,4chrt0-21swapper/200:20:432
18827994621,23cyclictest18655-21threads22:00:481
18827994621,23cyclictest18655-21threads22:00:481
18825994539,4cyclictest0-21swapper/000:00:290
184092440,1sleep00-21swapper/022:00:460
184092440,1sleep00-21swapper/022:00:460
37692420,3sleep30-21swapper/322:50:263
37692420,3sleep30-21swapper/322:50:263
183092420,3sleep20-21swapper/222:00:442
183092420,3sleep20-21swapper/222:00:442
30242410,3sleep20-21swapper/221:20:402
30242410,3sleep20-21swapper/221:20:402
18833994125,11cyclictest299932sleep200:00:292
18827994014,5cyclictest17212-21sshd21:58:051
18827994014,5cyclictest17212-21sshd21:58:051
194572390,2sleep019459-21sed20:35:480
194572390,2sleep019459-21sed20:35:480
18827993917,2cyclictest0-21swapper/119:30:481
18827993917,2cyclictest0-21swapper/119:30:481
18827993915,3cyclictest0-21swapper/120:50:361
18827993912,5cyclictest18823-21cyclictest21:50:361
174092390,3sleep20-21swapper/220:30:472
174092390,3sleep20-21swapper/220:30:472
136682370,2sleep20-21swapper/220:20:472
28032360,2sleep02849-21fschecks_count21:20:390
28032360,2sleep02849-21fschecks_count21:20:390
213722360,3sleep021467-21cpuspeed22:10:360
213722360,3sleep021467-21cpuspeed22:10:360
18827993627,7cyclictest4652-21netstat22:50:421
18827993611,3cyclictest0-21swapper/123:10:411
18827993611,3cyclictest0-21swapper/123:10:411
180102360,2sleep1271rcuc/120:35:241
180102360,2sleep1271rcuc/120:35:241
160932360,4sleep00-21swapper/023:20:460
225512350,2sleep022553-21latency_hist19:20:340
1883799351,25cyclictest30007-21chrt00:00:293
1883799351,25cyclictest30007-21chrt00:00:293
1883799351,25cyclictest30007-21chrt00:00:293
18825993525,8cyclictest26135-21threads22:20:470
18825993525,8cyclictest26135-21threads22:20:470
18825993525,8cyclictest26135-21threads22:20:470
42322340,3sleep20-21swapper/219:55:452
42322340,3sleep20-21swapper/219:55:452
42322340,3sleep20-21swapper/219:55:452
18827993426,6cyclictest23597-21timerandwakeup19:20:481
18827993426,6cyclictest23597-21timerandwakeup19:20:481
18825993429,3cyclictest24844-21gltestperf23:45:380
18825993429,3cyclictest24844-21gltestperf23:45:380
18825993427,5cyclictest15005-21latency_hist23:20:260
18825993427,5cyclictest15005-21latency_hist23:20:260
18825993424,8cyclictest32355-21timerandwakeup21:10:470
18825993424,8cyclictest32355-21timerandwakeup21:10:470
46582330,3sleep30-21swapper/322:50:423
18825993317,14cyclictest0-21swapper/021:00:380
18825993317,14cyclictest0-21swapper/021:00:380
18827993226,5cyclictest6936-21kernelversion21:30:401
18827993226,5cyclictest6936-21kernelversion21:30:401
18825993225,5cyclictest18823-21cyclictest21:40:380
18825993225,5cyclictest18823-21cyclictest21:40:380
18825993223,7cyclictest3843-21kernelversion00:15:410
18825993223,7cyclictest3843-21kernelversion00:15:410
14842320,2sleep01592-21df_inode00:10:370
14842320,2sleep01592-21df_inode00:10:370
36482310,3sleep13651-21grep00:15:391
36482310,3sleep13651-21grep00:15:391
318962310,3sleep20-21swapper/200:05:312
18827993125,3cyclictest27937-21kworker/u9:0-nfsiod00:01:101
18825993124,5cyclictest10604-21cron00:35:250
18825993124,5cyclictest10604-21cron00:35:250
214412300,2sleep016-21ksoftirqd/023:35:420
214412300,2sleep016-21ksoftirqd/023:35:420
18827993024,4cyclictest8064-21timerandwakeup20:05:481
18827993024,4cyclictest8064-21timerandwakeup20:05:481
18827993023,5cyclictest18823-21cyclictest19:42:071
18827993023,5cyclictest18823-21cyclictest19:42:071
18827993023,5cyclictest11967-21latency_hist21:45:321
18827993023,5cyclictest11967-21latency_hist21:45:321
18827993021,7cyclictest28762-21grep19:35:401
18827993021,7cyclictest28762-21grep19:35:401
241802290,2sleep024181-21swap22:15:460
241802290,2sleep024181-21swap22:15:460
18827992925,3cyclictest18823-21cyclictest00:10:471
18827992925,3cyclictest18823-21cyclictest00:10:471
18827992922,5cyclictest29053-21processes23:55:461
18827992922,5cyclictest29053-21processes23:55:461
18827992922,5cyclictest29053-21processes23:55:461
18827992920,7cyclictest24694-21fschecks_time19:25:401
18827992920,7cyclictest24694-21fschecks_time19:25:401
18825992923,4cyclictest15901-21fschecks_count21:55:370
18825992923,4cyclictest15901-21fschecks_count21:55:370
18825992922,5cyclictest18823-21cyclictest00:30:310
18825992922,5cyclictest18823-21cyclictest00:30:310
18825992919,8cyclictest3462-21cut19:55:370
18825992919,8cyclictest3462-21cut19:55:370
18825992919,8cyclictest3462-21cut19:55:370
18827992824,3cyclictest10750-21grep23:05:471
18827992824,3cyclictest10750-21grep23:05:471
18827992824,3cyclictest10750-21grep23:05:471
18827992822,5cyclictest9777-21processes00:30:461
18827992822,5cyclictest9777-21processes00:30:461
18827992822,4cyclictest18823-21cyclictest22:22:211
18827992822,4cyclictest18823-21cyclictest22:22:211
18827992822,4cyclictest18823-21cyclictest22:22:211
18827992821,5cyclictest5520-21head20:00:381
18827992821,5cyclictest5520-21head20:00:381
18827992821,5cyclictest28833-21latency_hist22:30:331
18827992819,7cyclictest24699-21fschecks_count23:45:371
18827992819,7cyclictest24699-21fschecks_count23:45:371
18825992824,2cyclictest0-21swapper/022:50:370
18825992823,3cyclictest0-21swapper/021:20:250
18825992823,3cyclictest0-21swapper/021:20:250
18825992823,3cyclictest0-21swapper/021:20:250
18825992822,4cyclictest18823-21cyclictest21:09:000
18825992822,4cyclictest18823-21cyclictest21:09:000
18825992822,4cyclictest0-21swapper/019:45:440
18825992816,10cyclictest12463-21cron00:40:250
18825992816,10cyclictest12463-21cron00:40:250
271242270,1sleep027159-21/usr/sbin/munin23:50:420
271242270,1sleep027159-21/usr/sbin/munin23:50:420
18827992723,3cyclictest12472-21cron00:40:251
18827992723,3cyclictest12472-21cron00:40:251
18827992722,4cyclictest1346-21avahi-daemon22:45:451
18827992722,4cyclictest1346-21avahi-daemon22:45:451
18827992721,5cyclictest11260-21latency20:15:401
18827992721,5cyclictest11260-21latency20:15:401
18827992719,6cyclictest19161-21fschecks_time23:30:381
18827992719,6cyclictest19161-21fschecks_time23:30:381
18827992715,10cyclictest5924-21df22:55:381
18827992715,10cyclictest5924-21df22:55:381
18825992715,3cyclictest90-1pr/ttyS022:49:560
18825992715,3cyclictest90-1pr/ttyS022:49:560
18827992621,3cyclictest0-21swapper/123:20:251
18827992621,3cyclictest0-21swapper/123:20:251
18827992620,4cyclictest550-21cron20:25:251
18827992620,4cyclictest18823-21cyclictest20:47:311
18827992620,4cyclictest18823-21cyclictest20:47:311
18827992620,4cyclictest0-21swapper/122:35:361
18827992620,4cyclictest0-21swapper/122:35:361
18827992620,3cyclictest0-21swapper/119:50:461
18827992619,5cyclictest32561-21unixbench_singl21:10:481
18827992619,5cyclictest32561-21unixbench_singl21:10:481
18827992619,5cyclictest28702-21latency_hist22:30:271
18827992618,6cyclictest18554-21cut20:35:381
18827992618,6cyclictest18554-21cut20:35:381
18825992620,4cyclictest7096-21needreboot21:30:420
18825992620,4cyclictest7096-21needreboot21:30:420
18825992620,4cyclictest31579-21sshd19:44:040
18825992620,4cyclictest31579-21sshd19:44:040
18825992620,3cyclictest0-21swapper/021:45:430
18825992620,3cyclictest0-21swapper/021:45:430
18825992619,4cyclictest0-21swapper/020:55:470
18825992619,4cyclictest0-21swapper/020:55:470
18825992619,4cyclictest0-21swapper/020:55:470
18825992618,6cyclictest1918-21cut19:50:390
18825992618,6cyclictest12618-21/usr/sbin/munin20:20:420
18825992617,7cyclictest23646-21sort23:40:470
293012250,3sleep20-21swapper/222:30:392
293012250,3sleep20-21swapper/222:30:392
18827992521,2cyclictest0-21swapper/121:05:381
18827992521,2cyclictest0-21swapper/121:05:381
18827992521,2cyclictest0-21swapper/100:10:241
18827992521,2cyclictest0-21swapper/100:10:241
18827992519,5cyclictest8551-21sshd00:27:591
18827992519,5cyclictest8551-21sshd00:27:591
18827992519,4cyclictest26249-21latency20:55:401
18827992519,4cyclictest26249-21latency20:55:401
18827992519,4cyclictest26249-21latency20:55:401
18827992518,5cyclictest22902-21sshd22:14:041
18827992518,5cyclictest22902-21sshd22:14:041
18827992518,5cyclictest19688-21fschecks_count22:05:371
18825992520,3cyclictest0-21swapper/021:50:430
18825992520,3cyclictest0-21swapper/019:20:480
18825992520,3cyclictest0-21swapper/019:20:480
18825992519,5cyclictest9373-21kernelversion20:10:400
18825992519,5cyclictest14987-21kernelversion20:25:420
18825992519,5cyclictest14987-21kernelversion20:25:420
18825992518,5cyclictest0-21swapper/019:33:050
18825992518,5cyclictest0-21swapper/019:33:050
18833992413,9cyclictest11885-21chrt20:15:472
18833992413,9cyclictest11885-21chrt20:15:472
18827992419,3cyclictest20103-21kworker/u9:0-xprtiod23:05:251
18827992419,3cyclictest0-21swapper/123:40:491
18827992419,3cyclictest0-21swapper/121:00:491
18827992419,3cyclictest0-21swapper/121:00:491
18827992418,3cyclictest0-21swapper/119:15:381
18827992417,4cyclictest0-21swapper/121:35:461
18827992417,4cyclictest0-21swapper/121:35:461
18827992417,4cyclictest0-21swapper/121:35:461
18825992419,3cyclictest0-21swapper/020:45:400
18825992419,3cyclictest0-21swapper/020:45:400
18825992418,5cyclictest4730-21fschecks_count21:25:370
18825992418,3cyclictest0-21swapper/023:25:450
18825992418,3cyclictest0-21swapper/023:25:450
18825992416,6cyclictest27547-21ls22:25:410
18825992416,6cyclictest27547-21ls22:25:410
18825992415,7cyclictest601-21snmpd00:10:330
18825992415,7cyclictest601-21snmpd00:10:330
1882799238,5cyclictest142-21systemd-journal20:15:251
18827992317,4cyclictest1346-21avahi-daemon21:25:451
18825992319,2cyclictest0-21swapper/022:30:460
18825992319,2cyclictest0-21swapper/022:30:460
18825992318,4cyclictest5484-21gltestperf20:00:380
18825992318,4cyclictest5484-21gltestperf20:00:380
18825992318,3cyclictest11468-21ntp_offset20:15:430
18825992318,3cyclictest11468-21ntp_offset20:15:430
18825992318,3cyclictest0-21swapper/022:55:460
18825992318,3cyclictest0-21swapper/022:55:460
18825992318,3cyclictest0-21swapper/020:30:450
18825992318,3cyclictest0-21swapper/020:30:450
18825992314,7cyclictest24914-21sort20:50:460
324092220,3sleep20-21swapper/200:05:392
324092220,3sleep20-21swapper/200:05:392
18827992217,3cyclictest0-21swapper/119:45:391
18827992214,6cyclictest3710-21threads21:20:491
18827992214,6cyclictest3710-21threads21:20:491
18825992217,3cyclictest31363-21needreboot22:35:400
18825992217,3cyclictest31363-21needreboot22:35:400
18825992217,3cyclictest0-21swapper/023:05:450
18825992217,3cyclictest0-21swapper/023:05:450
18825992217,3cyclictest0-21swapper/023:05:450
18825992216,5cyclictest25250-21processes19:25:480
18825992216,5cyclictest25250-21processes19:25:480
18825992216,5cyclictest19107-21cut23:30:380
18825992216,5cyclictest19107-21cut23:30:380
18825992216,4cyclictest0-21swapper/020:40:380
18825992216,4cyclictest0-21swapper/020:40:380
44052210,3sleep30-21swapper/319:55:463
44052210,3sleep30-21swapper/319:55:463
44052210,3sleep30-21swapper/319:55:463
18827992117,2cyclictest0-21swapper/120:40:471
18827992117,2cyclictest0-21swapper/120:40:471
18827992115,5cyclictest21327-21latency23:35:401
18827992115,5cyclictest21327-21latency23:35:401
18827992114,5cyclictest18823-21cyclictest21:15:441
18827992114,5cyclictest18823-21cyclictest21:15:441
18827992114,5cyclictest18823-21cyclictest21:15:441
18827992114,5cyclictest0-21swapper/119:55:401
18827992114,5cyclictest0-21swapper/119:55:401
18827992114,5cyclictest0-21swapper/119:55:401
1882799211,3cyclictest59862ntp_states00:20:451
1882799211,3cyclictest59862ntp_states00:20:451
1882799211,3cyclictest59862ntp_states00:20:451
18825992114,4cyclictest0-21swapper/022:05:470
18827992016,3cyclictest18823-21cyclictest23:50:341
18827992016,3cyclictest18823-21cyclictest23:50:341
18827992015,3cyclictest17385-21grep23:25:381
18827992015,3cyclictest17385-21grep23:25:381
18827992015,3cyclictest0-21swapper/122:15:471
18827992015,3cyclictest0-21swapper/122:15:471
73382190,3sleep20-21swapper/200:25:372
73382190,3sleep20-21swapper/200:25:372
1882799195,12cyclictest142-21systemd-journal23:25:241
18827991915,2cyclictest0-21swapper/122:40:461
18827991915,2cyclictest0-21swapper/122:40:461
18827991913,5cyclictest15006-21kernelversion20:25:421
18827991913,5cyclictest15006-21kernelversion20:25:421
18833991811,4cyclictest49862sleep221:25:402
16992180,2sleep20-21swapper/200:10:382
16992180,2sleep20-21swapper/200:10:382
1883799173,9cyclictest0-21swapper/300:00:393
1883799171,12cyclictest17097-21taskset20:30:443
1883799171,12cyclictest17097-21taskset20:30:443
1883799171,12cyclictest0-21swapper/320:40:363
1883799171,12cyclictest0-21swapper/320:40:363
1883799171,11cyclictest24981-21chrt20:50:463
1883799171,11cyclictest0-21swapper/322:00:423
1883799171,11cyclictest0-21swapper/322:00:423
1883399171,12cyclictest5165-21chrt00:20:352
1883399171,12cyclictest5165-21chrt00:20:352
1883799163,9cyclictest0-21swapper/322:57:053
1883799163,9cyclictest0-21swapper/322:57:053
1883799163,9cyclictest0-21swapper/321:43:043
1883799163,9cyclictest0-21swapper/321:43:043
1883799163,9cyclictest0-21swapper/300:07:053
1883799163,9cyclictest0-21swapper/300:07:053
1883799163,10cyclictest0-21swapper/321:26:053
1883799162,10cyclictest0-21swapper/322:15:383
1883799162,10cyclictest0-21swapper/322:15:383
1883799161,11cyclictest8035-21taskset23:00:393
1883799161,11cyclictest5974-21chrt20:00:453
1883799161,11cyclictest5974-21chrt20:00:453
1883799161,11cyclictest3828-21chrt21:20:493
1883799161,11cyclictest3828-21chrt21:20:493
1883799161,11cyclictest31797-21chrt21:10:403
1883799161,11cyclictest31797-21chrt21:10:403
1883799161,11cyclictest0-21swapper/323:15:413
1883799161,11cyclictest0-21swapper/323:15:413
1883399163,9cyclictest0-21swapper/223:07:042
1883399163,9cyclictest0-21swapper/223:07:042
1883399163,9cyclictest0-21swapper/223:07:042
1883399163,9cyclictest0-21swapper/221:06:052
1883399163,9cyclictest0-21swapper/221:06:052
18833991611,3cyclictest246332sleep223:45:382
18833991611,3cyclictest246332sleep223:45:382
18833991611,3cyclictest242072sleep220:50:372
1883399161,12cyclictest23300-21chrt19:20:442
1883399161,12cyclictest23300-21chrt19:20:442
1883399161,12cyclictest20794-21chrt23:35:362
1883399161,12cyclictest20794-21chrt23:35:362
1883399161,12cyclictest17464-21chrt23:25:392
1883399161,12cyclictest17464-21chrt23:25:392
1883399161,11cyclictest8387-21taskset21:35:362
1883399161,11cyclictest8387-21taskset21:35:362
1883399161,11cyclictest8387-21taskset21:35:362
1883399161,11cyclictest24548-21taskset19:25:382
1883399161,11cyclictest24548-21taskset19:25:382
1883399161,11cyclictest10414-21chrt21:40:382
1883399161,11cyclictest10414-21chrt21:40:382
1883799153,9cyclictest0-21swapper/321:37:043
1883799153,9cyclictest0-21swapper/321:37:043
1883799153,9cyclictest0-21swapper/321:37:043
1883799153,8cyclictest0-21swapper/323:32:043
1883799153,8cyclictest0-21swapper/323:32:043
1883799151,9cyclictest20037-21chrt22:05:403
1883799151,11cyclictest14648-21chrt21:50:443
1883799151,10cyclictest29598-21taskset22:30:443
1883799151,10cyclictest29598-21taskset22:30:443
1883799151,10cyclictest22078-21chrt20:45:353
1883799151,10cyclictest22078-21chrt20:45:353
1883799151,10cyclictest20887-21chrt23:35:373
1883799151,10cyclictest20887-21chrt23:35:373
1883799151,10cyclictest1924-21chrt21:15:473
1883799151,10cyclictest1924-21chrt21:15:473
1883799151,10cyclictest1924-21chrt21:15:473
1883799151,10cyclictest1504-21chrt19:50:363
1883799151,10cyclictest12010-21chrt23:10:403
1883799151,10cyclictest12010-21chrt23:10:403
1883799151,10cyclictest11324-21chrt20:15:403
1883799151,10cyclictest11324-21chrt20:15:403
1883799151,10cyclictest0-21swapper/300:15:393
1883799151,10cyclictest0-21swapper/300:15:393
1883399152,9cyclictest0-21swapper/220:46:052
1883399152,9cyclictest0-21swapper/220:46:052
1883399152,10cyclictest0-21swapper/222:30:262
1883399152,10cyclictest0-21swapper/222:30:262
1883399151,11cyclictest20739-21chrt20:40:402
1883399151,11cyclictest20739-21chrt20:40:402
1883399151,11cyclictest20557-21chrt22:05:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional