You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Mon Jul 20, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202521210,2sleep30-21swapper/307:48:493
202521210,2sleep30-21swapper/307:48:493
202521210,2sleep30-21swapper/307:48:493
2540021100,3chrt0-21swapper/310:18:443
2540021100,3chrt0-21swapper/310:18:443
148642880,3sleep30-21swapper/308:23:463
148642880,3sleep30-21swapper/308:23:463
290642810,3sleep30-21swapper/310:28:453
290642810,3sleep30-21swapper/310:28:453
283102810,8sleep028309-21strings07:33:430
113122670,4chrt0-21swapper/309:43:263
113122670,4chrt0-21swapper/309:43:263
260872640,2chrt26088-21systemctl08:53:460
260872640,2chrt26088-21systemctl08:53:460
216622600,1sleep00-21swapper/010:08:440
216622600,1sleep00-21swapper/010:08:440
216622600,1sleep00-21swapper/010:08:440
26932580,3chrt0-21swapper/107:53:371
26932580,3chrt0-21swapper/107:53:371
26932580,3chrt0-21swapper/107:53:371
141132520,3chrt0-21swapper/209:48:442
141132520,3chrt0-21swapper/209:48:442
67432510,3sleep20-21swapper/208:03:392
67432510,3sleep20-21swapper/208:03:392
67432510,3sleep20-21swapper/208:03:392
222002510,3sleep30-21swapper/311:38:353
222002510,3sleep30-21swapper/311:38:353
275352500,2chrt0-21swapper/307:33:343
275352500,2chrt0-21swapper/307:33:343
275352500,2chrt0-21swapper/307:33:343
120012480,3sleep30-21swapper/308:18:323
264072470,3chrt0-21swapper/208:53:482
264072470,3chrt0-21swapper/208:53:482
202722470,2sleep20-21swapper/211:33:322
202722470,2sleep20-21swapper/211:33:322
202722470,2sleep20-21swapper/211:33:322
177612470,3sleep30-21swapper/309:58:423
177612470,3sleep30-21swapper/309:58:423
177612470,3sleep30-21swapper/309:58:423
30062450,3sleep20-21swapper/209:18:492
30062450,3sleep20-21swapper/209:18:492
44382440,3sleep30-21swapper/309:23:403
44382440,3sleep30-21swapper/309:23:403
180672440,3sleep30-21swapper/308:33:393
180672440,3sleep30-21swapper/308:33:393
73332430,3chrt0-21swapper/312:23:423
73332430,3chrt0-21swapper/312:23:423
272102430,4sleep027204-21gzip10:23:430
272102430,4sleep027204-21gzip10:23:430
198522420,3sleep20-21swapper/210:03:472
198522420,3sleep20-21swapper/210:03:472
198522420,3sleep20-21swapper/210:03:472
122592410,4sleep20-21swapper/212:38:362
122592410,4sleep20-21swapper/212:38:362
122592410,4sleep20-21swapper/212:38:362
260052390,3sleep30-21swapper/308:53:453
260052390,3sleep30-21swapper/308:53:453
20493993926,11cyclictest0-21swapper/008:28:390
20493993926,11cyclictest0-21swapper/008:28:390
206132370,3sleep20-21swapper/208:38:492
206132370,3sleep20-21swapper/208:38:492
20494993722,3cyclictest181rcu_preempt11:18:241
20494993722,3cyclictest181rcu_preempt11:18:241
307192360,3sleep30-21swapper/309:08:333
307192360,3sleep30-21swapper/309:08:333
20494993526,7cyclictest5284-21kernelversion12:18:421
20494993526,7cyclictest5284-21kernelversion12:18:421
86792340,2sleep20-21swapper/212:28:392
86792340,2sleep20-21swapper/212:28:392
86792340,2sleep20-21swapper/212:28:392
20494993326,5cyclictest545-21in:imuxsock08:43:261
20494993326,5cyclictest545-21in:imuxsock08:43:261
20494993226,5cyclictest7222-21latency12:23:411
20494993226,5cyclictest7222-21latency12:23:411
20494993226,5cyclictest7222-21latency12:23:411
20494993226,4cyclictest5842-21kernelversion10:53:421
20494993226,4cyclictest5842-21kernelversion10:53:421
20494993226,4cyclictest5842-21kernelversion10:53:421
20494993226,4cyclictest5842-21kernelversion10:53:421
20493993228,2cyclictest0-21swapper/007:33:370
20493993228,2cyclictest0-21swapper/007:33:370
20493993226,4cyclictest9996-21latency_hist08:13:260
20493993226,4cyclictest9996-21latency_hist08:13:260
20493993226,3cyclictest0-21swapper/012:23:260
20493993226,3cyclictest0-21swapper/012:23:260
20493993226,3cyclictest0-21swapper/012:23:260
82582310,4sleep20-21swapper/208:08:342
82582310,4sleep20-21swapper/208:08:342
20493993127,2cyclictest0-21swapper/011:38:430
20493993127,2cyclictest0-21swapper/011:38:430
20493993126,3cyclictest4547-21cron12:18:250
20493993126,3cyclictest4547-21cron12:18:250
20493993126,3cyclictest4547-21cron12:18:250
20493993125,5cyclictest22333-21cpuspeed11:38:380
20493993125,5cyclictest22333-21cpuspeed11:38:380
20493993123,6cyclictest26779-21cut10:23:390
9682300,5sleep1947-21fschecks_count07:48:391
9682300,5sleep1947-21fschecks_count07:48:391
9682300,5sleep1947-21fschecks_count07:48:391
322772300,2sleep0171ktimers/010:38:390
322772300,2sleep0171ktimers/010:38:390
20494993024,4cyclictest545-21in:imuxsock11:03:091
20494993024,4cyclictest545-21in:imuxsock11:03:091
20494993024,4cyclictest545-21in:imuxsock11:03:091
20494993023,6cyclictest550-21cron10:43:381
20494993023,6cyclictest550-21cron10:43:381
20494993023,5cyclictest5612-21sshd09:27:251
20494993023,5cyclictest5612-21sshd09:27:251
20494993021,7cyclictest5465-21fschecks_count10:53:391
20493993025,3cyclictest27657-21idleruntime-cro11:53:260
20493993025,3cyclictest27657-21idleruntime-cro11:53:260
20493993023,5cyclictest26241-21kernelversion07:28:390
20493993023,5cyclictest26241-21kernelversion07:28:390
20493993023,5cyclictest26241-21kernelversion07:28:390
20493993023,5cyclictest18065-21sshd11:25:240
20493993023,5cyclictest18065-21sshd11:25:240
20493993023,5cyclictest18065-21sshd11:25:240
20493993022,6cyclictest8108-21mailstats10:58:490
20493993022,6cyclictest8108-21mailstats10:58:490
20493993022,6cyclictest8108-21mailstats10:58:490
9212290,3sleep20-21swapper/209:13:422
9212290,3sleep20-21swapper/209:13:422
9212290,3sleep20-21swapper/209:13:422
32802290,3sleep30-21swapper/312:13:413
32802290,3sleep30-21swapper/312:13:413
32802290,3sleep30-21swapper/312:13:413
32802290,3sleep30-21swapper/312:13:413
20494992924,3cyclictest9441-21gltestperf11:03:391
20494992924,3cyclictest9441-21gltestperf11:03:391
20494992924,3cyclictest9441-21gltestperf11:03:391
20494992924,2cyclictest0-21swapper/110:23:261
20494992924,2cyclictest0-21swapper/110:23:261
20494992923,4cyclictest18465-21ntp_offset08:33:441
20494992923,4cyclictest18465-21ntp_offset08:33:441
20494992917,3cyclictest181rcu_preempt09:58:071
20494992917,3cyclictest181rcu_preempt09:58:071
20494992917,3cyclictest181rcu_preempt09:58:071
20494992917,2cyclictest181rcu_preempt12:03:261
20494992917,2cyclictest181rcu_preempt12:03:261
20494992917,2cyclictest181rcu_preempt12:03:261
20493992925,3cyclictest20491-21cyclictest10:57:280
20493992925,3cyclictest20491-21cyclictest10:57:280
20493992925,3cyclictest20491-21cyclictest10:57:280
20493992925,3cyclictest20491-21cyclictest10:57:280
20493992924,4cyclictest1346-21avahi-daemon07:53:480
20493992924,4cyclictest1346-21avahi-daemon07:53:480
20493992924,4cyclictest1346-21avahi-daemon07:53:480
20493992922,5cyclictest15504-21cut09:53:380
302062280,3chrt0-21swapper/209:03:492
302062280,3chrt0-21swapper/209:03:492
20494992824,3cyclictest4651-21unixbench_multi10:48:501
20494992824,3cyclictest4651-21unixbench_multi10:48:501
20494992822,5cyclictest13979-21latency_hist12:43:261
20494992822,5cyclictest13979-21latency_hist12:43:261
20494992822,5cyclictest13979-21latency_hist12:43:261
20494992821,5cyclictest25824-21latency_hist11:48:271
20494992821,5cyclictest25824-21latency_hist11:48:271
20493992823,4cyclictest1346-21avahi-daemon11:58:490
20493992823,4cyclictest1346-21avahi-daemon11:58:490
20493992823,4cyclictest1346-21avahi-daemon11:58:490
20493992823,3cyclictest3621-21ntp_kernel_err12:13:450
20493992822,5cyclictest18428-21netstat08:33:430
20493992822,5cyclictest18428-21netstat08:33:430
20493992821,5cyclictest6943-21kernelversion08:03:410
20493992821,5cyclictest6943-21kernelversion08:03:410
20493992821,5cyclictest29177-21fschecks_time09:03:390
20493992821,5cyclictest29177-21fschecks_time09:03:390
20493992821,5cyclictest21459-21latency_hist08:43:360
20493992821,5cyclictest21459-21latency_hist08:43:360
272982270,4sleep20-21swapper/208:58:392
272982270,4sleep20-21swapper/208:58:392
20494992722,4cyclictest8104-21latency_hist08:08:371
20494992722,4cyclictest8104-21latency_hist08:08:371
20494992720,5cyclictest4869-21fschecks_count12:18:401
20494992720,5cyclictest11725-21netstat11:08:451
20494992720,5cyclictest11725-21netstat11:08:451
20494992720,5cyclictest11725-21netstat11:08:451
20494992719,6cyclictest29445-21kernelversion09:03:411
20494992719,6cyclictest29445-21kernelversion09:03:411
20493992722,3cyclictest11100-21needreboot12:33:450
20493992722,3cyclictest11100-21needreboot12:33:450
20493992722,3cyclictest11100-21needreboot12:33:450
20493992722,3cyclictest0-21swapper/009:23:490
20493992722,3cyclictest0-21swapper/009:23:490
2049699268,3cyclictest222102chrt10:08:542
2049699268,3cyclictest222102chrt10:08:542
2049699268,3cyclictest222102chrt10:08:542
20494992622,2cyclictest0-21swapper/110:33:261
20494992622,2cyclictest0-21swapper/110:33:261
20494992621,3cyclictest0-21swapper/110:08:381
20494992618,6cyclictest8467-21fschecks_count08:08:381
20494992618,6cyclictest8467-21fschecks_count08:08:381
20494992618,6cyclictest6673-21fschecks_time08:03:391
20494992618,6cyclictest6673-21fschecks_time08:03:391
20494992618,6cyclictest6673-21fschecks_time08:03:391
20494992618,6cyclictest12287-21fschecks_time08:18:391
20494992618,6cyclictest12287-21fschecks_time08:18:391
20493992622,2cyclictest0-21swapper/012:28:410
20493992622,2cyclictest0-21swapper/012:28:410
20493992622,2cyclictest0-21swapper/012:28:410
20493992622,2cyclictest0-21swapper/009:18:470
20493992622,2cyclictest0-21swapper/009:18:470
20493992621,3cyclictest0-21swapper/011:28:390
20493992621,3cyclictest0-21swapper/011:28:390
20493992621,3cyclictest0-21swapper/011:28:390
20493992621,3cyclictest0-21swapper/011:08:500
20493992621,3cyclictest0-21swapper/011:08:500
20493992621,3cyclictest0-21swapper/011:08:500
20493992621,3cyclictest0-21swapper/010:33:490
20493992621,3cyclictest0-21swapper/009:28:420
20493992621,3cyclictest0-21swapper/009:28:420
20493992621,3cyclictest0-21swapper/009:28:420
20493992621,3cyclictest0-21swapper/009:18:260
20493992621,3cyclictest0-21swapper/009:18:260
20493992621,3cyclictest0-21swapper/009:18:260
20493992620,4cyclictest23479-21fschecks_count08:48:400
20493992619,5cyclictest23286-21latency_hist08:48:350
20493992619,5cyclictest23286-21latency_hist08:48:350
20496992519,4cyclictest3570-21chrt12:13:442
20496992519,4cyclictest3570-21chrt12:13:442
20494992520,3cyclictest3791-21latency_hist09:23:261
20494992520,3cyclictest3791-21latency_hist09:23:261
20494992520,3cyclictest31913-21latency_hist10:38:251
20494992520,3cyclictest31913-21latency_hist10:38:251
20494992520,3cyclictest31913-21latency_hist10:38:251
20494992520,3cyclictest0-21swapper/112:08:401
20494992520,3cyclictest0-21swapper/112:08:401
20494992520,3cyclictest0-21swapper/112:08:401
20494992519,5cyclictest14300-21rt-features09:48:471
20494992519,5cyclictest14300-21rt-features09:48:471
20494992518,5cyclictest27565-21/usr/sbin/munin08:58:411
20494992518,5cyclictest27565-21/usr/sbin/munin08:58:411
20494992518,5cyclictest16428-21sendmail11:23:261
20494992518,5cyclictest16428-21sendmail11:23:261
20494992512,11cyclictest9444-21cron09:38:401
20494992512,11cyclictest9444-21cron09:38:401
20493992521,2cyclictest0-21swapper/009:58:480
20493992521,2cyclictest0-21swapper/009:58:480
20493992521,2cyclictest0-21swapper/009:58:480
20493992521,2cyclictest0-21swapper/007:38:480
20493992521,2cyclictest0-21swapper/007:38:480
20493992521,2cyclictest0-21swapper/007:38:480
20493992520,4cyclictest16684-21runrttasks09:55:060
20493992520,4cyclictest16684-21runrttasks09:55:060
20493992520,4cyclictest16684-21runrttasks09:55:060
20493992520,3cyclictest0-21swapper/009:43:420
20493992520,3cyclictest0-21swapper/009:43:420
20493992520,3cyclictest0-21swapper/009:43:420
20493992520,3cyclictest0-21swapper/008:03:470
20493992520,3cyclictest0-21swapper/008:03:470
20493992520,3cyclictest0-21swapper/007:33:450
20493992520,3cyclictest0-21swapper/007:33:450
20493992520,3cyclictest0-21swapper/007:33:450
20493992519,5cyclictest9658-21kernelversion11:03:410
20493992519,5cyclictest9658-21kernelversion11:03:410
20493992519,5cyclictest9658-21kernelversion11:03:410
20493992518,6cyclictest23283-21kernelversion10:13:410
20493992518,6cyclictest23283-21kernelversion10:13:410
20493992518,6cyclictest23283-21kernelversion10:13:410
20507992419,3cyclictest199852chrt10:03:483
20507992419,3cyclictest199852chrt10:03:483
20507992419,3cyclictest199852chrt10:03:483
2049699243,7cyclictest0-21swapper/208:19:252
2049699243,7cyclictest0-21swapper/208:19:252
20494992419,4cyclictest14678-21systemd-journal07:36:241
20494992419,4cyclictest14678-21systemd-journal07:36:241
20494992419,4cyclictest14678-21systemd-journal07:36:241
20494992419,4cyclictest14265-21fschecks_time08:23:391
20494992419,4cyclictest14265-21fschecks_time08:23:391
20494992419,3cyclictest0-21swapper/111:48:401
20494992419,3cyclictest0-21swapper/111:48:401
20494992417,6cyclictest9301-21ntp_kernel_pll_12:28:451
20494992417,6cyclictest9301-21ntp_kernel_pll_12:28:451
20494992417,6cyclictest9301-21ntp_kernel_pll_12:28:451
20494992417,5cyclictest9609-21latency_hist09:38:351
20494992417,5cyclictest9609-21latency_hist09:38:351
20494992417,5cyclictest9609-21latency_hist09:38:351
20494992415,7cyclictest25892-21fschecks_count07:28:361
20494992415,7cyclictest25892-21fschecks_count07:28:361
20494992415,7cyclictest25892-21fschecks_count07:28:361
20493992420,2cyclictest0-21swapper/012:08:480
20493992420,2cyclictest0-21swapper/012:08:480
20493992420,2cyclictest0-21swapper/012:08:480
20493992420,2cyclictest0-21swapper/010:48:430
20493992420,2cyclictest0-21swapper/010:48:430
20493992420,2cyclictest0-21swapper/010:48:430
20493992419,3cyclictest20491-21cyclictest12:08:200
20493992419,3cyclictest20491-21cyclictest12:08:200
20493992419,3cyclictest20491-21cyclictest12:08:200
20493992419,3cyclictest0-21swapper/009:38:490
20493992419,3cyclictest0-21swapper/009:38:490
20493992417,5cyclictest14948-21fschecks_count11:18:410
20493992417,5cyclictest14948-21fschecks_count11:18:410
20493992417,5cyclictest10709-21kernelversion08:13:420
20496992315,5cyclictest28098-21taskset07:33:412
20496992315,5cyclictest28098-21taskset07:33:412
20496992315,5cyclictest28098-21taskset07:33:412
20494992319,3cyclictest31687-21gltestperf07:43:401
20494992319,3cyclictest31687-21gltestperf07:43:401
20494992319,3cyclictest31687-21gltestperf07:43:401
20494992318,3cyclictest1916-21latency_hist09:18:261
20494992318,3cyclictest1916-21latency_hist09:18:261
20494992318,3cyclictest1916-21latency_hist09:18:261
20494992318,3cyclictest0-21swapper/110:18:261
20494992318,3cyclictest0-21swapper/110:18:261
20494992318,3cyclictest0-21swapper/110:18:261
20494992318,3cyclictest0-21swapper/108:53:381
20494992318,3cyclictest0-21swapper/108:53:381
20494992317,5cyclictest20572-21fschecks_count11:33:411
20494992317,5cyclictest20572-21fschecks_count11:33:411
20494992317,5cyclictest18464-21latency_hist11:28:351
20494992317,5cyclictest18464-21latency_hist11:28:351
20494992317,5cyclictest18464-21latency_hist11:28:351
20494992317,4cyclictest20238-21latency_hist11:33:291
20494992317,4cyclictest20238-21latency_hist11:33:291
20494992317,4cyclictest20238-21latency_hist11:33:291
20494992316,5cyclictest31046-21fschecks_time09:08:391
20494992316,5cyclictest31046-21fschecks_time09:08:391
20494992316,5cyclictest27339-21sshd07:32:251
20494992316,5cyclictest27339-21sshd07:32:251
20494992316,5cyclictest27339-21sshd07:32:251
20494992316,5cyclictest2706-21latency_hist12:13:261
20494992316,5cyclictest2706-21latency_hist12:13:261
20494992316,5cyclictest2706-21latency_hist12:13:261
20494992316,5cyclictest2706-21latency_hist12:13:261
20494992316,5cyclictest21634-21ntp_kernel_err10:08:431
20494992316,5cyclictest21634-21ntp_kernel_err10:08:431
20494992316,5cyclictest21634-21ntp_kernel_err10:08:431
20494992316,5cyclictest20491-21cyclictest08:52:061
20494992316,5cyclictest16598-21ntp_offset08:28:451
20494992316,5cyclictest16598-21ntp_offset08:28:451
20494992316,5cyclictest0-21swapper/108:13:421
20494992315,6cyclictest10618-21fschecks_count12:33:401
20494992315,6cyclictest10618-21fschecks_count12:33:401
20494992315,6cyclictest10618-21fschecks_count12:33:401
20493992319,2cyclictest0-21swapper/011:53:410
20493992319,2cyclictest0-21swapper/011:53:410
20493992319,2cyclictest0-21swapper/011:53:410
20493992319,2cyclictest0-21swapper/010:28:490
20493992319,2cyclictest0-21swapper/010:28:490
20493992319,2cyclictest0-21swapper/009:48:500
20493992319,2cyclictest0-21swapper/009:13:370
20493992319,2cyclictest0-21swapper/009:13:370
20493992319,2cyclictest0-21swapper/008:23:490
20493992319,2cyclictest0-21swapper/008:23:490
20493992319,2cyclictest0-21swapper/007:48:470
20493992319,2cyclictest0-21swapper/007:48:470
20493992319,2cyclictest0-21swapper/007:48:470
20493992318,3cyclictest0-21swapper/011:43:470
20493992318,3cyclictest0-21swapper/011:43:470
20493992316,5cyclictest1834-21fschecks_time10:43:400
20493992316,5cyclictest1834-21fschecks_time10:43:400
169942230,3sleep30-21swapper/308:28:493
169942230,3sleep30-21swapper/308:28:493
20494992218,3cyclictest749-21runrttasks09:43:451
20494992218,3cyclictest749-21runrttasks09:43:451
20494992218,3cyclictest749-21runrttasks09:43:451
20494992217,2cyclictest0-21swapper/108:48:261
20494992217,2cyclictest0-21swapper/108:48:261
20494992216,4cyclictest1431-21latency_hist10:43:281
20494992216,4cyclictest1431-21latency_hist10:43:281
20494992216,3cyclictest0-21swapper/112:28:261
20494992216,3cyclictest0-21swapper/112:28:261
20494992216,3cyclictest0-21swapper/112:28:261
20494992215,4cyclictest0-21swapper/110:23:481
20494992215,4cyclictest0-21swapper/110:23:481
20494992215,4cyclictest0-21swapper/109:28:461
20494992215,4cyclictest0-21swapper/109:28:461
20494992215,4cyclictest0-21swapper/109:28:461
20494992214,6cyclictest22566-21gltestperf11:38:401
20494992214,6cyclictest22566-21gltestperf11:38:401
20494992214,6cyclictest17729-21ls09:58:411
20494992214,6cyclictest17729-21ls09:58:411
20494992214,6cyclictest17729-21ls09:58:411
20493992218,2cyclictest0-21swapper/012:28:480
20493992218,2cyclictest0-21swapper/012:28:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional