You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 22:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Jul 14, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2154621500,1sleep1271rcuc/111:33:451
2154621500,1sleep1271rcuc/111:33:451
36632820,3sleep30-21swapper/310:48:323
36632820,3sleep30-21swapper/310:48:323
181832790,2sleep30-21swapper/309:58:443
181832790,2sleep30-21swapper/309:58:443
208142720,2sleep00-21swapper/011:33:370
208142720,2sleep00-21swapper/011:33:370
16492560,2chrt0-21swapper/312:08:363
16492560,2chrt0-21swapper/312:08:363
16492560,2chrt0-21swapper/312:08:363
69472520,2sleep30-21swapper/309:28:453
69472520,2sleep30-21swapper/309:28:453
69472520,2sleep30-21swapper/309:28:453
233732510,1chrt0-21swapper/010:13:360
233732510,1chrt0-21swapper/010:13:360
85312460,1chrt16-21ksoftirqd/009:33:400
85312460,1chrt16-21ksoftirqd/009:33:400
255202440,3sleep20-21swapper/208:53:352
255202440,3sleep20-21swapper/208:53:352
255202440,3sleep20-21swapper/208:53:352
250232440,1sleep025027-21timerwakeupswit07:23:440
250232440,1sleep025027-21timerwakeupswit07:23:440
141192440,2sleep114186-21fschecks_count08:23:311
141192440,2sleep114186-21fschecks_count08:23:311
137632430,4sleep20-21swapper/208:23:202
137632430,4sleep20-21swapper/208:23:202
20555993933,4cyclictest12619-21idleruntime-cro11:13:200
20555993933,4cyclictest12619-21idleruntime-cro11:13:200
20555993933,4cyclictest12619-21idleruntime-cro11:13:200
20555993731,4cyclictest11095-21mailstats08:13:420
20555993731,4cyclictest11095-21mailstats08:13:420
71162360,2sleep17119-21wc10:58:311
71162360,2sleep17119-21wc10:58:311
71162360,2sleep17119-21wc10:58:311
20556993528,5cyclictest2646-21grep12:13:211
20556993528,5cyclictest2646-21grep12:13:211
20556993528,5cyclictest2646-21grep12:13:211
69382340,3sleep20-21swapper/212:23:352
69382340,3sleep20-21swapper/212:23:352
20555993430,3cyclictest20549-21cyclictest07:43:310
20555993430,3cyclictest20549-21cyclictest07:43:310
20555993428,4cyclictest1362-21sendmail10:43:210
20555993428,4cyclictest1362-21sendmail10:43:210
20555993428,4cyclictest1362-21sendmail10:43:210
20555993327,4cyclictest9038-21latency_hist11:03:310
20555993327,4cyclictest9038-21latency_hist11:03:310
20555993327,4cyclictest9038-21latency_hist11:03:310
20555993327,4cyclictest9038-21latency_hist11:03:310
20555993327,4cyclictest20549-21cyclictest09:17:310
161612330,3sleep20-21swapper/209:53:402
161612330,3sleep20-21swapper/209:53:402
20555993225,5cyclictest550-21cron10:48:210
20555993225,5cyclictest550-21cron10:48:210
20555993225,5cyclictest550-21cron10:48:210
20556993126,3cyclictest20549-21cyclictest10:53:321
20556993126,3cyclictest20549-21cyclictest10:53:321
20556993126,3cyclictest20549-21cyclictest10:53:321
20555993124,5cyclictest8225-21latency_hist08:08:280
20555993124,5cyclictest8225-21latency_hist08:08:280
20555993124,5cyclictest8225-21latency_hist08:08:280
20556993025,3cyclictest0-21swapper/109:23:211
20556993025,3cyclictest0-21swapper/109:23:211
20556993024,4cyclictest0-21swapper/109:58:201
20556993024,4cyclictest0-21swapper/109:58:201
20556993024,4cyclictest0-21swapper/108:03:431
20556993024,4cyclictest0-21swapper/108:03:431
20556993024,4cyclictest0-21swapper/108:03:431
20556993022,6cyclictest18755-21timerandwakeup08:33:431
20556993022,6cyclictest18755-21timerandwakeup08:33:431
20556993022,6cyclictest18755-21timerandwakeup08:33:431
20556993020,7cyclictest16371-21sh11:23:231
20556993020,7cyclictest16371-21sh11:23:231
20556993020,7cyclictest16371-21sh11:23:231
20555993024,5cyclictest18247-21timerwakeupswit09:58:440
20555993024,5cyclictest18247-21timerwakeupswit09:58:440
20555993023,5cyclictest688-21sshd12:07:330
20555993023,5cyclictest688-21sshd12:07:330
20555993023,5cyclictest20549-21cyclictest07:33:210
20555993023,5cyclictest20549-21cyclictest07:33:210
20555993022,6cyclictest25759-21ls10:18:440
20555993022,6cyclictest25759-21ls10:18:440
18212300,1sleep00-21swapper/007:48:440
18212300,1sleep00-21swapper/007:48:440
20556992924,3cyclictest0-21swapper/109:48:371
20556992924,3cyclictest0-21swapper/109:48:371
20556992924,3cyclictest0-21swapper/109:48:371
20556992923,4cyclictest14678-21systemd-journal11:43:201
20556992923,4cyclictest14678-21systemd-journal11:43:201
20556992923,4cyclictest0-21swapper/112:03:201
20556992923,4cyclictest0-21swapper/112:03:201
20556992922,5cyclictest27210-21needreboot10:23:381
20556992922,5cyclictest27210-21needreboot10:23:381
20556992920,7cyclictest26959-21threads11:48:421
20556992920,7cyclictest26959-21threads11:48:421
20555992923,5cyclictest24789-21netstat11:43:390
20555992923,5cyclictest24789-21netstat11:43:390
20555992923,4cyclictest572-21cups-browsed12:23:430
20555992923,4cyclictest572-21cups-browsed12:23:430
20555992923,4cyclictest29958-21gltestperf11:58:350
20555992923,4cyclictest29958-21gltestperf11:58:350
20555992922,5cyclictest20063-21threads10:03:420
20555992922,5cyclictest20063-21threads10:03:420
20555992921,6cyclictest21689-21cut08:43:340
20555992921,6cyclictest21689-21cut08:43:340
20556992823,4cyclictest32163-21proc_pri07:43:401
20556992823,4cyclictest32163-21proc_pri07:43:401
20556992823,3cyclictest18247-21cron11:28:201
20556992823,3cyclictest18247-21cron11:28:201
20556992823,3cyclictest0-21swapper/107:48:451
20556992823,3cyclictest0-21swapper/107:48:451
20556992822,5cyclictest2393-21processes10:43:421
20556992822,5cyclictest2393-21processes10:43:421
20556992822,5cyclictest2393-21processes10:43:421
20556992822,5cyclictest20549-21cyclictest07:53:431
20556992822,5cyclictest20549-21cyclictest07:53:431
20556992822,4cyclictest29730-21fschecks_time07:38:341
20556992822,4cyclictest29730-21fschecks_time07:38:341
20556992820,5cyclictest24827-21ntp_offset11:43:401
20556992820,5cyclictest24827-21ntp_offset11:43:401
20555992823,3cyclictest4499-21cron12:18:200
20555992823,3cyclictest4499-21cron12:18:200
20555992822,4cyclictest572-21cups-browsed09:03:420
20555992822,4cyclictest572-21cups-browsed09:03:420
20555992822,4cyclictest572-21cups-browsed09:03:420
20555992822,4cyclictest13605-21fschecks_time09:48:310
20555992822,4cyclictest13605-21fschecks_time09:48:310
20555992821,5cyclictest9149-21missed_timers12:28:380
20555992821,5cyclictest9149-21missed_timers12:28:380
20555992819,7cyclictest26536-21/usr/sbin/munin10:23:380
20555992819,7cyclictest26536-21/usr/sbin/munin10:23:380
20555992819,7cyclictest18442-21netstat08:33:390
20555992819,7cyclictest18442-21netstat08:33:390
20555992819,7cyclictest18442-21netstat08:33:390
20558992714,9cyclictest21840-21chrt11:36:352
20558992714,9cyclictest21840-21chrt11:36:352
20556992723,2cyclictest0-21swapper/111:13:341
20556992723,2cyclictest0-21swapper/111:13:341
20556992723,2cyclictest0-21swapper/111:13:341
20556992723,2cyclictest0-21swapper/109:38:201
20556992723,2cyclictest0-21swapper/109:38:201
20556992722,2cyclictest0-21swapper/108:28:361
20556992722,2cyclictest0-21swapper/108:28:361
20556992722,2cyclictest0-21swapper/108:28:361
20556992721,5cyclictest390-21ntp_offset10:38:381
20556992721,5cyclictest390-21ntp_offset10:38:381
20556992721,5cyclictest390-21ntp_offset10:38:381
20556992721,4cyclictest0-21swapper/108:23:201
20556992721,4cyclictest0-21swapper/108:23:201
20556992720,4cyclictest0-21swapper/111:53:351
20556992720,4cyclictest0-21swapper/111:53:351
20556992720,4cyclictest0-21swapper/111:53:351
20556992710,7cyclictest700-21192.168.115.40-manager10:14:181
20556992710,7cyclictest700-21192.168.115.40-manager10:14:181
2055599279,16cyclictest23838-21cron11:43:200
2055599279,16cyclictest23838-21cron11:43:200
20555992723,2cyclictest0-21swapper/011:48:420
20555992723,2cyclictest0-21swapper/011:48:420
20555992723,2cyclictest0-21swapper/009:28:200
20555992723,2cyclictest0-21swapper/009:28:200
20555992722,3cyclictest0-21swapper/008:08:400
20555992722,3cyclictest0-21swapper/008:08:400
20555992721,4cyclictest31532-21ntp_kernel_err09:08:400
20555992721,4cyclictest31532-21ntp_kernel_err09:08:400
20555992721,4cyclictest16941-21latency_hist09:58:320
20555992721,4cyclictest16941-21latency_hist09:58:320
20555992720,5cyclictest14503-21kernelversion08:23:340
20555992720,5cyclictest14503-21kernelversion08:23:340
20555992720,5cyclictest11101-21cut11:08:330
20555992720,5cyclictest11101-21cut11:08:330
20555992720,5cyclictest11101-21cut11:08:330
20555992713,12cyclictest0-21swapper/009:28:350
20555992713,12cyclictest0-21swapper/009:28:350
20555992713,12cyclictest0-21swapper/009:28:350
81352260,2chrt0-21swapper/209:33:342
81352260,2chrt0-21swapper/209:33:342
20556992621,3cyclictest11314-21latency_hist09:43:201
20556992621,3cyclictest11314-21latency_hist09:43:201
20556992621,3cyclictest11314-21latency_hist09:43:201
20556992620,5cyclictest30313-21cpuspeed10:33:321
20556992620,5cyclictest30313-21cpuspeed10:33:321
20556992620,4cyclictest0-21swapper/112:03:451
20556992620,4cyclictest0-21swapper/112:03:451
20556992619,5cyclictest20549-21cyclictest12:37:241
20556992619,5cyclictest20549-21cyclictest12:37:241
20555992621,3cyclictest32197-21sh10:38:310
20555992621,3cyclictest32197-21sh10:38:310
20555992621,3cyclictest32197-21sh10:38:310
20555992621,3cyclictest0-21swapper/008:38:410
20555992621,3cyclictest0-21swapper/008:38:410
20555992621,3cyclictest0-21swapper/008:38:410
20555992620,4cyclictest0-21swapper/008:48:430
20555992620,4cyclictest0-21swapper/008:48:430
20555992620,4cyclictest0-21swapper/008:48:430
20555992619,5cyclictest11508-21/usr/sbin/munin09:43:420
20555992618,6cyclictest4622-21unixbench_multi10:48:430
20555992618,6cyclictest4622-21unixbench_multi10:48:430
20555992618,6cyclictest4622-21unixbench_multi10:48:430
20555992618,6cyclictest4022-21latency_hist09:23:300
20555992618,6cyclictest29118-21cut09:03:330
20555992614,9cyclictest0-21swapper/008:58:210
20555992614,9cyclictest0-21swapper/008:58:210
20555992614,9cyclictest0-21swapper/008:58:210
20555992612,12cyclictest0-21swapper/009:43:330
2055699257,3cyclictest37952sensors_temp12:13:441
2055699257,3cyclictest37952sensors_temp12:13:441
20556992521,2cyclictest0-21swapper/111:33:211
20556992521,2cyclictest0-21swapper/111:33:211
20556992521,2cyclictest0-21swapper/109:13:201
20556992521,2cyclictest0-21swapper/109:13:201
20556992521,2cyclictest0-21swapper/107:23:421
20556992521,2cyclictest0-21swapper/107:23:421
20556992520,3cyclictest17549-21idleruntime09:58:351
20556992520,3cyclictest17549-21idleruntime09:58:351
20556992520,3cyclictest0-21swapper/110:33:211
20556992520,3cyclictest0-21swapper/109:43:341
20556992520,3cyclictest0-21swapper/109:43:341
20556992520,3cyclictest0-21swapper/109:43:341
20556992520,2cyclictest0-21swapper/112:18:451
20556992520,2cyclictest0-21swapper/112:18:451
20556992520,2cyclictest0-21swapper/112:18:451
20556992519,4cyclictest12562-21grep12:38:331
20556992519,4cyclictest12562-21grep12:38:331
20556992518,5cyclictest6659-21ntp_offset09:28:411
20556992518,5cyclictest6659-21ntp_offset09:28:411
20556992518,5cyclictest6659-21ntp_offset09:28:411
20556992517,6cyclictest20615-21threads08:38:411
20556992517,6cyclictest20615-21threads08:38:411
20556992517,6cyclictest20615-21threads08:38:411
20555992521,3cyclictest15387-21sh09:53:310
20555992521,3cyclictest15387-21sh09:53:310
20555992521,3cyclictest15387-21sh09:53:310
20555992520,3cyclictest0-21swapper/012:23:340
20555992520,3cyclictest0-21swapper/011:53:430
20555992520,3cyclictest0-21swapper/011:53:430
20555992520,3cyclictest0-21swapper/011:53:430
20555992520,3cyclictest0-21swapper/011:28:430
20555992520,3cyclictest0-21swapper/011:28:430
20555992520,3cyclictest0-21swapper/010:53:420
20555992520,3cyclictest0-21swapper/010:53:420
20555992520,3cyclictest0-21swapper/010:53:420
20555992520,3cyclictest0-21swapper/010:33:320
20555992520,3cyclictest0-21swapper/010:33:320
20555992520,3cyclictest0-21swapper/007:53:440
20555992520,3cyclictest0-21swapper/007:53:440
20555992519,4cyclictest0-21swapper/011:18:340
20555992519,4cyclictest0-21swapper/011:18:340
20555992519,4cyclictest0-21swapper/011:18:340
20555992519,4cyclictest0-21swapper/009:40:020
20555992519,4cyclictest0-21swapper/009:40:020
20555992517,6cyclictest16078-21sshd11:19:450
20555992517,6cyclictest16078-21sshd11:19:450
20555992517,6cyclictest16078-21sshd11:19:450
174542250,3sleep20-21swapper/209:58:352
174542250,3sleep20-21swapper/209:58:352
20558992413,7cyclictest20987-21chrt08:40:032
20558992413,7cyclictest20987-21chrt08:40:032
20558992413,7cyclictest20987-21chrt08:40:032
20558992413,7cyclictest13565-21chrt11:13:402
20558992413,7cyclictest13565-21chrt11:13:402
20558992413,7cyclictest13565-21chrt11:13:402
20556992420,2cyclictest0-21swapper/110:03:431
20556992420,2cyclictest0-21swapper/110:03:431
20556992419,4cyclictest4790-21fschecks_time07:58:331
20556992419,4cyclictest4790-21fschecks_time07:58:331
20556992419,3cyclictest7004-21gltestperf12:23:351
20556992419,3cyclictest7004-21gltestperf12:23:351
20556992419,3cyclictest5239-21tail09:23:431
20556992419,3cyclictest5239-21tail09:23:431
20556992419,3cyclictest0-21swapper/108:48:341
20556992419,3cyclictest0-21swapper/108:48:341
20556992419,3cyclictest0-21swapper/108:48:341
20556992418,5cyclictest28353-21ntp_offset07:33:381
20556992418,5cyclictest28353-21ntp_offset07:33:381
20556992418,5cyclictest28353-21ntp_offset07:33:381
20556992418,3cyclictest0-21swapper/110:23:201
20556992418,3cyclictest0-21swapper/110:23:201
20556992417,5cyclictest30689-21latency_hist09:08:251
20556992417,5cyclictest30689-21latency_hist09:08:251
20556992417,5cyclictest30689-21latency_hist09:08:251
20556992415,7cyclictest21931-21threads10:08:421
20556992415,7cyclictest21931-21threads10:08:421
20556992415,7cyclictest21931-21threads10:08:421
20555992420,2cyclictest0-21swapper/012:33:400
20555992420,2cyclictest0-21swapper/012:33:400
20555992419,3cyclictest0-21swapper/007:43:360
20555992419,3cyclictest0-21swapper/007:43:360
20555992418,4cyclictest0-21swapper/008:28:450
20555992418,4cyclictest0-21swapper/008:28:450
20555992418,4cyclictest0-21swapper/008:28:450
20555992415,7cyclictest3907-21latency_hist09:23:250
20558992313,7cyclictest1251-21chrt10:42:242
20558992313,7cyclictest1251-21chrt10:42:242
20558992313,7cyclictest1251-21chrt10:42:242
20558992313,6cyclictest4457-21chrt12:17:522
20558992313,6cyclictest4457-21chrt12:17:522
20558992313,6cyclictest30900-21chrt07:40:342
20558992313,6cyclictest30900-21chrt07:40:342
20558992312,7cyclictest31823-21chrt10:37:262
20558992312,7cyclictest31823-21chrt10:37:262
20558992312,7cyclictest31823-21chrt10:37:262
20558992312,7cyclictest30418-21chrt09:06:042
20558992312,7cyclictest30418-21chrt09:06:042
20558992312,7cyclictest30418-21chrt09:06:042
20558992312,6cyclictest14777-21chrt09:49:302
20558992312,6cyclictest14777-21chrt09:49:302
20558992312,6cyclictest14777-21chrt09:49:302
20556992319,3cyclictest8860-21gltestperf12:28:351
20556992319,3cyclictest8860-21gltestperf12:28:351
20556992318,3cyclictest0-21swapper/111:18:321
20556992318,3cyclictest0-21swapper/111:18:321
20556992318,3cyclictest0-21swapper/111:18:321
20556992318,3cyclictest0-21swapper/111:08:381
20556992317,5cyclictest30792-21latency10:33:371
20556992317,5cyclictest30792-21latency10:33:371
20556992317,5cyclictest30792-21latency10:33:371
20556992316,5cyclictest9064-21ntp_offset08:08:391
20556992316,5cyclictest9064-21ntp_offset08:08:391
20556992316,5cyclictest8750-21sshd11:02:221
20556992316,5cyclictest8750-21sshd11:02:221
20556992316,5cyclictest8750-21sshd11:02:221
20556992316,5cyclictest8750-21sshd11:02:221
20555992319,2cyclictest0-21swapper/011:28:330
20555992319,2cyclictest0-21swapper/011:28:330
20555992318,3cyclictest0-21swapper/012:18:460
20555992318,3cyclictest0-21swapper/012:18:460
20555992316,5cyclictest28988-21latency_hist09:03:310
20555992316,5cyclictest28988-21latency_hist09:03:310
20555992311,10cyclictest1646-21bingrep12:08:360
20555992311,10cyclictest1646-21bingrep12:08:360
20555992311,10cyclictest1646-21bingrep12:08:360
20564992215,4cyclictest59202sleep312:18:453
20564992215,4cyclictest59202sleep312:18:453
20564992215,4cyclictest59202sleep312:18:453
20558992215,4cyclictest12303-21chrt11:09:302
20558992215,4cyclictest12303-21chrt11:09:302
20558992215,4cyclictest12303-21chrt11:09:302
20558992213,6cyclictest29718-21chrt10:29:182
20558992213,6cyclictest29718-21chrt10:29:182
20558992213,6cyclictest29718-21chrt10:29:182
20558992212,7cyclictest15305-21chrt08:23:512
20558992212,7cyclictest15305-21chrt08:23:512
20558992212,6cyclictest569-21chrt12:06:062
20558992212,6cyclictest569-21chrt12:06:062
20558992212,6cyclictest3143-21chrt10:47:232
20558992212,6cyclictest3143-21chrt10:47:232
20558992212,6cyclictest3143-21chrt10:47:232
20558992212,6cyclictest26022-21chrt10:20:012
20558992212,6cyclictest26022-21chrt10:20:012
20558992212,6cyclictest22494-21chrt10:12:332
20558992212,6cyclictest22494-21chrt10:12:332
20558992212,6cyclictest22494-21chrt10:12:332
20558992212,6cyclictest1897-21chrt09:18:102
20558992212,6cyclictest10992-21chrt09:39:212
20558992212,6cyclictest10992-21chrt09:39:212
20558992212,6cyclictest10992-21chrt09:39:212
20558992211,7cyclictest6955-21chrt10:58:122
20558992211,7cyclictest6955-21chrt10:58:122
20558992211,7cyclictest6955-21chrt10:58:122
20558992211,7cyclictest31120-21taskset12:00:552
20558992211,7cyclictest31120-21taskset12:00:552
20556992218,2cyclictest0-21swapper/108:58:451
20556992218,2cyclictest0-21swapper/108:58:451
20556992218,2cyclictest0-21swapper/108:58:451
20556992218,2cyclictest0-21swapper/108:53:341
20556992218,2cyclictest0-21swapper/108:53:341
20556992218,2cyclictest0-21swapper/108:53:341
20556992217,3cyclictest0-21swapper/111:08:331
20556992217,3cyclictest0-21swapper/111:08:331
20556992217,2cyclictest0-21swapper/107:28:351
20556992217,2cyclictest0-21swapper/107:28:351
20556992213,7cyclictest371-21fschecks_count09:13:321
2055699221,13cyclictest10707-21grep08:13:351
2055699221,13cyclictest10707-21grep08:13:351
20555992217,3cyclictest0-21swapper/012:38:340
20555992217,3cyclictest0-21swapper/012:38:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional