You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 20:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu May 28, 2026 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94021510,2sleep30-21swapper/307:57:533
94021510,2sleep30-21swapper/307:57:533
2225521280,3sleep20-21swapper/211:47:512
168321280,2chrt0-21swapper/310:52:523
168321280,2chrt0-21swapper/310:52:523
3063621210,1sleep10-21swapper/110:42:571
3063621210,1sleep10-21swapper/110:42:571
1015221200,2chrt10154-21fschecks_time12:42:491
1015221200,2chrt10154-21fschecks_time12:42:491
142532990,2sleep10-21swapper/111:27:481
142532990,2sleep10-21swapper/111:27:481
110582980,1chrt11057-21sed09:52:481
110582980,1chrt11057-21sed09:52:481
110582980,1chrt11057-21sed09:52:481
112572970,2sleep30-21swapper/309:52:503
112572970,2sleep30-21swapper/309:52:503
108232880,3sleep20-21swapper/211:17:522
108232880,3sleep20-21swapper/211:17:522
108232880,3sleep20-21swapper/211:17:522
199852740,2sleep20-21swapper/211:42:482
221282710,2sleep10-21swapper/111:47:501
221282710,2sleep10-21swapper/111:47:501
310872610,3sleep20-21swapper/212:12:472
310872610,3sleep20-21swapper/212:12:472
324622570,2sleep30-21swapper/309:22:513
324622570,2sleep30-21swapper/309:22:513
324622570,2sleep30-21swapper/309:22:513
44192510,3chrt0-21swapper/212:27:512
44192510,3chrt0-21swapper/212:27:512
115592510,1sleep10-21swapper/109:52:521
115592510,1sleep10-21swapper/109:52:521
115592510,1sleep10-21swapper/109:52:521
211272500,3sleep20-21swapper/210:17:542
211272500,3sleep20-21swapper/210:17:542
110892500,2chrt11072-21latency11:17:540
110892500,2chrt11072-21latency11:17:540
110892500,2chrt11072-21latency11:17:540
307732490,3sleep20-21swapper/210:42:582
307732490,3sleep20-21swapper/210:42:582
78442470,3sleep20-21swapper/211:07:592
78442470,3sleep20-21swapper/211:07:592
78442470,3sleep20-21swapper/211:07:592
78442470,3sleep20-21swapper/211:07:592
315682460,2sleep20-21swapper/207:52:542
168932460,2sleep20-21swapper/210:07:492
168932460,2sleep20-21swapper/210:07:492
67712440,3sleep20-21swapper/208:12:552
67712440,3sleep20-21swapper/208:12:552
92262420,2chrt0-21swapper/312:38:013
92262420,2chrt0-21swapper/312:38:013
221052420,2sleep122213-21missed_timers07:27:531
221052420,2sleep122213-21missed_timers07:27:531
221052420,2sleep122213-21missed_timers07:27:531
131212420,2sleep013159-21ntp_states11:22:570
131212420,2sleep013159-21ntp_states11:22:570
290222410,3sleep129026-21timerandwakeup10:37:591
290222410,3sleep129026-21timerandwakeup10:37:591
290222410,3sleep129026-21timerandwakeup10:37:591
16073993733,3cyclictest24550-21systemctl09:02:381
16073993733,3cyclictest24550-21systemctl09:02:381
16073993730,5cyclictest29441-21cut12:07:501
16073993730,5cyclictest29441-21cut12:07:501
101502370,2sleep110156-21gltestperf08:22:511
101502370,2sleep110156-21gltestperf08:22:511
101502370,2sleep110156-21gltestperf08:22:511
257772360,2sleep025780-21grep11:57:500
257772360,2sleep025780-21grep11:57:500
16073993630,4cyclictest572-21cups-browsed10:27:561
16073993630,4cyclictest572-21cups-browsed10:27:561
138652360,3chrt0-21swapper/308:32:503
247202340,3sleep20-21swapper/210:27:512
247202340,3sleep20-21swapper/210:27:512
207242340,2sleep30-21swapper/311:42:573
207242340,2sleep30-21swapper/311:42:573
16073993427,5cyclictest32491-21fschecks_time09:22:511
16073993427,5cyclictest32491-21fschecks_time09:22:511
16073993427,5cyclictest32491-21fschecks_time09:22:511
16070993324,7cyclictest26311-21processes11:57:560
16070993324,7cyclictest26311-21processes11:57:560
314392320,2sleep131567-21sed07:52:531
276792320,3sleep20-21swapper/209:07:592
276792320,3sleep20-21swapper/209:07:592
276792320,3sleep20-21swapper/209:07:592
16070993226,4cyclictest1692-21unixbench-2d12:18:000
16070993226,4cyclictest1692-21unixbench-2d12:18:000
273652310,3sleep20-21swapper/210:33:012
273652310,3sleep20-21swapper/210:33:012
16073993124,5cyclictest17824-21timerwakeupswit10:07:591
16073993124,5cyclictest17824-21timerwakeupswit10:07:591
16073993123,6cyclictest24639-21unixbench-2d07:33:001
16073993123,6cyclictest24639-21unixbench-2d07:33:001
16070993125,4cyclictest11971-21gltestperf08:27:510
16070993125,4cyclictest11971-21gltestperf08:27:510
16070993125,4cyclictest11971-21gltestperf08:27:510
16070993124,5cyclictest550-21cron08:12:490
16070993124,5cyclictest550-21cron08:12:490
16070993124,5cyclictest17702-21switchtime10:07:580
16070993124,5cyclictest17702-21switchtime10:07:580
16070993123,6cyclictest26013-21needreboot07:37:530
16070993123,6cyclictest26013-21needreboot07:37:530
66022300,1sleep3431rcuc/312:32:503
222142300,3sleep20-21swapper/207:27:532
222142300,3sleep20-21swapper/207:27:532
222142300,3sleep20-21swapper/207:27:532
16073993026,2cyclictest0-21swapper/109:02:551
16073993026,2cyclictest0-21swapper/109:02:551
16073993026,2cyclictest0-21swapper/109:02:551
16073993026,2cyclictest0-21swapper/108:02:381
16073993026,2cyclictest0-21swapper/108:02:381
16073993025,4cyclictest572-21cups-browsed11:07:571
16073993025,4cyclictest572-21cups-browsed11:07:571
16073993025,4cyclictest572-21cups-browsed11:07:571
16073993025,4cyclictest572-21cups-browsed11:07:571
16073993024,4cyclictest16066-21cyclictest08:37:561
16073993024,4cyclictest16066-21cyclictest08:37:561
16073993024,4cyclictest1346-21avahi-daemon10:17:591
16073993024,4cyclictest1346-21avahi-daemon10:17:591
16070993025,4cyclictest749-21runrttasks09:12:520
16070993025,4cyclictest749-21runrttasks09:12:520
16070993025,4cyclictest749-21runrttasks09:12:520
16070993025,4cyclictest32657-21switchtime10:47:590
16070993025,4cyclictest32657-21switchtime10:47:590
16070993025,3cyclictest2808-21gltestperf12:22:510
16070993025,3cyclictest2808-21gltestperf12:22:510
16070993023,5cyclictest17058-21latency_hist08:42:370
16070993023,5cyclictest17058-21latency_hist08:42:370
16073992925,3cyclictest4664-21sendmail11:02:371
16073992925,3cyclictest4664-21sendmail11:02:371
16073992925,3cyclictest4664-21sendmail11:02:371
16073992924,4cyclictest16066-21cyclictest08:07:581
16073992924,4cyclictest16066-21cyclictest08:07:581
16073992923,5cyclictest29745-21kernelversion12:07:521
16073992923,5cyclictest29745-21kernelversion12:07:521
16073992923,4cyclictest547-21rs:main1
16073992923,4cyclictest547-21rs:main1
16073992923,4cyclictest547-21rs:main1
16073992922,5cyclictest6617-21latency_hist11:07:401
16073992922,5cyclictest6617-21latency_hist11:07:401
16073992922,5cyclictest6617-21latency_hist11:07:401
16073992922,5cyclictest4029-21latency_hist08:07:431
16073992922,5cyclictest4029-21latency_hist08:07:431
16073992921,6cyclictest15896-21threads10:02:591
16073992921,6cyclictest15896-21threads10:02:591
16070992924,4cyclictest4735-21unixbench-2d09:33:010
16070992924,4cyclictest4735-21unixbench-2d09:33:010
16070992924,4cyclictest4488-21gltestperf08:07:510
16070992924,4cyclictest4488-21gltestperf08:07:510
16070992924,3cyclictest9568-21wc08:22:370
16070992924,3cyclictest7079-21latency_hist11:07:500
16070992924,3cyclictest7079-21latency_hist11:07:500
16070992922,5cyclictest8007-21latency_hist12:37:470
16070992922,5cyclictest8007-21latency_hist12:37:470
16070992921,6cyclictest23695-21processes08:57:570
16070992921,6cyclictest23695-21processes08:57:570
142752291,25sleep014299-21ntp_states08:32:560
16073992822,4cyclictest572-21cups-browsed11:27:581
16073992821,5cyclictest30257-21latency_hist09:17:431
16073992821,5cyclictest30257-21latency_hist09:17:431
16073992821,5cyclictest30257-21latency_hist09:17:431
16073992821,5cyclictest13831-21gltestperf08:32:501
16073992820,6cyclictest2687-21cut12:22:501
16073992820,6cyclictest2687-21cut12:22:501
16070992824,3cyclictest29824-21ntp_offset07:47:560
16070992824,3cyclictest29824-21ntp_offset07:47:560
16070992824,3cyclictest29824-21ntp_offset07:47:560
16070992823,3cyclictest22275-21unixbench_singl08:53:010
16070992823,3cyclictest22275-21unixbench_singl08:53:010
16070992822,5cyclictest30574-21ntp_offset10:42:560
16070992822,5cyclictest30574-21ntp_offset10:42:560
16070992822,4cyclictest4021-21timerandwakeup10:57:590
16070992822,4cyclictest4021-21timerandwakeup10:57:590
16070992822,4cyclictest4021-21timerandwakeup10:57:590
16070992822,4cyclictest3361-21cron09:32:380
16070992822,4cyclictest3361-21cron09:32:380
16070992822,4cyclictest3361-21cron09:32:380
16070992822,4cyclictest0-21swapper/011:02:490
16073992723,2cyclictest0-21swapper/110:12:581
16073992723,2cyclictest0-21swapper/110:12:581
16073992721,4cyclictest0-21swapper/110:02:501
16073992721,4cyclictest0-21swapper/110:02:501
16073992720,5cyclictest19196-21unixbench-2d11:38:001
16073992720,5cyclictest19196-21unixbench-2d11:38:001
16073992720,5cyclictest16066-21cyclictest11:32:531
16073992720,5cyclictest16066-21cyclictest11:32:531
16073992720,5cyclictest11013-21kernelversion11:17:531
16073992720,5cyclictest11013-21kernelversion11:17:531
16073992720,5cyclictest11013-21kernelversion11:17:531
16070992722,3cyclictest0-21swapper/011:37:590
16070992722,3cyclictest0-21swapper/011:37:590
16070992722,3cyclictest0-21swapper/010:02:580
16070992722,3cyclictest0-21swapper/010:02:580
16070992721,4cyclictest749-21runrttasks07:42:590
16070992721,4cyclictest749-21runrttasks07:42:590
16070992721,4cyclictest749-21runrttasks07:42:590
16070992721,4cyclictest29674-21unixbench-2d09:12:590
16070992721,4cyclictest29674-21unixbench-2d09:12:590
16070992721,4cyclictest29674-21unixbench-2d09:12:590
16070992721,4cyclictest11413-21gltestperf09:52:510
16070992721,4cyclictest0-21swapper/010:42:500
16070992721,4cyclictest0-21swapper/010:42:500
16070992721,4cyclictest0-21swapper/010:42:500
16070992720,5cyclictest20444-21ntp_offset07:22:570
16070992720,5cyclictest20444-21ntp_offset07:22:570
16070992719,6cyclictest460-21latency_hist12:17:450
16070992719,6cyclictest460-21latency_hist12:17:450
16070992719,6cyclictest460-21latency_hist12:17:450
16070992719,6cyclictest29343-21fschecks_count12:07:500
16070992719,6cyclictest29343-21fschecks_count12:07:500
16070992719,5cyclictest0-21swapper/008:42:560
16070992719,5cyclictest0-21swapper/008:42:560
260612260,3sleep20-21swapper/211:57:522
16073992622,3cyclictest27547-21systemctl09:07:581
16073992622,3cyclictest27547-21systemctl09:07:581
16073992622,3cyclictest27547-21systemctl09:07:581
16073992622,2cyclictest0-21swapper/110:27:381
16073992622,2cyclictest0-21swapper/110:27:381
16073992622,2cyclictest0-21swapper/110:27:381
16073992621,4cyclictest14678-21systemd-journal11:58:001
16073992621,4cyclictest14678-21systemd-journal11:58:001
16073992621,3cyclictest7660-21cron08:17:371
16073992621,3cyclictest7660-21cron08:17:371
16073992620,3cyclictest0-21swapper/111:52:531
16073992620,3cyclictest0-21swapper/111:52:531
16073992619,5cyclictest27916-21latency_hist10:37:471
16073992619,5cyclictest27916-21latency_hist10:37:471
16073992618,6cyclictest7608-21cut09:42:511
16073992618,6cyclictest7608-21cut09:42:511
16073992618,6cyclictest25361-21wc07:37:461
16073992618,6cyclictest25361-21wc07:37:461
16070992621,3cyclictest0-21swapper/009:42:380
16070992621,3cyclictest0-21swapper/009:42:380
16070992621,3cyclictest0-21swapper/007:27:490
16070992621,3cyclictest0-21swapper/007:27:490
16070992621,3cyclictest0-21swapper/007:27:490
16070992620,5cyclictest32090-21unixbench-2d07:53:000
16070992620,5cyclictest27071-21latency_hist09:07:510
16070992620,5cyclictest27071-21latency_hist09:07:510
16070992620,5cyclictest27071-21latency_hist09:07:510
16070992620,4cyclictest8994-21gltestperf11:12:510
16070992620,4cyclictest23833-21gltestperf07:32:510
16070992620,4cyclictest23833-21gltestperf07:32:510
16070992618,6cyclictest7494-21fschecks_count09:42:500
16070992618,6cyclictest7494-21fschecks_count09:42:500
16070992618,6cyclictest24431-21cut10:27:480
16070992618,6cyclictest24431-21cut10:27:480
16070992618,6cyclictest24431-21cut10:27:480
16070992618,6cyclictest20610-21fschecks_count10:17:500
16070992618,6cyclictest20610-21fschecks_count10:17:500
16073992521,2cyclictest0-21swapper/109:37:491
16073992521,2cyclictest0-21swapper/109:37:491
16073992520,3cyclictest0-21swapper/112:22:491
16073992520,3cyclictest0-21swapper/108:52:511
16073992520,3cyclictest0-21swapper/108:52:511
16073992520,3cyclictest0-21swapper/108:52:491
16073992520,3cyclictest0-21swapper/108:28:001
16073992520,3cyclictest0-21swapper/108:28:001
16073992520,3cyclictest0-21swapper/108:28:001
16073992520,2cyclictest0-21swapper/110:48:011
16073992520,2cyclictest0-21swapper/110:48:011
16073992519,5cyclictest2733-21threads09:27:581
16073992519,5cyclictest2733-21threads09:27:581
16073992519,5cyclictest2733-21threads09:27:581
16070992520,4cyclictest32587-21gltestperf09:22:520
16070992520,4cyclictest32587-21gltestperf09:22:520
16070992520,4cyclictest32587-21gltestperf09:22:520
16070992520,3cyclictest13275-21gltestperf09:57:500
16070992520,3cyclictest13275-21gltestperf09:57:500
16070992519,4cyclictest15487-21unixbench_multi11:28:000
16070992519,4cyclictest0-21swapper/010:12:580
16070992519,4cyclictest0-21swapper/010:12:580
16070992517,5cyclictest0-21swapper/011:42:500
16070992517,5cyclictest0-21swapper/011:42:500
16073992418,4cyclictest20428-21ntp_kernel_pll_07:22:571
16073992418,4cyclictest20428-21ntp_kernel_pll_07:22:571
16073992418,4cyclictest0-21swapper/112:12:521
16073992418,4cyclictest0-21swapper/112:12:521
16073992418,4cyclictest0-21swapper/112:12:521
16073992418,4cyclictest0-21swapper/108:42:521
16073992418,4cyclictest0-21swapper/108:42:521
16073992418,4cyclictest0-21swapper/108:17:521
16073992417,5cyclictest821-21gltestperf12:17:501
16073992417,5cyclictest550-21cron07:47:381
16073992417,5cyclictest550-21cron07:47:381
16073992417,5cyclictest550-21cron07:47:381
16070992420,3cyclictest749-21runrttasks09:57:380
16070992419,4cyclictest1945-21gltestperf09:27:500
16070992419,4cyclictest1945-21gltestperf09:27:500
16070992419,4cyclictest1945-21gltestperf09:27:500
16070992419,4cyclictest17608-21sshd11:35:000
16070992419,4cyclictest17608-21sshd11:35:000
16070992419,3cyclictest21700-21/usr/sbin/munin11:47:540
16070992419,3cyclictest21700-21/usr/sbin/munin11:47:540
16070992419,3cyclictest0-21swapper/012:37:500
16070992419,3cyclictest0-21swapper/012:37:500
16070992417,4cyclictest0-21swapper/012:27:590
16070992417,4cyclictest0-21swapper/012:27:590
224892230,2sleep122490-21/usr/sbin/munin11:47:541
224892230,2sleep122490-21/usr/sbin/munin11:47:541
16073992318,3cyclictest0-21swapper/108:47:581
16070992318,4cyclictest7939-21unixbench_multi11:07:590
16070992318,4cyclictest7939-21unixbench_multi11:07:590
16070992318,4cyclictest7939-21unixbench_multi11:07:590
16070992317,4cyclictest11371-21fschecks_time09:52:510
16070992317,4cyclictest0-21swapper/012:08:120
16070992317,4cyclictest0-21swapper/012:08:120
16070992317,4cyclictest0-21swapper/010:37:370
16070992317,4cyclictest0-21swapper/010:37:370
16070992317,4cyclictest0-21swapper/008:52:390
16070992317,4cyclictest0-21swapper/008:52:390
16070992317,3cyclictest0-21swapper/010:02:380
16070992317,3cyclictest0-21swapper/010:02:380
16070992317,3cyclictest0-21swapper/010:02:380
16070992316,5cyclictest0-21swapper/011:13:000
16070992316,5cyclictest0-21swapper/011:13:000
16073992218,2cyclictest0-21swapper/107:47:491
16073992218,2cyclictest0-21swapper/107:47:491
16073992218,2cyclictest0-21swapper/107:47:491
16073992216,4cyclictest14783-21latency_hist10:02:451
16073992216,3cyclictest0-21swapper/112:27:541
16073992216,3cyclictest0-21swapper/112:27:541
16073992215,4cyclictest0-21swapper/110:52:501
16073992215,4cyclictest0-21swapper/110:52:501
16070992218,2cyclictest0-21swapper/010:53:040
16070992218,2cyclictest0-21swapper/010:53:040
16070992217,3cyclictest0-21swapper/009:52:380
16070992215,5cyclictest10012-21fschecks_time08:22:510
16070992215,5cyclictest10012-21fschecks_time08:22:510
16070992215,5cyclictest10012-21fschecks_time08:22:510
16070992215,4cyclictest0-21swapper/010:31:590
16070992215,4cyclictest0-21swapper/010:31:590
16073992116,3cyclictest0-21swapper/112:32:541
16073992116,3cyclictest0-21swapper/112:32:541
16073992116,2cyclictest0-21swapper/109:32:591
16073992116,2cyclictest0-21swapper/109:32:591
16073992115,3cyclictest0-21swapper/111:13:001
16073992115,3cyclictest0-21swapper/111:13:001
16070992117,2cyclictest0-21swapper/008:03:020
16070992117,2cyclictest0-21swapper/008:03:020
16070992116,3cyclictest0-21swapper/007:57:500
16070992116,3cyclictest0-21swapper/007:57:500
95542200,2sleep30-21swapper/308:22:373
29392200,3sleep30-21swapper/308:02:553
29392200,3sleep30-21swapper/308:02:553
1607599201,14cyclictest19480-21chrt10:12:563
1607599201,14cyclictest19480-21chrt10:12:563
189772190,3sleep30-21swapper/311:37:593
189772190,3sleep30-21swapper/311:37:593
1607599193,10cyclictest0-21swapper/312:34:003
1607599193,10cyclictest0-21swapper/312:34:003
1607499183,12cyclictest15728-21chrt08:37:522
1607499183,12cyclictest15728-21chrt08:37:522
1607499181,13cyclictest10246-21chrt11:16:592
1607499181,13cyclictest10246-21chrt11:16:592
1607499181,12cyclictest25533-21chrt11:57:482
60052170,3sleep20-21swapper/208:12:472
60052170,3sleep20-21swapper/208:12:472
16074991712,3cyclictest323372sleep209:22:502
16074991712,3cyclictest323372sleep209:22:502
16074991712,3cyclictest323372sleep209:22:502
16074991711,4cyclictest137462sleep209:57:562
16074991711,4cyclictest137462sleep209:57:562
16074991711,4cyclictest137462sleep209:57:562
1607499171,11cyclictest29306-21chrt12:07:492
1607499171,11cyclictest29306-21chrt12:07:492
31302160,3sleep20-21swapper/210:57:502
31302160,3sleep20-21swapper/210:57:502
31302160,3sleep20-21swapper/210:57:502
1607599162,10cyclictest0-21swapper/310:28:593
1607599162,10cyclictest0-21swapper/310:28:593
1607599161,12cyclictest28749-21chrtset10:37:573
1607599161,12cyclictest28749-21chrtset10:37:573
1607599161,12cyclictest28749-21chrtset10:37:573
1607599161,11cyclictest28093-21taskset07:42:573
1607599161,11cyclictest28093-21taskset07:42:573
1607599161,11cyclictest28093-21taskset07:42:573
1607599161,11cyclictest16279-21chrt11:32:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional