You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 00:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Apr 05, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
365121380,3sleep20-21swapper/209:22:102
365121380,3sleep20-21swapper/209:22:102
365121380,3sleep20-21swapper/209:22:102
2743521130,3sleep30-21swapper/307:32:123
105721090,3chrt0-21swapper/310:42:113
105721090,3chrt0-21swapper/310:42:113
105721090,3chrt0-21swapper/310:42:113
510121060,2chrt0-21swapper/210:52:112
510121060,2chrt0-21swapper/210:52:112
2029821030,3chrt0-21swapper/310:07:093
2029821030,3chrt0-21swapper/310:07:093
232172990,4sleep30-21swapper/311:42:043
232172990,4sleep30-21swapper/311:42:043
62922950,3sleep30-21swapper/308:02:113
62922950,3sleep30-21swapper/308:02:113
254362950,3sleep30-21swapper/308:56:503
6132860,2chrt0-21swapper/207:47:112
6132860,2chrt0-21swapper/207:47:112
199332770,3sleep20-21swapper/210:07:042
199332770,3sleep20-21swapper/210:07:042
114202770,3chrt0-21swapper/308:17:073
114202770,3chrt0-21swapper/308:17:073
34702760,3chrt0-21swapper/107:57:031
34702760,3chrt0-21swapper/107:57:031
311552750,2sleep031159-21timerwakeupswit12:02:110
311552750,2sleep031159-21timerwakeupswit12:02:110
311552750,2sleep031159-21timerwakeupswit12:02:110
144902750,4sleep30-21swapper/311:17:123
144902750,4sleep30-21swapper/311:17:123
144902750,4sleep30-21swapper/311:17:123
90292730,2chrt0-21swapper/109:37:081
90292730,2chrt0-21swapper/109:37:081
130392720,3sleep20-21swapper/208:22:042
130392720,3sleep20-21swapper/208:22:042
297722700,3chrt0-21swapper/309:07:033
297722700,3chrt0-21swapper/309:07:033
176072680,3sleep0171ktimers/010:02:000
176072680,3sleep0171ktimers/010:02:000
39942640,3chrt0-21swapper/310:51:593
39942640,3chrt0-21swapper/310:51:593
21142620,3chrt0-21swapper/210:47:002
21142620,3chrt0-21swapper/210:47:002
21142620,3chrt0-21swapper/210:47:002
25702580,2chrt0-21swapper/009:21:560
25702580,2chrt0-21swapper/009:21:560
25702580,2chrt0-21swapper/009:21:560
275152560,2sleep20-21swapper/211:52:122
76602550,3sleep20-21swapper/208:07:092
76602550,3sleep20-21swapper/208:07:092
98092530,1chrt0-21swapper/211:07:022
50652510,3chrt0-21swapper/209:27:042
50652510,3chrt0-21swapper/209:27:042
289002510,2chrt0-21swapper/310:32:023
289002510,2chrt0-21swapper/310:32:023
118232500,3chrt0-21swapper/208:17:102
118232500,3chrt0-21swapper/208:17:102
77232480,2chrt0-21swapper/211:01:592
326072470,3sleep30-21swapper/307:47:083
326072470,3sleep30-21swapper/307:47:083
178432450,3chrt0-21swapper/210:02:022
178432450,3chrt0-21swapper/210:02:022
327472440,2sleep132748-21/usr/sbin/munin12:07:111
327472440,2sleep132748-21/usr/sbin/munin12:07:111
18896994436,6cyclictest7636-21netstat08:07:080
18896994436,6cyclictest7636-21netstat08:07:080
46192420,3sleep30-21swapper/309:27:013
189072410,3sleep118893-21cyclictest10:02:491
189072410,3sleep118893-21cyclictest10:02:491
253282380,2sleep30-21swapper/307:27:103
253282380,2sleep30-21swapper/307:27:103
206862380,6sleep120685-21needreboot08:42:051
18897993831,5cyclictest24834-21latency_hist10:21:491
18897993831,5cyclictest24834-21latency_hist10:21:491
18897993831,5cyclictest24834-21latency_hist10:21:491
18896993631,4cyclictest1816-21wc10:46:490
18896993631,4cyclictest1816-21wc10:46:490
18896993631,4cyclictest1816-21wc10:46:490
18896993529,4cyclictest28571-21latency_hist10:31:490
18896993528,5cyclictest601-21snmpd10:25:080
18896993528,5cyclictest601-21snmpd10:25:080
18896993528,5cyclictest601-21snmpd10:25:080
18896993526,7cyclictest25179-21fschecks_count10:22:000
18896993526,7cyclictest25179-21fschecks_count10:22:000
301372340,3sleep030136-21sort07:42:020
301372340,3sleep030136-21sort07:42:020
292602340,5sleep029264-21unixbench_multi07:37:120
292602340,5sleep029264-21unixbench_multi07:37:120
268002340,3chrt0-21swapper/210:26:542
268002340,3chrt0-21swapper/210:26:542
268002340,3chrt0-21swapper/210:26:542
18896993427,5cyclictest12318-21latency_hist08:21:490
18896993427,5cyclictest12318-21latency_hist08:21:490
18896993426,6cyclictest4958-21idleruntime-cro12:21:490
18896993426,6cyclictest4958-21idleruntime-cro12:21:490
142722340,2sleep114358-21ls09:52:051
141912340,3chrt0-21swapper/111:17:101
141912340,3chrt0-21swapper/111:17:101
141912340,3chrt0-21swapper/111:17:101
194892330,1sleep119490-21sshd08:38:081
194892330,1sleep119490-21sshd08:38:081
1889999331,3cyclictest0-21swapper/211:11:532
1889999331,3cyclictest0-21swapper/211:11:532
1889999331,21cyclictest0-21swapper/210:27:522
18896993325,6cyclictest545-21in:imuxsock08:46:500
18896993325,5cyclictest32462-21latency_hist10:41:550
18896993325,5cyclictest32462-21latency_hist10:41:550
18896993319,12cyclictest0-21swapper/011:47:010
1889999321,1cyclictest0-21swapper/210:41:222
1889999321,1cyclictest0-21swapper/210:41:222
18897993227,3cyclictest0-21swapper/111:41:491
18897993227,3cyclictest0-21swapper/111:41:491
18897993225,5cyclictest12027-21grep11:12:061
18897993225,5cyclictest12027-21grep11:12:061
150902320,3sleep10-21swapper/108:27:051
150902320,3sleep10-21swapper/108:27:051
311192310,3sleep20-21swapper/207:42:122
311192310,3sleep20-21swapper/207:42:122
18896993126,4cyclictest547-21rs:main0
18896993126,4cyclictest547-21rs:main0
18896993124,5cyclictest29463-21needreboot10:32:070
18896993124,5cyclictest29463-21needreboot10:32:070
18896993124,5cyclictest18893-21cyclictest09:43:440
18896993124,5cyclictest18893-21cyclictest09:43:440
18896993124,5cyclictest18893-21cyclictest09:43:440
18896993122,7cyclictest0-21swapper/011:37:540
18896993122,7cyclictest0-21swapper/011:37:540
18896993118,8cyclictest0-21swapper/012:40:250
18896993118,8cyclictest0-21swapper/012:40:250
1889999301,20cyclictest0-21swapper/208:49:202
1889999301,20cyclictest0-21swapper/208:49:202
18897993023,5cyclictest27644-21sshd07:34:081
18897993023,5cyclictest10554-21latency_hist12:36:491
18897993023,5cyclictest10554-21latency_hist12:36:491
18896993023,5cyclictest8986-21sshd11:03:080
18896993023,5cyclictest8986-21sshd11:03:080
18896993023,5cyclictest6092-21cut10:57:020
18896993023,5cyclictest6092-21cut10:57:020
18896993023,5cyclictest28997-21processes11:57:090
18896993023,5cyclictest28997-21processes11:57:090
18896993023,5cyclictest28997-21processes11:57:090
18896993023,5cyclictest18893-21cyclictest10:15:350
18896993023,5cyclictest18893-21cyclictest10:15:350
18896993021,7cyclictest19941-21kernelversion10:07:040
18896993021,7cyclictest19941-21kernelversion10:07:040
237922290,3sleep20-21swapper/211:42:112
237922290,3sleep20-21swapper/211:42:112
212782290,3chrt0-21swapper/107:17:071
1889999291,24cyclictest29570-21chrt07:39:592
1889999291,24cyclictest29570-21chrt07:39:592
1889999291,23cyclictest6520-21chrt08:04:272
1889999291,23cyclictest6520-21chrt08:04:272
1889999291,23cyclictest29629-21chrt11:59:202
1889999291,23cyclictest29629-21chrt11:59:202
1889999291,23cyclictest29629-21chrt11:59:202
1889999291,23cyclictest15273-21chrt09:54:222
1889999291,23cyclictest147182sleep211:19:532
1889999291,23cyclictest147182sleep211:19:532
1889999291,23cyclictest147182sleep211:19:532
1889999291,22cyclictest30726-21chrt09:08:192
1889999291,22cyclictest30726-21chrt09:08:192
18897992923,5cyclictest1346-21avahi-daemon08:52:091
18897992922,5cyclictest22074-21fschecks_count08:47:021
18897992922,5cyclictest22074-21fschecks_count08:47:021
18897992922,5cyclictest1666-21gltestperf07:52:021
18897992921,6cyclictest29360-21/usr/sbin/munin09:07:071
18897992921,6cyclictest29360-21/usr/sbin/munin09:07:071
18896992922,5cyclictest27737-21cut09:02:020
18896992922,5cyclictest27737-21cut09:02:020
18896992922,5cyclictest17774-21sshd08:35:080
18896992922,5cyclictest17774-21sshd08:35:080
18896992922,5cyclictest17774-21sshd08:35:080
18896992922,5cyclictest14540-21ntp_kernel_err09:52:080
18896992920,7cyclictest18435-21gltestperf08:37:020
18896992920,7cyclictest18435-21gltestperf08:37:020
18896992916,9cyclictest0-21swapper/010:56:230
18896992916,9cyclictest0-21swapper/010:56:230
18896992916,7cyclictest90-1pr/ttyS007:31:170
18896992916,7cyclictest90-1pr/ttyS007:31:170
18896992912,12cyclictest0-21swapper/007:55:480
251282280,3sleep20-21swapper/211:47:062
1889999281,2cyclictest0-21swapper/212:12:252
1889999281,2cyclictest0-21swapper/212:12:252
1889999281,2cyclictest0-21swapper/207:17:172
1889999281,23cyclictest9269-21chrt11:06:462
1889999281,23cyclictest32569-21chrt09:12:452
1889999281,23cyclictest32569-21chrt09:12:452
1889999281,22cyclictest30195-21chrt10:33:532
1889999281,22cyclictest30195-21chrt10:33:532
1889999281,22cyclictest27235-21chrt09:01:402
1889999281,22cyclictest27235-21chrt09:01:402
1889999281,22cyclictest24515-21chrt10:18:062
1889999281,22cyclictest24515-21chrt10:18:062
1889999281,22cyclictest24515-21chrt10:18:062
1889999281,22cyclictest13385-21chrt09:49:032
1889999281,22cyclictest13385-21chrt09:49:032
1889999281,22cyclictest13385-21chrt09:49:032
1889999281,20cyclictest0-21swapper/207:57:482
1889999281,20cyclictest0-21swapper/207:57:482
1889999281,1cyclictest0-21swapper/211:37:542
1889999281,1cyclictest0-21swapper/211:37:542
1889999281,1cyclictest0-21swapper/208:34:192
1889999281,1cyclictest0-21swapper/208:34:192
1889999281,1cyclictest0-21swapper/208:34:192
1889999280,24cyclictest4833-21chrt12:20:302
1889999280,24cyclictest4833-21chrt12:20:302
1889999280,24cyclictest20194-21chrt11:33:032
1889999280,23cyclictest18531-21chrt11:30:422
1889999280,23cyclictest18531-21chrt11:30:422
1889999280,23cyclictest12095-21chrt12:37:432
1889999280,23cyclictest12095-21chrt12:37:432
18897992823,4cyclictest18893-21cyclictest07:27:101
18897992823,4cyclictest18893-21cyclictest07:27:101
18897992823,4cyclictest142-21systemd-journal10:33:081
18897992823,4cyclictest142-21systemd-journal10:33:081
18897992823,3cyclictest18893-21cyclictest11:36:561
18897992823,3cyclictest0-21swapper/112:01:491
18897992823,3cyclictest0-21swapper/112:01:491
18897992823,3cyclictest0-21swapper/112:01:491
18897992822,4cyclictest6416-21unixbench_singl12:22:121
18897992822,4cyclictest6416-21unixbench_singl12:22:121
18897992822,4cyclictest6416-21unixbench_singl12:22:121
18897992821,5cyclictest27997-21kernelversion09:02:041
18897992821,5cyclictest27997-21kernelversion09:02:041
18897992820,6cyclictest19699-21fschecks_time10:07:021
18897992820,6cyclictest19699-21fschecks_time10:07:021
18897992819,7cyclictest8758-21latency_hist12:31:521
18897992819,7cyclictest8758-21latency_hist12:31:521
18896992822,4cyclictest11688-21gltestperf11:12:020
18896992822,4cyclictest11688-21gltestperf11:12:020
18896992822,3cyclictest0-21swapper/010:17:070
18896992821,5cyclictest8634-21sshd12:31:100
18896992821,5cyclictest8634-21sshd12:31:100
18896992818,2cyclictest181rcu_preempt12:35:390
18896992818,2cyclictest181rcu_preempt12:35:390
14592280,2sleep20-21swapper/207:52:012
112172280,1sleep1271rcuc/112:37:021
112172280,1sleep1271rcuc/112:37:021
1889999271,2cyclictest0-21swapper/211:13:532
1889999271,2cyclictest0-21swapper/211:13:532
1889999271,22cyclictest9769-21chrt09:40:432
1889999271,22cyclictest9769-21chrt09:40:432
1889999271,22cyclictest849-21chrt12:07:242
1889999271,22cyclictest849-21chrt12:07:242
1889999271,22cyclictest6479-21chrt12:22:232
1889999271,22cyclictest6479-21chrt12:22:232
1889999271,22cyclictest6479-21chrt12:22:232
1889999271,22cyclictest27573-21chrt07:33:122
1889999271,22cyclictest23913-21chrt07:24:032
1889999271,22cyclictest23913-21chrt07:24:032
1889999271,22cyclictest17045-21chrt09:58:122
1889999271,22cyclictest17045-21chrt09:58:122
1889999271,22cyclictest10172-21chrt08:13:322
1889999271,22cyclictest10172-21chrt08:13:322
1889999271,21cyclictest8390-21chrt12:28:022
1889999271,21cyclictest8390-21chrt12:28:022
1889999271,21cyclictest7812-21chrt09:34:282
1889999271,21cyclictest7812-21chrt09:34:282
1889999271,21cyclictest7131-21chrt10:58:302
1889999271,21cyclictest21482-21chrt08:44:312
1889999270,23cyclictest3323-21chrt10:47:242
1889999270,23cyclictest3323-21chrt10:47:242
1889999270,22cyclictest22671-21chrt10:13:192
1889999270,22cyclictest22671-21chrt10:13:192
18897992723,3cyclictest18893-21cyclictest09:01:561
18897992723,3cyclictest18893-21cyclictest09:01:561
18897992722,4cyclictest18893-21cyclictest09:16:491
18897992722,4cyclictest18893-21cyclictest09:16:491
18897992719,6cyclictest5924-21kworker/u9:4-rpciod09:46:591
18897992719,6cyclictest5924-21kworker/u9:4-rpciod09:46:591
18897992719,6cyclictest5924-21kworker/u9:4-rpciod09:46:591
18897992719,6cyclictest32035-21fschecks_time07:47:011
18897992719,6cyclictest32035-21fschecks_time07:47:011
1889799271,21cyclictest3433-21which09:22:081
1889799271,21cyclictest3433-21which09:22:081
1889799271,21cyclictest3433-21which09:22:081
1889699276,5cyclictest171ktimers/011:49:540
18896992721,3cyclictest0-21swapper/009:31:590
18896992721,3cyclictest0-21swapper/009:31:590
107732270,3sleep20-21swapper/209:42:082
107732270,3sleep20-21swapper/209:42:082
107732270,3sleep20-21swapper/209:42:082
1889999261,2cyclictest0-21swapper/212:04:252
1889999261,2cyclictest0-21swapper/212:04:252
1889999261,2cyclictest0-21swapper/212:04:252
1889999261,22cyclictest28864-21chrt09:03:202
1889999261,22cyclictest28864-21chrt09:03:202
1889999261,22cyclictest16471-21chrt11:23:102
1889999261,22cyclictest16471-21chrt11:23:102
1889999261,22cyclictest16471-21chrt11:23:102
1889999261,21cyclictest25897-21taskset07:30:382
1889999261,21cyclictest25897-21taskset07:30:382
1889999261,21cyclictest25048-21chrt08:52:272
1889999261,21cyclictest10300-21chrt12:33:372
1889999261,21cyclictest10300-21chrt12:33:372
1889999260,22cyclictest2226-21chrt09:19:452
1889999260,22cyclictest2226-21chrt09:19:452
1889999260,22cyclictest2226-21chrt09:19:452
1889999260,22cyclictest15764-21chrt08:28:112
1889999260,22cyclictest15764-21chrt08:28:112
1889999260,21cyclictest19465-21chrt08:37:482
1889999260,21cyclictest19465-21chrt08:37:482
18897992621,3cyclictest0-21swapper/110:27:081
18897992620,5cyclictest7940-21sshd09:36:081
18897992620,5cyclictest7940-21sshd09:36:081
18897992620,5cyclictest28054-21latency_hist11:56:521
18897992620,4cyclictest0-21swapper/109:17:041
18897992620,4cyclictest0-21swapper/109:17:041
18897992620,4cyclictest0-21swapper/109:17:041
18897992620,3cyclictest0-21swapper/107:46:491
18897992620,3cyclictest0-21swapper/107:46:491
18897992619,5cyclictest5990-21fschecks_time10:57:011
18897992619,5cyclictest5990-21fschecks_time10:57:011
18896992621,3cyclictest0-21swapper/010:47:080
18896992621,3cyclictest0-21swapper/010:47:080
18896992621,3cyclictest0-21swapper/009:47:100
18896992621,3cyclictest0-21swapper/009:47:100
18896992621,3cyclictest0-21swapper/009:47:100
18896992620,4cyclictest18893-21cyclictest09:22:040
18896992620,4cyclictest18893-21cyclictest09:22:040
18896992620,4cyclictest18893-21cyclictest09:22:040
18896992620,4cyclictest18893-21cyclictest08:12:120
18896992620,4cyclictest18893-21cyclictest08:12:120
18896992620,4cyclictest0-21swapper/011:32:080
18896992619,5cyclictest27801-21sshd07:36:080
18896992619,5cyclictest18893-21cyclictest08:47:000
18896992619,5cyclictest18893-21cyclictest08:47:000
18896992619,2cyclictest181rcu_preempt11:20:500
18896992619,2cyclictest181rcu_preempt11:20:500
18896992619,2cyclictest181rcu_preempt11:20:500
18896992618,6cyclictest1-21systemd08:52:080
18897992520,3cyclictest0-21swapper/108:07:481
18897992520,3cyclictest0-21swapper/108:07:481
18897992518,6cyclictest1-21systemd08:17:081
18897992518,6cyclictest1-21systemd08:17:081
18897992518,5cyclictest8185-21latency11:02:031
18897992518,5cyclictest8185-21latency11:02:031
18897992517,6cyclictest1-21systemd12:17:091
18897992517,6cyclictest1-21systemd12:17:091
18897992514,8cyclictest22944-21cron10:16:491
18897992514,8cyclictest22944-21cron10:16:491
18896992520,3cyclictest20955-21head07:17:020
18896992520,3cyclictest0-21swapper/011:07:080
18896992520,3cyclictest0-21swapper/011:07:080
18896992518,6cyclictest26815-21kernelversion11:52:050
18896992518,2cyclictest181rcu_preempt12:25:500
18896992518,2cyclictest181rcu_preempt12:25:500
18896992518,2cyclictest181rcu_preempt12:25:500
18896992517,6cyclictest32151-21grep09:12:110
18896992517,6cyclictest32151-21grep09:12:110
18896992517,6cyclictest0-21swapper/009:09:500
18896992517,6cyclictest0-21swapper/009:09:500
18896992516,7cyclictest5199-21netstat09:27:060
18896992516,7cyclictest5199-21netstat09:27:060
18896992515,8cyclictest15268-21grep08:27:080
18896992515,8cyclictest15268-21grep08:27:080
18897992419,3cyclictest0-21swapper/107:22:021
18897992419,3cyclictest0-21swapper/107:22:021
18897992418,5cyclictest30805-21sshd12:02:081
18897992418,5cyclictest30805-21sshd12:02:081
18897992418,5cyclictest30805-21sshd12:02:081
18897992418,4cyclictest1346-21avahi-daemon08:12:111
18897992418,4cyclictest1346-21avahi-daemon08:12:111
18897992418,4cyclictest0-21swapper/110:47:031
18897992418,4cyclictest0-21swapper/110:47:031
18896992420,3cyclictest24136-21idleruntime-cro07:26:490
18896992420,3cyclictest24136-21idleruntime-cro07:26:490
18896992419,3cyclictest16638-21kworker/u10:3-rpciod11:27:540
18896992419,3cyclictest16638-21kworker/u10:3-rpciod11:27:540
18896992418,4cyclictest601-21snmpd12:12:090
18896992418,4cyclictest601-21snmpd12:12:090
18896992417,5cyclictest5566-21kernelversion08:02:040
18896992417,5cyclictest5566-21kernelversion08:02:040
18896992417,2cyclictest181rcu_preempt12:07:460
18896992417,2cyclictest181rcu_preempt12:07:460
18896992417,2cyclictest181rcu_preempt11:44:550
18905992315,6cyclictest431rcuc/310:40:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional