You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu Jun 18, 2026 12:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162942950,3sleep20-21swapper/211:18:152
162942950,3sleep20-21swapper/211:18:152
191892910,3sleep30-21swapper/309:58:203
191892910,3sleep30-21swapper/309:58:203
191892910,3sleep30-21swapper/309:58:203
175152860,3chrt0-21swapper/311:23:063
175152860,3chrt0-21swapper/311:23:063
108622800,3sleep30-21swapper/308:13:003
108622800,3sleep30-21swapper/308:13:003
108622800,3sleep30-21swapper/308:13:003
178362780,1chrt0-21swapper/008:28:200
178362780,1chrt0-21swapper/008:28:200
61902730,3sleep30-21swapper/310:53:073
61902730,3sleep30-21swapper/310:53:073
61902730,3sleep30-21swapper/310:53:073
4252730,4sleep0426-21kernelversion12:03:110
4252730,4sleep0426-21kernelversion12:03:110
156602610,4sleep30-21swapper/311:18:083
156602610,4sleep30-21swapper/311:18:083
287412520,3sleep30-21swapper/311:53:093
287412520,3sleep30-21swapper/311:53:093
173512520,3sleep30-21swapper/311:23:023
173512520,3sleep30-21swapper/311:23:023
78942490,3sleep20-21swapper/210:58:022
78942490,3sleep20-21swapper/210:58:022
316512490,2chrt31655-21sed11:58:181
316512490,2chrt31655-21sed11:58:181
185062480,3sleep30-21swapper/308:33:063
185062480,3sleep30-21swapper/308:33:063
39052470,2sleep03907-21idleruntime07:53:110
39052470,2sleep03907-21idleruntime07:53:110
39052470,2sleep03907-21idleruntime07:53:110
34782420,2chrt0-21swapper/307:53:063
34782420,2chrt0-21swapper/307:53:063
34782420,2chrt0-21swapper/307:53:063
291452420,2sleep30-21swapper/311:53:133
291452420,2sleep30-21swapper/311:53:133
307912410,7sleep030754-21gltestperf11:58:090
307912410,7sleep030754-21gltestperf11:58:090
295252410,3chrt0-21swapper/310:28:113
295252410,3chrt0-21swapper/310:28:113
253552390,3sleep30-21swapper/310:18:033
253552390,3sleep30-21swapper/310:18:033
54992380,3sleep30-21swapper/307:58:093
54992380,3sleep30-21swapper/307:58:093
21266993627,7cyclictest11733-21netstat08:13:141
21266993627,7cyclictest11733-21netstat08:13:141
21265993627,7cyclictest27411-21processes07:28:180
21265993627,7cyclictest27411-21processes07:28:180
21265993627,7cyclictest13923-21cut11:13:090
21265993627,7cyclictest13923-21cut11:13:090
17452360,3sleep20-21swapper/209:13:142
17452360,3sleep20-21swapper/209:13:142
79352350,2chrt0-21swapper/008:03:120
79352350,2chrt0-21swapper/008:03:120
21266993525,8cyclictest3647-21netstat09:18:151
21266993525,8cyclictest3647-21netstat09:18:151
21265993529,4cyclictest27133-21cron10:22:570
21265993529,4cyclictest27133-21cron10:22:570
21265993529,4cyclictest27133-21cron10:22:570
21266993428,4cyclictest14775-21latency_hist12:42:571
21266993428,4cyclictest14775-21latency_hist12:42:571
21265993428,4cyclictest1567-21kernelversion09:13:110
21265993428,4cyclictest1567-21kernelversion09:13:110
21265993426,6cyclictest10288-21latency_hist09:37:580
21265993426,6cyclictest10288-21latency_hist09:37:580
243082330,3sleep20-21swapper/211:38:212
243082330,3sleep20-21swapper/211:38:212
21265993326,6cyclictest8131-21needreboot12:23:130
21265993326,6cyclictest8131-21needreboot12:23:130
21265993326,6cyclictest8131-21needreboot12:23:130
21265993324,7cyclictest3664-21unixbench_singl10:43:210
21265993324,7cyclictest3664-21unixbench_singl10:43:210
21265993324,7cyclictest12828-21latency_hist08:18:060
21265993324,7cyclictest12828-21latency_hist08:18:060
21266993226,4cyclictest30496-21ntp_offset09:03:141
21266993226,4cyclictest30496-21ntp_offset09:03:141
21266993225,5cyclictest21263-21cyclictest09:28:101
21266993225,5cyclictest21263-21cyclictest09:28:101
21266993224,6cyclictest28733-21fschecks_time07:33:091
21266993224,6cyclictest28733-21fschecks_time07:33:091
21265993224,6cyclictest23484-21apt.systemd.dai10:13:050
21265993224,6cyclictest23484-21apt.systemd.dai10:13:050
21265993224,6cyclictest23484-21apt.systemd.dai10:13:050
21265993224,6cyclictest23484-21apt.systemd.dai10:13:050
21265993224,6cyclictest1041-21acpi09:13:070
21265993224,6cyclictest1041-21acpi09:13:070
21265993224,6cyclictest1041-21acpi09:13:070
21265993217,14cyclictest90-1pr/ttyS008:55:190
21265993217,14cyclictest90-1pr/ttyS008:55:190
52322310,2sleep20-21swapper/207:57:592
52322310,2sleep20-21swapper/207:57:592
52322310,2sleep20-21swapper/207:57:592
21265993125,4cyclictest21969-21gltestperf10:08:110
21265993125,4cyclictest21969-21gltestperf10:08:110
21265993125,4cyclictest21969-21gltestperf10:08:110
21265993125,4cyclictest21969-21gltestperf10:08:110
21265993125,3cyclictest0-21swapper/008:33:080
21265993125,3cyclictest0-21swapper/008:33:080
21265993122,7cyclictest9869-21netstat08:08:140
21265993122,7cyclictest9869-21netstat08:08:140
21265993122,7cyclictest9869-21netstat08:08:140
21265993116,13cyclictest14678-21systemd-journal09:53:180
21265993116,13cyclictest14678-21systemd-journal09:53:180
21265993116,13cyclictest14678-21systemd-journal09:53:180
21266993025,4cyclictest25652-21systemctl07:23:161
21266993025,4cyclictest25652-21systemctl07:23:161
21266993025,3cyclictest14017-21gltestperf11:13:101
21266993024,4cyclictest0-21swapper/110:13:051
21266993024,4cyclictest0-21swapper/110:13:051
21266993024,4cyclictest0-21swapper/110:13:051
21266993024,4cyclictest0-21swapper/110:13:051
21266993023,5cyclictest12868-21latency_hist12:38:091
21265993024,5cyclictest14028-21latency_hist09:47:570
21265993024,5cyclictest14028-21latency_hist09:47:570
21265993024,5cyclictest14028-21latency_hist09:47:570
21265993024,5cyclictest14028-21latency_hist09:47:570
21265993023,5cyclictest5594-21cut07:58:100
21265993023,5cyclictest5594-21cut07:58:100
21265993023,5cyclictest25200-21cut11:43:100
21265993022,6cyclictest14590-21sendmail08:22:560
21265993022,6cyclictest14590-21sendmail08:22:560
21265993022,6cyclictest14590-21sendmail08:22:560
58032290,2sleep30-21swapper/309:23:193
58032290,2sleep30-21swapper/309:23:193
21266992923,4cyclictest1346-21avahi-daemon11:48:171
21266992923,4cyclictest1346-21avahi-daemon11:48:171
21266992923,4cyclictest1346-21avahi-daemon11:48:171
21266992921,6cyclictest32735-21gltestperf12:03:101
21266992921,6cyclictest32735-21gltestperf12:03:101
21265992924,3cyclictest0-21swapper/011:53:110
21265992923,4cyclictest12731-21cat09:43:110
21265992923,4cyclictest12731-21cat09:43:110
21265992922,5cyclictest547-21rs:main0
21265992922,5cyclictest547-21rs:main0
21265992922,5cyclictest21418-21fschecks_time11:33:100
21265992922,5cyclictest21418-21fschecks_time11:33:100
21265992922,5cyclictest21418-21fschecks_time11:33:100
21265992922,5cyclictest21263-21cyclictest11:31:120
21265992922,5cyclictest21263-21cyclictest11:31:120
21265992922,5cyclictest19260-21sshd11:28:060
21265992922,5cyclictest19260-21sshd11:28:060
149852290,2sleep30-21swapper/309:48:153
149852290,2sleep30-21swapper/309:48:153
149852290,2sleep30-21swapper/309:48:153
108532290,3chrt0-21swapper/309:38:103
108532290,3chrt0-21swapper/309:38:103
63582280,3sleep30-21swapper/312:18:183
63582280,3sleep30-21swapper/312:18:183
63582280,3sleep30-21swapper/312:18:183
21266992823,4cyclictest27566-21latency_hist10:23:091
21266992823,4cyclictest27566-21latency_hist10:23:091
21266992823,4cyclictest16181-21fschecks_count09:53:101
21266992823,4cyclictest16181-21fschecks_count09:53:101
21266992823,4cyclictest16181-21fschecks_count09:53:101
21266992821,5cyclictest6374-21fschecks_time10:53:091
21266992821,5cyclictest6374-21fschecks_time10:53:091
21266992821,5cyclictest6374-21fschecks_time10:53:091
21266992821,5cyclictest27986-21sshd07:29:441
21266992821,5cyclictest27986-21sshd07:29:441
21266992820,6cyclictest19517-21fschecks_time11:28:091
21266992820,6cyclictest19517-21fschecks_time11:28:091
21266992819,7cyclictest20557-21cut08:38:091
21266992819,7cyclictest20557-21cut08:38:091
21265992822,5cyclictest3532-21latency_hist12:12:590
21265992822,5cyclictest3532-21latency_hist12:12:590
21265992822,5cyclictest3532-21latency_hist12:12:590
21265992822,5cyclictest3532-21latency_hist12:12:590
21265992821,5cyclictest28365-21kernelversion08:58:110
21265992821,5cyclictest28365-21kernelversion08:58:110
21265992820,6cyclictest6677-21kernelversion10:53:120
21265992820,6cyclictest6677-21kernelversion10:53:120
122762280,1sleep112354-21cpu09:43:081
122762280,1sleep112354-21cpu09:43:081
21266992721,5cyclictest14671-21kernelversion09:48:111
21266992721,5cyclictest14671-21kernelversion09:48:111
21266992721,5cyclictest14671-21kernelversion09:48:111
21266992721,5cyclictest14671-21kernelversion09:48:111
21266992721,3cyclictest0-21swapper/110:43:211
21266992721,3cyclictest0-21swapper/110:43:211
21265992723,3cyclictest31247-21ntp_offset11:58:140
21265992723,3cyclictest31247-21ntp_offset11:58:140
21265992723,2cyclictest0-21swapper/010:33:080
21265992723,2cyclictest0-21swapper/010:33:080
21265992722,4cyclictest1346-21avahi-daemon07:23:160
21265992722,4cyclictest1346-21avahi-daemon07:23:160
21265992722,3cyclictest0-21swapper/011:08:180
21265992721,4cyclictest0-21swapper/010:13:170
21265992721,4cyclictest0-21swapper/010:13:170
21265992720,5cyclictest7990-21/usr/sbin/munin10:58:170
21265992720,5cyclictest7990-21/usr/sbin/munin10:58:170
21265992716,9cyclictest14678-21systemd-journal11:07:560
21265992716,9cyclictest14678-21systemd-journal11:07:560
21265992716,9cyclictest14678-21systemd-journal11:07:560
2126699264,2cyclictest181rcu_preempt10:56:221
2126699264,2cyclictest181rcu_preempt10:56:221
21266992620,5cyclictest16049-21kernelversion11:18:111
21266992620,5cyclictest16049-21kernelversion11:18:111
21266992620,5cyclictest11012-21wc12:32:571
21266992620,5cyclictest11012-21wc12:32:571
21266992620,5cyclictest11012-21wc12:32:571
21266992620,4cyclictest8506-21if_wlan010:58:121
21266992620,4cyclictest8506-21if_wlan010:58:121
21266992620,4cyclictest17007-21gltestperf08:28:111
21266992620,4cyclictest17007-21gltestperf08:28:111
21266992620,3cyclictest0-21swapper/108:58:191
21266992620,3cyclictest0-21swapper/108:58:191
21266992619,5cyclictest27218-21grep08:53:181
21266992619,5cyclictest27218-21grep08:53:181
21265992621,3cyclictest0-21swapper/012:18:140
21265992621,3cyclictest0-21swapper/012:18:140
21265992621,3cyclictest0-21swapper/012:18:140
21265992621,3cyclictest0-21swapper/009:58:200
21265992621,3cyclictest0-21swapper/009:58:200
21265992621,3cyclictest0-21swapper/009:58:200
21265992620,4cyclictest13448-21latency_hist12:38:080
21265992619,5cyclictest24882-21/usr/sbin/munin11:43:150
21265992619,5cyclictest24882-21/usr/sbin/munin11:43:150
21265992619,5cyclictest24882-21/usr/sbin/munin11:43:150
21265992618,6cyclictest17257-21latency_hist11:22:570
21265992618,6cyclictest17257-21latency_hist11:22:570
18042260,3sleep20-21swapper/210:38:192
18042260,3sleep20-21swapper/210:38:192
149552260,3sleep20-21swapper/209:48:142
149552260,3sleep20-21swapper/209:48:142
149552260,3sleep20-21swapper/209:48:142
149552260,3sleep20-21swapper/209:48:142
30252250,5sleep30-21swapper/309:18:083
30252250,5sleep30-21swapper/309:18:083
216632250,3sleep20-21swapper/210:08:082
216632250,3sleep20-21swapper/210:08:082
216632250,3sleep20-21swapper/210:08:082
216632250,3sleep20-21swapper/210:08:082
21266992521,3cyclictest19443-21systemctl08:33:161
21266992521,3cyclictest19443-21systemctl08:33:161
21266992518,5cyclictest0-21swapper/111:18:091
21266992518,5cyclictest0-21swapper/110:23:171
21266992518,5cyclictest0-21swapper/110:23:171
21266992518,4cyclictest0-21swapper/111:08:071
21266992518,4cyclictest0-21swapper/111:08:071
21266992518,4cyclictest0-21swapper/111:08:071
21266992517,6cyclictest32323-21netstat09:08:141
21266992517,6cyclictest32323-21netstat09:08:141
21266992517,6cyclictest32323-21netstat09:08:141
21266992516,6cyclictest31348-21fschecks_time10:33:091
21266992516,6cyclictest31348-21fschecks_time10:33:091
21266992515,8cyclictest13445-21cron11:12:571
21266992515,8cyclictest13445-21cron11:12:571
21265992521,2cyclictest0-21swapper/007:33:170
21265992521,2cyclictest0-21swapper/007:33:170
21265992520,4cyclictest21263-21cyclictest09:53:120
21265992520,4cyclictest21263-21cyclictest09:53:120
21265992520,4cyclictest21263-21cyclictest09:53:120
21265992519,5cyclictest27288-21kernelversion11:48:110
21265992519,5cyclictest27288-21kernelversion11:48:110
21265992518,5cyclictest23021-21/usr/sbin/munin11:38:150
21265992516,7cyclictest30734-21switchtime09:03:170
21265992516,7cyclictest30734-21switchtime09:03:170
21266992419,3cyclictest0-21swapper/108:18:171
21266992419,3cyclictest0-21swapper/108:18:171
21266992419,3cyclictest0-21swapper/108:18:171
21266992419,2cyclictest0-21swapper/108:23:091
21266992419,2cyclictest0-21swapper/108:23:091
21266992418,5cyclictest8531-21timerandwakeup12:23:171
21266992418,5cyclictest8531-21timerandwakeup12:23:171
21266992418,5cyclictest8531-21timerandwakeup12:23:171
21266992418,5cyclictest4676-21switchtime12:13:191
21266992418,5cyclictest4676-21switchtime12:13:191
21266992418,4cyclictest547-21rs:main1
21266992418,4cyclictest26740-21/usr/sbin/munin11:48:081
21266992418,4cyclictest26740-21/usr/sbin/munin11:48:081
21266992418,3cyclictest0-21swapper/109:17:571
21266992418,3cyclictest0-21swapper/109:17:571
21266992416,6cyclictest32561-21gltestperf07:43:101
21266992416,6cyclictest32561-21gltestperf07:43:101
21266992416,6cyclictest1547-21threads10:38:181
21266992416,6cyclictest1547-21threads10:38:181
21265992419,3cyclictest21263-21cyclictest08:53:060
21265992419,3cyclictest21263-21cyclictest08:53:060
21265992419,3cyclictest1931-21gltestperf07:48:090
21265992419,3cyclictest1931-21gltestperf07:48:090
21265992419,3cyclictest1931-21gltestperf07:48:090
21265992419,3cyclictest0-21swapper/008:23:150
21265992419,3cyclictest0-21swapper/008:23:150
21265992418,5cyclictest20628-21cut08:38:090
21265992418,5cyclictest20628-21cut08:38:090
21265992418,4cyclictest0-21swapper/012:13:200
21265992418,4cyclictest0-21swapper/012:13:200
21265992418,4cyclictest0-21swapper/007:38:190
21265992418,3cyclictest0-21swapper/012:33:120
199952240,3sleep20-21swapper/210:03:102
199952240,3sleep20-21swapper/210:03:102
199952240,3sleep20-21swapper/210:03:102
14712240,2sleep00-21swapper/010:38:170
14712240,2sleep00-21swapper/010:38:170
274962230,3sleep20-21swapper/211:48:142
274962230,3sleep20-21swapper/211:48:142
274962230,3sleep20-21swapper/211:48:142
21266992319,3cyclictest21263-21cyclictest12:21:541
21266992319,3cyclictest21263-21cyclictest12:21:541
21266992319,3cyclictest21263-21cyclictest12:21:541
21266992319,3cyclictest21263-21cyclictest11:43:181
21266992319,2cyclictest0-21swapper/107:58:101
21266992319,2cyclictest0-21swapper/107:58:101
21266992318,3cyclictest13379-21grep12:38:081
21266992318,3cyclictest0-21swapper/109:23:111
21266992318,3cyclictest0-21swapper/109:23:111
21266992317,4cyclictest9338-21ntp_kernel_pll_09:33:151
21266992317,4cyclictest9338-21ntp_kernel_pll_09:33:151
21266992317,4cyclictest0-21swapper/109:58:201
21266992317,4cyclictest0-21swapper/109:58:201
21266992317,4cyclictest0-21swapper/109:58:201
21266992316,5cyclictest3851-21head07:53:111
21266992316,5cyclictest3851-21head07:53:111
21266992316,5cyclictest3851-21head07:53:111
21266992315,6cyclictest14432-21awk11:13:151
21265992319,2cyclictest0-21swapper/012:33:090
21265992319,2cyclictest0-21swapper/012:33:090
21265992319,2cyclictest0-21swapper/010:53:030
21265992319,2cyclictest0-21swapper/010:53:030
21265992319,2cyclictest0-21swapper/010:53:030
21265992316,5cyclictest5091-21fschecks_time09:23:100
21265992316,5cyclictest5091-21fschecks_time09:23:100
21265992316,5cyclictest4836-21cpu09:23:080
21265992316,5cyclictest4836-21cpu09:23:080
21265992316,5cyclictest21263-21cyclictest10:25:280
21265992316,5cyclictest21263-21cyclictest10:25:280
21265992316,5cyclictest14426-21ntp_kernel_pll_11:13:150
21265992316,5cyclictest14426-21ntp_kernel_pll_11:13:150
21265992315,6cyclictest22386-21sort08:43:070
21265992315,6cyclictest22386-21sort08:43:070
21265992314,7cyclictest8451-21latency_hist09:33:010
21265992314,7cyclictest8451-21latency_hist09:33:010
21266992217,4cyclictest18180-21ntp_kernel_pll_11:23:141
21266992217,4cyclictest18180-21ntp_kernel_pll_11:23:141
21266992217,3cyclictest0-21swapper/112:13:111
21266992217,3cyclictest0-21swapper/109:53:231
21266992217,3cyclictest0-21swapper/109:53:231
21266992217,3cyclictest0-21swapper/109:53:231
21266992217,3cyclictest0-21swapper/108:08:191
21266992217,3cyclictest0-21swapper/108:08:191
21266992217,3cyclictest0-21swapper/108:08:191
21266992216,4cyclictest0-21swapper/111:37:571
21266992216,4cyclictest0-21swapper/111:37:571
21266992216,4cyclictest0-21swapper/111:37:571
2126699221,5cyclictest25370-21cat10:18:031
2126699221,5cyclictest25370-21cat10:18:031
21266992215,5cyclictest21029-21sed10:03:201
21266992215,5cyclictest21029-21sed10:03:201
21266992215,5cyclictest21029-21sed10:03:201
21266992215,5cyclictest21029-21sed10:03:201
21266992214,6cyclictest26179-21fschecks_count08:53:081
21265992218,2cyclictest0-21swapper/012:28:210
21265992215,5cyclictest0-21swapper/012:38:150
21265992215,5cyclictest0-21swapper/012:38:150
21269992115,4cyclictest278462sleep308:58:073
21269992115,4cyclictest278462sleep308:58:073
21269992114,5cyclictest431rcuc/308:03:283
21269992114,5cyclictest431rcuc/308:03:283
21266992116,4cyclictest23394-21head11:38:111
21266992116,4cyclictest23394-21head11:38:111
21266992116,3cyclictest2195-21gltestperf12:08:121
21266992116,3cyclictest2195-21gltestperf12:08:121
21266992116,3cyclictest2195-21gltestperf12:08:121
21266992116,3cyclictest0-21swapper/110:22:591
21266992116,3cyclictest0-21swapper/107:48:151
21266992116,3cyclictest0-21swapper/107:48:151
21266992116,3cyclictest0-21swapper/107:48:151
21266992114,4cyclictest0-21swapper/108:48:111
21269992015,4cyclictest431rcuc/312:29:083
21269992015,4cyclictest431rcuc/312:29:083
21269992015,4cyclictest431rcuc/312:29:083
21266992016,2cyclictest0-21swapper/111:58:081
21266992016,2cyclictest0-21swapper/111:58:081
21266992014,4cyclictest0-21swapper/108:03:121
21266992014,4cyclictest0-21swapper/108:03:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional