You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 19:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Thu Jul 16, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2181065995239,9cyclictest391ktimers/308:05:143
2181057994941,5cyclictest2291113-21grep12:25:231
2181053994935,10cyclictest121ktimers/008:00:130
2181053994935,10cyclictest121ktimers/008:00:120
2181057994738,5cyclictest2260470-21munin-plugin-st11:00:011
2181065994633,10cyclictest391ktimers/307:15:113
2181061994527,14cyclictest0-21swapper/209:00:012
2181057994532,9cyclictest231ktimers/107:50:101
2181053994539,3cyclictest2236393-21idleruntime-cro09:50:000
2181061994436,4cyclictest2253666-21sendmail10:40:002
2181061994436,4cyclictest2243424-21munin-plugin-st10:10:002
2181061994418,23cyclictest2199602-21grep08:00:212
2181061994418,23cyclictest2199602-21grep08:00:202
2181061994320,19cyclictest0-21swapper/210:15:252
218106199431,9cyclictest2273183-21/usr/sbin/munin11:35:172
2181061994223,15cyclictest2201827-21grep08:05:272
2181061994220,19cyclictest0-21swapper/210:00:272
218106199421,9cyclictest2266473-21/usr/sbin/munin11:15:192
218106199421,9cyclictest2260846-21/usr/sbin/munin11:00:142
2181061994216,23cyclictest645-21runrttasks11:30:232
218105799421,17cyclictest0-21swapper/109:45:121
2181065994131,5cyclictest0-21swapper/307:50:203
2181065994130,8cyclictest2265593-21munin-plugin-st11:15:013
218106199413,7cyclictest2290692-21ntp_states12:25:192
218106199411,9cyclictest2276486-21/usr/sbin/munin11:45:122
218106199411,10cyclictest2288874-21meminfo12:20:162
218105799412,15cyclictest0-21swapper/108:35:141
2181053994133,5cyclictest0-21swapper/009:35:120
218106199403,6cyclictest2207951-21irqstats08:25:172
218106199403,6cyclictest2185359-21df_inode07:20:172
2181061994029,7cyclictest311ktimers/209:15:122
218106199402,5cyclictest2282278-21/usr/sbin/munin12:00:232
218106199401,9cyclictest2262467-21/usr/sbin/munin11:05:112
2181061994013,24cyclictest0-21swapper/207:35:012
2181061994012,24cyclictest0-21swapper/209:35:252
218106199401,11cyclictest2279210-21grep11:50:252
218106199401,11cyclictest2275228-21memory11:40:212
2181057994034,4cyclictest2220985-21kworker/u8:2+events_unbound09:20:451
2181057994034,4cyclictest2220985-21kworker/u8:2+events_unbound09:20:451
2181065993929,6cyclictest2268792-21grep11:20:253
218106199392,6cyclictest2192784-21/usr/sbin/munin07:40:242
218106199392,5cyclictest2197944-21ntp_states07:55:242
218106199392,5cyclictest2197944-21ntp_states07:55:242
218106199391,8cyclictest2254470-21/usr/sbin/munin10:40:222
218106199391,8cyclictest2248885-21/usr/sbin/munin10:25:152
218106199391,6cyclictest2268193-21meminfo11:20:182
2181061993916,19cyclictest0-21swapper/209:55:022
2181053993932,5cyclictest2178880-21kworker/u8:0+events_unbound07:15:070
2181053993932,4cyclictest0-21swapper/008:10:000
2181053993929,7cyclictest2203950-21sh08:15:000
2181053993928,6cyclictest0-21swapper/008:20:170
2181065993827,8cyclictest2272617-21auditctl11:35:003
2181061993830,6cyclictest2202626-21fschecks_count08:10:152
2181061993824,9cyclictest2239515-21chrt09:55:262
218106199381,9cyclictest2280353-21sed11:55:182
218106199381,9cyclictest2280353-21sed11:55:182
218106199381,9cyclictest2264802-21fgrep11:10:242
218106199381,9cyclictest2259800-21wc10:55:242
218106199381,9cyclictest2257287-21/usr/sbin/munin10:50:272
218106199381,8cyclictest2223658-21/usr/sbin/munin09:10:222
218106199381,8cyclictest2219945-21sed09:00:192
218106199381,8cyclictest2184044-21/usr/sbin/munin07:15:202
218106199381,7cyclictest2251766-21cron10:33:002
218106199381,6cyclictest2195769-21df07:50:122
218106199381,5cyclictest2293653-21diskstats12:35:162
218106199381,5cyclictest2269886-21/usr/sbin/munin11:25:182
218106199381,5cyclictest2244447-21/usr/sbin/munin10:10:242
218106199381,5cyclictest2244447-21/usr/sbin/munin10:10:242
218106199381,5cyclictest2215815-21cron08:49:002
2181061993814,20cyclictest204-21dbus-daemon09:30:452
218106199381,11cyclictest2211473-21ls08:35:202
218106199381,11cyclictest2206250-21irqstats08:20:182
2181057993829,4cyclictest0-21swapper/111:35:151
2181057993828,5cyclictest0-21swapper/109:05:411
2181057993826,9cyclictest231ktimers/112:35:121
2181057993817,7cyclictest131rcu_preempt08:45:111
2181053993828,7cyclictest2215907-21idleruntime-cro08:50:010
2181065993723,10cyclictest391ktimers/311:05:113
218106199373,8cyclictest2229470-21cron09:29:012
218106199373,3cyclictest2204722-21/usr/sbin/munin08:15:212
218106199372,4cyclictest2221665-21cat09:05:172
218106199371,9cyclictest2233660-21/usr/sbin/munin09:40:202
218106199371,9cyclictest2209309-21/usr/sbin/munin08:30:262
218106199371,8cyclictest2216579-21meminfo08:50:172
218106199371,5cyclictest2247753-21/usr/sbin/munin10:20:242
218106199371,4cyclictest2235943-21/usr/sbin/munin09:45:252
218106199370,8cyclictest2182022-21/usr/sbin/munin07:10:252
2181057993730,4cyclictest2191812-21cron07:40:011
2181057993726,6cyclictest0-21swapper/112:00:261
2181065993629,4cyclictest2198844-21sendmail08:00:013
2181065993629,4cyclictest2198844-21sendmail08:00:003
218106199363,6cyclictest2256163-21ntp_states10:45:222
218106199361,9cyclictest2291949-21diskstats12:30:142
218106199361,9cyclictest2285680-21gunzip12:10:252
218106199361,8cyclictest2283468-21cut12:05:172
218106199361,6cyclictest2193754-21/usr/sbin/munin07:45:122
218106199361,5cyclictest2226509-21runrttasks09:20:162
218106199361,5cyclictest2226509-21runrttasks09:20:152
218106199361,4cyclictest2286809-21df12:15:122
218106199361,4cyclictest2187482-21/usr/sbin/munin07:25:212
218106199360,8cyclictest2190776-21sed07:35:192
2181057993627,6cyclictest2240434-21fschecks_time10:00:171
2181065993524,8cyclictest0-21swapper/307:15:023
2181057993528,4cyclictest2267499-21latency_hist11:19:591
2181057993526,7cyclictest231ktimers/112:05:121
2181053993528,4cyclictest2240001-21cron10:00:000
2181053993523,8cyclictest2265108-21grep11:10:250
2181065993426,5cyclictest2292843-21unixbench_multi12:30:253
2181065993426,4cyclictest0-21swapper/311:55:143
2181065993426,4cyclictest0-21swapper/311:55:143
2181057993423,7cyclictest2209450-21cut08:30:151
2181057993419,6cyclictest131rcu_preempt08:40:131
2181065993323,6cyclictest0-21swapper/308:55:013
218105799338,6cyclictest131rcu_preempt09:25:111
2181057993327,4cyclictest2232649-21kworker/u8:0+events_unbound09:40:471
2181057993325,4cyclictest0-21swapper/112:20:241
2181053993326,4cyclictest0-21swapper/007:20:270
2181065993223,6cyclictest2267043-21grep11:15:243
2181065993222,6cyclictest2189660-21grep07:30:243
2181057993224,4cyclictest0-21swapper/110:15:251
2181057993223,6cyclictest2240017-21idleruntime-cro10:00:001
2181057993222,5cyclictest0-21swapper/110:40:581
2181053993225,3cyclictest0-21swapper/010:50:250
2181053993224,5cyclictest0-21swapper/007:30:120
2181065993124,4cyclictest2274312-21cron11:40:013
2181065993123,4cyclictest0-21swapper/312:10:263
218105799317,14cyclictest131rcu_preempt07:15:241
2181057993123,4cyclictest0-21swapper/107:10:261
2181057993121,6cyclictest2202250-21sh08:10:011
2181057993121,5cyclictest0-21swapper/112:16:161
2181057993112,12cyclictest24-21ksoftirqd/111:15:001
2181057993110,3cyclictest131rcu_preempt12:00:011
2181057993110,3cyclictest131rcu_preempt12:00:001
2181053993123,4cyclictest0-21swapper/012:14:590
2181053993123,4cyclictest0-21swapper/008:25:150
2181065993023,4cyclictest2232994-21idleruntime-cro09:40:013
2181065993022,4cyclictest0-21swapper/308:40:173
2181065993021,5cyclictest0-21swapper/308:25:263
2181065993020,5cyclictest0-21swapper/311:40:143
2181065993019,7cyclictest2248533-21sh10:24:593
218105799308,12cyclictest24-21ksoftirqd/107:55:291
218105799308,12cyclictest24-21ksoftirqd/107:55:281
2181057993023,4cyclictest2277952-21kthreadd11:50:001
2181057993022,4cyclictest0-21swapper/110:20:161
2181057993020,6cyclictest2268815-21unixbench_singl11:20:261
2181057993020,6cyclictest2263885-21sh11:10:001
2181057993015,6cyclictest2212451-21kworker/u8:1+events_unbound08:53:161
2181057993012,5cyclictest131rcu_preempt09:55:011
2181053993024,3cyclictest0-21swapper/009:20:260
2181053993024,3cyclictest0-21swapper/009:20:250
2181065992921,4cyclictest0-21swapper/310:40:263
218105799299,11cyclictest24-21ksoftirqd/110:30:241
2181057992923,4cyclictest2184720-21kworker/u8:3+events_unbound07:20:081
2181057992922,5cyclictest2276185-21kworker/u8:3+events_unbound11:44:571
2181057992922,5cyclictest2256857-21kworker/u8:0+events_unbound10:47:411
2181057992921,5cyclictest2232981-21sendmail09:40:011
2181057992921,4cyclictest0-21swapper/108:15:271
2181057992919,6cyclictest2200563-21awk08:05:001
2181057992919,6cyclictest2200563-21awk08:05:001
2181057992918,7cyclictest0-21swapper/107:40:251
2181057992914,5cyclictest131rcu_preempt08:57:471
2181057992913,6cyclictest2291229-21kworker/u8:0+events_unbound12:34:501
2181053992922,5cyclictest2191821-21sendmail07:40:020
218106599285,5cyclictest22230612seq09:10:123
2181065992817,6cyclictest0-21swapper/309:50:253
2181065992816,9cyclictest391ktimers/310:50:113
2181057992818,6cyclictest0-21swapper/110:50:251
2181057992817,5cyclictest131rcu_preempt07:45:161
218105799280,6cyclictest0-21swapper/108:25:121
2181053992821,4cyclictest2277958-21idleruntime-cro11:50:000
2181053992817,7cyclictest2223994-21grep09:10:250
218105399281,5cyclictest2281344-21cron12:00:000
218105399281,5cyclictest2281344-21cron11:59:590
2181053992814,11cyclictest2181046-21cyclictest12:35:120
218105399280,25cyclictest0-21swapper/012:30:100
2181065992720,5cyclictest2279612-21kworker/u8:0+events_unbound12:01:173
2181065992720,4cyclictest2229102-21grep09:25:243
2181065992717,6cyclictest2246397-21grep10:15:263
2181065992716,6cyclictest0-21swapper/308:05:013
2181065992716,6cyclictest0-21swapper/308:05:003
2181057992721,4cyclictest2249898-21kworker/u8:1+events_unbound10:35:581
2181057992718,7cyclictest2266016-21kworker/u8:0+events_unbound11:29:371
2181057992717,7cyclictest0-21swapper/109:35:011
2181057992717,3cyclictest131rcu_preempt11:50:151
2181057992710,4cyclictest131rcu_preempt10:15:011
2181057992710,4cyclictest131rcu_preempt10:15:001
2181053992720,4cyclictest0-21swapper/009:05:240
2181053992720,3cyclictest0-21swapper/007:40:250
2181053992719,4cyclictest0-21swapper/009:50:240
218105399271,21cyclictest2252082-21cat10:35:020
218106599269,4cyclictest131rcu_preempt08:20:173
218106599269,12cyclictest391ktimers/309:40:133
2181065992620,4cyclictest2266016-21kworker/u8:0+events_unbound11:25:023
2181065992619,4cyclictest2211151-21fschecks_count08:35:163
2181065992619,3cyclictest0-21swapper/308:55:173
2181065992618,4cyclictest0-21swapper/307:35:263
2181065992617,6cyclictest0-21swapper/307:25:013
2181065992617,4cyclictest0-21swapper/309:55:253
2181065992615,8cyclictest2243735-21awk10:10:143
2181065992615,8cyclictest2243735-21awk10:10:133
218105799269,5cyclictest131rcu_preempt08:25:011
2181057992619,3cyclictest0-21swapper/107:30:161
2181057992618,6cyclictest2283300-21kworker/u8:1+events_unbound12:14:401
2181053992614,7cyclictest0-21swapper/008:40:000
218105399261,20cyclictest22413752chrt10:00:570
2181065992520,3cyclictest0-21swapper/309:30:153
2181065992519,3cyclictest0-21swapper/310:35:163
2181065992518,3cyclictest0-21swapper/309:10:003
2181065992517,4cyclictest0-21swapper/310:25:163
218105799255,5cyclictest2224851-21fschecks_time09:15:161
2181057992519,4cyclictest2200308-21kworker/u8:1+events_unbound08:10:301
2181057992518,4cyclictest0-21swapper/111:00:251
218105799251,6cyclictest24-21ksoftirqd/109:05:001
2181053992519,4cyclictest0-21swapper/011:35:260
2181053992519,3cyclictest0-21swapper/008:50:230
2181053992518,4cyclictest0-21swapper/010:35:280
2181053992518,3cyclictest0-21swapper/008:40:160
2181053992517,6cyclictest0-21swapper/010:24:130
2181053992515,8cyclictest2284812-21sed12:10:000
218105399251,20cyclictest0-21swapper/011:33:260
218105399251,20cyclictest0-21swapper/007:14:110
2181065992418,3cyclictest2295004-21kthreadd12:40:003
2181065992418,3cyclictest0-21swapper/312:05:233
2181065992418,3cyclictest0-21swapper/311:50:233
2181065992417,5cyclictest2193203-21kworker/u8:2+events_unbound07:43:193
2181065992417,4cyclictest2195227-21idleruntime-cro07:50:003
2181065992416,5cyclictest2286916-21cut12:15:143
2181065992416,4cyclictest2214594-21fschecks_count08:45:163
218105799246,11cyclictest0-21swapper/110:08:581
218105799242,11cyclictest0-21swapper/110:25:161
2181057992418,4cyclictest2263852-21kworker/u8:1+events_unbound11:31:041
2181053992417,5cyclictest2276185-21kworker/u8:3+events_unbound12:16:180
2181053992416,5cyclictest2282601-21unixbench_multi12:00:260
218105399241,5cyclictest2234692-21munin-run09:45:020
2181053992415,5cyclictest0-21swapper/010:08:490
218105399241,19cyclictest0-21swapper/011:04:510
218105399241,19cyclictest0-21swapper/010:55:500
218105399241,19cyclictest0-21swapper/010:16:090
218105399241,19cyclictest0-21swapper/007:58:420
218105399241,19cyclictest0-21swapper/007:58:410
218105399241,19cyclictest0-21swapper/007:48:530
218105399240,20cyclictest0-21swapper/009:27:040
218106599235,6cyclictest131rcu_preempt09:45:123
2181065992317,3cyclictest0-21swapper/309:00:233
2181065992316,3cyclictest0-21swapper/312:25:223
2181065992314,4cyclictest0-21swapper/311:50:003
2181065992312,8cyclictest40-21ksoftirqd/310:05:133
218105799238,6cyclictest24-21ksoftirqd/107:30:021
218105399233,6cyclictest2267531-21modprobe11:19:590
2181053992318,2cyclictest0-21swapper/012:25:230
2181053992317,2cyclictest0-21swapper/007:25:210
2181053992316,5cyclictest0-21swapper/009:31:320
2181053992316,3cyclictest0-21swapper/008:17:070
218105399231,3cyclictest2195224-21apt-get07:50:020
218105399231,18cyclictest0-21swapper/012:23:400
218105399231,18cyclictest0-21swapper/011:22:450
218105399231,18cyclictest0-21swapper/010:46:030
218105399231,18cyclictest0-21swapper/009:01:060
2181065992214,6cyclictest2222367-21kworker/u8:3+events_unbound09:20:133
2181065992214,6cyclictest2222367-21kworker/u8:3+events_unbound09:20:133
2181065992214,5cyclictest0-21swapper/308:30:243
2181053992216,3cyclictest13550irq/42-30be0000.ethernet10:40:180
2181053992216,3cyclictest0-21swapper/009:20:010
2181053992215,4cyclictest0-21swapper/011:25:260
2181053992215,3cyclictest0-21swapper/010:15:010
2181053992215,3cyclictest0-21swapper/010:15:010
2181053992214,5cyclictest2278343-21uniq11:50:140
218105399221,17cyclictest0-21swapper/010:25:450
218105399220,18cyclictest0-21swapper/008:31:360
218106599218,3cyclictest40-21ksoftirqd/310:00:203
2181065992115,4cyclictest2255138-21kworker/u8:2+events_unbound10:46:403
2181065992115,4cyclictest2222367-21kworker/u8:3+events_unbound09:15:063
2181065992113,4cyclictest0-21swapper/310:55:253
2181065992113,4cyclictest0-21swapper/307:25:263
2181065992014,4cyclictest2276185-21kworker/u8:3+events_unbound12:21:173
2181065992014,4cyclictest2203613-21kworker/u8:0+events_unbound08:13:323
2181065992013,5cyclictest0-21swapper/310:30:193
2181053992013,5cyclictest2217457-21kworker/u8:2+events_unbound08:55:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional