You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu Sep 17, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2186729995526,25cyclictest0-21swapper/209:20:002
2186729995526,25cyclictest0-21swapper/209:20:002
2186725995239,10cyclictest231ktimers/110:05:131
2186725995239,10cyclictest231ktimers/110:05:131
2186722995044,4cyclictest2209539-21kworker/u8:1+events_unbound08:25:470
2186729994922,5cyclictest0-21swapper/207:25:252
2186733994828,15cyclictest2231842-21idleruntime-cro09:20:013
2186733994828,15cyclictest2231842-21idleruntime-cro09:20:003
2186722994841,4cyclictest2190870-21munin-plugin-st07:20:010
2186733994519,22cyclictest391ktimers/308:50:133
2186725994538,4cyclictest2188672-21munin-node07:15:011
2186729994431,9cyclictest2190880-21sendmail07:20:012
218673399431,12cyclictest2234095-21/usr/sbin/munin09:25:143
2186725994335,5cyclictest2240561-21cron09:45:001
218673399421,8cyclictest2244490-21/usr/sbin/munin09:55:163
218673399421,3cyclictest0-21swapper/307:55:113
218672299421,38cyclictest2300328-21munin-plugin-st12:35:000
218673399411,3cyclictest0-21swapper/310:35:153
2186722994131,5cyclictest0-21swapper/007:45:220
2186722994113,18cyclictest131rcu_preempt09:00:000
218673399409,26cyclictest2269983-21cat11:05:213
218673399408,15cyclictest22011912cat07:50:013
218673399402,34cyclictest2284342-21unixbench_singl11:45:243
218673399402,34cyclictest2284342-21unixbench_singl11:45:243
218673399401,9cyclictest2224495-21/usr/sbin/munin08:55:263
2186733994019,17cyclictest0-21swapper/309:00:153
218673399401,8cyclictest2247793-21/usr/sbin/munin10:00:243
218673399401,8cyclictest2232720-21/usr/sbin/munin09:20:183
218673399401,8cyclictest2212719-21cron08:21:013
218673399401,7cyclictest2216687-21/usr/sbin/munin08:35:273
218673399401,35cyclictest2293020-21grep12:10:253
218673399401,11cyclictest2262633-21diskstats10:45:163
218673399400,2cyclictest0-21swapper/312:25:113
2186725994033,4cyclictest2237141-21cron09:35:001
2186722994033,5cyclictest2207670-21kworker/u8:2+events_unbound08:12:420
2186733993927,8cyclictest2282636-21grep11:40:253
218673399391,8cyclictest2288959-21/usr/sbin/munin12:00:163
218673399391,8cyclictest2186874-21apt-get07:10:113
218673399391,3cyclictest0-21swapper/311:30:123
218673399391,3cyclictest0-21swapper/308:45:113
218673399391,3cyclictest0-21swapper/308:30:123
218673399391,3cyclictest0-21swapper/308:00:113
218673399391,3cyclictest0-21swapper/308:00:103
218673399391,3cyclictest0-21swapper/307:35:113
218673399391,35cyclictest2211216-21sshd08:18:403
218673399391,33cyclictest2274515-21latency_hist11:20:003
2186733993913,23cyclictest2300368-21latency_hist12:35:003
218673399390,3cyclictest0-21swapper/307:50:093
2186729993932,4cyclictest2265755-21idleruntime-cro10:55:002
2186725993933,4cyclictest2184874-21kworker/u8:2+events_unbound07:20:171
2186725993932,5cyclictest2184874-21kworker/u8:2+events_unbound07:15:151
2186722993933,4cyclictest2209539-21kworker/u8:1+events_unbound08:30:470
2186722993925,9cyclictest164-21systemd-journal08:15:430
2186722993919,10cyclictest131rcu_preempt12:26:580
218673399383,32cyclictest2242824-21/usr/sbin/munin09:50:173
218673399382,5cyclictest2192926-21df_inode07:25:143
218673399381,9cyclictest2266413-21sed10:55:183
218673399381,9cyclictest2266413-21sed10:55:183
218673399381,8cyclictest2195519-21grep07:30:263
218673399381,7cyclictest2261791-21/usr/sbin/munin10:40:243
218673399381,6cyclictest2287349-21memory11:55:173
218673399381,6cyclictest2271852-21/usr/sbin/munin11:10:233
218673399381,5cyclictest2275322-21/usr/sbin/munin11:20:203
218673399381,4cyclictest2294070-21/usr/sbin/munin12:15:203
218673399381,4cyclictest2280896-21/usr/sbin/munin11:35:243
218673399381,3cyclictest0-21swapper/309:40:123
218673399381,34cyclictest2258476-21cron10:33:003
218673399381,33cyclictest2208098-21sed08:10:013
218673399381,32cyclictest2285417-21sed11:50:203
218673399381,32cyclictest2285417-21sed11:50:193
218673399381,32cyclictest2265867-21cat10:55:003
218673399381,12cyclictest2253914-21cut10:20:153
218673399381,11cyclictest2295899-21/usr/sbin/munin12:20:183
218673399381,10cyclictest2290437-21df_inode12:05:143
218673399380,3cyclictest0-21swapper/309:35:103
218673399380,3cyclictest0-21swapper/309:10:133
218673399380,3cyclictest0-21swapper/309:10:133
2186729993829,4cyclictest0-21swapper/209:55:002
2186729993828,5cyclictest2290084-21cron12:05:002
2186722993832,4cyclictest2231770-21kworker/u8:1+events_unbound09:30:570
2186722993817,10cyclictest131rcu_preempt10:16:270
2186722993813,11cyclictest0-21swapper/011:25:330
218673399373,31cyclictest22371322sleep309:34:563
218673399372,3cyclictest2208163-21/usr/sbin/munin08:10:123
218673399371,4cyclictest2267986-21/usr/sbin/munin11:00:163
218673399371,3cyclictest2248764-21df_inode10:05:163
218673399371,3cyclictest2248764-21df_inode10:05:153
218673399371,3cyclictest0-21swapper/310:25:113
218673399371,31cyclictest2191570-21/usr/sbin/munin07:20:203
218673399371,12cyclictest2219405-21tail08:40:263
218673399371,10cyclictest2198271-21/usr/sbin/munin07:40:153
2186729993728,6cyclictest0-21swapper/212:20:002
2186725993731,4cyclictest2258471-21kworker/u8:0+events_unbound10:41:051
2186725993729,4cyclictest0-21swapper/110:10:161
2186725993719,6cyclictest131rcu_preempt11:25:111
2186722993728,5cyclictest2207933-21idleruntime-cro08:10:000
2186722993726,4cyclictest131rcu_preempt11:47:380
2186722993726,4cyclictest131rcu_preempt11:47:380
2186722993725,4cyclictest131rcu_preempt07:28:480
2186722993715,5cyclictest0-21swapper/010:32:320
218673399363,10cyclictest2276466-21apt-get11:25:113
218673399361,6cyclictest2214355-21unixbench_singl08:25:253
218673399361,10cyclictest2250798-21meminfo10:10:193
2186729993630,4cyclictest2272608-21latency_hist11:15:022
2186729993626,6cyclictest0-21swapper/209:55:182
2186729993624,7cyclictest0-21swapper/210:20:012
2186725993629,4cyclictest2238846-21cron09:40:001
2186725993628,4cyclictest0-21swapper/109:05:161
2186725993627,5cyclictest2245097-21getprofile09:55:201
2186725993627,5cyclictest0-21swapper/110:50:161
2186725993626,6cyclictest2234116-21fschecks_count09:25:141
2186725993625,7cyclictest2294769-21grep12:15:261
2186722993625,4cyclictest131rcu_preempt11:37:250
2186722993618,5cyclictest131rcu_preempt12:38:490
2186722993618,4cyclictest131rcu_preempt09:40:060
2186722993616,4cyclictest131rcu_preempt10:26:460
2186722993614,4cyclictest131rcu_preempt11:02:480
2186722993614,10cyclictest131rcu_preempt10:55:560
2186722993614,10cyclictest131rcu_preempt10:55:560
2186722993612,15cyclictest0-21swapper/011:30:110
218673399351,4cyclictest2189740-21/usr/sbin/munin07:15:213
218673399351,3cyclictest2227271-21/usr/sbin/munin09:05:183
218673399350,3cyclictest0-21swapper/309:45:123
2186729993528,4cyclictest2221107-21unixbench_multi08:45:252
2186722993518,5cyclictest131rcu_preempt08:25:020
2186722993517,5cyclictest131rcu_preempt09:26:210
2186722993517,4cyclictest131rcu_preempt09:52:410
2186722993517,10cyclictest131rcu_preempt12:02:230
2186722993516,5cyclictest131rcu_preempt10:13:210
2186722993516,10cyclictest131rcu_preempt12:06:570
2186722993515,5cyclictest131rcu_preempt07:31:210
2186722993513,5cyclictest131rcu_preempt09:40:010
2186722993512,5cyclictest131rcu_preempt09:45:230
2186725993427,4cyclictest0-21swapper/111:40:001
2186725993427,4cyclictest0-21swapper/107:40:001
2186725993424,7cyclictest2281801-21fschecks_time11:40:151
218672299346,5cyclictest11-21ksoftirqd/008:50:270
2186722993427,5cyclictest2258471-21kworker/u8:0+events_unbound11:18:410
2186722993427,3cyclictest0-21swapper/010:10:010
2186722993427,3cyclictest0-21swapper/010:10:000
2186722993424,7cyclictest0-21swapper/007:55:260
2186722993421,5cyclictest131rcu_preempt12:15:160
2186722993419,4cyclictest131rcu_preempt09:16:480
2186722993419,4cyclictest131rcu_preempt09:16:470
2186722993418,4cyclictest131rcu_preempt11:41:430
2186722993418,4cyclictest131rcu_preempt10:20:490
2186722993417,4cyclictest131rcu_preempt10:46:200
2186722993416,4cyclictest131rcu_preempt08:44:140
2186722993415,4cyclictest131rcu_preempt10:03:490
2186722993414,4cyclictest131rcu_preempt11:57:020
2186722993412,5cyclictest131rcu_preempt07:41:390
2186729993325,4cyclictest0-21swapper/211:15:272
2186729993324,4cyclictest0-21swapper/208:30:012
2186725993325,5cyclictest0-21swapper/110:20:001
2186725993321,7cyclictest0-21swapper/111:25:011
2186722993320,5cyclictest131rcu_preempt11:09:210
2186722993318,7cyclictest131rcu_preempt11:55:010
2186722993318,7cyclictest131rcu_preempt11:55:000
2186722993317,5cyclictest131rcu_preempt08:39:440
2186722993317,4cyclictest131rcu_preempt10:50:420
2186722993316,9cyclictest131rcu_preempt11:10:190
2186722993316,4cyclictest131rcu_preempt11:24:070
2186722993316,4cyclictest131rcu_preempt10:38:100
2186722993314,11cyclictest131rcu_preempt09:00:100
2186722993314,11cyclictest131rcu_preempt08:45:230
2186729993224,4cyclictest0-21swapper/208:20:272
2186725993225,4cyclictest0-21swapper/109:00:001
2186725993223,5cyclictest0-21swapper/108:00:401
2186725993223,5cyclictest0-21swapper/108:00:401
218672299327,7cyclictest2296463-21sed12:20:240
2186722993218,4cyclictest131rcu_preempt09:10:580
2186722993218,4cyclictest131rcu_preempt09:10:580
2186722993218,4cyclictest131rcu_preempt07:38:350
2186722993215,5cyclictest131rcu_preempt09:06:480
2186722993214,4cyclictest131rcu_preempt08:01:490
2186722993214,4cyclictest131rcu_preempt08:01:490
2186729993121,5cyclictest0-21swapper/207:50:292
2186729993120,7cyclictest2279171-21grep11:30:252
2186729993119,9cyclictest2201110-21idleruntime-cro07:50:002
2186725993123,4cyclictest0-21swapper/107:45:261
2186725993122,6cyclictest2208304-21fschecks_count08:10:171
2186722993114,4cyclictest131rcu_preempt12:11:020
2186722993113,5cyclictest131rcu_preempt09:24:290
2186722993113,4cyclictest131rcu_preempt09:55:350
2186722993113,3cyclictest0-21swapper/007:10:310
2186729993022,4cyclictest0-21swapper/211:40:012
2186729993020,6cyclictest0-21swapper/212:10:002
2186725993025,3cyclictest2226706-21cron09:05:001
2186725993021,6cyclictest0-21swapper/112:20:241
2186725993021,6cyclictest0-21swapper/111:20:001
2186722993019,4cyclictest131rcu_preempt07:20:180
2186729992921,4cyclictest0-21swapper/212:30:242
2186729992921,4cyclictest0-21swapper/210:55:252
2186729992921,4cyclictest0-21swapper/210:55:252
2186729992921,4cyclictest0-21swapper/207:55:152
2186729992920,5cyclictest0-21swapper/211:55:142
2186729992917,10cyclictest2186713-21cyclictest10:05:132
2186729992917,10cyclictest2186713-21cyclictest10:05:132
2186729992916,8cyclictest204-21dbus-daemon07:20:142
2186725992922,4cyclictest0-21swapper/107:50:231
2186725992921,5cyclictest2239096-21kworker/u8:2+events_unbound09:45:161
2186725992919,4cyclictest2211267-21kworker/u8:2+events_unbound08:22:011
218672599290,6cyclictest0-21swapper/112:25:121
2186722992922,5cyclictest2199364-21kworker/u8:0+events_unbound07:51:060
2186729992820,5cyclictest2250585-21runrttasks10:10:162
2186729992820,4cyclictest0-21swapper/210:05:002
2186729992819,6cyclictest0-21swapper/209:00:002
218672599282,4cyclictest131rcu_preempt07:40:101
2186725992822,4cyclictest2209539-21kworker/u8:1+events_unbound08:15:261
2186725992820,4cyclictest0-21swapper/108:35:261
2186729992720,4cyclictest0-21swapper/207:15:012
2186729992720,3cyclictest0-21swapper/209:25:232
2186729992719,4cyclictest0-21swapper/208:00:142
2186729992719,4cyclictest0-21swapper/208:00:132
2186729992715,8cyclictest204-21dbus-daemon09:20:562
218672599277,4cyclictest131rcu_preempt10:45:161
2186725992719,5cyclictest0-21swapper/109:15:251
2186725992719,5cyclictest0-21swapper/109:15:251
2186725992719,4cyclictest0-21swapper/111:50:261
2186725992719,4cyclictest0-21swapper/111:50:261
218672599271,6cyclictest0-21swapper/111:45:121
218672599271,6cyclictest0-21swapper/111:45:111
2186725992711,13cyclictest24-21ksoftirqd/110:30:021
2186729992619,5cyclictest208-21systemd-logind11:44:402
2186729992619,3cyclictest0-21swapper/212:20:202
2186729992618,4cyclictest2298624-21kthreadd12:30:012
2186729992618,4cyclictest0-21swapper/211:20:242
218672599267,7cyclictest131rcu_preempt08:25:131
2186725992619,5cyclictest2286182-21kworker/u8:2+events_unbound12:10:241
2186725992619,5cyclictest2286182-21kworker/u8:2+events_unbound11:56:121
2186725992618,5cyclictest0-21swapper/109:10:171
2186725992618,5cyclictest0-21swapper/109:10:161
2186725992616,8cyclictest231ktimers/112:00:101
2186725992616,7cyclictest2260591-21idleruntime-cro10:40:001
2186725992616,6cyclictest0-21swapper/109:50:251
2186725992614,3cyclictest24-21ksoftirqd/109:20:141
2186729992518,4cyclictest0-21swapper/211:00:242
2186729992516,6cyclictest0-21swapper/211:55:002
2186729992516,6cyclictest0-21swapper/211:55:002
218672599258,4cyclictest0-21swapper/111:30:201
2186725992519,4cyclictest2201199-21kworker/u8:1+events_unbound07:55:251
2186725992518,4cyclictest0-21swapper/111:05:261
2186725992517,6cyclictest2192236-21kworker/u8:0+events_unbound07:32:521
2186725992517,5cyclictest0-21swapper/112:05:241
218672599251,3cyclictest0-21swapper/112:30:111
2186725992512,8cyclictest0-21swapper/108:05:241
2186729992418,3cyclictest0-21swapper/210:35:232
2186729992417,5cyclictest164-21systemd-journal10:42:402
2186729992417,4cyclictest311ktimers/210:48:522
2186729992417,4cyclictest0-21swapper/212:10:252
2186729992417,4cyclictest0-21swapper/211:50:002
2186729992417,4cyclictest0-21swapper/211:50:002
2186729992417,4cyclictest0-21swapper/209:45:172
2186729992417,3cyclictest0-21swapper/208:10:012
2186729992416,4cyclictest0-21swapper/208:45:002
2186729992413,8cyclictest1-21systemd09:00:522
218672599242,3cyclictest131rcu_preempt07:25:111
2186725992417,5cyclictest2216263-21kworker/u8:0+events_unbound08:33:011
2186725992417,5cyclictest0-21swapper/108:40:271
2186725992417,4cyclictest2221910-21cstates08:50:151
2186725992416,5cyclictest0-21swapper/111:00:011
2186725992416,5cyclictest0-21swapper/111:00:001
2186725992414,7cyclictest24-21ksoftirqd/112:35:211
2186725992412,6cyclictest24-21ksoftirqd/110:23:261
2186725992410,12cyclictest24-21ksoftirqd/108:45:161
2186729992317,4cyclictest178-21systemd-udevd08:32:412
2186729992315,5cyclictest0-21swapper/211:25:242
218672599237,8cyclictest131rcu_preempt11:10:141
218672999229,9cyclictest2197280-21grep07:35:252
218672999222,14cyclictest2238850-21apt09:40:002
2186729992217,3cyclictest2194894-21latency07:30:182
2186729992216,4cyclictest2254758-21unixbench_multi10:20:242
2186729992216,3cyclictest0-21swapper/209:05:252
2186729992215,5cyclictest164-21systemd-journal07:44:402
2186729992210,8cyclictest0-21swapper/210:25:192
218672599227,8cyclictest131rcu_preempt10:00:141
2186725992216,4cyclictest2267191-21kworker/u8:1+events_unbound11:01:061
218672999212,3cyclictest2257481-21cat10:30:172
2186729992115,4cyclictest178-21systemd-udevd08:36:402
2186729992114,5cyclictest164-21systemd-journal08:50:402
2186729992112,6cyclictest311ktimers/209:10:162
2186729992112,6cyclictest311ktimers/209:10:162
2186729992112,6cyclictest311ktimers/208:15:192
2186729992112,6cyclictest0-21swapper/212:40:002
2186729992110,7cyclictest204-21dbus-daemon09:40:582
218672999209,8cyclictest1-21systemd09:30:572
2186729992010,8cyclictest2208285-21entropy08:10:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional