You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 19:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Aug 30, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2207743995138,10cyclictest311ktimers/207:10:142
2207738995041,6cyclictest2249019-21grep09:05:261
2207747994937,9cyclictest391ktimers/309:35:153
2207734994841,5cyclictest2240829-21kworker/u8:1+events_unbound08:50:510
2207747994735,9cyclictest391ktimers/309:20:133
2207743994434,7cyclictest2227459-21fschecks_time08:05:202
2207743994424,16cyclictest0-21swapper/210:10:282
2207743994418,22cyclictest0-21swapper/207:35:162
220774399441,38cyclictest2243391-21ntp_states08:50:222
220774399441,38cyclictest2229306-21/usr/sbin/munin08:10:192
2207738994433,7cyclictest231ktimers/107:35:121
2207734994435,6cyclictest2230035-21unixbench_singl08:10:260
2207743994324,15cyclictest0-21swapper/208:00:262
220774399431,39cyclictest2304482-21sshd11:45:432
220774399431,37cyclictest2256483-21apt-get09:30:122
2207738994333,7cyclictest231ktimers/108:20:151
2207747994230,8cyclictest2245581-21grep08:55:283
220774399421,38cyclictest2320848-21/usr/sbin/munin12:35:272
220774399421,38cyclictest2295047-21/usr/sbin/munin11:20:182
220774399421,38cyclictest2236639-21/usr/sbin/munin08:30:262
220774399421,36cyclictest2313813-21apt-get12:15:142
220774399421,36cyclictest2293712-21ntp_states11:15:252
220774399421,36cyclictest2282895-21/usr/sbin/munin10:45:232
220774399421,35cyclictest2218743-21apt-get07:40:132
220774399421,34cyclictest0-21swapper/207:55:132
220774399420,39cyclictest0-21swapper/208:40:142
220774399420,37cyclictest2273559-21apt-get10:20:142
220774399411,37cyclictest2291784-21/usr/sbin/munin11:10:222
220774399411,37cyclictest2268739-21/usr/sbin/munin10:05:192
220774399411,36cyclictest2254791-21/usr/sbin/munin09:25:152
220774399411,35cyclictest2319153-21apt-get12:30:172
220774399411,35cyclictest2317559-21/usr/sbin/munin12:25:202
220774399411,35cyclictest2298603-21/usr/sbin/munin11:30:192
220774399411,35cyclictest2271843-21/usr/sbin/munin10:15:162
220774399411,34cyclictest2237500-21apt-get08:35:142
2207747994031,5cyclictest0-21swapper/312:10:293
2207743994029,6cyclictest2233428-21grep08:20:282
220774399402,33cyclictest2246258-21/usr/sbin/munin09:00:142
220774399402,30cyclictest311ktimers/210:25:132
220774399402,30cyclictest311ktimers/210:25:132
220774399401,36cyclictest2264065-21/usr/sbin/munin09:50:262
220774399401,35cyclictest2297128-21ntp_states11:25:232
220774399401,34cyclictest2303115-21sshd11:44:432
220774399401,34cyclictest2281208-21/usr/sbin/munin10:40:242
220774399401,34cyclictest2234098-21apt-get08:25:142
220774399400,36cyclictest2299965-21apt-get11:35:152
220774399392,34cyclictest2283756-21apt-get10:50:052
2207743993917,19cyclictest311ktimers/210:30:142
220774399391,35cyclictest2287838-21/usr/sbin/munin11:00:172
220774399391,35cyclictest2287170-21sshd10:57:442
220774399391,35cyclictest2280303-21sshd10:39:442
220774399391,35cyclictest2267008-21/usr/sbin/munin10:00:182
220774399391,35cyclictest2250848-21sshd09:11:422
220774399391,35cyclictest2242206-21users08:45:282
220774399391,35cyclictest2222601-21/usr/sbin/munin07:50:222
220774399391,35cyclictest2213958-21irqstats07:25:182
220774399391,35cyclictest2210822-21/usr/sbin/munin07:15:382
220774399391,34cyclictest2260248-21/usr/sbin/munin09:40:192
220774399391,33cyclictest2265128-21/usr/sbin/munin09:55:192
220774399391,33cyclictest2261607-21apt-get09:45:122
220774399391,33cyclictest2244532-21/usr/sbin/munin08:55:142
220774399391,33cyclictest2231420-21/usr/sbin/munin08:15:252
2207738993928,7cyclictest0-21swapper/112:40:001
2207734993930,6cyclictest2252368-21unixbench_multi09:15:270
2207734993927,8cyclictest2281637-21grep10:40:270
220774399382,33cyclictest2290881-21sshd11:08:432
220774399381,34cyclictest2316145-21/usr/sbin/munin12:20:262
220774399381,34cyclictest2312226-21/usr/sbin/munin12:10:192
220774399381,34cyclictest2248512-21/usr/sbin/munin09:05:222
220774399381,33cyclictest2251490-21/usr/sbin/munin09:15:172
220774399381,32cyclictest2212375-21memory07:20:212
2207738993830,5cyclictest2298040-21idleruntime-cro11:30:001
2207734993831,4cyclictest0-21swapper/011:35:180
2207734993830,4cyclictest0-21swapper/011:55:270
2207734993829,6cyclictest2297611-21unixbench_singl11:25:270
2207747993729,4cyclictest0-21swapper/311:40:003
2207747993727,6cyclictest2255849-21grep09:25:273
2207747993726,7cyclictest0-21swapper/308:45:273
220774399371,33cyclictest53-21kcompactd007:49:332
220774399371,33cyclictest2307994-21cron11:57:002
220774399371,33cyclictest2258297-21/usr/sbin/munin09:35:172
220774399371,30cyclictest2253082-21apt-get09:20:122
220774399370,31cyclictest0-21swapper/212:00:132
220774399370,31cyclictest0-21swapper/212:00:132
2207738993729,4cyclictest0-21swapper/111:00:001
220774399361,32cyclictest2311636-21sshd12:09:432
220774399361,32cyclictest2215440-21diskstats07:30:162
220774399361,30cyclictest2305081-21munin-node11:50:132
2207734993628,4cyclictest0-21swapper/010:30:000
2207734993628,4cyclictest0-21swapper/010:30:000
2207747993527,4cyclictest0-21swapper/307:25:253
2207747993526,5cyclictest0-21swapper/308:05:193
2207747993522,8cyclictest0-21swapper/312:30:303
2207738993522,9cyclictest0-21swapper/107:15:021
2207734993527,5cyclictest2249428-21cron09:10:000
2207734993525,4cyclictest0-21swapper/012:15:260
2207734993523,8cyclictest0-21swapper/009:35:300
2207747993425,4cyclictest0-21swapper/312:00:003
2207738993427,4cyclictest0-21swapper/108:40:001
220774799335,4cyclictest131rcu_preempt07:40:133
2207747993326,5cyclictest2263002-21kworker/u8:1+events_unbound09:55:583
2207738993326,4cyclictest0-21swapper/108:15:271
2207738993324,5cyclictest0-21swapper/108:30:271
2207734993325,4cyclictest0-21swapper/008:15:270
2207734993324,4cyclictest0-21swapper/009:30:540
2207734993321,9cyclictest121ktimers/010:35:130
2207747993222,6cyclictest0-21swapper/312:25:013
2207738993225,4cyclictest2314000-21fschecks_time12:15:171
2207738993225,4cyclictest0-21swapper/110:20:181
2207738993222,7cyclictest2298813-21ntp_offset11:30:221
2207738993222,6cyclictest0-21swapper/108:00:001
2207747993124,4cyclictest0-21swapper/307:30:263
2207747993123,5cyclictest2228665-21kworker/u8:0+events_unbound08:10:413
2207747993120,7cyclictest0-21swapper/310:50:013
2207738993124,4cyclictest2219813-21unixbench_singl07:40:261
2207738993123,4cyclictest0-21swapper/111:10:311
2207738993121,6cyclictest0-21swapper/111:20:011
2207738993118,5cyclictest2237033-21kworker/u8:0+events_unbound08:43:321
2207734993124,4cyclictest0-21swapper/007:25:010
2207734993120,7cyclictest2309503-21grep12:00:270
2207734993120,7cyclictest2309503-21grep12:00:270
2207734993119,7cyclictest0-21swapper/010:05:180
2207747993022,4cyclictest0-21swapper/312:00:273
2207747993022,4cyclictest0-21swapper/312:00:273
2207747993021,5cyclictest0-21swapper/312:25:313
2207738993023,4cyclictest0-21swapper/110:50:301
2207738993023,4cyclictest0-21swapper/108:10:261
2207738993022,4cyclictest0-21swapper/111:35:291
2207738993022,4cyclictest0-21swapper/109:15:171
2207738993021,6cyclictest2288011-21tune2fs11:00:201
2207738993021,6cyclictest2244721-21fschecks_time08:55:181
2207738993020,6cyclictest0-21swapper/107:15:411
2207738993017,11cyclictest2207725-21cyclictest09:35:151
2207734993023,4cyclictest0-21swapper/009:15:000
2207734993023,4cyclictest0-21swapper/007:40:260
220774799293,4cyclictest131rcu_preempt12:05:143
2207747992922,5cyclictest53-21kcompactd007:35:213
2207747992922,4cyclictest0-21swapper/311:40:263
2207747992921,4cyclictest0-21swapper/311:15:293
2207747992919,5cyclictest0-21swapper/310:10:283
2207747992919,5cyclictest0-21swapper/307:55:183
2207738992921,4cyclictest0-21swapper/112:10:201
2207738992921,4cyclictest0-21swapper/109:50:271
2207734992923,4cyclictest2265855-21threads09:55:290
2207734992919,6cyclictest0-21swapper/010:30:270
2207747992822,3cyclictest0-21swapper/310:30:273
2207747992822,3cyclictest0-21swapper/308:50:173
2207738992821,4cyclictest0-21swapper/110:10:271
2207738992819,4cyclictest0-21swapper/109:00:171
2207738992817,8cyclictest2263072-21sh09:50:011
2207734992822,3cyclictest0-21swapper/011:45:000
2207734992822,3cyclictest0-21swapper/011:10:000
2207734992822,3cyclictest0-21swapper/009:45:010
2207734992821,3cyclictest0-21swapper/011:15:180
2207734992820,4cyclictest0-21swapper/011:00:000
2207734992818,6cyclictest2318510-21grep12:25:310
2207734992816,8cyclictest2283916-21wc10:50:010
2207747992721,4cyclictest2221650-21kworker/u8:1+events_unbound08:00:343
2207747992719,4cyclictest0-21swapper/309:10:263
2207747992718,6cyclictest2297111-21tr11:25:223
2207747992716,8cyclictest2287554-21latency_hist11:00:013
2207747992716,7cyclictest2292476-21grep11:10:313
2207747992710,4cyclictest381rcuc/311:50:013
2207738992720,4cyclictest0-21swapper/112:25:311
2207738992717,6cyclictest0-21swapper/112:05:271
2207738992717,6cyclictest0-21swapper/109:30:251
2207734992717,6cyclictest0-21swapper/010:20:000
220773499271,5cyclictest2224188-21irqstats07:55:200
2207747992619,4cyclictest2207557-21kworker/u8:1+events_unbound07:18:473
2207747992619,4cyclictest0-21swapper/311:50:273
2207747992618,4cyclictest0-21swapper/309:00:263
2207747992618,4cyclictest0-21swapper/307:20:173
2207747992616,7cyclictest2251518-21grep09:15:173
2207747992615,8cyclictest2287945-21df_inode11:00:193
2207738992620,3cyclictest0-21swapper/107:45:251
2207738992619,4cyclictest0-21swapper/111:45:271
2207738992619,4cyclictest0-21swapper/110:05:271
2207738992618,4cyclictest0-21swapper/109:10:161
2207738992618,4cyclictest0-21swapper/107:20:361
2207738992617,6cyclictest0-21swapper/111:10:001
2207738992617,6cyclictest0-21swapper/107:30:261
2207738992616,6cyclictest0-21swapper/110:05:001
220773499262,8cyclictest22144402switchtime07:25:240
2207734992619,3cyclictest0-21swapper/008:40:010
2207734992618,5cyclictest0-21swapper/007:45:280
2207734992617,6cyclictest2313247-21kworker/u8:1-ext4-rsv-conversion12:40:000
2207747992519,4cyclictest2322343-21idleruntime-cro12:40:003
2207747992519,3cyclictest0-21swapper/310:25:263
2207747992519,3cyclictest0-21swapper/310:25:263
2207747992519,3cyclictest0-21swapper/309:35:003
2207747992519,3cyclictest0-21swapper/308:25:153
2207747992518,4cyclictest0-21swapper/311:35:013
2207747992518,4cyclictest0-21swapper/310:20:273
2207747992517,4cyclictest0-21swapper/310:05:283
2207738992515,7cyclictest2275830-21ntp_states10:25:231
2207738992515,7cyclictest2275830-21ntp_states10:25:231
2207738992515,6cyclictest0-21swapper/112:00:271
2207738992515,6cyclictest0-21swapper/112:00:271
2207738992515,6cyclictest0-21swapper/110:40:011
2207738992513,9cyclictest2320807-21sed12:35:011
2207734992519,4cyclictest2207557-21kworker/u8:1+events_unbound07:10:240
2207734992518,3cyclictest0-21swapper/012:13:050
2207734992518,3cyclictest0-21swapper/009:50:270
2207747992419,2cyclictest0-21swapper/309:50:273
2207747992418,4cyclictest2228665-21kworker/u8:0+events_unbound08:20:453
2207747992418,3cyclictest0-21swapper/307:55:013
2207747992415,6cyclictest0-21swapper/309:05:263
2207747992414,7cyclictest2209673-21sed07:15:023
2207747992413,7cyclictest2262651-21grep09:45:313
2207738992418,3cyclictest0-21swapper/112:25:011
2207738992418,3cyclictest0-21swapper/111:55:001
2207738992416,4cyclictest0-21swapper/108:00:161
2207734992418,4cyclictest2240829-21kworker/u8:1+events_unbound08:55:270
2207734992418,3cyclictest2225567-21apt-get08:00:120
2207734992418,3cyclictest0-21swapper/010:50:300
2207734992417,4cyclictest2304861-21idleruntime-cro11:50:000
2207734992417,3cyclictest0-21swapper/008:21:050
2207734992417,3cyclictest0-21swapper/007:18:090
220773499241,19cyclictest0-21swapper/012:09:460
220773499241,19cyclictest0-21swapper/007:52:030
220773499240,20cyclictest0-21swapper/009:01:310
2207747992316,4cyclictest0-21swapper/308:35:273
2207747992316,3cyclictest0-21swapper/311:05:233
220774799231,4cyclictest2279659-21sed10:35:253
2207747992314,6cyclictest2239840-21cat08:40:243
2207738992316,5cyclictest2240829-21kworker/u8:1+events_unbound08:49:011
2207738992316,4cyclictest0-21swapper/111:40:261
2207738992315,5cyclictest0-21swapper/111:55:271
2207738992315,5cyclictest0-21swapper/108:50:261
2207738992315,4cyclictest0-21swapper/109:25:171
2207738992313,6cyclictest0-21swapper/110:15:201
2207738992312,7cyclictest0-21swapper/108:05:301
2207734992317,3cyclictest0-21swapper/011:00:460
2207734992312,8cyclictest2239416-21apt-get08:40:060
220773499231,20cyclictest0-21swapper/008:35:010
220773499230,19cyclictest0-21swapper/011:22:000
2207747992216,3cyclictest0-21swapper/312:15:223
2207747992211,7cyclictest2221464-21grep07:45:283
2207738992217,3cyclictest0-21swapper/109:20:171
2207738992216,3cyclictest0-21swapper/110:50:011
2207734992216,3cyclictest0-21swapper/008:25:270
2207734992215,4cyclictest2263078-21idleruntime-cro09:50:010
2207734992215,3cyclictest0-21swapper/011:31:060
2207734992215,3cyclictest0-21swapper/010:20:080
2207734992214,5cyclictest2271200-21head10:10:280
220773499221,19cyclictest0-21swapper/009:21:290
220773499221,18cyclictest630-21snmpd10:00:540
220774799216,3cyclictest131rcu_preempt10:50:293
2207747992114,4cyclictest0-21swapper/309:40:283
2207747992113,5cyclictest0-21swapper/310:00:263
2207747992113,5cyclictest0-21swapper/308:30:253
2207747992112,6cyclictest2280826-21ls10:40:183
2207738992116,3cyclictest0-21swapper/110:30:191
2207738992115,3cyclictest0-21swapper/107:25:201
2207738992113,5cyclictest0-21swapper/107:50:191
2207738992111,7cyclictest0-21swapper/108:25:291
2207734992116,3cyclictest13650irq/42-30be0000.ethernet07:35:200
2207734992114,5cyclictest0-21swapper/008:05:190
220773499211,3cyclictest0-21swapper/011:11:480
220773499211,18cyclictest0-21swapper/012:30:090
220773499211,18cyclictest0-21swapper/009:25:370
2207734992111,7cyclictest2242740-21wc08:50:020
2207738992014,3cyclictest2294965-21cstates11:20:161
2207738992013,5cyclictest231ktimers/109:40:141
2207734991912,5cyclictest121ktimers/011:50:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional