You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 15:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue Dec 02, 2025 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2005563994922,9cyclictest2027595-21/usr/sbin/munin08:10:201
2005567994734,9cyclictest311ktimers/211:35:142
2005563994633,8cyclictest2035747-21apt-get08:35:131
2005563994533,9cyclictest231ktimers/109:00:141
2005563994418,10cyclictest2093884-21unixbench_multi11:20:251
2005559994438,4cyclictest2071433-21kworker/u8:0+events_unbound10:21:020
2005559994437,4cyclictest2114834-21idleruntime-cro12:25:000
2005559994437,4cyclictest2114834-21idleruntime-cro12:25:000
2005559994436,4cyclictest2071551-21cron10:20:000
2005559994436,4cyclictest2023370-21idleruntime-cro08:00:010
2005571994336,4cyclictest2021661-21idleruntime-cro07:55:023
2005567994334,6cyclictest2031783-21kworker/u8:0+events_unbound08:25:282
2005563994324,11cyclictest0-21swapper/110:30:121
2005559994235,5cyclictest2080011-21kworker/u8:0+events_unbound10:51:040
2005559994235,5cyclictest2080011-21kworker/u8:0+events_unbound10:51:040
2005563994126,11cyclictest2073953-21/usr/sbin/munin10:25:211
2005563994113,11cyclictest637-21runrttasks12:35:271
2005559994130,7cyclictest2054082-21grep09:25:260
2005571994032,4cyclictest2037232-21idleruntime-cro08:40:003
2005567994029,6cyclictest0-21swapper/211:40:212
2005563994031,5cyclictest2099478-21munin-plugin-st11:40:001
2005563994028,9cyclictest2059854-21apt-get09:45:121
2005563994028,7cyclictest2032912-21ntp_states08:25:231
2005563994026,9cyclictest2056775-21/usr/sbin/munin09:35:191
2005563994025,8cyclictest0-21swapper/108:45:141
2005563994024,11cyclictest0-21swapper/108:50:131
2005571993929,6cyclictest0-21swapper/307:55:313
2005563993931,4cyclictest2025312-21apt-get08:05:161
2005563993929,7cyclictest2013370-21apt-get07:30:151
2005563993929,7cyclictest2011446-21/usr/sbin/munin07:25:121
2005563993926,9cyclictest2086178-21/usr/sbin/munin11:00:221
2005563993926,9cyclictest2031087-21/usr/sbin/munin08:20:181
2005563993921,15cyclictest2091886-21grep11:15:251
2005563993920,11cyclictest231ktimers/112:15:121
2005571993831,4cyclictest2100729-21unixbench_multi11:40:303
2005571993829,6cyclictest2043788-21unixbench_multi08:55:283
2005571993827,6cyclictest0-21swapper/310:35:273
2005563993832,3cyclictest2082022-21apt-get10:50:141
2005563993832,3cyclictest2082022-21apt-get10:50:131
2005563993831,4cyclictest2037467-21apt-get08:40:141
2005563993828,7cyclictest2105899-21/usr/sbin/munin11:55:261
2005563993827,8cyclictest2077059-21/usr/sbin/munin10:35:171
2005563993826,9cyclictest2063859-21/usr/sbin/munin09:55:221
2005563993826,9cyclictest2059446-21cron09:43:001
2005563993826,9cyclictest2059446-21cron09:43:001
2005563993826,9cyclictest2023866-21/usr/sbin/munin08:00:161
2005563993826,7cyclictest2065492-21/usr/sbin/munin10:00:201
2005563993825,10cyclictest2022924-21/usr/sbin/munin07:55:311
2005563993824,10cyclictest2103255-21/usr/sbin/munin11:50:171
2005563993820,13cyclictest2106696-21cut12:00:141
2005563993820,13cyclictest2048195-21awk09:10:191
2005563993818,15cyclictest2049761-21tune2fs09:15:171
2005571993727,6cyclictest0-21swapper/311:55:263
2005563993731,3cyclictest2101423-21apt-get11:45:131
2005563993731,3cyclictest2053032-21apt-get09:25:131
2005563993728,6cyclictest2069587-21cron10:12:001
2005563993727,7cyclictest2114091-21/usr/sbin/munin12:20:251
2005563993727,7cyclictest2114091-21/usr/sbin/munin12:20:251
2005563993727,7cyclictest2096906-21/usr/sbin/munin11:30:221
2005563993727,7cyclictest2080998-21/usr/sbin/munin10:45:231
2005563993727,7cyclictest2080998-21/usr/sbin/munin10:45:231
2005563993727,7cyclictest2079102-21/usr/sbin/munin10:40:201
2005563993727,7cyclictest2035088-21unixbench_singl08:30:251
2005563993727,7cyclictest2010031-21/usr/sbin/munin07:20:171
2005563993727,6cyclictest2016901-21/usr/sbin/munin07:40:161
2005563993726,7cyclictest2066730-21/usr/sbin/munin10:05:151
2005563993724,10cyclictest2006933-21cron07:12:021
2005563993722,12cyclictest2095296-21/usr/sbin/munin11:25:221
2005563993720,14cyclictest2042963-21/usr/sbin/munin08:55:191
2005563993720,13cyclictest2007501-21munin-node07:15:031
2005571993626,7cyclictest391ktimers/311:05:133
2005571993624,9cyclictest391ktimers/308:50:143
2005571993624,8cyclictest2059620-21auditctl09:45:013
2005571993624,8cyclictest2059620-21auditctl09:45:003
2005563993630,3cyclictest2061552-21apt-get09:50:131
2005563993629,4cyclictest2020180-21apt-get07:50:111
2005563993627,7cyclictest2046571-21/usr/sbin/munin09:05:191
2005563993626,7cyclictest2072372-21/usr/sbin/munin10:20:221
2005563993626,7cyclictest2071146-21/usr/sbin/munin10:15:261
2005563993626,7cyclictest2029682-21/usr/sbin/munin08:15:231
2005563993625,8cyclictest2055840-21taskset09:30:441
2005563993624,9cyclictest2116193-21cron12:25:591
2005563993624,10cyclictest2052542-21cron09:22:001
2005563993623,7cyclictest2116772-21/usr/sbin/munin12:30:131
2005563993622,11cyclictest2019066-21/usr/sbin/munin07:45:221
2005563993622,10cyclictest2084173-21/usr/sbin/munin10:55:181
2005563993619,12cyclictest2087412-21ls11:05:151
2005563993617,15cyclictest2090267-21grep11:10:281
2005571993529,4cyclictest2118073-21kworker/u8:1+events_unbound12:36:183
2005571993528,5cyclictest2090657-21kworker/u8:0+events_unbound11:16:063
2005571993526,4cyclictest0-21swapper/312:10:003
2005571993524,6cyclictest0-21swapper/312:00:243
2005571993524,6cyclictest0-21swapper/307:20:013
2005563993526,6cyclictest2110319-21/usr/sbin/munin12:10:201
2005563993520,11cyclictest2109703-21cron12:10:011
2005559993527,4cyclictest0-21swapper/008:45:280
2005559993527,4cyclictest0-21swapper/007:15:010
2005559993526,6cyclictest2086699-21grep11:00:270
2005571993427,4cyclictest2116543-21munin-plugin-st12:30:003
2005571993426,4cyclictest0-21swapper/312:20:273
2005571993426,4cyclictest0-21swapper/312:20:263
2005571993425,4cyclictest0-21swapper/310:55:183
2005571993424,6cyclictest0-21swapper/311:00:273
2005571993424,6cyclictest0-21swapper/310:20:263
2005571993424,6cyclictest0-21swapper/309:00:263
2005571993424,6cyclictest0-21swapper/308:15:243
2005571993423,7cyclictest0-21swapper/312:10:273
2005571993423,6cyclictest0-21swapper/308:40:273
2005567993427,5cyclictest2059471-21kworker/u8:2+events_unbound09:50:452
2005567993427,3cyclictest0-21swapper/207:35:012
2005567993425,4cyclictest0-21swapper/212:15:162
2005567993424,6cyclictest2076667-21auditctl10:35:002
2005567993421,8cyclictest0-21swapper/208:50:312
200555999346,4cyclictest131rcu_preempt10:30:120
2005559993426,4cyclictest0-21swapper/008:25:270
200557199333,4cyclictest131rcu_preempt08:05:163
2005571993326,3cyclictest0-21swapper/307:30:013
2005571993321,7cyclictest2010774-21grep07:20:273
2005567993326,4cyclictest2044256-21munin-plugin-st09:00:012
2005567993325,4cyclictest0-21swapper/208:50:002
2005567993324,6cyclictest0-21swapper/207:20:262
2005559993325,4cyclictest0-21swapper/010:15:000
2005559993312,5cyclictest131rcu_preempt08:35:130
200557199323,5cyclictest131rcu_preempt10:25:153
2005571993224,4cyclictest0-21swapper/310:50:263
2005571993224,4cyclictest0-21swapper/310:50:263
2005571993222,6cyclictest0-21swapper/308:45:183
2005567993224,4cyclictest0-21swapper/207:45:262
2005567993224,4cyclictest0-21swapper/207:40:012
2005567993223,5cyclictest0-21swapper/211:30:012
2005559993225,5cyclictest2023226-21kworker/u8:1+events_unbound08:11:260
2005559993224,5cyclictest2030031-21kworker/u8:2+events_unbound08:20:160
2005559993223,5cyclictest13650irq/42-30be0000.ethernet07:40:260
2005559993222,6cyclictest0-21swapper/010:25:270
2005559993221,8cyclictest440-21cron11:50:000
2005571993121,6cyclictest0-21swapper/310:15:263
2005571993121,6cyclictest0-21swapper/309:15:263
2005571993121,6cyclictest0-21swapper/308:30:253
2005571993119,7cyclictest0-21swapper/308:20:243
2005567993124,4cyclictest0-21swapper/208:40:272
2005559993124,4cyclictest2096070-21sh11:30:010
2005559993122,6cyclictest2054270-21kworker/u8:2+events_unbound09:35:400
2005559993121,6cyclictest2099008-21grep11:35:260
200555999311,4cyclictest131rcu_preempt10:45:130
200555999311,4cyclictest131rcu_preempt10:45:130
2005571993020,6cyclictest0-21swapper/309:55:253
2005567993022,4cyclictest0-21swapper/210:40:002
2005567993022,4cyclictest0-21swapper/207:50:232
2005567993021,6cyclictest2084943-21unixbench_multi10:55:272
2005567993018,8cyclictest311ktimers/212:00:112
2005559993021,6cyclictest2035043-21grep08:30:250
2005559993021,4cyclictest0-21swapper/011:55:260
2005571992922,3cyclictest0-21swapper/309:15:013
2005571992922,3cyclictest0-21swapper/308:30:013
2005571992919,6cyclictest0-21swapper/307:40:273
2005571992918,7cyclictest0-21swapper/312:30:253
2005571992918,7cyclictest0-21swapper/309:50:253
2005571992918,6cyclictest0-21swapper/310:15:013
2005571992918,6cyclictest0-21swapper/309:30:373
2005571992917,8cyclictest0-21swapper/311:25:243
2005567992922,5cyclictest2059471-21kworker/u8:2+events_unbound09:45:422
2005567992922,4cyclictest0-21swapper/211:20:002
2005567992920,6cyclictest2064260-21unixbench_multi09:55:252
2005567992920,5cyclictest0-21swapper/209:10:272
2005567992918,6cyclictest0-21swapper/207:45:012
2005559992925,2cyclictest0-21swapper/009:20:110
2005559992920,6cyclictest2078384-21sendmail10:40:010
2005559992917,8cyclictest2038931-21apt08:45:000
200555999291,4cyclictest131rcu_preempt12:30:120
2005559992911,10cyclictest11-21ksoftirqd/011:10:260
2005571992822,3cyclictest0-21swapper/311:35:013
2005571992820,4cyclictest0-21swapper/311:50:003
2005571992818,6cyclictest0-21swapper/307:35:283
2005567992820,5cyclictest0-21swapper/208:35:012
2005567992820,4cyclictest0-21swapper/208:00:012
2005567992817,7cyclictest0-21swapper/208:10:262
2005559992822,4cyclictest2010845-21kworker/u8:0+events_unbound07:25:140
2005559992820,5cyclictest2012594-21kworker/u8:1+events_unbound07:45:250
2005559992817,8cyclictest2064735-21ls10:00:010
2005571992719,4cyclictest0-21swapper/311:55:003
2005567992720,5cyclictest181-21systemd-udevd09:19:412
2005567992717,6cyclictest0-21swapper/211:20:252
2005567992716,7cyclictest2082873-21grep10:50:252
2005567992716,7cyclictest2082873-21grep10:50:252
2005567992716,7cyclictest2031635-21grep08:20:242
2005559992720,5cyclictest2040584-21kworker/u8:2+events_unbound09:04:560
2005559992720,5cyclictest2040584-21kworker/u8:2+events_unbound08:50:150
2005559992719,6cyclictest2055989-21kworker/u8:1+events_unbound09:45:190
2005559992719,6cyclictest121ktimers/011:30:130
2005559992717,6cyclictest0-21swapper/009:10:190
2005559992716,6cyclictest0-21swapper/012:10:270
2005571992618,6cyclictest2054270-21kworker/u8:2+events_unbound09:29:423
2005571992618,6cyclictest2040584-21kworker/u8:2+events_unbound09:20:363
2005571992616,6cyclictest0-21swapper/312:15:253
2005571992615,7cyclictest0-21swapper/307:30:363
2005571992614,7cyclictest0-21swapper/309:45:263
2005567992618,4cyclictest0-21swapper/208:15:152
2005567992617,4cyclictest0-21swapper/209:30:372
200555999268,4cyclictest131rcu_preempt11:05:130
2005559992620,4cyclictest2024962-21kworker/u8:2+events_unbound08:08:560
2005559992619,5cyclictest2062943-21kworker/u8:1+events_unbound10:08:420
2005559992618,3cyclictest0-21swapper/007:15:110
2005571992519,4cyclictest2081725-21kworker/u8:1+events_unbound11:21:083
2005571992519,4cyclictest146-21jbd2/mmcblk1p2-809:35:183
2005571992518,4cyclictest0-21swapper/311:35:243
2005571992515,5cyclictest0-21swapper/310:30:153
2005567992519,3cyclictest0-21swapper/211:56:112
2005567992519,3cyclictest0-21swapper/208:00:232
2005567992518,5cyclictest299-21systemd-logind09:07:412
2005567992518,5cyclictest181-21systemd-udevd10:07:412
2005567992518,4cyclictest0-21swapper/208:10:012
2005567992518,3cyclictest0-21swapper/212:10:272
2005567992515,6cyclictest0-21swapper/209:00:262
2005567992514,7cyclictest2071567-21tr10:20:002
2005567992513,6cyclictest0-21swapper/209:25:262
2005559992518,5cyclictest2111178-21kworker/u8:0+events_unbound12:25:380
2005559992518,5cyclictest2042519-21kworker/u8:1+events_unbound08:57:390
2005559992518,4cyclictest2055989-21kworker/u8:1+events_unbound09:40:420
2005559992518,4cyclictest2055989-21kworker/u8:1+events_unbound09:40:410
2005559992518,4cyclictest2001780-21kworker/u8:1+events_unbound07:20:020
2005559992517,4cyclictest0-21swapper/008:00:250
2005559992514,8cyclictest2016554-21sendmail07:40:010
2005559992514,7cyclictest2085426-21sendmail11:00:000
2005571992417,4cyclictest20899542sleep311:10:273
2005571992416,5cyclictest0-21swapper/310:40:263
2005571992414,7cyclictest2067555-21cat10:05:263
2005571992414,6cyclictest2028269-21grep08:10:263
2005567992417,4cyclictest0-21swapper/210:20:232
2005567992415,5cyclictest0-21swapper/207:15:202
2005567992414,6cyclictest0-21swapper/210:00:252
2005559992418,4cyclictest2021486-21kworker/u8:0+events_unbound07:54:560
2005559992417,5cyclictest2014514-21kworker/u8:0+events_unbound07:31:330
2005559992416,5cyclictest2040584-21kworker/u8:2+events_unbound09:20:010
2005559992416,4cyclictest0-21swapper/009:30:370
2005559992415,5cyclictest0-21swapper/011:45:010
200555999241,4cyclictest131rcu_preempt11:15:130
2005559992413,8cyclictest2065375-21wc10:00:180
2005571992317,3cyclictest0-21swapper/309:05:233
2005571992313,7cyclictest2018601-21diskstats07:45:153
2005567992317,4cyclictest2099259-21kworker/u8:2+events_unbound11:49:172
2005567992317,3cyclictest0-21swapper/209:20:172
2005567992316,3cyclictest0-21swapper/212:20:172
2005567992316,3cyclictest0-21swapper/212:20:172
2005567992314,6cyclictest2057414-21/usr/sbin/munin09:35:272
2005567992314,5cyclictest0-21swapper/212:05:282
2005567992313,6cyclictest2115065-21/usr/sbin/munin12:25:262
2005567992313,6cyclictest0-21swapper/211:00:172
2005567992313,6cyclictest0-21swapper/207:25:252
2005567992313,5cyclictest2118241-21apt12:34:592
2005559992317,4cyclictest2062943-21kworker/u8:1+events_unbound10:41:080
2005559992316,5cyclictest13650irq/42-30be0000.ethernet11:20:030
2005559992316,3cyclictest0-21swapper/009:52:280
2005559992314,6cyclictest121ktimers/012:00:110
200555999231,18cyclictest2119931-21cron12:40:000
200555999231,18cyclictest0-21swapper/008:17:310
2005559992310,8cyclictest0-21swapper/012:16:130
2005571992214,4cyclictest0-21swapper/310:05:013
2005571992214,4cyclictest0-21swapper/307:10:253
2005567992216,3cyclictest0-21swapper/211:50:172
200555999221,3cyclictest2046306-21df09:05:150
2005559992213,6cyclictest2103471-21cut11:50:190
2005567992115,3cyclictest0-21swapper/212:40:012
2005567992115,3cyclictest0-21swapper/210:10:182
2005567992113,5cyclictest311ktimers/207:10:132
2005567992113,5cyclictest0-21swapper/210:45:242
2005567992113,5cyclictest0-21swapper/210:45:232
2005567992110,8cyclictest2096820-21nfs4_client11:30:212
2005571992015,3cyclictest2080011-21kworker/u8:0-events_power_efficient10:45:143
2005571992015,3cyclictest2080011-21kworker/u8:0-events_power_efficient10:45:143
2005567992013,3cyclictest440-21cron09:45:002
2005567992013,3cyclictest440-21cron09:45:002
200556799201,16cyclictest2079375-21expr10:40:242
200556799199,7cyclictest2089650-21expr11:10:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional