You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 18:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Mar 09, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2160449994842,4cyclictest2305409-21latency_hist09:30:013
2160443994741,4cyclictest2362170-21latency_hist10:25:011
2160443994543,1cyclictest2258213-21fwupd08:42:091
2160439993832,4cyclictest2289944-21latency_hist09:15:000
2160443993631,4cyclictest2253276-21latency_hist08:40:021
2160447993329,3cyclictest252-21systemd-journal09:10:002
2160439993327,4cyclictest2341913-21diskstats10:05:140
2160439993125,4cyclictest2217129-21latency_hist08:05:000
2160449992926,2cyclictest2243036-21kworker/u8:1+flush-259:009:49:593
2160447992924,3cyclictest2263668-21kworker/u8:3+flush-259:009:25:002
2160439992923,4cyclictest2434931-21latency_hist11:35:000
2160443992823,3cyclictest2481653-21/usr/sbin/munin12:20:151
2160449992722,4cyclictest252-21systemd-journal11:45:003
2160439992725,1cyclictest2253378-21kworker/0:2+pm08:42:100
2160447992520,4cyclictest252-21systemd-journal08:42:112
2160443992520,4cyclictest252-21systemd-journal08:05:001
2160443992419,3cyclictest252-21systemd-journal11:20:081
2160447992317,4cyclictest252-21systemd-journal08:35:002
2160443992319,3cyclictest2388219-21apt-get10:50:131
2160439992320,2cyclictest2227544-21kworker/u8:2+events_unbound08:50:010
2160439992319,3cyclictest2181366-21apt-get07:30:100
2160439992319,3cyclictest2160614-21kworker/u8:4+flush-259:007:15:170
2160439992319,3cyclictest2160614-21kworker/u8:4+flush-259:007:15:160
2160439992319,2cyclictest490-21dbus-daemon11:45:000
2160439992316,5cyclictest2387940-21latency_hist10:50:010
2160449992216,4cyclictest2315744-21latency_hist09:40:013
2160447992215,4cyclictest252-21systemd-journal07:40:002
2160443992217,3cyclictest2263647-21apt-get08:50:001
2160439992219,2cyclictest2409132-21kworker/u8:3+flush-259:011:39:590
2160449992117,3cyclictest2460740-21kworker/u8:3+events_unbound12:10:203
2160449992117,3cyclictest2460740-21kworker/u8:3+events_unbound12:10:203
2160449992117,3cyclictest2393178-21munin-plugin-st10:55:013
2160449992115,4cyclictest2486599-21latency_hist12:25:013
2160447992116,3cyclictest2295099-21latency_hist09:20:002
2160439992117,3cyclictest2429973-21kworker/u8:4+flush-259:012:35:250
2160439992117,2cyclictest2275103-21irqcore09:00:160
2160439992115,4cyclictest2491788-21cron12:30:000
2160449992017,2cyclictest2409376-21apt-get11:10:143
2160449992014,4cyclictest2455581-21latency_hist11:55:003
2160449992014,4cyclictest2367773-21diskstats10:30:143
2160447992018,1cyclictest2269256-21idleruntime-cro08:55:012
2160447992017,2cyclictest2429973-21kworker/u8:4+flush-259:012:00:002
216044399205,7cyclictest2326033-21munin-plugin-st09:50:001
2160443992014,4cyclictest2300264-21latency_hist09:25:011
2160439992016,3cyclictest2196511-21kworker/u8:1+flush-259:008:15:180
2160449991916,2cyclictest2263668-21kworker/u8:3+flush-259:008:50:133
216043999191,16cyclictest1-21systemd11:46:080
2160449991815,2cyclictest2326039-21kworker/u8:3+flush-259:009:50:193
2160449991815,2cyclictest2243036-21kworker/u8:1+flush-259:008:40:193
2160447991811,5cyclictest2429748-21grep11:29:592
2160443991815,2cyclictest2409132-21kworker/u8:3+flush-259:011:15:171
2160443991813,4cyclictest2268337-21ntpq08:50:211
2160443991812,4cyclictest2226612-21ntpq08:10:231
2160439991814,3cyclictest2160614-21kworker/u8:4+flush-259:007:15:000
2160439991814,2cyclictest0-21swapper/010:55:010
2160439991813,3cyclictest2445439-21kworker/u8:2+flush-259:012:05:140
2160439991811,5cyclictest252-21systemd-journal09:54:590
2160449991714,2cyclictest2409132-21kworker/u8:3+flush-259:011:25:233
2160449991713,3cyclictest2398406-21kworker/u8:1+flush-259:011:00:243
2160449991712,3cyclictest252-21systemd-journal11:46:083
2160449991710,5cyclictest2491807-21latency_hist12:30:013
2160443991715,1cyclictest2372477-21idleruntime-cro10:35:001
2160443991714,2cyclictest2346636-21latency_hist10:09:591
2160443991714,2cyclictest2310528-21idleruntime-cro09:34:591
2160443991713,3cyclictest2351828-21kworker/u8:0+flush-259:010:15:241
2160443991713,2cyclictest0-21swapper/109:10:001
2160439991714,2cyclictest60350irq/132-enp0s29f1:rx-010:10:230
2160439991714,2cyclictest2211991-21kworker/u8:2+events_unbound08:05:220
2160439991713,3cyclictest2445230-21kworker/u8:0+flush-259:012:15:000
2160439991713,3cyclictest2445230-21kworker/u8:0+flush-259:012:15:000
2160439991713,3cyclictest2296387-21sed09:20:170
2160439991713,2cyclictest0-21swapper/010:30:190
2160439991712,3cyclictest2221936-21kworker/u8:0+flush-259:008:20:160
2160439991711,4cyclictest509-21rs:main0
2160439991711,4cyclictest509-21rs:main0
2160439991711,4cyclictest252-21systemd-journal11:25:010
2160449991613,2cyclictest2207500-21irqcore07:55:143
2160449991612,3cyclictest2243036-21kworker/u8:1+flush-259:009:19:593
2160449991610,5cyclictest2263647-21apt-get08:50:003
216044799169,5cyclictest2175913-21latency_hist07:25:002
2160447991613,2cyclictest2289939-21sh09:15:002
2160447991612,3cyclictest2460740-21kworker/u8:3+flush-259:012:20:002
2160447991612,3cyclictest2460740-21kworker/u8:3+flush-259:012:19:592
2160447991612,2cyclictest0-21swapper/209:49:592
2160447991610,4cyclictest2347068-21diskstats10:10:152
2160443991613,2cyclictest2409132-21kworker/u8:3+flush-259:011:25:251
2160443991613,2cyclictest2362395-21kworker/u8:4+events_unbound10:45:171
2160443991612,3cyclictest2372497-21kworker/u8:0+flush-259:011:05:011
2160443991612,3cyclictest2211991-21kworker/u8:2+events_unbound08:05:091
2160443991610,5cyclictest2205928-21ntpq07:50:191
216043999169,6cyclictest2310563-21kworker/u8:0-events_unbound09:40:000
2160439991614,1cyclictest60350irq/132-enp0s29f1:rx-011:15:150
2160439991614,1cyclictest60350irq/132-enp0s29f1:rx-007:45:160
2160439991613,2cyclictest61150irq/133-enp0s29f1:tx-010:15:230
2160439991613,2cyclictest60350irq/132-enp0s29f1:rx-012:34:540
2160439991613,2cyclictest60350irq/132-enp0s29f1:rx-010:40:200
2160439991613,2cyclictest60350irq/132-enp0s29f1:rx-007:35:230
2160439991610,4cyclictest2398782-21latency_hist11:00:000
2160449991512,2cyclictest2227544-21kworker/u8:2+flush-259:008:30:013
2160447991511,3cyclictest500-21systemd-logind09:30:002
2160447991510,3cyclictest2300274-21kworker/u8:2+flush-259:009:30:152
216044399159,4cyclictest2476227-21latency_hist12:15:011
216044399159,4cyclictest2476227-21latency_hist12:15:011
2160443991512,2cyclictest2451093-21irqcore11:50:161
2160443991512,2cyclictest2166279-21irqcore07:15:171
2160443991512,2cyclictest2166279-21irqcore07:15:161
2160443991511,3cyclictest2434041-21ntp_kernel_pll_11:30:211
2160443991510,4cyclictest2445207-21latency_hist11:45:001
216043999158,5cyclictest252-21systemd-journal07:26:090
2160439991514,1cyclictest60350irq/132-enp0s29f1:rx-011:27:340
2160439991513,1cyclictest60350irq/132-enp0s29f1:rx-009:40:150
2160439991513,1cyclictest60350irq/132-enp0s29f1:rx-009:28:070
2160439991513,1cyclictest60350irq/132-enp0s29f1:rx-009:09:060
2160439991512,2cyclictest60350irq/132-enp0s29f1:rx-011:59:590
2160439991511,3cyclictest2221936-21kworker/u8:0+flush-259:008:15:000
2160439991511,3cyclictest2160614-21kworker/u8:4+events_unbound07:20:140
2160439991511,2cyclictest0-21swapper/008:35:000
216044999149,4cyclictest2440091-21latency_hist11:40:003
2160449991411,2cyclictest2434521-21unixbench_singl11:30:243
2160449991411,2cyclictest2362395-21kworker/u8:4+events_unbound11:00:013
2160449991411,2cyclictest2357648-21sed10:20:163
2160449991411,2cyclictest2223000-21irqcore08:10:183
2160449991411,2cyclictest0-21swapper/308:40:003
2160449991410,3cyclictest2149950-21kworker/u8:0+flush-259:007:30:143
216044799148,4cyclictest252-21systemd-journal12:35:002
2160447991411,1cyclictest0-21swapper/209:40:002
2160447991410,3cyclictest252-21systemd-journal08:26:082
2160447991410,3cyclictest0-21swapper/211:05:002
216044399147,5cyclictest2367343-21latency_hist10:30:011
2160443991410,3cyclictest2290207-21apt-get09:15:101
2160439991412,1cyclictest60350irq/132-enp0s29f1:rx-009:49:330
2160439991412,1cyclictest60350irq/132-enp0s29f1:rx-009:33:590
2160439991411,2cyclictest61150irq/133-enp0s29f1:tx-010:00:210
2160439991411,2cyclictest60350irq/132-enp0s29f1:rx-012:00:150
2160439991411,2cyclictest60350irq/132-enp0s29f1:rx-011:05:150
2160439991411,2cyclictest60350irq/132-enp0s29f1:rx-010:35:190
2160439991411,2cyclictest0-21swapper/008:50:140
2160439991410,3cyclictest2399118-21cpuspeed_turbos11:00:130
2160439991410,3cyclictest2341506-21kworker/u8:3+events_unbound10:25:200
2160439991410,2cyclictest2482089-21irqcore12:20:160
2160439991410,2cyclictest0-21swapper/008:25:240
216044999139,3cyclictest2243036-21kworker/u8:1+flush-259:009:10:183
216044999139,3cyclictest2196511-21kworker/u8:1+flush-259:007:45:173
2160449991311,1cyclictest0-21swapper/310:05:003
2160449991310,2cyclictest2202331-21irqcore07:50:153
216044799139,3cyclictest2409132-21kworker/u8:3+flush-259:011:30:252
216044799139,2cyclictest2219713-21tr08:05:152
216044799137,5cyclictest0-21swapper/207:30:002
216044799134,3cyclictest2336364-21basename10:00:002
216044799134,3cyclictest2336364-21basename09:59:592
216044799132,6cyclictest2367324-21cron10:30:002
2160447991311,1cyclictest0-21swapper/208:15:012
2160447991310,2cyclictest2337637-21kthreadcore10:00:172
2160447991310,2cyclictest2160614-21kworker/u8:4+flush-259:007:15:252
2160447991310,2cyclictest2160614-21kworker/u8:4+flush-259:007:15:242
2160447991310,2cyclictest0-21swapper/207:35:012
216044399139,3cyclictest509-21rs:main1
2160443991311,1cyclictest0-21swapper/108:15:121
2160443991310,2cyclictest2326397-21cpuspeed_turbos09:50:131
2160443991310,2cyclictest2221936-21kworker/u8:0+flush-259:008:20:241
2160443991310,2cyclictest2200727-21ntp_kernel_err07:45:191
2160439991311,1cyclictest60350irq/132-enp0s29f1:rx-007:55:140
2160439991311,1cyclictest60350irq/132-enp0s29f1:rx-007:41:000
2160439991310,2cyclictest60350irq/132-enp0s29f1:rx-007:50:180
2160439991310,2cyclictest2274421-21turbostat09:00:000
216044999128,3cyclictest2362395-21kworker/u8:4+flush-259:010:40:133
216044999128,3cyclictest2243036-21kworker/u8:1+flush-259:009:00:133
216044999128,2cyclictest0-21swapper/309:55:163
216044999128,2cyclictest0-21swapper/309:55:153
216044999127,3cyclictest252-21systemd-journal10:48:093
2160449991210,1cyclictest2456629-21irqcore11:55:153
2160449991210,1cyclictest0-21swapper/309:40:173
2160449991210,1cyclictest0-21swapper/308:20:143
216044799129,2cyclictest2388284-21cpuspeed_turbos10:50:142
216044799120,5cyclictest2201650-21munin-run07:50:012
216044399129,2cyclictest2466581-21irqcore12:05:151
216044399129,2cyclictest2440077-21cron11:40:001
216044399129,2cyclictest2372914-21fschecks_count10:35:131
216044399129,2cyclictest2336703-21cpuspeed_turbos10:00:131
216044399129,2cyclictest0-21swapper/112:20:001
216044399129,2cyclictest0-21swapper/112:20:001
216044399128,3cyclictest2149950-21kworker/u8:0+flush-259:007:25:151
216044399127,3cyclictest252-21systemd-journal11:59:081
216044399126,2cyclictest25250systemd-journal11:15:001
2160443991210,1cyclictest0-21swapper/109:00:001
216044999118,2cyclictest2373761-21kthreadcore10:35:153
216044999118,2cyclictest2279975-21cpuspeed_turbos09:05:123
216044999117,3cyclictest21761572sleep307:25:113
216044999115,4cyclictest2466140-21/usr/sbin/munin12:05:143
216044799119,1cyclictest0-21swapper/211:50:002
216044799118,2cyclictest2408675-21unixbench_singl11:05:242
216044799118,2cyclictest2161665-21kthreadcore07:10:162
216044799118,2cyclictest0-21swapper/211:40:172
216044799118,1cyclictest0-21swapper/211:10:202
216044799117,3cyclictest2445230-21kworker/u8:0+flush-259:012:10:232
216044799117,3cyclictest2445230-21kworker/u8:0+flush-259:012:10:232
216044799117,3cyclictest2351828-21kworker/u8:0+flush-259:010:20:242
216044799114,2cyclictest252-21systemd-journal08:25:002
216044399119,1cyclictest2181770-21irqcore07:30:151
216044399118,2cyclictest2171109-21cpuspeed_turbos07:20:121
216044999107,2cyclictest2465426-21unixbench_multi12:00:253
216044799108,1cyclictest0-21swapper/208:35:132
216044799107,2cyclictest2481901-21fschecks_time12:20:152
216044799107,1cyclictest0-21swapper/210:05:162
216044799106,2cyclictest22591102sleep208:45:162
216044399108,1cyclictest0-21swapper/109:29:591
216044399108,1cyclictest0-21swapper/107:55:121
216044399107,2cyclictest24609592sleep112:00:131
216044399107,2cyclictest2149950-21kworker/u8:0+flush-259:007:35:241
21604499996,2cyclictest2414611-21cpuspeed_turbos11:15:133
21604439984,3cyclictest252-21systemd-journal12:25:391
21604439984,3cyclictest2310940-21cut09:35:141
21604439981,5cyclictest2238100-21apt-get08:25:111
21604439974,2cyclictest2347794-21sed10:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional