You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 16:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun May 03, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2123696994842,4cyclictest2341286-21apt-get10:40:121
2123704994539,4cyclictest252-21systemd-journal10:55:153
2123696994033,5cyclictest2367031-21apt-get11:05:111
2123704993932,5cyclictest2268398-21latency_hist09:30:013
2123699993935,3cyclictest2123887-21kworker/u8:1+flush-259:008:50:142
2123699993833,3cyclictest252-21systemd-journal09:02:092
2123696993833,4cyclictest2123887-21kworker/u8:1+flush-259:009:40:231
2123694993733,3cyclictest2366534-21kworker/u8:3+flush-259:011:15:210
2123696993529,4cyclictest252-21systemd-journal08:57:111
2123694993531,3cyclictest2371928-21kworker/u8:0+flush-259:011:20:150
2123694993531,3cyclictest2123887-21kworker/u8:1+flush-259:007:50:230
2123696993430,3cyclictest2371928-21kworker/u8:0+events_unbound11:25:211
2123694993330,2cyclictest2371928-21kworker/u8:0+flush-259:011:15:010
2123694993329,2cyclictest2258088-21true09:19:590
2123694993228,3cyclictest2139398-21apt-get07:25:120
2123704993124,5cyclictest2288560-21ntpq09:45:203
2123696993126,4cyclictest2361863-21/usr/sbin/munin11:00:151
2123694993026,3cyclictest252-21systemd-journal08:45:000
2123699992924,3cyclictest2325848-21apt-get10:25:132
2123704992822,4cyclictest2377329-21/usr/sbin/munin11:15:203
2123696992824,3cyclictest2118546-21kworker/u8:0+events_unbound07:20:211
2123696992823,3cyclictest2180702-21apt-get08:05:111
2123694992824,3cyclictest2123887-21kworker/u8:1+events_unbound09:40:220
2123694992823,3cyclictest2408039-21kworker/u8:1+events_unbound11:49:590
2123694992822,5cyclictest2123887-21kworker/u8:1+flush-259:009:10:010
2123696992724,2cyclictest2377113-21kworker/u8:1+flush-259:011:20:011
2123696992720,5cyclictest2403129-21apt-get11:40:131
2123694992723,3cyclictest2123887-21kworker/u8:1+flush-259:007:10:240
2123694992722,4cyclictest2263481-21/usr/sbin/munin09:25:240
2123694992722,3cyclictest2170375-21apt-get07:55:130
2123694992720,5cyclictest2324713-21ntpq10:20:200
2123696992623,2cyclictest2206110-21kworker/u8:0+flush-259:008:30:201
2123696992622,3cyclictest2330757-21kworker/u8:1+events_unbound10:55:231
2123696992622,3cyclictest2123887-21kworker/u8:1+flush-259:007:10:201
2123696992620,4cyclictest2377091-21latency_hist11:15:011
2123696992619,5cyclictest2153758-21ntpq07:35:191
2123694992622,3cyclictest2273586-21kworker/u8:2+flush-259:010:15:250
2123694992622,3cyclictest2273586-21kworker/u8:2+flush-259:010:15:240
2123699992522,2cyclictest2123887-21kworker/u8:1+flush-259:008:35:212
2123699992520,4cyclictest2123887-21kworker/u8:1+flush-259:009:25:232
2123696992522,2cyclictest64996-21kworker/u8:2+events_unbound07:15:231
2123696992522,2cyclictest2408039-21kworker/u8:1+events_unbound11:50:141
2123696992521,3cyclictest2408040-21kworker/u8:4+events_unbound11:55:251
2123696992521,3cyclictest2118546-21kworker/u8:0+events_unbound07:40:211
2123696992520,4cyclictest2258065-21latency_hist09:20:001
2123696992520,3cyclictest2170337-21kworker/u8:3+flush-259:007:55:171
2123694992521,3cyclictest2408039-21kworker/u8:1+events_unbound11:55:290
2123694992521,3cyclictest2123887-21kworker/u8:1+flush-259:008:10:210
2123694992519,4cyclictest2435188-21diskstats12:10:130
2123694992519,4cyclictest2200131-21ntpq08:20:200
2123694992518,5cyclictest2396880-21ntpq11:30:210
2123694992518,5cyclictest2315242-21latency_hist10:15:010
2123699992419,3cyclictest2300001-21/usr/sbin/munin10:00:142
2123699992418,4cyclictest2346583-21diskstats10:45:142
2123699992417,5cyclictest252-21systemd-journal11:05:012
2123696992420,3cyclictest2309450-21kworker/u8:4+flush-259:010:30:221
2123696992420,3cyclictest2118546-21kworker/u8:0+flush-259:008:05:001
2123694992421,2cyclictest2330757-21kworker/u8:1+flush-259:010:45:010
2123694992420,3cyclictest2309450-21kworker/u8:4+events_unbound10:10:010
2123694992420,3cyclictest2309450-21kworker/u8:4+events_unbound10:10:000
2123694992420,3cyclictest2263008-21kworker/u8:0+events_unbound09:30:190
2123694992420,3cyclictest2118546-21kworker/u8:0+events_unbound07:35:230
2123694992419,4cyclictest2123887-21kworker/u8:1+events_unbound08:00:120
2123699992319,3cyclictest2408039-21kworker/u8:1+flush-259:012:20:162
2123696992319,3cyclictest2330757-21kworker/u8:1+events_unbound10:45:161
2123694992318,4cyclictest2263008-21kworker/u8:0+events_unbound09:35:020
2123694992317,4cyclictest2222297-21apt-get08:45:120
2123694992317,4cyclictest2195928-21kworker/u8:2+flush-259:008:25:200
2123704992218,2cyclictest2330975-21apt-get10:30:103
2123704992217,3cyclictest2253192-21apt-get09:15:113
2123704992217,3cyclictest2123887-21kworker/u8:1+flush-259:010:05:183
2123704992217,3cyclictest2123887-21kworker/u8:1+flush-259:010:05:173
2123704992216,4cyclictest2414280-21/usr/sbin/munin11:50:203
2123704992216,4cyclictest2211720-21awk08:35:013
2123699992217,4cyclictest2309450-21kworker/u8:4+flush-259:010:30:242
2123696992218,3cyclictest2263008-21kworker/u8:0+events_unbound09:35:161
2123694992218,3cyclictest2408040-21kworker/u8:4+events_unbound12:35:210
2123694992218,3cyclictest2118546-21kworker/u8:0+events_unbound07:30:250
2123694992217,4cyclictest2206110-21kworker/u8:0+events_unbound09:14:500
2123694992217,3cyclictest64996-21kworker/u8:2+flush-259:007:15:200
2123699992117,3cyclictest2123887-21kworker/u8:1+flush-259:009:10:172
2123699992117,2cyclictest509-21rs:main2
2123696992118,2cyclictest2273586-21kworker/u8:2+events_unbound09:45:221
2123696992117,3cyclictest2170337-21kworker/u8:3+events_unbound08:10:151
2123696992116,3cyclictest2408698-21apt-get11:45:131
2123696992115,4cyclictest252-21systemd-journal10:25:001
2123694992118,2cyclictest2371928-21kworker/u8:0+flush-259:012:20:210
2123694992118,2cyclictest2206110-21kworker/u8:0+flush-259:008:50:220
2123694992117,3cyclictest2123887-21kworker/u8:1+flush-259:009:05:000
2123694992114,5cyclictest252-21systemd-journal11:55:000
2123704992017,2cyclictest2366534-21kworker/u8:3+flush-259:011:30:173
2123699992015,4cyclictest2289134-21kworker/u8:0+flush-259:009:59:592
2123696992017,2cyclictest2371928-21kworker/u8:0+events_unbound12:25:231
2123696992017,2cyclictest2118546-21kworker/u8:0+events_unbound07:30:231
2123696992016,3cyclictest2123887-21kworker/u8:1+flush-259:008:55:001
2123696992014,4cyclictest2201287-21/usr/sbin/munin08:25:171
2123694992016,3cyclictest2371928-21kworker/u8:0+events_unbound12:05:220
2123694992016,3cyclictest2366534-21kworker/u8:3+flush-259:011:10:000
2123694992013,5cyclictest2138289-21ntpq07:20:210
2123699991914,4cyclictest2268830-21diskstats09:30:142
2123696991915,3cyclictest2304930-21kworker/u8:3+events_unbound10:05:221
2123696991915,3cyclictest2304930-21kworker/u8:3+events_unbound10:05:221
2123696991915,3cyclictest2123887-21kworker/u8:1+flush-259:009:55:221
2123694991916,2cyclictest2408006-21cut11:45:000
2123694991914,4cyclictest2123887-21kworker/u8:1+events_unbound09:23:130
2123694991913,4cyclictest2387624-21kworker/u8:2+flush-259:011:35:160
2123704991814,3cyclictest2278852-21base6409:40:003
2123704991814,3cyclictest2133803-21kworker/u8:3+flush-259:007:40:013
2123704991812,4cyclictest2356457-21latency_hist10:55:013
2123704991811,5cyclictest2262330-21ntpq09:20:203
2123699991815,2cyclictest2279807-21irqcore09:40:172
2123699991814,2cyclictest0-21swapper/211:20:012
2123699991813,3cyclictest2371928-21kworker/u8:0+flush-259:011:10:172
2123699991812,4cyclictest252-21systemd-journal12:30:382
2123699991812,4cyclictest252-21systemd-journal12:30:372
2123696991815,2cyclictest2304930-21kworker/u8:3+flush-259:010:35:261
2123696991815,2cyclictest2195910-21sh08:20:001
2123696991815,2cyclictest2123887-21kworker/u8:1+flush-259:009:00:221
2123696991815,2cyclictest0-21swapper/112:15:001
2123696991814,3cyclictest2371928-21kworker/u8:0+events_unbound12:00:201
2123696991814,3cyclictest2133803-21kworker/u8:3+events_unbound07:25:241
2123694991815,2cyclictest2309450-21kworker/u8:4+events_unbound10:31:110
2123694991815,2cyclictest2273586-21kworker/u8:2+events_unbound09:45:210
2123694991814,3cyclictest2206110-21kworker/u8:0+flush-259:008:59:460
2123694991811,5cyclictest2195904-21latency_hist08:20:000
2123704991712,3cyclictest252-21systemd-journal12:20:103
2123699991714,2cyclictest2455409-21cron12:30:002
2123696991714,2cyclictest2463174-21kthreadcore12:35:191
2123696991713,3cyclictest2123887-21kworker/u8:1+flush-259:007:55:001
2123696991712,4cyclictest2242910-21apt-get09:05:131
2123694991714,2cyclictest60350irq/132-enp0s29f1:rx-009:50:110
2123694991714,2cyclictest60350irq/132-enp0s29f1:rx-007:41:110
2123694991713,3cyclictest2419225-21kworker/u8:5+events_unbound12:33:110
2123694991713,3cyclictest2419225-21kworker/u8:5+events_unbound12:33:110
2123694991713,3cyclictest2408039-21kworker/u8:1+flush-259:012:00:180
2123694991713,3cyclictest2330757-21kworker/u8:1+flush-259:010:45:110
2123694991713,3cyclictest2118546-21kworker/u8:0+events_unbound08:09:370
2123704991614,1cyclictest0-21swapper/309:10:003
2123704991613,2cyclictest2315515-21apt-get10:15:123
2123704991613,2cyclictest2315515-21apt-get10:15:113
2123699991613,2cyclictest2201726-21irqcore08:25:182
2123699991612,2cyclictest0-21swapper/211:54:592
2123699991610,4cyclictest2284558-21apt-get09:45:102
212369699169,5cyclictest2211969-21/usr/sbin/munin08:35:141
2123696991612,3cyclictest2304930-21kworker/u8:3+flush-259:010:25:261
2123696991612,3cyclictest2123887-21kworker/u8:1+flush-259:009:10:211
2123696991611,4cyclictest2371928-21kworker/u8:0+events_unbound11:30:231
2123694991613,2cyclictest61150irq/133-enp0s29f1:tx-011:25:240
2123694991613,2cyclictest60350irq/132-enp0s29f1:rx-010:25:170
2123694991613,2cyclictest60350irq/132-enp0s29f1:rx-008:31:290
2123694991612,3cyclictest2330757-21kworker/u8:1+events_unbound11:00:250
2123694991612,2cyclictest2371928-21kworker/u8:0+flush-259:012:15:170
2123694991611,4cyclictest2351321-21kworker/u8:0+events_unbound10:58:120
212370499159,4cyclictest2402856-21latency_hist11:40:003
2123704991512,2cyclictest2971-21cron08:40:003
212369999159,4cyclictest252-21systemd-journal12:39:102
212369999151,5cyclictest2392545-21munin-run11:30:012
2123699991510,3cyclictest2123887-21kworker/u8:1+flush-259:007:50:162
2123696991512,2cyclictest2263008-21kworker/u8:0+flush-259:009:34:591
2123696991511,3cyclictest2118546-21kworker/u8:0+events_unbound07:45:201
2123694991513,1cyclictest60350irq/132-enp0s29f1:rx-010:03:420
2123694991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:550
2123694991512,2cyclictest60350irq/132-enp0s29f1:rx-009:55:190
2123694991512,2cyclictest2118546-21kworker/u8:0+flush-259:007:45:230
2123694991511,3cyclictest2330757-21kworker/u8:1+flush-259:010:50:240
212370499148,4cyclictest252-21systemd-journal08:22:103
212370499147,5cyclictest252-21systemd-journal09:34:593
2123704991411,2cyclictest2435440-21irqcore12:10:163
2123704991411,2cyclictest2346647-21fschecks_time10:45:133
2123704991411,2cyclictest2320736-21cpuspeed_turbos10:20:133
2123704991411,2cyclictest2143392-21ntp_kernel_err07:25:213
2123704991410,3cyclictest1-21systemd08:09:103
212369999148,4cyclictest252-21systemd-journal12:17:112
212369999148,4cyclictest2341002-21sh10:40:012
212369999148,4cyclictest2253354-21diskstats09:15:132
2123699991412,1cyclictest0-21swapper/207:35:002
2123699991411,1cyclictest0-21swapper/209:40:012
2123699991410,3cyclictest2123887-21kworker/u8:1+flush-259:008:45:172
212369699148,4cyclictest252-21systemd-journal10:52:111
2123696991411,2cyclictest2387624-21kworker/u8:2+events_unbound11:35:221
2123696991411,2cyclictest2195928-21kworker/u8:2+flush-259:008:24:411
2123696991411,1cyclictest0-21swapper/107:10:001
2123694991411,2cyclictest60350irq/132-enp0s29f1:rx-012:27:100
212369999137,4cyclictest2402053-21sshd11:35:222
2123699991310,2cyclictest2355696-21proc_pri10:50:242
2123699991310,2cyclictest2210748-21needreboot08:30:192
2123699991310,2cyclictest2160542-21irqcore07:45:172
212369699139,3cyclictest2309450-21kworker/u8:4+events_unbound10:10:111
212369699138,4cyclictest252-21systemd-journal09:29:521
2123696991310,2cyclictest2371928-21kworker/u8:0+flush-259:011:25:001
2123696991310,2cyclictest2258754-21irqcore09:20:171
212370499129,2cyclictest2236621-21ntp_kernel_pll_08:55:223
212370499129,2cyclictest2179946-21unixbench_multi08:00:243
212370499126,4cyclictest2170109-21awk07:55:013
212369999129,2cyclictest2134300-21cpuspeed_turbos07:20:132
212369999129,2cyclictest0-21swapper/210:25:012
212369999129,2cyclictest0-21swapper/210:10:002
212369999129,2cyclictest0-21swapper/210:09:592
212369999129,1cyclictest0-21swapper/211:45:182
212369999128,3cyclictest2217203-21cpuspeed_turbos08:40:142
212369999128,3cyclictest2143841-21unixbench_multi07:25:252
212369999128,3cyclictest2123887-21kworker/u8:1+flush-259:007:10:252
212369699128,3cyclictest2371928-21kworker/u8:0+flush-259:012:15:351
212369699128,3cyclictest2217135-21apt-get08:40:121
2123694991210,1cyclictest60350irq/132-enp0s29f1:rx-010:35:200
212370499119,1cyclictest0-21swapper/311:00:163
212370499119,1cyclictest0-21swapper/308:25:183
212370499118,2cyclictest2461900-21kthreadcore12:35:183
212370499118,2cyclictest0-21swapper/308:40:133
212370499118,2cyclictest0-21swapper/307:25:003
212370499117,2cyclictest21294392sleep307:15:183
212370499110,9cyclictest2460612-21awk12:35:003
212370499110,9cyclictest2460612-21awk12:35:003
212369999118,2cyclictest2175690-21fschecks_count08:00:152
212369999118,2cyclictest0-21swapper/210:40:132
212369999117,3cyclictest2252636-21kworker/u8:2+flush-259:009:21:072
212369999117,3cyclictest2123887-21kworker/u8:1+flush-259:008:15:152
212369999116,3cyclictest252-21systemd-journal11:08:102
212369699118,2cyclictest2289788-21cpuspeed_turbos09:50:131
212369699115,4cyclictest2429980-21diskstats12:05:131
212370499107,2cyclictest2371091-21ntpq11:05:223
212370499104,4cyclictest252-21systemd-journal10:45:013
212370499101,2cyclictest2392538-21latency_hist11:30:003
212370499100,8cyclictest2294754-21cat09:55:013
212369999106,2cyclictest0-21swapper/210:15:172
212369999106,2cyclictest0-21swapper/210:15:162
212369699107,2cyclictest2445468-21cpuspeed_turbos12:20:121
21236999997,1cyclictest0-21swapper/211:20:122
21236969997,1cyclictest0-21swapper/110:15:181
21236969997,1cyclictest0-21swapper/110:15:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional