You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 19:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 23, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1995359995044,4cyclictest2248870-21cat11:15:013
1995355995046,3cyclictest1989811-21kworker/u8:0+flush-259:007:45:012
1995355994239,2cyclictest2109098-21kworker/u8:0+flush-259:009:00:202
1995349994239,2cyclictest2217913-21kworker/u8:1+flush-259:011:05:000
1995355994137,2cyclictest2269694-21kworker/u8:0+events_unbound11:50:162
1995351994137,3cyclictest2217913-21kworker/u8:1+flush-259:010:49:591
1995355994037,2cyclictest2026393-21kworker/u8:1+flush-259:007:50:012
1995355994034,2cyclictest2321574-21kworker/u8:1+events_unbound12:30:152
1995359993933,4cyclictest335557-21systemd-journal07:40:013
1995355993834,3cyclictest2114443-21kworker/u8:1+flush-259:009:20:222
1995355993733,3cyclictest2217913-21kworker/u8:1+flush-259:011:15:382
1995355993733,3cyclictest2186359-21kworker/u8:0+events_unbound10:20:202
1995355993732,4cyclictest1989811-21kworker/u8:0+events_unbound08:10:212
1995351993732,3cyclictest2171094-21kworker/u8:3+flush-259:010:20:001
1995355993633,2cyclictest2062464-21kworker/u8:4+events_unbound08:15:212
1995355993633,2cyclictest2026393-21kworker/u8:1+events_unbound08:00:162
1995355993632,3cyclictest2150248-21kworker/u8:2+events_unbound09:44:402
1995355993532,2cyclictest1995318-21kworker/u8:3+flush-259:008:50:202
1995359993430,3cyclictest2150248-21kworker/u8:2+flush-259:010:10:003
1995355993431,2cyclictest2114443-21kworker/u8:1+events_unbound09:35:212
1995355993430,3cyclictest2114443-21kworker/u8:1+events_unbound09:25:222
1995355993427,3cyclictest2289884-21kworker/u8:2+events_unbound12:10:122
1995355993330,2cyclictest2316186-21kworker/u8:3+events_unbound12:25:142
1995355993330,2cyclictest2150248-21kworker/u8:2+flush-259:010:30:152
1995355993329,3cyclictest2150248-21kworker/u8:2+events_unbound11:00:132
1995355993229,2cyclictest2072993-21kworker/u8:1+events_unbound08:35:172
1995355993227,2cyclictest2072993-21kworker/u8:1+events_unbound08:25:002
1995355993226,2cyclictest2139726-21kworker/u8:0+events_unbound09:50:222
1995359993127,3cyclictest1995318-21kworker/u8:3+flush-259:008:09:383
1995355993128,2cyclictest2289884-21kworker/u8:2+flush-259:012:05:262
1995355993128,2cyclictest2217913-21kworker/u8:1+events_unbound10:55:222
1995355993128,2cyclictest2150248-21kworker/u8:2+events_unbound10:00:242
1995355993127,3cyclictest2150248-21kworker/u8:2+flush-259:011:25:232
1995355993127,3cyclictest2150248-21kworker/u8:2+events_unbound10:29:362
1995351993127,3cyclictest2269915-21apt-get11:35:121
1995349993127,3cyclictest2186359-21kworker/u8:0+flush-259:010:20:170
1995349993125,4cyclictest335557-21systemd-journal09:29:200
1995359993027,2cyclictest2072993-21kworker/u8:1+flush-259:008:30:153
1995359993024,5cyclictest2020175-21ntpq07:30:223
1995355993027,2cyclictest2062464-21kworker/u8:4+events_unbound08:49:132
1995355993026,3cyclictest2165746-21kworker/u8:1+flush-259:010:05:212
1995351993025,3cyclictest2099014-21/usr/sbin/munin08:50:141
1995355992925,3cyclictest2093823-21kworker/u8:2+flush-259:008:59:392
1995355992925,3cyclictest2093823-21kworker/u8:2+flush-259:008:59:392
1995351992925,3cyclictest2264752-21apt-get11:30:101
1995351992924,4cyclictest1999543-21ntpq07:10:201
1995349992921,6cyclictest2046814-21latency_hist08:00:010
1995359992824,3cyclictest2269694-21kworker/u8:0+flush-259:011:45:013
1995355992825,2cyclictest2186359-21kworker/u8:0+flush-259:011:10:262
1995355992825,2cyclictest2062464-21kworker/u8:4+flush-259:009:15:382
1995355992825,2cyclictest1989811-21kworker/u8:0+flush-259:007:10:022
1995355992824,3cyclictest2253896-21kworker/u8:3+events_unbound11:40:142
1995355992824,3cyclictest2217913-21kworker/u8:1+flush-259:010:45:252
1995355992824,3cyclictest2114443-21kworker/u8:1+events_unbound09:09:392
1995355992824,3cyclictest1995318-21kworker/u8:3+flush-259:007:30:112
1995355992824,3cyclictest1995318-21kworker/u8:3+flush-259:007:15:222
1995355992823,3cyclictest2186359-21kworker/u8:0+flush-259:010:35:252
1995351992825,2cyclictest2186359-21kworker/u8:0+flush-259:011:00:011
1995349992821,5cyclictest2269653-21latency_hist11:35:010
1995359992722,4cyclictest2176043-21latency_hist10:05:023
1995355992723,3cyclictest1995318-21kworker/u8:3+events_unbound08:26:402
1995355992721,4cyclictest2191512-21latency_hist10:20:022
199534999277,5cyclictest2315502-21ntpq12:15:200
1995349992722,4cyclictest2021298-21apt-get07:35:110
1995349992720,5cyclictest2010753-21latency_hist07:25:010
1995355992623,2cyclictest1989811-21kworker/u8:0+events_unbound07:25:152
1995355992622,3cyclictest2269694-21kworker/u8:0+events_unbound11:55:012
1995355992622,3cyclictest1995318-21kworker/u8:3+flush-259:008:30:422
1995355992622,3cyclictest1995318-21kworker/u8:3+events_unbound08:05:392
1995355992622,3cyclictest1989811-21kworker/u8:0+events_unbound07:36:392
1995355992621,3cyclictest335557-21systemd-journal09:58:432
1995351992623,2cyclictest2150248-21kworker/u8:2+flush-259:011:25:151
1995349992619,5cyclictest2160800-21/usr/sbin/munin09:50:190
1995349992618,5cyclictest2036469-21latency_hist07:50:010
1995355992522,2cyclictest2289884-21kworker/u8:2+flush-259:012:20:162
1995355992521,3cyclictest2264316-21kworker/u8:1+events_unbound11:35:002
1995355992521,3cyclictest2150248-21kworker/u8:2+events_unbound11:35:152
1995355992521,3cyclictest2150248-21kworker/u8:2+events_unbound09:47:402
1995351992521,3cyclictest2114443-21kworker/u8:1+flush-259:009:25:001
1995351992520,3cyclictest2290259-21apt-get11:55:011
1995359992420,3cyclictest2269694-21kworker/u8:0+events_unbound11:50:143
1995359992420,3cyclictest2093823-21kworker/u8:2+flush-259:008:45:173
1995355992421,2cyclictest2253896-21kworker/u8:3+flush-259:012:00:192
1995355992421,2cyclictest2026393-21kworker/u8:1+flush-259:007:55:232
1995355992420,3cyclictest2129695-21kworker/u8:2+events_unbound09:30:162
1995351992420,3cyclictest2150248-21kworker/u8:2+events_unbound10:35:221
1995351992420,2cyclictest1989811-21kworker/u8:0+events_unbound08:20:161
1995349992420,3cyclictest335557-21systemd-journal08:28:170
1995359992319,3cyclictest2150248-21kworker/u8:2+events_unbound10:35:183
1995359992317,4cyclictest2310483-21ntpq12:10:233
1995355992320,2cyclictest2186359-21kworker/u8:0+events_unbound11:06:382
1995355992320,2cyclictest2171094-21kworker/u8:3+flush-259:010:10:532
1995355992319,3cyclictest2150248-21kworker/u8:2+flush-259:010:40:232
1995355992319,3cyclictest2026393-21kworker/u8:1+events_unbound07:50:172
1995349992317,4cyclictest2119642-21apt-get09:10:110
1995359992219,2cyclictest2289884-21kworker/u8:2+events_unbound12:05:233
1995359992219,2cyclictest1989811-21kworker/u8:0+events_unbound08:25:243
1995359992218,3cyclictest2150248-21kworker/u8:2+flush-259:011:10:003
1995359992218,3cyclictest2026393-21kworker/u8:1+flush-259:007:45:253
1995355992218,3cyclictest1984235-21kworker/u8:1+events_unbound07:24:372
1995351992218,3cyclictest2186359-21kworker/u8:0+flush-259:010:30:191
1995351992218,3cyclictest1984235-21kworker/u8:1+events_unbound07:20:151
1995359992118,2cyclictest2041613-21idleruntime-cro07:55:003
1995359992117,3cyclictest2150248-21kworker/u8:2+flush-259:010:45:213
1995359992117,3cyclictest2124386-21journal-offline09:13:253
1995351992118,2cyclictest2150248-21kworker/u8:2+flush-259:009:55:251
1995351992118,2cyclictest2129695-21kworker/u8:2+events_unbound09:30:131
1995351992117,3cyclictest1995318-21kworker/u8:3+flush-259:008:30:201
1995351992117,2cyclictest2150248-21kworker/u8:2+flush-259:011:00:161
1995359992017,2cyclictest2129695-21kworker/u8:2+flush-259:009:30:203
1995359992016,2cyclictest2150248-21kworker/u8:2+events_unbound11:35:193
1995359992015,4cyclictest2072072-21ntpq08:20:203
1995355992017,2cyclictest2253896-21kworker/u8:3+events_unbound11:20:222
1995355992017,2cyclictest2062464-21kworker/u8:4+events_unbound09:10:252
1995355992017,2cyclictest1995318-21kworker/u8:3+events_unbound08:44:392
1995351992018,1cyclictest2331085-21ntpq12:30:221
1995351992017,2cyclictest2186359-21kworker/u8:0+flush-259:010:20:191
1995351992016,3cyclictest2062464-21kworker/u8:4+flush-259:009:10:241
1995351992016,3cyclictest2031562-21/usr/sbin/munin07:45:141
1995351992015,3cyclictest2249356-21/usr/sbin/munin11:15:181
1995349992016,3cyclictest335557-21systemd-journal10:28:470
1995349992010,2cyclictest2294945-21ntpq11:55:180
1995359991916,2cyclictest2150248-21kworker/u8:2+events_unbound09:55:233
1995359991915,3cyclictest2150248-21kworker/u8:2+events_unbound11:30:223
1995359991915,3cyclictest2088695-21apt-get08:40:123
1995355991915,3cyclictest2269694-21kworker/u8:0+events_unbound11:48:362
1995355991915,3cyclictest2186359-21kworker/u8:0+events_unbound10:50:232
1995355991915,2cyclictest2311568-21apt-get12:15:112
1995351991916,2cyclictest2072993-21kworker/u8:1+flush-259:008:35:171
1995351991915,3cyclictest2114443-21kworker/u8:1+flush-259:009:05:101
1995351991915,3cyclictest2093823-21kworker/u8:2+events_unbound08:45:231
1995351991915,3cyclictest1989811-21kworker/u8:0+events_unbound08:10:231
199534999195,4cyclictest2088442-21munin-run08:40:010
1995349991913,4cyclictest335557-21systemd-journal11:45:010
1995359991815,3cyclictest2150248-21kworker/u8:2+events_unbound09:40:213
1995359991815,2cyclictest2150248-21kworker/u8:2+events_unbound10:40:183
1995359991815,2cyclictest2109098-21kworker/u8:0+events_unbound09:15:223
1995359991815,2cyclictest1995318-21kworker/u8:3+flush-259:008:50:243
1995359991815,2cyclictest1989811-21kworker/u8:0+flush-259:008:00:183
1995359991814,3cyclictest2129695-21kworker/u8:2+flush-259:009:30:003
1995359991813,3cyclictest2197120-21latency_hist10:25:003
1995359991812,5cyclictest2186589-21apt-get10:15:143
1995351991815,2cyclictest2269694-21kworker/u8:0+events_unbound12:35:141
1995351991815,2cyclictest2139726-21kworker/u8:0+flush-259:009:50:161
1995351991815,2cyclictest2062464-21kworker/u8:4+flush-259:009:15:241
1995351991814,3cyclictest2165746-21kworker/u8:1+events_unbound10:05:151
199534999189,2cyclictest2263579-21ntpq11:25:190
199534999184,4cyclictest2242620-21ntpq11:05:190
199534999184,4cyclictest2186933-21awk10:15:170
199534999184,4cyclictest2145334-21apt-get09:35:110
199534999183,5cyclictest2062650-21taskset08:15:130
199534999183,4cyclictest2118547-21ntpq09:05:190
199534999183,4cyclictest2103889-21modprobe08:54:380
1995349991815,2cyclictest335557-21systemd-journal08:50:000
1995349991812,4cyclictest2289884-21kworker/u8:2+flush-259:012:10:160
1995349991811,5cyclictest335557-21systemd-journal12:24:560
1995359991715,1cyclictest2315138-21kthreadcore12:15:173
1995359991714,2cyclictest2150248-21kworker/u8:2+flush-259:011:00:243
1995359991714,2cyclictest1989811-21kworker/u8:0+flush-259:008:10:213
1995359991713,3cyclictest2253896-21kworker/u8:3+flush-259:011:20:163
1995359991712,3cyclictest2083533-21/usr/sbin/munin08:35:153
1995355991714,2cyclictest2269694-21kworker/u8:0+events_unbound12:35:132
1995351991714,3cyclictest2150248-21kworker/u8:2+events_unbound10:25:161
1995351991714,2cyclictest2306146-21kworker/u8:1+flush-259:012:10:241
1995351991714,2cyclictest2289884-21kworker/u8:2+events_unbound12:20:231
1995351991714,2cyclictest2083530-21kworker/u8:0+events_unbound08:40:211
199534999176,2cyclictest2113323-21ntpq09:00:180
199534999175,2cyclictest2227054-21ntpq10:50:210
199534999174,7cyclictest2082468-21ntpq08:30:210
199534999174,4cyclictest2247777-21ld11:10:220
199534999173,4cyclictest2214954-21grep10:40:150
199534999173,4cyclictest2029200-21tr07:40:180
199534999172,5cyclictest2183290-21cat10:10:190
1995349991715,1cyclictest0-21swapper/010:40:000
1995349991714,2cyclictest60350irq/132-enp0s29f1:rx-010:55:190
1995349991713,3cyclictest60350irq/132-enp0s29f1:rx-012:00:130
1995349991713,2cyclictest2274815-21turbostat11:40:000
1995349991710,5cyclictest335557-21systemd-journal10:34:590
1995359991612,3cyclictest2186359-21kworker/u8:0+events_unbound10:50:153
1995351991613,3cyclictest1989811-21kworker/u8:0+events_unbound07:35:221
1995351991613,2cyclictest2306146-21kworker/u8:1+flush-259:012:15:191
1995351991612,3cyclictest2253896-21kworker/u8:3+events_unbound11:20:161
1995351991612,3cyclictest2114443-21kworker/u8:1+flush-259:009:35:191
1995351991610,5cyclictest2216811-21ntpq10:40:201
199534999163,4cyclictest2305747-21modprobe12:05:370
199534999162,5cyclictest2105247-21grep08:55:150
199534999162,5cyclictest2105247-21grep08:55:150
199534999162,4cyclictest2180342-21ntpq10:05:210
1995349991614,1cyclictest60350irq/132-enp0s29f1:rx-007:34:300
1995349991613,2cyclictest61150irq/133-enp0s29f1:tx-009:55:250
1995349991612,2cyclictest2093591-21latency_hist08:45:000
1995349991610,3cyclictest2289343-21ntpq11:50:190
1995359991512,2cyclictest2114443-21kworker/u8:1+flush-259:009:35:203
1995359991512,2cyclictest0-21swapper/309:25:013
1995359991511,3cyclictest2186359-21kworker/u8:0+flush-259:011:15:153
1995351991513,1cyclictest0-21swapper/107:15:191
1995351991512,2cyclictest2155425-21idleruntime-cro09:45:001
1995351991512,2cyclictest1989811-21kworker/u8:0+flush-259:008:00:161
1995351991511,3cyclictest2269694-21kworker/u8:0+flush-259:011:55:151
1995351991511,3cyclictest2253896-21kworker/u8:3+flush-259:011:40:201
1995351991511,3cyclictest2253896-21kworker/u8:3+events_unbound12:00:231
1995351991511,3cyclictest2186359-21kworker/u8:0+flush-259:010:50:251
1995351991511,3cyclictest2073236-21apt-get08:25:121
199534999159,4cyclictest2150248-21kworker/u8:2+flush-259:010:45:170
199534999159,4cyclictest2061346-21ntpq08:10:210
199534999158,5cyclictest335557-21systemd-journal08:10:000
199534999157,6cyclictest335557-21systemd-journal07:55:000
199534999157,6cyclictest2000874-21grep07:15:130
199534999156,7cyclictest2067894-21date08:20:010
199534999154,9cyclictest2011427-21irqcore07:25:160
199534999154,7cyclictest2327323-21fw_forwarded_lo12:30:150
199534999151,4cyclictest2047231-21diskstats08:00:130
1995349991513,1cyclictest60350irq/132-enp0s29f1:rx-012:36:470
1995349991513,1cyclictest60350irq/132-enp0s29f1:rx-009:20:140
1995349991510,3cyclictest507-21in:imuxsock09:45:010
1995359991412,1cyclictest2289884-21kworker/u8:2+events_unbound12:20:183
1995359991412,1cyclictest0-21swapper/312:30:003
1995359991411,2cyclictest2279181-21kworker/u8:1+flush-259:011:45:203
1995359991411,2cyclictest2150248-21kworker/u8:2+flush-259:010:25:213
1995359991411,2cyclictest2109071-21sh09:00:013
1995359991411,2cyclictest2109071-21sh09:00:003
1995359991410,3cyclictest2062464-21kworker/u8:4+flush-259:009:05:233
1995359991410,3cyclictest1984235-21kworker/u8:1+flush-259:007:23:073
1995351991411,2cyclictest2062464-21kworker/u8:4+flush-259:008:15:151
1995351991411,2cyclictest2026393-21kworker/u8:1+flush-259:007:55:211
199534999147,5cyclictest2155698-21apt-get09:45:120
199534999144,9cyclictest0-21swapper/009:15:140
199534999144,8cyclictest2326831-21cat12:30:010
199534999143,2cyclictest2144210-21ntpq09:30:220
199534999142,7cyclictest2249541-21diskstats11:15:130
199534999141,8cyclictest1995877-21hddtemp_smartct07:10:150
1995349991413,1cyclictest60350irq/132-enp0s29f1:rx-011:44:290
199535999139,3cyclictest2139726-21kworker/u8:0+events_unbound09:45:153
1995359991310,2cyclictest2330311-21kthreadcore12:30:173
1995359991310,1cyclictest0-21swapper/310:55:193
1995359991310,1cyclictest0-21swapper/309:00:143
199535199139,3cyclictest2150248-21kworker/u8:2+flush-259:010:00:161
199535199139,3cyclictest2114443-21kworker/u8:1+events_unbound09:28:401
199535199139,3cyclictest1995318-21kworker/u8:3+flush-259:008:05:261
199534999139,3cyclictest2171125-21apt-get10:00:110
199534999137,5cyclictest2254910-21tr11:20:160
199535999128,4cyclictest2253896-21kworker/u8:3+events_unbound12:00:383
199535199129,2cyclictest2150248-21kworker/u8:2+events_unbound11:05:231
199535199128,3cyclictest2139726-21kworker/u8:0+flush-259:009:48:431
199535199126,4cyclictest2185413-21ntpq10:10:221
199535999118,2cyclictest2181513-21cpuspeed_turbos10:10:133
199535999117,3cyclictest1984235-21kworker/u8:1+flush-259:007:28:393
199535999116,4cyclictest2336092-21ntpq12:35:213
199535199117,3cyclictest2109098-21kworker/u8:0+flush-259:009:00:161
199535199117,3cyclictest2026393-21kworker/u8:1+flush-259:007:50:241
199535999106,3cyclictest1995318-21kworker/u8:3+events_unbound07:15:173
199535999106,2cyclictest2264490-21basename11:30:013
19953599996,2cyclictest481rcuc/309:50:183
19953519996,2cyclictest2104264-21cpuspeed_turbos08:55:111
19953519996,2cyclictest2104264-21cpuspeed_turbos08:55:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional