You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 13:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Sep 11, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1859300995451,2cyclictest75-21kswapd022:00:020
1859303994540,3cyclictest2985399-21kworker/u8:1+flush-259:020:50:251
1859306994337,4cyclictest1905439-21kworker/u8:0+flush-259:020:30:162
1859300994238,3cyclictest1937447-21/usr/sbin/munin20:25:140
1859310994037,2cyclictest75-21kswapd022:00:033
1859303993732,3cyclictest2985399-21kworker/u8:1+events_unbound21:50:191
1859300993734,2cyclictest1983801-21kworker/u8:2+flush-259:022:40:180
1859306993631,3cyclictest1927112-21/usr/sbin/munin20:15:162
1859303993632,3cyclictest2985399-21kworker/u8:1+events_unbound20:05:191
1859310993431,2cyclictest2192151-21kworker/u8:0+flush-259:000:30:263
1859310993226,4cyclictest2139130-21latency_hist23:40:013
1859300993228,3cyclictest335557-21systemd-journal21:05:160
1859306993025,4cyclictest2123696-21kworker/u8:1+flush-259:023:30:192
1859306993024,4cyclictest335557-21systemd-journal19:30:162
1859300993025,4cyclictest1983801-21kworker/u8:2+flush-259:021:50:260
1859303992925,3cyclictest2985399-21kworker/u8:1+events_unbound20:20:141
1859303992825,2cyclictest1983801-21kworker/u8:2+flush-259:022:40:201
1859303992824,3cyclictest2097769-21kworker/u8:0+flush-259:023:40:101
1859303992823,4cyclictest1921932-21/usr/sbin/munin20:10:141
1859303992724,2cyclictest2985399-21kworker/u8:1+events_unbound22:00:261
1859303992722,4cyclictest1953012-21apt-get20:40:111
1859303992722,3cyclictest4009291-21kworker/u8:4+flush-259:019:15:151
1859300992721,5cyclictest335557-21systemd-journal19:45:000
1859303992622,3cyclictest1911598-21kworker/u8:2+events_unbound20:55:231
1859300992620,4cyclictest2170872-21apt-get00:10:140
1859300992620,4cyclictest2014975-21apt-get21:40:130
1859306992521,3cyclictest2097769-21kworker/u8:0+flush-259:023:30:002
1859303992521,3cyclictest2985399-21kworker/u8:1+events_unbound19:35:231
1859303992521,3cyclictest1984016-21apt-get21:10:101
1859303992520,3cyclictest2097769-21kworker/u8:0+events_unbound00:15:211
1859303992518,5cyclictest509-21rs:main1
1859300992519,4cyclictest1885395-21apt-get19:35:120
1859310992420,3cyclictest2985399-21kworker/u8:1+flush-259:022:05:253
1859303992420,3cyclictest4009291-21kworker/u8:4+flush-259:019:40:211
1859303992420,3cyclictest2985399-21kworker/u8:1+events_unbound19:10:151
1859303992420,3cyclictest2097769-21kworker/u8:0+events_unbound23:15:211
1859303992420,3cyclictest2071731-21kworker/u8:3+events_unbound23:05:161
1859303992420,3cyclictest1999476-21kworker/u8:0+events_unbound21:30:131
1859303992418,4cyclictest2020105-21/usr/sbin/munin21:45:141
1859306992319,3cyclictest1864671-21kworker/u8:2+flush-259:019:20:172
1859306992317,4cyclictest2077159-21latency_hist22:40:002
1859303992320,2cyclictest4009291-21kworker/u8:4+flush-259:019:45:201
1859303992319,3cyclictest2985399-21kworker/u8:1+events_unbound20:00:251
1859303992319,3cyclictest2985399-21kworker/u8:1+events_unbound19:50:241
1859303992319,3cyclictest2170836-21kworker/u8:2+flush-259:000:30:211
1859303992319,3cyclictest2123696-21kworker/u8:1+flush-259:023:25:161
1859303992319,3cyclictest2035427-21gpgv22:00:011
1859303992314,3cyclictest2097769-21kworker/u8:0+events_unbound23:20:201
1859300992318,3cyclictest2160513-21apt-get00:00:120
1859306992217,4cyclictest335557-21systemd-journal19:40:162
1859303992219,2cyclictest2176560-21kworker/u8:3+events_unbound00:25:221
1859303992219,2cyclictest2097769-21kworker/u8:0+flush-259:023:55:261
1859303992216,4cyclictest1884247-21ntpq19:30:191
1859300992218,3cyclictest2985399-21kworker/u8:1+events_unbound19:50:220
1859300992218,3cyclictest1983801-21kworker/u8:2+flush-259:022:50:220
1859310992118,2cyclictest2985399-21kworker/u8:1+flush-259:021:45:163
1859310992118,2cyclictest1911598-21kworker/u8:2+flush-259:020:45:273
1859306992117,3cyclictest1983801-21kworker/u8:2+events_unbound21:55:172
1859303992118,2cyclictest1983801-21kworker/u8:2+events_unbound22:20:231
1859303992117,3cyclictest2035434-21kworker/u8:0+events_unbound22:10:201
1859300992117,3cyclictest2097769-21kworker/u8:0+flush-259:023:20:160
1859300992116,4cyclictest1916563-21latency_hist20:05:000
1859310992018,1cyclictest1905439-21kworker/u8:0+flush-259:020:15:253
1859310992018,1cyclictest0-21swapper/322:50:003
1859310992016,3cyclictest1978429-21kworker/u8:0+flush-259:021:10:173
1859310992015,4cyclictest335557-21systemd-journal21:45:013
1859310992015,4cyclictest2035405-21latency_hist22:00:013
1859306992016,3cyclictest2071731-21kworker/u8:3+flush-259:023:00:232
1859306992016,3cyclictest2071731-21kworker/u8:3+flush-259:023:00:222
1859303992017,2cyclictest2985399-21kworker/u8:1+events_unbound21:21:461
1859303992016,3cyclictest2097769-21kworker/u8:0+flush-259:023:45:101
1859303992016,3cyclictest1999476-21kworker/u8:0+events_unbound21:35:271
1859303992016,3cyclictest1905439-21kworker/u8:0+events_unbound20:26:341
1859303992015,4cyclictest2985399-21kworker/u8:1+flush-259:021:05:221
1859303992015,3cyclictest1869904-21/usr/sbin/munin19:20:141
1859300992017,2cyclictest1911598-21kworker/u8:2+flush-259:020:55:210
1859300992016,3cyclictest2985399-21kworker/u8:1+flush-259:020:50:200
1859300992016,3cyclictest2170836-21kworker/u8:2+flush-259:000:26:140
1859310991916,2cyclictest2144339-21kworker/u8:2+flush-259:023:50:003
1859310991915,3cyclictest1911598-21kworker/u8:2+flush-259:020:55:253
1859306991916,2cyclictest2186802-21irqcore00:25:172
1859306991915,3cyclictest500-21systemd-logind19:20:002
1859306991915,3cyclictest1983801-21kworker/u8:2+flush-259:021:20:282
1859303991916,2cyclictest2160274-21kworker/u8:1+events_unbound00:00:251
1859303991915,3cyclictest1983801-21kworker/u8:2+events_unbound22:57:061
1859300991917,1cyclictest1994519-21fschecks_count21:20:160
1859300991915,3cyclictest2149884-21idleruntime-cro23:50:010
1859300991913,4cyclictest335557-21systemd-journal21:00:160
1859310991815,2cyclictest2123696-21kworker/u8:1+flush-259:023:25:263
1859310991814,3cyclictest509-21rs:main3
1859310991814,3cyclictest335557-21systemd-journal21:53:163
1859310991811,5cyclictest2107240-21ntpq23:05:223
1859306991815,2cyclictest2113321-21cron23:15:002
1859306991814,3cyclictest1983801-21kworker/u8:2+flush-259:022:21:112
1859306991814,3cyclictest1978429-21kworker/u8:0+flush-259:021:10:212
1859306991813,4cyclictest2051572-21/usr/sbin/munin22:15:182
1859306991813,4cyclictest1999476-21kworker/u8:0+flush-259:021:25:272
1859303991815,2cyclictest2985399-21kworker/u8:1+flush-259:020:30:241
1859303991815,2cyclictest2170836-21kworker/u8:2+flush-259:000:10:211
1859303991814,3cyclictest2170836-21kworker/u8:2+events_unbound00:24:181
1859303991814,3cyclictest1999476-21kworker/u8:0+flush-259:021:25:191
1859303991814,3cyclictest1983801-21kworker/u8:2+events_unbound23:13:161
1859300991814,3cyclictest1911598-21kworker/u8:2+flush-259:020:45:000
1859300991813,4cyclictest1932317-21apt-get20:20:110
1859310991715,1cyclictest1933338-21kthreadcore20:20:173
1859310991714,2cyclictest1890528-21apt-get19:40:123
1859306991714,2cyclictest1968921-21irqcore20:55:162
1859306991714,1cyclictest0-21swapper/220:00:002
1859306991713,3cyclictest2985399-21kworker/u8:1+flush-259:022:05:182
1859306991713,3cyclictest2154799-21kworker/u8:3+flush-259:000:05:242
1859306991713,3cyclictest1983801-21kworker/u8:2+flush-259:021:15:212
1859306991712,4cyclictest335557-21systemd-journal00:21:162
1859306991712,4cyclictest1983801-21kworker/u8:2+flush-259:022:47:162
1859303991714,2cyclictest2985399-21kworker/u8:1+events_unbound21:01:441
1859303991714,2cyclictest1911598-21kworker/u8:2+flush-259:020:45:241
1859303991713,3cyclictest2160274-21kworker/u8:1+flush-259:000:09:311
1859303991713,3cyclictest2097769-21kworker/u8:0+events_unbound23:35:151
1859303991713,3cyclictest1905439-21kworker/u8:0+events_unbound19:56:301
1859300991714,2cyclictest60350irq/132-enp0s29f1:rx-019:13:400
1859300991714,2cyclictest0-21swapper/023:30:000
1859300991712,4cyclictest2103184-21kworker/u8:4+flush-259:023:12:080
1859300991711,4cyclictest2143388-21ntpq23:40:200
1859300991711,4cyclictest1911355-21latency_hist19:59:590
1859310991614,1cyclictest1859295-21cyclictest22:25:263
1859306991614,1cyclictest0-21swapper/222:35:002
1859306991614,1cyclictest0-21swapper/200:00:002
1859306991611,4cyclictest2051333-21latency_hist22:15:002
1859303991612,3cyclictest2985399-21kworker/u8:1+flush-259:019:27:061
1859303991612,3cyclictest2123696-21kworker/u8:1+events_unbound23:30:161
1859303991612,3cyclictest1983801-21kworker/u8:2+events_unbound22:50:171
1859303991611,4cyclictest2035434-21kworker/u8:0+events_unbound22:32:011
1859300991614,1cyclictest60350irq/132-enp0s29f1:rx-019:45:140
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-023:56:550
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-023:15:220
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-023:05:170
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-022:59:160
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-022:20:180
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-021:34:040
1859300991613,2cyclictest60350irq/132-enp0s29f1:rx-000:20:110
1859300991613,2cyclictest2097769-21kworker/u8:0+flush-259:000:15:210
1859300991610,4cyclictest335557-21systemd-journal20:17:010
1859310991512,2cyclictest1983801-21kworker/u8:2+flush-259:022:50:283
1859310991511,3cyclictest2113343-21turbostat23:15:013
1859310991510,4cyclictest335557-21systemd-journal23:02:023
1859310991510,4cyclictest335557-21systemd-journal23:02:023
1859310991510,4cyclictest2133944-21latency_hist23:35:013
1859306991511,3cyclictest1983801-21kworker/u8:2+flush-259:021:40:262
1859306991510,4cyclictest1983801-21kworker/u8:2+flush-259:022:45:002
1859303991512,2cyclictest2035434-21kworker/u8:0+flush-259:022:25:251
1859303991512,2cyclictest2035434-21kworker/u8:0+events_unbound22:18:161
1859303991511,3cyclictest2071731-21kworker/u8:3+events_unbound22:35:221
1859303991511,3cyclictest1999476-21kworker/u8:0+events_unbound21:41:511
1859303991511,3cyclictest1905439-21kworker/u8:0+flush-259:020:15:151
1859300991513,2cyclictest60350irq/132-enp0s29f1:rx-021:10:160
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-022:30:240
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:200
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-021:15:270
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:140
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-020:11:580
1859300991513,1cyclictest60350irq/132-enp0s29f1:rx-019:30:320
1859300991512,2cyclictest60350irq/132-enp0s29f1:rx-023:35:240
1859300991512,2cyclictest60350irq/132-enp0s29f1:rx-022:25:170
1859300991512,2cyclictest60350irq/132-enp0s29f1:rx-000:05:140
1859300991512,2cyclictest1983801-21kworker/u8:2+flush-259:021:55:210
1859300991511,3cyclictest2071731-21kworker/u8:3+flush-259:023:00:250
1859300991511,3cyclictest2071731-21kworker/u8:3+flush-259:023:00:250
185931099148,5cyclictest2118493-21latency_hist23:20:003
1859310991412,1cyclictest0-21swapper/323:25:003
1859310991411,2cyclictest2170173-21unixbench_singl00:05:263
1859310991411,2cyclictest2071731-21kworker/u8:3+events_unbound22:35:183
1859310991411,2cyclictest1999476-21kworker/u8:0+flush-259:021:25:243
1859306991411,2cyclictest2971-21cron00:15:002
185930399148,4cyclictest2150147-21apt-get23:50:121
185930099148,5cyclictest1963105-21latency_hist20:50:010
1859300991413,1cyclictest60350irq/132-enp0s29f1:rx-022:47:070
1859300991412,1cyclictest60350irq/132-enp0s29f1:rx-019:25:130
1859300991411,2cyclictest0-21swapper/000:34:590
185931099139,3cyclictest2056780-21apt-get22:20:113
1859310991311,1cyclictest2159378-21ntp_kernel_pll_23:55:233
1859310991311,1cyclictest1982146-21kthreadcore21:05:193
1859310991311,1cyclictest1950948-21kthreadcore20:35:193
1859310991311,1cyclictest0-21swapper/319:40:003
185931099131,10cyclictest1922260-21hddtemp_smartct20:10:153
1859310991310,2cyclictest2985399-21kworker/u8:1+events_unbound19:10:253
1859310991310,2cyclictest2014304-21unixbench_singl21:35:263
1859310991310,2cyclictest1943071-21irqcore20:30:153
185930699139,3cyclictest2985399-21kworker/u8:1+flush-259:019:25:242
185930699138,4cyclictest2985399-21kworker/u8:1+flush-259:020:00:252
185930699138,4cyclictest2097769-21kworker/u8:0+flush-259:023:15:142
185930699131,5cyclictest2149887-21munin-run23:50:002
1859306991310,2cyclictest2144603-21latency_hist23:45:012
1859306991310,2cyclictest1895842-21cpuspeed_turbos19:45:112
1859300991312,1cyclictest60350irq/132-enp0s29f1:rx-019:16:580
1859300991311,2cyclictest60350irq/132-enp0s29f1:rx-022:08:370
1859300991311,1cyclictest60350irq/132-enp0s29f1:rx-023:30:280
1859300991311,1cyclictest60350irq/132-enp0s29f1:rx-020:35:240
1859300991311,1cyclictest60350irq/132-enp0s29f1:rx-000:35:250
1859300991311,1cyclictest1874799-21idleruntime-cro19:25:010
1859300991310,1cyclictest0-21swapper/022:40:000
185931099129,2cyclictest1941962-21unixbench_singl20:25:253
185931099129,2cyclictest0-21swapper/323:45:013
185931099126,5cyclictest335557-21systemd-journal00:02:123
185931099126,4cyclictest2176635-21sshd00:15:163
1859310991210,1cyclictest1921692-21sh20:10:003
1859310991210,1cyclictest1881262-21kthreadcore19:30:173
185930699129,2cyclictest2040551-21unixbench_multi22:00:262
185930699128,3cyclictest2170836-21kworker/u8:2+flush-259:000:30:252
185930699128,3cyclictest2097769-21kworker/u8:0+flush-259:023:20:212
185930699128,3cyclictest1958165-21/usr/sbin/munin20:45:202
185930699127,1cyclictest1942400-21awk20:30:002
185930699121,6cyclictest2139131-21munin-plugin-st23:40:012
185930399128,3cyclictest2985399-21kworker/u8:1+flush-259:022:05:261
185930399127,3cyclictest2098217-21fschecks_count23:00:151
185930399127,3cyclictest2098217-21fschecks_count23:00:151
1859303991210,1cyclictest1950147-21kthreadcore20:35:191
185930099127,3cyclictest1917111-21fw_conntrack20:05:160
1859300991210,1cyclictest60350irq/132-enp0s29f1:rx-022:10:140
185931099119,1cyclictest0-21swapper/319:55:013
185931099119,1cyclictest0-21swapper/300:25:013
185931099118,2cyclictest2035434-21kworker/u8:0+events_unbound22:10:243
185931099118,2cyclictest1870354-21grep19:20:153
185931099117,3cyclictest2097769-21kworker/u8:0+flush-259:023:50:253
185931099117,3cyclictest2093064-21uniq22:55:153
185931099117,3cyclictest1983801-21kworker/u8:2+flush-259:022:15:263
185930699119,1cyclictest0-21swapper/219:10:202
185930699118,2cyclictest1911598-21kworker/u8:2+flush-259:020:55:002
185930699118,2cyclictest0-21swapper/221:05:142
185930699117,3cyclictest335557-21systemd-journal21:34:552
185930699117,3cyclictest2985399-21kworker/u8:1+flush-259:019:35:322
185930699110,9cyclictest2014704-21awk21:40:002
185930099119,2cyclictest61150irq/133-enp0s29f1:tx-021:45:130
185931099107,2cyclictest2067501-21sed22:30:163
185931099106,2cyclictest2081438-21ntpq22:40:213
185930699107,2cyclictest2176129-21cpuspeed_turbos00:15:132
185930699106,2cyclictest0-21swapper/221:00:162
185930399106,3cyclictest1983801-21kworker/u8:2+events_unbound21:15:101
18593069994,4cyclictest2088727-21sed22:50:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional