You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 06:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Dec 23, 2025 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1976395996965,3cyclictest2054718-21kworker/u8:2+events_unbound20:27:032
1976395996965,3cyclictest2054718-21kworker/u8:2+events_unbound20:27:022
1976395993935,3cyclictest2210751-21kworker/u8:3+events_unbound22:55:232
1976395993935,3cyclictest2054718-21kworker/u8:2+events_unbound20:35:212
1976395993835,2cyclictest2065047-21kworker/u8:1+events_unbound20:40:242
1976395993835,2cyclictest1966219-21kworker/u8:1+flush-259:020:05:232
1976395993834,3cyclictest2237187-21kworker/u8:3+events_unbound23:20:232
1976399993731,4cyclictest2198902-21ntpq22:40:223
1976395993633,2cyclictest2237187-21kworker/u8:3+events_unbound23:30:242
1976395993632,3cyclictest2231833-21kworker/u8:2+events_unbound23:15:252
1976395993632,3cyclictest2012893-21kworker/u8:2+events_unbound19:55:182
1976395993632,3cyclictest1976515-21kworker/u8:0+events_unbound19:25:162
1976395993531,3cyclictest2237187-21kworker/u8:3+flush-259:023:35:162
1976395993531,3cyclictest2095672-21kworker/u8:2+flush-259:021:05:012
1976395993430,3cyclictest3116667-21kworker/u8:4+flush-259:019:20:242
1976395993430,3cyclictest2111035-21kworker/u8:0+events_unbound21:55:232
1976395993328,3cyclictest2184119-21kworker/u8:4+flush-259:022:30:252
1976399993218,12cyclictest2303809-21idleruntime-cro00:25:003
1976395993229,2cyclictest2278303-21kworker/u8:3+events_unbound00:05:222
1976395993229,2cyclictest2111035-21kworker/u8:0+events_unbound21:50:232
1976391993227,4cyclictest2039488-21/usr/sbin/munin20:10:161
1976395993127,3cyclictest2210751-21kworker/u8:3+events_unbound23:10:222
1976399993025,3cyclictest2215948-21/usr/sbin/munin23:00:153
1976395993027,2cyclictest2210751-21kworker/u8:3+events_unbound23:05:202
1976395993027,2cyclictest2184119-21kworker/u8:4+events_unbound22:35:222
1976395993027,2cyclictest2111035-21kworker/u8:0+flush-259:021:30:162
1976395993027,2cyclictest2111035-21kworker/u8:0+events_unbound22:20:172
1976389993024,4cyclictest2267713-21latency_hist23:50:010
1976389993023,5cyclictest1981448-21apt-get19:15:010
1976395992926,2cyclictest2194675-21kworker/u8:0+events_unbound23:25:092
1976395992926,2cyclictest2158401-21kworker/u8:3+flush-259:022:05:202
1976395992925,3cyclictest2272893-21kworker/u8:2+flush-259:023:55:272
1976395992925,3cyclictest2137102-21kworker/u8:2+flush-259:021:45:162
1976399992813,4cyclictest252-21systemd-journal23:35:003
1976395992824,3cyclictest2288364-21kworker/u8:0+flush-259:000:25:162
1976395992824,3cyclictest2039669-21kworker/u8:0+flush-259:020:15:192
1976395992724,3cyclictest1966219-21kworker/u8:1+events_unbound20:00:222
1976395992723,3cyclictest2054718-21kworker/u8:2+flush-259:020:30:162
1976391992721,4cyclictest252-21systemd-journal21:50:011
1976391992721,4cyclictest2283229-21latency_hist00:05:011
1976399992620,5cyclictest2189100-21latency_hist22:35:003
1976395992623,2cyclictest2293709-21kworker/u8:4+flush-259:000:15:192
1976395992622,3cyclictest2012893-21kworker/u8:2+events_unbound19:50:232
1976395992621,3cyclictest2065047-21kworker/u8:1+events_unbound21:10:162
1976389992620,4cyclictest2049796-21/usr/sbin/munin20:20:200
1976399992521,3cyclictest1981478-21gpgv19:15:003
1976395992521,3cyclictest2065047-21kworker/u8:1+events_unbound21:39:112
1976395992521,3cyclictest2054718-21kworker/u8:2+events_unbound20:45:222
1976395992520,3cyclictest1966219-21kworker/u8:1+events_unbound19:10:142
1976395992421,2cyclictest2251256-21kworker/u8:4+events_unbound23:40:292
1976391992420,3cyclictest2034338-21apt-get20:05:141
1976389992418,4cyclictest2209683-21ntpq22:50:230
1976389992417,5cyclictest2308074-21ntpq00:25:220
1976399992317,4cyclictest2034158-21base6420:05:003
1976395992321,2cyclictest2251256-21kworker/u8:4+events_unbound23:45:152
1976395992321,2cyclictest2168061-21kworker/u8:2+flush-259:022:18:092
1976395992320,2cyclictest1966219-21kworker/u8:1+flush-259:019:35:212
1976395992319,3cyclictest3116667-21kworker/u8:4+events_unbound19:45:212
1976395992319,3cyclictest2178979-21kworker/u8:1+events_unbound22:25:192
1976391992317,4cyclictest2033646-21latency_hist20:05:001
1976389992317,4cyclictest252-21systemd-journal23:10:010
1976389992317,4cyclictest252-21systemd-journal21:34:090
1976389992317,4cyclictest2006772-21ntpq19:35:230
1976395992219,2cyclictest2257618-21kworker/u8:1+events_unbound00:30:182
1976395992218,3cyclictest2054718-21kworker/u8:2+flush-259:020:52:082
1976395992217,3cyclictest252-21systemd-journal22:45:002
1976395992216,4cyclictest1982118-21/usr/sbin/munin19:15:152
1976391992219,2cyclictest2054718-21kworker/u8:2+flush-259:020:50:201
1976391992217,3cyclictest2111536-21/usr/sbin/munin21:20:131
1976391992216,4cyclictest252-21systemd-journal23:51:091
1976389992215,5cyclictest2054972-21/usr/sbin/munin20:25:130
1976389992215,5cyclictest2054972-21/usr/sbin/munin20:25:130
1976399992117,3cyclictest252-21systemd-journal00:11:093
1976395992118,2cyclictest2184119-21kworker/u8:4+events_unbound22:40:142
1976395992117,3cyclictest2137102-21kworker/u8:2+events_unbound22:00:212
1976391992116,3cyclictest252-21systemd-journal21:12:101
1976389992115,4cyclictest2298671-21latency_hist00:20:000
1976399992015,4cyclictest1966219-21kworker/u8:1+flush-259:019:23:393
1976395992017,2cyclictest1966219-21kworker/u8:1+events_unbound19:30:162
1976395992016,3cyclictest2278303-21kworker/u8:3+flush-259:000:00:162
1976391992017,2cyclictest509-21rs:main1
1976391992017,2cyclictest509-21rs:main1
1976391992017,2cyclictest2168061-21kworker/u8:2+flush-259:022:45:261
1976391992016,3cyclictest2168061-21kworker/u8:2+flush-259:022:35:261
1976389992016,3cyclictest2085866-21apt-get20:55:140
1976389992015,3cyclictest2111035-21kworker/u8:0+flush-259:021:55:500
1976395991915,3cyclictest2205599-21kworker/u8:1+events_unbound23:04:512
1976395991915,2cyclictest2111035-21kworker/u8:0+events_unbound21:20:182
1976389991915,3cyclictest2168061-21kworker/u8:2+flush-259:022:30:170
1976389991914,3cyclictest2210791-21apt-get22:55:120
1976389991914,3cyclictest2158401-21kworker/u8:3+flush-259:022:05:180
1976389991913,4cyclictest1991437-21ntpq19:20:230
1976389991912,5cyclictest2137507-21diskstats21:45:140
1976389991912,5cyclictest1996542-21ntpq19:25:220
1976389991911,6cyclictest2220866-21latency_hist23:05:010
1976389991911,5cyclictest252-21systemd-journal19:49:590
1976399991815,2cyclictest2100997-21cron21:10:013
1976399991814,3cyclictest2048654-21ntp_kernel_pll_20:15:213
1976399991813,3cyclictest509-21rs:main3
1976399991813,3cyclictest509-21rs:main3
1976395991815,2cyclictest2111035-21kworker/u8:0+events_unbound22:10:202
1976395991815,2cyclictest2090195-21kworker/u8:0+flush-259:021:00:002
1976395991815,2cyclictest2080480-21kworker/u8:3+events_unbound21:15:202
1976395991815,2cyclictest1966219-21kworker/u8:1+events_unbound19:40:172
1976395991814,3cyclictest2257618-21kworker/u8:1+events_unbound23:50:252
1976395991814,3cyclictest2080480-21kworker/u8:3+events_unbound21:05:192
1976395991814,2cyclictest2080480-21kworker/u8:3+events_unbound21:25:262
1976391991815,2cyclictest2065291-21apt-get20:35:121
1976391991814,3cyclictest252-21systemd-journal19:42:091
1976391991814,3cyclictest2221562-21apt-get23:05:131
1976391991814,3cyclictest2106421-21apt-get21:15:121
1976391991814,3cyclictest1966219-21kworker/u8:1+flush-259:019:15:161
1976389991814,3cyclictest60350irq/132-enp0s29f1:rx-021:35:130
1976389991814,3cyclictest2257618-21kworker/u8:1+flush-259:000:35:250
1976389991814,2cyclictest60350irq/132-enp0s29f1:rx-000:30:220
1976389991813,3cyclictest60350irq/132-enp0s29f1:rx-019:55:000
1976389991811,5cyclictest252-21systemd-journal21:30:010
1976389991811,5cyclictest2177877-21ntpq22:20:250
1976389991811,5cyclictest2106157-21latency_hist21:15:010
1976399991711,4cyclictest2283490-21apt-get00:05:123
1976399991711,4cyclictest2090692-21latency_hist21:00:003
1976395991711,4cyclictest2210516-21latency_hist22:55:012
1976391991714,2cyclictest2168715-21apt-get22:15:101
1976391991713,3cyclictest2049539-21cron20:19:591
1976389991714,2cyclictest60350irq/132-enp0s29f1:rx-023:20:260
1976389991714,2cyclictest60350irq/132-enp0s29f1:rx-019:40:530
1976389991713,3cyclictest1982143-21apt-get19:15:110
1976389991713,2cyclictest2194637-21sh22:40:000
1976389991712,3cyclictest2033988-21apt-key20:05:000
197638999171,14cyclictest252-21systemd-journal22:45:000
1976389991711,4cyclictest2251256-21kworker/u8:4+events_unbound23:40:210
1976389991710,4cyclictest2096093-21/usr/sbin/munin21:05:190
1976399991614,2cyclictest2065047-21kworker/u8:1+flush-259:021:50:113
1976399991614,1cyclictest0-21swapper/323:30:003
1976399991613,2cyclictest2049235-21kworker/u8:3+flush-259:020:32:533
1976399991613,1cyclictest0-21swapper/322:05:003
1976399991612,3cyclictest2018047-21latency_hist19:50:013
1976395991613,2cyclictest2257618-21kworker/u8:1+events_unbound00:20:222
1976395991613,2cyclictest1966219-21kworker/u8:1+flush-259:020:22:152
1976395991612,3cyclictest2065047-21kworker/u8:1+flush-259:021:40:422
1976391991613,1cyclictest0-21swapper/122:20:191
1976391991611,4cyclictest252-21systemd-journal23:20:001
197638999169,5cyclictest2302960-21ntpq00:20:230
1976389991614,1cyclictest60350irq/132-enp0s29f1:rx-021:43:100
1976389991613,2cyclictest60350irq/132-enp0s29f1:rx-023:58:350
1976389991613,2cyclictest60350irq/132-enp0s29f1:rx-021:00:120
1976389991613,2cyclictest60350irq/132-enp0s29f1:rx-020:32:340
1976389991613,2cyclictest60350irq/132-enp0s29f1:rx-019:30:180
1976389991610,4cyclictest2210751-21kworker/u8:3+flush-259:023:10:180
1976399991512,2cyclictest2232885-21kthreadcore23:15:203
1976399991512,2cyclictest2125916-21ntp_kernel_pll_21:30:213
1976399991512,2cyclictest0-21swapper/322:50:003
1976399991511,3cyclictest252-21systemd-journal22:53:273
1976399991511,3cyclictest0-21swapper/323:10:003
1976395991511,3cyclictest2308993-21kworker/u8:3+events_unbound00:36:232
1976391991513,1cyclictest2304484-21irqcore00:25:171
1976391991512,2cyclictest2199342-21unixbench_multi22:40:251
1976389991513,2cyclictest60350irq/132-enp0s29f1:rx-020:50:190
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-023:37:120
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:170
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-023:15:270
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-020:40:060
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:230
1976389991513,1cyclictest60350irq/132-enp0s29f1:rx-020:07:160
1976389991512,2cyclictest60350irq/132-enp0s29f1:rx-019:57:410
1976389991512,2cyclictest60350irq/132-enp0s29f1:rx-000:05:240
1976389991511,3cyclictest2202781-21tr22:45:220
1976389991511,2cyclictest0-21swapper/023:55:000
1976389991511,2cyclictest0-21swapper/020:50:000
1976399991412,1cyclictest0-21swapper/320:05:003
1976399991411,2cyclictest2231597-21idleruntime-cro23:15:003
1976399991410,3cyclictest252-21systemd-journal23:54:553
1976399991410,3cyclictest0-21swapper/300:00:223
1976391991411,2cyclictest2263220-21irqcore23:45:161
1976391991411,1cyclictest0-21swapper/123:25:001
1976391991410,3cyclictest2080480-21kworker/u8:3+flush-259:021:25:261
1976391991410,3cyclictest1966219-21kworker/u8:1+flush-259:019:35:001
1976389991412,1cyclictest60350irq/132-enp0s29f1:rx-022:26:030
1976389991412,1cyclictest60350irq/132-enp0s29f1:rx-021:20:140
1976389991412,1cyclictest60350irq/132-enp0s29f1:rx-020:11:510
1976389991412,1cyclictest60350irq/132-enp0s29f1:rx-000:00:160
1976389991411,2cyclictest60350irq/132-enp0s29f1:rx-023:25:110
1976389991411,2cyclictest60350irq/132-enp0s29f1:rx-022:10:120
1976389991411,2cyclictest60350irq/132-enp0s29f1:rx-022:00:240
197639999138,4cyclictest252-21systemd-journal21:40:013
1976399991311,1cyclictest2241918-21cron23:25:003
1976399991311,1cyclictest0-21swapper/323:50:003
1976399991310,2cyclictest0-21swapper/319:30:183
1976395991310,2cyclictest2012893-21kworker/u8:2+events_unbound20:10:132
197639199139,3cyclictest2145242-21kthreadcore21:50:211
197639199139,2cyclictest0-21swapper/100:35:241
197639199137,4cyclictest490-21dbus-daemon19:15:011
1976391991310,2cyclictest500-21systemd-logind00:20:001
1976391991310,2cyclictest2091038-21cpuspeed_turbos21:00:141
1976391991310,2cyclictest2077850-21kthreadcore20:45:181
1976391991310,2cyclictest2049235-21kworker/u8:3+events_unbound20:20:181
197638999138,4cyclictest2288364-21kworker/u8:0+flush-259:000:10:210
1976389991311,1cyclictest60350irq/132-enp0s29f1:rx-022:15:120
197639999129,2cyclictest2174104-21fschecks_time22:20:163
197639999129,2cyclictest2172712-21ntp_kernel_pll_22:15:213
197639999127,3cyclictest252-21systemd-journal19:57:393
1976399991210,1cyclictest0-21swapper/322:10:193
197639199129,2cyclictest2183435-21unixbench_multi22:25:261
197639199129,2cyclictest2148313-21fschecks_count21:55:151
1976389991210,1cyclictest60350irq/132-enp0s29f1:rx-020:17:080
197639999119,1cyclictest0-21swapper/300:25:153
197639999118,2cyclictest2189851-21cpuspeed_turbos22:35:113
197639999118,2cyclictest1992718-21fschecks_count19:25:143
197639999118,2cyclictest1982559-21irqcore19:15:173
197639999117,3cyclictest2111035-21kworker/u8:0+flush-259:022:25:273
197639199119,1cyclictest0-21swapper/123:40:151
197639199119,1cyclictest0-21swapper/121:35:181
197639199119,1cyclictest0-21swapper/119:45:211
197639199118,2cyclictest2018440-21tr19:50:131
197639199118,2cyclictest2002937-21cpuspeed_turbos19:35:141
197639199111,2cyclictest2189100-21latency_hist22:35:001
197639199110,8cyclictest2210516-21latency_hist22:55:011
197638999118,2cyclictest60350irq/132-enp0s29f1:rx-021:50:100
197639999108,1cyclictest0-21swapper/321:25:233
197639999108,1cyclictest0-21swapper/321:10:123
197639999107,2cyclictest2148525-21irqcore21:55:173
197639999107,2cyclictest2132181-21apt-get21:40:093
197639199107,2cyclictest2273339-21fschecks_count23:55:161
197639199107,2cyclictest0-21swapper/121:30:141
197639199107,1cyclictest0-21swapper/119:25:131
197639199106,3cyclictest2071112-21sed20:40:161
197639199106,3cyclictest2065047-21kworker/u8:1+flush-259:021:40:161
19763999991,2cyclictest2257392-21latency_hist23:40:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional