You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 13:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Sep 15, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2048541995047,2cyclictest2246717-21kworker/u8:3+flush-259:023:15:000
2048543994337,4cyclictest2288108-21kworker/u8:1+flush-259:023:40:231
2048541994137,3cyclictest2320158-21apt-get23:30:130
2048543994036,2cyclictest2110713-21kworker/u8:0+flush-259:020:35:231
2048541994035,4cyclictest2387790-21apt-get00:35:120
2048543993936,2cyclictest2205479-21kworker/u8:0+flush-259:022:00:251
2048543993934,3cyclictest2361920-21apt-get00:10:121
2048543993831,5cyclictest2293251-21latency_hist23:05:011
2048551993632,2cyclictest2304491-21base6423:15:013
2048546993430,3cyclictest2261715-21kworker/u8:2+flush-259:022:45:252
2048546993329,3cyclictest2111123-21gpgv20:10:012
2048543993326,5cyclictest335557-21systemd-journal00:09:591
2048551993125,4cyclictest2205252-21latency_hist21:40:003
2048546993024,4cyclictest2230318-21ntpq22:00:222
2048541993026,3cyclictest2319627-21kworker/u8:3+flush-259:023:30:000
2048541993026,3cyclictest2194659-21kworker/u8:1+flush-259:021:35:150
2048541993026,3cyclictest2142377-21kworker/u8:1+flush-259:020:50:110
2048541993026,3cyclictest2116382-21kworker/u8:2+flush-259:020:20:000
2048551992926,2cyclictest2288108-21kworker/u8:1+flush-259:023:40:013
2048543992925,3cyclictest2314325-21kworker/u8:0+flush-259:023:25:241
2048543992925,3cyclictest2288108-21kworker/u8:1+events_unbound23:35:171
2048543992925,3cyclictest2116382-21kworker/u8:2+flush-259:020:30:251
2048543992924,3cyclictest2215628-21kworker/u8:1+events_unbound22:30:181
2048551992822,4cyclictest2184331-21cat21:20:013
2048546992823,3cyclictest2163500-21latency_hist21:00:012
2048543992824,3cyclictest2215628-21kworker/u8:1+events_unbound22:09:391
2048543992824,3cyclictest2205479-21kworker/u8:0+flush-259:021:45:151
2048543992824,3cyclictest2058563-21kworker/u8:2+flush-259:019:30:201
2048551992722,4cyclictest335557-21systemd-journal19:24:593
2048546992723,3cyclictest2184627-21cat21:20:012
2048546992721,4cyclictest2153122-21latency_hist20:50:012
2048543992724,2cyclictest2168722-21kworker/u8:0+flush-259:021:20:021
2048543992722,3cyclictest2267439-21kworker/u8:1+flush-259:022:45:001
2048543992721,4cyclictest2303980-21latency_hist23:15:011
2048543992623,2cyclictest2116382-21kworker/u8:2+flush-259:021:00:231
2048543992622,3cyclictest2288108-21kworker/u8:1+events_unbound23:05:021
2048546992522,2cyclictest2215628-21kworker/u8:1+flush-259:022:15:142
2048543992421,2cyclictest2116382-21kworker/u8:2+events_unbound20:40:261
2048543992421,2cyclictest2089572-21kworker/u8:1+events_unbound20:00:251
2048543992421,2cyclictest2089572-21kworker/u8:1+events_unbound20:00:251
2048543992420,3cyclictest2277616-21kworker/u8:0+events_unbound23:00:001
2048543992420,2cyclictest2142377-21kworker/u8:1+flush-259:020:45:181
2048543992417,3cyclictest2377382-21kworker/u8:0+events_unbound00:25:181
2048551992319,3cyclictest2205479-21kworker/u8:0+flush-259:022:00:223
2048551992319,3cyclictest2158157-21kworker/u8:3+flush-259:021:05:163
2048551992319,3cyclictest2089572-21kworker/u8:1+flush-259:020:05:003
2048551992319,3cyclictest2089572-21kworker/u8:1+flush-259:020:05:003
2048546992320,2cyclictest2288108-21kworker/u8:1+flush-259:000:30:012
2048543992320,2cyclictest2288108-21kworker/u8:1+events_unbound23:45:251
2048543992319,3cyclictest2205479-21kworker/u8:0+events_unbound22:10:281
2048543992319,3cyclictest2194659-21kworker/u8:1+events_unbound21:33:381
2048543992319,3cyclictest2000556-21kworker/u8:1+events_unbound19:15:141
2048541992319,3cyclictest2246717-21kworker/u8:3+flush-259:022:40:160
2048551992216,4cyclictest2345231-21ntpq23:50:223
2048546992218,3cyclictest2350967-21kworker/u8:2+flush-259:000:05:232
2048546992217,4cyclictest2308628-21ntpq23:15:172
2048543992219,2cyclictest2205479-21kworker/u8:0+events_unbound22:00:011
2048543992219,2cyclictest2194659-21kworker/u8:1+flush-259:021:35:231
2048543992218,3cyclictest335557-21systemd-journal22:49:361
2048543992217,3cyclictest2116382-21kworker/u8:2+events_unbound20:15:141
2048551992115,5cyclictest2069136-21latency_hist19:30:003
2048543992118,2cyclictest2319627-21kworker/u8:3+events_unbound00:15:201
2048543992118,2cyclictest2184813-21kworker/u8:2+events_unbound21:20:171
2048543992117,3cyclictest2261715-21kworker/u8:2+events_unbound22:35:021
2048543992117,3cyclictest2048491-21kworker/u8:0+events_unbound19:52:381
2048541992118,2cyclictest2074286-21sh19:35:000
2048551992017,2cyclictest2319627-21kworker/u8:3+flush-259:023:49:593
2048551992015,4cyclictest509-21rs:main3
2048551992013,5cyclictest335557-21systemd-journal22:20:013
2048543992017,2cyclictest2246717-21kworker/u8:3+flush-259:023:20:161
2048543992016,3cyclictest2319627-21kworker/u8:3+events_unbound00:01:391
2048543992016,3cyclictest2215628-21kworker/u8:1+events_unbound22:25:141
2048543992015,3cyclictest2142377-21kworker/u8:1+events_unbound20:50:171
204854199200,19cyclictest1-21systemd20:35:370
2048551991915,3cyclictest2366832-21kworker/u8:2+flush-259:000:14:593
2048546991914,4cyclictest2111739-21diskstats20:10:152
2048543991916,2cyclictest2319627-21kworker/u8:3+events_unbound23:50:141
2048543991916,2cyclictest2205479-21kworker/u8:0+flush-259:022:20:231
2048543991916,2cyclictest2168722-21kworker/u8:0+flush-259:021:13:571
2048543991915,3cyclictest2048491-21kworker/u8:0+events_unbound19:36:381
2048543991912,5cyclictest2350375-21ntpq23:55:201
2048541991916,2cyclictest2226251-21apt-get22:00:120
2048541991915,3cyclictest2132245-21apt-get20:30:120
2048541991913,4cyclictest2377151-21latency_hist00:25:010
2048551991815,2cyclictest2267404-21idleruntime-cro22:40:003
2048551991814,3cyclictest2215628-21kworker/u8:1+flush-259:022:06:063
2048551991814,3cyclictest2142377-21kworker/u8:1+flush-259:020:50:003
2048546991816,1cyclictest2257688-21irqcore22:30:172
2048546991815,2cyclictest2194659-21kworker/u8:1+flush-259:021:35:132
2048546991815,2cyclictest2142377-21kworker/u8:1+flush-259:020:40:002
2048546991814,3cyclictest2319627-21kworker/u8:3+flush-259:023:35:002
2048546991813,4cyclictest2387529-21latency_hist00:35:012
2048543991815,2cyclictest2261715-21kworker/u8:2+flush-259:022:50:201
2048543991815,2cyclictest2058563-21kworker/u8:2+events_unbound19:45:201
2048543991814,3cyclictest2387002-21kworker/u8:2+events_unbound00:34:551
2048543991813,3cyclictest2089572-21kworker/u8:1+flush-259:020:05:181
2048543991812,4cyclictest2190022-21/usr/sbin/munin21:25:201
2048543991811,5cyclictest2121929-21/usr/sbin/munin20:20:221
2048541991814,3cyclictest2336069-21apt-get23:45:130
2048541991814,3cyclictest2277616-21kworker/u8:0+flush-259:023:00:160
2048551991714,2cyclictest2288108-21kworker/u8:1+flush-259:000:20:003
2048551991713,3cyclictest2246915-21/usr/sbin/munin22:20:143
2048546991714,2cyclictest2205479-21kworker/u8:0+flush-259:021:45:252
2048546991713,3cyclictest2158157-21kworker/u8:3+flush-259:021:50:132
2048546991713,3cyclictest2000556-21kworker/u8:1+flush-259:019:25:492
2048546991712,3cyclictest335557-21systemd-journal19:31:582
2048543991714,2cyclictest2215628-21kworker/u8:1+events_unbound22:15:111
2048543991713,3cyclictest2288108-21kworker/u8:1+flush-259:023:17:471
2048541991715,1cyclictest2063988-21idleruntime-cro19:25:000
2048541991714,2cyclictest60350irq/132-enp0s29f1:rx-020:20:200
2048541991714,2cyclictest2319627-21kworker/u8:3+flush-259:023:55:160
2048541991714,2cyclictest2058563-21kworker/u8:2+flush-259:019:27:420
2048541991711,5cyclictest2245755-21ntpq22:15:180
2048551991613,2cyclictest2158157-21kworker/u8:3+flush-259:021:30:173
2048551991612,3cyclictest2095368-21cron19:55:003
2048546991613,2cyclictest2288108-21kworker/u8:1+flush-259:000:35:192
2048546991612,3cyclictest2205479-21kworker/u8:0+flush-259:022:20:162
2048543991613,2cyclictest2158157-21kworker/u8:3+events_unbound21:05:121
2048543991612,3cyclictest2058563-21kworker/u8:2+events_unbound19:40:201
2048541991613,2cyclictest60350irq/132-enp0s29f1:rx-023:50:140
2048541991612,3cyclictest60350irq/132-enp0s29f1:rx-021:40:220
2048541991610,4cyclictest2330632-21latency_hist23:40:010
2048551991512,2cyclictest2325393-21latency_hist23:35:013
2048551991512,2cyclictest2168686-21sh21:05:003
2048551991512,2cyclictest0-21swapper/319:50:003
2048551991511,3cyclictest2288108-21kworker/u8:1+flush-259:000:24:593
2048551991511,3cyclictest2267439-21kworker/u8:1+flush-259:022:44:433
204854699159,5cyclictest2236341-21latency_hist22:10:002
204854699158,1cyclictest0-21swapper/221:45:002
2048546991512,2cyclictest2288108-21kworker/u8:1+flush-259:023:10:202
2048546991511,3cyclictest2110713-21kworker/u8:0+flush-259:020:20:102
2048546991511,2cyclictest0-21swapper/223:05:002
2048543991511,3cyclictest2304193-21kworker/u8:2+events_unbound23:34:401
2048543991511,3cyclictest2110713-21kworker/u8:0+events_unbound20:27:241
2048543991511,3cyclictest2028146-21kworker/u8:3+events_unbound19:10:481
2048543991510,4cyclictest2058563-21kworker/u8:2+flush-259:019:27:071
2048541991514,1cyclictest60350irq/132-enp0s29f1:rx-020:00:150
2048541991514,1cyclictest60350irq/132-enp0s29f1:rx-020:00:150
2048541991513,1cyclictest60350irq/132-enp0s29f1:rx-023:05:150
2048541991513,1cyclictest60350irq/132-enp0s29f1:rx-019:15:180
2048541991513,1cyclictest60350irq/132-enp0s29f1:rx-000:25:100
2048541991513,1cyclictest0-21swapper/019:15:000
2048541991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:010
2048541991512,2cyclictest60350irq/132-enp0s29f1:rx-021:30:150
2048541991512,2cyclictest60350irq/132-enp0s29f1:rx-021:00:250
2048541991512,2cyclictest60350irq/132-enp0s29f1:rx-000:20:000
2048541991511,3cyclictest335557-21systemd-journal22:10:370
2048541991511,3cyclictest2215604-21latency_hist21:50:000
204855199149,4cyclictest2110891-21apt-get20:10:013
204855199149,3cyclictest335557-21systemd-journal19:36:573
2048551991412,1cyclictest2294341-21irqcore23:05:153
2048551991412,1cyclictest0-21swapper/321:25:013
2048551991412,1cyclictest0-21swapper/320:10:003
2048551991411,2cyclictest2381845-21unixbench_multi00:25:233
2048551991411,2cyclictest2273849-21kthreadcore22:45:163
2048551991411,2cyclictest2206535-21tr21:40:173
2048551991411,2cyclictest2084592-21cron19:45:003
2048551991411,2cyclictest0-21swapper/320:45:003
2048546991412,1cyclictest0-21swapper/223:25:012
2048546991411,2cyclictest2267901-21fschecks_time22:40:152
2048546991411,1cyclictest0-21swapper/220:00:002
2048546991410,3cyclictest2288108-21kworker/u8:1+flush-259:023:26:072
2048546991410,3cyclictest2261715-21kworker/u8:2+flush-259:022:35:252
2048546991410,3cyclictest2089572-21kworker/u8:1+flush-259:019:50:002
2048543991411,2cyclictest2392243-21unixbench_singl00:35:261
2048543991410,3cyclictest2319627-21kworker/u8:3+events_unbound00:22:401
2048543991410,3cyclictest2158157-21kworker/u8:3+events_unbound21:41:131
2048543991410,3cyclictest2147943-21kworker/u8:0+flush-259:020:55:331
2048543991410,3cyclictest2089572-21kworker/u8:1+events_unbound19:55:211
204854199149,3cyclictest2194924-21cron21:29:590
2048541991413,1cyclictest60350irq/132-enp0s29f1:rx-022:54:300
2048541991413,1cyclictest60350irq/132-enp0s29f1:rx-019:43:080
2048541991412,2cyclictest61150irq/133-enp0s29f1:tx-020:05:140
2048541991412,2cyclictest60350irq/132-enp0s29f1:rx-020:40:140
2048541991412,1cyclictest60350irq/132-enp0s29f1:rx-023:20:570
2048541991412,1cyclictest60350irq/132-enp0s29f1:rx-022:30:120
2048541991412,1cyclictest60350irq/132-enp0s29f1:rx-020:28:520
2048541991412,1cyclictest0-21swapper/021:20:010
2048541991411,2cyclictest60350irq/132-enp0s29f1:rx-022:05:000
2048541991411,2cyclictest60350irq/132-enp0s29f1:rx-020:10:130
2048541991411,2cyclictest60350irq/132-enp0s29f1:rx-019:45:120
2048541991411,2cyclictest509-21rs:main0
2048541991411,2cyclictest2100582-21turbostat19:59:590
204855199139,3cyclictest335557-21systemd-journal19:14:563
204855199139,3cyclictest335557-21systemd-journal00:37:553
204855199138,4cyclictest2127040-21/usr/sbin/munin20:25:223
2048551991310,2cyclictest2205479-21kworker/u8:0+flush-259:021:55:213
2048551991310,2cyclictest2073841-21unixbench_singl19:30:243
2048551991310,2cyclictest2054189-21fschecks_time19:15:153
2048546991311,1cyclictest0-21swapper/200:10:252
2048546991310,1cyclictest2349334-21kthreadcore23:55:162
204854399139,3cyclictest2095417-21kworker/u8:3+events_unbound20:10:401
204854399138,2cyclictest2000556-21kworker/u8:1+events_unbound19:20:141
204854399137,4cyclictest2048461-21latency_hist19:10:011
2048543991310,2cyclictest2158157-21kworker/u8:3+events_unbound21:53:211
2048541991312,1cyclictest60350irq/132-enp0s29f1:rx-023:18:050
2048541991312,1cyclictest60350irq/132-enp0s29f1:rx-022:25:160
2048541991312,1cyclictest60350irq/132-enp0s29f1:rx-021:50:150
2048541991311,2cyclictest61150irq/133-enp0s29f1:tx-020:55:220
2048541991311,1cyclictest60350irq/132-enp0s29f1:rx-023:40:230
2048541991311,1cyclictest60350irq/132-enp0s29f1:rx-021:55:240
2048541991311,1cyclictest60350irq/132-enp0s29f1:rx-021:20:200
2048541991311,1cyclictest60350irq/132-enp0s29f1:rx-019:36:020
2048541991311,1cyclictest0-21swapper/000:15:000
2048541991310,2cyclictest2205479-21kworker/u8:0+flush-259:022:20:060
2048541991310,2cyclictest2169966-21tr21:05:160
204855199129,2cyclictest2262213-21sh22:35:003
204854699129,2cyclictest2137168-21apt-key20:35:002
204854699128,3cyclictest335557-21systemd-journal20:27:372
204854699128,3cyclictest2058563-21kworker/u8:2+flush-259:019:41:072
204854199129,2cyclictest60350irq/132-enp0s29f1:rx-022:45:250
204854199129,2cyclictest60350irq/132-enp0s29f1:rx-020:45:120
204854199129,2cyclictest2356509-21idleruntime-cro00:04:590
2048541991210,1cyclictest60350irq/132-enp0s29f1:rx-000:30:260
204854199120,4cyclictest2094462-21ntpq19:50:200
204855199118,2cyclictest2283758-21irqcore22:55:183
204855199118,2cyclictest2162583-21ntp_kernel_err20:55:193
204855199118,2cyclictest0-21swapper/300:35:003
204855199118,2cyclictest0-21swapper/300:10:003
204855199117,2cyclictest0-21swapper/323:20:203
204855199116,3cyclictest513-21gdbus23:05:003
204855199110,3cyclictest2137124-21cron20:35:003
204854699118,2cyclictest2351588-21cpuspeed_turbos00:00:142
204854699116,3cyclictest2090432-21/usr/sbin/munin19:50:142
204854199119,1cyclictest60350irq/132-enp0s29f1:rx-000:05:190
204855199107,2cyclictest2236673-21cpuspeed_turbos22:10:123
204855199106,3cyclictest2215308-21sshd21:46:373
204854699107,2cyclictest2195427-21fschecks_time21:30:162
204854699107,1cyclictest0-21swapper/221:00:272
20485519997,1cyclictest0-21swapper/321:10:163
20485519997,1cyclictest0-21swapper/319:55:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional