You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 09:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue May 12, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2055126999592,2cyclictest2215129-21kworker/u8:3+events_unbound21:55:242
2055131995855,2cyclictest75-21kswapd021:55:243
2055121994643,2cyclictest75-21kswapd021:55:240
2055126994541,3cyclictest2194530-21kworker/u8:0+flush-259:021:45:002
2055121994542,2cyclictest2060414-21kworker/u8:0+events_unbound19:30:000
2055121994439,4cyclictest2396895-21latency_hist00:40:000
2055126994137,3cyclictest509-21rs:main2
2055121994136,4cyclictest2127459-21apt-get20:20:120
2055126993936,2cyclictest2142652-21kworker/u8:0+events_unbound20:40:002
2055126993935,3cyclictest2060414-21kworker/u8:0+events_unbound19:47:372
2055121993936,2cyclictest2277450-21kworker/u8:2+flush-259:022:50:000
2055121993935,3cyclictest509-21rs:main0
2055131993830,6cyclictest2142628-21latency_hist20:35:013
2055126993833,3cyclictest2344812-21latency_hist23:50:002
2055126993733,3cyclictest2354775-21kworker/u8:0+events_unbound00:04:372
2055126993732,4cyclictest252-21systemd-journal00:38:252
2055131993630,4cyclictest2091109-21latency_hist19:45:013
2055121993632,3cyclictest2365606-21kworker/u8:1+events_unbound00:21:370
2055121993632,3cyclictest2153118-21kworker/u8:1+events_unbound20:51:380
2055121993632,3cyclictest2060414-21kworker/u8:0+events_unbound19:37:370
2055126993531,3cyclictest2142652-21kworker/u8:0+events_unbound20:54:372
2055123993530,3cyclictest2153417-21base6420:45:001
2055121993532,2cyclictest2122012-21kworker/u8:2+events_unbound20:47:260
2055121993528,5cyclictest2065346-21latency_hist19:20:010
2055131993427,5cyclictest2111711-21latency_hist20:05:013
2055123993430,3cyclictest2215129-21kworker/u8:3+events_unbound21:55:201
2055121993431,2cyclictest2111586-21kworker/u8:0+flush-259:020:05:210
2055121993430,3cyclictest2001933-21kworker/u8:1+events_unbound19:22:370
2055123993329,3cyclictest2153118-21kworker/u8:1+events_unbound21:15:011
2055123993329,3cyclictest2060414-21kworker/u8:0+events_unbound19:55:011
2055123993328,3cyclictest2251943-21base6422:20:011
2055123993327,4cyclictest2168761-21latency_hist21:00:001
2055123993326,5cyclictest2333614-21ntpq23:35:211
2055121993330,2cyclictest2153118-21kworker/u8:1+events_unbound21:32:430
2055121993330,2cyclictest2049818-21kworker/u8:2+events_unbound19:48:380
2055131993226,4cyclictest2215108-21latency_hist21:45:013
2055123993229,2cyclictest2303546-21kworker/u8:3+events_unbound23:10:201
2055123993227,4cyclictest2194530-21kworker/u8:0+flush-259:021:50:381
2055123993227,4cyclictest2153118-21kworker/u8:1+events_unbound21:05:001
2055121993229,3cyclictest2060414-21kworker/u8:0+events_unbound19:53:380
2055121993228,3cyclictest2101587-21kworker/u8:1+events_unbound20:10:220
2055126993127,3cyclictest2142652-21kworker/u8:0+events_unbound20:43:382
2055126993127,3cyclictest2080827-21kworker/u8:3+events_unbound19:52:162
2055123993127,3cyclictest2229765-21kworker/u8:4+flush-259:022:05:151
2055121993127,3cyclictest2194530-21kworker/u8:0+events_unbound23:09:380
2055126993027,2cyclictest2080827-21kworker/u8:3+flush-259:020:32:232
2055123993023,5cyclictest2146934-21ntpq20:35:221
2055121993026,3cyclictest2153118-21kworker/u8:1+flush-259:021:45:230
2055121993025,4cyclictest2060183-21latency_hist19:15:010
2055121993025,3cyclictest2339677-21latency_hist23:45:000
2055131992925,3cyclictest2215129-21kworker/u8:3+flush-259:021:55:003
2055123992922,5cyclictest2069586-21ntpq19:20:191
2055121992926,2cyclictest2184216-21kworker/u8:3+events_unbound21:29:360
2055121992926,2cyclictest2184216-21kworker/u8:3+events_unbound21:29:360
2055121992925,3cyclictest2319264-21kworker/u8:0+events_unbound23:34:370
2055121992925,3cyclictest2229765-21kworker/u8:4+flush-259:022:00:360
2055131992824,3cyclictest2049962-21kworker/u8:3+flush-259:019:15:003
2055131992824,3cyclictest2049962-21kworker/u8:3+flush-259:019:14:593
2055131992823,3cyclictest252-21systemd-journal19:51:353
2055131992822,5cyclictest2209104-21ntpq21:35:213
2055126992826,1cyclictest2194530-21kworker/u8:0+events_unbound21:35:252
2055126992825,3cyclictest2262141-21kworker/u8:1+events_unbound22:43:372
2055126992824,3cyclictest2215129-21kworker/u8:3+events_unbound22:08:362
2055126992822,4cyclictest252-21systemd-journal23:15:002
2055123992824,3cyclictest2060414-21kworker/u8:0+events_unbound19:27:101
2055123992824,2cyclictest252-21systemd-journal00:25:361
2055121992825,2cyclictest2334528-21kworker/u8:3+flush-259:023:50:190
2055121992825,2cyclictest2153118-21kworker/u8:1+events_unbound21:38:360
2055121992824,3cyclictest2262141-21kworker/u8:1+events_unbound22:41:370
2055121992824,3cyclictest2229765-21kworker/u8:4+flush-259:022:15:360
2055121992824,3cyclictest2142652-21kworker/u8:0+events_unbound20:41:370
2055121992823,3cyclictest252-21systemd-journal23:02:360
2055131992720,5cyclictest2116888-21latency_hist20:10:003
2055126992723,3cyclictest2365606-21kworker/u8:1+flush-259:000:15:242
2055126992723,3cyclictest2153118-21kworker/u8:1+events_unbound21:10:372
2055126992722,4cyclictest2334769-21apt-get23:40:122
2055123992723,3cyclictest252-21systemd-journal20:20:371
2055123992723,3cyclictest2060414-21kworker/u8:0+events_unbound19:40:241
2055121992724,3cyclictest2173805-21kworker/u8:2+events_unbound21:04:380
2055121992723,3cyclictest2365606-21kworker/u8:1+events_unbound00:15:230
2055121992723,3cyclictest2303546-21kworker/u8:3+events_unbound23:23:370
2055121992723,3cyclictest2292962-21kworker/u8:2+flush-259:023:10:370
2055121992723,3cyclictest2122012-21kworker/u8:2+events_unbound20:25:210
2055121992722,4cyclictest2283061-21apt-get22:50:130
2055121992722,4cyclictest2225455-21latency_hist21:55:010
2055126992622,3cyclictest2049818-21kworker/u8:2+events_unbound19:42:132
2055123992623,2cyclictest2365606-21kworker/u8:1+events_unbound00:24:371
2055123992622,3cyclictest2215129-21kworker/u8:3+flush-259:022:30:191
2055123992622,3cyclictest2122012-21kworker/u8:2+events_unbound20:29:371
2055123992622,3cyclictest2060414-21kworker/u8:0+events_unbound19:32:101
2055121992623,2cyclictest2215129-21kworker/u8:3+events_unbound22:25:370
2055126992521,3cyclictest2313815-21kworker/u8:1+flush-259:023:50:362
2055126992521,3cyclictest2215129-21kworker/u8:3+events_unbound22:58:372
2055123992522,2cyclictest2060414-21kworker/u8:0+events_unbound19:17:371
2055123992521,3cyclictest2354775-21kworker/u8:0+events_unbound00:05:021
2055123992521,3cyclictest2153118-21kworker/u8:1+events_unbound21:10:251
2055123992519,4cyclictest252-21systemd-journal00:30:461
2055121992520,4cyclictest2167877-21ntpq20:55:210
2055126992421,2cyclictest2365606-21kworker/u8:1+flush-259:000:20:262
2055126992421,2cyclictest2344834-21kworker/u8:2+flush-259:000:05:202
2055126992421,2cyclictest2122012-21kworker/u8:2+flush-259:020:15:262
2055126992418,5cyclictest2199697-21latency_hist21:30:002
2055126992418,5cyclictest2199697-21latency_hist21:30:002
2055121992422,2cyclictest2313815-21kworker/u8:1+events_unbound23:49:370
2055121992421,2cyclictest2215129-21kworker/u8:3+events_unbound22:05:230
2055121992421,2cyclictest2173805-21kworker/u8:2+events_unbound21:12:360
2055131992320,2cyclictest2080771-21cron19:35:003
2055126992320,2cyclictest2173805-21kworker/u8:2+flush-259:021:05:242
2055126992320,2cyclictest2111586-21kworker/u8:0+events_unbound20:05:182
2055126992319,3cyclictest2376082-21kworker/u8:3+events_unbound00:25:232
2055126992319,3cyclictest2313815-21kworker/u8:1+events_unbound23:20:142
2055126992319,3cyclictest2215129-21kworker/u8:3+flush-259:022:05:002
2055126992319,3cyclictest2101587-21kworker/u8:1+events_unbound19:55:232
2055123992319,3cyclictest2313815-21kworker/u8:1+events_unbound23:55:251
2055123992319,3cyclictest2158753-21apt-get20:50:131
2055123992319,3cyclictest2122012-21kworker/u8:2+flush-259:020:40:161
2055126992219,3cyclictest2153118-21kworker/u8:1+events_unbound21:17:382
2055126992218,3cyclictest2215129-21kworker/u8:3+events_unbound22:22:552
2055123992219,2cyclictest2292962-21kworker/u8:2+events_unbound23:17:371
2055121992218,3cyclictest2354775-21kworker/u8:0+flush-259:000:10:200
2055121992218,3cyclictest2184216-21kworker/u8:3+flush-259:021:15:290
2055131992117,3cyclictest252-21systemd-journal20:42:243
2055131992115,4cyclictest2246164-21latency_hist22:15:013
2055126992118,3cyclictest2080827-21kworker/u8:3+events_unbound20:00:252
2055126992118,2cyclictest509-21rs:main2
2055126992118,2cyclictest2319264-21kworker/u8:0+flush-259:023:25:172
2055126992118,2cyclictest2101587-21kworker/u8:1+events_unbound20:10:242
2055126992118,2cyclictest2080827-21kworker/u8:3+events_unbound20:25:012
2055126992117,3cyclictest2153118-21kworker/u8:1+events_unbound21:33:382
2055123992118,2cyclictest2153118-21kworker/u8:1+events_unbound21:30:221
2055123992117,3cyclictest2153118-21kworker/u8:1+events_unbound21:07:351
2055121992118,2cyclictest2049818-21kworker/u8:2+flush-259:019:40:160
2055121992116,4cyclictest2267530-21apt-get22:35:120
2055121992116,4cyclictest2252004-21apt-get22:20:100
2055131992017,2cyclictest2049818-21kworker/u8:2+events_unbound19:25:013
2055131992015,3cyclictest2313815-21kworker/u8:1+flush-259:023:35:153
2055131992013,5cyclictest2251312-21apt-get22:20:003
2055126992017,3cyclictest2292962-21kworker/u8:2+flush-259:023:05:362
2055126992017,2cyclictest2313815-21kworker/u8:1+events_unbound23:58:182
2055126992017,2cyclictest2215129-21kworker/u8:3+events_unbound22:15:232
2055123992017,2cyclictest2334528-21kworker/u8:3+flush-259:023:45:251
2055123992017,2cyclictest2292962-21kworker/u8:2+flush-259:023:00:201
2055123992016,3cyclictest2324448-21/usr/sbin/munin23:30:201
2055123992016,3cyclictest2313815-21kworker/u8:1+events_unbound23:41:361
2055123992016,3cyclictest2229765-21kworker/u8:4+flush-259:022:00:171
2055123992016,3cyclictest2153118-21kworker/u8:1+events_unbound21:45:191
2055121992018,1cyclictest0-21swapper/023:29:590
2055121992015,3cyclictest252-21systemd-journal22:59:590
2055121992014,4cyclictest2354305-21ntpq23:55:220
2055131991915,3cyclictest2142652-21kworker/u8:0+flush-259:020:55:123
2055131991915,3cyclictest2122012-21kworker/u8:2+flush-259:020:15:013
2055131991915,2cyclictest2184253-21unin-run21:15:003
2055126991916,2cyclictest2319264-21kworker/u8:0+flush-259:023:30:162
2055126991916,2cyclictest2122012-21kworker/u8:2+events_unbound20:45:152
2055126991915,3cyclictest2292962-21kworker/u8:2+events_unbound23:15:142
2055126991915,3cyclictest2194530-21kworker/u8:0+flush-259:022:35:202
2055126991915,3cyclictest2122012-21kworker/u8:2+flush-259:020:25:162
2055123991916,2cyclictest2354775-21kworker/u8:0+events_unbound00:00:171
2055123991916,2cyclictest2319264-21kworker/u8:0+flush-259:023:25:151
2055123991916,2cyclictest2049818-21kworker/u8:2+events_unbound19:45:171
2055123991915,3cyclictest2292962-21kworker/u8:2+events_unbound23:05:131
2055121991917,2cyclictest2080827-21kworker/u8:3+events_unbound20:00:150
2055121991916,3cyclictest2344834-21kworker/u8:2+events_unbound00:02:370
2055121991916,2cyclictest2215129-21kworker/u8:3+events_unbound22:10:230
2055121991913,4cyclictest509-21rs:main0
2055131991813,3cyclictest2292962-21kworker/u8:2+flush-259:023:15:153
2055126991814,3cyclictest2313815-21kworker/u8:1+events_unbound23:35:112
2055126991814,3cyclictest2153118-21kworker/u8:1+events_unbound21:20:152
2055126991814,3cyclictest2142652-21kworker/u8:0+flush-259:020:55:272
2055126991814,3cyclictest2060414-21kworker/u8:0+flush-259:019:32:122
2055126991814,3cyclictest2049962-21kworker/u8:3+flush-259:019:10:232
2055126991814,3cyclictest2049962-21kworker/u8:3+flush-259:019:10:232
2055123991814,3cyclictest2101587-21kworker/u8:1+events_unbound20:02:171
2055123991814,3cyclictest2055332-21apt-get19:10:121
2055123991814,3cyclictest2055332-21apt-get19:10:111
2055123991813,3cyclictest509-21rs:main1
2055121991816,2cyclictest2153118-21kworker/u8:1+events_unbound21:08:380
2055131991715,1cyclictest0-21swapper/320:45:203
2055131991714,2cyclictest509-21rs:main3
2055131991711,4cyclictest252-21systemd-journal00:10:013
2055126991714,1cyclictest0-21swapper/223:04:592
2055126991713,3cyclictest2376082-21kworker/u8:3+events_unbound00:31:392
2055126991713,3cyclictest2229765-21kworker/u8:4+events_unbound22:11:382
2055123991714,2cyclictest2365606-21kworker/u8:1+events_unbound00:35:161
2055123991714,2cyclictest2215129-21kworker/u8:3+flush-259:022:25:191
2055123991714,2cyclictest2122012-21kworker/u8:2+events_unbound20:15:231
2055123991714,2cyclictest2111971-21apt-get20:05:121
2055123991713,3cyclictest2194530-21kworker/u8:0+events_unbound22:38:061
2055123991713,3cyclictest2194530-21kworker/u8:0+events_unbound21:41:371
2055121991714,2cyclictest61150irq/133-enp0s29f1:tx-000:25:190
2055131991613,2cyclictest2235814-21cron22:05:003
2055131991612,3cyclictest2060414-21kworker/u8:0+flush-259:019:35:163
2055126991613,2cyclictest2001933-21kworker/u8:1+flush-259:019:20:182
2055126991612,3cyclictest2354775-21kworker/u8:0+events_unbound00:10:222
2055126991612,3cyclictest2163626-21kworker/u8:3+events_unbound21:00:162
2055126991612,3cyclictest2049818-21kworker/u8:2+events_unbound19:35:372
2055123991613,2cyclictest2282784-21idleruntime-cro22:50:001
2055123991613,2cyclictest2215129-21kworker/u8:3+flush-259:022:10:171
205512399161,1cyclictest0-21swapper/123:55:011
2055121991613,3cyclictest2292962-21kworker/u8:2+events_unbound23:18:130
2055121991613,2cyclictest2364580-21needreboot00:05:200
2055121991612,3cyclictest60350irq/132-enp0s29f1:rx-022:30:130
2055131991512,2cyclictest2204833-21sh21:35:003
2055131991512,2cyclictest2106525-21sh20:00:003
2055131991512,2cyclictest0-21swapper/300:00:013
2055126991512,2cyclictest2153118-21kworker/u8:1+events_unbound21:46:382
2055126991511,3cyclictest2060414-21kworker/u8:0+events_unbound19:25:372
2055123991513,1cyclictest2060414-21kworker/u8:0+events_unbound19:35:191
2055123991512,2cyclictest2354775-21kworker/u8:0+events_unbound00:10:181
2055123991512,2cyclictest2194530-21kworker/u8:0+flush-259:022:40:251
2055123991510,4cyclictest2117131-21/usr/sbin/munin20:10:151
2055123991510,4cyclictest2106344-21apt-get19:58:271
2055121991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:270
2055121991513,1cyclictest60350irq/132-enp0s29f1:rx-019:12:020
2055121991512,2cyclictest60350irq/132-enp0s29f1:rx-021:20:170
2055121991512,2cyclictest2080827-21kworker/u8:3+flush-259:020:30:240
2055121991511,2cyclictest0-21swapper/023:40:010
2055131991411,2cyclictest2190044-21sed21:20:173
2055131991410,3cyclictest2262141-21kworker/u8:1+events_unbound22:35:013
2055131991410,3cyclictest2215129-21kworker/u8:3+flush-259:022:20:233
2055131991410,3cyclictest2163626-21kworker/u8:3+flush-259:021:00:253
2055131991410,3cyclictest2122012-21kworker/u8:2+flush-259:020:15:233
2055126991411,2cyclictest2194530-21kworker/u8:0+events_unbound22:27:372
2055123991410,3cyclictest2080827-21kworker/u8:3+events_unbound20:30:241
205513199139,3cyclictest2334528-21kworker/u8:3+flush-259:023:55:003
205513199139,3cyclictest2319264-21kworker/u8:0+flush-259:023:25:073
205513199138,3cyclictest2292962-21kworker/u8:2+events_unbound23:00:203
205513199137,4cyclictest2236055-21/usr/sbin/munin22:05:143
2055131991311,1cyclictest0-21swapper/319:45:173
2055131991310,2cyclictest2387806-21irqcore00:30:173
2055131991310,2cyclictest2137017-21unixbench_multi20:25:253
2055131991310,2cyclictest0-21swapper/323:50:003
205512699139,3cyclictest2262141-21kworker/u8:1+flush-259:022:50:412
205512399139,3cyclictest2365606-21kworker/u8:1+events_unbound00:15:211
2055123991310,2cyclictest2215129-21kworker/u8:3+events_unbound22:17:371
205512199137,4cyclictest2386860-21grep00:30:130
205513199129,2cyclictest2292962-21kworker/u8:2+flush-259:023:05:473
205513199129,2cyclictest0-21swapper/321:15:203
205513199128,3cyclictest2324540-21cpuspeed_turbos23:30:133
205513199127,4cyclictest2219829-21grep21:45:263
205513199125,5cyclictest252-21systemd-journal21:28:363
205513199125,5cyclictest252-21systemd-journal21:28:363
205512699129,2cyclictest2215129-21kworker/u8:3+flush-259:022:30:172
205512399129,2cyclictest2290548-21kthreadcore22:55:191
205512399129,2cyclictest2153118-21kworker/u8:1+flush-259:021:20:241
2055121991210,1cyclictest60350irq/132-enp0s29f1:rx-021:44:500
205513199118,2cyclictest2272803-21cpuspeed_turbos22:40:133
205513199118,2cyclictest2064520-21ntpq19:15:223
205513199118,1cyclictest0-21swapper/320:25:003
205513199117,3cyclictest2354775-21kworker/u8:0+flush-259:000:10:273
205513199117,2cyclictest2194530-21kworker/u8:0+flush-259:022:35:163
205513199116,3cyclictest2259287-21cut22:25:203
205513199115,4cyclictest2288147-21cat22:55:003
2055131991111,0cyclictest2132193-21kworker/3:0+events_power_efficient00:17:083
205513199108,1cyclictest0-21swapper/322:45:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional