You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 17:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Mar 25, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
387867199340015,3380cyclictest3975217-21kworker/0:0+events00:10:140
387867699315812,3142cyclictest3980189-21kworker/1:1+events00:35:211
387867999290714,2890cyclictest82-21kswapd000:01:472
387867699278013,2765cyclictest3885302-21kworker/1:1+events19:35:031
387867999275913,2741cyclictest3932052-21kworker/2:1+events21:55:122
387867999275013,2734cyclictest3911392-21kworker/2:2+events20:55:172
387867999266211,2647cyclictest3946114-21kworker/2:1+events22:40:172
387867199261410,2599cyclictest3896688-21kworker/0:0+events20:30:150
38786769925601,2555cyclictest3892046-21kworker/1:1+events20:01:081
387867999254411,2529cyclictest3954289-21kworker/2:2+events23:05:002
38786719925321,2525cyclictest3911218-21kworker/0:0+events20:50:200
387867699252010,2506cyclictest3961502-21kworker/1:0+events23:32:251
387868299250812,2492cyclictest3901696-21kworker/3:0+events20:24:593
387867199250112,2485cyclictest3879952-21kworker/0:0+events19:20:110
387867699249512,2481cyclictest3941518-21kworker/1:1+events22:26:571
387867699249310,2480cyclictest3890390-21kworker/1:0+events19:45:151
387867999248710,2473cyclictest3935446-21kworker/2:2+events22:27:432
387867199247812,2462cyclictest3901903-21kworker/0:1+events20:22:250
387867199247611,2461cyclictest3901903-21kworker/0:1+events20:36:440
387867699247111,2457cyclictest3914297-21kworker/1:1+events20:57:321
387867199246512,2450cyclictest3951118-21kworker/0:2+events23:00:530
38786769924639,2450cyclictest3927317-21kworker/1:1+events21:51:431
387867199246312,2447cyclictest3936948-21kworker/0:0+events22:12:020
387867699246212,2446cyclictest3895420-21kworker/1:2+events20:07:101
387867199246212,2447cyclictest3887699-21kworker/0:0+events19:46:220
387867699245911,2445cyclictest3955811-21kworker/1:2+events23:17:501
387867699245112,2436cyclictest3955811-21kworker/1:2+events23:22:261
387867999244710,2433cyclictest3954289-21kworker/2:2+events23:23:582
387867199244610,2431cyclictest3912875-21kworker/0:1+events20:57:100
387867999244412,2428cyclictest3923358-21kworker/2:2+events21:36:532
387867699243812,2422cyclictest3955811-21kworker/1:2+events23:12:081
387868299243310,2419cyclictest3886964-21kworker/3:2+events20:17:293
387867699243312,2419cyclictest3963533-21kworker/1:1+events23:35:051
387867699242612,2410cyclictest3922209-21kworker/1:0+events21:22:241
387867999242512,2409cyclictest3923358-21kworker/2:2+events21:34:362
387867699242112,2406cyclictest3936676-21kworker/1:0+events22:34:321
387867999242011,2405cyclictest3935446-21kworker/2:2+events22:15:532
387867699242012,2404cyclictest3961502-21kworker/1:0+events23:51:221
387867199241412,2399cyclictest3954052-21kworker/0:1+events23:10:590
387867999241212,2396cyclictest3954289-21kworker/2:2+events23:07:152
387867199241210,2398cyclictest3967386-21kworker/0:0+events23:49:080
387868299241112,2396cyclictest3949740-21kworker/3:2+events23:17:273
387867699241012,2395cyclictest3946412-21kworker/1:1+events22:47:511
387867199240912,2395cyclictest3933750-21kworker/0:2+events22:30:210
387867199240911,2394cyclictest3896688-21kworker/0:0+events20:09:050
387867999240812,2393cyclictest3956208-21kworker/2:0+events23:28:572
387867699240611,2393cyclictest3892046-21kworker/1:1+events19:50:081
387867699240512,2389cyclictest3903317-21kworker/1:0+events20:54:091
387867199240411,2390cyclictest3890241-21kworker/0:2+events19:50:300
387867699240012,2385cyclictest3919179-21kworker/1:1+events21:28:071
387867699240012,2384cyclictest3980189-21kworker/1:1+events00:31:341
387867699239812,2384cyclictest3915945-21kworker/1:2+events21:10:051
387867699239812,2383cyclictest3943209-21kworker/1:2+events22:37:361
387867699239811,2383cyclictest3975038-21kworker/1:0+events00:10:361
387867699239712,2381cyclictest3927317-21kworker/1:1+events21:41:271
387867699239712,2381cyclictest3900065-21kworker/1:1+events20:12:331
387867699239612,2381cyclictest3950911-21kworker/1:2+events22:52:021
387867699239611,2381cyclictest3971724-21kworker/1:2+events00:04:511
38786769923959,2382cyclictest3915945-21kworker/1:2+events21:18:091
387867699239512,2379cyclictest3952602-21kworker/1:0+events22:58:551
38786719923959,2383cyclictest3928820-21kworker/0:0+events21:50:140
387867699239412,2379cyclictest3968773-21kworker/1:1+events23:49:291
387867699239411,2381cyclictest3936676-21kworker/1:0+events22:15:061
38786719923942,2389cyclictest3963774-21kworker/0:1+events23:38:290
387867199239312,2377cyclictest3960562-21kworker/0:2+events23:33:580
38786799923928,2381cyclictest3898752-21kworker/2:0+events20:13:392
387867199239212,2377cyclictest3933750-21kworker/0:2+events22:09:430
387867199239212,2376cyclictest3919149-21kworker/0:0+events21:31:130
387867199239112,2376cyclictest3944692-21kworker/0:1+events22:39:060
387867199239112,2373cyclictest3920793-21kworker/0:1+events21:19:170
387867199239110,2377cyclictest3893431-21kworker/0:1+events19:58:240
387867199239012,2374cyclictest3960562-21kworker/0:2+events23:24:210
387867199239012,2374cyclictest3928820-21kworker/0:0+events21:46:030
387867199239011,2375cyclictest3963774-21kworker/0:1+events00:03:190
387867199238812,2372cyclictest3901903-21kworker/0:1+events20:27:130
387867199238712,2373cyclictest3896688-21kworker/0:0+events20:15:130
387867199238712,2371cyclictest3981681-21kworker/0:2+events00:28:040
387867199238712,2371cyclictest3981681-21kworker/0:2+events00:28:030
387867999238510,2372cyclictest3902784-21kworker/2:1+events20:31:252
387867699238312,2367cyclictest3973397-21kworker/1:1+events00:08:401
387867199238212,2366cyclictest3939556-21kworker/0:1+events22:24:180
387867199238111,2367cyclictest3915792-21kworker/0:0+events21:04:420
387867999237811,2363cyclictest3978626-21kworker/2:2+events00:21:372
387867199237712,2362cyclictest3944692-21kworker/0:1+events22:45:540
38786719923767,2365cyclictest3958871-21kworker/0:1+events23:19:000
387867199237611,2362cyclictest3949305-21kworker/0:0+events22:58:080
387867999236612,2351cyclictest3975005-21kworker/2:1+events00:13:362
387867999236512,2349cyclictest3876758-21kworker/2:2+events19:17:332
387867699236512,2349cyclictest3927317-21kworker/1:1+events21:49:511
387867999236412,2348cyclictest3919213-21kworker/2:1+events21:25:292
387867999236410,2351cyclictest3965375-21kworker/2:2+events23:41:312
387867999236312,2348cyclictest3943355-21kworker/2:3+events22:35:422
387867999236312,2348cyclictest3906427-21kworker/2:0+events20:42:472
387867999236312,2348cyclictest3906427-21kworker/2:0+events20:37:312
387867999236111,2346cyclictest3923358-21kworker/2:2+events21:51:212
387867999235712,2342cyclictest3886811-21kworker/2:2+events19:51:372
387868299235212,2337cyclictest3933720-21kworker/3:0+events22:00:573
387867999235210,2338cyclictest3947741-21kworker/2:0+events22:45:092
387867999235112,2336cyclictest3896862-21kworker/2:1+events20:08:452
387867999235112,2335cyclictest3967259-21kworker/2:1+events23:53:142
387868299235012,2335cyclictest3977154-21kworker/3:1+events00:22:453
387867199235011,2336cyclictest3943025-21kworker/0:0+events22:29:590
387867999234311,2328cyclictest3981651-21kworker/2:1+events00:37:162
387867699234311,2328cyclictest3933781-21kworker/1:2+events22:00:351
387867199234311,2330cyclictest3981681-21kworker/0:2+events00:35:420
38786719923429,2330cyclictest3960562-21kworker/0:2+events23:29:200
387867999234112,2325cyclictest3900573-21kworker/2:2+events20:19:452
387867999233811,2324cyclictest3876758-21kworker/2:2+events19:13:472
387867999233811,2323cyclictest3943355-21kworker/2:3+events22:33:232
387867999233712,2322cyclictest3882108-21kworker/2:1+events19:29:222
387868299233611,2322cyclictest3928937-21kworker/3:2+events21:44:313
387867999233612,2321cyclictest3913026-21kworker/2:0+events21:10:512
387867999233011,2316cyclictest3928851-21kworker/2:0+events21:47:342
387867999232810,2315cyclictest3919213-21kworker/2:1+events21:23:352
387867699232811,2312cyclictest3946412-21kworker/1:1+events23:06:541
387867999232712,2312cyclictest3932052-21kworker/2:1+events22:09:222
387867999232612,2311cyclictest3956208-21kworker/2:0+events23:12:542
387868299232512,2310cyclictest3933720-21kworker/3:0+events22:43:193
387867999232512,2310cyclictest3898752-21kworker/2:0+events20:22:032
387867199232412,2309cyclictest3933750-21kworker/0:2+events22:02:070
387867699232211,2307cyclictest3927317-21kworker/1:1+events21:56:201
387867199232010,2307cyclictest3924107-21kworker/0:3+events21:41:030
387867199231511,2300cyclictest3920793-21kworker/0:1+events21:21:140
387867999231212,2296cyclictest3976992-21kworker/2:0+events00:27:212
387867999231212,2296cyclictest3976992-21kworker/2:0+events00:27:202
387867199230911,2295cyclictest3980037-21kworker/0:1+events00:31:100
387867699230811,2293cyclictest3915945-21kworker/1:2+events21:06:161
387867699230810,2295cyclictest3927317-21kworker/1:1+events22:06:181
387867199230512,2290cyclictest3973555-21kworker/0:2+events00:09:260
387867999230212,2287cyclictest3913026-21kworker/2:0+events21:01:392
387867199230111,2286cyclictest3970220-21kworker/0:2+events23:52:520
387868299230012,2284cyclictest3981831-21kworker/3:0+events00:32:433
38786769922988,2286cyclictest3906770-21kworker/1:2+events20:36:211
387867699229111,2277cyclictest3922209-21kworker/1:0+events21:30:251
38786829922819,2269cyclictest3886964-21kworker/3:2+events19:37:403
387867699227110,2258cyclictest3936676-21kworker/1:0+events22:11:391
387867199227111,2257cyclictest3973555-21kworker/0:2+events00:16:390
387867999226812,2253cyclictest3882108-21kworker/2:1+events19:42:592
38786769922549,2241cyclictest3914297-21kworker/1:1+events21:03:551
387867699225410,2240cyclictest3978506-21kworker/1:0+events00:28:261
387867699225410,2240cyclictest3978506-21kworker/1:0+events00:28:261
387867699225210,2238cyclictest3903317-21kworker/1:0+events20:46:121
387867999225010,2236cyclictest3906427-21kworker/2:0+events20:47:212
387867999224611,2231cyclictest3967259-21kworker/2:1+events23:45:202
387867999224211,2227cyclictest3962048-21kworker/2:1+events23:30:282
387868299223910,2226cyclictest3952450-21kworker/3:1+events22:57:003
387867699223812,2224cyclictest3892046-21kworker/1:1+events19:55:211
387867199223411,2220cyclictest3887699-21kworker/0:0+events19:44:080
387867199223311,2219cyclictest3887699-21kworker/0:0+events19:36:070
387867199223211,2218cyclictest3879952-21kworker/0:0+events19:27:050
387867999223111,2217cyclictest3981651-21kworker/2:1+events00:33:272
38786829922268,2215cyclictest3970395-21kworker/3:2+events23:56:363
387868299222211,2208cyclictest3903346-21kworker/3:1+events20:40:543
387867699222210,2209cyclictest3973397-21kworker/1:1+events00:15:311
387867199222010,2207cyclictest3971873-21kworker/0:0+events23:59:350
38786769922087,2198cyclictest3885302-21kworker/1:1+events19:27:501
387867699220610,2193cyclictest3903317-21kworker/1:0+events20:25:421
387867999220511,2191cyclictest3882108-21kworker/2:1+events19:32:232
38786769922059,2193cyclictest3978506-21kworker/1:0+events00:20:541
38786769922058,2193cyclictest3895420-21kworker/1:2+events20:17:501
38786719922048,2193cyclictest3909590-21kworker/0:2+events20:47:430
38786719922033,2197cyclictest3895030-21kworker/0:2+events20:00:440
387867699220212,2186cyclictest3927317-21kworker/1:1+events21:38:481
387867699220111,2187cyclictest3941518-21kworker/1:1+events22:23:101
387867699220110,2188cyclictest3903317-21kworker/1:0+events20:40:101
387867699220010,2187cyclictest3952602-21kworker/1:0+events23:02:461
387867199220011,2186cyclictest3932145-21kworker/0:1+events21:57:300
387867199220010,2187cyclictest3944692-21kworker/0:1+events22:50:320
38786769921998,2187cyclictest3961502-21kworker/1:0+events23:29:431
387867699219911,2185cyclictest3967083-21kworker/1:2+events23:44:571
387867699219811,2184cyclictest3895420-21kworker/1:2+events20:24:371
387867999219710,2184cyclictest3928851-21kworker/2:0+events21:42:592
387867699219710,2184cyclictest3880191-21kworker/1:2+events19:15:421
38786769921968,2185cyclictest3880191-21kworker/1:2+events19:20:351
387867199219612,2181cyclictest3917553-21kworker/0:1+events21:08:360
387867199219610,2183cyclictest3917553-21kworker/0:1+events21:10:280
387867199219511,2181cyclictest3954052-21kworker/0:1+events23:06:310
38786719921929,2180cyclictest3963774-21kworker/0:1+events23:40:220
387867199218911,2174cyclictest3909590-21kworker/0:2+events20:44:440
387867199218910,2176cyclictest3975217-21kworker/0:0+events00:21:580
38786829921889,2176cyclictest3977154-21kworker/3:1+events00:26:593
38786829921889,2176cyclictest3977154-21kworker/3:1+events00:26:593
38786719921878,2175cyclictest3922481-21kworker/0:2+events21:26:150
387867199218711,2173cyclictest3881964-21kworker/0:2+events19:19:020
387867199218710,2174cyclictest3944692-21kworker/0:1+events22:41:480
387867199218410,2170cyclictest3939556-21kworker/0:1+events22:19:420
387867199218311,2169cyclictest3898405-21kworker/0:2+events20:12:550
387867199218210,2169cyclictest3883642-21kworker/0:1+events19:31:370
387867199218210,2168cyclictest3927161-21kworker/0:1+events21:37:170
387867699217911,2165cyclictest3890390-21kworker/1:0+events19:43:441
387867999217810,2165cyclictest3973337-21kworker/2:0+events00:05:582
387867699217710,2163cyclictest3883377-21kworker/1:0+events19:31:131
387867699217510,2162cyclictest3946412-21kworker/1:1+events22:42:121
387867699217311,2159cyclictest3904914-21kworker/1:1+events20:32:571
387868299214612,2130cyclictest3880285-21kworker/3:0+events19:40:203
387867999214412,2129cyclictest3952663-21kworker/2:0+events22:59:422
387867999214211,2128cyclictest3933690-21kworker/2:0+events22:03:402
387867999214111,2127cyclictest3886811-21kworker/2:2+events20:04:322
387867999214011,2126cyclictest3976992-21kworker/2:0+events00:19:212
387867999214011,2126cyclictest3956208-21kworker/2:0+events23:18:142
387867999214011,2126cyclictest3935446-21kworker/2:2+events22:24:402
387867999213910,2125cyclictest3956208-21kworker/2:0+events23:39:152
387867999213811,2123cyclictest3886811-21kworker/2:2+events19:58:472
387867999213410,2121cyclictest3943355-21kworker/2:3+events22:50:552
387868299213110,2117cyclictest3880285-21kworker/3:0+events19:34:403
387868299213010,2117cyclictest3942967-21kworker/3:2+events22:29:353
387868299212811,2114cyclictest3954083-21kworker/3:0+events23:05:233
387868299212811,2113cyclictest3898164-21kworker/3:0+events20:07:573
387867999212711,2112cyclictest3891899-21kworker/2:0+events19:47:542
38786829921269,2115cyclictest3952450-21kworker/3:1+events23:00:053
387867999212611,2113cyclictest3902784-21kworker/2:1+events20:26:302
387867999212611,2111cyclictest3915885-21kworker/2:1+events21:06:392
387867999212610,2113cyclictest3886811-21kworker/2:2+events19:39:582
387867999212511,2111cyclictest3967259-21kworker/2:1+events23:59:582
387868299211511,2100cyclictest3958904-21kworker/3:1+events23:41:083
387868299211511,2100cyclictest3958904-21kworker/3:1+events23:23:363
387868299211411,2100cyclictest3972114-21kworker/3:3+events00:02:113
387868299211410,2101cyclictest3936707-21kworker/3:2+events22:08:133
387868299211311,2099cyclictest3903346-21kworker/3:1+events21:23:583
387867999211111,2097cyclictest3911392-21kworker/2:2+events20:51:042
387868299210811,2093cyclictest3914235-21kworker/3:0+events20:59:023
387868299210711,2093cyclictest3903346-21kworker/3:1+events21:33:503
38786829921058,2094cyclictest3928937-21kworker/3:2+events21:50:363
38786829921049,2092cyclictest3880285-21kworker/3:0+events19:21:233
387868299210211,2088cyclictest3903346-21kworker/3:1+events21:59:023
387868299209911,2085cyclictest3933720-21kworker/3:0+events22:12:483
387868299209111,2077cyclictest3903346-21kworker/3:1+events20:32:353
38786829920664,2059cyclictest3903346-21kworker/3:1+events21:48:203
387868299206410,2051cyclictest3960594-21kworker/3:0+events23:27:253
387867999206411,2050cyclictest3917518-21kworker/2:2+events21:18:322
387867699205810,2045cyclictest3971724-21kworker/1:2+events23:56:581
387868299205711,2043cyclictest3933720-21kworker/3:0+events22:52:253
38786829920368,2025cyclictest3966990-21kworker/3:0+events23:54:223
387867699202810,2016cyclictest3875231-21kworker/1:1+events19:11:291
38786719920289,2016cyclictest3879952-21kworker/0:0+events19:14:100
38786799919848,1973cyclictest3876758-21kworker/2:2+events19:23:132
38786829919738,1962cyclictest3972114-21kworker/3:3+events00:07:333
38786829919576,1948cyclictest3925540-21kworker/3:0+events21:37:403
38786829919515,1943cyclictest3903346-21kworker/3:1+events21:16:143
387868299195110,1938cyclictest3876729-21kworker/3:2+events19:12:153
38786829919506,1941cyclictest3895148-21kworker/3:1+events20:02:393
38786829919487,1938cyclictest3901696-21kworker/3:0+events20:27:373
38786829919479,1935cyclictest3975068-21kworker/3:0+events00:18:333
38786829919437,1932cyclictest3922392-21kworker/3:2+events21:27:033
38786829919298,1917cyclictest3886964-21kworker/3:2+events19:58:003
387867999191310,1901cyclictest3935446-21kworker/2:2+events22:10:072
38786829919059,1893cyclictest3886964-21kworker/3:2+events20:11:253
38781702171140,26sleep20-21swapper/219:05:562
38784272158114,26sleep00-21swapper/019:09:110
38783372147102,26sleep30-21swapper/319:08:013
38782392143111,26sleep10-21swapper/119:06:471
3878682993015,7cyclictest3916181-21awk21:05:003
3878682992820,6cyclictest3976372-21ldconfig00:10:193
3878682992718,6cyclictest3911433-21basename20:50:003
3878682992320,2cyclictest3965492-21sendmail23:40:003
3878682992319,2cyclictest3941748-21munin-run22:25:003
3878682992311,10cyclictest3985339-21grep00:40:003
387868299225,11cyclictest3882162-21/usr/sbin/munin19:20:003
3878682992214,5cyclictest3908262-21idleruntime-cro20:40:003
387868299216,5cyclictest3939328-21ntpq22:15:163
387868299215,10cyclictest3956820-21ntpq23:10:173
3878682992115,3cyclictest3919327-21munin-run21:15:003
3878682992112,6cyclictest3946494-21systemctl22:40:003
3878682992111,7cyclictest3892193-21perf-exec19:50:013
387868299208,4cyclictest3944144-21ntpq22:30:193
387868299199,6cyclictest3892970-21awk19:50:173
387868299199,5cyclictest3911689-21apt-get20:50:123
387868299198,8cyclictest3949665-21perf22:50:003
387868299192,4cyclictest3916656-21/usr/sbin/munin21:05:163
3878682991914,2cyclictest3963891-21munin-run23:35:003
3878682991912,4cyclictest3967816-21smartctl23:45:143
3878682991911,6cyclictest3885600-21awk19:30:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional