You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 13:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sun Apr 12, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39882999935437,3530cyclictest4060266-21kworker/0:1+events23:05:200
398830799340616,3383cyclictest4045689-21kworker/2:2+events22:25:012
398829999309413,3075cyclictest4043874-21kworker/0:1+events22:05:140
398829999293615,2917cyclictest3991571-21kworker/0:0+events19:20:100
398830299286110,2846cyclictest4076846-21kworker/1:2+events00:05:181
398830999277812,2763cyclictest4071616-21kworker/3:1+events23:30:183
398830999276713,2749cyclictest4034767-21kworker/3:3+events22:00:123
398830999275513,2736cyclictest4034374-21kworker/3:1+events21:35:123
398830999269713,2680cyclictest4013968-21kworker/3:1+events20:30:243
398830799267713,2660cyclictest4023563-21kworker/2:0+events21:00:172
398829999266713,2651cyclictest4078480-21kworker/0:0+events00:00:010
398829999266312,2648cyclictest4034432-21kworker/0:0+events21:40:120
398829999263913,2624cyclictest4072891-21kworker/0:1+events23:35:150
398830799263812,2623cyclictest4084844-21kworker/2:1+events00:09:022
398830799259212,2577cyclictest3997916-21kworker/2:0+events20:04:442
398829999259211,2577cyclictest4072891-21kworker/0:1+events23:40:130
398829999257010,2556cyclictest4060266-21kworker/0:1+events22:56:540
398830299255612,2540cyclictest4014082-21kworker/1:0+events20:32:201
398829999254712,2531cyclictest4015632-21kworker/0:2+events20:40:200
39882999925425,2533cyclictest4020074-21kworker/0:0+events20:46:180
398829999253412,2518cyclictest4041030-21kworker/0:0+events21:55:150
39882999925299,2516cyclictest4086415-21kworker/0:1+events00:32:120
398829999252912,2513cyclictest4036123-21kworker/0:2+events21:54:520
398829999252612,2510cyclictest4043874-21kworker/0:1+events22:01:210
398829999252611,2511cyclictest4086415-21kworker/0:1+events00:25:440
398829999250812,2494cyclictest3993283-21kworker/0:1+events19:25:050
398830999250612,2491cyclictest4078267-21kworker/3:1+events00:17:033
398830799249912,2483cyclictest4039468-21kworker/2:0+events21:51:322
398829999249711,2483cyclictest4045481-21kworker/0:0+events22:14:190
398830799249612,2481cyclictest4071402-21kworker/2:2+events23:46:402
398830799249212,2476cyclictest4062079-21kworker/2:0+events22:59:592
398830999249112,2476cyclictest3999389-21kworker/3:2+events19:55:583
398830999249011,2475cyclictest4053868-21kworker/3:1+events22:46:143
398829999248912,2474cyclictest4084816-21kworker/0:2+events00:09:480
398830999248712,2471cyclictest4029961-21kworker/3:2+events21:28:433
398830799248512,2470cyclictest4001202-21kworker/2:1+events19:52:292
398830999248412,2468cyclictest4078267-21kworker/3:1+events23:58:543
398830999248312,2468cyclictest4078267-21kworker/3:1+events00:13:583
398830999248311,2469cyclictest4089947-21kworker/3:1+events00:29:543
398830999248212,2466cyclictest4078267-21kworker/3:1+events00:00:473
398830999248112,2465cyclictest4078267-21kworker/3:1+events23:47:483
398830999248010,2466cyclictest4040888-21kworker/3:0+events21:56:233
398830999247912,2464cyclictest4015602-21kworker/3:0+events20:40:413
398830799247912,2464cyclictest4060355-21kworker/2:2+events22:53:522
398830799247910,2466cyclictest4065575-21kworker/2:0+events23:15:552
398830799247810,2465cyclictest4034488-21kworker/2:2+events21:46:362
398829999247412,2458cyclictest4026635-21kworker/0:0+events21:18:540
39882999924738,2462cyclictest4078480-21kworker/0:0+events00:15:540
398830999247011,2456cyclictest4052003-21kworker/3:2+events22:32:093
398829999246711,2454cyclictest3995669-21kworker/0:2+events19:35:020
398830999246310,2450cyclictest4047077-21kworker/3:1+events22:27:143
398830999245612,2440cyclictest4060296-21kworker/3:0+events22:58:513
398829999245612,2440cyclictest4007522-21kworker/0:1+events20:10:310
398829999245511,2440cyclictest4032827-21kworker/0:1+events21:31:260
398830999245310,2440cyclictest4007555-21kworker/3:0+events20:22:013
398829999245212,2436cyclictest4025036-21kworker/0:2+events21:04:280
398829999244912,2433cyclictest4004235-21kworker/0:0+events20:09:430
398830999244811,2434cyclictest4068394-21kworker/3:2+events23:43:383
398830799244812,2432cyclictest4028209-21kworker/2:1+events21:15:512
39882999924489,2435cyclictest4086415-21kworker/0:1+events00:36:220
398829999244812,2432cyclictest4068334-21kworker/0:2+events23:19:220
398829999244711,2432cyclictest4060266-21kworker/0:1+events23:22:430
398829999244711,2432cyclictest4060266-21kworker/0:1+events23:22:430
398829999244710,2433cyclictest4026635-21kworker/0:0+events21:13:350
39883099924468,2435cyclictest4020479-21kworker/3:1+events20:54:143
398829999244512,2430cyclictest4025036-21kworker/0:2+events21:07:540
398829999244512,2429cyclictest4029873-21kworker/0:2+events21:27:370
398829999244412,2429cyclictest4061896-21kworker/0:2+events23:10:380
398829999244411,2430cyclictest4009947-21kworker/0:2+events20:16:380
398829999244411,2429cyclictest4036123-21kworker/0:2+events21:39:010
398829999244312,2427cyclictest4002624-21kworker/0:1+events20:02:260
398829999244311,2429cyclictest4017584-21kworker/0:1+events20:55:450
398829999244212,2427cyclictest4072891-21kworker/0:1+events23:34:080
398829999244112,2426cyclictest4060266-21kworker/0:1+events22:51:580
398829999244011,2426cyclictest4076725-21kworker/0:2+events23:51:180
398830999243910,2426cyclictest3993166-21kworker/3:1+events19:27:453
398829999243912,2424cyclictest4007522-21kworker/0:1+events20:22:240
398829999243812,2422cyclictest4050436-21kworker/0:0+events22:42:490
39882999924369,2424cyclictest4000994-21kworker/0:0+events19:49:310
398829999243510,2421cyclictest4088017-21kworker/0:2+events00:20:480
398830999243312,2417cyclictest4034767-21kworker/3:3+events21:46:593
398830999243012,2414cyclictest3997765-21kworker/3:1+events19:41:523
398829999242912,2412cyclictest3993283-21kworker/0:1+events19:44:100
398829999242911,2414cyclictest4047108-21kworker/0:1+events22:22:200
398830999242811,2414cyclictest4029961-21kworker/3:2+events21:21:123
398829999242711,2412cyclictest4060266-21kworker/0:1+events23:02:410
398830999242612,2410cyclictest4053868-21kworker/3:1+events22:50:503
398830999242412,2409cyclictest4092706-21kworker/3:0+events00:35:593
398830999242212,2406cyclictest3991537-21kworker/3:2+events19:18:393
398830799242212,2406cyclictest4002844-21kworker/2:2+events19:59:472
398830299241412,2400cyclictest4058961-21kworker/1:2+events22:52:431
398830999241212,2397cyclictest4007555-21kworker/3:0+events20:11:153
398830799240611,2391cyclictest4053896-21kworker/2:2+events22:38:132
39883099924049,2392cyclictest4029961-21kworker/3:2+events21:31:023
398830799240412,2388cyclictest4023563-21kworker/2:0+events21:12:522
398830799240310,2390cyclictest4069779-21kworker/2:1+events23:21:582
398830799240310,2390cyclictest4069779-21kworker/2:1+events23:21:572
398829999240311,2389cyclictest4012097-21kworker/0:0+events20:33:540
398830999240212,2387cyclictest4034767-21kworker/3:3+events21:54:283
398830799240212,2386cyclictest4060355-21kworker/2:2+events23:03:022
398830799240112,2385cyclictest4065575-21kworker/2:0+events23:13:152
398830799240112,2385cyclictest4057151-21kworker/2:0+events22:42:272
398830999240012,2384cyclictest4066788-21kworker/3:0+events23:16:173
398830999240010,2386cyclictest4068394-21kworker/3:2+events23:37:573
398830299240012,2384cyclictest4058961-21kworker/1:2+events22:58:261
398830999239912,2383cyclictest3999389-21kworker/3:2+events19:48:213
39883029923998,2386cyclictest4047045-21kworker/1:1+events22:16:141
398830999239812,2383cyclictest4034767-21kworker/3:3+events21:42:263
398830999239812,2383cyclictest4018877-21kworker/3:2+events20:47:503
398830999239810,2384cyclictest4025066-21kworker/3:1+events21:04:513
398830999239712,2382cyclictest4063407-21kworker/3:1+events23:13:393
398830999239612,2382cyclictest4068394-21kworker/3:2+events23:20:063
398830999239612,2382cyclictest4068394-21kworker/3:2+events23:20:053
398830999239612,2381cyclictest4063407-21kworker/3:1+events23:04:573
398830999239610,2383cyclictest4023322-21kworker/3:2+events20:58:483
398830999239512,2379cyclictest4092706-21kworker/3:0+events00:34:273
398830999239512,2379cyclictest4063407-21kworker/3:1+events23:09:303
398830999239512,2379cyclictest3994769-21kworker/3:2+events19:32:203
398830999239412,2378cyclictest4088256-21kworker/3:0+events00:24:113
398830999239411,2380cyclictest4005918-21kworker/3:1+events20:08:593
398830799239410,2380cyclictest4037748-21kworker/2:1+events21:43:572
398830999239311,2379cyclictest4025066-21kworker/3:1+events21:08:163
398830999239212,2376cyclictest4053868-21kworker/3:1+events22:43:563
398830999239011,2376cyclictest4048682-21kworker/3:2+events22:17:213
398830799239012,2374cyclictest4031464-21kworker/2:0+events21:32:092
398830999238812,2373cyclictest4047077-21kworker/3:1+events22:14:423
398830799238810,2375cyclictest4023563-21kworker/2:0+events21:07:082
398830999238712,2372cyclictest4085021-21kworker/3:0+events00:09:263
398830999238112,2366cyclictest3989495-21kworker/3:0+events19:23:123
398830299237812,2363cyclictest4066578-21kworker/1:2+events23:15:321
398830999236511,2350cyclictest4080136-21kworker/3:2+events23:52:453
398830999236412,2348cyclictest4013968-21kworker/3:1+events20:28:313
398830999236312,2348cyclictest4050406-21kworker/3:0+events22:24:373
398830999236212,2346cyclictest3997765-21kworker/3:1+events19:53:383
398830999235912,2344cyclictest4052003-21kworker/3:2+events22:38:373
398830799235010,2337cyclictest4009039-21kworker/2:0+events20:17:252
398830299235011,2335cyclictest4025317-21kworker/1:0+events21:45:281
398830799234312,2327cyclictest4007370-21kworker/2:2+events20:21:162
398830299234212,2327cyclictest4083810-21kworker/1:1+events00:10:101
398830799233912,2324cyclictest4007370-21kworker/2:2+events20:31:092
39883079923379,2324cyclictest4007370-21kworker/2:2+events20:08:352
398830799233711,2323cyclictest3997916-21kworker/2:0+events19:49:522
398830999233610,2323cyclictest3989495-21kworker/3:0+events19:39:143
398830299233510,2322cyclictest4091314-21kworker/1:2+events00:28:451
398830799233012,2315cyclictest3991412-21kworker/2:2+events19:34:162
398830799232911,2315cyclictest4045689-21kworker/2:2+events22:09:202
398830299232910,2316cyclictest4087987-21kworker/1:2+events00:20:261
398830799232812,2312cyclictest4082013-21kworker/2:3+events00:00:232
398830799232712,2312cyclictest4050254-21kworker/2:1+events22:45:512
398830799232612,2311cyclictest4074939-21kworker/2:0+events23:55:472
398830799232612,2311cyclictest4074939-21kworker/2:0+events23:39:262
398830799232612,2311cyclictest4071402-21kworker/2:2+events23:50:532
398830299232511,2311cyclictest4025317-21kworker/1:0+events21:56:011
398829999232412,2312cyclictest4078480-21kworker/0:0+events00:04:100
398830799232311,2309cyclictest4034488-21kworker/2:2+events21:59:492
398830299232312,2308cyclictest4044148-21kworker/1:0+events22:08:571
398829999232312,2308cyclictest4037777-21kworker/0:1+events21:48:300
398830799232112,2306cyclictest4029844-21kworker/2:2+events21:20:472
398830299231811,2304cyclictest4053780-21kworker/1:1+events23:00:221
398830299231811,2304cyclictest4040742-21kworker/1:1+events22:03:181
398830799231711,2302cyclictest3997916-21kworker/2:0+events19:40:222
398830299231712,2301cyclictest4062455-21kworker/1:0+events23:44:011
398830799231612,2301cyclictest4088285-21kworker/2:2+events00:34:062
398830299231612,2301cyclictest4020153-21kworker/1:1+events20:50:261
398830299231512,2300cyclictest4050493-21kworker/1:2+events22:26:061
398829999231512,2300cyclictest4068334-21kworker/0:2+events23:26:300
398829999231512,2300cyclictest4068334-21kworker/0:2+events23:26:290
398830299231411,2299cyclictest4025317-21kworker/1:0+events21:39:491
398830799231212,2297cyclictest4047380-21kworker/2:0+events22:15:522
398830799231112,2296cyclictest4007370-21kworker/2:2+events20:11:382
398830299231111,2297cyclictest4004202-21kworker/1:1+events20:00:331
398830799231011,2295cyclictest4007370-21kworker/2:2+events20:35:232
398830799231010,2297cyclictest4089988-21kworker/2:0+events00:26:062
398830799230912,2294cyclictest4041098-21kworker/2:1+events22:12:462
398830799230811,2294cyclictest4088285-21kworker/2:2+events00:23:502
398830799230710,2294cyclictest4089988-21kworker/2:0+events00:38:372
398830799230611,2292cyclictest4034488-21kworker/2:2+events21:36:452
398830299230611,2292cyclictest3989839-21kworker/1:3+events19:26:581
398829999230611,2292cyclictest4050436-21kworker/0:0+events22:48:300
398830799230410,2291cyclictest3996315-21kworker/2:1+events19:35:502
39883079922959,2283cyclictest4051939-21kworker/2:0+events22:28:442
398830799228411,2269cyclictest4020364-21kworker/2:0+events20:49:212
398830999228012,2265cyclictest3989495-21kworker/3:0+events19:13:183
398830799227811,2264cyclictest3991412-21kworker/2:2+events19:23:562
39883029922767,2266cyclictest4042518-21kworker/1:2+events22:10:501
398830799227512,2260cyclictest4060355-21kworker/2:2+events23:09:072
398829999227411,2260cyclictest4076725-21kworker/0:2+events23:46:190
398829999227411,2259cyclictest3995669-21kworker/0:2+events19:31:130
398829999226911,2255cyclictest4012097-21kworker/0:0+events20:26:380
39882999922689,2255cyclictest4015632-21kworker/0:2+events20:36:560
39883079922620,2259cyclictest3983157-21kworker/2:0+events19:14:042
398830999225711,2243cyclictest4068394-21kworker/3:2+events23:29:343
398830999225711,2243cyclictest4068394-21kworker/3:2+events23:29:343
398829999224311,2229cyclictest4078480-21kworker/0:0+events00:12:500
398830999224110,2228cyclictest4004265-21kworker/3:0+events20:00:573
398829999224111,2227cyclictest4002624-21kworker/0:1+events19:58:170
39882999922409,2227cyclictest3986196-21kworker/0:1+events19:17:280
398830999223710,2224cyclictest4026669-21kworker/3:2+events21:12:293
398829999223711,2223cyclictest4021782-21kworker/0:2+events20:52:430
39882999922366,2226cyclictest4029873-21kworker/0:2+events21:20:260
39882999922359,2223cyclictest4053987-21kworker/0:2+events22:35:570
398830299223410,2221cyclictest4014082-21kworker/1:0+events20:35:471
398829999223310,2220cyclictest4047108-21kworker/0:1+events22:17:450
398829999223111,2217cyclictest4052118-21kworker/0:1+events22:31:020
398830799222911,2214cyclictest3983157-21kworker/2:0+events19:19:032
398830999222411,2210cyclictest4010402-21kworker/3:1+events20:18:563
39883079922249,2212cyclictest3991412-21kworker/2:2+events19:26:342
398829999222110,2207cyclictest4048779-21kworker/0:2+events22:27:580
398830299220112,2186cyclictest4001114-21kworker/1:0+events19:57:541
398830999220011,2185cyclictest4028253-21kworker/3:0+events21:16:383
398829999219511,2181cyclictest4002624-21kworker/0:1+events19:54:490
398830799219210,2179cyclictest4012307-21kworker/2:0+events20:26:162
398830799218812,2173cyclictest4021957-21kworker/2:1+events20:54:372
39883099921676,2158cyclictest4015602-21kworker/3:0+events20:39:123
39883029921676,2158cyclictest4070364-21kworker/1:2+events23:28:481
39883029921676,2158cyclictest4070364-21kworker/1:2+events23:28:481
398830299216610,2153cyclictest4028296-21kworker/1:2+events21:16:141
39883029921648,2153cyclictest4032797-21kworker/1:1+events21:30:161
398830299216411,2149cyclictest4010461-21kworker/1:2+events20:45:571
398830299216211,2147cyclictest3999512-21kworker/1:2+events19:51:211
398830799215912,2143cyclictest4074939-21kworker/2:0+events23:42:512
398830799214712,2132cyclictest4065575-21kworker/2:0+events23:31:502
398830299213612,2121cyclictest4057268-21kworker/1:0+events22:46:581
398830299212810,2115cyclictest4087987-21kworker/1:2+events00:18:101
398830299212610,2114cyclictest3993139-21kworker/1:1+events19:30:031
398830299212510,2113cyclictest4032797-21kworker/1:1+events21:42:491
398830299212111,2106cyclictest4010461-21kworker/1:2+events20:57:381
398830299212011,2105cyclictest4062455-21kworker/1:0+events23:11:001
39883029921189,2106cyclictest4001114-21kworker/1:0+events20:09:201
398830299211811,2104cyclictest4028296-21kworker/1:2+events21:14:431
398830299211810,2105cyclictest4001114-21kworker/1:0+events20:20:531
398830299211810,2105cyclictest3993139-21kworker/1:1+events19:43:241
398830299211710,2103cyclictest4050493-21kworker/1:2+events22:32:321
398830299211611,2102cyclictest3989839-21kworker/1:3+events19:16:421
398830299211511,2101cyclictest3989613-21kworker/1:0+events19:14:491
398830799211411,2100cyclictest4021957-21kworker/2:1+events20:59:102
398830299211411,2100cyclictest3999512-21kworker/1:2+events19:48:441
398830299211411,2099cyclictest4010461-21kworker/1:2+events20:29:151
398830299211411,2099cyclictest4007492-21kworker/1:1+events20:13:111
398830299211311,2099cyclictest4050493-21kworker/1:2+events22:35:331
398830299211211,2098cyclictest4048654-21kworker/1:0+events22:24:141
398830299211110,2099cyclictest4076846-21kworker/1:2+events23:50:071
398830299211110,2098cyclictest4053780-21kworker/1:1+events22:43:101
398830299211011,2096cyclictest4062455-21kworker/1:0+events23:22:191
398830299211011,2096cyclictest4062455-21kworker/1:0+events23:22:191
398830799210511,2090cyclictest4018703-21kworker/2:2+events20:44:272
39883029921059,2092cyclictest4076846-21kworker/1:2+events23:57:441
398830799210411,2090cyclictest4082013-21kworker/2:3+events00:10:552
398830799210410,2091cyclictest4041098-21kworker/2:1+events22:02:312
39883079921035,2095cyclictest4050254-21kworker/2:1+events22:30:392
39883079920979,2086cyclictest4031464-21kworker/2:0+events21:25:012
398829999208710,2074cyclictest3986196-21kworker/0:1+events19:12:550
398830799208011,2067cyclictest4065575-21kworker/2:0+events23:26:512
398830799208011,2067cyclictest4065575-21kworker/2:0+events23:26:512
39883099920469,2034cyclictest4044275-21kworker/3:0+events22:08:133
398830299197210,1959cyclictest4001114-21kworker/1:0+events20:17:021
398830299195310,1939cyclictest4025317-21kworker/1:0+events21:51:091
39883029919496,1940cyclictest4025317-21kworker/1:0+events21:25:441
39883029918918,1880cyclictest4062455-21kworker/1:0+events23:38:421
39880362153108,25sleep10-21swapper/119:09:361
39877312145101,41sleep20-21swapper/219:05:442
39879002144111,29sleep00-21swapper/019:07:510
39877952142110,27sleep30-21swapper/319:06:333
398830799109106,2cyclictest4084844-21kworker/2:1+pm00:19:512
3988302992421,2cyclictest4076846-21kworker/1:2+pm23:49:561
3988302992212,7cyclictest593-21dbus-daemon00:40:011
398830299207,8cyclictest0-21swapper/119:35:121
398830299205,6cyclictest3992610-21expr19:20:161
3988302992016,2cyclictest4073271-21idleruntime-cro23:35:001
3988302992015,3cyclictest355-21systemd-journal21:24:591
3988302991815,2cyclictest331ktimers/100:00:131
398830299172,6cyclictest4026029-21ntpq21:05:181
398830299170,5cyclictest4091768-21seq00:30:141
398830299169,5cyclictest4024151-21/usr/sbin/munin21:00:151
398830299141,3cyclictest4018149-21ntpq20:40:181
398830299141,10cyclictest4064033-21apt-get23:05:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional