You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 18:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Fri May 01, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
43889399321615,3198cyclictest498268-21kworker/3:2+events22:20:113
43888399279513,2778cyclictest472371-21kworker/0:2+events21:05:130
43888999279114,2774cyclictest485190-21kworker/2:1+events21:35:202
43888399272613,2708cyclictest523861-21kworker/0:2+events23:35:200
43888399270713,2690cyclictest491560-21kworker/0:2+events22:05:000
43889399270113,2684cyclictest439963-21kworker/3:0+events19:20:113
43888399270113,2684cyclictest451939-21kworker/0:1+events20:20:100
43889399263813,2621cyclictest486822-21kworker/3:2+events21:45:103
43888399259212,2576cyclictest485582-21kworker/0:2+events21:40:160
43889399258512,2570cyclictest445454-21kworker/3:0+events20:10:193
43888999257812,2564cyclictest448536-21kworker/2:0+events19:45:052
43888399257712,2561cyclictest479140-21kworker/0:2+events21:19:420
43888999257412,2558cyclictest515556-21kworker/2:0+events23:07:492
4388899925738,2561cyclictest456769-21kworker/2:2+events20:05:232
43888999256912,2553cyclictest488537-21kworker/2:2+events21:43:152
43888999256810,2554cyclictest528471-21kworker/2:2+events00:03:302
43889399255812,2542cyclictest491712-21kworker/3:2+events21:56:173
43888399255412,2538cyclictest512427-21kworker/0:0+events23:08:580
43888999255012,2535cyclictest502837-21kworker/2:0+events22:30:432
43889399254212,2526cyclictest502660-21kworker/3:1+events22:33:013
43888999254012,2525cyclictest451815-21kworker/2:1+events19:54:162
43888399254012,2524cyclictest477513-21kworker/0:0+events21:11:160
4388899925364,2529cyclictest507693-21kworker/2:0+events22:57:182
43888399253611,2521cyclictest533415-21kworker/0:0+events00:03:070
43888399253312,2517cyclictest450279-21kworker/0:0+events19:44:440
43889399252912,2513cyclictest498268-21kworker/3:2+events22:16:213
43888399252812,2512cyclictest510805-21kworker/0:1+events22:52:450
43888399251012,2494cyclictest519264-21kworker/0:1+events23:28:020
43888999250512,2489cyclictest464560-21kworker/2:2+events20:59:072
43888399250412,2488cyclictest519264-21kworker/0:1+events23:46:420
43889399250012,2485cyclictest479078-21kworker/3:2+events21:29:343
43889399250012,2484cyclictest466168-21kworker/3:2+events20:47:013
43889399249912,2485cyclictest494995-21kworker/3:0+events22:05:233
43888999249612,2481cyclictest540832-21kworker/2:2+events00:36:322
43888999249612,2480cyclictest440231-21kworker/2:1+events19:28:312
43889399249512,2480cyclictest521369-21kworker/3:2+events23:25:453
43889399249512,2480cyclictest445454-21kworker/3:0+events19:59:363
43889399249512,2479cyclictest451968-21kworker/3:1+events19:50:503
4388939924950,2492cyclictest502660-21kworker/3:1+events22:27:213
4388939924950,2492cyclictest502660-21kworker/3:1+events22:27:203
43888999249412,2479cyclictest522248-21kworker/2:2+events23:33:242
43888999249412,2479cyclictest477332-21kworker/2:2+events21:30:432
43888999249412,2479cyclictest464560-21kworker/2:2+events20:40:552
43888999249412,2478cyclictest475718-21kworker/2:0+events21:11:392
43888999249412,2478cyclictest475718-21kworker/2:0+events21:03:192
43888999249312,2478cyclictest510953-21kworker/2:2+events23:00:382
4388839924939,2480cyclictest530042-21kworker/0:0+events23:53:100
43889399249212,2477cyclictest519115-21kworker/3:0+events23:19:173
43888999249212,2476cyclictest499434-21kworker/2:1+events22:18:152
43888999249212,2476cyclictest493343-21kworker/2:1+events22:08:232
43888999249211,2478cyclictest469375-21kworker/2:0+events20:48:112
43889399249112,2476cyclictest532124-21kworker/3:3+events00:04:393
43889399249112,2476cyclictest453630-21kworker/3:2+events20:20:353
43888999249112,2476cyclictest528471-21kworker/2:2+events00:05:452
43888999249112,2476cyclictest493343-21kworker/2:1+events22:04:122
43888999249112,2475cyclictest480600-21kworker/2:1+events21:18:322
43888999249012,2474cyclictest502987-21kworker/2:3+events22:37:572
43888999249012,2474cyclictest494964-21kworker/2:0+events22:20:352
43888999249010,2476cyclictest494964-21kworker/2:0+events22:12:542
43888999248911,2475cyclictest510953-21kworker/2:2+events22:54:402
43888999248911,2475cyclictest477332-21kworker/2:2+events21:27:192
43888999248511,2470cyclictest528471-21kworker/2:2+events23:47:052
43888999248412,2469cyclictest537276-21kworker/2:1+events00:29:442
43888999248412,2469cyclictest528471-21kworker/2:2+events23:56:362
43888999248411,2470cyclictest477332-21kworker/2:2+events21:22:452
43889399248211,2467cyclictest535519-21kworker/3:1+events00:11:493
43888999248111,2467cyclictest523890-21kworker/2:1+events23:37:552
43888999247912,2464cyclictest506037-21kworker/2:1+events22:44:282
43888999247712,2461cyclictest513929-21kworker/2:1+events23:16:112
43888999247711,2462cyclictest448536-21kworker/2:0+events19:42:492
43889399247612,2460cyclictest472277-21kworker/3:0+events21:07:523
43888399247212,2456cyclictest451939-21kworker/0:1+events20:06:320
43888399247212,2456cyclictest440108-21kworker/0:2+events19:25:300
43888999246712,2451cyclictest513929-21kworker/2:1+events23:12:222
4388839924677,2456cyclictest480749-21kworker/0:0+events21:33:240
43888999246112,2446cyclictest540832-21kworker/2:2+events00:34:592
43888399245612,2441cyclictest440108-21kworker/0:2+events19:16:250
4388899924559,2443cyclictest537276-21kworker/2:1+events00:23:152
43888399245112,2436cyclictest487913-21kworker/0:0+events21:45:320
43888399244912,2433cyclictest540534-21kworker/0:0+events00:33:290
43888399244812,2432cyclictest514076-21kworker/0:1+events23:11:370
43888399244812,2432cyclictest497925-21kworker/0:0+events22:12:310
43888399244812,2432cyclictest466257-21kworker/0:0+events20:35:290
43888399244712,2432cyclictest463051-21kworker/0:2+events20:33:550
4388839924469,2434cyclictest440108-21kworker/0:2+events19:21:410
43888399244512,2429cyclictest504468-21kworker/0:2+events22:38:170
43888399244511,2432cyclictest487913-21kworker/0:0+events21:50:070
43888399244511,2431cyclictest534098-21kworker/0:1+events00:11:250
43888399244412,2429cyclictest451939-21kworker/0:1+events19:51:370
43888399244310,2430cyclictest525542-21kworker/0:0+events23:40:110
43888399244212,2426cyclictest455322-21kworker/0:2+events20:04:130
43888399244211,2428cyclictest533415-21kworker/0:0+events00:06:300
43889399243912,2424cyclictest447057-21kworker/3:2+events19:33:233
43888399243712,2423cyclictest444006-21kworker/0:1+events19:36:490
43888399243612,2421cyclictest451939-21kworker/0:1+events20:28:540
43889399242611,2412cyclictest509532-21kworker/3:1+events23:09:203
43888399242512,2409cyclictest466257-21kworker/0:0+events20:54:590
43888999241810,2405cyclictest458371-21kworker/2:0+events20:10:412
43889399241312,2397cyclictest532124-21kworker/3:3+events00:26:203
43889399241012,2394cyclictest502660-21kworker/3:1+events22:35:183
43888599240612,2391cyclictest454871-21kworker/1:1+events20:09:321
43888399239910,2386cyclictest508035-21kworker/0:2+events22:59:510
43889399239810,2385cyclictest542280-21kworker/3:2+events00:35:463
4388839923969,2384cyclictest479140-21kworker/0:2+events21:26:340
43888599239510,2382cyclictest520945-21kworker/1:2+events00:14:291
43889399239412,2378cyclictest461300-21kworker/3:0+events20:31:143
43888999239410,2378cyclictest506037-21kworker/2:1+events22:48:382
43888399239411,2380cyclictest459763-21kworker/0:2+events20:13:210
4388939923916,2381cyclictest509532-21kworker/3:1+events23:12:443
43888399238912,2374cyclictest540534-21kworker/0:0+events00:36:560
43888999238812,2372cyclictest491741-21kworker/2:2+events21:57:272
43888999238611,2371cyclictest440231-21kworker/2:1+events19:24:422
43889399238311,2368cyclictest477452-21kworker/3:1+events21:13:323
43888399238312,2367cyclictest506337-21kworker/0:1+events22:42:100
43888399237812,2362cyclictest517599-21kworker/0:2+events23:24:380
43888999237712,2361cyclictest533917-21kworker/2:0+events00:13:212
43888399237612,2361cyclictest444006-21kworker/0:1+events19:32:170
43888399236012,2345cyclictest495026-21kworker/0:1+events22:20:580
43888999235812,2342cyclictest520528-21kworker/2:0+events23:22:192
43889399235710,2343cyclictest528621-21kworker/3:0+events23:49:213
43888999234612,2331cyclictest462932-21kworker/2:0+events20:31:582
43888399234612,2331cyclictest501276-21kworker/0:0+events22:29:560
43888399234612,2331cyclictest501276-21kworker/0:0+events22:29:560
43888399234612,2330cyclictest538655-21kworker/0:1+events00:28:570
43888599234312,2327cyclictest537239-21kworker/1:1+events00:38:041
43889399234012,2324cyclictest504352-21kworker/3:2+events22:46:013
43888399233812,2322cyclictest508035-21kworker/0:2+events22:47:300
43889399232911,2314cyclictest506276-21kworker/3:0+events22:41:243
43888999232911,2315cyclictest490140-21kworker/2:1+events21:52:482
43889399232712,2311cyclictest445454-21kworker/3:0+events19:48:563
43888599232710,2313cyclictest499870-21kworker/1:2+events22:40:381
43888999232611,2311cyclictest464560-21kworker/2:2+events20:51:342
43889399232511,2311cyclictest442232-21kworker/3:2+events19:25:533
43889399232212,2306cyclictest482375-21kworker/3:1+events21:30:203
43888599231812,2302cyclictest531888-21kworker/1:0+events00:01:591
43889399231712,2303cyclictest532124-21kworker/3:3+events00:20:083
43888999231710,2304cyclictest499434-21kworker/2:1+events22:28:062
43888999231710,2304cyclictest499434-21kworker/2:1+events22:28:052
43889399231512,2300cyclictest523706-21kworker/3:0+events23:39:483
43888999231310,2300cyclictest451815-21kworker/2:1+events20:24:232
43889399231112,2295cyclictest504352-21kworker/3:2+events22:51:583
43889399231111,2297cyclictest461300-21kworker/3:0+events20:42:493
43889399231012,2294cyclictest488505-21kworker/3:0+events21:52:253
43889399231010,2296cyclictest453630-21kworker/3:2+events20:08:233
43889399230812,2293cyclictest528621-21kworker/3:0+events23:50:553
43889399230812,2292cyclictest531826-21kworker/3:0+events00:05:233
43889399230711,2293cyclictest509532-21kworker/3:1+events23:02:093
43889399230711,2293cyclictest496592-21kworker/3:1+events22:11:253
43889399230711,2293cyclictest453630-21kworker/3:2+events20:18:153
43889399230512,2289cyclictest491712-21kworker/3:2+events22:04:373
43889399230510,2291cyclictest466168-21kworker/3:2+events20:35:513
43888999230111,2286cyclictest451815-21kworker/2:1+events20:17:312
4388839923008,2289cyclictest531673-21kworker/0:1+events23:57:450
43889399229712,2282cyclictest461300-21kworker/3:0+events20:27:443
43888999229110,2278cyclictest523890-21kworker/2:1+events23:44:472
43888999229012,2276cyclictest528471-21kworker/2:2+events00:15:372
4388899922887,2278cyclictest464560-21kworker/2:2+events20:35:052
43888599228811,2274cyclictest458340-21kworker/1:0+events20:15:381
43889399228212,2267cyclictest530222-21kworker/3:2+events23:58:553
4388899922828,2271cyclictest445727-21kworker/2:2+events19:34:332
43889399228012,2265cyclictest479078-21kworker/3:2+events21:18:573
43888999228012,2265cyclictest490140-21kworker/2:1+events21:49:452
43889399227611,2261cyclictest537119-21kworker/3:0+events00:17:093
4388899922769,2263cyclictest451815-21kworker/2:1+events20:01:112
43889399227511,2261cyclictest540651-21kworker/3:0+events00:34:373
43889399227411,2260cyclictest453630-21kworker/3:2+events20:00:473
43889399227310,2260cyclictest480691-21kworker/3:0+events21:20:503
43889399227211,2258cyclictest448662-21kworker/3:1+events19:38:433
43888599227110,2257cyclictest440354-21kworker/1:2+events19:38:211
43888999227011,2255cyclictest477332-21kworker/2:2+events21:08:162
43888999227010,2256cyclictest522248-21kworker/2:2+events23:28:252
43889399226911,2255cyclictest523706-21kworker/3:0+events23:34:573
4388939922688,2258cyclictest511151-21kworker/3:0+events22:55:033
43888999226811,2254cyclictest453569-21kworker/2:2+events19:56:342
43888599226711,2253cyclictest472989-21kworker/1:2+events21:07:291
43888999226511,2250cyclictest448536-21kworker/2:0+events19:36:272
43888399226510,2251cyclictest467840-21kworker/0:2+events20:43:350
43888999226210,2248cyclictest413532-21kworker/2:0+events19:18:182
43888999226111,2246cyclictest462932-21kworker/2:0+events20:25:312
43889399226011,2246cyclictest509532-21kworker/3:1+events23:20:243
43888399226011,2246cyclictest472371-21kworker/0:2+events21:00:380
43889399225410,2241cyclictest472277-21kworker/3:0+events20:59:303
43888399225010,2236cyclictest472371-21kworker/0:2+events20:55:460
43888399224311,2229cyclictest480749-21kworker/0:0+events21:20:270
43888399223711,2223cyclictest522159-21kworker/0:0+events23:31:280
43888399223510,2222cyclictest512427-21kworker/0:0+events23:17:450
43888399223110,2217cyclictest535730-21kworker/0:0+events00:18:400
43888399222910,2215cyclictest538655-21kworker/0:1+events00:24:250
4388899922275,2219cyclictest440231-21kworker/2:1+events19:14:552
43888399222711,2213cyclictest483945-21kworker/0:1+events21:36:060
43888399222611,2212cyclictest491560-21kworker/0:2+events21:59:180
43889399222412,2209cyclictest472277-21kworker/3:0+events21:04:513
43888399222411,2210cyclictest495026-21kworker/0:1+events22:15:350
43888399222411,2210cyclictest491560-21kworker/0:2+events22:09:310
43888399222211,2208cyclictest501276-21kworker/0:0+events22:32:370
43888399222211,2207cyclictest512427-21kworker/0:0+events23:02:330
43888399222111,2207cyclictest448626-21kworker/0:2+events19:46:390
4388839922199,2206cyclictest451939-21kworker/0:1+events19:57:190
43888399221011,2196cyclictest466257-21kworker/0:0+events20:45:270
4388859922039,2191cyclictest477421-21kworker/1:1+events21:21:141
43888599217912,2164cyclictest519232-21kworker/1:0+events23:26:071
43888599215812,2142cyclictest467564-21kworker/1:1+events20:55:231
43888599215611,2141cyclictest506480-21kworker/1:0+events22:58:461
43889399212111,2107cyclictest472277-21kworker/3:0+events20:51:123
43888599212010,2106cyclictest488798-21kworker/1:2+events21:47:021
43888599211911,2105cyclictest531888-21kworker/1:0+events00:17:541
43889399211611,2102cyclictest488505-21kworker/3:0+events21:44:273
43888599211511,2101cyclictest516094-21kworker/1:1+events23:19:381
43888599211511,2101cyclictest460042-21kworker/1:2+events20:36:161
4388939921079,2095cyclictest442232-21kworker/3:2+events19:18:393
43888999210610,2093cyclictest525485-21kworker/2:0+events23:50:312
43889399210311,2088cyclictest525308-21kworker/3:1+events23:40:343
43888599209811,2084cyclictest497836-21kworker/1:1+events22:24:211
4388859920969,2084cyclictest491946-21kworker/1:0+events22:10:381
43888599209511,2081cyclictest487094-21kworker/1:1+events21:58:321
43888599209510,2081cyclictest520945-21kworker/1:2+events23:59:421
43889399209010,2077cyclictest486822-21kworker/3:2+events21:39:073
4388839920837,2073cyclictest440108-21kworker/0:2+events19:13:230
43888399208210,2069cyclictest451939-21kworker/0:1+events20:18:390
43888599197510,1962cyclictest512576-21kworker/1:2+events23:10:281
4388859919628,1951cyclictest472989-21kworker/1:2+events21:01:251
4388859919598,1948cyclictest482076-21kworker/1:0+events21:39:521
43889399195110,1938cyclictest437072-21kworker/3:1+events19:14:343
4388859919509,1938cyclictest440354-21kworker/1:2+events19:55:471
4388939919476,1937cyclictest445454-21kworker/3:0+events19:43:123
4388859919019,1889cyclictest438402-21kworker/1:0+events19:15:401
4383152192161,28sleep20-21swapper/219:05:462
4386462144113,25sleep30-21swapper/319:09:563
4383402144102,37sleep00-21swapper/019:06:050
4386212143109,28sleep10-21swapper/119:09:391
43888599294,22cyclictest525634-21readlink23:40:001
438885992410,4cyclictest740-21snmpd20:43:251
438885992313,7cyclictest440321-21apt-get19:15:001
43888599220,19cyclictest0-21swapper/122:50:121
43888599220,11cyclictest526105-21df_inode23:40:161
43888599218,10cyclictest529250-21df23:50:151
43888599212,17cyclictest447231-21seq19:33:561
43888599212,16cyclictest0-21swapper/123:10:011
43888599211,17cyclictest520112-21ntpq23:20:171
43888599211,17cyclictest488744-21idleruntime-cro21:45:011
43888599210,1cyclictest0-21swapper/120:25:111
43888599209,7cyclictest504537-21apt-get22:35:001
43888599207,7cyclictest513460-21strings23:00:171
43888599201,17cyclictest498693-21hddtemp_smartct22:15:141
43888599201,17cyclictest491726-21seq21:53:131
43888599201,16cyclictest539082-21munin-run00:25:011
43888599200,8cyclictest479876-21/usr/sbin/munin21:15:181
43888599200,1cyclictest0-21swapper/120:30:161
43888599191,15cyclictest505583-21ntpq22:35:171
43888599191,15cyclictest502967-21awk22:30:001
43888599191,15cyclictest502967-21awk22:30:001
43888599191,15cyclictest459979-21munin-run20:15:001
43888599191,14cyclictest523230-21ntpq23:30:171
43888599191,14cyclictest483204-21ntpq21:25:191
43888599190,1cyclictest0-21swapper/120:50:001
43888599190,17cyclictest449392-21df_inode19:40:131
43888599189,7cyclictest450743-21/usr/sbin/munin19:45:191
43888599188,8cyclictest0-21swapper/119:24:591
43888599187,9cyclictest508772-21ld22:45:181
43888599187,6cyclictest478139-21smartctl21:10:131
43888599181,14cyclictest453650-21idleruntime-cro19:55:011
43888599180,5cyclictest484208-21taskset21:30:041
43888599180,1cyclictest0-21swapper/100:05:461
43888599180,17cyclictest496602-21taskset22:09:501
43888599180,14cyclictest471810-21ntpq20:50:161
43888599180,13cyclictest539792-21hddtemp_smartct00:25:171
43888599177,7cyclictest528796-21awk23:50:001
43888599173,12cyclictest444440-21/usr/sbin/munin19:25:131
43888599171,13cyclictest455710-21df20:00:131
43888599170,14cyclictest542468-21sleep00:35:001
43888599161,12cyclictest493744-21apt-get22:00:111
43888599160,14cyclictest461819-21/usr/sbin/munin20:20:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional