You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-12 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Nov 12, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30064799310215,3083cyclictest370597-21kworker/3:0+events23:00:183
30063799296614,2947cyclictest386406-21kworker/0:2+events23:35:110
30064599296514,2946cyclictest376994-21kworker/2:2+events23:05:372
30063799291514,2896cyclictest354397-21kworker/0:1+events21:55:120
30064799289514,2876cyclictest375840-21kworker/3:2+events23:05:133
30064599285714,2841cyclictest339605-21kworker/2:2+events21:15:012
30063799278814,2770cyclictest349546-21kworker/0:2+events21:39:400
30064099272213,2705cyclictest300214-21kworker/1:0+events19:15:151
30064599259510,2580cyclictest388245-21kworker/2:2+events00:25:182
30064599254312,2527cyclictest358975-21kworker/2:0+events22:14:362
3006459925379,2525cyclictest365880-21kworker/2:2+events22:30:152
30064599253412,2519cyclictest358975-21kworker/2:0+events22:08:102
30064099250012,2484cyclictest359095-21kworker/1:1+events22:26:081
3006379924929,2480cyclictest383207-21kworker/0:2+events23:25:200
30064099249112,2475cyclictest400971-21kworker/1:0+events00:22:381
30063799249012,2475cyclictest373980-21kworker/0:0+events23:04:050
30064599248810,2474cyclictest351383-21kworker/2:1+events21:50:172
30063799248410,2470cyclictest370702-21kworker/0:0+events22:48:110
3006409924828,2470cyclictest346091-21kworker/1:1+events21:42:201
3006409924828,2470cyclictest346091-21kworker/1:1+events21:42:191
30064099248212,2466cyclictest380301-21kworker/1:0+events23:15:311
30064799245610,2443cyclictest336309-21kworker/3:1+events21:03:543
30064599245512,2439cyclictest388245-21kworker/2:2+events00:23:232
30063799245512,2440cyclictest407369-21kworker/0:1+events00:39:020
30064599245212,2437cyclictest404349-21kworker/2:1+events00:30:172
30064599245112,2435cyclictest334732-21kworker/2:0+events21:02:192
30064099245112,2435cyclictest324675-21kworker/1:0+events20:30:121
30064099245012,2435cyclictest319544-21kworker/1:2+events20:20:461
30064599244411,2429cyclictest325859-21kworker/2:2+events20:37:312
30064799244312,2426cyclictest344778-21kworker/3:2+events21:30:113
30064599243912,2424cyclictest383501-21kworker/2:2+events23:27:372
30064599243812,2424cyclictest385346-21kworker/2:0+events23:40:042
3006379924389,2425cyclictest344372-21kworker/0:1+events21:32:250
30064799243712,2421cyclictest324493-21kworker/3:0+events20:40:123
30064599243212,2418cyclictest381851-21kworker/2:1+events23:20:052
30064599243012,2414cyclictest313232-21kworker/2:2+events19:52:372
30064099243012,2414cyclictest363923-21kworker/1:2+events22:43:121
30064599242912,2413cyclictest367485-21kworker/2:0+events22:38:352
30064099242912,2414cyclictest359095-21kworker/1:1+events22:18:251
30064599242512,2410cyclictest367485-21kworker/2:0+events22:50:282
30064599242512,2410cyclictest316511-21kworker/2:1+events20:01:232
30064599242512,2410cyclictest316511-21kworker/2:1+events20:01:232
30064599242512,2409cyclictest405953-21kworker/2:0+events00:38:382
30064799242311,2408cyclictest386637-21kworker/3:1+events23:43:323
30063799242212,2406cyclictest346013-21kworker/0:2+events21:29:260
30063799242011,2405cyclictest331326-21kworker/0:1+events20:44:210
30064799241912,2403cyclictest392686-21kworker/3:2+events00:02:063
30063799241912,2404cyclictest351198-21kworker/0:0+events22:00:110
30063799241811,2403cyclictest324317-21kworker/0:1+events20:22:150
30064599241712,2402cyclictest332863-21kworker/2:2+events20:49:182
30064799241312,2398cyclictest390207-21kworker/3:0+events23:56:043
30064799241312,2397cyclictest370597-21kworker/3:0+events23:17:263
30063799241012,2394cyclictest379973-21kworker/0:1+events23:12:480
3006409924067,2395cyclictest296909-21kworker/1:1+events19:27:351
30064599240511,2391cyclictest381851-21kworker/2:1+events23:30:162
3006479924049,2391cyclictest334642-21kworker/3:0+events20:52:213
30063799240211,2387cyclictest389753-21kworker/0:0+events23:46:090
30063799240112,2386cyclictest303657-21kworker/0:2+events19:39:250
30064099240010,2387cyclictest400971-21kworker/1:0+events00:28:221
30064099239912,2383cyclictest402604-21kworker/1:1+events00:38:141
30064099239910,2386cyclictest344399-21kworker/1:0+events21:24:311
30063799239912,2383cyclictest388040-21kworker/0:1+events23:42:200
30063799239912,2383cyclictest325960-21kworker/0:0+events20:37:080
30064099239812,2382cyclictest311932-21kworker/1:1+events19:54:091
30063799239812,2383cyclictest313352-21kworker/0:1+events19:53:220
30064099239712,2381cyclictest392655-21kworker/1:1+events23:51:301
30064099239712,2381cyclictest322903-21kworker/1:1+events20:25:181
30063799239712,2381cyclictest358866-21kworker/0:1+events22:16:060
30063799239711,2382cyclictest344372-21kworker/0:1+events21:23:220
3006409923959,2383cyclictest387920-21kworker/1:2+events00:00:371
30064099239512,2379cyclictest352528-21kworker/1:2+events21:46:521
30064099239511,2381cyclictest357494-21kworker/1:2+events22:08:311
30064099239510,2381cyclictest315200-21kworker/1:2+events19:56:051
30063799239512,2379cyclictest394292-21kworker/0:2+events23:58:250
30064099239412,2380cyclictest339575-21kworker/1:2+events21:16:081
30063799239412,2379cyclictest319877-21kworker/0:2+events20:17:430
30064099239211,2378cyclictest359095-21kworker/1:1+events22:30:371
30064099239211,2377cyclictest374078-21kworker/1:1+events22:59:561
30064799239111,2378cyclictest370597-21kworker/3:0+events22:50:053
30064099239112,2376cyclictest331546-21kworker/1:1+events20:48:071
30063799238610,2372cyclictest372353-21kworker/0:2+events22:52:400
30064599238410,2370cyclictest367485-21kworker/2:0+events22:57:372
30063799238412,2369cyclictest358866-21kworker/0:1+events22:13:260
30064099238311,2369cyclictest311932-21kworker/1:1+events19:45:281
30063799238112,2366cyclictest303657-21kworker/0:2+events19:42:260
30064799237911,2365cyclictest319606-21kworker/3:2+events20:17:203
30064799237811,2364cyclictest384985-21kworker/3:0+events23:33:163
30064799237612,2360cyclictest308832-21kworker/3:2+events19:48:043
30063799236610,2353cyclictest365911-21kworker/0:2+events22:29:070
30064799236411,2350cyclictest324493-21kworker/3:0+events20:38:403
30063799236411,2349cyclictest389753-21kworker/0:0+events00:01:430
30064799236110,2347cyclictest402575-21kworker/3:2+events00:36:233
30064799236011,2346cyclictest380016-21kworker/3:2+events23:12:263
3006479923529,2339cyclictest402575-21kworker/3:2+events00:33:213
30064799235212,2336cyclictest370597-21kworker/3:0+events22:45:293
30064799235112,2336cyclictest329913-21kworker/3:2+events20:55:493
30064799235010,2337cyclictest381703-21kworker/3:1+events23:26:063
30064099235010,2336cyclictest310282-21kworker/1:2+events19:43:571
3006409923489,2336cyclictest380301-21kworker/1:0+events23:33:411
30064799234712,2332cyclictest386637-21kworker/3:1+events23:48:263
30064099234510,2331cyclictest331546-21kworker/1:1+events20:51:111
30064799234412,2328cyclictest337998-21kworker/3:2+events21:07:463
30064799234212,2327cyclictest370597-21kworker/3:0+events23:21:373
30064099234211,2329cyclictest322903-21kworker/1:1+events20:35:131
30064799234011,2326cyclictest400910-21kworker/3:1+events00:22:143
30064799233812,2323cyclictest308832-21kworker/3:2+events19:38:393
30064799233612,2321cyclictest349257-21kworker/3:1+events21:43:513
30064799233612,2321cyclictest349257-21kworker/3:1+events21:43:513
30064799233512,2320cyclictest307169-21kworker/3:0+events19:30:593
30064799233510,2322cyclictest359184-21kworker/3:2+events22:33:163
30064599233011,2316cyclictest358975-21kworker/2:0+events22:17:382
30064799232412,2308cyclictest308832-21kworker/3:2+events19:42:033
30064799232410,2311cyclictest324493-21kworker/3:0+events20:29:033
30064799232312,2308cyclictest337998-21kworker/3:2+events21:13:293
30064599232311,2309cyclictest376994-21kworker/2:2+events23:03:422
30064099232311,2308cyclictest339575-21kworker/1:2+events21:25:581
30063799232210,2309cyclictest331326-21kworker/0:1+events20:46:130
30064599231310,2300cyclictest313232-21kworker/2:2+events19:47:192
30064099231312,2297cyclictest352528-21kworker/1:2+events21:51:011
30064799231112,2296cyclictest322811-21kworker/3:1+events20:24:323
30063799231111,2296cyclictest334760-21kworker/0:1+events21:02:430
30063799231110,2298cyclictest373980-21kworker/0:0+events23:06:220
30064799230511,2290cyclictest308832-21kworker/3:2+events19:53:463
30064799230111,2287cyclictest383383-21kworker/3:2+events23:36:413
30064799229911,2284cyclictest319606-21kworker/3:2+events20:12:033
30063799229712,2281cyclictest318273-21kworker/0:1+events20:07:270
30064099229311,2279cyclictest319544-21kworker/1:2+events20:09:441
3006409922887,2278cyclictest363923-21kworker/1:2+events22:51:561
30064099228210,2269cyclictest380301-21kworker/1:0+events23:43:081
30064799227811,2264cyclictest359184-21kworker/3:2+events22:19:353
30064099227711,2262cyclictest321182-21kworker/1:0+events20:12:491
30064099227112,2256cyclictest387920-21kworker/1:2+events00:18:501
30063799227111,2257cyclictest389753-21kworker/0:0+events23:50:200
3006479922589,2246cyclictest373944-21kworker/3:1+events22:56:113
30063799225411,2239cyclictest402533-21kworker/0:0+events00:24:320
30064799225110,2238cyclictest332742-21kworker/3:1+events20:48:303
30064099224712,2231cyclictest317943-21kworker/1:1+events20:01:471
30064099224712,2231cyclictest317943-21kworker/1:1+events20:01:471
30064599224010,2227cyclictest344339-21kworker/2:0+events21:35:512
30064599223810,2225cyclictest358975-21kworker/2:0+events22:22:132
30064799223710,2224cyclictest349257-21kworker/3:1+events21:48:473
3006459922379,2225cyclictest388245-21kworker/2:2+events00:10:262
30064599223510,2222cyclictest334732-21kworker/2:0+events21:09:172
30064599223510,2221cyclictest370774-21kworker/2:1+events22:47:492
3006459922338,2221cyclictest332863-21kworker/2:2+events20:52:442
30064599223311,2218cyclictest388245-21kworker/2:2+events23:59:292
30064599223311,2218cyclictest341237-21kworker/2:1+events21:20:422
30064599223310,2220cyclictest392808-21kworker/2:0+events23:53:472
30064599223211,2217cyclictest346027-21kworker/2:2+events21:46:052
30064599223210,2219cyclictest334732-21kworker/2:0+events21:13:532
30064599223010,2216cyclictest331265-21kworker/2:1+events20:43:342
30063799223011,2217cyclictest332912-21kworker/0:2+events20:50:040
30064599222810,2214cyclictest308685-21kworker/2:0+events19:35:132
30063799222812,2214cyclictest389753-21kworker/0:0+events00:15:050
30064599222711,2213cyclictest357329-21kworker/2:2+events22:02:042
30064599222610,2213cyclictest346027-21kworker/2:2+events21:34:212
30064599222610,2213cyclictest325859-21kworker/2:2+events20:34:042
30064599222511,2211cyclictest367485-21kworker/2:0+events22:41:402
30064599222311,2210cyclictest341237-21kworker/2:1+events21:25:382
30064099222310,2210cyclictest308575-21kworker/1:0+events19:33:421
30064599221811,2204cyclictest360608-21kworker/2:1+events22:27:362
30064099221811,2203cyclictest336214-21kworker/1:2+events20:59:151
30064799221012,2195cyclictest354171-21kworker/3:2+events22:00:563
30063799221011,2196cyclictest316587-21kworker/0:0+events20:04:500
30063799221011,2196cyclictest316587-21kworker/0:0+events20:04:500
30064099220911,2196cyclictest394286-21kworker/1:0+events00:10:031
3006409922089,2195cyclictest337936-21kworker/1:1+events21:04:421
3006379922089,2196cyclictest351198-21kworker/0:0+events21:49:080
3006379922089,2195cyclictest313352-21kworker/0:1+events19:57:560
30064799220610,2192cyclictest396284-21kworker/3:0+events00:18:273
30063799220611,2192cyclictest367496-21kworker/0:1+events22:36:430
30063799220410,2190cyclictest402533-21kworker/0:0+events00:33:430
30064599220311,2189cyclictest318153-21kworker/2:0+events20:16:132
3006409922036,2194cyclictest354130-21kworker/1:0+events22:03:141
30064099220311,2188cyclictest380301-21kworker/1:0+events23:48:471
30064599220111,2187cyclictest318153-21kworker/2:0+events20:08:372
3006379922019,2189cyclictest358866-21kworker/0:1+events22:20:430
3006379922018,2190cyclictest344372-21kworker/0:1+events21:42:430
3006379922018,2190cyclictest344372-21kworker/0:1+events21:42:420
30064599220010,2186cyclictest389946-21kworker/2:1+events23:49:332
30064099220011,2186cyclictest339575-21kworker/1:2+events21:09:411
30063799220011,2186cyclictest365911-21kworker/0:2+events22:32:070
30063799220011,2185cyclictest402533-21kworker/0:0+events00:26:500
30063799220011,2185cyclictest367496-21kworker/0:1+events22:44:450
30064099219911,2185cyclictest359095-21kworker/1:1+events22:24:101
30064099219911,2185cyclictest337936-21kworker/1:1+events21:14:141
30064099219910,2185cyclictest394286-21kworker/1:0+events00:08:341
30064099219910,2185cyclictest339575-21kworker/1:2+events21:37:471
30063799219911,2185cyclictest379973-21kworker/0:1+events23:21:130
30063799219911,2185cyclictest306871-21kworker/0:0+events19:30:360
30063799219911,2184cyclictest325960-21kworker/0:0+events20:56:590
30063799219911,2184cyclictest305282-21kworker/0:1+events19:23:420
3006409921984,2190cyclictest387920-21kworker/1:2+events23:39:421
3006379921989,2186cyclictest389753-21kworker/0:0+events00:11:120
3006379921989,2186cyclictest327812-21kworker/0:2+events20:33:170
30063799219810,2185cyclictest334760-21kworker/0:1+events21:05:270
3006409921977,2186cyclictest400971-21kworker/1:0+events00:32:111
30064099219710,2184cyclictest296909-21kworker/1:1+events19:20:391
3006379921979,2185cyclictest351198-21kworker/0:0+events21:54:260
30063799219711,2183cyclictest324317-21kworker/0:1+events20:26:030
30063799219711,2183cyclictest313352-21kworker/0:1+events19:48:270
3006409921968,2184cyclictest387920-21kworker/1:2+events23:56:281
30064099219611,2182cyclictest380301-21kworker/1:0+events23:22:201
30064099219610,2182cyclictest357494-21kworker/1:2+events22:13:031
30063799219611,2181cyclictest372353-21kworker/0:2+events22:56:310
30064099219511,2181cyclictest376961-21kworker/1:2+events23:11:411
30064099219510,2181cyclictest329558-21kworker/1:0+events20:41:191
3006379921958,2183cyclictest341757-21kworker/0:2+events21:18:520
30063799219511,2181cyclictest356295-21kworker/0:2+events22:06:160
30064099219410,2181cyclictest372347-21kworker/1:0+events23:02:321
30063799218910,2176cyclictest386406-21kworker/0:2+events23:34:030
3006479921889,2176cyclictest396284-21kworker/3:0+events00:11:593
3006409921889,2176cyclictest355856-21kworker/1:1+events21:59:001
30064099218613,2170cyclictest322903-21kworker/1:1+events20:19:361
30064599218110,2168cyclictest325859-21kworker/2:2+events20:27:552
30064099218011,2165cyclictest308575-21kworker/1:0+events19:39:011
3006379921808,2169cyclictest318273-21kworker/0:1+events20:14:190
3006409921799,2167cyclictest363923-21kworker/1:2+events22:38:591
3006409921777,2166cyclictest339575-21kworker/1:2+events21:32:491
30064799217011,2155cyclictest324493-21kworker/3:0+events20:32:533
30064599216211,2148cyclictest318153-21kworker/2:0+events20:20:222
30064799216111,2147cyclictest402575-21kworker/3:2+events00:27:573
30064799216111,2147cyclictest364225-21kworker/3:0+events22:27:133
30064799215911,2144cyclictest300229-21kworker/3:1+events19:26:253
30064799215610,2142cyclictest342868-21kworker/3:1+events21:21:503
30064799215511,2141cyclictest368907-21kworker/3:1+events22:37:083
30064799215411,2140cyclictest349257-21kworker/3:1+events21:37:013
30064799215410,2140cyclictest349257-21kworker/3:1+events21:55:553
30064799215311,2139cyclictest362596-21kworker/3:1+events22:21:523
30064799215310,2140cyclictest340908-21kworker/3:0+events21:26:443
30064799215211,2137cyclictest349257-21kworker/3:1+events21:52:333
30064799215011,2136cyclictest342868-21kworker/3:1+events21:18:043
30064799214610,2133cyclictest308832-21kworker/3:2+events19:55:423
30064799214111,2127cyclictest349257-21kworker/3:1+events22:08:523
30064799214011,2126cyclictest315016-21kworker/3:1+events20:09:003
30064799214011,2126cyclictest315016-21kworker/3:1+events20:03:413
30064799214011,2126cyclictest315016-21kworker/3:1+events20:03:413
30064799214011,2125cyclictest301899-21kworker/3:0+events19:19:523
30063799213911,2125cyclictest381578-21kworker/0:0+events23:16:380
3006479921388,2127cyclictest300229-21kworker/3:1+events19:21:033
30064799213611,2122cyclictest301899-21kworker/3:0+events19:14:063
30064799213110,2118cyclictest370597-21kworker/3:0+events22:43:363
30064599213011,2116cyclictest319758-21kworker/2:1+events20:12:262
3006409921259,2113cyclictest380301-21kworker/1:0+events23:29:531
3006379921206,2111cyclictest303657-21kworker/0:2+events19:16:250
3006459921197,2109cyclictest378577-21kworker/2:0+events23:19:192
30064799211311,2099cyclictest359184-21kworker/3:2+events22:10:503
3006459921128,2101cyclictest398545-21kworker/2:0+events00:15:252
30064599210011,2086cyclictest313232-21kworker/2:2+events19:57:332
3006379920939,2081cyclictest303657-21kworker/0:2+events19:26:010
30064599208910,2076cyclictest303818-21kworker/2:1+events19:28:182
3006459920889,2076cyclictest353672-21kworker/2:0+events21:56:192
3006459920806,2071cyclictest303818-21kworker/2:1+events19:41:192
30064599207810,2064cyclictest298763-21kworker/2:2+events19:14:522
3006459920774,2070cyclictest332863-21kworker/2:2+events20:55:032
3006459920768,2065cyclictest394527-21kworker/2:1+events00:05:332
30064599207510,2061cyclictest303818-21kworker/2:1+events19:20:162
3006459920749,2062cyclictest378577-21kworker/2:0+events23:13:122
3006459920717,2061cyclictest300702-21kworker/2:0+events19:17:342
30063799207010,2057cyclictest300487-21kworker/0:0+events19:13:430
3006459920648,2053cyclictest303818-21kworker/2:1+events19:34:052
30064099205510,2041cyclictest372347-21kworker/1:0+events22:49:441
3006379920496,2040cyclictest396717-21kworker/0:1+events00:08:570
3006379920365,2028cyclictest339661-21kworker/0:0+events21:12:430
3006409920319,2019cyclictest376961-21kworker/1:2+events23:08:381
3006479920007,1990cyclictest396284-21kworker/3:0+events00:05:573
30064799198710,1973cyclictest390207-21kworker/3:0+events23:51:063
30064099196410,1951cyclictest300214-21kworker/1:0+events19:11:481
2990372151103,28sleep00-21swapper/019:05:050
3001402148112,31sleep10-21swapper/119:07:071
3002212144114,24sleep30-21swapper/319:08:093
3000962142111,26sleep20-21swapper/219:06:312
300645998380,2cyclictest385346-21kworker/2:0+pm23:39:542
300645991912,5cyclictest351336-21true21:45:012
300645991912,5cyclictest351336-21true21:45:002
30064599158,5cyclictest395673-21ld00:00:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional