You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 02:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Wed Sep 17, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31419399298615,2967cyclictest372544-21kworker/0:1+events22:15:190
31419799295414,2937cyclictest356040-21kworker/1:0+events21:20:211
31420299282514,2807cyclictest409086-21kworker/2:0+events00:20:222
31419399272513,2708cyclictest397993-21kworker/0:2+events00:07:130
31419399269812,2683cyclictest380351-21kworker/0:0+events22:40:210
31419399267913,2662cyclictest338162-21kworker/0:1+events20:30:130
31419399266313,2647cyclictest327040-21kworker/0:0+events19:50:000
31420699265613,2640cyclictest388780-21kworker/3:1+events23:10:223
31419399262313,2605cyclictest410743-21kworker/0:0+events00:20:000
31420699256912,2553cyclictest417387-21kworker/3:1+events00:34:573
31420299256411,2550cyclictest346211-21kworker/2:0+events21:19:592
31420299256312,2549cyclictest365537-21kworker/2:1+events21:50:132
31420299256212,2548cyclictest378782-21kworker/2:0+events22:51:232
3142029925519,2539cyclictest402644-21kworker/2:0+events23:54:552
31420299254612,2530cyclictest404278-21kworker/2:1+events00:16:552
31419799254212,2526cyclictest404816-21kworker/1:0+events23:59:531
31419799253112,2517cyclictest354398-21kworker/1:2+events21:25:201
31419799252912,2514cyclictest382002-21kworker/1:1+events22:48:191
31419799252912,2513cyclictest308986-21kworker/1:0+events19:15:201
31419799252812,2514cyclictest351188-21kworker/1:1+events21:06:401
31420299252612,2510cyclictest404278-21kworker/2:1+events00:04:052
31420299252111,2508cyclictest346211-21kworker/2:0+events20:55:552
31420299251612,2501cyclictest341185-21kworker/2:0+events20:34:192
3141979925098,2497cyclictest338037-21kworker/1:1+events20:44:081
31419799250812,2492cyclictest394903-21kworker/1:1+events23:28:151
31419799250512,2489cyclictest382002-21kworker/1:1+events23:03:341
31419799249712,2482cyclictest417360-21kworker/1:2+events00:37:171
31420299249512,2477cyclictest363841-21kworker/2:0+events21:43:182
31420299249212,2476cyclictest359363-21kworker/2:2+events21:32:572
31420299249112,2476cyclictest404278-21kworker/2:1+events00:06:482
31420299249112,2475cyclictest386607-21kworker/2:1+events23:19:102
31420299249012,2476cyclictest359363-21kworker/2:2+events22:00:012
31419799248812,2473cyclictest354398-21kworker/1:2+events21:14:141
31420299248712,2471cyclictest399880-21kworker/2:1+events23:43:282
31420299248612,2470cyclictest320665-21kworker/2:2+events19:29:542
31420699248411,2469cyclictest414190-21kworker/3:2+events00:25:453
31420699248411,2469cyclictest414190-21kworker/3:2+events00:25:453
31420299248412,2469cyclictest331740-21kworker/2:2+events20:09:312
31420299248412,2469cyclictest322270-21kworker/2:0+events19:35:112
31420699248311,2468cyclictest347759-21kworker/3:1+events20:53:403
3142029924828,2472cyclictest396441-21kworker/2:1+events23:30:112
3142029924819,2468cyclictest346211-21kworker/2:0+events20:50:142
31420299247812,2462cyclictest328375-21kworker/2:0+events19:56:562
31420299246912,2455cyclictest351342-21kworker/2:1+events21:05:082
31420299246510,2452cyclictest323932-21kworker/2:1+events19:45:492
31419799245712,2441cyclictest331558-21kworker/1:2+events20:01:571
31419399245712,2440cyclictest352768-21kworker/0:1+events21:35:170
31420299245612,2441cyclictest372389-21kworker/2:0+events22:20:342
31419799245212,2437cyclictest412479-21kworker/1:0+events00:16:321
31420299244912,2433cyclictest378782-21kworker/2:0+events22:45:172
31419799244912,2433cyclictest322175-21kworker/1:1+events19:59:391
3141979924469,2434cyclictest336396-21kworker/1:0+events20:20:251
31419799244612,2432cyclictest368787-21kworker/1:2+events22:05:201
31419399244611,2432cyclictest374464-21kworker/0:2+events22:20:590
31419399244512,2430cyclictest390286-21kworker/0:0+events23:15:200
3141979924429,2429cyclictest386848-21kworker/1:2+events23:18:461
31419799244212,2426cyclictest382002-21kworker/1:1+events22:59:471
31419799244212,2426cyclictest356040-21kworker/1:0+events21:42:321
31419799244210,2429cyclictest338037-21kworker/1:1+events20:39:351
31419799244210,2428cyclictest415749-21kworker/1:0+events00:30:471
31419799244112,2426cyclictest356040-21kworker/1:0+events21:34:541
31419799243910,2426cyclictest334762-21kworker/1:2+events20:12:561
31419799243812,2422cyclictest394903-21kworker/1:1+events23:34:461
31419799243812,2422cyclictest320482-21kworker/1:2+events19:35:341
31419799243612,2421cyclictest408995-21kworker/1:1+events00:29:361
31419799243612,2421cyclictest408995-21kworker/1:1+events00:29:351
31419799243612,2421cyclictest375460-21kworker/1:0+events22:29:041
31419399243512,2419cyclictest352768-21kworker/0:1+events21:30:180
31420699243112,2416cyclictest360894-21kworker/3:0+events21:40:153
31419399243011,2415cyclictest344227-21kworker/0:0+events20:49:050
31419799242912,2412cyclictest386848-21kworker/1:2+events23:09:151
31419799242811,2414cyclictest360754-21kworker/1:1+events21:35:391
31419799242711,2413cyclictest339615-21kworker/1:0+events20:29:491
31420299242612,2411cyclictest398052-21kworker/2:2+events23:45:432
31419799242412,2409cyclictest370662-21kworker/1:1+events22:24:501
31419399241612,2401cyclictest357725-21kworker/0:2+events21:53:130
31419399241611,2402cyclictest318876-21kworker/0:0+events19:30:170
31420299241512,2400cyclictest339552-21kworker/2:1+events20:49:522
31419399241111,2396cyclictest313777-21kworker/0:1+events19:21:050
31420299241012,2394cyclictest378782-21kworker/2:0+events22:43:002
31419799240712,2391cyclictest346031-21kworker/1:2+events20:50:361
31420299240611,2391cyclictest317400-21kworker/2:1+events19:18:472
31420299240312,2388cyclictest323932-21kworker/2:1+events19:43:542
31420699240210,2389cyclictest346089-21kworker/3:0+events20:47:103
31420699239912,2384cyclictest322001-21kworker/3:0+events19:34:263
31420699239812,2382cyclictest349714-21kworker/3:0+events21:03:133
31420699239810,2384cyclictest370123-21kworker/3:0+events22:41:053
3142069923969,2384cyclictest365415-21kworker/3:1+events21:56:123
31420699239611,2382cyclictest396750-21kworker/3:2+events23:38:343
31419799239611,2382cyclictest377049-21kworker/1:2+events22:38:501
31420699239512,2379cyclictest370811-21kworker/3:1+events22:08:013
31420699239512,2379cyclictest360894-21kworker/3:0+events21:47:093
31420699239511,2381cyclictest396750-21kworker/3:2+events23:31:423
31420699239412,2379cyclictest334998-21kworker/3:0+events20:36:553
31420699239311,2378cyclictest370123-21kworker/3:0+events22:33:363
31419799239311,2379cyclictest402975-21kworker/1:2+events00:05:391
31420699239011,2376cyclictest370123-21kworker/3:0+events22:17:323
31419399239012,2374cyclictest323724-21kworker/0:0+events19:38:140
3141979923878,2376cyclictest336396-21kworker/1:0+events20:18:551
31420699238312,2367cyclictest334998-21kworker/3:0+events20:17:043
31420699238112,2366cyclictest406255-21kworker/3:3+events00:02:323
31420699237612,2360cyclictest334998-21kworker/3:0+events20:29:043
31420699237412,2359cyclictest359119-21kworker/3:1+events21:36:263
3142029923749,2361cyclictest386607-21kworker/2:1+events23:07:412
31420699237312,2358cyclictest370123-21kworker/3:0+events22:04:573
31420699236410,2351cyclictest409288-21kworker/3:1+events00:17:173
31419399236412,2348cyclictest417509-21kworker/0:2+events00:39:350
31419399236011,2346cyclictest397993-21kworker/0:2+events00:11:030
3142069923564,2348cyclictest319087-21kworker/3:2+events19:42:223
31419399235612,2340cyclictest338162-21kworker/0:1+events20:27:370
31420299235512,2340cyclictest337893-21kworker/2:0+events20:23:022
31420699235210,2338cyclictest328439-21kworker/3:2+events20:12:123
31419399235010,2337cyclictest385122-21kworker/0:0+events22:54:250
31419399234312,2327cyclictest315768-21kworker/0:3+events19:18:250
31419399234311,2326cyclictest394755-21kworker/0:2+events23:25:330
31419399234112,2326cyclictest370906-21kworker/0:0+events22:09:570
31419399234012,2325cyclictest383395-21kworker/0:1+events22:56:220
31419399234011,2325cyclictest401221-21kworker/0:0+events23:45:210
31419399233912,2324cyclictest339832-21kworker/0:2+events20:41:060
31419399233912,2323cyclictest374464-21kworker/0:2+events22:48:420
31419399233910,2326cyclictest334825-21kworker/0:0+events20:24:340
31420299233812,2322cyclictest359363-21kworker/2:2+events22:12:142
31419399233712,2323cyclictest386815-21kworker/0:2+events23:05:040
31419399233711,2322cyclictest347907-21kworker/0:2+events21:05:540
31419399233612,2321cyclictest377140-21kworker/0:0+events22:31:430
31419399233512,2320cyclictest415904-21kworker/0:0+events00:34:330
3142029923309,2318cyclictest320665-21kworker/2:2+events19:34:022
31420299233012,2315cyclictest349668-21kworker/2:2+events21:00:532
3141979923299,2317cyclictest367198-21kworker/1:1+events21:55:481
31419399232512,2310cyclictest368583-21kworker/0:1+events21:58:530
31419399232511,2311cyclictest357725-21kworker/0:2+events21:25:410
31419399232111,2307cyclictest370906-21kworker/0:0+events22:11:520
3141979923159,2303cyclictest386848-21kworker/1:2+events23:14:131
31420299231412,2299cyclictest386607-21kworker/2:1+events23:14:592
3141979923139,2300cyclictest333152-21kworker/1:1+events20:06:321
31419799231011,2296cyclictest377049-21kworker/1:2+events22:33:591
31420299230812,2292cyclictest346211-21kworker/2:0+events21:24:112
31419399230812,2293cyclictest352768-21kworker/0:1+events21:16:310
31420299230513,2289cyclictest339552-21kworker/2:1+events20:43:022
31419399228412,2269cyclictest356096-21kworker/0:0+events21:24:330
31419399228210,2268cyclictest410743-21kworker/0:0+events00:23:040
31420699227911,2265cyclictest388780-21kworker/3:1+events23:06:343
31420299227710,2264cyclictest333399-21kworker/2:0+events20:10:392
31420699227612,2261cyclictest393339-21kworker/3:0+events23:19:563
31419799227412,2258cyclictest322175-21kworker/1:1+events19:53:061
31420299227110,2257cyclictest388522-21kworker/2:2+events23:03:552
31420299227011,2255cyclictest328375-21kworker/2:0+events19:52:432
31419799226912,2253cyclictest398175-21kworker/1:2+events23:40:501
3142029922689,2256cyclictest359363-21kworker/2:2+events21:36:492
31420299226610,2253cyclictest391879-21kworker/2:0+events23:21:262
31419799226512,2249cyclictest408995-21kworker/1:1+events00:24:141
31420299226410,2251cyclictest404278-21kworker/2:1+events00:11:502
31420299226310,2249cyclictest359363-21kworker/2:2+events21:48:402
31420299226110,2248cyclictest339552-21kworker/2:1+events20:28:432
31420299226011,2246cyclictest372389-21kworker/2:0+events22:18:422
31420299226010,2247cyclictest404278-21kworker/2:1+events00:35:212
31420299226010,2247cyclictest378782-21kworker/2:0+events22:34:452
31420299225910,2245cyclictest404278-21kworker/2:1+events00:31:562
31420299225810,2244cyclictest346211-21kworker/2:0+events21:26:512
31420299225711,2244cyclictest378782-21kworker/2:0+events22:38:052
31419799225512,2239cyclictest356040-21kworker/1:0+events21:54:421
31419799225412,2238cyclictest342898-21kworker/1:0+events20:49:291
31419799225411,2237cyclictest322175-21kworker/1:1+events19:48:061
3142029922459,2232cyclictest375745-21kworker/2:2+events22:26:452
31420299224510,2232cyclictest391879-21kworker/2:0+events23:27:292
31420299224510,2232cyclictest368801-21kworker/2:1+events22:06:522
3141939922459,2232cyclictest352768-21kworker/0:1+events21:13:510
31419399224411,2230cyclictest346304-21kworker/0:1+events20:56:420
31419799224210,2228cyclictest354398-21kworker/1:2+events21:18:531
31420299223810,2225cyclictest346211-21kworker/2:0+events21:12:202
31420299223810,2225cyclictest328375-21kworker/2:0+events20:00:502
31419799223810,2224cyclictest394903-21kworker/1:1+events23:51:511
31420299223510,2221cyclictest378782-21kworker/2:0+events22:58:372
31419799223410,2221cyclictest402975-21kworker/1:2+events00:03:411
31420699223312,2218cyclictest341307-21kworker/3:1+events20:43:463
31419799223211,2218cyclictest402975-21kworker/1:2+events00:14:351
31419799223211,2217cyclictest401370-21kworker/1:0+events23:46:501
3141979922279,2215cyclictest308986-21kworker/1:0+events19:22:581
31419799222710,2214cyclictest377049-21kworker/1:2+events22:44:531
31419799222510,2212cyclictest370662-21kworker/1:1+events22:14:331
3141979922248,2213cyclictest314005-21kworker/1:2+events19:14:561
31419799221811,2204cyclictest322175-21kworker/1:1+events19:44:181
3141979922178,2206cyclictest320482-21kworker/1:2+events19:27:361
31419799221511,2201cyclictest377049-21kworker/1:2+events22:50:151
31420299220411,2190cyclictest317400-21kworker/2:1+events19:22:342
31420699220310,2190cyclictest334998-21kworker/3:0+events20:34:413
31419799220110,2188cyclictest363981-21kworker/1:1+events21:46:481
31420699220010,2186cyclictest323602-21kworker/3:1+events19:46:343
3141979922009,2188cyclictest349542-21kworker/1:2+events21:00:301
3142069921999,2186cyclictest406255-21kworker/3:3+events00:09:093
3141979921998,2187cyclictest394903-21kworker/1:1+events23:38:101
31420699219811,2183cyclictest359119-21kworker/3:1+events21:29:113
31420699219810,2185cyclictest401189-21kworker/3:1+events23:54:333
31420699219810,2185cyclictest315280-21kworker/3:0+events19:16:533
31420699219611,2182cyclictest386635-21kworker/3:2+events23:00:323
31420699219611,2182cyclictest351374-21kworker/3:1+events21:10:273
31420699219611,2182cyclictest343058-21kworker/3:2+events21:09:193
31420699219611,2181cyclictest334998-21kworker/3:0+events20:21:323
3142069921949,2181cyclictest375502-21kworker/3:1+events22:23:393
31419399218811,2173cyclictest334825-21kworker/0:0+events20:19:170
31420699218710,2174cyclictest315280-21kworker/3:0+events19:21:273
31420699218511,2171cyclictest383367-21kworker/3:1+events22:54:493
31419799218410,2171cyclictest356040-21kworker/1:0+events22:01:101
31420299218110,2168cyclictest359363-21kworker/2:2+events21:56:332
31419799218010,2167cyclictest338037-21kworker/1:1+events20:30:341
31420699217511,2161cyclictest328439-21kworker/3:2+events19:53:533
31420699217510,2162cyclictest323602-21kworker/3:1+events19:37:063
31419399217510,2161cyclictest366904-21kworker/0:0+events22:01:540
31420699217411,2159cyclictest409288-21kworker/3:1+events00:22:423
31420699217410,2160cyclictest343058-21kworker/3:2+events21:31:023
31420699217311,2160cyclictest375502-21kworker/3:1+events22:35:053
3142069921728,2161cyclictest384968-21kworker/3:0+events22:57:093
31420699217211,2157cyclictest402886-21kworker/3:0+events23:56:053
3142069921718,2160cyclictest328439-21kworker/3:2+events20:03:513
31420699217110,2158cyclictest375502-21kworker/3:1+events22:26:213
31420699217011,2156cyclictest393339-21kworker/3:0+events23:28:373
31420699216910,2155cyclictest380498-21kworker/3:2+events22:47:103
3142069921659,2153cyclictest401189-21kworker/3:1+events23:48:463
31420299216311,2149cyclictest391879-21kworker/2:0+events23:35:532
31420699215711,2143cyclictest418983-21kworker/3:2+events00:39:133
31419399215510,2142cyclictest363722-21kworker/0:0+events21:41:250
31419399215211,2137cyclictest390286-21kworker/0:0+events23:32:060
31419399214211,2127cyclictest386815-21kworker/0:2+events23:00:110
31419399214110,2127cyclictest320514-21kworker/0:2+events20:02:420
31419399214011,2126cyclictest386815-21kworker/0:2+events23:14:340
31419399214010,2126cyclictest414286-21kworker/0:1+events00:29:130
31419399214010,2126cyclictest414286-21kworker/0:1+events00:29:120
31419799213911,2125cyclictest370662-21kworker/1:1+events22:16:241
31419399213911,2125cyclictest397993-21kworker/0:2+events00:01:240
31419399213911,2125cyclictest338162-21kworker/0:1+events20:39:580
31419399213911,2124cyclictest320514-21kworker/0:2+events20:06:550
3142029921388,2126cyclictest404278-21kworker/2:1+events00:25:232
3142029921388,2126cyclictest404278-21kworker/2:1+events00:25:232
31419399213810,2124cyclictest390286-21kworker/0:0+events23:24:240
31419399213311,2119cyclictest397993-21kworker/0:2+events23:35:320
31419399213111,2117cyclictest365310-21kworker/0:1+events21:46:240
31419399213110,2118cyclictest323724-21kworker/0:0+events19:41:350
31419399212811,2114cyclictest377140-21kworker/0:0+events22:28:160
31419399212411,2110cyclictest401221-21kworker/0:0+events23:44:140
31419399211811,2104cyclictest397993-21kworker/0:2+events23:56:280
3142069921178,2106cyclictest409288-21kworker/3:1+events00:12:133
3142069921169,2104cyclictest343058-21kworker/3:2+events20:58:593
3142029921169,2103cyclictest331740-21kworker/2:2+events20:17:502
31419399211611,2102cyclictest374464-21kworker/0:2+events22:39:130
31419399211411,2100cyclictest346304-21kworker/0:1+events20:54:260
31419399211411,2100cyclictest320514-21kworker/0:2+events20:11:260
3142069921105,2102cyclictest393339-21kworker/3:0+events23:24:013
31420699210711,2093cyclictest396750-21kworker/3:2+events23:42:193
31419399210611,2092cyclictest328655-21kworker/0:1+events19:58:520
31420299210510,2091cyclictest313662-21kworker/2:2+events19:10:172
31419799207810,2065cyclictest342898-21kworker/1:0+events20:55:331
31419799207210,2059cyclictest386848-21kworker/1:2+events23:22:551
3141979920693,2063cyclictest322175-21kworker/1:1+events19:34:491
31420699204810,2035cyclictest317334-21kworker/3:1+events19:25:403
31419399204511,2031cyclictest327040-21kworker/0:0+events19:51:330
31419399204110,2028cyclictest318876-21kworker/0:0+events19:26:510
3142069920396,2030cyclictest328439-21kworker/3:2+events20:08:483
3142069920289,2017cyclictest323602-21kworker/3:1+events19:55:023
3142069920273,2021cyclictest355880-21kworker/3:0+events21:19:143
3142069920199,2007cyclictest360894-21kworker/3:0+events21:52:053
3142069920112,2005cyclictest300046-21kworker/3:2+events19:14:353
3142069920026,1993cyclictest370811-21kworker/3:1+events22:10:443
31419399198410,1971cyclictest312132-21kworker/0:0+events19:12:130
31419399197010,1957cyclictest347907-21kworker/0:2+events21:01:160
3138432146106,37sleep20-21swapper/219:08:402
3138742145110,30sleep30-21swapper/319:09:053
313939214498,41sleep10-21swapper/119:09:551
3136462141110,26sleep00-21swapper/019:06:140
31420299218,8cyclictest1615-21gsd-print-notif00:00:012
31420699170,15cyclictest357005-21ntpq21:20:193
31419399169,5cyclictest798-21runrttasks23:52:240
31420299140,4cyclictest342913-21seq20:39:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional