You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 18:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Dec 11, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44660999325915,3240cyclictest453760-21kworker/3:2+events19:40:163
44659999272011,2705cyclictest463386-21kworker/0:1+events20:40:170
44659999272011,2705cyclictest463386-21kworker/0:1+events20:40:170
44659999269713,2682cyclictest488909-21kworker/0:1+events22:55:010
44660699257311,2560cyclictest508059-21kworker/2:1+events22:40:162
44660999253712,2523cyclictest529428-21kworker/3:1+events23:35:013
44660699253612,2521cyclictest543916-21kworker/2:0+events00:17:142
44660699250812,2492cyclictest545612-21kworker/2:2+events00:30:192
44660999249812,2482cyclictest461600-21kworker/3:1+events19:55:403
44660999249512,2480cyclictest497081-21kworker/3:1+events21:51:243
44660999248512,2470cyclictest489321-21kworker/3:2+events21:27:263
44659999248312,2468cyclictest534469-21kworker/0:1+events00:00:120
44660999246712,2452cyclictest477525-21kworker/3:0+events21:12:203
44659999246011,2446cyclictest471087-21kworker/0:0+events20:22:240
44660499245412,2438cyclictest492427-21kworker/1:2+events22:15:451
44660999244510,2432cyclictest471681-21kworker/3:2+events20:30:003
44660699244510,2431cyclictest461659-21kworker/2:0+events19:55:172
44660699243012,2415cyclictest540675-21kworker/2:0+events23:57:292
44660699242312,2407cyclictest539089-21kworker/2:1+events00:07:482
44660699242212,2406cyclictest487140-21kworker/2:2+events21:21:422
44660699242112,2406cyclictest479222-21kworker/2:2+events20:52:102
44660499241712,2400cyclictest482127-21kworker/1:0+events21:22:051
44660499240812,2393cyclictest512723-21kworker/1:2+events22:36:051
44660699240712,2392cyclictest495460-21kworker/2:1+events21:49:102
44660499240712,2391cyclictest550757-21kworker/1:2+events00:34:051
44660499240312,2387cyclictest521611-21kworker/1:0+events23:02:161
44660499240112,2384cyclictest492427-21kworker/1:2+events22:10:501
44660499239712,2382cyclictest550757-21kworker/1:2+events00:29:561
44660499238711,2373cyclictest479282-21kworker/1:2+events20:59:211
44660499238612,2371cyclictest466586-21kworker/1:2+events20:13:201
44660999238310,2370cyclictest451809-21kworker/3:0+events19:32:193
4466069923838,2373cyclictest534624-21kworker/2:1+events23:40:022
44660999238012,2364cyclictest545539-21kworker/3:2+events00:20:193
44660499236412,2350cyclictest455247-21kworker/1:2+events20:00:191
44660499236211,2347cyclictest483749-21kworker/1:1+events21:02:001
44659999236112,2347cyclictest477673-21kworker/0:2+events20:45:160
44660499235712,2342cyclictest503278-21kworker/1:1+events22:04:441
44660499235312,2338cyclictest525957-21kworker/1:0+events23:12:081
44660499235212,2336cyclictest492427-21kworker/1:2+events22:08:121
44660499235110,2338cyclictest455247-21kworker/1:2+events19:48:071
44659999235110,2338cyclictest550918-21kworker/0:1+events00:33:410
44660499234911,2335cyclictest468186-21kworker/1:1+events20:15:311
44660999234811,2334cyclictest524474-21kworker/3:2+events23:28:573
44660999234112,2326cyclictest453760-21kworker/3:2+events20:01:043
44660499232911,2314cyclictest514327-21kworker/1:0+events22:42:071
44660999232012,2304cyclictest497081-21kworker/3:1+events21:47:143
44660999231712,2301cyclictest524474-21kworker/3:2+events23:18:583
44660699228110,2267cyclictest472632-21kworker/2:1+events20:36:292
44660999227710,2264cyclictest477525-21kworker/3:0+events21:16:043
44659999227612,2261cyclictest519652-21kworker/0:2+events23:05:200
44660699227412,2259cyclictest490727-21kworker/2:0+events21:30:522
44660699227012,2255cyclictest472632-21kworker/2:1+events20:34:562
44660699226711,2253cyclictest453704-21kworker/2:2+events19:45:532
44660999226611,2252cyclictest450063-21kworker/3:1+events19:26:583
44660999225810,2245cyclictest464916-21kworker/3:1+events20:14:023
44660999225511,2240cyclictest509835-21kworker/3:1+events22:24:563
44660999225510,2243cyclictest493719-21kworker/3:1+events21:35:053
44660999225510,2242cyclictest534350-21kworker/3:2+events23:56:193
4466099922548,2243cyclictest450063-21kworker/3:1+events19:20:073
44660999225411,2239cyclictest513170-21kworker/3:1+events22:58:513
44660499225310,2237cyclictest549077-21kworker/1:0+events00:36:401
44659999225211,2238cyclictest536246-21kworker/0:2+events23:46:290
44660999225111,2237cyclictest506541-21kworker/3:1+events22:17:183
44660499225111,2237cyclictest512723-21kworker/1:2+events22:33:231
44659999224611,2231cyclictest509806-21kworker/0:0+events22:27:150
44660699223210,2218cyclictest446180-21kworker/2:2+events19:23:582
44660999223010,2216cyclictest474234-21kworker/3:1+events20:42:343
44660999223010,2216cyclictest474234-21kworker/3:1+events20:42:343
44660499223011,2215cyclictest544269-21kworker/1:0+events00:14:121
44660999222910,2216cyclictest453760-21kworker/3:2+events19:51:313
44660699222911,2214cyclictest453704-21kworker/2:2+events19:38:442
4466069922288,2217cyclictest504848-21kworker/2:2+events22:32:142
44660699222711,2212cyclictest539089-21kworker/2:1+events00:04:442
44660699222510,2211cyclictest508059-21kworker/2:1+events22:28:012
44660699222510,2211cyclictest468259-21kworker/2:2+events20:16:182
44660699222411,2210cyclictest529278-21kworker/2:1+events23:25:272
44660699222411,2210cyclictest498907-21kworker/2:2+events21:59:482
4466069922239,2211cyclictest527653-21kworker/2:0+events23:18:352
44660699222310,2210cyclictest545612-21kworker/2:2+events00:13:492
44660699222310,2210cyclictest472632-21kworker/2:1+events21:08:092
44659999222211,2208cyclictest488909-21kworker/0:1+events21:58:380
44660999222110,2208cyclictest477525-21kworker/3:0+events20:53:423
44660699222110,2208cyclictest516216-21kworker/2:2+events22:48:312
44660699221911,2205cyclictest501627-21kworker/2:1+events22:05:302
44660699221710,2203cyclictest531143-21kworker/2:2+events23:52:272
4466099922127,2201cyclictest504881-21kworker/3:0+events22:10:273
44660699221210,2199cyclictest464980-21kworker/2:0+events20:14:232
4465999922119,2199cyclictest463386-21kworker/0:1+events20:28:520
44660699221010,2196cyclictest508059-21kworker/2:1+events22:38:462
44660699220410,2191cyclictest501627-21kworker/2:1+events22:00:552
44660699220311,2188cyclictest531143-21kworker/2:2+events23:39:172
44660699220310,2190cyclictest497230-21kworker/2:0+events21:54:052
44660999220111,2187cyclictest477525-21kworker/3:0+events20:49:293
44660499220112,2187cyclictest451660-21kworker/1:0+events19:25:071
4466069922008,2190cyclictest469919-21kworker/2:0+events20:25:022
4466069921978,2185cyclictest519320-21kworker/2:0+events23:06:302
4465999921972,2192cyclictest531265-21kworker/0:2+events23:34:170
44660699219410,2181cyclictest472632-21kworker/2:1+events21:03:542
4466069921849,2172cyclictest441655-21kworker/2:1+events19:15:132
4466049921837,2172cyclictest475869-21kworker/1:2+events20:38:461
4466049921829,2169cyclictest542584-21kworker/1:1+events00:08:551
44660499217911,2164cyclictest524355-21kworker/1:1+events23:07:131
44660499217811,2164cyclictest540907-21kworker/1:0+events23:59:481
44660499217811,2163cyclictest531237-21kworker/1:0+events23:31:141
44660499217810,2165cyclictest547094-21kworker/1:1+events00:19:091
44660499217711,2163cyclictest531237-21kworker/1:0+events23:35:251
44660499217610,2163cyclictest492427-21kworker/1:2+events21:45:431
44660499217510,2161cyclictest492427-21kworker/1:2+events21:38:061
44660699217411,2160cyclictest472632-21kworker/2:1+events20:45:392
44660499217411,2160cyclictest456851-21kworker/1:0+events19:42:081
44660499217111,2157cyclictest506600-21kworker/1:1+events22:27:381
4466049921685,2160cyclictest468186-21kworker/1:1+events20:43:421
4466049921685,2160cyclictest468186-21kworker/1:1+events20:43:421
44660499216811,2154cyclictest540907-21kworker/1:0+events00:03:381
44660499216710,2154cyclictest517725-21kworker/1:2+events22:54:371
44659999216710,2154cyclictest534469-21kworker/0:1+events23:44:350
44659999216710,2154cyclictest488909-21kworker/0:1+events21:35:280
44660499216610,2153cyclictest494152-21kworker/1:0+events21:42:391
44660499216510,2153cyclictest482127-21kworker/1:0+events21:05:021
44660499216411,2149cyclictest517725-21kworker/1:2+events22:56:351
44660499216410,2151cyclictest533674-21kworker/1:1+events23:49:301
44660499216410,2151cyclictest487052-21kworker/1:2+events21:13:501
4466049921639,2151cyclictest463323-21kworker/1:0+events20:33:031
44659999216211,2148cyclictest463386-21kworker/0:1+events20:18:570
44659999216210,2149cyclictest458262-21kworker/0:1+events19:47:000
4465999921618,2150cyclictest465307-21kworker/0:2+events20:06:480
44659999216111,2147cyclictest517784-21kworker/0:0+events22:53:520
44659999216111,2147cyclictest481884-21kworker/0:1+events21:00:530
44659999216111,2147cyclictest463386-21kworker/0:1+events20:01:500
44660499216011,2146cyclictest527590-21kworker/1:2+events23:29:421
44660499216010,2147cyclictest549077-21kworker/1:0+events00:23:461
4465999921606,2151cyclictest463386-21kworker/0:1+events19:59:550
44660699215910,2146cyclictest464980-21kworker/2:0+events20:05:392
44659999215910,2146cyclictest441328-21kworker/0:0+events19:42:290
4466049921588,2147cyclictest533674-21kworker/1:1+events23:41:561
44659999215711,2143cyclictest490620-21kworker/0:2+events21:27:030
44659999215710,2144cyclictest501744-21kworker/0:0+events22:02:030
44659999215511,2141cyclictest453965-21kworker/0:1+events19:34:550
44659999215510,2142cyclictest485386-21kworker/0:2+events21:11:570
44659999215411,2140cyclictest544157-21kworker/0:0+events00:13:260
44659999215411,2140cyclictest527560-21kworker/0:0+events23:23:360
44660699215211,2138cyclictest495460-21kworker/2:1+events21:41:322
44659999215211,2137cyclictest527560-21kworker/0:0+events23:18:150
44659999215210,2139cyclictest492577-21kworker/0:0+events21:34:420
44659999214610,2133cyclictest488909-21kworker/0:1+events21:24:440
4466099921456,2136cyclictest513170-21kworker/3:1+events23:04:353
44660999214510,2132cyclictest504881-21kworker/3:0+events22:09:193
4466049921454,2138cyclictest450030-21kworker/1:1+events19:30:471
4466069921417,2131cyclictest550724-21kworker/2:1+events00:29:322
4465999921409,2128cyclictest498569-21kworker/0:2+events21:51:470
44659999214011,2126cyclictest488909-21kworker/0:1+events21:40:460
4466049921329,2120cyclictest459888-21kworker/1:1+events19:50:451
44660999213111,2117cyclictest547466-21kworker/3:3+events00:34:273
44660999213111,2117cyclictest489321-21kworker/3:2+events21:34:193
44659999212811,2114cyclictest515950-21kworker/0:2+events22:46:150
44660999212211,2108cyclictest516184-21kworker/3:2+events22:45:293
44660999211810,2105cyclictest436925-21kworker/3:2+events19:17:273
4465999921189,2106cyclictest544473-21kworker/0:3+events00:20:430
44660999211610,2103cyclictest474234-21kworker/3:1+events20:31:553
4466099921159,2103cyclictest464916-21kworker/3:1+events20:08:193
44660999211510,2102cyclictest489321-21kworker/3:2+events22:02:273
44660999211410,2101cyclictest517890-21kworker/3:0+events22:54:143
44660999211410,2101cyclictest513170-21kworker/3:1+events22:44:243
4466049921149,2102cyclictest450030-21kworker/1:1+events19:38:211
4466099921138,2102cyclictest453760-21kworker/3:2+events19:46:153
44660999211210,2099cyclictest524474-21kworker/3:2+events23:13:193
44660699211011,2096cyclictest550724-21kworker/2:1+events00:35:332
44660999210710,2094cyclictest474234-21kworker/3:1+events20:38:253
44660699210511,2090cyclictest516216-21kworker/2:2+events22:50:462
44659999210510,2092cyclictest515950-21kworker/0:2+events22:41:460
4466099921049,2092cyclictest540873-21kworker/3:0+events00:02:293
44660999210310,2090cyclictest550575-21kworker/3:0+events00:28:223
44660999210310,2090cyclictest536007-21kworker/3:1+events23:45:443
4466099921028,2091cyclictest480766-21kworker/3:1+events20:57:033
44660999210210,2089cyclictest500290-21kworker/3:0+events21:56:013
4466069921019,2089cyclictest521561-21kworker/2:1+events23:05:002
4466099921008,2090cyclictest468127-21kworker/3:2+events20:15:083
4466099921008,2089cyclictest477525-21kworker/3:0+events21:23:123
44660699210010,2087cyclictest472632-21kworker/2:1+events20:56:402
44660699209911,2085cyclictest453704-21kworker/2:2+events19:44:242
44660999209810,2085cyclictest540873-21kworker/3:0+events00:06:383
4466069920983,2092cyclictest549107-21kworker/2:0+events00:24:092
44660999209711,2082cyclictest524474-21kworker/3:2+events23:09:093
44660999209710,2085cyclictest527741-21kworker/3:0+events23:20:063
44660499209711,2083cyclictest492427-21kworker/1:2+events21:51:031
44660999209611,2082cyclictest511448-21kworker/3:0+events22:39:083
44659999209510,2081cyclictest477673-21kworker/0:2+events20:58:360
44660999209411,2080cyclictest511448-21kworker/3:0+events22:31:513
44660999209411,2080cyclictest508182-21kworker/3:2+events22:29:353
4465999920899,2077cyclictest521995-21kworker/0:0+events23:01:310
44660699208510,2072cyclictest504848-21kworker/2:2+events22:16:562
44660499208410,2073cyclictest516010-21kworker/1:1+events22:45:071
4466099920839,2071cyclictest540873-21kworker/3:0+events00:11:343
4466069920787,2068cyclictest469919-21kworker/2:0+events20:23:082
4466069920773,2071cyclictest504848-21kworker/2:2+events22:20:212
44660699207710,2063cyclictest450185-21kworker/2:0+events19:26:362
4466069920765,2068cyclictest487140-21kworker/2:2+events21:16:482
44660699207610,2063cyclictest446180-21kworker/2:2+events19:14:282
44659999207410,2060cyclictest550918-21kworker/0:1+events00:39:190
4466069920728,2061cyclictest461659-21kworker/2:0+events19:53:232
4466069920727,2062cyclictest529278-21kworker/2:1+events23:32:232
44660699207210,2059cyclictest472632-21kworker/2:1+events21:11:362
4465999920725,2064cyclictest479348-21kworker/0:0+events20:53:190
4466069920718,2060cyclictest536276-21kworker/2:0+events23:46:522
4466069920714,2064cyclictest453704-21kworker/2:2+events19:32:432
44660699207110,2058cyclictest503248-21kworker/2:0+events22:11:112
4465999920719,2058cyclictest488909-21kworker/0:1+events21:18:400
4466069920709,2058cyclictest489030-21kworker/2:1+events21:25:302
4466069920704,2063cyclictest524386-21kworker/2:2+events23:11:472
44659999206910,2056cyclictest503575-21kworker/0:2+events22:16:090
44660499206811,2054cyclictest477614-21kworker/1:0+events20:48:191
4466069920677,2056cyclictest527653-21kworker/2:0+events23:23:142
4466069920669,2053cyclictest453704-21kworker/2:2+events20:04:072
4466099920639,2051cyclictest531522-21kworker/3:0+events23:33:313
44660499206310,2050cyclictest463323-21kworker/1:0+events20:06:011
44660499205910,2046cyclictest479282-21kworker/1:2+events20:54:031
44660999205811,2044cyclictest456608-21kworker/3:1+events19:39:063
4465999920457,2036cyclictest536246-21kworker/0:2+events23:55:110
4466099920434,2036cyclictest477525-21kworker/3:0+events21:08:553
4465999920367,2025cyclictest534469-21kworker/0:1+events00:05:530
44659999203610,2023cyclictest441328-21kworker/0:0+events19:37:110
4466099920349,2022cyclictest464916-21kworker/3:1+events20:22:473
4465999920338,2022cyclictest488909-21kworker/0:1+events22:35:170
4466099920329,2020cyclictest534350-21kworker/3:2+events23:52:513
4466099920298,2018cyclictest540873-21kworker/3:0+events00:16:513
44660499202810,2015cyclictest488999-21kworker/1:1+events21:29:211
44660499202610,2014cyclictest443186-21kworker/1:2+events19:17:041
4466049920247,2014cyclictest426718-21kworker/1:0+events19:14:521
4466049920238,2012cyclictest533674-21kworker/1:1+events23:53:141
44660499202210,2009cyclictest463323-21kworker/1:0+events20:29:371
44660499201910,2006cyclictest482127-21kworker/1:0+events21:17:101
4465999920175,2009cyclictest549206-21kworker/0:0+events00:26:060
44660999201610,2003cyclictest477525-21kworker/3:0+events21:01:373
44659999201510,2002cyclictest463386-21kworker/0:1+events20:35:190
4466049920109,1997cyclictest463323-21kworker/1:0+events19:59:331
4466069920099,1997cyclictest472632-21kworker/2:1+events20:42:552
4466069920099,1997cyclictest472632-21kworker/2:1+events20:42:552
4466049920096,2000cyclictest500081-21kworker/1:0+events21:59:251
4466049920085,2000cyclictest525957-21kworker/1:0+events23:21:401
4466049920085,2000cyclictest443186-21kworker/1:2+events19:20:531
4465999920079,1995cyclictest474473-21kworker/0:0+events20:34:340
44659999200610,1993cyclictest483722-21kworker/0:0+events21:05:250
44660499200410,1991cyclictest506600-21kworker/1:1+events22:21:061
4466049920029,1990cyclictest488999-21kworker/1:1+events21:33:561
4466099920019,1989cyclictest497081-21kworker/3:1+events21:43:483
4465999920009,1988cyclictest509806-21kworker/0:0+events22:24:320
44659999199910,1986cyclictest511416-21kworker/0:2+events22:33:470
4466069919988,1987cyclictest493736-21kworker/2:2+events21:37:432
4465999919977,1987cyclictest459950-21kworker/0:2+events19:51:080
4465999919974,1990cyclictest544473-21kworker/0:3+events00:18:460
4465999919968,1985cyclictest488909-21kworker/0:1+events22:05:060
4465999919939,1981cyclictest450127-21kworker/0:1+events19:19:450
4465999919869,1974cyclictest529309-21kworker/0:1+events23:25:500
4466099919835,1975cyclictest552354-21kworker/3:1+events00:35:113
44659999198310,1971cyclictest488909-21kworker/0:1+events22:10:060
4465999919826,1973cyclictest488909-21kworker/0:1+events21:49:330
4466099919809,1968cyclictest536007-21kworker/3:1+events23:43:273
4466049919765,1968cyclictest527590-21kworker/1:2+events23:19:441
4465999919718,1960cyclictest441328-21kworker/0:0+events19:13:200
4465999919565,1948cyclictest441328-21kworker/0:0+events19:26:150
44659999195510,1942cyclictest527560-21kworker/0:0+events23:37:200
4466049919508,1939cyclictest468186-21kworker/1:1+events20:23:521
4465999919319,1919cyclictest467863-21kworker/0:0+events20:12:110
4465999919304,1923cyclictest525928-21kworker/0:1+events23:14:270
4466099919158,1904cyclictest436925-21kworker/3:2+events19:10:233
4465999918799,1867cyclictest450127-21kworker/0:1+events19:22:490
44659999153148,3cyclictest534469-21kworker/0:1+pm23:55:000
4460042151107,24sleep00-21swapper/019:05:220
4463342143111,27sleep30-21swapper/319:09:343
4463222143110,26sleep10-21swapper/119:09:241
4462132140109,26sleep20-21swapper/219:08:012
446606991610,3cyclictest521123-21/usr/sbin/munin22:55:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional