You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 12:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Apr 04, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17659199317215,3152cyclictest218999-21kworker/3:0+events21:25:133
17657699300715,2988cyclictest205703-21kworker/0:0+events21:14:590
17659199294914,2932cyclictest255418-21kworker/3:1+events23:15:163
1765829928318,2819cyclictest242577-21kworker/1:0+events22:35:131
17659199281713,2799cyclictest208786-21kworker/3:1+events20:55:163
17658699277613,2759cyclictest179664-21kworker/2:0+events19:45:012
17658699276113,2744cyclictest237768-21kworker/2:0+events22:50:002
17658699273713,2720cyclictest257230-21kworker/2:1+events23:35:122
1765869927177,2706cyclictest179664-21kworker/2:0+events20:05:172
17658699271712,2701cyclictest239488-21kworker/2:1+events22:25:172
17657699271313,2697cyclictest279709-21kworker/0:2+events00:35:190
17659199269612,2679cyclictest263556-21kworker/3:1+events23:40:113
17658299269612,2681cyclictest247215-21kworker/1:1+events23:10:001
17657699268013,2664cyclictest177918-21kworker/0:1+events19:15:010
17658299264013,2624cyclictest178172-21kworker/1:3+events19:30:151
17658299263413,2616cyclictest247215-21kworker/1:1+events23:20:171
17658299262413,2607cyclictest203017-21kworker/1:1+events20:50:161
17659199260912,2593cyclictest202581-21kworker/3:1+events20:31:523
17658299258012,2564cyclictest264938-21kworker/1:2+events23:42:261
1765829925698,2559cyclictest178172-21kworker/1:3+events19:20:181
17659199255210,2538cyclictest270287-21kworker/3:2+events00:03:013
17659199253112,2515cyclictest207115-21kworker/3:0+events20:50:403
1765869925269,2513cyclictest257230-21kworker/2:1+events23:28:212
17659199252112,2505cyclictest253800-21kworker/3:2+events23:14:553
17659199250111,2486cyclictest270013-21kworker/3:1+events23:58:493
17658299249812,2483cyclictest224520-21kworker/1:2+events21:39:131
17657699249612,2481cyclictest258589-21kworker/0:1+events23:25:160
17658699249411,2479cyclictest242755-21kworker/2:1+events22:39:192
17658299249112,2475cyclictest267152-21kworker/1:1+events23:56:311
17658299249012,2474cyclictest183193-21kworker/1:1+events19:44:151
17658299248712,2472cyclictest187992-21kworker/1:2+events19:53:111
17658299248511,2471cyclictest231338-21kworker/1:1+events22:11:581
17658299248411,2469cyclictest201011-21kworker/1:0+events20:33:471
17657699248212,2466cyclictest267565-21kworker/0:2+events23:56:540
17658299247812,2462cyclictest178172-21kworker/1:3+events19:27:151
17658299247211,2459cyclictest216615-21kworker/1:0+events21:20:451
17658699246711,2453cyclictest237768-21kworker/2:0+events22:20:212
17658299246512,2450cyclictest227842-21kworker/1:2+events21:56:441
17658699246213,2446cyclictest264854-21kworker/2:2+events23:52:422
17658699245212,2436cyclictest268613-21kworker/2:1+events23:56:082
17658699245110,2437cyclictest219903-21kworker/2:2+events21:48:212
17659199244810,2434cyclictest202581-21kworker/3:1+events20:39:293
17658699244812,2432cyclictest210570-21kworker/2:2+events20:59:282
17658699244712,2432cyclictest179664-21kworker/2:0+events20:02:382
17657699244412,2428cyclictest210636-21kworker/0:1+events21:00:150
17657699243612,2421cyclictest234527-21kworker/0:0+events22:21:050
17658299243512,2419cyclictest240966-21kworker/1:1+events22:29:291
17659199242912,2414cyclictest208786-21kworker/3:1+events20:49:313
17659199242810,2415cyclictest215343-21kworker/3:1+events21:32:463
17659199242611,2411cyclictest279618-21kworker/3:1+events00:33:463
17659199242312,2408cyclictest223071-21kworker/3:0+events21:39:373
17659199242312,2407cyclictest276343-21kworker/3:2+events00:26:323
17658699242312,2407cyclictest183373-21kworker/2:1+events19:34:302
17659199242112,2406cyclictest239519-21kworker/3:0+events22:27:563
17659199242111,2406cyclictest191585-21kworker/3:2+events19:57:183
17659199242111,2406cyclictest186314-21kworker/3:1+events19:41:183
17659199242012,2404cyclictest223071-21kworker/3:0+events21:44:373
17659199241912,2403cyclictest279618-21kworker/3:1+events00:37:353
17659199241911,2405cyclictest216965-21kworker/3:2+events21:19:373
17658699241512,2399cyclictest201922-21kworker/2:2+events20:32:382
17658699241412,2399cyclictest207296-21kworker/2:0+events20:51:492
17659199241312,2398cyclictest265276-21kworker/3:3+events23:46:363
17659199241312,2397cyclictest181654-21kworker/3:0+events19:26:283
17659199241210,2399cyclictest252214-21kworker/3:0+events23:02:053
17659199240911,2395cyclictest196026-21kworker/3:0+events20:12:263
17658299240912,2393cyclictest193098-21kworker/1:1+events20:10:151
17658699240712,2392cyclictest197928-21kworker/2:0+events20:26:582
17658699240212,2387cyclictest237768-21kworker/2:0+events22:55:412
1765829924009,2387cyclictest271777-21kworker/1:0+events00:10:541
17658699239412,2378cyclictest279493-21kworker/2:2+events00:36:492
17658699239411,2379cyclictest223130-21kworker/2:0+events21:35:472
17658699239212,2378cyclictest227990-21kworker/2:1+events22:05:032
17659199238810,2374cyclictest265276-21kworker/3:3+events00:07:523
17658699238811,2374cyclictest237768-21kworker/2:0+events22:41:552
17658699238711,2373cyclictest227990-21kworker/2:1+events21:58:372
1765869923859,2374cyclictest260538-21kworker/2:0+events00:00:192
17658699238412,2369cyclictest215016-21kworker/2:1+events21:19:152
17658699238411,2370cyclictest215016-21kworker/2:1+events21:13:552
17658699238211,2367cyclictest197928-21kworker/2:0+events20:23:332
17659199237210,2359cyclictest245823-21kworker/3:1+events22:44:133
17658699236712,2351cyclictest273047-21kworker/2:1+events00:06:442
17657699236712,2352cyclictest188246-21kworker/0:3+events19:50:570
17658699236611,2351cyclictest179664-21kworker/2:0+events19:26:052
1765869923619,2348cyclictest207296-21kworker/2:0+events21:00:592
17658299235712,2342cyclictest271777-21kworker/1:0+events00:30:001
17658299235712,2342cyclictest227842-21kworker/1:2+events22:01:391
17658699235211,2337cyclictest179664-21kworker/2:0+events19:51:202
17658699235012,2335cyclictest201922-21kworker/2:2+events20:42:352
17658699234912,2334cyclictest204067-21kworker/2:1+events20:37:382
17658299234912,2334cyclictest264938-21kworker/1:2+events23:50:471
17658699234812,2333cyclictest281128-21kworker/2:0+events00:33:002
17659199234411,2330cyclictest233046-21kworker/3:2+events22:09:183
17658699234311,2328cyclictest251010-21kworker/2:2+events23:16:262
17657699234012,2324cyclictest239302-21kworker/0:1+events22:51:330
17657699233612,2322cyclictest199573-21kworker/0:1+events20:30:000
17658299233512,2323cyclictest254111-21kworker/1:2+events23:10:471
17657699233412,2319cyclictest190267-21kworker/0:0+events20:15:550
17657699233112,2315cyclictest269950-21kworker/0:1+events00:11:170
17657699232912,2314cyclictest247772-21kworker/0:2+events23:12:400
17657699232812,2312cyclictest241087-21kworker/0:2+events22:30:140
17658299232712,2313cyclictest209264-21kworker/1:2+events21:05:111
17658299232712,2313cyclictest209264-21kworker/1:2+events21:05:111
17658299232712,2311cyclictest231338-21kworker/1:1+events22:15:481
17657699232712,2311cyclictest239302-21kworker/0:1+events22:47:410
17657699232711,2312cyclictest219871-21kworker/0:1+events21:25:360
17657699232611,2311cyclictest177918-21kworker/0:1+events19:37:310
17657699232610,2313cyclictest271629-21kworker/0:0+events00:03:440
17658299232412,2308cyclictest279526-21kworker/1:2+events00:30:441
17658299232212,2307cyclictest224520-21kworker/1:2+events21:41:101
17658299232112,2307cyclictest220078-21kworker/1:1+events21:30:061
17658299231910,2306cyclictest191457-21kworker/1:0+events19:56:541
17657699231911,2305cyclictest247772-21kworker/0:2+events23:44:220
17658699231611,2302cyclictest253847-21kworker/2:1+events23:07:222
17658299231612,2302cyclictest195997-21kworker/1:2+events20:20:541
17657699231212,2298cyclictest190267-21kworker/0:0+events20:07:570
17657699231012,2295cyclictest247772-21kworker/0:2+events23:38:390
17657699230612,2291cyclictest262011-21kworker/0:0+events23:50:250
17657699230610,2293cyclictest234527-21kworker/0:0+events22:08:310
17658299230512,2289cyclictest227842-21kworker/1:2+events21:52:101
17658299230410,2291cyclictest226245-21kworker/1:0+events21:47:141
1765919922939,2281cyclictest223071-21kworker/3:0+events21:49:053
17658699228512,2269cyclictest204067-21kworker/2:1+events20:46:272
17658699228312,2267cyclictest237768-21kworker/2:0+events22:54:112
17659199227712,2262cyclictest253800-21kworker/3:2+events23:09:393
1765769922779,2264cyclictest197837-21kworker/0:2+events20:20:310
17657699227511,2260cyclictest219871-21kworker/0:1+events21:34:400
17658299226811,2254cyclictest205674-21kworker/1:2+events20:42:571
17658299226610,2253cyclictest261711-21kworker/1:1+events23:33:441
17658299225810,2245cyclictest187992-21kworker/1:2+events19:49:291
17658299225711,2243cyclictest237677-21kworker/1:2+events22:24:341
17659199225412,2238cyclictest274740-21kworker/3:1+events00:17:223
1765829922548,2243cyclictest216615-21kworker/1:0+events21:14:381
17658299225410,2240cyclictest195997-21kworker/1:2+events20:28:271
17658299225310,2240cyclictest191457-21kworker/1:0+events20:01:541
17658299224910,2235cyclictest175995-21kworker/1:2+events19:17:161
17659199224710,2234cyclictest276343-21kworker/3:2+events00:22:453
17658299224711,2233cyclictest237677-21kworker/1:2+events22:31:231
17657699224712,2232cyclictest236530-21kworker/0:2+events22:17:170
17659199223710,2224cyclictest202581-21kworker/3:1+events20:29:363
17658699223212,2217cyclictest257230-21kworker/2:1+events23:23:452
17658299223211,2218cyclictest257550-21kworker/1:0+events23:25:401
17658299223211,2218cyclictest250860-21kworker/1:0+events23:03:591
17659199223011,2215cyclictest242516-21kworker/3:2+events22:32:563
17659199222911,2214cyclictest244174-21kworker/3:0+events22:53:493
17659199222810,2215cyclictest234647-21kworker/3:0+events22:15:013
17659199222611,2211cyclictest212086-21kworker/3:0+events21:07:293
17659199222611,2211cyclictest212086-21kworker/3:0+events21:07:283
17659199222610,2213cyclictest218999-21kworker/3:0+events21:21:063
1765919922260,2223cyclictest239519-21kworker/3:0+events22:24:563
17659199222511,2211cyclictest196026-21kworker/3:0+events20:17:263
17659199222510,2212cyclictest247490-21kworker/3:2+events22:55:203
17659199222510,2211cyclictest181654-21kworker/3:0+events19:34:543
17658699222510,2211cyclictest276373-21kworker/2:1+events00:20:482
17657699222511,2211cyclictest207360-21kworker/0:2+events20:46:050
17659199222311,2209cyclictest268317-21kworker/3:0+events23:53:053
17659199222311,2209cyclictest228078-21kworker/3:1+events21:51:473
17659199222310,2210cyclictest231101-21kworker/3:0+events22:00:063
17659199222310,2210cyclictest191585-21kworker/3:2+events20:03:453
17659199222111,2207cyclictest244174-21kworker/3:0+events22:45:213
17659199221911,2205cyclictest274740-21kworker/3:1+events00:12:493
17658699221811,2204cyclictest251010-21kworker/2:2+events23:13:242
17659199221611,2202cyclictest177649-21kworker/3:2+events19:21:493
17659199221610,2203cyclictest255418-21kworker/3:1+events23:30:393
17659199221610,2202cyclictest184648-21kworker/3:2+events19:35:173
17658299221511,2201cyclictest274648-21kworker/1:2+events00:18:071
17657699221112,2196cyclictest219871-21kworker/0:1+events21:48:440
17658699220511,2190cyclictest215016-21kworker/2:1+events21:08:162
17658699220511,2190cyclictest215016-21kworker/2:1+events21:08:162
17657699220311,2189cyclictest205703-21kworker/0:0+events20:44:080
17659199220211,2187cyclictest202581-21kworker/3:1+events20:40:153
17659199220011,2186cyclictest237862-21kworker/3:1+events22:35:363
17658699220012,2185cyclictest219903-21kworker/2:2+events21:29:192
17659199219811,2184cyclictest208786-21kworker/3:1+events21:03:183
17657699219811,2184cyclictest239302-21kworker/0:1+events22:39:400
17657699219611,2181cyclictest219871-21kworker/0:1+events22:10:260
17659199219510,2183cyclictest212086-21kworker/3:0+events21:10:073
17657699219511,2181cyclictest205703-21kworker/0:0+events20:56:010
17658699219412,2179cyclictest257230-21kworker/2:1+events23:34:292
1765919921926,2183cyclictest257013-21kworker/3:0+events23:21:053
17659199219111,2177cyclictest197715-21kworker/3:1+events20:21:173
17659199219110,2178cyclictest196026-21kworker/3:0+events20:09:063
17657699219112,2176cyclictest247772-21kworker/0:2+events23:04:450
17658699218611,2172cyclictest188235-21kworker/2:2+events19:45:232
1765869921841,2180cyclictest270501-21kworker/2:2+events00:15:282
17657699218311,2169cyclictest265467-21kworker/0:1+events23:49:160
17658699217911,2164cyclictest237768-21kworker/2:0+events22:30:362
17658699217911,2164cyclictest183373-21kworker/2:1+events19:37:092
1765919921788,2166cyclictest188020-21kworker/3:2+events19:46:303
1765869921778,2166cyclictest179664-21kworker/2:0+events19:56:102
17658699217710,2163cyclictest232710-21kworker/2:0+events22:03:332
17658699217610,2163cyclictest276373-21kworker/2:1+events00:28:502
17659199217511,2161cyclictest260286-21kworker/3:2+events23:39:273
17658699217511,2160cyclictest221498-21kworker/2:1+events21:32:242
17658699217011,2156cyclictest226361-21kworker/2:0+events21:51:262
17658699216611,2153cyclictest264854-21kworker/2:2+events23:45:072
17658699216511,2150cyclictest218280-21kworker/2:0+events21:22:332
17658699216510,2152cyclictest237768-21kworker/2:0+events23:00:322
17658699216411,2149cyclictest179664-21kworker/2:0+events19:19:542
1765869921637,2153cyclictest224734-21kworker/2:1+events21:41:322
17658699216110,2148cyclictest260538-21kworker/2:0+events23:42:502
17657699214310,2130cyclictest199573-21kworker/0:1+events20:38:230
17657699214110,2128cyclictest205703-21kworker/0:0+events21:22:110
17657699213211,2118cyclictest210636-21kworker/0:1+events21:08:390
17657699213211,2118cyclictest210636-21kworker/0:1+events21:08:390
17658699212510,2112cyclictest194578-21kworker/2:2+events20:12:502
17657699212512,2109cyclictest197837-21kworker/0:2+events20:14:460
1765829921198,2108cyclictest242577-21kworker/1:0+events22:42:181
17657699211611,2102cyclictest188246-21kworker/0:3+events19:55:230
1765829921148,2103cyclictest267152-21kworker/1:1+events00:04:311
17657699211411,2099cyclictest177918-21kworker/0:1+events19:23:240
17657699210911,2094cyclictest194490-21kworker/0:1+events20:04:540
17657699210910,2095cyclictest202406-21kworker/0:0+events20:29:140
17657699210711,2093cyclictest205703-21kworker/0:0+events20:51:260
17657699210711,2092cyclictest271629-21kworker/0:0+events00:07:300
17657699210611,2093cyclictest278092-21kworker/0:0+events00:25:220
17657699210611,2092cyclictest269950-21kworker/0:1+events00:34:340
17657699210511,2091cyclictest247772-21kworker/0:2+events23:24:080
1765769921049,2092cyclictest219871-21kworker/0:1+events21:40:470
17657699210411,2090cyclictest269950-21kworker/0:1+events00:16:370
17657699210411,2090cyclictest223221-21kworker/0:2+events21:38:270
17657699210411,2090cyclictest177918-21kworker/0:1+events19:45:440
1765769921029,2089cyclictest247772-21kworker/0:2+events22:56:030
17657699210211,2088cyclictest253968-21kworker/0:0+events23:08:540
17658299210111,2087cyclictest247215-21kworker/1:1+events22:48:261
17658299210011,2085cyclictest249149-21kworker/1:2+events22:56:261
17658299209911,2085cyclictest247215-21kworker/1:1+events22:52:191
17659199209810,2085cyclictest189936-21kworker/3:1+events19:52:293
17658299209811,2084cyclictest195997-21kworker/1:2+events20:06:471
17658299209811,2083cyclictest213847-21kworker/1:1+events21:15:441
1765829920979,2085cyclictest271777-21kworker/1:0+events00:06:001
17658299209710,2084cyclictest279526-21kworker/1:2+events00:39:501
1765829920959,2083cyclictest220078-21kworker/1:1+events21:25:591
17658299209510,2082cyclictest271777-21kworker/1:0+events00:24:591
17658299209410,2081cyclictest264938-21kworker/1:2+events23:45:301
17658299209311,2079cyclictest199388-21kworker/1:1+events20:19:201
17657699209211,2077cyclictest219871-21kworker/0:1+events21:54:510
1765769920838,2075cyclictest177918-21kworker/0:1+events19:18:030
1765769920788,2067cyclictest187847-21kworker/0:2+events19:42:250
1765919920755,2067cyclictest260286-21kworker/3:2+events23:29:083
17658699207511,2061cyclictest227990-21kworker/2:1+events22:13:282
17659199207410,2060cyclictest233046-21kworker/3:2+events22:16:113
17657699207310,2060cyclictest183257-21kworker/0:2+events19:29:540
1765919920702,2064cyclictest177649-21kworker/3:2+events19:16:513
1765769920688,2056cyclictest205703-21kworker/0:0+events21:18:060
1765919920668,2055cyclictest174638-21kworker/3:0+events19:12:433
1765919920649,2051cyclictest228078-21kworker/3:1+events21:56:003
1765829920619,2049cyclictest203017-21kworker/1:1+events20:38:021
17658699205510,2043cyclictest179664-21kworker/2:0+events19:24:112
1765769920504,2042cyclictest253968-21kworker/0:0+events23:19:090
17657699204911,2035cyclictest239302-21kworker/0:1+events22:44:340
1765869920258,2014cyclictest274708-21kworker/2:0+events00:14:412
1765769920128,2002cyclictest273256-21kworker/0:2+events00:20:010
1765869920115,2002cyclictest196209-21kworker/2:1+events20:15:112
1765869919957,1985cyclictest168116-21kworker/2:2+events19:13:062
1765829919589,1947cyclictest171622-21kworker/1:1+events19:11:561
1765769919525,1944cyclictest229826-21kworker/0:0+events21:57:300
1765769919517,1941cyclictest247772-21kworker/0:2+events23:34:510
1765829919499,1937cyclictest227842-21kworker/1:2+events22:08:541
1765829919499,1937cyclictest209264-21kworker/1:2+events20:58:191
17658299194710,1934cyclictest183193-21kworker/1:1+events19:38:421
17658299194610,1933cyclictest212026-21kworker/1:0+events21:02:541
1765869919406,1931cyclictest236162-21kworker/2:2+events22:16:552
1765769918727,1862cyclictest239302-21kworker/0:1+events22:28:420
176201214896,43sleep00-21swapper/019:08:160
1761752143108,30sleep10-21swapper/119:07:571
1761252140108,27sleep30-21swapper/319:07:193
1760812140108,27sleep20-21swapper/219:06:462
176582992721,3cyclictest0-21swapper/123:20:001
17657699181,13cyclictest233317-21basename22:05:000
17658299175,8cyclictest263640-21awk23:40:001
17658299161,13cyclictest209026-21munin-run20:50:001
17657699157,1cyclictest191rcu_preempt19:30:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional