You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 19:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Sat Nov 29, 2025 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317465999304310,3028cyclictest3206661-21kworker/1:0+events21:05:141
317465999300214,2982cyclictest3221092-21kworker/1:0+events21:35:231
317465499296813,2951cyclictest3241991-21kworker/0:2+events23:05:200
317466499290614,2887cyclictest3216259-21kworker/3:0+events21:40:173
317466199280411,2789cyclictest3184289-21kworker/2:0+events19:50:012
317465499280413,2785cyclictest3241991-21kworker/0:2+events22:50:130
317466499272812,2711cyclictest3188889-21kworker/3:1+events20:00:153
317466199262413,2607cyclictest3209834-21kworker/2:1+events21:10:142
317465999259212,2576cyclictest3189184-21kworker/1:1+events20:05:161
317465499256712,2551cyclictest3251907-21kworker/0:1+events23:10:190
317466199249412,2479cyclictest3263226-21kworker/2:2+events23:46:572
317465999249412,2478cyclictest3275746-21kworker/1:2+events00:27:561
317466199249212,2477cyclictest3278811-21kworker/2:2+events00:39:482
317466199247111,2457cyclictest3220796-21kworker/2:0+events21:39:552
317466199244912,2434cyclictest3258366-21kworker/2:0+events23:44:152
317465499244811,2433cyclictest3274302-21kworker/0:2+events00:21:060
317465499244811,2433cyclictest3253508-21kworker/0:2+events23:27:080
317465499244511,2431cyclictest3178087-21kworker/0:2+events19:33:300
317466199243711,2423cyclictest3190893-21kworker/2:2+events20:04:522
317466199243011,2416cyclictest3272698-21kworker/2:2+events00:17:412
31746599924269,2414cyclictest3235498-21kworker/1:2+events22:20:571
31746549924249,2412cyclictest3240390-21kworker/0:0+events22:34:330
31746619924218,2410cyclictest3250360-21kworker/2:2+events23:22:562
317465499241210,2398cyclictest3178087-21kworker/0:2+events19:30:000
317466199240614,2389cyclictest3240450-21kworker/2:1+events22:40:192
317466199240311,2388cyclictest3222395-21kworker/2:1+events22:10:212
317466499239511,2381cyclictest3260065-21kworker/3:0+events23:48:523
317466499239112,2376cyclictest3254841-21kworker/3:0+events23:22:323
317466499238911,2375cyclictest3270946-21kworker/3:0+events00:14:593
317466499238612,2371cyclictest3200144-21kworker/3:0+events20:49:223
317466499237112,2356cyclictest3227944-21kworker/3:2+events22:14:483
317465499235412,2338cyclictest3214743-21kworker/0:0+events21:18:110
317465999234212,2328cyclictest3180534-21kworker/1:1+events19:36:351
317466499233211,2317cyclictest3222367-21kworker/3:1+events21:50:113
317466199233211,2318cyclictest3243645-21kworker/2:0+events23:13:462
31746619923288,2316cyclictest3164785-21kworker/2:1+events19:15:112
317465999232210,2308cyclictest3244035-21kworker/1:2+events23:02:221
317465999231611,2302cyclictest3189184-21kworker/1:1+events19:56:061
317465999230911,2295cyclictest3195436-21kworker/1:0+events20:18:311
317466499229912,2284cyclictest3240509-21kworker/3:1+events22:44:293
317465999229610,2283cyclictest3184168-21kworker/1:2+events19:40:241
317465999229310,2280cyclictest3238781-21kworker/1:0+events22:41:491
317466199228711,2273cyclictest3198573-21kworker/2:2+events20:26:522
317465999228112,2266cyclictest3225617-21kworker/1:0+events21:57:251
317465999227811,2264cyclictest3251664-21kworker/1:1+events23:41:351
317466199227610,2263cyclictest3206571-21kworker/2:2+events20:57:442
317465499227610,2263cyclictest3209745-21kworker/0:2+events21:03:430
317466199227511,2260cyclictest3263226-21kworker/2:2+events23:50:232
317465999227411,2259cyclictest3230770-21kworker/1:0+events22:17:271
317466199227211,2257cyclictest3200234-21kworker/2:1+events20:35:372
317466199227211,2257cyclictest3164785-21kworker/2:1+events19:28:282
317465999227211,2259cyclictest3232691-21kworker/1:1+events22:11:271
317465999227210,2258cyclictest3219398-21kworker/1:1+events21:35:001
317465999227111,2257cyclictest3238781-21kworker/1:0+events22:34:571
317466199227011,2256cyclictest3259972-21kworker/2:2+events23:34:022
317465999227011,2256cyclictest3263256-21kworker/1:0+events23:54:581
317465999227011,2256cyclictest3238781-21kworker/1:0+events22:39:331
317465999227011,2256cyclictest3230770-21kworker/1:0+events22:09:581
31746599922699,2257cyclictest3195436-21kworker/1:0+events20:28:461
317465999226910,2256cyclictest3187553-21kworker/1:2+events19:54:551
31746619922689,2255cyclictest3254780-21kworker/2:1+events23:29:522
317466199226811,2254cyclictest3243645-21kworker/2:0+events22:57:292
317466199226810,2255cyclictest3259972-21kworker/2:2+events23:35:542
31746599922689,2256cyclictest3275746-21kworker/1:2+events00:31:221
31746619922679,2255cyclictest3203340-21kworker/2:0+events20:53:362
31746599922678,2256cyclictest3266433-21kworker/1:1+events00:03:171
317465999226711,2253cyclictest3206661-21kworker/1:0+events21:13:391
317465999226710,2254cyclictest3205029-21kworker/1:1+events20:45:341
317466199226510,2251cyclictest3270859-21kworker/2:0+events00:25:172
317465999226510,2252cyclictest3219398-21kworker/1:1+events21:29:381
31746619922648,2253cyclictest3220796-21kworker/2:0+events21:32:422
317466199226410,2251cyclictest3190893-21kworker/2:2+events20:15:282
317466199226311,2249cyclictest3200234-21kworker/2:1+events20:32:572
317465999226311,2249cyclictest3246761-21kworker/1:1+events22:57:511
31746619922626,2252cyclictest3263226-21kworker/2:2+events00:04:272
317466199226210,2249cyclictest3270859-21kworker/2:0+events00:13:532
317466199226011,2246cyclictest3224079-21kworker/2:2+events21:43:202
317466199226010,2246cyclictest3203340-21kworker/2:0+events20:46:192
317466199225911,2245cyclictest3229151-21kworker/2:0+events22:31:332
317466199225510,2241cyclictest3250360-21kworker/2:2+events23:19:522
317466199225510,2241cyclictest3179416-21kworker/2:0+events19:23:572
317465999225411,2240cyclictest3251664-21kworker/1:1+events23:25:141
317466499225110,2239cyclictest3184351-21kworker/3:0+events19:40:013
317465999224910,2236cyclictest3227512-21kworker/1:1+events22:03:081
317465499224110,2228cyclictest3272666-21kworker/0:1+events00:19:110
317465499223910,2226cyclictest3181282-21kworker/0:0+events19:48:040
317465499223810,2224cyclictest3241991-21kworker/0:2+events23:03:520
31746619922379,2224cyclictest3196921-21kworker/2:1+events20:22:192
31746549922369,2224cyclictest3234109-21kworker/0:0+events22:16:200
317465499223410,2221cyclictest3256352-21kworker/0:1+events23:42:210
317465499223410,2220cyclictest3220976-21kworker/0:1+events21:52:020
317465499223110,2218cyclictest3263075-21kworker/0:0+events00:08:090
317465499222910,2216cyclictest3245220-21kworker/0:1+events22:58:360
317465499222910,2216cyclictest3230654-21kworker/0:0+events22:04:150
317466199222711,2213cyclictest3164785-21kworker/2:1+events19:30:472
317465499222610,2212cyclictest3277808-21kworker/0:1+events00:35:110
31746619922249,2212cyclictest3229151-21kworker/2:0+events22:15:572
317465499222311,2208cyclictest3187337-21kworker/0:2+events19:59:530
317465499222211,2208cyclictest3274302-21kworker/0:2+events00:33:170
317465499222111,2207cyclictest3217443-21kworker/0:2+events21:25:490
317465499221911,2205cyclictest3243615-21kworker/0:0+events22:45:590
317465499221911,2205cyclictest3220976-21kworker/0:1+events21:37:390
317465499221911,2204cyclictest3234109-21kworker/0:0+events22:13:410
317465499221910,2206cyclictest3250273-21kworker/0:0+events23:17:100
31746549922179,2205cyclictest3241991-21kworker/0:2+events22:38:240
317465499221711,2203cyclictest3253508-21kworker/0:2+events23:20:390
317465499221711,2203cyclictest3223926-21kworker/0:2+events21:44:520
317465499221611,2202cyclictest3197379-21kworker/0:1+events20:33:180
317465499221610,2202cyclictest3263075-21kworker/0:0+events00:02:540
317466199221510,2202cyclictest3187614-21kworker/2:1+events19:50:482
31746599922158,2204cyclictest3162919-21kworker/1:0+events19:21:391
317465499221210,2199cyclictest3227451-21kworker/0:2+events21:57:020
31746619922106,2201cyclictest3218789-21kworker/2:2+events21:26:112
317465999220910,2196cyclictest3201912-21kworker/1:2+events20:37:561
31746599922079,2195cyclictest3277385-21kworker/1:1+events00:37:301
317466499220010,2187cyclictest3214568-21kworker/3:2+events21:17:033
317466199220010,2186cyclictest3237216-21kworker/2:1+events22:22:482
317466499219911,2185cyclictest3193659-21kworker/3:2+events20:10:353
317466499219811,2183cyclictest3222367-21kworker/3:1+events21:38:463
317466199219210,2179cyclictest3224079-21kworker/2:2+events21:46:462
317466499219110,2178cyclictest3270946-21kworker/3:0+events00:34:263
317465999219111,2177cyclictest3251664-21kworker/1:1+events23:08:031
317465499219110,2178cyclictest3235773-21kworker/0:1+events22:27:430
317466499219010,2177cyclictest3200144-21kworker/3:0+events20:36:003
317466199219010,2177cyclictest3209834-21kworker/2:1+events21:08:412
31746649921879,2175cyclictest3270946-21kworker/3:0+events00:36:443
317466499218710,2174cyclictest3251603-21kworker/3:1+events23:16:493
31746649921868,2174cyclictest3233962-21kworker/3:0+events22:36:283
317466499218510,2172cyclictest3266104-21kworker/3:1+events23:53:473
31746599921857,2175cyclictest3180534-21kworker/1:1+events19:30:231
31746549921857,2174cyclictest3187337-21kworker/0:2+events20:29:540
31746649921849,2172cyclictest3182686-21kworker/3:2+events19:33:543
31746649921848,2174cyclictest3177757-21kworker/3:2+events19:25:063
31746649921847,2174cyclictest3200144-21kworker/3:0+events20:50:553
317466499218410,2171cyclictest3269352-21kworker/3:2+events00:01:453
317466199218411,2170cyclictest3243645-21kworker/2:0+events23:09:582
31746649921839,2171cyclictest3193659-21kworker/3:2+events20:31:273
31746649921838,2172cyclictest3266104-21kworker/3:1+events00:06:403
317466499218310,2170cyclictest3272548-21kworker/3:2+events00:16:323
317466499218310,2170cyclictest3243734-21kworker/3:2+events22:52:073
317466499218111,2167cyclictest3188889-21kworker/3:1+events20:09:513
317466499218010,2167cyclictest3208446-21kworker/3:2+events20:59:143
31746649921798,2167cyclictest3270946-21kworker/3:0+events00:25:383
317466199217810,2164cyclictest3193630-21kworker/2:1+events20:10:132
317466499217311,2158cyclictest3224017-21kworker/3:2+events21:46:003
31746649921717,2160cyclictest3201743-21kworker/3:1+events20:43:183
317466499217111,2156cyclictest3263342-21kworker/3:2+events23:55:203
317466499217111,2156cyclictest3208446-21kworker/3:2+events21:04:293
31746649921696,2160cyclictest3216259-21kworker/3:0+events21:30:503
317466199216311,2149cyclictest3270859-21kworker/2:0+events00:20:422
31746549921598,2148cyclictest3205119-21kworker/0:1+events20:49:460
317466199215810,2145cyclictest3243645-21kworker/2:0+events22:48:412
317466199215610,2143cyclictest3190893-21kworker/2:2+events20:06:032
317465999215611,2143cyclictest3235498-21kworker/1:2+events22:25:071
317465499215010,2138cyclictest3256352-21kworker/0:1+events23:45:010
317466499214610,2133cyclictest3200144-21kworker/3:0+events21:08:183
317466499214411,2130cyclictest3179385-21kworker/3:1+events19:35:243
317465499213810,2125cyclictest3188950-21kworker/0:1+events20:01:250
317465499213510,2122cyclictest3203492-21kworker/0:2+events20:42:550
317465499213310,2120cyclictest3211362-21kworker/0:0+events21:05:370
317466499213111,2118cyclictest3216259-21kworker/3:0+events21:20:073
317465999212810,2115cyclictest3259853-21kworker/1:0+events23:32:511
317465999212010,2107cyclictest3251664-21kworker/1:1+events23:17:581
317465999211910,2106cyclictest3198511-21kworker/1:2+events20:24:091
317465499211911,2105cyclictest3263075-21kworker/0:0+events23:58:460
317466199211710,2104cyclictest3225680-21kworker/2:0+events21:50:352
317466499211610,2103cyclictest3253238-21kworker/3:2+events23:14:083
31746619921169,2104cyclictest3278811-21kworker/2:2+events00:33:392
317466199211610,2103cyclictest3200234-21kworker/2:1+events20:42:322
31746649921146,2105cyclictest3246913-21kworker/3:0+events22:56:433
31746619921148,2103cyclictest3243645-21kworker/2:0+events23:03:302
317465499211410,2101cyclictest3220976-21kworker/0:1+events21:34:380
317465999211310,2100cyclictest3246761-21kworker/1:1+events22:53:411
317466199211210,2099cyclictest3266534-21kworker/2:1+events00:05:322
317465999211210,2099cyclictest3266433-21kworker/1:1+events00:15:471
317465999211210,2099cyclictest3201912-21kworker/1:2+events20:41:461
317465999211210,2099cyclictest3189184-21kworker/1:1+events20:13:591
31746619921119,2098cyclictest3184289-21kworker/2:0+events19:43:042
317466199211110,2098cyclictest3209834-21kworker/2:1+events21:17:492
31746599921118,2099cyclictest3211482-21kworker/1:2+events21:04:061
317465499211010,2097cyclictest3187337-21kworker/0:2+events20:05:400
31746649921088,2097cyclictest3240509-21kworker/3:1+events22:49:273
31746599921087,2097cyclictest3238781-21kworker/1:0+events22:45:141
317465999210810,2095cyclictest3271126-21kworker/1:2+events00:13:071
317465999210810,2095cyclictest3216140-21kworker/1:2+events21:19:431
31746619921079,2095cyclictest3229151-21kworker/2:0+events22:00:282
31746599921079,2095cyclictest3223957-21kworker/1:2+events21:47:081
317466199210610,2093cyclictest3222395-21kworker/2:1+events21:58:362
317466199210610,2093cyclictest3181009-21kworker/2:2+events19:38:052
31746599921068,2095cyclictest3274030-21kworker/1:0+events00:22:141
31746599921058,2094cyclictest3263256-21kworker/1:0+events00:06:171
31746649921049,2092cyclictest3230739-21kworker/3:1+events22:04:373
31746619921049,2092cyclictest3175957-21kworker/2:2+events19:14:252
31746599921044,2097cyclictest3263256-21kworker/1:0+events23:50:001
317465999210410,2091cyclictest3259853-21kworker/1:0+events23:36:161
317465499210410,2091cyclictest3206843-21kworker/0:0+events20:54:440
31746619921035,2095cyclictest3245249-21kworker/2:1+events22:51:432
317466199210310,2090cyclictest3266534-21kworker/2:1+events23:56:282
317465999210310,2090cyclictest3162919-21kworker/1:0+events19:25:261
31746619921026,2093cyclictest3206571-21kworker/2:2+events21:01:092
31746619921018,2090cyclictest3238816-21kworker/2:2+events22:39:122
31746599921015,2092cyclictest3162919-21kworker/1:0+events19:16:201
31746549921012,2096cyclictest3259824-21kworker/0:0+events23:34:460
31746599921008,2089cyclictest3216140-21kworker/1:2+events21:22:241
317465499210011,2085cyclictest3212990-21kworker/0:1+events21:23:100
31746619920985,2090cyclictest3222395-21kworker/2:1+events22:09:122
317466499209511,2081cyclictest3198543-21kworker/3:1+events20:24:343
317465999209510,2082cyclictest3180534-21kworker/1:1+events19:46:561
31746549920934,2086cyclictest3181282-21kworker/0:0+events19:40:470
31746649920878,2076cyclictest3226004-21kworker/3:0+events21:59:223
317465499208610,2073cyclictest3164921-21kworker/0:0+events19:14:040
317465499208410,2071cyclictest3235773-21kworker/0:1+events22:42:130
317466499208211,2068cyclictest3216259-21kworker/3:0+events21:26:583
317466499208210,2069cyclictest3233962-21kworker/3:0+events22:20:113
31746549920816,2072cyclictest3187337-21kworker/0:2+events19:53:440
317465499208010,2067cyclictest3234109-21kworker/0:0+events22:21:420
31746549920798,2068cyclictest3225558-21kworker/0:0+events21:47:290
31746549920797,2069cyclictest3193898-21kworker/0:1+events20:12:070
317465499207910,2066cyclictest3197379-21kworker/0:1+events20:35:130
31746549920787,2068cyclictest3261422-21kworker/0:2+events23:39:170
317466499207710,2064cyclictest3177757-21kworker/3:2+events19:20:523
31746549920767,2065cyclictest3178087-21kworker/0:2+events19:24:420
317465499207510,2062cyclictest3164921-21kworker/0:0+events19:17:060
317465499207410,2060cyclictest3227451-21kworker/0:2+events22:05:460
31746549920708,2058cyclictest3212990-21kworker/0:1+events21:14:460
31746549920679,2055cyclictest3272666-21kworker/0:1+events00:14:160
31746599920649,2052cyclictest3189184-21kworker/1:1+events20:00:391
31746599920628,2051cyclictest3248843-21kworker/1:0+events23:10:431
317466199206010,2047cyclictest3238816-21kworker/2:2+events22:28:302
317465499206010,2048cyclictest3187337-21kworker/0:2+events20:20:060
31746619920478,2036cyclictest3214688-21kworker/2:0+events21:23:572
31746599920469,2034cyclictest3219398-21kworker/1:1+events21:44:301
31746599920459,2033cyclictest3254938-21kworker/1:0+events23:21:021
31746549920458,2034cyclictest3205119-21kworker/0:1+events20:59:360
31746649920429,2030cyclictest3233962-21kworker/3:0+events22:26:123
31746619920415,2033cyclictest3187614-21kworker/2:1+events19:56:282
31746649920384,2030cyclictest3260065-21kworker/3:0+events23:41:113
31746599920369,2024cyclictest3223957-21kworker/1:2+events21:51:401
317466499203510,2022cyclictest3193659-21kworker/3:2+events20:28:223
31746599920357,2025cyclictest3162919-21kworker/1:0+events19:11:241
317465499203510,2024cyclictest3178087-21kworker/0:2+events19:35:020
31746649920299,2018cyclictest3260065-21kworker/3:0+events23:35:313
31746649920288,2017cyclictest3227944-21kworker/3:2+events22:05:223
31746599920289,2016cyclictest3209402-21kworker/1:1+events20:57:221
31746599920287,2017cyclictest3200176-21kworker/1:1+events20:32:121
31746549920277,2017cyclictest3264713-21kworker/0:2+events23:51:080
31746649920257,2015cyclictest3251603-21kworker/3:1+events23:07:153
317466499202510,2012cyclictest3254841-21kworker/3:0+events23:26:223
31746649920245,2016cyclictest3188889-21kworker/3:1+events19:53:013
317466499202410,2012cyclictest3233962-21kworker/3:0+events22:30:023
317466499202410,2011cyclictest3212900-21kworker/3:1+events21:12:313
31746649920239,2011cyclictest3193659-21kworker/3:2+events20:15:513
317466499202310,2010cyclictest3275894-21kworker/3:2+events00:24:313
317466499202210,2009cyclictest3184351-21kworker/3:0+events19:48:293
31746549920116,2000cyclictest3275954-21kworker/0:0+events00:28:190
31746549920108,1999cyclictest3195525-21kworker/0:0+events20:19:180
31746649919765,1968cyclictest3256502-21kworker/3:2+events23:34:253
31746649919636,1954cyclictest3174425-21kworker/3:0+events19:15:323
31746599919428,1931cyclictest3266433-21kworker/1:1+events23:57:391
31746649918679,1856cyclictest3171151-21kworker/3:1+events19:10:403
31744072178148,25sleep30-21swapper/319:09:093
31743672144100,40sleep10-21swapper/119:08:381
31742662144115,24sleep00-21swapper/019:07:210
31744472139102,32sleep20-21swapper/219:09:402
3174664991611,4cyclictest3190437-21sshd19:55:403
317466499149,4cyclictest3234754-21taskset22:15:133
317466499130,12cyclictest0-21swapper/323:00:323
317465999130,1cyclictest3207267-21expr20:50:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional