You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Mon Oct 20, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332894799311015,3091cyclictest3355553-21kworker/3:2+events20:45:003
332894799308715,3068cyclictest3333864-21kworker/3:2+events19:50:203
332894799292014,2903cyclictest3422340-21kworker/3:2+events00:00:003
332894599286014,2842cyclictest3361702-21kworker/2:1+events20:55:002
332894599282112,2805cyclictest3335441-21kworker/2:2+events19:45:212
332894799278914,2770cyclictest3348935-21kworker/3:2+events20:10:143
332894199276513,2749cyclictest3328571-21kworker/1:2+events19:40:001
332894199269913,2682cyclictest3407974-21kworker/1:0+events23:15:191
332893999268113,2664cyclictest3361883-21kworker/0:2+events21:00:180
332894599266213,2647cyclictest3371183-21kworker/2:0+events21:30:012
332894199264212,2627cyclictest3365037-21kworker/1:2+events21:05:131
332894799262613,2609cyclictest3325682-21kworker/3:1+events19:20:153
332894199252612,2509cyclictest3365037-21kworker/1:2+events22:00:131
332893999247111,2456cyclictest3382611-21kworker/0:2+events21:55:190
332894599246011,2445cyclictest3401528-21kworker/2:1+events22:57:242
332894199244812,2433cyclictest3365037-21kworker/1:2+events21:10:241
332894599244210,2427cyclictest3427101-21kworker/2:2+events00:36:422
332894599243912,2423cyclictest3387457-21kworker/2:0+events22:14:432
332894199243612,2421cyclictest3399979-21kworker/1:1+events22:47:221
332894199243312,2418cyclictest3365037-21kworker/1:2+events21:40:231
332893999243310,2419cyclictest3420793-21kworker/0:1+events23:53:570
33289459924295,2420cyclictest3420825-21kworker/2:1+events00:09:292
332894599242712,2412cyclictest3419218-21kworker/2:0+events23:51:382
332894599242711,2413cyclictest3363312-21kworker/2:0+events20:55:462
33289479924239,2410cyclictest3391996-21kworker/3:0+events22:56:383
332894599242211,2407cyclictest3427101-21kworker/2:2+events00:25:452
332894599242210,2408cyclictest3411286-21kworker/2:2+events23:43:582
33289479924209,2408cyclictest3404854-21kworker/3:2+events23:05:253
332894599242011,2405cyclictest3377505-21kworker/2:1+events21:52:162
332894599241712,2402cyclictest3325351-21kworker/2:0+events19:16:242
332894599241611,2401cyclictest3389128-21kworker/2:2+events22:45:292
332894599241112,2395cyclictest3389128-21kworker/2:2+events22:26:052
332894599240612,2391cyclictest3412973-21kworker/2:1+events23:33:112
332894599240611,2392cyclictest3404762-21kworker/2:0+events23:26:402
332894599240312,2388cyclictest3345498-21kworker/2:1+events20:05:132
332894799240012,2384cyclictest3427189-21kworker/3:2+events00:32:343
332894599239811,2383cyclictest3342138-21kworker/2:0+events20:02:092
332894799239511,2381cyclictest3409636-21kworker/3:2+events23:24:003
332894599239412,2378cyclictest3401528-21kworker/2:1+events23:06:112
332894799239312,2378cyclictest3427189-21kworker/3:2+events00:15:113
332893999239312,2379cyclictest3414471-21kworker/0:0+events23:40:060
332894799239210,2379cyclictest3430486-21kworker/3:1+events00:23:503
332894799239112,2375cyclictest3376017-21kworker/3:2+events21:38:513
332894799239012,2376cyclictest3391996-21kworker/3:0+events23:18:423
332894799239011,2376cyclictest3391996-21kworker/3:0+events22:44:213
332893999238912,2374cyclictest3355310-21kworker/0:0+events20:36:350
332894799238712,2373cyclictest3350542-21kworker/3:1+events20:25:073
332894799238711,2373cyclictest3355553-21kworker/3:2+events20:38:293
332894799238710,2373cyclictest3434052-21kworker/3:1+events00:37:533
332894799238512,2370cyclictest3430486-21kworker/3:1+events00:26:093
332894799238512,2369cyclictest3391996-21kworker/3:0+events22:31:013
332894799238511,2372cyclictest3342198-21kworker/3:1+events19:56:033
332894599238511,2371cyclictest3422413-21kworker/2:2+events23:59:132
332894799238211,2367cyclictest3409636-21kworker/3:2+events23:33:343
332894799238111,2367cyclictest3360160-21kworker/3:0+events20:53:053
332894799238012,2365cyclictest3409636-21kworker/3:2+events23:45:533
332894199238012,2365cyclictest3393811-21kworker/1:0+events22:36:231
332894199238012,2365cyclictest3377685-21kworker/1:1+events21:40:001
332893999238011,2365cyclictest3369553-21kworker/0:2+events21:43:020
332894799237912,2364cyclictest3348935-21kworker/3:2+events20:19:023
332894799237811,2364cyclictest3368218-21kworker/3:2+events21:19:233
332894599236411,2349cyclictest3389128-21kworker/2:2+events22:51:162
332894199236312,2347cyclictest3427504-21kworker/1:0+events00:30:181
332894799236112,2345cyclictest3417638-21kworker/3:1+events23:53:343
332894199235412,2338cyclictest3409572-21kworker/1:2+events23:26:161
332893999235311,2338cyclictest3422428-21kworker/0:0+events00:00:450
332894199235212,2336cyclictest3433723-21kworker/1:2+events00:36:001
332893999235212,2336cyclictest3393717-21kworker/0:1+events22:27:590
332894199235112,2336cyclictest3355343-21kworker/1:2+events20:30:271
332894199235011,2336cyclictest3392175-21kworker/1:1+events22:24:331
332893999234912,2334cyclictest3337217-21kworker/0:1+events19:34:190
332894199234812,2333cyclictest3419462-21kworker/1:2+events23:52:471
332894199234812,2332cyclictest3363434-21kworker/1:0+events20:54:381
332894199234812,2332cyclictest3335379-21kworker/1:1+events19:32:451
332893999234812,2333cyclictest3422428-21kworker/0:0+events23:57:430
33289419923479,2335cyclictest3356953-21kworker/1:1+events20:38:531
332894199234712,2332cyclictest3363434-21kworker/1:0+events20:59:341
332893999234712,2333cyclictest3398556-21kworker/0:1+events23:00:030
332894199234612,2331cyclictest3385887-21kworker/1:3+events22:27:141
332894799234312,2328cyclictest3376017-21kworker/3:2+events21:34:353
332893999234312,2328cyclictest3398556-21kworker/0:1+events22:48:560
33289479923416,2331cyclictest3381035-21kworker/3:0+events21:58:413
33289399923408,2328cyclictest3411106-21kworker/0:1+events23:34:420
332893999234012,2325cyclictest3424171-21kworker/0:2+events00:16:180
332893999234012,2324cyclictest3387626-21kworker/0:1+events22:18:300
332894199233912,2324cyclictest3395415-21kworker/1:2+events23:08:281
332893999233912,2323cyclictest3369553-21kworker/0:2+events21:18:160
332893999233810,2325cyclictest3361883-21kworker/0:2+events20:58:260
332893999233711,2323cyclictest3409423-21kworker/0:2+events23:20:340
332894599233412,2319cyclictest3406428-21kworker/2:2+events23:13:032
332894199233310,2319cyclictest3421099-21kworker/1:1+events00:05:431
332893999232312,2307cyclictest3387626-21kworker/0:1+events22:14:190
332893999231912,2304cyclictest3390430-21kworker/0:0+events22:39:480
33289479923159,2303cyclictest3385946-21kworker/3:1+events22:13:343
332894199231212,2297cyclictest3365037-21kworker/1:2+events21:03:211
332894599230011,2286cyclictest3384029-21kworker/2:2+events22:04:452
332893999229910,2286cyclictest3403405-21kworker/0:2+events23:08:530
332894799229112,2276cyclictest3371487-21kworker/3:1+events21:22:273
332894599228511,2271cyclictest3343775-21kworker/2:2+events19:54:082
332894199228510,2271cyclictest3347125-21kworker/1:2+events20:17:061
332894199227912,2263cyclictest3345464-21kworker/1:0+events20:01:461
332894199226812,2253cyclictest3355343-21kworker/1:2+events20:43:051
332894199225211,2238cyclictest3419462-21kworker/1:2+events23:59:381
332893999225211,2238cyclictest3424171-21kworker/0:2+events00:21:560
332894599223510,2222cyclictest3384029-21kworker/2:2+events21:57:572
332894599223311,2219cyclictest3389128-21kworker/2:2+events22:39:252
332894599223210,2219cyclictest3420825-21kworker/2:1+events00:04:142
33289459922318,2220cyclictest3377505-21kworker/2:1+events21:45:472
33289419922308,2219cyclictest3365037-21kworker/1:2+events21:21:181
332894599222611,2211cyclictest3372959-21kworker/2:1+events21:29:142
332894599222610,2213cyclictest3401528-21kworker/2:1+events23:02:002
332894199222611,2212cyclictest3421099-21kworker/1:1+events00:17:011
332894799222511,2210cyclictest3400253-21kworker/3:2+events22:53:343
33289459922239,2210cyclictest3355522-21kworker/2:0+events20:44:372
33289459922218,2210cyclictest3353889-21kworker/2:1+events20:24:222
33289459922218,2209cyclictest3345498-21kworker/2:1+events20:10:382
332894599222110,2207cyclictest3351877-21kworker/2:2+events20:19:472
332894199222110,2208cyclictest3430424-21kworker/1:2+events00:24:371
332894599222010,2206cyclictest3389128-21kworker/2:2+events22:31:252
332894799221911,2204cyclictest3391996-21kworker/3:0+events23:04:403
33289459922198,2208cyclictest3363312-21kworker/2:0+events21:04:512
332894599221911,2204cyclictest3415644-21kworker/2:0+events23:39:212
33289459922189,2206cyclictest3360065-21kworker/2:2+events20:47:172
332894599221811,2204cyclictest3377505-21kworker/2:1+events21:42:172
332894599221610,2202cyclictest3333599-21kworker/2:1+events19:28:572
33289459922158,2204cyclictest3404762-21kworker/2:0+events23:19:062
332894199221511,2201cyclictest3406335-21kworker/1:1+events23:14:571
33289399922118,2200cyclictest3353679-21kworker/0:2+events20:22:290
33289479922078,2196cyclictest3376017-21kworker/3:2+events21:40:463
332894599220610,2192cyclictest3385654-21kworker/2:1+events22:08:352
332894799220211,2188cyclictest3391996-21kworker/3:0+events22:21:333
332894799220210,2189cyclictest3355553-21kworker/3:2+events20:30:513
33289419922019,2189cyclictest3409572-21kworker/1:2+events23:32:261
332894799219910,2186cyclictest3391996-21kworker/3:0+events22:29:073
332894799219711,2183cyclictest3350542-21kworker/3:1+events20:23:163
33289459921979,2185cyclictest3397021-21kworker/2:1+events22:41:202
332893999219310,2180cyclictest3398556-21kworker/0:1+events22:55:520
332894199219210,2176cyclictest3347125-21kworker/1:2+events20:07:101
332894599219111,2177cyclictest3427101-21kworker/2:2+events00:31:042
332894599219010,2176cyclictest3428761-21kworker/2:1+events00:18:102
332894799218911,2174cyclictest3364978-21kworker/3:1+events21:13:023
332894599218911,2175cyclictest3427101-21kworker/2:2+events00:23:292
33289479921879,2175cyclictest3409636-21kworker/3:2+events23:41:153
332894599218611,2171cyclictest3337369-21kworker/2:0+events19:36:342
33289459921859,2173cyclictest3371183-21kworker/2:0+events21:36:562
33289419921855,2177cyclictest3328571-21kworker/1:2+events19:43:261
332894799218411,2169cyclictest3409636-21kworker/3:2+events23:37:233
332894799218311,2169cyclictest3364978-21kworker/3:1+events21:07:023
332894599218310,2170cyclictest3363312-21kworker/2:0+events21:08:092
33289459921809,2167cyclictest3351877-21kworker/2:2+events20:29:192
332894799217911,2166cyclictest3398467-21kworker/3:1+events22:45:063
332894799217811,2164cyclictest3381035-21kworker/3:0+events22:01:463
332894799217810,2165cyclictest3332243-21kworker/3:0+events19:27:043
33289479921769,2163cyclictest3377657-21kworker/3:1+events21:50:443
332894799217610,2164cyclictest3333864-21kworker/3:2+events19:30:493
332894799217610,2162cyclictest3406579-21kworker/3:1+events23:14:103
33289419921769,2164cyclictest3350823-21kworker/1:0+events20:28:331
332894799217411,2160cyclictest3343833-21kworker/3:0+events20:04:033
33289479921729,2160cyclictest3409636-21kworker/3:2+events23:25:313
332894799217212,2157cyclictest3360160-21kworker/3:0+events20:48:053
332894799217011,2156cyclictest3338614-21kworker/3:1+events19:39:373
332894799216911,2154cyclictest3333864-21kworker/3:2+events19:47:403
332893999216811,2154cyclictest3390430-21kworker/0:0+events22:24:570
332894799216610,2153cyclictest3389034-21kworker/3:2+events22:17:233
332894199216511,2151cyclictest3342261-21kworker/1:0+events19:49:131
332893999216511,2153cyclictest3333718-21kworker/0:1+events19:25:070
332894199216410,2151cyclictest3417822-21kworker/1:0+events23:44:421
332894199216410,2151cyclictest3365037-21kworker/1:2+events21:49:591
33289479921637,2153cyclictest3419494-21kworker/3:0+events00:06:073
33289399921619,2149cyclictest3405254-21kworker/0:0+events23:25:540
332894199216011,2145cyclictest3381186-21kworker/1:0+events21:50:211
332894199216010,2147cyclictest3385887-21kworker/1:3+events22:09:421
33289479921597,2149cyclictest3364978-21kworker/3:1+events20:59:553
33289399921599,2147cyclictest3337217-21kworker/0:1+events19:41:330
332893999215910,2146cyclictest3379363-21kworker/0:1+events21:47:400
332894199215811,2144cyclictest3355343-21kworker/1:2+events20:46:541
332893999215811,2143cyclictest3346976-21kworker/0:1+events20:11:470
332893999215810,2145cyclictest3376047-21kworker/0:0+events21:36:340
332894199215711,2143cyclictest3401772-21kworker/1:0+events22:58:081
332894199215711,2142cyclictest3425738-21kworker/1:2+events00:12:311
332894199215710,2144cyclictest3417822-21kworker/1:0+events23:49:211
332893999215711,2142cyclictest3340801-21kworker/0:2+events19:51:050
332894199215611,2142cyclictest3409572-21kworker/1:2+events23:39:441
332893999215611,2141cyclictest3411106-21kworker/0:1+events23:38:090
332893999215610,2143cyclictest3369553-21kworker/0:2+events21:22:030
332893999215610,2143cyclictest3363550-21kworker/0:0+events21:09:140
332894199215511,2141cyclictest3432029-21kworker/1:1+events00:28:461
332894199215511,2140cyclictest3347125-21kworker/1:2+events20:13:201
332894199215510,2141cyclictest3374317-21kworker/1:1+events21:27:431
332893999215511,2141cyclictest3409423-21kworker/0:2+events23:18:190
332893999215510,2142cyclictest3355310-21kworker/0:0+events20:31:360
33289419921548,2142cyclictest3390554-21kworker/1:0+events22:19:181
332893999215411,2140cyclictest3398556-21kworker/0:1+events22:44:430
33289399921539,2141cyclictest3374381-21kworker/0:1+events21:32:200
332893999215311,2139cyclictest3424171-21kworker/0:2+events00:11:000
332893999215311,2139cyclictest3340801-21kworker/0:2+events19:47:170
332894199215211,2138cyclictest3365037-21kworker/1:2+events21:57:111
33289399921529,2140cyclictest3340801-21kworker/0:2+events20:06:460
33289399921525,2144cyclictest3407822-21kworker/0:1+events23:11:300
332893999215211,2138cyclictest3385914-21kworker/0:2+events22:08:100
332893999215110,2139cyclictest3367931-21kworker/0:1+events21:10:030
332893999215110,2137cyclictest3433543-21kworker/0:0+events00:38:160
33289399921428,2131cyclictest3431941-21kworker/0:1+events00:29:540
332893999214210,2129cyclictest3414471-21kworker/0:0+events23:47:030
33289399921419,2129cyclictest3333718-21kworker/0:1+events19:23:150
332893999214110,2128cyclictest3358589-21kworker/0:1+events20:44:130
332893999214011,2126cyclictest3424171-21kworker/0:2+events00:34:260
332893999214010,2127cyclictest3346976-21kworker/0:1+events20:15:370
33289399921397,2129cyclictest3422428-21kworker/0:0+events00:07:350
332893999213911,2124cyclictest3358589-21kworker/0:1+events20:51:540
332893999213711,2123cyclictest3390430-21kworker/0:0+events22:33:420
332893999213711,2123cyclictest3335348-21kworker/0:2+events19:35:270
332893999213011,2116cyclictest3369553-21kworker/0:2+events21:25:270
332894199212911,2115cyclictest3343862-21kworker/1:2+events19:58:191
332894799212811,2114cyclictest3427189-21kworker/3:2+events00:12:553
332893999212511,2111cyclictest3381003-21kworker/0:0+events22:04:010
332894199212410,2111cyclictest3395415-21kworker/1:2+events22:40:111
33289459921229,2109cyclictest3366659-21kworker/2:1+events21:14:102
332894799211911,2105cyclictest3391996-21kworker/3:0+events22:36:473
332893999211510,2102cyclictest3398556-21kworker/0:1+events22:53:570
332894799210910,2095cyclictest3363355-21kworker/3:2+events21:02:373
332894799210811,2094cyclictest3333864-21kworker/3:2+events19:41:563
332893999210710,2094cyclictest3343650-21kworker/0:1+events19:55:160
33289459921069,2094cyclictest3333599-21kworker/2:1+events19:31:582
332894799210311,2088cyclictest3330195-21kworker/3:2+events19:17:573
33289419921039,2090cyclictest3328571-21kworker/1:2+events19:17:341
33289459920978,2086cyclictest3387457-21kworker/2:0+events22:19:402
332894799209311,2079cyclictest3371487-21kworker/3:1+events21:26:593
33289459920889,2076cyclictest3411286-21kworker/2:2+events23:46:162
332894599208110,2069cyclictest3368305-21kworker/2:2+events21:20:102
33289459920808,2069cyclictest3427101-21kworker/2:2+events00:14:472
33289399920799,2067cyclictest3346976-21kworker/0:1+events20:26:380
33289459920748,2063cyclictest3409665-21kworker/2:1+events23:21:432
332894199207310,2060cyclictest3387549-21kworker/1:1+events22:13:561
33289459920714,2063cyclictest3371183-21kworker/2:0+events21:19:012
33289459920676,2058cyclictest3343775-21kworker/2:2+events19:55:392
33289459920673,2060cyclictest3340500-21kworker/2:1+events19:42:172
33289459920649,2052cyclictest3355522-21kworker/2:0+events20:32:002
33289419920609,2048cyclictest3353741-21kworker/1:1+events20:22:521
332894599205910,2046cyclictest3325351-21kworker/2:0+events19:20:382
332893999204410,2031cyclictest3358589-21kworker/0:1+events20:46:310
33289419920328,2021cyclictest3328571-21kworker/1:2+events19:23:391
332894199202910,2016cyclictest3392175-21kworker/1:1+events22:31:471
332894799202810,2015cyclictest3330195-21kworker/3:2+events19:14:533
33289419920278,2015cyclictest3365037-21kworker/1:2+events21:33:501
33289479920259,2014cyclictest3385946-21kworker/3:1+events22:05:083
33289479920258,2014cyclictest3347063-21kworker/3:1+events20:07:563
332894199201010,1997cyclictest3342261-21kworker/1:0+events19:52:141
332894199200810,1995cyclictest3424049-21kworker/1:0+events00:04:591
33289419920059,1993cyclictest3335379-21kworker/1:1+events19:29:201
332893999200510,1992cyclictest3328392-21kworker/0:0+events19:19:070
33289399920037,1992cyclictest3340801-21kworker/0:2+events20:02:550
33289419919986,1989cyclictest3328571-21kworker/1:2+events19:12:361
332894599199710,1984cyclictest3325351-21kworker/2:0+events19:10:422
33289419919978,1985cyclictest3401772-21kworker/1:0+events23:02:231
332894199199510,1982cyclictest3407974-21kworker/1:0+events23:21:191
33289419919935,1985cyclictest3395415-21kworker/1:2+events22:54:211
33289479919924,1985cyclictest3377657-21kworker/3:1+events21:48:033
33289419919498,1938cyclictest3365037-21kworker/1:2+events21:16:051
33289399919389,1926cyclictest3330105-21kworker/0:2+events19:14:310
33289399918969,1884cyclictest3381003-21kworker/0:0+events21:53:020
33283532142109,27sleep30-21swapper/319:05:323
33286992141110,26sleep10-21swapper/119:09:541
33286172140108,27sleep20-21swapper/219:08:512
33284852140109,25sleep00-21swapper/019:07:090
332894599231,19cyclictest3391049-21taskset22:20:142
332894599180,16cyclictest3357453-21taskset20:35:122
3328947991511,3cyclictest660-21rs:main3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional