You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 19:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Mon Dec 08, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321658899303415,3015cyclictest3301880-21kworker/1:1+events23:35:011
321659399299113,2974cyclictest3218630-21kworker/3:2+events19:24:303
321659399285313,2837cyclictest3229801-21kworker/3:1+events20:15:143
321659199282613,2809cyclictest3228139-21kworker/2:2+events20:05:182
321659199280013,2782cyclictest3287584-21kworker/2:0+events22:50:002
321658499276010,2746cyclictest3258251-21kworker/0:2+events21:25:170
321658899270512,2688cyclictest3301880-21kworker/1:1+events00:30:111
321659399266813,2650cyclictest3300263-21kworker/3:2+events00:15:183
321659399263913,2622cyclictest3289550-21kworker/3:0+events23:05:193
321659199260012,2583cyclictest3241057-21kworker/2:2+events20:45:152
321659199260012,2583cyclictest3241057-21kworker/2:2+events20:45:142
321658499257112,2556cyclictest3312977-21kworker/0:1+events00:10:440
321659199254212,2526cyclictest3266566-21kworker/2:2+events21:50:172
321659399254010,2525cyclictest3312851-21kworker/3:1+events00:10:193
321659199253011,2517cyclictest3244020-21kworker/2:1+events20:55:342
321658499251212,2497cyclictest3283951-21kworker/0:1+events22:39:220
321659199249213,2476cyclictest3306633-21kworker/2:2+events23:58:232
321659199248712,2472cyclictest3221592-21kworker/2:2+events19:28:432
321659199248211,2467cyclictest3244020-21kworker/2:1+events20:50:582
321659199248111,2467cyclictest3228139-21kworker/2:2+events19:55:012
321658499247912,2464cyclictest3261593-21kworker/0:1+events21:34:220
321659199247812,2463cyclictest3303213-21kworker/2:0+events23:49:142
321658499247512,2460cyclictest3235695-21kworker/0:0+events20:17:530
321659199246012,2444cyclictest3309921-21kworker/2:1+events00:04:342
321659199245711,2443cyclictest3321165-21kworker/2:0+events00:38:342
321658899245412,2437cyclictest3301880-21kworker/1:1+events23:55:201
321659199245311,2439cyclictest3272883-21kworker/2:2+events22:01:342
321659199244912,2434cyclictest3319535-21kworker/2:1+events00:29:502
321659199244712,2432cyclictest3263075-21kworker/2:1+events21:42:432
321659199244410,2430cyclictest3276061-21kworker/2:1+events22:16:062
321659199242112,2405cyclictest3298586-21kworker/2:2+events23:40:162
321658899242112,2405cyclictest3263107-21kworker/1:2+events21:41:131
321659199240111,2385cyclictest3292452-21kworker/2:2+events23:10:162
321658899239611,2381cyclictest3263107-21kworker/1:2+events21:56:161
321658899238812,2373cyclictest3294027-21kworker/1:0+events23:15:151
321659199238710,2374cyclictest3300341-21kworker/2:1+events23:34:362
321658499238712,2372cyclictest3240908-21kworker/0:1+events20:38:440
321658499238012,2365cyclictest3300131-21kworker/0:1+events23:30:260
321658899235012,2334cyclictest3301880-21kworker/1:1+events00:24:291
32165849923479,2334cyclictest3245681-21kworker/0:2+events20:42:110
321658899234012,2324cyclictest3280950-21kworker/1:2+events23:07:141
321658899233712,2322cyclictest3247367-21kworker/1:1+events21:07:471
321659399232511,2311cyclictest3245439-21kworker/3:0+events20:56:423
321659399231911,2305cyclictest3285601-21kworker/3:2+events22:50:233
321658499231812,2302cyclictest3312977-21kworker/0:1+events00:20:160
321659399231211,2298cyclictest3293785-21kworker/3:1+events23:12:083
321659399231111,2296cyclictest3237387-21kworker/3:2+events20:30:203
321659399230812,2293cyclictest3289550-21kworker/3:0+events23:01:293
321659399230712,2292cyclictest3300263-21kworker/3:2+events00:02:403
321658899228212,2266cyclictest3285572-21kworker/1:0+events22:42:411
321658499227210,2259cyclictest3240908-21kworker/0:1+events20:33:470
32165849922698,2258cyclictest3240908-21kworker/0:1+events20:53:160
32165889922687,2257cyclictest3309624-21kworker/1:0+events00:00:211
321658499226811,2254cyclictest3279494-21kworker/0:2+events22:32:040
321659399226711,2252cyclictest3253497-21kworker/3:1+events21:07:243
321659199226710,2253cyclictest3244020-21kworker/2:1+events20:39:062
321658499226610,2253cyclictest3249008-21kworker/0:0+events21:08:580
321659199226310,2250cyclictest3294295-21kworker/2:0+events23:25:522
321658499226311,2249cyclictest3274787-21kworker/0:0+events22:26:200
321658499226311,2249cyclictest3231224-21kworker/0:0+events19:58:480
321659399226210,2249cyclictest3234182-21kworker/3:0+events20:09:573
321658499225511,2240cyclictest3239024-21kworker/0:2+events20:27:220
321658499225411,2240cyclictest3297267-21kworker/0:0+events23:21:190
321659399225310,2240cyclictest3269466-21kworker/3:0+events21:54:003
32165849922539,2241cyclictest3274787-21kworker/0:0+events22:13:020
321658499225311,2239cyclictest3283951-21kworker/0:1+events22:46:320
32165849922528,2241cyclictest3274787-21kworker/0:0+events22:17:580
321658499225011,2236cyclictest3240908-21kworker/0:1+events20:57:060
321658499225010,2237cyclictest3239024-21kworker/0:2+events20:23:140
321658499224310,2229cyclictest3266299-21kworker/0:1+events21:43:300
321658499224211,2228cyclictest3309535-21kworker/0:0+events23:56:530
321658499223810,2225cyclictest3273151-21kworker/0:2+events22:10:010
321658499223210,2220cyclictest3232827-21kworker/0:2+events20:05:420
321658499223111,2217cyclictest3249008-21kworker/0:0+events21:16:140
321659199223011,2217cyclictest3252922-21kworker/2:0+events21:10:082
32165919922259,2212cyclictest3290825-21kworker/2:0+events23:03:232
321659199222411,2210cyclictest3264943-21kworker/2:0+events21:48:262
321658899221912,2204cyclictest3289101-21kworker/1:0+events22:56:321
32165919922167,2205cyclictest3312821-21kworker/2:0+events00:23:212
321658499221510,2202cyclictest3303313-21kworker/0:2+events23:50:450
321658899221311,2199cyclictest3289101-21kworker/1:0+events22:53:301
321659199220211,2187cyclictest3298586-21kworker/2:2+events23:24:002
32165919922018,2190cyclictest3250643-21kworker/2:2+events21:00:272
32165939921909,2178cyclictest3304865-21kworker/3:1+events23:44:483
321659399219011,2176cyclictest3258313-21kworker/3:0+events21:29:013
32165889921907,2180cyclictest3242448-21kworker/1:0+events20:49:511
32165889921907,2180cyclictest3242448-21kworker/1:0+events20:49:501
321658499218710,2174cyclictest3240908-21kworker/0:1+events20:47:290
321658499218710,2174cyclictest3240908-21kworker/0:1+events20:47:290
321658899218510,2172cyclictest3301880-21kworker/1:1+events23:53:491
32165849921843,2177cyclictest3266299-21kworker/0:1+events21:46:090
321659199218210,2169cyclictest3317929-21kworker/2:2+events00:32:492
321658899217911,2164cyclictest3301880-21kworker/1:1+events00:05:191
321658499217710,2165cyclictest3303313-21kworker/0:2+events23:45:080
321658899217611,2162cyclictest3263107-21kworker/1:2+events21:37:261
32165919921757,2165cyclictest3244020-21kworker/2:1+events20:41:462
321658499216910,2156cyclictest3290555-21kworker/0:2+events23:08:460
321658899216510,2152cyclictest3259902-21kworker/1:0+events21:33:591
321658499216411,2150cyclictest3267896-21kworker/0:2+events21:52:540
32165849921578,2146cyclictest3256653-21kworker/0:1+events21:13:120
321658899215510,2142cyclictest3321012-21kworker/1:0+events00:36:141
32165849921546,2145cyclictest3300131-21kworker/0:1+events23:40:390
321659199215310,2140cyclictest3250643-21kworker/2:2+events21:33:362
321658899215111,2137cyclictest3250301-21kworker/1:2+events20:52:541
32165919921509,2137cyclictest3276061-21kworker/2:1+events22:14:342
321658899214910,2136cyclictest3295665-21kworker/1:2+events23:20:561
321658899214410,2131cyclictest3240847-21kworker/1:1+events20:23:591
321658899214011,2126cyclictest3252052-21kworker/1:0+events21:04:211
321658899214011,2125cyclictest3314312-21kworker/1:0+events00:14:101
321658899214011,2125cyclictest3252052-21kworker/1:0+events21:13:331
321658899214010,2128cyclictest3247367-21kworker/1:1+events20:55:111
321658899213911,2125cyclictest3277811-21kworker/1:0+events22:24:021
321658899213910,2126cyclictest3263107-21kworker/1:2+events22:00:271
321658899213811,2124cyclictest3219849-21kworker/1:2+events19:20:221
321658899213711,2123cyclictest3238927-21kworker/1:2+events20:17:301
321659399213211,2118cyclictest3218630-21kworker/3:2+events19:38:133
321658899213211,2118cyclictest3280950-21kworker/1:2+events22:28:391
32165919921319,2118cyclictest3272883-21kworker/2:2+events22:09:142
32165919921308,2119cyclictest3241057-21kworker/2:2+events20:28:482
32165919921278,2116cyclictest3277900-21kworker/2:2+events22:22:532
321659399212610,2112cyclictest3266385-21kworker/3:1+events22:05:003
321658899212611,2112cyclictest3258222-21kworker/1:1+events21:29:251
321658899212611,2111cyclictest3277811-21kworker/1:0+events22:19:071
321658899212510,2111cyclictest3280950-21kworker/1:2+events23:03:011
321659199212110,2108cyclictest3226163-21kworker/2:0+events19:45:082
321659399211910,2106cyclictest3276356-21kworker/3:2+events22:19:493
321658499211710,2103cyclictest3271529-21kworker/0:1+events22:04:140
321659399211611,2102cyclictest3229801-21kworker/3:1+events20:29:123
321658899211611,2101cyclictest3301880-21kworker/1:1+events23:47:001
321658499211610,2103cyclictest3317273-21kworker/0:0+events00:29:060
321658499211610,2103cyclictest3283951-21kworker/0:1+events22:40:520
32165849921159,2103cyclictest3232827-21kworker/0:2+events20:01:060
321658499211510,2102cyclictest3300131-21kworker/0:1+events23:38:480
321658499211510,2102cyclictest3228018-21kworker/0:2+events19:52:460
32165919921149,2102cyclictest3284011-21kworker/2:1+events22:37:292
321658899211411,2100cyclictest3273508-21kworker/1:0+events22:10:241
32165849921146,2105cyclictest3249008-21kworker/0:0+events21:00:520
321658499211410,2101cyclictest3295538-21kworker/0:1+events23:15:590
32165849921137,2103cyclictest3287966-21kworker/0:0+events22:53:070
32165919921129,2100cyclictest3306633-21kworker/2:2+events23:53:032
321658499211110,2098cyclictest3292270-21kworker/0:0+events23:12:320
321658499211110,2098cyclictest3222775-21kworker/0:1+events19:36:410
32165849921098,2098cyclictest3219881-21kworker/0:0+events19:27:340
321659399210810,2095cyclictest3314525-21kworker/3:0+events00:22:343
321659399210711,2093cyclictest3308066-21kworker/3:1+events23:54:573
321659199210711,2093cyclictest3312821-21kworker/2:0+events00:17:582
32165849921078,2096cyclictest3217865-21kworker/0:1+events19:15:470
32165849921077,2097cyclictest3319292-21kworker/0:2+events00:39:200
321659399210611,2092cyclictest3293785-21kworker/3:1+events23:16:223
321659399210611,2092cyclictest3245439-21kworker/3:0+events20:44:053
321659399210510,2091cyclictest3298677-21kworker/3:1+events23:26:173
32165939921049,2092cyclictest3273211-21kworker/3:0+events22:34:453
32165939921042,2099cyclictest3273211-21kworker/3:0+events22:24:483
321659399210411,2090cyclictest3222835-21kworker/3:1+events19:27:563
321659199210410,2090cyclictest3312821-21kworker/2:0+events00:13:022
321658899210411,2090cyclictest3295665-21kworker/1:2+events23:42:541
321658899210410,2091cyclictest3242448-21kworker/1:0+events20:39:291
321659399210311,2089cyclictest3295384-21kworker/3:0+events23:23:373
321659399210311,2088cyclictest3222835-21kworker/3:1+events19:30:113
32165919921039,2091cyclictest3234124-21kworker/2:0+events20:21:402
321659199210310,2090cyclictest3252922-21kworker/2:0+events21:05:312
32165939921029,2090cyclictest3228109-21kworker/3:0+events19:45:533
32165919921019,2089cyclictest3250643-21kworker/2:2+events21:22:582
321659199210010,2087cyclictest3294295-21kworker/2:0+events23:15:372
32165919920997,2089cyclictest3277900-21kworker/2:2+events22:53:522
32165919920992,2094cyclictest3284011-21kworker/2:1+events22:43:262
32165849920996,2090cyclictest3224378-21kworker/0:2+events19:33:400
321659199209810,2085cyclictest3237328-21kworker/2:2+events20:13:202
32165849920989,2086cyclictest3290555-21kworker/0:2+events22:58:490
321659399209611,2082cyclictest3253497-21kworker/3:1+events21:10:323
32165919920967,2086cyclictest3282404-21kworker/2:0+events22:32:502
321658899209611,2082cyclictest3242448-21kworker/1:0+events20:30:431
32165849920969,2084cyclictest3258251-21kworker/0:2+events21:23:440
321658499209511,2081cyclictest3303313-21kworker/0:2+events00:06:280
321659199209410,2081cyclictest3292452-21kworker/2:2+events23:06:292
321659399208910,2076cyclictest3258313-21kworker/3:0+events21:21:533
32165889920898,2078cyclictest3301880-21kworker/1:1+events00:28:191
321658499208910,2076cyclictest3303313-21kworker/0:2+events00:03:010
321659399208711,2073cyclictest3245439-21kworker/3:0+events20:36:483
321659199208210,2069cyclictest3250643-21kworker/2:2+events21:16:582
32165939920808,2069cyclictest3218630-21kworker/3:2+events19:50:503
32165919920795,2071cyclictest3270945-21kworker/2:0+events21:58:082
321658899207811,2064cyclictest3295665-21kworker/1:2+events23:28:121
32165919920778,2067cyclictest3226163-21kworker/2:0+events19:40:072
32165919920759,2065cyclictest3228139-21kworker/2:2+events19:57:382
321659199207410,2061cyclictest3237328-21kworker/2:2+events20:16:202
32165849920729,2060cyclictest3269612-21kworker/0:0+events21:55:530
321659399207110,2058cyclictest3300263-21kworker/3:2+events23:59:573
32165919920707,2060cyclictest3298586-21kworker/2:2+events23:36:082
321659199206810,2055cyclictest3203508-21kworker/2:0+events19:19:582
32165919920678,2056cyclictest3224408-21kworker/2:1+events19:31:432
321659399206611,2052cyclictest3314525-21kworker/3:0+events00:26:243
321659199206610,2053cyclictest3241057-21kworker/2:2+events20:32:382
32165919920637,2053cyclictest3289194-21kworker/2:1+events22:59:352
321659399206210,2049cyclictest3237387-21kworker/3:2+events20:14:513
321658899206210,2049cyclictest3231194-21kworker/1:2+events19:54:401
321658899206111,2047cyclictest3231194-21kworker/1:2+events20:04:341
321658899205710,2044cyclictest3280950-21kworker/1:2+events22:38:121
321659199205610,2043cyclictest3250643-21kworker/2:2+events21:28:182
32165849920539,2041cyclictest3214575-21kworker/0:2+events19:23:230
321659199205010,2037cyclictest3306633-21kworker/2:2+events00:08:482
32165849920479,2035cyclictest3312977-21kworker/0:1+events00:17:360
32165849920467,2036cyclictest3235695-21kworker/0:0+events20:12:330
321659199204510,2032cyclictest3280766-21kworker/2:1+events22:27:292
32165889920445,2035cyclictest3255334-21kworker/1:2+events21:18:501
32165849920447,2034cyclictest3214575-21kworker/0:2+events19:13:520
32165919920422,2037cyclictest3216184-21kworker/2:2+events19:13:282
32165919920403,2034cyclictest3250643-21kworker/2:2+events21:38:122
32165889920408,2029cyclictest3227839-21kworker/1:2+events19:45:301
32165919920339,2021cyclictest3234124-21kworker/2:0+events20:02:392
321659199203310,2020cyclictest3221592-21kworker/2:2+events19:35:332
321659399203111,2017cyclictest3300263-21kworker/3:2+events23:35:233
32165939920298,2018cyclictest3287762-21kworker/3:1+events22:55:223
321658899202611,2012cyclictest3242448-21kworker/1:0+events20:28:271
32165849920259,2013cyclictest3290555-21kworker/0:2+events23:27:030
321659399202311,2009cyclictest3226132-21kworker/3:1+events19:43:123
32165889920239,2012cyclictest3234423-21kworker/1:0+events20:11:041
321658899202111,2007cyclictest3280950-21kworker/1:2+events22:48:041
32165919920055,1997cyclictest3219940-21kworker/2:1+events19:24:092
32165939920027,1992cyclictest3321100-21kworker/3:1+events00:36:373
32165889920029,1990cyclictest3314312-21kworker/1:0+events00:16:051
32165939920019,1989cyclictest3279223-21kworker/3:1+events22:25:583
32165889919989,1986cyclictest3255334-21kworker/1:2+events21:20:221
321658899199610,1983cyclictest3268191-21kworker/1:1+events21:54:251
32165889919865,1977cyclictest3211306-21kworker/1:1+events19:28:191
32165889919858,1974cyclictest3232795-21kworker/1:1+events19:59:581
32165939919849,1972cyclictest3273211-21kworker/3:0+events22:36:193
321658899198410,1971cyclictest3273508-21kworker/1:0+events22:07:191
321658899198410,1971cyclictest3231194-21kworker/1:2+events20:08:461
32165889919838,1972cyclictest3242448-21kworker/1:0+events20:44:521
321658899198310,1970cyclictest3294027-21kworker/1:0+events23:11:241
321658899198310,1970cyclictest3280950-21kworker/1:2+events22:34:001
32165889919828,1971cyclictest3301880-21kworker/1:1+events23:36:311
32165889919765,1968cyclictest3211306-21kworker/1:1+events19:34:261
32165889919738,1962cyclictest3227839-21kworker/1:2+events19:42:271
32165889919735,1965cyclictest3266596-21kworker/1:0+events21:45:471
321658899197310,1960cyclictest3225949-21kworker/1:0+events19:39:011
321658499196811,1954cyclictest3290555-21kworker/0:2+events23:02:380
321658899196210,1949cyclictest3211306-21kworker/1:1+events19:17:191
321659399196110,1948cyclictest3218630-21kworker/3:2+events20:00:223
32165889919619,1949cyclictest3211306-21kworker/1:1+events19:14:371
32165939919548,1943cyclictest3256686-21kworker/3:2+events21:15:503
32165939919517,1941cyclictest3216534-21kworker/3:0+events19:14:593
32165939919509,1939cyclictest3260025-21kworker/3:1+events21:30:113
32165939919508,1939cyclictest3300263-21kworker/3:2+events23:47:243
321659399195010,1936cyclictest3229801-21kworker/3:1+events19:55:233
32165849919509,1938cyclictest3226010-21kworker/0:0+events19:43:350
32165939919489,1935cyclictest3261668-21kworker/3:2+events21:41:583
321658499194810,1937cyclictest3259933-21kworker/0:0+events21:37:030
32165939919479,1935cyclictest3273211-21kworker/3:0+events22:41:383
32165939919479,1935cyclictest3261668-21kworker/3:2+events21:36:183
32165939919476,1937cyclictest3273211-21kworker/3:0+events22:46:093
32165939919469,1934cyclictest3314525-21kworker/3:0+events00:33:333
32165939919468,1935cyclictest3237387-21kworker/3:2+events20:22:043
321659399194610,1933cyclictest3273211-21kworker/3:0+events22:14:553
321659399194610,1933cyclictest3245439-21kworker/3:0+events20:50:363
32165849919427,1931cyclictest3274787-21kworker/0:0+events22:24:250
32165939919406,1931cyclictest3300263-21kworker/3:2+events00:07:383
32165939919396,1930cyclictest3300263-21kworker/3:2+events23:31:333
32165939919396,1930cyclictest3247305-21kworker/3:1+events20:45:363
32165939919396,1930cyclictest3247305-21kworker/3:1+events20:45:363
32165849919315,1923cyclictest3228018-21kworker/0:2+events19:48:550
32165939919229,1910cyclictest3218630-21kworker/3:2+events19:16:103
32165939919149,1901cyclictest3266385-21kworker/3:1+events21:56:593
32165939918874,1880cyclictest3251846-21kworker/3:2+events21:02:243
321658499150147,2cyclictest3319292-21kworker/0:2+pm00:34:540
32159752147103,26sleep10-21swapper/119:05:451
32160712141109,26sleep30-21swapper/319:06:593
32160332141110,26sleep20-21swapper/219:06:302
32161322140109,26sleep00-21swapper/019:07:440
3216593991611,2cyclictest191rcu_preempt22:05:153
321659399159,3cyclictest52-21ksoftirqd/321:45:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional