You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 11:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Nov 03, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
342618699296514,2945cyclictest3458627-21kworker/1:1+events21:15:201
342618699295213,2934cyclictest3431171-21kworker/1:2+events19:50:201
342618399277713,2758cyclictest3495403-21kworker/0:2+events22:45:150
342618999274613,2729cyclictest3434757-21kworker/2:0+events19:40:162
342619399262712,2610cyclictest3527629-21kworker/3:0+events00:25:223
342619399259611,2581cyclictest3521318-21kworker/3:2+events00:10:253
342618699258313,2568cyclictest3524482-21kworker/1:1+events00:17:381
342618999257211,2558cyclictest3472972-21kworker/2:2+events21:50:162
342619399255412,2539cyclictest3498989-21kworker/3:0+events23:09:543
34261939925524,2544cyclictest3448838-21kworker/3:0+events20:18:463
342618699254812,2531cyclictest3475993-21kworker/1:1+events22:00:141
342618699254712,2531cyclictest3506774-21kworker/1:1+events23:20:361
342618999253211,2518cyclictest3478038-21kworker/2:1+events21:55:172
342618399252512,2510cyclictest3432807-21kworker/0:2+events19:33:050
342619399251612,2500cyclictest3461918-21kworker/3:1+events21:08:073
342618999250212,2486cyclictest3524661-21kworker/2:1+events00:37:252
34261869924970,2494cyclictest3458627-21kworker/1:1+events21:01:351
342618699249312,2478cyclictest3489067-21kworker/1:1+events22:40:391
342619399249212,2476cyclictest3453751-21kworker/3:2+events20:36:083
342618699248912,2474cyclictest3466787-21kworker/1:2+events21:21:481
342619399248111,2466cyclictest3440932-21kworker/3:0+events19:54:273
342619399247912,2463cyclictest3437715-21kworker/3:1+events20:01:233
342619399247812,2462cyclictest3492352-21kworker/3:1+events22:39:103
342618699247712,2462cyclictest3472722-21kworker/1:1+events21:35:471
34261939924769,2464cyclictest3511765-21kworker/3:0+events23:42:503
342618699246812,2453cyclictest3442350-21kworker/1:1+events19:57:071
342619399246511,2451cyclictest3492352-21kworker/3:1+events22:51:193
342618699246512,2450cyclictest3471137-21kworker/1:0+events21:29:461
342618699246511,2450cyclictest3526116-21kworker/1:0+events00:27:181
342619399246412,2449cyclictest3523421-21kworker/3:1+events00:15:203
342619399246312,2448cyclictest3458308-21kworker/3:1+events20:49:023
342619399246311,2449cyclictest3485687-21kworker/3:0+events22:32:393
342618699246312,2448cyclictest3431171-21kworker/1:2+events19:23:311
342619399246111,2446cyclictest3511765-21kworker/3:0+events23:38:133
342618699246112,2446cyclictest3434671-21kworker/1:0+events19:40:381
342619399246012,2444cyclictest3477682-21kworker/3:1+events21:53:463
342619399246010,2447cyclictest3459938-21kworker/3:0+events20:55:553
342618399246011,2445cyclictest3477443-21kworker/0:0+events21:52:360
342619399245912,2444cyclictest3431112-21kworker/3:1+events19:27:223
342619399245912,2443cyclictest3484083-21kworker/3:1+events22:11:433
342618399245112,2436cyclictest3508379-21kworker/0:1+events23:26:480
342618399245112,2435cyclictest3477443-21kworker/0:0+events22:23:560
342618399245012,2435cyclictest3439249-21kworker/0:1+events20:14:330
342618399244912,2434cyclictest3515742-21kworker/0:0+events23:51:200
342618399244911,2435cyclictest3497265-21kworker/0:0+events23:23:420
342618399244712,2432cyclictest3453460-21kworker/0:1+events20:40:200
342618399244410,2430cyclictest3444221-21kworker/0:0+events20:04:480
342618399243512,2419cyclictest3453460-21kworker/0:1+events20:34:150
342619399242911,2415cyclictest3500621-21kworker/3:2+events23:00:263
342618999242811,2413cyclictest3487448-21kworker/2:2+events22:23:112
342618999242612,2411cyclictest3444188-21kworker/2:1+events20:20:382
342618699242610,2412cyclictest3481006-21kworker/1:2+events22:05:581
342618999242211,2408cyclictest3521196-21kworker/2:2+events00:08:532
342618999242211,2407cyclictest3482277-21kworker/2:2+events22:12:072
342618999242210,2408cyclictest3466361-21kworker/2:2+events21:23:412
342618699242112,2406cyclictest3497657-21kworker/1:1+events22:51:421
342618999241811,2404cyclictest3429573-21kworker/2:2+events19:46:272
342618699241811,2403cyclictest3448683-21kworker/1:1+events20:20:141
342618999241112,2396cyclictest3521196-21kworker/2:2+events00:12:152
342618999241112,2395cyclictest3513344-21kworker/2:0+events23:43:562
342619399240911,2395cyclictest3458308-21kworker/3:1+events20:50:113
342619399240910,2395cyclictest3521318-21kworker/3:2+events00:30:363
342618999240812,2393cyclictest3440873-21kworker/2:1+events19:53:212
342618999240611,2392cyclictest3485806-21kworker/2:1+events22:19:012
34261839924059,2393cyclictest3497265-21kworker/0:0+events23:14:020
342618699240410,2390cyclictest3431171-21kworker/1:2+events19:27:451
342618999240211,2388cyclictest3459906-21kworker/2:2+events21:02:432
342618399240211,2389cyclictest3511586-21kworker/0:2+events23:35:060
342618699239311,2379cyclictest3453691-21kworker/1:2+events20:44:531
342619399238111,2366cyclictest3485687-21kworker/3:0+events22:25:253
342618399237310,2360cyclictest3449019-21kworker/0:2+events20:47:540
342619399236411,2350cyclictest3420892-21kworker/3:0+events19:20:313
342618399236212,2347cyclictest3497265-21kworker/0:0+events23:32:260
342619399234412,2329cyclictest3521318-21kworker/3:2+events00:37:043
342618999234211,2328cyclictest3517942-21kworker/2:0+events23:58:132
342619399233912,2324cyclictest3432741-21kworker/3:0+events19:41:493
342618399233710,2323cyclictest3487476-21kworker/0:1+events22:41:020
342619399233011,2315cyclictest3475870-21kworker/3:2+events22:02:323
342619399232412,2309cyclictest3471403-21kworker/3:2+events21:30:313
34261839923229,2310cyclictest3458369-21kworker/0:1+events21:05:250
342618999232112,2306cyclictest3489126-21kworker/2:0+events22:40:162
342618399232011,2306cyclictest3489097-21kworker/0:2+events22:34:350
342618999231711,2303cyclictest3461831-21kworker/2:1+events21:15:442
34261869923095,2301cyclictest3475993-21kworker/1:1+events21:48:231
342618399229910,2285cyclictest3459969-21kworker/0:0+events20:53:590
342618399229311,2279cyclictest3531165-21kworker/0:1+events00:38:340
342618999229211,2279cyclictest3442561-21kworker/2:0+events20:00:132
342618699228710,2274cyclictest3500526-21kworker/1:0+events23:09:311
342619399228410,2270cyclictest3453751-21kworker/3:2+events21:04:183
342618699227811,2264cyclictest3444042-21kworker/1:0+events20:08:101
342618699227511,2261cyclictest3456946-21kworker/1:0+events20:53:361
342618699227412,2259cyclictest3484049-21kworker/1:0+events22:20:301
342619399227311,2258cyclictest3437715-21kworker/3:1+events19:57:533
342619399227211,2258cyclictest3461918-21kworker/3:1+events21:17:393
342619399227211,2258cyclictest3432741-21kworker/3:0+events19:34:583
342618699227210,2259cyclictest3431171-21kworker/1:2+events19:31:351
342618699227111,2256cyclictest3452002-21kworker/1:1+events20:28:371
342619399227010,2257cyclictest3498989-21kworker/3:0+events22:56:113
342619399227010,2257cyclictest3492352-21kworker/3:1+events22:41:263
342618699227011,2256cyclictest3489067-21kworker/1:1+events22:30:251
342618699227011,2256cyclictest3472722-21kworker/1:1+events21:31:391
342619399226911,2255cyclictest3514792-21kworker/3:1+events23:57:253
342619399226911,2255cyclictest3473033-21kworker/3:1+events21:38:503
342618699226911,2255cyclictest3503841-21kworker/1:2+events23:10:391
342619399226810,2255cyclictest3448838-21kworker/3:0+events20:22:313
342619399226711,2254cyclictest3514792-21kworker/3:1+events23:50:103
342619399226711,2253cyclictest3475870-21kworker/3:2+events21:48:453
342619399226711,2252cyclictest3439329-21kworker/3:2+events19:48:253
342618699226711,2252cyclictest3458627-21kworker/1:1+events21:08:521
342619399226611,2251cyclictest3434789-21kworker/3:2+events19:39:103
342619399226611,2251cyclictest3434789-21kworker/3:2+events19:39:103
342619399226610,2253cyclictest3492352-21kworker/3:1+events22:47:293
342619399226610,2253cyclictest3452125-21kworker/3:0+events20:34:373
342618699226611,2252cyclictest3497657-21kworker/1:1+events23:04:121
342618699226611,2251cyclictest3475993-21kworker/1:1+events21:56:251
34261839922669,2253cyclictest3529449-21kworker/0:2+events00:32:560
342619399226511,2251cyclictest3518003-21kworker/3:0+events00:08:073
342619399226511,2251cyclictest3437715-21kworker/3:1+events20:11:573
342619399226510,2251cyclictest3475870-21kworker/3:2+events22:09:493
342618699226511,2251cyclictest3516489-21kworker/1:0+events23:50:571
342619399226411,2250cyclictest3505263-21kworker/3:2+events23:24:043
342618699226411,2249cyclictest3500526-21kworker/1:0+events23:27:581
342618699226411,2249cyclictest3456946-21kworker/1:0+events20:48:391
34261869922639,2251cyclictest3456946-21kworker/1:0+events20:57:051
342618699226311,2249cyclictest3489067-21kworker/1:1+events22:35:431
342618699226310,2251cyclictest3485746-21kworker/1:1+events22:15:081
342619399226211,2248cyclictest3505263-21kworker/3:2+events23:29:243
34261839922629,2250cyclictest3492541-21kworker/0:0+events22:38:000
342618699226111,2246cyclictest3524482-21kworker/1:1+events00:21:101
342618699226110,2249cyclictest3510192-21kworker/1:1+events23:45:061
342619399225711,2243cyclictest3487324-21kworker/3:2+events22:21:413
342618999225610,2242cyclictest3502180-21kworker/2:2+events23:28:402
342618399225510,2241cyclictest3526209-21kworker/0:1+events00:28:240
34261939922544,2247cyclictest3502569-21kworker/3:1+events23:12:343
34261939922509,2237cyclictest3461918-21kworker/3:1+events21:13:503
342619399224911,2235cyclictest3502569-21kworker/3:1+events23:17:313
342619399224811,2234cyclictest3475870-21kworker/3:2+events21:59:063
342619399224511,2231cyclictest3505263-21kworker/3:2+events23:31:403
342618399224511,2232cyclictest3471376-21kworker/0:1+events21:30:080
342618399224511,2231cyclictest3513377-21kworker/0:1+events23:42:260
342618399224511,2230cyclictest3519427-21kworker/0:1+events23:57:480
34261939922449,2232cyclictest3518003-21kworker/3:0+events00:00:313
34261939922449,2232cyclictest3518003-21kworker/3:0+events00:00:303
342619399224410,2231cyclictest3514792-21kworker/3:1+events23:48:123
342618699223911,2226cyclictest3474333-21kworker/1:0+events21:42:191
342619399223710,2223cyclictest3450520-21kworker/3:1+events20:29:013
342618999223710,2223cyclictest3502180-21kworker/2:2+events23:37:492
342618699223611,2222cyclictest3448683-21kworker/1:1+events20:16:281
34261839922339,2221cyclictest3497265-21kworker/0:0+events23:18:410
34261839922339,2221cyclictest3477443-21kworker/0:0+events21:59:500
342618399223211,2218cyclictest3447411-21kworker/0:0+events20:17:590
342618399223210,2218cyclictest3466396-21kworker/0:2+events21:23:180
342618399223011,2216cyclictest3458369-21kworker/0:1+events20:55:310
342618399223010,2217cyclictest3515742-21kworker/0:0+events00:09:170
342618399222911,2214cyclictest3435050-21kworker/0:0+events19:47:380
34261839922288,2217cyclictest3449019-21kworker/0:2+events20:35:470
342618399222711,2213cyclictest3513377-21kworker/0:1+events23:45:310
342618399222711,2213cyclictest3489097-21kworker/0:2+events22:29:380
342618399222710,2214cyclictest3466396-21kworker/0:2+events21:29:020
342618999222611,2213cyclictest3497235-21kworker/2:1+events22:50:092
34261839922268,2215cyclictest3522709-21kworker/0:1+events00:10:020
342618399222611,2212cyclictest3471376-21kworker/0:1+events21:46:520
342618399222610,2213cyclictest3498899-21kworker/0:1+events22:55:480
342618399222610,2213cyclictest3444221-21kworker/0:0+events20:07:240
34261839922259,2212cyclictest3432807-21kworker/0:2+events19:28:550
342618399222510,2211cyclictest3515742-21kworker/0:0+events00:18:020
342618399222411,2210cyclictest3425844-21kworker/0:1+events19:20:520
342618399222410,2211cyclictest3477443-21kworker/0:0+events22:05:140
342618399222311,2209cyclictest3502299-21kworker/0:1+events23:07:380
342618399222311,2209cyclictest3466396-21kworker/0:2+events21:16:530
342618399222310,2210cyclictest3521077-21kworker/0:2+events00:03:550
342618399222310,2210cyclictest3521077-21kworker/0:2+events00:03:550
342618399222211,2208cyclictest3474900-21kworker/0:2+events21:41:080
342618999222011,2206cyclictest3524661-21kworker/2:1+events00:34:492
342618999222010,2207cyclictest3461831-21kworker/2:1+events21:06:592
342618699221911,2205cyclictest3511902-21kworker/1:0+events23:35:531
342618399221910,2206cyclictest3439249-21kworker/0:1+events20:23:160
342618399221610,2202cyclictest3500652-21kworker/0:2+events23:01:330
342618999221510,2202cyclictest3502180-21kworker/2:2+events23:04:342
34261899922133,2207cyclictest3459906-21kworker/2:2+events20:58:322
342618999221011,2196cyclictest3442561-21kworker/2:0+events20:07:002
34261839922096,2200cyclictest3477443-21kworker/0:0+events22:10:130
34261839922037,2193cyclictest3435050-21kworker/0:0+events19:43:460
342618999220211,2187cyclictest3434757-21kworker/2:0+events19:38:022
342618999220211,2187cyclictest3434757-21kworker/2:0+events19:38:022
342618999220011,2186cyclictest3485806-21kworker/2:1+events22:26:352
342618999220011,2186cyclictest3471253-21kworker/2:1+events21:36:552
342618699220011,2186cyclictest3518092-21kworker/1:1+events00:04:181
342618699220011,2186cyclictest3518092-21kworker/1:1+events00:04:181
342618999219811,2184cyclictest3444188-21kworker/2:1+events20:43:232
34261899921979,2185cyclictest3482277-21kworker/2:2+events22:07:082
342618999219710,2184cyclictest3456829-21kworker/2:0+events20:46:252
342618999219611,2181cyclictest3489126-21kworker/2:0+events22:35:222
34261899921958,2184cyclictest3502180-21kworker/2:2+events23:22:322
342618999219511,2181cyclictest3429573-21kworker/2:2+events19:58:152
34261899921949,2181cyclictest3490757-21kworker/2:2+events22:34:112
342618999219311,2179cyclictest3489126-21kworker/2:0+events22:58:082
342618399219210,2178cyclictest3477443-21kworker/0:0+events22:02:550
342618999219011,2176cyclictest3444188-21kworker/2:1+events20:16:502
342618999219010,2177cyclictest3515072-21kworker/2:1+events23:47:252
342618999218611,2172cyclictest3502180-21kworker/2:2+events23:06:542
34261899921849,2172cyclictest3471253-21kworker/2:1+events21:34:172
34261899921849,2172cyclictest3444188-21kworker/2:1+events20:37:162
34261839921849,2172cyclictest3473002-21kworker/0:0+events21:36:100
342618999218311,2169cyclictest3466361-21kworker/2:2+events21:25:372
342618999218211,2168cyclictest3526305-21kworker/2:2+events00:21:552
342618999218111,2167cyclictest3461831-21kworker/2:1+events21:14:142
342618699217910,2166cyclictest3479286-21kworker/1:0+events21:54:551
342619399217210,2159cyclictest3437715-21kworker/3:1+events20:05:323
342618999217211,2158cyclictest3503781-21kworker/2:1+events23:12:112
342618999216411,2150cyclictest3524661-21kworker/2:1+events00:25:442
342618699216210,2149cyclictest3444042-21kworker/1:0+events20:38:021
342618999216010,2147cyclictest3474602-21kworker/2:0+events21:44:572
342619399215711,2142cyclictest3429481-21kworker/3:2+events19:17:023
342619399215210,2139cyclictest3521318-21kworker/3:2+events00:21:323
342618399214911,2135cyclictest3461817-21kworker/0:2+events21:03:070
342618699213710,2124cyclictest3531319-21kworker/1:0+events00:38:571
342618399213610,2123cyclictest3439249-21kworker/0:1+events19:53:430
342618699213010,2117cyclictest3489067-21kworker/1:1+events22:26:121
34261899921255,2118cyclictest3429573-21kworker/2:2+events19:20:072
34261839921227,2112cyclictest3497265-21kworker/0:0+events22:52:030
342619399211910,2106cyclictest3469802-21kworker/3:0+events21:43:033
342619399211510,2102cyclictest3485687-21kworker/3:0+events22:17:293
34261869921139,2101cyclictest3431171-21kworker/1:2+events19:39:541
34261869921139,2101cyclictest3431171-21kworker/1:2+events19:39:541
342618699211310,2100cyclictest3500526-21kworker/1:0+events22:58:311
342618999211210,2099cyclictest3450606-21kworker/2:2+events20:26:432
34261869921127,2102cyclictest3522592-21kworker/1:2+events00:11:551
342618699211210,2099cyclictest3444042-21kworker/1:0+events20:30:311
34261869921119,2099cyclictest3514612-21kworker/1:2+events23:41:191
342619399210910,2097cyclictest3469802-21kworker/3:0+events21:26:233
342618999210910,2096cyclictest3478038-21kworker/2:1+events22:01:472
342618699210910,2096cyclictest3508498-21kworker/1:2+events23:32:481
34261839921098,2098cyclictest3439249-21kworker/0:1+events19:56:440
342619399210810,2095cyclictest3420892-21kworker/3:0+events19:14:193
342619399210710,2094cyclictest3461918-21kworker/3:1+events21:24:053
342618699210710,2094cyclictest3424268-21kworker/1:1+events19:12:461
342618699210610,2093cyclictest3522592-21kworker/1:2+events00:09:411
342618699210310,2090cyclictest3529479-21kworker/1:1+events00:31:231
342618699210210,2089cyclictest3516489-21kworker/1:0+events23:57:041
342618699210110,2089cyclictest3445729-21kworker/1:2+events20:11:351
342618999210011,2086cyclictest3424301-21kworker/2:1+events19:17:252
34261839921008,2089cyclictest3526209-21kworker/0:1+events00:24:110
342618399210011,2086cyclictest3427637-21kworker/0:2+events19:17:490
34261869920999,2087cyclictest3424268-21kworker/1:1+events19:15:061
342619399209610,2082cyclictest3452125-21kworker/3:0+events20:43:443
342618699209410,2081cyclictest3500526-21kworker/1:0+events23:16:441
342618999209211,2078cyclictest3429573-21kworker/2:2+events19:34:362
342618699208310,2070cyclictest3431171-21kworker/1:2+events19:48:021
34261869920779,2065cyclictest3442350-21kworker/1:1+events20:01:461
342618999207510,2062cyclictest3453517-21kworker/2:0+events20:32:442
342618399207310,2060cyclictest3477443-21kworker/0:0+events22:19:220
342618999207111,2057cyclictest3445788-21kworker/2:2+events20:11:112
342618999207110,2058cyclictest3519548-21kworker/2:1+events00:03:322
342618999207110,2058cyclictest3519548-21kworker/2:1+events00:03:322
342618399207110,2058cyclictest3422554-21kworker/0:0+events19:13:570
342618999207010,2056cyclictest3502180-21kworker/2:2+events23:19:032
34261899920699,2057cyclictest3429573-21kworker/2:2+events19:25:262
34261839920668,2055cyclictest3425844-21kworker/0:1+events19:36:290
34261839920668,2055cyclictest3425844-21kworker/0:1+events19:36:280
34261899920658,2053cyclictest3505407-21kworker/2:0+events23:30:552
342618999206510,2052cyclictest3524661-21kworker/2:1+events00:20:012
34261899920646,2055cyclictest3456829-21kworker/2:0+events20:54:462
342618999206410,2051cyclictest3517942-21kworker/2:0+events23:54:222
34261839920645,2056cyclictest3458369-21kworker/0:1+events21:14:360
34261899920488,2037cyclictest3425941-21kworker/2:0+events19:14:432
342618999204010,2027cyclictest3489126-21kworker/2:0+events22:45:582
34261899920399,2027cyclictest3474602-21kworker/2:0+events21:49:312
34261839920343,2028cyclictest3450700-21kworker/0:0+events20:25:570
34261869919668,1955cyclictest3465032-21kworker/1:0+events21:11:561
34261869919189,1906cyclictest3484049-21kworker/1:0+events22:12:291
34256762191161,25sleep00-21swapper/019:07:240
34257392171143,23sleep30-21swapper/319:08:113
34256162144109,29sleep20-21swapper/219:06:372
34256102142108,31sleep10-21swapper/119:06:331
3426186991411,2cyclictest3496793-21ntpq22:45:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional