You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 21:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun Mar 15, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
330287099383017,3806cyclictest3304117-21kworker/3:0+events19:40:013
330285899281013,2792cyclictest3380204-21kworker/0:0+events23:15:150
330286699277711,2761cyclictest3365707-21kworker/2:0+events22:50:132
330286299273013,2713cyclictest3314023-21kworker/1:2+events19:50:151
330287099271513,2699cyclictest3396628-21kworker/3:0+events00:10:173
330287099270913,2692cyclictest3365473-21kworker/3:0+events22:30:183
330287099270513,2688cyclictest3370074-21kworker/3:2+events22:40:153
330285899256912,2555cyclictest3351128-21kworker/0:1+events21:40:200
330285899256212,2546cyclictest3406550-21kworker/0:2+events00:30:480
330285899254710,2533cyclictest3319004-21kworker/0:1+events20:00:550
330286299252612,2510cyclictest3314023-21kworker/1:2+events19:58:371
330285899252512,2509cyclictest3388443-21kworker/0:0+events23:38:090
330285899249612,2482cyclictest3399912-21kworker/0:0+events00:11:040
330285899249312,2478cyclictest3327318-21kworker/0:0+events20:33:350
330287099249212,2476cyclictest3396628-21kworker/3:0+events00:05:193
330286699249012,2474cyclictest3381446-21kworker/2:1+events23:26:212
330286699249010,2476cyclictest3351156-21kworker/2:0+events22:12:202
330285899248712,2472cyclictest3382286-21kworker/0:2+events23:28:380
330285899248512,2470cyclictest3391728-21kworker/0:2+events23:46:090
330285899248312,2468cyclictest3402038-21kworker/0:2+events00:18:130
330285899248212,2466cyclictest3384975-21kworker/0:1+events23:24:060
330285899248111,2467cyclictest3382286-21kworker/0:2+events23:33:140
330287099247312,2457cyclictest3383251-21kworker/3:2+events23:21:233
33028629924625,2453cyclictest3351283-21kworker/1:0+events21:43:031
330286299246112,2446cyclictest3373488-21kworker/1:2+events23:20:141
330285899245712,2441cyclictest3309289-21kworker/0:2+events19:45:190
330285899245512,2440cyclictest3300930-21kworker/0:1+events19:22:390
330285899245311,2438cyclictest3378480-21kworker/0:2+events23:04:360
330285899245111,2436cyclictest3317308-21kworker/0:0+events19:55:580
330287099244912,2435cyclictest3317339-21kworker/3:0+events19:55:143
330285899244812,2433cyclictest3335175-21kworker/0:1+events20:50:420
330287099244512,2429cyclictest3401477-21kworker/3:1+events00:36:123
330287099244511,2430cyclictest3335144-21kworker/3:2+events20:49:563
330287099242711,2413cyclictest3352816-21kworker/3:0+events21:52:193
330286299242311,2408cyclictest3370135-21kworker/1:0+events22:42:581
330286699242212,2406cyclictest3376564-21kworker/2:2+events22:58:512
330286699242212,2406cyclictest3335261-21kworker/2:2+events20:50:182
330286299241912,2403cyclictest3320801-21kworker/1:1+events20:16:311
330286299241911,2404cyclictest3390237-21kworker/1:2+events23:53:421
330286299241811,2404cyclictest3390237-21kworker/1:2+events23:42:211
330286299241811,2404cyclictest3357422-21kworker/1:0+events22:21:311
330287099241711,2403cyclictest3391757-21kworker/3:1+events00:00:233
330286699241612,2401cyclictest3351156-21kworker/2:0+events21:48:292
330286299241512,2400cyclictest3394806-21kworker/1:0+events23:58:531
330286299241511,2400cyclictest3380145-21kworker/1:1+events23:11:481
330287099241412,2397cyclictest3374938-21kworker/3:1+events23:09:353
33028669924138,2402cyclictest3381446-21kworker/2:1+events23:19:072
330286299241312,2398cyclictest3394806-21kworker/1:0+events00:23:581
330286299241312,2397cyclictest3320801-21kworker/1:1+events20:33:121
330287099241210,2398cyclictest3373338-21kworker/3:0+events22:52:263
33028669924119,2398cyclictest3327143-21kworker/2:1+events20:36:402
330286699240812,2392cyclictest3401337-21kworker/2:1+events00:26:112
330286699240812,2392cyclictest3362386-21kworker/2:1+events22:16:092
330286699240712,2392cyclictest3396485-21kworker/2:2+events00:09:542
330286699240712,2392cyclictest3335261-21kworker/2:2+events21:00:322
330286699240712,2391cyclictest3346668-21kworker/2:0+events21:28:532
330286299240712,2391cyclictest3319092-21kworker/1:0+events20:06:381
330286699240612,2391cyclictest3378572-21kworker/2:0+events23:11:272
330286699240612,2390cyclictest3333572-21kworker/2:0+events20:47:142
330286699240611,2392cyclictest3386954-21kworker/2:2+events23:49:082
330285899240612,2391cyclictest3373402-21kworker/0:2+events22:53:110
330286699240512,2389cyclictest3319178-21kworker/2:1+events20:03:592
330286299240414,2386cyclictest3373488-21kworker/1:2+events23:17:581
330286699240311,2390cyclictest3351156-21kworker/2:0+events21:57:172
330286699240212,2387cyclictest3381446-21kworker/2:1+events23:30:332
330286699240210,2389cyclictest3396485-21kworker/2:2+events00:04:332
330286699240112,2386cyclictest3403209-21kworker/2:0+events00:18:572
330286699240111,2385cyclictest3365707-21kworker/2:0+events22:35:412
330286699240012,2384cyclictest3310684-21kworker/2:0+events19:47:152
330286699239712,2381cyclictest3327143-21kworker/2:1+events20:40:502
330286299239712,2383cyclictest3343495-21kworker/1:0+events21:30:021
330287099239412,2379cyclictest3378868-21kworker/3:0+events23:10:183
330286299238510,2371cyclictest3314023-21kworker/1:2+events20:02:501
330285899238211,2369cyclictest3344984-21kworker/0:2+events21:20:010
330286699238011,2367cyclictest3365707-21kworker/2:0+events22:30:412
330287099237714,2359cyclictest3331788-21kworker/3:2+events20:40:293
330287099237611,2361cyclictest3370074-21kworker/3:2+events22:47:093
330285899236911,2355cyclictest3333542-21kworker/0:2+events20:46:080
330287099236211,2348cyclictest3302375-21kworker/3:2+events19:21:043
330287099235911,2345cyclictest3378868-21kworker/3:0+events23:16:023
33028709923539,2341cyclictest3310982-21kworker/3:1+events19:51:263
330286299235112,2336cyclictest3370135-21kworker/1:0+events22:45:411
330286699235011,2336cyclictest3365707-21kworker/2:0+events22:25:182
330286699233412,2319cyclictest3351156-21kworker/2:0+events22:08:272
330286699232511,2311cyclictest3315630-21kworker/2:2+events19:54:292
330287099231710,2304cyclictest3386773-21kworker/3:0+events23:41:103
330287099231511,2300cyclictest3357578-21kworker/3:2+events22:14:143
330286299231511,2301cyclictest3357422-21kworker/1:0+events22:19:151
330286299231011,2295cyclictest3349586-21kworker/1:2+events21:38:291
330287099230811,2293cyclictest3315473-21kworker/3:2+events19:46:513
330285899230410,2291cyclictest3352998-21kworker/0:2+events22:17:200
330285899230112,2286cyclictest3333542-21kworker/0:2+events20:55:120
330287099230011,2285cyclictest3323676-21kworker/3:1+events20:11:563
330286699229411,2280cyclictest3338255-21kworker/2:0+events20:59:472
330287099229312,2278cyclictest3331788-21kworker/3:2+events20:37:493
33028629922928,2281cyclictest3343495-21kworker/1:0+events21:26:561
330286699229110,2277cyclictest3319178-21kworker/2:1+events20:15:012
330286299228911,2275cyclictest3365618-21kworker/1:1+events22:34:321
330286299227512,2260cyclictest3349586-21kworker/1:2+events21:52:411
330285899227311,2259cyclictest3373402-21kworker/0:2+events22:57:410
330285899227311,2258cyclictest3300930-21kworker/0:1+events19:25:150
330285899227110,2258cyclictest3390027-21kworker/0:1+events23:50:370
330285899227011,2256cyclictest3343317-21kworker/0:0+events21:13:300
33028589922698,2258cyclictest3355848-21kworker/0:1+events21:51:550
33028589922689,2256cyclictest3309289-21kworker/0:2+events20:19:340
330287099226611,2252cyclictest3318941-21kworker/3:2+events20:06:163
330285899226610,2253cyclictest3367135-21kworker/0:2+events22:37:120
330285899226510,2252cyclictest3327318-21kworker/0:0+events20:37:010
330285899226311,2249cyclictest3338493-21kworker/0:1+events21:07:230
33028589922629,2250cyclictest3362145-21kworker/0:1+events22:26:520
330285899226211,2247cyclictest3352998-21kworker/0:2+events21:45:230
33028589922619,2249cyclictest3404760-21kworker/0:0+events00:25:470
330285899226110,2248cyclictest3408834-21kworker/0:1+events00:39:580
330285899226011,2246cyclictest3396512-21kworker/0:2+events00:07:570
330285899226011,2246cyclictest3352998-21kworker/0:2+events22:00:230
330285899226011,2245cyclictest3368784-21kworker/0:1+events22:41:490
330286699225911,2246cyclictest3391812-21kworker/2:1+events23:51:222
33028589922598,2248cyclictest3309289-21kworker/0:2+events19:54:510
330285899225811,2243cyclictest3309289-21kworker/0:2+events19:32:520
33028629922578,2246cyclictest3304293-21kworker/1:2+events19:18:281
330285899225611,2242cyclictest3336801-21kworker/0:0+events21:02:510
330285899225610,2243cyclictest3396512-21kworker/0:2+events00:04:090
33028589922545,2245cyclictest3304347-21kworker/0:2+events19:19:140
330286699225211,2237cyclictest3403209-21kworker/2:0+events00:20:312
330285899224710,2234cyclictest3325575-21kworker/0:1+events20:24:100
33028709922449,2232cyclictest3391757-21kworker/3:1+events23:52:083
330286299223910,2226cyclictest3330515-21kworker/1:2+events20:44:121
33028589922329,2220cyclictest3346726-21kworker/0:0+events21:38:520
330285899223211,2217cyclictest3396512-21kworker/0:2+events23:57:460
330287099223111,2217cyclictest3401477-21kworker/3:1+events00:16:203
330286699223010,2216cyclictest3374906-21kworker/2:1+events23:02:162
330286299223011,2215cyclictest3351283-21kworker/1:0+events21:47:171
330286299223010,2217cyclictest3404881-21kworker/1:1+events00:32:181
330285899222910,2216cyclictest3398306-21kworker/0:1+events00:22:260
330286699222711,2212cyclictest3312376-21kworker/2:1+events19:38:312
330285899222710,2213cyclictest3373402-21kworker/0:2+events22:49:270
330287099222611,2211cyclictest3340058-21kworker/3:0+events21:06:143
330286299222611,2212cyclictest3392244-21kworker/1:1+events23:48:451
330286299222610,2213cyclictest3365618-21kworker/1:1+events22:27:371
330286299222610,2212cyclictest3357422-21kworker/1:0+events21:58:511
330286299222511,2211cyclictest3388559-21kworker/1:0+events23:35:531
330286699222411,2209cyclictest3376564-21kworker/2:2+events23:07:392
330286299222411,2209cyclictest3359175-21kworker/1:2+events22:05:001
330286299222311,2209cyclictest3341544-21kworker/1:2+events21:12:241
330286299222310,2210cyclictest3394806-21kworker/1:0+events00:28:301
330286299222310,2210cyclictest3320801-21kworker/1:1+events20:39:191
330286699222211,2208cyclictest3343436-21kworker/2:2+events21:25:002
330285899222210,2209cyclictest3376593-21kworker/0:1+events23:06:330
33028669922217,2212cyclictest3408066-21kworker/2:2+events00:35:022
330286299222111,2207cyclictest3322425-21kworker/1:2+events20:14:381
330286699222011,2206cyclictest3401337-21kworker/2:1+events00:31:112
330286299222011,2206cyclictest3386685-21kworker/1:1+events23:29:001
330286699221910,2206cyclictest3343436-21kworker/2:2+events21:39:152
330286699221811,2203cyclictest3341481-21kworker/2:0+events21:16:102
330286699221810,2204cyclictest3322017-21kworker/2:0+events20:07:472
33028629922189,2206cyclictest3338222-21kworker/1:0+events21:02:031
33028629922188,2206cyclictest3386685-21kworker/1:1+events23:34:421
330286699221710,2202cyclictest3351156-21kworker/2:0+events22:04:132
330286299221711,2203cyclictest3396659-21kworker/1:1+events00:03:261
330286299221710,2204cyclictest3302612-21kworker/1:1+events19:42:391
330286699221512,2200cyclictest3323618-21kworker/2:2+events20:23:462
330286699221511,2201cyclictest3381446-21kworker/2:1+events23:39:172
330286699221510,2202cyclictest3381446-21kworker/2:1+events23:20:592
330287099221412,2199cyclictest3363781-21kworker/3:1+events22:21:113
330286699221410,2201cyclictest3352876-21kworker/2:1+events21:44:372
330286699221410,2201cyclictest3339881-21kworker/2:1+events21:07:452
33028669922139,2200cyclictest3310684-21kworker/2:0+events19:34:012
330286699220811,2194cyclictest3396485-21kworker/2:2+events23:57:242
330286699220811,2193cyclictest3323618-21kworker/2:2+events20:17:412
330286299220610,2192cyclictest3336625-21kworker/1:2+events20:52:581
33028589922068,2195cyclictest3390027-21kworker/0:1+events23:44:380
330286299220410,2191cyclictest3320801-21kworker/1:1+events20:29:221
330286299220210,2188cyclictest3373488-21kworker/1:2+events23:01:531
330285899220211,2188cyclictest3362145-21kworker/0:1+events22:23:060
33028629921999,2186cyclictest3404881-21kworker/1:1+events00:38:281
33028629921987,2188cyclictest3302612-21kworker/1:1+events19:37:251
330286699219710,2184cyclictest3373307-21kworker/2:2+events22:48:182
330286699219210,2179cyclictest3328735-21kworker/2:0+events20:29:462
330286699219111,2178cyclictest3386954-21kworker/2:2+events23:40:022
330286299218910,2176cyclictest3336625-21kworker/1:2+events20:56:441
330287099218811,2174cyclictest3335144-21kworker/3:2+events20:59:253
330286699218711,2173cyclictest3341481-21kworker/2:0+events21:14:162
330286299218610,2173cyclictest3357422-21kworker/1:0+events22:11:091
330287099218510,2172cyclictest3391757-21kworker/3:1+events23:47:383
33028629921857,2174cyclictest3302612-21kworker/1:1+events19:49:081
33028629921847,2174cyclictest3367286-21kworker/1:2+events22:39:061
330286299218411,2170cyclictest3373488-21kworker/1:2+events22:55:501
33028669921819,2169cyclictest3354630-21kworker/2:3+events21:53:042
330286699218111,2167cyclictest3306356-21kworker/2:3+events19:21:282
33028629921819,2169cyclictest3371828-21kworker/1:1+events22:51:431
330286299218111,2167cyclictest3394806-21kworker/1:0+events00:18:371
330286699217911,2165cyclictest3396485-21kworker/2:2+events00:12:342
33028709921779,2165cyclictest3346337-21kworker/3:0+events21:22:173
330286699217711,2163cyclictest3296567-21kworker/2:0+events19:14:162
33028709921767,2165cyclictest3335144-21kworker/3:2+events20:54:043
33028669921769,2163cyclictest3368471-21kworker/2:2+events22:40:372
330287099217411,2160cyclictest3320686-21kworker/3:0+events20:04:213
330287099217210,2158cyclictest3404971-21kworker/3:0+events00:29:153
330287099217110,2158cyclictest3320686-21kworker/3:0+events20:25:163
330286299217010,2157cyclictest3309164-21kworker/1:2+events19:32:291
330287099216811,2154cyclictest3374938-21kworker/3:1+events22:59:153
330287099216810,2154cyclictest3335144-21kworker/3:2+events21:40:433
33028709921659,2153cyclictest3335144-21kworker/3:2+events21:04:443
33028709921658,2153cyclictest3359234-21kworker/3:1+events22:04:353
330287099216510,2153cyclictest3320686-21kworker/3:0+events20:30:093
330287099216311,2149cyclictest3357578-21kworker/3:2+events22:16:333
330287099216310,2150cyclictest3341726-21kworker/3:1+events21:13:533
33028709921629,2150cyclictest3367495-21kworker/3:1+events22:39:303
330287099216110,2148cyclictest3341726-21kworker/3:1+events21:19:153
33028709921585,2150cyclictest3320686-21kworker/3:0+events20:19:583
330287099215811,2144cyclictest3359234-21kworker/3:1+events22:07:403
33028709921576,2148cyclictest3320686-21kworker/3:0+events20:23:253
330286699215710,2144cyclictest3343436-21kworker/2:2+events21:32:422
330287099215610,2143cyclictest3335144-21kworker/3:2+events21:25:473
330286699215310,2140cyclictest3315630-21kworker/2:2+events19:59:452
330287099215012,2134cyclictest3335144-21kworker/3:2+events21:31:113
330286699215010,2137cyclictest3310684-21kworker/2:0+events19:43:252
330287099214611,2131cyclictest3304117-21kworker/3:0+events19:25:373
330287099214211,2127cyclictest3391757-21kworker/3:1+events23:58:283
330287099213911,2124cyclictest3383251-21kworker/3:2+events23:27:073
330287099213811,2124cyclictest3386773-21kworker/3:0+events23:39:383
330286699213810,2125cyclictest3294701-21kworker/2:1+events19:16:322
330286299213810,2124cyclictest3341544-21kworker/1:2+events21:18:291
330285899213510,2121cyclictest3376593-21kworker/0:1+events23:14:050
330287099213110,2118cyclictest3355942-21kworker/3:1+events21:56:553
33028709921275,2119cyclictest3398634-21kworker/3:2+events00:22:483
330285899211610,2102cyclictest3300930-21kworker/0:1+events19:13:090
330285899211410,2101cyclictest3357804-21kworker/0:0+events22:06:540
33028589921105,2102cyclictest3346726-21kworker/0:0+events21:29:380
330285899211010,2097cyclictest3327318-21kworker/0:0+events20:26:230
33028589921098,2097cyclictest3309289-21kworker/0:2+events20:09:170
33028589921089,2096cyclictest3344984-21kworker/0:2+events21:30:240
33028589921018,2090cyclictest3343317-21kworker/0:0+events21:17:190
330285899209910,2086cyclictest3352998-21kworker/0:2+events22:10:460
33028669920979,2085cyclictest3364029-21kworker/2:2+events22:20:242
330287099209511,2081cyclictest3304117-21kworker/3:0+events19:41:303
330286299209210,2078cyclictest3359175-21kworker/1:2+events22:10:001
330286699208410,2071cyclictest3327143-21kworker/2:1+events20:30:322
33028629920776,2068cyclictest3302612-21kworker/1:1+events19:20:211
330287099206910,2055cyclictest3349524-21kworker/3:0+events21:36:093
330286299206910,2056cyclictest3333806-21kworker/1:1+events20:48:231
33028629920689,2056cyclictest3324581-21kworker/1:0+events20:20:211
330286299206811,2054cyclictest3394806-21kworker/1:0+events00:14:481
33028629920659,2053cyclictest3309164-21kworker/1:2+events19:29:261
330286299206111,2047cyclictest3343495-21kworker/1:0+events21:20:231
330287099205911,2045cyclictest3357578-21kworker/3:2+events22:27:133
330286299205910,2046cyclictest3338222-21kworker/1:0+events21:07:001
330286299205810,2045cyclictest3376386-21kworker/1:0+events23:05:461
33028589920576,2048cyclictest3312685-21kworker/0:0+events19:43:030
330287099204110,2027cyclictest3304117-21kworker/3:0+events19:16:103
33028629920258,2014cyclictest3398366-21kworker/1:2+events00:08:441
330287099202011,2006cyclictest3406671-21kworker/3:2+events00:31:573
330287099201410,2001cyclictest3376655-21kworker/3:2+events23:02:403
330287099201410,2001cyclictest3304117-21kworker/3:0+events19:34:243
33028589920089,1996cyclictest3322313-21kworker/0:0+events20:10:270
33028589920069,1994cyclictest3327318-21kworker/0:0+events20:42:200
330287099200510,1992cyclictest3335144-21kworker/3:2+events21:46:323
33028589920059,1993cyclictest3300930-21kworker/0:1+events19:37:480
33028709920009,1988cyclictest3386773-21kworker/3:0+events23:32:503
33028669919949,1982cyclictest3294701-21kworker/2:1+events19:28:392
33028709919549,1942cyclictest3302375-21kworker/3:2+events19:12:463
33028629919335,1925cyclictest3274824-21kworker/1:0+events19:12:221
33026192154106,27sleep00-21swapper/019:09:370
33013512152100,42sleep30-21swapper/319:05:123
33026102147101,26sleep20-21swapper/219:09:322
33023032142112,25sleep10-21swapper/119:05:391
330285899150,13cyclictest3356411-21runrttasks21:55:080
330285899137,4cyclictest3368535-21taskset22:31:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional