You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 22:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Mon Mar 16, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
378061199295814,2939cyclictest3880462-21kworker/1:1+events00:30:161
378061199292912,2913cyclictest3822789-21kworker/1:1+events21:20:171
378061199282313,2805cyclictest3777012-21kworker/1:2+events19:40:161
378061699281914,2800cyclictest3818140-21kworker/2:2+events21:10:012
378060999271614,2696cyclictest3790292-21kworker/0:2+events19:50:130
378062299271212,2697cyclictest3805294-21kworker/3:0+events20:25:183
37806099927070,2703cyclictest3829540-21kworker/0:1+events21:45:170
378060999269613,2680cyclictest3816515-21kworker/0:0+events21:00:100
378060999269613,2680cyclictest3816515-21kworker/0:0+events21:00:090
378061699268313,2667cyclictest3810149-21kworker/2:1+events20:40:102
378060999267812,2661cyclictest3851627-21kworker/0:0+events22:50:160
37806169926715,2662cyclictest3861154-21kworker/2:0+events23:30:132
378061699265613,2639cyclictest3806775-21kworker/2:1+events20:30:142
378061699263513,2618cyclictest3795412-21kworker/2:2+events19:55:122
37806169926348,2622cyclictest3770443-21kworker/2:2+events19:10:202
378061699256212,2546cyclictest3851722-21kworker/2:2+events23:00:112
378061199254612,2529cyclictest3872638-21kworker/1:0+events00:00:191
378061199254512,2529cyclictest3850112-21kworker/1:1+events22:45:151
378061699253511,2520cyclictest3788693-21kworker/2:2+events19:44:052
378061199253412,2518cyclictest3834331-21kworker/1:2+events22:00:191
378061199252812,2512cyclictest3857795-21kworker/1:1+events23:16:341
378061199252712,2511cyclictest3886947-21kworker/1:2+events00:37:271
378061699251112,2495cyclictest3870865-21kworker/2:0+events00:21:102
378061199251112,2497cyclictest3800505-21kworker/1:0+events20:15:061
378061199251012,2494cyclictest3867973-21kworker/1:1+events23:45:511
378061699250212,2486cyclictest3881963-21kworker/2:2+events00:29:082
378061699249212,2477cyclictest3788693-21kworker/2:2+events19:34:562
378061199248511,2471cyclictest3850112-21kworker/1:1+events22:51:491
378061699248111,2467cyclictest3861154-21kworker/2:0+events23:39:472
378061699246912,2454cyclictest3797158-21kworker/2:0+events20:09:232
378061699245711,2443cyclictest3829599-21kworker/2:1+events22:35:172
37806229924409,2427cyclictest3819621-21kworker/3:0+events21:15:193
378061199243812,2423cyclictest3872638-21kworker/1:0+events23:58:221
378061199243512,2419cyclictest3882174-21kworker/1:2+events00:27:591
378060999243510,2421cyclictest3859695-21kworker/0:2+events23:19:590
378061199243412,2418cyclictest3800505-21kworker/1:0+events20:12:261
378061199243212,2418cyclictest3861029-21kworker/1:0+events23:20:461
378061199242812,2413cyclictest3842194-21kworker/1:2+events22:19:061
378061199242410,2411cyclictest3811896-21kworker/1:0+events20:51:511
378060999242211,2408cyclictest3845376-21kworker/0:1+events22:40:180
378061199241311,2399cyclictest3788631-21kworker/1:0+events19:38:011
378060999240812,2393cyclictest3839166-21kworker/0:0+events22:15:190
378062299240712,2392cyclictest3794080-21kworker/3:2+events20:05:553
378061199239611,2383cyclictest3822789-21kworker/1:1+events21:30:031
378060999238910,2376cyclictest3845376-21kworker/0:1+events22:29:390
378061699238811,2374cyclictest3788693-21kworker/2:2+events19:45:152
378061199238712,2372cyclictest3809896-21kworker/1:2+events20:37:511
378061199237911,2365cyclictest3878858-21kworker/1:0+events00:20:281
378062299237712,2362cyclictest3858095-21kworker/3:2+events23:10:263
378061199237410,2360cyclictest3870743-21kworker/1:2+events23:50:431
378061199235912,2344cyclictest3838845-21kworker/1:1+events22:20:161
378060999235712,2342cyclictest3861299-21kworker/0:0+events23:25:420
378062299235411,2339cyclictest3787151-21kworker/3:0+events19:33:493
378061699235411,2340cyclictest3783749-21kworker/2:2+events19:20:112
378060999235212,2336cyclictest3781861-21kworker/0:1+events19:21:420
378060999234912,2333cyclictest3861299-21kworker/0:0+events00:14:200
378060999234911,2334cyclictest3883931-21kworker/0:1+events00:32:100
378061699234811,2335cyclictest3855248-21kworker/2:1+events23:10:062
378062299234712,2332cyclictest3848492-21kworker/3:2+events22:41:033
378062299234712,2332cyclictest3787151-21kworker/3:0+events19:41:473
378061199234410,2330cyclictest3854956-21kworker/1:2+events23:01:211
37806119923439,2331cyclictest3815219-21kworker/1:2+events21:16:281
378060999234112,2326cyclictest3798663-21kworker/0:1+events20:08:140
378062299233911,2325cyclictest3819621-21kworker/3:0+events21:07:423
378062299233611,2322cyclictest3822822-21kworker/3:2+events21:23:413
378062299232912,2313cyclictest3815123-21kworker/3:2+events20:59:473
378062299232712,2312cyclictest3848492-21kworker/3:2+events22:56:203
378062299232712,2311cyclictest3787151-21kworker/3:0+events19:53:153
378062299232612,2311cyclictest3845236-21kworker/3:0+events22:32:163
378060999232612,2311cyclictest3814893-21kworker/0:2+events20:59:000
378060999232311,2309cyclictest3834095-21kworker/0:0+events21:52:040
378061699232211,2308cyclictest3829599-21kworker/2:1+events22:09:422
37806099923209,2308cyclictest3829540-21kworker/0:1+events21:39:350
378061199231910,2306cyclictest3785288-21kworker/1:0+events19:22:281
378061699231812,2303cyclictest3829599-21kworker/2:1+events22:16:302
378061699231811,2303cyclictest3851722-21kworker/2:2+events22:56:432
37806169923178,2306cyclictest3848337-21kworker/2:0+events22:47:552
378061699231511,2300cyclictest3861154-21kworker/2:0+events23:18:532
378061699231411,2300cyclictest3821498-21kworker/2:0+events21:19:532
378061699231411,2299cyclictest3866821-21kworker/2:1+events23:43:582
378061699231211,2298cyclictest3870865-21kworker/2:0+events00:05:382
37806169923119,2300cyclictest3798844-21kworker/2:2+events20:10:062
378060999231111,2296cyclictest3880311-21kworker/0:1+events00:17:490
378060999230611,2292cyclictest3787679-21kworker/0:0+events19:32:180
378060999229012,2274cyclictest3810253-21kworker/0:2+events20:41:410
378061199228011,2266cyclictest3838845-21kworker/1:1+events22:14:571
378061699227810,2264cyclictest3862778-21kworker/2:1+events23:24:332
378060999227411,2260cyclictest3806805-21kworker/0:2+events20:32:070
378062299227111,2257cyclictest3858095-21kworker/3:2+events23:20:223
378061199227011,2255cyclictest3872638-21kworker/1:0+events00:05:151
37806099922698,2257cyclictest3861299-21kworker/0:0+events00:01:040
378062299226311,2249cyclictest3819621-21kworker/3:0+events21:37:423
37806169922639,2251cyclictest3882265-21kworker/2:3+events00:31:232
378061699226111,2246cyclictest3837310-21kworker/2:0+events22:02:122
378061199226111,2246cyclictest3811896-21kworker/1:0+events20:49:121
378061699225811,2243cyclictest3843868-21kworker/2:0+events22:29:162
378061699225810,2245cyclictest3846077-21kworker/2:2+events22:31:112
378062299225711,2243cyclictest3869205-21kworker/3:0+events23:52:403
37806169922569,2244cyclictest3872491-21kworker/2:1+events23:55:412
37806169922568,2245cyclictest3848337-21kworker/2:0+events22:44:512
378061699225511,2241cyclictest3819915-21kworker/2:1+events21:13:012
378061699225411,2240cyclictest3826099-21kworker/2:0+events21:37:182
378062299224611,2231cyclictest3885496-21kworker/3:1+events00:39:213
378061699224610,2233cyclictest3829599-21kworker/2:1+events21:44:552
378062299224510,2231cyclictest3809956-21kworker/3:0+events20:48:273
378061699224511,2231cyclictest3861154-21kworker/2:0+events23:26:462
378061199224311,2229cyclictest3815219-21kworker/1:2+events21:08:051
378061199224211,2228cyclictest3842194-21kworker/1:2+events22:26:181
378062299224110,2228cyclictest3870804-21kworker/3:2+events00:04:523
37806119922419,2229cyclictest3797067-21kworker/1:0+events20:02:271
378061699224010,2227cyclictest3797158-21kworker/2:0+events20:19:162
378061199223311,2219cyclictest3842194-21kworker/1:2+events22:34:101
37806119922326,2222cyclictest3850112-21kworker/1:1+events22:58:151
378061199223210,2218cyclictest3798692-21kworker/1:1+events20:26:041
378061199223011,2216cyclictest3864405-21kworker/1:1+events23:34:061
37806119922289,2216cyclictest3874305-21kworker/1:2+events00:13:141
37806119922288,2217cyclictest3777012-21kworker/1:2+events19:27:251
378061199222711,2213cyclictest3790877-21kworker/1:1+events19:54:481
378061199222610,2213cyclictest3842194-21kworker/1:2+events22:43:171
378061199222610,2212cyclictest3824595-21kworker/1:0+events21:25:311
378061199222511,2211cyclictest3857795-21kworker/1:1+events23:08:141
378061199222311,2209cyclictest3798692-21kworker/1:1+events20:20:461
37806119922218,2209cyclictest3777012-21kworker/1:2+events19:15:151
378061199222011,2206cyclictest3818110-21kworker/1:1+events21:04:421
378061199222011,2206cyclictest3818110-21kworker/1:1+events21:04:421
378060999222011,2205cyclictest3825950-21kworker/0:0+events21:32:450
37806099922197,2209cyclictest3851627-21kworker/0:0+events22:57:280
378060999221911,2205cyclictest3825950-21kworker/0:0+events21:27:010
378062299220811,2194cyclictest3870804-21kworker/3:2+events00:12:293
37806119922078,2196cyclictest3819768-21kworker/1:0+events21:10:221
378061199220711,2194cyclictest3790877-21kworker/1:1+events19:46:001
378061199220513,2189cyclictest3806691-21kworker/1:0+events20:34:231
378061699220412,2189cyclictest3869267-21kworker/2:2+events23:52:162
378061199220210,2190cyclictest3777012-21kworker/1:2+events19:30:031
378061699220111,2187cyclictest3827997-21kworker/2:2+events21:47:342
378061199219910,2186cyclictest3867973-21kworker/1:1+events23:43:351
378061199219510,2182cyclictest3874305-21kworker/1:2+events00:17:241
378060999218410,2171cyclictest3804115-21kworker/0:0+events20:27:310
378062299218111,2166cyclictest3819621-21kworker/3:0+events21:13:263
378062299217412,2159cyclictest3827757-21kworker/3:1+events21:34:173
378062299217212,2157cyclictest3881934-21kworker/3:0+events00:24:353
37806169921629,2149cyclictest3816487-21kworker/2:1+events21:01:402
37806169921629,2149cyclictest3816487-21kworker/2:1+events21:01:392
37806119921609,2148cyclictest3828346-21kworker/1:0+events21:53:571
378060999216011,2145cyclictest3781861-21kworker/0:1+events19:39:540
378060999215910,2146cyclictest3861299-21kworker/0:0+events23:47:000
378061199215411,2139cyclictest3859425-21kworker/1:2+events23:12:011
378060999215310,2140cyclictest3861299-21kworker/0:0+events23:22:170
378060999214812,2133cyclictest3883931-21kworker/0:1+events00:29:320
37806099921429,2129cyclictest3790292-21kworker/0:2+events19:47:550
37806229921396,2130cyclictest3774015-21kworker/3:0+events19:16:023
378060999213911,2124cyclictest3814893-21kworker/0:2+events21:07:200
378062299213711,2123cyclictest3835721-21kworker/3:1+events22:01:053
378060999213711,2122cyclictest3839166-21kworker/0:0+events22:12:170
378061699213610,2123cyclictest3878709-21kworker/2:1+events00:17:022
378062299213410,2120cyclictest3856467-21kworker/3:1+events23:07:283
378061199213411,2120cyclictest3809896-21kworker/1:2+events20:43:311
378062299213211,2118cyclictest3881934-21kworker/3:0+events00:33:403
378062299213111,2116cyclictest3848492-21kworker/3:2+events22:46:003
37806169921319,2118cyclictest3803531-21kworker/2:2+events20:22:592
37806099921318,2120cyclictest3813259-21kworker/0:1+events20:54:050
378062299213011,2116cyclictest3846859-21kworker/3:1+events22:37:593
378062299212911,2115cyclictest3809956-21kworker/3:0+events20:38:143
378062299212911,2115cyclictest3800329-21kworker/3:1+events20:41:173
378060999212811,2114cyclictest3861299-21kworker/0:0+events00:07:070
378060999212810,2114cyclictest3861299-21kworker/0:0+events23:50:220
378062299212711,2113cyclictest3877435-21kworker/3:1+events00:25:213
378062299212711,2113cyclictest3870804-21kworker/3:2+events23:57:383
378062299212711,2113cyclictest3829483-21kworker/3:2+events21:46:033
378062299212711,2113cyclictest3800329-21kworker/3:1+events20:23:213
37806099921278,2116cyclictest3824340-21kworker/0:2+events21:21:240
378060999212711,2113cyclictest3861299-21kworker/0:0+events23:37:320
378062299212611,2112cyclictest3808293-21kworker/3:2+events20:32:313
378062299212610,2113cyclictest3783928-21kworker/3:1+events19:25:523
378062299212511,2111cyclictest3843601-21kworker/3:2+events22:24:013
378062299212511,2111cyclictest3809956-21kworker/3:0+events20:54:303
378062299212511,2111cyclictest3798604-21kworker/3:0+events20:12:033
37806099921259,2113cyclictest3885530-21kworker/0:2+events00:36:420
378062299212311,2108cyclictest3869205-21kworker/3:0+events23:44:213
37806169921235,2114cyclictest3785375-21kworker/2:0+events19:25:082
37806119921239,2110cyclictest3834331-21kworker/1:2+events22:05:581
378060999212211,2108cyclictest3813259-21kworker/0:1+events20:48:470
37806169921219,2109cyclictest3810149-21kworker/2:1+events20:45:262
378062299212011,2106cyclictest3788828-21kworker/3:2+events19:39:313
378060999212011,2106cyclictest3814893-21kworker/0:2+events21:14:330
378060999212010,2108cyclictest3818172-21kworker/0:1+events21:15:430
378062299211911,2105cyclictest3829483-21kworker/3:2+events21:56:343
378062299211910,2106cyclictest3832791-21kworker/3:0+events21:51:433
37806099921198,2108cyclictest3798663-21kworker/0:1+events20:24:540
378062299211811,2103cyclictest3774015-21kworker/3:0+events19:23:363
378060999211811,2104cyclictest3867584-21kworker/0:2+events23:41:430
378060999211811,2104cyclictest3856226-21kworker/0:1+events23:14:400
37806099921179,2105cyclictest3848308-21kworker/0:2+events23:00:350
37806099921176,2108cyclictest3800270-21kworker/0:2+events20:17:480
378060999211710,2103cyclictest3831520-21kworker/0:2+events22:02:360
378062299211611,2102cyclictest3858095-21kworker/3:2+events23:15:263
378060999211611,2102cyclictest3848308-21kworker/0:2+events22:36:260
378062299211510,2102cyclictest3794080-21kworker/3:2+events19:56:423
378060999210811,2094cyclictest3825950-21kworker/0:0+events21:41:060
37806169921079,2094cyclictest3870865-21kworker/2:0+events23:50:012
378061199210711,2093cyclictest3828346-21kworker/1:0+events21:48:411
378060999210710,2094cyclictest3845376-21kworker/0:1+events22:31:330
378061699210611,2092cyclictest3835063-21kworker/2:2+events21:59:342
378061199210511,2091cyclictest3842194-21kworker/1:2+events22:37:121
378061699210411,2089cyclictest3785375-21kworker/2:0+events19:39:092
378061699210310,2090cyclictest3832823-21kworker/2:0+events21:52:492
37806169921029,2090cyclictest3819915-21kworker/2:1+events21:24:252
378061699210011,2085cyclictest3872491-21kworker/2:1+events00:04:052
378061699210010,2086cyclictest3790879-21kworker/2:1+events19:52:292
378061699209911,2085cyclictest3803531-21kworker/2:2+events20:28:422
37806099920999,2086cyclictest3781861-21kworker/0:1+events19:18:170
37806169920987,2089cyclictest3824447-21kworker/2:2+events21:25:092
378061699209811,2084cyclictest3808543-21kworker/2:0+events20:39:462
378061699209810,2085cyclictest3816487-21kworker/2:1+events20:57:512
378061699209810,2085cyclictest3812586-21kworker/2:2+events20:51:072
37806169920973,2091cyclictest3781739-21kworker/2:1+events19:16:472
378061699209710,2084cyclictest3838934-21kworker/2:2+events22:12:402
378061699209611,2082cyclictest3887036-21kworker/2:1+events00:38:592
378061699209511,2081cyclictest3838934-21kworker/2:2+events22:21:442
378061699209310,2080cyclictest3857857-21kworker/2:0+events23:07:052
378061699208811,2074cyclictest3851722-21kworker/2:2+events22:52:562
378062299208410,2071cyclictest3854682-21kworker/3:0+events23:03:403
378061699208210,2069cyclictest3790879-21kworker/2:1+events20:03:362
37806119920808,2069cyclictest3797067-21kworker/1:0+events19:58:391
37806119920808,2069cyclictest3795381-21kworker/1:2+events20:07:511
378061199208010,2067cyclictest3861029-21kworker/1:0+events23:27:331
378062299207810,2065cyclictest3864463-21kworker/3:2+events23:31:463
37806119920768,2064cyclictest3822789-21kworker/1:1+events21:36:341
37806119920758,2064cyclictest3828346-21kworker/1:0+events21:58:491
378061199207410,2061cyclictest3862748-21kworker/1:2+events23:37:081
37806119920708,2059cyclictest3828346-21kworker/1:0+events21:41:291
37806099920649,2052cyclictest3848308-21kworker/0:2+events22:47:320
37806099920617,2051cyclictest3781861-21kworker/0:1+events19:27:030
378062299205611,2042cyclictest3798604-21kworker/3:0+events20:03:593
37806119920498,2038cyclictest3811896-21kworker/1:0+events20:55:591
378060999203311,2019cyclictest3781861-21kworker/0:1+events19:14:300
378060999203010,2017cyclictest3877431-21kworker/0:3+events00:20:490
37806229920268,2017cyclictest3870804-21kworker/3:2+events00:15:073
378060999201410,2001cyclictest3798663-21kworker/0:1+events20:04:450
378060999201310,2000cyclictest3864138-21kworker/0:1+events23:30:370
37806229920093,2003cyclictest3800329-21kworker/3:1+events20:19:393
37806229920088,1997cyclictest3845236-21kworker/3:0+events22:28:533
378060999200610,1993cyclictest3856226-21kworker/0:1+events23:06:420
378061699198710,1974cyclictest3826099-21kworker/2:0+events21:33:542
378060999197810,1965cyclictest3831520-21kworker/0:2+events21:59:120
378062299197710,1963cyclictest3848492-21kworker/3:2+events22:51:023
37806229919768,1965cyclictest3815123-21kworker/3:2+events21:01:163
37806229919768,1965cyclictest3815123-21kworker/3:2+events21:01:163
378062299197510,1962cyclictest3831166-21kworker/3:1+events21:44:323
37806229919739,1961cyclictest3840791-21kworker/3:0+events22:19:523
378060999197310,1960cyclictest3839166-21kworker/0:0+events22:23:150
378060999197310,1959cyclictest3800270-21kworker/0:2+events20:13:140
37806229919715,1963cyclictest3870804-21kworker/3:2+events23:48:073
378062299197010,1958cyclictest3860433-21kworker/3:1+events23:37:543
378060999196910,1956cyclictest3808412-21kworker/0:1+events20:37:070
378062299196410,1951cyclictest3875830-21kworker/3:0+events00:06:013
378062299196210,1949cyclictest3837455-21kworker/3:0+events22:05:343
37806099919609,1948cyclictest3795502-21kworker/0:0+events19:55:580
378061699194710,1934cyclictest3870865-21kworker/2:0+events00:12:512
378062299194610,1933cyclictest3860433-21kworker/3:1+events23:29:503
378062299194410,1931cyclictest3774015-21kworker/3:0+events19:12:383
37806099919299,1917cyclictest3790292-21kworker/0:2+events19:42:090
37806099919289,1917cyclictest3835926-21kworker/0:1+events22:07:260
37806229919158,1904cyclictest3791943-21kworker/3:1+events19:46:243
37806229918927,1882cyclictest3829483-21kworker/3:2+events22:13:483
37802272153124,23sleep00-21swapper/019:08:110
37801382142112,25sleep10-21swapper/119:07:041
3780002214195,30sleep30-21swapper/319:05:203
37802722138103,30sleep20-21swapper/219:08:452
378062299271,7cyclictest3826287-21awk21:30:013
378060999211,6cyclictest3874262-21awk00:00:010
378061199140,13cyclictest3781184-21/usr/sbin/munin19:10:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional