You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 19:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Apr 11, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
351196499314114,3122cyclictest3539712-21kworker/3:0+events20:50:143
351195399309715,3078cyclictest3591554-21kworker/0:0+events23:15:010
351196499289714,2879cyclictest3606810-21kworker/3:1+events00:05:133
351195699289114,2872cyclictest3531752-21kworker/1:0+events20:20:141
351195899284213,2824cyclictest3580648-21kworker/2:2+events23:00:182
351195399272013,2704cyclictest3533590-21kworker/0:2+events20:40:390
351195399271710,2705cyclictest3591554-21kworker/0:0+events23:25:180
351196499271313,2696cyclictest3582135-21kworker/3:2+events22:48:083
351195699270013,2684cyclictest3572324-21kworker/1:1+events22:20:151
351196499267311,2659cyclictest3508084-21kworker/3:0+events19:15:003
351195699265113,2634cyclictest3541195-21kworker/1:1+events20:40:161
351195899264812,2633cyclictest3586940-21kworker/2:3+events23:05:132
351195899262611,2612cyclictest3575696-21kworker/2:1+events22:30:142
351195899258113,2564cyclictest3609469-21kworker/2:1+events00:18:092
351195899253614,2518cyclictest3546306-21kworker/2:1+events21:02:282
351195399253612,2521cyclictest3601682-21kworker/0:2+events23:51:510
351195899253512,2521cyclictest3538686-21kworker/2:2+events20:38:442
351195899253112,2515cyclictest3593480-21kworker/2:2+events23:31:022
351195899252812,2512cyclictest3550775-21kworker/2:2+events21:22:492
351195899250212,2484cyclictest3596059-21kworker/2:0+events00:30:212
351195899250210,2489cyclictest3550775-21kworker/2:2+events21:25:272
351196499249912,2483cyclictest3602838-21kworker/3:1+events23:50:183
351195899249412,2479cyclictest3614563-21kworker/2:1+events00:29:332
351195899249012,2474cyclictest3591434-21kworker/2:1+events23:20:212
351196499248912,2474cyclictest3547481-21kworker/3:2+events21:08:383
351195699248711,2472cyclictest3608052-21kworker/1:0+events00:33:271
351195399247511,2460cyclictest3533590-21kworker/0:2+events20:32:410
351195399247212,2456cyclictest3616138-21kworker/0:1+events00:26:530
351195899246912,2453cyclictest3562157-21kworker/2:0+events21:59:482
351196499246412,2449cyclictest3547481-21kworker/3:2+events20:58:403
35119589924629,2450cyclictest3604760-21kworker/2:2+events23:55:412
351195899245811,2444cyclictest3528554-21kworker/2:2+events20:05:282
351195899245810,2444cyclictest3506549-21kworker/2:0+events19:24:112
351195899245712,2442cyclictest3530227-21kworker/2:0+events20:10:472
351195899245512,2438cyclictest3562157-21kworker/2:0+events21:50:142
351195899245512,2438cyclictest3562157-21kworker/2:0+events21:50:132
351195899245212,2436cyclictest3580648-21kworker/2:2+events22:49:132
351195899245012,2434cyclictest3518260-21kworker/2:1+events19:27:152
351195399245012,2434cyclictest3523897-21kworker/0:0+events19:47:210
351195899244812,2434cyclictest3506549-21kworker/2:0+events19:45:062
351195899244610,2433cyclictest3562157-21kworker/2:0+events22:07:482
351195699244610,2433cyclictest3601116-21kworker/1:2+events23:42:201
351195399244611,2431cyclictest3583531-21kworker/0:0+events22:52:180
351195899244512,2429cyclictest3550775-21kworker/2:2+events21:42:312
351195899244511,2430cyclictest3609469-21kworker/2:1+events00:10:332
351195899244511,2430cyclictest3567586-21kworker/2:1+events22:00:562
351195899244510,2431cyclictest3538686-21kworker/2:2+events20:46:262
351195899244412,2429cyclictest3604760-21kworker/2:2+events00:00:362
351195399244411,2429cyclictest3585215-21kworker/0:2+events23:00:400
351196499244312,2427cyclictest3536158-21kworker/3:2+events20:29:373
351195899244312,2427cyclictest3589807-21kworker/2:0+events23:14:372
351195899244311,2429cyclictest3530227-21kworker/2:0+events20:28:082
351195899244212,2427cyclictest3596059-21kworker/2:0+events23:54:312
351195899244212,2426cyclictest3593480-21kworker/2:2+events23:26:042
351195899244211,2428cyclictest3572351-21kworker/2:2+events22:15:002
35119589924419,2428cyclictest3596059-21kworker/2:0+events23:37:052
351195899244111,2426cyclictest3534715-21kworker/2:2+events20:18:202
351195899243712,2422cyclictest3544636-21kworker/2:0+events21:07:072
35119649924369,2424cyclictest3618087-21kworker/3:0+events00:37:173
351195899243612,2421cyclictest3536366-21kworker/2:1+events20:34:582
351195399243612,2420cyclictest3599791-21kworker/0:1+events23:44:370
351195899243511,2421cyclictest3541401-21kworker/2:0+events20:41:022
351195399243412,2419cyclictest3580301-21kworker/0:1+events22:38:590
351195399243012,2415cyclictest3549347-21kworker/0:2+events21:09:500
351195399242912,2414cyclictest3533590-21kworker/0:2+events20:25:270
351195399242312,2407cyclictest3522174-21kworker/0:1+events19:40:130
351195399242312,2407cyclictest3522174-21kworker/0:1+events19:40:130
351196499242111,2406cyclictest3539712-21kworker/3:0+events20:47:123
351195899242112,2405cyclictest3530227-21kworker/2:0+events20:23:132
351196499241812,2403cyclictest3586576-21kworker/3:2+events22:57:363
351195899241812,2403cyclictest3526959-21kworker/2:1+events19:59:462
351195899241611,2401cyclictest3575696-21kworker/2:1+events22:25:362
351196499241411,2400cyclictest3544731-21kworker/3:1+events21:03:143
351195399241412,2399cyclictest3555463-21kworker/0:2+events21:31:350
351196499241212,2397cyclictest3596117-21kworker/3:2+events00:00:143
351195899241211,2397cyclictest3526959-21kworker/2:1+events20:04:202
35119589924108,2399cyclictest3578909-21kworker/2:0+events22:35:132
351196499240612,2391cyclictest3596117-21kworker/3:2+events23:56:043
351195699240612,2390cyclictest3537750-21kworker/1:2+events20:26:351
351195699240312,2387cyclictest3612753-21kworker/1:1+events00:19:411
351196499240212,2387cyclictest3572441-21kworker/3:2+events22:18:463
351196499240212,2386cyclictest3536158-21kworker/3:2+events20:37:163
351196499240112,2385cyclictest3550713-21kworker/3:0+events21:20:323
351196499240110,2387cyclictest3583795-21kworker/3:1+events23:06:203
351196499240012,2385cyclictest3611502-21kworker/3:1+events00:27:153
351196499239912,2383cyclictest3564261-21kworker/3:2+events21:52:543
351196499239912,2383cyclictest3564261-21kworker/3:2+events21:52:543
351196499239912,2383cyclictest3528314-21kworker/3:2+events20:06:143
351196499239911,2384cyclictest3594489-21kworker/3:1+events23:34:503
351196499239812,2382cyclictest3596117-21kworker/3:2+events00:17:223
351196499239712,2382cyclictest3547481-21kworker/3:2+events21:35:213
351196499239711,2383cyclictest3583795-21kworker/3:1+events22:53:473
351196499239710,2384cyclictest3611502-21kworker/3:1+events00:20:503
351196499239611,2382cyclictest3547481-21kworker/3:2+events21:18:393
351195699239512,2380cyclictest3611093-21kworker/1:2+events00:12:491
35119539923950,2392cyclictest3580301-21kworker/0:1+events22:40:520
351195699239412,2379cyclictest3586762-21kworker/1:1+events23:35:111
35119569923939,2380cyclictest3580214-21kworker/1:0+events22:41:171
351196499238912,2373cyclictest3594489-21kworker/3:1+events23:26:493
351195399238712,2372cyclictest3560652-21kworker/0:0+events21:46:450
351195399238512,2369cyclictest3607801-21kworker/0:2+events00:09:030
35119649923848,2372cyclictest3547481-21kworker/3:2+events21:13:403
351195399238312,2368cyclictest3526720-21kworker/0:1+events19:58:390
351195399238312,2367cyclictest3558644-21kworker/0:1+events21:38:420
351196499238211,2367cyclictest3539712-21kworker/3:0+events20:43:463
351195399238012,2365cyclictest3515171-21kworker/0:0+events19:18:000
351196499237712,2362cyclictest3596117-21kworker/3:2+events23:46:303
351196499237412,2358cyclictest3592125-21kworker/3:2+events23:19:583
351195399237212,2357cyclictest3569231-21kworker/0:1+events22:12:020
351195399236612,2350cyclictest3588327-21kworker/0:0+events23:06:420
35119589923638,2351cyclictest3572351-21kworker/2:2+events22:18:222
351195899236311,2348cyclictest3586607-21kworker/2:1+events22:59:312
351196499236010,2346cyclictest3583795-21kworker/3:1+events23:04:033
351195399235610,2342cyclictest3569231-21kworker/0:1+events22:19:080
351195399235412,2338cyclictest3616138-21kworker/0:1+events00:33:510
351195399235312,2337cyclictest3607801-21kworker/0:2+events00:14:450
351195399235212,2336cyclictest3613107-21kworker/0:0+events00:38:480
351195399235210,2339cyclictest3607801-21kworker/0:2+events00:03:180
351195399235112,2336cyclictest3565681-21kworker/0:1+events21:54:260
351195399235112,2336cyclictest3565681-21kworker/0:1+events21:54:260
351195399235112,2336cyclictest3544365-21kworker/0:0+events21:04:010
351195399235012,2334cyclictest3549347-21kworker/0:2+events21:12:080
351195399234910,2336cyclictest3520306-21kworker/0:0+events19:35:390
35119539923468,2334cyclictest3558644-21kworker/0:1+events21:40:130
351195399234311,2329cyclictest3539858-21kworker/0:0+events20:35:450
351195399234212,2326cyclictest3585215-21kworker/0:2+events22:58:010
351195699233012,2315cyclictest3515352-21kworker/1:1+events19:59:261
351195699232812,2312cyclictest3538156-21kworker/1:3+events20:59:481
35119569923278,2315cyclictest3526871-21kworker/1:2+events19:54:101
351195399232712,2311cyclictest3562332-21kworker/0:2+events22:02:030
351195699232612,2311cyclictest3563990-21kworker/1:2+events21:49:491
351195699232610,2313cyclictest3596302-21kworker/1:2+events23:30:161
351195699232511,2311cyclictest3558980-21kworker/1:0+events21:50:591
351195699232511,2311cyclictest3558980-21kworker/1:0+events21:50:591
351195699232411,2309cyclictest3521992-21kworker/1:0+events19:37:581
351195899232312,2307cyclictest3596059-21kworker/2:0+events23:49:092
351195699232311,2309cyclictest3530146-21kworker/1:2+events20:14:591
351196499232211,2308cyclictest3583795-21kworker/3:1+events23:13:083
351195699232210,2309cyclictest3570689-21kworker/1:0+events22:18:011
351195699231911,2305cyclictest3558980-21kworker/1:0+events21:37:561
351195699231512,2299cyclictest3538156-21kworker/1:3+events20:48:211
351195699231311,2298cyclictest3521992-21kworker/1:0+events19:41:431
351195699231311,2298cyclictest3521992-21kworker/1:0+events19:41:421
351195699231212,2298cyclictest3586762-21kworker/1:1+events23:10:081
351195699231211,2298cyclictest3562039-21kworker/1:1+events21:43:391
351195699231211,2297cyclictest3601116-21kworker/1:2+events23:46:541
351195699231210,2298cyclictest3553930-21kworker/1:1+events21:34:351
351195699231112,2296cyclictest3563990-21kworker/1:2+events22:05:321
351195699231111,2297cyclictest3538156-21kworker/1:3+events21:19:011
35119569923109,2298cyclictest3612753-21kworker/1:1+events00:21:591
351195699231012,2294cyclictest3549676-21kworker/1:1+events21:07:321
351195899230910,2295cyclictest3513581-21kworker/2:3+events19:19:082
351195699230912,2294cyclictest3538156-21kworker/1:3+events20:37:371
351195899230811,2293cyclictest3544636-21kworker/2:0+events20:52:102
351195699230612,2291cyclictest3585156-21kworker/1:0+events22:56:041
351195699229812,2283cyclictest3583424-21kworker/1:2+events23:05:571
351195899229211,2277cyclictest3518260-21kworker/2:1+events19:31:042
351195699228911,2275cyclictest3515352-21kworker/1:1+events20:04:431
351195899227911,2264cyclictest3564055-21kworker/2:1+events21:49:032
35119539922789,2266cyclictest3580301-21kworker/0:1+events22:47:440
351196499227711,2263cyclictest3531602-21kworker/3:0+events20:16:503
351195399227410,2260cyclictest3513162-21kworker/0:2+events19:31:280
351195899227212,2257cyclictest3506549-21kworker/2:0+events19:52:372
351195399227211,2257cyclictest3562332-21kworker/0:2+events21:58:370
351195899226911,2255cyclictest3552445-21kworker/2:1+events21:17:312
351195899226311,2248cyclictest3575696-21kworker/2:1+events22:42:492
351196499224712,2233cyclictest3508084-21kworker/3:0+events19:25:433
351195899224511,2232cyclictest3550775-21kworker/2:2+events21:31:122
351195899224011,2225cyclictest3550775-21kworker/2:2+events21:37:112
351195899224010,2227cyclictest3585010-21kworker/2:0+events22:53:002
351195899224010,2226cyclictest3616934-21kworker/2:2+events00:36:072
351195899223810,2225cyclictest3596059-21kworker/2:0+events23:43:492
351195899223810,2225cyclictest3521962-21kworker/2:2+events19:40:362
351195899223810,2225cyclictest3521962-21kworker/2:2+events19:40:362
351195899223611,2223cyclictest3612907-21kworker/2:2+events00:20:042
351195899223610,2222cyclictest3550775-21kworker/2:2+events21:13:172
35119589922358,2224cyclictest3572351-21kworker/2:2+events22:23:452
351196499223210,2218cyclictest3590018-21kworker/3:0+events23:23:223
351196499223111,2217cyclictest3518227-21kworker/3:2+events19:42:293
351196499223111,2217cyclictest3518227-21kworker/3:2+events19:42:283
35119589922239,2211cyclictest3544636-21kworker/2:0+events20:57:072
351195699222311,2209cyclictest3515352-21kworker/1:1+events20:08:301
351195399222310,2210cyclictest3607801-21kworker/0:2+events00:22:230
351195899221911,2205cyclictest3596059-21kworker/2:0+events00:08:382
351196499221612,2201cyclictest3531602-21kworker/3:0+events20:11:563
351195699221411,2200cyclictest3583424-21kworker/1:2+events22:53:241
35119649922139,2201cyclictest3572441-21kworker/3:2+events22:30:373
351195699221310,2200cyclictest3531752-21kworker/1:0+events20:33:021
351195399221111,2199cyclictest3585215-21kworker/0:2+events23:16:330
351195699220611,2192cyclictest3606306-21kworker/1:2+events00:03:411
351195699220611,2191cyclictest3586762-21kworker/1:1+events23:04:491
351196499220511,2191cyclictest3520251-21kworker/3:1+events20:03:103
351196499220211,2187cyclictest3572441-21kworker/3:2+events22:29:523
351196499220111,2187cyclictest3520251-21kworker/3:1+events19:33:443
35119649922008,2189cyclictest3569173-21kworker/3:1+events22:02:273
351196499220010,2186cyclictest3531602-21kworker/3:0+events20:20:353
35119649921988,2187cyclictest3562305-21kworker/3:0+events21:48:403
351196499219711,2182cyclictest3596117-21kworker/3:2+events23:41:113
351195699219711,2182cyclictest3602720-21kworker/1:1+events00:07:311
35119649921967,2186cyclictest3569173-21kworker/3:1+events22:09:193
351196499219511,2181cyclictest3536158-21kworker/3:2+events20:34:353
351196499219511,2181cyclictest3508084-21kworker/3:0+events19:23:473
351196499219412,2178cyclictest3518227-21kworker/3:2+events19:37:103
351196499219411,2180cyclictest3572441-21kworker/3:2+events22:20:403
351196499219410,2181cyclictest3520251-21kworker/3:1+events19:51:073
351196499218911,2175cyclictest3524852-21kworker/3:0+events19:49:593
351196499218811,2174cyclictest3596117-21kworker/3:2+events23:37:493
351195399218611,2169cyclictest3544365-21kworker/0:0+events20:50:590
351195699218011,2166cyclictest3618014-21kworker/1:1+events00:37:401
351195699217912,2163cyclictest3581837-21kworker/1:1+events22:48:281
351195699217811,2163cyclictest3602720-21kworker/1:1+events23:53:001
351195399217812,2164cyclictest3526720-21kworker/0:1+events20:15:210
351195899217710,2165cyclictest3506549-21kworker/2:0+events19:36:252
351195699217511,2161cyclictest3538156-21kworker/1:3+events20:51:241
351196499217311,2159cyclictest3569173-21kworker/3:1+events22:12:453
351196499217111,2157cyclictest3567253-21kworker/3:0+events21:55:573
35119649921689,2156cyclictest3611502-21kworker/3:1+events00:31:523
351195699216811,2155cyclictest3555554-21kworker/1:0+events21:25:041
351195699216612,2151cyclictest3594517-21kworker/1:0+events23:26:261
351195399216210,2149cyclictest3523897-21kworker/0:0+events19:51:310
351195399216011,2146cyclictest3601682-21kworker/0:2+events23:55:170
351196499215911,2145cyclictest3520251-21kworker/3:1+events19:56:453
351195399215711,2143cyclictest3562332-21kworker/0:2+events22:07:040
351195399215711,2143cyclictest3533590-21kworker/0:2+events20:46:040
351195399215710,2143cyclictest3569231-21kworker/0:1+events22:28:190
351195399215611,2141cyclictest3555463-21kworker/0:2+events21:22:010
351195399215513,2139cyclictest3545950-21kworker/0:1+events20:55:130
351195399215510,2141cyclictest3531692-21kworker/0:0+events20:11:100
351195399215410,2141cyclictest3611393-21kworker/0:1+events00:19:170
351195399215410,2141cyclictest3574144-21kworker/0:0+events22:31:460
351195399215310,2139cyclictest3591554-21kworker/0:0+events23:45:230
351195699215210,2139cyclictest3520068-21kworker/1:2+events19:34:511
35119539921529,2140cyclictest3528344-21kworker/0:2+events20:01:160
351195399215211,2139cyclictest3533590-21kworker/0:2+events20:22:080
35119539921518,2140cyclictest3555463-21kworker/0:2+events21:28:310
351195699215011,2136cyclictest3515352-21kworker/1:1+events19:25:201
351195399215011,2136cyclictest3569231-21kworker/0:1+events22:23:210
351195399214512,2130cyclictest3598078-21kworker/0:2+events23:34:250
351195699214311,2129cyclictest3572324-21kworker/1:1+events22:30:591
35119649921429,2130cyclictest3511660-21kworker/3:1+events19:13:503
35119539921399,2126cyclictest3516821-21kworker/0:1+events19:28:470
351195699213811,2124cyclictest3586762-21kworker/1:1+events23:15:471
351195699213311,2119cyclictest3546177-21kworker/1:0+events21:00:571
351195699212412,2109cyclictest3553930-21kworker/1:1+events21:22:251
351196499211911,2105cyclictest3579009-21kworker/3:1+events22:37:493
351195699211910,2106cyclictest3523676-21kworker/1:2+events19:46:351
351195699211711,2103cyclictest3538156-21kworker/1:3+events21:11:231
351195699211611,2102cyclictest3604643-21kworker/1:0+events23:57:561
351195699211511,2101cyclictest3531752-21kworker/1:0+events20:18:421
351195699211510,2102cyclictest3503705-21kworker/1:3+events19:23:241
35119569921138,2102cyclictest3608052-21kworker/1:0+events00:28:251
351195699211311,2099cyclictest3586762-21kworker/1:1+events23:23:001
351195699211210,2099cyclictest3572324-21kworker/1:1+events22:13:541
351196499210711,2094cyclictest3579009-21kworker/3:1+events22:40:083
351195399210511,2091cyclictest3515171-21kworker/0:0+events19:21:290
351195699210411,2090cyclictest3563990-21kworker/1:2+events21:59:251
35119569921009,2087cyclictest3577488-21kworker/1:2+events22:38:141
35119589920778,2066cyclictest3513130-21kworker/2:2+events19:14:372
351196499203910,2026cyclictest3555617-21kworker/3:1+events21:27:443
351196499203910,2025cyclictest3559441-21kworker/3:1+events21:44:263
351195699202610,2013cyclictest3503705-21kworker/1:3+events19:19:331
35119649920127,2002cyclictest3547481-21kworker/3:2+events21:30:263
35119539920118,2001cyclictest3585215-21kworker/0:2+events23:21:520
351195399201010,1996cyclictest3513162-21kworker/0:2+events19:13:070
35119539920057,1995cyclictest3598078-21kworker/0:2+events23:38:110
351195699200310,1991cyclictest3570689-21kworker/1:0+events22:25:151
35119539920024,1994cyclictest3544365-21kworker/0:0+events21:19:240
351195699195210,1938cyclictest3567555-21kworker/1:1+events22:03:131
35119569919468,1935cyclictest3503705-21kworker/1:3+events19:13:281
35119539919325,1924cyclictest3526720-21kworker/0:1+events20:09:160
35114362158114,26sleep20-21swapper/219:05:572
35116142143102,36sleep10-21swapper/119:08:121
35115912140109,26sleep30-21swapper/319:07:553
3511390213893,16sleep00-21swapper/019:05:230
351195899187,7cyclictest3593237-21basename23:19:592
351196499140,4cyclictest3610097-21chrt00:10:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional