You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 22:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Fri May 08, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
375403399278613,2768cyclictest3833755-21kworker/2:2+events23:35:122
375403399277412,2758cyclictest3843239-21kworker/2:2+events00:10:002
375403199272313,2707cyclictest3802927-21kworker/1:2+events22:00:151
375403199271712,2701cyclictest3763920-21kworker/1:2+events19:45:001
375402699268413,2667cyclictest3814667-21kworker/0:2+events22:20:180
375403699267613,2661cyclictest3846626-21kworker/3:0+events00:05:013
375403699267412,2658cyclictest3768410-21kworker/3:1+events19:55:183
375403399266713,2649cyclictest3768498-21kworker/2:1+events20:00:172
375402699264311,2628cyclictest3770310-21kworker/0:2+events20:05:150
37540369926180,2614cyclictest3755623-21kworker/3:1+events19:25:163
375403699257912,2563cyclictest3808275-21kworker/3:0+events22:26:423
375403699257312,2557cyclictest3794117-21kworker/3:2+events21:25:193
375402699256912,2553cyclictest3776157-21kworker/0:1+events20:18:330
375402699256412,2548cyclictest3825987-21kworker/0:0+events22:57:100
375402699255211,2537cyclictest3837104-21kworker/0:1+events00:05:470
375403399253912,2523cyclictest3778094-21kworker/2:2+events20:40:142
375402699253812,2523cyclictest3825987-21kworker/0:0+events23:02:060
375403399253510,2521cyclictest3856085-21kworker/2:2+events00:30:412
375403399253011,2515cyclictest3779759-21kworker/2:0+events20:28:502
375403399252410,2511cyclictest3856085-21kworker/2:2+events00:28:232
375403699251612,2500cyclictest3838591-21kworker/3:2+events23:43:343
375403699250012,2485cyclictest3776174-21kworker/3:0+events20:26:103
375403699250012,2484cyclictest3846626-21kworker/3:0+events00:11:073
375403699249712,2481cyclictest3789292-21kworker/3:1+events21:00:583
375403699249712,2481cyclictest3770045-21kworker/3:2+events20:10:573
375403699249711,2484cyclictest3786007-21kworker/3:2+events20:50:033
375403399249712,2482cyclictest3798597-21kworker/2:0+events21:30:142
375403699249512,2480cyclictest3841813-21kworker/3:1+events23:48:143
375403699249512,2480cyclictest3838591-21kworker/3:2+events23:52:053
375403699249512,2480cyclictest3819756-21kworker/3:1+events22:59:283
375402699249412,2479cyclictest3759219-21kworker/0:2+events19:35:530
375403699249211,2477cyclictest3819756-21kworker/3:1+events22:54:543
375402699249212,2476cyclictest3837104-21kworker/0:1+events23:31:270
375403699249112,2476cyclictest3776174-21kworker/3:0+events20:33:243
375403699249112,2476cyclictest3770045-21kworker/3:2+events20:15:523
375403699249012,2474cyclictest3830505-21kworker/3:2+events23:09:313
375402699249012,2475cyclictest3790876-21kworker/0:1+events21:13:560
375402699248912,2474cyclictest3795695-21kworker/0:0+events21:28:210
375402699248612,2471cyclictest3790876-21kworker/0:1+events21:16:350
375402699248612,2470cyclictest3805167-21kworker/0:1+events21:53:190
375402699248612,2470cyclictest3805167-21kworker/0:1+events21:53:190
37540269924859,2472cyclictest3852783-21kworker/0:0+events00:32:590
375402699248412,2470cyclictest3837104-21kworker/0:1+events23:40:100
375403399248112,2466cyclictest3792545-21kworker/2:0+events21:15:262
375402699247712,2461cyclictest3816407-21kworker/0:0+events22:42:450
375402699247710,2464cyclictest3779787-21kworker/0:0+events20:32:400
375402699247612,2461cyclictest3776157-21kworker/0:1+events20:53:470
375402699247112,2456cyclictest3801874-21kworker/0:0+events22:17:190
375403699247011,2455cyclictest3824201-21kworker/3:0+events22:46:563
375402699247011,2456cyclictest3837104-21kworker/0:1+events23:47:030
375403399246612,2450cyclictest3829090-21kworker/2:1+events23:19:182
375402699246610,2452cyclictest3852783-21kworker/0:0+events00:22:370
375403399246211,2448cyclictest3816230-21kworker/2:1+events22:28:362
375403399246210,2448cyclictest3808213-21kworker/2:1+events22:13:312
375402699246211,2448cyclictest3837104-21kworker/0:1+events23:29:550
375403399245112,2436cyclictest3814488-21kworker/2:0+events22:51:492
375403399245112,2435cyclictest3853000-21kworker/2:0+events00:23:012
375403399245112,2435cyclictest3822785-21kworker/2:2+events22:48:052
375403399245111,2437cyclictest3806605-21kworker/2:2+events22:02:102
375403399244912,2434cyclictest3778094-21kworker/2:2+events20:22:452
375403399244912,2433cyclictest3806605-21kworker/2:2+events21:57:342
375403399244912,2433cyclictest3806605-21kworker/2:2+events21:57:342
375403399244912,2431cyclictest3778094-21kworker/2:2+events20:38:192
375403399244812,2432cyclictest3819544-21kworker/2:2+events22:33:542
375403399244812,2432cyclictest3798597-21kworker/2:0+events21:26:512
37540339924479,2436cyclictest3849789-21kworker/2:0+events00:10:452
375403399244711,2432cyclictest3837432-21kworker/2:1+events23:42:272
37540339924469,2433cyclictest3766866-21kworker/2:0+events19:49:122
375403399244611,2432cyclictest3765263-21kworker/2:2+events19:44:372
375403399244512,2431cyclictest3833755-21kworker/2:2+events23:24:172
375403399244312,2428cyclictest3843239-21kworker/2:2+events23:50:312
375403399244312,2427cyclictest3790786-21kworker/2:1+events21:07:022
375403399244311,2428cyclictest3773329-21kworker/2:0+events20:11:412
375402699244211,2428cyclictest3846506-21kworker/0:0+events23:59:130
375403399243912,2425cyclictest3759100-21kworker/2:2+events19:31:182
375403699243312,2419cyclictest3781452-21kworker/3:1+events20:35:203
375402699243310,2420cyclictest3776157-21kworker/0:1+events20:21:120
375403399243212,2416cyclictest3803767-21kworker/2:0+events21:49:172
375403699242412,2408cyclictest3856182-21kworker/3:2+events00:35:173
375403699242211,2407cyclictest3814555-21kworker/3:1+events22:18:263
37540319924207,2409cyclictest3827588-21kworker/1:1+events23:00:161
375403399241911,2404cyclictest3794854-21kworker/2:1+events21:38:572
375403399241412,2399cyclictest3843239-21kworker/2:2+events00:00:212
375403399241412,2399cyclictest3843239-21kworker/2:2+events00:00:212
375403199241412,2400cyclictest3835475-21kworker/1:0+events23:25:031
375403199241012,2395cyclictest3837077-21kworker/1:1+events23:49:451
375403199241010,2396cyclictest3816320-21kworker/1:0+events22:30:301
375403699240812,2392cyclictest3808275-21kworker/3:0+events22:13:543
37540319924079,2395cyclictest3840040-21kworker/1:0+events23:41:211
375403399240512,2388cyclictest3814488-21kworker/2:0+events22:43:092
37540269924008,2387cyclictest3798614-21kworker/0:1+events21:37:250
375403699239612,2381cyclictest3765199-21kworker/3:2+events19:43:283
375403699239511,2380cyclictest3790906-21kworker/3:0+events21:07:483
375403699238912,2373cyclictest3808275-21kworker/3:0+events22:07:523
375402699238511,2370cyclictest3837104-21kworker/0:1+events23:35:350
375402699238212,2366cyclictest3825987-21kworker/0:0+events22:54:300
375402699237812,2363cyclictest3843270-21kworker/0:0+events23:51:410
375403399237612,2360cyclictest3781365-21kworker/2:1+events20:34:572
375402699236311,2349cyclictest3846506-21kworker/0:0+events00:04:370
375402699236311,2349cyclictest3846506-21kworker/0:0+events00:04:370
375403699235612,2341cyclictest3852844-21kworker/3:1+events00:18:253
375403699235512,2339cyclictest3827621-21kworker/3:0+events23:37:073
375403699235311,2338cyclictest3763576-21kworker/3:0+events19:50:223
375403699235011,2336cyclictest3794117-21kworker/3:2+events21:23:273
375403199234812,2334cyclictest3816320-21kworker/1:0+events22:26:191
37540269923479,2335cyclictest3798614-21kworker/0:1+events21:34:440
37540269923476,2338cyclictest3829314-21kworker/0:2+events23:23:540
375403699234112,2326cyclictest3755623-21kworker/3:1+events19:20:153
375403199234111,2326cyclictest3848073-21kworker/1:1+events00:05:241
375403199233911,2324cyclictest3832157-21kworker/1:2+events23:33:191
375403199233712,2322cyclictest3782816-21kworker/1:0+events21:06:401
375403199232912,2314cyclictest3766683-21kworker/1:0+events19:47:411
375403199232912,2313cyclictest3768317-21kworker/1:2+events19:54:091
375403199232911,2315cyclictest3792331-21kworker/1:2+events21:18:081
37540269923292,2324cyclictest3810257-21kworker/0:2+events22:09:000
375403199232812,2312cyclictest3841843-21kworker/1:2+events23:57:191
375403199232811,2313cyclictest3851267-21kworker/1:2+events00:23:471
37540319923269,2314cyclictest3762157-21kworker/1:0+events19:35:291
37540319923267,2315cyclictest3806637-21kworker/1:1+events21:57:101
37540319923267,2315cyclictest3806637-21kworker/1:1+events21:57:101
375403199232612,2311cyclictest3802927-21kworker/1:2+events21:50:461
375403199232612,2311cyclictest3802927-21kworker/1:2+events21:50:461
375403199232611,2312cyclictest3848073-21kworker/1:1+events00:01:531
375403199232611,2312cyclictest3848073-21kworker/1:1+events00:01:521
375403199232512,2311cyclictest3832157-21kworker/1:2+events23:20:061
375402699232411,2310cyclictest3783054-21kworker/0:0+events20:40:380
375403199232212,2307cyclictest3757292-21kworker/1:1+events19:21:471
375403199232011,2306cyclictest3811532-21kworker/1:2+events22:12:251
375403199231912,2304cyclictest3818229-21kworker/1:1+events22:38:111
375403199231911,2305cyclictest3798702-21kworker/1:0+events21:34:211
375402699231914,2302cyclictest3776157-21kworker/0:1+events20:39:290
375402699231911,2305cyclictest3774574-21kworker/0:0+events20:11:190
375403699231612,2301cyclictest3790906-21kworker/3:0+events21:13:313
375403699230812,2292cyclictest3808275-21kworker/3:0+events22:03:393
375403699230810,2295cyclictest3830505-21kworker/3:2+events23:11:003
375402699230811,2294cyclictest3852783-21kworker/0:0+events00:36:040
375403699230612,2291cyclictest3838591-21kworker/3:2+events23:56:573
375403199229111,2276cyclictest3777574-21kworker/1:0+events20:29:581
375402699228811,2273cyclictest3827651-21kworker/0:1+events23:19:420
375402699228413,2268cyclictest3759219-21kworker/0:2+events19:47:170
37540369922785,2268cyclictest3770045-21kworker/3:2+events20:05:373
37540269922776,2268cyclictest3852783-21kworker/0:0+events00:29:080
375403699227610,2262cyclictest3757791-21kworker/3:2+events19:33:133
375403699227511,2262cyclictest3816197-21kworker/3:2+events22:30:073
375403699227511,2261cyclictest3827621-21kworker/3:0+events23:31:033
375403699227511,2260cyclictest3827621-21kworker/3:0+events23:20:273
375403699227511,2260cyclictest3789292-21kworker/3:1+events21:18:543
375402699227511,2261cyclictest3801874-21kworker/0:0+events21:59:530
375402699227511,2261cyclictest3801874-21kworker/0:0+events21:59:520
37540369922747,2264cyclictest3821407-21kworker/3:2+events22:43:523
375403699227411,2260cyclictest3794117-21kworker/3:2+events21:41:153
375403699227410,2261cyclictest3851208-21kworker/3:2+events00:21:293
375403699227410,2261cyclictest3808275-21kworker/3:0+events22:23:183
375403699227310,2260cyclictest3801815-21kworker/3:1+events21:55:383
375403699227310,2260cyclictest3801815-21kworker/3:1+events21:55:383
375402699227311,2259cyclictest3790876-21kworker/0:1+events21:09:450
375403699227211,2258cyclictest3846626-21kworker/3:0+events00:00:433
375403699227211,2258cyclictest3846626-21kworker/3:0+events00:00:433
375402699227211,2258cyclictest3816407-21kworker/0:0+events22:37:000
375402699227211,2258cyclictest3768587-21kworker/0:0+events20:02:340
375402699227110,2259cyclictest3810257-21kworker/0:2+events22:10:080
37540369922709,2257cyclictest3819756-21kworker/3:1+events22:35:513
375402699227011,2256cyclictest3819456-21kworker/0:1+events22:31:380
375402699227011,2256cyclictest3766806-21kworker/0:1+events19:59:310
375402699227011,2255cyclictest3752093-21kworker/0:1+events19:29:490
375402699227010,2257cyclictest3766806-21kworker/0:1+events19:50:430
375403699226911,2254cyclictest3789292-21kworker/3:1+events20:59:033
375402699226913,2254cyclictest3765169-21kworker/0:0+events19:43:530
375402699226911,2255cyclictest3829314-21kworker/0:2+events23:11:210
37540369922685,2260cyclictest3803441-21kworker/3:0+events21:47:463
375402699226711,2253cyclictest3783054-21kworker/0:0+events20:49:420
375402699226611,2252cyclictest3852783-21kworker/0:0+events00:17:170
375402699226611,2252cyclictest3808396-21kworker/0:1+events22:00:390
375402699226610,2253cyclictest3783054-21kworker/0:0+events21:03:120
375403699226510,2252cyclictest3776174-21kworker/3:0+events20:24:163
375403399226310,2250cyclictest3787722-21kworker/2:2+events20:56:522
375403199226310,2250cyclictest3787841-21kworker/1:2+events20:55:441
375402699226011,2246cyclictest3759219-21kworker/0:2+events19:30:330
375402699225911,2245cyclictest3783054-21kworker/0:0+events20:58:410
375403399225611,2241cyclictest3851393-21kworker/2:1+events00:18:482
375402699225411,2240cyclictest3822756-21kworker/0:1+events22:48:270
375403399225210,2239cyclictest3851393-21kworker/2:1+events00:37:542
375403399225210,2238cyclictest3803767-21kworker/2:0+events21:52:112
375403399225210,2238cyclictest3803767-21kworker/2:0+events21:52:112
375402699225011,2236cyclictest3803564-21kworker/0:2+events21:45:500
37540369922469,2231cyclictest3763576-21kworker/3:0+events19:37:453
375403199224513,2229cyclictest3782816-21kworker/1:0+events21:02:261
375403199224511,2231cyclictest3784529-21kworker/1:2+events20:46:181
375403399224110,2228cyclictest3814488-21kworker/2:0+events22:37:472
37540339922389,2226cyclictest3814488-21kworker/2:0+events22:18:482
37540339922389,2226cyclictest3757414-21kworker/2:1+events19:29:052
375403399223811,2224cyclictest3837432-21kworker/2:1+events23:46:402
375403399223610,2222cyclictest3765263-21kworker/2:2+events19:53:012
375403399223510,2222cyclictest3790786-21kworker/2:1+events21:03:572
375403399223311,2219cyclictest3827466-21kworker/2:2+events23:07:182
375403399223210,2219cyclictest3827466-21kworker/2:2+events23:02:492
375403399223210,2219cyclictest3749168-21kworker/2:0+events19:15:462
375402699223111,2216cyclictest3795695-21kworker/0:0+events21:21:340
375403399223010,2217cyclictest3792545-21kworker/2:0+events21:10:312
375403399222911,2215cyclictest3797018-21kworker/2:2+events21:21:552
37540339922288,2217cyclictest3814488-21kworker/2:0+events22:23:422
375402699222410,2210cyclictest3801874-21kworker/0:0+events21:43:320
375403699222311,2209cyclictest3771669-21kworker/3:0+events20:04:523
375403399222311,2209cyclictest3761977-21kworker/2:0+events19:37:232
375403399222310,2210cyclictest3845057-21kworker/2:0+events23:58:502
375403399222110,2208cyclictest3794854-21kworker/2:1+events21:42:242
375403199222111,2208cyclictest3800365-21kworker/1:1+events21:35:311
375403699222011,2206cyclictest3795724-21kworker/3:0+events21:33:573
375403399222011,2207cyclictest3829090-21kworker/2:1+events23:10:372
37540339922075,2198cyclictest3833755-21kworker/2:2+events23:30:172
375403699220510,2192cyclictest3854575-21kworker/3:0+events00:26:263
375403699219911,2185cyclictest3856182-21kworker/3:2+events00:32:363
375403399219410,2180cyclictest3833755-21kworker/2:2+events23:26:542
375403199219412,2179cyclictest3822634-21kworker/1:0+events22:52:591
375403699219010,2177cyclictest3755623-21kworker/3:1+events19:18:203
375403399218210,2168cyclictest3784746-21kworker/2:1+events20:48:592
375403199217711,2163cyclictest3851267-21kworker/1:2+events00:28:001
375402699217110,2158cyclictest3814667-21kworker/0:2+events22:25:570
375403699216110,2148cyclictest3784380-21kworker/3:0+events20:48:123
375403199215712,2141cyclictest3781182-21kworker/1:1+events20:31:301
375403199214610,2133cyclictest3808244-21kworker/1:0+events22:06:001
375403199213611,2122cyclictest3811532-21kworker/1:2+events22:18:031
375403199213011,2116cyclictest3760557-21kworker/1:1+events19:30:551
375403199212811,2114cyclictest3851267-21kworker/1:2+events00:14:131
375403199212811,2113cyclictest3820371-21kworker/1:2+events22:41:151
375403199212810,2115cyclictest3758950-21kworker/1:2+events19:28:181
375403199212711,2113cyclictest3802927-21kworker/1:2+events21:41:371
375403199212711,2113cyclictest3777574-21kworker/1:0+events20:20:501
375403199212611,2111cyclictest3809927-21kworker/1:1+events22:21:241
375403199212511,2111cyclictest3837077-21kworker/1:1+events23:54:001
375403199212511,2111cyclictest3829235-21kworker/1:0+events23:14:461
37540319921217,2111cyclictest3794025-21kworker/1:1+events21:22:171
375403199212111,2107cyclictest3782816-21kworker/1:0+events20:38:421
375403199212110,2108cyclictest3822634-21kworker/1:0+events22:56:251
375403199212011,2106cyclictest3782816-21kworker/1:0+events20:42:551
37540319921194,2112cyclictest3832157-21kworker/1:2+events23:15:321
375403199211910,2106cyclictest3829235-21kworker/1:0+events23:06:541
375402699211810,2105cyclictest3752093-21kworker/0:1+events19:13:260
37540339921179,2105cyclictest3768498-21kworker/2:1+events20:09:472
375403199211610,2103cyclictest3769981-21kworker/1:0+events20:05:591
375403199211610,2103cyclictest3749082-21kworker/1:0+events19:19:291
375403199211610,2102cyclictest3837077-21kworker/1:1+events23:36:211
375403199211511,2100cyclictest3804984-21kworker/1:0+events21:48:321
375402699211310,2100cyclictest3827651-21kworker/0:1+events23:05:230
375402699211110,2098cyclictest3779787-21kworker/0:0+events20:29:110
375403699210811,2094cyclictest3803441-21kworker/3:0+events21:51:493
375403699210811,2094cyclictest3803441-21kworker/3:0+events21:51:493
37540369921068,2094cyclictest3827621-21kworker/3:0+events23:00:583
375403199210611,2092cyclictest3856272-21kworker/1:1+events00:34:311
375403699210511,2090cyclictest3765199-21kworker/3:2+events19:46:553
375403199210411,2090cyclictest3851267-21kworker/1:2+events00:17:401
375403199210411,2090cyclictest3782816-21kworker/1:0+events20:50:271
375403199210311,2088cyclictest3858374-21kworker/1:2+events00:37:311
375403199210210,2089cyclictest3782816-21kworker/1:0+events21:10:541
375403399210110,2088cyclictest3768498-21kworker/2:1+events19:55:412
375403199209510,2081cyclictest3824324-21kworker/1:1+events22:48:491
37540269920896,2080cyclictest3752093-21kworker/0:1+events19:16:070
375403699208410,2070cyclictest3827621-21kworker/3:0+events23:27:403
37540339920848,2073cyclictest3814488-21kworker/2:0+events22:57:342
375403699208311,2069cyclictest3781452-21kworker/3:1+events20:41:013
37540339920817,2071cyclictest3782966-21kworker/2:0+events20:53:262
37540339920808,2069cyclictest3749168-21kworker/2:0+events19:20:392
37540339920799,2067cyclictest3755372-21kworker/2:2+events19:13:482
37540339920629,2050cyclictest3773329-21kworker/2:0+events20:18:092
375403699200711,1993cyclictest3833726-21kworker/3:1+events23:17:243
375403199198910,1976cyclictest3774928-21kworker/1:2+events20:17:021
375403199197210,1958cyclictest3749082-21kworker/1:0+events19:14:111
375403199196410,1951cyclictest3771608-21kworker/1:2+events20:04:071
37540369919639,1950cyclictest3801815-21kworker/3:1+events21:37:013
37540319919637,1953cyclictest3792331-21kworker/1:2+events21:27:131
37540319919622,1957cyclictest3769981-21kworker/1:0+events20:14:211
375403199196010,1947cyclictest3769981-21kworker/1:0+events19:58:451
37540369919463,1940cyclictest3752152-21kworker/3:2+events19:12:423
3753872214897,40sleep20-21swapper/219:09:542
37537082143109,28sleep00-21swapper/019:07:490
37538372141107,30sleep30-21swapper/319:09:283
37537202139108,26sleep10-21swapper/119:07:571
375402699237,6cyclictest3759144-21perf19:24:590
3754033991710,5cyclictest3810499-21df_inode22:05:142
375402699160,14cyclictest3850437-21/usr/sbin/munin00:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional