You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 16:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Tue Aug 26, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244686299303614,3016cyclictest2502999-21kworker/2:2+events22:25:122
244685599287713,2858cyclictest2448002-21kworker/0:2+events19:15:130
244685599282211,2807cyclictest2470780-21kworker/0:1+events20:24:590
244686599280814,2791cyclictest2470853-21kworker/3:0+events20:30:213
244685999280213,2787cyclictest2490358-21kworker/1:2+events21:25:191
244685599277611,2761cyclictest2519027-21kworker/0:1+events23:13:150
244686599275913,2743cyclictest2463388-21kworker/3:2+events20:20:253
244686299274012,2723cyclictest2493400-21kworker/2:0+events21:35:152
244686299272013,2703cyclictest2475987-21kworker/2:0+events20:45:012
244685599271713,2700cyclictest2469140-21kworker/0:0+events20:18:520
244686299271012,2693cyclictest2546745-21kworker/2:0+events00:25:142
244685599268411,2667cyclictest2464674-21kworker/0:1+events20:05:170
244686599267313,2657cyclictest2461512-21kworker/3:1+events20:00:223
244686299266812,2651cyclictest2502999-21kworker/2:2+events22:05:182
244686299266511,2650cyclictest2470821-21kworker/2:2+events20:25:242
244685999265812,2642cyclictest2461235-21kworker/1:2+events19:55:221
244685999265412,2637cyclictest2519056-21kworker/1:2+events23:00:191
24468659926405,2631cyclictest2530695-21kworker/3:0+events23:30:153
24468599926159,2602cyclictest2477449-21kworker/1:2+events20:45:221
244685599258312,2567cyclictest2533663-21kworker/0:0+events23:45:180
244685999258212,2567cyclictest2485519-21kworker/1:2+events21:11:391
244686299257812,2562cyclictest2450101-21kworker/2:0+events19:28:552
244685599257312,2557cyclictest2491973-21kworker/0:1+events21:37:100
244685999256112,2545cyclictest2496915-21kworker/1:0+events21:48:081
244685999255912,2543cyclictest2525625-21kworker/1:0+events23:18:341
244685599255412,2538cyclictest2459801-21kworker/0:2+events19:49:170
244685599254711,2532cyclictest2520676-21kworker/0:0+events23:07:320
244685599254310,2529cyclictest2477210-21kworker/0:0+events20:47:390
244685599254011,2525cyclictest2491973-21kworker/0:1+events21:57:400
244685999253012,2516cyclictest2444989-21kworker/1:1+events19:35:381
244686599252812,2512cyclictest2495077-21kworker/3:1+events21:53:533
244685599252712,2511cyclictest2533663-21kworker/0:0+events23:43:060
244685999252612,2511cyclictest2528911-21kworker/1:2+events23:23:511
244685999252112,2505cyclictest2538720-21kworker/1:1+events23:59:221
24468599925198,2508cyclictest2512922-21kworker/1:3+events22:41:371
24468599925198,2508cyclictest2512922-21kworker/1:3+events22:41:371
24468559925160,2512cyclictest2493597-21kworker/0:0+events21:34:520
244685599251412,2499cyclictest2490229-21kworker/0:2+events21:22:130
244685599250912,2493cyclictest2506293-21kworker/0:1+events22:13:380
24468659925037,2493cyclictest2538403-21kworker/3:0+events23:57:523
244686599250012,2485cyclictest2469164-21kworker/3:1+events20:53:493
244686299249812,2482cyclictest2457966-21kworker/2:0+events19:50:482
244685999249612,2480cyclictest2483875-21kworker/1:1+events21:05:141
244685999249412,2479cyclictest2511249-21kworker/1:2+events22:36:151
244685999249412,2478cyclictest2538720-21kworker/1:1+events00:06:101
244686299249311,2480cyclictest2515910-21kworker/2:2+events22:45:022
244685999249312,2477cyclictest2504676-21kworker/1:0+events22:28:581
244685999249212,2476cyclictest2535447-21kworker/1:1+events23:48:201
244685599249212,2476cyclictest2445121-21kworker/0:1+events19:25:320
244686599249112,2475cyclictest2519044-21kworker/3:2+events22:59:083
244685999249112,2476cyclictest2523951-21kworker/1:1+events23:11:411
244685599249112,2475cyclictest2506293-21kworker/0:1+events22:22:500
244685999249012,2474cyclictest2493626-21kworker/1:2+events21:42:061
244685599249012,2475cyclictest2475574-21kworker/0:1+events20:37:540
244686599248911,2475cyclictest2538403-21kworker/3:0+events00:10:223
244685599248812,2472cyclictest2470780-21kworker/0:1+events20:29:570
244685599248712,2472cyclictest2448002-21kworker/0:2+events19:22:550
244685999248612,2470cyclictest2475816-21kworker/1:0+events20:56:071
244686599248512,2469cyclictest2546553-21kworker/3:0+events00:21:483
244685999248512,2469cyclictest2499004-21kworker/1:2+events22:02:151
244685599248512,2469cyclictest2535334-21kworker/0:1+events00:18:030
244685599248511,2470cyclictest2459801-21kworker/0:2+events19:55:430
244685599248413,2468cyclictest2525862-21kworker/0:0+events23:26:080
244685599248411,2470cyclictest2509557-21kworker/0:2+events22:35:290
244685599248311,2469cyclictest2456516-21kworker/0:0+events19:40:570
244685599248311,2468cyclictest2519027-21kworker/0:1+events22:59:320
244686599248211,2468cyclictest2540025-21kworker/3:2+events00:00:323
244685999248211,2467cyclictest2475816-21kworker/1:0+events20:40:511
244685599248212,2466cyclictest2500387-21kworker/0:2+events22:17:280
244685599248111,2466cyclictest2535334-21kworker/0:1+events23:58:130
244685999248011,2465cyclictest2506321-21kworker/1:1+events22:14:011
244685599247912,2464cyclictest2461419-21kworker/0:1+events19:54:590
244685999247812,2462cyclictest2467656-21kworker/1:2+events20:13:101
244685999247711,2463cyclictest2463001-21kworker/1:0+events20:02:141
244685999247612,2460cyclictest2504676-21kworker/1:0+events22:09:041
244685999247512,2459cyclictest2461235-21kworker/1:2+events19:52:181
244685999247312,2457cyclictest2532171-21kworker/1:1+events23:36:121
244685999247311,2459cyclictest2530555-21kworker/1:0+events00:14:161
244685999247112,2457cyclictest2453418-21kworker/1:2+events19:40:081
244685999247011,2456cyclictest2492005-21kworker/1:0+events21:32:121
244685999246912,2454cyclictest2479125-21kworker/1:1+events20:50:421
244685999246911,2455cyclictest2549902-21kworker/1:0+events00:38:361
244685999246810,2454cyclictest2493626-21kworker/1:2+events21:39:521
244685599246812,2454cyclictest2453266-21kworker/0:0+events19:30:250
244685999246611,2452cyclictest2499004-21kworker/1:2+events21:55:471
244685599246512,2450cyclictest2459801-21kworker/0:2+events20:10:560
244685599246311,2448cyclictest2473930-21kworker/0:2+events20:41:360
244686599246212,2446cyclictest2548189-21kworker/3:2+events00:27:533
244685599246112,2445cyclictest2478884-21kworker/0:1+events20:51:520
244685599246111,2447cyclictest2454878-21kworker/0:2+events19:36:460
244685599245911,2445cyclictest2500387-21kworker/0:2+events22:03:240
244685999245812,2443cyclictest2523951-21kworker/1:1+events23:27:151
244685599245811,2443cyclictest2519027-21kworker/0:1+events23:04:070
244685999245712,2442cyclictest2459342-21kworker/1:1+events20:07:511
244685999245611,2441cyclictest2467656-21kworker/1:2+events20:15:281
244685999245610,2443cyclictest2444989-21kworker/1:1+events19:32:381
244685599245512,2440cyclictest2532024-21kworker/0:2+events23:37:220
244685599245512,2439cyclictest2511328-21kworker/0:1+events22:32:030
244685599245412,2438cyclictest2509557-21kworker/0:2+events22:45:240
244685599245312,2438cyclictest2525862-21kworker/0:0+events23:15:300
244686599245212,2438cyclictest2530695-21kworker/3:0+events23:35:093
244685599245212,2436cyclictest2488560-21kworker/0:0+events21:25:420
244686599245112,2436cyclictest2546553-21kworker/3:0+events00:34:263
244685599245112,2436cyclictest2498586-21kworker/0:0+events21:54:390
244686599245010,2436cyclictest2524174-21kworker/3:2+events23:13:363
244686599244912,2433cyclictest2541690-21kworker/3:1+events00:06:573
244686599244912,2433cyclictest2463388-21kworker/3:2+events20:13:553
244686599244812,2432cyclictest2517423-21kworker/3:1+events22:47:423
244685599244811,2433cyclictest2527556-21kworker/0:2+events23:24:140
244685599244810,2435cyclictest2541838-21kworker/0:2+events00:08:520
244685599244711,2433cyclictest2500387-21kworker/0:2+events22:06:240
244685599244710,2434cyclictest2515822-21kworker/0:1+events22:44:390
244685599244710,2434cyclictest2515822-21kworker/0:1+events22:44:390
244686599244612,2430cyclictest2504844-21kworker/3:1+events22:14:233
244686599244612,2430cyclictest2451777-21kworker/3:2+events19:33:263
244686599244512,2430cyclictest2496718-21kworker/3:2+events21:48:313
244686599244512,2429cyclictest2450117-21kworker/3:1+events19:21:213
244686599244412,2428cyclictest2469164-21kworker/3:1+events20:26:553
244686599244411,2430cyclictest2522302-21kworker/3:0+events23:15:543
244686599244212,2428cyclictest2512210-21kworker/3:1+events22:35:053
244686599244212,2427cyclictest2534851-21kworker/3:1+events23:47:323
244686599244212,2426cyclictest2544931-21kworker/3:1+events00:19:113
244686599244112,2426cyclictest2512210-21kworker/3:1+events22:32:253
244686599244111,2427cyclictest2514162-21kworker/3:0+events22:41:143
244686599244111,2427cyclictest2514162-21kworker/3:0+events22:41:133
244686599244012,2425cyclictest2458261-21kworker/3:2+events19:48:083
244685999243912,2423cyclictest2469333-21kworker/1:1+events20:22:221
244686599243812,2422cyclictest2493449-21kworker/3:2+events21:34:053
244686599243712,2422cyclictest2514162-21kworker/3:0+events22:54:373
244685999243612,2422cyclictest2517404-21kworker/1:1+events22:50:021
244685599243510,2421cyclictest2535334-21kworker/0:1+events00:26:450
244685999243412,2418cyclictest2483875-21kworker/1:1+events21:03:211
244685599243112,2416cyclictest2550009-21kworker/0:0+events00:37:070
244686599242811,2413cyclictest2508348-21kworker/3:2+events22:26:423
244686599242710,2414cyclictest2469164-21kworker/3:1+events20:46:313
24468659924269,2414cyclictest2484112-21kworker/3:0+events21:20:223
244686599242411,2410cyclictest2459873-21kworker/3:0+events19:54:133
244686299242112,2405cyclictest2510969-21kworker/2:1+events22:37:232
244686299241612,2400cyclictest2522311-21kworker/2:2+events23:31:222
244686299241312,2398cyclictest2467897-21kworker/2:1+events20:18:302
244685999241311,2400cyclictest2483875-21kworker/1:1+events21:15:041
244686599241112,2396cyclictest2469164-21kworker/3:1+events20:58:243
244686299241110,2397cyclictest2535480-21kworker/2:0+events23:56:422
244686299240912,2394cyclictest2510969-21kworker/2:1+events22:43:082
244686299240912,2394cyclictest2510969-21kworker/2:1+events22:43:082
244686299240912,2393cyclictest2470821-21kworker/2:2+events20:46:082
244686299240312,2387cyclictest2464580-21kworker/2:1+events20:06:462
244685599239912,2384cyclictest2459801-21kworker/0:2+events20:04:300
244685999239611,2382cyclictest2444989-21kworker/1:1+events19:23:411
24468659923959,2383cyclictest2455003-21kworker/3:0+events19:38:383
244685999239410,2380cyclictest2444989-21kworker/1:1+events19:28:331
244686299238911,2375cyclictest2493400-21kworker/2:0+events21:47:222
244686299236611,2352cyclictest2552935-21kworker/2:0+events00:39:462
244685999236512,2349cyclictest2545016-21kworker/1:1+events00:19:341
244685999236511,2350cyclictest2483875-21kworker/1:1+events21:50:261
244685999236412,2348cyclictest2472594-21kworker/1:1+events20:36:461
244685999235510,2341cyclictest2519056-21kworker/1:2+events23:05:381
244685599233912,2323cyclictest2473930-21kworker/0:2+events20:34:050
244686299233811,2323cyclictest2522311-21kworker/2:2+events23:26:302
244686299233712,2322cyclictest2484084-21kworker/2:0+events21:05:372
244685599233711,2322cyclictest2540117-21kworker/0:0+events00:02:260
244686299232912,2314cyclictest2512588-21kworker/2:2+events22:34:212
244686299232812,2313cyclictest2539992-21kworker/2:2+events00:06:322
244686299232812,2312cyclictest2538305-21kworker/2:1+events23:52:562
244686299232712,2312cyclictest2507703-21kworker/2:1+events22:17:512
244686299232712,2311cyclictest2522311-21kworker/2:2+events23:08:192
244685999232712,2311cyclictest2504676-21kworker/1:0+events22:21:421
244686299232612,2312cyclictest2517633-21kworker/2:0+events23:03:212
244686299232612,2312cyclictest2517633-21kworker/2:0+events22:51:562
244686299232612,2312cyclictest2466188-21kworker/2:0+events20:20:022
244686299232612,2311cyclictest2491781-21kworker/2:2+events21:26:472
244686299232612,2310cyclictest2549516-21kworker/2:1+events00:30:332
244686299232611,2312cyclictest2525832-21kworker/2:1+events23:41:322
244686299232512,2309cyclictest2482048-21kworker/2:2+events21:04:272
244685999232311,2309cyclictest2546632-21kworker/1:2+events00:22:551
244686299231911,2306cyclictest2498438-21kworker/2:1+events21:50:012
244686299231410,2301cyclictest2525832-21kworker/2:1+events23:38:322
244686299230912,2294cyclictest2466188-21kworker/2:0+events20:11:172
244686299230910,2296cyclictest2493400-21kworker/2:0+events21:32:352
244686299230812,2293cyclictest2462908-21kworker/2:2+events20:03:222
244686299230712,2292cyclictest2450101-21kworker/2:0+events19:33:032
24468659923059,2293cyclictest2522302-21kworker/3:0+events23:06:243
244685599229511,2281cyclictest2445121-21kworker/0:1+events19:14:280
244685599229211,2278cyclictest2484117-21kworker/0:0+events21:06:230
24468559922848,2272cyclictest2482184-21kworker/0:1+events21:12:010
244685999228312,2268cyclictest2528911-21kworker/1:2+events23:32:331
24468559922779,2264cyclictest2517436-21kworker/0:0+events22:51:100
244685599227511,2261cyclictest2509557-21kworker/0:2+events22:25:330
244685599227511,2261cyclictest2495251-21kworker/0:2+events21:42:520
244685599227210,2258cyclictest2532024-21kworker/0:2+events23:34:000
244685999227110,2258cyclictest2530555-21kworker/1:0+events23:53:401
244685999227011,2256cyclictest2463001-21kworker/1:0+events20:25:451
244685999227011,2255cyclictest2530555-21kworker/1:0+events00:03:321
244685599227010,2257cyclictest2495251-21kworker/0:2+events21:46:380
244685999226911,2255cyclictest2530555-21kworker/1:0+events23:44:331
24468559922689,2255cyclictest2488560-21kworker/0:0+events21:19:120
244685999226411,2250cyclictest2546632-21kworker/1:2+events00:34:031
244685999226311,2250cyclictest2504676-21kworker/1:0+events22:15:101
244685999226211,2247cyclictest2456729-21kworker/1:0+events19:48:541
244685599226211,2247cyclictest2548148-21kworker/0:0+events00:24:040
24468559922608,2249cyclictest2548337-21kworker/0:3+events00:34:480
244685599225610,2242cyclictest2538338-21kworker/0:2+events23:52:340
244685599225510,2242cyclictest2482184-21kworker/0:1+events21:04:510
244685999225411,2240cyclictest2448140-21kworker/1:0+events19:18:401
244685999225210,2238cyclictest2546632-21kworker/1:2+events00:29:481
244685999224610,2233cyclictest2506321-21kworker/1:1+events22:33:101
244685599224210,2229cyclictest2543537-21kworker/0:0+events00:12:420
244686599224112,2226cyclictest2496718-21kworker/3:2+events21:43:383
244686599223511,2220cyclictest2520658-21kworker/3:1+events23:02:123
244686599223010,2217cyclictest2549859-21kworker/3:1+events00:35:573
24468659922293,2222cyclictest2469164-21kworker/3:1+events20:39:423
244685999222810,2214cyclictest2517404-21kworker/1:1+events22:56:331
244685599222711,2213cyclictest2482184-21kworker/0:1+events20:59:340
244685999222511,2211cyclictest2463001-21kworker/1:0+events20:31:531
244686599222410,2211cyclictest2475627-21kworker/3:2+events20:40:273
244686599222311,2208cyclictest2527385-21kworker/3:1+events23:29:303
244686599222310,2209cyclictest2458261-21kworker/3:2+events19:44:243
244686599222210,2209cyclictest2501563-21kworker/3:2+events22:03:023
244686599222110,2208cyclictest2488554-21kworker/3:2+events21:18:523
244686299222112,2206cyclictest2478756-21kworker/2:1+events20:57:162
244686599222010,2207cyclictest2461512-21kworker/3:1+events19:56:313
24468629922209,2207cyclictest2487194-21kworker/2:1+events21:21:522
244685999222010,2206cyclictest2448140-21kworker/1:0+events19:13:191
24468659922198,2208cyclictest2534851-21kworker/3:1+events23:41:563
24468659922198,2208cyclictest2469164-21kworker/3:1+events20:17:433
24468659922187,2208cyclictest2504844-21kworker/3:1+events22:22:283
244686599221811,2204cyclictest2504844-21kworker/3:1+events22:18:373
244686599221611,2202cyclictest2463388-21kworker/3:2+events20:09:013
244686599221610,2203cyclictest2522302-21kworker/3:0+events23:23:263
244686599221610,2202cyclictest2482220-21kworker/3:2+events21:08:593
244686299221410,2200cyclictest2450101-21kworker/2:0+events19:19:502
244686599221112,2195cyclictest2482220-21kworker/3:2+events21:01:263
244686599220311,2189cyclictest2534851-21kworker/3:1+events23:50:163
244686599219711,2182cyclictest2499960-21kworker/3:0+events21:56:333
244686599219611,2182cyclictest2491817-21kworker/3:0+events21:35:383
244686299218810,2175cyclictest2484084-21kworker/2:0+events21:18:312
24468629921616,2151cyclictest2457966-21kworker/2:0+events19:42:522
244686299214112,2125cyclictest2504744-21kworker/2:0+events22:11:192
244686299213911,2126cyclictest2498438-21kworker/2:1+events22:01:282
244686599213810,2125cyclictest2446363-21kworker/3:0+events19:16:223
244686299213311,2119cyclictest2459682-21kworker/2:1+events19:47:462
244686299213311,2118cyclictest2539992-21kworker/2:2+events00:02:032
244686299213010,2116cyclictest2474150-21kworker/2:1+events20:36:002
244686299212911,2115cyclictest2535480-21kworker/2:0+events23:48:432
244686299212910,2115cyclictest2478756-21kworker/2:1+events20:52:172
244686299212711,2113cyclictest2441990-21kworker/2:3+events19:22:072
244686299212710,2114cyclictest2493400-21kworker/2:0+events21:42:302
244686299212611,2112cyclictest2539992-21kworker/2:2+events00:22:122
244686299212111,2106cyclictest2500143-21kworker/2:0+events21:58:472
24468629921206,2110cyclictest2539992-21kworker/2:2+events00:12:202
244686299211910,2105cyclictest2462908-21kworker/2:2+events19:59:582
244685999211910,2106cyclictest2515788-21kworker/1:0+events22:49:151
244686299211711,2103cyclictest2509346-21kworker/2:0+events22:23:152
24468599921119,2099cyclictest2483875-21kworker/1:1+events21:22:591
244686599210510,2092cyclictest2501563-21kworker/3:2+events22:06:023
244686299210511,2091cyclictest2484084-21kworker/2:0+events21:13:322
244686299210410,2090cyclictest2525832-21kworker/2:1+events23:20:282
24468629921038,2092cyclictest2470821-21kworker/2:2+events20:31:062
244686299210211,2088cyclictest2522311-21kworker/2:2+events23:18:092
244686299209911,2086cyclictest2539992-21kworker/2:2+events00:15:242
24468659920809,2068cyclictest2484112-21kworker/3:0+events21:10:513
24468659920739,2061cyclictest2448099-21kworker/3:2+events19:14:063
244686599206610,2053cyclictest2491817-21kworker/3:0+events21:29:293
24468629920165,2008cyclictest2455121-21kworker/2:1+events19:36:242
244686299197710,1963cyclictest2519254-21kworker/2:1+events22:57:182
244686299197110,1957cyclictest2448042-21kworker/2:1+events19:12:092
24468629919695,1961cyclictest2522311-21kworker/2:2+events23:14:212
24466252166137,25sleep00-21swapper/019:09:260
24466312142114,23sleep10-21swapper/119:09:321
24466402141110,25sleep30-21swapper/319:09:373
24464222141111,25sleep20-21swapper/219:06:532
2446865991514,1cyclictest26050irq/143-i91519:26:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional