You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 13:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Tue Jun 16, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130546299307911,3064cyclictest1335910-21kworker/3:2+events21:35:183
130545199302415,3004cyclictest1313522-21kworker/0:1+events19:35:180
130546299299014,2971cyclictest1353538-21kworker/3:1+events21:40:173
130546299293913,2923cyclictest1385554-21kworker/3:0+events00:00:183
13054629929329,2919cyclictest1379118-21kworker/3:2+events23:10:163
130545199283512,2820cyclictest1363277-21kworker/0:1+events22:20:120
130545199283113,2816cyclictest1318625-21kworker/0:0+events20:45:120
130546099280813,2791cyclictest1369581-21kworker/2:2+events23:25:122
130545199280113,2784cyclictest1348583-21kworker/0:2+events21:30:170
130546099277413,2758cyclictest1351920-21kworker/2:1+events21:37:332
130546099276713,2750cyclictest1366183-21kworker/2:1+events22:32:502
130545199275613,2739cyclictest1321196-21kworker/0:1+events20:00:230
130545199274913,2732cyclictest1367690-21kworker/0:2+events22:25:130
130546099270712,2691cyclictest1328190-21kworker/2:3+events20:40:182
130546299270513,2688cyclictest1307075-21kworker/3:3+events19:26:393
130546299268913,2672cyclictest1407695-21kworker/3:2+events00:31:103
130545199262613,2609cyclictest1318625-21kworker/0:0+events20:10:160
130546099262211,2606cyclictest1400463-21kworker/2:2+events00:10:132
130546299260913,2594cyclictest1355167-21kworker/3:0+events21:45:163
130546099259412,2578cyclictest1342308-21kworker/2:0+events21:09:172
130546099257111,2556cyclictest1375967-21kworker/2:0+events22:49:392
130546099256310,2550cyclictest1319777-21kworker/2:0+events19:53:542
130546099255612,2541cyclictest1342308-21kworker/2:0+events21:30:412
13054609925389,2527cyclictest1332293-21kworker/2:0+events20:35:012
130546099253811,2524cyclictest1404399-21kworker/2:2+events00:38:442
13054519925348,2522cyclictest1365993-21kworker/0:0+events22:40:520
130545199253311,2518cyclictest1374070-21kworker/0:1+events22:46:350
130546099253211,2517cyclictest1325014-21kworker/2:1+events20:21:432
130545199253212,2516cyclictest1377570-21kworker/0:1+events22:58:310
130545199253212,2516cyclictest1377570-21kworker/0:1+events22:54:170
130545199253111,2517cyclictest1390332-21kworker/0:1+events23:42:450
130546099253012,2515cyclictest1369581-21kworker/2:2+events23:19:062
130546099253012,2514cyclictest1400463-21kworker/2:2+events00:06:022
130546099253012,2514cyclictest1391844-21kworker/2:0+events00:03:442
130545199252411,2509cyclictest1354987-21kworker/0:1+events21:43:440
130546299252311,2508cyclictest1377510-21kworker/3:0+events23:04:593
130546099252310,2510cyclictest1369581-21kworker/2:2+events23:13:192
13054629925126,2501cyclictest1356769-21kworker/3:2+events21:50:123
130546299250912,2493cyclictest1322881-21kworker/3:2+events20:05:203
130546099250212,2486cyclictest1346801-21kworker/2:2+events21:16:552
130546099250011,2485cyclictest1369581-21kworker/2:2+events23:08:002
130546099249712,2481cyclictest1321406-21kworker/2:2+events20:04:102
130546099249512,2480cyclictest1323056-21kworker/2:0+events20:07:132
130546099249312,2477cyclictest1348430-21kworker/2:1+events21:26:072
130545199249211,2478cyclictest1404365-21kworker/0:1+events00:20:280
130546099249112,2475cyclictest1362934-21kworker/2:2+events22:17:512
130546099249111,2471cyclictest1318119-21kworker/2:1+events19:58:302
130546099249111,2471cyclictest1318119-21kworker/2:1+events19:58:302
130545199249112,2475cyclictest1324697-21kworker/0:1+events20:09:530
130546299249010,2476cyclictest1337540-21kworker/3:1+events20:50:543
130545199249012,2474cyclictest1380917-21kworker/0:3+events23:28:160
130546099248912,2474cyclictest1339082-21kworker/2:1+events21:02:232
130546099248910,2475cyclictest1391844-21kworker/2:0+events23:56:522
130546099248811,2475cyclictest1406123-21kworker/2:0+events00:25:022
130546099248712,2472cyclictest1407754-21kworker/2:1+events00:30:222
130546099248412,2468cyclictest1348430-21kworker/2:1+events21:23:032
130545199248312,2468cyclictest1311896-21kworker/0:0+events19:33:450
130546099248112,2466cyclictest1402736-21kworker/2:1+events00:15:292
130546099248011,2466cyclictest1342308-21kworker/2:0+events21:11:342
130546099248011,2465cyclictest1391844-21kworker/2:0+events23:47:202
130546099247911,2464cyclictest1335849-21kworker/2:0+events20:46:202
130546299247710,2463cyclictest1335910-21kworker/3:2+events21:05:293
130546099247712,2462cyclictest1369581-21kworker/2:2+events23:21:452
130546099247711,2464cyclictest1325014-21kworker/2:1+events20:25:072
130546099247710,2463cyclictest1367843-21kworker/2:0+events22:28:392
130546099247611,2461cyclictest1358501-21kworker/2:1+events22:02:272
130546099247611,2461cyclictest1339082-21kworker/2:1+events20:58:372
130545199247512,2459cyclictest1387089-21kworker/0:0+events23:24:270
13054629924736,2463cyclictest1335910-21kworker/3:2+events21:13:083
13054609924729,2461cyclictest1391844-21kworker/2:0+events23:40:072
130546299246912,2453cyclictest1396971-21kworker/3:1+events00:07:103
130546299246812,2453cyclictest1311776-21kworker/3:1+events20:20:563
130546299246711,2453cyclictest1313437-21kworker/3:0+events19:38:413
130545199246712,2452cyclictest1332838-21kworker/0:2+events20:39:110
130546299246412,2448cyclictest1388514-21kworker/3:1+events23:38:333
130546099246212,2446cyclictest1358501-21kworker/2:1+events21:57:262
130546099246111,2446cyclictest1386938-21kworker/2:1+events23:33:352
130546299246012,2444cyclictest1358369-21kworker/3:1+events22:08:373
130546299246012,2444cyclictest1335910-21kworker/3:2+events20:46:433
130545199245712,2442cyclictest1358187-21kworker/0:2+events21:55:560
130546099245412,2438cyclictest1375967-21kworker/2:0+events22:52:212
130545199245312,2438cyclictest1346926-21kworker/0:0+events21:25:430
130545199245312,2437cyclictest1365993-21kworker/0:0+events22:37:040
130545199245212,2437cyclictest1380828-21kworker/0:2+events23:07:370
130545199244912,2433cyclictest1363277-21kworker/0:1+events22:11:160
130545199244911,2434cyclictest1318625-21kworker/0:0+events20:34:390
130545199244812,2432cyclictest1404365-21kworker/0:1+events00:18:590
130545199244812,2432cyclictest1380917-21kworker/0:3+events23:17:590
130545199244811,2433cyclictest1343643-21kworker/0:1+events21:20:240
130546299244711,2433cyclictest1379118-21kworker/3:2+events23:06:263
130545199244712,2432cyclictest1401105-21kworker/0:0+events00:06:460
130545199244712,2431cyclictest1394773-21kworker/0:2+events23:56:060
130545199244711,2433cyclictest1318625-21kworker/0:0+events20:28:330
130545199244612,2430cyclictest1337479-21kworker/0:1+events20:57:020
130545199244612,2430cyclictest1318625-21kworker/0:0+events20:42:570
130545199244610,2432cyclictest1406003-21kworker/0:0+events00:26:070
13054519924459,2432cyclictest1337479-21kworker/0:1+events20:51:410
130545199244512,2429cyclictest1353355-21kworker/0:0+events22:07:260
13054519924429,2430cyclictest1365993-21kworker/0:0+events22:31:440
130545199244212,2428cyclictest1340715-21kworker/0:0+events21:10:490
130545199244112,2426cyclictest1310257-21kworker/0:1+events19:25:520
130545199244012,2425cyclictest1377570-21kworker/0:1+events23:00:220
130545199243912,2424cyclictest1387089-21kworker/0:0+events23:30:560
130545199243912,2423cyclictest1354987-21kworker/0:1+events21:46:250
130546099243810,2425cyclictest1310348-21kworker/2:2+events19:40:352
130545199243812,2423cyclictest1327882-21kworker/0:2+events20:23:590
13054629924369,2424cyclictest1311776-21kworker/3:1+events20:33:543
13054629924349,2421cyclictest1383915-21kworker/3:1+events23:16:493
130546099243112,2416cyclictest1325014-21kworker/2:1+events20:11:232
130545199243012,2415cyclictest1394773-21kworker/0:2+events23:49:560
130546299242312,2408cyclictest1334138-21kworker/3:0+events20:43:193
130545199242112,2406cyclictest1343643-21kworker/0:1+events21:19:370
130546099242011,2406cyclictest1337449-21kworker/2:2+events20:53:372
13054569924209,2407cyclictest1326789-21kworker/1:0+events20:19:251
130546299241911,2405cyclictest1369477-21kworker/3:0+events22:30:353
130546299241112,2395cyclictest1385554-21kworker/3:0+events23:26:453
130546299241112,2395cyclictest1335910-21kworker/3:2+events20:57:493
130546299241012,2394cyclictest1307075-21kworker/3:3+events19:20:003
13054569924109,2397cyclictest1359882-21kworker/1:2+events22:23:181
130546299240912,2395cyclictest1319631-21kworker/3:0+events20:00:453
130545199240912,2394cyclictest1327882-21kworker/0:2+events20:17:530
130546099240312,2388cyclictest1310348-21kworker/2:2+events19:34:322
130546299240212,2386cyclictest1362844-21kworker/3:0+events22:17:283
130546299240012,2384cyclictest1313437-21kworker/3:0+events19:33:243
130546299239911,2384cyclictest1343268-21kworker/3:1+events21:15:253
130546299239911,2384cyclictest1316691-21kworker/3:2+events19:45:123
130545699239910,2385cyclictest1310133-21kworker/1:0+events19:44:031
130546299239511,2381cyclictest1385554-21kworker/3:0+events23:55:213
130546299239312,2377cyclictest1385554-21kworker/3:0+events23:22:553
130546299239311,2379cyclictest1396971-21kworker/3:1+events00:18:113
130546299239310,2379cyclictest1326586-21kworker/3:2+events20:16:193
130546299239212,2376cyclictest1330887-21kworker/3:0+events20:28:123
130546299238912,2374cyclictest1364506-21kworker/3:2+events22:12:253
130546299238812,2373cyclictest1346828-21kworker/3:0+events21:24:573
130546299238812,2372cyclictest1407695-21kworker/3:2+events00:37:123
130546299238810,2375cyclictest1366149-21kworker/3:1+events22:42:013
130546299238810,2374cyclictest1311776-21kworker/3:1+events19:50:583
130546299238711,2373cyclictest1404464-21kworker/3:2+events00:20:053
130546299238711,2372cyclictest1388514-21kworker/3:1+events23:32:023
130546299238710,2373cyclictest1306565-21kworker/3:0+events19:14:223
130546299238512,2370cyclictest1340777-21kworker/3:0+events21:00:533
130546099238412,2369cyclictest1362934-21kworker/2:2+events22:12:012
130546299238312,2368cyclictest1324861-21kworker/3:0+events20:13:183
130545699238112,2366cyclictest1382419-21kworker/1:2+events23:15:151
130546299237511,2361cyclictest1402828-21kworker/3:0+events00:13:133
130546299237411,2359cyclictest1375811-21kworker/3:2+events22:50:483
130546299237310,2360cyclictest1371082-21kworker/3:2+events22:39:193
130546299237211,2358cyclictest1311776-21kworker/3:1+events20:36:083
130546299236612,2350cyclictest1350266-21kworker/3:1+events21:29:103
130546299236112,2346cyclictest1388514-21kworker/3:1+events23:41:413
130545199236112,2346cyclictest1409302-21kworker/0:1+events00:37:350
13054519923599,2347cyclictest1315122-21kworker/0:2+events19:52:270
130546299235811,2343cyclictest1310164-21kworker/3:0+events19:21:583
13054519923378,2326cyclictest1365993-21kworker/0:0+events22:17:050
130546099233210,2318cyclictest1379180-21kworker/2:0+events23:01:542
13054629923288,2316cyclictest1366149-21kworker/3:1+events22:29:253
130546299232812,2313cyclictest1366149-21kworker/3:1+events22:24:263
130546099232612,2310cyclictest1369581-21kworker/2:2+events22:42:452
130545699232411,2310cyclictest1395368-21kworker/1:0+events23:52:411
130545699232411,2310cyclictest1395368-21kworker/1:0+events23:52:401
130545199232111,2306cyclictest1302208-21kworker/0:0+events19:18:540
130545199231712,2302cyclictest1310257-21kworker/0:1+events19:23:550
13054569923169,2304cyclictest1326789-21kworker/1:0+events20:20:321
130545699231612,2300cyclictest1389778-21kworker/1:1+events23:35:541
130546099230812,2293cyclictest1310348-21kworker/2:2+events19:36:462
130545699230612,2291cyclictest1367813-21kworker/1:1+events22:32:051
130545199230611,2292cyclictest1394773-21kworker/0:2+events00:12:060
130546299230412,2288cyclictest1319631-21kworker/3:0+events19:59:143
130546299230412,2288cyclictest1319631-21kworker/3:0+events19:59:143
130546299230211,2288cyclictest1375811-21kworker/3:2+events22:46:583
130546099228811,2275cyclictest1386938-21kworker/2:1+events23:35:092
13054569922779,2265cyclictest1398329-21kworker/1:1+events00:39:531
130546099227513,2259cyclictest1366183-21kworker/2:1+events22:20:362
130546099227510,2261cyclictest1369581-21kworker/2:2+events22:38:112
130546099227411,2259cyclictest1393496-21kworker/2:1+events23:52:172
130546099227411,2259cyclictest1393496-21kworker/2:1+events23:52:172
130546099227211,2258cyclictest1369581-21kworker/2:2+events22:58:542
130546099227011,2256cyclictest1310348-21kworker/2:2+events19:26:152
130546099227011,2255cyclictest1404399-21kworker/2:2+events00:20:522
130546099226911,2256cyclictest1303780-21kworker/2:2+events19:15:072
130546099226911,2255cyclictest1328190-21kworker/2:3+events20:30:292
13054609922608,2249cyclictest1358501-21kworker/2:1+events22:06:422
130546099225910,2246cyclictest1306534-21kworker/2:0+events19:21:332
130545199225910,2245cyclictest1394773-21kworker/0:2+events00:03:000
130546099225811,2244cyclictest1325014-21kworker/2:1+events20:15:572
130546099225711,2243cyclictest1318119-21kworker/2:1+events19:47:302
130546099225310,2239cyclictest1355226-21kworker/2:2+events21:49:262
130545699225311,2238cyclictest1353476-21kworker/1:0+events21:40:401
130545199225311,2238cyclictest1383825-21kworker/0:0+events23:14:060
130546099225210,2239cyclictest1353519-21kworker/2:0+events21:41:512
130545199225212,2236cyclictest1390332-21kworker/0:1+events23:37:240
13054629922498,2238cyclictest1355167-21kworker/3:0+events21:55:333
130546099224710,2234cyclictest1356827-21kworker/2:0+events21:50:572
130545199223910,2225cyclictest1353355-21kworker/0:0+events22:04:220
13054519922369,2223cyclictest1315122-21kworker/0:2+events19:44:260
13054519922359,2223cyclictest1407634-21kworker/0:2+events00:30:450
130545199223210,2219cyclictest1315122-21kworker/0:2+events19:47:540
13054519922209,2208cyclictest1318625-21kworker/0:0+events19:58:070
13054519922209,2208cyclictest1318625-21kworker/0:0+events19:58:070
130545199221711,2204cyclictest1392044-21kworker/0:0+events23:50:440
130545199221711,2204cyclictest1392044-21kworker/0:0+events23:50:430
130545199221511,2200cyclictest1340715-21kworker/0:0+events21:06:150
130546299219410,2181cyclictest1351859-21kworker/3:0+events21:34:543
130546299218910,2176cyclictest1393378-21kworker/3:2+events23:47:443
13054519921899,2177cyclictest1353355-21kworker/0:0+events21:36:470
130546299218311,2168cyclictest1396971-21kworker/3:1+events00:28:503
130546299218310,2169cyclictest1313437-21kworker/3:0+events19:42:323
130545699218311,2169cyclictest1398329-21kworker/1:1+events00:17:481
130546299218210,2169cyclictest1366149-21kworker/3:1+events22:56:353
130546299218110,2167cyclictest1358369-21kworker/3:1+events22:01:163
130546299216911,2155cyclictest1395155-21kworker/3:3+events23:53:503
130546299216911,2155cyclictest1395155-21kworker/3:3+events23:53:503
130545199213210,2119cyclictest1306628-21kworker/0:1+events19:14:440
130545699213011,2116cyclictest1348492-21kworker/1:2+events21:31:501
130545699211911,2104cyclictest1329361-21kworker/1:2+events20:32:471
130545699211910,2105cyclictest1332695-21kworker/1:1+events20:39:571
130545699211611,2102cyclictest1340239-21kworker/1:2+events20:58:131
13054569921158,2104cyclictest1351873-21kworker/1:1+events21:50:331
130545199210710,2093cyclictest1358187-21kworker/0:2+events21:52:300
13054609921017,2090cyclictest1306534-21kworker/2:0+events19:12:092
13054569920909,2079cyclictest1391602-21kworker/1:2+events00:00:411
130545699208911,2074cyclictest1370877-21kworker/1:0+events23:03:041
130545699208910,2076cyclictest1380710-21kworker/1:1+events23:05:441
13054569920868,2075cyclictest1387280-21kworker/1:0+events23:30:321
13054569920849,2072cyclictest1316721-21kworker/1:2+events19:56:371
13054569920849,2072cyclictest1316721-21kworker/1:2+events19:56:371
130545199207110,2058cyclictest1340715-21kworker/0:0+events21:02:020
130545699199810,1984cyclictest1351873-21kworker/1:1+events21:37:111
130545699196410,1951cyclictest1303024-21kworker/1:2+events19:20:471
13054569919618,1951cyclictest1359882-21kworker/1:2+events22:05:081
13054569919596,1950cyclictest1370877-21kworker/1:0+events23:10:391
130545699195310,1939cyclictest1334438-21kworker/1:0+events21:22:171
130545699195210,1939cyclictest1351873-21kworker/1:1+events21:58:121
13054569919518,1940cyclictest1355105-21kworker/1:2+events21:46:031
13054569917824,1775cyclictest1300726-21kworker/1:1+events19:10:141
13051302143100,39sleep00-21swapper/019:08:400
13050372143109,29sleep20-21swapper/219:07:302
13051882141110,26sleep30-21swapper/319:09:273
13051042140104,22sleep10-21swapper/119:08:211
130545699310,5cyclictest1394038-21hddtemp_smartct23:45:131
130545699300,1cyclictest0-21swapper/123:20:161
1305456992711,12cyclictest1346319-21ntpq21:15:171
130545699245,17cyclictest1339224-21munin-run20:55:001
130545699241,19cyclictest1364047-21ntpq22:10:181
130545699241,17cyclictest1323151-21perf20:05:001
130545699221,20cyclictest0-21swapper/100:30:001
130545699221,20cyclictest0-21swapper/100:05:211
130545699221,19cyclictest1319984-21perf19:55:001
130545699221,18cyclictest1345556-21munin-run21:15:001
130545699214,14cyclictest593-21dbus-daemon19:40:001
1305456992114,6cyclictest603-21systemd-logind22:50:021
130545699211,18cyclictest1361647-21dump-pmu-power22:05:001
130545699211,17cyclictest1397453-21ntpq23:55:171
130545699211,17cyclictest1350577-21munin-run21:30:011
130545699210,5cyclictest1374145-21runrttasks22:43:121
130545699210,4cyclictest1308625-21seq19:16:481
130545699210,1cyclictest0-21swapper/122:55:121
130545699210,18cyclictest1403063-21basename00:15:001
130545699203,4cyclictest622-21gdbus22:50:061
130545699201,7cyclictest1323623-21packagekitd20:05:011
130545699201,16cyclictest1312079-21awk19:30:001
130545699201,14cyclictest0-21swapper/120:40:121
130545699200,9cyclictest1341625-21ntpq21:00:171
130545699200,9cyclictest1336906-21ntpq20:45:171
130545699200,2cyclictest1365554-21ntpq22:15:161
1305456991915,2cyclictest1313654-21munin-run19:35:001
130545699191,16cyclictest1317632-21ntpq19:45:171
130545699191,15cyclictest1330595-21nvmesmart_nvme020:25:181
130545699190,2cyclictest1372375-21chrt22:35:591
130545699190,14cyclictest0-21swapper/123:40:151
130545699181,14cyclictest1388039-21ntpq23:25:181
130545699181,14cyclictest1325813-21ntpq20:10:191
130545699180,2cyclictest1369315-21taskset22:27:111
130545699171,13cyclictest1343996-21idleruntime-cro21:10:001
130545699170,14cyclictest1405478-21ntpq00:20:181
130545699160,13cyclictest0-21swapper/100:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional