You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 12:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Fri Jun 05, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27216699445113,4434cyclictest308887-21kworker/0:0+events21:05:180
27216699400519,3982cyclictest277180-21kworker/0:1+events19:30:100
27217199302913,3014cyclictest337475-21kworker/1:1+events22:35:121
27217999299314,2975cyclictest271652-21kworker/3:2+events19:20:173
27217999285213,2834cyclictest318515-21kworker/3:1+events21:40:173
27216699281214,2794cyclictest342297-21kworker/0:2+events22:50:210
27217199281013,2792cyclictest358474-21kworker/1:2+events23:55:191
27216699280413,2788cyclictest359986-21kworker/0:0+events00:15:170
27217699280213,2785cyclictest296102-21kworker/2:2+events20:51:562
27217699279813,2781cyclictest342210-21kworker/2:0+events22:54:312
27216699278114,2761cyclictest297520-21kworker/0:1+events20:35:130
27217999277012,2754cyclictest323163-21kworker/3:0+events22:25:213
27217199276913,2753cyclictest319879-21kworker/1:0+events21:39:551
27217199276413,2746cyclictest346834-21kworker/1:2+events23:10:101
27216699270413,2688cyclictest324679-21kworker/0:0+events22:05:160
27216699269813,2682cyclictest359986-21kworker/0:0+events23:49:370
27217199267912,2665cyclictest263265-21kworker/1:1+events19:15:141
27216699265812,2642cyclictest300873-21kworker/0:2+events21:00:170
27216699265413,2637cyclictest335691-21kworker/0:1+events22:55:160
27216699264213,2624cyclictest277180-21kworker/0:1+events19:25:110
27216699262513,2608cyclictest288051-21kworker/0:0+events20:00:140
27216699259610,2582cyclictest281628-21kworker/0:2+events19:44:520
27217699258112,2565cyclictest303867-21kworker/2:1+events21:01:282
27217699257612,2560cyclictest362094-21kworker/2:1+events23:49:582
27216699257512,2559cyclictest294292-21kworker/0:2+events20:20:270
27216699257412,2558cyclictest346866-21kworker/0:2+events23:09:250
27217699257010,2555cyclictest335899-21kworker/2:1+events22:29:082
2721769925677,2556cyclictest296102-21kworker/2:2+events20:24:132
27216699256412,2548cyclictest302528-21kworker/0:1+events20:46:120
27217999256312,2546cyclictest278481-21kworker/3:0+events19:31:193
27216699256312,2547cyclictest269506-21kworker/0:2+events19:21:040
27216699256212,2546cyclictest353663-21kworker/0:2+events23:39:390
27216699256211,2548cyclictest374767-21kworker/0:1+events00:26:240
2721719925529,2538cyclictest291417-21kworker/1:2+events20:13:551
27217999254812,2532cyclictest300902-21kworker/3:2+events21:30:223
27217699254812,2533cyclictest343834-21kworker/2:2+events23:00:552
2721769925470,2543cyclictest346803-21kworker/2:1+events23:17:262
27217699254511,2531cyclictest331102-21kworker/2:2+events22:24:112
2721719925414,2533cyclictest334177-21kworker/1:1+events22:23:241
27217199254112,2525cyclictest337475-21kworker/1:1+events22:42:031
2721669925409,2527cyclictest335691-21kworker/0:1+events22:26:510
27217999253911,2526cyclictest289844-21kworker/3:2+events20:20:043
27217999253812,2522cyclictest289844-21kworker/3:2+events20:14:173
2721719925386,2528cyclictest358474-21kworker/1:2+events00:25:591
27217199253811,2523cyclictest340786-21kworker/1:0+events22:57:531
27217999253612,2520cyclictest300902-21kworker/3:2+events20:48:533
27217999253612,2520cyclictest292660-21kworker/3:0+events20:26:303
27216699253213,2515cyclictest361850-21kworker/0:2+events23:50:220
2721799925319,2519cyclictest363666-21kworker/3:0+events00:06:313
27217999253112,2517cyclictest281658-21kworker/3:2+events19:53:443
27217699252910,2516cyclictest331102-21kworker/2:2+events22:46:342
27216699252811,2513cyclictest269506-21kworker/0:2+events19:18:450
27217199252412,2508cyclictest307099-21kworker/1:2+events21:33:021
2721799925209,2507cyclictest375073-21kworker/3:0+events00:30:143
27217199251510,2503cyclictest302198-21kworker/1:1+events20:45:491
27217699250812,2492cyclictest371671-21kworker/2:2+events00:22:572
27216699250611,2491cyclictest310476-21kworker/0:2+events21:10:120
27216699250512,2489cyclictest359986-21kworker/0:0+events00:03:470
27217199250212,2487cyclictest376344-21kworker/1:1+events00:36:411
27217999249712,2482cyclictest320263-21kworker/3:2+events21:47:283
27217199249712,2481cyclictest348707-21kworker/1:1+events23:08:411
27217699249412,2479cyclictest366778-21kworker/2:1+events00:05:202
27217699249312,2477cyclictest294419-21kworker/2:1+events20:25:202
27217699249212,2477cyclictest378184-21kworker/2:2+events00:39:412
27217199249211,2477cyclictest350399-21kworker/1:0+events23:33:541
27216699249212,2476cyclictest294292-21kworker/0:2+events20:31:060
27216699249111,2477cyclictest323071-21kworker/0:1+events21:49:480
27217699249012,2475cyclictest346803-21kworker/2:1+events23:36:352
27217699249012,2475cyclictest302228-21kworker/2:0+events20:45:252
27217699249012,2474cyclictest283372-21kworker/2:0+events19:44:072
27217199249012,2475cyclictest342413-21kworker/1:2+events22:54:081
2721799924897,2478cyclictest339134-21kworker/3:2+events22:45:493
27216699248712,2472cyclictest335691-21kworker/0:1+events22:45:270
27216699248712,2471cyclictest369959-21kworker/0:1+events00:14:320
27216699248712,2471cyclictest307004-21kworker/0:1+events21:18:310
27216699248612,2472cyclictest346866-21kworker/0:2+events23:16:170
27216699248612,2470cyclictest300873-21kworker/0:2+events20:56:500
27216699248611,2471cyclictest317026-21kworker/0:0+events21:38:010
27217699248510,2472cyclictest280122-21kworker/2:2+events19:37:202
27217199248510,2471cyclictest323226-21kworker/1:2+events21:50:341
27217699248412,2468cyclictest365056-21kworker/2:0+events23:58:002
27217199248411,2470cyclictest350399-21kworker/1:0+events23:28:541
27217699248312,2468cyclictest296102-21kworker/2:2+events20:44:182
27217699248312,2467cyclictest303867-21kworker/2:1+events21:13:122
27216699248312,2469cyclictest307004-21kworker/0:1+events21:20:020
27216699248310,2470cyclictest317026-21kworker/0:0+events21:31:290
27217699248212,2467cyclictest376557-21kworker/2:1+events00:34:052
27217699248210,2468cyclictest320149-21kworker/2:0+events21:44:502
27216699248211,2467cyclictest363455-21kworker/0:1+events23:58:220
27217199248112,2466cyclictest358474-21kworker/1:2+events23:48:271
27216699248112,2465cyclictest324679-21kworker/0:0+events21:58:530
27216699248012,2464cyclictest323071-21kworker/0:1+events21:51:410
27216699248011,2466cyclictest315419-21kworker/0:2+events21:29:570
27217699247911,2465cyclictest273535-21kworker/2:0+events19:15:382
27217699247910,2465cyclictest297764-21kworker/2:0+events20:33:212
27217699247812,2463cyclictest346803-21kworker/2:1+events23:30:272
27217699247812,2463cyclictest346803-21kworker/2:1+events23:06:222
27217699247810,2464cyclictest321771-21kworker/2:1+events21:49:012
27216699247811,2464cyclictest331160-21kworker/0:0+events22:16:380
27217699247712,2462cyclictest278510-21kworker/2:0+events19:27:502
27216699247712,2462cyclictest335691-21kworker/0:1+events22:30:420
27217699247612,2460cyclictest291210-21kworker/2:0+events20:17:462
2721769924757,2465cyclictest285368-21kworker/2:2+events19:54:082
27217699247512,2460cyclictest316754-21kworker/2:1+events21:27:192
27216699247512,2461cyclictest300873-21kworker/0:2+events20:51:100
27216699247512,2460cyclictest378064-21kworker/0:0+events00:38:340
27217699247412,2459cyclictest342210-21kworker/2:0+events22:56:232
27217699247112,2456cyclictest355393-21kworker/2:0+events23:41:112
27217999246911,2455cyclictest339134-21kworker/3:2+events00:04:113
27216699246912,2453cyclictest335691-21kworker/0:1+events22:38:380
27217199246812,2453cyclictest324828-21kworker/1:0+events22:16:171
27217199246710,2453cyclictest293015-21kworker/1:0+events20:18:301
27217199246611,2452cyclictest286375-21kworker/1:0+events19:52:371
27217199246410,2450cyclictest335839-21kworker/1:0+events22:29:531
27216699246412,2449cyclictest357932-21kworker/0:1+events23:40:490
27217199246312,2448cyclictest286375-21kworker/1:0+events20:04:021
27217199246312,2447cyclictest307099-21kworker/1:2+events21:00:411
27217999246012,2444cyclictest360075-21kworker/3:0+events23:46:333
27217999245611,2442cyclictest289844-21kworker/3:2+events20:05:343
27216699245610,2442cyclictest346866-21kworker/0:2+events23:04:270
27217999245512,2439cyclictest371703-21kworker/3:2+events00:20:153
2721669924559,2442cyclictest297520-21kworker/0:1+events20:28:010
27217999245312,2437cyclictest343688-21kworker/3:1+events22:52:373
27217999245312,2437cyclictest300902-21kworker/3:2+events21:28:273
27217199245311,2438cyclictest319879-21kworker/1:0+events21:42:551
27217199245310,2440cyclictest276914-21kworker/1:1+events19:55:191
27216699245211,2438cyclictest300873-21kworker/0:2+events20:41:580
2721799924519,2440cyclictest320263-21kworker/3:2+events21:50:103
27217999245111,2437cyclictest312247-21kworker/3:1+events21:23:273
27217999245110,2438cyclictest339134-21kworker/3:2+events23:05:363
27217999245012,2435cyclictest292660-21kworker/3:0+events20:15:263
27217999245012,2434cyclictest323163-21kworker/3:0+events21:55:283
27217999245011,2435cyclictest339134-21kworker/3:2+events23:29:393
27217999245011,2435cyclictest300902-21kworker/3:2+events21:14:413
27217199245010,2436cyclictest337475-21kworker/1:1+events22:49:341
27217999244912,2434cyclictest323163-21kworker/3:0+events22:21:563
27217999244912,2433cyclictest306899-21kworker/3:0+events20:57:123
27217199244911,2434cyclictest358474-21kworker/1:2+events00:14:541
2721799924489,2436cyclictest345418-21kworker/3:0+events23:02:533
27217999244812,2434cyclictest312247-21kworker/3:1+events21:15:263
27217999244811,2434cyclictest375073-21kworker/3:0+events00:37:023
27217999244712,2431cyclictest297584-21kworker/3:2+events20:30:183
27217999244711,2432cyclictest288218-21kworker/3:0+events20:03:173
27217199244712,2432cyclictest302198-21kworker/1:1+events20:57:591
27217199244712,2432cyclictest293015-21kworker/1:0+events20:25:431
27217199244711,2433cyclictest299309-21kworker/1:2+events20:36:431
27217999244611,2431cyclictest300902-21kworker/3:2+events20:50:243
27216699244612,2430cyclictest281628-21kworker/0:2+events20:09:010
27217199244512,2429cyclictest350399-21kworker/1:0+events23:20:311
27217199244411,2429cyclictest324828-21kworker/1:0+events22:12:061
27217199244411,2429cyclictest319879-21kworker/1:0+events21:45:581
27217999244312,2427cyclictest351949-21kworker/3:1+events23:22:453
27217999244311,2429cyclictest300902-21kworker/3:2+events20:41:373
2721799924428,2431cyclictest339134-21kworker/3:2+events23:15:323
27217999244112,2425cyclictest308810-21kworker/3:1+events21:02:123
27217999243612,2420cyclictest316695-21kworker/3:0+events21:37:383
27217999243512,2419cyclictest281658-21kworker/3:2+events19:41:513
27217199243111,2416cyclictest310625-21kworker/1:0+events21:09:491
27217999242811,2414cyclictest355268-21kworker/3:0+events23:31:593
27217999242512,2409cyclictest323163-21kworker/3:0+events22:03:243
27217199242512,2410cyclictest323226-21kworker/1:2+events21:57:001
27217199242512,2409cyclictest281894-21kworker/1:0+events19:41:041
27217999242211,2407cyclictest323163-21kworker/3:0+events22:09:513
27217999241910,2406cyclictest334713-21kworker/3:2+events22:30:173
2721799924138,2402cyclictest371703-21kworker/3:2+events00:17:583
27217999241312,2397cyclictest373434-21kworker/3:1+events00:29:313
27216699241211,2399cyclictest277180-21kworker/0:1+events19:35:040
2721669924119,2398cyclictest351980-21kworker/0:1+events23:24:180
27217199241012,2394cyclictest365216-21kworker/1:1+events00:04:561
27217199240810,2395cyclictest326459-21kworker/1:1+events22:04:081
27217999240712,2392cyclictest278481-21kworker/3:0+events19:28:373
27216699239810,2384cyclictest331160-21kworker/0:0+events22:21:100
27217999239711,2383cyclictest339134-21kworker/3:2+events23:12:283
27217999239512,2379cyclictest281658-21kworker/3:2+events19:56:043
2721669923955,2386cyclictest321473-21kworker/0:2+events21:43:430
27217699239212,2378cyclictest289547-21kworker/2:2+events20:10:062
27217699239112,2376cyclictest371671-21kworker/2:2+events00:19:292
27217199238512,2369cyclictest368202-21kworker/1:0+events00:07:171
27217199238211,2368cyclictest358474-21kworker/1:2+events23:39:161
27217999236710,2353cyclictest339134-21kworker/3:2+events23:41:573
27216699235512,2340cyclictest281628-21kworker/0:2+events19:57:100
27217199235412,2338cyclictest360108-21kworker/1:1+events23:43:061
27217199235112,2335cyclictest358474-21kworker/1:2+events00:32:111
27216699235012,2335cyclictest359986-21kworker/0:0+events00:08:030
27217699233711,2323cyclictest312131-21kworker/2:0+events21:24:142
27217999233511,2320cyclictest331283-21kworker/3:2+events22:18:093
2721769923279,2315cyclictest327839-21kworker/2:1+events22:02:162
27217699232410,2310cyclictest283372-21kworker/2:0+events19:55:422
27217699232110,2308cyclictest346803-21kworker/2:1+events23:23:552
27217699231910,2306cyclictest287920-21kworker/2:1+events20:01:012
27217999230612,2291cyclictest366986-21kworker/3:1+events00:10:223
2721769923059,2293cyclictest320149-21kworker/2:0+events21:54:442
27217199230412,2289cyclictest307099-21kworker/1:2+events21:15:471
2721799922949,2282cyclictest363666-21kworker/3:0+events23:54:553
27217699228412,2268cyclictest281722-21kworker/2:1+events19:45:402
27216699228410,2271cyclictest289813-21kworker/0:1+events20:12:450
27217199228110,2268cyclictest307099-21kworker/1:2+events21:25:231
2721719922799,2267cyclictest345211-21kworker/1:1+events23:00:341
27217699227511,2260cyclictest331102-21kworker/2:2+events22:31:022
27216699227411,2260cyclictest281628-21kworker/0:2+events19:54:310
27216699227410,2262cyclictest326309-21kworker/0:2+events22:00:010
27217199227111,2257cyclictest358474-21kworker/1:2+events23:52:401
27217199227011,2257cyclictest289782-21kworker/1:1+events20:05:111
27217199227010,2256cyclictest296044-21kworker/1:2+events20:24:571
27217699226910,2256cyclictest337662-21kworker/2:0+events22:39:002
27217699226910,2255cyclictest316754-21kworker/2:1+events21:38:472
27217199226911,2255cyclictest263265-21kworker/1:1+events19:12:331
27217199226810,2254cyclictest358474-21kworker/1:2+events00:18:211
27216699226810,2256cyclictest353663-21kworker/0:2+events23:30:490
2721669922679,2255cyclictest335691-21kworker/0:1+events22:40:310
2721669922678,2256cyclictest289813-21kworker/0:1+events20:16:130
27217699226611,2252cyclictest366778-21kworker/2:1+events00:12:392
27217699226611,2252cyclictest275716-21kworker/2:1+events19:30:352
2721669922669,2254cyclictest329533-21kworker/0:2+events22:11:450
27217699226210,2249cyclictest320149-21kworker/2:0+events21:59:402
27217199226110,2249cyclictest276914-21kworker/1:1+events19:45:161
27216699225811,2244cyclictest374767-21kworker/0:1+events00:31:010
27216699225711,2243cyclictest346866-21kworker/0:2+events23:12:510
2721769922559,2242cyclictest331102-21kworker/2:2+events22:14:232
27217699225411,2239cyclictest316754-21kworker/2:1+events21:34:112
27217699225410,2241cyclictest296102-21kworker/2:2+events20:35:362
2721769922529,2240cyclictest331102-21kworker/2:2+events22:18:572
2721769922529,2240cyclictest269596-21kworker/2:2+events19:14:062
27216699225010,2236cyclictest351980-21kworker/0:1+events23:29:180
27217699224710,2233cyclictest329467-21kworker/2:0+events22:08:422
27216699224010,2226cyclictest371829-21kworker/0:2+events00:23:190
27217699223710,2224cyclictest346803-21kworker/2:1+events23:27:002
27217199223511,2220cyclictest352011-21kworker/1:1+events23:19:441
27217199223311,2218cyclictest280211-21kworker/1:2+events19:38:051
2721799922328,2221cyclictest284889-21kworker/3:0+events19:49:323
2721719922329,2219cyclictest276914-21kworker/1:1+events19:22:331
27217199223210,2219cyclictest299309-21kworker/1:2+events20:44:391
2721799922309,2218cyclictest300902-21kworker/3:2+events21:07:363
27217199223011,2216cyclictest358474-21kworker/1:2+events00:24:291
27217199223011,2216cyclictest335839-21kworker/1:0+events22:33:181
27217999222910,2216cyclictest363666-21kworker/3:0+events23:59:113
27217699222810,2215cyclictest307353-21kworker/2:2+events21:09:282
27217199222810,2215cyclictest324828-21kworker/1:0+events22:09:041
2721799922268,2214cyclictest356952-21kworker/3:1+events23:38:543
27217199222610,2213cyclictest314369-21kworker/1:0+events21:22:191
27217999222511,2211cyclictest323163-21kworker/3:0+events22:35:573
27217999222511,2210cyclictest299252-21kworker/3:0+events20:37:483
27217999222510,2212cyclictest339134-21kworker/3:2+events22:58:373
27217199222510,2212cyclictest299309-21kworker/1:2+events20:50:471
27217999222310,2210cyclictest337325-21kworker/3:1+events22:41:383
27217199222310,2211cyclictest276914-21kworker/1:1+events19:30:571
27217999222211,2208cyclictest278481-21kworker/3:0+events19:38:493
27217999222211,2208cyclictest273660-21kworker/3:0+events19:17:583
27217199222210,2208cyclictest276914-21kworker/1:1+events19:27:041
27217999218610,2173cyclictest323163-21kworker/3:0+events22:12:273
2721799921717,2161cyclictest266419-21kworker/3:1+events19:13:433
2721769921689,2156cyclictest303867-21kworker/2:1+events21:16:342
27216699214510,2132cyclictest283249-21kworker/0:1+events19:46:040
2721769921399,2127cyclictest340581-21kworker/2:1+events22:44:192
27217199212010,2107cyclictest310625-21kworker/1:0+events21:12:491
27216699211410,2101cyclictest269506-21kworker/0:2+events19:13:190
2721769921098,2098cyclictest269596-21kworker/2:2+events19:21:482
27217699210711,2092cyclictest365056-21kworker/2:0+events00:00:212
27217699209910,2086cyclictest289547-21kworker/2:2+events20:07:082
27217699209611,2081cyclictest346803-21kworker/2:1+events23:12:052
27217199204010,2027cyclictest293015-21kworker/1:0+events20:34:301
2721769920323,2026cyclictest305527-21kworker/2:0+events20:56:262
2721769919417,1930cyclictest371671-21kworker/2:2+events00:29:062
2716172175146,24sleep30-21swapper/319:08:553
2715592160120,35sleep20-21swapper/219:08:102
2716092151103,28sleep00-21swapper/019:08:480
2713722144101,37sleep10-21swapper/119:05:491
27217699150,13cyclictest362656-21/usr/sbin/munin23:50:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional