You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 22:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Aug 29, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
280573199338216,3363cyclictest2836510-21kworker/0:0+events20:45:160
280574599315514,3138cyclictest2852472-21kworker/3:2+events21:35:213
280573599283612,2820cyclictest2899145-21kworker/1:2+events00:00:211
280573599283513,2818cyclictest2835140-21kworker/1:2+events20:45:391
280574599279413,2777cyclictest2876421-21kworker/3:1+events23:05:133
280574599276812,2752cyclictest2820490-21kworker/3:1+events19:55:213
280573599275212,2736cyclictest2847674-21kworker/1:0+events21:27:241
280573599273111,2716cyclictest2820254-21kworker/1:2+events20:03:231
280573199272013,2703cyclictest2804980-21kworker/0:1+events19:42:530
280573199271913,2702cyclictest2845896-21kworker/0:2+events21:28:330
280574399271113,2693cyclictest2855815-21kworker/2:2+events21:45:132
280573599271111,2696cyclictest2810426-21kworker/1:2+events19:25:011
280574599270313,2688cyclictest2899203-21kworker/3:1+events00:05:183
280573199268313,2666cyclictest2829290-21kworker/0:0+events20:24:480
280574599267913,2662cyclictest2859281-21kworker/3:1+events22:05:213
280574599267213,2656cyclictest2829720-21kworker/3:1+events20:25:113
280573199266212,2646cyclictest2817396-21kworker/0:0+events19:53:260
280574599265911,2644cyclictest2849243-21kworker/3:1+events21:31:123
280573199264013,2624cyclictest2894613-21kworker/0:0+events23:45:100
280574599262913,2612cyclictest2912299-21kworker/3:0+events00:39:123
28057359926289,2615cyclictest2813948-21kworker/1:2+events19:40:381
280573199262012,2605cyclictest2898369-21kworker/0:0+events23:56:310
280573599261513,2598cyclictest2839524-21kworker/1:0+events20:55:231
280573599260612,2590cyclictest2812344-21kworker/1:1+events19:34:531
280574399260413,2587cyclictest2854192-21kworker/2:1+events21:43:212
280574599259615,2577cyclictest2865543-21kworker/3:0+events22:29:213
280573199258312,2567cyclictest2889627-21kworker/0:1+events23:34:370
280573599258212,2566cyclictest2889662-21kworker/1:0+events23:29:141
280573599258112,2565cyclictest2857473-21kworker/1:2+events21:55:291
280573599257712,2561cyclictest2826591-21kworker/1:0+events20:16:301
280574399257612,2560cyclictest2818625-21kworker/2:1+events19:47:032
280573599257412,2558cyclictest2844176-21kworker/1:0+events21:08:011
280573599257312,2557cyclictest2829924-21kworker/1:0+events20:40:241
280573199257312,2558cyclictest2900995-21kworker/0:1+events00:23:570
28057359925729,2559cyclictest2850899-21kworker/1:1+events21:40:181
28057359925718,2559cyclictest2841622-21kworker/1:1+events21:01:061
280574599256912,2553cyclictest2831315-21kworker/3:2+events20:47:083
28057439925676,2557cyclictest2813416-21kworker/2:2+events19:34:312
280573599256710,2553cyclictest2839524-21kworker/1:0+events20:52:461
28057359925657,2554cyclictest2820254-21kworker/1:2+events20:06:251
280573599256410,2550cyclictest2859074-21kworker/1:1+events22:11:001
280573599256312,2548cyclictest2875113-21kworker/1:2+events22:49:311
28057359925629,2549cyclictest2894753-21kworker/1:0+events23:53:531
28057359925589,2546cyclictest2894753-21kworker/1:0+events23:47:251
280573599255612,2540cyclictest2904413-21kworker/1:1+events00:17:271
280573599255610,2543cyclictest2873437-21kworker/1:0+events23:17:441
280573599255310,2540cyclictest2873437-21kworker/1:0+events22:44:551
280573599255012,2535cyclictest2870197-21kworker/1:1+events22:30:311
280574599254412,2528cyclictest2854104-21kworker/3:1+events21:41:263
280574599254312,2527cyclictest2904543-21kworker/3:0+events00:31:383
280573599254012,2525cyclictest2826591-21kworker/1:0+events20:12:471
280573199253512,2519cyclictest2900995-21kworker/0:1+events00:10:150
280574399253212,2516cyclictest2860517-21kworker/2:1+events21:58:302
280573199252814,2510cyclictest2821946-21kworker/0:1+events20:13:110
280573599252510,2512cyclictest2860702-21kworker/1:0+events22:00:481
280573199252112,2505cyclictest2804980-21kworker/0:1+events19:39:050
280573599251612,2501cyclictest2828182-21kworker/1:2+events20:21:481
280573599251511,2501cyclictest2912170-21kworker/1:2+events00:38:041
280573199251412,2498cyclictest2870258-21kworker/0:2+events22:48:230
28057459925128,2500cyclictest2859281-21kworker/3:1+events21:58:543
280573599251112,2496cyclictest2807083-21kworker/1:1+events19:14:481
280573199250912,2494cyclictest2831285-21kworker/0:1+events20:38:070
280573199250712,2493cyclictest2860790-21kworker/0:0+events22:00:030
280573599250012,2485cyclictest2813948-21kworker/1:2+events19:38:411
280574599249911,2484cyclictest2879905-21kworker/3:2+events22:58:223
280573599249712,2481cyclictest2881593-21kworker/1:1+events23:13:141
280573599249612,2481cyclictest2873437-21kworker/1:0+events22:54:071
280573599249612,2480cyclictest2892993-21kworker/1:1+events00:07:341
280573599249612,2480cyclictest2847674-21kworker/1:0+events21:22:561
280574399249412,2478cyclictest2910537-21kworker/2:0+events00:32:192
280573199249410,2480cyclictest2855666-21kworker/0:2+events21:44:490
280573599249312,2478cyclictest2884885-21kworker/1:2+events23:23:041
28057319924939,2480cyclictest2904324-21kworker/0:2+events00:18:380
280573199249312,2478cyclictest2841412-21kworker/0:2+events21:03:020
280573199249312,2477cyclictest2880029-21kworker/0:2+events22:59:300
280574399249212,2477cyclictest2821815-21kworker/2:1+events19:57:392
280574399249212,2477cyclictest2807111-21kworker/2:0+events19:29:572
280573199249112,2475cyclictest2804980-21kworker/0:1+events19:23:330
280573199249112,2475cyclictest2804980-21kworker/0:1+events19:23:320
280573199249110,2477cyclictest2876387-21kworker/0:0+events23:14:240
280573599249012,2475cyclictest2859074-21kworker/1:1+events21:53:371
28057319924908,2478cyclictest2817396-21kworker/0:0+events19:58:260
280573199249012,2474cyclictest2878081-21kworker/0:1+events22:53:430
280573199249012,2474cyclictest2870258-21kworker/0:2+events22:42:170
280573199249011,2475cyclictest2801494-21kworker/0:0+events19:12:530
280573599248912,2473cyclictest2873437-21kworker/1:0+events23:05:371
280573599248812,2472cyclictest2906019-21kworker/1:0+events00:29:201
280573599248812,2472cyclictest2891363-21kworker/1:2+events23:43:381
280573199248811,2473cyclictest2860790-21kworker/0:0+events22:14:300
280573599248712,2471cyclictest2812344-21kworker/1:1+events19:51:571
28057319924878,2475cyclictest2876387-21kworker/0:0+events23:04:300
280573599248611,2472cyclictest2805125-21kworker/1:0+events19:17:061
280573199248411,2470cyclictest2857562-21kworker/0:1+events21:52:060
280573599248310,2470cyclictest2906019-21kworker/1:0+events00:24:221
280573599248211,2467cyclictest2873437-21kworker/1:0+events22:57:591
280573599248112,2465cyclictest2833406-21kworker/1:1+events20:36:381
280573599248012,2464cyclictest2866964-21kworker/1:0+events22:27:031
280573599247812,2463cyclictest2850899-21kworker/1:1+events21:33:281
280573599247812,2463cyclictest2839812-21kworker/1:3+events21:19:281
280573599247711,2463cyclictest2812344-21kworker/1:1+events19:48:331
280573199247611,2461cyclictest2845896-21kworker/0:2+events21:13:210
280573599247512,2460cyclictest2831526-21kworker/1:2+events20:31:411
280573599247512,2459cyclictest2852561-21kworker/1:2+events21:37:391
280573199247512,2459cyclictest2827499-21kworker/0:2+events20:16:510
280573599247410,2460cyclictest2866964-21kworker/1:0+events22:23:361
280574399246813,2453cyclictest2850943-21kworker/2:1+events21:27:472
280573199246612,2450cyclictest2860790-21kworker/0:0+events22:27:260
280574599246512,2449cyclictest2831315-21kworker/3:2+events20:36:163
280573199246512,2449cyclictest2857562-21kworker/0:1+events21:56:380
280573199246412,2448cyclictest2847916-21kworker/0:0+events21:20:370
280573599246311,2449cyclictest2839812-21kworker/1:3+events21:12:571
280573199245910,2446cyclictest2885887-21kworker/0:2+events23:26:310
28057319924574,2449cyclictest2900995-21kworker/0:1+events00:31:580
280574599245512,2438cyclictest2831315-21kworker/3:2+events20:41:083
280573599245312,2438cyclictest2887718-21kworker/1:1+events23:30:451
280573199245312,2437cyclictest2900995-21kworker/0:1+events00:04:540
280573199245212,2436cyclictest2839730-21kworker/0:1+events21:16:240
28057459924479,2434cyclictest2863885-21kworker/3:2+events22:51:023
280573199244612,2430cyclictest2817396-21kworker/0:0+events20:02:360
280574399244511,2430cyclictest2862158-21kworker/2:2+events22:12:572
280574599244010,2426cyclictest2904543-21kworker/3:0+events00:27:013
280573199244010,2427cyclictest2852412-21kworker/0:0+events21:45:360
280574599243712,2423cyclictest2838106-21kworker/3:0+events20:50:093
280574599243712,2422cyclictest2865543-21kworker/3:0+events22:18:403
280574599243712,2422cyclictest2855782-21kworker/3:2+events21:46:473
280574599243712,2421cyclictest2800079-21kworker/3:1+events19:35:163
280574599243612,2420cyclictest2863885-21kworker/3:2+events22:33:113
280574599243412,2418cyclictest2849243-21kworker/3:1+events21:26:413
280573199243412,2418cyclictest2910774-21kworker/0:2+events00:35:260
280573599243210,2418cyclictest2870197-21kworker/1:1+events22:35:491
280574599243012,2416cyclictest2838106-21kworker/3:0+events20:55:013
280574599243012,2415cyclictest2845749-21kworker/3:2+events21:12:123
280573199243011,2416cyclictest2881683-21kworker/0:1+events23:16:390
280573199242512,2411cyclictest2889627-21kworker/0:1+events23:50:050
280573199242411,2409cyclictest2852412-21kworker/0:0+events21:38:260
280574399242112,2406cyclictest2821815-21kworker/2:1+events20:01:292
280574599242010,2406cyclictest2810178-21kworker/3:2+events19:26:323
280573199242012,2405cyclictest2900995-21kworker/0:1+events00:08:430
28057319924178,2405cyclictest2881683-21kworker/0:1+events23:09:490
28057319924129,2400cyclictest2889627-21kworker/0:1+events23:40:340
280573199241212,2396cyclictest2813976-21kworker/0:0+events19:34:080
280573599241111,2396cyclictest2862423-21kworker/1:2+events22:17:061
280573199241012,2395cyclictest2887748-21kworker/0:0+events23:21:560
280573199241010,2397cyclictest2865394-21kworker/0:1+events22:16:430
28057359924096,2400cyclictest2902779-21kworker/1:2+events00:10:591
28057459924088,2397cyclictest2886248-21kworker/3:1+events23:20:243
280573199240812,2393cyclictest2839730-21kworker/0:1+events20:56:090
280574399240712,2391cyclictest2828225-21kworker/2:1+events20:22:352
280573599240511,2391cyclictest2892993-21kworker/1:1+events23:56:551
280573199240512,2389cyclictest2852412-21kworker/0:0+events21:32:430
280574399240311,2390cyclictest2865374-21kworker/2:0+events22:15:132
280573199240311,2388cyclictest2827499-21kworker/0:2+events20:29:460
280573199240112,2386cyclictest2870258-21kworker/0:2+events22:31:400
280574399240012,2384cyclictest2836612-21kworker/2:2+events20:49:452
280574399240011,2386cyclictest2865374-21kworker/2:0+events22:31:192
280573199240012,2385cyclictest2900995-21kworker/0:1+events00:26:380
280574399239912,2383cyclictest2889672-21kworker/2:2+events23:36:062
280574399239912,2383cyclictest2844270-21kworker/2:0+events21:07:402
280574399239911,2384cyclictest2878234-21kworker/2:0+events23:01:462
280574399239910,2386cyclictest2868589-21kworker/2:2+events22:23:592
280574399239910,2386cyclictest2829873-21kworker/2:0+events20:25:572
280573199239912,2384cyclictest2827499-21kworker/0:2+events20:30:330
280574599239712,2381cyclictest2810178-21kworker/3:2+events19:24:413
280574599239712,2381cyclictest2810178-21kworker/3:2+events19:24:413
280573599239711,2383cyclictest2906019-21kworker/1:0+events00:33:521
280573199239712,2381cyclictest2821946-21kworker/0:1+events20:08:190
28057439923967,2386cyclictest2894529-21kworker/2:2+events23:44:022
280574399239612,2380cyclictest2876618-21kworker/2:2+events22:59:082
280574399239512,2379cyclictest2871796-21kworker/2:2+events22:43:012
280574399239511,2381cyclictest2842684-21kworker/2:2+events21:02:392
280573199239511,2381cyclictest2844237-21kworker/0:0+events21:07:180
280574599239411,2380cyclictest2823723-21kworker/3:3+events20:06:033
280573199239410,2381cyclictest2817396-21kworker/0:0+events19:47:250
280574599239211,2378cyclictest2863885-21kworker/3:2+events22:11:243
280574599239210,2378cyclictest2897516-21kworker/3:2+events00:02:173
280574399239111,2376cyclictest2894529-21kworker/2:2+events23:48:302
280573199239110,2378cyclictest2807831-21kworker/0:2+events19:19:440
280574399239011,2375cyclictest2807111-21kworker/2:0+events19:21:142
280574399239011,2375cyclictest2807111-21kworker/2:0+events19:21:142
280574599238910,2375cyclictest2838106-21kworker/3:0+events21:08:473
28057459923878,2375cyclictest2891335-21kworker/3:0+events23:38:213
280574599238212,2366cyclictest2863885-21kworker/3:2+events22:47:593
280574599237910,2365cyclictest2829720-21kworker/3:1+events20:31:193
280574599237712,2362cyclictest2886248-21kworker/3:1+events23:25:443
280573199237711,2362cyclictest2860790-21kworker/0:0+events22:07:390
280574399237612,2361cyclictest2835008-21kworker/2:1+events20:40:452
280573199237610,2362cyclictest2836510-21kworker/0:0+events20:54:390
280574599236112,2345cyclictest2897516-21kworker/3:2+events23:54:173
280574399236111,2346cyclictest2882961-21kworker/2:2+events23:08:382
280574599235912,2344cyclictest2806569-21kworker/3:0+events19:13:153
280574599235812,2342cyclictest2891335-21kworker/3:0+events23:48:103
280574399235610,2342cyclictest2902899-21kworker/2:1+events00:14:262
280574599235410,2341cyclictest2810178-21kworker/3:2+events19:30:413
280573599235412,2338cyclictest2889662-21kworker/1:0+events23:36:521
280574599235312,2338cyclictest2872712-21kworker/3:0+events22:37:453
280574599235312,2337cyclictest2865543-21kworker/3:0+events22:24:233
28057459923522,2347cyclictest2892933-21kworker/3:1+events23:43:173
280574599235112,2336cyclictest2907358-21kworker/3:2+events00:21:383
280574599235112,2336cyclictest2897516-21kworker/3:2+events23:57:393
280574599235112,2336cyclictest2881816-21kworker/3:0+events23:17:223
280574599235112,2336cyclictest2823363-21kworker/3:0+events20:01:533
280574599235012,2334cyclictest2881816-21kworker/3:0+events23:10:353
280574599235010,2336cyclictest2859281-21kworker/3:1+events22:01:553
28057459923499,2337cyclictest2818772-21kworker/3:2+events19:48:573
280574599234912,2334cyclictest2815459-21kworker/3:0+events19:44:233
280574599234912,2333cyclictest2857677-21kworker/3:0+events21:51:433
280574599234912,2333cyclictest2828094-21kworker/3:0+events20:21:273
280574599234910,2336cyclictest2847612-21kworker/3:0+events21:17:103
280574599234812,2332cyclictest2806569-21kworker/3:0+events19:19:203
280574399234812,2332cyclictest2871796-21kworker/2:2+events22:39:162
280574599234312,2327cyclictest2826503-21kworker/3:1+events20:12:263
280574399234312,2329cyclictest2882961-21kworker/2:2+events23:20:012
280574399234212,2326cyclictest2857707-21kworker/2:0+events22:03:052
280574399234112,2326cyclictest2809141-21kworker/2:1+events19:36:472
280573599234112,2325cyclictest2859074-21kworker/1:1+events22:06:071
280574599234010,2327cyclictest2818772-21kworker/3:2+events19:54:593
280574399234012,2325cyclictest2886159-21kworker/2:0+events23:16:162
280574399234010,2326cyclictest2891273-21kworker/2:0+events23:34:582
280574399233711,2323cyclictest2870191-21kworker/2:1+events22:29:452
280574599233211,2317cyclictest2838106-21kworker/3:0+events21:02:163
280574399233012,2315cyclictest2844270-21kworker/2:0+events21:17:332
280574399232912,2314cyclictest2899326-21kworker/2:2+events00:00:452
280574399232912,2313cyclictest2863769-21kworker/2:1+events22:09:532
280574399232911,2315cyclictest2838444-21kworker/2:1+events20:59:092
280574399232711,2313cyclictest2820225-21kworker/2:0+events20:11:422
280574399232611,2312cyclictest2910537-21kworker/2:0+events00:35:492
280574399232512,2310cyclictest2907328-21kworker/2:2+events00:26:162
280574399232512,2309cyclictest2904493-21kworker/2:0+events00:19:002
280574399232512,2309cyclictest2849354-21kworker/2:2+events21:23:192
280574399231011,2296cyclictest2820225-21kworker/2:0+events20:09:262
280574399231010,2297cyclictest2849354-21kworker/2:2+events21:34:582
280574399230911,2294cyclictest2901248-21kworker/2:0+events00:09:072
280574399230812,2293cyclictest2875022-21kworker/2:1+events22:45:422
280574399230612,2290cyclictest2884567-21kworker/2:1+events23:12:512
280573599230111,2286cyclictest2805125-21kworker/1:0+events19:20:511
280573599230111,2286cyclictest2805125-21kworker/1:0+events19:20:511
280573599228612,2271cyclictest2879966-21kworker/1:2+events23:00:151
28057319922709,2257cyclictest2810485-21kworker/0:0+events19:26:110
280573599226910,2256cyclictest2854335-21kworker/1:0+events21:47:101
280573599226110,2248cyclictest2829924-21kworker/1:0+events20:27:041
28057319922589,2245cyclictest2831285-21kworker/0:1+events20:43:460
280574399225310,2240cyclictest2876618-21kworker/2:2+events22:50:382
280574399225112,2236cyclictest2818625-21kworker/2:1+events19:50:272
280574599224711,2232cyclictest2904543-21kworker/3:0+events00:16:403
280574399221910,2205cyclictest2852552-21kworker/2:0+events21:39:102
280574399221811,2203cyclictest2826621-21kworker/2:2+events20:17:372
28057319922179,2205cyclictest2867029-21kworker/0:2+events22:21:180
280573199220711,2192cyclictest2891306-21kworker/0:0+events23:37:140
280573199220610,2192cyclictest2868651-21kworker/0:1+events22:38:310
280574599219012,2175cyclictest2847612-21kworker/3:0+events21:20:143
280574599216211,2147cyclictest2823723-21kworker/3:3+events20:16:093
280574599215711,2142cyclictest2899203-21kworker/3:1+events00:12:333
280574399215711,2142cyclictest2897739-21kworker/2:1+events23:59:342
28057459921549,2141cyclictest2887873-21kworker/3:2+events23:31:313
280574599215210,2138cyclictest2872712-21kworker/3:0+events22:43:233
280574399213211,2117cyclictest2828225-21kworker/2:1+events20:32:042
280574399210911,2095cyclictest2799939-21kworker/2:2+events19:16:422
280574399210711,2093cyclictest2886159-21kworker/2:0+events23:26:072
280574399210311,2089cyclictest2829873-21kworker/2:0+events20:39:172
280574399210111,2087cyclictest2815404-21kworker/2:0+events19:41:012
280574399209811,2084cyclictest2907328-21kworker/2:2+events00:22:012
28057439919587,1948cyclictest2857707-21kworker/2:0+events21:50:322
28050082144110,29sleep10-21swapper/119:07:041
2805009214396,31sleep20-21swapper/219:07:052
28049852143108,31sleep30-21swapper/319:06:463
28049592140100,26sleep00-21swapper/019:06:270
2805745992012,5cyclictest2880833-21runrttasks23:00:163
280574399193,4cyclictest43-21ksoftirqd/220:55:002
2805743991810,4cyclictest43-21ksoftirqd/221:10:112
280574399180,5cyclictest2896752-21hddtemp_smartct23:50:142
280574399180,14cyclictest2805850-21munin-node19:10:092
2805735991713,2cyclictest0-21swapper/120:00:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional