You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 09:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Wed May 06, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
280660899296110,2948cyclictest2851857-21kworker/1:0+events21:33:371
280661499295613,2939cyclictest2891790-21kworker/3:0+events23:55:113
280661499284714,2828cyclictest2813008-21kworker/3:1+events19:45:123
28066149928060,2802cyclictest2909296-21kworker/3:0+events00:37:463
280661499277113,2754cyclictest2814727-21kworker/3:0+events19:35:003
280660499276112,2745cyclictest2878590-21kworker/0:0+events22:51:520
280660899275114,2733cyclictest2886900-21kworker/1:1+events00:15:181
280661299272313,2707cyclictest2879130-21kworker/2:1+events22:55:172
280660899271711,2702cyclictest2864574-21kworker/1:2+events22:45:011
280660499266313,2648cyclictest2838862-21kworker/0:2+events21:20:160
280661499264713,2629cyclictest2858526-21kworker/3:0+events21:55:213
280660899263812,2622cyclictest2853492-21kworker/1:2+events22:00:161
280660899262312,2607cyclictest2822595-21kworker/1:2+events20:01:301
28066129926199,2606cyclictest2822742-21kworker/2:1+events19:59:582
280661499259110,2577cyclictest2877704-21kworker/3:1+events22:51:293
280661499258913,2572cyclictest2885541-21kworker/3:0+events23:15:133
280661499257612,2560cyclictest2845281-21kworker/3:1+events21:14:303
280661499257512,2559cyclictest2885541-21kworker/3:0+events23:22:233
280661499257412,2559cyclictest2813008-21kworker/3:1+events19:53:343
28066049925657,2555cyclictest2829115-21kworker/0:2+events20:27:460
280660499255312,2538cyclictest2880580-21kworker/0:1+events23:12:330
280660499254912,2534cyclictest2866088-21kworker/0:0+events22:19:000
28066049925489,2535cyclictest2822714-21kworker/0:2+events20:09:490
28066049925469,2534cyclictest2838862-21kworker/0:2+events21:09:390
280660499254311,2529cyclictest2854887-21kworker/0:1+events22:08:160
280660499254211,2527cyclictest2824457-21kworker/0:0+events20:23:120
280660499254112,2526cyclictest2904525-21kworker/0:1+events00:14:550
280660499254012,2524cyclictest2824457-21kworker/0:0+events20:40:440
280660499253911,2524cyclictest2854887-21kworker/0:1+events21:51:510
280660499253712,2523cyclictest2864300-21kworker/0:2+events22:22:180
280661499253512,2519cyclictest2813008-21kworker/3:1+events19:56:103
280660499253510,2523cyclictest2827508-21kworker/0:1+events20:16:420
280660499252312,2507cyclictest2838862-21kworker/0:2+events21:01:170
280661499251712,2501cyclictest2867752-21kworker/3:0+events22:40:343
280661299251612,2500cyclictest2899612-21kworker/2:0+events00:00:282
280661499251412,2498cyclictest2845281-21kworker/3:1+events21:16:033
280660499251412,2499cyclictest2888857-21kworker/0:0+events23:27:230
280660899250712,2493cyclictest2886900-21kworker/1:1+events00:00:051
280660899250312,2488cyclictest2907562-21kworker/1:1+events00:27:011
280660499250310,2489cyclictest2811377-21kworker/0:2+events19:25:130
280661499250012,2484cyclictest2891790-21kworker/3:0+events00:00:533
280661499249912,2483cyclictest2851768-21kworker/3:2+events21:33:133
280661299249914,2481cyclictest2880792-21kworker/2:0+events23:13:432
280661499249812,2483cyclictest2866118-21kworker/3:1+events22:19:223
28066149924974,2489cyclictest2904377-21kworker/3:0+events00:16:473
280661499249712,2481cyclictest2837137-21kworker/3:1+events20:46:063
280661499249712,2481cyclictest2818448-21kworker/3:0+events20:04:543
28066089924965,2488cyclictest2853492-21kworker/1:2+events21:48:041
280660499249612,2480cyclictest2880580-21kworker/0:1+events23:50:140
280660499249312,2477cyclictest2901413-21kworker/0:2+events00:04:210
280660499249312,2477cyclictest2874315-21kworker/0:2+events22:48:480
280661499249112,2477cyclictest2808003-21kworker/3:2+events19:20:093
280661499249112,2476cyclictest2824515-21kworker/3:1+events20:27:003
280661499249012,2475cyclictest2877704-21kworker/3:1+events23:11:003
280661499248911,2475cyclictest2864483-21kworker/3:2+events22:24:323
280660499248912,2474cyclictest2882262-21kworker/0:0+events23:05:380
280660499248812,2473cyclictest2896496-21kworker/0:2+events23:49:500
280661499248712,2472cyclictest2813008-21kworker/3:1+events19:36:283
280661499248711,2473cyclictest2891790-21kworker/3:0+events23:54:053
280660499248712,2472cyclictest2909358-21kworker/0:1+events00:32:500
280660499248612,2470cyclictest2851587-21kworker/0:0+events21:39:190
280661499248512,2469cyclictest2895434-21kworker/3:1+events23:47:103
280661499248511,2470cyclictest2887202-21kworker/3:2+events23:27:003
280661499248412,2469cyclictest2867752-21kworker/3:0+events22:56:493
280660499248412,2469cyclictest2814668-21kworker/0:2+events19:36:070
280660499248412,2468cyclictest2907758-21kworker/0:2+events00:24:490
280661499248312,2468cyclictest2904377-21kworker/3:0+events00:20:393
280661499248312,2468cyclictest2872536-21kworker/3:2+events22:34:303
280661499248212,2467cyclictest2853376-21kworker/3:1+events21:40:533
280660499248212,2466cyclictest2838862-21kworker/0:2+events21:11:300
280661499248111,2467cyclictest2867752-21kworker/3:0+events22:46:343
280660899248112,2465cyclictest2886900-21kworker/1:1+events00:10:251
280660499248112,2466cyclictest2827508-21kworker/0:1+events20:13:380
280660499248012,2465cyclictest2880580-21kworker/0:1+events23:01:460
280660499248012,2465cyclictest2845578-21kworker/0:1+events21:17:550
280660499247911,2464cyclictest2838862-21kworker/0:2+events20:54:210
280660499247811,2464cyclictest2874315-21kworker/0:2+events22:41:380
280661299247711,2461cyclictest2813191-21kworker/2:1+events19:40:182
280661499247512,2459cyclictest2867752-21kworker/3:0+events22:26:033
280660499247512,2459cyclictest2870757-21kworker/0:0+events22:30:140
280661499247412,2459cyclictest2856741-21kworker/3:2+events21:47:173
280661499247411,2459cyclictest2858526-21kworker/3:0+events21:53:473
280661499247011,2456cyclictest2887202-21kworker/3:2+events23:32:193
280660499246910,2456cyclictest2887173-21kworker/0:2+events23:23:100
280661499246812,2453cyclictest2830925-21kworker/3:2+events20:33:063
280660499246812,2453cyclictest2819425-21kworker/0:2+events19:50:130
280661299246112,2445cyclictest2803702-21kworker/2:2+events19:23:382
280661299246012,2444cyclictest2861376-21kworker/2:0+events22:01:252
280660499245911,2444cyclictest2872658-21kworker/0:1+events22:37:540
280660499245712,2441cyclictest2824457-21kworker/0:0+events20:47:590
280661299245611,2443cyclictest2827627-21kworker/2:1+events20:15:092
280661499245311,2438cyclictest2887202-21kworker/3:2+events23:41:283
280660499245311,2439cyclictest2880580-21kworker/0:1+events22:57:350
280660899245211,2437cyclictest2847236-21kworker/1:2+events21:18:191
280660499245212,2437cyclictest2851587-21kworker/0:0+events21:30:550
280660499245212,2436cyclictest2845578-21kworker/0:1+events21:25:350
280660499245212,2436cyclictest2803152-21kworker/0:0+events19:55:270
280660499245111,2436cyclictest2864300-21kworker/0:2+events22:14:030
280660499245012,2434cyclictest2851587-21kworker/0:0+events21:46:560
280660499245010,2436cyclictest2880580-21kworker/0:1+events23:31:100
280661299244912,2434cyclictest2867419-21kworker/2:0+events22:17:042
280660499244912,2434cyclictest2803152-21kworker/0:0+events19:45:360
280660499244912,2433cyclictest2854887-21kworker/0:1+events22:02:340
28066129924359,2423cyclictest2827627-21kworker/2:1+events20:35:482
280661299243412,2418cyclictest2850257-21kworker/2:2+events21:29:462
280661299243410,2421cyclictest2859773-21kworker/2:2+events22:05:132
280661299243212,2416cyclictest2903047-21kworker/2:1+events00:33:132
280661299242812,2413cyclictest2821089-21kworker/2:2+events20:10:102
280661299242612,2411cyclictest2880792-21kworker/2:0+events23:38:272
280661299242412,2408cyclictest2894838-21kworker/2:2+events23:46:032
280661299242412,2408cyclictest2840603-21kworker/2:1+events21:06:362
280661299242410,2410cyclictest2867419-21kworker/2:0+events22:46:102
280661299242312,2407cyclictest2851917-21kworker/2:0+events21:43:542
280661299242312,2407cyclictest2842511-21kworker/2:0+events21:03:312
280661299242211,2407cyclictest2880792-21kworker/2:0+events23:42:382
280660899242212,2407cyclictest2840280-21kworker/1:1+events21:00:291
280661299242111,2407cyclictest2899612-21kworker/2:0+events00:07:002
280661299242111,2407cyclictest2845340-21kworker/2:2+events21:12:152
280660899242011,2405cyclictest2826210-21kworker/1:1+events20:19:221
280661499241912,2404cyclictest2887202-21kworker/3:2+events23:37:173
280661299241812,2402cyclictest2819489-21kworker/2:1+events19:47:072
280660899241411,2399cyclictest2882327-21kworker/1:0+events23:05:161
280661499241312,2398cyclictest2853376-21kworker/3:1+events21:38:343
280661499241311,2398cyclictest2902340-21kworker/3:1+events00:27:223
280660899240912,2393cyclictest2867478-21kworker/1:0+events22:17:501
280661299240412,2388cyclictest2888580-21kworker/2:1+events23:26:162
280661299240112,2386cyclictest2867419-21kworker/2:0+events22:26:272
280660899240112,2385cyclictest2828900-21kworker/1:0+events20:22:501
280661299239911,2385cyclictest2880792-21kworker/2:0+events23:17:292
280660499239910,2385cyclictest2791807-21kworker/0:1+events19:13:180
280660899239412,2380cyclictest2899704-21kworker/1:0+events00:21:001
280660899239212,2376cyclictest2836129-21kworker/1:0+events20:50:591
280660499239112,2376cyclictest2854887-21kworker/0:1+events21:41:380
280660499239111,2377cyclictest2838862-21kworker/0:2+events20:58:340
280660899238811,2373cyclictest2824249-21kworker/1:0+events20:06:011
280661299238412,2369cyclictest2905967-21kworker/2:0+events00:20:152
280660499238411,2370cyclictest2870757-21kworker/0:0+events22:28:420
280661299238310,2371cyclictest2832394-21kworker/2:0+events20:30:032
280661299238112,2365cyclictest2815996-21kworker/2:0+events19:36:522
280661299237012,2355cyclictest2901291-21kworker/2:2+events00:11:352
280661299236312,2348cyclictest2879130-21kworker/2:1+events22:53:002
280661299236212,2347cyclictest2903047-21kworker/2:1+events00:29:192
280661299236212,2347cyclictest2858080-21kworker/2:1+events21:51:262
280661299236112,2346cyclictest2872502-21kworker/2:1+events22:38:372
280660899236112,2346cyclictest2830682-21kworker/1:2+events20:39:341
280661299236012,2345cyclictest2864696-21kworker/2:1+events22:14:472
280661499235711,2343cyclictest2830925-21kworker/3:2+events20:37:173
280660899235713,2340cyclictest2882327-21kworker/1:0+events23:24:431
280660899235712,2342cyclictest2882327-21kworker/1:0+events23:26:381
280661499235612,2341cyclictest2877704-21kworker/3:1+events23:01:003
280661499235611,2342cyclictest2816328-21kworker/3:2+events19:44:283
280660499235511,2341cyclictest2816296-21kworker/0:1+events19:44:490
28066089923433,2337cyclictest2875933-21kworker/1:0+events22:53:221
280661299234112,2326cyclictest2899612-21kworker/2:0+events23:56:422
280661299234112,2326cyclictest2846968-21kworker/2:0+events21:17:352
280661299234112,2325cyclictest2867419-21kworker/2:0+events22:33:202
280661299234111,2326cyclictest2846968-21kworker/2:0+events21:21:012
280661299234012,2324cyclictest2830205-21kworker/2:2+events20:21:172
280661299234010,2326cyclictest2896440-21kworker/2:1+events23:51:462
280660899234010,2326cyclictest2818455-21kworker/1:1+events19:55:491
280661299233912,2324cyclictest2838917-21kworker/2:2+events20:58:582
280661299233812,2323cyclictest2858080-21kworker/2:1+events21:57:392
280661299233812,2323cyclictest2851917-21kworker/2:0+events21:38:582
280661299233711,2322cyclictest2880792-21kworker/2:0+events23:01:222
280660899233712,2322cyclictest2898013-21kworker/1:2+events23:53:181
280661299233612,2321cyclictest2905967-21kworker/2:0+events00:17:112
280661299233611,2322cyclictest2835719-21kworker/2:0+events20:41:532
280660899233612,2321cyclictest2842200-21kworker/1:2+events21:06:591
280661299233412,2319cyclictest2890340-21kworker/2:2+events23:31:562
280660499233311,2319cyclictest2824457-21kworker/0:0+events20:33:530
280660899233112,2315cyclictest2821000-21kworker/1:0+events19:53:551
280660899232912,2314cyclictest2853492-21kworker/1:2+events21:35:321
280661499232812,2313cyclictest2824515-21kworker/3:1+events20:11:453
280660899232712,2312cyclictest2893486-21kworker/1:2+events23:39:331
280660899232612,2311cyclictest2836129-21kworker/1:0+events20:55:301
280661499232311,2309cyclictest2862761-21kworker/3:0+events22:08:413
280661299232312,2308cyclictest2809898-21kworker/2:0+events19:28:142
280661299232310,2311cyclictest2856454-21kworker/2:2+events21:45:012
28066089923239,2311cyclictest2895109-21kworker/1:0+events23:46:241
280660899232312,2308cyclictest2884050-21kworker/1:2+events23:10:131
280660899231611,2301cyclictest2807944-21kworker/1:0+events19:29:451
280660899231411,2300cyclictest2880638-21kworker/1:2+events23:00:371
280660499231412,2298cyclictest2894870-21kworker/0:0+events23:44:560
280660899231110,2297cyclictest2822595-21kworker/1:2+events20:10:571
280661499230911,2294cyclictest2837137-21kworker/3:1+events20:56:173
280660899230912,2294cyclictest2893486-21kworker/1:2+events23:43:031
280660899230811,2294cyclictest2853492-21kworker/1:2+events21:56:301
280661499230712,2291cyclictest2900041-21kworker/3:3+events00:05:283
280661499230612,2291cyclictest2874200-21kworker/3:1+events22:39:013
280661499230612,2291cyclictest2861106-21kworker/3:2+events22:01:023
280660899230511,2291cyclictest2845430-21kworker/1:1+events21:11:531
280661499229911,2283cyclictest2808003-21kworker/3:2+events19:29:003
280661299229611,2282cyclictest2835719-21kworker/2:0+events20:51:432
280661299228612,2271cyclictest2880792-21kworker/2:0+events23:08:442
28066129922759,2263cyclictest2835719-21kworker/2:0+events20:47:152
280661299227411,2259cyclictest2803702-21kworker/2:2+events19:34:132
280660899227410,2260cyclictest2878027-21kworker/1:1+events22:59:531
280661499227311,2259cyclictest2824515-21kworker/3:1+events20:18:353
280660899227111,2257cyclictest2836129-21kworker/1:0+events20:45:431
280660499226811,2254cyclictest2901413-21kworker/0:2+events00:07:460
280660899226410,2251cyclictest2816236-21kworker/1:2+events19:42:121
280661299226311,2248cyclictest2867419-21kworker/2:0+events22:21:132
280660499226311,2248cyclictest2901413-21kworker/0:2+events00:15:390
280661499226111,2247cyclictest2845281-21kworker/3:1+events21:08:063
280661499226111,2246cyclictest2824515-21kworker/3:1+events20:06:463
280660499226111,2247cyclictest2834181-21kworker/0:2+events20:37:410
280661499225810,2244cyclictest2833263-21kworker/3:0+events20:54:443
280661499225310,2240cyclictest2902340-21kworker/3:1+events00:11:123
280661499225310,2240cyclictest2877704-21kworker/3:1+events23:08:203
280660499225210,2238cyclictest2898103-21kworker/0:0+events23:57:500
280661499225110,2237cyclictest2806294-21kworker/3:1+events19:14:503
280660499224710,2233cyclictest2813016-21kworker/0:1+events19:32:450
280660899224011,2226cyclictest2886900-21kworker/1:1+events23:18:161
28066089922398,2227cyclictest2809985-21kworker/1:1+events19:21:431
280661299223811,2224cyclictest2886932-21kworker/2:2+events23:20:502
28066129922368,2224cyclictest2851917-21kworker/2:0+events21:32:512
280660499223111,2216cyclictest2906109-21kworker/0:0+events00:37:220
280660499223110,2218cyclictest2803152-21kworker/0:0+events19:20:320
280661299222911,2215cyclictest2821089-21kworker/2:2+events20:05:172
280660499222811,2213cyclictest2822714-21kworker/0:2+events20:04:100
280661499222610,2213cyclictest2833263-21kworker/3:0+events20:41:063
280660499222611,2212cyclictest2854887-21kworker/0:1+events21:59:530
280660499222610,2213cyclictest2880580-21kworker/0:1+events23:19:010
280660899222511,2212cyclictest2807944-21kworker/1:0+events19:15:111
280661299219711,2182cyclictest2832394-21kworker/2:0+events20:27:242
280660899217911,2165cyclictest2834269-21kworker/1:1+events20:40:211
28066049921699,2157cyclictest2791807-21kworker/0:1+events19:15:350
280661299216311,2149cyclictest2803702-21kworker/2:2+events19:18:382
280660899216111,2147cyclictest2847236-21kworker/1:2+events21:25:121
280661299216011,2145cyclictest2821089-21kworker/2:2+events20:01:082
28066129921568,2144cyclictest2815996-21kworker/2:0+events19:54:412
280660899215311,2139cyclictest2861136-21kworker/1:0+events22:07:071
280660499214911,2134cyclictest2906109-21kworker/0:0+events00:28:570
28066129921298,2118cyclictest2903047-21kworker/2:1+events00:39:412
280660899211611,2103cyclictest2853492-21kworker/1:2+events21:40:061
280660899211611,2102cyclictest2814612-21kworker/1:1+events19:35:221
280660899211511,2100cyclictest2862879-21kworker/1:1+events22:12:311
280661499211310,2100cyclictest2804633-21kworker/3:0+events19:19:243
280660899211310,2101cyclictest2886900-21kworker/1:1+events00:05:071
280660899210911,2094cyclictest2909201-21kworker/1:2+events00:32:031
280660899210811,2094cyclictest2864574-21kworker/1:2+events22:30:371
280660899210810,2094cyclictest2853492-21kworker/1:2+events21:50:421
280660899210711,2093cyclictest2864574-21kworker/1:2+events22:24:551
28066089921069,2094cyclictest2807944-21kworker/1:0+events19:33:081
280660899210611,2092cyclictest2864574-21kworker/1:2+events22:36:241
280660899210511,2091cyclictest2910780-21kworker/1:0+events00:39:201
280661499210410,2091cyclictest2864483-21kworker/3:2+events22:12:543
280660899210311,2088cyclictest2886900-21kworker/1:1+events23:33:281
28066149920997,2089cyclictest2829144-21kworker/3:0+events20:21:393
280661499209911,2085cyclictest2842410-21kworker/3:2+events21:01:393
28066149920988,2087cyclictest2850020-21kworker/3:0+events21:29:233
280661499209711,2083cyclictest2907699-21kworker/3:2+events00:30:303
280661499209710,2084cyclictest2845281-21kworker/3:1+events21:20:403
28066129920767,2067cyclictest2872502-21kworker/2:1+events22:40:112
280660899206011,2046cyclictest2899704-21kworker/1:0+events23:58:371
280660899204110,2028cyclictest2828900-21kworker/1:0+events20:31:311
28066129920159,2003cyclictest2807856-21kworker/2:1+events19:14:272
280660899197711,1963cyclictest2847236-21kworker/1:2+events21:23:201
28066089919745,1966cyclictest2806262-21kworker/1:2+events19:14:041
28066089919519,1939cyclictest2816236-21kworker/1:2+events19:45:581
28066089919209,1908cyclictest2869333-21kworker/1:1+events22:26:491
28060742152105,27sleep10-21swapper/119:06:121
28060982148102,25sleep00-21swapper/019:06:300
28062512142113,24sleep20-21swapper/219:08:282
28062122140108,27sleep30-21swapper/319:07:573
2806608997471,2cyclictest2864574-21kworker/1:2+pm22:44:521
2806604992014,3cyclictest0-21swapper/023:40:000
280660899181,3cyclictest2831876-21strings20:25:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional