You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 09:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Jun 22, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
415655299383717,3817cyclictest12621-21kworker/2:2+events22:02:232
41565439933889,3375cyclictest4190379-21kworker/0:1+events20:56:410
415654899335416,3334cyclictest4177617-21kworker/1:2+events20:20:161
415656199328016,3260cyclictest30572-21kworker/3:0+events22:40:013
415654399326212,3246cyclictest4165945-21kworker/0:2+events19:45:170
415656199316215,3141cyclictest47956-21kworker/3:0+events23:40:183
415654899298713,2970cyclictest4192100-21kworker/1:0+events21:06:151
415654399298011,2965cyclictest43514-21kworker/0:1+events23:30:130
415654899297414,2956cyclictest13926-21kworker/1:1+events21:54:231
415656199297313,2956cyclictest12419-21kworker/3:0+events21:45:153
415656199297114,2951cyclictest64493-21kworker/3:3+events00:25:143
415654399296814,2950cyclictest4468-21kworker/0:1+events21:22:530
415656199296114,2944cyclictest4157867-21kworker/3:2+events19:15:023
415656199295714,2939cyclictest23686-21kworker/3:2+events22:50:133
415656199290813,2891cyclictest4177527-21kworker/3:1+events20:26:443
415655299290614,2888cyclictest25137-21kworker/2:0+events22:25:172
41565619928905,2881cyclictest4174059-21kworker/3:2+events20:05:013
415654399288914,2870cyclictest54521-21kworker/0:2+events00:00:170
415656199288613,2869cyclictest36719-21kworker/3:0+events23:05:013
415655299287612,2860cyclictest7584-21kworker/2:0+events21:29:472
415655299286213,2845cyclictest4159637-21kworker/2:0+events19:20:012
415654899284313,2828cyclictest39856-21kworker/1:2+events23:10:271
415654899284313,2826cyclictest6309-21kworker/1:2+events21:46:031
415656199284214,2824cyclictest6189-21kworker/3:1+events21:27:053
415654899283713,2820cyclictest20266-21kworker/1:0+events22:07:231
415654899283613,2821cyclictest1105-21kworker/1:2+events21:10:271
415654899283413,2817cyclictest4167718-21kworker/1:0+events20:05:491
415654399283214,2814cyclictest30428-21kworker/0:1+events22:46:030
415655299283012,2813cyclictest48195-21kworker/2:2+events23:38:032
415654899283013,2813cyclictest49816-21kworker/1:1+events23:40:421
415654899283013,2813cyclictest4177617-21kworker/1:2+events20:38:281
415655299282913,2811cyclictest17162-21kworker/2:1+events21:59:242
415655299282810,2815cyclictest4193425-21kworker/2:1+events21:05:062
415655299282613,2809cyclictest4187179-21kworker/2:0+events20:47:072
415654899282313,2806cyclictest4187654-21kworker/1:1+events20:59:421
415654899282113,2806cyclictest48047-21kworker/1:2+events23:35:091
415654899282113,2804cyclictest4175715-21kworker/1:1+events20:10:221
415654899282113,2804cyclictest24985-21kworker/1:0+events22:31:201
415654899281914,2803cyclictest15560-21kworker/1:0+events21:55:101
415654899281813,2801cyclictest4167718-21kworker/1:0+events19:54:241
415654399281713,2800cyclictest6162-21kworker/0:2+events21:26:420
415655299281413,2799cyclictest40072-21kworker/2:1+events23:10:022
415655299281413,2797cyclictest4172684-21kworker/2:2+events20:16:302
415655299281413,2797cyclictest40072-21kworker/2:1+events23:41:062
41565529928139,2800cyclictest4169444-21kworker/2:1+events20:01:362
415654899281312,2799cyclictest4684-21kworker/1:0+events21:40:031
415655299281113,2794cyclictest10940-21kworker/2:1+events21:39:162
41565489928100,2806cyclictest27000-21kworker/1:1+events22:45:181
415654399280913,2792cyclictest4170923-21kworker/0:2+events20:06:350
415654399280913,2792cyclictest12594-21kworker/0:2+events22:02:020
415654899280613,2789cyclictest4684-21kworker/1:0+events21:30:551
415654399280613,2789cyclictest12594-21kworker/0:2+events22:11:110
41565439928059,2792cyclictest4180840-21kworker/0:0+events20:28:380
415654399280513,2788cyclictest4468-21kworker/0:1+events21:19:480
415654399280513,2788cyclictest4167691-21kworker/0:1+events19:52:060
415654399280510,2791cyclictest4173972-21kworker/0:1+events20:14:100
415654899280413,2788cyclictest13926-21kworker/1:1+events22:13:071
415654899280413,2787cyclictest4177617-21kworker/1:2+events20:25:591
415654899280313,2786cyclictest41788-21kworker/1:0+events23:31:451
415656199280211,2787cyclictest4184298-21kworker/3:0+events20:45:413
415654899280213,2785cyclictest4177617-21kworker/1:2+events20:51:181
415654899280213,2784cyclictest13926-21kworker/1:1+events22:17:381
415655299280113,2784cyclictest61115-21kworker/2:2+events00:22:362
415656199280013,2783cyclictest4191800-21kworker/3:1+events21:03:343
415654399280012,2785cyclictest45141-21kworker/0:0+events23:26:070
415654899279913,2782cyclictest36631-21kworker/1:0+events23:05:241
415655299279713,2782cyclictest18785-21kworker/2:0+events22:10:262
415654899279513,2778cyclictest57967-21kworker/1:0+events00:04:071
415654899279513,2778cyclictest4161211-21kworker/1:2+events19:24:131
415656199279013,2773cyclictest23686-21kworker/3:2+events22:29:293
415655299279013,2773cyclictest4190602-21kworker/2:0+events20:57:032
415656199278913,2772cyclictest6189-21kworker/3:1+events21:24:233
415654899278813,2772cyclictest43426-21kworker/1:1+events23:28:461
415656199278511,2770cyclictest47956-21kworker/3:0+events23:38:263
415656199278413,2766cyclictest4172348-21kworker/3:0+events19:58:113
415655299278413,2767cyclictest4177349-21kworker/2:1+events20:13:282
415654399278413,2767cyclictest49554-21kworker/0:0+events23:41:290
415656199278213,2765cyclictest22054-21kworker/3:1+events22:19:353
415655299278113,2764cyclictest4180929-21kworker/2:0+events20:34:182
415654899278010,2766cyclictest4177617-21kworker/1:2+events20:42:381
415654899277913,2762cyclictest49816-21kworker/1:1+events23:46:031
415654899277913,2762cyclictest4684-21kworker/1:0+events21:20:591
415654899277913,2762cyclictest4166035-21kworker/1:1+events19:41:061
415654899277812,2763cyclictest59566-21kworker/1:2+events00:29:271
415655299277711,2762cyclictest4162808-21kworker/2:1+events19:29:262
415654899277712,2761cyclictest4187654-21kworker/1:1+events21:03:581
415655299277613,2759cyclictest40072-21kworker/2:1+events23:33:372
415655299277612,2760cyclictest52803-21kworker/2:2+events23:55:472
415654899277613,2759cyclictest4177617-21kworker/1:2+events20:49:021
415654899277613,2759cyclictest4172612-21kworker/1:2+events20:00:521
415654899277413,2757cyclictest3025-21kworker/1:1+events21:19:271
41565529927736,2763cyclictest51170-21kworker/2:0+events23:50:572
415654899277315,2754cyclictest4162839-21kworker/1:1+events19:31:181
415654399277313,2756cyclictest43514-21kworker/0:1+events23:20:450
415655299277211,2757cyclictest27090-21kworker/2:1+events22:39:382
415654899277210,2758cyclictest6309-21kworker/1:2+events21:28:361
41565529927719,2759cyclictest4156440-21kworker/2:3+events19:21:112
415654899277113,2754cyclictest13926-21kworker/1:1+events22:01:381
41565529927707,2759cyclictest4193425-21kworker/2:1+events21:03:112
415655299277013,2753cyclictest4187179-21kworker/2:0+events20:43:472
415654899277013,2753cyclictest27000-21kworker/1:1+events22:50:361
415654899277012,2754cyclictest4162839-21kworker/1:1+events19:28:431
415655299276913,2753cyclictest4169444-21kworker/2:1+events19:57:252
415655299276913,2752cyclictest1261-21kworker/2:0+events21:12:202
415655299276913,2750cyclictest65787-21kworker/2:0+events00:30:122
41565489927698,2757cyclictest36631-21kworker/1:0+events23:00:511
415654899276912,2755cyclictest21993-21kworker/1:2+events22:20:431
415654899276912,2753cyclictest61222-21kworker/1:1+events00:16:311
41565529927689,2755cyclictest23505-21kworker/2:2+events22:24:102
415655299276813,2751cyclictest61115-21kworker/2:2+events00:15:242
415655299276713,2752cyclictest3203-21kworker/2:3+events21:30:322
415654899276712,2751cyclictest4167718-21kworker/1:0+events19:48:221
415656199276613,2749cyclictest15651-21kworker/3:0+events22:03:573
415655299276512,2749cyclictest4159637-21kworker/2:0+events19:32:262
415654899276513,2748cyclictest4177617-21kworker/1:2+events20:33:111
415654899276512,2749cyclictest67567-21kworker/1:0+events00:38:111
415654899276413,2748cyclictest4684-21kworker/1:0+events21:35:531
415654399276312,2749cyclictest33739-21kworker/0:0+events23:00:040
415656199276213,2747cyclictest7854-21kworker/3:0+events21:30:093
415655299276213,2745cyclictest4188806-21kworker/2:2+events21:15:392
415654399276213,2745cyclictest4188716-21kworker/0:2+events20:47:310
415654399276212,2746cyclictest9286-21kworker/0:0+events21:48:430
415654399276211,2747cyclictest26848-21kworker/0:1+events22:26:490
415656199276113,2743cyclictest4182646-21kworker/3:2+events20:36:133
415654399276112,2747cyclictest52923-21kworker/0:1+events23:55:030
415656199276013,2743cyclictest59447-21kworker/3:2+events00:20:203
415654399276013,2744cyclictest12594-21kworker/0:2+events21:52:320
415654399276013,2743cyclictest28797-21kworker/0:2+events22:34:470
415656199275913,2743cyclictest64493-21kworker/3:3+events00:30:563
415654399275913,2742cyclictest4190379-21kworker/0:1+events20:53:370
415654899275813,2741cyclictest4158619-21kworker/1:1+events19:18:321
415654399275813,2742cyclictest43514-21kworker/0:1+events23:39:570
415654399275813,2741cyclictest52923-21kworker/0:1+events23:51:180
415654399275713,2740cyclictest60958-21kworker/0:2+events00:13:280
415654399275712,2741cyclictest12594-21kworker/0:2+events21:56:180
415654399275613,2739cyclictest4170923-21kworker/0:2+events20:03:300
415654399275513,2738cyclictest20420-21kworker/0:0+events22:35:530
415656199275413,2737cyclictest4177527-21kworker/3:1+events20:21:033
415654899275413,2739cyclictest49816-21kworker/1:1+events23:50:091
415656199275311,2738cyclictest4160473-21kworker/3:1+events19:25:213
41565439927538,2741cyclictest4187090-21kworker/0:0+events20:42:590
415654399275113,2734cyclictest9286-21kworker/0:0+events21:33:360
415654399275113,2734cyclictest4173972-21kworker/0:1+events20:30:530
41565619927508,2739cyclictest4188629-21kworker/3:2+events20:54:443
415656199274913,2732cyclictest6189-21kworker/3:1+events21:35:303
415656199274913,2732cyclictest4182646-21kworker/3:2+events20:33:333
415654899274812,2733cyclictest21993-21kworker/1:2+events22:25:421
415654399274712,2731cyclictest62641-21kworker/0:0+events00:38:540
415656199274613,2729cyclictest4184298-21kworker/3:0+events20:55:533
415656199274613,2729cyclictest34119-21kworker/3:1+events22:59:423
415654399274611,2731cyclictest22082-21kworker/0:1+events22:19:100
415655299274412,2728cyclictest35039-21kworker/2:0+events22:57:472
415654399274413,2728cyclictest4163129-21kworker/0:1+events19:31:410
415654399274413,2727cyclictest4192991-21kworker/0:0+events21:08:320
415656199274313,2726cyclictest54689-21kworker/3:3+events23:59:093
415656199274213,2725cyclictest45436-21kworker/3:2+events23:26:533
415656199274113,2724cyclictest57844-21kworker/3:1+events00:10:303
415656199274016,2720cyclictest4157867-21kworker/3:2+events19:33:143
415656199273912,2724cyclictest4175927-21kworker/3:0+events20:12:433
415656199273911,2724cyclictest23686-21kworker/3:2+events22:40:453
415656199273813,2721cyclictest4166184-21kworker/3:0+events19:43:223
415654899273812,2722cyclictest43426-21kworker/1:1+events23:20:221
415656199273713,2720cyclictest69141-21kworker/3:1+events00:39:413
415656199273711,2722cyclictest4169141-21kworker/3:1+events19:48:443
415654399273713,2721cyclictest4185068-21kworker/0:2+events20:39:130
415656199273513,2718cyclictest20450-21kworker/3:2+events22:12:433
415656199273512,2719cyclictest54494-21kworker/3:1+events23:54:413
415654399273510,2721cyclictest9286-21kworker/0:0+events21:44:110
415656199273413,2717cyclictest15651-21kworker/3:0+events22:05:503
415654399273312,2717cyclictest36601-21kworker/0:2+events22:59:200
415656199273213,2716cyclictest36719-21kworker/3:0+events23:13:083
415656199273113,2714cyclictest36719-21kworker/3:0+events23:08:293
415656199273111,2717cyclictest4169141-21kworker/3:1+events19:50:373
415655299273011,2715cyclictest38433-21kworker/2:2+events23:06:572
415654399273013,2713cyclictest4192991-21kworker/0:0+events21:14:130
415654399273013,2713cyclictest4173972-21kworker/0:1+events20:17:590
415656199272913,2712cyclictest4184298-21kworker/3:0+events20:44:103
415656199272212,2706cyclictest22054-21kworker/3:1+events22:23:473
415654399272112,2705cyclictest4167691-21kworker/0:1+events19:43:460
415656199271713,2700cyclictest4179134-21kworker/3:2+events20:19:543
415656199271713,2700cyclictest23686-21kworker/3:2+events22:30:563
415654399271713,2700cyclictest4192991-21kworker/0:0+events21:01:590
41565529927159,2702cyclictest4167837-21kworker/2:2+events19:47:372
415656199270813,2691cyclictest47956-21kworker/3:0+events23:31:233
415656199270613,2690cyclictest4160473-21kworker/3:1+events19:23:263
415656199269712,2681cyclictest59447-21kworker/3:2+events00:09:473
415655299268913,2672cyclictest51170-21kworker/2:0+events23:46:472
415655299267311,2658cyclictest4177349-21kworker/2:1+events20:28:142
415656199266913,2652cyclictest4191800-21kworker/3:1+events21:06:393
415655299266910,2655cyclictest31092-21kworker/2:2+events22:47:552
415655299266412,2649cyclictest12621-21kworker/2:2+events21:45:402
415656199265613,2639cyclictest4193457-21kworker/3:2+events21:18:393
41565529926529,2639cyclictest4169444-21kworker/2:1+events19:54:482
41565619926506,2641cyclictest4169141-21kworker/3:1+events20:00:273
415656199264913,2632cyclictest52893-21kworker/3:0+events23:49:023
415656199264613,2629cyclictest15651-21kworker/3:0+events21:58:153
415654899264510,2631cyclictest49816-21kworker/1:1+events00:05:181
415654399264111,2626cyclictest33739-21kworker/0:0+events22:51:430
415655299264012,2624cyclictest7584-21kworker/2:0+events21:40:252
415656199263012,2614cyclictest41940-21kworker/3:2+events23:16:333
415655299262513,2608cyclictest61115-21kworker/2:2+events00:29:032
415655299262310,2609cyclictest55879-21kworker/2:1+events00:00:402
415656199261612,2600cyclictest6189-21kworker/3:1+events21:52:103
415654399260613,2589cyclictest38284-21kworker/0:1+events23:08:070
415655299259913,2582cyclictest4172684-21kworker/2:2+events20:09:172
415656199259412,2578cyclictest4193457-21kworker/3:2+events21:14:343
415655299259213,2576cyclictest4172684-21kworker/2:2+events20:21:252
415656199258310,2569cyclictest40011-21kworker/3:1+events23:24:133
415654399257912,2563cyclictest12594-21kworker/0:2+events22:08:080
41565489925699,2556cyclictest27000-21kworker/1:1+events22:58:341
415655299256712,2551cyclictest43212-21kworker/2:0+events23:19:132
415654899256712,2550cyclictest4149498-21kworker/1:0+events19:36:101
415656199256613,2549cyclictest52893-21kworker/3:0+events00:04:553
415654899255212,2536cyclictest4167718-21kworker/1:0+events20:19:301
415654899254910,2535cyclictest41788-21kworker/1:0+events23:16:561
415655299254712,2531cyclictest4159637-21kworker/2:0+events19:36:332
415654899254712,2531cyclictest49816-21kworker/1:1+events23:56:331
41565489925467,2536cyclictest27000-21kworker/1:1+events22:44:091
415655299254512,2530cyclictest57816-21kworker/2:0+events00:13:082
415655299254412,2528cyclictest12621-21kworker/2:2+events21:51:232
415656199254312,2527cyclictest32261-21kworker/3:0+events22:49:283
415655299254312,2528cyclictest29006-21kworker/2:0+events22:40:242
415654899254211,2527cyclictest4170981-21kworker/1:1+events19:55:101
415655299254111,2526cyclictest4182696-21kworker/2:3+events20:36:382
415655299254012,2524cyclictest3203-21kworker/2:3+events21:24:012
415655299254010,2527cyclictest23505-21kworker/2:2+events22:18:482
415654399253911,2524cyclictest41911-21kworker/0:2+events23:16:110
415655299253810,2524cyclictest31092-21kworker/2:2+events22:53:142
41565489925389,2525cyclictest57967-21kworker/1:0+events00:12:461
415654399253812,2522cyclictest20420-21kworker/0:0+events22:20:220
415654399253712,2522cyclictest59330-21kworker/0:0+events00:06:260
41565529925366,2526cyclictest69257-21kworker/2:1+events00:38:332
415655299253612,2520cyclictest40072-21kworker/2:1+events23:28:232
415655299253411,2519cyclictest4159637-21kworker/2:0+events19:44:322
415654399253212,2518cyclictest66003-21kworker/0:2+events00:31:210
415655299253112,2515cyclictest35039-21kworker/2:0+events23:03:292
415654399253112,2516cyclictest39979-21kworker/0:0+events23:14:180
415654399253112,2515cyclictest60958-21kworker/0:2+events00:17:380
415654399253110,2517cyclictest4173972-21kworker/0:1+events20:24:520
41565439925308,2518cyclictest4155701-21kworker/0:0+events19:35:490
415654399253011,2515cyclictest62641-21kworker/0:0+events00:24:050
415654899252812,2512cyclictest62906-21kworker/1:0+events00:24:291
41565439925283,2521cyclictest4169293-21kworker/0:0+events19:57:490
415654399252712,2511cyclictest62641-21kworker/0:0+events00:25:580
415654399252712,2511cyclictest32077-21kworker/0:2+events22:44:570
415654399252612,2511cyclictest4159855-21kworker/0:1+events19:22:390
415654399252311,2508cyclictest9286-21kworker/0:0+events21:36:160
415654399252212,2506cyclictest4155701-21kworker/0:0+events19:12:230
415654399251913,2504cyclictest49554-21kworker/0:0+events23:48:160
415654399251412,2498cyclictest4155701-21kworker/0:0+events19:18:540
415656199251310,2499cyclictest4154166-21kworker/3:1+events19:11:373
415655299251212,2497cyclictest57816-21kworker/2:0+events00:08:172
415656199250712,2492cyclictest4160473-21kworker/3:1+events19:38:483
415656199250612,2491cyclictest62672-21kworker/3:0+events00:19:103
415656199250512,2490cyclictest6189-21kworker/3:1+events21:41:563
415654899245912,2443cyclictest4156033-21kworker/1:2+events19:12:001
415655299245411,2440cyclictest4155856-21kworker/2:2+events19:14:182
415655299245411,2440cyclictest40072-21kworker/2:1+events23:21:092
415654399244212,2426cyclictest4161534-21kworker/0:2+events19:27:140
415654899232711,2312cyclictest65669-21kworker/1:1+events00:30:341
415654899219811,2184cyclictest28888-21kworker/1:2+events22:36:381
41558112193168,21sleep10-21swapper/119:07:031
41560162189161,23sleep20-21swapper/219:09:402
41558082170143,24sleep30-21swapper/319:07:023
41560352142108,29sleep00-21swapper/019:09:550
4156552996360,2cyclictest27090-21kworker/2:1+pm22:34:582
415655299214,11cyclictest4190587-21awk20:55:002
4156552992013,3cyclictest0-21swapper/222:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional