You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 05:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Wed Nov 19, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262879699308812,3073cyclictest2676864-21kworker/2:0+events21:45:212
262880099306615,3046cyclictest2718245-21kworker/3:1+events00:15:003
262879699279113,2775cyclictest2657614-21kworker/2:1+events20:40:232
26287929927099,2695cyclictest2694158-21kworker/1:1+events22:55:131
262880099261313,2597cyclictest2695846-21kworker/3:1+events22:50:163
262880099252312,2508cyclictest2675117-21kworker/3:2+events21:36:573
262879699248612,2470cyclictest2684912-21kworker/2:1+events22:26:262
262879699248611,2472cyclictest2696072-21kworker/2:0+events22:46:062
262879699248212,2468cyclictest2710457-21kworker/2:2+events23:25:052
262880099245812,2443cyclictest2667183-21kworker/3:2+events21:18:473
262879699245612,2440cyclictest2655980-21kworker/2:2+events20:38:042
262879699245512,2439cyclictest2678484-21kworker/2:2+events21:54:472
262879699245211,2437cyclictest2691049-21kworker/2:2+events22:44:332
262879699244311,2430cyclictest2648210-21kworker/2:1+events20:20:042
262880099243412,2417cyclictest2692621-21kworker/3:1+events22:30:153
262879699243012,2415cyclictest2714518-21kworker/2:0+events23:39:202
262879699241512,2400cyclictest2721424-21kworker/2:0+events00:05:212
262879699240512,2389cyclictest2716577-21kworker/2:1+events00:10:222
26288009923829,2370cyclictest2688578-21kworker/3:0+events22:25:153
262879699237910,2366cyclictest2669042-21kworker/2:2+events21:16:542
262879299236212,2346cyclictest2630021-21kworker/1:0+events19:31:421
262879299236111,2348cyclictest2712063-21kworker/1:2+events23:33:351
262879299234012,2324cyclictest2708683-21kworker/1:1+events23:18:391
262880099233011,2315cyclictest2705588-21kworker/3:2+events23:28:133
262879099232812,2313cyclictest2723011-21kworker/0:2+events00:06:070
262879699232612,2311cyclictest2696072-21kworker/2:0+events23:03:292
262879699232611,2312cyclictest2635635-21kworker/2:2+events19:31:182
262879299231812,2302cyclictest2734272-21kworker/1:0+events00:37:581
262879299231712,2301cyclictest2630021-21kworker/1:0+events19:15:211
262879699229511,2281cyclictest2633749-21kworker/2:0+events19:25:172
262880099227611,2262cyclictest2670761-21kworker/3:0+events21:28:173
262880099227510,2261cyclictest2675117-21kworker/3:2+events21:49:533
262880099227411,2259cyclictest2628519-21kworker/3:1+events19:33:143
262880099227410,2261cyclictest2638499-21kworker/3:0+events19:45:333
262880099227310,2259cyclictest2681656-21kworker/3:1+events22:18:043
262880099227211,2258cyclictest2721455-21kworker/3:0+events00:02:003
262880099227211,2257cyclictest2695846-21kworker/3:1+events22:47:353
262880099227210,2259cyclictest2659300-21kworker/3:1+events20:54:043
262880099227110,2258cyclictest2660931-21kworker/3:0+events21:11:343
262879699227011,2256cyclictest2732944-21kworker/2:1+events00:37:372
26288009922699,2256cyclictest2710396-21kworker/3:1+events23:33:583
262880099226911,2255cyclictest2649513-21kworker/3:2+events20:11:453
262880099226710,2253cyclictest2688578-21kworker/3:0+events22:21:523
26288009922669,2254cyclictest2694247-21kworker/3:0+events22:38:073
262879099226611,2252cyclictest2652843-21kworker/0:0+events20:24:400
26288009922657,2254cyclictest2699427-21kworker/3:0+events22:57:063
262880099226510,2252cyclictest2628519-21kworker/3:1+events19:44:003
262879099226510,2252cyclictest2662472-21kworker/0:0+events21:19:580
26288009922649,2252cyclictest2675117-21kworker/3:2+events21:41:083
26287969922629,2249cyclictest2716577-21kworker/2:1+events23:58:102
262879699226210,2248cyclictest2665582-21kworker/2:1+events21:41:532
262879699226010,2246cyclictest2654345-21kworker/2:0+events20:30:262
26287969922586,2249cyclictest2643057-21kworker/2:2+events20:04:032
262879699225811,2244cyclictest2694421-21kworker/2:1+events22:36:102
26287969922578,2246cyclictest2710457-21kworker/2:2+events23:33:112
262880099225611,2242cyclictest2656008-21kworker/3:0+events20:43:273
262880099225511,2240cyclictest2675117-21kworker/3:2+events21:52:083
262880099225411,2240cyclictest2732671-21kworker/3:0+events00:33:033
262880099225311,2239cyclictest2656008-21kworker/3:0+events20:38:483
26287969922535,2245cyclictest2665582-21kworker/2:1+events21:31:422
262879699225310,2240cyclictest2684912-21kworker/2:1+events22:08:052
262880099224911,2236cyclictest2654377-21kworker/3:1+events20:32:403
262879099224412,2229cyclictest2689635-21kworker/0:1+events22:20:450
26287969922428,2230cyclictest2659628-21kworker/2:0+events21:03:382
262880099224111,2227cyclictest2660931-21kworker/3:0+events21:08:553
262879699223611,2221cyclictest2716577-21kworker/2:1+events23:45:562
26287969922347,2223cyclictest2716577-21kworker/2:1+events00:20:472
26287969922347,2223cyclictest2716577-21kworker/2:1+events00:20:472
26287969922307,2219cyclictest2643057-21kworker/2:2+events20:11:232
262879699222811,2214cyclictest2680088-21kworker/2:1+events21:58:372
262879699222811,2213cyclictest2663956-21kworker/2:2+events20:59:032
262880099222711,2213cyclictest2662771-21kworker/3:2+events20:59:503
262879699222711,2213cyclictest2641434-21kworker/2:0+events19:49:182
262879699222710,2214cyclictest2689422-21kworker/2:0+events22:18:262
26287969922269,2214cyclictest2655980-21kworker/2:2+events20:49:282
26287969922269,2214cyclictest2655980-21kworker/2:2+events20:49:282
26287969922268,2215cyclictest2692650-21kworker/2:0+events22:31:222
262879699222611,2212cyclictest2703798-21kworker/2:1+events23:13:002
262879699222611,2211cyclictest2632127-21kworker/2:1+events19:22:142
262879699222610,2213cyclictest2714518-21kworker/2:0+events23:44:012
262879699222510,2212cyclictest2659628-21kworker/2:0+events21:08:312
262879699222510,2211cyclictest2700432-21kworker/2:1+events22:55:592
262879699222411,2210cyclictest2726544-21kworker/2:2+events00:15:462
262879699222211,2208cyclictest2643057-21kworker/2:2+events19:58:192
262880099222110,2208cyclictest2731063-21kworker/3:2+events00:37:153
262879699222110,2207cyclictest2611025-21kworker/2:0+events19:18:242
262879699221311,2198cyclictest2691049-21kworker/2:2+events22:23:012
26287929922109,2198cyclictest2686423-21kworker/1:2+events22:16:311
262879299219411,2180cyclictest2646399-21kworker/1:2+events20:22:001
26288009921878,2176cyclictest2695846-21kworker/3:1+events22:44:113
26288009921858,2174cyclictest2683262-21kworker/3:2+events22:12:183
262879699217910,2166cyclictest2643057-21kworker/2:2+events20:07:322
262879099217411,2160cyclictest2633660-21kworker/0:1+events19:27:070
262879699217211,2158cyclictest2643057-21kworker/2:2+events19:53:022
262880099216810,2155cyclictest2675117-21kworker/3:2+events21:32:283
26288009921666,2158cyclictest2701970-21kworker/3:2+events23:00:063
262879099216410,2151cyclictest2665668-21kworker/0:2+events21:09:180
262879299216111,2147cyclictest2657844-21kworker/1:2+events20:41:301
262879699215710,2144cyclictest2654345-21kworker/2:0+events20:28:552
262879299215510,2142cyclictest2684823-21kworker/1:0+events22:11:101
262880099215310,2140cyclictest2728061-21kworker/3:0+events00:20:003
26287929921537,2144cyclictest2720045-21kworker/1:1+events00:00:051
262879299215311,2139cyclictest2646399-21kworker/1:2+events20:30:481
262879699215110,2138cyclictest2726544-21kworker/2:2+events00:32:402
262879299215111,2137cyclictest2632094-21kworker/1:1+events19:21:521
262879099215111,2137cyclictest2673513-21kworker/0:1+events21:57:060
26287969921464,2139cyclictest2665582-21kworker/2:1+events21:23:002
262879099214610,2132cyclictest2687905-21kworker/0:0+events22:33:540
262879299214411,2129cyclictest2676981-21kworker/1:0+events21:44:581
262879299214410,2131cyclictest2691318-21kworker/1:0+events22:31:421
262879299214410,2131cyclictest2670468-21kworker/1:1+events21:37:451
26287909921449,2132cyclictest2662472-21kworker/0:0+events21:10:510
262879299214311,2129cyclictest2720045-21kworker/1:1+events23:57:271
262879299214310,2130cyclictest2638170-21kworker/1:2+events19:37:031
262880099214210,2129cyclictest2646961-21kworker/3:1+events20:09:273
262879299214211,2128cyclictest2662304-21kworker/1:2+events21:07:231
26287929921420,2139cyclictest2712063-21kworker/1:2+events00:12:171
262880099214110,2128cyclictest2641235-21kworker/3:2+events19:51:093
262880099214110,2127cyclictest2715007-21kworker/3:2+events23:37:493
262879099214111,2127cyclictest2709193-21kworker/0:1+events23:28:360
262879099214111,2127cyclictest2680120-21kworker/0:2+events21:53:160
262879299214011,2126cyclictest2680284-21kworker/1:2+events21:55:331
262879299214011,2125cyclictest2639889-21kworker/1:1+events19:42:511
262879299214010,2127cyclictest2694158-21kworker/1:1+events22:47:571
262879299213811,2124cyclictest2708683-21kworker/1:1+events23:22:471
262879299213811,2124cyclictest2676981-21kworker/1:0+events21:51:461
262879099213811,2124cyclictest2709193-21kworker/0:1+events23:32:260
262879299213711,2123cyclictest2712063-21kworker/1:2+events00:25:001
262879299213711,2123cyclictest2712063-21kworker/1:2+events00:25:001
262879299213711,2123cyclictest2686423-21kworker/1:2+events22:29:301
262879299213711,2123cyclictest2664047-21kworker/1:0+events21:00:101
262879099213511,2122cyclictest2713674-21kworker/0:2+events23:35:080
262879099213210,2119cyclictest2635292-21kworker/0:0+events19:30:550
262879099213111,2117cyclictest2673513-21kworker/0:1+events22:06:330
262879299213011,2116cyclictest2646399-21kworker/1:2+events20:18:111
262879099213011,2116cyclictest2678516-21kworker/0:0+events21:47:140
262879099213011,2116cyclictest2641374-21kworker/0:2+events19:48:130
262879099213011,2115cyclictest2702059-21kworker/0:2+events23:09:320
26287909921289,2116cyclictest2669364-21kworker/0:2+events21:20:440
262879099212810,2114cyclictest2673513-21kworker/0:1+events21:38:280
262879099212712,2111cyclictest2646281-21kworker/0:0+events20:10:150
262879099212611,2112cyclictest2709193-21kworker/0:1+events23:21:390
262880099212310,2110cyclictest2635230-21kworker/3:2+events19:38:143
262879099212210,2108cyclictest2651233-21kworker/0:1+events20:18:550
26287969921207,2110cyclictest2684912-21kworker/2:1+events22:14:162
262880099211911,2105cyclictest2718245-21kworker/3:1+events23:48:143
262880099211611,2102cyclictest2679997-21kworker/3:0+events21:57:503
262880099211610,2103cyclictest2644805-21kworker/3:0+events20:01:003
262880099211510,2102cyclictest2705588-21kworker/3:2+events23:12:363
262880099211510,2102cyclictest2652769-21kworker/3:0+events20:22:473
26287929921159,2103cyclictest2668806-21kworker/1:0+events21:17:161
262879299211510,2102cyclictest2641613-21kworker/1:0+events20:11:001
262879699211310,2099cyclictest2729749-21kworker/2:0+events00:27:402
26288009921129,2100cyclictest2683262-21kworker/3:2+events22:02:233
26288009921129,2100cyclictest2657674-21kworker/3:2+events20:46:483
26288009921129,2100cyclictest2657674-21kworker/3:2+events20:46:483
26287969921129,2100cyclictest2635635-21kworker/2:2+events19:35:552
262880099211110,2098cyclictest2718245-21kworker/3:1+events23:53:163
262880099211010,2097cyclictest2718245-21kworker/3:1+events00:09:153
26287969921109,2098cyclictest2696072-21kworker/2:0+events23:20:322
262880099210910,2096cyclictest2628519-21kworker/3:1+events19:28:183
26287969921098,2098cyclictest2659628-21kworker/2:0+events20:51:222
26287969921089,2096cyclictest2659628-21kworker/2:0+events21:10:262
262879099210810,2095cyclictest2673513-21kworker/0:1+events22:04:200
262880099210710,2094cyclictest2715007-21kworker/3:2+events23:42:053
26287969921077,2097cyclictest2665582-21kworker/2:1+events21:38:062
262879699210710,2094cyclictest2669042-21kworker/2:2+events21:29:032
26287929921078,2096cyclictest2638170-21kworker/1:2+events19:48:571
262879099210711,2093cyclictest2716514-21kworker/0:1+events23:43:130
262879099210710,2094cyclictest2718306-21kworker/0:2+events23:52:540
262879299210610,2093cyclictest2708683-21kworker/1:1+events23:29:451
26287909921069,2094cyclictest2669364-21kworker/0:2+events21:25:370
262879299210511,2091cyclictest2724491-21kworker/1:1+events00:07:181
26287909921058,2094cyclictest2699156-21kworker/0:0+events22:56:420
26288009921048,2092cyclictest2718245-21kworker/3:1+events23:58:323
262879699210410,2092cyclictest2706970-21kworker/2:2+events23:17:522
26287969921037,2093cyclictest2696072-21kworker/2:0+events23:08:252
262879299210310,2090cyclictest2712063-21kworker/1:2+events23:41:181
262879099210311,2089cyclictest2723011-21kworker/0:2+events00:04:110
26287909921029,2090cyclictest2641374-21kworker/0:2+events19:59:490
262879699210110,2087cyclictest2696072-21kworker/2:0+events22:51:022
26287969921008,2089cyclictest2683292-21kworker/2:0+events22:00:112
262879099209810,2085cyclictest2662472-21kworker/0:0+events20:56:440
262879099209711,2082cyclictest2725039-21kworker/0:1+events00:13:050
262879299209511,2081cyclictest2672096-21kworker/1:2+events21:27:311
26288009920939,2081cyclictest2628519-21kworker/3:1+events19:19:553
26287969920938,2082cyclictest2714518-21kworker/2:0+events23:50:562
26288009920897,2079cyclictest2649513-21kworker/3:2+events20:16:163
262879299208911,2074cyclictest2702241-21kworker/1:0+events23:05:221
262879299208810,2075cyclictest2695906-21kworker/1:2+events22:43:021
262880099208710,2074cyclictest2642966-21kworker/3:1+events19:55:393
26288009920869,2074cyclictest2628519-21kworker/3:1+events19:15:003
26287969920859,2072cyclictest2716577-21kworker/2:1+events00:01:142
262880099208411,2070cyclictest2660931-21kworker/3:0+events21:02:313
262879299208211,2068cyclictest2641613-21kworker/1:0+events19:55:151
262879099207910,2066cyclictest2654614-21kworker/0:1+events20:54:280
262879699207110,2058cyclictest2635635-21kworker/2:2+events19:44:242
262879099206811,2054cyclictest2654614-21kworker/0:1+events20:35:440
262879099206510,2052cyclictest2639768-21kworker/0:1+events19:44:480
26287909920629,2051cyclictest2673513-21kworker/0:1+events21:43:480
262879099206110,2048cyclictest2635292-21kworker/0:0+events19:36:180
26287909920608,2049cyclictest2703736-21kworker/0:1+events23:11:500
262879299205610,2043cyclictest2729783-21kworker/1:0+events00:29:571
26288009920479,2035cyclictest2728061-21kworker/3:0+events00:22:433
26288009920479,2035cyclictest2728061-21kworker/3:0+events00:22:433
262880099204710,2034cyclictest2705588-21kworker/3:2+events23:23:353
26288009920437,2033cyclictest2652769-21kworker/3:0+events20:25:523
26287929920436,2034cyclictest2694158-21kworker/1:1+events22:35:261
26288009920429,2030cyclictest2699427-21kworker/3:0+events23:17:313
26288009920423,2036cyclictest2670761-21kworker/3:0+events21:23:233
262879099203510,2023cyclictest2648337-21kworker/0:2+events20:30:030
262879099203311,2019cyclictest2702059-21kworker/0:2+events23:18:150
26287969920329,2020cyclictest2649810-21kworker/2:0+events20:16:392
26287929920219,2009cyclictest2689666-21kworker/1:1+events22:21:081
26287929920065,1998cyclictest2712063-21kworker/1:2+events23:51:211
26287909920067,1996cyclictest2626859-21kworker/0:2+events19:23:230
26287969920038,1992cyclictest2611025-21kworker/2:0+events19:11:342
26287929919989,1985cyclictest2726393-21kworker/1:0+events00:15:231
26287929919987,1987cyclictest2660717-21kworker/1:1+events20:50:161
26287929919979,1985cyclictest2654498-21kworker/1:0+events20:29:181
26287909919969,1984cyclictest2652843-21kworker/0:0+events20:26:150
26287929919957,1985cyclictest2682987-21kworker/1:1+events22:06:121
26287929919933,1987cyclictest2670468-21kworker/1:1+events21:22:391
262879299199310,1980cyclictest2654498-21kworker/1:0+events20:49:061
262879299199310,1980cyclictest2654498-21kworker/1:0+events20:49:061
26287929919928,1981cyclictest2712063-21kworker/1:2+events00:31:081
262879299198710,1974cyclictest2712063-21kworker/1:2+events23:49:461
26287929919867,1976cyclictest2700583-21kworker/1:2+events23:01:571
26287929919859,1973cyclictest2700583-21kworker/1:2+events22:54:271
26287929919854,1978cyclictest2662304-21kworker/1:2+events21:11:131
26287909919858,1974cyclictest2695753-21kworker/0:1+events22:51:460
262879299198410,1971cyclictest2646399-21kworker/1:2+events20:06:241
26287929919833,1977cyclictest2662304-21kworker/1:2+events20:59:261
26287909919838,1972cyclictest2659329-21kworker/0:2+events20:45:440
26287909919838,1972cyclictest2659329-21kworker/0:2+events20:45:430
26287929919829,1970cyclictest2638170-21kworker/1:2+events19:53:241
26287929919829,1970cyclictest2633780-21kworker/1:2+events19:27:321
26287909919814,1974cyclictest2683415-21kworker/0:2+events22:12:410
26287929919808,1969cyclictest2706788-21kworker/1:2+events23:12:131
26287929919808,1969cyclictest2641613-21kworker/1:0+events20:00:351
262879299197610,1963cyclictest2682987-21kworker/1:1+events22:03:341
26288009919757,1965cyclictest2718245-21kworker/3:1+events00:26:073
26287929919748,1963cyclictest2656101-21kworker/1:1+events20:37:411
26287909919739,1961cyclictest2646281-21kworker/0:0+events20:03:420
26287909919738,1961cyclictest2729541-21kworker/0:1+events00:36:290
262879099197310,1960cyclictest2635292-21kworker/0:0+events19:50:460
262879099197310,1960cyclictest2626859-21kworker/0:2+events19:17:170
26287909919728,1961cyclictest2726864-21kworker/0:0+events00:21:560
26287909919728,1961cyclictest2726864-21kworker/0:0+events00:21:550
26287909919728,1961cyclictest2723011-21kworker/0:2+events00:18:490
262879099197210,1959cyclictest2731155-21kworker/0:2+events00:30:450
26287909919717,1961cyclictest2673513-21kworker/0:1+events21:33:160
262879099197110,1958cyclictest2716514-21kworker/0:1+events23:55:320
26287909919708,1959cyclictest2731155-21kworker/0:2+events00:28:040
26287909919708,1958cyclictest2687905-21kworker/0:0+events22:41:320
262879099197010,1957cyclictest2702059-21kworker/0:2+events23:02:430
26287909919648,1953cyclictest2695753-21kworker/0:1+events22:37:430
262879099196310,1950cyclictest2697466-21kworker/0:2+events22:47:130
26287909919619,1948cyclictest2687905-21kworker/0:0+events22:26:020
26287909919495,1941cyclictest2716514-21kworker/0:1+events23:48:360
26287909919434,1936cyclictest2687905-21kworker/0:0+events22:19:370
26288009919319,1919cyclictest2630201-21kworker/3:0+events19:24:063
26287929919306,1921cyclictest2628337-21kworker/1:2+events19:14:361
26287909919278,1916cyclictest2628490-21kworker/0:0+events19:13:510
26287929919268,1914cyclictest2678606-21kworker/1:1+events21:46:511
26287929919219,1909cyclictest2673752-21kworker/1:0+events21:30:121
26287929919169,1904cyclictest2712063-21kworker/1:2+events23:35:551
26287909919147,1904cyclictest2646281-21kworker/0:0+events20:05:370
26287909919089,1896cyclictest2654614-21kworker/0:1+events20:44:330
26287909919059,1893cyclictest2662472-21kworker/0:0+events21:04:440
26288009918709,1858cyclictest2703887-21kworker/3:1+events23:08:483
26283942142110,27sleep00-21swapper/019:07:540
26282362142100,38sleep20-21swapper/219:05:572
26284122140111,23sleep30-21swapper/319:08:103
26283452139110,24sleep10-21swapper/119:07:191
262880099160,14cyclictest2685202-21runrttasks22:05:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional