You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 07:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sun Dec 07, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27393369931465,3136cyclictest2792758-21kworker/0:1+events22:00:200
273933899281013,2793cyclictest2839606-21kworker/1:0+events00:23:501
273933899278913,2770cyclictest2791184-21kworker/1:1+events22:45:131
273933899277713,2760cyclictest2759137-21kworker/1:2+events20:15:001
273934299273813,2721cyclictest2821802-21kworker/2:1+events23:30:172
273934299271913,2703cyclictest2817183-21kworker/2:1+events23:10:142
273933699267411,2658cyclictest2780015-21kworker/0:2+events21:20:160
27393429925517,2540cyclictest2837676-21kworker/2:1+events00:25:212
273933699254713,2531cyclictest2825178-21kworker/0:2+events23:35:140
273934299254511,2531cyclictest2740464-21kworker/2:0+events19:15:152
27393389925247,2513cyclictest2826514-21kworker/1:2+events23:40:171
273934299251612,2500cyclictest2765556-21kworker/2:1+events20:35:172
273933899250910,2494cyclictest2771964-21kworker/1:2+events20:50:151
273933699249712,2481cyclictest2832080-21kworker/0:2+events00:19:380
273933699248911,2474cyclictest2825178-21kworker/0:2+events23:45:180
273934299244210,2428cyclictest2837676-21kworker/2:1+events00:20:022
273934699243211,2419cyclictest2839458-21kworker/3:0+events00:30:133
273934299242812,2413cyclictest2823422-21kworker/2:0+events23:58:192
273934299241912,2403cyclictest2830055-21kworker/2:1+events23:52:082
273934299240712,2392cyclictest2785197-21kworker/2:0+events22:01:272
273933699240612,2391cyclictest2821949-21kworker/0:2+events23:23:530
273933699240611,2392cyclictest2825178-21kworker/0:2+events23:34:520
273933899240312,2387cyclictest2812044-21kworker/1:1+events23:00:231
273933699240112,2385cyclictest2807196-21kworker/0:0+events22:59:170
273933699239212,2377cyclictest2774854-21kworker/0:2+events21:03:500
273933899238011,2366cyclictest2791184-21kworker/1:1+events21:49:381
27393369923738,2362cyclictest2817031-21kworker/0:0+events23:10:370
273933699237212,2357cyclictest2792758-21kworker/0:1+events22:22:470
273934299234212,2326cyclictest2807286-21kworker/2:0+events22:40:172
273933899231311,2300cyclictest2815636-21kworker/1:0+events23:05:151
273934299231112,2296cyclictest2776895-21kworker/2:0+events21:05:012
27393369922807,2270cyclictest2845852-21kworker/0:0+events00:38:160
273933699226910,2257cyclictest2749730-21kworker/0:2+events19:45:220
273933899223810,2225cyclictest2797500-21kworker/1:2+events22:12:501
273933899223611,2222cyclictest2808581-21kworker/1:0+events22:41:251
273933699223010,2216cyclictest2783225-21kworker/0:1+events21:29:200
273934299222811,2214cyclictest2832808-21kworker/2:2+events00:09:512
273933899222811,2214cyclictest2823454-21kworker/1:0+events23:37:581
273934299222711,2213cyclictest2789641-21kworker/2:2+events21:43:552
273933699222711,2213cyclictest2826789-21kworker/0:0+events23:50:140
273933899222611,2212cyclictest2832989-21kworker/1:2+events00:00:351
273933699222611,2212cyclictest2755456-21kworker/0:0+events20:18:040
27393429922258,2214cyclictest2804035-21kworker/2:0+events22:29:182
273933699222511,2211cyclictest2783225-21kworker/0:1+events21:32:020
273934299222411,2210cyclictest2820169-21kworker/2:2+events23:21:142
273934299222410,2211cyclictest2755633-21kworker/2:0+events20:05:492
273934299222311,2209cyclictest2794423-21kworker/2:1+events22:06:032
273933899222311,2209cyclictest2821861-21kworker/1:1+events23:27:141
273933699222310,2209cyclictest2834500-21kworker/0:0+events00:04:270
273934299222211,2208cyclictest2823422-21kworker/2:0+events23:39:082
273933699222211,2207cyclictest2789942-21kworker/0:2+events21:49:150
273933899222110,2208cyclictest2791184-21kworker/1:1+events21:53:051
27393369922209,2208cyclictest2801001-21kworker/0:0+events22:29:380
273933699222010,2208cyclictest2746148-21kworker/0:2+events19:30:500
27393429922199,2207cyclictest2812072-21kworker/2:1+events22:52:272
273934299221911,2205cyclictest2765556-21kworker/2:1+events20:42:322
273934299221911,2204cyclictest2771722-21kworker/2:0+events20:47:092
273933899221910,2205cyclictest2788943-21kworker/1:0+events21:42:231
273933699221911,2204cyclictest2744549-21kworker/0:1+events19:44:120
273933699221910,2205cyclictest2762622-21kworker/0:1+events20:23:020
273933899221811,2203cyclictest2773854-21kworker/1:0+events21:14:121
273933899221711,2203cyclictest2773854-21kworker/1:0+events21:33:311
273933899221711,2202cyclictest2791184-21kworker/1:1+events22:19:391
27393369922178,2206cyclictest2826789-21kworker/0:0+events23:43:200
273933899221611,2201cyclictest2791184-21kworker/1:1+events22:05:391
273933899221610,2202cyclictest2794634-21kworker/1:0+events22:00:001
273933899221510,2202cyclictest2768610-21kworker/1:1+events20:39:281
273933899221311,2198cyclictest2834713-21kworker/1:1+events00:09:041
27393369922136,2204cyclictest2771994-21kworker/0:0+events20:55:310
273933699221310,2199cyclictest2735614-21kworker/0:0+events19:17:550
273933899221211,2197cyclictest2834713-21kworker/1:1+events00:12:051
273933699221210,2200cyclictest2799395-21kworker/0:2+events22:15:520
273933699221210,2198cyclictest2788285-21kworker/0:1+events21:44:170
273934299221110,2198cyclictest2783333-21kworker/2:1+events21:33:082
273933899221110,2198cyclictest2775787-21kworker/1:2+events21:04:131
27393369922118,2200cyclictest2832080-21kworker/0:2+events00:22:190
273933699221111,2197cyclictest2753824-21kworker/0:1+events19:55:550
27393369922109,2198cyclictest2836105-21kworker/0:1+events00:11:000
273934299220711,2192cyclictest2821802-21kworker/2:1+events23:25:232
273934299220611,2192cyclictest2837676-21kworker/2:1+events00:12:282
273934299220510,2191cyclictest2749335-21kworker/2:2+events19:44:582
27393369922059,2193cyclictest2753824-21kworker/0:1+events19:54:480
273934299220310,2190cyclictest2844251-21kworker/2:0+events00:39:242
273933699220311,2189cyclictest2821949-21kworker/0:2+events23:25:450
273934299220010,2186cyclictest2810150-21kworker/2:2+events22:46:462
273934299220010,2186cyclictest2781711-21kworker/2:0+events21:20:402
273933699219510,2182cyclictest2803900-21kworker/0:2+events22:41:490
273933899219310,2180cyclictest2773854-21kworker/1:0+events21:25:331
27393369921929,2180cyclictest2814297-21kworker/0:1+events23:02:580
273934299219011,2177cyclictest2802447-21kworker/2:2+events22:30:022
273933899218911,2175cyclictest2800754-21kworker/1:0+events22:33:261
273933899218710,2174cyclictest2818929-21kworker/1:2+events23:19:191
273933699218711,2172cyclictest2796013-21kworker/0:2+events22:05:160
27393429921869,2174cyclictest2753975-21kworker/2:2+events19:54:242
27393389921859,2172cyclictest2818929-21kworker/1:2+events23:22:441
273933899218110,2168cyclictest2759137-21kworker/1:2+events20:16:551
27393369921819,2169cyclictest2789942-21kworker/0:2+events21:50:480
273933899217811,2165cyclictest2839606-21kworker/1:0+events00:26:301
273933699217310,2160cyclictest2844192-21kworker/0:2+events00:34:280
27393429921698,2158cyclictest2744398-21kworker/2:1+events19:28:322
273933699215910,2146cyclictest2781623-21kworker/0:0+events21:37:230
273933899215511,2140cyclictest2834713-21kworker/1:1+events00:18:321
273933699214910,2136cyclictest2830259-21kworker/0:1+events23:55:130
273934699214811,2134cyclictest2785043-21kworker/3:0+events21:52:413
27393429921467,2135cyclictest2802447-21kworker/2:2+events22:24:172
273933899214410,2131cyclictest2768610-21kworker/1:1+events20:49:271
273934699214312,2128cyclictest2760805-21kworker/3:0+events20:26:303
273934699214312,2128cyclictest2760805-21kworker/3:0+events20:26:303
273934299213710,2124cyclictest2761195-21kworker/2:1+events20:20:202
27393369921355,2127cyclictest2771994-21kworker/0:0+events20:51:230
273934699213210,2119cyclictest2812282-21kworker/3:0+events22:56:363
273934699212911,2115cyclictest2755518-21kworker/3:1+events20:05:263
273933699212610,2113cyclictest2801001-21kworker/0:0+events22:31:320
273933699212610,2113cyclictest2765374-21kworker/0:2+events20:30:420
273934699212211,2108cyclictest2778473-21kworker/3:0+events21:14:563
273934699211911,2105cyclictest2785043-21kworker/3:0+events22:04:303
273934699211811,2104cyclictest2785043-21kworker/3:0+events21:31:153
273934699211710,2104cyclictest2796226-21kworker/3:1+events22:20:493
27393389921176,2108cyclictest2786819-21kworker/1:1+events21:36:131
273934699211511,2101cyclictest2816998-21kworker/3:1+events23:15:313
273934699211511,2101cyclictest2745938-21kworker/3:1+events19:27:463
273934299211511,2101cyclictest2812072-21kworker/2:1+events23:01:272
273934699211411,2100cyclictest2836161-21kworker/3:1+events00:10:363
27393429921138,2102cyclictest2765556-21kworker/2:1+events20:57:462
273933899211310,2100cyclictest2826514-21kworker/1:2+events23:48:191
27393369921138,2102cyclictest2807196-21kworker/0:0+events22:49:040
27393469921128,2101cyclictest2783152-21kworker/3:2+events21:27:033
273934699211211,2100cyclictest2796226-21kworker/3:1+events22:47:323
27393429921119,2098cyclictest2834469-21kworker/2:1+events00:02:102
273934699210810,2095cyclictest2810303-21kworker/3:2+events22:54:193
273934699210810,2095cyclictest2805536-21kworker/3:0+events22:43:423
27393429921075,2099cyclictest2799130-21kworker/2:0+events22:17:452
273933899210711,2093cyclictest2810182-21kworker/1:2+events22:50:331
273934699210410,2091cyclictest2845823-21kworker/3:1+events00:37:313
273934699210311,2089cyclictest2799366-21kworker/3:2+events22:19:173
273933699210311,2088cyclictest2762622-21kworker/0:1+events20:44:020
27393429921029,2090cyclictest2794423-21kworker/2:1+events21:57:422
273933699210210,2089cyclictest2749730-21kworker/0:2+events20:01:150
27393389920997,2089cyclictest2762411-21kworker/1:0+events20:24:111
273934699209610,2083cyclictest2742722-21kworker/3:2+events19:37:423
273934299208910,2076cyclictest2753975-21kworker/2:2+events19:57:522
273933699208810,2075cyclictest2839488-21kworker/0:1+events00:28:430
27393429920859,2073cyclictest2763885-21kworker/2:0+events20:25:462
27393429920859,2073cyclictest2763885-21kworker/2:0+events20:25:462
27393429920859,2072cyclictest2785197-21kworker/2:0+events21:48:282
27393429920817,2071cyclictest2813961-21kworker/2:0+events23:07:582
273934299207910,2065cyclictest2744398-21kworker/2:1+events19:34:422
273934299207810,2064cyclictest2771722-21kworker/2:0+events20:54:232
27393429920779,2065cyclictest2747729-21kworker/2:0+events19:35:272
27393369920778,2066cyclictest2781623-21kworker/0:0+events21:19:090
27393369920758,2064cyclictest2803900-21kworker/0:2+events22:38:220
273933699207410,2060cyclictest2770357-21kworker/0:2+events20:48:410
273933899207111,2058cyclictest2762411-21kworker/1:0+events20:40:141
27393429920709,2058cyclictest2783333-21kworker/2:1+events21:26:412
27393389920709,2058cyclictest2773854-21kworker/1:0+events21:18:021
27393389920703,2063cyclictest2752299-21kworker/1:0+events20:04:161
273933699207010,2057cyclictest2832080-21kworker/0:2+events00:05:130
273934299206910,2057cyclictest2826758-21kworker/2:1+events23:43:432
27393369920676,2058cyclictest2735614-21kworker/0:0+events19:26:390
27393429920669,2054cyclictest2740464-21kworker/2:0+events19:22:282
273934299206610,2053cyclictest2759405-21kworker/2:2+events20:15:232
273933899206610,2053cyclictest2839606-21kworker/1:0+events00:37:081
273933899206610,2053cyclictest2794634-21kworker/1:0+events22:03:441
273934699206510,2052cyclictest2780166-21kworker/3:1+events21:22:343
27393389920657,2055cyclictest2800754-21kworker/1:0+events22:28:311
273933899206510,2052cyclictest2773854-21kworker/1:0+events21:21:241
273933899206510,2052cyclictest2738821-21kworker/1:2+events19:19:051
27393429920648,2053cyclictest2752349-21kworker/2:0+events19:49:292
273934299206410,2051cyclictest2755633-21kworker/2:0+events20:10:262
27393389920649,2052cyclictest2738821-21kworker/1:2+events19:23:381
27393389920637,2053cyclictest2765946-21kworker/1:2+events20:31:301
27393389920636,2054cyclictest2764038-21kworker/1:1+events20:29:121
27393389920636,2054cyclictest2764038-21kworker/1:1+events20:29:121
273933699206310,2050cyclictest2792758-21kworker/0:1+events21:56:330
27393429920626,2053cyclictest2813961-21kworker/2:0+events23:18:122
27393389920624,2055cyclictest2828145-21kworker/1:1+events23:51:451
27393429920618,2050cyclictest2778501-21kworker/2:2+events21:09:572
273933899206110,2048cyclictest2744610-21kworker/1:1+events19:42:191
27393369920618,2050cyclictest2765374-21kworker/0:2+events20:36:030
27393369920616,2052cyclictest2776744-21kworker/0:1+events21:07:430
273933899206010,2047cyclictest2791184-21kworker/1:1+events22:23:551
27393429920596,2050cyclictest2783333-21kworker/2:1+events21:35:042
273933899205910,2046cyclictest2805715-21kworker/1:2+events22:38:451
273933899205810,2045cyclictest2768610-21kworker/1:1+events20:58:091
27393369920586,2048cyclictest2776744-21kworker/0:1+events21:13:020
273933699205810,2045cyclictest2817031-21kworker/0:0+events23:09:080
27393429920574,2050cyclictest2823422-21kworker/2:0+events23:48:422
273933899205710,2044cyclictest2753914-21kworker/1:2+events19:55:321
27393389920568,2045cyclictest2778290-21kworker/1:1+events21:08:041
27393389920545,2046cyclictest2832989-21kworker/1:2+events23:59:041
273934299205310,2040cyclictest2778501-21kworker/2:2+events21:19:312
27393389920529,2040cyclictest2752299-21kworker/1:0+events19:48:461
273933699205210,2039cyclictest2814297-21kworker/0:1+events23:17:020
273933699205210,2039cyclictest2792758-21kworker/0:1+events22:12:270
27393469920489,2036cyclictest2745938-21kworker/3:1+events19:31:123
27393469920479,2035cyclictest2823517-21kworker/3:2+events23:53:183
27393429920474,2040cyclictest2812072-21kworker/2:1+events22:57:222
27393369920479,2035cyclictest2744549-21kworker/0:1+events19:35:030
27393389920468,2035cyclictest2744610-21kworker/1:1+events19:52:071
27393389920467,2035cyclictest2744610-21kworker/1:1+events19:26:151
273933699204610,2033cyclictest2735614-21kworker/0:0+events19:24:230
27393429920448,2032cyclictest2744398-21kworker/2:1+events20:02:462
27393389920446,2035cyclictest2749060-21kworker/1:2+events19:38:291
27393429920438,2032cyclictest2785197-21kworker/2:0+events21:54:362
27393389920427,2032cyclictest2821861-21kworker/1:1+events23:31:491
27393369920425,2034cyclictest2757399-21kworker/0:1+events20:08:290
273934299204010,2027cyclictest2765556-21kworker/2:1+events20:31:062
27393369920388,2027cyclictest2762622-21kworker/0:1+events20:26:090
27393369920388,2027cyclictest2762622-21kworker/0:1+events20:26:080
27393389920378,2026cyclictest2759137-21kworker/1:2+events20:09:151
273934299203312,2017cyclictest2805687-21kworker/2:1+events22:39:302
273933899203310,2020cyclictest2839606-21kworker/1:0+events00:31:461
273934299202810,2015cyclictest2740464-21kworker/2:0+events19:13:412
273934299202710,2014cyclictest2837676-21kworker/2:1+events00:31:222
273934299202710,2014cyclictest2799130-21kworker/2:0+events22:12:032
27393389920169,2004cyclictest2812044-21kworker/1:1+events22:58:081
27393429920098,2000cyclictest2837676-21kworker/2:1+events00:15:112
273933699199710,1984cyclictest2755456-21kworker/0:0+events20:12:220
27393469919969,1984cyclictest2742722-21kworker/3:2+events19:22:063
27393429919959,1983cyclictest2778501-21kworker/2:2+events21:12:162
27393369919959,1983cyclictest2810425-21kworker/0:1+events22:50:110
27393469919938,1982cyclictest2765657-21kworker/3:1+events21:07:183
27393389919927,1982cyclictest2738821-21kworker/1:2+events19:13:181
27393469919819,1969cyclictest2836161-21kworker/3:1+events00:23:273
27393389919779,1964cyclictest2742666-21kworker/1:0+events19:33:571
27393389919749,1961cyclictest2815636-21kworker/1:0+events23:11:001
27393369919747,1964cyclictest2740523-21kworker/0:2+events19:12:540
273934699197111,1957cyclictest2836161-21kworker/3:1+events00:19:163
273934699197010,1956cyclictest2765657-21kworker/3:1+events21:03:043
273934699196910,1956cyclictest2780166-21kworker/3:1+events21:16:043
27393469919689,1956cyclictest2765657-21kworker/3:1+events20:33:243
27393469919609,1948cyclictest2765657-21kworker/3:1+events20:36:263
27393469919608,1949cyclictest2810303-21kworker/3:2+events23:14:213
273934699195310,1939cyclictest2792907-21kworker/3:1+events21:56:093
27393469919507,1940cyclictest2796226-21kworker/3:1+events22:32:193
273934699194910,1936cyclictest2796226-21kworker/3:1+events22:14:233
273934699194910,1936cyclictest2765657-21kworker/3:1+events20:45:593
27393469919489,1936cyclictest2823517-21kworker/3:2+events23:37:353
27393469919479,1935cyclictest2796226-21kworker/3:1+events22:06:473
273934699193610,1923cyclictest2799366-21kworker/3:2+events22:26:133
273934699192910,1916cyclictest2755518-21kworker/3:1+events20:13:283
273934699192710,1914cyclictest2750834-21kworker/3:1+events19:44:363
27393469919265,1918cyclictest2833137-21kworker/3:0+events00:07:303
27393469919249,1912cyclictest2816998-21kworker/3:1+events23:06:243
27393469919247,1914cyclictest2753796-21kworker/3:2+events19:54:023
273934699189510,1882cyclictest2727675-21kworker/3:0+events19:19:493
27393469918949,1882cyclictest2760805-21kworker/3:0+events20:24:353
27393469918949,1882cyclictest2747574-21kworker/3:0+events19:45:453
27393469918929,1880cyclictest2780166-21kworker/3:1+events21:38:533
27393469918919,1879cyclictest2755518-21kworker/3:1+events19:58:583
27393469918842,1879cyclictest2823517-21kworker/3:2+events23:59:483
27393469918839,1871cyclictest2727675-21kworker/3:0+events19:12:313
27393469918833,1877cyclictest2821770-21kworker/3:0+events23:28:003
27393469918818,1870cyclictest2816998-21kworker/3:1+events23:20:523
27393469918248,1815cyclictest2747574-21kworker/3:0+events20:00:063
27388362146101,26sleep00-21swapper/019:06:370
27387482141107,28sleep10-21swapper/119:05:301
27388182140108,27sleep30-21swapper/319:06:243
27388172140103,31sleep20-21swapper/219:06:232
273934699210,3cyclictest2770343-21sshd20:43:443
2739346991911,8cyclictest0-21swapper/320:50:133
273934699191,15cyclictest2789960-21idleruntime-cro21:45:003
273934699190,5cyclictest2842910-21chrt00:29:123
2739346991812,6cyclictest0-21swapper/323:30:203
273934699181,14cyclictest2762562-21tr20:20:003
273934699171,8cyclictest2830034-21awk23:49:593
273934699171,13cyclictest2791547-21munin-run21:50:003
273934699171,13cyclictest2775457-21munin-run21:00:003
273934699170,5cyclictest2814905-21missed_timers23:00:163
273934699170,15cyclictest2807359-21munin-run22:40:013
273934699161,7cyclictest2827678-21ntpq23:40:183
273934699161,12cyclictest2834179-21ps00:00:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional