You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 19:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sun Dec 14, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59604699354418,3518cyclictest686985-21kworker/3:1+events00:10:173
59603899306815,3050cyclictest615389-21kworker/1:1+events20:10:161
59604699303715,3018cyclictest638419-21kworker/3:2+events21:30:143
59604699285812,2843cyclictest665815-21kworker/3:1+events23:10:143
59604299270013,2684cyclictest662534-21kworker/2:1+events22:35:012
59603599269013,2672cyclictest608755-21kworker/0:1+events20:15:130
59604699264910,2635cyclictest638419-21kworker/3:2+events21:25:163
5960359926019,2588cyclictest661138-21kworker/0:1+events22:40:190
59603899254210,2529cyclictest660955-21kworker/1:0+events22:42:351
59603899249312,2478cyclictest630608-21kworker/1:2+events20:58:281
59604299249012,2475cyclictest644500-21kworker/2:0+events21:46:542
59603899248812,2473cyclictest660955-21kworker/1:0+events22:28:521
59603899248712,2472cyclictest649292-21kworker/1:0+events21:55:581
59604699248611,2472cyclictest657470-21kworker/3:2+events22:17:483
59604699248012,2464cyclictest652765-21kworker/3:1+events22:10:143
59603899246211,2447cyclictest680452-21kworker/1:1+events23:30:511
5960359924309,2417cyclictest604169-21kworker/0:0+events19:35:180
59604299242812,2413cyclictest631982-21kworker/2:1+events21:15:172
59603599241511,2400cyclictest663212-21kworker/0:2+events23:05:130
59604299241112,2395cyclictest638175-21kworker/2:2+events21:20:172
59604699240112,2385cyclictest689969-21kworker/3:3+events00:05:183
59603599239711,2383cyclictest680180-21kworker/0:1+events23:30:280
59603599238612,2371cyclictest633399-21kworker/0:0+events21:13:030
59604699236112,2346cyclictest678551-21kworker/3:0+events23:29:413
59604699233111,2318cyclictest685117-21kworker/3:2+events23:50:173
59604699232112,2305cyclictest678551-21kworker/3:0+events23:48:243
59604699231711,2302cyclictest657470-21kworker/3:2+events22:22:233
59603899231111,2296cyclictest695946-21kworker/1:0+events00:26:371
59603899231111,2296cyclictest695946-21kworker/1:0+events00:26:371
59603899231110,2298cyclictest630608-21kworker/1:2+events21:16:491
59604299231011,2296cyclictest675652-21kworker/2:0+events23:32:452
59603899231011,2295cyclictest623179-21kworker/1:0+events20:35:371
5960389923099,2296cyclictest630608-21kworker/1:2+events21:01:111
5960389923069,2294cyclictest650977-21kworker/1:2+events22:01:191
59603899230610,2293cyclictest683308-21kworker/1:2+events23:41:351
59603899230511,2291cyclictest618646-21kworker/1:2+events20:20:261
5960389923049,2292cyclictest638453-21kworker/1:0+events21:32:551
59603899230410,2290cyclictest655579-21kworker/1:2+events22:14:471
59604699230311,2289cyclictest597147-21kworker/3:2+events19:30:463
59604299230312,2288cyclictest685027-21kworker/2:2+events23:51:502
59603899230310,2290cyclictest657440-21kworker/1:0+events22:20:281
5960389923029,2290cyclictest646355-21kworker/1:1+events21:47:391
59603899230211,2288cyclictest605530-21kworker/1:2+events19:52:011
59603899230211,2287cyclictest603900-21kworker/1:1+events19:36:491
5960389923009,2289cyclictest695946-21kworker/1:0+events00:33:071
59603899230011,2286cyclictest627071-21kworker/1:1+events20:44:491
59603899230011,2286cyclictest618646-21kworker/1:2+events20:29:371
59603899230010,2287cyclictest607433-21kworker/1:0+events19:49:211
59603899229910,2286cyclictest692743-21kworker/1:2+events00:06:051
59603899229910,2285cyclictest613526-21kworker/1:2+events20:08:021
5960389922979,2285cyclictest662564-21kworker/1:2+events22:35:451
59603899229611,2282cyclictest686656-21kworker/1:2+events23:54:061
59603899229610,2283cyclictest677047-21kworker/1:0+events23:27:431
59603899229610,2283cyclictest653938-21kworker/1:1+events22:15:311
59603899229610,2282cyclictest673751-21kworker/1:1+events23:12:541
59603899229511,2281cyclictest680452-21kworker/1:1+events23:55:381
5960359922829,2270cyclictest620062-21kworker/0:0+events20:44:270
59603899228010,2267cyclictest667177-21kworker/1:2+events22:55:111
59603599227210,2259cyclictest644589-21kworker/0:1+events21:51:260
59603899227010,2257cyclictest627071-21kworker/1:1+events20:46:441
59603599226811,2254cyclictest647868-21kworker/0:2+events22:04:010
5960359922679,2254cyclictest655609-21kworker/0:0+events22:13:150
59603599226611,2253cyclictest655609-21kworker/0:0+events22:20:070
59603599226610,2253cyclictest615478-21kworker/0:0+events20:11:240
59603599226511,2251cyclictest644589-21kworker/0:1+events21:41:350
59603599226511,2250cyclictest604169-21kworker/0:0+events19:57:440
5960429922641,2259cyclictest631982-21kworker/2:1+events21:06:332
59603599226311,2249cyclictest661138-21kworker/0:1+events22:35:230
59603599226111,2248cyclictest683428-21kworker/0:0+events23:40:020
59603599226111,2247cyclictest644589-21kworker/0:1+events21:46:310
5960359922609,2249cyclictest685203-21kworker/0:1+events23:46:280
59603599225610,2243cyclictest696219-21kworker/0:0+events00:30:460
5960429922487,2238cyclictest694610-21kworker/2:0+events00:19:002
59603599224811,2234cyclictest633399-21kworker/0:0+events21:06:560
59603599224412,2229cyclictest638360-21kworker/0:1+events21:27:140
59604699224211,2228cyclictest694405-21kworker/3:0+events00:31:343
59603599224111,2228cyclictest655609-21kworker/0:0+events22:15:100
5960469922409,2229cyclictest630236-21kworker/3:1+events20:55:023
59603599223811,2224cyclictest678583-21kworker/0:0+events23:24:420
59603599223810,2224cyclictest663212-21kworker/0:2+events22:53:140
5960359922379,2224cyclictest696219-21kworker/0:0+events00:28:100
5960359922379,2224cyclictest696219-21kworker/0:0+events00:28:100
59603599223711,2223cyclictest629034-21kworker/0:1+events20:55:270
59603599223710,2224cyclictest702331-21kworker/0:2+events00:37:400
5960359922359,2223cyclictest604169-21kworker/0:0+events19:47:280
59603899223410,2221cyclictest649292-21kworker/1:0+events22:09:271
59603599223410,2221cyclictest657562-21kworker/0:2+events22:28:070
59603599223210,2218cyclictest661138-21kworker/0:1+events22:31:560
59604699222811,2214cyclictest657470-21kworker/3:2+events22:46:453
5960429922269,2215cyclictest698624-21kworker/2:2+events00:30:012
59604699222311,2209cyclictest654545-21kworker/3:0+events22:28:293
59603599222011,2206cyclictest620062-21kworker/0:0+events20:31:110
5960389922199,2207cyclictest603900-21kworker/1:1+events19:33:491
59603599221510,2202cyclictest620062-21kworker/0:0+events20:22:440
59603599221010,2196cyclictest688138-21kworker/0:0+events23:53:430
59603899220810,2195cyclictest667177-21kworker/1:2+events23:00:581
59603899219811,2184cyclictest628959-21kworker/1:0+events20:50:331
59603899219410,2181cyclictest695946-21kworker/1:0+events00:22:461
59604699219110,2178cyclictest633581-21kworker/3:1+events21:03:293
59604699219110,2177cyclictest678551-21kworker/3:0+events23:35:473
59603599218411,2169cyclictest598173-21kworker/0:1+events19:16:170
5960359921827,2171cyclictest608755-21kworker/0:1+events20:06:080
5960359921786,2169cyclictest685203-21kworker/0:1+events00:04:080
59604299216610,2152cyclictest692983-21kworker/2:1+events00:14:252
59604699216411,2150cyclictest638419-21kworker/3:2+events21:35:333
59604699216210,2148cyclictest627657-21kworker/3:0+events20:49:223
59604299216111,2147cyclictest683396-21kworker/2:1+events23:43:282
59604699216011,2146cyclictest683460-21kworker/3:1+events23:43:513
59604699216011,2146cyclictest670883-21kworker/3:2+events23:02:533
59604699215911,2144cyclictest644439-21kworker/3:1+events21:52:363
59603599215911,2145cyclictest680180-21kworker/0:1+events23:35:230
5960469921578,2146cyclictest603960-21kworker/3:1+events20:06:323
59604699215611,2142cyclictest620181-21kworker/3:0+events20:33:013
59603899215611,2143cyclictest630608-21kworker/1:2+events21:07:201
59604699215311,2139cyclictest665815-21kworker/3:1+events22:52:073
59604699215210,2139cyclictest603960-21kworker/3:1+events20:11:463
59603599215211,2138cyclictest647868-21kworker/0:2+events21:55:120
5960429921507,2139cyclictest655697-21kworker/2:1+events22:19:432
59604299215012,2135cyclictest604021-21kworker/2:1+events19:36:032
59604699214910,2136cyclictest694405-21kworker/3:0+events00:17:313
5960469921489,2135cyclictest665815-21kworker/3:1+events23:21:143
59604699214811,2133cyclictest623385-21kworker/3:2+events20:35:153
5960469921479,2135cyclictest699361-21kworker/3:2+events00:38:033
59604299214711,2133cyclictest675652-21kworker/2:0+events23:29:172
59604299214711,2133cyclictest644500-21kworker/2:0+events21:43:502
59604699214611,2132cyclictest676926-21kworker/3:2+events23:18:593
5960389921469,2134cyclictest677047-21kworker/1:0+events23:23:551
5960429921449,2132cyclictest685027-21kworker/2:2+events23:49:552
59604299214411,2130cyclictest655697-21kworker/2:1+events22:22:452
59604299214410,2131cyclictest675652-21kworker/2:0+events23:38:052
5960389921448,2133cyclictest695946-21kworker/1:0+events00:18:391
59604299214311,2129cyclictest694610-21kworker/2:0+events00:25:262
59604299214311,2129cyclictest694610-21kworker/2:0+events00:25:262
59603599214311,2129cyclictest604169-21kworker/0:0+events19:52:240
59604299214211,2128cyclictest674020-21kworker/2:1+events23:13:152
59604699214111,2127cyclictest686985-21kworker/3:1+events00:00:393
5960469921406,2131cyclictest608874-21kworker/3:2+events19:53:303
59604299213911,2125cyclictest618677-21kworker/2:1+events20:20:492
59604299213910,2126cyclictest604021-21kworker/2:1+events19:33:262
5960469921379,2125cyclictest694405-21kworker/3:0+events00:25:503
5960469921379,2125cyclictest694405-21kworker/3:0+events00:25:503
59604699213710,2124cyclictest657470-21kworker/3:2+events22:30:483
59604299213711,2123cyclictest611957-21kworker/2:1+events20:03:052
5960389921344,2127cyclictest689948-21kworker/1:0+events00:01:031
59604699213211,2118cyclictest664193-21kworker/3:0+events22:39:093
5960359921295,2120cyclictest633399-21kworker/0:0+events21:35:110
59604299212311,2108cyclictest669407-21kworker/2:2+events22:57:322
59604299212210,2109cyclictest620390-21kworker/2:2+events20:37:572
59604299212110,2108cyclictest675652-21kworker/2:0+events23:15:552
59603899211710,2104cyclictest660955-21kworker/1:0+events22:34:371
59603899211710,2104cyclictest605530-21kworker/1:2+events19:40:381
59604699211310,2100cyclictest685117-21kworker/3:2+events23:59:533
5960389921138,2102cyclictest641475-21kworker/1:2+events21:44:351
59603899211310,2100cyclictest649292-21kworker/1:0+events21:52:591
59603899211310,2100cyclictest641475-21kworker/1:2+events21:29:081
59603899211310,2099cyclictest694346-21kworker/1:1+events00:12:091
5960429921129,2100cyclictest615448-21kworker/2:0+events20:16:452
5960389921129,2100cyclictest667177-21kworker/1:2+events22:49:001
5960389921129,2100cyclictest636789-21kworker/1:1+events21:14:301
5960389921119,2099cyclictest600877-21kworker/1:0+events19:26:141
5960389921109,2098cyclictest572394-21kworker/1:1+events19:21:141
59603899211010,2098cyclictest610294-21kworker/1:1+events19:55:011
5960389921098,2098cyclictest677047-21kworker/1:0+events23:18:351
5960389921096,2100cyclictest638453-21kworker/1:0+events21:36:431
5960389921086,2099cyclictest680452-21kworker/1:1+events23:36:571
5960389921079,2095cyclictest695946-21kworker/1:0+events00:38:261
59603899210710,2094cyclictest665553-21kworker/1:1+events22:50:341
59603899210610,2093cyclictest623179-21kworker/1:0+events20:34:301
5960389921056,2096cyclictest617015-21kworker/1:0+events20:19:201
59603899210410,2091cyclictest638453-21kworker/1:0+events21:20:401
5960359921016,2092cyclictest696219-21kworker/0:0+events00:22:020
59604699209711,2083cyclictest630236-21kworker/3:1+events20:52:243
59603899209610,2083cyclictest610294-21kworker/1:1+events20:01:561
5960429920949,2081cyclictest599368-21kworker/2:2+events19:29:152
59603599208811,2074cyclictest600813-21kworker/0:0+events19:25:510
5960359920852,2080cyclictest670758-21kworker/0:1+events22:59:290
5960389920819,2069cyclictest667177-21kworker/1:2+events23:06:001
5960359920818,2070cyclictest596140-21kworker/0:2+events19:22:000
59603599207910,2065cyclictest638360-21kworker/0:1+events21:23:440
59604299207810,2064cyclictest702300-21kworker/2:2+events00:38:492
5960359920785,2070cyclictest613615-21kworker/0:2+events20:04:370
5960429920769,2063cyclictest630265-21kworker/2:2+events20:54:152
5960359920747,2064cyclictest685203-21kworker/0:1+events00:11:230
59603599207410,2061cyclictest672744-21kworker/0:0+events23:15:340
5960359920733,2067cyclictest672744-21kworker/0:0+events23:14:020
5960359920732,2068cyclictest636729-21kworker/0:2+events21:17:590
59603599207310,2060cyclictest602504-21kworker/0:1+events19:30:230
5960359920729,2060cyclictest620062-21kworker/0:0+events20:47:310
5960359920723,2066cyclictest623356-21kworker/0:2+events20:38:200
59603599207210,2059cyclictest678583-21kworker/0:0+events23:26:340
5960389920719,2059cyclictest572394-21kworker/1:1+events19:17:031
5960359920712,2066cyclictest685203-21kworker/0:1+events00:19:450
59603599207110,2058cyclictest604169-21kworker/0:0+events19:44:040
59604699207010,2057cyclictest646089-21kworker/3:0+events22:00:343
5960359920707,2060cyclictest620062-21kworker/0:0+events20:27:190
5960359920696,2060cyclictest685203-21kworker/0:1+events00:07:370
59603599206810,2055cyclictest670758-21kworker/0:1+events23:03:160
59603599206710,2054cyclictest647868-21kworker/0:2+events22:06:200
5960359920669,2054cyclictest665671-21kworker/0:0+events22:47:090
5960389920653,2059cyclictest680452-21kworker/1:1+events23:46:061
59603599206410,2051cyclictest685203-21kworker/0:1+events23:56:010
59604699206111,2047cyclictest672541-21kworker/3:0+events23:08:423
59603599206010,2047cyclictest631373-21kworker/0:2+events21:00:470
5960469920559,2043cyclictest607275-21kworker/3:0+events19:48:153
5960469920428,2030cyclictest597147-21kworker/3:2+events19:19:433
59603899204110,2028cyclictest597189-21kworker/1:0+events19:12:281
59604699204011,2026cyclictest633581-21kworker/3:1+events21:11:083
5960469920399,2027cyclictest603960-21kworker/3:1+events20:15:363
5960469920384,2030cyclictest600781-21kworker/3:0+events19:23:553
5960359920277,2017cyclictest629034-21kworker/0:1+events20:53:070
59604299202210,2009cyclictest611957-21kworker/2:1+events20:08:462
5960429920219,2009cyclictest694610-21kworker/2:0+events00:21:402
5960429920099,1997cyclictest641690-21kworker/2:2+events21:34:042
59604699200411,1990cyclictest646089-21kworker/3:0+events21:43:283
59604699200110,1988cyclictest633581-21kworker/3:1+events21:06:103
59603599200110,1988cyclictest642961-21kworker/0:2+events21:33:410
5960359919978,1986cyclictest588349-21kworker/0:0+events19:14:000
5960469919819,1968cyclictest680243-21kworker/3:1+events23:31:153
5960469919759,1962cyclictest652765-21kworker/3:1+events22:08:173
5960469919713,1965cyclictest603960-21kworker/3:1+events20:26:093
5960429919703,1964cyclictest604021-21kworker/2:1+events19:40:152
5960469919655,1957cyclictest603960-21kworker/3:1+events19:55:243
59604699196510,1952cyclictest600781-21kworker/3:0+events19:36:263
59604699196310,1950cyclictest667427-21kworker/3:0+events22:57:093
5960429919637,1952cyclictest664367-21kworker/2:0+events22:54:012
59604699196210,1950cyclictest620181-21kworker/3:0+events20:24:393
59604699196210,1949cyclictest657470-21kworker/3:2+events22:41:533
5960429919629,1950cyclictest641690-21kworker/2:2+events21:36:192
5960469919618,1950cyclictest694405-21kworker/3:0+events00:24:393
5960469919618,1950cyclictest636817-21kworker/3:0+events21:17:123
5960469919617,1950cyclictest603960-21kworker/3:1+events20:00:233
5960469919609,1948cyclictest600781-21kworker/3:0+events19:29:593
5960429919609,1948cyclictest650887-21kworker/2:0+events22:05:112
59604299196010,1947cyclictest647896-21kworker/2:1+events21:57:072
5960429919597,1949cyclictest652515-21kworker/2:2+events22:04:252
5960429919597,1949cyclictest626981-21kworker/2:0+events21:01:582
5960469919586,1949cyclictest625249-21kworker/3:1+events20:40:403
59604299195210,1939cyclictest689591-21kworker/2:1+events23:59:302
5960429919519,1939cyclictest669407-21kworker/2:2+events23:03:392
5960429919518,1940cyclictest692983-21kworker/2:1+events00:09:542
59604299195110,1938cyclictest669407-21kworker/2:2+events23:09:272
59604699195010,1937cyclictest638419-21kworker/3:2+events21:21:243
5960429919508,1939cyclictest586758-21kworker/2:1+events19:16:402
59604299195010,1936cyclictest610356-21kworker/2:0+events19:53:542
5960429919499,1938cyclictest615448-21kworker/2:0+events20:30:012
5960429919499,1936cyclictest655697-21kworker/2:1+events22:14:022
5960429919497,1939cyclictest659613-21kworker/2:2+events22:26:362
5960429919494,1942cyclictest675652-21kworker/2:0+events23:20:512
5960429919494,1942cyclictest635679-21kworker/2:0+events21:12:402
5960429919477,1937cyclictest615448-21kworker/2:0+events20:14:032
59604299194710,1933cyclictest626981-21kworker/2:0+events20:46:222
5960429919463,1940cyclictest641690-21kworker/2:2+events21:53:222
59604299194610,1933cyclictest686717-21kworker/2:0+events00:02:362
5960429919457,1935cyclictest664367-21kworker/2:0+events22:49:472
5960429919436,1934cyclictest631982-21kworker/2:1+events21:00:002
5960429919408,1929cyclictest623308-21kworker/2:1+events20:42:552
5960469919329,1920cyclictest651008-21kworker/3:2+events21:59:473
5960429919246,1915cyclictest635679-21kworker/2:0+events21:28:222
5960469918989,1886cyclictest597147-21kworker/3:2+events19:14:233
5960469918939,1881cyclictest603960-21kworker/3:1+events19:43:413
5960469918929,1880cyclictest644439-21kworker/3:1+events21:49:333
5960429918838,1872cyclictest604021-21kworker/2:1+events19:46:192
5960429918757,1865cyclictest659613-21kworker/2:2+events22:36:072
5960429918658,1854cyclictest608665-21kworker/2:2+events19:58:072
5960429918137,1803cyclictest591796-21kworker/2:0+events19:13:362
5952402151100,16sleep00-21swapper/019:05:150
5957152143112,26sleep30-21swapper/319:08:413
595024214193,44sleep20-21swapper/219:05:132
5958132140108,28sleep10-21swapper/119:09:561
596042992724,2cyclictest615448-21kworker/2:0+pm20:29:512
59604299170,15cyclictest599989-21hddtemp_smartct19:20:122
596042991413,1cyclictest664367-21kworker/2:0+events_freezable22:44:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional