You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 08:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Dec 30, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
407702099582515,5806cyclictest4070177-21kworker/0:0+events19:11:520
407703099578727,5755cyclictest4069735-21kworker/3:2+events19:11:283
407702099269913,2682cyclictest4121952-21kworker/0:2+events21:30:120
407703099268513,2668cyclictest4126601-21kworker/3:1+events21:55:153
407702699267913,2661cyclictest4112459-21kworker/2:1+events21:00:212
407702099249911,2484cyclictest4098211-21kworker/0:2+events20:35:150
407702399244210,2429cyclictest4115508-21kworker/1:0+events21:20:111
40770239924147,2404cyclictest4071924-21kworker/1:2+events19:12:371
407702699240312,2387cyclictest4144342-21kworker/2:1+events22:45:172
407703099240012,2384cyclictest4166648-21kworker/3:0+events23:55:193
407703099234410,2330cyclictest4128289-21kworker/3:0+events21:50:173
407702099232712,2311cyclictest4180938-21kworker/0:1+events00:35:150
407702399231311,2299cyclictest4153826-21kworker/1:0+events23:08:581
407703099231210,2299cyclictest4150687-21kworker/3:0+events23:09:463
407702399230811,2294cyclictest4082124-21kworker/1:0+events19:34:001
407703099229812,2283cyclictest4129987-21kworker/3:2+events22:00:123
407702099226511,2250cyclictest4158637-21kworker/0:1+events00:05:140
407702699222911,2215cyclictest4160212-21kworker/2:1+events23:39:392
40770269922158,2206cyclictest4085174-21kworker/2:2+events19:35:082
407702699220111,2187cyclictest4098272-21kworker/2:0+events20:30:462
407703099219612,2180cyclictest4115387-21kworker/3:0+events21:10:163
407702399219211,2178cyclictest4134664-21kworker/1:0+events22:17:421
407702099217911,2165cyclictest4139647-21kworker/0:1+events22:24:360
407702099217211,2158cyclictest4171294-21kworker/0:2+events00:15:160
407702099216711,2153cyclictest4098211-21kworker/0:2+events20:25:000
407702699215711,2143cyclictest4174385-21kworker/2:0+events00:13:192
407703099214211,2128cyclictest4134346-21kworker/3:1+events22:18:063
407703099214110,2128cyclictest4168309-21kworker/3:1+events00:11:473
407703099214011,2126cyclictest4137825-21kworker/3:0+events22:32:403
407702699213610,2123cyclictest4118620-21kworker/2:1+events21:19:012
40770239921368,2125cyclictest4093115-21kworker/1:0+events20:01:231
40770309921359,2123cyclictest4090064-21kworker/3:1+events20:48:323
407703099213410,2121cyclictest4150687-21kworker/3:0+events23:00:553
407702099212610,2113cyclictest4131437-21kworker/0:0+events22:39:590
407702399212410,2111cyclictest4163124-21kworker/1:1+events23:36:351
407702399212010,2107cyclictest4131195-21kworker/1:0+events21:57:331
407702399211510,2102cyclictest4172715-21kworker/1:1+events00:14:511
40770309921137,2103cyclictest4144191-21kworker/3:1+events22:47:363
40770239921115,2103cyclictest4172715-21kworker/1:1+events00:17:071
407702399211110,2098cyclictest4105881-21kworker/1:0+events20:44:001
40770239921108,2099cyclictest4082124-21kworker/1:0+events19:26:531
407702399211010,2097cyclictest4153826-21kworker/1:0+events23:31:571
40770309921098,2097cyclictest4085141-21kworker/3:0+events19:54:523
40770239921097,2099cyclictest4123318-21kworker/1:1+events21:51:261
40770239921079,2095cyclictest4139406-21kworker/1:1+events22:44:551
40770239921077,2097cyclictest4176218-21kworker/1:2+events00:34:541
407702399210710,2094cyclictest4166527-21kworker/1:0+events23:59:321
40770239921069,2094cyclictest4110618-21kworker/1:1+events20:56:351
40770239921039,2091cyclictest4134664-21kworker/1:0+events22:10:331
40770239921008,2089cyclictest4148936-21kworker/1:2+events22:57:061
407702399209810,2085cyclictest4101731-21kworker/1:2+events20:34:511
407702399209710,2083cyclictest4123318-21kworker/1:1+events21:36:591
40770239920966,2087cyclictest4137367-21kworker/1:2+events22:29:341
40770309920949,2082cyclictest4122014-21kworker/3:1+events21:34:433
40770309920947,2084cyclictest4171177-21kworker/3:2+events00:04:283
40770309920899,2077cyclictest4117047-21kworker/3:1+events21:23:163
40770239920859,2073cyclictest4123318-21kworker/1:1+events22:09:461
40770239920769,2064cyclictest4113876-21kworker/1:2+events21:11:461
407702399207610,2063cyclictest4082124-21kworker/1:0+events19:24:341
407702099207610,2063cyclictest4173019-21kworker/0:0+events00:12:320
407703099207410,2061cyclictest4090064-21kworker/3:1+events20:02:333
407703099207110,2058cyclictest4113786-21kworker/3:1+events21:01:073
407702699206610,2053cyclictest4107744-21kworker/2:1+events20:48:112
40770309920647,2054cyclictest4168309-21kworker/3:1+events00:19:473
40770269920647,2054cyclictest4098272-21kworker/2:0+events20:40:532
40770269920599,2047cyclictest4098272-21kworker/2:0+events20:15:572
407702399205810,2045cyclictest4099873-21kworker/1:1+events20:20:481
40770239920579,2045cyclictest4172715-21kworker/1:1+events00:20:351
407703099205510,2042cyclictest4174354-21kworker/3:0+events00:22:273
407702399205510,2043cyclictest4169792-21kworker/1:2+events00:06:001
407702399205310,2040cyclictest4157067-21kworker/1:2+events23:20:521
407703099205210,2039cyclictest4150687-21kworker/3:0+events23:25:493
40770239920519,2039cyclictest4115508-21kworker/1:0+events21:28:191
40770239920508,2039cyclictest4071924-21kworker/1:2+events19:19:561
40770239920499,2037cyclictest4101731-21kworker/1:2+events20:29:351
407702399204910,2038cyclictest4153826-21kworker/1:0+events23:10:091
407702399204810,2035cyclictest4177886-21kworker/1:0+events00:26:361
407702399204810,2035cyclictest4086383-21kworker/1:2+events19:50:001
40770239920479,2035cyclictest4166527-21kworker/1:0+events00:01:501
40770239920469,2034cyclictest4105881-21kworker/1:0+events20:36:431
40770239920468,2035cyclictest4094776-21kworker/1:2+events20:05:351
407702399204610,2034cyclictest4146060-21kworker/1:0+events22:53:431
40770309920459,2032cyclictest4137825-21kworker/3:0+events22:25:463
40770239920459,2033cyclictest4163124-21kworker/1:1+events23:46:551
40770239920449,2032cyclictest4139406-21kworker/1:1+events22:33:241
40770239920449,2032cyclictest4113876-21kworker/1:2+events21:04:081
40770239920449,2032cyclictest4096399-21kworker/1:0+events20:10:551
40770239920449,2032cyclictest4086383-21kworker/1:2+events19:41:201
40770239920429,2030cyclictest4107715-21kworker/1:2+events20:50:471
40770239920429,2030cyclictest4107715-21kworker/1:2+events20:47:471
407703099204110,2027cyclictest4131809-21kworker/3:0+events22:09:243
40770239920413,2035cyclictest4082124-21kworker/1:0+events19:35:311
40770239920409,2028cyclictest4123318-21kworker/1:1+events21:32:281
40770239920409,2027cyclictest4123318-21kworker/1:1+events21:48:241
40770239920389,2025cyclictest4139406-21kworker/1:1+events22:39:111
40770239920388,2027cyclictest4139406-21kworker/1:1+events22:23:041
40770239920385,2030cyclictest4158776-21kworker/1:1+events23:29:421
407702399203810,2025cyclictest4155460-21kworker/1:1+events23:16:561
40770239920379,2024cyclictest4094776-21kworker/1:2+events20:18:571
407702399203710,2024cyclictest4089911-21kworker/1:1+events19:52:141
40770209920378,2026cyclictest4083666-21kworker/0:1+events19:34:230
40770239920369,2024cyclictest4176218-21kworker/1:2+events00:38:191
40770239920369,2024cyclictest4146060-21kworker/1:0+events22:45:391
407702699203510,2021cyclictest4120251-21kworker/2:0+events21:36:142
40770309920339,2021cyclictest4085141-21kworker/3:0+events19:35:553
40770309920338,2022cyclictest4137825-21kworker/3:0+events22:41:073
40770309920338,2022cyclictest4069735-21kworker/3:2+events19:22:593
40770239920333,2027cyclictest4153826-21kworker/1:0+events23:40:251
40770239920333,2027cyclictest4153826-21kworker/1:0+events23:40:241
40770209920338,2022cyclictest4143155-21kworker/0:1+events22:40:440
40770309920328,2021cyclictest4085141-21kworker/3:0+events19:40:563
40770269920326,2023cyclictest4098272-21kworker/2:0+events20:39:002
40770309920319,2019cyclictest4124914-21kworker/3:2+events21:42:413
407702699203110,2018cyclictest4106129-21kworker/2:2+events20:59:122
40770239920317,2022cyclictest4164892-21kworker/1:2+events23:50:021
40770269920308,2019cyclictest4179395-21kworker/2:2+events00:27:442
407702699203010,2017cyclictest4177730-21kworker/2:1+events00:24:182
407702699203010,2016cyclictest4120251-21kworker/2:0+events21:57:102
407703099202910,2016cyclictest4120406-21kworker/3:2+events21:28:403
407702699202910,2017cyclictest4150779-21kworker/2:0+events23:08:352
407702699202910,2016cyclictest4164771-21kworker/2:0+events23:44:392
407702699202910,2016cyclictest4164771-21kworker/2:0+events23:44:392
40770309920289,2015cyclictest4171177-21kworker/3:2+events00:07:103
40770269920288,2016cyclictest4131408-21kworker/2:1+events22:20:002
407702699202810,2015cyclictest4106129-21kworker/2:2+events20:51:342
407703099202710,2014cyclictest4149091-21kworker/3:1+events22:57:513
407702699202710,2013cyclictest4166402-21kworker/2:1+events23:49:162
407702699202610,2013cyclictest4120251-21kworker/2:0+events21:25:362
40770239920258,2015cyclictest4150566-21kworker/1:1+events23:00:101
407702699202410,2011cyclictest4156975-21kworker/2:2+events23:19:412
407702699202410,2011cyclictest4114084-21kworker/2:0+events21:05:402
40770269920238,2012cyclictest4144342-21kworker/2:1+events22:54:302
407702699202310,2010cyclictest4166402-21kworker/2:1+events23:51:082
40770269920229,2010cyclictest4144342-21kworker/2:1+events22:59:022
407702699202210,2009cyclictest4085174-21kworker/2:2+events19:54:302
40770209920227,2012cyclictest4098211-21kworker/0:2+events20:17:500
407702099202111,2008cyclictest4082002-21kworker/0:0+events19:25:440
40770239920209,2008cyclictest4086383-21kworker/1:2+events19:56:241
407702699201910,2006cyclictest4120251-21kworker/2:0+events21:33:372
40770269920184,2011cyclictest4141125-21kworker/2:0+events22:33:032
407702699201810,2005cyclictest4065594-21kworker/2:2+events19:24:112
407702099201710,2003cyclictest4131437-21kworker/0:0+events22:29:100
40770269920158,2004cyclictest4129802-21kworker/2:2+events21:54:052
40770269920084,2001cyclictest4120251-21kworker/2:0+events21:48:022
40770209920089,1995cyclictest4131437-21kworker/0:0+events22:31:530
40770269920072,2002cyclictest4144342-21kworker/2:1+events22:43:232
40770269920057,1995cyclictest4169764-21kworker/2:1+events00:01:052
40770309920038,1992cyclictest4134346-21kworker/3:1+events22:11:183
40770209919996,1990cyclictest4120286-21kworker/0:0+events21:38:290
40770209919995,1991cyclictest4134695-21kworker/0:1+events22:12:270
407702099199910,1986cyclictest4117391-21kworker/0:1+events21:15:350
40770209919988,1987cyclictest4131437-21kworker/0:0+events22:01:450
40770269919975,1989cyclictest4131408-21kworker/2:1+events22:02:332
40770209919978,1986cyclictest4158637-21kworker/0:1+events23:25:250
407702099199710,1985cyclictest4174913-21kworker/0:1+events00:20:110
40770209919969,1984cyclictest4131437-21kworker/0:0+events22:06:420
407702099199510,1982cyclictest4169613-21kworker/0:0+events00:00:190
40770239919948,1983cyclictest4117256-21kworker/1:1+events21:15:581
40770209919949,1982cyclictest4083666-21kworker/0:1+events19:53:210
40770309919938,1982cyclictest4150687-21kworker/3:0+events23:12:243
407702099199310,1980cyclictest4158637-21kworker/0:1+events23:36:590
407702099199110,1978cyclictest4169613-21kworker/0:0+events23:58:030
40770269919909,1979cyclictest4131408-21kworker/2:1+events22:05:102
40770269919909,1978cyclictest4091659-21kworker/2:1+events20:01:022
40770209919879,1975cyclictest4147362-21kworker/0:0+events22:56:440
40770209919866,1977cyclictest4120286-21kworker/0:0+events21:29:040
407702099198610,1974cyclictest4088377-21kworker/0:0+events19:45:490
40770209919859,1973cyclictest4120286-21kworker/0:0+events21:48:470
40770209919859,1973cyclictest4098211-21kworker/0:2+events20:29:120
40770269919849,1971cyclictest4168070-21kworker/2:0+events23:59:112
40770209919849,1972cyclictest4178803-21kworker/0:0+events00:28:070
40770209919839,1971cyclictest4131437-21kworker/0:0+events22:16:560
40770209919836,1974cyclictest4121952-21kworker/0:2+events21:40:470
40770209919836,1974cyclictest4094650-21kworker/0:1+events20:06:200
407702099198310,1970cyclictest4150595-21kworker/0:2+events23:00:320
40770309919829,1970cyclictest4137825-21kworker/3:0+events22:36:293
40770209919826,1973cyclictest4096311-21kworker/0:0+events20:11:180
40770209919819,1969cyclictest4113936-21kworker/0:2+events21:12:310
407702099198110,1968cyclictest4106146-21kworker/0:0+events20:59:580
407703099197711,1963cyclictest4085141-21kworker/3:0+events19:49:153
407702699197510,1962cyclictest4116929-21kworker/2:2+events21:21:192
40770209919746,1965cyclictest4112193-21kworker/0:1+events21:05:190
40770239919736,1964cyclictest4124945-21kworker/1:2+events21:41:081
40770309919718,1961cyclictest4099811-21kworker/3:2+events20:21:593
40770269919719,1959cyclictest4158605-21kworker/2:0+events23:33:072
40770269919713,1965cyclictest4098272-21kworker/2:0+events20:27:182
40770269919687,1958cyclictest4138138-21kworker/2:2+events22:22:422
40770209919689,1956cyclictest4090034-21kworker/0:2+events19:55:380
407702699196710,1953cyclictest4141125-21kworker/2:0+events22:37:162
40770269919669,1954cyclictest4155255-21kworker/2:1+events23:21:132
40770269919669,1954cyclictest4150779-21kworker/2:0+events23:11:192
40770309919647,1954cyclictest4124914-21kworker/3:2+events21:37:443
40770269919647,1954cyclictest4120251-21kworker/2:0+events21:41:322
40770309919633,1957cyclictest4124914-21kworker/3:2+events21:46:323
40770269919639,1951cyclictest4085174-21kworker/2:2+events19:59:302
407702699196210,1949cyclictest4098272-21kworker/2:0+events20:20:272
40770309919619,1949cyclictest4078336-21kworker/3:1+events19:17:143
40770269919619,1949cyclictest4096340-21kworker/2:2+events20:14:472
40770209919614,1954cyclictest4104405-21kworker/0:1+events20:34:300
40770309919607,1950cyclictest4106027-21kworker/3:2+events20:41:173
40770269919609,1947cyclictest4116929-21kworker/2:2+events21:13:162
407702699196010,1947cyclictest4138138-21kworker/2:2+events22:27:382
40770209919608,1949cyclictest4150595-21kworker/0:2+events23:07:270
40770309919599,1947cyclictest4150687-21kworker/3:0+events23:16:333
40770269919596,1950cyclictest4080319-21kworker/2:0+events19:42:282
40770209919578,1948cyclictest4164762-21kworker/0:0+events23:45:020
407702699195610,1943cyclictest4179395-21kworker/2:2+events00:39:472
407702099195510,1942cyclictest4129711-21kworker/0:2+events21:54:280
40770309919549,1941cyclictest4085141-21kworker/3:0+events19:56:483
40770269919548,1943cyclictest4150779-21kworker/2:0+events23:03:152
407702699195310,1940cyclictest4080319-21kworker/2:0+events19:32:282
40770309919528,1941cyclictest4163289-21kworker/3:1+events23:43:523
40770309919528,1941cyclictest4163289-21kworker/3:1+events23:43:523
407703099195210,1939cyclictest4149091-21kworker/3:1+events22:54:533
40770269919529,1940cyclictest4169764-21kworker/2:1+events00:06:472
40770269919528,1941cyclictest4080319-21kworker/2:0+events19:26:072
40770239919529,1940cyclictest4123318-21kworker/1:1+events22:04:261
40770309919517,1941cyclictest4179607-21kworker/3:1+events00:30:243
40770309919506,1941cyclictest4109312-21kworker/3:2+events21:07:593
40770309919497,1939cyclictest4109312-21kworker/3:2+events20:52:453
40770309919496,1939cyclictest4163289-21kworker/3:1+events23:47:423
407703099194910,1936cyclictest4098179-21kworker/3:0+events20:18:123
40770309919469,1934cyclictest4165014-21kworker/3:2+events23:52:173
40770309919445,1936cyclictest4137825-21kworker/3:0+events22:24:143
40770309919436,1933cyclictest4174354-21kworker/3:0+events00:29:393
407703099193910,1926cyclictest4182440-21kworker/3:2+events00:38:433
40770209919399,1927cyclictest4152315-21kworker/0:0+events23:22:000
407702699193810,1925cyclictest4156975-21kworker/2:2+events23:26:592
40770269919357,1926cyclictest4080319-21kworker/2:0+events19:45:062
40770309919349,1922cyclictest4069735-21kworker/3:2+events19:27:163
40770209919319,1919cyclictest4090034-21kworker/0:2+events20:02:090
40770209919319,1919cyclictest4083666-21kworker/0:1+events19:42:490
40770209919315,1923cyclictest4085325-21kworker/0:2+events19:36:410
40770209919299,1917cyclictest4171294-21kworker/0:2+events00:34:100
40770209919297,1919cyclictest4166345-21kworker/0:2+events23:50:450
40770209919289,1916cyclictest4145732-21kworker/0:2+events22:50:150
40770209919285,1921cyclictest4156943-21kworker/0:2+events23:18:310
40770209919259,1913cyclictest4154024-21kworker/0:1+events23:11:400
407702099192110,1908cyclictest4113936-21kworker/0:2+events21:03:460
40770209919199,1907cyclictest4145732-21kworker/0:2+events22:46:260
40770269919178,1906cyclictest4065594-21kworker/2:2+events19:13:002
40770209919179,1905cyclictest4071779-21kworker/0:2+events19:22:140
40770239919169,1904cyclictest4113876-21kworker/1:2+events21:07:351
407702099191610,1904cyclictest4106146-21kworker/0:0+events20:45:050
40770209919159,1903cyclictest4120286-21kworker/0:0+events21:24:020
40770209919079,1895cyclictest4128112-21kworker/0:1+events21:56:470
407703099190610,1893cyclictest4109312-21kworker/3:2+events20:56:133
40770209919069,1894cyclictest4158637-21kworker/0:1+events23:34:390
40770269919059,1893cyclictest4065594-21kworker/2:2+events19:19:322
40770209919032,1898cyclictest4158637-21kworker/0:1+events23:42:450
40770209919032,1898cyclictest4158637-21kworker/0:1+events23:42:440
40770309919004,1893cyclictest4099811-21kworker/3:2+events20:28:033
40770309918969,1884cyclictest4082478-21kworker/3:1+events19:32:043
407702099189510,1882cyclictest4109627-21kworker/0:2+events20:53:310
40770269918939,1881cyclictest4133152-21kworker/2:0+events22:14:422
40770309918919,1879cyclictest4090064-21kworker/3:1+events20:07:503
40770209918907,1880cyclictest4098211-21kworker/0:2+events20:42:270
40770309918839,1871cyclictest4090064-21kworker/3:1+events20:31:523
407703099188310,1870cyclictest4161698-21kworker/3:2+events23:33:553
407703099188210,1869cyclictest4150687-21kworker/3:0+events23:37:443
40770269918827,1872cyclictest4179395-21kworker/2:2+events00:32:422
407703099187810,1865cyclictest4106027-21kworker/3:2+events20:38:363
40770309918759,1863cyclictest4155548-21kworker/3:2+events23:22:233
407703099187510,1862cyclictest4090064-21kworker/3:1+events20:13:383
40770309918738,1862cyclictest4109312-21kworker/3:2+events21:16:203
40770269918697,1859cyclictest4091659-21kworker/2:1+events20:08:372
40770209918288,1817cyclictest4078245-21kworker/0:1+events19:17:370
40764062149102,28sleep30-21swapper/319:05:573
4076556214294,39sleep10-21swapper/119:07:511
40764722140108,27sleep20-21swapper/219:06:482
40764132140102,31sleep00-21swapper/019:06:010
407702699170,15cyclictest4175305-21cstates00:15:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional