You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 23:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Mon Nov 17, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
168035199295414,2935cyclictest1735141-21kworker/2:1+events22:20:182
168035199294714,2930cyclictest1770069-21kworker/2:2+events00:05:192
16803519929378,2926cyclictest1770069-21kworker/2:2+events00:00:202
168035199273413,2717cyclictest1700906-21kworker/2:1+events21:20:252
168035499272116,2699cyclictest1706082-21kworker/3:0+events21:00:153
168034999268813,2673cyclictest1710918-21kworker/1:2+events20:55:171
168034499261513,2599cyclictest1776578-21kworker/0:1+events00:10:160
16803549925598,2546cyclictest1779720-21kworker/3:2+events00:30:173
168034499249312,2478cyclictest1758667-21kworker/0:2+events23:31:110
168034499249312,2478cyclictest1758667-21kworker/0:2+events23:19:510
168034499248912,2474cyclictest1771870-21kworker/0:2+events00:03:230
168034499248912,2474cyclictest1725474-21kworker/0:1+events21:40:530
168035499248612,2471cyclictest1697937-21kworker/3:1+events20:05:013
168034499248612,2471cyclictest1761897-21kworker/0:0+events23:22:510
168034499248612,2471cyclictest1715867-21kworker/0:0+events21:04:430
168034499248512,2469cyclictest1770277-21kworker/0:0+events23:57:160
168035499247112,2455cyclictest1720686-21kworker/3:2+events21:15:243
168035199245112,2436cyclictest1763528-21kworker/2:0+events23:40:172
168034499244610,2432cyclictest1780503-21kworker/0:0+events00:35:540
168035199244312,2427cyclictest1750874-21kworker/2:0+events23:15:142
168034499243212,2417cyclictest1706172-21kworker/0:2+events20:47:420
168034499241911,2404cyclictest1770277-21kworker/0:0+events23:50:310
168035199240411,2389cyclictest1765130-21kworker/2:2+events23:35:182
168035199240211,2388cyclictest1707692-21kworker/2:2+events20:36:592
168035199240111,2387cyclictest1727583-21kworker/2:1+events21:42:242
168035199240012,2385cyclictest1717576-21kworker/2:2+events21:09:202
168035199238910,2376cyclictest1687236-21kworker/2:2+events19:30:582
168035199238611,2372cyclictest1749268-21kworker/2:2+events22:47:482
168034999237811,2364cyclictest1760209-21kworker/1:0+events23:16:461
168035199235711,2342cyclictest1754011-21kworker/2:1+events22:58:482
168035499235611,2342cyclictest1760301-21kworker/3:2+events23:19:293
168035499235112,2336cyclictest1736790-21kworker/3:2+events22:06:383
168035499235012,2335cyclictest1752620-21kworker/3:0+events23:00:223
168035499234712,2332cyclictest1725141-21kworker/3:2+events21:41:173
168035499234612,2331cyclictest1758638-21kworker/3:1+events23:14:513
168035499234612,2331cyclictest1733423-21kworker/3:2+events21:53:003
168034999234511,2331cyclictest1783106-21kworker/1:0+events00:29:091
168034999234112,2325cyclictest1699601-21kworker/1:2+events20:10:191
168034999234010,2327cyclictest1768436-21kworker/1:0+events23:42:551
168034999233811,2324cyclictest1701201-21kworker/1:0+events20:52:141
168034999233811,2324cyclictest1701201-21kworker/1:0+events20:37:211
168034499233512,2319cyclictest1700993-21kworker/0:0+events20:14:310
168034999233112,2316cyclictest1770034-21kworker/1:1+events23:57:401
168035499233011,2316cyclictest1699572-21kworker/3:2+events20:10:443
168035499232912,2315cyclictest1761924-21kworker/3:1+events23:25:073
168034999232812,2314cyclictest1778144-21kworker/1:1+events00:31:481
168034999232812,2313cyclictest1770034-21kworker/1:1+events00:01:271
168034999232812,2313cyclictest1736733-21kworker/1:2+events22:20:411
168034999232112,2306cyclictest1688299-21kworker/1:1+events19:35:591
168034999231611,2302cyclictest1731734-21kworker/1:1+events21:46:341
16803449923128,2301cyclictest1768673-21kworker/0:2+events23:45:580
16803449923119,2298cyclictest1784763-21kworker/0:1+events00:34:480
168034999230910,2296cyclictest1701201-21kworker/1:0+events20:22:521
168035499229611,2282cyclictest1681826-21kworker/3:0+events19:40:143
168034999228711,2273cyclictest1720509-21kworker/1:0+events21:14:151
168035499228111,2267cyclictest1731821-21kworker/3:0+events22:27:343
168035499227612,2261cyclictest1706082-21kworker/3:0+events20:36:373
168035499227512,2260cyclictest1768806-21kworker/3:1+events23:55:473
168034499227411,2260cyclictest1683602-21kworker/0:2+events19:18:580
168035499227312,2258cyclictest1687036-21kworker/3:1+events19:32:533
168035199227214,2255cyclictest1691506-21kworker/2:2+events19:43:152
168034499227111,2256cyclictest1780503-21kworker/0:0+events00:28:020
168034499227110,2258cyclictest1742888-21kworker/0:0+events22:45:300
168034499227011,2256cyclictest1706172-21kworker/0:2+events20:53:000
168034499226910,2255cyclictest1742888-21kworker/0:0+events22:39:000
168034499226711,2253cyclictest1742888-21kworker/0:0+events22:28:430
168034499226611,2252cyclictest1686933-21kworker/0:2+events19:40:580
168035499226511,2250cyclictest1774912-21kworker/3:1+events00:16:193
16803449922657,2254cyclictest1702888-21kworker/0:1+events20:26:170
168034499226511,2251cyclictest1721961-21kworker/0:2+events21:32:140
168034499226510,2252cyclictest1730357-21kworker/0:2+events22:00:570
168035499226412,2249cyclictest1774912-21kworker/3:1+events00:06:513
168034499226411,2250cyclictest1750908-21kworker/0:1+events23:09:100
168034499226411,2249cyclictest1780503-21kworker/0:0+events00:21:160
168034499226411,2249cyclictest1725474-21kworker/0:1+events21:51:070
168034499226411,2249cyclictest1681536-21kworker/0:1+events19:20:310
168034499226311,2249cyclictest1715867-21kworker/0:0+events21:13:060
168034499226310,2250cyclictest1738183-21kworker/0:0+events22:11:310
168034499226310,2250cyclictest1725474-21kworker/0:1+events21:38:170
16803449922619,2248cyclictest1752560-21kworker/0:0+events22:55:450
16803449922618,2249cyclictest1765187-21kworker/0:0+events23:41:000
168034499226110,2248cyclictest1691535-21kworker/0:1+events19:55:240
168034499226110,2247cyclictest1730357-21kworker/0:2+events22:07:250
168034499226011,2246cyclictest1689910-21kworker/0:0+events19:39:280
168034499226011,2245cyclictest1749240-21kworker/0:2+events22:44:450
168034499226011,2245cyclictest1689910-21kworker/0:0+events19:45:570
168034499226010,2246cyclictest1763495-21kworker/0:1+events23:28:100
168034499225910,2246cyclictest1702888-21kworker/0:1+events20:23:400
16803449922588,2247cyclictest1710708-21kworker/0:0+events20:42:190
168034499225811,2244cyclictest1733694-21kworker/0:0+events21:56:240
168034999225610,2243cyclictest1720509-21kworker/1:0+events21:17:201
168034499225611,2242cyclictest1750908-21kworker/0:1+events23:13:430
168034499225510,2241cyclictest1725474-21kworker/0:1+events21:47:200
168034499224911,2235cyclictest1763495-21kworker/0:1+events23:39:300
168034499224511,2231cyclictest1744617-21kworker/0:2+events22:33:140
168034999224410,2230cyclictest1714653-21kworker/1:1+events21:00:371
168034499224010,2226cyclictest1721961-21kworker/0:2+events21:24:370
168034499223510,2222cyclictest1704543-21kworker/0:0+events20:33:550
168035199223311,2219cyclictest1694771-21kworker/2:2+events20:17:092
168035199223011,2216cyclictest1763528-21kworker/2:0+events23:33:042
168034999222610,2213cyclictest1683817-21kworker/1:2+events19:47:491
16803449922268,2215cyclictest1730357-21kworker/0:2+events22:18:230
168035199222311,2209cyclictest1741292-21kworker/2:0+events22:17:362
168035199222210,2209cyclictest1731914-21kworker/2:2+events21:59:012
168035199222110,2208cyclictest1770069-21kworker/2:2+events23:58:032
168035199222011,2206cyclictest1700906-21kworker/2:1+events20:59:042
168034999222010,2207cyclictest1744462-21kworker/1:1+events22:29:041
168035199221912,2205cyclictest1750874-21kworker/2:0+events23:01:322
16803519922188,2206cyclictest1777968-21kworker/2:1+events00:27:382
168035199221810,2205cyclictest1714059-21kworker/2:2+events20:54:562
168035199221810,2205cyclictest1696370-21kworker/2:0+events20:08:282
168035199221511,2201cyclictest1781370-21kworker/2:2+events00:30:382
16803519922147,2203cyclictest1700906-21kworker/2:1+events20:49:132
168035199221410,2201cyclictest1770069-21kworker/2:2+events00:11:482
168035199221310,2200cyclictest1696370-21kworker/2:0+events20:00:002
16803519922109,2197cyclictest1683679-21kworker/2:0+events19:23:372
168035199221011,2196cyclictest1693170-21kworker/2:0+events19:50:272
168035199221010,2197cyclictest1759003-21kworker/2:1+events23:24:222
168034999220910,2196cyclictest1778144-21kworker/1:1+events00:35:331
168035199220811,2194cyclictest1731914-21kworker/2:2+events21:48:522
16803519922079,2195cyclictest1735141-21kworker/2:1+events22:08:322
16803519922059,2194cyclictest1706051-21kworker/2:0+events20:30:032
168035199220510,2192cyclictest1735141-21kworker/2:1+events22:10:472
168035199220410,2191cyclictest1727583-21kworker/2:1+events21:37:312
168035199220310,2190cyclictest1771726-21kworker/2:1+events23:54:402
168035199220111,2188cyclictest1691506-21kworker/2:2+events19:45:092
168035199220111,2187cyclictest1757250-21kworker/2:2+events23:09:312
168035199220011,2186cyclictest1731914-21kworker/2:2+events21:53:232
168035499219812,2183cyclictest1736790-21kworker/3:2+events22:18:013
16803519921986,2188cyclictest1676719-21kworker/2:1+events19:16:392
168035499219512,2179cyclictest1779720-21kworker/3:2+events00:36:173
16803449921958,2184cyclictest1750908-21kworker/0:1+events22:54:120
168035499219112,2176cyclictest1774912-21kworker/3:1+events00:20:533
168035199219110,2178cyclictest1763528-21kworker/2:0+events23:47:082
168034999218811,2173cyclictest1735018-21kworker/1:0+events21:58:391
168034999218810,2175cyclictest1739720-21kworker/1:0+events22:30:131
168035199218611,2172cyclictest1744704-21kworker/2:1+events22:34:022
168035499218511,2170cyclictest1717424-21kworker/3:1+events21:13:523
168034999218411,2169cyclictest1710918-21kworker/1:2+events20:46:101
16803519921819,2169cyclictest1743010-21kworker/2:2+events22:25:372
168035199218010,2167cyclictest1700906-21kworker/2:1+events20:11:512
168034999217811,2163cyclictest1752590-21kworker/1:1+events23:05:221
16803499921717,2160cyclictest1698000-21kworker/1:1+events20:05:231
168035499216711,2153cyclictest1773202-21kworker/3:0+events00:04:563
168034999216711,2153cyclictest1754199-21kworker/1:2+events23:00:461
168035499216411,2149cyclictest1699572-21kworker/3:2+events20:21:443
168034999216311,2149cyclictest1729824-21kworker/1:0+events21:50:431
16803549921628,2150cyclictest1725141-21kworker/3:2+events21:31:103
168035499216110,2147cyclictest1699572-21kworker/3:2+events20:15:183
168035499216011,2146cyclictest1714144-21kworker/3:2+events21:08:113
168035499216010,2147cyclictest1761924-21kworker/3:1+events23:36:483
16803549921598,2148cyclictest1689846-21kworker/3:2+events19:39:053
168035499215911,2145cyclictest1725141-21kworker/3:2+events21:26:103
16803499921589,2146cyclictest1739720-21kworker/1:0+events22:38:371
16803549921579,2145cyclictest1746126-21kworker/3:1+events22:40:323
168035499215710,2144cyclictest1714144-21kworker/3:2+events20:54:333
168035499215611,2142cyclictest1765219-21kworker/3:0+events23:42:103
168035499215611,2141cyclictest1752620-21kworker/3:0+events23:07:383
168035499215511,2141cyclictest1731821-21kworker/3:0+events21:47:433
168035499215510,2142cyclictest1731821-21kworker/3:0+events22:32:513
168035499215311,2139cyclictest1746126-21kworker/3:1+events22:37:523
168035499215311,2138cyclictest1752620-21kworker/3:0+events23:22:283
168035499215210,2138cyclictest1731821-21kworker/3:0+events22:21:013
16803549921509,2138cyclictest1746126-21kworker/3:1+events22:53:503
16803549921476,2135cyclictest1706082-21kworker/3:0+events20:42:433
168035499214710,2137cyclictest1699572-21kworker/3:2+events20:09:573
168035499214610,2133cyclictest1749421-21kworker/3:2+events22:46:393
168035499214610,2133cyclictest1680121-21kworker/3:1+events19:17:033
168035199214311,2128cyclictest1700906-21kworker/2:1+events21:10:302
168034999214310,2130cyclictest1731734-21kworker/1:1+events22:05:511
168035499214110,2128cyclictest1731821-21kworker/3:0+events22:12:163
168034999214111,2127cyclictest1707661-21kworker/1:2+events20:34:181
168035499214011,2126cyclictest1768806-21kworker/3:1+events23:50:533
168034999214011,2126cyclictest1778144-21kworker/1:1+events00:15:571
168034999214010,2127cyclictest1747766-21kworker/1:1+events22:40:541
168035499213910,2127cyclictest1719060-21kworker/3:0+events21:20:023
168034999213911,2125cyclictest1776423-21kworker/1:2+events00:08:011
168034999213911,2124cyclictest1736733-21kworker/1:2+events22:16:071
168034999213811,2124cyclictest1714653-21kworker/1:1+events21:07:261
168034999213711,2123cyclictest1768436-21kworker/1:0+events23:48:381
168034999213510,2122cyclictest1752590-21kworker/1:1+events22:59:591
168034999213011,2116cyclictest1739720-21kworker/1:0+events22:12:401
168034999213011,2115cyclictest1762106-21kworker/1:2+events23:36:021
168034999213010,2117cyclictest1760209-21kworker/1:0+events23:28:551
168034999213010,2117cyclictest1735018-21kworker/1:0+events22:00:341
168034999212911,2115cyclictest1683817-21kworker/1:2+events19:40:351
168034999212910,2116cyclictest1729824-21kworker/1:0+events21:44:201
168035499212711,2113cyclictest1765219-21kworker/3:0+events23:49:013
168034999212710,2114cyclictest1694740-21kworker/1:0+events20:00:471
168034999212710,2114cyclictest1683817-21kworker/1:2+events19:28:141
168034999212610,2114cyclictest1701201-21kworker/1:0+events20:25:071
168034999212511,2112cyclictest1747766-21kworker/1:1+events22:45:071
168034999212511,2110cyclictest1750966-21kworker/1:2+events22:53:271
168034999212411,2110cyclictest1676688-21kworker/1:0+events19:24:451
168035199211811,2104cyclictest1700906-21kworker/2:1+events21:02:282
168034499211610,2103cyclictest1719121-21kworker/0:1+events21:15:460
168034999211510,2102cyclictest1709295-21kworker/1:1+events20:41:111
16803449921147,2104cyclictest1717542-21kworker/0:2+events21:06:170
168034499211410,2101cyclictest1697813-21kworker/0:2+events20:15:400
168034499211410,2101cyclictest1685324-21kworker/0:0+events19:26:190
168034499211410,2101cyclictest1681536-21kworker/0:1+events19:34:030
16803499921129,2099cyclictest1694740-21kworker/1:0+events19:58:261
168034499211110,2098cyclictest1776578-21kworker/0:1+events00:17:040
16803449921098,2098cyclictest1706172-21kworker/0:2+events20:56:490
16803549921089,2096cyclictest1781340-21kworker/3:0+events00:27:173
16803449921079,2095cyclictest1739900-21kworker/0:1+events22:21:470
168034499210610,2094cyclictest1693231-21kworker/0:2+events19:50:050
168034499210511,2090cyclictest1697813-21kworker/0:2+events20:06:540
168034999210411,2090cyclictest1762106-21kworker/1:2+events23:33:251
168035199209810,2085cyclictest1783289-21kworker/2:0+events00:36:412
168035199209410,2081cyclictest1683679-21kworker/2:0+events19:25:312
168035499209211,2078cyclictest1725141-21kworker/3:2+events21:39:013
168035199208911,2075cyclictest1744704-21kworker/2:1+events22:36:432
168034999208311,2069cyclictest1694740-21kworker/1:0+events19:54:181
16803499920799,2067cyclictest1720509-21kworker/1:0+events21:28:501
168035199207710,2064cyclictest1731914-21kworker/2:2+events22:03:142
16803499920757,2065cyclictest1776423-21kworker/1:2+events00:21:381
168034499207010,2057cyclictest1691535-21kworker/0:1+events20:01:540
168035199206811,2054cyclictest1696370-21kworker/2:0+events20:01:082
168034499206710,2054cyclictest1723866-21kworker/0:0+events21:25:250
16803449920657,2051cyclictest1754150-21kworker/0:2+events23:03:260
168035199206310,2050cyclictest1707692-21kworker/2:2+events20:43:052
168035199205910,2046cyclictest1683679-21kworker/2:0+events19:35:352
168035199205410,2041cyclictest1744704-21kworker/2:1+events22:42:262
168035199205310,2039cyclictest1777968-21kworker/2:1+events00:24:392
168035199205110,2038cyclictest1721995-21kworker/2:2+events21:30:232
168035199205010,2037cyclictest1721995-21kworker/2:2+events21:18:072
168035499204911,2035cyclictest1752620-21kworker/3:0+events22:56:083
16803519920498,2038cyclictest1700906-21kworker/2:1+events20:27:492
16803519920479,2035cyclictest1700906-21kworker/2:1+events20:23:152
16803449920449,2032cyclictest1707908-21kworker/0:1+events20:36:140
168035199203410,2021cyclictest1777968-21kworker/2:1+events00:18:352
16803449920343,2028cyclictest1681536-21kworker/0:1+events19:14:450
168034499203010,2017cyclictest1770277-21kworker/0:0+events00:09:090
16803549920289,2016cyclictest1706082-21kworker/3:0+events20:56:273
16803549920258,2014cyclictest1706082-21kworker/3:0+events20:31:373
16803549920059,1993cyclictest1712280-21kworker/3:1+events20:47:183
16803549920057,1995cyclictest1689846-21kworker/3:2+events19:58:043
168035499200412,1989cyclictest1699572-21kworker/3:2+events20:28:093
168035199200410,1991cyclictest1759003-21kworker/2:1+events23:27:482
16803549920008,1989cyclictest1763588-21kworker/3:2+events23:31:563
16803549919997,1989cyclictest1774912-21kworker/3:1+events00:10:403
16803549919988,1987cyclictest1694708-21kworker/3:1+events19:53:543
168035499199810,1985cyclictest1691473-21kworker/3:1+events19:46:193
16803549919979,1985cyclictest1685141-21kworker/3:2+events19:25:553
168035499199710,1983cyclictest1733423-21kworker/3:2+events21:56:473
16803549919959,1983cyclictest1681826-21kworker/3:0+events19:21:423
168035499199510,1982cyclictest1731821-21kworker/3:0+events22:04:443
16803519919949,1982cyclictest1676719-21kworker/2:1+events19:13:182
168035199198511,1971cyclictest1749268-21kworker/2:2+events22:50:272
168034999198410,1971cyclictest1752590-21kworker/1:1+events23:10:391
168034999198210,1968cyclictest1776423-21kworker/1:2+events00:14:021
16803499919819,1969cyclictest1720509-21kworker/1:0+events21:23:051
168034999197310,1961cyclictest1725380-21kworker/1:2+events21:32:361
168034999197210,1959cyclictest1681742-21kworker/1:1+events19:18:361
16803499919692,1964cyclictest1701201-21kworker/1:0+events20:16:241
168034999196310,1949cyclictest1752590-21kworker/1:1+events23:20:141
168034999195810,1945cyclictest1768436-21kworker/1:0+events23:51:171
168035499195610,1943cyclictest1672093-21kworker/3:2+events19:14:233
16803499919569,1943cyclictest1676688-21kworker/1:0+events19:14:021
16803499919489,1936cyclictest1676688-21kworker/1:0+events19:31:451
16803499919029,1890cyclictest1727310-21kworker/1:1+events21:35:381
16800942143111,27sleep10-21swapper/119:09:001
1679838214396,16sleep00-21swapper/019:05:470
16800812141109,27sleep30-21swapper/319:08:503
16800852140110,25sleep20-21swapper/219:08:532
168035199159,4cyclictest1758587-21/usr/sbin/munin23:10:242
168035199131,9cyclictest1724871-21grep21:25:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional