You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 05:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Tue Dec 02, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38564199305715,3037cyclictest427193-21kworker/1:1+events21:25:201
38564899279912,2784cyclictest386890-21kworker/3:1+events19:41:133
38564899276113,2744cyclictest423916-21kworker/3:0+events21:10:173
38564899274213,2726cyclictest388904-21kworker/3:0+events19:25:193
38563999271614,2697cyclictest432077-21kworker/0:1+events21:40:200
38564599268913,2672cyclictest448518-21kworker/2:0+events22:30:182
38564599247510,2461cyclictest409721-21kworker/2:2+events20:33:272
38564899242810,2415cyclictest409817-21kworker/3:0+events20:30:003
3856419923969,2383cyclictest411479-21kworker/1:0+events20:45:171
38564599237712,2361cyclictest446856-21kworker/2:2+events22:25:202
38564599236212,2346cyclictest391951-21kworker/2:2+events19:29:252
38564899235911,2345cyclictest433427-21kworker/3:2+events21:41:503
38564199235211,2338cyclictest456504-21kworker/1:2+events22:50:541
38564199235211,2338cyclictest456504-21kworker/1:2+events22:50:541
38564899234112,2327cyclictest486711-21kworker/3:0+events00:25:123
38564199232812,2313cyclictest401721-21kworker/1:2+events20:11:441
38563999232611,2312cyclictest393666-21kworker/0:0+events19:50:160
38563999232512,2310cyclictest453305-21kworker/0:0+events22:43:200
38563999232312,2308cyclictest393666-21kworker/0:0+events19:58:570
38564199231411,2300cyclictest398520-21kworker/1:2+events19:53:191
38564199231211,2298cyclictest430456-21kworker/1:2+events21:30:191
38563999230812,2293cyclictest411357-21kworker/0:2+events20:56:110
38564599227511,2260cyclictest407684-21kworker/2:0+events20:25:512
38563999227110,2258cyclictest462661-21kworker/0:1+events23:21:430
38564899227011,2255cyclictest477259-21kworker/3:1+events00:36:333
38564599227010,2257cyclictest420960-21kworker/2:1+events21:06:092
38564899223910,2225cyclictest436686-21kworker/3:2+events21:52:283
38564899222711,2213cyclictest392129-21kworker/3:2+events20:03:103
38564899222510,2212cyclictest479012-21kworker/3:3+events00:01:363
38564599222510,2212cyclictest440434-21kworker/2:0+events22:14:092
3856489922229,2210cyclictest472410-21kworker/3:2+events23:44:403
38563999222210,2209cyclictest400087-21kworker/0:1+events20:02:000
38564899222111,2206cyclictest448611-21kworker/3:0+events22:32:103
38564899221911,2205cyclictest474041-21kworker/3:0+events23:53:123
38564899221911,2205cyclictest408033-21kworker/3:2+events20:53:363
38564899221810,2204cyclictest438601-21kworker/3:0+events22:02:223
38564899221610,2203cyclictest464344-21kworker/3:0+events23:18:163
38564899221510,2201cyclictest428969-21kworker/3:1+events21:39:113
38564199221511,2202cyclictest390677-21kworker/1:0+events19:25:431
38564899221311,2199cyclictest486711-21kworker/3:0+events00:23:193
38564899221111,2197cyclictest431760-21kworker/3:0+events21:34:333
38564899220810,2195cyclictest408033-21kworker/3:2+events21:09:303
38564899220611,2192cyclictest470068-21kworker/3:1+events23:31:343
38564899220311,2189cyclictest386890-21kworker/3:1+events19:36:163
38564899220310,2190cyclictest459439-21kworker/3:2+events23:25:123
3856399922029,2190cyclictest393666-21kworker/0:0+events20:09:070
3856489921987,2188cyclictest443594-21kworker/3:1+events22:15:193
38564899219711,2183cyclictest443594-21kworker/3:1+events22:22:143
38564199219311,2179cyclictest459740-21kworker/1:1+events23:09:571
38564899218811,2174cyclictest474041-21kworker/3:0+events23:46:383
38564899218810,2175cyclictest408033-21kworker/3:2+events20:31:303
38564899218710,2173cyclictest404968-21kworker/3:1+events20:19:003
38563999218611,2172cyclictest406206-21kworker/0:2+events20:17:270
38564599218312,2168cyclictest462630-21kworker/2:2+events23:20:122
3856399921830,2180cyclictest411357-21kworker/0:2+events20:52:490
3856489921828,2170cyclictest436686-21kworker/3:2+events21:49:063
3856489921819,2170cyclictest456413-21kworker/3:0+events22:50:103
3856489921819,2170cyclictest456413-21kworker/3:0+events22:50:093
38564899218111,2167cyclictest419300-21kworker/3:0+events20:57:423
38564899218010,2168cyclictest459439-21kworker/3:2+events23:10:193
38564899217810,2164cyclictest408033-21kworker/3:2+events20:23:353
38564899217610,2163cyclictest479012-21kworker/3:3+events00:09:153
38564899217610,2163cyclictest403314-21kworker/3:0+events20:14:473
38564899217311,2159cyclictest454689-21kworker/3:2+events22:42:583
38564899217110,2158cyclictest451885-21kworker/3:1+events22:36:013
3856489921689,2156cyclictest398462-21kworker/3:1+events19:52:333
3856489921567,2145cyclictest451885-21kworker/3:1+events22:45:143
3856459921548,2143cyclictest366839-21kworker/2:0+events19:33:122
38564599214812,2133cyclictest432004-21kworker/2:2+events21:36:522
38564199213310,2120cyclictest390677-21kworker/1:0+events19:43:521
38564199212011,2106cyclictest396923-21kworker/1:1+events20:01:381
38564199211811,2104cyclictest420772-21kworker/1:2+events21:05:241
38564199211811,2104cyclictest406321-21kworker/1:1+events20:24:421
38563999211711,2103cyclictest390410-21kworker/0:2+events19:30:340
38564599211610,2103cyclictest471017-21kworker/2:2+events23:38:292
38564199211611,2103cyclictest475917-21kworker/1:0+events23:55:071
38564199211611,2102cyclictest406321-21kworker/1:1+events20:27:461
38564199211610,2103cyclictest420772-21kworker/1:2+events21:03:291
38564199211511,2101cyclictest445461-21kworker/1:2+events22:20:441
38564199211511,2101cyclictest445461-21kworker/1:2+events22:17:591
38564199211411,2100cyclictest472566-21kworker/1:0+events23:39:381
38564199211411,2100cyclictest465863-21kworker/1:2+events23:19:261
38564199211411,2100cyclictest438426-21kworker/1:0+events21:56:361
38564199211411,2100cyclictest417582-21kworker/1:2+events20:51:211
38564199211311,2099cyclictest469353-21kworker/1:2+events23:46:591
3856399921139,2101cyclictest430487-21kworker/0:2+events21:32:130
3856399921138,2101cyclictest438512-21kworker/0:2+events21:53:560
38563999211311,2099cyclictest450094-21kworker/0:0+events22:31:240
38564199210911,2094cyclictest453272-21kworker/1:0+events22:49:021
38564599210811,2094cyclictest396950-21kworker/2:0+events19:46:292
38564599210810,2095cyclictest475115-21kworker/2:1+events23:56:152
38564599210711,2093cyclictest448518-21kworker/2:0+events22:53:152
38564599210711,2093cyclictest448518-21kworker/2:0+events22:53:152
3856419921078,2096cyclictest396923-21kworker/1:1+events19:46:081
38564199210711,2092cyclictest414354-21kworker/1:1+events20:39:361
38564199210710,2093cyclictest482000-21kworker/1:1+events00:09:381
38564599210611,2092cyclictest477290-21kworker/2:0+events00:05:262
38563999210611,2091cyclictest420837-21kworker/0:1+events21:04:380
38563999210610,2093cyclictest412993-21kworker/0:0+events20:34:380
38564599210511,2091cyclictest480659-21kworker/2:1+events00:14:142
3856399921059,2093cyclictest477169-21kworker/0:2+events23:57:020
3856399921058,2094cyclictest467783-21kworker/0:2+events23:30:490
38563999210511,2091cyclictest427127-21kworker/0:1+events21:23:260
38563999210510,2092cyclictest480512-21kworker/0:2+events00:10:470
3856459921048,2093cyclictest427222-21kworker/2:1+events21:34:112
38564599210411,2090cyclictest395330-21kworker/2:2+events19:43:292
38563999210411,2090cyclictest442258-21kworker/0:2+events22:21:290
38563999210411,2090cyclictest432077-21kworker/0:1+events21:37:390
38563999210410,2091cyclictest458168-21kworker/0:2+events22:55:560
3856489921037,2093cyclictest472410-21kworker/3:2+events23:37:443
38564599210311,2090cyclictest407684-21kworker/2:0+events20:22:242
3856459921029,2090cyclictest453211-21kworker/2:2+events22:39:042
3856459921029,2090cyclictest436593-21kworker/2:2+events21:50:122
38564599210210,2089cyclictest440434-21kworker/2:0+events22:01:142
3856419921026,2093cyclictest480394-21kworker/1:2+events00:03:281
38563999210211,2088cyclictest462661-21kworker/0:1+events23:08:260
38564599210110,2088cyclictest413083-21kworker/2:0+events20:35:442
38563999210111,2087cyclictest467783-21kworker/0:2+events23:29:200
38564599209910,2086cyclictest407684-21kworker/2:0+events20:16:412
38564599209910,2086cyclictest393695-21kworker/2:1+events19:35:292
38564899209812,2083cyclictest485053-21kworker/3:2+events00:19:353
3856419920989,2085cyclictest449945-21kworker/1:1+events22:42:091
38564599209510,2082cyclictest417495-21kworker/2:0+events20:52:272
38563999209411,2080cyclictest442258-21kworker/0:2+events22:37:090
38563999209410,2081cyclictest480512-21kworker/0:2+events00:26:220
38564199209310,2080cyclictest447154-21kworker/1:0+events22:30:421
38564199209310,2080cyclictest425577-21kworker/1:0+events21:16:061
38564599209210,2079cyclictest396950-21kworker/2:0+events19:51:022
3856489920899,2077cyclictest386890-21kworker/3:1+events19:13:333
38563999208910,2076cyclictest472656-21kworker/0:1+events00:07:220
38564899208711,2073cyclictest477259-21kworker/3:1+events23:58:573
38564599208411,2070cyclictest471017-21kworker/2:2+events23:42:442
3856399920793,2073cyclictest440377-21kworker/0:0+events21:59:410
38564899207710,2063cyclictest461097-21kworker/3:1+events23:09:343
38563999207610,2063cyclictest475501-21kworker/0:0+events23:49:200
3856399920757,2065cyclictest382106-21kworker/0:0+events19:18:040
3856489920732,2068cyclictest425641-21kworker/3:1+events21:18:023
3856489920727,2062cyclictest408033-21kworker/3:2+events20:39:573
3856489920725,2064cyclictest427314-21kworker/3:2+events21:22:393
38564899207210,2059cyclictest465955-21kworker/3:1+events23:20:343
38564899207110,2058cyclictest420929-21kworker/3:1+events21:03:503
38564899207010,2057cyclictest403314-21kworker/3:0+events20:08:433
3856489920698,2058cyclictest441595-21kworker/3:2+events22:10:193
38564599206810,2055cyclictest425547-21kworker/2:0+events21:17:142
3856419920679,2055cyclictest442228-21kworker/1:0+events22:04:421
38563999206610,2053cyclictest454931-21kworker/0:1+events22:47:320
3856489920659,2053cyclictest459439-21kworker/3:2+events22:59:223
38564899206510,2052cyclictest477259-21kworker/3:1+events00:30:283
3856399920654,2058cyclictest411357-21kworker/0:2+events20:48:420
3856489920638,2052cyclictest396829-21kworker/3:0+events19:47:393
3856459920639,2050cyclictest387071-21kworker/2:2+events19:16:102
3856489920626,2053cyclictest448611-21kworker/3:0+events22:29:093
3856399920628,2051cyclictest428791-21kworker/0:0+events21:29:560
3856489920615,2053cyclictest477259-21kworker/3:1+events00:10:243
3856459920618,2050cyclictest453211-21kworker/2:2+events22:42:332
38564899206010,2047cyclictest408033-21kworker/3:2+events20:43:243
38564899205910,2046cyclictest461097-21kworker/3:1+events23:03:323
38564599205710,2043cyclictest427222-21kworker/2:1+events21:27:162
3856419920564,2049cyclictest482000-21kworker/1:1+events00:16:521
38563999205510,2042cyclictest422555-21kworker/0:2+events21:12:130
38563999205310,2040cyclictest458168-21kworker/0:2+events23:14:250
38564899205210,2039cyclictest379380-21kworker/3:2+events19:15:263
38563999205211,2038cyclictest472656-21kworker/0:1+events23:52:010
38564899205010,2037cyclictest416311-21kworker/3:1+events20:49:283
3856399920509,2038cyclictest408129-21kworker/0:1+events20:20:290
3856419920489,2037cyclictest459740-21kworker/1:1+events23:22:531
3856489920479,2035cyclictest392129-21kworker/3:2+events19:30:573
38564899204110,2028cyclictest388904-21kworker/3:0+events19:21:073
3856489920356,2026cyclictest427314-21kworker/3:2+events21:25:433
3856399920357,2025cyclictest432077-21kworker/0:1+events22:03:550
3856459920329,2020cyclictest469414-21kworker/2:0+events23:34:152
38564899203010,2017cyclictest392129-21kworker/3:2+events19:59:213
38564199202611,2012cyclictest414354-21kworker/1:1+events20:42:151
38564199202410,2011cyclictest438426-21kworker/1:0+events21:52:501
38564199202310,2010cyclictest411479-21kworker/1:0+events20:30:241
38563999202011,2006cyclictest442258-21kworker/0:2+events22:19:340
38563999201811,2004cyclictest390410-21kworker/0:2+events19:27:110
3856459920059,1992cyclictest389164-21kworker/2:1+events19:22:152
3856419920048,1993cyclictest474255-21kworker/1:1+events23:54:211
3856419920048,1992cyclictest467752-21kworker/1:0+events23:27:041
38564599200010,1986cyclictest485207-21kworker/2:0+events00:21:042
3856489919999,1987cyclictest428969-21kworker/3:1+events21:58:103
3856399919998,1988cyclictest456563-21kworker/0:0+events22:51:180
3856399919998,1988cyclictest456563-21kworker/0:0+events22:51:170
38564199198811,1974cyclictest490597-21kworker/1:0+events00:38:491
3856459919858,1974cyclictest456474-21kworker/2:1+events23:06:312
38564899198310,1970cyclictest441595-21kworker/3:2+events22:05:503
3856399919839,1971cyclictest488233-21kworker/0:0+events00:33:530
3856399919839,1971cyclictest382106-21kworker/0:0+events19:11:590
38564199198110,1968cyclictest483631-21kworker/1:0+events00:21:501
3856419919756,1966cyclictest443830-21kworker/1:1+events22:14:311
38564199197410,1961cyclictest390677-21kworker/1:0+events19:32:291
38564199197410,1961cyclictest389023-21kworker/1:2+events19:21:511
3856459919735,1965cyclictest458104-21kworker/2:2+events22:58:122
38564599197311,1959cyclictest486837-21kworker/2:2+events00:27:542
3856419919725,1964cyclictest434908-21kworker/1:1+events21:43:241
3856419919723,1966cyclictest442228-21kworker/1:0+events22:06:561
38564199197110,1958cyclictest486931-21kworker/1:2+events00:33:311
38563999197110,1958cyclictest412993-21kworker/0:0+events20:43:000
3856459919702,1965cyclictest436593-21kworker/2:2+events21:57:232
3856419919705,1962cyclictest387014-21kworker/1:1+events19:19:121
3856419919697,1959cyclictest459740-21kworker/1:1+events23:12:091
38564199196910,1956cyclictest472566-21kworker/1:0+events23:43:301
38564199196910,1956cyclictest449945-21kworker/1:1+events22:38:191
38564599196710,1954cyclictest485207-21kworker/2:0+events00:39:572
3856419919657,1955cyclictest449945-21kworker/1:1+events22:26:521
38564199196410,1951cyclictest459740-21kworker/1:1+events23:01:411
3856419919638,1952cyclictest486931-21kworker/1:2+events00:25:351
3856419919637,1953cyclictest400120-21kworker/1:0+events19:55:131
3856419919629,1950cyclictest404668-21kworker/1:0+events20:19:461
3856419919629,1950cyclictest390677-21kworker/1:0+events19:38:081
3856419919627,1952cyclictest420772-21kworker/1:2+events20:58:311
3856419919614,1954cyclictest385297-21kworker/1:0+events19:13:551
3856459919609,1948cyclictest480659-21kworker/2:1+events00:18:232
3856419919609,1948cyclictest459740-21kworker/1:1+events23:31:561
3856419919609,1948cyclictest453272-21kworker/1:0+events22:58:571
3856419919609,1948cyclictest436563-21kworker/1:2+events21:47:571
3856419919606,1951cyclictest401721-21kworker/1:2+events20:06:531
38563999196010,1947cyclictest458168-21kworker/0:2+events23:04:390
3856419919594,1952cyclictest482000-21kworker/1:1+events00:13:251
3856419919587,1948cyclictest423988-21kworker/1:1+events21:11:031
3856399919536,1944cyclictest408129-21kworker/0:1+events20:28:080
3856459919525,1944cyclictest380454-21kworker/2:1+events19:13:102
3856399919524,1945cyclictest450094-21kworker/0:0+events22:28:470
3856459919519,1939cyclictest479011-21kworker/2:3+events00:03:062
3856419919513,1945cyclictest427193-21kworker/1:1+events21:23:041
3856399919519,1939cyclictest445219-21kworker/0:0+events22:13:220
3856399919518,1940cyclictest467783-21kworker/0:2+events23:36:120
38564599195010,1937cyclictest403161-21kworker/2:2+events20:14:242
3856399919508,1939cyclictest436532-21kworker/0:0+events21:48:430
38563999195010,1938cyclictest442258-21kworker/0:2+events22:05:040
3856459919495,1940cyclictest475115-21kworker/2:1+events23:49:432
38564599194910,1936cyclictest440434-21kworker/2:0+events22:05:272
38563999194910,1936cyclictest489832-21kworker/0:1+events00:36:550
3856399919486,1939cyclictest462661-21kworker/0:1+events23:17:530
38563999194810,1935cyclictest420837-21kworker/0:1+events21:08:460
3856459919479,1935cyclictest422584-21kworker/2:2+events21:12:362
3856459919479,1935cyclictest411420-21kworker/2:1+events20:40:222
3856459919479,1935cyclictest401510-21kworker/2:1+events19:58:362
38564599194710,1934cyclictest445186-21kworker/2:1+events22:17:132
3856399919479,1935cyclictest393666-21kworker/0:0+events19:48:460
3856399919478,1936cyclictest485621-21kworker/0:1+events00:21:270
3856459919464,1939cyclictest448518-21kworker/2:0+events22:24:332
3856399919468,1935cyclictest478806-21kworker/0:0+events00:02:440
3856399919465,1938cyclictest422555-21kworker/0:2+events21:17:390
38564199194510,1932cyclictest430456-21kworker/1:2+events21:38:481
38564599194410,1931cyclictest464288-21kworker/2:0+events23:13:402
38564599194410,1930cyclictest448518-21kworker/2:0+events22:45:592
3856459919427,1932cyclictest489888-21kworker/2:1+events00:33:072
38564599194210,1929cyclictest420960-21kworker/2:1+events21:01:572
3856459919419,1929cyclictest462630-21kworker/2:2+events23:15:352
3856459919388,1926cyclictest433610-21kworker/2:0+events21:47:112
3856459919377,1927cyclictest456474-21kworker/2:1+events23:00:532
3856399919366,1927cyclictest406206-21kworker/0:2+events20:12:060
38563999193310,1921cyclictest472656-21kworker/0:1+events23:40:470
3856459919329,1920cyclictest417495-21kworker/2:0+events20:47:112
3856459919306,1921cyclictest471017-21kworker/2:2+events23:50:302
3856459919197,1909cyclictest422584-21kworker/2:2+events21:22:162
3856459919088,1897cyclictest403161-21kworker/2:2+events20:09:512
38563999189510,1882cyclictest411357-21kworker/0:2+events20:35:220
3856399918778,1866cyclictest393666-21kworker/0:0+events19:43:060
3856399918774,1870cyclictest390410-21kworker/0:2+events19:24:100
3856459918769,1864cyclictest466598-21kworker/2:1+events23:28:572
3856459918738,1862cyclictest396950-21kworker/2:0+events20:02:452
3856459918677,1857cyclictest417495-21kworker/2:0+events20:59:372
3856399918622,1857cyclictest390410-21kworker/0:2+events19:36:360
3852092150103,24sleep10-21swapper/119:06:571
3853182141108,27sleep00-21swapper/019:08:160
3851802140101,36sleep20-21swapper/219:06:342
3854262138106,29sleep30-21swapper/319:09:393
38564599199,2cyclictest191rcu_preempt21:40:242
38563999170,15cyclictest484555-21/usr/sbin/munin00:15:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional