You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 09:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Mon Dec 29, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
359686799584224,5815cyclictest3590093-21kworker/1:0+events19:11:511
359687199579923,5772cyclictest3597937-21kworker/2:1+events19:11:292
359687699297514,2957cyclictest3626266-21kworker/3:0+events20:40:003
359687199268113,2664cyclictest3667587-21kworker/2:2+events22:50:182
359686799267911,2663cyclictest3596493-21kworker/1:2+events19:20:131
359686799267510,2661cyclictest3634063-21kworker/1:2+events21:05:201
359687199265313,2636cyclictest3608668-21kworker/2:1+events19:50:122
359686599254112,2525cyclictest3605279-21kworker/0:0+events19:40:000
359687699253012,2513cyclictest3688585-21kworker/3:1+events00:00:163
359686599250212,2486cyclictest3612012-21kworker/0:1+events20:00:000
359687699233310,2320cyclictest3699757-21kworker/3:2+events00:28:323
359687199232812,2312cyclictest3613551-21kworker/2:1+events20:15:152
359686599231311,2298cyclictest3683599-21kworker/0:2+events23:39:590
359686599227910,2266cyclictest3615292-21kworker/0:0+events20:06:530
359687199227011,2256cyclictest3684155-21kworker/2:0+events00:05:122
359687699224110,2228cyclictest3663153-21kworker/3:1+events22:45:473
359686599223511,2221cyclictest3651744-21kworker/0:1+events22:08:240
359686599222011,2205cyclictest3622997-21kworker/0:1+events20:43:490
359686599220610,2192cyclictest3685260-21kworker/0:0+events00:04:260
35968659922009,2187cyclictest3677038-21kworker/0:0+events23:20:210
359687199219711,2182cyclictest3644039-21kworker/2:1+events21:40:122
35968769921839,2171cyclictest3658116-21kworker/3:1+events22:24:353
35968769921839,2171cyclictest3658116-21kworker/3:1+events22:24:353
35968679921788,2167cyclictest3624724-21kworker/1:2+events20:34:381
359686799217811,2164cyclictest3678635-21kworker/1:1+events23:26:551
359687199216611,2152cyclictest3629654-21kworker/2:2+events21:04:342
359686799216510,2152cyclictest3642142-21kworker/1:0+events21:30:351
359686799216111,2147cyclictest3670875-21kworker/1:0+events23:17:411
359687199216011,2146cyclictest3638787-21kworker/2:2+events21:28:412
359687199216010,2147cyclictest3626239-21kworker/2:1+events20:54:582
359687199215510,2142cyclictest3638787-21kworker/2:2+events21:22:342
35968769921547,2144cyclictest3593516-21kworker/3:0+events19:20:343
359687199215411,2140cyclictest3667587-21kworker/2:2+events22:57:302
359687699214810,2135cyclictest3658116-21kworker/3:1+events22:26:063
359686599214610,2133cyclictest3627953-21kworker/0:2+events20:55:200
359686799213110,2118cyclictest3605161-21kworker/1:0+events19:36:361
359687199212510,2111cyclictest3627863-21kworker/2:0+events20:48:272
359687199212310,2107cyclictest3648486-21kworker/2:2+events21:50:232
359686599211910,2106cyclictest3688555-21kworker/0:2+events23:55:190
35968719921109,2098cyclictest3684155-21kworker/2:0+events23:53:472
35968769921068,2095cyclictest3672322-21kworker/3:2+events23:17:213
35968679921059,2093cyclictest3638912-21kworker/1:2+events21:23:211
359687699210111,2087cyclictest3618170-21kworker/3:2+events20:14:523
35968769920938,2082cyclictest3638881-21kworker/3:1+events21:19:303
35968769920827,2072cyclictest3620068-21kworker/3:1+events20:56:283
35968769920819,2069cyclictest3696283-21kworker/3:0+events00:21:363
359687199207710,2065cyclictest3611952-21kworker/2:2+events19:55:062
359686599207410,2061cyclictest3669214-21kworker/0:2+events23:08:130
359686799206911,2055cyclictest3629530-21kworker/1:1+events21:03:471
35968769920685,2060cyclictest3652041-21kworker/3:0+events22:05:263
359687699206710,2054cyclictest3628041-21kworker/3:2+events20:49:593
35968769920649,2052cyclictest3646887-21kworker/3:2+events21:43:163
35968659920638,2052cyclictest3662911-21kworker/0:1+events22:57:540
35968769920628,2050cyclictest3650353-21kworker/3:2+events22:02:073
359687199206110,2048cyclictest3654837-21kworker/2:0+events22:31:482
359687699205910,2046cyclictest3670697-21kworker/3:0+events23:00:113
35968769920589,2046cyclictest3648692-21kworker/3:0+events21:50:463
359687699205510,2042cyclictest3652041-21kworker/3:0+events22:11:253
359686799205510,2043cyclictest3596493-21kworker/1:2+events19:15:181
359687699205110,2038cyclictest3638881-21kworker/3:1+events21:59:283
35968769920508,2039cyclictest3601780-21kworker/3:1+events19:33:543
35968769920484,2041cyclictest3637187-21kworker/3:0+events21:12:143
35968769920479,2035cyclictest3663153-21kworker/3:1+events22:51:273
359687699204710,2034cyclictest3669093-21kworker/3:2+events22:55:393
35968769920458,2034cyclictest3640493-21kworker/3:0+events21:26:243
359687699204510,2032cyclictest3603510-21kworker/3:2+events19:43:233
359686799204510,2032cyclictest3614200-21kworker/1:1+events20:03:051
35968769920429,2030cyclictest3670697-21kworker/3:0+events23:06:413
35968769920425,2034cyclictest3663153-21kworker/3:1+events22:40:273
35968659920427,2032cyclictest3634185-21kworker/0:2+events21:04:100
35968769920419,2029cyclictest3640493-21kworker/3:0+events21:37:513
35968659920397,2029cyclictest3616957-21kworker/0:1+events20:16:020
35968769920379,2025cyclictest3638881-21kworker/3:1+events21:22:573
35968659920359,2022cyclictest3645345-21kworker/0:1+events21:38:140
359686599203310,2019cyclictest3630836-21kworker/0:1+events21:14:070
35968769920318,2020cyclictest3694681-21kworker/3:1+events00:12:473
35968659920319,2019cyclictest3694858-21kworker/0:0+events00:30:450
359686599203110,2018cyclictest3693080-21kworker/0:2+events00:07:290
35968769920309,2018cyclictest3593516-21kworker/3:0+events19:27:503
359687199203010,2018cyclictest3696346-21kworker/2:2+events00:18:092
35968679920308,2019cyclictest3669276-21kworker/1:2+events23:07:511
35968659920309,2018cyclictest3621397-21kworker/0:0+events20:31:360
35968659920309,2018cyclictest3605279-21kworker/0:0+events19:47:340
35968659920309,2018cyclictest3605279-21kworker/0:0+events19:47:330
35968659920304,2023cyclictest3661249-21kworker/0:2+events22:29:280
359686799202910,2016cyclictest3605161-21kworker/1:0+events19:55:511
35968659920299,2016cyclictest3598085-21kworker/0:1+events19:29:000
359686799202811,2013cyclictest3658422-21kworker/1:2+events22:30:151
35968659920289,2016cyclictest3624694-21kworker/0:2+events20:36:570
35968659920275,2019cyclictest3630836-21kworker/0:1+events20:54:360
359686599202710,2014cyclictest3690155-21kworker/0:1+events00:13:350
359686599202710,2014cyclictest3656640-21kworker/0:0+events22:33:180
359686599202710,2014cyclictest3637393-21kworker/0:2+events21:16:000
35968769920268,2015cyclictest3610564-21kworker/3:1+events20:05:213
35968719920249,2011cyclictest3597937-21kworker/2:1+events19:33:112
359687199202410,2010cyclictest3672652-21kworker/2:1+events23:08:362
35968659920248,2013cyclictest3696531-21kworker/0:2+events00:20:500
359686599202410,2011cyclictest3667556-21kworker/0:0+events22:48:280
359686599202310,2010cyclictest3653392-21kworker/0:0+events22:03:350
35968659920229,2010cyclictest3613610-21kworker/0:2+events20:04:350
35968659920223,2016cyclictest3596273-21kworker/0:0+events19:18:210
35968659920219,2009cyclictest3639033-21kworker/0:0+events21:30:120
35968659920219,2009cyclictest3596273-21kworker/0:0+events19:12:370
35968769920187,2008cyclictest3656431-21kworker/3:2+events22:17:473
35968719920185,2010cyclictest3672652-21kworker/2:1+events23:13:362
35968769920177,2007cyclictest3635552-21kworker/3:1+events21:08:263
359686599201710,2004cyclictest3619742-21kworker/0:2+events20:21:410
35968769920168,2005cyclictest3618170-21kworker/3:2+events20:22:053
359686599201610,2003cyclictest3596273-21kworker/0:0+events19:24:240
35968659920147,2004cyclictest3648574-21kworker/0:2+events21:54:590
359686599201410,2001cyclictest3702863-21kworker/0:2+events00:37:100
359686599201210,2000cyclictest3639033-21kworker/0:0+events21:25:160
359686799201110,1998cyclictest3689918-21kworker/1:1+events00:13:581
35968659920119,2000cyclictest3603356-21kworker/0:2+events19:30:060
35968659920118,1999cyclictest3680122-21kworker/0:1+events23:41:110
35968659920109,1998cyclictest3673805-21kworker/0:1+events23:13:580
359687699200810,1995cyclictest3593516-21kworker/3:0+events19:13:243
35968719920088,1997cyclictest3618735-21kworker/2:2+events20:20:552
35968769920079,1995cyclictest3696283-21kworker/3:0+events00:39:003
35968679920077,1997cyclictest3624724-21kworker/1:2+events20:43:041
35968659920069,1994cyclictest3669214-21kworker/0:2+events23:19:350
35968679920039,1991cyclictest3624724-21kworker/1:2+events20:45:201
359686799200210,1989cyclictest3670875-21kworker/1:0+events23:13:111
35968769920009,1988cyclictest3690281-21kworker/3:2+events00:05:353
35968769919989,1986cyclictest3672322-21kworker/3:2+events23:36:563
35968769919979,1985cyclictest3624663-21kworker/3:2+events20:34:153
35968719919979,1984cyclictest3665928-21kworker/2:0+events22:43:092
359686599199610,1984cyclictest3656640-21kworker/0:0+events22:38:110
35968769919959,1983cyclictest3672322-21kworker/3:2+events23:33:043
359686799199510,1982cyclictest3629530-21kworker/1:1+events20:58:451
35968679919944,1987cyclictest3614200-21kworker/1:1+events20:25:321
35968769919938,1982cyclictest3615147-21kworker/3:0+events20:15:403
35968659919935,1985cyclictest3651744-21kworker/0:1+events22:10:410
35968769919918,1981cyclictest3685141-21kworker/3:1+events23:45:003
35968719919899,1977cyclictest3616895-21kworker/2:0+events20:10:422
359686799198710,1974cyclictest3655069-21kworker/1:2+events22:10:171
359686799198710,1974cyclictest3646919-21kworker/1:1+events21:46:171
35968769919859,1973cyclictest3694681-21kworker/3:1+events00:19:193
359687699198510,1972cyclictest3672322-21kworker/3:2+events23:28:273
359687699198510,1971cyclictest3638881-21kworker/3:1+events21:32:053
35968679919857,1974cyclictest3685410-21kworker/1:2+events23:59:061
359686799198510,1971cyclictest3607089-21kworker/1:2+events19:40:211
35968769919849,1972cyclictest3638881-21kworker/3:1+events21:48:323
359686799198410,1971cyclictest3614200-21kworker/1:1+events20:08:491
35968769919838,1972cyclictest3681881-21kworker/3:0+events23:43:513
35968679919838,1972cyclictest3646919-21kworker/1:1+events21:42:071
35968679919836,1974cyclictest3611864-21kworker/1:2+events19:52:041
35968679919835,1975cyclictest3618200-21kworker/1:2+events20:19:261
35968679919826,1973cyclictest3689918-21kworker/1:1+events00:20:031
359686799198210,1970cyclictest3651830-21kworker/1:2+events22:00:131
359686799198210,1969cyclictest3662821-21kworker/1:0+events22:52:351
35968769919815,1973cyclictest3659856-21kworker/3:0+events22:38:563
35968679919819,1969cyclictest3664447-21kworker/1:2+events22:38:341
359687699198010,1967cyclictest3675679-21kworker/3:0+events23:23:503
35968769919799,1967cyclictest3661525-21kworker/3:2+events22:34:023
35968769919799,1967cyclictest3620068-21kworker/3:1+events20:53:273
35968769919789,1966cyclictest3696283-21kworker/3:0+events00:31:533
35968769919789,1966cyclictest3620068-21kworker/3:1+events20:25:553
35968679919787,1968cyclictest3689918-21kworker/1:1+events00:34:081
35968679919755,1967cyclictest3691655-21kworker/1:0+events00:04:491
35968769919749,1962cyclictest3681881-21kworker/3:0+events23:54:333
35968769919749,1962cyclictest3606933-21kworker/3:0+events19:54:203
359687699197410,1962cyclictest3631015-21kworker/3:0+events21:02:373
35968659919749,1962cyclictest3616957-21kworker/0:1+events20:12:590
35968719919737,1963cyclictest3608668-21kworker/2:1+events19:42:142
359686799197210,1959cyclictest3646919-21kworker/1:1+events22:28:461
359687199197110,1958cyclictest3603323-21kworker/2:0+events19:39:382
35968719919709,1958cyclictest3698242-21kworker/2:0+events00:24:212
35968679919709,1958cyclictest3624724-21kworker/1:2+events20:52:441
35968659919706,1961cyclictest3690155-21kworker/0:1+events00:17:470
35968769919697,1959cyclictest3673923-21kworker/3:1+events23:10:323
35968719919698,1958cyclictest3686832-21kworker/2:1+events23:49:352
35968679919693,1963cyclictest3669276-21kworker/1:2+events22:57:081
35968679919693,1963cyclictest3650238-21kworker/1:0+events21:56:291
35968659919698,1958cyclictest3607248-21kworker/0:1+events19:43:470
359687199196710,1954cyclictest3613551-21kworker/2:1+events20:06:312
35968659919679,1954cyclictest3685260-21kworker/0:0+events23:54:090
359687199196610,1953cyclictest3634276-21kworker/2:1+events21:10:212
359687199196510,1952cyclictest3621334-21kworker/2:0+events20:36:332
35968659919658,1955cyclictest3656640-21kworker/0:0+events22:20:060
35968659919658,1955cyclictest3656640-21kworker/0:0+events22:20:050
35968719919643,1958cyclictest3621334-21kworker/2:0+events20:31:582
35968659919648,1953cyclictest3612012-21kworker/0:1+events19:53:580
359686599196410,1951cyclictest3669214-21kworker/0:2+events22:54:050
35968659919639,1951cyclictest3685260-21kworker/0:0+events23:45:460
35968659919639,1951cyclictest3650157-21kworker/0:0+events21:56:070
35968659919639,1951cyclictest3630836-21kworker/0:1+events21:21:250
35968769919627,1952cyclictest3593516-21kworker/3:0+events19:16:263
359687199196210,1949cyclictest3698242-21kworker/2:0+events00:36:482
359686799196210,1949cyclictest3685410-21kworker/1:2+events23:49:581
35968659919628,1951cyclictest3645345-21kworker/0:1+events21:44:010
359686599196210,1949cyclictest3621397-21kworker/0:0+events20:28:090
35968769919619,1949cyclictest3620068-21kworker/3:1+events20:40:453
359687199196110,1948cyclictest3696346-21kworker/2:2+events00:25:292
359687199196110,1948cyclictest3675409-21kworker/2:0+events23:32:422
359687199196110,1948cyclictest3597937-21kworker/2:1+events19:28:372
359686799196110,1948cyclictest3601692-21kworker/1:1+events19:28:141
35968659919619,1949cyclictest3670936-21kworker/0:0+events23:01:440
359686599196110,1948cyclictest3662911-21kworker/0:1+events22:42:020
35968719919605,1952cyclictest3626239-21kworker/2:1+events20:43:252
35968719919604,1953cyclictest3661456-21kworker/2:2+events22:39:192
35968659919609,1948cyclictest3655011-21kworker/0:2+events22:15:550
359687199195910,1946cyclictest3629654-21kworker/2:2+events20:55:452
35968659919598,1948cyclictest3627953-21kworker/0:2+events20:46:540
35968679919582,1953cyclictest3685410-21kworker/1:2+events23:52:371
359686599195810,1945cyclictest3648574-21kworker/0:2+events21:49:380
35968769919569,1944cyclictest3615147-21kworker/3:0+events20:03:283
359687199195610,1943cyclictest3635943-21kworker/2:0+events21:16:472
35968659919563,1949cyclictest3680122-21kworker/0:1+events23:34:130
35968679919548,1943cyclictest3689918-21kworker/1:1+events00:06:431
35968719919539,1941cyclictest3658146-21kworker/2:2+events22:19:412
35968719919537,1943cyclictest3682018-21kworker/2:1+events23:39:142
35968719919525,1944cyclictest3654837-21kworker/2:0+events22:27:372
35968659919529,1940cyclictest3634185-21kworker/0:2+events21:08:050
359687699195010,1937cyclictest3603510-21kworker/3:2+events19:37:473
35968719919499,1938cyclictest3699964-21kworker/2:1+events00:33:232
359687199194910,1936cyclictest3654837-21kworker/2:0+events22:07:182
35968679919498,1938cyclictest3669276-21kworker/1:2+events23:04:021
35968719919479,1935cyclictest3610296-21kworker/2:0+events19:48:202
35968719919479,1935cyclictest3610296-21kworker/2:0+events19:48:202
35968719919477,1937cyclictest3644039-21kworker/2:1+events21:45:532
35968659919479,1935cyclictest3698535-21kworker/0:1+events00:26:360
359687199194110,1928cyclictest3615263-21kworker/2:2+events20:04:572
359686799194010,1927cyclictest3646919-21kworker/1:1+events22:16:391
359687199193510,1922cyclictest3621334-21kworker/2:0+events20:26:172
35968679919353,1929cyclictest3608995-21kworker/1:1+events19:47:101
35968679919353,1929cyclictest3608995-21kworker/1:1+events19:47:101
35968769919349,1922cyclictest3613000-21kworker/3:2+events19:56:353
35968769919339,1921cyclictest3606933-21kworker/3:0+events19:46:043
35968769919339,1921cyclictest3606933-21kworker/3:0+events19:46:043
35968719919339,1921cyclictest3644039-21kworker/2:1+events21:59:052
35968679919328,1921cyclictest3614200-21kworker/1:1+events20:35:481
359686799193010,1917cyclictest3670875-21kworker/1:0+events23:31:311
359686799193010,1917cyclictest3662821-21kworker/1:0+events22:42:471
359686799192910,1916cyclictest3644071-21kworker/1:2+events21:37:311
35968679919239,1911cyclictest3635674-21kworker/1:0+events21:15:161
35968719919228,1911cyclictest3680423-21kworker/2:2+events23:40:232
35968679919219,1909cyclictest3601692-21kworker/1:1+events19:31:131
35968679919205,1912cyclictest3638912-21kworker/1:2+events21:27:551
35968679919204,1912cyclictest3614200-21kworker/1:1+events20:14:291
35968679919198,1908cyclictest3646919-21kworker/1:1+events22:22:191
35968679919198,1908cyclictest3646919-21kworker/1:1+events22:22:181
35968679919187,1908cyclictest3683721-21kworker/1:0+events23:41:321
359686799191711,1903cyclictest3621545-21kworker/1:0+events20:24:471
359686799191710,1904cyclictest3670875-21kworker/1:0+events23:21:531
35968679919167,1906cyclictest3689918-21kworker/1:1+events00:28:081
35968679919159,1903cyclictest3662821-21kworker/1:0+events22:45:241
35968679919149,1902cyclictest3694905-21kworker/1:0+events00:15:291
35968679919079,1895cyclictest3653478-21kworker/1:0+events22:07:401
35968769919049,1893cyclictest3681881-21kworker/3:0+events23:57:373
35968719919045,1896cyclictest3600006-21kworker/2:2+events19:24:452
35968679919039,1891cyclictest3683721-21kworker/1:0+events23:38:491
35968719918999,1888cyclictest3684155-21kworker/2:0+events23:56:062
359686799189910,1886cyclictest3689918-21kworker/1:1+events00:38:391
359687199189710,1884cyclictest3694651-21kworker/2:1+events00:12:042
35968719918965,1889cyclictest3597937-21kworker/2:1+events19:19:072
35968719918959,1883cyclictest3678817-21kworker/2:1+events23:25:002
35968719918959,1883cyclictest3669243-21kworker/2:0+events23:02:532
35968719918949,1882cyclictest3675409-21kworker/2:0+events23:18:502
35968659918939,1881cyclictest3677038-21kworker/0:0+events23:25:480
35968719918865,1878cyclictest3634276-21kworker/2:1+events21:06:302
359687199188610,1873cyclictest3658146-21kworker/2:2+events22:22:412
359687199188610,1873cyclictest3658146-21kworker/2:2+events22:22:402
35968719918848,1873cyclictest3656518-21kworker/2:1+events22:13:162
35968719918838,1871cyclictest3690325-21kworker/2:3+events00:02:092
35968719918833,1877cyclictest3675409-21kworker/2:0+events23:29:372
359686799188310,1870cyclictest3634063-21kworker/1:2+events21:11:501
35968719918805,1872cyclictest3663057-21kworker/2:1+events22:47:202
35968719918718,1860cyclictest3638787-21kworker/2:2+events21:34:462
35968679918459,1835cyclictest3648518-21kworker/1:2+events21:50:001
35968719918439,1831cyclictest3638787-21kworker/2:2+events21:37:072
35964922146111,30sleep20-21swapper/219:08:182
35963422140111,23sleep30-21swapper/319:06:233
3596386213993,16sleep00-21swapper/019:06:560
35963822139106,28sleep10-21swapper/119:06:531
359687199180,12cyclictest0-21swapper/222:00:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional