You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Sat Nov 22, 2025 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
404589399340116,3382cyclictest4128876-21kworker/3:2+events23:40:023
404588699306216,3042cyclictest4050805-21kworker/0:2+events19:50:180
404589199285514,2836cyclictest4060319-21kworker/2:0+events19:55:192
404588899278313,2768cyclictest4090894-21kworker/1:1+events21:35:011
404588699276213,2746cyclictest4078152-21kworker/0:1+events21:00:190
404588699264712,2631cyclictest4070431-21kworker/0:2+events20:30:170
404588699262513,2608cyclictest4111554-21kworker/0:0+events22:45:190
404588699249712,2481cyclictest4055345-21kworker/0:0+events19:40:200
404589399249512,2477cyclictest4103643-21kworker/3:2+events22:14:583
404588699249012,2475cyclictest4078152-21kworker/0:1+events21:05:110
404588699249012,2474cyclictest4148428-21kworker/0:1+events00:35:140
404589399246110,2448cyclictest4108519-21kworker/3:0+events22:45:433
404589199245812,2441cyclictest4081306-21kworker/2:2+events21:10:142
404589399245610,2443cyclictest4047221-21kworker/3:2+events19:22:053
40458939924489,2434cyclictest4055313-21kworker/3:1+events20:10:123
404588699244612,2430cyclictest4057026-21kworker/0:1+events19:45:160
404589399243810,2424cyclictest4114696-21kworker/3:2+events22:42:403
404588899243011,2416cyclictest4094641-21kworker/1:2+events22:04:361
404588699241812,2402cyclictest4128905-21kworker/0:0+events23:27:270
404589399236411,2349cyclictest4087557-21kworker/3:2+events21:24:413
40458939923589,2346cyclictest4079514-21kworker/3:0+events20:55:393
40458889923309,2316cyclictest4062040-21kworker/1:0+events20:28:031
40458889923309,2316cyclictest4062040-21kworker/1:0+events20:28:021
404589199232612,2310cyclictest4078088-21kworker/2:0+events20:50:152
404589199231312,2298cyclictest4076367-21kworker/2:1+events20:58:222
404589399230711,2293cyclictest4051876-21kworker/3:0+events19:38:273
404589399228511,2271cyclictest4119523-21kworker/3:0+events22:59:463
404589199228511,2270cyclictest4111524-21kworker/2:0+events22:32:432
404588699227411,2261cyclictest4137195-21kworker/0:0+events23:55:090
404589399227211,2257cyclictest4073437-21kworker/3:0+events20:35:183
404589399227111,2257cyclictest4068499-21kworker/3:1+events20:17:503
404588699227110,2258cyclictest4121236-21kworker/0:1+events23:15:310
404589399226911,2255cyclictest4145233-21kworker/3:1+events00:23:013
404589399226811,2255cyclictest4075101-21kworker/3:2+events20:45:143
40458869922689,2256cyclictest4109944-21kworker/0:2+events22:27:410
404589399226710,2254cyclictest4094112-21kworker/3:0+events21:41:073
404588899226710,2254cyclictest4094641-21kworker/1:2+events21:45:121
40458869922668,2254cyclictest4137195-21kworker/0:0+events00:03:100
404589399226510,2251cyclictest4090910-21kworker/3:1+events21:31:113
404589399226411,2249cyclictest4113039-21kworker/3:1+events22:37:183
404589399226411,2249cyclictest4113039-21kworker/3:1+events22:37:183
404589399226311,2249cyclictest4051876-21kworker/3:0+events19:41:063
404589399226211,2249cyclictest4094112-21kworker/3:0+events22:05:473
404589399226211,2248cyclictest4087557-21kworker/3:2+events21:36:543
404588699226210,2249cyclictest4140447-21kworker/0:2+events00:13:030
404589399226111,2247cyclictest4134061-21kworker/3:1+events23:49:013
404589399226011,2247cyclictest4082753-21kworker/3:1+events21:15:083
404588699226010,2247cyclictest4140447-21kworker/0:2+events00:21:300
404589399225910,2246cyclictest4119523-21kworker/3:0+events23:03:083
404589399225910,2246cyclictest4084383-21kworker/3:0+events21:12:073
404588699225911,2245cyclictest4055345-21kworker/0:0+events19:38:060
40458939922576,2248cyclictest4094112-21kworker/3:0+events22:01:573
404589399225310,2240cyclictest4071766-21kworker/3:1+events20:29:103
404589399225310,2240cyclictest4071766-21kworker/3:1+events20:29:093
404588699225210,2239cyclictest4128905-21kworker/0:0+events23:44:570
404588899225012,2235cyclictest4089305-21kworker/1:0+events21:28:301
40458869922509,2237cyclictest4097454-21kworker/0:2+events21:52:260
40458869922499,2237cyclictest4121236-21kworker/0:1+events23:08:110
404589399224711,2233cyclictest4060502-21kworker/3:2+events19:54:313
404589399224610,2233cyclictest4116296-21kworker/3:1+events23:08:573
404589399224410,2230cyclictest4097422-21kworker/3:1+events21:49:483
404588699224211,2227cyclictest4101503-21kworker/0:2+events22:09:140
40458889922389,2226cyclictest4121147-21kworker/1:0+events23:09:221
404588699223411,2220cyclictest4127272-21kworker/0:2+events23:22:040
404588899223112,2216cyclictest4110240-21kworker/1:2+events22:47:381
404588899222910,2216cyclictest4105725-21kworker/1:1+events22:33:541
40458889922276,2218cyclictest4084261-21kworker/1:2+events21:09:271
404588899222611,2213cyclictest4119496-21kworker/1:1+events23:01:161
404588899222611,2212cyclictest4129753-21kworker/1:2+events23:46:491
404588899222410,2210cyclictest4132022-21kworker/1:1+events23:37:451
404588899222311,2209cyclictest4137286-21kworker/1:0+events00:22:371
404588899222310,2210cyclictest4129753-21kworker/1:2+events23:52:511
404588899222210,2209cyclictest4103851-21kworker/1:0+events22:15:231
404588899222210,2208cyclictest4141782-21kworker/1:2+events00:10:251
404588899222110,2208cyclictest4125976-21kworker/1:2+events23:23:371
404588899222110,2207cyclictest4062040-21kworker/1:0+events20:18:131
404588899222011,2206cyclictest4053805-21kworker/1:1+events19:47:111
404588899222011,2205cyclictest4052203-21kworker/1:0+events19:31:171
404588899221811,2205cyclictest4087510-21kworker/1:2+events21:20:041
404588899221711,2203cyclictest4151370-21kworker/1:0+events00:39:271
40458869922129,2199cyclictest4079816-21kworker/0:2+events20:57:120
404588899220710,2194cyclictest4110240-21kworker/1:2+events22:52:281
404589399220511,2191cyclictest4134061-21kworker/3:1+events23:55:343
404589399218610,2173cyclictest4062130-21kworker/3:0+events20:04:263
404588699218511,2171cyclictest4140447-21kworker/0:2+events00:06:150
40458889921849,2172cyclictest4127585-21kworker/1:1+events23:28:561
40458889921698,2157cyclictest4090894-21kworker/1:1+events21:42:541
40458939921667,2156cyclictest4148529-21kworker/3:1+events00:33:213
404588899216110,2148cyclictest4137286-21kworker/1:0+events00:19:591
40458939921605,2152cyclictest4124426-21kworker/3:0+events23:23:583
40458939921519,2139cyclictest4124426-21kworker/3:0+events23:26:173
404589399214110,2128cyclictest4141898-21kworker/3:1+events00:08:283
404588699213811,2124cyclictest4072805-21kworker/0:0+events20:43:430
404589399213510,2122cyclictest4124426-21kworker/3:0+events23:15:543
404588899213010,2117cyclictest4132022-21kworker/1:1+events23:40:461
40458919921298,2118cyclictest4055253-21kworker/2:2+events19:51:272
40458939921289,2115cyclictest4103643-21kworker/3:2+events22:28:053
404588699212810,2113cyclictest4093048-21kworker/0:1+events21:45:350
404588899212610,2113cyclictest4063825-21kworker/1:2+events20:07:061
404589199212511,2111cyclictest4089153-21kworker/2:2+events21:46:202
40458889921259,2112cyclictest4047482-21kworker/1:3+events19:15:141
404589399212310,2110cyclictest4103643-21kworker/3:2+events22:18:063
404589399211810,2105cyclictest4151280-21kworker/3:0+events00:36:463
404589399211810,2105cyclictest4055313-21kworker/3:1+events20:05:113
404589199211811,2104cyclictest4062100-21kworker/2:1+events20:04:022
404588699211810,2105cyclictest4063428-21kworker/0:2+events20:14:460
40458939921169,2104cyclictest4108519-21kworker/3:0+events22:52:053
40458939921169,2104cyclictest4043784-21kworker/3:0+events19:17:553
404589399211410,2101cyclictest4146856-21kworker/3:0+events00:26:273
40458919921149,2102cyclictest4100385-21kworker/2:0+events21:59:192
404588699211410,2101cyclictest4070431-21kworker/0:2+events20:26:070
404588699211410,2101cyclictest4070431-21kworker/0:2+events20:26:070
404589399211210,2100cyclictest4134061-21kworker/3:1+events00:00:073
404588699211210,2099cyclictest4121236-21kworker/0:1+events23:12:040
404588699211210,2099cyclictest4089243-21kworker/0:1+events21:26:160
404588699211210,2099cyclictest4060442-21kworker/0:0+events19:56:280
404589399211110,2098cyclictest4045539-21kworker/3:1+events19:13:183
404588699211110,2098cyclictest4128905-21kworker/0:0+events23:35:260
40458939921108,2100cyclictest4075101-21kworker/3:2+events20:50:393
404589399211010,2097cyclictest4140207-21kworker/3:2+events00:12:413
40458939921099,2097cyclictest4135683-21kworker/3:2+events23:53:363
404589399210810,2096cyclictest4122758-21kworker/3:2+events23:14:013
404588699210810,2095cyclictest4105338-21kworker/0:1+events22:36:550
404588699210810,2095cyclictest4105338-21kworker/0:1+events22:36:550
404589399210710,2094cyclictest4055313-21kworker/3:1+events19:56:053
404589399210710,2094cyclictest4051876-21kworker/3:0+events19:26:193
404589199210710,2094cyclictest4127330-21kworker/2:2+events23:34:162
404588899210710,2093cyclictest4073314-21kworker/1:2+events20:40:191
40458869921077,2097cyclictest4117827-21kworker/0:2+events23:04:420
40458869921075,2098cyclictest4099052-21kworker/0:0+events21:58:070
40458939921068,2095cyclictest4128876-21kworker/3:2+events23:32:193
404589399210610,2093cyclictest4075101-21kworker/3:2+events21:01:263
40458939921059,2093cyclictest4082753-21kworker/3:1+events21:07:083
40458939921059,2093cyclictest4071766-21kworker/3:1+events20:33:473
40458939921057,2095cyclictest4068499-21kworker/3:1+events20:21:123
40458869921055,2097cyclictest4063428-21kworker/0:2+events20:17:270
404588699210511,2091cyclictest4111554-21kworker/0:0+events22:50:110
404588699210510,2092cyclictest4095733-21kworker/0:0+events21:43:410
40458869921047,2094cyclictest4087590-21kworker/0:0+events21:18:320
404588699210410,2091cyclictest4132415-21kworker/0:1+events23:49:260
404588699210410,2091cyclictest4105338-21kworker/0:1+events22:16:330
404589199210310,2090cyclictest4103734-21kworker/2:2+events22:17:202
40458869921037,2093cyclictest4050805-21kworker/0:2+events19:25:080
404588699210310,2090cyclictest4078152-21kworker/0:1+events21:10:360
404589399210210,2089cyclictest4051876-21kworker/3:0+events19:30:303
40458869921026,2093cyclictest4074828-21kworker/0:1+events20:37:360
404588699210210,2089cyclictest4146794-21kworker/0:0+events00:29:510
404588699210210,2089cyclictest4057026-21kworker/0:1+events20:04:490
404589399210110,2088cyclictest4099023-21kworker/3:2+events21:58:313
40458939920996,2090cyclictest4089183-21kworker/3:0+events21:25:273
40458889920997,2089cyclictest4105725-21kworker/1:1+events22:24:151
40458869920997,2089cyclictest4090943-21kworker/0:0+events21:31:350
404588699209910,2086cyclictest4093048-21kworker/0:1+events22:00:270
40458939920989,2086cyclictest4128876-21kworker/3:2+events23:38:093
404589399209810,2085cyclictest4094112-21kworker/3:0+events21:50:343
404589199209811,2084cyclictest4151247-21kworker/2:1+events00:38:392
404588899209810,2085cyclictest4100596-21kworker/1:1+events22:05:231
40458869920988,2087cyclictest4067076-21kworker/0:1+events20:23:080
404589199209510,2082cyclictest4089153-21kworker/2:2+events21:27:222
40458889920958,2083cyclictest4060289-21kworker/1:2+events19:52:141
404589199209411,2080cyclictest4081306-21kworker/2:2+events21:04:032
40458889920947,2084cyclictest4075008-21kworker/1:0+events20:39:311
40458869920944,2087cyclictest4052441-21kworker/0:1+events19:30:540
404588699209410,2081cyclictest4109944-21kworker/0:2+events22:30:230
40458869920939,2081cyclictest4093048-21kworker/0:1+events21:36:070
40458939920908,2079cyclictest4108519-21kworker/3:0+events22:24:373
40458919920908,2079cyclictest4097584-21kworker/2:1+events22:08:282
40458869920907,2080cyclictest4113185-21kworker/0:2+events22:40:470
404588699209010,2076cyclictest4085839-21kworker/0:2+events21:21:140
40458889920879,2075cyclictest4103851-21kworker/1:0+events22:25:221
404589199208611,2072cyclictest4132975-21kworker/2:1+events23:52:282
404588899208312,2068cyclictest4045569-21kworker/1:2+events19:10:151
404588899208210,2069cyclictest4121147-21kworker/1:0+events23:16:411
404588699208010,2067cyclictest4140447-21kworker/0:2+events00:17:160
404588899207710,2064cyclictest4110240-21kworker/1:2+events22:57:501
404589399207610,2063cyclictest4103643-21kworker/3:2+events22:33:083
404588899207610,2062cyclictest4137286-21kworker/1:0+events00:05:511
404589199207511,2061cyclictest4127330-21kworker/2:2+events23:38:332
40458889920737,2063cyclictest4070346-21kworker/1:1+events20:32:131
404588899207210,2059cyclictest4079578-21kworker/1:0+events20:52:111
40458889920709,2059cyclictest4105725-21kworker/1:1+events22:35:041
40458889920709,2059cyclictest4105725-21kworker/1:1+events22:35:031
404588899207010,2057cyclictest4103851-21kworker/1:0+events22:10:431
40458919920699,2056cyclictest4063708-21kworker/2:2+events20:15:092
404588899206910,2056cyclictest4062040-21kworker/1:0+events20:24:391
40458869920697,2059cyclictest4048969-21kworker/0:0+events19:24:220
40458919920689,2057cyclictest4106983-21kworker/2:1+events22:39:592
40458919920689,2057cyclictest4106983-21kworker/2:1+events22:39:592
40458889920689,2056cyclictest4135652-21kworker/1:1+events23:57:041
404588899206810,2055cyclictest4079578-21kworker/1:0+events21:01:021
40458889920678,2056cyclictest4055711-21kworker/1:2+events19:43:461
40458889920675,2059cyclictest4047482-21kworker/1:3+events19:28:581
40458889920667,2056cyclictest4100596-21kworker/1:1+events21:59:421
40458889920665,2058cyclictest4137286-21kworker/1:0+events00:25:411
404588899206610,2053cyclictest4122788-21kworker/1:1+events23:10:301
40458889920659,2053cyclictest4077966-21kworker/1:1+events20:46:461
40458889920659,2053cyclictest4062040-21kworker/1:0+events19:59:501
404588899206510,2052cyclictest4090894-21kworker/1:1+events21:30:491
40458889920649,2052cyclictest4121147-21kworker/1:0+events23:31:551
40458889920649,2052cyclictest4094641-21kworker/1:2+events21:50:571
40458889920639,2051cyclictest4053805-21kworker/1:1+events20:01:241
40458869920636,2053cyclictest4135419-21kworker/0:2+events23:53:140
40458869920579,2045cyclictest4107086-21kworker/0:0+events22:21:340
40458869920529,2040cyclictest4063428-21kworker/0:2+events20:09:250
404589199205011,2036cyclictest4052321-21kworker/2:0+events19:39:562
40458869920468,2035cyclictest4146794-21kworker/0:0+events00:33:440
404589199204410,2031cyclictest4135593-21kworker/2:2+events23:56:412
40458919920428,2031cyclictest4132975-21kworker/2:1+events23:41:332
40458939920419,2029cyclictest4056939-21kworker/3:2+events19:46:253
40458939920404,2033cyclictest4143500-21kworker/3:0+events00:15:423
40458939920398,2028cyclictest4073437-21kworker/3:0+events20:44:293
404588899203710,2024cyclictest4137286-21kworker/1:0+events00:02:481
404589199203411,2020cyclictest4084864-21kworker/2:1+events21:15:512
404588899203410,2021cyclictest4110240-21kworker/1:2+events22:41:101
40458869920328,2021cyclictest4101503-21kworker/0:2+events22:13:510
40458869920319,2019cyclictest4032424-21kworker/0:1+events19:16:220
40458869920309,2018cyclictest4128905-21kworker/0:0+events23:32:410
40458869920246,2015cyclictest4078152-21kworker/0:1+events20:54:290
404589199202210,2009cyclictest4050716-21kworker/2:2+events19:25:552
40458889920205,2012cyclictest4062040-21kworker/1:0+events20:12:501
404589199201911,2005cyclictest4138858-21kworker/2:1+events00:09:142
40458889920199,2007cyclictest4053805-21kworker/1:1+events19:36:111
40458919920169,2004cyclictest4128940-21kworker/2:1+events23:27:492
40458889920139,2001cyclictest4081511-21kworker/1:1+events21:16:381
40458889920114,2004cyclictest4081511-21kworker/1:1+events21:14:231
404588699201010,1997cyclictest4072805-21kworker/0:0+events20:48:200
40458889920049,1991cyclictest4047482-21kworker/1:3+events19:21:431
404589199200311,1989cyclictest4113338-21kworker/2:2+events22:43:022
40458889920029,1990cyclictest4148098-21kworker/1:1+events00:31:231
40458919919996,1992cyclictest4141406-21kworker/2:0+events00:10:012
40458919919979,1984cyclictest4122726-21kworker/2:0+events23:23:132
40458869919969,1984cyclictest4114989-21kworker/0:1+events22:56:180
404589199199411,1980cyclictest4089153-21kworker/2:2+events21:44:052
404589199199410,1980cyclictest4084864-21kworker/2:1+events21:22:212
40458889919939,1981cyclictest4073314-21kworker/1:2+events20:56:021
40458919919825,1974cyclictest4089153-21kworker/2:2+events21:54:422
404589199198110,1968cyclictest4118041-21kworker/2:2+events22:57:042
404589199198110,1968cyclictest4089153-21kworker/2:2+events21:39:132
40458869919789,1966cyclictest4043802-21kworker/0:2+events19:11:240
40458919919758,1964cyclictest4049063-21kworker/2:0+events19:19:482
40458919919738,1962cyclictest4073526-21kworker/2:0+events20:35:402
404589199197310,1960cyclictest4118041-21kworker/2:2+events23:08:352
40458919919729,1960cyclictest4105368-21kworker/2:0+events22:23:292
404589199197210,1959cyclictest4062100-21kworker/2:1+events20:08:172
404589199197110,1958cyclictest4146764-21kworker/2:2+events00:29:292
404589199196910,1956cyclictest4138858-21kworker/2:1+events00:23:472
40458919919648,1953cyclictest4070202-21kworker/2:2+events20:28:252
40458919919648,1953cyclictest4070202-21kworker/2:2+events20:28:242
40458919919634,1956cyclictest4119676-21kworker/2:1+events23:02:462
404589199196310,1950cyclictest4100385-21kworker/2:0+events22:01:122
40458919919627,1952cyclictest4138858-21kworker/2:1+events00:19:122
404589199196210,1949cyclictest4070202-21kworker/2:2+events20:34:562
40458919919613,1955cyclictest4043742-21kworker/2:1+events19:14:032
404589199196110,1948cyclictest4070202-21kworker/2:2+events20:40:422
40458919919609,1948cyclictest4066897-21kworker/2:0+events20:12:062
40458919919587,1948cyclictest4066897-21kworker/2:0+events20:20:272
404589199195510,1942cyclictest4056907-21kworker/2:1+events19:42:142
404589199195210,1938cyclictest4116265-21kworker/2:0+events22:54:252
40458919919519,1939cyclictest4043742-21kworker/2:1+events19:33:302
40458919919509,1938cyclictest4089153-21kworker/2:2+events21:33:542
40458919919507,1940cyclictest4108663-21kworker/2:2+events22:27:192
404589199194110,1928cyclictest4138858-21kworker/2:1+events00:03:342
40458919919384,1931cyclictest4103734-21kworker/2:2+events22:14:122
404589199193710,1924cyclictest4082958-21kworker/2:0+events21:07:552
40458919919309,1918cyclictest4132975-21kworker/2:1+events23:47:542
40458919919258,1914cyclictest4056907-21kworker/2:1+events19:45:392
404589199192010,1906cyclictest4148396-21kworker/2:0+events00:31:462
40458919919198,1908cyclictest4043742-21kworker/2:1+events19:23:152
40458919918959,1883cyclictest4070202-21kworker/2:2+events20:45:392
40458919918946,1885cyclictest4122726-21kworker/2:0+events23:18:382
40458919918944,1887cyclictest4106983-21kworker/2:1+events22:46:512
40455802142108,29sleep20-21swapper/219:09:262
4045463214295,24sleep00-21swapper/019:07:560
4044308214193,42sleep30-21swapper/319:05:113
40454692140112,23sleep10-21swapper/119:08:011
404589199170,15cyclictest4124169-21runrttasks23:11:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional