You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 23:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Thu Nov 20, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310250299282213,2805cyclictest3137614-21kworker/0:0+events21:25:010
310251399274013,2723cyclictest3157161-21kworker/3:1+events22:29:593
310251399269612,2678cyclictest3118553-21kworker/3:2+events20:40:143
310251399255810,2543cyclictest3180812-21kworker/3:1+events23:45:223
310251399255112,2534cyclictest3113582-21kworker/3:0+events20:10:203
310251399246111,2447cyclictest3118553-21kworker/3:2+events20:30:233
310251399244712,2429cyclictest3108023-21kworker/3:2+events19:56:113
31025139924449,2433cyclictest3111979-21kworker/3:1+events20:15:143
310251399243112,2416cyclictest3110088-21kworker/3:0+events20:00:243
310250299242412,2408cyclictest3169681-21kworker/0:1+events23:23:580
310250299240011,2386cyclictest3187164-21kworker/0:0+events00:01:240
310250299239912,2384cyclictest3107791-21kworker/0:2+events20:09:100
310250999239712,2382cyclictest3152240-21kworker/2:2+events22:15:532
310250999239412,2380cyclictest3179388-21kworker/2:1+events23:35:042
310250299239412,2379cyclictest3144289-21kworker/0:1+events21:54:230
310250999239011,2376cyclictest3126803-21kworker/2:1+events21:01:042
310250999238411,2369cyclictest3126803-21kworker/2:1+events20:52:432
310251399238111,2368cyclictest3111979-21kworker/3:1+events20:20:103
310250799234812,2332cyclictest3126487-21kworker/1:2+events21:05:151
310250799233712,2322cyclictest3141156-21kworker/1:0+events21:35:251
310250999233110,2316cyclictest3152240-21kworker/2:2+events22:22:022
310250799233012,2315cyclictest3193958-21kworker/1:2+events00:23:371
310250299230911,2294cyclictest3158672-21kworker/0:2+events22:41:000
310250299229210,2278cyclictest3144289-21kworker/0:1+events21:45:170
310251399225113,2235cyclictest3164888-21kworker/3:1+events22:50:263
310250299223710,2224cyclictest3149131-21kworker/0:2+events22:04:470
310250299223611,2222cyclictest3183914-21kworker/0:1+events23:51:490
310250299223311,2218cyclictest3100460-21kworker/0:1+events19:28:170
310250299222910,2217cyclictest3144289-21kworker/0:1+events22:10:090
310251399222711,2213cyclictest3184048-21kworker/3:0+events23:53:233
310250999222211,2208cyclictest3134422-21kworker/2:0+events21:19:172
310250999221811,2204cyclictest3116724-21kworker/2:0+events20:33:232
310250299221812,2203cyclictest3185561-21kworker/0:2+events23:57:120
310250299221512,2201cyclictest3107791-21kworker/0:2+events20:55:010
310251399221410,2201cyclictest3176326-21kworker/3:2+events23:29:183
31025099922108,2199cyclictest3126803-21kworker/2:1+events21:12:042
310250999220910,2195cyclictest3123504-21kworker/2:1+events20:43:162
310250299220911,2195cyclictest3190678-21kworker/0:0+events00:12:260
310250299220812,2194cyclictest3165245-21kworker/0:2+events22:55:230
310250999220511,2192cyclictest3109049-21kworker/2:1+events19:55:272
310250999220411,2189cyclictest3176086-21kworker/2:2+events23:23:132
310250299220311,2189cyclictest3147519-21kworker/0:0+events21:56:440
310250299220310,2190cyclictest3198768-21kworker/0:0+events00:36:180
310250299220310,2189cyclictest3141077-21kworker/0:0+events21:33:300
310251399220211,2188cyclictest3157161-21kworker/3:1+events22:35:393
310251399220211,2188cyclictest3108023-21kworker/3:2+events20:06:083
310251399220211,2188cyclictest3106685-21kworker/3:1+events19:40:483
310250999220210,2189cyclictest3115067-21kworker/2:1+events20:20:542
310250299220210,2188cyclictest3169681-21kworker/0:1+events23:05:160
310250999220111,2187cyclictest3182701-21kworker/2:1+events23:46:512
31025029922019,2189cyclictest3131459-21kworker/0:1+events21:18:550
310250299220110,2188cyclictest3107791-21kworker/0:2+events20:26:110
310251399220011,2185cyclictest3162026-21kworker/3:2+events22:41:233
31025139921999,2187cyclictest3171436-21kworker/3:1+events23:23:353
31025099921999,2186cyclictest3115067-21kworker/2:1+events20:11:272
310250299219910,2186cyclictest3195558-21kworker/0:0+events00:28:380
31025139921989,2186cyclictest3180812-21kworker/3:1+events23:43:043
310251399219811,2184cyclictest3103755-21kworker/3:2+events19:26:203
310251399219811,2183cyclictest3135729-21kworker/3:0+events21:24:383
310250999219811,2184cyclictest3182701-21kworker/2:1+events23:53:442
310250999219811,2184cyclictest3157101-21kworker/2:0+events23:09:072
310251399219711,2183cyclictest3185684-21kworker/3:1+events00:02:563
31025099921979,2186cyclictest3107319-21kworker/2:0+events20:05:002
31025029921979,2185cyclictest3165245-21kworker/0:2+events22:53:320
310250299219711,2183cyclictest3176237-21kworker/0:0+events23:33:340
310250299219710,2184cyclictest3173003-21kworker/0:2+events23:18:140
310250299219710,2184cyclictest3124975-21kworker/0:0+events20:51:590
310251399219611,2183cyclictest3173063-21kworker/3:0+events23:30:053
310251399219611,2182cyclictest3173063-21kworker/3:0+events23:18:383
310251399219611,2182cyclictest3124917-21kworker/3:0+events20:47:523
310251399219611,2181cyclictest3105101-21kworker/3:1+events19:32:223
31025099921968,2185cyclictest3134422-21kworker/2:0+events21:30:482
31025099921967,2186cyclictest3125124-21kworker/2:0+events20:45:092
310250999219611,2181cyclictest3115067-21kworker/2:1+events20:18:362
31025029921968,2185cyclictest3160331-21kworker/0:1+events22:37:330
310250299219611,2182cyclictest3188819-21kworker/0:1+events00:32:530
310250299219611,2182cyclictest3171408-21kworker/0:0+events23:12:300
310250299219611,2182cyclictest3142666-21kworker/0:2+events21:43:240
310250299219610,2184cyclictest3141077-21kworker/0:0+events21:35:030
310251399219511,2181cyclictest3185684-21kworker/3:1+events23:59:053
310250999219510,2181cyclictest3200414-21kworker/2:1+events00:37:462
310250999219411,2180cyclictest3193862-21kworker/2:2+events00:19:462
310250999219410,2180cyclictest3152240-21kworker/2:2+events22:32:152
31025099921939,2181cyclictest3116724-21kworker/2:0+events20:25:482
31025029921937,2183cyclictest3106156-21kworker/0:0+events19:39:170
310251399218411,2170cyclictest3145683-21kworker/3:2+events22:10:563
31025029921847,2174cyclictest3144289-21kworker/0:1+events22:22:260
310250299218411,2170cyclictest3113776-21kworker/0:1+events20:14:040
310250999218210,2168cyclictest3104896-21kworker/2:2+events19:25:582
310250799218212,2167cyclictest3112010-21kworker/1:0+events20:03:051
310250299218210,2169cyclictest3110534-21kworker/0:1+events20:02:180
310251399218111,2167cyclictest3107378-21kworker/3:0+events19:45:193
31025139921807,2170cyclictest3137647-21kworker/3:1+events21:32:213
310251399218010,2167cyclictest3128173-21kworker/3:2+events21:08:453
310251399217910,2166cyclictest3173063-21kworker/3:0+events23:35:493
310250299217810,2164cyclictest3106156-21kworker/0:0+events19:46:070
31025139921758,2164cyclictest3126582-21kworker/3:1+events20:51:343
310250999217411,2160cyclictest3126803-21kworker/2:1+events21:09:522
310250999217311,2159cyclictest3149043-21kworker/2:0+events21:59:272
310250999217211,2159cyclictest3104896-21kworker/2:2+events19:35:032
31025029921726,2163cyclictest3188819-21kworker/0:1+events00:24:240
310250299217211,2157cyclictest3131459-21kworker/0:1+events21:11:230
310250299217210,2159cyclictest3161995-21kworker/0:0+events22:47:040
310251399217110,2158cyclictest3193799-21kworker/3:0+events00:20:333
310250999217110,2157cyclictest3174427-21kworker/2:0+events23:16:422
31025099921683,2162cyclictest3161934-21kworker/2:1+events22:44:232
31025139921626,2153cyclictest3128173-21kworker/3:2+events21:19:403
310250299216211,2148cyclictest3188819-21kworker/0:1+events00:07:490
31025139921576,2148cyclictest3164888-21kworker/3:1+events22:45:553
310251399215310,2139cyclictest3141215-21kworker/3:0+events21:48:423
31025099921529,2140cyclictest3176086-21kworker/2:2+events23:26:382
31025029921516,2142cyclictest3100460-21kworker/0:1+events19:32:450
31025029921479,2135cyclictest3117099-21kworker/0:1+events20:21:160
310250799213811,2124cyclictest3169978-21kworker/1:0+events23:05:401
310250299213711,2123cyclictest3106156-21kworker/0:0+events19:42:380
310251399213610,2123cyclictest3169831-21kworker/3:2+events23:04:093
31025099921368,2124cyclictest3182701-21kworker/2:1+events00:04:282
310250299213611,2121cyclictest3121660-21kworker/0:0+events20:34:100
31025099921324,2124cyclictest3136173-21kworker/2:2+events21:29:162
31025079921285,2120cyclictest3113793-21kworker/1:2+events20:09:561
310250299212410,2111cyclictest3169681-21kworker/0:1+events23:25:300
31025029921229,2109cyclictest3129837-21kworker/0:0+events21:03:210
310250799212111,2107cyclictest3190614-21kworker/1:0+events00:19:231
31025079921204,2113cyclictest3134483-21kworker/1:1+events21:13:361
310250799212011,2105cyclictest3126487-21kworker/1:2+events21:15:521
31025029921197,2109cyclictest3107791-21kworker/0:2+events19:55:490
310250799211711,2102cyclictest3104567-21kworker/1:1+events19:29:261
310251399211611,2102cyclictest3189067-21kworker/3:0+events00:07:263
310250799211610,2103cyclictest3145743-21kworker/1:0+events22:12:271
31025139921159,2103cyclictest3143104-21kworker/3:1+events21:42:593
310250799211411,2101cyclictest3187257-21kworker/1:2+events00:01:471
310250799211411,2100cyclictest3145743-21kworker/1:0+events21:57:301
310251399211311,2099cyclictest3187319-21kworker/3:2+events00:27:063
310250999211210,2099cyclictest3157101-21kworker/2:0+events22:38:212
310251399211110,2098cyclictest3158792-21kworker/3:0+events22:33:443
31025029921109,2098cyclictest3131459-21kworker/0:1+events21:05:390
310250799210911,2095cyclictest3187257-21kworker/1:2+events00:10:301
31025139921069,2093cyclictest3123295-21kworker/3:1+events20:39:503
310250799210611,2092cyclictest3142814-21kworker/1:1+events21:46:491
310250799210511,2091cyclictest3166577-21kworker/1:1+events23:04:521
310250299210510,2092cyclictest3107791-21kworker/0:2+events20:17:290
310250799210411,2089cyclictest3107118-21kworker/1:2+events19:44:101
310250799210410,2091cyclictest3126487-21kworker/1:2+events21:27:201
310250799210311,2089cyclictest3109169-21kworker/1:2+events20:00:011
310250799210311,2088cyclictest3118494-21kworker/1:0+events20:42:061
310250799210111,2086cyclictest3112010-21kworker/1:0+events20:12:331
310250299210111,2087cyclictest3124975-21kworker/0:0+events20:43:380
310250999209910,2086cyclictest3121871-21kworker/2:2+events20:58:242
310250999209711,2083cyclictest3121871-21kworker/2:2+events20:39:052
31025079920929,2080cyclictest3121728-21kworker/1:1+events20:49:431
310250799208710,2074cyclictest3161814-21kworker/1:0+events22:51:581
310251399208610,2073cyclictest3197133-21kworker/3:0+events00:30:583
310251399208211,2068cyclictest3158792-21kworker/3:0+events23:06:263
310251399207710,2064cyclictest3145683-21kworker/3:2+events21:59:033
31025099920779,2065cyclictest3182701-21kworker/2:1+events23:57:352
310250299207710,2065cyclictest3182316-21kworker/0:2+events23:45:000
31025079920757,2065cyclictest3113793-21kworker/1:2+events20:15:581
310251399207111,2057cyclictest3131399-21kworker/3:1+events21:11:443
310250299206910,2056cyclictest3100460-21kworker/0:1+events19:51:390
310251399206510,2052cyclictest3100518-21kworker/3:1+events19:21:043
31025079920649,2052cyclictest3190614-21kworker/1:0+events00:36:401
310251399206110,2048cyclictest3145683-21kworker/3:2+events21:52:543
310250999206111,2046cyclictest3152240-21kworker/2:2+events22:26:122
310250999206110,2048cyclictest3104896-21kworker/2:2+events19:53:082
31025029920608,2048cyclictest3131459-21kworker/0:1+events21:26:100
310250999205710,2044cyclictest3192191-21kworker/2:1+events00:12:482
310250999205710,2044cyclictest3141297-21kworker/2:1+events22:08:592
31025029920559,2043cyclictest3160331-21kworker/0:1+events22:34:300
310250299205310,2040cyclictest3188819-21kworker/0:1+events00:16:170
31025099920528,2041cyclictest3103906-21kworker/2:0+events19:23:412
31025029920498,2037cyclictest3176237-21kworker/0:0+events23:36:110
310251399204810,2035cyclictest3197133-21kworker/3:0+events00:38:333
310250999204810,2035cyclictest3157101-21kworker/2:0+events22:54:392
31025139920473,2041cyclictest3169831-21kworker/3:2+events23:12:513
310250999204710,2035cyclictest3157101-21kworker/2:0+events22:59:562
31025099920468,2034cyclictest3136173-21kworker/2:2+events21:39:112
310250999204510,2032cyclictest3087843-21kworker/2:2+events19:13:502
310250299204510,2032cyclictest3155055-21kworker/0:2+events22:17:010
31025099920449,2031cyclictest3193862-21kworker/2:2+events00:34:232
31025139920439,2031cyclictest3155472-21kworker/3:0+events22:20:533
310251399204310,2030cyclictest3145683-21kworker/3:2+events22:18:353
31025099920439,2031cyclictest3141297-21kworker/2:1+events21:41:052
31025099920439,2030cyclictest3157101-21kworker/2:0+events22:49:412
31025099920438,2032cyclictest3174427-21kworker/2:0+events23:33:562
31025099920434,2036cyclictest3141297-21kworker/2:1+events22:02:522
310250999204310,2030cyclictest3190500-21kworker/2:2+events00:06:192
310250999204310,2029cyclictest3180990-21kworker/2:2+events23:43:502
310250299204310,2031cyclictest3100460-21kworker/0:1+events19:15:200
310251399204210,2029cyclictest3137647-21kworker/3:1+events21:25:473
31025099920428,2031cyclictest3103906-21kworker/2:0+events19:19:312
31025099920425,2033cyclictest3104896-21kworker/2:2+events19:43:472
310250999204210,2029cyclictest3146047-21kworker/2:2+events21:52:312
310250299204210,2029cyclictest3149131-21kworker/0:2+events22:09:230
31025139920408,2029cyclictest3106685-21kworker/3:1+events19:53:323
31025139920406,2032cyclictest3192100-21kworker/3:1+events00:15:093
310251399204010,2027cyclictest3147403-21kworker/3:1+events22:00:123
31025029920407,2030cyclictest3098842-21kworker/0:2+events19:14:120
31025099920397,2029cyclictest3193862-21kworker/2:2+events00:25:342
31025029920399,2027cyclictest3169681-21kworker/0:1+events23:03:440
310250299203810,2025cyclictest3100460-21kworker/0:1+events19:20:420
310251399203710,2024cyclictest3128173-21kworker/3:2+events21:03:433
31025139920358,2024cyclictest3158792-21kworker/3:0+events22:56:543
310250999203510,2021cyclictest3109049-21kworker/2:1+events20:03:532
310250999203410,2021cyclictest3170044-21kworker/2:1+events23:10:152
310250999203410,2021cyclictest3141297-21kworker/2:1+events22:12:042
310250299202610,2013cyclictest3182316-21kworker/0:2+events23:43:270
31025139920249,2011cyclictest3111979-21kworker/3:1+events20:29:133
31025139920239,2011cyclictest3187319-21kworker/3:2+events00:10:523
310250799202211,2008cyclictest3159180-21kworker/1:1+events22:31:081
31025099920218,2010cyclictest3144112-21kworker/2:0+events21:45:402
31025139920208,2009cyclictest3105742-21kworker/3:2+events19:38:553
31025079920129,2000cyclictest3142814-21kworker/1:1+events21:41:511
310250799200410,1991cyclictest3155594-21kworker/1:2+events22:25:241
310250299200410,1991cyclictest3107791-21kworker/0:2+events20:47:270
31025099919999,1987cyclictest3105572-21kworker/2:0+events19:31:362
31025079919998,1987cyclictest3118494-21kworker/1:0+events20:35:431
31025139919959,1984cyclictest3150666-21kworker/3:0+events22:05:093
31025139919909,1978cyclictest3128173-21kworker/3:2+events20:58:003
310250799199011,1976cyclictest3092704-21kworker/1:2+events19:21:491
31025029919892,1984cyclictest3123356-21kworker/0:1+events20:39:280
31025079919879,1975cyclictest3145743-21kworker/1:0+events22:06:421
31025099919859,1973cyclictest3134422-21kworker/2:0+events21:24:152
31025079919848,1974cyclictest3171620-21kworker/1:2+events23:40:011
31025029919829,1970cyclictest3157041-21kworker/0:0+events22:26:590
31025079919818,1970cyclictest3153695-21kworker/1:1+events22:20:281
31025099919798,1968cyclictest3165214-21kworker/2:2+events23:02:352
31025099919779,1965cyclictest3195476-21kworker/2:1+events00:24:472
31025139919758,1964cyclictest3100518-21kworker/3:1+events19:14:343
310251399197510,1962cyclictest3100518-21kworker/3:1+events19:16:523
31025099919759,1960cyclictest3104896-21kworker/2:2+events19:48:412
310250799196210,1949cyclictest3155594-21kworker/1:2+events22:19:191
310250799196110,1948cyclictest3126487-21kworker/1:2+events20:54:141
31025079919599,1947cyclictest3159180-21kworker/1:1+events22:36:471
31025079919596,1950cyclictest3145743-21kworker/1:0+events21:52:071
31025079919589,1946cyclictest3102846-21kworker/1:1+events19:17:371
31025079919587,1948cyclictest3190614-21kworker/1:0+events00:29:001
31025079919546,1944cyclictest3113793-21kworker/1:2+events20:28:031
310250799195210,1939cyclictest3184078-21kworker/1:1+events23:58:211
310250799195210,1939cyclictest3169978-21kworker/1:0+events23:14:211
31025079919519,1939cyclictest3171620-21kworker/1:2+events23:34:191
310250799195110,1938cyclictest3190614-21kworker/1:0+events00:32:281
310250799195110,1938cyclictest3105218-21kworker/1:0+events19:33:311
310250799194910,1936cyclictest3181050-21kworker/1:0+events23:47:561
310250799194910,1936cyclictest3126487-21kworker/1:2+events21:33:541
31025079919489,1936cyclictest3166577-21kworker/1:1+events22:59:331
310250799194810,1935cyclictest3179418-21kworker/1:1+events23:36:351
310250799194810,1935cyclictest3121728-21kworker/1:1+events20:34:331
31025079919478,1935cyclictest3113793-21kworker/1:2+events20:23:541
310250799194710,1934cyclictest3171620-21kworker/1:2+events23:27:211
310250799194510,1932cyclictest3174702-21kworker/1:1+events23:24:221
31025079919338,1922cyclictest3163554-21kworker/1:2+events22:47:281
31025079919202,1915cyclictest3092704-21kworker/1:2+events19:13:261
31025079919169,1904cyclictest3104567-21kworker/1:1+events19:36:111
31025079918959,1883cyclictest3105218-21kworker/1:0+events19:49:261
31025079918933,1887cyclictest3136342-21kworker/1:0+events21:21:101
31025079918913,1885cyclictest3161814-21kworker/1:0+events22:43:361
31025079918897,1879cyclictest3171620-21kworker/1:2+events23:19:461
31025079918818,1870cyclictest3145743-21kworker/1:0+events22:00:581
310250799188010,1867cyclictest3190614-21kworker/1:0+events00:09:221
31025079918376,1828cyclictest3121728-21kworker/1:1+events20:56:541
31021122141110,26sleep20-21swapper/219:07:532
31020352140112,23sleep30-21swapper/319:06:533
31019672140104,30sleep00-21swapper/019:05:580
31020742139107,27sleep10-21swapper/119:07:241
310250799210,13cyclictest3184822-21irqstats23:50:181
310250799169,5cyclictest3131379-21sshd21:03:201
3102507991611,4cyclictest3108720-21seq19:51:361
310251399140,13cyclictest3141508-21/usr/sbin/munin21:35:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional