You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 00:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Mar 09, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44108499359218,3569cyclictest526181-21kworker/1:2+events23:35:131
44107999293614,2918cyclictest524093-21kworker/0:2+events23:55:000
44108499283513,2820cyclictest532244-21kworker/1:0+events00:00:191
44108499282513,2810cyclictest492471-21kworker/1:2+events21:55:011
44108999282113,2806cyclictest524309-21kworker/3:2+events23:30:143
4410869926977,2685cyclictest480929-21kworker/2:0+events21:15:182
44108699267812,2661cyclictest517930-21kworker/2:0+events23:10:202
44108999266913,2651cyclictest492663-21kworker/3:2+events22:05:163
44108999263413,2617cyclictest464974-21kworker/3:0+events20:25:173
44108999258212,2566cyclictest474387-21kworker/3:1+events21:25:173
44107999257111,2553cyclictest471392-21kworker/0:2+events20:50:130
44108999255012,2535cyclictest450568-21kworker/3:0+events20:01:033
44107999254412,2528cyclictest524093-21kworker/0:2+events23:50:000
44108499252512,2509cyclictest468051-21kworker/1:0+events20:45:181
44108999251712,2502cyclictest520989-21kworker/3:0+events23:38:363
44108999251412,2498cyclictest453882-21kworker/3:2+events19:52:463
44108499251412,2499cyclictest477552-21kworker/1:2+events21:20:171
44107999250612,2491cyclictest545284-21kworker/0:3+events00:39:550
4410799924995,2490cyclictest492721-21kworker/0:1+events21:50:490
44108699249612,2482cyclictest503771-21kworker/2:0+events22:25:052
44107999249612,2482cyclictest505163-21kworker/0:2+events22:30:480
44107999249612,2481cyclictest538638-21kworker/0:0+events00:12:290
44107999249412,2478cyclictest456844-21kworker/0:0+events19:57:390
44108499248911,2474cyclictest455453-21kworker/1:0+events20:00:181
44107999248912,2475cyclictest484370-21kworker/0:0+events21:32:540
44108999248812,2473cyclictest511689-21kworker/3:1+events22:55:513
44108999248810,2475cyclictest500328-21kworker/3:2+events22:42:183
4410799924883,2482cyclictest471392-21kworker/0:2+events20:45:420
44108499248610,2472cyclictest535555-21kworker/1:2+events00:05:151
44107999248611,2472cyclictest524093-21kworker/0:2+events23:42:260
44108999248512,2470cyclictest472756-21kworker/3:0+events20:47:573
44108999248512,2469cyclictest503593-21kworker/3:1+events22:26:373
44107999248512,2470cyclictest468139-21kworker/0:0+events20:43:450
44108999248412,2470cyclictest526212-21kworker/3:1+events23:55:453
44108999248412,2469cyclictest461661-21kworker/3:2+events20:17:443
44107999248412,2469cyclictest534217-21kworker/0:0+events00:04:530
44107999248412,2469cyclictest513194-21kworker/0:1+events23:12:140
44107999248312,2468cyclictest492721-21kworker/0:1+events21:59:360
44107999248212,2466cyclictest489209-21kworker/0:1+events21:39:290
44107999248211,2468cyclictest484370-21kworker/0:0+events21:40:150
44107999248112,2466cyclictest484370-21kworker/0:0+events21:49:410
44108999248012,2465cyclictest545047-21kworker/3:1+events00:37:383
44107999247912,2464cyclictest522466-21kworker/0:0+events23:24:020
44108999247511,2460cyclictest526212-21kworker/3:1+events23:47:193
44108999247312,2458cyclictest511689-21kworker/3:1+events22:50:563
44107999247212,2458cyclictest531026-21kworker/0:3+events00:16:220
44107999246512,2449cyclictest513194-21kworker/0:1+events23:06:090
44108999246412,2449cyclictest461661-21kworker/3:2+events20:37:193
44108999246212,2448cyclictest461661-21kworker/3:2+events20:55:133
44107999246112,2445cyclictest497145-21kworker/0:2+events22:01:070
44108999245612,2441cyclictest500328-21kworker/3:2+events22:35:463
44108999245612,2440cyclictest491033-21kworker/3:1+events21:53:513
44108999245512,2440cyclictest526212-21kworker/3:1+events23:40:313
44108999245411,2440cyclictest534005-21kworker/3:0+events00:08:413
4410869924549,2440cyclictest466607-21kworker/2:0+events20:30:152
44107999245412,2438cyclictest463261-21kworker/0:0+events20:22:160
44107999245312,2437cyclictest503565-21kworker/0:0+events22:38:040
44108999245212,2437cyclictest479301-21kworker/3:2+events21:13:043
44107999245010,2436cyclictest473230-21kworker/0:0+events21:03:320
44107999245010,2436cyclictest473230-21kworker/0:0+events21:03:320
4410899924489,2436cyclictest513397-21kworker/3:0+events23:01:353
44108999244812,2433cyclictest487479-21kworker/3:1+events21:36:223
44108999244811,2433cyclictest500328-21kworker/3:2+events22:24:433
44108999244712,2431cyclictest494432-21kworker/3:0+events21:59:143
4410899924458,2434cyclictest461661-21kworker/3:2+events20:41:283
44108999244211,2427cyclictest461661-21kworker/3:2+events20:30:573
44107999244212,2427cyclictest440672-21kworker/0:2+events19:15:580
44108999243712,2422cyclictest487479-21kworker/3:1+events21:34:273
4410849924279,2414cyclictest498998-21kworker/1:1+events22:10:361
44108499242610,2413cyclictest469769-21kworker/1:1+events20:43:241
44108499241212,2396cyclictest477552-21kworker/1:2+events21:16:041
44108499240911,2394cyclictest511452-21kworker/1:0+events22:50:121
44108499239912,2384cyclictest450511-21kworker/1:1+events19:37:111
44108499239812,2383cyclictest524220-21kworker/1:1+events23:46:581
44108499239812,2383cyclictest488993-21kworker/1:0+events21:43:391
44108499239811,2383cyclictest513074-21kworker/1:2+events22:57:481
44108499239612,2380cyclictest506948-21kworker/1:1+events22:35:241
44108499239312,2378cyclictest516303-21kworker/1:0+events23:09:571
44108999238511,2371cyclictest545047-21kworker/3:1+events00:34:583
44108499238410,2371cyclictest516303-21kworker/1:0+events23:16:481
44108999238312,2368cyclictest537280-21kworker/3:2+events00:15:133
44108499238211,2370cyclictest494113-21kworker/1:1+events21:56:331
44108499237610,2362cyclictest479183-21kworker/1:1+events21:10:481
44108999237110,2357cyclictest506858-21kworker/3:1+events22:33:503
44108499236211,2348cyclictest460085-21kworker/1:1+events20:24:541
44108699236112,2346cyclictest468201-21kworker/2:1+events20:35:272
44108699235412,2339cyclictest455272-21kworker/2:1+events19:59:572
44107999235310,2340cyclictest475815-21kworker/0:1+events21:22:580
44108999235112,2335cyclictest498728-21kworker/3:1+events22:10:573
44107999235111,2336cyclictest463261-21kworker/0:0+events20:18:070
44108699233812,2323cyclictest465002-21kworker/2:2+events20:40:222
44108699233512,2320cyclictest487719-21kworker/2:2+events21:37:322
44108499233312,2318cyclictest461751-21kworker/1:2+events20:16:361
44108699232612,2310cyclictest474297-21kworker/2:2+events20:55:372
44108499232312,2308cyclictest506948-21kworker/1:1+events22:41:301
44108699232212,2307cyclictest487719-21kworker/2:2+events21:41:462
4410899923178,2305cyclictest526212-21kworker/3:1+events23:51:323
44108499231510,2302cyclictest532244-21kworker/1:0+events23:54:131
44107999231511,2301cyclictest475815-21kworker/0:1+events21:29:480
44108699231012,2295cyclictest517930-21kworker/2:0+events23:18:202
44108699231010,2296cyclictest452369-21kworker/2:0+events19:49:232
44108999230812,2292cyclictest510061-21kworker/3:0+events22:45:183
44108699230812,2294cyclictest526033-21kworker/2:1+events23:52:192
44108699230810,2295cyclictest478974-21kworker/2:2+events21:12:192
44108699230712,2291cyclictest533972-21kworker/2:0+events23:58:482
44108999230612,2292cyclictest494432-21kworker/3:0+events22:02:173
44108999230312,2288cyclictest450568-21kworker/3:0+events19:48:363
44107999229911,2284cyclictest460057-21kworker/0:1+events20:13:560
44107999229412,2279cyclictest511571-21kworker/0:2+events22:50:340
44108499229211,2277cyclictest516303-21kworker/1:0+events23:04:371
44108699229111,2276cyclictest458638-21kworker/2:2+events20:08:102
44107999229011,2276cyclictest522466-21kworker/0:0+events23:29:500
44107999228711,2273cyclictest530795-21kworker/0:1+events23:59:100
44107999228612,2271cyclictest460057-21kworker/0:1+events20:07:480
44108999228012,2265cyclictest450568-21kworker/3:0+events20:07:253
44108999227510,2261cyclictest474387-21kworker/3:1+events21:23:453
44107999227410,2261cyclictest458462-21kworker/0:2+events20:38:050
44107999227111,2257cyclictest448916-21kworker/0:1+events20:00:410
44107999227010,2256cyclictest514860-21kworker/0:2+events23:00:280
44108999226810,2255cyclictest437211-21kworker/3:2+events19:17:263
44107999226810,2254cyclictest446092-21kworker/0:2+events19:30:480
44108999226511,2251cyclictest500328-21kworker/3:2+events22:18:133
44108999226510,2251cyclictest474387-21kworker/3:1+events21:19:073
4410899922649,2253cyclictest463294-21kworker/3:1+events20:20:023
4410899922649,2252cyclictest534005-21kworker/3:0+events00:02:153
44108699226411,2250cyclictest465002-21kworker/2:2+events20:26:462
44107999226311,2249cyclictest538638-21kworker/0:0+events00:28:070
44107999226311,2249cyclictest446092-21kworker/0:2+events19:25:510
44107999226310,2250cyclictest524093-21kworker/0:2+events23:39:440
44108999226210,2249cyclictest520989-21kworker/3:0+events23:17:573
44107999226210,2249cyclictest479152-21kworker/0:2+events21:08:520
44108999226111,2246cyclictest442695-21kworker/3:3+events19:36:483
44107999226111,2247cyclictest498881-21kworker/0:1+events22:08:180
44107999226111,2247cyclictest475815-21kworker/0:1+events20:56:460
44108999226011,2245cyclictest520989-21kworker/3:0+events23:29:033
44107999226010,2246cyclictest503565-21kworker/0:0+events22:58:340
44108999225911,2245cyclictest445015-21kworker/3:0+events19:27:473
44107999225910,2246cyclictest464945-21kworker/0:1+events20:30:370
44108999225811,2244cyclictest539152-21kworker/3:0+events00:26:563
44108999225810,2245cyclictest519324-21kworker/3:1+events23:14:513
44108999225810,2245cyclictest450568-21kworker/3:0+events19:43:383
44108999225611,2242cyclictest450568-21kworker/3:0+events19:55:473
4410799922538,2243cyclictest513194-21kworker/0:1+events23:15:400
4410799922537,2243cyclictest500699-21kworker/0:2+events22:19:450
4410799922529,2240cyclictest475815-21kworker/0:1+events21:11:340
4410799922459,2233cyclictest503565-21kworker/0:0+events22:29:170
4410799922395,2231cyclictest448916-21kworker/0:1+events19:50:310
44108999223710,2224cyclictest539152-21kworker/3:0+events00:20:313
44108999223410,2220cyclictest513397-21kworker/3:0+events23:09:343
44107999223410,2221cyclictest509911-21kworker/0:1+events22:44:120
4410899922328,2221cyclictest474387-21kworker/3:1+events21:06:153
44108999223210,2218cyclictest517721-21kworker/3:2+events23:21:473
44107999223210,2218cyclictest498881-21kworker/0:1+events22:23:340
44107999223210,2218cyclictest438746-21kworker/0:1+events19:23:570
44107999223110,2217cyclictest543505-21kworker/0:1+events00:31:550
44108999222911,2215cyclictest489087-21kworker/3:0+events21:44:473
44108999222910,2216cyclictest450568-21kworker/3:0+events20:14:193
44108699222911,2215cyclictest492517-21kworker/2:0+events21:48:332
44108499222912,2213cyclictest475904-21kworker/1:0+events20:59:261
4410899922289,2216cyclictest442695-21kworker/3:3+events19:31:343
44108999222810,2214cyclictest474387-21kworker/3:1+events20:53:403
44108999222511,2211cyclictest442695-21kworker/3:3+events19:20:293
44108699222410,2211cyclictest494290-21kworker/2:2+events22:12:512
44107999222010,2207cyclictest531026-21kworker/0:3+events00:06:030
44108499221910,2206cyclictest543627-21kworker/1:1+events00:30:241
4410849922179,2206cyclictest460085-21kworker/1:1+events20:10:091
4410849922056,2195cyclictest541962-21kworker/1:2+events00:25:251
44108499220513,2189cyclictest488993-21kworker/1:0+events21:46:201
44108499220511,2191cyclictest522496-21kworker/1:2+events23:22:331
44108499220310,2190cyclictest498998-21kworker/1:1+events22:25:511
44108499220210,2189cyclictest518051-21kworker/1:2+events23:13:211
44108499220210,2188cyclictest437179-21kworker/1:0+events19:22:021
4410849922018,2190cyclictest484249-21kworker/1:1+events21:28:181
44108499220111,2187cyclictest452162-21kworker/1:2+events19:44:011
44108499220010,2186cyclictest533880-21kworker/1:1+events23:57:411
44108499220010,2186cyclictest511452-21kworker/1:0+events22:48:191
44108499219911,2185cyclictest497341-21kworker/1:0+events22:03:461
44108499219811,2183cyclictest468051-21kworker/1:0+events20:33:341
44108499219810,2185cyclictest437179-21kworker/1:0+events19:30:251
4410849921979,2185cyclictest533880-21kworker/1:1+events00:15:581
44108499219711,2183cyclictest538761-21kworker/1:0+events00:23:321
44108499219710,2184cyclictest538761-21kworker/1:0+events00:38:231
44108499219710,2184cyclictest527876-21kworker/1:0+events23:41:391
44108499219710,2184cyclictest455453-21kworker/1:0+events20:07:031
44108499219611,2182cyclictest498998-21kworker/1:1+events22:21:171
44108499219611,2182cyclictest475904-21kworker/1:0+events21:02:471
44108499219611,2182cyclictest475904-21kworker/1:0+events21:02:471
44108499219311,2179cyclictest516303-21kworker/1:0+events23:27:541
44108499219311,2179cyclictest460085-21kworker/1:1+events20:28:191
44108499218410,2171cyclictest533880-21kworker/1:1+events00:13:161
44108499218410,2171cyclictest437179-21kworker/1:0+events19:28:321
44108499217610,2162cyclictest484249-21kworker/1:1+events21:31:211
44108499217311,2159cyclictest498998-21kworker/1:1+events22:18:361
44108499217311,2159cyclictest450511-21kworker/1:1+events19:56:331
4410899921729,2160cyclictest526212-21kworker/3:1+events00:14:023
4410849921726,2163cyclictest450511-21kworker/1:1+events19:45:311
44108499217111,2156cyclictest477552-21kworker/1:2+events21:35:131
44108499216710,2154cyclictest477552-21kworker/1:2+events21:06:371
4410869921662,2161cyclictest508251-21kworker/2:0+events22:39:132
4410849921628,2151cyclictest497341-21kworker/1:0+events22:06:481
4410799921539,2140cyclictest541872-21kworker/0:2+events00:23:090
44107999215111,2137cyclictest450540-21kworker/0:0+events19:39:050
44108699214011,2126cyclictest526033-21kworker/2:1+events23:42:472
4410799921335,2125cyclictest481076-21kworker/0:0+events21:16:490
44108699213211,2118cyclictest510118-21kworker/2:2+events22:49:502
44107999213010,2118cyclictest440672-21kworker/0:2+events19:14:250
44108699212410,2111cyclictest540491-21kworker/2:0+events00:24:172
44108699212011,2106cyclictest513359-21kworker/2:0+events22:56:382
44108699212011,2106cyclictest502147-21kworker/2:1+events22:20:312
44108699211911,2105cyclictest482558-21kworker/2:1+events21:57:422
44108699211711,2102cyclictest476313-21kworker/2:1+events21:00:552
44108699211711,2102cyclictest476313-21kworker/2:1+events21:00:552
44108699211611,2102cyclictest472667-21kworker/2:1+events20:50:362
44108699211611,2101cyclictest497253-21kworker/2:0+events22:04:332
44108699211511,2101cyclictest447663-21kworker/2:2+events19:51:132
44108699211310,2100cyclictest476313-21kworker/2:1+events21:05:512
44107999211310,2100cyclictest458462-21kworker/0:2+events20:26:020
4410899921077,2097cyclictest475993-21kworker/3:0+events21:03:113
4410899921077,2097cyclictest475993-21kworker/3:0+events21:03:113
4410869921068,2094cyclictest505983-21kworker/2:2+events22:34:142
4410849921069,2094cyclictest505223-21kworker/1:0+events22:34:371
4410899921057,2095cyclictest489087-21kworker/3:0+events21:45:553
44108699210511,2091cyclictest511717-21kworker/2:1+events22:52:262
44108699210410,2091cyclictest508251-21kworker/2:0+events22:44:332
4410799921028,2090cyclictest524093-21kworker/0:2+events23:33:400
4410849920999,2087cyclictest465061-21kworker/1:2+events20:37:431
4410799920979,2085cyclictest448916-21kworker/0:1+events19:40:130
44108699209411,2080cyclictest485641-21kworker/2:0+events21:30:112
4410799920949,2082cyclictest509911-21kworker/0:1+events22:46:500
44108699209211,2078cyclictest521198-21kworker/2:2+events23:36:432
44108499208010,2067cyclictest471452-21kworker/1:2+events20:54:501
4410799920706,2061cyclictest450540-21kworker/0:0+events19:46:180
4410869920668,2055cyclictest533972-21kworker/2:0+events00:06:472
44108499205410,2041cyclictest437179-21kworker/1:0+events19:19:211
4410899920465,2038cyclictest437211-21kworker/3:2+events19:12:063
44108499204510,2031cyclictest516303-21kworker/1:0+events23:32:101
4410849920417,2031cyclictest450511-21kworker/1:1+events19:53:331
44108699203410,2021cyclictest521198-21kworker/2:2+events23:25:582
44108699203111,2017cyclictest538578-21kworker/2:1+events00:25:472
44108699199910,1985cyclictest478974-21kworker/2:2+events21:21:272
4410869919939,1980cyclictest500478-21kworker/2:0+events22:15:542
44108499198910,1976cyclictest435584-21kworker/1:2+events19:13:141
44108699197411,1960cyclictest458638-21kworker/2:2+events20:04:492
44108699196110,1948cyclictest510118-21kworker/2:2+events23:08:242
4410869919593,1953cyclictest447663-21kworker/2:2+events19:37:322
44108699195810,1945cyclictest494290-21kworker/2:2+events22:07:112
44108699195610,1943cyclictest510118-21kworker/2:2+events23:02:222
44108699195210,1939cyclictest456902-21kworker/2:0+events20:13:342
44108699195110,1938cyclictest535796-21kworker/2:2+events00:15:362
44108699195010,1937cyclictest482558-21kworker/2:1+events21:54:372
4410869919499,1937cyclictest438897-21kworker/2:1+events19:24:432
44108699194810,1935cyclictest540491-21kworker/2:0+events00:38:002
44108699194810,1935cyclictest535796-21kworker/2:2+events00:10:582
4410869919479,1935cyclictest521198-21kworker/2:2+events23:32:332
44108699194710,1934cyclictest482558-21kworker/2:1+events21:26:462
44108699194710,1934cyclictest470091-21kworker/2:0+events20:46:032
4410869919078,1896cyclictest447663-21kworker/2:2+events19:44:232
4410869919009,1888cyclictest444252-21kworker/2:2+events19:18:352
44108699189310,1881cyclictest446062-21kworker/2:0+events19:30:022
4410869918828,1870cyclictest460297-21kworker/2:1+events20:24:092
4410869918819,1869cyclictest438897-21kworker/2:1+events19:11:432
4410869918809,1868cyclictest540491-21kworker/2:0+events00:32:182
4407722167138,24sleep20-21swapper/219:08:572
4407122144112,26sleep00-21swapper/019:08:100
4406222143109,28sleep10-21swapper/119:07:041
4406792141106,30sleep30-21swapper/319:07:463
441086999996,2cyclictest446062-21kworker/2:0+pm19:29:522
44108699230,19cyclictest535178-21python300:00:202
441086991513,1cyclictest0-21swapper/223:45:112
44108699142,6cyclictest0-21swapper/223:20:172
441086991410,3cyclictest463407-21taskset20:19:012
44107999149,3cyclictest499861-21awk22:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional