You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 16:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Fri Mar 27, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62344999332918,3306cyclictest631457-21kworker/3:2+events19:50:123
62344599286214,2843cyclictest705821-21kworker/2:1+events00:00:142
62344599283914,2822cyclictest679107-21kworker/2:0+events22:25:202
62343999282113,2805cyclictest698063-21kworker/1:1+events23:30:011
62343599279813,2782cyclictest664791-21kworker/0:1+events21:20:200
62344599275312,2736cyclictest647216-21kworker/2:0+events20:25:022
62343999273611,2721cyclictest691199-21kworker/1:0+events23:09:521
6234459927149,2701cyclictest668499-21kworker/2:2+events21:35:142
62343599268413,2666cyclictest694744-21kworker/0:1+events23:30:210
62343599263013,2613cyclictest704468-21kworker/0:1+events23:55:150
62343999262913,2613cyclictest722416-21kworker/1:1+events00:35:211
62343999261811,2603cyclictest682123-21kworker/1:0+events22:32:341
62343599260712,2591cyclictest648721-21kworker/0:2+events20:29:090
62343999258013,2563cyclictest707666-21kworker/1:2+events00:03:411
62344999255012,2534cyclictest696710-21kworker/3:2+events23:21:333
6234459925287,2517cyclictest688809-21kworker/2:0+events23:03:482
62343999252710,2513cyclictest698063-21kworker/1:1+events23:40:141
62343599251812,2504cyclictest710855-21kworker/0:0+events00:10:090
62343599251510,2501cyclictest683642-21kworker/0:0+events22:36:000
62344999251212,2497cyclictest677653-21kworker/3:2+events22:09:533
6234399925119,2498cyclictest671465-21kworker/1:2+events21:51:581
62343999250812,2493cyclictest698063-21kworker/1:1+events23:38:201
62343599250611,2492cyclictest696342-21kworker/0:0+events23:13:410
62343599250412,2488cyclictest660032-21kworker/0:1+events21:02:260
62344999250112,2486cyclictest635051-21kworker/3:1+events20:03:503
6234499924958,2484cyclictest715935-21kworker/3:2+events00:25:323
62344999249312,2477cyclictest673066-21kworker/3:0+events21:42:573
62344999249211,2478cyclictest717599-21kworker/3:1+events00:31:343
62344999249110,2478cyclictest677653-21kworker/3:2+events22:15:543
62343599249112,2475cyclictest686924-21kworker/0:0+events22:48:120
62344999249012,2475cyclictest655617-21kworker/3:0+events20:50:453
62344999248912,2474cyclictest665011-21kworker/3:0+events21:20:453
62344999248912,2474cyclictest652370-21kworker/3:2+events20:45:463
62344999248911,2474cyclictest722476-21kworker/3:2+events00:39:123
62344999248911,2474cyclictest645535-21kworker/3:0+events20:27:593
62344999248812,2472cyclictest677653-21kworker/3:2+events22:41:413
62344999248812,2472cyclictest666924-21kworker/3:2+events21:27:383
62343599248812,2472cyclictest694744-21kworker/0:1+events23:27:430
62344999248610,2472cyclictest639442-21kworker/3:2+events20:12:103
6234399924786,2469cyclictest671465-21kworker/1:2+events21:47:261
62344999247511,2461cyclictest675570-21kworker/3:1+events22:11:213
62344999247411,2459cyclictest642752-21kworker/3:1+events20:16:003
62344999247410,2461cyclictest683459-21kworker/3:0+events22:39:263
62344999247312,2457cyclictest690384-21kworker/3:1+events22:59:193
62343999247011,2455cyclictest686624-21kworker/1:2+events22:42:501
62343599246712,2449cyclictest701228-21kworker/0:2+events23:35:190
62343999246411,2450cyclictest686993-21kworker/1:3+events22:49:201
62344999246012,2444cyclictest715935-21kworker/3:2+events00:18:343
62344999245812,2443cyclictest637658-21kworker/3:0+events19:55:523
62343999245812,2442cyclictest650686-21kworker/1:2+events20:40:111
62344999245710,2444cyclictest673066-21kworker/3:0+events21:45:363
6234499924559,2442cyclictest717599-21kworker/3:1+events00:24:443
62343599245511,2440cyclictest671557-21kworker/0:0+events21:48:110
62344999245212,2436cyclictest645535-21kworker/3:0+events20:23:083
62344999245211,2437cyclictest680468-21kworker/3:1+events22:27:123
62343599245212,2436cyclictest636085-21kworker/0:0+events19:58:100
62344599244912,2433cyclictest655498-21kworker/2:0+events20:48:522
62344599244712,2432cyclictest661866-21kworker/2:0+events21:09:472
62343599244411,2430cyclictest639287-21kworker/0:1+events20:01:370
62344999244212,2427cyclictest701165-21kworker/3:1+events23:34:113
62343999243812,2423cyclictest673218-21kworker/1:1+events21:44:271
6234359924338,2422cyclictest678815-21kworker/0:1+events22:23:060
62343999242811,2416cyclictest684974-21kworker/1:1+events22:50:061
62343999242811,2413cyclictest686993-21kworker/1:3+events22:58:551
62344999242712,2412cyclictest705850-21kworker/3:2+events23:53:413
62343999242512,2410cyclictest693206-21kworker/1:1+events23:10:371
62344599242410,2411cyclictest693293-21kworker/2:2+events23:07:342
62343999242412,2409cyclictest640971-21kworker/1:1+events20:29:561
62343599242411,2409cyclictest650622-21kworker/0:1+events20:37:090
62343999242312,2407cyclictest657246-21kworker/1:0+events20:57:091
62343599242312,2408cyclictest624529-21kworker/0:1+events19:50:350
62343599242311,2408cyclictest704468-21kworker/0:1+events23:45:140
62343599242310,2410cyclictest710855-21kworker/0:0+events00:08:360
62343599242310,2409cyclictest710855-21kworker/0:0+events00:17:020
62343599242212,2406cyclictest699593-21kworker/0:0+events23:24:580
62343599242210,2409cyclictest655673-21kworker/0:0+events21:05:550
62343999242111,2406cyclictest705940-21kworker/1:0+events23:50:591
6234359924208,2408cyclictest676755-21kworker/0:1+events22:06:010
62343599242012,2405cyclictest678815-21kworker/0:1+events22:42:290
62343599242012,2404cyclictest710855-21kworker/0:0+events00:23:340
62344999241911,2405cyclictest694953-21kworker/3:1+events23:15:563
62344999241911,2405cyclictest694953-21kworker/3:1+events23:15:563
62344599241911,2405cyclictest639504-21kworker/2:0+events20:09:302
62343999241912,2404cyclictest693206-21kworker/1:1+events23:01:561
62343999241912,2404cyclictest652309-21kworker/1:1+events20:39:261
62343999241912,2403cyclictest663319-21kworker/1:1+events21:14:421
6234359924188,2407cyclictest666683-21kworker/0:2+events21:32:350
62343599241812,2403cyclictest678125-21kworker/0:2+events22:14:010
62343599241611,2402cyclictest629859-21kworker/0:2+events19:28:450
6234359924157,2405cyclictest645657-21kworker/0:0+events20:19:240
62343599241112,2395cyclictest641002-21kworker/0:2+events20:05:430
62343999241011,2395cyclictest626810-21kworker/1:0+events19:23:051
62343599240912,2394cyclictest655673-21kworker/0:0+events20:51:290
6234459924049,2391cyclictest686894-21kworker/2:2+events22:52:022
62344599240412,2388cyclictest679107-21kworker/2:0+events22:22:192
62344999240312,2388cyclictest623384-21kworker/3:3+events19:16:353
62344999240210,2389cyclictest688553-21kworker/3:0+events22:48:353
62344599240211,2387cyclictest693293-21kworker/2:2+events23:13:182
62344999239712,2382cyclictest628196-21kworker/3:1+events19:30:173
62344599239710,2385cyclictest657094-21kworker/2:2+events21:00:092
62344599239612,2381cyclictest712559-21kworker/2:2+events00:05:332
62344599239412,2379cyclictest641176-21kworker/2:1+events20:28:232
62343599239412,2379cyclictest631467-21kworker/0:0+events19:36:480
62344599239311,2378cyclictest683428-21kworker/2:2+events22:34:532
62344999239210,2379cyclictest674836-21kworker/3:0+events22:03:433
62343599239210,2379cyclictest645657-21kworker/0:0+events20:24:150
62344599239110,2378cyclictest693293-21kworker/2:2+events23:23:472
62344599239012,2374cyclictest674568-21kworker/2:2+events21:58:462
62344599239012,2374cyclictest655498-21kworker/2:0+events20:56:002
62344599239011,2375cyclictest664884-21kworker/2:1+events21:26:302
62344599238810,2374cyclictest705821-21kworker/2:1+events23:48:162
62344599238712,2371cyclictest645591-21kworker/2:2+events20:19:462
62344599238412,2368cyclictest688809-21kworker/2:0+events22:58:322
6234359923828,2371cyclictest645657-21kworker/0:0+events20:30:200
62344599238111,2368cyclictest637868-21kworker/2:1+events19:58:342
62343999238010,2366cyclictest637630-21kworker/1:2+events20:06:521
62344999237810,2365cyclictest660091-21kworker/3:0+events21:10:113
62344599237812,2362cyclictest705821-21kworker/2:1+events23:43:182
62343599237512,2360cyclictest643995-21kworker/0:1+events20:13:440
62343599237512,2359cyclictest710855-21kworker/0:0+events00:04:020
62343599237411,2361cyclictest690125-21kworker/0:2+events22:55:050
6234359923737,2363cyclictest666683-21kworker/0:2+events21:43:190
62343599236311,2348cyclictest624529-21kworker/0:1+events19:21:110
62344999236112,2345cyclictest671404-21kworker/3:2+events21:37:343
6234359923529,2340cyclictest666683-21kworker/0:2+events21:38:170
62344999234310,2329cyclictest648871-21kworker/3:1+events20:33:023
62343999234312,2327cyclictest674243-21kworker/1:0+events21:58:261
62344999233712,2322cyclictest652370-21kworker/3:2+events20:44:403
62344999233112,2316cyclictest671404-21kworker/3:2+events21:59:323
62343999233012,2315cyclictest674243-21kworker/1:0+events22:04:081
62343999233012,2315cyclictest628578-21kworker/1:1+events19:25:211
62343999233010,2317cyclictest669806-21kworker/1:0+events21:37:101
6234359923289,2315cyclictest668317-21kworker/0:0+events21:28:020
62344999232411,2311cyclictest665011-21kworker/3:0+events21:30:173
6234399923059,2292cyclictest647129-21kworker/1:0+events20:32:391
62343999230012,2286cyclictest677023-21kworker/1:2+events22:06:251
62343999229612,2281cyclictest639256-21kworker/1:0+events20:00:301
6234459922949,2282cyclictest666804-21kworker/2:0+events21:33:432
62343599229010,2278cyclictest719352-21kworker/0:2+events00:25:080
62343599228812,2272cyclictest704468-21kworker/0:1+events23:52:100
62344999227210,2258cyclictest713399-21kworker/3:0+events00:05:573
6234499922709,2257cyclictest654016-21kworker/3:1+events20:59:253
62344999226710,2253cyclictest683459-21kworker/3:0+events22:32:123
62344599226710,2253cyclictest680850-21kworker/2:1+events22:48:592
62344999226612,2251cyclictest654016-21kworker/3:1+events21:05:313
62344999226611,2252cyclictest648871-21kworker/3:1+events20:35:143
62343599226611,2251cyclictest678125-21kworker/0:2+events22:17:470
62344999226311,2249cyclictest631457-21kworker/3:2+events19:47:313
62344999226210,2249cyclictest705850-21kworker/3:2+events23:41:463
62344999226210,2248cyclictest707699-21kworker/3:1+events23:56:253
62344999226111,2247cyclictest701165-21kworker/3:1+events23:36:053
62344999226111,2247cyclictest688553-21kworker/3:0+events23:08:213
62344999225911,2245cyclictest693179-21kworker/3:2+events23:01:363
62344999225911,2245cyclictest631457-21kworker/3:2+events19:36:023
62344999225410,2240cyclictest711346-21kworker/3:3+events00:03:173
62343999223511,2220cyclictest628578-21kworker/1:1+events19:44:061
62343599223410,2221cyclictest624529-21kworker/0:1+events19:41:020
6234499922339,2221cyclictest680468-21kworker/3:1+events22:24:573
62343999223211,2218cyclictest678750-21kworker/1:2+events22:24:141
62343999223211,2218cyclictest657246-21kworker/1:0+events21:08:381
6234399922317,2220cyclictest637630-21kworker/1:2+events19:56:381
62343999223111,2216cyclictest663319-21kworker/1:1+events21:31:051
62343599223110,2217cyclictest624529-21kworker/0:1+events19:31:040
62343599223011,2216cyclictest702840-21kworker/0:0+events23:43:400
62344999222911,2214cyclictest671404-21kworker/3:2+events21:54:403
62343999222910,2216cyclictest674243-21kworker/1:0+events22:17:011
62343999222910,2216cyclictest663319-21kworker/1:1+events21:17:431
6234359922297,2218cyclictest655673-21kworker/0:0+events20:57:330
62344999222811,2213cyclictest660091-21kworker/3:0+events21:02:033
6234399922289,2216cyclictest628578-21kworker/1:1+events19:38:211
62343599222811,2213cyclictest652217-21kworker/0:0+events20:41:190
62343599222810,2215cyclictest674152-21kworker/0:1+events21:52:230
62343999222711,2213cyclictest618967-21kworker/1:1+events19:12:021
62343999222611,2211cyclictest677684-21kworker/1:1+events22:13:381
62343599222611,2212cyclictest664791-21kworker/0:1+events21:18:060
62343999222511,2210cyclictest664921-21kworker/1:2+events21:26:071
62343999222510,2212cyclictest640971-21kworker/1:1+events20:10:401
62344599222411,2210cyclictest639504-21kworker/2:0+events20:02:432
62343599222411,2210cyclictest683642-21kworker/0:0+events22:34:300
62343599222411,2210cyclictest655673-21kworker/0:0+events21:10:570
62343999222311,2209cyclictest618967-21kworker/1:1+events19:17:441
6234359922239,2211cyclictest719352-21kworker/0:2+events00:33:490
6234359922239,2211cyclictest690125-21kworker/0:2+events23:07:580
62343999222211,2207cyclictest640971-21kworker/1:1+events20:20:541
62343999222211,2207cyclictest637630-21kworker/1:2+events19:52:501
62343599222210,2209cyclictest694744-21kworker/0:1+events23:16:390
62343599222210,2209cyclictest694744-21kworker/0:1+events23:16:390
62343999222111,2206cyclictest698063-21kworker/1:1+events23:19:421
62343999222111,2206cyclictest698063-21kworker/1:1+events23:19:411
62344599222011,2207cyclictest717846-21kworker/2:0+events00:30:242
62343999222011,2207cyclictest707666-21kworker/1:2+events00:15:101
62343999222011,2206cyclictest655587-21kworker/1:2+events20:51:061
6234359922207,2209cyclictest666683-21kworker/0:2+events21:56:570
62343599222010,2206cyclictest636085-21kworker/0:0+events19:49:250
62343599221910,2206cyclictest676755-21kworker/0:1+events22:01:480
62343999221711,2203cyclictest698063-21kworker/1:1+events23:23:251
62343999221710,2204cyclictest699709-21kworker/1:0+events23:34:341
62344599221210,2198cyclictest717846-21kworker/2:0+events00:23:122
62343599221210,2199cyclictest653902-21kworker/0:2+events20:47:180
62344999221110,2198cyclictest629825-21kworker/3:0+events19:28:213
62344599221010,2197cyclictest693293-21kworker/2:2+events23:39:042
62344599220810,2195cyclictest676904-21kworker/2:0+events22:04:522
62343999220711,2192cyclictest682123-21kworker/1:0+events22:39:021
62343599220311,2190cyclictest721025-21kworker/0:1+events00:36:070
62343999220010,2188cyclictest716299-21kworker/1:0+events00:21:171
62343599220011,2185cyclictest678125-21kworker/0:2+events22:26:500
62343599219811,2185cyclictest686924-21kworker/0:0+events23:00:060
6234459921977,2186cyclictest655498-21kworker/2:0+events20:53:442
62344599219711,2182cyclictest678336-21kworker/2:1+events22:15:312
62344599219710,2183cyclictest705821-21kworker/2:1+events23:54:042
6234459921966,2187cyclictest680850-21kworker/2:1+events22:44:442
62344599219611,2182cyclictest634634-21kworker/2:0+events19:49:022
6234399921963,2190cyclictest716299-21kworker/1:0+events00:27:031
62343999219611,2182cyclictest678750-21kworker/1:2+events22:29:301
6234459921958,2185cyclictest634634-21kworker/2:0+events19:52:042
62344599219411,2180cyclictest648901-21kworker/2:2+events20:33:462
62343999219410,2181cyclictest698063-21kworker/1:1+events23:46:451
62344599218911,2175cyclictest626751-21kworker/2:1+events19:37:582
62344599218810,2175cyclictest677592-21kworker/2:2+events22:10:132
6234459921879,2175cyclictest624707-21kworker/2:2+events19:23:262
62344599218611,2172cyclictest707427-21kworker/2:0+events23:56:472
62344599218611,2172cyclictest657094-21kworker/2:2+events21:21:522
62344599218410,2171cyclictest693293-21kworker/2:2+events23:18:342
62344599218410,2171cyclictest693293-21kworker/2:2+events23:18:332
62344599218410,2171cyclictest624707-21kworker/2:2+events19:18:292
62344599218310,2169cyclictest670369-21kworker/2:1+events21:41:242
62344599218110,2167cyclictest717846-21kworker/2:0+events00:27:252
62344599217810,2165cyclictest664884-21kworker/2:1+events21:19:592
6234399921764,2169cyclictest663319-21kworker/1:1+events21:22:381
6234459921748,2163cyclictest661866-21kworker/2:0+events21:11:422
62344599217410,2161cyclictest716057-21kworker/2:2+events00:14:002
6234499921727,2162cyclictest713399-21kworker/3:0+events00:12:493
62344599217110,2158cyclictest701383-21kworker/2:1+events23:32:182
62344599217110,2157cyclictest648901-21kworker/2:2+events20:42:272
6234459921679,2155cyclictest631342-21kworker/2:2+events19:42:562
6234499921659,2153cyclictest633191-21kworker/3:0+events19:43:443
62344599216411,2150cyclictest648901-21kworker/2:2+events20:36:452
62344999216110,2147cyclictest623384-21kworker/3:3+events19:24:583
6234459921607,2149cyclictest693293-21kworker/2:2+events23:29:372
62344999215711,2143cyclictest701165-21kworker/3:1+events23:29:133
62344999215410,2141cyclictest694953-21kworker/3:1+events23:10:153
62344599215311,2138cyclictest629735-21kworker/2:0+events19:29:302
62344999214311,2129cyclictest663347-21kworker/3:1+events21:15:493
6234399921388,2126cyclictest714692-21kworker/1:1+events00:12:261
6234499921118,2100cyclictest641117-21kworker/3:0+events20:06:303
62343999211011,2096cyclictest652309-21kworker/1:1+events20:49:361
62344599209911,2085cyclictest720845-21kworker/2:1+events00:37:412
62343599209712,2082cyclictest686924-21kworker/0:0+events22:52:240
62343599209411,2080cyclictest626563-21kworker/0:0+events19:16:580
62344599208810,2075cyclictest680850-21kworker/2:1+events22:38:392
62343999208311,2069cyclictest631435-21kworker/1:0+events19:33:211
6234399920787,2068cyclictest709579-21kworker/1:1+events23:59:501
6234399920774,2070cyclictest716299-21kworker/1:0+events00:32:211
6234399920729,2059cyclictest628578-21kworker/1:1+events19:47:081
6234399920678,2056cyclictest707666-21kworker/1:2+events00:09:451
6234499920629,2050cyclictest705850-21kworker/3:2+events23:49:263
62344599203710,2024cyclictest676904-21kworker/2:0+events22:06:472
62344599203510,2022cyclictest673004-21kworker/2:0+events21:51:162
62344599203410,2021cyclictest624707-21kworker/2:2+events19:13:342
62344599202910,2016cyclictest714420-21kworker/2:1+events00:15:312
62343599201610,2003cyclictest619863-21kworker/0:2+events19:14:190
6234459920047,1994cyclictest631342-21kworker/2:2+events19:32:142
6234399919999,1987cyclictest644263-21kworker/1:2+events20:16:231
6234499919059,1893cyclictest623126-21kworker/3:1+events19:10:543
6231922144112,27sleep10-21swapper/119:09:271
6231672142115,21sleep30-21swapper/319:09:083
6229932140110,25sleep20-21swapper/219:06:562
6231232139109,25sleep00-21swapper/019:08:330
623439991911,5cyclictest660392-21idleruntime-cro21:04:591
623449991615,1cyclictest26450irq/143-i91522:50:063
62344599150,13cyclictest644264-21chrt20:14:442
62344599121,8cyclictest674270-21awk21:50:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional