You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 00:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Mar 26, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16089599403516,4013cyclictest243385-21kworker/2:2+events23:25:112
16089399340616,3381cyclictest249707-21kworker/1:1+events23:55:171
16089399297614,2957cyclictest173819-21kworker/1:0+events19:50:121
16088899281213,2796cyclictest264487-21kworker/0:1+events00:35:110
16089599280613,2790cyclictest162181-21kworker/2:1+events19:15:122
16089399279814,2780cyclictest222132-21kworker/1:1+events22:25:121
16088899277713,2760cyclictest221950-21kworker/0:0+events22:35:130
16089399261612,2600cyclictest188645-21kworker/1:1+events20:35:191
16089399260212,2586cyclictest166124-21kworker/1:2+events19:25:161
16089599259010,2576cyclictest220570-21kworker/2:2+events22:20:102
16088899252712,2511cyclictest240014-21kworker/0:1+events23:12:430
16088899251412,2498cyclictest217378-21kworker/0:2+events22:07:580
16089399251312,2497cyclictest190249-21kworker/1:0+events20:45:141
16089399251012,2494cyclictest258228-21kworker/1:0+events00:30:131
16089399250712,2491cyclictest199623-21kworker/1:2+events21:19:241
16089899250312,2487cyclictest187073-21kworker/3:2+events20:35:443
16088899249911,2484cyclictest169375-21kworker/0:2+events19:36:090
16089399249712,2481cyclictest177039-21kworker/1:0+events19:58:271
16089899249612,2481cyclictest234606-21kworker/3:2+events23:11:113
16088899249612,2480cyclictest255029-21kworker/0:2+events00:03:360
16089399249512,2479cyclictest183550-21kworker/1:2+events20:28:101
16088899249512,2480cyclictest191720-21kworker/0:0+events20:47:580
16088899249512,2479cyclictest241611-21kworker/0:2+events23:20:340
16088899249512,2479cyclictest194926-21kworker/0:1+events21:14:020
16088899249411,2480cyclictest210874-21kworker/0:2+events21:48:490
16089899249312,2477cyclictest188920-21kworker/3:1+events20:44:053
16089899249212,2476cyclictest167516-21kworker/3:0+events19:49:063
16089399249212,2476cyclictest210728-21kworker/1:0+events21:50:211
16089399249010,2477cyclictest164192-21kworker/1:1+events19:22:391
16088899249011,2475cyclictest166094-21kworker/0:2+events19:25:390
16088899248812,2472cyclictest164220-21kworker/0:0+events19:31:170
1608889924878,2475cyclictest229957-21kworker/0:1+events23:04:190
16088899248412,2469cyclictest231589-21kworker/0:0+events22:49:220
16088899248311,2468cyclictest185294-21kworker/0:0+events20:29:410
1608959924825,2473cyclictest210936-21kworker/2:2+events21:57:162
16088899248112,2465cyclictest229957-21kworker/0:1+events22:54:190
16088899248110,2468cyclictest177156-21kworker/0:2+events20:02:120
16088899248012,2465cyclictest214086-21kworker/0:1+events21:58:270
16089599247812,2463cyclictest230133-21kworker/2:2+events22:45:292
1608889924789,2467cyclictest206343-21kworker/0:0+events21:40:030
16088899247610,2464cyclictest253430-21kworker/0:1+events00:05:090
16089899247112,2456cyclictest254688-21kworker/3:0+events23:56:503
16088899246912,2454cyclictest208715-21kworker/0:1+events21:37:230
16088899246812,2453cyclictest220163-21kworker/0:1+events22:28:410
16088899246514,2448cyclictest191720-21kworker/0:0+events20:41:470
16089399246412,2449cyclictest178803-21kworker/1:1+events20:18:571
16089599246012,2444cyclictest257958-21kworker/2:0+events00:08:152
16089399246012,2444cyclictest197976-21kworker/1:1+events21:01:411
16089399245711,2442cyclictest245283-21kworker/1:2+events23:32:501
16089599244912,2434cyclictest177300-21kworker/2:1+events20:07:552
16089399244010,2427cyclictest190249-21kworker/1:0+events21:10:321
16088899244011,2426cyclictest238093-21kworker/0:2+events23:08:080
1608959924399,2426cyclictest204318-21kworker/2:1+events21:23:372
16089599243812,2422cyclictest236648-21kworker/2:2+events23:13:282
1608989924370,2431cyclictest217137-21kworker/3:2+events22:10:153
16089599243611,2421cyclictest226847-21kworker/2:0+events22:37:332
16089399243612,2421cyclictest167750-21kworker/1:1+events19:45:181
16089599243212,2416cyclictest224915-21kworker/2:1+events22:30:382
16089399243212,2416cyclictest222132-21kworker/1:1+events22:23:161
16089399242812,2413cyclictest228424-21kworker/1:1+events22:41:411
16089899242111,2406cyclictest243207-21kworker/3:1+events23:29:223
16089599242112,2405cyclictest183580-21kworker/2:2+events20:19:212
16089399242012,2404cyclictest207473-21kworker/1:1+events21:41:331
16089599241912,2403cyclictest193264-21kworker/2:2+events20:50:342
16089399241711,2402cyclictest207473-21kworker/1:1+events21:38:111
16089399241612,2401cyclictest164192-21kworker/1:1+events19:19:191
16089399241310,2400cyclictest199623-21kworker/1:2+events21:28:351
16089599241210,2398cyclictest231742-21kworker/2:1+events22:53:582
16089899241112,2397cyclictest199684-21kworker/3:0+events21:10:073
16089599241112,2395cyclictest249769-21kworker/2:0+events23:45:492
16089899240912,2394cyclictest199684-21kworker/3:0+events21:19:023
16089599240911,2394cyclictest181683-21kworker/2:0+events20:21:582
16089399240912,2393cyclictest249707-21kworker/1:1+events23:48:491
16089399240810,2395cyclictest240189-21kworker/1:0+events23:18:191
16089599240612,2390cyclictest185354-21kworker/2:1+events20:25:502
16089599240611,2391cyclictest217225-21kworker/2:0+events22:12:302
16089399240611,2391cyclictest177039-21kworker/1:0+events20:08:191
16089399240512,2390cyclictest185202-21kworker/1:0+events20:31:551
16089399240512,2389cyclictest253225-21kworker/1:0+events00:02:271
16088899240411,2389cyclictest198259-21kworker/0:0+events21:04:430
16089599240312,2388cyclictest257958-21kworker/2:0+events00:10:302
16089599240310,2389cyclictest262648-21kworker/2:2+events00:33:172
16089399240312,2388cyclictest220368-21kworker/1:0+events22:33:421
16089399240212,2387cyclictest190249-21kworker/1:0+events20:43:421
16089899240112,2386cyclictest223427-21kworker/3:1+events22:24:023
16089599240111,2386cyclictest253206-21kworker/2:0+events23:53:252
16089599240012,2385cyclictest207715-21kworker/2:0+events21:34:202
16089599240011,2385cyclictest199593-21kworker/2:1+events21:06:392
16089399240010,2386cyclictest258228-21kworker/1:0+events00:26:021
16088899240012,2384cyclictest183488-21kworker/0:2+events20:17:270
16089399239912,2383cyclictest249707-21kworker/1:1+events00:08:371
16089399239911,2385cyclictest249707-21kworker/1:1+events23:52:151
16089399239911,2384cyclictest238329-21kworker/1:1+events23:09:401
1608989923979,2384cyclictest167516-21kworker/3:0+events20:10:353
1608939923979,2384cyclictest190249-21kworker/1:0+events20:54:251
16089599239611,2381cyclictest204318-21kworker/2:1+events21:38:322
16089399239612,2381cyclictest236468-21kworker/1:3+events23:10:261
16089399239611,2382cyclictest195105-21kworker/1:2+events20:59:241
16089599239512,2379cyclictest164171-21kworker/2:0+events19:23:232
16089399239511,2381cyclictest258228-21kworker/1:0+events00:36:191
16088899239412,2380cyclictest259473-21kworker/0:0+events00:15:040
16089899238912,2373cyclictest225035-21kworker/3:0+events22:29:273
16089599238912,2372cyclictest226847-21kworker/2:0+events22:40:122
16089899238713,2371cyclictest255109-21kworker/3:3+events00:07:053
16089599238711,2373cyclictest170896-21kworker/2:0+events19:44:092
16089399238611,2372cyclictest177039-21kworker/1:0+events20:11:401
16088899238212,2367cyclictest187223-21kworker/0:2+events20:52:070
16089899236412,2348cyclictest213849-21kworker/3:1+events21:55:213
1608959923598,2347cyclictest169289-21kworker/2:2+events19:46:262
16089899235612,2341cyclictest266091-21kworker/3:0+events00:35:313
16089399235612,2341cyclictest212333-21kworker/1:2+events22:07:351
16088899235510,2341cyclictest169375-21kworker/0:2+events19:48:420
16089599235410,2341cyclictest177300-21kworker/2:1+events20:03:422
16089899235111,2337cyclictest209374-21kworker/3:0+events22:04:553
16089599234611,2332cyclictest207715-21kworker/2:0+events21:44:142
16088899234310,2329cyclictest240014-21kworker/0:1+events23:17:130
16089899234011,2326cyclictest245220-21kworker/3:2+events23:38:393
16089899233912,2323cyclictest177216-21kworker/3:1+events20:04:043
16089899233612,2321cyclictest167516-21kworker/3:0+events20:25:053
16089899232612,2311cyclictest232085-21kworker/3:0+events22:51:173
16089599232414,2306cyclictest254914-21kworker/2:1+events00:03:152
16089899232312,2307cyclictest188920-21kworker/3:1+events21:00:553
16089899232311,2309cyclictest199684-21kworker/3:0+events21:22:053
16088899231911,2304cyclictest187223-21kworker/0:2+events20:55:330
16089899231812,2302cyclictest241547-21kworker/3:0+events23:20:133
1608939923189,2306cyclictest199623-21kworker/1:2+events21:23:131
16089399231612,2300cyclictest190249-21kworker/1:0+events21:06:161
16088899231612,2301cyclictest255029-21kworker/0:2+events00:22:170
16089899231311,2298cyclictest167516-21kworker/3:0+events19:54:223
16089899231011,2296cyclictest173998-21kworker/3:2+events19:55:063
16089899230912,2295cyclictest188920-21kworker/3:1+events21:05:073
16088899230911,2295cyclictest201201-21kworker/0:2+events21:15:570
1608989923089,2296cyclictest167516-21kworker/3:0+events20:15:323
1608939923009,2287cyclictest240189-21kworker/1:0+events23:23:391
16089899229512,2281cyclictest181625-21kworker/3:2+events20:20:053
1608889922898,2278cyclictest187223-21kworker/0:2+events20:33:060
16089899227410,2261cyclictest225035-21kworker/3:0+events22:31:243
16088899227111,2257cyclictest164220-21kworker/0:0+events19:22:170
16088899227110,2258cyclictest220163-21kworker/0:1+events22:20:340
16089899227011,2256cyclictest232085-21kworker/3:0+events23:03:563
1608889922699,2257cyclictest194926-21kworker/0:1+events21:24:450
16088899226911,2256cyclictest178915-21kworker/0:0+events20:10:100
16088899226711,2252cyclictest204647-21kworker/0:2+events21:28:570
16088899226710,2254cyclictest255029-21kworker/0:2+events00:27:120
1608889922669,2254cyclictest173731-21kworker/0:1+events19:54:430
1608889922668,2254cyclictest243295-21kworker/0:0+events23:28:150
16088899226611,2252cyclictest210874-21kworker/0:2+events21:54:130
16088899226411,2250cyclictest233344-21kworker/0:2+events22:58:370
16088899226410,2250cyclictest250870-21kworker/0:2+events23:47:190
16088899226310,2250cyclictest221950-21kworker/0:0+events22:40:570
16088899226011,2245cyclictest178915-21kworker/0:0+events20:07:090
1608989922518,2240cyclictest239952-21kworker/3:1+events23:15:203
16089899225011,2236cyclictest259592-21kworker/3:0+events00:17:433
16089899224911,2235cyclictest195166-21kworker/3:0+events20:59:013
1608889922475,2239cyclictest198259-21kworker/0:0+events21:08:590
16088899224711,2233cyclictest220163-21kworker/0:1+events22:12:070
1608889922468,2234cyclictest220163-21kworker/0:1+events22:18:400
16089899224210,2229cyclictest209374-21kworker/3:0+events21:51:083
1608889922409,2228cyclictest215719-21kworker/0:0+events22:01:260
1608939922389,2225cyclictest215574-21kworker/1:0+events22:02:591
1608959922336,2223cyclictest217225-21kworker/2:0+events22:09:522
16089599223111,2216cyclictest245252-21kworker/2:0+events23:33:132
16088899223011,2216cyclictest246829-21kworker/0:0+events23:37:520
1608939922289,2215cyclictest258228-21kworker/1:0+events00:13:331
16088899222811,2214cyclictest190098-21kworker/0:1+events20:36:530
16088899222811,2213cyclictest264487-21kworker/0:1+events00:32:570
16089599222711,2213cyclictest196740-21kworker/2:2+events21:17:532
16088899222711,2213cyclictest162118-21kworker/0:2+events19:16:410
16088899222511,2212cyclictest221950-21kworker/0:0+events22:30:590
16088899222411,2210cyclictest248436-21kworker/0:1+events23:44:000
16089399222311,2208cyclictest231650-21kworker/1:1+events22:48:351
16089399222211,2209cyclictest170566-21kworker/1:0+events19:40:471
1608939922209,2208cyclictest170566-21kworker/1:0+events19:36:331
16089599221910,2206cyclictest254914-21kworker/2:1+events23:59:272
16089599221910,2205cyclictest207715-21kworker/2:0+events21:46:092
16089399221910,2206cyclictest212333-21kworker/1:2+events21:58:031
16089599221712,2201cyclictest218886-21kworker/2:1+events22:15:542
16089399221711,2202cyclictest226817-21kworker/1:2+events22:36:221
16089899221612,2202cyclictest223427-21kworker/3:1+events22:45:063
1608959922167,2206cyclictest204318-21kworker/2:1+events21:26:382
16089599221610,2203cyclictest162181-21kworker/2:1+events19:31:382
16089399221610,2203cyclictest249707-21kworker/1:1+events23:44:211
16089399221610,2203cyclictest212333-21kworker/1:2+events21:49:341
16089399221511,2201cyclictest231650-21kworker/1:1+events22:57:261
16089399221311,2199cyclictest258228-21kworker/1:0+events00:18:061
16089399221211,2198cyclictest240189-21kworker/1:0+events23:26:441
16089399221211,2198cyclictest183550-21kworker/1:2+events20:22:221
16089599221011,2195cyclictest231742-21kworker/2:1+events23:05:292
16089399221011,2196cyclictest234835-21kworker/1:0+events23:03:341
1608889922094,2202cyclictest245191-21kworker/0:1+events23:30:330
1608959922088,2196cyclictest160436-21kworker/2:2+events19:13:182
16089599220610,2192cyclictest188498-21kworker/2:0+events20:46:002
16089599220511,2190cyclictest231742-21kworker/2:1+events23:38:152
16089599220510,2192cyclictest195076-21kworker/2:1+events20:56:422
16089599220411,2189cyclictest264424-21kworker/2:0+events00:29:292
16089599220410,2190cyclictest164171-21kworker/2:0+events19:26:042
1608959922036,2194cyclictest220570-21kworker/2:2+events22:29:512
16089599220311,2188cyclictest169289-21kworker/2:2+events19:38:062
16089599220310,2191cyclictest207715-21kworker/2:0+events21:50:452
16089599220310,2190cyclictest210936-21kworker/2:2+events22:03:452
16088899220310,2190cyclictest173731-21kworker/0:1+events19:59:120
1608959922029,2190cyclictest177300-21kworker/2:1+events20:14:452
16088899220210,2189cyclictest259473-21kworker/0:0+events00:12:020
1608959922009,2187cyclictest183580-21kworker/2:2+events20:34:572
16089599220011,2186cyclictest231742-21kworker/2:1+events23:41:412
16089599219911,2185cyclictest169289-21kworker/2:2+events19:51:442
1608939921998,2188cyclictest262886-21kworker/1:2+events00:24:321
16089599219411,2180cyclictest175389-21kworker/2:0+events19:55:492
16089399219210,2179cyclictest167750-21kworker/1:1+events19:33:291
1608939921878,2176cyclictest230043-21kworker/1:2+events22:54:441
1608959921829,2170cyclictest259856-21kworker/2:1+events00:24:112
16089599217511,2162cyclictest188498-21kworker/2:0+events21:00:092
16089599217311,2158cyclictest188498-21kworker/2:0+events20:37:382
16088899217311,2159cyclictest250870-21kworker/0:2+events23:50:230
16089899216911,2156cyclictest193562-21kworker/3:2+events20:50:103
16089899215711,2143cyclictest221700-21kworker/3:0+events22:16:183
16089899215611,2142cyclictest228632-21kworker/3:0+events22:44:203
16089899215012,2134cyclictest167516-21kworker/3:0+events19:28:173
16088899214610,2133cyclictest171014-21kworker/0:0+events19:44:560
1608939921399,2127cyclictest212333-21kworker/1:2+events22:13:371
16089899213611,2121cyclictest155479-21kworker/3:0+events19:10:163
16089899213411,2120cyclictest209374-21kworker/3:0+events21:41:123
16089899213312,2117cyclictest257867-21kworker/3:1+events00:14:403
16089899211210,2099cyclictest248405-21kworker/3:0+events23:40:323
1608939921129,2100cyclictest177039-21kworker/1:0+events20:04:501
16089899210710,2093cyclictest167516-21kworker/3:0+events19:43:233
16089899210511,2090cyclictest204724-21kworker/3:2+events21:33:123
16088899210410,2091cyclictest173731-21kworker/0:1+events20:23:340
16089899210311,2089cyclictest248405-21kworker/3:0+events23:49:123
16089899210311,2089cyclictest232085-21kworker/3:0+events22:55:303
16089899210211,2088cyclictest264360-21kworker/3:1+events00:34:263
16089899210211,2088cyclictest209374-21kworker/3:0+events21:46:323
16089899210211,2088cyclictest169169-21kworker/3:2+events19:34:163
16089899210211,2088cyclictest160394-21kworker/3:2+events19:21:113
1608989921018,2090cyclictest262737-21kworker/3:2+events00:25:393
16089899210111,2087cyclictest243207-21kworker/3:1+events23:52:383
16089899210010,2087cyclictest262737-21kworker/3:2+events00:22:403
16088899209810,2085cyclictest204647-21kworker/0:2+events21:32:040
1608989920889,2076cyclictest234606-21kworker/3:2+events23:05:053
16089599207710,2063cyclictest190217-21kworker/2:1+events20:40:172
1608889920766,2066cyclictest162118-21kworker/0:2+events19:14:270
1608939920686,2060cyclictest245283-21kworker/1:2+events23:35:101
1608959920659,2053cyclictest231742-21kworker/2:1+events23:24:262
1608939920659,2053cyclictest202934-21kworker/1:0+events21:32:491
1608939920638,2052cyclictest212333-21kworker/1:2+events22:17:051
16089599206010,2046cyclictest196740-21kworker/2:2+events21:13:142
16089599205010,2037cyclictest230133-21kworker/2:2+events22:57:502
16089599204810,2035cyclictest257958-21kworker/2:0+events00:15:272
1608959920268,2015cyclictest234924-21kworker/2:0+events23:02:242
1608959920267,2015cyclictest231742-21kworker/2:1+events23:16:512
16089399201310,2000cyclictest158949-21kworker/1:0+events19:14:051
16089899196110,1948cyclictest202995-21kworker/3:1+events21:26:173
1608989919519,1939cyclictest160394-21kworker/3:2+events19:16:183
1608989919506,1940cyclictest255109-21kworker/3:3+events00:00:333
1608989919496,1940cyclictest223427-21kworker/3:1+events22:39:503
1608989919488,1937cyclictest204724-21kworker/3:2+events21:39:393
16089899194810,1935cyclictest243207-21kworker/3:1+events23:33:593
1608989919466,1937cyclictest188920-21kworker/3:1+events20:49:483
16089899194510,1933cyclictest167516-21kworker/3:0+events20:30:033
1603632156111,25sleep30-21swapper/319:06:083
1606502141114,22sleep20-21swapper/219:09:462
1603802141109,27sleep00-21swapper/019:06:200
1604042140110,25sleep10-21swapper/119:06:371
160888992417,5cyclictest255119-40sh00:00:000
160898991610,4cyclictest170163-21ld19:35:183
16089899157,1cyclictest191rcu_preempt20:10:003
160898991514,1cyclictest26450irq/143-i91522:06:513
16089599159,4cyclictest267738-21munin-plugin-st00:40:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional