You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 20:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Aug 25, 2026 00:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90864599371516,3694cyclictest974680-21kworker/0:1+events22:40:170
90865099292916,2909cyclictest997014-21kworker/1:2+events00:10:201
90864599284113,2824cyclictest980704-21kworker/0:1+events22:55:290
9086599927978,2785cyclictest985915-21kworker/3:2+events23:15:163
90865999277312,2757cyclictest1004583-21kworker/3:2+events00:18:193
90865999275113,2735cyclictest941076-21kworker/3:2+events21:00:183
90865099274613,2729cyclictest1004579-21kworker/1:1+events00:35:121
90865099274013,2723cyclictest997014-21kworker/1:2+events00:20:131
90865099270812,2692cyclictest929702-21kworker/1:0+events20:14:561
90864599269913,2682cyclictest936077-21kworker/0:0+events20:40:010
90865099269813,2681cyclictest945972-21kworker/1:0+events21:22:431
90865099269712,2683cyclictest953756-21kworker/1:2+events21:30:211
90865099269712,2681cyclictest937468-21kworker/1:2+events21:00:391
90865499268113,2664cyclictest988975-21kworker/2:2+events23:20:142
90865999267413,2657cyclictest929451-21kworker/3:0+events20:15:193
90865099266113,2644cyclictest928018-21kworker/1:1+events20:20:431
90865099266113,2644cyclictest928018-21kworker/1:1+events20:20:431
90865999264413,2627cyclictest985915-21kworker/3:2+events23:20:353
90865499259612,2580cyclictest956677-21kworker/2:2+events21:40:392
90864599257010,2556cyclictest961641-21kworker/0:2+events22:15:170
90864599257010,2556cyclictest961641-21kworker/0:2+events22:15:170
90865499256612,2550cyclictest960281-21kworker/2:2+events21:49:432
90865499256212,2546cyclictest928134-21kworker/2:2+events20:13:472
90864599256112,2545cyclictest976488-21kworker/0:0+events22:49:220
90865499256011,2546cyclictest945653-21kworker/2:1+events21:05:132
90865499255512,2539cyclictest967987-21kworker/2:1+events22:11:512
9086459925531,2548cyclictest993597-21kworker/0:1+events23:39:370
90865999255212,2536cyclictest953555-21kworker/3:1+events21:41:253
90865499254911,2534cyclictest916790-21kworker/2:2+events19:47:552
90864599254911,2534cyclictest993597-21kworker/0:1+events00:02:230
9086599925477,2536cyclictest972449-21kworker/3:0+events22:26:163
90865999254712,2532cyclictest980823-21kworker/3:1+events22:57:253
90865999254512,2529cyclictest953555-21kworker/3:1+events21:48:593
90865999254212,2526cyclictest941076-21kworker/3:2+events20:56:513
90865999254210,2529cyclictest968075-21kworker/3:2+events22:14:103
90865499254212,2526cyclictest929863-21kworker/2:0+events20:22:582
90865499254212,2526cyclictest929863-21kworker/2:0+events20:22:582
90864599254012,2524cyclictest993597-21kworker/0:1+events00:07:190
90865499253913,2523cyclictest942355-21kworker/2:0+events20:58:232
90865099253512,2520cyclictest995340-21kworker/1:1+events23:50:341
90865999252812,2512cyclictest935929-21kworker/3:0+events20:36:323
90865499252812,2513cyclictest916790-21kworker/2:2+events19:40:412
90864599252711,2511cyclictest961641-21kworker/0:2+events21:56:590
90865999252611,2513cyclictest999703-21kworker/3:2+events00:00:023
90865099252012,2504cyclictest945972-21kworker/1:0+events21:39:321
90865499251312,2497cyclictest982665-21kworker/2:2+events23:03:572
9086599925125,2502cyclictest919899-21kworker/3:2+events19:45:153
90865999251112,2496cyclictest955168-21kworker/3:0+events22:00:283
90865499250910,2495cyclictest979144-21kworker/2:0+events22:52:262
90865999250411,2490cyclictest979205-21kworker/3:0+events23:04:213
90864599250212,2486cyclictest918506-21kworker/0:2+events19:52:530
90864599250112,2485cyclictest937677-21kworker/0:1+events21:01:250
90865499250012,2484cyclictest984460-21kworker/2:3+events23:08:542
90865999249512,2480cyclictest1006877-21kworker/3:2+events00:39:203
90864599249312,2479cyclictest913378-21kworker/0:1+events19:25:280
90864599249312,2478cyclictest918506-21kworker/0:2+events19:55:580
90865499249212,2476cyclictest1003070-21kworker/2:2+events00:24:472
90864599249212,2477cyclictest942443-21kworker/0:0+events20:55:430
90864599249112,2477cyclictest987378-21kworker/0:0+events23:21:220
90865499249012,2474cyclictest997552-21kworker/2:1+events23:55:292
90865499248912,2473cyclictest915187-21kworker/2:1+events20:09:162
90864599248912,2473cyclictest961641-21kworker/0:2+events22:38:490
90865499248811,2475cyclictest915187-21kworker/2:1+events19:30:232
90864599248812,2473cyclictest980704-21kworker/0:1+events22:52:500
90865999248712,2471cyclictest944289-21kworker/3:1+events21:18:563
90865499248612,2470cyclictest891731-21kworker/2:1+events19:21:202
9086459924850,2481cyclictest985742-21kworker/0:1+events23:08:070
90865999248412,2468cyclictest944289-21kworker/3:1+events21:07:313
90865999248410,2471cyclictest993556-21kworker/3:2+events23:35:273
90865499248412,2469cyclictest952061-21kworker/2:0+events21:29:132
90865999248311,2468cyclictest1005244-21kworker/3:1+events00:21:013
90865499248210,2468cyclictest915187-21kworker/2:1+events19:39:552
90865499248111,2467cyclictest966382-21kworker/2:2+events22:08:282
9086599924809,2467cyclictest937579-21kworker/3:2+events20:40:243
90864599248012,2465cyclictest937677-21kworker/0:1+events20:45:440
90865499247912,2463cyclictest1004664-21kworker/2:1+events00:32:062
90864599247812,2462cyclictest932696-21kworker/0:0+events20:23:210
90864599247812,2462cyclictest932696-21kworker/0:0+events20:23:210
9086549924767,2467cyclictest961882-21kworker/2:0+events22:00:062
90865099247612,2460cyclictest999196-21kworker/1:0+events00:00:251
90864599247612,2461cyclictest1006805-21kworker/0:1+events00:29:260
90865099247512,2459cyclictest956617-21kworker/1:1+events22:19:501
90865099247512,2459cyclictest956617-21kworker/1:1+events22:19:501
90865099247512,2459cyclictest942654-21kworker/1:0+events20:57:381
90865499247412,2459cyclictest915187-21kworker/2:1+events20:03:592
90865499247412,2458cyclictest979144-21kworker/2:0+events22:47:512
90865499247412,2458cyclictest1004664-21kworker/2:1+events00:28:142
90865499247412,2458cyclictest1003070-21kworker/2:2+events00:10:422
90864599247312,2458cyclictest937677-21kworker/0:1+events20:42:170
90865099247210,2458cyclictest956617-21kworker/1:1+events22:36:301
90865999247112,2455cyclictest968075-21kworker/3:2+events22:33:083
90865099246912,2454cyclictest935807-21kworker/1:1+events20:40:481
90864599246911,2454cyclictest924913-21kworker/0:0+events20:04:450
90865999246811,2453cyclictest950313-21kworker/3:2+events21:21:343
90864599246812,2452cyclictest951905-21kworker/0:2+events21:21:560
90865999246612,2451cyclictest915033-21kworker/3:1+events19:27:453
90865499246612,2451cyclictest947379-21kworker/2:2+events21:17:502
90865499246611,2451cyclictest915187-21kworker/2:1+events20:27:312
90864599246612,2451cyclictest961641-21kworker/0:2+events21:51:380
90864599246612,2450cyclictest924913-21kworker/0:0+events20:07:240
90864599246611,2452cyclictest951905-21kworker/0:2+events21:29:590
90865999246511,2451cyclictest951937-21kworker/3:0+events21:26:123
90865499246512,2449cyclictest903301-21kworker/2:0+events19:14:262
90865499246412,2449cyclictest984324-21kworker/2:1+events23:11:102
90865499246412,2448cyclictest961882-21kworker/2:0+events21:54:422
90865499246411,2450cyclictest911872-21kworker/2:2+events19:18:162
90865499246211,2449cyclictest988975-21kworker/2:2+events23:25:102
90864599246210,2449cyclictest1010318-21kworker/0:2+events00:39:430
90865099246111,2446cyclictest932611-21kworker/1:2+events20:25:591
90865999245910,2446cyclictest995158-21kworker/3:0+events23:56:163
90864599245912,2443cyclictest1001473-21kworker/0:2+events00:23:370
90865999245711,2442cyclictest948682-21kworker/3:0+events21:14:493
90865999245610,2442cyclictest996784-21kworker/3:2+events23:50:573
90865999245512,2440cyclictest974328-21kworker/3:1+events22:36:533
90864599245511,2440cyclictest993597-21kworker/0:1+events23:42:160
90865999245412,2438cyclictest955168-21kworker/3:0+events21:57:463
90865999245412,2438cyclictest955168-21kworker/3:0+events21:33:503
90865099245412,2438cyclictest935807-21kworker/1:1+events20:33:321
90865999245312,2439cyclictest984318-21kworker/3:1+events23:11:333
90865999245211,2437cyclictest918276-21kworker/3:1+events19:53:173
90865099245212,2437cyclictest926299-21kworker/1:2+events20:10:001
90865999245112,2436cyclictest956779-21kworker/3:2+events21:38:213
90865999245112,2435cyclictest980823-21kworker/3:1+events22:54:203
90865999245111,2437cyclictest1006877-21kworker/3:2+events00:27:063
90865999245111,2436cyclictest984318-21kworker/3:1+events23:06:133
90865099244811,2433cyclictest958503-21kworker/1:2+events21:45:571
90865999244712,2432cyclictest932668-21kworker/3:0+events20:22:123
90865999244712,2432cyclictest932668-21kworker/3:0+events20:22:123
90865499244711,2432cyclictest947379-21kworker/2:2+events21:23:072
9086509924458,2433cyclictest985927-21kworker/1:0+events23:28:361
90865099244511,2430cyclictest945972-21kworker/1:0+events21:07:541
90865999244311,2430cyclictest924956-21kworker/3:1+events20:02:273
90864599243811,2424cyclictest926597-21kworker/0:1+events20:11:090
90865999243412,2419cyclictest1001352-21kworker/3:0+events00:12:353
90865099243212,2416cyclictest956617-21kworker/1:1+events21:58:081
9086509924278,2416cyclictest956617-21kworker/1:1+events22:28:101
90865099242012,2404cyclictest937468-21kworker/1:2+events20:51:291
90865499241911,2405cyclictest1003070-21kworker/2:2+events00:17:322
90865999240711,2392cyclictest926671-21kworker/3:2+events20:07:013
9086459924058,2393cyclictest987378-21kworker/0:0+events23:31:170
90865499240311,2388cyclictest993567-21kworker/2:1+events23:32:262
90865499240112,2385cyclictest967987-21kworker/2:1+events22:15:412
90865499240112,2385cyclictest967987-21kworker/2:1+events22:15:412
90865099240012,2386cyclictest945972-21kworker/1:0+events21:10:571
90865499239911,2385cyclictest995193-21kworker/2:0+events23:41:532
90865099239912,2383cyclictest956617-21kworker/1:1+events22:31:351
90865499239811,2383cyclictest997552-21kworker/2:1+events23:49:042
90865099239812,2382cyclictest916519-21kworker/1:1+events19:49:271
90865099239810,2385cyclictest965023-21kworker/1:2+events22:08:031
90865099239612,2380cyclictest935807-21kworker/1:1+events20:37:201
90864599239511,2380cyclictest915216-21kworker/0:2+events19:31:090
90865099239412,2378cyclictest993659-21kworker/1:2+events23:33:331
90865099239311,2378cyclictest928018-21kworker/1:1+events20:15:411
90865099239111,2377cyclictest997014-21kworker/1:2+events23:47:541
90865099239012,2375cyclictest1001255-21kworker/1:1+events00:06:131
90865099239012,2374cyclictest985927-21kworker/1:0+events23:42:391
90865099238911,2374cyclictest987551-21kworker/1:2+events23:23:171
90865099238910,2375cyclictest945972-21kworker/1:0+events21:29:371
90865099238812,2373cyclictest956617-21kworker/1:1+events22:23:141
90865099238812,2372cyclictest979177-21kworker/1:2+events22:48:151
90865099238811,2375cyclictest979177-21kworker/1:2+events22:50:071
90865099238712,2372cyclictest956617-21kworker/1:1+events22:03:311
90865099238712,2372cyclictest1004579-21kworker/1:1+events00:33:181
90865099238710,2373cyclictest982700-21kworker/1:1+events22:59:211
90865999238612,2371cyclictest960445-21kworker/3:3+events21:50:303
90865099238612,2370cyclictest999196-21kworker/1:0+events23:56:381
90865999238511,2370cyclictest969951-21kworker/3:3+events22:23:353
90865999238310,2369cyclictest995158-21kworker/3:0+events23:43:003
90865099238312,2368cyclictest918184-21kworker/1:0+events19:39:341
90865099238011,2366cyclictest916519-21kworker/1:1+events19:40:181
90865099237812,2362cyclictest956617-21kworker/1:1+events22:43:371
90865099237712,2362cyclictest910012-21kworker/1:1+events19:22:481
90865099237711,2362cyclictest956617-21kworker/1:1+events21:54:191
9086599923738,2363cyclictest915033-21kworker/3:1+events19:30:013
90865099237312,2359cyclictest912025-21kworker/1:0+events19:25:071
90865999237011,2355cyclictest995158-21kworker/3:0+events23:49:483
90865499236012,2344cyclictest915187-21kworker/2:1+events19:50:132
90865499234411,2329cyclictest956677-21kworker/2:2+events21:39:082
90864599233911,2325cyclictest1008446-21kworker/0:0+events00:30:120
90865499233811,2323cyclictest974539-21kworker/2:2+events22:44:002
90865099233310,2320cyclictest966629-21kworker/1:0+events22:11:291
9086599923246,2315cyclictest926671-21kworker/3:2+events20:25:363
90865999232210,2309cyclictest934339-21kworker/3:1+events20:31:383
90865499231812,2302cyclictest995193-21kworker/2:0+events23:52:302
90864599231212,2296cyclictest916824-21kworker/0:1+events19:41:020
90864599230812,2292cyclictest965082-21kworker/0:1+events22:05:220
90865499230010,2286cyclictest984324-21kworker/2:1+events23:17:562
90865099230010,2286cyclictest916519-21kworker/1:1+events19:57:531
90865099228710,2275cyclictest979177-21kworker/1:2+events23:00:531
90865499227611,2262cyclictest939804-21kworker/2:2+events20:49:112
90865499227511,2261cyclictest945653-21kworker/2:1+events21:12:082
90865499227410,2261cyclictest997552-21kworker/2:1+events00:01:582
9086459922745,2265cyclictest997941-21kworker/0:2+events23:52:070
90864599227411,2260cyclictest918506-21kworker/0:2+events19:46:000
90864599227411,2259cyclictest984112-21kworker/0:2+events23:16:500
90865499227311,2259cyclictest995193-21kworker/2:0+events23:37:422
90864599227311,2259cyclictest961641-21kworker/0:2+events22:27:460
90864599227311,2259cyclictest926597-21kworker/0:1+events20:16:280
90864599227310,2260cyclictest945837-21kworker/0:0+events21:09:260
90864599227211,2257cyclictest984112-21kworker/0:2+events23:14:330
90865499227111,2257cyclictest982665-21kworker/2:2+events22:58:562
90865499227011,2255cyclictest969993-21kworker/2:0+events22:22:052
9086509922709,2260cyclictest985927-21kworker/1:0+events23:10:041
90864599227012,2255cyclictest934297-21kworker/0:1+events20:30:310
90865499226910,2256cyclictest1001288-21kworker/2:0+events00:09:342
9086459922699,2257cyclictest945837-21kworker/0:0+events21:18:350
9086459922698,2258cyclictest953606-21kworker/0:1+events21:32:200
90864599226911,2255cyclictest937677-21kworker/0:1+events20:51:520
90864599226911,2254cyclictest990791-21kworker/0:3+events23:27:290
90865499226811,2254cyclictest937780-21kworker/2:1+events20:50:432
90864599226810,2255cyclictest944195-21kworker/0:2+events21:13:170
90864599226810,2254cyclictest957249-21kworker/0:1+events21:42:580
90865499226711,2253cyclictest913556-21kworker/2:0+events19:28:532
90865499226711,2252cyclictest929863-21kworker/2:0+events20:17:152
9086459922679,2254cyclictest997047-21kworker/0:0+events23:49:260
90864599226611,2252cyclictest909774-21kworker/0:2+events19:15:340
90864599226610,2252cyclictest976488-21kworker/0:0+events23:01:160
90864599226610,2252cyclictest961641-21kworker/0:2+events22:12:380
9086459922658,2254cyclictest904941-21kworker/0:0+events19:24:430
90865999226410,2250cyclictest913416-21kworker/3:0+events19:22:273
9086459922647,2254cyclictest961641-21kworker/0:2+events22:24:450
90865999226110,2248cyclictest939468-21kworker/3:1+events20:51:073
9086459922619,2250cyclictest904941-21kworker/0:0+events19:39:110
90865999226011,2246cyclictest966483-21kworker/3:0+events22:09:363
90865999225310,2240cyclictest977597-21kworker/3:2+events22:44:463
90865499225210,2239cyclictest1010100-21kworker/2:2+events00:36:192
90865499224210,2229cyclictest969993-21kworker/2:0+events22:29:162
90865499224111,2226cyclictest972814-21kworker/2:1+events22:30:242
90864599223910,2226cyclictest961641-21kworker/0:2+events22:04:150
90865999223310,2220cyclictest935929-21kworker/3:0+events20:46:303
90865999223210,2219cyclictest1006877-21kworker/3:2+events00:34:493
9086599922316,2222cyclictest968075-21kworker/3:2+events22:16:273
9086599922316,2222cyclictest968075-21kworker/3:2+events22:16:263
90865999223010,2217cyclictest974328-21kworker/3:1+events22:46:173
9086599922288,2216cyclictest984318-21kworker/3:1+events23:27:063
90865999222811,2214cyclictest911769-21kworker/3:2+events19:35:223
90865999222710,2214cyclictest926671-21kworker/3:2+events20:11:553
90865499222611,2211cyclictest943959-21kworker/2:2+events21:01:012
90865099222411,2210cyclictest906399-21kworker/1:2+events19:17:531
90865499221510,2202cyclictest934329-21kworker/2:2+events20:36:112
90865999220610,2192cyclictest908796-21kworker/3:1+events19:18:403
9086459922068,2194cyclictest993597-21kworker/0:1+events23:59:380
90865099219510,2181cyclictest997014-21kworker/1:2+events00:17:081
90865099219210,2178cyclictest995340-21kworker/1:1+events23:39:581
90864599218610,2172cyclictest934297-21kworker/0:1+events20:27:550
90865099218411,2170cyclictest913706-21kworker/1:2+events19:32:191
90865099218410,2170cyclictest987551-21kworker/1:2+events23:16:021
90865099218310,2170cyclictest979177-21kworker/1:2+events23:05:491
90865099218011,2165cyclictest926299-21kworker/1:2+events20:04:231
90865099217810,2164cyclictest1006834-21kworker/1:0+events00:29:011
90865499217710,2164cyclictest974539-21kworker/2:2+events22:35:222
90865999217311,2159cyclictest1001352-21kworker/3:0+events00:08:503
90865099216811,2153cyclictest956617-21kworker/1:1+events21:41:021
90864599214410,2131cyclictest1004426-21kworker/0:0+events00:13:210
9086549921423,2135cyclictest935958-21kworker/2:0+events20:42:412
9086549921179,2104cyclictest953723-21kworker/2:1+events21:31:312
90865499211110,2098cyclictest960281-21kworker/2:2+events21:57:222
9086549921059,2093cyclictest915187-21kworker/2:1+events20:30:532
90865999210410,2090cyclictest906590-21kworker/3:0+events19:12:563
90865499209810,2085cyclictest915187-21kworker/2:1+events19:58:162
9086459920989,2086cyclictest951905-21kworker/0:2+events21:37:140
90865099209510,2082cyclictest919837-21kworker/1:2+events19:51:001
90865999207610,2062cyclictest923104-21kworker/3:2+events19:57:303
90865999207510,2062cyclictest984318-21kworker/3:1+events23:33:573
90864599206710,2053cyclictest972876-21kworker/0:0+events22:31:580
90865999204110,2028cyclictest918276-21kworker/3:1+events19:43:213
90864599204011,2026cyclictest909774-21kworker/0:2+events19:14:030
90865099202510,2012cyclictest906399-21kworker/1:2+events19:13:431
90865099202210,2008cyclictest937468-21kworker/1:2+events20:46:071
9086509920219,2009cyclictest945972-21kworker/1:0+events21:17:281
9081402155111,24sleep20-21swapper/219:05:522
9083322149106,37sleep00-21swapper/019:08:140
9083482143112,26sleep10-21swapper/119:08:271
9084322140108,26sleep30-21swapper/319:09:333
90864599238,2cyclictest191rcu_preempt00:20:000
90864599190,17cyclictest960353-21taskset21:49:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional