You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-17 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Tue Nov 17, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267148999304013,3023cyclictest2741238-21kworker/3:0+events23:10:103
267148299297813,2960cyclictest2753343-21kworker/1:2+events23:25:191
267147999280313,2785cyclictest2758476-21kworker/0:2+events00:00:200
267148299276513,2748cyclictest2680992-21kworker/1:1+events20:06:291
26714899927486,2738cyclictest2743438-21kworker/3:2+events22:55:193
267148299273412,2718cyclictest2695611-21kworker/1:0+events20:34:421
267148299268013,2663cyclictest2677791-21kworker/1:1+events19:30:191
267148299267413,2658cyclictest2740689-21kworker/1:2+events22:49:591
267148299263313,2616cyclictest2743420-21kworker/1:0+events23:00:161
267148999263012,2614cyclictest2697093-21kworker/3:2+events20:45:173
267147999262712,2611cyclictest2751962-21kworker/0:1+events23:35:140
267148299254311,2528cyclictest2721068-21kworker/1:1+events21:49:121
26714799925419,2528cyclictest2769855-21kworker/0:0+events00:20:190
267148299254012,2525cyclictest2721068-21kworker/1:1+events21:42:211
267148299253012,2514cyclictest2711735-21kworker/1:0+events21:14:511
267148599252912,2513cyclictest2710226-21kworker/2:0+events21:20:162
267148299252611,2511cyclictest2755268-21kworker/1:0+events23:43:351
267147999251812,2502cyclictest2710138-21kworker/0:2+events21:10:180
267148599251413,2498cyclictest2708474-21kworker/2:2+events21:05:202
267148299249712,2482cyclictest2695611-21kworker/1:0+events20:43:231
267148299249712,2481cyclictest2738886-21kworker/1:1+events22:53:241
267148299249712,2481cyclictest2732374-21kworker/1:2+events22:17:361
267148299249212,2477cyclictest2713379-21kworker/1:2+events21:32:491
267148299249212,2477cyclictest2695611-21kworker/1:0+events20:36:361
267148299249112,2476cyclictest2776089-21kworker/1:2+events00:32:271
267148299248811,2475cyclictest2695611-21kworker/1:0+events20:25:071
267148999248510,2472cyclictest2716438-21kworker/3:2+events21:31:193
267148299248212,2466cyclictest2713379-21kworker/1:2+events21:38:561
267148299247912,2463cyclictest2732374-21kworker/1:2+events22:22:581
267148299247812,2464cyclictest2732374-21kworker/1:2+events22:35:101
267148299247611,2462cyclictest2747059-21kworker/1:1+events23:10:571
267148299247412,2458cyclictest2680992-21kworker/1:1+events20:03:041
267148299246911,2455cyclictest2713379-21kworker/1:2+events21:25:591
267148599246711,2453cyclictest2740385-21kworker/2:2+events23:01:272
267147999246712,2451cyclictest2727668-21kworker/0:0+events22:12:200
267147999245012,2434cyclictest2745344-21kworker/0:0+events23:01:030
267148299244712,2432cyclictest2710107-21kworker/1:1+events21:21:481
267148599244612,2430cyclictest2698762-21kworker/2:1+events20:39:132
267148299244310,2429cyclictest2760231-21kworker/1:1+events23:49:191
26714899924426,2433cyclictest2761420-21kworker/3:1+events23:57:203
267148999243912,2423cyclictest2761420-21kworker/3:1+events23:53:313
267148299243710,2424cyclictest2770268-21kworker/1:0+events00:25:351
267147999243410,2421cyclictest2714914-21kworker/0:2+events21:25:140
26714829924339,2420cyclictest2768265-21kworker/1:3+events00:13:251
267148599243012,2415cyclictest2750232-21kworker/2:0+events23:24:132
267148599241912,2403cyclictest2771416-21kworker/2:1+events00:35:512
267148599241212,2396cyclictest2690519-21kworker/2:0+events20:14:482
267148599240812,2392cyclictest2713043-21kworker/2:2+events21:26:232
267148999240712,2392cyclictest2766352-21kworker/3:0+events00:10:183
26714829924069,2393cyclictest2747059-21kworker/1:1+events23:15:571
267147999240310,2389cyclictest2722666-21kworker/0:2+events21:50:410
267148999239912,2383cyclictest2751928-21kworker/3:0+events23:21:113
26714899923977,2387cyclictest2766352-21kworker/3:0+events00:27:303
26714829923978,2385cyclictest2747059-21kworker/1:1+events23:21:571
267148599239512,2381cyclictest2771416-21kworker/2:1+events00:25:132
267148599239312,2378cyclictest2750232-21kworker/2:0+events00:03:022
267148999239012,2375cyclictest2719652-21kworker/3:2+events21:55:173
267148599238912,2373cyclictest2750232-21kworker/2:0+events23:15:322
267148999238710,2373cyclictest2697093-21kworker/3:2+events21:06:303
26714859923878,2375cyclictest2737166-21kworker/2:2+events22:36:172
267148599238612,2371cyclictest2682800-21kworker/2:1+events19:53:532
267148599238611,2371cyclictest2740385-21kworker/2:2+events22:49:362
267148999238410,2371cyclictest2713199-21kworker/3:1+events21:23:203
267148999238212,2366cyclictest2700549-21kworker/3:0+events20:38:283
267148999238211,2368cyclictest2766352-21kworker/3:0+events00:18:483
267148999238211,2368cyclictest2748613-21kworker/3:2+events23:07:543
267148599238111,2367cyclictest2768105-21kworker/2:2+events00:13:482
26714799923808,2368cyclictest2693829-21kworker/0:2+events20:21:150
267148999237912,2365cyclictest2728924-21kworker/3:0+events22:06:143
267148599237311,2359cyclictest2738766-21kworker/2:0+events22:42:172
267147999237310,2360cyclictest2727668-21kworker/0:0+events22:05:530
26714899923679,2355cyclictest2719652-21kworker/3:2+events21:47:173
267148599236511,2350cyclictest2727639-21kworker/2:0+events22:27:312
267148999236312,2347cyclictest2771500-21kworker/3:2+events00:30:343
267148999236311,2349cyclictest2745405-21kworker/3:1+events23:00:403
267148599236110,2348cyclictest2724331-21kworker/2:2+events21:54:322
267147999235911,2345cyclictest2758476-21kworker/0:2+events00:07:360
267147999235412,2339cyclictest2737288-21kworker/0:0+events22:38:100
267147999235412,2338cyclictest2706881-21kworker/0:1+events21:41:150
267148999235210,2338cyclictest2735572-21kworker/3:1+events22:31:213
267148599235212,2337cyclictest2713043-21kworker/2:2+events21:16:472
267148599235210,2339cyclictest2702305-21kworker/2:2+events20:48:182
267147999235210,2339cyclictest2727668-21kworker/0:0+events22:23:200
267148999235112,2335cyclictest2741238-21kworker/3:0+events22:53:013
267147999235010,2336cyclictest2774484-21kworker/0:2+events00:36:360
267147999234912,2334cyclictest2691222-21kworker/0:1+events20:37:210
267147999234911,2336cyclictest2758476-21kworker/0:2+events23:55:040
267147999234812,2332cyclictest2693829-21kworker/0:2+events20:18:580
267148999234711,2332cyclictest2716438-21kworker/3:2+events21:29:473
267148599234710,2334cyclictest2750232-21kworker/2:0+events23:41:432
267148999234612,2331cyclictest2755479-21kworker/3:0+events23:39:253
267147999234212,2326cyclictest2751962-21kworker/0:1+events23:22:190
267148299234114,2324cyclictest2724392-21kworker/1:2+events21:54:541
267147999233910,2325cyclictest2735665-21kworker/0:1+events22:44:130
267148299233512,2319cyclictest2703577-21kworker/1:1+events20:50:131
267148599233412,2319cyclictest2740385-21kworker/2:2+events22:56:062
267148299233410,2322cyclictest2776089-21kworker/1:2+events00:35:061
267147999233411,2320cyclictest2748689-21kworker/0:0+events23:19:420
267148599232912,2314cyclictest2703943-21kworker/2:0+events20:56:592
267148299232812,2313cyclictest2755268-21kworker/1:0+events23:34:491
267148999232711,2313cyclictest2708372-21kworker/3:0+events21:01:543
267148999231810,2304cyclictest2697093-21kworker/3:2+events20:41:323
267148599231712,2302cyclictest2667847-21kworker/2:2+events19:16:192
267147999231312,2299cyclictest2774484-21kworker/0:2+events00:31:190
26714899923038,2292cyclictest2748613-21kworker/3:2+events23:30:423
26714899922974,2289cyclictest2757297-21kworker/3:1+events23:40:113
267147999228510,2271cyclictest2706881-21kworker/0:1+events21:16:250
267148999228011,2266cyclictest2713199-21kworker/3:1+events21:18:203
267148299227411,2259cyclictest2745311-21kworker/1:2+events23:08:161
267148299227211,2258cyclictest2734007-21kworker/1:0+events22:26:001
267147999227211,2257cyclictest2751962-21kworker/0:1+events23:40:590
267148299227111,2258cyclictest2738886-21kworker/1:1+events22:40:031
267148299227010,2257cyclictest2695611-21kworker/1:0+events21:06:531
267148299226911,2256cyclictest2670881-21kworker/1:0+events19:25:021
267148299226911,2256cyclictest2670881-21kworker/1:0+events19:25:021
267148299226911,2255cyclictest2724392-21kworker/1:2+events22:00:541
267148299226911,2255cyclictest2690442-21kworker/1:0+events20:13:151
267148299226911,2254cyclictest2758507-21kworker/1:2+events00:06:041
267148299226811,2255cyclictest2758507-21kworker/1:2+events23:50:051
267148299226811,2254cyclictest2680992-21kworker/1:1+events19:57:191
267148299226811,2254cyclictest2679393-21kworker/1:0+events19:39:211
267148299226711,2252cyclictest2664794-21kworker/1:1+events19:15:571
26714829922669,2254cyclictest2664794-21kworker/1:1+events19:13:181
267148299226410,2251cyclictest2693927-21kworker/1:2+events20:18:371
267148299226311,2249cyclictest2770268-21kworker/1:0+events00:16:301
267148299226310,2250cyclictest2695611-21kworker/1:0+events21:03:021
267148299226111,2247cyclictest2745311-21kworker/1:2+events22:57:161
267148299226111,2247cyclictest2679393-21kworker/1:0+events19:44:211
267148299226010,2247cyclictest2721068-21kworker/1:1+events21:55:371
267148299226010,2246cyclictest2711735-21kworker/1:0+events21:17:561
26714829922575,2249cyclictest2676134-21kworker/1:2+events19:22:011
267148299225611,2242cyclictest2755268-21kworker/1:0+events23:39:041
267148299225610,2243cyclictest2680992-21kworker/1:1+events19:46:391
267148999225310,2239cyclictest2730886-21kworker/3:3+events22:18:013
26714799922519,2239cyclictest2706881-21kworker/0:1+events21:07:140
26714859922499,2236cyclictest2771416-21kworker/2:1+events00:24:032
267148599224912,2233cyclictest2755086-21kworker/2:1+events23:32:092
267148299224611,2231cyclictest2680992-21kworker/1:1+events20:20:531
267148299224411,2230cyclictest2695611-21kworker/1:0+events20:46:031
26714829922429,2230cyclictest2695611-21kworker/1:0+events20:57:221
267148999223811,2223cyclictest2685896-21kworker/3:2+events20:00:003
267147999223111,2217cyclictest2691222-21kworker/0:1+events20:34:190
267148999222911,2214cyclictest2733945-21kworker/3:0+events22:39:413
267148999222910,2216cyclictest2713199-21kworker/3:1+events21:38:113
267148999222311,2209cyclictest2685896-21kworker/3:2+events20:06:513
26714859922239,2211cyclictest2700653-21kworker/2:0+events20:41:532
26714899922226,2212cyclictest2759383-21kworker/3:2+events23:46:393
267148599222111,2206cyclictest2761545-21kworker/2:1+events23:59:342
267147999221910,2207cyclictest2751962-21kworker/0:1+events23:27:140
267148999221810,2205cyclictest2719652-21kworker/3:2+events22:11:113
26714829922177,2207cyclictest2724392-21kworker/1:2+events22:05:291
267148999221212,2196cyclictest2766352-21kworker/3:0+events00:03:253
267147999219710,2184cyclictest2737288-21kworker/0:0+events22:34:490
267148999219112,2176cyclictest2693845-21kworker/3:2+events20:19:453
267148999218812,2173cyclictest2730886-21kworker/3:3+events22:23:433
267147999218811,2173cyclictest2760125-21kworker/0:0+events23:47:010
267148599218612,2171cyclictest2774696-21kworker/2:2+events00:30:562
267148599218611,2172cyclictest2672856-21kworker/2:1+events19:22:252
267148999218510,2172cyclictest2676097-21kworker/3:2+events19:27:183
267148999218510,2172cyclictest2676097-21kworker/3:2+events19:27:183
267148999218110,2167cyclictest2689385-21kworker/3:1+events20:23:583
267148999217811,2164cyclictest2705120-21kworker/3:0+events20:51:193
267148299217810,2164cyclictest2764788-21kworker/1:1+events00:02:401
267148999217411,2161cyclictest2705120-21kworker/3:0+events20:55:053
267148999217011,2156cyclictest2719652-21kworker/3:2+events22:00:313
267147999217011,2155cyclictest2748689-21kworker/0:0+events23:14:240
267147999216911,2155cyclictest2681196-21kworker/0:2+events19:53:290
267147999216810,2155cyclictest2705241-21kworker/0:2+events20:57:440
26714899921679,2155cyclictest2761420-21kworker/3:1+events00:06:253
26714899921679,2154cyclictest2748613-21kworker/3:2+events23:19:173
267148999216710,2154cyclictest2679300-21kworker/3:0+events19:51:363
267148599216711,2152cyclictest2761545-21kworker/2:1+events23:47:472
267148599216711,2152cyclictest2724331-21kworker/2:2+events21:57:522
267148599216710,2154cyclictest2703943-21kworker/2:0+events21:01:312
267148999216611,2151cyclictest2771500-21kworker/3:2+events00:23:433
26714799921669,2154cyclictest2732316-21kworker/0:1+events22:18:230
267147999216611,2152cyclictest2706881-21kworker/0:1+events21:46:550
267148999216511,2151cyclictest2733945-21kworker/3:0+events22:26:453
267148999216511,2151cyclictest2687529-21kworker/3:0+events20:00:473
267148599216511,2152cyclictest2724331-21kworker/2:2+events22:00:072
267148999216411,2149cyclictest2679300-21kworker/3:0+events19:42:043
267148999216410,2150cyclictest2739079-21kworker/3:3+events22:42:413
267148599216412,2149cyclictest2719697-21kworker/2:0+events21:45:462
267148599216411,2150cyclictest2761545-21kworker/2:1+events23:52:232
267148599216410,2151cyclictest2714765-21kworker/2:1+events21:37:012
267148999216311,2149cyclictest2741238-21kworker/3:0+events22:47:173
26714859921638,2152cyclictest2740385-21kworker/2:2+events23:06:222
267148599216311,2149cyclictest2740385-21kworker/2:2+events23:11:212
267148599216310,2150cyclictest2706820-21kworker/2:1+events21:13:192
26714899921628,2150cyclictest2722888-21kworker/3:1+events21:51:503
267148999216211,2148cyclictest2669460-21kworker/3:0+events19:23:533
26714859921628,2151cyclictest2727639-21kworker/2:0+events22:19:582
267148599216211,2147cyclictest2717998-21kworker/2:2+events21:43:522
267147999216211,2148cyclictest2691222-21kworker/0:1+events20:28:340
267148999216110,2149cyclictest2753546-21kworker/3:1+events23:26:083
26714859921618,2150cyclictest2722578-21kworker/2:1+events22:15:002
267148599216111,2147cyclictest2688825-21kworker/2:2+events20:24:202
267148599216111,2146cyclictest2681166-21kworker/2:0+events19:58:282
267148599216010,2146cyclictest2688825-21kworker/2:2+events20:07:372
26714799921607,2150cyclictest2677940-21kworker/0:0+events19:33:420
26714899921588,2147cyclictest2697093-21kworker/3:2+events20:29:203
267148599215810,2145cyclictest2676510-21kworker/2:0+events19:26:112
267148599215810,2145cyclictest2676510-21kworker/2:0+events19:26:102
26714799921578,2145cyclictest2763064-21kworker/0:1+events23:53:060
26714899921569,2143cyclictest2676097-21kworker/3:2+events19:33:203
267147999215611,2141cyclictest2698821-21kworker/0:0+events20:41:090
267147999215610,2143cyclictest2698821-21kworker/0:0+events20:54:420
267147999215511,2141cyclictest2735665-21kworker/0:1+events22:50:240
267147999215511,2141cyclictest2684081-21kworker/0:1+events20:00:230
267148599215411,2140cyclictest2750232-21kworker/2:0+events00:19:112
26714799921548,2142cyclictest2751962-21kworker/0:1+events23:32:320
267147999215411,2140cyclictest2746967-21kworker/0:1+events23:09:010
267147999215411,2140cyclictest2716673-21kworker/0:0+events21:34:200
267147999215411,2140cyclictest2669449-21kworker/0:2+events19:15:110
267147999215410,2141cyclictest2676163-21kworker/0:1+events19:35:590
267147999215311,2139cyclictest2771675-21kworker/0:1+events00:26:210
267147999215311,2138cyclictest2742284-21kworker/0:2+events22:59:540
26714859921527,2142cyclictest2755086-21kworker/2:1+events23:35:582
267148599215211,2138cyclictest2679568-21kworker/2:2+events19:43:142
267147999215111,2137cyclictest2687469-21kworker/0:0+events20:13:380
267147999215011,2138cyclictest2669449-21kworker/0:2+events19:21:160
267147999214910,2136cyclictest2698821-21kworker/0:0+events20:49:260
267148299214611,2132cyclictest2728668-21kworker/1:1+events22:13:281
267148299214511,2131cyclictest2735603-21kworker/1:1+events22:32:091
267147999214511,2131cyclictest2687469-21kworker/0:0+events20:08:000
267148599214011,2126cyclictest2755086-21kworker/2:1+events23:26:312
26714799921409,2128cyclictest2758476-21kworker/0:2+events00:13:020
267147999214011,2126cyclictest2706881-21kworker/0:1+events21:39:180
26714799921386,2129cyclictest2722666-21kworker/0:2+events21:59:210
26714859921356,2126cyclictest2741994-21kworker/2:1+events22:51:542
267148599213011,2115cyclictest2727639-21kworker/2:0+events22:24:272
267148999212611,2112cyclictest2692255-21kworker/3:0+events20:14:253
26714799921117,2101cyclictest2740536-21kworker/0:0+events22:48:020
26714829921087,2098cyclictest2770268-21kworker/1:0+events00:22:111
267148299210510,2091cyclictest2758507-21kworker/1:2+events23:58:281
267147999209811,2083cyclictest2706881-21kworker/0:1+events21:00:220
267148599208811,2074cyclictest2688825-21kworker/2:2+events20:28:112
267147999208710,2074cyclictest2681196-21kworker/0:2+events19:40:540
267148999205910,2046cyclictest2697093-21kworker/3:2+events20:32:463
26714799920369,2024cyclictest2722666-21kworker/0:2+events22:03:570
267148599203511,2020cyclictest2722578-21kworker/2:1+events22:09:162
267147999203511,2021cyclictest2758476-21kworker/0:2+events00:15:430
26714899920103,2003cyclictest2672869-21kworker/3:1+events19:19:233
26714899920102,2005cyclictest2679300-21kworker/3:0+events19:38:583
26714859920089,1996cyclictest2682800-21kworker/2:1+events19:45:292
26714859920087,1998cyclictest2679568-21kworker/2:2+events19:39:442
267147999200510,1992cyclictest2733976-21kworker/0:2+events22:27:540
26714859920049,1992cyclictest2734210-21kworker/2:1+events22:31:452
26714799920039,1990cyclictest2684081-21kworker/0:1+events19:59:140
267148999200110,1987cyclictest2713199-21kworker/3:1+events21:40:503
26714859920008,1988cyclictest2697153-21kworker/2:0+events20:31:362
267148599200010,1987cyclictest2682800-21kworker/2:1+events20:01:092
26714859919998,1987cyclictest2714765-21kworker/2:1+events21:33:102
267147999199910,1986cyclictest2681196-21kworker/0:2+events19:46:160
26714859919957,1985cyclictest2750232-21kworker/2:0+events00:09:102
26714799919948,1983cyclictest2677940-21kworker/0:0+events19:29:340
26714799919948,1983cyclictest2677940-21kworker/0:0+events19:29:340
26714859919887,1978cyclictest2672856-21kworker/2:1+events19:34:272
267148999198310,1970cyclictest2669460-21kworker/3:0+events19:12:563
26714859919828,1970cyclictest2702305-21kworker/2:2+events20:53:572
267147999197610,1963cyclictest2672767-21kworker/0:0+events19:14:250
267147999197110,1958cyclictest2706881-21kworker/0:1+events21:24:060
26714859919678,1956cyclictest2667847-21kworker/2:2+events19:14:492
26711962148100,35sleep00-21swapper/019:09:370
26709582146111,29sleep30-21swapper/319:06:363
26709912144111,27sleep10-21swapper/119:07:021
26709772139108,26sleep20-21swapper/219:06:512
2671489991710,5cyclictest2777186-21ntpq00:35:193
267148999160,15cyclictest2710723-21/usr/sbin/munin21:10:133
267148599160,3cyclictest2693888-21runrttasks20:16:532
267148299140,4cyclictest2685153-21/usr/sbin/munin19:50:161
267148999130,13cyclictest0-21swapper/319:45:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional