You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 00:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Mon Jun 15, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83787699297514,2958cyclictest902065-21kworker/3:1+events22:30:173
83786699291514,2897cyclictest929430-21kworker/1:0+events00:00:171
83787699283913,2822cyclictest850703-21kworker/3:0+events19:50:173
83787299279013,2772cyclictest871036-21kworker/2:0+events21:05:172
83787699278313,2766cyclictest858395-21kworker/3:0+events20:30:123
83787699278313,2765cyclictest902065-21kworker/3:1+events22:40:163
83787299278213,2765cyclictest894191-21kworker/2:2+events22:14:232
83787299278013,2763cyclictest855602-21kworker/2:3+events20:15:192
83786199273411,2719cyclictest910153-21kworker/0:3+events23:00:190
83787699273313,2716cyclictest922970-21kworker/3:2+events23:35:163
83786699271313,2696cyclictest892507-21kworker/1:0+events22:00:161
83786699266813,2651cyclictest876610-21kworker/1:2+events21:35:171
83787699266713,2650cyclictest868061-21kworker/3:2+events20:46:433
83787299264712,2631cyclictest892567-21kworker/2:1+events22:03:422
83787299263813,2621cyclictest837377-21kworker/2:0+events19:15:152
83786199262313,2606cyclictest937346-21kworker/0:0+events00:20:210
83787699262213,2607cyclictest939117-21kworker/3:2+events00:25:183
8378769926209,2607cyclictest881051-21kworker/3:2+events21:31:063
83787699258012,2564cyclictest871235-21kworker/3:1+events21:00:183
83787699256310,2548cyclictest910100-21kworker/3:1+events23:05:123
83787699256212,2547cyclictest903677-21kworker/3:0+events22:45:173
83787299255411,2539cyclictest841102-21kworker/2:2+events19:42:432
83787299255012,2534cyclictest911401-21kworker/2:1+events23:11:392
83786199254912,2533cyclictest864773-21kworker/0:1+events21:06:250
83786199254612,2530cyclictest902098-21kworker/0:2+events23:12:440
83787299254512,2530cyclictest881286-21kworker/2:0+events21:26:312
83787699254412,2528cyclictest852330-21kworker/3:1+events19:55:143
83787299253712,2522cyclictest911401-21kworker/2:1+events23:26:062
83787699253411,2519cyclictest841222-21kworker/3:0+events19:27:283
83787299251912,2504cyclictest841102-21kworker/2:2+events19:46:322
83787299251012,2495cyclictest926110-21kworker/2:1+events23:59:562
83787299251011,2496cyclictest920865-21kworker/2:2+events23:30:182
83787699250410,2490cyclictest903677-21kworker/3:0+events22:54:173
83786199250312,2487cyclictest917756-21kworker/0:0+events23:20:200
83787299250212,2486cyclictest855602-21kworker/2:3+events20:45:112
83786199250112,2485cyclictest849276-21kworker/0:1+events19:48:240
83786199250010,2486cyclictest902098-21kworker/0:2+events22:29:300
83787299249812,2483cyclictest924334-21kworker/2:0+events23:43:592
83787299249812,2482cyclictest883010-21kworker/2:1+events21:39:492
83787299249611,2482cyclictest855602-21kworker/2:3+events20:38:152
83786199249512,2479cyclictest940628-21kworker/0:2+events00:37:520
83787699249311,2478cyclictest900472-21kworker/3:2+events22:24:353
83787299249311,2478cyclictest898695-21kworker/2:1+events22:23:302
83786199249312,2477cyclictest931155-21kworker/0:3+events00:05:570
83787299249212,2476cyclictest868091-21kworker/2:1+events21:04:092
83787299249112,2475cyclictest864834-21kworker/2:1+events20:33:382
83787299249012,2475cyclictest914707-21kworker/2:2+events23:15:482
83786699249012,2474cyclictest909839-21kworker/1:1+events23:03:181
83786199248910,2475cyclictest881256-21kworker/0:0+events21:42:230
83786199248812,2472cyclictest872858-21kworker/0:0+events20:56:310
83787299248712,2472cyclictest942289-21kworker/2:2+events00:35:572
83787299248711,2473cyclictest858962-21kworker/2:0+events20:21:482
83787299248711,2472cyclictest898695-21kworker/2:1+events22:19:432
83786699248710,2473cyclictest920895-21kworker/1:1+events23:38:151
83786199248712,2471cyclictest921018-21kworker/0:1+events23:40:330
83786199248711,2472cyclictest902098-21kworker/0:2+events22:35:410
83786199248711,2472cyclictest830787-21kworker/0:0+events19:52:100
83786199248612,2470cyclictest860560-21kworker/0:1+events20:21:230
83786199248612,2470cyclictest852152-21kworker/0:2+events19:59:210
83786199248611,2471cyclictest902098-21kworker/0:2+events22:52:040
83787299248512,2470cyclictest871036-21kworker/2:0+events21:16:182
83786199248512,2469cyclictest830787-21kworker/0:0+events19:22:060
83786199248511,2470cyclictest940628-21kworker/0:2+events00:34:240
83787699248412,2468cyclictest934265-21kworker/3:1+events00:36:203
83786199248412,2468cyclictest892536-21kworker/0:0+events22:07:540
83787299248112,2467cyclictest892567-21kworker/2:1+events22:06:442
83787299248112,2466cyclictest903647-21kworker/2:2+events22:36:042
83787299248011,2467cyclictest898695-21kworker/2:1+events22:25:192
83786699248012,2466cyclictest917849-21kworker/1:2+events23:26:301
83786199248011,2466cyclictest886326-21kworker/0:2+events21:51:120
83787299247812,2462cyclictest908180-21kworker/2:0+events23:06:192
83787299247812,2462cyclictest908180-21kworker/2:0+events23:01:252
83786199247112,2456cyclictest897496-21kworker/0:0+events22:22:450
8378619924709,2457cyclictest917756-21kworker/0:0+events23:25:190
83786199247012,2455cyclictest927099-21kworker/0:2+events23:54:330
83787299246512,2451cyclictest931025-21kworker/2:3+events00:10:032
83787299246512,2450cyclictest841102-21kworker/2:2+events20:06:562
83786199246410,2451cyclictest888022-21kworker/0:3+events22:02:310
83787299246312,2447cyclictest924334-21kworker/2:0+events23:48:322
83786199246312,2447cyclictest881256-21kworker/0:0+events21:29:110
83786199246312,2447cyclictest868186-21kworker/0:2+events20:53:540
83787299246112,2447cyclictest940686-21kworker/2:1+events00:31:202
8378729924609,2447cyclictest841102-21kworker/2:2+events19:22:282
83787299246012,2445cyclictest858962-21kworker/2:0+events20:28:422
83786199246012,2445cyclictest927099-21kworker/0:2+events23:56:290
83787299245912,2445cyclictest841102-21kworker/2:2+events19:25:072
83787299245812,2443cyclictest868091-21kworker/2:1+events20:57:372
83787299245811,2444cyclictest911401-21kworker/2:1+events22:59:112
83786199245712,2441cyclictest910153-21kworker/0:3+events23:30:400
83786199245612,2441cyclictest886326-21kworker/0:2+events21:49:420
83787299245512,2440cyclictest868091-21kworker/2:1+events20:52:042
83786199245412,2439cyclictest845991-21kworker/0:1+events19:37:010
83786199245411,2440cyclictest900443-21kworker/0:1+events22:42:130
83786199245312,2438cyclictest852152-21kworker/0:2+events20:19:070
83786699245212,2436cyclictest895732-21kworker/1:0+events22:47:331
83786199245212,2436cyclictest864773-21kworker/0:1+events21:17:030
83787299245111,2437cyclictest841102-21kworker/2:2+events19:34:422
83786199245012,2436cyclictest858634-21kworker/0:0+events20:26:260
83786199245012,2435cyclictest937346-21kworker/0:0+events00:28:410
83786199245011,2436cyclictest910153-21kworker/0:3+events22:57:400
83786199244711,2433cyclictest892536-21kworker/0:0+events21:59:070
83787699244511,2430cyclictest844449-21kworker/3:1+events19:32:493
83787299244510,2431cyclictest846023-21kworker/2:1+events19:39:202
83786199244511,2430cyclictest906937-21kworker/0:0+events22:49:040
83787699244012,2425cyclictest858395-21kworker/3:0+events20:22:113
83787699243810,2424cyclictest863199-21kworker/3:1+events20:37:513
83787699243612,2421cyclictest934265-21kworker/3:1+events00:15:453
83787699243411,2419cyclictest902065-21kworker/3:1+events22:35:173
83787699243211,2418cyclictest837468-21kworker/3:1+events19:19:053
83787699243211,2417cyclictest877854-21kworker/3:1+events21:14:063
83787699242912,2414cyclictest929395-21kworker/3:3+events23:57:143
83787699242912,2414cyclictest897227-21kworker/3:0+events22:26:033
83787299242710,2414cyclictest903647-21kworker/2:2+events22:34:072
83787699242612,2411cyclictest919505-21kworker/3:0+events23:34:273
83787699242612,2410cyclictest910100-21kworker/3:1+events22:56:543
83786199242611,2411cyclictest931155-21kworker/0:3+events00:01:260
83787699242312,2408cyclictest863199-21kworker/3:1+events20:43:133
83787699242112,2405cyclictest881051-21kworker/3:2+events21:28:483
83787699242111,2406cyclictest873097-21kworker/3:0+events20:59:333
83787699242110,2407cyclictest919505-21kworker/3:0+events23:29:103
83787699242011,2406cyclictest934265-21kworker/3:1+events00:21:303
83787699242011,2406cyclictest932554-21kworker/3:0+events00:06:203
83787699241911,2405cyclictest887793-21kworker/3:0+events21:45:273
83786699241912,2403cyclictest882737-21kworker/1:1+events22:08:151
83787699241812,2402cyclictest877854-21kworker/3:1+events21:24:133
83787699241711,2404cyclictest895639-21kworker/3:2+events22:10:103
83787699241612,2401cyclictest874779-21kworker/3:2+events21:09:263
83787699241612,2400cyclictest849103-21kworker/3:1+events19:46:073
83787699241512,2400cyclictest910100-21kworker/3:1+events23:10:293
83786699241514,2397cyclictest895732-21kworker/1:0+events22:37:121
83787699241312,2398cyclictest877854-21kworker/3:1+events21:15:553
83787699241312,2398cyclictest858395-21kworker/3:0+events20:28:193
83787699241110,2397cyclictest852330-21kworker/3:1+events20:07:423
83787699241012,2394cyclictest868061-21kworker/3:2+events20:53:303
83786699241012,2394cyclictest916212-21kworker/1:1+events23:15:261
83786699241011,2395cyclictest916212-21kworker/1:1+events23:13:301
83787699240912,2393cyclictest940718-21kworker/3:0+events00:33:133
83787299240614,2388cyclictest881286-21kworker/2:0+events21:52:422
83786199240612,2390cyclictest910153-21kworker/0:3+events23:37:060
83787699240512,2389cyclictest887793-21kworker/3:0+events21:43:313
83786699240412,2388cyclictest882737-21kworker/1:1+events21:44:401
83787299240110,2388cyclictest841102-21kworker/2:2+events19:51:462
83787699240012,2385cyclictest895639-21kworker/3:2+events22:17:033
83786199239811,2383cyclictest931155-21kworker/0:3+events00:11:140
83786699239611,2382cyclictest849319-21kworker/1:1+events20:23:441
83786699239412,2380cyclictest882737-21kworker/1:1+events22:11:181
83786699238810,2374cyclictest934148-21kworker/1:1+events00:08:531
83787699238710,2375cyclictest852330-21kworker/3:1+events20:00:073
83787299238110,2367cyclictest881286-21kworker/2:0+events21:41:392
83786699238010,2367cyclictest939089-21kworker/1:1+events00:30:111
83786199238012,2366cyclictest902098-21kworker/0:2+events23:15:030
83787299237610,2363cyclictest937393-21kworker/2:1+events00:18:502
83787699237110,2358cyclictest910100-21kworker/3:1+events23:01:463
83786699237111,2358cyclictest849319-21kworker/1:1+events20:33:151
83787699236712,2351cyclictest884253-21kworker/3:1+events21:39:053
83787699235411,2339cyclictest914614-21kworker/3:2+events23:18:283
83786699234112,2327cyclictest926051-21kworker/1:2+events23:48:551
83786699233911,2324cyclictest861564-21kworker/1:0+events20:25:171
83786699233811,2323cyclictest909839-21kworker/1:1+events22:59:341
83786699233512,2319cyclictest876610-21kworker/1:2+events21:27:171
83787299233111,2315cyclictest871036-21kworker/2:0+events21:10:132
83787699233012,2315cyclictest919505-21kworker/3:0+events23:42:503
83786699232512,2310cyclictest898968-21kworker/1:2+events22:20:531
83786699231112,2296cyclictest866711-21kworker/1:0+events21:14:481
83787699230811,2294cyclictest924575-21kworker/3:1+events23:50:283
83787299230510,2292cyclictest855602-21kworker/2:3+events20:13:002
83786699230512,2290cyclictest911638-21kworker/1:0+events23:09:441
8378669923039,2290cyclictest926051-21kworker/1:2+events23:50:521
8378619922958,2283cyclictest864773-21kworker/0:1+events21:34:100
83786699229012,2274cyclictest887939-21kworker/1:0+events21:48:081
8378769922838,2272cyclictest847327-21kworker/3:2+events20:13:463
83787299227611,2262cyclictest903647-21kworker/2:2+events22:41:502
8378729922729,2261cyclictest887702-21kworker/2:2+events21:55:442
83787299227111,2257cyclictest881286-21kworker/2:0+events21:48:552
83787299227011,2256cyclictest852120-21kworker/2:0+events20:02:432
83787699226911,2255cyclictest841222-21kworker/3:0+events19:20:143
83787299226911,2255cyclictest883010-21kworker/2:1+events21:30:432
83787299226910,2256cyclictest939027-21kworker/2:0+events00:25:412
83787699226812,2253cyclictest926200-21kworker/3:2+events00:14:383
8378729922678,2256cyclictest924334-21kworker/2:0+events23:39:012
8378669922669,2255cyclictest841282-21kworker/1:2+events19:30:091
8378729922659,2253cyclictest855602-21kworker/2:3+events20:41:422
83787299226411,2250cyclictest937393-21kworker/2:1+events00:20:462
83787299226411,2250cyclictest926110-21kworker/2:1+events23:54:562
83787299226411,2250cyclictest905425-21kworker/2:3+events22:45:412
83786199226311,2249cyclictest830787-21kworker/0:0+events19:19:290
83786199226211,2248cyclictest856975-21kworker/0:1+events20:12:380
83786199226211,2247cyclictest841163-21kworker/0:2+events19:27:040
83787299226111,2248cyclictest917913-21kworker/2:0+events23:20:432
83787299226011,2245cyclictest841102-21kworker/2:2+events19:55:372
8378729922587,2247cyclictest876462-21kworker/2:2+events21:22:002
83787699225510,2241cyclictest919505-21kworker/3:0+events23:24:123
8378619922559,2243cyclictest830787-21kworker/0:0+events19:43:510
83786199225510,2241cyclictest864773-21kworker/0:1+events20:44:480
83786199225211,2238cyclictest877974-21kworker/0:2+events21:20:290
83786199225111,2236cyclictest895791-21kworker/0:2+events22:15:310
8378619922369,2223cyclictest852152-21kworker/0:2+events20:03:510
83786199223511,2220cyclictest866498-21kworker/0:0+events20:39:480
83786199223410,2220cyclictest927099-21kworker/0:2+events23:46:180
83787699223110,2217cyclictest886176-21kworker/3:2+events21:57:143
83786199222911,2214cyclictest864773-21kworker/0:1+events21:12:090
8378619922277,2217cyclictest830787-21kworker/0:0+events20:05:470
83786199222611,2212cyclictest881256-21kworker/0:0+events21:39:270
83786199222610,2212cyclictest839151-21kworker/0:1+events19:13:220
83787699222410,2212cyclictest924575-21kworker/3:1+events23:45:073
83786199222410,2211cyclictest872858-21kworker/0:0+events21:00:410
83786199222410,2210cyclictest864773-21kworker/0:1+events20:49:480
83787699222310,2210cyclictest932554-21kworker/3:0+events00:02:133
83786199221712,2202cyclictest863166-21kworker/0:2+events20:31:460
83787299221410,2201cyclictest934120-21kworker/2:0+events00:07:472
83787699220011,2186cyclictest841222-21kworker/3:0+events19:38:333
83787699219910,2186cyclictest891381-21kworker/3:0+events22:04:493
83786699219912,2184cyclictest882737-21kworker/1:1+events21:52:181
83786699219811,2184cyclictest849319-21kworker/1:1+events20:07:181
83787699219610,2183cyclictest893979-21kworker/3:1+events22:07:083
8378769921929,2181cyclictest886176-21kworker/3:2+events21:50:033
83786699219111,2177cyclictest895732-21kworker/1:0+events22:19:201
8378769921849,2172cyclictest847327-21kworker/3:2+events20:18:463
83786199215911,2144cyclictest841163-21kworker/0:2+events19:33:330
8378769921539,2140cyclictest849103-21kworker/3:1+events19:44:133
83786699214911,2134cyclictest847602-21kworker/1:2+events19:41:571
83786699213611,2122cyclictest871627-21kworker/1:2+events20:55:211
83787299213110,2118cyclictest824521-21kworker/2:1+events19:14:072
8378669921305,2122cyclictest841282-21kworker/1:2+events19:25:301
8378619921288,2117cyclictest931155-21kworker/0:3+events00:17:400
83786699212610,2113cyclictest895732-21kworker/1:0+events22:42:351
83786699212511,2111cyclictest882737-21kworker/1:1+events21:57:371
83786699211911,2105cyclictest839091-21kworker/1:1+events19:19:491
83786699211911,2104cyclictest849319-21kworker/1:1+events19:58:131
83786699211910,2106cyclictest929430-21kworker/1:0+events00:14:141
83786699211812,2104cyclictest866711-21kworker/1:0+events21:20:051
83786699211711,2103cyclictest940985-21kworker/1:2+events00:35:331
83786699211711,2103cyclictest906753-21kworker/1:2+events22:53:341
83786699211711,2103cyclictest866711-21kworker/1:0+events21:03:451
83786699211711,2103cyclictest853810-21kworker/1:2+events20:00:511
83786699211611,2101cyclictest866711-21kworker/1:0+events21:09:501
83786699211610,2102cyclictest869674-21kworker/1:1+events20:53:091
83786699211511,2101cyclictest924304-21kworker/1:0+events23:43:141
83786699211511,2101cyclictest876610-21kworker/1:2+events21:17:251
83786699211511,2101cyclictest816625-21kworker/1:0+events19:12:141
83786699211411,2099cyclictest849319-21kworker/1:1+events20:13:231
83786699211210,2099cyclictest939089-21kworker/1:1+events00:26:491
83787299211010,2097cyclictest929336-21kworker/2:2+events00:03:432
83786699210811,2093cyclictest895732-21kworker/1:0+events22:25:401
83786699210411,2090cyclictest927683-21kworker/1:1+events23:59:311
83786699210311,2089cyclictest842948-21kworker/1:0+events19:45:461
8378619920787,2068cyclictest894160-21kworker/0:1+events22:13:370
83787699207110,2058cyclictest837468-21kworker/3:1+events19:13:443
8378669920568,2045cyclictest866711-21kworker/1:0+events20:48:411
8378669920253,2018cyclictest929430-21kworker/1:0+events00:24:101
8378619920194,2012cyclictest900443-21kworker/0:1+events22:34:540
8378669919677,1958cyclictest935894-21kworker/1:2+events00:15:021
8378669919595,1951cyclictest876610-21kworker/1:2+events21:32:161
83786699194810,1935cyclictest858571-21kworker/1:2+events20:16:511
8378669919476,1938cyclictest845785-21kworker/1:1+events19:35:271
8376472158112,26sleep20-21swapper/219:09:492
8376462149102,43sleep10-21swapper/119:09:481
8373692146100,40sleep00-21swapper/019:06:180
8375912142110,27sleep30-21swapper/319:09:063
83786699218,10cyclictest903809-21awk22:35:001
83786699206,3cyclictest0-21swapper/123:20:121
83786699173,4cyclictest851667-21ntpq19:50:181
83786699171,13cyclictest603-21systemd-logind23:30:011
837866991610,2cyclictest866642-21munin-run20:40:001
83786699158,3cyclictest842931-21perf19:25:011
837866991510,1cyclictest191rcu_preempt20:40:161
837872991311,1cyclictest908788-21/usr/sbin/munin22:50:182
83786199137,4cyclictest913760-21sh23:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional