You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 18:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sun Jun 07, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122248299370815,3687cyclictest1227259-21kworker/0:2+events19:50:170
122249599318915,3170cyclictest1292881-21kworker/3:1+events22:46:333
122249199311815,3098cyclictest1245127-21kworker/2:1+events20:25:172
122248299292514,2906cyclictest1302777-21kworker/0:3+events23:30:150
122249199289213,2875cyclictest1281559-21kworker/2:0+events22:14:342
122248799285714,2839cyclictest1278680-21kworker/1:1+events22:25:161
122249199279313,2775cyclictest1275588-21kworker/2:3+events22:15:192
122248299274412,2730cyclictest1262567-21kworker/0:0+events21:15:210
122249199271013,2693cyclictest1312466-21kworker/2:0+events23:50:422
122248299271013,2693cyclictest1246543-21kworker/0:1+events20:23:230
122249199270313,2686cyclictest1257982-21kworker/2:0+events21:01:322
122249199268012,2664cyclictest1320344-21kworker/2:2+events00:20:192
122249599265313,2636cyclictest1230527-21kworker/3:2+events19:46:043
122249199265113,2633cyclictest1272150-21kworker/2:1+events21:45:132
122249199263712,2621cyclictest1291514-21kworker/2:1+events22:48:282
122248299262112,2605cyclictest1277087-21kworker/0:2+events22:15:410
122248799261912,2604cyclictest1260786-21kworker/1:0+events21:13:261
122249599261113,2594cyclictest1251252-21kworker/3:0+events20:38:353
122249599261113,2594cyclictest1251252-21kworker/3:0+events20:38:343
122249199255810,2545cyclictest1230491-21kworker/2:0+events20:00:172
122249599254212,2528cyclictest1302651-21kworker/3:0+events23:39:223
122248299253912,2524cyclictest1315397-21kworker/0:0+events00:00:320
122248299252112,2505cyclictest1293002-21kworker/0:1+events22:55:190
122248299250612,2490cyclictest1286811-21kworker/0:0+events22:34:050
122249199250512,2489cyclictest1275588-21kworker/2:3+events21:57:232
122249599249912,2483cyclictest1302651-21kworker/3:0+events23:40:553
12224919924989,2486cyclictest1264052-21kworker/2:0+events21:54:012
122248799249510,2481cyclictest1243581-21kworker/1:0+events20:17:461
122248299249410,2480cyclictest1254522-21kworker/0:0+events20:51:380
122248299249112,2475cyclictest1293002-21kworker/0:1+events22:50:430
12224879924907,2480cyclictest1323697-21kworker/1:2+events00:30:131
122248799249012,2474cyclictest1307491-21kworker/1:2+events23:33:421
122248299248812,2472cyclictest1275423-21kworker/0:1+events21:57:460
122248299248612,2471cyclictest1240703-21kworker/0:0+events20:13:350
122248299248512,2469cyclictest1300799-21kworker/0:0+events23:13:330
122249599248412,2469cyclictest1249624-21kworker/3:2+events20:33:393
122249199248212,2466cyclictest1264052-21kworker/2:0+events21:30:172
122248299247912,2463cyclictest1273789-21kworker/0:0+events22:04:180
122249199247712,2461cyclictest1228823-21kworker/2:1+events19:32:502
12224919924768,2464cyclictest1299198-21kworker/2:2+events00:07:242
122249199247510,2462cyclictest1247044-21kworker/2:2+events20:45:272
122248799247510,2461cyclictest1321859-21kworker/1:0+events00:25:151
12224879924749,2461cyclictest1248079-21kworker/1:0+events20:36:171
12224879924749,2461cyclictest1248079-21kworker/1:0+events20:36:171
122249599247312,2457cyclictest1228737-21kworker/3:1+events19:30:323
12224919924739,2460cyclictest1310600-21kworker/2:1+events23:42:032
122249199247312,2457cyclictest1294695-21kworker/2:2+events22:56:062
122249199247310,2459cyclictest1283159-21kworker/2:1+events22:24:292
12224829924739,2460cyclictest1243343-21kworker/0:2+events20:16:350
122248799247211,2458cyclictest1296180-21kworker/1:1+events22:58:481
122249199247112,2455cyclictest1317112-21kworker/2:0+events00:18:462
122249199247112,2455cyclictest1299198-21kworker/2:2+events23:38:372
122248799247111,2456cyclictest1268857-21kworker/1:1+events21:39:481
122249199247012,2454cyclictest1299198-21kworker/2:2+events23:11:402
122249199247012,2454cyclictest1264052-21kworker/2:0+events21:28:002
122248799247012,2455cyclictest1312436-21kworker/1:2+events23:58:391
122248799247012,2454cyclictest1233275-21kworker/1:0+events19:45:431
12224919924686,2458cyclictest1296363-21kworker/2:0+events23:02:592
122249199246711,2452cyclictest1275588-21kworker/2:3+events22:00:292
122249199246212,2446cyclictest1299198-21kworker/2:2+events23:27:112
122248799246112,2446cyclictest1262477-21kworker/1:2+events21:15:451
122248299246012,2444cyclictest1227259-21kworker/0:2+events19:32:280
122248799245712,2441cyclictest1307491-21kworker/1:2+events23:42:261
122248299245511,2441cyclictest1267275-21kworker/0:1+events21:36:220
122249599245412,2439cyclictest1278623-21kworker/3:1+events22:09:333
122249599245412,2438cyclictest1318747-21kworker/3:2+events00:32:063
122248799245411,2440cyclictest1291422-21kworker/1:1+events22:43:061
122249599245212,2437cyclictest1257774-21kworker/3:1+events21:08:283
122249199244912,2434cyclictest1254580-21kworker/2:1+events20:51:162
122249599244810,2435cyclictest1285111-21kworker/3:1+events22:32:343
122249199244612,2432cyclictest1262328-21kworker/2:1+events21:21:262
122248799244612,2430cyclictest1296180-21kworker/1:1+events23:19:581
122248299244612,2430cyclictest1267275-21kworker/0:1+events21:26:240
12224919924459,2433cyclictest1245127-21kworker/2:1+events20:34:022
122249599244312,2427cyclictest1246775-21kworker/3:1+events20:42:003
122249599244312,2427cyclictest1246775-21kworker/3:1+events20:41:593
122248799244311,2428cyclictest1293179-21kworker/1:0+events22:52:381
122249599244112,2425cyclictest1305595-21kworker/3:1+events23:28:193
122249599243712,2422cyclictest1254553-21kworker/3:0+events20:58:533
122249599243712,2421cyclictest1276995-21kworker/3:2+events21:59:203
122249599243712,2421cyclictest1246775-21kworker/3:1+events20:48:103
12224959924368,2425cyclictest1301065-21kworker/3:2+events23:19:143
122249599243612,2420cyclictest1290112-21kworker/3:0+events22:41:133
12224879924345,2426cyclictest1236980-21kworker/1:2+events19:56:021
122249199243212,2416cyclictest1230491-21kworker/2:0+events19:48:462
122249599243112,2416cyclictest1243522-21kworker/3:0+events20:23:023
122248299242910,2415cyclictest1309214-21kworker/0:2+events23:42:490
122248799242811,2414cyclictest1283223-21kworker/1:2+events22:20:171
122249199242612,2410cyclictest1228823-21kworker/2:1+events19:29:222
122249199242512,2409cyclictest1289867-21kworker/2:2+events22:39:222
122248299242411,2410cyclictest1270488-21kworker/0:2+events21:47:540
122248299242311,2409cyclictest1298222-21kworker/0:2+events23:06:470
122248799242212,2406cyclictest1277027-21kworker/1:2+events22:00:531
122248299242012,2405cyclictest1296331-21kworker/0:0+events23:02:370
122248299241910,2406cyclictest1305566-21kworker/0:1+events23:48:060
122249199241812,2402cyclictest1230491-21kworker/2:0+events20:09:462
122249199241712,2402cyclictest1320344-21kworker/2:2+events00:31:442
122248799241512,2399cyclictest1229009-21kworker/1:2+events19:44:111
122248799241411,2399cyclictest1256326-21kworker/1:1+events21:06:581
122249199241012,2394cyclictest1230491-21kworker/2:0+events19:54:322
122248799240912,2393cyclictest1245262-21kworker/1:2+events20:29:051
122248299240912,2393cyclictest1321766-21kworker/0:2+events00:19:330
122248299240912,2393cyclictest1305566-21kworker/0:1+events00:11:110
122249599240811,2394cyclictest1254553-21kworker/3:0+events21:00:473
122249199240812,2392cyclictest1281559-21kworker/2:0+events22:26:502
12224919924074,2400cyclictest1270520-21kworker/2:2+events21:37:502
122248299240712,2391cyclictest1291394-21kworker/0:0+events22:47:210
122248299240410,2391cyclictest1227259-21kworker/0:2+events20:00:390
122248299240312,2387cyclictest1222231-21kworker/0:1+events19:24:280
122248299240311,2388cyclictest1302515-21kworker/0:2+events23:18:290
122248299240311,2388cyclictest1285175-21kworker/0:2+events22:38:570
122248299240310,2389cyclictest1248170-21kworker/0:2+events20:42:240
122248299240310,2389cyclictest1248170-21kworker/0:2+events20:42:230
122248299240212,2388cyclictest1227259-21kworker/0:2+events19:35:080
122248299240211,2388cyclictest1267275-21kworker/0:1+events21:31:030
122248799240112,2385cyclictest1221992-21kworker/1:2+events19:16:301
122248299240112,2385cyclictest1281618-21kworker/0:0+events22:12:380
122248299240012,2384cyclictest1305566-21kworker/0:1+events23:51:510
122249599239912,2384cyclictest1316992-21kworker/3:0+events00:26:453
12224829923999,2386cyclictest1291394-21kworker/0:0+events22:44:140
122248299239912,2383cyclictest1278761-21kworker/0:1+events22:09:580
122248299239910,2386cyclictest1246543-21kworker/0:1+events20:27:350
122249199239812,2383cyclictest1230491-21kworker/2:0+events19:37:512
122248799239812,2383cyclictest1307491-21kworker/1:2+events23:35:581
122248799239812,2382cyclictest1288444-21kworker/1:2+events23:00:391
122248799239811,2383cyclictest1248079-21kworker/1:0+events20:34:261
122248299239812,2382cyclictest1323465-21kworker/0:1+events00:24:280
122248299239712,2381cyclictest1248170-21kworker/0:2+events20:47:010
122248299239711,2384cyclictest1254522-21kworker/0:0+events21:00:030
122248299239711,2383cyclictest1305566-21kworker/0:1+events00:08:090
122248299239711,2383cyclictest1233548-21kworker/0:0+events19:41:570
122248299239612,2381cyclictest1264465-21kworker/0:2+events21:20:410
122249199239514,2377cyclictest1310600-21kworker/2:1+events23:46:122
122249199239512,2379cyclictest1235326-21kworker/2:2+events19:56:252
122248299239512,2380cyclictest1249914-21kworker/0:0+events20:35:560
122248299239512,2380cyclictest1249914-21kworker/0:0+events20:35:550
122249599239412,2376cyclictest1281858-21kworker/3:2+events22:18:233
122249199239411,2379cyclictest1291514-21kworker/2:1+events23:08:382
12224879923938,2381cyclictest1219164-21kworker/1:1+events19:20:181
122248799239212,2376cyclictest1285561-21kworker/1:0+events22:37:021
122249199239110,2378cyclictest1260694-21kworker/2:2+events21:07:202
122248799239112,2375cyclictest1300885-21kworker/1:2+events23:13:111
122249199239011,2375cyclictest1291514-21kworker/2:1+events22:52:152
122249599238912,2374cyclictest1265647-21kworker/3:0+events21:35:343
122249199238911,2375cyclictest1315310-21kworker/2:1+events23:56:462
122248799238912,2374cyclictest1278680-21kworker/1:1+events22:17:131
122248799238912,2374cyclictest1260786-21kworker/1:0+events21:25:141
122248799238912,2373cyclictest1320191-21kworker/1:2+events00:15:201
122248799238912,2373cyclictest1256326-21kworker/1:1+events21:04:151
122249199238812,2372cyclictest1260694-21kworker/2:2+events21:13:032
122248799238812,2372cyclictest1296180-21kworker/1:1+events23:29:041
122248799238812,2372cyclictest1236980-21kworker/1:2+events19:52:361
122249199238710,2374cyclictest1262328-21kworker/2:1+events21:18:222
122248799238712,2373cyclictest1266299-21kworker/1:2+events21:40:571
122249199238612,2371cyclictest1247044-21kworker/2:2+events20:38:112
122249199238612,2371cyclictest1247044-21kworker/2:2+events20:38:112
122249199238612,2371cyclictest1241863-21kworker/2:2+events20:10:332
122249199238612,2370cyclictest1320344-21kworker/2:2+events00:37:232
122249599238512,2370cyclictest1223618-21kworker/3:2+events19:22:143
122249199238512,2369cyclictest1299198-21kworker/2:2+events23:19:372
122249199238412,2369cyclictest1228823-21kworker/2:1+events19:40:502
122249199238412,2368cyclictest1304142-21kworker/2:0+events23:32:322
122248799238412,2368cyclictest1310779-21kworker/1:0+events23:49:361
122249599238312,2367cyclictest1280250-21kworker/3:0+events22:26:253
122249199238312,2367cyclictest1299198-21kworker/2:2+events23:23:002
122248799238312,2368cyclictest1318592-21kworker/1:1+events00:22:591
122248799238212,2367cyclictest1238785-21kworker/1:1+events20:22:181
122248799238112,2365cyclictest1233275-21kworker/1:0+events20:07:071
12224919923809,2369cyclictest1281559-21kworker/2:0+events22:40:052
122248799238012,2365cyclictest1229009-21kworker/1:2+events19:35:551
122248799237911,2365cyclictest1238785-21kworker/1:1+events20:02:541
12224959923779,2364cyclictest1302651-21kworker/3:0+events23:22:383
122248799237712,2361cyclictest1241980-21kworker/1:2+events20:12:051
12224959923768,2364cyclictest1292881-21kworker/3:1+events23:02:133
122249599237610,2362cyclictest1260123-21kworker/3:2+events21:23:203
122249599237510,2361cyclictest1302651-21kworker/3:0+events23:34:053
122249599237510,2361cyclictest1235384-21kworker/3:1+events20:04:273
122249199237511,2362cyclictest1278220-21kworker/2:0+events22:05:032
122248299237410,2361cyclictest1237131-21kworker/0:0+events19:57:340
122249599237312,2358cyclictest1260123-21kworker/3:2+events21:11:553
122249199237312,2357cyclictest1299198-21kworker/2:2+events00:03:122
122249599236912,2354cyclictest1265647-21kworker/3:0+events21:32:073
12224879923699,2357cyclictest1312436-21kworker/1:2+events23:54:291
122248799236910,2356cyclictest1273665-21kworker/1:1+events21:54:211
122248299236912,2354cyclictest1267275-21kworker/0:1+events21:44:490
122248799236610,2352cyclictest1299229-21kworker/1:0+events23:07:311
122249599236512,2349cyclictest1273605-21kworker/3:2+events21:47:083
122249599236412,2348cyclictest1315278-21kworker/3:1+events23:57:313
122249599236411,2350cyclictest1318747-21kworker/3:2+events00:19:103
122249199236412,2348cyclictest1317112-21kworker/2:0+events00:14:132
122248799236211,2347cyclictest1229009-21kworker/1:2+events19:32:051
12224959923618,2349cyclictest1326402-21kworker/3:1+events00:39:193
12224879923618,2350cyclictest1251283-21kworker/1:2+events20:41:141
12224879923618,2350cyclictest1251283-21kworker/1:2+events20:41:141
122248799236012,2345cyclictest1266299-21kworker/1:2+events21:30:391
122249599235811,2344cyclictest1256185-21kworker/3:2+events20:54:403
122249599235512,2340cyclictest1318747-21kworker/3:2+events00:24:063
122249599235212,2337cyclictest1235384-21kworker/3:1+events20:10:103
122249599235211,2338cyclictest1260123-21kworker/3:2+events21:17:163
122249199235212,2337cyclictest1281559-21kworker/2:0+events22:32:112
12224959923506,2340cyclictest1233751-21kworker/3:0+events19:51:483
122249599235012,2335cyclictest1309245-21kworker/3:1+events23:49:133
122249599235012,2334cyclictest1280250-21kworker/3:0+events22:13:263
122248799234712,2332cyclictest1225722-21kworker/1:0+events19:27:051
122249599234512,2330cyclictest1237331-21kworker/3:2+events19:57:133
122249599234312,2328cyclictest1312734-21kworker/3:0+events23:54:533
122248799234312,2328cyclictest1275431-21kworker/1:0+events21:58:551
122249599234212,2327cyclictest1299407-21kworker/3:0+events23:12:473
122249599234212,2326cyclictest1232107-21kworker/3:1+events19:39:223
122248299234012,2325cyclictest1326724-21kworker/0:2+events00:37:010
122249599233812,2323cyclictest1280250-21kworker/3:0+events22:22:363
122249599233812,2322cyclictest1316992-21kworker/3:0+events00:02:263
122249599233712,2321cyclictest1316992-21kworker/3:0+events00:08:563
122249599233711,2322cyclictest1260123-21kworker/3:2+events21:27:133
122249599233512,2322cyclictest1265647-21kworker/3:0+events22:00:063
12224829923338,2321cyclictest1248170-21kworker/0:2+events20:30:380
122249599233111,2316cyclictest1265647-21kworker/3:0+events21:41:433
122248799232412,2308cyclictest1291422-21kworker/1:1+events22:46:581
122249599232010,2307cyclictest1243522-21kworker/3:0+events20:15:303
122248799232011,2306cyclictest1318592-21kworker/1:1+events00:07:471
122249199231811,2304cyclictest1254580-21kworker/2:1+events20:58:312
122249599231212,2296cyclictest1233751-21kworker/3:0+events19:44:573
122248299231110,2298cyclictest1260754-21kworker/0:2+events21:09:120
122249599228711,2273cyclictest1265647-21kworker/3:0+events21:53:163
122248299226912,2253cyclictest1283251-21kworker/0:1+events22:23:220
122248799226712,2251cyclictest1312436-21kworker/1:2+events00:00:551
122248799225511,2240cyclictest1252945-21kworker/1:0+events20:55:491
122248799225112,2236cyclictest1310779-21kworker/1:0+events00:11:341
122248299224810,2235cyclictest1307584-21kworker/0:0+events23:37:510
122249199223412,2218cyclictest1247044-21kworker/2:2+events20:40:512
122249199223412,2218cyclictest1247044-21kworker/2:2+events20:40:502
122248299222912,2214cyclictest1302777-21kworker/0:3+events23:24:080
122249599222312,2207cyclictest1316992-21kworker/3:0+events00:13:503
122248299220811,2194cyclictest1323465-21kworker/0:1+events00:28:410
12224829922059,2193cyclictest1323465-21kworker/0:1+events00:30:590
122248299220510,2191cyclictest1270488-21kworker/0:2+events21:51:210
122248299220410,2190cyclictest1235204-21kworker/0:1+events19:48:240
122248799220311,2188cyclictest1273665-21kworker/1:1+events21:48:181
122248299220210,2188cyclictest1222231-21kworker/0:1+events19:16:530
122249199220111,2187cyclictest1230491-21kworker/2:0+events20:19:162
122248299220110,2187cyclictest1285175-21kworker/0:2+events22:29:070
12224919922009,2187cyclictest1219003-21kworker/2:2+events19:14:342
122248299220011,2185cyclictest1305566-21kworker/0:1+events23:57:080
122248299220010,2187cyclictest1302777-21kworker/0:3+events23:26:050
122248299219811,2184cyclictest1238755-21kworker/0:1+events20:08:380
122249199219711,2182cyclictest1225599-21kworker/2:0+events19:17:172
122249199219710,2183cyclictest1264052-21kworker/2:0+events21:44:032
122249199218710,2173cyclictest1225599-21kworker/2:0+events19:21:262
122249199218611,2171cyclictest1322271-21kworker/2:1+events00:25:382
122249199218111,2166cyclictest1245127-21kworker/2:1+events20:22:412
122248799218111,2167cyclictest1278680-21kworker/1:1+events22:05:261
12224879921799,2167cyclictest1275431-21kworker/1:0+events22:12:161
122248299217911,2165cyclictest1257852-21kworker/0:1+events21:14:360
122248299217811,2163cyclictest1222231-21kworker/0:1+events19:26:010
122248799217611,2161cyclictest1252945-21kworker/1:0+events20:50:521
122248799217511,2161cyclictest1252945-21kworker/1:0+events20:49:201
122248799217411,2160cyclictest1221992-21kworker/1:2+events19:13:271
122248799216610,2153cyclictest1321859-21kworker/1:0+events00:38:321
122248799216511,2150cyclictest1285561-21kworker/1:0+events22:34:491
122248799216310,2149cyclictest1296180-21kworker/1:1+events23:24:331
122249599215611,2142cyclictest1292881-21kworker/3:1+events22:54:563
122248799215511,2141cyclictest1264173-21kworker/1:1+events21:23:431
12224959921538,2142cyclictest1223618-21kworker/3:2+events19:19:563
122249599215011,2135cyclictest1228737-21kworker/3:1+events19:27:523
12224959921429,2129cyclictest1240201-21kworker/3:0+events20:05:583
12224959921408,2128cyclictest1292881-21kworker/3:1+events23:08:163
122249599213711,2124cyclictest1294542-21kworker/3:0+events22:56:523
12224959921328,2121cyclictest1246775-21kworker/3:1+events20:25:413
12224959920327,2022cyclictest1223618-21kworker/3:2+events19:12:413
12224829919879,1974cyclictest1218885-21kworker/0:0+events19:11:530
12220072158115,24sleep30-21swapper/319:06:373
12220062157114,26sleep20-21swapper/219:06:362
12222662144111,28sleep00-21swapper/019:09:550
12220202143111,25sleep10-21swapper/119:06:481
122248299111108,2cyclictest1254522-21kworker/0:0+pm20:59:520
122249599141,9cyclictest740-21snmpd22:35:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional