You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 01:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Mon Sep 07, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2030321770,5sleep11955699cyclictest08:40:381
235921260,4sleep02362-21aten_rbpower_cu11:50:300
2370121060,2sleep10-21swapper/110:56:491
1955599994,70cyclictest0-21swapper/011:15:350
1955599907,14cyclictest0-21swapper/009:40:300
19555998943,11cyclictest0-21swapper/010:50:350
181402870,2sleep00-21swapper/011:30:260
1955599867,69cyclictest0-21swapper/008:45:300
89952830,3sleep231-21ksoftirqd/212:36:542
1955599821,51cyclictest0-21swapper/008:05:290
1955599821,51cyclictest0-21swapper/008:05:290
1955599804,20cyclictest1741-21ssh11:10:320
59062790,5sleep01955599cyclictest10:35:420
59062790,5sleep01955599cyclictest10:35:420
1955599787,54cyclictest14323-21cut11:25:340
19555997810,45cyclictest0-21swapper/011:45:300
47422770,5sleep21955799cyclictest09:17:222
68652740,4sleep26839-21ssh11:55:362
68652740,4sleep26839-21ssh11:55:362
1955599742,54cyclictest23750-21sshd08:50:380
1955599742,54cyclictest23750-21sshd08:50:380
1955599733,46cyclictest0-21swapper/009:15:280
1955599730,46cyclictest0-21swapper/012:25:170
19556997212,38cyclictest6199-21fschecks_time11:15:361
1955599716,27cyclictest10570-21ssh12:00:300
1955899709,43cyclictest7950irq/56-dwc_otg_11:15:353
1955799706,28cyclictest0-21swapper/211:30:302
19557996939,24cyclictest6215-21fschecks_time11:15:362
19556996911,14cyclictest23-21ksoftirqd/110:50:351
1955599696,52cyclictest0-21swapper/010:05:310
1955599696,52cyclictest0-21swapper/010:05:310
1955599691,55cyclictest23344-21fschecks_time12:15:340
186132690,2sleep10-21swapper/111:30:351
1955799673,10cyclictest7750irq/56-dwc_otg07:40:282
1955799672,12cyclictest23853-21ssh09:40:282
19556996713,17cyclictest23-21ksoftirqd/112:35:291
1955599678,48cyclictest14055-21ssh10:45:390
1955599672,51cyclictest13114-21latency_hist10:45:170
19557996618,12cyclictest29878-21ssh09:46:342
1955599668,46cyclictest23537-21idleruntime-cro09:40:170
1955599666,14cyclictest0-21swapper/008:30:300
1955599661,53cyclictest0-21swapper/009:25:450
19555996612,33cyclictest1180-21runrttasks07:25:440
19555996611,45cyclictest3289-21latency_hist07:55:170
19557996520,11cyclictest13920-21sed10:45:372
1955599658,46cyclictest101ktimersoftd/009:23:340
1955599657,46cyclictest0-21swapper/012:05:220
19555996515,5cyclictest101ktimersoftd/011:45:170
1955599651,53cyclictest0-21swapper/010:19:390
19555996513,48cyclictest101ktimersoftd/011:55:460
19555996513,48cyclictest101ktimersoftd/011:55:460
116422650,1sleep00-21swapper/010:04:180
19557996422,20cyclictest2240-21ls07:50:382
1955599649,44cyclictest21488-21latency_hist08:45:180
1955599645,49cyclictest0-21swapper/008:10:380
1955799636,27cyclictest0-21swapper/208:00:292
1955599634,37cyclictest0-21swapper/011:00:290
19555996312,46cyclictest101ktimersoftd/009:45:450
19557996224,18cyclictest30275-21ls10:25:452
1955599627,40cyclictest1542-21latency_hist07:50:180
1955599621,49cyclictest28906-21date10:25:180
1955599619,37cyclictest31758-21if_wlan012:25:370
1955599615,47cyclictest0-21swapper/008:00:170
1955599615,41cyclictest0-21swapper/009:15:060
19557996024,15cyclictest12334-21ssh11:22:442
1955599609,35cyclictest6405-21grep08:00:430
1955599607,41cyclictest700-21ssh09:50:420
1955599605,41cyclictest18227-21ssh10:11:160
19555996033,22cyclictest0-21swapper/008:15:300
1955599602,43cyclictest0-21swapper/008:55:340
1955799594,9cyclictest4145-21ssh09:55:282
1955599599,38cyclictest0-21swapper/012:30:320
1955599597,35cyclictest17358-21sh09:31:570
1955599595,47cyclictest0-21swapper/010:28:090
1955599592,46cyclictest0-21swapper/012:10:340
1955899587,26cyclictest7950irq/56-dwc_otg_11:30:273
1955599585,40cyclictest12329-21ssh11:22:430
19557995725,11cyclictest2513-21ntp_states11:10:432
19557995722,14cyclictest9890-21ssh09:23:562
19556995720,26cyclictest9243-21ssh10:40:311
1955799564,11cyclictest7950irq/56-dwc_otg_11:45:302
19557995629,12cyclictest4414-21ssh12:31:022
1955799562,10cyclictest0-21swapper/209:05:282
19555995615,30cyclictest0-21swapper/009:00:440
294102550,4sleep21955799cyclictest07:35:392
19557995531,7cyclictest24263-21ls08:50:452
19557995531,7cyclictest24263-21ls08:50:452
19557995528,9cyclictest23283-21apt-get07:20:232
19557995521,12cyclictest9550irq/80-mmc010:15:232
19557995520,11cyclictest14283-21df_inode11:25:322
19557995517,14cyclictest17316-21ssh12:08:112
1955599556,37cyclictest0-21swapper/009:57:020
1955599556,30cyclictest0-21swapper/007:35:170
19555995525,16cyclictest7950irq/56-dwc_otg_08:30:170
1955599551,40cyclictest21745-21chrt10:55:230
19557995423,21cyclictest8386-21sh10:39:352
19557995423,21cyclictest8386-21sh10:39:352
19557995418,21cyclictest20770-21ssh10:54:112
1955599544,47cyclictest101ktimersoftd/010:30:430
1955599544,46cyclictest0-21swapper/011:05:320
19555995415,30cyclictest101ktimersoftd/012:35:410
19555995412,39cyclictest101ktimersoftd/007:11:090
99692530,2sleep10-21swapper/109:24:061
55912530,1sleep30-21swapper/309:18:523
1955799538,13cyclictest0-21swapper/207:30:302
19557995328,16cyclictest10827-21ssh10:02:482
19557995321,17cyclictest13278-21ntpq10:05:402
19557995321,17cyclictest13278-21ntpq10:05:402
19557995318,17cyclictest13028-21ssh12:02:542
19557995317,22cyclictest22165-21chrt09:37:552
1955599533,11cyclictest7750irq/56-dwc_otg09:05:280
1955599531,33cyclictest13672-21unixbench_singl08:20:450
189162530,5sleep20-21swapper/207:05:462
19557995221,12cyclictest3256-21ssh09:54:202
1955699523,9cyclictest2501-21ssh09:15:291
1955599527,35cyclictest0-21swapper/011:36:490
1955599521,28cyclictest30464-21latency_hist07:40:180
1955599521,14cyclictest23128-21latency_hist07:20:170
174712520,2sleep30-21swapper/312:08:293
1955899515,8cyclictest7950irq/56-dwc_otg_07:35:283
19557995125,14cyclictest28009-21ssh11:02:102
19557995123,7cyclictest4056-21memory07:55:372
19557995122,18cyclictest25096-21sh10:59:232
1955599516,31cyclictest0-21swapper/007:40:300
19557995026,12cyclictest31887-21ls12:25:382
19557995019,14cyclictest5580-21ssh11:54:202
1955699507,25cyclictest11046-21ssh09:25:241
1955699503,37cyclictest0-21swapper/111:45:301
1955699501,20cyclictest7950irq/56-dwc_otg_10:30:281
1955799498,16cyclictest0-21swapper/209:26:252
19557994920,12cyclictest30821-21ssh11:05:412
19557994918,18cyclictest27487-21chrt10:22:562
19557994917,23cyclictest28739-21ssh11:42:362
19557994915,5cyclictest7850irq/56-dwc_otg_09:10:292
1955699496,9cyclictest14530-21ls08:25:321
19555994916,21cyclictest18214-21grep08:35:340
19557994820,18cyclictest18613-21ssh10:11:582
19557994820,12cyclictest24463-21taskset11:37:192
1955699486,25cyclictest0-21swapper/108:30:301
19555994824,13cyclictest7950irq/56-dwc_otg_07:20:330
1955899472,6cyclictest13725-21munin-run11:25:173
19557994724,7cyclictest7301-21df08:05:322
19557994724,7cyclictest7301-21df08:05:322
19557994714,10cyclictest7950irq/56-dwc_otg_10:31:302
19556994723,12cyclictest17198-21apt-config10:50:171
1955799467,25cyclictest0-21swapper/208:10:302
19557994622,12cyclictest20290-21ssh12:11:042
1955699467,23cyclictest0-21swapper/108:05:301
1955699467,23cyclictest0-21swapper/108:05:301
1955699463,4cyclictest7950irq/56-dwc_otg_09:00:281
19557994524,15cyclictest12963-21ssh10:45:152
19557994520,13cyclictest28859-21ssh12:21:292
19557994516,12cyclictest25066-21ssh12:17:062
1955699456,23cyclictest0-21swapper/107:40:301
19557994423,12cyclictest15317-21ssh09:30:252
19557994422,13cyclictest19236-21rm08:37:092
1955699446,12cyclictest23-21ksoftirqd/112:05:351
19556994423,6cyclictest32327-21run-parts07:45:291
19556994410,12cyclictest221ktimersoftd/108:10:441
1955899431,10cyclictest9141-21uniq08:10:343
1955799437,24cyclictest0-21swapper/208:30:302
19557994330,11cyclictest13153-21date08:20:382
19557994316,11cyclictest1606-21runrttasks07:50:182
19557994313,11cyclictest21528-21taskset08:45:202
1955699437,24cyclictest0-21swapper/109:05:301
1955699437,22cyclictest0-21swapper/107:20:221
1955699436,23cyclictest0-21swapper/110:15:231
1955699434,7cyclictest23018-21ssh12:15:281
1955699432,11cyclictest0-21swapper/108:15:301
190612433,34sleep00-21swapper/007:07:310
326062420,3sleep332610-21fschecks_count07:45:343
1955899426,5cyclictest7850irq/56-dwc_otg_10:50:393
1955899422,6cyclictest7950irq/56-dwc_otg_11:40:353
1955699427,25cyclictest0-21swapper/112:30:301
19558994120,5cyclictest1372-21latency_hist11:10:183
1955899411,5cyclictest0-21swapper/309:05:293
1955699419,24cyclictest0-21swapper/110:35:231
1955699419,24cyclictest0-21swapper/110:35:231
1955699416,23cyclictest0-21swapper/108:55:291
19556994119,8cyclictest30338-21diskmemload12:03:211
19556994117,11cyclictest7950irq/56-dwc_otg_10:05:311
19556994117,11cyclictest7950irq/56-dwc_otg_10:05:311
1955799409,12cyclictest7850irq/56-dwc_otg_08:26:412
19557994025,11cyclictest25226-21cpu07:25:322
1955699409,5cyclictest23-21ksoftirqd/109:40:331
1955699407,23cyclictest0-21swapper/112:10:311
19556994024,9cyclictest27774-21ssh11:40:501
19556994020,12cyclictest221ktimersoftd/107:55:431
19556994019,5cyclictest6879-21latency_hist08:05:171
148372400,1sleep30-21swapper/309:29:593
230122390,2sleep223015-21apt-config07:20:172
19558993917,4cyclictest14029-21/usr/sbin/munin11:25:333
1955899391,19cyclictest0-21swapper/310:45:183
1955699395,5cyclictest7950irq/56-dwc_otg_11:25:311
19556993914,12cyclictest26060-21aten_rbpower_vo11:00:321
19556993913,5cyclictest0-21swapper/109:55:291
1955699391,21cyclictest0-21swapper/107:10:301
1955699391,19cyclictest0-21swapper/110:12:371
19557993822,13cyclictest20632-21ls07:10:452
19557993815,11cyclictest26591-21chrt08:58:512
19557993810,11cyclictest19733-21/usr/sbin/munin08:40:372
1955699388,8cyclictest221ktimersoftd/110:25:431
1955699386,8cyclictest21-21rcuc/111:23:011
1955699386,20cyclictest0-21swapper/109:30:301
19556993812,8cyclictest221ktimersoftd/111:05:301
19557993715,9cyclictest7850irq/56-dwc_otg_08:18:472
1955699379,5cyclictest0-21swapper/107:25:291
1955699378,18cyclictest221ktimersoftd/112:25:451
1955699378,18cyclictest221ktimersoftd/109:45:541
1955699377,5cyclictest21-21rcuc/107:35:301
1955699374,16cyclictest0-21swapper/111:51:211
1955899366,13cyclictest7850irq/56-dwc_otg_07:15:323
1955899362,5cyclictest7950irq/56-dwc_otg_09:30:283
19558993622,11cyclictest0-21swapper/308:55:333
19558993619,4cyclictest0-21swapper/310:35:183
19558993617,3cyclictest7950irq/56-dwc_otg_11:55:443
19558993617,3cyclictest7950irq/56-dwc_otg_11:55:443
1955899361,5cyclictest16461-21uniq08:30:343
1955899361,4cyclictest0-21swapper/309:23:173
1955699368,7cyclictest0-21swapper/110:20:301
1955699367,5cyclictest7950irq/56-dwc_otg_09:35:461
1955699362,4cyclictest0-21swapper/111:55:341
1955699362,4cyclictest0-21swapper/111:55:341
19556993618,6cyclictest21536-21/usr/sbin/munin08:45:421
19556993612,8cyclictest7950irq/56-dwc_otg_08:50:481
19556993612,8cyclictest7950irq/56-dwc_otg_08:50:481
1955899358,6cyclictest0-21swapper/312:30:173
19558993515,7cyclictest26283-21tune2fs11:00:353
1955899351,32cyclictest0-21swapper/309:50:363
1955899351,28cyclictest1991-21cut11:10:363
1955899351,24cyclictest13471-21timerandwakeup08:20:443
1955699358,6cyclictest23-21ksoftirqd/109:54:321
1955699354,12cyclictest221ktimersoftd/107:50:351
1955699352,22cyclictest26230-21latency_hist11:40:181
1955699351,23cyclictest27744-21latency12:20:381
1955899345,6cyclictest0-21swapper/312:00:313
1955899341,29cyclictest26982-21ls12:20:183
1955899341,23cyclictest17597-21switchtime10:10:443
19557993421,11cyclictest27216-21fschecks_count09:00:342
1955699346,4cyclictest0-21swapper/110:00:441
19556993414,9cyclictest221ktimersoftd/111:10:401
1955899339,14cyclictest37-21rcuc/310:48:323
1955899337,9cyclictest7850irq/56-dwc_otg_08:00:423
19558993315,4cyclictest28476-21fschecks_time09:45:343
19558993315,10cyclictest25922-21sh11:40:003
1955699339,12cyclictest0-21swapper/109:10:291
217332320,2sleep321381-21apt-get10:55:223
1955899329,11cyclictest7950irq/56-dwc_otg_09:35:353
1955899324,6cyclictest7850irq/56-dwc_otg_09:55:443
19558993222,7cyclictest30991-21fschecks_time11:45:373
19558993217,11cyclictest0-21swapper/311:50:423
1955899321,16cyclictest0-21swapper/310:07:533
1955899321,16cyclictest0-21swapper/310:07:533
19558993211,4cyclictest27075-21cpu09:00:313
1955699328,10cyclictest0-21swapper/108:25:181
1955699327,16cyclictest221ktimersoftd/107:30:341
1955699324,5cyclictest7750irq/56-dwc_otg08:35:341
109192320,3sleep310922-21latency_hist12:40:183
1955899317,4cyclictest28310-21cat12:20:453
1955899315,6cyclictest7750irq/56-dwc_otg09:10:343
1955899315,15cyclictest7850irq/56-dwc_otg_10:00:483
1955899312,22cyclictest0-21swapper/312:32:523
19558993114,4cyclictest25052-21aten_rbpower_en10:20:313
1955899311,15cyclictest5047-21latency_hist08:00:183
19558993110,4cyclictest0-21swapper/312:13:203
19558993110,10cyclictest0-21swapper/309:40:573
19556993123,4cyclictest0-21swapper/107:20:171
1955899306,4cyclictest25368-21fschecks_count07:25:343
19558993024,4cyclictest19505-21munin-plugin-st08:40:173
1955899301,17cyclictest20265-21latency08:40:383
1955899297,12cyclictest7850irq/56-dwc_otg_08:45:333
1955899293,5cyclictest7750irq/56-dwc_otg10:35:243
1955899293,5cyclictest7750irq/56-dwc_otg10:35:243
1955899291,5cyclictest29434-21sort10:25:353
1955899291,24cyclictest11620-21timerandwakeup08:15:433
19558992910,4cyclictest0-21swapper/310:15:243
1893622910,12sleep30-21swapper/307:05:523
1955899288,5cyclictest7850irq/56-dwc_otg_07:50:323
1955899282,7cyclictest7750irq/56-dwc_otg07:30:453
1955899281,22cyclictest7939-21switchtime08:05:423
1955899281,22cyclictest7939-21switchtime08:05:423
1955899281,16cyclictest7750irq/56-dwc_otg07:12:563
190522283,17sleep10-21swapper/107:07:231
1955899272,5cyclictest23999-21ntp_states07:20:413
1955899272,18cyclictest0-21swapper/308:54:483
1955899272,18cyclictest0-21swapper/308:54:483
1955899266,9cyclictest7950irq/56-dwc_otg_07:40:453
1955899266,5cyclictest0-21swapper/308:25:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional