You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 01:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Sep 14, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
108222520,2sleep211-21rcu_preempt07:05:482
1845991031,83cyclictest28584-21ssh10:05:460
2754421000,3sleep013-21rcuc/012:01:570
184599981,85cyclictest4527-21sh09:37:460
184599981,81cyclictest0-21swapper/012:25:210
184599971,76cyclictest6464-21cut09:40:340
184599951,73cyclictest17199-21latency_hist09:15:210
184599931,81cyclictest30146-21ssh12:05:380
184599931,67cyclictest8868-21gpgv11:40:210
184599922,77cyclictest0-21swapper/008:25:390
184599921,87cyclictest4684-21fschecks_time10:55:380
184599921,87cyclictest4684-21fschecks_time10:55:380
184599921,79cyclictest5608-21apt-get07:20:320
184599921,79cyclictest5608-21apt-get07:20:320
184599921,79cyclictest29352-21ssh09:29:200
184599921,77cyclictest11817-21sshd10:25:280
184599921,68cyclictest760-21users10:10:490
184599911,74cyclictest23138-21taskset09:20:520
184599901,77cyclictest25851-21proc_pri11:20:450
184599901,77cyclictest25851-21proc_pri11:20:450
184599901,71cyclictest10042-21rm10:22:380
184599901,71cyclictest10042-21rm10:22:380
184599891,76cyclictest14389-21ssh12:25:410
184599891,76cyclictest14389-21ssh12:25:410
184599891,73cyclictest6919-21sed08:50:470
184599891,72cyclictest3981-21cron10:55:200
184599881,77cyclictest0-21swapper/012:39:320
184599881,71cyclictest4488-21ssh12:14:040
184599881,68cyclictest16425-21apt-get07:50:320
184599871,71cyclictest0-21swapper/009:15:450
184599871,64cyclictest18239-21aten_rbpower_cu07:55:340
184599861,80cyclictest0-21swapper/011:10:370
184599861,77cyclictest25094-21sh12:00:010
184599861,73cyclictest3767-21apt-get07:15:280
184599861,71cyclictest27827-21ssh10:44:420
184599861,70cyclictest30565-21chrt10:47:090
184599861,66cyclictest6268-21ntp_kernel_pll_12:15:430
184599851,72cyclictest0-21swapper/009:34:550
184599851,71cyclictest12201-21seq09:46:100
184599851,70cyclictest10641-21taskset07:33:560
184599851,69cyclictest0-21swapper/010:00:350
184599841,73cyclictest0-21swapper/011:06:470
184599841,72cyclictest9972-21ps11:40:460
184599841,71cyclictest23359-21sh11:17:570
184599841,71cyclictest14647-21rm11:45:580
184599841,70cyclictest0-21swapper/011:34:460
184599841,69cyclictest0-21swapper/010:19:490
184599841,68cyclictest23186-21chrt08:06:310
184599841,66cyclictest0-21swapper/009:09:490
184599841,64cyclictest21392-21ssh09:57:220
319872830,2sleep10-21swapper/112:07:331
220712830,6sleep1184699cyclictest09:20:381
184599831,72cyclictest12473-21taskset07:39:180
184599831,68cyclictest20647-21ssh11:54:240
184599831,68cyclictest19595-21rm12:31:220
184599831,68cyclictest11546-21ssh11:03:560
184599822,65cyclictest0-21swapper/009:51:470
1845998132,38cyclictest7750irq/56-dwc_otg10:35:380
184599811,67cyclictest3547-21chrt08:42:090
184599811,67cyclictest0-21swapper/007:25:510
184599811,65cyclictest5390-21chrt08:47:400
184599811,62cyclictest10931-21taskset09:04:180
184599802,70cyclictest0-21swapper/008:33:550
184599802,62cyclictest28920-21latency_hist08:25:210
184599801,70cyclictest12827-21diskmemload10:31:060
184599801,64cyclictest0-21swapper/008:58:450
184599792,62cyclictest0-21swapper/007:42:030
184599781,64cyclictest0-21swapper/011:29:100
184599781,62cyclictest0-21swapper/008:01:230
184599771,62cyclictest0-21swapper/008:11:570
184599771,59cyclictest1799-21runrttasks08:39:230
184599751,62cyclictest0-21swapper/007:47:280
265402730,2sleep10-21swapper/110:42:191
18062720,3sleep2184799cyclictest11:30:472
184599711,59cyclictest0-21swapper/008:20:140
184599691,57cyclictest0-21swapper/007:15:080
184599691,57cyclictest0-21swapper/007:15:080
173072670,2sleep20-21swapper/209:52:402
250692660,2sleep10-21swapper/112:38:411
184899636,43cyclictest7950irq/56-dwc_otg_09:40:433
184899632,10cyclictest0-21swapper/309:19:043
184899621,6cyclictest22322-21/usr/sbin/munin09:20:413
184899604,3cyclictest7950irq/56-dwc_otg_07:50:403
1847996020,14cyclictest28740-21/usr/sbin/munin10:05:482
184899592,6cyclictest7950irq/56-dwc_otg_12:00:343
184899591,3cyclictest0-21swapper/310:30:303
184899591,12cyclictest7193-21ssh10:19:583
184899591,11cyclictest30742-21switchtime12:05:463
184899584,9cyclictest7950irq/56-dwc_otg_10:55:433
184899584,9cyclictest7950irq/56-dwc_otg_10:55:433
1847995820,24cyclictest2604650rm10:03:052
1847995820,20cyclictest23571-21sh11:57:132
1847995816,15cyclictest23539-21runrttasks11:18:172
184699587,28cyclictest0-21swapper/109:05:351
184899577,39cyclictest7850irq/56-dwc_otg_11:54:323
184899575,4cyclictest0-21swapper/310:23:313
184899575,4cyclictest0-21swapper/310:23:313
184899572,7cyclictest5919-21wget08:50:343
184799577,15cyclictest0-21swapper/211:40:262
1847995723,16cyclictest18623-21/usr/sbin/munin07:55:392
184899566,4cyclictest7950irq/56-dwc_otg_07:55:443
184899561,4cyclictest7750irq/56-dwc_otg08:20:213
1847995618,14cyclictest14496-21ssh10:28:142
184699567,30cyclictest9662-21ssh12:20:341
184699563,8cyclictest0-21swapper/112:15:341
184899557,33cyclictest0-21swapper/311:48:483
184899553,4cyclictest0-21swapper/309:55:333
184899552,7cyclictest20623-21cat08:00:423
184899552,4cyclictest7950irq/56-dwc_otg_09:47:013
184899552,11cyclictest2915350/usr/sbin/munin08:25:463
184899548,4cyclictest0-21swapper/311:12:273
184899547,38cyclictest11893-21/usr/sbin/munin10:25:343
184899546,37cyclictest7850irq/56-dwc_otg_11:34:543
184899542,9cyclictest0-21swapper/311:20:253
184899542,9cyclictest0-21swapper/311:20:253
184899541,9cyclictest8617-21wget11:00:353
184899541,10cyclictest7750irq/56-dwc_otg11:06:553
1847995423,18cyclictest18559-21timerwakeupswit09:15:472
1847995421,18cyclictest5808-21ssh10:17:252
1847995420,11cyclictest21564-21ssh10:35:562
184899533,40cyclictest7850irq/56-dwc_otg_11:40:443
184899532,8cyclictest7950irq/56-dwc_otg_12:35:433
184899531,5cyclictest0-21swapper/309:50:313
1848995312,38cyclictest21949-21timerandwakeup11:15:493
184899531,11cyclictest12827-21diskmemload09:28:313
184799538,32cyclictest0-21swapper/209:00:332
1847995330,8cyclictest27367-21apt-get08:20:312
1847995313,12cyclictest17411-21ssh10:31:012
184699534,4cyclictest0-21swapper/107:10:341
184699534,4cyclictest0-21swapper/107:10:341
184899526,30cyclictest7950irq/56-dwc_otg_08:10:403
184899525,8cyclictest7950irq/56-dwc_otg_10:38:543
184899522,8cyclictest657-21fschecks_time08:35:393
184899521,8cyclictest7950irq/56-dwc_otg_10:03:093
184899521,4cyclictest7850irq/56-dwc_otg_09:10:213
1847995225,20cyclictest5907-21tune2fs07:20:382
1847995225,20cyclictest5907-21tune2fs07:20:382
1847995222,12cyclictest26459-21ssh11:21:052
1847995222,12cyclictest26459-21ssh11:21:052
1847995222,12cyclictest23728-21/usr/sbin/munin08:10:462
1847995219,11cyclictest21432-21ssh09:57:262
1847995213,12cyclictest0-21swapper/207:50:352
184699526,8cyclictest7750irq/56-dwc_otg08:05:341
1846995223,10cyclictest23-21ksoftirqd/109:35:331
184899519,30cyclictest0-21swapper/310:40:293
184899515,4cyclictest7750irq/56-dwc_otg12:10:463
184899514,8cyclictest7950irq/56-dwc_otg_12:17:003
184899513,9cyclictest21025-21ssh12:34:003
184899512,8cyclictest7950irq/56-dwc_otg_11:29:183
184899512,8cyclictest0-21swapper/309:32:383
184899512,6cyclictest5840-21grep07:20:383
184899512,6cyclictest5840-21grep07:20:383
184899512,3cyclictest0-21swapper/312:00:213
184799512,5cyclictest0-21swapper/209:45:322
1847995122,19cyclictest20498-21ssh11:15:172
1847995120,8cyclictest25692-21munin-run09:25:202
1847995120,19cyclictest29363-21ssh09:29:212
1847995118,11cyclictest29409-21fschecks_count08:25:382
1847995116,17cyclictest23974-21kworker/u8:010:45:462
184699514,6cyclictest7750irq/56-dwc_otg07:30:321
184699513,7cyclictest0-21swapper/111:25:221
184699513,7cyclictest0-21swapper/111:25:221
184899501,7cyclictest3277-21apt10:15:213
184899501,7cyclictest31074-21basename08:30:353
184899501,7cyclictest0-21swapper/311:37:403
184899501,5cyclictest15576-21ssh09:12:423
1848995010,36cyclictest158482chrt07:46:213
1847995023,11cyclictest14596-21proc_pri12:25:452
1847995023,11cyclictest14596-21proc_pri12:25:452
1847995020,17cyclictest4390-21hostname10:55:342
1847995020,17cyclictest4390-21hostname10:55:342
1847995020,12cyclictest10044-21ssh10:22:382
1847995020,12cyclictest10044-21ssh10:22:382
1847995019,13cyclictest25710-21ssh12:39:522
1847995015,12cyclictest7409-21ssh12:16:522
1847995014,25cyclictest0-21swapper/209:35:472
1847995012,12cyclictest11526-21rm11:03:542
184899497,3cyclictest0-21swapper/310:46:353
184899496,4cyclictest7750irq/56-dwc_otg09:37:463
184899492,6cyclictest2977-21unixbench_multi07:10:493
184899492,6cyclictest2977-21unixbench_multi07:10:493
184899492,5cyclictest0-21swapper/308:45:473
184899491,8cyclictest13091-21fschecks_count07:40:383
1847994922,16cyclictest12505-21taskset07:39:442
1847994922,10cyclictest7950irq/56-dwc_otg_09:40:412
1847994917,12cyclictest29825-21cut12:05:342
1847994916,26cyclictest32603-21ssh09:32:352
1847994916,11cyclictest26124-21ssh10:41:332
1847994911,22cyclictest7950irq/56-dwc_otg_12:11:252
184899485,4cyclictest0-21swapper/312:30:143
184899485,4cyclictest0-21swapper/312:30:143
184899482,8cyclictest10749-21timerwakeupswit12:20:483
184899481,7cyclictest8716-21unixbench-2d08:55:473
184899481,2cyclictest0-21swapper/310:06:453
1847994820,11cyclictest5863-21apt-get08:50:312
1847994819,12cyclictest1129-21grep10:50:452
1847994816,10cyclictest26903-1kworker/u9:111:54:252
1847994815,11cyclictest15715-21ssh09:12:572
1846994811,9cyclictest0-21swapper/109:10:331
184899473,5cyclictest0-21swapper/307:30:363
184899471,7cyclictest22188-21fschecks_count08:05:383
184899471,5cyclictest7950irq/56-dwc_otg_07:15:383
1847994718,18cyclictest3770-21sshd08:44:572
184699476,25cyclictest0-21swapper/112:30:261
184899462,7cyclictest11866-21cat07:35:483
184899462,5cyclictest8328-21cat07:25:473
184899461,7cyclictest3882-21cat08:45:213
184899461,6cyclictest9550-21wget09:00:353
184899461,12cyclictest0-21swapper/310:52:533
1847994616,7cyclictest7850irq/56-dwc_otg_11:09:392
1847994616,13cyclictest21136-21ssh12:34:122
1847994614,16cyclictest25545-21sh12:00:262
184699468,3cyclictest7750irq/56-dwc_otg11:00:261
14502463,34sleep00-21swapper/007:08:470
184899451,6cyclictest27354-21/usr/sbin/munin08:20:463
1847994519,11cyclictest14836-21taskset11:46:192
1847994515,14cyclictest8698-21munin-run11:40:212
1847994416,12cyclictest12827-21diskmemload12:22:532
184699447,24cyclictest0-21swapper/109:45:331
8312430,2sleep10-21swapper/110:10:541
1847994314,20cyclictest1832-21taskset08:39:502
184699437,25cyclictest0-21swapper/107:25:341
1846994318,5cyclictest23-21ksoftirqd/112:25:321
1846994318,5cyclictest23-21ksoftirqd/112:25:321
1847994212,11cyclictest7950irq/56-dwc_otg_07:15:352
184699427,23cyclictest0-21swapper/108:10:341
184699422,21cyclictest5200-21fschecks_count11:35:391
1846994219,4cyclictest26521-21if_wlan009:25:401
184799417,25cyclictest0-21swapper/207:45:332
184799414,21cyclictest7950irq/56-dwc_otg_11:25:342
1847994117,11cyclictest0-21swapper/207:31:202
1847994112,10cyclictest7750irq/56-dwc_otg10:11:522
184699418,19cyclictest221ktimersoftd/112:10:301
184699418,19cyclictest0-21swapper/110:00:311
184699417,24cyclictest0-21swapper/111:15:361
184699414,5cyclictest7750irq/56-dwc_otg11:10:331
1846994114,24cyclictest0-21swapper/108:35:351
1847994015,7cyclictest26099-21ls08:15:412
1846994020,5cyclictest640150wget09:40:341
184799397,25cyclictest0-21swapper/208:05:262
1847993915,13cyclictest21270-21runrttasks08:01:232
184699394,9cyclictest0-21swapper/107:50:321
184699391,24cyclictest0-21swapper/108:25:341
184799388,20cyclictest0-21swapper/209:07:122
1847993813,11cyclictest8628-21chrt07:26:112
184699383,17cyclictest0-21swapper/110:20:331
184699383,17cyclictest0-21swapper/110:20:331
1846993825,9cyclictest0-21swapper/110:50:421
184699382,16cyclictest7850irq/56-dwc_otg_09:35:201
1846993817,5cyclictest1229-21if_err_wlan011:30:391
260702370,7sleep1221ktimersoftd/108:15:411
1847993723,11cyclictest4045-21/usr/sbin/munin08:45:502
1846993726,3cyclictest7950irq/56-dwc_otg_09:53:341
1847993620,12cyclictest31660-21ntp_states08:30:442
1847993615,11cyclictest14344-21sshd07:45:062
184699367,5cyclictest7750irq/56-dwc_otg11:55:421
184699367,3cyclictest7950irq/56-dwc_otg_10:15:321
184699366,4cyclictest5962-21ls07:20:391
184699366,4cyclictest5962-21ls07:20:391
184699362,6cyclictest0-21swapper/108:20:311
1846993621,6cyclictest7950irq/56-dwc_otg_11:50:371
1846993613,5cyclictest9329-1kworker/u9:210:25:381
1846993612,5cyclictest28968-21unixbench_singl10:05:501
184699359,4cyclictest0-21swapper/111:40:511
184699358,12cyclictest7950irq/56-dwc_otg_10:00:221
184699357,15cyclictest0-21swapper/107:40:341
184699352,6cyclictest0-21swapper/111:07:281
184699352,10cyclictest7750irq/56-dwc_otg07:15:321
1846993519,3cyclictest0-21swapper/110:45:351
1847993420,11cyclictest8066-21cat08:55:372
1847993420,11cyclictest1860-21/usr/sbin/munin07:10:452
1847993420,11cyclictest1860-21/usr/sbin/munin07:10:452
184699347,6cyclictest0-21swapper/107:55:461
184699346,6cyclictest0-21swapper/111:45:481
184699345,20cyclictest7750irq/56-dwc_otg12:00:431
184699343,16cyclictest7850irq/56-dwc_otg_09:15:451
184699342,17cyclictest0-21swapper/108:55:371
176172340,2sleep10-21swapper/110:31:241
184699335,5cyclictest9450irq/48-DMA08:56:171
184699332,22cyclictest0-21swapper/111:29:191
184699331,22cyclictest4381-21uniq08:45:371
184699328,5cyclictest0-21swapper/108:00:351
1846993215,5cyclictest11280-21fschecks_count07:35:391
1846993214,9cyclictest31635-21ntp_kernel_pll_08:30:431
184699321,19cyclictest0-21swapper/109:00:351
1846993210,7cyclictest4713-21idleruntime10:55:381
1846993210,7cyclictest4713-21idleruntime10:55:381
184699318,12cyclictest7950irq/56-dwc_otg_08:40:411
184699314,7cyclictest7950irq/56-dwc_otg_07:45:391
12802313,20sleep10-21swapper/107:06:411
184699301,21cyclictest6027-21cpuspeed08:50:341
13272293,20sleep30-21swapper/307:07:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional