You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 17:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sun May 24, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4356991072,92cyclictest0-21swapper/009:45:150
2976721060,2sleep30-21swapper/312:01:433
4356991051,101cyclictest0-21swapper/012:06:340
4356991011,80cyclictest0-21swapper/010:40:140
435699981,85cyclictest26843-21ssh11:58:560
435699961,92cyclictest0-21swapper/009:25:290
435699951,80cyclictest28600-21apt-config12:40:030
192742940,2sleep30-21swapper/312:28:323
435699931,75cyclictest0-21swapper/011:53:090
435699911,77cyclictest28202-21ssh11:20:300
435699911,76cyclictest0-21swapper/010:45:230
435699911,74cyclictest24140-21ssh12:34:510
88902900,5sleep2435899cyclictest10:57:412
435699901,69cyclictest28565-21grep08:15:250
272482900,2sleep10-21swapper/110:40:291
435699891,76cyclictest17579-21unixbench_singl12:25:340
435699891,74cyclictest23707-21ntp_kernel_pll_11:15:260
435699891,74cyclictest23707-21ntp_kernel_pll_11:15:260
435699891,73cyclictest5687-21fschecks_count10:15:190
435699891,73cyclictest5687-21fschecks_count10:15:190
435699881,76cyclictest0-21swapper/012:04:090
435699881,65cyclictest332-21chrt11:25:570
435699881,37cyclictest10573-21chrt12:17:590
435699871,63cyclictest22740-21latency_hist11:15:040
435699861,72cyclictest24232-21aten_rbpower_cu09:20:170
435699851,81cyclictest22979-21ssh09:56:160
435699851,65cyclictest17867-21ssh11:47:410
435699851,65cyclictest17867-21ssh11:47:410
435699841,68cyclictest10288-21grep07:25:230
435699841,56cyclictest10263-21fschecks_count08:55:210
435699831,59cyclictest6219-21ssh11:34:060
4356998313,46cyclictest0-21swapper/012:20:200
435699822,68cyclictest0-21swapper/008:49:220
435699822,61cyclictest0-21swapper/007:11:440
435699821,71cyclictest17197-21diskmemload10:29:180
435699821,62cyclictest0-21swapper/010:58:510
302412820,2sleep20-21swapper/209:26:222
435699811,63cyclictest0-21swapper/010:23:300
435699811,57cyclictest0-21swapper/009:39:440
435699811,53cyclictest8332-21grep07:20:200
435699801,75cyclictest531-21munin-node08:35:130
435699801,69cyclictest0-21swapper/010:10:150
435699801,68cyclictest0-21swapper/010:37:100
435699801,64cyclictest25502-21ssh10:00:170
435699801,64cyclictest0-21swapper/011:42:130
435699801,60cyclictest3689-21chrt10:50:460
435699801,60cyclictest20055-21ssh09:53:300
435699801,60cyclictest20055-21ssh09:53:300
435699801,60cyclictest0-21swapper/010:31:430
435699801,57cyclictest17016-21dpkg07:45:030
435699801,42cyclictest19610-21ntpq07:50:260
435699792,62cyclictest0-21swapper/009:31:260
435699791,57cyclictest9720-21sshd08:54:550
435699781,64cyclictest0-21swapper/010:07:080
435699781,63cyclictest0-21swapper/009:14:390
435699771,61cyclictest0-21swapper/011:06:570
435699771,58cyclictest8703-21ssh09:40:040
435699771,58cyclictest12990-21seq09:00:360
435699771,43cyclictest12389-21ssh11:01:290
245702770,2sleep10-21swapper/109:59:101
435699762,53cyclictest0-21swapper/007:56:060
435699761,58cyclictest0-21swapper/012:12:250
435699751,61cyclictest0-21swapper/009:17:260
435699751,61cyclictest0-21swapper/009:17:260
435699751,55cyclictest0-21swapper/008:10:130
293002750,5sleep2435899cyclictest10:05:032
435699741,61cyclictest0-21swapper/007:19:560
435699741,58cyclictest0-21swapper/007:30:180
435699741,36cyclictest7361-21sshd11:35:190
262232740,2sleep10-21swapper/112:35:551
68852720,2sleep20-21swapper/209:37:172
435699721,62cyclictest0-21swapper/007:45:040
228482720,2sleep3435999cyclictest12:32:313
435699701,57cyclictest1133-21runrttasks08:21:030
435699691,58cyclictest0-21swapper/009:06:140
435699691,48cyclictest0-21swapper/008:07:000
435699691,48cyclictest0-21swapper/008:07:000
435699691,47cyclictest2289-21sshd08:32:190
435699672,44cyclictest0-21swapper/007:36:240
435699672,44cyclictest0-21swapper/007:36:240
4357996614,32cyclictest23-21ksoftirqd/112:25:171
435699661,50cyclictest0-21swapper/008:01:240
265312650,1sleep30-21swapper/312:36:303
132962650,2sleep30-21swapper/312:20:313
435899642,10cyclictest7850irq/56-dwc_otg10:50:152
435699641,54cyclictest0-21swapper/008:29:310
435699633,55cyclictest0-21swapper/008:41:160
435799622,12cyclictest7950irq/56-dwc_otg_11:20:141
31292620,4sleep3435999cyclictest09:33:123
435799617,17cyclictest0-21swapper/112:15:161
435799601,25cyclictest15999-21ls12:25:041
435999562,10cyclictest7950irq/56-dwc_otg_07:15:133
435899561,8cyclictest7850irq/56-dwc_otg07:40:152
37332543,12sleep00-21swapper/007:05:340
4357995326,5cyclictest24116-21kworker/1:011:25:151
230642530,2sleep20-21swapper/212:32:542
4358995110,27cyclictest29-21rcuc/210:45:262
106172510,3sleep10-21swapper/108:55:251
435899508,5cyclictest0-21swapper/208:40:152
4357994920,16cyclictest7950irq/56-dwc_otg_10:30:171
183102490,2sleep20-21swapper/211:48:302
183102490,2sleep20-21swapper/211:48:302
4359994825,4cyclictest23949-21latency_hist09:20:043
4359994825,4cyclictest23949-21latency_hist09:20:043
435999477,25cyclictest0-21swapper/308:30:143
435899472,9cyclictest20817-21ssh10:33:202
435799476,5cyclictest0-21swapper/109:00:171
435799472,14cyclictest0-21swapper/110:00:151
435899467,24cyclictest0-21swapper/211:40:162
435899463,28cyclictest0-21swapper/208:50:152
435999457,24cyclictest0-21swapper/307:55:173
435899459,16cyclictest7950irq/56-dwc_otg_11:15:032
435899457,25cyclictest0-21swapper/208:30:142
435899457,23cyclictest0-21swapper/208:25:172
435899453,16cyclictest7950irq/56-dwc_otg_08:00:142
435899452,5cyclictest2964-21ssh11:30:162
435899444,29cyclictest7950irq/56-dwc_otg_10:35:232
435799447,24cyclictest0-21swapper/107:20:161
17022441,4sleep21712-21ssh12:06:592
435999436,24cyclictest0-21swapper/308:05:163
435999436,24cyclictest0-21swapper/308:05:163
4359994315,23cyclictest39-21ksoftirqd/310:25:143
435899434,23cyclictest0-21swapper/210:40:162
435799437,24cyclictest0-21swapper/108:50:161
435799431,5cyclictest7950irq/56-dwc_otg_10:10:271
435799431,3cyclictest7850irq/56-dwc_otg09:25:171
435999427,20cyclictest0-21swapper/309:05:163
435899429,16cyclictest31-21ksoftirqd/209:45:162
435899425,5cyclictest8050irq/56-dwc_otg_11:00:172
435899425,19cyclictest29-21rcuc/209:59:012
435799427,23cyclictest0-21swapper/111:30:161
4357994221,6cyclictest7307-21tail07:15:291
4357994220,5cyclictest11289-21aten_rbpower_en11:40:161
86082411,3sleep10-21swapper/111:35:541
435999417,23cyclictest0-21swapper/308:55:173
435999416,22cyclictest0-21swapper/308:25:173
4359994120,4cyclictest16798-21apt-get07:45:023
435899417,22cyclictest0-21swapper/208:05:162
435899417,22cyclictest0-21swapper/208:05:162
435899414,29cyclictest0-21swapper/211:15:142
435899414,29cyclictest0-21swapper/211:15:142
4358994115,9cyclictest7850irq/56-dwc_otg10:20:492
4357994111,9cyclictest0-21swapper/109:45:131
309912410,2sleep10-21swapper/110:45:241
435999407,24cyclictest0-21swapper/310:20:083
435999407,19cyclictest22477-21cut10:35:203
4359994015,16cyclictest4488-21basename07:10:153
435999401,21cyclictest0-21swapper/308:45:143
435899408,21cyclictest31-21ksoftirqd/208:55:182
435899407,20cyclictest29-21rcuc/210:29:012
435899406,17cyclictest31-21ksoftirqd/210:15:392
435899406,17cyclictest31-21ksoftirqd/210:15:392
435799407,23cyclictest0-21swapper/107:50:181
435799401,5cyclictest1223-21cut08:30:181
435799401,3cyclictest0-21swapper/109:20:151
435999397,21cyclictest0-21swapper/308:10:163
435999391,20cyclictest2385850ssh11:15:293
435999391,20cyclictest2385850ssh11:15:293
435899399,19cyclictest31-21ksoftirqd/209:20:322
4358993919,8cyclictest562450ssh12:11:342
4358993910,15cyclictest7950irq/56-dwc_otg_07:50:292
435799395,22cyclictest6408-21ssh10:55:161
435799394,3cyclictest8050irq/56-dwc_otg_09:35:201
4357993910,5cyclictest7850irq/56-dwc_otg10:20:041
4357993910,5cyclictest7850irq/56-dwc_otg10:20:041
147552390,6sleep3435999cyclictest09:46:243
435999385,20cyclictest4577-21ssh09:35:163
435899388,14cyclictest7950irq/56-dwc_otg_12:37:432
435899386,15cyclictest31-21ksoftirqd/212:15:302
4358993813,9cyclictest7850irq/56-dwc_otg12:01:482
435799384,26cyclictest8050irq/56-dwc_otg_08:25:161
435799384,19cyclictest7950irq/56-dwc_otg_11:20:041
435799384,19cyclictest7950irq/56-dwc_otg_11:20:041
203142380,3sleep220310-21ssh11:50:272
435999377,23cyclictest0-21swapper/310:40:163
435999376,7cyclictest19364-21latency_hist11:50:043
435999376,7cyclictest19364-21latency_hist11:50:043
435999372,26cyclictest8050irq/56-dwc_otg_09:50:133
435999372,26cyclictest8050irq/56-dwc_otg_09:50:133
435999371,6cyclictest3411-21munin-run12:10:033
4359993710,12cyclictest0-21swapper/310:50:173
435899379,6cyclictest7850irq/56-dwc_otg12:25:032
435899377,18cyclictest301ktimersoftd/207:20:162
435899376,20cyclictest0-21swapper/207:15:152
435899373,9cyclictest29-21rcuc/211:20:282
4358993711,4cyclictest8050irq/56-dwc_otg_10:10:142
435799376,6cyclictest7850irq/56-dwc_otg12:00:031
4357993714,4cyclictest1133-21runrttasks11:51:181
4357993713,4cyclictest14811-21sh11:05:181
435799371,24cyclictest26064-21ls08:10:041
435799371,24cyclictest26064-21ls08:10:041
190052370,10sleep1221ktimersoftd/111:49:461
190052370,10sleep1221ktimersoftd/111:49:461
177552371,4sleep317765-21ssh09:12:073
435999364,5cyclictest7850irq/56-dwc_otg11:50:203
435899364,19cyclictest29-21rcuc/208:35:302
435899363,5cyclictest0-21swapper/208:20:152
4358993616,13cyclictest16586-21fschecks_count12:25:222
435899361,5cyclictest29-21rcuc/211:28:562
435799361,5cyclictest7950irq/56-dwc_otg_09:16:001
435799361,5cyclictest7950irq/56-dwc_otg_09:16:001
4357993615,5cyclictest12489-21sh09:44:501
4359993514,4cyclictest9227-21latency_hist10:20:033
4359993514,4cyclictest9227-21latency_hist10:20:033
435999351,24cyclictest9889-21sh09:40:303
435999351,13cyclictest7950irq/56-dwc_otg_07:30:133
435899358,4cyclictest7850irq/56-dwc_otg09:30:162
435899357,11cyclictest7850irq/56-dwc_otg09:42:282
435899353,4cyclictest301ktimersoftd/207:25:232
4358993515,4cyclictest7950irq/56-dwc_otg_08:15:302
435799353,20cyclictest1165-21snmpd10:24:171
435799352,5cyclictest8050irq/56-dwc_otg_10:50:291
435799351,22cyclictest16795-21latency_hist07:45:031
435799351,16cyclictest7850irq/56-dwc_otg12:05:291
323352350,5sleep3435999cyclictest10:46:353
196602350,21sleep28050irq/56-dwc_otg_09:52:472
196602350,21sleep28050irq/56-dwc_otg_09:52:472
435999348,6cyclictest8050irq/56-dwc_otg_11:25:153
435999347,24cyclictest0-21swapper/311:10:163
435999342,6cyclictest0-21swapper/310:00:143
4359993414,5cyclictest18985-21/usr/sbin/munin10:30:293
435999341,3cyclictest8050irq/56-dwc_otg_09:20:173
4358993418,5cyclictest7950irq/56-dwc_otg_11:40:032
435899341,22cyclictest21030-21cut07:55:212
435899341,20cyclictest301ktimersoftd/210:07:082
435799341,22cyclictest30108-21cut08:20:201
435799341,16cyclictest985-21latency_hist10:10:031
435999338,13cyclictest0-21swapper/307:25:043
435999331,24cyclictest11787-21ssh12:20:043
435999331,19cyclictest22874-21uniq08:00:213
4359993310,4cyclictest0-21swapper/311:40:033
435899338,6cyclictest14795-21sh11:05:182
435899337,18cyclictest31-21ksoftirqd/209:17:472
435899337,18cyclictest31-21ksoftirqd/209:17:472
435899337,13cyclictest301ktimersoftd/207:45:042
435899335,5cyclictest7850irq/56-dwc_otg11:55:182
435899334,6cyclictest7850irq/56-dwc_otg07:35:172
435899334,6cyclictest7850irq/56-dwc_otg07:35:172
435899333,19cyclictest7850irq/56-dwc_otg09:11:502
4358993318,4cyclictest26149-21/usr/sbin/munin08:10:172
435899331,20cyclictest15285-21latency_hist09:10:032
435799338,15cyclictest0-21swapper/109:50:161
435799338,15cyclictest0-21swapper/109:50:161
435799335,19cyclictest27812-21ssh12:00:161
435799334,4cyclictest8050irq/56-dwc_otg_10:35:151
4357993320,7cyclictest8050irq/56-dwc_otg_12:30:141
4357993317,7cyclictest10542-21/usr/sbin/munin11:00:231
4357993313,7cyclictest23-21ksoftirqd/108:15:021
4357993310,5cyclictest0-21swapper/112:10:171
435999328,5cyclictest0-21swapper/311:00:313
435999326,12cyclictest8050irq/56-dwc_otg_10:10:203
435899326,10cyclictest8050irq/56-dwc_otg_08:45:202
435799327,5cyclictest7850irq/56-dwc_otg09:30:221
435799326,6cyclictest7850irq/56-dwc_otg07:35:311
435799326,6cyclictest7850irq/56-dwc_otg07:35:311
435799323,15cyclictest221ktimersoftd/108:00:161
435799322,6cyclictest0-21swapper/109:05:201
435799321,6cyclictest7850irq/56-dwc_otg11:10:261
435799321,21cyclictest10167-21ls07:25:211
435999317,16cyclictest0-21swapper/309:29:543
435999314,4cyclictest7850irq/56-dwc_otg10:55:173
435999312,5cyclictest0-21swapper/311:40:153
435999311,4cyclictest8050irq/56-dwc_otg_07:35:313
435999311,4cyclictest8050irq/56-dwc_otg_07:35:313
435999311,20cyclictest0-21swapper/308:50:213
435999311,13cyclictest8050irq/56-dwc_otg_08:45:033
435999311,13cyclictest20047-21grep07:50:323
435999311,13cyclictest0-21swapper/311:57:503
4359993111,10cyclictest0-21swapper/311:20:213
435899317,21cyclictest0-21swapper/207:30:162
435799319,11cyclictest21-21rcuc/108:40:221
435799314,5cyclictest14332-21ssh10:25:231
435799312,6cyclictest7850irq/56-dwc_otg07:15:031
435799311,5cyclictest7850irq/56-dwc_otg07:55:241
435799311,22cyclictest28131-21cpuspeed08:15:181
435999308,4cyclictest0-21swapper/312:10:183
435999306,4cyclictest7950irq/56-dwc_otg_07:25:163
435999303,13cyclictest7950irq/56-dwc_otg_09:55:323
4359993016,4cyclictest1133-21runrttasks08:20:523
435999301,5cyclictest8050irq/56-dwc_otg_10:05:223
4359993013,4cyclictest2990-21/usr/sbin/munin08:35:203
435899304,14cyclictest301ktimersoftd/209:03:272
435799306,5cyclictest0-21swapper/109:10:131
435799306,4cyclictest7850irq/56-dwc_otg07:45:191
4357993011,5cyclictest0-21swapper/108:50:031
40262303,19sleep10-21swapper/107:09:191
435999298,12cyclictest0-21swapper/311:06:533
435999291,6cyclictest27996-21wget08:15:173
435999291,18cyclictest3938-21ls11:30:293
435899291,4cyclictest7850irq/56-dwc_otg07:10:042
435799291,13cyclictest7850irq/56-dwc_otg08:38:141
435799283,3cyclictest7850irq/56-dwc_otg07:30:161
435999273,5cyclictest7850irq/56-dwc_otg09:00:293
4359992720,5cyclictest17171-21wget07:45:163
40512273,14sleep20-21swapper/207:09:372
39302263,14sleep30-21swapper/307:08:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional