You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 23:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Aug 17, 2026 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
307279911848,8cyclictest7850irq/56-dwc_otg_10:25:280
30727991152,54cyclictest25610-21ntpq12:05:310
30728991134,32cyclictest25571-21sh12:05:301
307279910954,10cyclictest13-21rcuc/012:30:280
307279910410,59cyclictest20319-21grep10:40:380
1915621010,2sleep20-21swapper/209:20:392
1915621010,2sleep20-21swapper/209:20:392
3072899997,21cyclictest7750irq/56-dwc_otg10:45:381
3072799997,59cyclictest0-21swapper/012:15:350
3072799997,59cyclictest0-21swapper/012:15:350
3072899989,49cyclictest0-21swapper/111:20:181
3072799973,71cyclictest0-21swapper/010:15:220
3072899953,13cyclictest7208-21uname10:25:261
30727999457,19cyclictest7950irq/56-dwc_otg_10:45:360
100542940,5sleep13072899cyclictest07:40:321
3072899922,16cyclictest7850irq/56-dwc_otg_09:15:241
3072799915,51cyclictest0-21swapper/009:15:220
3072899855,19cyclictest13079-21/usr/sbin/munin12:30:271
3072899853,20cyclictest0-21swapper/112:15:371
3072899853,20cyclictest0-21swapper/112:15:371
3072799846,28cyclictest0-21swapper/008:50:200
3072899824,18cyclictest0-21swapper/110:40:361
207202820,5sleep23072999cyclictest12:00:182
3072899792,19cyclictest7950irq/56-dwc_otg_10:15:231
30727997771,4cyclictest101ktimersoftd/011:40:400
124002740,2sleep00-21swapper/012:29:270
126392730,1sleep00-21swapper/010:31:310
3072999723,41cyclictest13440-21uniq12:30:252
148992710,1sleep00-21swapper/009:55:280
30729997011,24cyclictest7950irq/56-dwc_otg_09:15:232
3073099699,40cyclictest7850irq/56-dwc_otg_09:15:223
309702660,5sleep03072799cyclictest12:11:480
30729996612,19cyclictest31-21ksoftirqd/212:15:362
30729996612,19cyclictest31-21ksoftirqd/212:15:362
3072899654,12cyclictest17796-21ssh09:20:171
3072899654,12cyclictest17796-21ssh09:20:171
30729996429,11cyclictest301ktimersoftd/210:25:322
3072899646,39cyclictest7750irq/56-dwc_otg10:35:191
30730996318,24cyclictest0-21swapper/312:30:273
3072899636,19cyclictest0-21swapper/109:10:211
218222630,1sleep10-21swapper/110:04:231
30730996237,8cyclictest7750irq/56-dwc_otg10:25:293
3072899612,6cyclictest7750irq/56-dwc_otg12:20:191
325752600,3sleep1221ktimersoftd/109:37:331
3073099607,33cyclictest7850irq/56-dwc_otg_10:45:373
30727996027,6cyclictest24091-21ssh11:25:180
30727996027,15cyclictest1191-21snmpd11:15:260
3073099593,32cyclictest7750irq/56-dwc_otg10:40:383
30727995921,22cyclictest18489-21unixbench_singl12:35:350
3072999583,26cyclictest20141-21ssh10:40:352
30727995815,27cyclictest11768-21fschecks_count11:10:250
3073099573,13cyclictest1870-21grep12:15:353
3073099573,13cyclictest1870-21grep12:15:353
30729995616,26cyclictest0-21swapper/207:15:202
30729995614,21cyclictest255682sleep212:05:302
3072899566,9cyclictest0-21swapper/112:35:181
30727995630,5cyclictest7850irq/56-dwc_otg_08:40:360
30727995619,14cyclictest7850irq/56-dwc_otg_08:35:340
3072799561,44cyclictest0-21swapper/011:59:470
165982560,2sleep30-21swapper/311:15:313
30727995528,11cyclictest7850irq/56-dwc_otg_07:50:250
3072799551,39cyclictest9577-21grep11:45:360
3072799551,39cyclictest4933-21aten_rbpower_vo12:20:200
3072799551,36cyclictest0-21swapper/010:05:200
302502553,45sleep00-21swapper/007:07:340
302502553,45sleep00-21swapper/007:07:340
30730995414,24cyclictest0-21swapper/312:05:283
3072899546,20cyclictest0-21swapper/108:15:201
3072899546,20cyclictest0-21swapper/108:15:201
30727995438,8cyclictest1180-21runrttasks10:36:550
3072799541,50cyclictest3726-21sh11:40:060
3072799541,41cyclictest13-21rcuc/010:55:070
3072799541,41cyclictest13-21rcuc/010:55:070
3072799541,37cyclictest7231-21unixbench_multi09:45:340
3072799541,33cyclictest0-21swapper/011:20:180
3073099536,20cyclictest30826-21/usr/sbin/munin10:15:243
3072799536,29cyclictest5513-21latency_hist07:30:070
3072799536,29cyclictest5513-21latency_hist07:30:070
30727995337,5cyclictest6013-21ssh11:03:200
30727995328,5cyclictest9222-21grep09:10:070
30727995322,6cyclictest13618-21unixbench-2d11:50:350
3072799531,38cyclictest0-21swapper/008:00:230
3072799531,34cyclictest27636-21grep10:10:350
30727995224,3cyclictest0-21swapper/007:40:180
3072799522,38cyclictest0-21swapper/010:20:240
3072799522,38cyclictest0-21swapper/010:20:240
30727995223,6cyclictest20860-21grep12:00:220
3072799522,33cyclictest0-21swapper/009:35:200
3072799521,39cyclictest0-21swapper/009:40:270
30727995126,13cyclictest0-21swapper/009:20:220
30727995126,13cyclictest0-21swapper/009:20:220
30727995126,12cyclictest7850irq/56-dwc_otg_09:55:060
30727995126,12cyclictest7850irq/56-dwc_otg_09:55:060
3072799511,35cyclictest18748-21fschecks_count10:00:240
3072799511,32cyclictest0-21swapper/011:05:300
3072999504,18cyclictest7850irq/56-dwc_otg_10:45:372
30728995019,7cyclictest22216-21fschecks_count09:25:241
3072899501,7cyclictest7750irq/56-dwc_otg11:05:181
3072799501,12cyclictest7950irq/56-dwc_otg_09:30:180
3072999497,19cyclictest0-21swapper/210:15:222
3072899499,18cyclictest7950irq/56-dwc_otg_07:15:201
3072799492,34cyclictest0-21swapper/007:45:230
3072799491,39cyclictest1180-21runrttasks09:10:310
3072999487,25cyclictest0-21swapper/208:50:202
3072899483,11cyclictest20716-21ssh12:00:181
30727994827,5cyclictest7950irq/56-dwc_otg_09:25:310
30727994821,5cyclictest7850irq/56-dwc_otg_07:15:270
3072799481,6cyclictest7950irq/56-dwc_otg_11:30:190
3072799481,34cyclictest0-21swapper/010:55:260
103552480,2sleep20-21swapper/211:08:412
3072799471,3cyclictest0-21swapper/008:30:320
3072899467,25cyclictest0-21swapper/108:55:191
3072799464,31cyclictest0-21swapper/008:10:190
293172460,3sleep1221ktimersoftd/112:10:241
3072999452,6cyclictest7950irq/56-dwc_otg_11:30:182
3072899453,28cyclictest7750irq/56-dwc_otg09:50:181
3072899453,28cyclictest7750irq/56-dwc_otg09:50:181
30727994518,3cyclictest0-21swapper/007:35:290
3072799451,31cyclictest0-21swapper/008:57:570
30727994513,18cyclictest26363-21grep08:25:330
3072799451,24cyclictest24403-21runrttasks08:20:300
30727994510,2cyclictest0-21swapper/008:05:180
3072999442,12cyclictest7750irq/56-dwc_otg10:05:202
3072899442,36cyclictest31222-21grep08:40:251
3072799442,31cyclictest0-21swapper/007:56:460
30727994415,5cyclictest0-21swapper/007:10:210
30727994319,11cyclictest7850irq/56-dwc_otg_08:15:280
30727994319,11cyclictest7850irq/56-dwc_otg_08:15:280
3073099427,21cyclictest0-21swapper/307:15:113
30730994214,6cyclictest21513-21sh09:25:003
30730994214,6cyclictest21513-21sh09:25:003
3072899427,23cyclictest0-21swapper/111:25:121
3072899422,9cyclictest5990-21ssh09:45:171
3072899422,17cyclictest0-21swapper/107:45:171
30728994213,18cyclictest8316-21ssh11:45:191
3073099417,21cyclictest0-21swapper/308:45:213
3073099414,9cyclictest7750irq/56-dwc_otg08:15:183
3073099414,9cyclictest7750irq/56-dwc_otg08:15:183
30730994122,4cyclictest17346-21wget12:35:203
3072999417,7cyclictest7850irq/56-dwc_otg_08:35:062
3072899411,8cyclictest14420-21cron07:55:061
30728994115,5cyclictest6360-21modprobe10:25:071
30728994115,5cyclictest6360-21modprobe10:25:071
3072799416,25cyclictest0-21swapper/009:00:190
30727994122,4cyclictest5733-21wget07:30:200
30730994025,6cyclictest0-21swapper/309:50:153
30730994025,6cyclictest0-21swapper/309:50:153
3072899404,19cyclictest0-21swapper/109:35:071
3072899402,5cyclictest21-21rcuc/112:25:261
30728994022,7cyclictest7850irq/56-dwc_otg_08:35:191
3072899401,32cyclictest32376-21ssh11:35:171
3072799405,15cyclictest0-21swapper/008:45:190
3072799401,27cyclictest0-21swapper/007:20:230
276342401,34sleep10-21swapper/110:10:361
30730993817,5cyclictest3186-21grep07:20:353
3072999381,18cyclictest12154-21cat11:10:292
3072899384,5cyclictest5933-21cut07:30:231
3072899383,23cyclictest7750irq/56-dwc_otg11:10:251
3072899382,20cyclictest0-21swapper/109:40:291
3072899381,24cyclictest31112-21ls07:10:251
3072899381,22cyclictest7950irq/56-dwc_otg_08:10:061
3072899381,20cyclictest15491-21ssh09:55:361
164262380,1sleep20-21swapper/210:35:522
10922380,8sleep231-21ksoftirqd/208:45:332
3073099375,18cyclictest3222-21ssh11:00:203
3072999371,6cyclictest7950irq/56-dwc_otg_11:35:172
3072999371,3cyclictest7950irq/56-dwc_otg_07:55:172
3072899378,17cyclictest0-21swapper/111:45:071
30728993713,6cyclictest0-21swapper/109:05:221
3073099367,6cyclictest0-21swapper/311:25:223
3073099367,15cyclictest0-21swapper/309:05:183
3073099366,20cyclictest7850irq/56-dwc_otg_10:30:193
30730993622,4cyclictest5130-21ls11:40:333
3073099362,16cyclictest7750irq/56-dwc_otg07:15:063
3073099361,4cyclictest0-21swapper/311:31:163
3073099361,3cyclictest0-21swapper/312:00:203
3072999361,25cyclictest9172-21dpkg09:10:072
3072999361,24cyclictest31748-21ls07:10:342
3072899361,4cyclictest0-21swapper/111:50:181
30728993614,8cyclictest23994-21fschecks_time08:20:241
30728993610,11cyclictest0-21swapper/111:30:191
82232350,6sleep33073099cyclictest12:24:233
3073099359,6cyclictest39-21ksoftirqd/307:50:183
3073099353,15cyclictest7850irq/56-dwc_otg_08:50:233
3073099352,17cyclictest7950irq/56-dwc_otg_09:40:273
30730993517,4cyclictest12709-21sh12:30:013
30730993514,5cyclictest1180-21runrttasks11:45:103
3072999357,25cyclictest0-21swapper/208:10:192
30729993519,7cyclictest7950irq/56-dwc_otg_12:37:172
3072999351,3cyclictest7950irq/56-dwc_otg_11:00:062
3072899359,19cyclictest7850irq/56-dwc_otg_08:50:241
3072899353,24cyclictest7850irq/56-dwc_otg_08:10:201
30728993516,5cyclictest14650-21latency_hist10:35:061
3073099349,11cyclictest0-21swapper/309:30:183
3073099347,5cyclictest7950irq/56-dwc_otg_08:00:073
3073099342,6cyclictest7850irq/56-dwc_otg_12:10:183
3072999347,24cyclictest0-21swapper/208:20:202
3072999345,11cyclictest7850irq/56-dwc_otg_07:50:282
30729993424,6cyclictest301ktimersoftd/207:40:182
3072899345,22cyclictest7750irq/56-dwc_otg11:20:061
30728993420,10cyclictest0-21swapper/110:05:361
30728993412,7cyclictest27623-21forks10:50:241
30728993412,7cyclictest27623-21forks10:50:241
3072899341,22cyclictest7071-21ls11:05:061
30728993410,7cyclictest16891-21/usr/sbin/munin11:55:231
3073099337,14cyclictest0-21swapper/308:30:193
30730993316,4cyclictest17312-21sh10:37:293
3073099331,5cyclictest0-21swapper/311:05:233
3073099331,19cyclictest3730-21latency_hist11:40:073
30730993311,4cyclictest0-21swapper/309:45:243
3072999339,5cyclictest7850irq/56-dwc_otg_12:20:252
30729993318,4cyclictest27339-21apt-get10:50:182
30729993318,4cyclictest27339-21apt-get10:50:182
30729993312,7cyclictest23846-21latency_hist11:25:072
30729993310,7cyclictest0-21swapper/211:50:352
3072899337,15cyclictest0-21swapper/109:00:191
3072899331,7cyclictest16796-21fschecks_time08:00:241
30728993310,8cyclictest0-21swapper/108:25:251
3073099327,15cyclictest0-21swapper/308:25:213
3073099322,13cyclictest7950irq/56-dwc_otg_09:35:213
30730993214,5cyclictest29578-21irqstats08:35:263
3073099321,22cyclictest28393-21ls10:50:343
3073099321,22cyclictest28393-21ls10:50:343
3072999328,4cyclictest0-21swapper/209:11:442
3072999327,16cyclictest0-21swapper/212:10:202
3072999327,11cyclictest0-21swapper/210:01:302
3072999325,19cyclictest0-21swapper/211:01:102
3072999321,20cyclictest2134-21ls09:40:252
30729993211,10cyclictest7950irq/56-dwc_otg_10:13:112
3072899326,16cyclictest0-21swapper/107:55:191
3072899325,13cyclictest7950irq/56-dwc_otg_08:30:311
3072899325,11cyclictest7950irq/56-dwc_otg_07:20:261
3073099316,14cyclictest23333-21runrttasks09:25:453
3073099316,14cyclictest0-21swapper/308:10:193
3073099312,5cyclictest31849-21perl10:55:233
3073099312,25cyclictest27127-21ls10:10:273
3073099312,18cyclictest7750irq/56-dwc_otg11:20:193
30730993120,9cyclictest7950irq/56-dwc_otg_11:55:163
30730993115,5cyclictest7190-21seq09:04:113
30730993113,4cyclictest5716-21sh10:23:593
30730993113,4cyclictest5716-21sh10:23:593
3072999317,5cyclictest31-21ksoftirqd/207:35:352
3072999317,15cyclictest0-21swapper/209:00:192
3072999316,10cyclictest0-21swapper/211:29:282
3072999314,13cyclictest7950irq/56-dwc_otg_08:05:222
3072999314,10cyclictest7950irq/56-dwc_otg_10:30:222
3072999314,10cyclictest7850irq/56-dwc_otg_08:35:242
3072999313,4cyclictest8819-21diskmemload11:45:272
3072999313,10cyclictest7850irq/56-dwc_otg_12:25:192
3072999312,8cyclictest0-21swapper/209:45:182
30729993113,4cyclictest1180-21runrttasks07:22:492
3072999311,23cyclictest16835-21idleruntime08:00:252
3072999311,20cyclictest15385-21timerandwakeup09:55:352
3072999311,16cyclictest3182-21memory10:20:272
3072999311,16cyclictest3182-21memory10:20:272
30729993111,4cyclictest0-21swapper/209:33:492
3072899313,3cyclictest0-21swapper/107:25:331
3072899313,3cyclictest0-21swapper/107:25:331
114592310,2sleep311460-21cat07:45:253
3073099309,14cyclictest0-21swapper/311:54:193
3073099305,8cyclictest39-21ksoftirqd/309:55:333
3073099303,13cyclictest7950irq/56-dwc_otg_11:12:373
3073099302,17cyclictest0-21swapper/307:25:213
3073099302,17cyclictest0-21swapper/307:25:213
30730993013,5cyclictest11139-21sh09:11:063
3073099301,12cyclictest7750irq/56-dwc_otg07:35:063
3072999308,4cyclictest7850irq/56-dwc_otg_09:25:202
3072999307,14cyclictest0-21swapper/208:25:212
3072999303,20cyclictest30207-21ssh09:35:202
3072999302,19cyclictest16760-21ssh11:55:202
3072899304,5cyclictest7750irq/56-dwc_otg10:55:281
3073099299,10cyclictest0-21swapper/310:00:563
3073099295,5cyclictest9577-21/usr/sbin/munin07:40:253
3072999297,14cyclictest0-21swapper/209:50:202
3072999297,14cyclictest0-21swapper/209:50:202
3072999296,4cyclictest32503-21idleruntime-cro08:45:062
3072999295,4cyclictest7750irq/56-dwc_otg11:45:072
3072899291,6cyclictest7706-21fschecks_count07:35:231
3073099289,12cyclictest11-21rcu_preempt10:05:183
3073099282,4cyclictest7950irq/56-dwc_otg_08:05:273
3073099281,5cyclictest0-21swapper/308:20:173
30729992816,6cyclictest7850irq/56-dwc_otg_11:15:492
295422285,13sleep30-21swapper/307:05:303
295422285,13sleep30-21swapper/307:05:303
3073099273,12cyclictest0-21swapper/308:57:573
3073099272,8cyclictest7766-21fschecks_time07:35:243
30729992717,5cyclictest12497-21dhclient-script07:48:472
3072999271,13cyclictest7750irq/56-dwc_otg07:25:282
3072999271,13cyclictest7750irq/56-dwc_otg07:25:282
3072899272,3cyclictest0-21swapper/108:45:381
303522273,15sleep10-21swapper/107:08:521
303522273,15sleep10-21swapper/107:08:521
302172273,14sleep20-21swapper/207:07:072
302172273,14sleep20-21swapper/207:07:072
30729992618,5cyclictest301ktimersoftd/208:55:172
30730992519,4cyclictest31024-21wget08:40:223
3073099251,5cyclictest0-21swapper/308:00:173
3072999254,12cyclictest7950irq/56-dwc_otg_07:30:102
3072999251,5cyclictest22302-21if_eth008:15:262
3072999251,5cyclictest22302-21if_eth008:15:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional