You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System (updated Thu Mar 26, 2026 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1747721110,2sleep00-21swapper/007:20:330
1305299995,74cyclictest0-21swapper/007:10:130
1305299991,52cyclictest0-21swapper/011:10:380
1305299991,52cyclictest0-21swapper/011:10:380
1305299946,71cyclictest17215-21ls08:50:280
1305299796,63cyclictest0-21swapper/010:10:220
13052997913,37cyclictest0-21swapper/008:20:380
13052997913,37cyclictest0-21swapper/008:20:380
13052997814,46cyclictest3046-21unixbench_multi11:15:380
13052997613,33cyclictest11650-21unixbench_singl11:25:380
264832740,2sleep30-21swapper/309:11:583
13052997460,5cyclictest7850irq/56-dwc_otg_09:45:220
29482710,2sleep30-21swapper/309:22:333
179842710,2sleep30-21swapper/309:40:283
161832710,2sleep10-21swapper/109:38:131
130762710,12sleep21306599cyclictest07:10:132
13061997142,4cyclictest27549-21sh11:45:211
30962700,2sleep30-21swapper/311:54:473
1305299702,54cyclictest0-21swapper/008:40:090
1305299702,31cyclictest0-21swapper/009:50:240
1305299696,21cyclictest20794-21ssh12:15:160
13052996924,5cyclictest0-21swapper/010:35:200
1305299682,54cyclictest0-21swapper/007:55:370
1305299682,54cyclictest0-21swapper/007:55:370
13052996824,28cyclictest9209-21unixbench_singl12:00:380
1305299681,48cyclictest25405-21fschecks_count12:20:250
1305299681,48cyclictest25405-21fschecks_count12:20:250
1305299673,52cyclictest18887-21aten_rbpower_vo08:55:240
1305299671,53cyclictest0-21swapper/010:45:250
13052996711,41cyclictest0-21swapper/010:20:350
13052996627,22cyclictest0-21swapper/009:40:220
13052996524,21cyclictest18637-21wget07:25:230
1305299642,45cyclictest0-21swapper/007:30:370
13052996415,37cyclictest16803-21fschecks_count12:10:280
1305299641,50cyclictest26020-21cut11:05:340
1305299632,39cyclictest0-21swapper/007:40:340
272352620,2sleep10-21swapper/109:50:371
1305299622,49cyclictest22933-21modprobe11:40:100
1305299621,45cyclictest0-21swapper/008:10:270
13061996029,11cyclictest7850irq/56-dwc_otg_09:20:231
1305299607,38cyclictest13076-21fschecks_count10:50:290
13052996018,32cyclictest9550irq/80-mmc009:30:100
128402600,11sleep0101ktimersoftd/007:10:110
312102590,3sleep10-21swapper/108:00:231
1305299592,28cyclictest0-21swapper/012:25:220
13052995917,35cyclictest6089-21rm10:41:470
1305299591,44cyclictest28036-21cat07:50:290
13052995911,37cyclictest1437-21/usr/sbin/munin09:20:350
1307199581,29cyclictest0-21swapper/309:55:243
1305299589,9cyclictest0-21swapper/009:35:190
13052995832,5cyclictest9450irq/48-DMA09:12:250
13052995830,13cyclictest7950irq/56-dwc_otg_11:35:100
1305299582,45cyclictest25526-21ssh09:10:360
13052995818,27cyclictest0-21swapper/009:15:390
1305299581,45cyclictest0-21swapper/008:25:230
1305299581,44cyclictest16187-21grep08:45:370
106452570,2sleep30-21swapper/309:31:023
1305299562,38cyclictest0-21swapper/010:15:300
1305299552,24cyclictest0-21swapper/012:05:350
1305299551,7cyclictest28835-21unixbench_singl11:45:390
1305299551,25cyclictest29285-21grep10:30:390
1305299546,39cyclictest17710-21ls10:55:300
13052995440,4cyclictest7850irq/56-dwc_otg_11:55:090
13052995427,13cyclictest0-21swapper/009:00:200
1305299541,45cyclictest0-21swapper/008:15:240
1305299541,36cyclictest0-21swapper/007:15:350
1305299541,36cyclictest0-21swapper/007:15:350
13052995413,33cyclictest0-21swapper/010:25:280
13061995320,4cyclictest23-21ksoftirqd/108:10:211
1305299531,8cyclictest21616-21fschecks_count11:00:260
1305299531,45cyclictest0-21swapper/009:56:070
1305299531,39cyclictest12747-21sh09:34:420
1305299531,37cyclictest0-21swapper/012:30:190
1306599524,19cyclictest17659-21ssh09:40:222
13061995217,9cyclictest7950irq/56-dwc_otg_07:10:131
13052995231,12cyclictest7850irq/56-dwc_otg_11:25:100
13052995227,5cyclictest7850irq/56-dwc_otg_11:45:100
13052995211,8cyclictest9450irq/48-DMA09:12:250
1305299518,29cyclictest0-21swapper/012:35:240
1305299511,8cyclictest3791-21wget11:55:230
1307199496,27cyclictest12237-21sh12:05:233
1305299492,44cyclictest101ktimersoftd/010:05:240
13052994912,24cyclictest0-21swapper/009:05:220
1306199488,31cyclictest7950irq/56-dwc_otg_10:05:201
1306199487,25cyclictest0-21swapper/109:30:251
1306599477,26cyclictest28028-21ssh10:30:242
1306599477,25cyclictest0-21swapper/209:25:212
13065994723,5cyclictest16982-21if_wlan012:10:292
1306199476,26cyclictest149-21systemd-journal08:35:231
1306199474,3cyclictest0-21swapper/107:20:221
13061994722,6cyclictest908-21runrttasks11:05:371
1307199467,24cyclictest0-21swapper/308:20:233
1307199467,24cyclictest0-21swapper/308:20:233
13071994629,13cyclictest37-21rcuc/309:00:203
1306599467,24cyclictest0-21swapper/209:05:222
1306199467,25cyclictest0-21swapper/111:35:161
1306199462,9cyclictest0-21swapper/107:15:221
1306199462,9cyclictest0-21swapper/107:15:221
1306599457,25cyclictest0-21swapper/208:50:232
1306199457,23cyclictest0-21swapper/107:45:231
1306199453,8cyclictest7750irq/56-dwc_otg11:40:211
1306199451,7cyclictest7950irq/56-dwc_otg_07:25:201
1306199451,6cyclictest0-21swapper/107:40:211
1305299451,33cyclictest434250ssh10:01:500
1307199447,24cyclictest0-21swapper/307:35:233
1306599446,25cyclictest0-21swapper/207:15:242
1306599446,25cyclictest0-21swapper/207:15:242
1306599445,10cyclictest0-21swapper/210:35:202
1306199449,23cyclictest0-21swapper/108:15:151
1306199447,25cyclictest0-21swapper/108:55:151
13061994434,7cyclictest0-21swapper/108:20:221
13061994434,7cyclictest0-21swapper/108:20:221
1305299442,25cyclictest0-21swapper/008:45:040
1307199433,4cyclictest7950irq/56-dwc_otg_11:30:223
1306599436,24cyclictest0-21swapper/207:25:222
1306599435,24cyclictest10885-21ssh10:10:222
13065994319,5cyclictest25148-21sh12:20:212
13065994319,5cyclictest25148-21sh12:20:212
13061994312,11cyclictest7850irq/56-dwc_otg_07:55:201
13061994312,11cyclictest7850irq/56-dwc_otg_07:55:201
319422420,4sleep225023-1kworker/u9:111:50:232
1307199424,4cyclictest7950irq/56-dwc_otg_09:25:203
13071994214,8cyclictest0-21swapper/309:51:263
1306199426,29cyclictest19465-21ssh10:20:221
13061994217,11cyclictest7850irq/56-dwc_otg_10:02:471
1305299421,22cyclictest0-21swapper/007:35:200
1307199417,25cyclictest0-21swapper/307:10:233
1307199412,8cyclictest7950irq/56-dwc_otg_07:30:223
13071994110,7cyclictest7950irq/56-dwc_otg_10:05:213
1306599417,24cyclictest0-21swapper/209:45:252
1306599417,23cyclictest0-21swapper/212:15:152
13065994118,9cyclictest12465-21latency_hist10:50:112
1306599411,25cyclictest0-21swapper/208:15:162
1305299418,14cyclictest26847-21unixbench_multi07:45:380
13071994020,7cyclictest39-21ksoftirqd/308:05:193
13065994016,4cyclictest7850irq/56-dwc_otg_10:15:212
1306199405,16cyclictest221ktimersoftd/108:45:301
13061994014,9cyclictest7950irq/56-dwc_otg_12:39:201
13061994013,12cyclictest7750irq/56-dwc_otg11:21:341
1307199397,23cyclictest0-21swapper/310:40:233
1307199397,22cyclictest0-21swapper/310:50:243
1307199396,15cyclictest7850irq/56-dwc_otg_10:30:393
1306599397,25cyclictest0-21swapper/211:10:222
1306599397,25cyclictest0-21swapper/211:10:222
1306599397,23cyclictest0-21swapper/211:15:232
1306599396,22cyclictest14218-21ls08:40:352
1306199395,15cyclictest7950irq/56-dwc_otg_09:15:091
13061993923,8cyclictest7750irq/56-dwc_otg10:45:371
13061993910,13cyclictest29986-21basename11:10:241
13061993910,13cyclictest29986-21basename11:10:241
1307199387,26cyclictest0-21swapper/308:15:153
1307199386,25cyclictest0-21swapper/312:00:233
1307199381,25cyclictest1046-21ls12:30:103
13065993820,9cyclictest26631-21sh09:12:142
13065993818,11cyclictest18789-21latency_hist11:35:112
13061993824,5cyclictest7850irq/56-dwc_otg_11:32:421
1306199381,7cyclictest24813-21munin-run12:20:101
13061993815,12cyclictest7950irq/56-dwc_otg_10:39:561
13061993813,11cyclictest221ktimersoftd/112:05:571
13061993810,7cyclictest0-21swapper/110:50:211
13052993811,4cyclictest0-21swapper/008:00:200
13071993716,6cyclictest30900-21sh11:10:363
13071993716,6cyclictest30900-21sh11:10:363
1306599371,5cyclictest30471-21/usr/sbin/munin09:55:252
1306599371,4cyclictest7750irq/56-dwc_otg07:45:212
13065993713,4cyclictest27706-21latency_hist10:30:102
1306599371,28cyclictest2713-21ls10:00:272
1306199379,13cyclictest7750irq/56-dwc_otg12:25:101
1306199379,13cyclictest7750irq/56-dwc_otg12:25:101
1306199375,4cyclictest7750irq/56-dwc_otg09:40:281
1306199374,16cyclictest4388-21ssh12:33:481
1306199372,18cyclictest8202-21entropy12:00:261
13061993713,8cyclictest7850irq/56-dwc_otg_10:17:251
13061993712,8cyclictest7950irq/56-dwc_otg_11:55:191
1307199365,28cyclictest7950irq/56-dwc_otg_12:15:203
13071993614,11cyclictest7750irq/56-dwc_otg10:25:253
1307199361,3cyclictest7850irq/56-dwc_otg_11:20:203
13071993611,5cyclictest0-21swapper/311:55:233
1306199366,15cyclictest0-21swapper/109:55:241
1306199366,10cyclictest7850irq/56-dwc_otg_08:50:231
13061993615,9cyclictest7950irq/56-dwc_otg_11:27:341
13061993615,9cyclictest221ktimersoftd/109:17:321
1306199361,3cyclictest7750irq/56-dwc_otg10:40:291
13061993612,4cyclictest7850irq/56-dwc_otg_10:25:301
13061993612,4cyclictest2772-21switchtime11:15:361
1306199361,23cyclictest13527-21cut08:40:251
13061993612,11cyclictest7850irq/56-dwc_otg_11:04:511
1306199361,17cyclictest473-21rm11:50:371
1306199361,16cyclictest7950irq/56-dwc_otg_12:25:341
1306199361,11cyclictest0-21swapper/109:45:421
191202350,1sleep20-21swapper/210:56:572
1307199353,16cyclictest7950irq/56-dwc_otg_09:45:363
1307199353,10cyclictest0-21swapper/308:25:233
13071993516,5cyclictest20944-21sh11:00:073
13071993512,4cyclictest0-21swapper/309:19:223
1307199351,22cyclictest8770-21uniq10:45:283
13065993525,7cyclictest9241-21ssh12:00:392
1306599351,23cyclictest19026-21ssh11:35:232
1306199354,11cyclictest23-21ksoftirqd/110:14:121
13061993515,13cyclictest7950irq/56-dwc_otg_09:08:111
1306199351,20cyclictest1380-21cat08:05:341
1306199351,11cyclictest23269-21grep07:35:371
1307199341,29cyclictest19009-21cut08:55:263
1306599347,18cyclictest24423-21ssh11:03:442
1306599344,4cyclictest0-21swapper/211:45:382
1306599343,3cyclictest0-21swapper/210:54:512
13065993420,4cyclictest28662-21sh09:52:382
13065993417,6cyclictest29265-21sed09:15:312
1306599341,5cyclictest0-21swapper/211:58:592
1306599341,4cyclictest0-21swapper/212:36:522
13065993412,5cyclictest31405-21sh12:26:472
1306199346,10cyclictest23-21ksoftirqd/112:11:261
1306199345,12cyclictest7850irq/56-dwc_otg_08:30:271
1306199341,5cyclictest7950irq/56-dwc_otg_07:50:221
1306199341,13cyclictest23-21ksoftirqd/110:31:081
1307199339,15cyclictest0-21swapper/311:45:213
1307199338,15cyclictest0-21swapper/308:45:223
1307199337,14cyclictest0-21swapper/311:35:163
1307199336,12cyclictest7850irq/56-dwc_otg_08:35:243
1307199331,5cyclictest1347650wget09:35:223
13071993315,5cyclictest15137-21/usr/sbin/munin10:15:283
13071993314,5cyclictest10933-21basename10:10:233
1306599339,15cyclictest0-21swapper/211:20:282
1306599339,14cyclictest9450irq/48-DMA09:12:252
1306599336,6cyclictest31-21ksoftirqd/207:55:352
1306599336,6cyclictest31-21ksoftirqd/207:55:352
1306599334,11cyclictest7850irq/56-dwc_otg_08:10:092
1306599332,7cyclictest606-21ssh09:20:242
1306599332,24cyclictest0-21swapper/208:04:462
1306599331,24cyclictest0-21swapper/212:34:472
13065993312,10cyclictest23942-21diskmemload11:44:352
1306599331,12cyclictest7950irq/56-dwc_otg_09:35:222
1306199332,4cyclictest7950irq/56-dwc_otg_07:30:201
13061993315,4cyclictest7950irq/56-dwc_otg_09:26:051
1307199325,18cyclictest7850irq/56-dwc_otg_10:20:353
13071993214,11cyclictest21247-21ssh11:00:153
1306599326,10cyclictest7950irq/56-dwc_otg_12:07:232
1306599322,21cyclictest11973-21runrttasks09:33:212
1306599321,23cyclictest20486-21timerandwakeup10:20:372
1306599321,21cyclictest0-21swapper/211:30:102
13065993212,13cyclictest36032chrt08:11:432
13065993212,12cyclictest5286-21unixbench-2d10:40:382
1306599321,18cyclictest7850irq/56-dwc_otg_07:35:102
1306199321,10cyclictest221ktimersoftd/110:56:471
121372324,17sleep312264-21grep07:05:373
115272325,16sleep211141-21/usr/sbin/munin07:05:282
1307199316,15cyclictest0-21swapper/307:40:223
1307199315,5cyclictest5217-21sh10:03:223
1307199315,14cyclictest7850irq/56-dwc_otg_12:20:243
1307199315,14cyclictest7850irq/56-dwc_otg_12:20:243
1307199314,6cyclictest23255-21/usr/sbin/munin11:40:353
1307199314,5cyclictest7750irq/56-dwc_otg08:00:263
1307199314,12cyclictest7850irq/56-dwc_otg_07:50:303
13071993122,7cyclictest7950irq/56-dwc_otg_11:05:143
1307199311,19cyclictest17297-21ls07:20:303
13071993110,5cyclictest0-21swapper/312:10:233
1306599316,7cyclictest28017-21kernelversion07:50:292
1306599315,4cyclictest7943-21/usr/sbin/munin08:25:242
1306599314,5cyclictest26446-21ntp_states11:05:402
1306599314,15cyclictest7750irq/56-dwc_otg07:40:232
13065993116,5cyclictest7725-21timerwakeupswit10:05:362
1306199311,10cyclictest0-21swapper/108:29:531
1307199309,3cyclictest0-21swapper/310:39:063
1307199307,4cyclictest0-21swapper/312:38:383
1307199302,5cyclictest39-21ksoftirqd/311:15:403
1307199302,20cyclictest0-21swapper/307:28:433
1307199302,19cyclictest0-21swapper/307:56:503
1307199302,19cyclictest0-21swapper/307:56:503
1307199301,14cyclictest7950irq/56-dwc_otg_07:45:223
1306599301,4cyclictest22136-21apt-get07:35:212
1307199296,14cyclictest0-21swapper/312:30:243
1307199295,5cyclictest7950irq/56-dwc_otg_08:40:223
1307199293,5cyclictest10960-21/usr/sbin/munin11:25:303
1307199292,19cyclictest0-21swapper/308:52:073
13065992923,4cyclictest7612-21sh08:25:092
13065992923,4cyclictest7612-21sh08:25:092
1306599291,7cyclictest0-21swapper/209:05:102
13065992912,9cyclictest16013-21timerandwakeup08:45:352
1306199291,15cyclictest7750irq/56-dwc_otg09:00:251
1307199282,18cyclictest0-21swapper/308:33:513
1306599282,23cyclictest17605-21ls07:20:352
1306599281,5cyclictest18984-21df_inode08:55:252
1307199274,6cyclictest1913-21kworker/3:008:10:383
1307199271,5cyclictest15600-21ntp_states07:15:333
1307199271,5cyclictest15600-21ntp_states07:15:333
1307199271,18cyclictest0-21swapper/309:05:123
1306599271,17cyclictest0-21swapper/208:32:352
124252263,14sleep10-21swapper/107:06:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional