You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun Dec 21, 2025 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285122870,2sleep30-21swapper/310:05:303
238352870,2sleep10-21swapper/108:25:061
2901199822,39cyclictest23871-21sshd08:25:150
2901199797,69cyclictest0-21swapper/007:30:210
29011997824,32cyclictest0-21swapper/009:50:110
2901199763,58cyclictest0-21swapper/010:15:190
2901199737,14cyclictest0-21swapper/011:30:210
29011997314,37cyclictest0-21swapper/008:35:190
29011997131,34cyclictest0-21swapper/011:55:200
2901499707,26cyclictest0-21swapper/308:35:193
2901199684,48cyclictest0-21swapper/010:10:180
2901199684,45cyclictest0-21swapper/007:10:190
2901499677,40cyclictest0-21swapper/311:55:203
29011996635,13cyclictest15542-21aten_rbpower_cu12:30:200
2901399643,14cyclictest0-21swapper/209:40:172
2901399643,14cyclictest0-21swapper/209:40:172
2901199641,59cyclictest11857-21grep12:20:200
2901199631,33cyclictest32628-21ls11:45:320
29011996135,11cyclictest3250-21grep07:25:350
29011996111,28cyclictest9550irq/80-mmc010:50:060
29011996037,9cyclictest30208-21timerandwakeup08:40:320
29011996029,9cyclictest13509-21basename10:55:190
29011995939,10cyclictest101ktimersoftd/007:20:270
2901199592,44cyclictest0-21swapper/012:05:060
2901199585,5cyclictest7850irq/56-dwc_otg_08:45:180
29011995735,6cyclictest0-21swapper/010:30:060
2901199572,40cyclictest0-21swapper/010:20:340
2901199571,47cyclictest0-21swapper/007:48:000
97702560,2sleep20-21swapper/210:45:062
2901199563,49cyclictest101ktimersoftd/009:20:310
2901199561,40cyclictest16825-21fschecks_time08:05:230
2901199561,38cyclictest2602-21fschecks_count08:55:230
2901199561,38cyclictest2602-21fschecks_count08:55:230
2901199561,20cyclictest0-21swapper/009:55:190
2901199561,20cyclictest0-21swapper/009:55:190
29011995610,13cyclictest0-21swapper/007:15:160
2901499555,19cyclictest7850irq/56-dwc_otg_08:45:203
2901199557,38cyclictest18719-21wget09:40:200
2901199557,38cyclictest18719-21wget09:40:200
29011995535,8cyclictest0-21swapper/010:30:300
29011995535,8cyclictest0-21swapper/010:30:300
2901199553,30cyclictest23595-21grep11:20:340
29011995532,12cyclictest101ktimersoftd/012:05:200
29011995530,9cyclictest101ktimersoftd/011:15:240
29011995530,9cyclictest101ktimersoftd/011:15:240
2901199552,39cyclictest0-21swapper/012:18:400
2901199552,39cyclictest0-21swapper/012:18:400
2901199552,38cyclictest0-21swapper/010:42:100
29011995511,31cyclictest0-21swapper/011:50:340
2901299542,5cyclictest0-21swapper/112:20:171
29011995425,7cyclictest23236-21head08:20:350
2901199541,42cyclictest25844-21apt-get11:30:050
2901499533,8cyclictest0-21swapper/307:15:163
2901199533,37cyclictest635-21wget08:50:200
2901199533,37cyclictest635-21wget08:50:200
29011995328,3cyclictest0-21swapper/009:15:240
2901199532,40cyclictest0-21swapper/009:47:030
2901199531,39cyclictest13282-21aten_rbpower_po09:25:190
29014995210,16cyclictest7850irq/56-dwc_otg_09:10:183
29011995233,10cyclictest25933-21grep08:30:230
2901199522,33cyclictest20573-21fschecks_time08:15:230
2901199522,33cyclictest20573-21fschecks_time08:15:230
2901199521,39cyclictest5957-21/usr/sbin/munin09:05:240
2901199516,40cyclictest0-21swapper/009:10:190
2901199514,8cyclictest7950irq/56-dwc_otg_11:40:170
29011995133,9cyclictest0-21swapper/010:05:220
29011995126,6cyclictest17306-21fschecks_count11:05:230
2901199512,37cyclictest0-21swapper/011:00:340
2901199512,37cyclictest0-21swapper/010:35:240
2901199511,30cyclictest26159-21fschecks_count10:00:240
2901199502,32cyclictest0-21swapper/010:50:410
2901199501,39cyclictest0-21swapper/012:12:550
2901199501,32cyclictest0-21swapper/012:38:200
2901299492,11cyclictest0-21swapper/112:10:181
29012994914,22cyclictest0-21swapper/111:30:211
29011994931,9cyclictest0-21swapper/012:25:110
29011994930,4cyclictest7132-21runrttasks07:38:200
2901199492,37cyclictest0-21swapper/007:40:480
2901199492,37cyclictest0-21swapper/007:40:480
2901199492,35cyclictest0-21swapper/009:04:150
2901199492,34cyclictest0-21swapper/008:13:200
2901199491,37cyclictest0-21swapper/008:01:100
2901199491,33cyclictest11402-21fschecks_count07:50:230
2901199491,27cyclictest0-21swapper/009:35:290
2901399487,26cyclictest0-21swapper/210:45:192
2901199482,32cyclictest0-21swapper/007:55:330
2901499472,6cyclictest0-21swapper/310:45:193
2901399477,25cyclictest0-21swapper/208:15:122
2901399477,25cyclictest0-21swapper/208:15:122
2901399476,26cyclictest0-21swapper/208:00:182
2901399473,17cyclictest7950irq/56-dwc_otg_11:50:232
29011994729,8cyclictest0-21swapper/009:31:430
2901499464,7cyclictest7850irq/56-dwc_otg_07:45:193
29011994619,5cyclictest19550-21/usr/sbin/munin11:10:280
285082463,33sleep00-21swapper/007:07:120
29014994516,11cyclictest7850irq/56-dwc_otg_11:15:263
29014994516,11cyclictest7850irq/56-dwc_otg_11:15:263
29014994511,16cyclictest7950irq/56-dwc_otg_08:30:053
2901199451,32cyclictest28572-21sort11:35:280
2901499447,24cyclictest0-21swapper/312:00:213
2901499447,23cyclictest0-21swapper/311:30:113
2901499447,23cyclictest0-21swapper/307:30:213
2901399447,23cyclictest0-21swapper/209:20:192
2901299448,28cyclictest0-21swapper/112:25:101
2901299446,8cyclictest0-21swapper/108:45:191
2901299446,25cyclictest0-21swapper/110:05:211
2901299443,21cyclictest0-21swapper/110:00:181
277482448,25sleep227837-21/usr/sbin/munin07:05:282
2901499437,22cyclictest0-21swapper/309:55:223
2901499437,22cyclictest0-21swapper/309:55:223
2901499434,9cyclictest7950irq/56-dwc_otg_08:40:333
29014994315,11cyclictest5332-21ls10:30:333
29014994315,11cyclictest5332-21ls10:30:333
2901499427,23cyclictest0-21swapper/307:25:203
2901399426,22cyclictest0-21swapper/210:05:102
2901499417,20cyclictest0-21swapper/307:55:193
2901499413,10cyclictest0-21swapper/309:15:183
29014994118,4cyclictest7534-21apt07:40:173
29014994118,4cyclictest7534-21apt07:40:173
2901399417,23cyclictest0-21swapper/208:05:192
2901299419,17cyclictest0-21swapper/110:15:191
2901299415,26cyclictest7750irq/56-dwc_otg09:25:291
2901299415,23cyclictest7750irq/56-dwc_otg10:25:341
2901299413,28cyclictest7750irq/56-dwc_otg08:05:321
2901299411,5cyclictest7750irq/56-dwc_otg11:00:181
2901499403,13cyclictest0-21swapper/308:00:163
29014994016,10cyclictest7950irq/56-dwc_otg_09:00:053
29014994016,10cyclictest7950irq/56-dwc_otg_09:00:053
29014994011,11cyclictest21074-21ntp_kernel_pll_09:45:293
2901399406,25cyclictest0-21swapper/208:45:122
2901299401,25cyclictest7750irq/56-dwc_otg09:10:061
250802400,1sleep20-21swapper/211:25:312
29014993927,8cyclictest381ktimersoftd/308:20:183
29014993915,9cyclictest7750irq/56-dwc_otg12:30:233
2901399392,6cyclictest0-21swapper/208:30:192
2901299394,24cyclictest7750irq/56-dwc_otg10:20:201
29012993912,7cyclictest0-21swapper/107:30:201
2901499381,5cyclictest39-21ksoftirqd/308:30:233
29014993813,7cyclictest7750irq/56-dwc_otg07:20:283
2901399381,23cyclictest6642-21cut12:05:232
2901299386,8cyclictest0-21swapper/108:35:191
83432370,2sleep38342-21tune2fs10:40:243
2901399376,6cyclictest7750irq/56-dwc_otg09:55:192
2901399376,6cyclictest7750irq/56-dwc_otg09:55:192
2901399371,3cyclictest0-21swapper/212:35:352
29013993710,5cyclictest7750irq/56-dwc_otg08:25:152
29013993710,5cyclictest224162latency_hist11:20:072
29013993710,5cyclictest224162latency_hist11:20:072
2901299374,3cyclictest7750irq/56-dwc_otg08:10:311
2901299373,22cyclictest7750irq/56-dwc_otg10:45:231
29012993713,7cyclictest24033-21munin-plugin-st11:25:051
2901299371,28cyclictest17546-21cut12:35:231
2901299371,22cyclictest10896-21latency_hist07:50:061
2901299371,21cyclictest13765-21cut10:55:221
29012993710,10cyclictest7950irq/56-dwc_otg_10:10:261
2901499363,5cyclictest7950irq/56-dwc_otg_12:15:183
2901499363,5cyclictest7950irq/56-dwc_otg_12:15:183
2901499361,6cyclictest0-21swapper/308:15:173
2901499361,6cyclictest0-21swapper/308:15:173
29014993613,8cyclictest7850irq/56-dwc_otg_07:10:363
2901399366,5cyclictest0-21swapper/211:10:172
2901399362,17cyclictest7850irq/56-dwc_otg_10:10:202
29013993616,6cyclictest26430-21fschecks_count11:30:242
2901399361,21cyclictest2601-21cut08:55:232
2901399361,21cyclictest2601-21cut08:55:232
2901399361,20cyclictest26185-21cut10:00:242
2901299367,26cyclictest0-21swapper/109:40:191
2901299367,26cyclictest0-21swapper/109:40:191
2901299366,20cyclictest0-21swapper/111:10:181
2901299365,21cyclictest7750irq/56-dwc_otg12:30:341
41622351,2sleep20-21swapper/209:00:182
2901499358,10cyclictest7950irq/56-dwc_otg_11:15:063
2901499357,14cyclictest0-21swapper/311:45:193
2901499355,14cyclictest7950irq/56-dwc_otg_10:55:223
29014993513,6cyclictest7750irq/56-dwc_otg12:05:223
29013993514,4cyclictest23625-21sh08:25:052
29013993512,5cyclictest18351-21kworker/u8:112:20:062
29013993512,5cyclictest18351-21kworker/u8:112:20:062
2901299359,15cyclictest0-21swapper/111:40:191
2901299357,6cyclictest0-21swapper/109:45:211
2901299351,24cyclictest0-21swapper/109:22:411
29012993510,5cyclictest7750irq/56-dwc_otg07:20:221
2901499347,7cyclictest7950irq/56-dwc_otg_11:40:173
2901499345,14cyclictest7950irq/56-dwc_otg_09:40:223
2901499345,14cyclictest7950irq/56-dwc_otg_09:40:223
2901499344,16cyclictest7950irq/56-dwc_otg_12:25:113
29014993416,8cyclictest5957-21/usr/sbin/munin09:05:333
2901399347,5cyclictest28568-21grep08:35:332
2901399341,8cyclictest13584-21dpkg12:25:062
2901399341,23cyclictest2384-21uniq07:25:242
2901399341,23cyclictest19987-21ls08:15:062
2901299341,7cyclictest11057-21grep12:15:331
2901299341,7cyclictest11057-21grep12:15:331
2901299341,23cyclictest0-21swapper/109:55:261
2901299341,23cyclictest0-21swapper/109:55:261
249352340,1sleep30-21swapper/311:25:283
2901499338,16cyclictest7950irq/56-dwc_otg_11:03:523
2901499337,15cyclictest0-21swapper/309:25:193
2901499337,14cyclictest0-21swapper/309:50:193
2901499336,14cyclictest0-21swapper/310:50:213
2901499333,15cyclictest7950irq/56-dwc_otg_10:10:343
2901399338,6cyclictest7850irq/56-dwc_otg_11:20:232
2901399334,14cyclictest7850irq/56-dwc_otg_08:50:232
2901399334,14cyclictest7850irq/56-dwc_otg_08:50:232
2901399332,4cyclictest7850irq/56-dwc_otg_12:10:312
2901399331,23cyclictest5295-21switchtime10:30:332
2901399331,23cyclictest5295-21switchtime10:30:332
2901399331,22cyclictest4192-21fschecks_count07:30:242
2901299333,18cyclictest7750irq/56-dwc_otg11:25:211
29012993324,6cyclictest14056-21unixbench_multi07:55:331
2901299332,2cyclictest0-21swapper/111:05:201
2901299332,16cyclictest7950irq/56-dwc_otg_08:25:311
29012993312,5cyclictest16726-21latency_hist09:35:061
2901299331,23cyclictest3211-21switchtime08:55:331
2901299331,23cyclictest3211-21switchtime08:55:331
2901499323,15cyclictest7950irq/56-dwc_otg_10:05:053
29014993214,7cyclictest7750irq/56-dwc_otg11:23:273
2901499321,14cyclictest0-21swapper/310:20:333
2901399324,14cyclictest7850irq/56-dwc_otg_09:30:212
2901399323,19cyclictest0-21swapper/210:55:042
2901399323,14cyclictest7950irq/56-dwc_otg_11:05:212
2901399322,20cyclictest0-21swapper/211:35:162
2901399322,14cyclictest7850irq/56-dwc_otg_10:55:202
2901399321,14cyclictest7750irq/56-dwc_otg11:40:342
2901299327,4cyclictest7850irq/56-dwc_otg_08:50:301
2901299327,4cyclictest7850irq/56-dwc_otg_08:50:301
2901299327,22cyclictest0-21swapper/107:15:171
29012993215,8cyclictest7750irq/56-dwc_otg09:02:131
29012993213,6cyclictest30859-21idleruntime-cro08:45:051
29012993212,18cyclictest0-21swapper/107:35:191
2901499316,5cyclictest7750irq/56-dwc_otg09:34:473
2901499313,12cyclictest39-21ksoftirqd/311:06:343
2901499311,4cyclictest7950irq/56-dwc_otg_11:50:183
2901499311,21cyclictest11728-21missed_timers07:50:273
29014993111,10cyclictest1125-21runrttasks11:38:303
2901399317,5cyclictest0-21swapper/209:05:222
2901399316,6cyclictest7850irq/56-dwc_otg_07:35:302
2901399316,15cyclictest0-21swapper/211:00:192
2901399314,14cyclictest7950irq/56-dwc_otg_09:45:352
2901399313,5cyclictest17061-21munin-plugin-st12:35:052
2901399313,4cyclictest7850irq/56-dwc_otg_12:00:272
2901399312,8cyclictest1112-21fschecks_time10:20:232
29013993124,4cyclictest30891-21aten_rbpower_en07:15:182
29013993116,4cyclictest31502/usr/sbin/munin11:55:252
2901299319,9cyclictest7750irq/56-dwc_otg10:50:271
2901299319,6cyclictest0-21swapper/107:25:251
2901299317,12cyclictest6269-21latency_hist12:05:061
2901299315,4cyclictest0-21swapper/107:50:331
2901299315,14cyclictest7950irq/56-dwc_otg_10:35:221
2901299314,6cyclictest7850irq/56-dwc_otg_09:15:051
2901299312,5cyclictest6636-21cut12:05:231
29012993113,6cyclictest23-21ksoftirqd/109:15:321
2901299311,27cyclictest26197-21ls08:30:261
2901299311,18cyclictest30701-21ls07:15:061
2901299311,14cyclictest0-21swapper/111:15:231
2901299311,14cyclictest0-21swapper/111:15:231
2901499307,4cyclictest32526-21/usr/sbin/munin10:15:363
2901499307,20cyclictest0-21swapper/309:00:193
2901499304,11cyclictest539-21/usr/sbin/munin08:50:343
2901499304,11cyclictest539-21/usr/sbin/munin08:50:343
2901499304,11cyclictest39-21ksoftirqd/309:20:333
2901499301,19cyclictest18431-21wget08:10:193
2901399307,5cyclictest7850irq/56-dwc_otg_09:35:192
2901399306,4cyclictest31504-21wget10:15:222
2901399304,6cyclictest7850irq/56-dwc_otg_07:55:052
2901399302,16cyclictest0-21swapper/208:42:422
29013993012,6cyclictest128-21systemd-journal09:29:462
2901399301,14cyclictest7950irq/56-dwc_otg_12:25:322
2901299307,21cyclictest0-21swapper/110:30:201
2901299307,21cyclictest0-21swapper/110:30:201
2901299306,7cyclictest23-21ksoftirqd/110:41:071
2901299305,12cyclictest7950irq/56-dwc_otg_07:40:331
2901299305,12cyclictest7950irq/56-dwc_otg_07:40:331
2901299304,13cyclictest17491-21ntp_states09:35:291
2901299301,17cyclictest2556-21ls11:55:061
2901499295,10cyclictest7950irq/56-dwc_otg_09:40:043
2901499291,2cyclictest0-21swapper/312:35:173
2901399296,13cyclictest0-21swapper/209:50:112
2901399295,4cyclictest7850irq/56-dwc_otg_09:17:052
2901399291,5cyclictest0-21swapper/209:13:152
2901399291,4cyclictest32718-21grep11:45:332
2901299297,15cyclictest0-21swapper/109:50:111
2901299296,21cyclictest0-21swapper/108:15:111
2901299296,21cyclictest0-21swapper/108:15:111
2901299293,20cyclictest21-21rcuc/111:55:181
2901299292,18cyclictest0-21swapper/108:02:161
29012992921,5cyclictest28231-21fschecks_count11:35:241
286332293,15sleep10-21swapper/107:08:511
283962298,14sleep30-21swapper/307:05:453
2901499286,12cyclictest37-21rcuc/312:13:473
29014992814,7cyclictest7791-21idleruntime-cro10:40:053
2901399285,10cyclictest7850irq/56-dwc_otg_10:35:272
2901399283,5cyclictest7850irq/56-dwc_otg_10:25:262
29013992822,4cyclictest8389-21ls07:40:322
29013992822,4cyclictest8389-21ls07:40:322
2901299281,18cyclictest7850irq/56-dwc_otg_11:45:291
2901399272,12cyclictest7850irq/56-dwc_otg_07:10:322
2901399271,6cyclictest1264-21grep07:20:322
2901499264,8cyclictest7950irq/56-dwc_otg_08:06:453
2901499263,11cyclictest1124-21snmpd12:20:193
2901499262,10cyclictest7950irq/56-dwc_otg_07:38:193
2901499261,12cyclictest2676-21wget10:25:203
2901399261,6cyclictest14095-21unixbench_singl07:55:342
2901399261,13cyclictest9529-21ls07:45:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional