You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 21:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Tue Mar 17, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1432421170,5sleep01971699cyclictest09:28:400
19716991077,58cyclictest30501-21diskmemload09:50:160
326072960,2sleep10-21swapper/111:07:251
149532950,2sleep20-21swapper/210:07:112
138552930,11sleep00-21swapper/010:05:320
1971699841,46cyclictest0-21swapper/010:00:150
19716998220,5cyclictest26445-21unixbench_singl10:20:310
89962810,2sleep10-21swapper/109:21:491
32532810,6sleep31971999cyclictest11:50:223
7682790,2sleep30-21swapper/307:45:303
19716997920,4cyclictest23925-21df12:15:200
313962780,3sleep20-21swapper/207:40:302
19716997822,5cyclictest30336-21wget11:05:190
1971699772,20cyclictest15845-21fschecks_time09:30:220
181632710,7sleep218166-21fschecks_count07:05:212
1971699696,25cyclictest19360-21ssh12:10:060
1971699696,25cyclictest19360-21ssh12:10:060
1971699691,36cyclictest0-21swapper/012:25:190
19716996831,14cyclictest7850irq/56-dwc_otg_07:15:190
19716996719,31cyclictest0-21swapper/007:10:070
1971699668,30cyclictest8009-21taskset12:35:180
196372660,4sleep10-21swapper/107:10:061
1971699658,5cyclictest0-21swapper/010:50:180
19716996514,10cyclictest0-21swapper/008:10:170
309142640,2sleep10-21swapper/110:26:021
309142640,2sleep10-21swapper/110:26:021
23432640,2sleep30-21swapper/311:10:213
19717996413,24cyclictest2019-21sh11:10:111
231762630,2sleep00-21swapper/010:17:030
1971699617,30cyclictest0-21swapper/011:30:170
1971699617,30cyclictest0-21swapper/011:30:170
1971699616,22cyclictest0-21swapper/011:10:100
1971699611,33cyclictest15280-21sh11:25:290
1971699609,32cyclictest0-21swapper/012:30:520
1971699609,26cyclictest3913-21unixbench_multi09:15:330
19716996038,9cyclictest0-21swapper/008:20:210
1971699602,47cyclictest0-21swapper/010:25:330
1971699602,47cyclictest0-21swapper/010:25:330
19716996023,7cyclictest0-21swapper/007:35:170
19716996010,25cyclictest0-21swapper/010:40:250
1971699598,34cyclictest7850irq/56-dwc_otg_09:10:180
1971699581,26cyclictest0-21swapper/008:35:180
1971699581,26cyclictest0-21swapper/008:35:180
75692570,2sleep30-21swapper/308:05:233
19716995710,3cyclictest0-21swapper/008:55:190
1971699561,32cyclictest23757-21fschecks_time08:50:200
1971699559,20cyclictest17171-21fschecks_count10:10:210
1971699555,41cyclictest11874-21unixbench_multi08:15:330
19716995528,12cyclictest7850irq/56-dwc_otg_07:20:320
1971699552,32cyclictest31340-21grep07:40:300
1971699551,30cyclictest61-21kswapd010:35:040
1971699551,30cyclictest14049-21uniq10:45:220
1971699551,26cyclictest0-21swapper/011:20:260
1971699542,30cyclictest0-21swapper/012:10:180
75642531,2sleep00-21swapper/010:37:300
1971899533,32cyclictest0-21swapper/207:10:072
1971699539,14cyclictest0-21swapper/011:45:240
1971699534,5cyclictest28019-21cut12:20:170
1971699534,5cyclictest28019-21cut12:20:170
1971699533,26cyclictest28407-21kworker/u8:009:10:050
19716995331,5cyclictest7850irq/56-dwc_otg_11:00:180
1971699532,26cyclictest0-21swapper/007:30:300
19716995322,5cyclictest0-21swapper/012:00:180
1971799526,6cyclictest0-21swapper/111:00:331
19717995228,6cyclictest32220-21latency_hist09:50:051
1971699522,28cyclictest0-21swapper/011:15:190
19716995220,8cyclictest7850irq/56-dwc_otg_09:35:220
1971699521,23cyclictest23207-21uniq11:35:210
131792520,1sleep10-21swapper/110:44:581
19716995128,6cyclictest7850irq/56-dwc_otg_08:05:260
1971699512,28cyclictest7924-21sh09:20:310
19716995117,15cyclictest1091-21unixbench_singl07:45:330
1971999503,8cyclictest0-21swapper/307:40:163
19719995010,8cyclictest7950irq/56-dwc_otg_11:40:183
1971799507,30cyclictest5200-21ssh10:35:171
1971699504,9cyclictest0-21swapper/011:40:180
19716995035,7cyclictest0-21swapper/010:00:050
19716995024,7cyclictest0-21swapper/010:55:170
19716995024,7cyclictest0-21swapper/010:55:170
19716995021,15cyclictest3808-21cut07:55:210
19716995018,17cyclictest0-21swapper/008:30:300
1971799499,27cyclictest0-21swapper/107:10:071
19716994921,4cyclictest22465-21cat08:45:310
1971699491,15cyclictest7912-21ssh11:55:290
191572483,14sleep00-21swapper/007:06:300
1971999478,26cyclictest0-21swapper/312:20:113
1971999478,26cyclictest0-21swapper/312:20:113
1971699471,8cyclictest2876-21grep07:50:320
19716994717,19cyclictest0-21swapper/009:40:150
1971799466,25cyclictest0-21swapper/108:55:101
1971799463,8cyclictest7950irq/56-dwc_otg_11:40:191
1971699463,20cyclictest9-21ksoftirqd/008:00:240
1971699461,22cyclictest0-21swapper/009:45:290
1971799457,24cyclictest0-21swapper/108:35:181
1971799457,24cyclictest0-21swapper/108:35:181
1971799457,23cyclictest0-21swapper/109:35:181
241062440,3sleep30-21swapper/310:18:443
1971699449,17cyclictest26252-21grep07:25:340
1971699442,23cyclictest4155-21unixbench_singl11:50:340
19716994414,16cyclictest28272-21grep09:00:330
1971899437,5cyclictest7850irq/56-dwc_otg_10:35:212
1971899435,4cyclictest7850irq/56-dwc_otg_11:45:182
251762420,3sleep125179-21aten_rbpower_cu07:25:201
1971999426,22cyclictest31205-21ssh11:45:183
1971899427,23cyclictest0-21swapper/212:20:112
1971899427,23cyclictest0-21swapper/212:20:112
19717994223,4cyclictest908-21runrttasks10:05:281
184012421,36sleep218408-21sh12:08:382
184012421,36sleep218408-21sh12:08:382
167602420,1sleep30-21swapper/311:27:163
1971899418,18cyclictest0-21swapper/211:10:112
1971899416,23cyclictest0-21swapper/210:50:182
320572400,9sleep2301ktimersoftd/211:06:252
19719994017,10cyclictest7950irq/56-dwc_otg_10:45:093
19719994016,5cyclictest22633-21sh09:38:163
1971899407,23cyclictest0-21swapper/211:50:182
19718994017,6cyclictest26455-21fschecks_time11:00:222
19718994015,12cyclictest7950irq/56-dwc_otg_12:00:312
1971799405,23cyclictest0-21swapper/111:55:111
1971799401,20cyclictest24851-21kworker/u8:112:10:161
1971699406,24cyclictest0-21swapper/008:25:200
1971699405,20cyclictest9-21ksoftirqd/008:40:240
1971999394,5cyclictest23508-21latency_hist12:15:053
1971999393,13cyclictest0-21swapper/307:10:073
1971999391,5cyclictest0-21swapper/308:15:183
19719993912,4cyclictest7950irq/56-dwc_otg_07:30:183
1971899397,24cyclictest0-21swapper/212:15:182
19718993917,5cyclictest6919-21cron08:05:052
19717993919,5cyclictest17773-21processes10:10:291
19717993910,15cyclictest0-21swapper/109:25:241
1971999389,14cyclictest7950irq/56-dwc_otg_11:55:343
1971999383,28cyclictest7950irq/56-dwc_otg_08:00:163
19718993813,10cyclictest7950irq/56-dwc_otg_07:25:282
19717993819,5cyclictest17800-21/usr/sbin/munin10:50:201
1971999377,19cyclictest688-21kworker/u8:310:40:113
1971999377,14cyclictest7950irq/56-dwc_otg_11:10:053
1971999376,5cyclictest29623-21ntpq09:05:273
1971999373,13cyclictest39-21ksoftirqd/310:20:173
1971999371,4cyclictest7950irq/56-dwc_otg_08:25:283
1971899376,4cyclictest7950irq/56-dwc_otg_10:30:162
1971799377,10cyclictest0-21swapper/110:58:581
1971799377,10cyclictest0-21swapper/110:58:581
1971799374,4cyclictest7750irq/56-dwc_otg10:00:141
1971799371,8cyclictest0-21swapper/109:10:181
19717993716,6cyclictest27642-21apt-config12:20:051
1971799371,26cyclictest0-21swapper/107:40:181
1971799371,21cyclictest23677-21cut08:50:191
173282370,8sleep2301ktimersoftd/209:31:282
19719993629,5cyclictest12425-21idleruntime-cro10:05:053
1971999361,6cyclictest0-21swapper/309:45:183
1971999361,25cyclictest4470-21timerandwakeup07:55:313
19719993611,20cyclictest15422-21ssh12:05:183
19719993611,20cyclictest15422-21ssh12:05:183
1971899361,5cyclictest1956050ssh12:10:182
19718993615,4cyclictest635-21sh10:30:002
19718993615,4cyclictest635-21sh10:30:002
19718993614,9cyclictest17203-21fschecks_count10:10:212
1971899361,23cyclictest11332-21switchtime11:20:302
1971799362,15cyclictest0-21swapper/109:03:071
19717993614,5cyclictest31308-21/usr/sbin/munin11:45:191
19717993610,5cyclictest0-21swapper/109:55:191
1971999354,18cyclictest23268-21grep10:55:353
1971999354,18cyclictest23268-21grep10:55:353
1971999353,13cyclictest7950irq/56-dwc_otg_07:35:333
19719993515,13cyclictest381ktimersoftd/309:51:563
19719993512,5cyclictest27499-21ssh12:20:053
1971999351,24cyclictest18964-21timerwakeupswit10:50:323
1971999351,21cyclictest22470-21ls08:45:313
1971999351,21cyclictest18187-21ls08:35:193
1971999351,21cyclictest18187-21ls08:35:193
1971999351,19cyclictest5004-21ls10:35:053
1971899355,14cyclictest7950irq/56-dwc_otg_09:45:252
1971899351,8cyclictest0-21swapper/207:45:162
19718993518,4cyclictest908-21runrttasks11:55:272
19718993516,5cyclictest9522-21sh12:36:032
1971899351,23cyclictest26257-21ls08:55:342
19718993510,12cyclictest0-21swapper/211:37:012
1971799359,7cyclictest9450irq/48-DMA09:12:251
1971799357,15cyclictest0-21swapper/111:20:181
1971799357,15cyclictest0-21swapper/108:10:191
1971799355,15cyclictest7750irq/56-dwc_otg12:35:181
1971799354,14cyclictest7850irq/56-dwc_otg_07:55:311
1971799353,24cyclictest685-21proc_pri07:45:291
1971799352,16cyclictest0-21swapper/109:51:261
19717993517,4cyclictest908-21runrttasks12:30:131
19717993516,4cyclictest908-21runrttasks10:15:541
1971799351,11cyclictest0-21swapper/108:20:301
19717993511,11cyclictest30501-21diskmemload11:50:221
1971999347,5cyclictest37-21rcuc/307:18:443
1971999347,4cyclictest7950irq/56-dwc_otg_10:25:193
1971999347,4cyclictest7950irq/56-dwc_otg_10:25:193
1971999347,15cyclictest0-21swapper/310:05:283
1971999346,13cyclictest7950irq/56-dwc_otg_07:25:333
19719993412,10cyclictest0-21swapper/311:15:163
1971899349,6cyclictest7950irq/56-dwc_otg_07:15:322
1971899348,14cyclictest7950irq/56-dwc_otg_09:40:282
1971899347,15cyclictest0-21swapper/210:40:102
19718993424,7cyclictest22462-21apt-get11:35:052
19718993424,7cyclictest22462-21apt-get11:35:052
1971899341,23cyclictest0-21swapper/211:27:102
1971899341,16cyclictest18980-21grep08:35:312
1971899341,16cyclictest18980-21grep08:35:312
1971799347,7cyclictest9450irq/48-DMA09:12:251
19717993426,5cyclictest22757-21unixbench_singl08:45:331
19717993421,6cyclictest18691-21ssh12:09:101
19717993421,6cyclictest18691-21ssh12:09:101
1971799341,21cyclictest11286-21ssh12:00:181
145552340,1sleep10-21swapper/108:25:211
1971999337,22cyclictest0-21swapper/309:20:183
1971999335,14cyclictest7950irq/56-dwc_otg_08:45:053
1971999334,3cyclictest7950irq/56-dwc_otg_09:15:303
1971999333,14cyclictest7950irq/56-dwc_otg_07:20:193
19719993314,4cyclictest21302-21sh11:32:593
19719993314,4cyclictest21302-21sh11:32:593
1971999331,17cyclictest24015-21ssh09:40:163
1971999331,14cyclictest7950irq/56-dwc_otg_08:10:343
1971899336,14cyclictest7950irq/56-dwc_otg_09:30:052
1971899335,6cyclictest7950irq/56-dwc_otg_09:05:222
1971899334,6cyclictest11-21rcu_preempt09:35:332
1971899334,15cyclictest7950irq/56-dwc_otg_12:30:352
19718993317,11cyclictest7950irq/56-dwc_otg_10:00:142
19718993313,5cyclictest28876-21latency_hist09:05:062
1971899331,2cyclictest0-21swapper/210:20:252
1971899331,22cyclictest0-21swapper/207:21:162
1971799339,13cyclictest0-21swapper/110:30:291
1971799337,5cyclictest9450irq/48-DMA09:12:251
1971799332,4cyclictest0-21swapper/112:20:171
1971799332,4cyclictest0-21swapper/112:20:171
19717993317,6cyclictest2338850wget07:20:181
19717993314,4cyclictest908-21runrttasks10:45:191
19717993313,5cyclictest26833-21sh10:21:091
19717993310,11cyclictest0-21swapper/109:15:171
112232330,2sleep30-21swapper/312:00:133
1971999326,6cyclictest7950irq/56-dwc_otg_12:30:043
1971999326,14cyclictest0-21swapper/311:35:313
1971999324,18cyclictest39-21ksoftirqd/309:26:283
1971999323,16cyclictest7850irq/56-dwc_otg_07:50:233
1971999323,10cyclictest7950irq/56-dwc_otg_08:30:213
1971899328,7cyclictest7850irq/56-dwc_otg_11:20:052
1971899328,13cyclictest0-21swapper/209:20:282
1971899327,15cyclictest0-21swapper/210:45:112
1971899324,7cyclictest7950irq/56-dwc_otg_07:50:182
1971899322,5cyclictest0-21swapper/208:50:052
1971899321,4cyclictest21365-21fschecks_time10:15:222
1971799329,11cyclictest0-21swapper/111:33:471
1971799329,11cyclictest0-21swapper/111:33:471
1971799326,11cyclictest7950irq/56-dwc_otg_08:40:191
19717993216,5cyclictest18333-21idleruntime-cro11:30:051
19717993214,5cyclictest30358-21basename07:40:051
1971799321,23cyclictest0-21swapper/111:15:141
1971999319,11cyclictest7950irq/56-dwc_otg_11:05:043
1971999315,12cyclictest7950irq/56-dwc_otg_09:55:343
1971999311,7cyclictest908-21runrttasks09:00:303
1971999311,6cyclictest7641-21latency_hist12:35:053
19719993114,5cyclictest37-21rcuc/308:54:243
19719993111,12cyclictest11036-21ssh12:38:483
1971899318,11cyclictest0-21swapper/209:58:172
1971899314,17cyclictest7950irq/56-dwc_otg_07:31:142
19718993116,4cyclictest32173-21sh09:10:352
19718993110,4cyclictest0-21swapper/212:25:242
1971799319,7cyclictest5699-21fschecks_time08:00:221
1971799317,5cyclictest7750irq/56-dwc_otg12:25:291
1971799316,15cyclictest0-21swapper/109:05:181
1971799312,15cyclictest0-21swapper/107:32:021
1971799311,7cyclictest16727-21ssh09:30:331
1971999305,5cyclictest7950irq/56-dwc_otg_08:55:353
1971999302,4cyclictest5689-21/usr/sbin/munin10:35:233
19719993014,6cyclictest39-21ksoftirqd/309:30:263
1971899306,7cyclictest7850irq/56-dwc_otg_11:40:212
1971899305,12cyclictest7950irq/56-dwc_otg_08:10:272
1971899304,5cyclictest7950irq/56-dwc_otg_09:50:162
1971899304,14cyclictest7950irq/56-dwc_otg_08:40:222
1971899304,14cyclictest7750irq/56-dwc_otg08:25:212
1971899302,15cyclictest7750irq/56-dwc_otg10:55:172
1971899302,15cyclictest7750irq/56-dwc_otg10:55:172
19718993013,5cyclictest5323-21sed08:00:052
19718993013,4cyclictest3938-21unixbench_singl09:15:332
1971799302,18cyclictest0-21swapper/108:30:071
1971999298,4cyclictest0-21swapper/310:10:213
1971999297,11cyclictest0-21swapper/311:22:193
1971999291,8cyclictest31222-21fschecks_time09:10:223
1971899296,4cyclictest7750irq/56-dwc_otg08:50:252
1971899292,7cyclictest28765-21/usr/sbin/munin07:35:272
19718992925,2cyclictest0-21swapper/208:30:312
182402295,10sleep30-21swapper/307:05:233
1971999282,19cyclictest0-21swapper/308:24:543
1971799288,14cyclictest0-21swapper/108:15:161
1971899276,4cyclictest7950irq/56-dwc_otg_08:20:162
1971899272,4cyclictest7850irq/56-dwc_otg_08:05:222
1971899271,6cyclictest0-21swapper/208:15:132
1971799279,9cyclictest917-21snmpd07:15:301
1971799277,4cyclictest8863-21sed08:10:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional