You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 20:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Thu Dec 18, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2954822310,2sleep10-21swapper/107:05:291
3030899967,25cyclictest0-21swapper/009:20:090
3030899842,41cyclictest0-21swapper/010:20:130
3030899772,37cyclictest0-21swapper/007:45:170
30308997315,46cyclictest101ktimersoftd/009:00:150
3030899705,43cyclictest0-21swapper/007:50:250
3030899676,14cyclictest0-21swapper/009:25:170
30308996721,31cyclictest20277-21latency_hist11:10:040
3030899651,30cyclictest0-21swapper/010:15:140
30308996435,16cyclictest0-21swapper/007:15:150
3030899642,44cyclictest14102-21grep10:50:310
3030899637,25cyclictest0-21swapper/008:55:310
3030899633,42cyclictest0-21swapper/009:15:040
3030899631,43cyclictest8069-21fschecks_time10:35:210
3030899631,39cyclictest18628-21latency_hist11:05:050
3030899621,58cyclictest238552sleep009:50:180
3030899621,58cyclictest238552sleep009:50:180
3030899611,24cyclictest18068-21unixbench_multi12:30:310
3030899606,39cyclictest7984-21timerandwakeup07:35:310
3030899606,28cyclictest16642-21idleruntime-cro11:00:040
3030899602,33cyclictest30746-21aten_rbpower_cu08:40:180
3030899591,42cyclictest1975-21cut08:50:180
3030899591,42cyclictest1975-21cut08:50:180
3030899591,35cyclictest21657-21tr08:15:180
3030899591,35cyclictest21657-21tr08:15:180
3030899591,13cyclictest27551-21tr10:00:180
3030899582,32cyclictest0-21swapper/008:35:030
3030899581,45cyclictest21120-21switchtime09:40:300
3030899581,39cyclictest15909-21proc_pri12:25:280
30308995727,13cyclictest7850irq/56-dwc_otg_11:45:040
30308995726,8cyclictest26006-21wget11:25:190
30308995710,17cyclictest0-21swapper/011:50:040
300232573,12sleep20-21swapper/207:09:522
3030899564,24cyclictest0-21swapper/010:10:170
3030899562,29cyclictest25769-21aten_rbpower_vo09:55:180
3030899562,28cyclictest8438-21unixbench_singl09:05:320
3030899561,31cyclictest6008-21aten_rbpower_cu10:30:190
3030899551,38cyclictest10075-21taskset10:40:250
3030899551,32cyclictest24471-21unixbench_multi08:20:300
3030899551,32cyclictest24471-21unixbench_multi08:20:300
3030899541,40cyclictest1125-21runrttasks11:35:290
3030899541,28cyclictest9786-21aten_rbpower_en12:10:190
3030899536,31cyclictest22334-21fschecks_time09:45:210
30308995325,14cyclictest0-21swapper/007:30:240
3030899532,36cyclictest0-21swapper/007:10:140
3030899531,36cyclictest0-21swapper/010:05:170
3030899528,24cyclictest0-21swapper/008:00:170
3030899522,11cyclictest18305-21latency_hist09:35:040
3030899521,5cyclictest18840-21cat08:05:280
3030899521,38cyclictest0-21swapper/009:36:120
314152510,2sleep30-21swapper/311:40:203
3031099511,17cyclictest0-21swapper/212:10:172
3030899512,7cyclictest11768-21fschecks_count12:15:210
3030899511,26cyclictest12129-21proc_pri10:45:280
3031199506,19cyclictest7950irq/56-dwc_otg_09:25:093
30308995026,5cyclictest7750irq/56-dwc_otg12:40:040
30308995021,12cyclictest0-21swapper/012:05:180
30308995021,12cyclictest0-21swapper/012:05:180
3030899501,32cyclictest0-21swapper/012:20:250
3030899501,27cyclictest3377-21aten_rbpower_en07:25:180
3031199497,26cyclictest0-21swapper/307:10:133
30309994920,4cyclictest1329550wget10:50:181
30308994918,5cyclictest1551-21grep07:20:170
3030899484,30cyclictest0-21swapper/011:33:470
3030899482,44cyclictest0-21swapper/010:30:040
3030899482,44cyclictest0-21swapper/010:30:040
3030899482,26cyclictest0-21swapper/011:15:050
3030899482,26cyclictest0-21swapper/011:15:050
30309994721,5cyclictest23367-21sshd09:47:101
3031199467,24cyclictest0-21swapper/309:15:103
30311994612,22cyclictest0-21swapper/310:50:173
3031099467,24cyclictest0-21swapper/208:40:092
30310994620,5cyclictest13096-21cron12:20:042
3030899462,31cyclictest0-21swapper/008:27:460
3030899461,22cyclictest0-21swapper/008:11:100
298612463,36sleep00-21swapper/007:07:430
3031199457,29cyclictest0-21swapper/308:40:093
3030999457,26cyclictest0-21swapper/107:10:131
30308994518,11cyclictest0-21swapper/012:00:160
30308994514,21cyclictest0-21swapper/007:55:390
3030899451,32cyclictest0-21swapper/011:58:330
3031099442,22cyclictest0-21swapper/208:10:222
3030999447,22cyclictest0-21swapper/111:20:171
294202440,5sleep33031199cyclictest11:35:043
3031199437,28cyclictest0-21swapper/307:20:173
3031199436,21cyclictest0-21swapper/311:20:173
3031099437,24cyclictest0-21swapper/207:20:172
3030899432,29cyclictest0-21swapper/007:41:410
3030899431,31cyclictest0-21swapper/011:18:310
3030899431,30cyclictest0-21swapper/008:48:120
284782438,24sleep30-21swapper/307:05:123
3031199427,21cyclictest0-21swapper/308:00:093
3031099428,28cyclictest0-21swapper/211:35:182
3030899422,31cyclictest0-21swapper/008:37:100
30308994213,22cyclictest0-21swapper/011:53:520
3030899421,25cyclictest10944-21apt-config09:15:050
3031199417,22cyclictest0-21swapper/311:35:183
3031099412,5cyclictest7950irq/56-dwc_otg_10:45:152
30310994121,6cyclictest13638-21fschecks_time12:20:232
3031099412,14cyclictest0-21swapper/209:05:142
30309994117,4cyclictest23-21ksoftirqd/111:45:041
3030899411,5cyclictest24141-21cut11:20:180
3031199405,23cyclictest3920-21ls07:25:253
3031099407,5cyclictest22720-21unixbench_singl08:15:322
3031099407,5cyclictest22720-21unixbench_singl08:15:322
3030999407,23cyclictest0-21swapper/108:40:091
3030999403,28cyclictest7950irq/56-dwc_otg_08:15:141
3030999403,28cyclictest7950irq/56-dwc_otg_08:15:141
3031199398,15cyclictest0-21swapper/310:15:103
30311993913,18cyclictest37-21rcuc/310:34:573
3031099391,27cyclictest30977-21ls10:10:042
3030999397,20cyclictest0-21swapper/109:30:171
3030999394,10cyclictest21-21rcuc/110:15:041
30309993930,6cyclictest221ktimersoftd/111:45:181
30309993922,6cyclictest18073-21unixbench_multi12:30:311
30309993918,6cyclictest7750irq/56-dwc_otg12:10:041
30309993918,6cyclictest7750irq/56-dwc_otg12:10:041
30309993913,9cyclictest221ktimersoftd/109:20:181
3031199386,6cyclictest7850irq/56-dwc_otg_11:25:333
30311993818,4cyclictest17962-21unixbench_multi11:00:333
3031099388,5cyclictest7850irq/56-dwc_otg_12:05:322
3031099388,5cyclictest7850irq/56-dwc_otg_12:05:322
3031099384,4cyclictest31-21ksoftirqd/210:20:282
3031099381,8cyclictest31-21ksoftirqd/207:15:282
30310993817,5cyclictest31167-21/usr/sbin/munin07:10:252
3031099381,25cyclictest24421-21ls09:50:242
3031099381,25cyclictest24421-21ls09:50:242
30310993811,11cyclictest18476-21aten_rbpower_cu09:35:182
3031199374,27cyclictest7950irq/56-dwc_otg_11:55:153
3031099377,17cyclictest0-21swapper/208:00:092
30310993717,13cyclictest31-21ksoftirqd/211:45:042
3030999374,7cyclictest21-21rcuc/111:50:291
30309993720,4cyclictest29317-21wget10:05:171
30311993614,10cyclictest381ktimersoftd/307:40:233
3031199361,31cyclictest1266-21latency_hist07:20:053
3031199361,22cyclictest39-21ksoftirqd/312:10:303
3031099368,5cyclictest7850irq/56-dwc_otg_10:30:332
3031099365,22cyclictest11318-21fschecks_time09:15:222
3031099364,4cyclictest7750irq/56-dwc_otg11:05:192
3031099363,4cyclictest7950irq/56-dwc_otg_11:00:182
3031099362,4cyclictest3028-21unixbench_singl08:50:332
3031099362,4cyclictest3028-21unixbench_singl08:50:332
30310993612,11cyclictest9004-21/usr/sbin/munin07:40:192
3030999367,22cyclictest0-21swapper/107:50:181
3030999361,24cyclictest10880-21cut07:45:231
30309993612,12cyclictest0-21swapper/109:25:091
281302360,2sleep10-21swapper/111:30:241
3031199358,8cyclictest37-21rcuc/311:05:193
30311993512,12cyclictest381ktimersoftd/310:55:133
3031199351,19cyclictest30832-21latency_hist10:10:043
30311993511,16cyclictest381ktimersoftd/308:26:553
3031099356,19cyclictest31-21ksoftirqd/208:25:202
3031099355,4cyclictest21804-21idleruntime-cro09:45:042
3031099354,25cyclictest7750irq/56-dwc_otg11:25:042
3031099352,7cyclictest7850irq/56-dwc_otg_12:35:162
3031099351,15cyclictest7950irq/56-dwc_otg_10:05:042
3030999357,14cyclictest21-21rcuc/112:10:251
150562350,1sleep10-21swapper/110:55:101
3031199346,5cyclictest11399-21proc_pri07:45:303
3031199345,19cyclictest39-21ksoftirqd/308:30:283
3031199344,8cyclictest7850irq/56-dwc_otg_08:15:313
3031199344,8cyclictest7850irq/56-dwc_otg_08:15:313
3031199342,6cyclictest5476-21/usr/sbin/munin09:00:303
30311993416,11cyclictest6797-21/usr/sbin/munin12:00:273
3031199341,15cyclictest14491-21apt-get09:25:033
3031099349,5cyclictest31-21ksoftirqd/208:59:132
3031099349,12cyclictest31-21ksoftirqd/210:40:322
3031099346,4cyclictest7850irq/56-dwc_otg_07:25:312
3031099346,18cyclictest0-21swapper/210:55:162
30310993428,4cyclictest31-21ksoftirqd/211:30:042
3031099341,7cyclictest14493-21ls09:25:032
3031099341,6cyclictest6558-21grep09:00:322
3031099341,4cyclictest7850irq/56-dwc_otg_07:45:312
3031099341,12cyclictest9450irq/48-DMA10:44:552
30310993411,12cyclictest7850irq/56-dwc_otg_08:30:312
3030999347,5cyclictest23-21ksoftirqd/112:35:211
3030999344,15cyclictest7950irq/56-dwc_otg_08:35:221
3030999342,23cyclictest0-21swapper/107:25:021
30309993418,5cyclictest11340-21fschecks_time09:15:221
3031199337,6cyclictest7850irq/56-dwc_otg_09:55:323
3031199334,14cyclictest39-21ksoftirqd/307:38:193
3031199331,23cyclictest22552-21grep11:15:223
3031199331,20cyclictest39-21ksoftirqd/309:50:253
3031199331,20cyclictest39-21ksoftirqd/309:50:253
30311993311,13cyclictest127332chrt10:47:433
3031099337,6cyclictest14369-21aten_rbpower_vo07:55:182
3031099336,14cyclictest0-21swapper/210:50:172
3031099335,4cyclictest7950irq/56-dwc_otg_11:50:232
3031099332,14cyclictest7950irq/56-dwc_otg_08:05:172
30310993319,8cyclictest27717-21/usr/sbin/munin11:30:232
30310993318,5cyclictest25645-21/usr/sbin/munin09:55:282
3031099331,4cyclictest29-21rcuc/208:35:192
30310993312,9cyclictest29-21rcuc/211:13:582
30310993312,9cyclictest29-21rcuc/211:13:582
3031099331,16cyclictest32548-21wget08:45:172
3031099331,15cyclictest0-21swapper/210:10:302
3030999337,7cyclictest7536-21awk10:35:031
3030999337,15cyclictest0-21swapper/108:00:091
3030999337,10cyclictest7750irq/56-dwc_otg08:30:301
3030999336,12cyclictest7950irq/56-dwc_otg_08:45:191
3030999335,4cyclictest25966-21tune2fs09:55:211
3030999335,10cyclictest7750irq/56-dwc_otg11:05:231
3030999333,6cyclictest0-21swapper/108:00:041
30309993328,3cyclictest0-21swapper/108:10:301
3030999332,17cyclictest7950irq/56-dwc_otg_10:40:321
30309993320,4cyclictest9223-21aten_rbpower_vo09:10:201
3030999331,4cyclictest0-21swapper/111:55:151
290102330,2sleep30-21swapper/308:35:213
3031199323,16cyclictest0-21swapper/309:30:173
3031199322,7cyclictest0-21swapper/311:50:223
3031199321,7cyclictest28595-21head10:00:323
3031199321,7cyclictest13284-21latency_hist12:20:043
30311993217,5cyclictest7981-21aten_rbpower_en12:05:183
30311993217,5cyclictest7981-21aten_rbpower_en12:05:183
3031099326,5cyclictest7850irq/56-dwc_otg_11:15:222
3031099325,8cyclictest17754-21grep09:30:322
3031099325,16cyclictest31-21ksoftirqd/209:50:042
3031099324,7cyclictest7850irq/56-dwc_otg_10:15:282
3030999325,7cyclictest21-21rcuc/107:15:291
3030999322,4cyclictest7950irq/56-dwc_otg_10:25:321
3030999322,4cyclictest7950irq/56-dwc_otg_10:25:321
3030999322,12cyclictest7950irq/56-dwc_otg_10:15:231
30309993220,5cyclictest5546-21aten_rbpower_en09:00:181
3030999321,24cyclictest0-21swapper/107:29:251
30309993212,13cyclictest0-21swapper/110:20:271
30309993210,3cyclictest7750irq/56-dwc_otg12:30:041
81052310,4sleep18107-21fschecks_time10:35:211
3031199318,12cyclictest39-21ksoftirqd/312:35:213
3031199314,5cyclictest20582-21grep11:10:193
3031199314,5cyclictest20582-21grep11:10:193
3031199311,5cyclictest7850irq/56-dwc_otg_08:45:173
3031199311,16cyclictest3045-21grep08:50:333
3031199311,16cyclictest3045-21grep08:50:333
30311993110,12cyclictest4921-21processes10:25:293
30311993110,12cyclictest4921-21processes10:25:293
3031099311,8cyclictest4978-21ntp_kernel_err11:55:262
3031099311,4cyclictest29-21rcuc/209:25:292
30310993111,5cyclictest2272-21latency_hist11:50:052
3031099311,14cyclictest7950irq/56-dwc_otg_07:50:152
3031099311,12cyclictest7950irq/56-dwc_otg_10:25:322
3031099311,12cyclictest7950irq/56-dwc_otg_10:25:322
30310993111,13cyclictest31-21ksoftirqd/210:40:042
3030999315,7cyclictest23-21ksoftirqd/109:50:271
3030999315,7cyclictest23-21ksoftirqd/109:50:271
3030999315,16cyclictest21-21rcuc/111:25:231
3030999315,14cyclictest7850irq/56-dwc_otg_11:16:341
3030999315,11cyclictest7850irq/56-dwc_otg_11:40:041
3030999314,6cyclictest7850irq/56-dwc_otg_11:00:221
3030999314,13cyclictest221ktimersoftd/107:33:181
3030999312,6cyclictest7750irq/56-dwc_otg09:38:051
3030999312,12cyclictest7750irq/56-dwc_otg07:45:031
30309993116,8cyclictest7022-21/usr/sbin/munin07:35:331
3031199308,5cyclictest7850irq/56-dwc_otg_07:55:243
3031199307,12cyclictest37-21rcuc/310:37:223
3031199305,11cyclictest39-21ksoftirqd/310:23:333
3031199304,7cyclictest7950irq/56-dwc_otg_09:50:043
3031199301,5cyclictest9839-21/usr/sbin/munin09:10:303
3031199301,5cyclictest7850irq/56-dwc_otg_11:45:193
3031199301,17cyclictest32074-21grep10:10:323
30310993012,4cyclictest1125-21runrttasks09:13:582
3031099301,20cyclictest0-21swapper/207:37:502
3030999305,4cyclictest0-21swapper/112:15:251
3030999304,5cyclictest7750irq/56-dwc_otg09:05:171
3030999303,4cyclictest25132-21latency_hist08:25:041
3030999303,4cyclictest25132-21latency_hist08:25:041
3030999302,13cyclictest7850irq/56-dwc_otg_10:50:041
30309993010,10cyclictest7750irq/56-dwc_otg10:03:571
3031199291,5cyclictest39-21ksoftirqd/310:40:253
30311992914,4cyclictest1136-21sshd09:08:103
3031199291,13cyclictest7950irq/56-dwc_otg_08:55:173
3031099291,6cyclictest17974-21wc12:30:302
3031099291,5cyclictest0-21swapper/208:20:132
3031099291,5cyclictest0-21swapper/208:20:132
3030999292,6cyclictest0-21swapper/112:00:311
30309992913,5cyclictest3742-21aten_rbpower_en08:55:171
3030999291,23cyclictest21350-21ls11:10:311
3030999291,23cyclictest21350-21ls11:10:311
3031199288,12cyclictest7950irq/56-dwc_otg_12:25:303
3031199283,6cyclictest7950irq/56-dwc_otg_12:30:123
3031199283,11cyclictest7950irq/56-dwc_otg_09:35:203
30311992814,7cyclictest381ktimersoftd/307:30:253
3031199281,16cyclictest0-21swapper/308:10:223
3031099281,15cyclictest0-21swapper/207:34:442
3030999286,4cyclictest7750irq/56-dwc_otg08:25:201
3030999282,9cyclictest7750irq/56-dwc_otg12:21:221
3030999281,9cyclictest21805-21munin-run09:45:041
3031199271,4cyclictest7950irq/56-dwc_otg_08:20:163
3031199271,4cyclictest7950irq/56-dwc_otg_08:20:163
3031199271,16cyclictest12439-21/usr/sbin/munin07:50:283
30311992710,9cyclictest216832chrt09:43:433
3031099271,15cyclictest0-21swapper/212:29:072
30309992712,5cyclictest19099-21unixbench_singl08:05:311
3031199261,13cyclictest7950irq/56-dwc_otg_12:21:473
20992260,5sleep13030999cyclictest08:50:201
20992260,5sleep13030999cyclictest08:50:201
3031199241,5cyclictest17993-21aten_rbpower_cu08:05:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional