You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 18:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Jun 20, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332423110,1sleep10-21swapper/107:10:061
761921100,5sleep1336299cyclictest12:15:241
33619910239,10cyclictest7950irq/56-dwc_otg_09:15:170
3361991013,43cyclictest61-21kswapd009:35:160
3361999515,56cyclictest0-21swapper/008:15:190
3361999149,9cyclictest13859-21ssh11:05:170
336199913,58cyclictest61-21kswapd011:50:180
80002870,2sleep37154-21/usr/sbin/munin08:50:313
209712850,2sleep00-21swapper/010:35:030
209712850,2sleep00-21swapper/010:35:030
336199832,18cyclictest26409-21ssh11:20:160
336199829,68cyclictest29862-21unixbench_multi08:20:320
336199816,55cyclictest0-21swapper/012:05:060
336199816,55cyclictest0-21swapper/012:05:060
3361998114,34cyclictest0-21swapper/009:40:240
3361998017,3cyclictest0-21swapper/009:25:350
336199766,13cyclictest0-21swapper/010:20:060
336199751,22cyclictest0-21swapper/010:53:140
3361997417,42cyclictest14678-21ssh11:45:150
95932730,2sleep30-21swapper/310:20:283
336199731,5cyclictest17600-21munin-run07:50:050
336199731,17cyclictest0-21swapper/011:30:320
336199731,14cyclictest0-21swapper/009:20:240
336199721,20cyclictest20188-21ssh12:30:260
336199721,17cyclictest23561-21taskset10:37:120
336199712,20cyclictest0-21swapper/009:00:220
336199712,20cyclictest0-21swapper/009:00:220
336199711,16cyclictest15437-21aten_rbpower_en12:25:180
336199707,13cyclictest0-21swapper/009:52:460
3361997024,30cyclictest7950irq/56-dwc_otg_08:40:200
336199692,56cyclictest9291-21apt-get11:00:100
3361996835,3cyclictest0-21swapper/011:25:170
3361996835,3cyclictest0-21swapper/011:25:170
3361996818,4cyclictest750-21snmpd10:20:080
336199681,14cyclictest0-21swapper/010:45:220
286772680,1sleep30-21swapper/312:01:013
286772680,1sleep30-21swapper/312:01:013
3361996723,31cyclictest0-21swapper/007:20:160
336199671,53cyclictest0-21swapper/010:00:260
336199671,20cyclictest3729-21ssh12:10:280
336299666,11cyclictest7850irq/56-dwc_otg11:15:171
336199666,12cyclictest0-21swapper/012:38:480
3361996617,35cyclictest0-21swapper/010:14:240
336199652,59cyclictest6266-21grep07:15:330
336199652,18cyclictest0-21swapper/009:55:330
3361996513,43cyclictest0-21swapper/012:18:530
3361996512,4cyclictest7850irq/56-dwc_otg09:05:240
3361996512,11cyclictest0-21swapper/007:50:320
3361996512,11cyclictest0-21swapper/007:28:300
336199651,19cyclictest3740-21taskset07:10:240
336199651,19cyclictest0-21swapper/007:44:440
336199651,12cyclictest0-21swapper/011:35:400
3361996414,4cyclictest26545-21timerandwakeup10:40:310
3361996413,9cyclictest24423-21ssh11:17:060
336199641,18cyclictest727-21runrttasks10:08:380
336199639,4cyclictest125-21systemd-journal08:02:470
336199631,14cyclictest0-21swapper/012:20:300
3361996215,4cyclictest10561-21latency_hist09:00:060
336199621,3cyclictest0-21swapper/009:48:260
336199621,14cyclictest0-21swapper/011:58:240
169272620,2sleep121-21rcuc/111:08:451
3361996134,5cyclictest8050irq/56-dwc_otg_11:10:210
336199612,3cyclictest0-21swapper/008:37:290
3361996115,5cyclictest8965-21ssh10:59:310
3361996115,35cyclictest0-21swapper/012:07:580
3361996113,3cyclictest7950irq/56-dwc_otg_10:26:130
336199611,16cyclictest0-21swapper/009:31:380
336299604,17cyclictest7711-21sh09:40:201
336199597,12cyclictest0-21swapper/009:11:180
336199592,8cyclictest20707-21sed07:55:330
336199591,23cyclictest727-21runrttasks08:48:470
336199591,22cyclictest32240-21latency_hist08:30:050
336199591,11cyclictest0-21swapper/011:41:480
94412580,4sleep19403-21missed_timers07:25:271
327372580,8sleep0336199cyclictest08:30:230
336299574,6cyclictest7850irq/56-dwc_otg12:00:161
336299574,6cyclictest7850irq/56-dwc_otg12:00:161
336299573,10cyclictest0-21swapper/112:05:191
3362995719,11cyclictest0-21swapper/109:35:161
336199569,9cyclictest0-21swapper/007:36:350
336199569,9cyclictest0-21swapper/007:36:350
336199561,15cyclictest0-21swapper/008:51:580
3361995611,4cyclictest24760-21chrt08:09:380
336199561,11cyclictest0-21swapper/008:10:200
3361995610,8cyclictest0-21swapper/007:33:520
126632540,2sleep30-21swapper/312:20:463
3362995312,8cyclictest8050irq/56-dwc_otg_11:30:191
336499524,5cyclictest7950irq/56-dwc_otg_08:00:183
3363995242,8cyclictest0-21swapper/211:55:172
336299512,11cyclictest0-21swapper/108:45:161
336499502,6cyclictest0-21swapper/307:25:183
336399487,25cyclictest0-21swapper/208:00:212
336299488,25cyclictest0-21swapper/107:45:191
336299480,9cyclictest8050irq/56-dwc_otg_11:00:061
336499477,25cyclictest0-21swapper/307:10:193
336499472,11cyclictest23376-21ls11:15:313
27102473,37sleep00-21swapper/007:05:530
336499467,25cyclictest0-21swapper/309:05:193
336499467,24cyclictest0-21swapper/307:20:193
336399467,28cyclictest9650-21ssh11:00:112
336399467,25cyclictest7113-21ssh12:15:182
336299468,25cyclictest0-21swapper/110:30:121
336299468,25cyclictest0-21swapper/110:30:121
336299467,26cyclictest0-21swapper/107:15:191
336499455,17cyclictest0-21swapper/309:40:203
336399457,24cyclictest0-21swapper/209:00:192
336399457,24cyclictest0-21swapper/209:00:192
3363994511,6cyclictest8050irq/56-dwc_otg_12:25:152
336299458,24cyclictest0-21swapper/108:10:201
336499447,24cyclictest0-21swapper/309:25:203
336399447,23cyclictest0-21swapper/208:20:182
3362994412,12cyclictest221ktimersoftd/109:25:271
336499436,25cyclictest0-21swapper/310:05:203
336499436,24cyclictest23065-21ssh09:20:183
336299439,17cyclictest8050irq/56-dwc_otg_07:50:271
336299437,24cyclictest0-21swapper/109:05:191
3362994317,10cyclictest7850irq/56-dwc_otg09:45:291
9102420,2sleep3381ktimersoftd/312:07:013
336299424,25cyclictest0-21swapper/110:10:191
3362994222,5cyclictest7850irq/56-dwc_otg12:35:321
3362994219,4cyclictest8050irq/56-dwc_otg_11:00:251
336399417,22cyclictest0-21swapper/209:55:182
336299419,14cyclictest15945-21unixbench_singl11:45:311
336299417,24cyclictest0-21swapper/110:45:181
3362994122,8cyclictest7850irq/56-dwc_otg09:19:581
3362994118,9cyclictest8050irq/56-dwc_otg_10:37:141
3362994114,9cyclictest7950irq/56-dwc_otg_09:51:141
244352410,2sleep20-21swapper/211:17:082
168562410,32sleep28050irq/56-dwc_otg_10:30:052
336499407,23cyclictest0-21swapper/308:10:203
336499406,23cyclictest31621-21ssh09:30:203
336499404,24cyclictest2280-21ssh11:30:193
336399405,7cyclictest8050irq/56-dwc_otg_07:25:342
336399405,2cyclictest0-21swapper/210:20:192
336399403,6cyclictest8050irq/56-dwc_otg_10:00:172
3363994019,4cyclictest14961-21/usr/sbin/munin11:45:202
336299409,20cyclictest221ktimersoftd/110:06:001
336299408,18cyclictest7850irq/56-dwc_otg11:50:191
336299402,12cyclictest7950irq/56-dwc_otg_12:20:161
3362994020,7cyclictest7950irq/56-dwc_otg_10:25:461
3362994016,12cyclictest7850irq/56-dwc_otg09:22:341
336299401,4cyclictest0-21swapper/108:35:171
3362994011,11cyclictest10778-21apt-get09:00:181
3362994011,11cyclictest10778-21apt-get09:00:181
336499393,3cyclictest7850irq/56-dwc_otg11:20:173
336499391,6cyclictest30849-21cut08:25:243
336499391,3cyclictest0-21swapper/310:55:223
336399398,5cyclictest25619-21cpu10:40:192
336299396,4cyclictest27195-21fschecks_count08:15:221
336299394,15cyclictest31599-21ssh11:25:311
336299394,15cyclictest31599-21ssh11:25:311
3362993915,7cyclictest7850irq/56-dwc_otg08:20:281
3362993915,6cyclictest7950irq/56-dwc_otg_12:27:111
3362993913,6cyclictest221ktimersoftd/112:10:231
336299391,24cyclictest4613-21/usr/sbin/munin08:40:331
103612390,2sleep30-21swapper/311:00:263
336499389,6cyclictest0-21swapper/312:15:193
336499385,8cyclictest39-21ksoftirqd/308:40:053
3364993816,4cyclictest19778-21entropy12:30:213
336499381,25cyclictest18321-21ls11:10:203
336399382,16cyclictest7950irq/56-dwc_otg_10:35:332
3363993819,4cyclictest3183-21/usr/sbin/munin11:30:312
336299388,7cyclictest7850irq/56-dwc_otg12:30:231
336299383,15cyclictest8050irq/56-dwc_otg_09:57:011
336299383,11cyclictest8050irq/56-dwc_otg_10:40:271
3362993821,8cyclictest7850irq/56-dwc_otg10:03:041
290012380,2sleep10-21swapper/111:22:551
3364993719,4cyclictest3798-21fschecks_time09:35:233
336399372,3cyclictest7850irq/56-dwc_otg08:40:182
3363993721,5cyclictest759-21sshd09:15:212
336399371,4cyclictest0-21swapper/209:10:182
3363993712,4cyclictest24037-21/usr/sbin/munin08:05:312
336399371,24cyclictest14500-21ssh11:05:272
336399371,22cyclictest20143-21latency_hist09:55:062
336299379,6cyclictest9120-21grep10:20:231
336299372,10cyclictest0-21swapper/110:50:191
3362993720,5cyclictest1428650wget07:40:201
3362993715,8cyclictest7850irq/56-dwc_otg07:55:311
336499367,22cyclictest0-21swapper/310:40:183
336499361,9cyclictest16229-21ssh09:50:183
336499361,24cyclictest6763-21cut11:35:233
336399368,12cyclictest0-21swapper/212:10:272
336399367,4cyclictest0-21swapper/209:48:042
336399367,14cyclictest8050irq/56-dwc_otg_08:10:342
336399362,7cyclictest7950irq/56-dwc_otg_12:10:052
3363993614,4cyclictest22055-21latency_hist11:15:062
3363993612,5cyclictest727-21runrttasks09:26:162
336399361,25cyclictest0-21swapper/208:55:192
336399361,23cyclictest2074-21ls11:30:062
336399361,23cyclictest2074-21ls11:30:062
336299366,20cyclictest6422-21ssh11:35:191
336299365,11cyclictest21-21rcuc/111:11:171
3362993620,9cyclictest7850irq/56-dwc_otg11:56:161
3362993615,6cyclictest9274-21fschecks_time08:55:231
336299361,20cyclictest8050irq/56-dwc_otg_09:15:061
336499353,9cyclictest0-21swapper/309:10:163
336499351,26cyclictest1108-21rm10:50:063
336399358,6cyclictest7850irq/56-dwc_otg10:50:052
336399358,13cyclictest8050irq/56-dwc_otg_10:15:072
336399352,19cyclictest8050irq/56-dwc_otg_09:05:172
3363993517,5cyclictest28537-21latency_hist08:20:052
336299351,5cyclictest0-21swapper/108:25:181
3362993513,8cyclictest31589-21ssh09:30:181
129202350,1sleep2301ktimersoftd/207:35:272
129202350,1sleep2301ktimersoftd/207:35:272
336499343,21cyclictest29733-21ls08:20:313
336499342,8cyclictest22638-21unixbench_singl10:35:343
336499342,14cyclictest7950irq/56-dwc_otg_07:45:053
3364993416,10cyclictest8050irq/56-dwc_otg_09:59:003
3364993415,7cyclictest9049-21aten_rbpower_po08:55:203
3364993415,5cyclictest37-21rcuc/311:50:353
336399348,3cyclictest7950irq/56-dwc_otg_09:30:262
336399347,15cyclictest0-21swapper/207:30:192
336399347,14cyclictest7950irq/56-dwc_otg_12:22:122
336399346,3cyclictest7950irq/56-dwc_otg_10:31:192
336399346,3cyclictest7950irq/56-dwc_otg_10:31:192
336399345,14cyclictest8050irq/56-dwc_otg_08:00:062
336399341,22cyclictest14464-21cut07:40:232
336399341,22cyclictest0-21swapper/207:50:182
336399341,17cyclictest0-21swapper/210:05:162
336299348,8cyclictest7950irq/56-dwc_otg_07:10:211
336299346,15cyclictest0-21swapper/108:50:191
3362993417,8cyclictest7850irq/56-dwc_otg10:19:571
336499337,12cyclictest8050irq/56-dwc_otg_12:15:053
336499336,7cyclictest39-21ksoftirqd/310:00:373
336499335,19cyclictest13872-21ssh11:05:193
336499334,4cyclictest4680-21ssh10:15:193
336499333,6cyclictest7850irq/56-dwc_otg11:40:213
3364993321,5cyclictest17105-21ssh10:30:093
3364993321,5cyclictest17105-21ssh10:30:093
336499331,20cyclictest784-21cut10:10:233
336399338,6cyclictest8050irq/56-dwc_otg_09:38:022
336399336,14cyclictest8050irq/56-dwc_otg_11:50:272
336399332,11cyclictest6533-21grep08:45:342
336399331,11cyclictest0-21swapper/211:35:192
336299334,9cyclictest13898-21chrt07:39:121
336299334,9cyclictest13898-21chrt07:39:121
3362993311,7cyclictest7850irq/56-dwc_otg11:42:211
3362993311,11cyclictest0-21swapper/108:30:161
27182335,20sleep20-21swapper/207:05:592
77042320,2sleep10-21swapper/107:20:281
336499326,15cyclictest0-21swapper/308:05:193
336499324,7cyclictest7950irq/56-dwc_otg_08:30:313
3364993221,6cyclictest381ktimersoftd/307:55:163
336499321,5cyclictest0-21swapper/307:35:183
336499321,5cyclictest0-21swapper/307:35:183
336499321,16cyclictest7950irq/56-dwc_otg_09:49:093
3364993211,10cyclictest0-21swapper/311:25:203
3364993211,10cyclictest0-21swapper/311:25:203
3363993225,5cyclictest27391-21fschecks_count12:00:222
3363993225,5cyclictest27391-21fschecks_count12:00:222
336399321,16cyclictest7950irq/56-dwc_otg_12:34:102
336299324,5cyclictest7850irq/56-dwc_otg08:00:211
336499319,10cyclictest0-21swapper/312:37:183
336499318,4cyclictest125-21systemd-journal08:20:053
336499317,8cyclictest16298-21fschecks_count07:45:233
336499311,24cyclictest8050irq/56-dwc_otg_11:55:173
336499311,21cyclictest14000-21ssh10:25:343
336499311,19cyclictest0-21swapper/309:19:183
336399317,13cyclictest0-21swapper/210:10:182
336399316,13cyclictest8050irq/56-dwc_otg_08:30:192
336399313,17cyclictest7950irq/56-dwc_otg_08:25:352
3363993124,5cyclictest23133-21aten_rbpower_po09:20:192
3363993121,5cyclictest301ktimersoftd/207:15:182
3363993116,12cyclictest0-21swapper/208:35:202
336399311,21cyclictest23965-21ssh12:35:232
336299316,12cyclictest8050irq/56-dwc_otg_08:05:341
336499306,6cyclictest39-21ksoftirqd/307:30:543
336499306,14cyclictest0-21swapper/307:15:193
3364993023,5cyclictest39-21ksoftirqd/308:45:333
336499302,19cyclictest15359-21/usr/sbin/munin12:25:223
336499301,19cyclictest1519-21cpuspeed10:50:213
336399309,10cyclictest0-21swapper/210:57:292
336399307,13cyclictest8050irq/56-dwc_otg_11:24:362
336399301,8cyclictest0-21swapper/207:13:082
336399301,4cyclictest0-21swapper/210:55:062
336399301,3cyclictest0-21swapper/209:42:462
336399301,26cyclictest8713-21ls07:25:062
3363993010,4cyclictest0-21swapper/211:42:442
336299302,15cyclictest8050irq/56-dwc_otg_07:31:251
336499299,10cyclictest0-21swapper/307:50:293
336499293,8cyclictest8050irq/56-dwc_otg_09:00:163
336499293,8cyclictest8050irq/56-dwc_otg_09:00:163
3364992914,5cyclictest39-21ksoftirqd/308:40:253
3363992923,4cyclictest16266-21fschecks_count07:45:232
336399291,14cyclictest7850irq/56-dwc_otg08:50:262
336499283,3cyclictest7950irq/56-dwc_otg_11:45:233
14712273,14sleep30-21swapper/307:05:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional