You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 19:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun Jun 21, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
318632930,4sleep331861-21ssh12:25:273
283292930,2sleep00-21swapper/010:25:060
287182830,2sleep30-21swapper/312:21:243
18083998324,4cyclictest12979-21aten_rbpower_cu10:45:200
1808399787,18cyclictest0-21swapper/011:30:070
1808399772,28cyclictest0-21swapper/009:45:200
275552750,5sleep21809099cyclictest07:35:252
324902730,2sleep10-21swapper/110:30:071
19562720,5sleep11959-21ntp_kernel_pll_09:15:271
181222720,4sleep161-21kswapd007:10:121
18083997121,12cyclictest0-21swapper/010:32:380
73212700,2sleep10-21swapper/110:38:161
289602700,2sleep20-21swapper/207:40:162
18086996836,9cyclictest7950irq/56-dwc_otg_12:10:161
18086996836,9cyclictest7950irq/56-dwc_otg_12:10:161
18083996713,28cyclictest21687-21cron08:50:060
1809099654,50cyclictest9656-21ssh11:59:232
1809099645,42cyclictest0-21swapper/211:23:082
1809099642,5cyclictest5663-21aten_rbpower_po08:05:212
18083996316,7cyclictest0-21swapper/009:55:160
1809099624,44cyclictest8050irq/56-dwc_otg_11:45:072
1809099623,39cyclictest8050irq/56-dwc_otg_10:59:322
1809099621,48cyclictest11690-21ssh10:05:172
1808399626,48cyclictest0-21swapper/009:20:180
1810199615,13cyclictest7850irq/56-dwc_otg11:30:173
1809099615,41cyclictest8050irq/56-dwc_otg_11:08:042
1809099615,35cyclictest0-21swapper/211:04:192
1809099612,40cyclictest28624-21aten_rbpower_en10:25:182
1810199608,11cyclictest8050irq/56-dwc_otg_10:15:173
1809099605,36cyclictest8050irq/56-dwc_otg_12:05:212
1809099602,41cyclictest8050irq/56-dwc_otg_10:50:202
1809099602,41cyclictest0-21swapper/210:30:262
1809099601,4cyclictest24387-21/usr/sbin/munin10:20:232
1809099601,48cyclictest21744-21ssh12:13:492
1809099601,48cyclictest21744-21ssh12:13:492
1809099601,40cyclictest8050irq/56-dwc_otg_07:30:182
18090996011,27cyclictest9433-21idleruntime-cro09:25:062
1809099591,47cyclictest29825-21ssh09:48:282
1809099591,41cyclictest0-21swapper/211:36:282
18083995944,5cyclictest2582-21latency_hist12:30:060
1809099585,42cyclictest8050irq/56-dwc_otg_09:36:592
1809099583,45cyclictest2812-21ssh09:16:042
1809099581,5cyclictest14610-21sensors11:25:302
1809099573,50cyclictest8295-21unixbench_multi12:35:332
1809099573,37cyclictest8050irq/56-dwc_otg_10:11:012
1809099572,37cyclictest0-21swapper/211:55:052
1809099572,36cyclictest9550irq/48-DMA15:26:472
18090995714,29cyclictest3213-21fschecks_count12:30:232
1809099571,41cyclictest0-21swapper/209:14:382
18083995732,5cyclictest8050irq/56-dwc_otg_10:15:050
18083995729,13cyclictest8050irq/56-dwc_otg_08:55:190
18083995715,5cyclictest8232-21unixbench-2d12:35:330
1809099561,44cyclictest0-21swapper/209:25:262
1809099561,44cyclictest0-21swapper/209:25:262
1809099561,39cyclictest0-21swapper/211:11:162
18083995635,12cyclictest101ktimersoftd/011:30:220
18083995633,14cyclictest0-21swapper/009:55:060
18083995612,5cyclictest5783-21unixbench_multi10:35:340
1809099554,40cyclictest8050irq/56-dwc_otg_09:51:002
1809099554,31cyclictest0-21swapper/209:44:422
1809099553,41cyclictest8050irq/56-dwc_otg_10:42:252
1809099552,3cyclictest8050irq/56-dwc_otg_10:00:202
1809099552,3cyclictest7850irq/56-dwc_otg12:25:282
1809099551,5cyclictest14019-21/usr/sbin/munin09:30:322
1809099551,5cyclictest13553-21sshd10:45:272
1809099551,4cyclictest7950irq/56-dwc_otg_10:17:062
1809099551,42cyclictest0-21swapper/212:21:582
1809099551,3cyclictest7850irq/56-dwc_otg11:31:132
1809099551,36cyclictest0-21swapper/209:57:002
18086995515,8cyclictest7850irq/56-dwc_otg11:50:171
1808399556,38cyclictest0-21swapper/012:20:190
18083995529,14cyclictest7850irq/56-dwc_otg09:15:220
18083995525,15cyclictest11373-21grep12:00:310
1808399551,38cyclictest10845-21head11:20:340
1809099541,4cyclictest7950irq/56-dwc_otg_09:05:212
1808399541,36cyclictest29860-21tune2fs11:05:240
1808399541,29cyclictest19540-21grep09:35:330
175882543,14sleep20-21swapper/207:08:072
1809099534,42cyclictest7850irq/56-dwc_otg11:48:172
1809099533,3cyclictest8050irq/56-dwc_otg_11:19:452
1809099532,47cyclictest8050irq/56-dwc_otg_10:35:172
1808399531,34cyclictest3112-21grep07:55:330
1808399531,19cyclictest30128-21ssh11:45:070
1809099522,40cyclictest0-21swapper/212:02:052
1809099522,37cyclictest0-21swapper/208:44:492
1809099521,6cyclictest24061-21cut08:55:222
1809099521,38cyclictest0-21swapper/207:27:172
1808699525,18cyclictest0-21swapper/109:55:161
18086995227,5cyclictest5559-21aten_rbpower_en09:20:191
18083995227,5cyclictest0-21swapper/009:30:240
18083995226,6cyclictest11829-21aten_rbpower_po10:05:230
18083995211,20cyclictest22641-21missed_timers11:35:270
1809099513,40cyclictest750-21snmpd08:19:282
1809099511,4cyclictest12629-21latency_hist08:25:062
1809099511,46cyclictest19981-21wget07:15:212
1809099511,3cyclictest0-21swapper/208:50:162
1808399517,23cyclictest9228-21idleruntime-cro11:20:060
18083995127,13cyclictest7950irq/56-dwc_otg_12:15:180
18083995125,5cyclictest10310-21grep08:15:340
18083995122,3cyclictest0-21swapper/008:35:210
18083995120,4cyclictest0-21swapper/011:50:190
18083995116,15cyclictest0-21swapper/007:25:220
1808399511,28cyclictest25363-21/usr/sbin/munin07:30:170
175462516,36sleep00-21swapper/007:07:330
1810199502,11cyclictest0-21swapper/308:40:183
1809099502,33cyclictest0-21swapper/207:10:252
1809099501,4cyclictest8050irq/56-dwc_otg_07:59:542
1808699508,25cyclictest0-21swapper/108:35:111
1808399501,31cyclictest25210-21ls11:00:070
1808399501,27cyclictest17859-21ssh10:50:280
1809099492,43cyclictest7470-21aten_rbpower_po08:10:192
1809099492,43cyclictest30816-21aten_rbpower_cu07:45:182
1809099492,43cyclictest30816-21aten_rbpower_cu07:45:182
1809099492,42cyclictest21206-21unixbench-2d08:45:332
1809099491,5cyclictest13151-21/usr/sbin/munin08:25:232
1809099491,44cyclictest18235-21latency_hist08:40:062
1809099491,3cyclictest0-21swapper/208:30:172
18083994924,13cyclictest0-21swapper/009:11:130
1808399492,38cyclictest0-21swapper/012:33:220
18083994920,14cyclictest7950irq/56-dwc_otg_07:20:340
1808699488,26cyclictest0-21swapper/110:00:121
1808399489,4cyclictest0-21swapper/007:50:340
1808399488,18cyclictest9-21ksoftirqd/009:40:200
1808399485,19cyclictest0-21swapper/010:00:240
18083994827,6cyclictest7850irq/56-dwc_otg11:10:340
18083994824,8cyclictest0-21swapper/009:00:290
1808399481,25cyclictest10155-21idleruntime09:25:230
1808399481,25cyclictest10155-21idleruntime09:25:230
1809099471,4cyclictest0-21swapper/208:02:352
1809099471,44cyclictest26809-21unixbench_singl09:00:352
1809099471,38cyclictest8050irq/56-dwc_otg_07:54:232
1808699477,25cyclictest0-21swapper/109:00:111
1808699472,5cyclictest0-21swapper/111:00:181
1808399478,5cyclictest0-21swapper/009:05:350
18083994712,19cyclictest29024-21diskmemload12:10:060
1810199467,26cyclictest0-21swapper/308:35:123
1809099461,42cyclictest22841-21sed07:20:332
1808699467,26cyclictest0-21swapper/109:30:201
18083994624,11cyclictest0-21swapper/010:15:400
1808399462,23cyclictest11339-21fschecks_time08:20:240
1808399461,33cyclictest0-21swapper/012:13:180
1808399461,33cyclictest0-21swapper/012:13:180
1810199451,7cyclictest0-21swapper/308:05:193
18086994521,14cyclictest0-21swapper/112:35:191
18086994516,23cyclictest0-21swapper/112:25:111
18083994534,4cyclictest6938-21ls11:55:250
1808399451,7cyclictest28677-21cut10:25:190
18083994516,17cyclictest19453-21unixbench_singl08:40:330
1808399451,26cyclictest0-21swapper/007:45:060
1808399451,24cyclictest0-21swapper/008:10:270
1810199447,23cyclictest0-21swapper/307:30:203
18083994423,11cyclictest0-21swapper/008:55:070
1808399442,29cyclictest0-21swapper/010:43:350
18083994422,7cyclictest0-21swapper/008:00:170
18083994416,14cyclictest20371-21if_wlan007:15:260
1808399441,22cyclictest29955-21apt-get11:45:090
1808399441,22cyclictest0-21swapper/007:10:200
1808399441,14cyclictest0-21swapper/011:04:040
18101994321,4cyclictest7850irq/56-dwc_otg10:05:293
18101994312,7cyclictest7950irq/56-dwc_otg_09:40:183
1808699434,11cyclictest7850irq/56-dwc_otg10:10:201
18086994320,12cyclictest12498-21idleruntime-cro10:45:061
18086994318,13cyclictest13753-21ssh11:25:191
18083994323,2cyclictest0-21swapper/008:30:170
217262420,2sleep30-21swapper/312:13:473
217262420,2sleep30-21swapper/312:13:473
1810199427,23cyclictest0-21swapper/308:25:193
1810199426,3cyclictest0-21swapper/311:10:193
1810199424,26cyclictest8050irq/56-dwc_otg_10:40:063
1808699427,25cyclictest0-21swapper/111:45:181
1808699427,25cyclictest0-21swapper/110:45:201
18086994223,8cyclictest7850irq/56-dwc_otg12:19:031
18086994223,10cyclictest7850irq/56-dwc_otg10:05:111
1808399421,6cyclictest14365-21sh08:30:060
1808699417,5cyclictest23-21ksoftirqd/112:30:231
1808699414,18cyclictest221ktimersoftd/111:05:301
1808699412,5cyclictest0-21swapper/108:45:171
18086994110,2cyclictest0-21swapper/112:00:191
18083994120,4cyclictest0-21swapper/008:05:260
1808699403,7cyclictest7850irq/56-dwc_otg08:10:161
18086994012,17cyclictest221ktimersoftd/109:39:221
18086994010,17cyclictest359-21fschecks_count07:50:241
18083994023,4cyclictest7950irq/56-dwc_otg_07:39:270
18083994020,4cyclictest7850irq/56-dwc_otg07:45:190
18083994020,4cyclictest7850irq/56-dwc_otg07:45:190
162672400,3sleep316260-21ssh10:10:243
110552401,4sleep111065-21ssh11:20:561
96102390,1sleep30-21swapper/309:25:073
1810199393,4cyclictest7850irq/56-dwc_otg09:50:063
18101993916,6cyclictest20439-21sh10:54:163
1808699397,6cyclictest7950irq/56-dwc_otg_08:25:331
1808699394,18cyclictest8050irq/56-dwc_otg_08:45:061
18086993919,5cyclictest16405-21latency_hist08:35:071
18086993915,11cyclictest221ktimersoftd/111:16:521
18086993914,6cyclictest21-21rcuc/111:10:451
284902380,5sleep31810199cyclictest11:42:273
1810199382,4cyclictest8050irq/56-dwc_otg_07:25:313
18101993815,10cyclictest257612hostname09:00:213
1808699385,5cyclictest8050irq/56-dwc_otg_09:45:311
18086993814,13cyclictest221ktimersoftd/108:50:311
18086993813,5cyclictest0-21swapper/112:05:171
1810199371,25cyclictest28458-21timerwakeupswit09:05:343
1810199370,29cyclictest4218-21timerwakeupswit09:55:313
1808699379,8cyclictest8050irq/56-dwc_otg_09:25:251
1808699379,8cyclictest8050irq/56-dwc_otg_09:25:251
1808699374,20cyclictest7850irq/56-dwc_otg09:42:371
18086993716,8cyclictest221ktimersoftd/110:53:401
18086993710,9cyclictest7850irq/56-dwc_otg08:05:181
1810199363,5cyclictest646-21fschecks_time10:30:243
1810199362,23cyclictest0-21swapper/310:21:283
1810199361,23cyclictest3185-21cut12:30:233
1808699368,19cyclictest0-21swapper/111:35:191
18086993617,8cyclictest7850irq/56-dwc_otg10:21:551
18086993617,4cyclictest221ktimersoftd/111:59:101
1808699361,21cyclictest23-21ksoftirqd/111:31:561
1808699361,15cyclictest221ktimersoftd/108:24:591
18086993610,14cyclictest0-21swapper/109:10:171
1810199355,6cyclictest30401-21aten_rbpower_cu11:45:183
18101993519,6cyclictest29515-21switchtime10:25:303
1808699358,14cyclictest221ktimersoftd/110:30:501
1808699357,24cyclictest0-21swapper/107:25:181
1808699354,21cyclictest221ktimersoftd/110:59:441
1808699354,16cyclictest8050irq/56-dwc_otg_07:40:311
1808699354,16cyclictest7850irq/56-dwc_otg12:21:501
18086993513,5cyclictest26762-21grep11:40:251
1808699351,22cyclictest24082-21latency_hist10:20:061
1808699351,13cyclictest21-21rcuc/107:35:241
1810199347,15cyclictest0-21swapper/308:15:203
1810199347,14cyclictest7950irq/56-dwc_otg_09:15:283
1810199343,6cyclictest7850irq/56-dwc_otg11:00:203
1810199341,5cyclictest8050irq/56-dwc_otg_12:35:183
18101993415,4cyclictest727-21runrttasks08:11:403
1810199341,3cyclictest7850irq/56-dwc_otg07:40:173
18101993412,4cyclictest727-21runrttasks11:54:413
1810199341,23cyclictest9018-21cut10:40:243
1810199341,18cyclictest801650ssh11:17:563
1808699345,6cyclictest9239-21aten_rbpower_en08:15:201
1810199339,4cyclictest0-21swapper/309:10:353
1810199338,5cyclictest7950irq/56-dwc_otg_07:10:253
1810199338,4cyclictest0-21swapper/312:00:203
1810199338,12cyclictest8050irq/56-dwc_otg_07:15:343
1810199337,5cyclictest8050irq/56-dwc_otg_11:25:213
1810199337,23cyclictest31168-21sh09:50:133
1810199334,6cyclictest8050irq/56-dwc_otg_07:35:193
1810199334,6cyclictest7850irq/56-dwc_otg12:15:213
1810199334,15cyclictest8050irq/56-dwc_otg_11:55:323
1810199333,4cyclictest8050irq/56-dwc_otg_11:35:243
1810199333,15cyclictest4831-21grep08:00:343
18101993325,6cyclictest381ktimersoftd/308:30:173
1810199331,23cyclictest0-21swapper/310:45:513
1808699339,4cyclictest2269-21fschecks_time07:55:221
1810199329,5cyclictest8050irq/56-dwc_otg_10:00:203
1810199329,4cyclictest0-21swapper/312:07:153
1810199327,7cyclictest8050irq/56-dwc_otg_11:05:253
1810199327,22cyclictest0-21swapper/307:45:183
1810199327,22cyclictest0-21swapper/307:45:183
18101993215,5cyclictest381ktimersoftd/308:22:243
18101993210,10cyclictest0-21swapper/311:22:563
1808699327,15cyclictest0-21swapper/109:05:201
1808699325,5cyclictest21798-21grep07:20:191
1808699323,4cyclictest8050irq/56-dwc_otg_07:30:261
18086993226,4cyclictest32531-21latency_hist07:50:071
18086993226,4cyclictest32531-21latency_hist07:50:071
1808699321,16cyclictest0-21swapper/109:51:001
174512322,21sleep10-21swapper/107:06:201
1810199312,6cyclictest7950irq/56-dwc_otg_08:55:283
1810199312,16cyclictest0-21swapper/307:55:063
1810199311,4cyclictest0-21swapper/309:37:123
1810199311,20cyclictest22719-21ls07:20:323
1810199311,19cyclictest15844-21rm09:31:253
1808699317,15cyclictest0-21swapper/107:15:201
18086993113,9cyclictest221ktimersoftd/108:59:271
1810199304,14cyclictest1947-21/usr/sbin/munin07:55:273
1810199302,3cyclictest7850irq/56-dwc_otg09:25:263
1810199302,3cyclictest7850irq/56-dwc_otg09:25:263
1810199302,12cyclictest7950irq/56-dwc_otg_08:50:163
1810199301,3cyclictest0-21swapper/310:55:213
1810199293,12cyclictest8050irq/56-dwc_otg_08:46:473
1808699296,7cyclictest221ktimersoftd/108:00:061
168912284,15sleep316924-21/usr/sbin/munin07:05:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional