You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 20:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Fri Jun 12, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1699821790,5sleep32581199cyclictest10:01:333
2580899912,26cyclictest0-21swapper/010:55:140
2580899912,26cyclictest0-21swapper/010:55:140
25808998431,3cyclictest0-21swapper/011:35:290
16032780,2sleep30-21swapper/307:30:303
292032740,5sleep02580899cyclictest09:38:390
2580999733,53cyclictest12202-21ssh12:29:231
2580999722,41cyclictest0-21swapper/112:35:261
16302720,1sleep10-21swapper/111:00:171
2580999702,49cyclictest8050irq/56-dwc_otg_10:20:011
2580999701,53cyclictest22175-21ssh10:08:081
2580999691,48cyclictest7850irq/56-dwc_otg10:46:271
2580999691,47cyclictest16850-21/usr/sbin/munin10:40:301
2580999689,40cyclictest29911-21seq09:39:521
2580999671,50cyclictest29453-21apt-get07:20:131
25809996613,41cyclictest29466-21latency_hist10:55:021
2580999657,42cyclictest7850irq/56-dwc_otg08:40:151
2580999655,44cyclictest8050irq/56-dwc_otg_11:33:011
2580999653,44cyclictest8050irq/56-dwc_otg_08:13:581
2580999642,43cyclictest0-21swapper/111:12:161
2580999641,52cyclictest22698-21ssh12:02:281
2580999641,4cyclictest7850irq/56-dwc_otg10:20:221
2580999641,48cyclictest125-21systemd-journal07:38:241
2580999641,37cyclictest0-21swapper/112:24:361
176422640,4sleep2301ktimersoftd/208:15:212
2580999633,43cyclictest7850irq/56-dwc_otg07:40:201
2580999631,43cyclictest21667-21chrt11:23:361
197982630,1sleep30-21swapper/312:38:053
2580999624,43cyclictest18088-21ssh11:19:471
2580999623,44cyclictest7850irq/56-dwc_otg08:05:201
2580999622,43cyclictest0-21swapper/110:11:041
25808996232,5cyclictest7950irq/56-dwc_otg_08:40:310
2580999614,41cyclictest8050irq/56-dwc_otg_09:45:261
2580999613,43cyclictest7058-21ssh09:12:151
2580999613,39cyclictest32485-21http12:15:011
2580999612,39cyclictest0-21swapper/109:32:341
2580999611,4cyclictest7850irq/56-dwc_otg09:40:191
2580999611,48cyclictest0-21swapper/110:55:141
2580999611,48cyclictest0-21swapper/110:55:141
25808996139,5cyclictest12960-21wget12:30:140
2580999604,31cyclictest8050irq/56-dwc_otg_08:50:241
2580999604,31cyclictest8050irq/56-dwc_otg_08:50:241
2580999603,49cyclictest5351-21ssh11:41:571
2580999603,37cyclictest8050irq/56-dwc_otg_11:30:021
2580999603,37cyclictest8050irq/56-dwc_otg_11:30:021
2580999602,44cyclictest0-21swapper/109:29:211
2580999601,5cyclictest4256-21cron12:20:011
2580999601,39cyclictest6347-21df_inode07:45:171
25808996019,24cyclictest23269-21idleruntime-cro10:10:010
2580999593,53cyclictest22715-21aten_rbpower_vo08:30:161
2580999592,38cyclictest0-21swapper/107:35:021
2580999591,44cyclictest9652-21sed09:15:231
25808995935,7cyclictest7850irq/56-dwc_otg09:10:010
2580999584,39cyclictest8050irq/56-dwc_otg_09:20:441
2580999583,41cyclictest8050irq/56-dwc_otg_10:40:011
2580999583,35cyclictest6432-21/usr/sbin/munin09:50:201
2580999583,31cyclictest7850irq/56-dwc_otg12:32:191
2580999582,44cyclictest32602-21grep11:35:291
2580999582,43cyclictest8050irq/56-dwc_otg_09:59:381
2580999581,45cyclictest0-21swapper/110:28:581
2580999581,42cyclictest28063-21runrttasks08:45:151
2580899581,37cyclictest0-21swapper/010:35:180
2581199573,14cyclictest4077-21ssh10:25:113
2581099577,28cyclictest0-21swapper/211:45:142
2580999573,39cyclictest0-21swapper/110:02:071
2580999571,40cyclictest0-21swapper/112:08:481
2580999571,39cyclictest0-21swapper/111:50:241
2580899572,53cyclictest0-21swapper/009:25:130
2580899572,35cyclictest0-21swapper/008:55:120
2580999563,41cyclictest0-21swapper/108:56:231
2580999563,36cyclictest518-21rs:main1
2580999562,8cyclictest0-21swapper/108:00:111
2580999561,34cyclictest0-21swapper/109:09:411
2580999561,2cyclictest0-21swapper/110:31:301
2580899567,14cyclictest0-21swapper/007:35:160
2580899563,50cyclictest3463-21unixbench_singl09:45:290
2580999552,41cyclictest0-21swapper/107:16:321
25809995510,40cyclictest26993-21unixbench_singl07:10:291
25808995538,5cyclictest26925-21latency_hist11:30:020
25808995538,5cyclictest26925-21latency_hist11:30:020
2580899553,29cyclictest0-21swapper/011:45:120
25808995532,5cyclictest31906-21cron10:20:010
25808995529,2cyclictest0-21swapper/010:30:120
25808995524,19cyclictest11759-21aten_rbpower_cu11:50:160
2580899552,28cyclictest0-21swapper/009:10:120
2581199547,7cyclictest8050irq/56-dwc_otg_09:50:163
2580999545,30cyclictest0-21swapper/111:48:231
2580899542,44cyclictest0-21swapper/008:50:020
25808995420,4cyclictest5998-21latency_hist07:45:020
25808995420,4cyclictest0-21swapper/009:30:130
25808995420,22cyclictest7950irq/56-dwc_otg_10:00:200
2580899541,34cyclictest0-21swapper/011:00:250
124552540,2sleep20-21swapper/209:19:132
25942530,2sleep30-21swapper/311:39:363
2580999531,2cyclictest0-21swapper/111:55:121
2580899536,37cyclictest0-21swapper/008:00:140
2580899531,30cyclictest4463-21ssh10:25:180
2580999523,36cyclictest7850irq/56-dwc_otg07:55:271
25808995229,5cyclictest29565-21wget07:20:160
25808995227,5cyclictest25547-21aten_rbpower_vo10:50:150
25808995217,22cyclictest10878-21grep11:10:250
2580899521,5cyclictest1832-21munin-plugin-st09:45:010
2580899521,37cyclictest16363-21fschecks_time11:55:180
2581099511,4cyclictest0-21swapper/207:25:152
2580999511,4cyclictest20047-21ls08:20:291
2580899512,32cyclictest0-21swapper/007:55:210
2580899512,21cyclictest0-21swapper/012:25:120
2580899511,31cyclictest28334-21unixbench_multi11:30:280
249772510,3sleep024983-21timerwakeupswit07:05:290
2580999508,39cyclictest31428-21cpuspeed07:25:191
2580999501,39cyclictest7850irq/56-dwc_otg09:01:321
2580899502,32cyclictest0-21swapper/007:45:190
25808995013,4cyclictest11439-21sh09:17:260
2580899501,26cyclictest4459-21sed11:40:300
2580999491,4cyclictest17170-21apt-get08:15:141
2580999491,3cyclictest0-21swapper/107:50:131
25808994924,5cyclictest29921-21aten_rbpower_po08:50:160
25808994924,5cyclictest29921-21aten_rbpower_po08:50:160
25808994921,16cyclictest28757-21aten_rbpower_vo12:10:140
25808994917,22cyclictest0-21swapper/008:16:070
2580899491,4cyclictest10465-21taskset09:55:020
2580899491,27cyclictest5852-21ssh11:05:130
2580899491,27cyclictest125-21systemd-journal10:49:020
2580999481,6cyclictest0-21swapper/108:25:141
25808994831,5cyclictest7850irq/56-dwc_otg07:10:230
25808994826,5cyclictest7950irq/56-dwc_otg_10:10:100
25808994823,5cyclictest20914-21ssh10:45:010
2580899481,4cyclictest14368-21aten_rbpower_po11:15:130
2580899481,34cyclictest17534-21if_wlan012:35:180
2581199476,6cyclictest8050irq/56-dwc_otg_08:55:123
2581199472,23cyclictest8050irq/56-dwc_otg_09:25:153
2581099472,7cyclictest31-21ksoftirqd/211:20:262
2581099471,8cyclictest0-21swapper/211:40:132
2580999471,2cyclictest0-21swapper/108:35:261
25808994725,12cyclictest0-21swapper/011:22:310
2580899472,29cyclictest0-21swapper/007:15:190
25808994720,4cyclictest0-21swapper/012:05:010
2581099467,24cyclictest0-21swapper/208:00:142
25808994623,14cyclictest16328-21sed08:10:310
2580899461,31cyclictest0-21swapper/012:06:120
2580899461,23cyclictest727-21runrttasks09:55:040
2580899460,3cyclictest440-21ssh12:15:140
2581199452,10cyclictest2553-21timerandwakeup11:00:293
2581099457,25cyclictest0-21swapper/207:30:072
2581099457,24cyclictest0-21swapper/207:55:072
2581099457,23cyclictest0-21swapper/210:15:142
2581099451,5cyclictest8050irq/56-dwc_otg_09:55:122
25810994514,11cyclictest61-21kswapd011:25:112
25810994514,11cyclictest61-21kswapd011:25:112
25808994528,5cyclictest7950irq/56-dwc_otg_08:10:010
25808994524,4cyclictest24728-21fschecks_time08:35:180
25808994514,15cyclictest8376-21iwlist07:50:210
2581099447,23cyclictest0-21swapper/209:00:152
2581099447,22cyclictest0-21swapper/209:05:152
2581099441,4cyclictest7850irq/56-dwc_otg10:55:132
2581099441,4cyclictest7850irq/56-dwc_otg10:55:132
2580899445,23cyclictest9-21ksoftirqd/012:20:260
2580899443,10cyclictest7850irq/56-dwc_otg10:20:120
25808994420,14cyclictest13251-21/usr/sbin/munin09:20:280
2580899441,30cyclictest0-21swapper/007:30:300
2581199437,24cyclictest0-21swapper/308:45:143
2581099437,22cyclictest0-21swapper/208:55:142
25808994325,4cyclictest7950irq/56-dwc_otg_08:25:230
25811994234,4cyclictest28668-21rm12:10:133
2581099426,22cyclictest0-21swapper/212:15:072
25810994219,13cyclictest0-21swapper/212:30:132
2581099421,11cyclictest8050irq/56-dwc_otg_10:00:142
2581199417,21cyclictest0-21swapper/307:15:153
2581199414,5cyclictest0-21swapper/310:20:123
2581199412,20cyclictest7950irq/56-dwc_otg_12:15:223
2580899413,22cyclictest0-21swapper/009:00:200
2581199405,30cyclictest7464-21ssh11:45:143
2581199401,5cyclictest0-21swapper/311:10:143
2581099404,23cyclictest61-21kswapd011:35:122
25810994012,7cyclictest24930-21unixbench_multi10:10:282
2580899401,29cyclictest0-21swapper/008:30:230
2580899401,23cyclictest367-21basename07:30:010
2580899401,22cyclictest0-21swapper/008:20:120
77222390,2sleep20-21swapper/207:50:012
2581199397,26cyclictest0-21swapper/307:35:163
2581199391,24cyclictest10362-21latency07:55:193
2581099397,22cyclictest0-21swapper/209:40:142
2581099397,20cyclictest0-21swapper/207:10:142
2581099394,11cyclictest31-21ksoftirqd/209:15:012
242482395,22sleep224344-21/usr/sbin/munin07:05:202
2581199387,21cyclictest0-21swapper/308:40:153
2581199382,6cyclictest8050irq/56-dwc_otg_07:40:153
25811993815,5cyclictest15028-21idleruntime-cro08:10:013
2581199381,24cyclictest29721-21ssh10:55:163
2581199381,24cyclictest29721-21ssh10:55:163
2581099387,20cyclictest31-21ksoftirqd/212:20:222
2581099386,18cyclictest31-21ksoftirqd/212:05:212
25810993818,17cyclictest18066-21sh10:40:292
25810993816,4cyclictest7850irq/56-dwc_otg11:00:252
25810993811,4cyclictest31-21ksoftirqd/210:05:152
2581199379,12cyclictest0-21swapper/309:55:253
2581199378,16cyclictest0-21swapper/308:20:153
2581199376,26cyclictest727-21runrttasks12:30:133
2581199371,21cyclictest6699-21missed_timers07:45:233
25810993718,5cyclictest8500-21ssh10:30:142
188712370,2sleep20-21swapper/212:36:232
2581199365,5cyclictest7950irq/56-dwc_otg_12:00:153
2581199361,20cyclictest18390-21ls11:20:023
2581199361,11cyclictest0-21swapper/310:40:143
2581099367,5cyclictest7850irq/56-dwc_otg10:25:022
2581099366,7cyclictest7850irq/56-dwc_otg12:10:102
2581099365,16cyclictest7950irq/56-dwc_otg_08:20:292
2581099361,3cyclictest0-21swapper/212:25:122
25810993613,14cyclictest0-21swapper/210:35:162
2581099361,23cyclictest2389-21ls09:45:162
2581199359,12cyclictest26077-21ssh09:35:133
2581099357,12cyclictest8050irq/56-dwc_otg_11:55:182
2581099353,17cyclictest8050irq/56-dwc_otg_09:35:112
2581099352,8cyclictest29-21rcuc/207:38:172
25810993510,12cyclictest28068-21cat11:30:262
25810993510,12cyclictest0-21swapper/209:25:472
2581199349,12cyclictest28240-21timerwakeupswit11:30:283
2581199349,11cyclictest0-21swapper/310:51:333
2581199348,16cyclictest0-21swapper/309:15:153
2581199346,4cyclictest0-21swapper/311:55:183
2581199344,15cyclictest8050irq/56-dwc_otg_10:30:263
2581199342,6cyclictest8050irq/56-dwc_otg_11:40:213
2581199342,25cyclictest8050irq/56-dwc_otg_10:15:133
2581099342,5cyclictest13305-21aten_rbpower_cu09:20:152
25810993414,6cyclictest31402-21apt08:55:012
25810993414,6cyclictest31402-21apt08:55:012
2581099341,22cyclictest22957-21ls08:30:192
2581099341,14cyclictest29-21rcuc/211:50:202
2581099341,12cyclictest8050irq/56-dwc_otg_10:45:572
249382340,4sleep224397-21/usr/sbin/munin08:35:222
245062345,16sleep10-21swapper/107:05:231
261162330,5sleep32581199cyclictest07:10:173
2581199332,19cyclictest7950irq/56-dwc_otg_09:46:393
2581199331,5cyclictest8050irq/56-dwc_otg_09:35:013
25811993313,4cyclictest4366-21diskmemload10:06:133
25811993312,4cyclictest7950irq/56-dwc_otg_11:20:553
25810993311,10cyclictest0-21swapper/211:10:202
2581199328,11cyclictest0-21swapper/311:51:433
2581199327,10cyclictest7950irq/56-dwc_otg_11:09:183
2581199327,10cyclictest7950irq/56-dwc_otg_10:10:143
2581199325,4cyclictest7950irq/56-dwc_otg_09:45:023
2581199323,15cyclictest0-21swapper/308:50:143
2581199323,15cyclictest0-21swapper/308:50:143
25811993218,4cyclictest8050irq/56-dwc_otg_12:28:403
25811993211,5cyclictest8050irq/56-dwc_otg_10:40:013
25811993210,5cyclictest0-21swapper/307:20:193
2581099328,13cyclictest0-21swapper/210:25:112
2581099326,11cyclictest8050irq/56-dwc_otg_08:45:172
2581099326,11cyclictest7950irq/56-dwc_otg_11:15:142
2581099325,7cyclictest7950irq/56-dwc_otg_12:00:302
2581099325,12cyclictest8050irq/56-dwc_otg_09:50:302
2581099322,4cyclictest6931-21/usr/sbin/munin11:05:272
25810993223,6cyclictest25484-21aten_rbpower_en10:50:152
2581099321,21cyclictest21078-21grep08:25:192
2581099321,13cyclictest7950irq/56-dwc_otg_08:40:162
25810993211,13cyclictest7950irq/56-dwc_otg_09:30:182
2581199317,4cyclictest0-21swapper/311:27:343
2581199317,4cyclictest0-21swapper/311:27:343
2581199316,9cyclictest0-21swapper/309:14:203
2581199316,15cyclictest0-21swapper/308:00:133
2581199313,10cyclictest7950irq/56-dwc_otg_09:05:193
2581199312,12cyclictest8050irq/56-dwc_otg_09:05:013
2581199312,10cyclictest0-21swapper/310:45:183
25811993111,6cyclictest0-21swapper/309:21:543
2581199307,13cyclictest0-21swapper/312:20:153
2581199304,15cyclictest8050irq/56-dwc_otg_07:25:323
2581199304,11cyclictest7950irq/56-dwc_otg_07:50:073
2581199303,4cyclictest8050irq/56-dwc_otg_08:35:203
2581099301,8cyclictest4449-21cut07:40:172
2581199297,9cyclictest7950irq/56-dwc_otg_08:28:343
2581199293,13cyclictest8050irq/56-dwc_otg_08:19:143
25811992919,8cyclictest8050irq/56-dwc_otg_12:07:133
2581199283,5cyclictest8050irq/56-dwc_otg_08:10:213
2581199281,5cyclictest0-21swapper/308:30:223
2581099284,5cyclictest7850irq/56-dwc_otg07:50:212
2581099281,6cyclictest7850irq/56-dwc_otg08:05:272
2581099281,6cyclictest29352-21cat07:20:022
2581099281,20cyclictest29440-21/usr/sbin/munin07:20:202
2581099271,6cyclictest7950irq/56-dwc_otg_08:10:172
249022274,13sleep324973-21/usr/sbin/munin07:05:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional