You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 20:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Jun 26, 2026 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
519621760,5sleep32462399cyclictest09:11:153
24620991095,73cyclictest0-21swapper/011:30:330
246219910432,19cyclictest4240-21df_inode12:25:241
246219910432,19cyclictest4240-21df_inode12:25:241
24620991014,42cyclictest7850irq/56-dwc_otg12:25:250
24620991014,42cyclictest7850irq/56-dwc_otg12:25:250
2462099956,62cyclictest0-21swapper/008:15:210
24620998543,24cyclictest0-21swapper/009:00:180
220802820,3sleep324619-21cyclictest11:28:393
157952800,5sleep12462199cyclictest11:20:321
24621997930,12cyclictest7850irq/56-dwc_otg09:40:191
256702760,4sleep32462399cyclictest07:10:363
24621997654,15cyclictest23879-21memory11:30:311
24472750,2sleep20-21swapper/209:45:562
2462099711,23cyclictest0-21swapper/012:15:210
24621997026,23cyclictest9167-21latency_hist09:55:091
24621996929,13cyclictest7145-21rm11:50:091
24622996714,25cyclictest301ktimersoftd/212:25:242
24622996714,25cyclictest301ktimersoftd/212:25:242
24621996729,21cyclictest19906-21if_eth008:25:271
24621996628,20cyclictest9892-21taskset07:57:301
68522650,2sleep00-21swapper/007:50:210
24621996529,16cyclictest9396-21sh10:34:361
24621996529,16cyclictest9396-21sh10:34:361
24621996528,19cyclictest1012-21ssh11:02:531
24621996527,24cyclictest10352-21taskset11:14:511
24621996523,16cyclictest19465-21http12:05:081
24623996410,31cyclictest37-21rcuc/312:25:243
24623996410,31cyclictest37-21rcuc/312:25:243
24621996431,20cyclictest25383-21/usr/sbin/munin07:10:331
24621996429,14cyclictest27208-21/usr/sbin/munin07:15:371
24621996428,20cyclictest21101-21ssh10:48:221
24621996425,24cyclictest10006-21ssh12:31:401
24621996422,11cyclictest28411-21sed11:35:361
24621996422,11cyclictest28411-21sed11:35:361
24621996420,20cyclictest14019-21cat10:40:091
24621996320,12cyclictest3551-21ssh09:10:221
2462099631,51cyclictest31499-21aten_rbpower_cu11:40:200
24621996237,12cyclictest30720-21memory10:20:291
24621996229,13cyclictest19761-21dpkg12:05:091
24621996227,21cyclictest25984-21ssh10:54:331
24621996227,11cyclictest24443-21apt-get09:35:101
24621996225,22cyclictest13243-21/usr/sbin/munin08:05:371
24621996224,16cyclictest5574-21ssh11:08:391
24621996224,16cyclictest5574-21ssh11:08:391
24620996235,9cyclictest18004-21fschecks_time08:20:250
2462099623,37cyclictest0-21swapper/008:05:210
24621996126,16cyclictest14199-21ssh10:00:291
2462199612,11cyclictest0-21swapper/109:45:201
2462099613,48cyclictest28026-21kworker/0:110:00:090
24621996025,18cyclictest25484-21ssh10:14:521
24621996024,12cyclictest12242-21apt-get12:35:191
2462099601,48cyclictest9594-21sshd09:16:310
2462099601,48cyclictest9594-21sshd09:16:310
24621995929,14cyclictest3779-21ls07:40:291
24621995922,12cyclictest19355-21latency_hist08:25:091
24621995921,13cyclictest2938-21ssh10:25:361
24620995940,5cyclictest19553-21unixbench_multi10:45:380
24620995928,14cyclictest0-21swapper/009:30:330
24621995823,22cyclictest7950irq/56-dwc_otg_11:50:091
24621995822,16cyclictest3169-21diskmemload09:34:371
24621995821,19cyclictest1366-21aten_rbpower_cu07:35:211
24621995821,14cyclictest29776-21idleruntime-cro10:20:081
24620995831,14cyclictest21871-21grep08:30:300
2462099582,16cyclictest0-21swapper/011:10:090
2462099582,16cyclictest0-21swapper/011:10:090
2462099581,48cyclictest0-21swapper/011:05:000
2462099581,11cyclictest19579-21wget08:25:220
24621995728,16cyclictest18458-21ssh09:27:071
24621995726,17cyclictest10913-21ssh09:18:481
24621995726,17cyclictest10913-21ssh09:18:481
24621995725,18cyclictest30209-21sh12:16:591
24621995718,8cyclictest7850irq/56-dwc_otg11:00:081
2462099578,28cyclictest0-21swapper/008:50:080
24620995733,5cyclictest0-21swapper/009:40:350
24620995711,26cyclictest26258-21ssh10:15:250
292382560,2sleep329215-21ssh09:40:223
24621995628,13cyclictest19428-21ssh10:06:221
24621995627,12cyclictest15495-21ssh09:24:231
24621995624,21cyclictest20790-21ssh11:26:171
24621995616,15cyclictest6386-21chrt07:48:451
2462099563,27cyclictest11134-21fschecks_count11:15:250
24620995630,7cyclictest26180-21grep08:40:370
24620995630,7cyclictest26180-21grep08:40:370
2462099561,5cyclictest30532-21latency_hist11:00:080
2462399558,22cyclictest8050irq/56-dwc_otg_11:30:313
24621995527,11cyclictest13245-21ssh11:56:221
24621995527,11cyclictest13245-21ssh11:56:221
24621995526,20cyclictest13178-21ssh11:17:261
24621995526,12cyclictest26681-21latency_hist08:45:081
24621995526,12cyclictest26681-21latency_hist08:45:081
24621995526,12cyclictest14079-21rm10:40:121
24621995523,13cyclictest26987-21rm12:13:391
24621995522,12cyclictest31662-21taskset07:29:231
24621995522,12cyclictest31662-21taskset07:29:231
24620995533,5cyclictest7850irq/56-dwc_otg11:20:230
24620995512,36cyclictest0-21swapper/007:11:360
24621995426,13cyclictest2212-21ssh12:22:301
24621995422,10cyclictest0-21swapper/111:44:061
2462099542,28cyclictest11368-21latency_hist11:55:090
2462099541,6cyclictest7173-21grep10:30:350
2462099541,6cyclictest7173-21grep10:30:350
2462099541,29cyclictest6417-21grep09:50:370
24621995328,14cyclictest9333-21ssh09:55:091
24621995324,13cyclictest10408-21/usr/sbin/munin08:00:221
2462099536,25cyclictest0-21swapper/009:25:260
24620995326,12cyclictest28635-21unixbench_singl11:35:380
24620995326,12cyclictest28635-21unixbench_singl11:35:380
24620995325,13cyclictest7850irq/56-dwc_otg09:45:370
24620995318,19cyclictest727-21runrttasks12:10:270
2462099531,5cyclictest9650irq/80-mmc012:35:080
24621995222,14cyclictest28815-21cpuspeed08:50:231
24621995217,19cyclictest1309-21taskset09:04:441
2462099523,40cyclictest1003-21kworker/0:110:28:430
24620995226,5cyclictest30203-21aten_rbpower_cu07:25:200
24620995226,5cyclictest30203-21aten_rbpower_cu07:25:200
2462099521,28cyclictest12459-21ssh09:20:260
2462399513,17cyclictest28527-21ls08:50:083
2462099512,33cyclictest0-21swapper/012:05:090
2462099512,29cyclictest26319-21cron10:55:080
24620995120,6cyclictest3563-21aten_rbpower_cu09:10:220
2462099511,7cyclictest7850irq/56-dwc_otg12:05:190
24620995116,28cyclictest0-21swapper/008:35:210
2462099511,26cyclictest14686-21ssh10:40:280
2462199508,26cyclictest8050irq/56-dwc_otg_07:33:301
24621995029,12cyclictest24703-21sshd08:39:291
2462099502,24cyclictest12093-21ssh11:55:270
2462099502,24cyclictest12093-21ssh11:55:270
2462099502,24cyclictest0-21swapper/007:45:220
24620995015,31cyclictest0-21swapper/010:20:160
236062503,7sleep00-21swapper/007:05:360
2462299494,13cyclictest7850irq/56-dwc_otg08:55:192
24621994924,12cyclictest17412-21chrt08:19:531
24621994923,12cyclictest7850irq/56-dwc_otg09:10:081
24621994922,13cyclictest7950irq/56-dwc_otg_08:30:471
24620994926,13cyclictest0-21swapper/009:05:200
24620994925,5cyclictest0-21swapper/009:35:330
24620994924,4cyclictest28408-21aten_rbpower_cu07:20:220
24620994919,8cyclictest10349-21/usr/sbin/munin08:00:180
2462099491,34cyclictest2461-21unixbench_multi07:35:360
2462099491,14cyclictest0-21swapper/012:20:290
24621994817,13cyclictest29605-21runrttasks07:21:071
24620994831,3cyclictest0-21swapper/010:10:210
24620994824,5cyclictest14152-21aten_rbpower_po08:10:220
2462099481,26cyclictest0-21swapper/007:30:350
294192470,1sleep20-21swapper/211:37:002
294192470,1sleep20-21swapper/211:37:002
2462399477,25cyclictest0-21swapper/307:45:233
2462399477,25cyclictest0-21swapper/307:15:253
24621994720,12cyclictest505-21cron08:45:091
24620994729,4cyclictest7950irq/56-dwc_otg_10:05:230
2462099472,30cyclictest0-21swapper/007:40:350
2462099472,24cyclictest0-21swapper/011:25:240
24620994715,20cyclictest0-21swapper/011:11:230
2462399465,19cyclictest8050irq/56-dwc_otg_11:00:143
2462299463,24cyclictest0-21swapper/211:30:322
24621994621,9cyclictest0-21swapper/107:50:371
24621994615,21cyclictest7950irq/56-dwc_otg_08:58:531
24620994625,9cyclictest0-21swapper/010:01:350
24620994611,15cyclictest0-21swapper/010:35:210
24621994521,12cyclictest0-21swapper/108:11:261
2462099452,15cyclictest0-21swapper/007:20:080
2462099451,28cyclictest3490-21fschecks_time11:45:250
2462099451,27cyclictest0-21swapper/007:55:350
172422450,1sleep30-21swapper/312:01:083
2462299442,9cyclictest0-21swapper/207:55:232
2462299442,4cyclictest0-21swapper/211:50:182
24620994428,4cyclictest7950irq/56-dwc_otg_12:40:080
24620994316,16cyclictest0-21swapper/008:57:280
2462099431,4cyclictest0-21swapper/008:50:280
2462399427,22cyclictest0-21swapper/310:05:213
149982420,4sleep2774-21lldpd09:23:302
248182410,2sleep30-21swapper/310:13:393
2462299417,5cyclictest8050irq/56-dwc_otg_11:10:202
24622994120,5cyclictest21494-21sh10:10:082
24622994114,5cyclictest2446450http09:35:082
24622994021,4cyclictest2844-21sh11:05:242
24622994021,4cyclictest2844-21sh11:05:242
24623993924,5cyclictest1576450ssh10:02:133
24622993931,6cyclictest8050irq/56-dwc_otg_12:10:202
2462399389,12cyclictest3169-21diskmemload11:51:573
2462399382,23cyclictest32084-21ls12:20:093
24623993816,7cyclictest0-21swapper/311:20:363
2462299382,5cyclictest25509-21ls08:40:282
2462299382,5cyclictest25509-21ls08:40:282
24622993813,5cyclictest18789-21if_wlan010:45:282
2462399375,20cyclictest3175-21ssh11:45:213
2462399372,18cyclictest0-21swapper/309:00:213
24623993720,10cyclictest3169-21diskmemload10:30:363
24623993720,10cyclictest3169-21diskmemload10:30:363
24623993720,10cyclictest10485-21ssh10:35:273
24623993716,12cyclictest3169-21diskmemload09:25:293
2462299373,5cyclictest8050irq/56-dwc_otg_11:25:202
24622993712,4cyclictest0-21swapper/212:20:262
2462399368,10cyclictest8050irq/56-dwc_otg_12:30:243
2462299364,11cyclictest0-21swapper/211:03:352
2462299362,3cyclictest8050irq/56-dwc_otg_08:30:212
24622993620,4cyclictest6749-21apt-get07:50:182
24622993618,10cyclictest0-21swapper/207:15:282
110012360,2sleep20-21swapper/209:56:032
2462399359,17cyclictest3169-21diskmemload10:48:303
2462399357,23cyclictest0-21swapper/309:05:203
2462399355,27cyclictest8050irq/56-dwc_otg_09:55:213
2462399354,20cyclictest28659-21fschecks_time07:20:263
24623993525,7cyclictest13838-21apt-config08:10:093
24623993515,12cyclictest17714-21hostname08:20:213
24623993510,14cyclictest0-21swapper/309:20:273
2462299359,5cyclictest8050irq/56-dwc_otg_10:10:252
2462299359,11cyclictest0-21swapper/211:55:362
2462299359,11cyclictest0-21swapper/211:55:362
2462299357,5cyclictest8050irq/56-dwc_otg_07:10:222
24622993514,6cyclictest29-21rcuc/208:25:202
24622993514,4cyclictest0-21swapper/209:15:322
24622993514,4cyclictest0-21swapper/209:15:322
2462299351,23cyclictest16242-21ls12:40:092
2462299351,12cyclictest7850irq/56-dwc_otg10:45:082
2462299351,10cyclictest0-21swapper/209:00:182
2462399345,5cyclictest0-21swapper/307:35:363
2462399343,26cyclictest7950irq/56-dwc_otg_09:35:203
24623993416,4cyclictest8901-21timerwakeupswit09:15:363
24623993416,4cyclictest8901-21timerwakeupswit09:15:363
2462399341,23cyclictest30762-21missed_timers07:25:283
2462399341,23cyclictest30762-21missed_timers07:25:283
24623993412,11cyclictest22028-21rm12:07:093
24623993411,13cyclictest0-21swapper/312:13:393
24623993410,4cyclictest0-21swapper/310:20:373
2462299348,5cyclictest7850irq/56-dwc_otg09:25:352
2462299346,7cyclictest7950irq/56-dwc_otg_07:30:232
2462299342,13cyclictest31450-21ssh11:40:182
2462299341,20cyclictest7950irq/56-dwc_otg_11:22:182
24622993410,8cyclictest7950irq/56-dwc_otg_08:10:252
243332346,19sleep2750-21snmpd07:09:552
34322330,2sleep229-21rcuc/207:40:252
2462399338,5cyclictest7850irq/56-dwc_otg10:50:283
2462399337,23cyclictest0-21swapper/311:55:203
2462399337,23cyclictest0-21swapper/311:55:203
2462399337,12cyclictest8050irq/56-dwc_otg_12:20:303
24623993320,6cyclictest13030-21sh12:35:313
2462299333,9cyclictest0-21swapper/210:30:172
2462299333,9cyclictest0-21swapper/210:30:172
24622993316,4cyclictest11391-21kernelversion11:15:282
2462299331,29cyclictest29546-21ls09:40:262
24622993310,10cyclictest7950irq/56-dwc_otg_08:05:242
2462399329,4cyclictest0-21swapper/309:53:193
2462399323,5cyclictest8050irq/56-dwc_otg_07:30:373
2462399322,4cyclictest0-21swapper/311:40:203
2462399322,22cyclictest0-21swapper/307:55:383
24623993218,4cyclictest5182-21ssh11:07:563
24623993218,4cyclictest5182-21ssh11:07:563
24623993214,9cyclictest17447-21cron08:20:083
2462399321,22cyclictest0-21swapper/308:37:023
2462299328,4cyclictest7950irq/56-dwc_otg_07:45:212
2462299328,10cyclictest0-21swapper/210:58:252
2462299325,5cyclictest7950irq/56-dwc_otg_08:35:372
2462299322,6cyclictest23749-21sed10:50:382
2462299322,17cyclictest0-21swapper/207:25:312
2462299322,17cyclictest0-21swapper/207:25:312
24622993219,4cyclictest31-21ksoftirqd/210:25:362
2462299321,6cyclictest845-21rm10:24:052
2462299321,5cyclictest7950irq/56-dwc_otg_10:35:232
24622993214,6cyclictest27135-21chrt09:37:152
2462399318,13cyclictest0-21swapper/311:35:363
2462399318,13cyclictest0-21swapper/311:35:363
2462399316,12cyclictest7950irq/56-dwc_otg_09:45:333
2462399312,9cyclictest0-21swapper/310:58:223
2462399311,19cyclictest0-21swapper/307:55:023
2462299318,15cyclictest8050irq/56-dwc_otg_12:05:382
2462299316,10cyclictest7950irq/56-dwc_otg_10:20:092
2462299314,6cyclictest7850irq/56-dwc_otg09:10:352
24622993118,11cyclictest8050irq/56-dwc_otg_10:01:482
2462299311,14cyclictest8050irq/56-dwc_otg_11:48:342
2462399308,14cyclictest0-21swapper/310:25:333
2462399307,15cyclictest0-21swapper/308:00:343
2462399306,15cyclictest0-21swapper/310:40:213
2462399303,23cyclictest8050irq/56-dwc_otg_08:25:193
2462399301,20cyclictest0-21swapper/311:10:353
24623993010,4cyclictest0-21swapper/309:30:323
2462299309,7cyclictest0-21swapper/208:00:222
2462299309,4cyclictest0-21swapper/212:03:102
2462299307,5cyclictest7950irq/56-dwc_otg_08:20:292
2462299307,21cyclictest0-21swapper/207:35:212
2462299305,11cyclictest8050irq/56-dwc_otg_09:05:252
24622993012,5cyclictest9404-21unixbench_singl12:30:362
24622993010,4cyclictest0-21swapper/209:54:432
2462399299,3cyclictest0-21swapper/311:19:213
2462399291,20cyclictest0-21swapper/308:50:113
2462299299,4cyclictest31-21ksoftirqd/208:50:362
24622992923,4cyclictest31-21ksoftirqd/208:15:362
2462399286,15cyclictest25998-21timerwakeupswit08:40:363
2462399286,15cyclictest25998-21timerwakeupswit08:40:363
2462399282,4cyclictest7850irq/56-dwc_otg10:15:233
24623992817,4cyclictest30423-21/usr/sbin/munin08:55:303
2462399281,21cyclictest0-21swapper/308:14:483
2462299286,6cyclictest28653-21tune2fs07:20:252
2462299281,13cyclictest8050irq/56-dwc_otg_12:17:382
2462399272,15cyclictest0-21swapper/308:30:253
2462399271,4cyclictest750-21snmpd07:43:233
2462299278,11cyclictest24619-21cyclictest08:45:332
241322279,12sleep10-21swapper/107:07:271
242112263,15sleep30-21swapper/307:08:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional