You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 22:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Jul 06, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2778621050,3sleep00-21swapper/009:32:270
2778621050,3sleep00-21swapper/009:32:270
29620999755,24cyclictest16925-21diskmemload09:20:270
220272900,2sleep32962399cyclictest10:04:553
220272900,2sleep32962399cyclictest10:04:553
2962099881,39cyclictest0-21swapper/008:55:250
2962099861,15cyclictest0-21swapper/009:47:380
29620998518,46cyclictest7950irq/56-dwc_otg_12:00:410
2962099851,32cyclictest0-21swapper/011:20:250
29620998427,9cyclictest0-21swapper/011:55:270
2962099841,49cyclictest0-21swapper/009:15:250
2962099838,48cyclictest0-21swapper/010:25:270
29620998220,45cyclictest3888-21latency_hist11:40:140
2962099821,40cyclictest0-21swapper/010:40:240
29620998123,39cyclictest6408-21aten_rbpower_cu09:05:270
234642810,4sleep123463-21/usr/sbin/munin10:05:381
29620997918,48cyclictest21164-21latency08:15:350
59492770,5sleep09-21ksoftirqd/012:20:400
2962099774,23cyclictest13274-21ssh12:30:270
29620997721,39cyclictest9917-21/usr/sbin/munin07:45:280
29620997721,39cyclictest9917-21/usr/sbin/munin07:45:280
29620997618,39cyclictest0-21swapper/011:25:350
26482760,2sleep30-21swapper/312:16:403
232352760,3sleep223238-21proc_pri08:20:402
2962099756,38cyclictest0-21swapper/009:25:230
29620997521,39cyclictest13922-21latency_hist09:55:140
2962099751,40cyclictest0-21swapper/008:30:250
2962099751,40cyclictest0-21swapper/008:30:250
2962099751,34cyclictest0-21swapper/007:25:260
123252750,3sleep312328-21wc11:10:343
29620997327,14cyclictest0-21swapper/008:40:270
29620997216,6cyclictest30118-21kernelversion07:10:350
2962099721,55cyclictest394-21rm10:55:420
220102720,4sleep121-21rcuc/110:43:341
2962099705,51cyclictest7772-21fschecks_count11:05:300
2962099705,45cyclictest0-21swapper/010:50:130
179902690,2sleep00-21swapper/010:00:050
2962099681,55cyclictest0-21swapper/007:59:020
29620996812,4cyclictest7850irq/56-dwc_otg11:55:140
2962099681,16cyclictest0-21swapper/012:25:390
30982670,6sleep23099-21cut11:00:142
2962099672,13cyclictest0-21swapper/010:05:310
29620996719,37cyclictest0-21swapper/010:30:270
2962099671,56cyclictest0-21swapper/012:35:260
2962099671,18cyclictest0-21swapper/010:35:340
2962099671,17cyclictest0-21swapper/010:51:150
2962099661,50cyclictest4374-21ssh10:21:380
29620996610,43cyclictest0-21swapper/011:46:270
29620996610,43cyclictest0-21swapper/011:46:270
2962099652,47cyclictest0-21swapper/010:18:410
2962099651,50cyclictest30058-21ssh11:31:240
2962099651,49cyclictest0-21swapper/011:40:340
2962099651,15cyclictest0-21swapper/009:10:590
191702650,2sleep30-21swapper/311:19:153
29621996416,25cyclictest16654-21ssh11:55:271
29620996432,17cyclictest5643-21cat09:45:140
29620996414,41cyclictest0-21swapper/009:38:570
29620996411,42cyclictest0-21swapper/010:01:250
29620996411,42cyclictest0-21swapper/010:01:250
2962099641,13cyclictest0-21swapper/007:30:290
2962099639,45cyclictest26766-21aten_rbpower_en10:10:270
29620996317,36cyclictest0-21swapper/007:37:210
2962099631,16cyclictest26654-21rm12:06:260
29620996311,2cyclictest0-21swapper/007:40:250
2962199624,6cyclictest7850irq/56-dwc_otg07:55:271
29620996224,24cyclictest0-21swapper/008:50:260
29620996211,39cyclictest0-21swapper/011:18:560
29620996120,29cyclictest0-21swapper/011:14:050
2962099611,17cyclictest0-21swapper/011:02:310
29620996111,2cyclictest0-21swapper/012:15:140
29620996016,33cyclictest0-21swapper/008:01:490
2962099601,19cyclictest0-21swapper/012:16:450
29621995814,23cyclictest0-21swapper/108:55:251
2962099588,11cyclictest0-21swapper/008:10:260
2962099585,4cyclictest9550irq/48-DMA15:26:470
2962099585,4cyclictest9550irq/48-DMA15:26:470
2962299577,15cyclictest0-21swapper/211:10:192
2962099572,44cyclictest0-21swapper/007:50:510
2962099561,33cyclictest24376-21aten_rbpower_po08:25:280
2962099561,31cyclictest22471-21/usr/sbin/munin08:20:300
2962099561,29cyclictest0-21swapper/008:45:250
29621995516,6cyclictest8050irq/56-dwc_otg_09:30:251
29621995516,6cyclictest8050irq/56-dwc_otg_09:30:251
29620995524,10cyclictest0-21swapper/008:35:260
2962099551,14cyclictest0-21swapper/007:15:500
2962099532,15cyclictest0-21swapper/008:07:390
29620995231,5cyclictest1583-21proc_pri07:20:370
2962199507,27cyclictest0-21swapper/108:30:251
2962199507,27cyclictest0-21swapper/108:30:251
2962199502,8cyclictest7950irq/56-dwc_otg_07:45:251
2962199502,8cyclictest7950irq/56-dwc_otg_07:45:251
29621995023,5cyclictest7850irq/56-dwc_otg09:15:251
29621994925,22cyclictest7945-21diskmemload10:10:261
29621994921,20cyclictest14620-21kworker/u8:010:50:201
29621994911,23cyclictest7850irq/56-dwc_otg11:30:311
29621994910,13cyclictest7850irq/56-dwc_otg08:20:251
29621994829,15cyclictest7945-21diskmemload09:45:241
316382470,8sleep32962399cyclictest08:45:283
2962299472,7cyclictest7850irq/56-dwc_otg09:50:262
2962199471,5cyclictest7950irq/56-dwc_otg_10:25:271
2962299467,25cyclictest0-21swapper/207:35:272
2962199467,25cyclictest0-21swapper/108:25:271
2962199464,34cyclictest8050irq/56-dwc_otg_08:15:141
2962199457,24cyclictest0-21swapper/107:20:251
29621994517,13cyclictest8050irq/56-dwc_otg_11:25:311
109992450,4sleep3381ktimersoftd/309:13:023
2962199446,18cyclictest7850irq/56-dwc_otg07:10:321
2962199444,10cyclictest7950irq/56-dwc_otg_09:11:151
2962199443,6cyclictest0-21swapper/110:00:241
2962199443,6cyclictest0-21swapper/110:00:241
29621994423,9cyclictest7850irq/56-dwc_otg12:34:561
29621994418,15cyclictest7850irq/56-dwc_otg11:45:581
29621994418,15cyclictest7850irq/56-dwc_otg11:45:581
29621994411,11cyclictest8050irq/56-dwc_otg_12:00:361
225472440,5sleep32962399cyclictest10:05:233
2962299437,24cyclictest0-21swapper/208:30:262
2962299437,24cyclictest0-21swapper/208:30:262
2962299431,13cyclictest26597-21timerwakeupswit09:30:412
2962299431,13cyclictest26597-21timerwakeupswit09:30:412
29621994319,9cyclictest8050irq/56-dwc_otg_10:16:021
29621994317,15cyclictest7850irq/56-dwc_otg12:09:351
29621994316,10cyclictest7950irq/56-dwc_otg_11:40:331
29621994314,12cyclictest221ktimersoftd/109:55:401
29621994310,8cyclictest0-21swapper/111:20:251
29622994221,13cyclictest0-21swapper/212:05:282
29621994210,8cyclictest8050irq/56-dwc_otg_09:20:261
2962299417,25cyclictest0-21swapper/209:11:162
2962299414,5cyclictest2566-21ssh10:20:272
2962299412,9cyclictest15237-21fschecks_count10:35:302
2962199417,23cyclictest0-21swapper/109:05:271
2962199417,13cyclictest20665-21apt-get08:15:271
29621994110,11cyclictest7950irq/56-dwc_otg_11:54:211
324052400,3sleep3381ktimersoftd/310:55:363
2962199408,10cyclictest10350-21ssh11:08:301
2962199406,14cyclictest18096-21ssh10:38:591
29621994018,9cyclictest8050irq/56-dwc_otg_09:25:221
29621994011,12cyclictest10820-21/usr/sbin/munin10:30:391
20482400,1sleep30-21swapper/311:36:543
2962399395,23cyclictest7950irq/56-dwc_otg_10:25:303
29623993931,3cyclictest7950irq/56-dwc_otg_07:40:263
2962399392,14cyclictest0-21swapper/308:20:263
2962299396,24cyclictest0-21swapper/210:50:192
2962199395,7cyclictest0-21swapper/107:25:261
2962199393,10cyclictest0-21swapper/109:50:511
29621993918,10cyclictest10811-21ssh12:26:251
29621993916,6cyclictest7950irq/56-dwc_otg_08:43:051
29621993912,9cyclictest7850irq/56-dwc_otg10:21:341
2962399387,15cyclictest8050irq/56-dwc_otg_09:15:413
29623993815,5cyclictest8050irq/56-dwc_otg_12:20:253
29621993817,11cyclictest7850irq/56-dwc_otg12:12:231
2962199381,16cyclictest5074-21ssh09:44:311
2962399374,16cyclictest7950irq/56-dwc_otg_07:25:143
2962399372,28cyclictest8050irq/56-dwc_otg_11:25:283
2962399371,3cyclictest1553-21ssh09:40:243
2962299373,29cyclictest4961-21ssh12:20:252
29622993728,5cyclictest301ktimersoftd/211:40:242
2962199377,18cyclictest5636-21ssh11:02:271
2962199377,14cyclictest8050irq/56-dwc_otg_12:23:371
29621993719,7cyclictest7950irq/56-dwc_otg_09:39:131
29621993717,4cyclictest8050irq/56-dwc_otg_10:45:251
29621993712,10cyclictest7850irq/56-dwc_otg10:56:401
29621993710,13cyclictest7950irq/56-dwc_otg_12:15:221
180952370,5sleep22962299cyclictest12:35:352
4682361,5sleep2478-21ssh09:38:582
29623993623,11cyclictest750-21snmpd09:53:203
2962299366,18cyclictest0-21swapper/210:40:392
2962299366,16cyclictest0-21swapper/208:50:272
29622993615,12cyclictest301ktimersoftd/207:31:242
29621993612,5cyclictest7410-21unixbench_singl07:35:421
29621993610,6cyclictest221ktimersoftd/111:17:121
286052368,13sleep30-21swapper/307:05:403
200262360,2sleep30-21swapper/311:20:243
2962399356,7cyclictest7950irq/56-dwc_otg_08:55:133
29623993521,5cyclictest39-21ksoftirqd/309:20:363
2962299357,6cyclictest0-21swapper/209:50:142
2962299352,5cyclictest0-21swapper/207:55:292
29622993517,5cyclictest695-21sh12:15:172
29622993516,5cyclictest29047-21/usr/sbin/munin12:10:382
2962299351,21cyclictest0-21swapper/211:35:002
29621993513,7cyclictest7950irq/56-dwc_otg_11:11:081
2962199351,22cyclictest1160-21ls08:50:281
2962399348,15cyclictest8050irq/56-dwc_otg_07:35:313
2962399347,6cyclictest7950irq/56-dwc_otg_07:15:393
2962399346,7cyclictest39-21ksoftirqd/310:45:133
2962399346,20cyclictest2570-21ssh10:20:273
2962399346,16cyclictest8050irq/56-dwc_otg_09:45:273
2962399345,15cyclictest8050irq/56-dwc_otg_12:25:433
2962399342,4cyclictest7950irq/56-dwc_otg_09:05:143
2962399342,4cyclictest7950irq/56-dwc_otg_09:05:143
29623993416,5cyclictest17381-21sh12:35:243
2962299347,15cyclictest0-21swapper/211:06:302
2962299346,18cyclictest10168-21uniq07:45:312
2962299346,18cyclictest10168-21uniq07:45:312
2962299345,5cyclictest8050irq/56-dwc_otg_09:30:142
29622993426,4cyclictest19175-21/usr/sbin/munin10:00:362
29622993426,4cyclictest19175-21/usr/sbin/munin10:00:362
2962299341,4cyclictest7950irq/56-dwc_otg_12:25:392
29622993413,6cyclictest17637-21switchtime11:55:412
2962299341,22cyclictest3731-21ls08:55:412
2962299341,15cyclictest478-21ssh11:35:302
2962199348,5cyclictest1254-21grep11:35:401
2962199346,16cyclictest0-21swapper/108:35:261
2962399337,13cyclictest8050irq/56-dwc_otg_08:45:133
2962399335,6cyclictest7850irq/56-dwc_otg10:50:423
2962399335,13cyclictest7950irq/56-dwc_otg_12:10:153
29623993317,6cyclictest5808-21ssh11:41:133
29623993314,5cyclictest18281-21sh11:56:163
2962399331,15cyclictest8338-21ssh11:45:243
2962399331,15cyclictest8338-21ssh11:45:243
2962399331,15cyclictest7950irq/56-dwc_otg_09:00:143
29623993311,5cyclictest3633-21/usr/sbin/munin11:00:303
2962399331,14cyclictest7950irq/56-dwc_otg_08:30:143
2962399331,12cyclictest7950irq/56-dwc_otg_08:10:253
2962299336,12cyclictest8050irq/56-dwc_otg_11:15:302
2962299333,18cyclictest10095-21ssh10:29:312
2962299332,3cyclictest0-21swapper/208:35:402
29622993323,7cyclictest20153-21aten_rbpower_po11:20:272
2962299331,26cyclictest19216-21ls08:10:312
2962199334,19cyclictest8160-21grep07:40:271
2962199334,13cyclictest23-21ksoftirqd/108:45:501
2962199331,18cyclictest7950irq/56-dwc_otg_12:35:231
2927123314,13sleep00-21swapper/007:09:130
2962399328,12cyclictest0-21swapper/309:35:243
2962399327,11cyclictest8050irq/56-dwc_otg_10:20:143
2962399325,5cyclictest7950irq/56-dwc_otg_11:50:313
2962399324,6cyclictest39-21ksoftirqd/309:55:333
2962399324,22cyclictest8050irq/56-dwc_otg_11:30:273
2962399324,21cyclictest37-21rcuc/310:30:353
29623993225,5cyclictest27037-21ssh12:07:093
2962399321,8cyclictest7925-21cron09:10:133
2962399321,8cyclictest29458-21sh08:40:133
2962299329,14cyclictest8050irq/56-dwc_otg_09:40:402
2962299327,5cyclictest7850irq/56-dwc_otg09:00:412
2962299327,5cyclictest7850irq/56-dwc_otg09:00:412
2962299324,6cyclictest7850irq/56-dwc_otg09:15:412
2962299324,14cyclictest8050irq/56-dwc_otg_10:15:302
2962299323,4cyclictest7850irq/56-dwc_otg08:45:192
2962299322,4cyclictest0-21swapper/207:25:412
29622993223,5cyclictest301ktimersoftd/211:45:412
29622993223,5cyclictest301ktimersoftd/211:45:412
2962299322,17cyclictest14369-21aten_rbpower_vo09:55:282
29622993214,5cyclictest23818-21grep10:05:412
29622993212,5cyclictest21455-21missed_timers12:00:372
2962299321,21cyclictest1774-21timerandwakeup07:20:392
2962299321,21cyclictest0-21swapper/212:34:312
2962299321,17cyclictest24244-21ssh10:45:402
2962199328,15cyclictest0-21swapper/108:05:271
2962199325,5cyclictest7850irq/56-dwc_otg08:00:241
29621993225,4cyclictest31567-21aten_rbpower_vo07:15:291
2962199321,20cyclictest4924-21cut07:30:321
2962399319,10cyclictest0-21swapper/312:33:183
2962399317,10cyclictest8050irq/56-dwc_otg_10:45:313
2962399316,5cyclictest7950irq/56-dwc_otg_07:30:413
2962399316,13cyclictest0-21swapper/309:35:033
2962399316,13cyclictest0-21swapper/309:35:033
2962399313,12cyclictest7950irq/56-dwc_otg_07:45:363
2962399313,12cyclictest7950irq/56-dwc_otg_07:45:363
2962399311,3cyclictest0-21swapper/308:05:273
29623993112,6cyclictest15288-21fschecks_time10:35:303
2962299318,10cyclictest0-21swapper/210:11:102
2962299316,4cyclictest8050irq/56-dwc_otg_08:40:412
2962299315,6cyclictest8050irq/56-dwc_otg_08:20:142
2962299312,16cyclictest0-21swapper/211:26:142
2962299312,13cyclictest0-21swapper/209:20:322
29622993114,5cyclictest7945-21diskmemload11:00:592
29622993110,7cyclictest0-21swapper/210:30:342
29622993110,4cyclictest17894-21/usr/sbin/munin08:05:382
2962399308,10cyclictest7945-21diskmemload09:25:443
2962399307,13cyclictest8050irq/56-dwc_otg_07:50:363
2962399306,4cyclictest13691-21fschecks_count07:55:323
2962399302,26cyclictest30577-21ls07:10:413
2962399301,17cyclictest0-21swapper/312:00:423
293252303,21sleep20-21swapper/207:09:562
2962399296,5cyclictest7850irq/56-dwc_otg10:10:243
2962399294,5cyclictest39-21ksoftirqd/311:05:333
2962399292,19cyclictest0-21swapper/308:02:283
2962299291,8cyclictest6409-21cut09:05:272
29623992821,5cyclictest37-21rcuc/308:15:283
2962299289,5cyclictest12585-21grep11:50:262
2962299283,5cyclictest8050irq/56-dwc_otg_07:50:362
2962299283,5cyclictest31890-21if_wlan007:15:332
2962299281,16cyclictest25273-21timerwakeupswit08:25:422
2962199282,4cyclictest7850irq/56-dwc_otg09:00:301
2962199282,4cyclictest7850irq/56-dwc_otg09:00:301
274372281,4sleep30-21swapper/308:32:413
274372281,4sleep30-21swapper/308:32:413
2962299272,6cyclictest8050irq/56-dwc_otg_07:40:302
2962199271,4cyclictest12845-21runrttasks07:50:471
293292272,16sleep10-21swapper/107:09:591
29623992616,6cyclictest4388-21seq07:30:143
2962299262,9cyclictest0-21swapper/207:13:252
2962299261,3cyclictest0-21swapper/208:01:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional