You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 22:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Wed Sep 16, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3207121120,3sleep30-21swapper/308:35:223
1895521090,2sleep20-21swapper/209:18:082
595221080,4sleep0110199cyclictest08:50:460
2399821010,2sleep20-21swapper/210:46:382
257902990,4sleep1221ktimersoftd/109:26:091
110199977,50cyclictest0-21swapper/008:45:360
110199977,50cyclictest0-21swapper/008:45:360
110199938,75cyclictest0-21swapper/009:35:300
73172880,2sleep10-21swapper/111:48:511
66822880,2sleep20-21swapper/211:47:352
110199877,37cyclictest0-21swapper/012:15:300
110399784,58cyclictest12335-21ssh10:31:482
1102997811,25cyclictest7950irq/56-dwc_otg_10:05:351
1102997811,25cyclictest7950irq/56-dwc_otg_10:05:351
110199782,24cyclictest0-21swapper/009:15:340
110199781,42cyclictest0-21swapper/008:40:340
110399773,48cyclictest12143-21pluginstate12:35:482
110399761,58cyclictest0-21swapper/210:04:542
110399752,57cyclictest22399-21unixbench_multi11:25:512
1101997418,27cyclictest0-21swapper/010:00:330
60762730,2sleep10-21swapper/109:42:541
110399734,53cyclictest0-21swapper/210:59:582
110399726,47cyclictest7850irq/56-dwc_otg_09:35:222
1101997215,41cyclictest9450irq/48-DMA08:56:170
110399718,48cyclictest7950irq/56-dwc_otg_11:23:282
110399713,59cyclictest2689-21ssh11:42:252
110399713,51cyclictest7950irq/56-dwc_otg_12:25:322
92822700,2sleep30-21swapper/312:32:013
1104997025,26cyclictest1180-21runrttasks12:10:423
110399706,49cyclictest7950irq/56-dwc_otg_12:15:222
110399702,51cyclictest0-21swapper/212:22:182
110399701,53cyclictest7950irq/56-dwc_otg_07:30:372
110399701,53cyclictest7950irq/56-dwc_otg_07:30:372
110399692,52cyclictest0-21swapper/209:21:052
110399691,59cyclictest25034-21ssh10:06:282
110399691,59cyclictest25034-21ssh10:06:282
1101996936,7cyclictest6506-21apt-config07:25:220
1101996936,7cyclictest6506-21apt-config07:25:220
1101996926,23cyclictest7328-21cron09:45:220
110399681,51cyclictest0-21swapper/209:44:552
110499671,49cyclictest31840-21apt-get09:35:303
110399676,46cyclictest7850irq/56-dwc_otg_11:00:482
110399676,41cyclictest7850irq/56-dwc_otg_09:45:532
110399671,52cyclictest27892-21ssh09:30:202
110499661,52cyclictest2514-21ssh11:42:043
110399662,49cyclictest22872-21ssh12:08:402
110399661,53cyclictest4677-21ssh10:22:062
110399661,51cyclictest7850irq/56-dwc_otg_08:10:362
110399661,49cyclictest0-21swapper/208:51:572
110399661,44cyclictest25118-21aten_rbpower_cu11:30:362
1101996645,5cyclictest7750irq/56-dwc_otg10:55:440
110499652,47cyclictest23973-21taskset10:46:353
1104996515,35cyclictest11492-21sh11:54:223
110499651,45cyclictest0-21swapper/307:30:293
110499651,45cyclictest0-21swapper/307:30:293
110399657,44cyclictest7950irq/56-dwc_otg_12:01:172
110399657,44cyclictest7950irq/56-dwc_otg_12:01:172
110399653,45cyclictest7750irq/56-dwc_otg11:35:422
110399653,45cyclictest7750irq/56-dwc_otg11:35:422
110399652,44cyclictest0-21swapper/211:18:272
110399651,5cyclictest13963-21ssh11:56:302
1101996526,23cyclictest0-21swapper/011:10:340
110199652,40cyclictest26163-21cat11:30:510
110399642,53cyclictest15977-21ssh10:36:132
110399642,12cyclictest0-21swapper/209:00:332
110399641,4cyclictest0-21swapper/210:18:072
110399641,43cyclictest729-21/usr/sbin/munin09:35:492
110199647,9cyclictest509-21cron07:35:220
110199647,9cyclictest509-21cron07:35:220
110199643,7cyclictest0-21swapper/011:35:350
110199643,7cyclictest0-21swapper/011:35:350
1101996428,18cyclictest24804-21latency_hist08:15:220
1101996421,26cyclictest25606-21unixbench_singl09:25:520
1104996322,30cyclictest23856-21sh09:25:063
110499631,50cyclictest528-21munin-node08:10:323
110499631,41cyclictest0-21swapper/308:05:253
110399636,41cyclictest7950irq/56-dwc_otg_10:10:422
110399636,40cyclictest0-21swapper/211:05:452
110399634,45cyclictest7950irq/56-dwc_otg_12:19:522
110399633,44cyclictest7850irq/56-dwc_otg_10:26:472
110399631,51cyclictest0-21swapper/209:57:092
110199632,54cyclictest8429-21latency_hist07:30:220
110499622,46cyclictest0-21swapper/312:25:203
110499621,57cyclictest1574750ssh12:00:043
110499621,44cyclictest21069-21pluginstate08:05:223
110399622,45cyclictest0-21swapper/208:05:222
110399621,3cyclictest0-21swapper/210:41:462
110299621,46cyclictest21-21rcuc/111:20:521
1101996243,5cyclictest9-21ksoftirqd/011:20:530
1101996243,5cyclictest7850irq/56-dwc_otg_11:15:340
110199624,34cyclictest0-21swapper/012:00:340
110199624,34cyclictest0-21swapper/012:00:340
1101996218,24cyclictest13388-21/usr/sbin/munin09:10:470
257482610,2sleep10-21swapper/112:11:361
110499617,41cyclictest7950irq/56-dwc_otg_10:03:463
110399615,43cyclictest7950irq/56-dwc_otg_09:12:042
110399615,38cyclictest7850irq/56-dwc_otg_10:51:312
110399611,45cyclictest0-21swapper/208:39:172
110199618,36cyclictest0-21swapper/010:25:350
1101996121,12cyclictest5551-21aten_rbpower_cu11:05:360
110499602,32cyclictest14919-21awk12:40:223
110499601,46cyclictest14960-21ssh11:16:293
110499601,44cyclictest26310-21tail11:30:533
110399602,39cyclictest0-21swapper/209:09:332
1101996020,18cyclictest11045-21latency_hist12:35:220
110499595,29cyclictest7950irq/56-dwc_otg_09:45:533
110499592,45cyclictest0-21swapper/309:30:383
110499591,46cyclictest6388-21ssh09:43:313
110499591,45cyclictest26532-21ssh10:09:273
110499591,45cyclictest26532-21ssh10:09:273
110499591,35cyclictest27964-21sh10:51:443
110399592,4cyclictest0-21swapper/208:22:172
110399592,41cyclictest0-21swapper/208:05:442
110399591,40cyclictest0-21swapper/211:11:342
1101995930,10cyclictest9-21ksoftirqd/012:10:340
1101995920,25cyclictest0-21swapper/007:47:260
110499581,45cyclictest32482-21ssh11:39:583
110499581,45cyclictest32482-21ssh11:39:583
110499581,45cyclictest29194-21ssh10:11:583
110499581,45cyclictest19725-21ssh12:05:123
110499581,45cyclictest19725-21ssh12:05:123
110499581,44cyclictest22616-21ssh11:26:073
110499581,42cyclictest31855-21ssh10:56:443
110499581,38cyclictest7026-21ssh11:06:183
110399583,8cyclictest0-21swapper/208:15:362
110399582,5cyclictest7850irq/56-dwc_otg_07:23:482
110399582,5cyclictest7850irq/56-dwc_otg_07:23:482
110399582,51cyclictest15253-21sed07:45:502
110399582,4cyclictest0-21swapper/211:51:162
110399582,3cyclictest0-21swapper/209:51:002
1103995816,37cyclictest18850-21grep07:55:522
110299589,28cyclictest0-21swapper/107:40:351
110199584,32cyclictest25175-21cut08:15:400
1101995830,17cyclictest9-21ksoftirqd/009:50:500
110199582,31cyclictest6436-21kworker/0:210:37:140
1101995819,20cyclictest8438-21sh11:50:350
110199581,47cyclictest0-21swapper/009:46:380
110199581,46cyclictest0-21swapper/009:56:200
110499572,43cyclictest0-21swapper/310:30:313
110499571,45cyclictest1362-21/usr/sbin/munin07:10:403
110499571,45cyclictest1362-21/usr/sbin/munin07:10:403
110499571,45cyclictest11097-21ssh11:11:363
110499571,44cyclictest22843-21ssh12:08:373
110499571,41cyclictest28052-21ssh12:15:333
110499571,37cyclictest5715-21ssh10:24:113
110399574,48cyclictest10747-21fschecks_count07:35:402
110399571,4cyclictest0-21swapper/208:40:532
110399571,44cyclictest0-21swapper/212:31:142
110199571,7cyclictest3058-21seq07:15:330
110199571,41cyclictest0-21swapper/010:17:010
110499562,35cyclictest3123-21ssh11:01:173
110499561,47cyclictest675-21ssh10:17:003
110499561,42cyclictest18790-21ssh11:21:183
110499561,41cyclictest8404-21ssh10:26:453
110499561,40cyclictest21305-21ssh10:44:033
110499561,38cyclictest0-21swapper/312:28:513
110499561,37cyclictest17563-21ssh10:39:233
110499561,36cyclictest12921-21ssh09:50:573
1101995627,14cyclictest7750irq/56-dwc_otg07:15:220
1101995627,14cyclictest7750irq/56-dwc_otg07:15:220
1101995623,17cyclictest11446-21aten_rbpower_vo12:35:370
1101995620,19cyclictest23231-21sensors_temp10:45:490
1101995615,25cyclictest19154-21grep10:40:470
110199561,3cyclictest0-21swapper/011:00:380
110499551,43cyclictest18547-21ssh09:59:093
110499551,39cyclictest6559-21taskset08:52:103
110499551,37cyclictest18645-21ssh09:17:303
110499551,35cyclictest20188-21snmpd07:23:273
110499551,35cyclictest20188-21snmpd07:23:273
110399555,38cyclictest7950irq/56-dwc_otg_08:57:012
110399552,49cyclictest12530-21fschecks_count07:40:392
110399552,3cyclictest0-21swapper/207:25:342
110399552,37cyclictest0-21swapper/207:51:192
110399552,37cyclictest0-21swapper/207:17:052
110399551,6cyclictest0-21swapper/208:25:432
110299559,30cyclictest0-21swapper/107:25:361
110199557,32cyclictest9-21ksoftirqd/011:30:210
110499541,42cyclictest17310-21runrttasks07:53:413
110399543,3cyclictest7850irq/56-dwc_otg_08:32:162
110399541,4cyclictest7950irq/56-dwc_otg_07:10:462
110399541,4cyclictest7950irq/56-dwc_otg_07:10:462
110299547,31cyclictest19518-21ssh10:00:351
1102995415,10cyclictest7950irq/56-dwc_otg_09:15:341
110199542,5cyclictest26820-21aten_rbpower_po08:20:370
110199542,31cyclictest11615-21unixbench_multi07:35:530
1101995421,17cyclictest9-21ksoftirqd/008:00:430
1101995419,20cyclictest21789-21cut08:05:430
1101995419,17cyclictest14825-21sh11:58:120
1101995417,25cyclictest0-21swapper/007:54:530
110499531,48cyclictest26735-21apt-get08:20:353
110499531,42cyclictest0-21swapper/308:36:463
110499531,35cyclictest6388-21taskset11:47:003
110499531,33cyclictest15755-21taskset09:14:343
110399531,8cyclictest4403-21timerandwakeup08:45:502
110399531,8cyclictest4403-21timerandwakeup08:45:502
110299539,30cyclictest0-21swapper/110:40:371
110299538,30cyclictest0-21swapper/112:15:291
110299537,27cyclictest7750irq/56-dwc_otg08:15:371
1102995313,25cyclictest7750irq/56-dwc_otg11:40:471
1102995310,31cyclictest0-21swapper/109:45:361
110199536,4cyclictest0-21swapper/012:20:360
110199536,13cyclictest7636-21missed_timers08:55:440
110199533,25cyclictest0-21swapper/012:05:430
1101995329,6cyclictest7850irq/56-dwc_otg_10:50:480
110499522,33cyclictest7950irq/56-dwc_otg_09:27:423
110499521,33cyclictest2953-21chrt08:42:033
110499521,32cyclictest11949-21chrt09:06:573
110299528,27cyclictest0-21swapper/107:45:341
110299527,37cyclictest0-21swapper/110:46:511
110299527,11cyclictest7750irq/56-dwc_otg12:35:231
110199523,37cyclictest1427-21proc_pri11:40:480
1101995224,10cyclictest2738-21ssh10:20:330
110199521,30cyclictest31253-21runrttasks08:30:460
110499512,44cyclictest17707-21apt-get07:55:333
1104995118,29cyclictest1180-21runrttasks07:16:543
110499511,40cyclictest15353-21taskset07:46:433
110499511,38cyclictest85672sleep308:59:483
110499511,37cyclictest0-21swapper/307:28:333
110299518,29cyclictest0-21swapper/108:05:361
110299513,4cyclictest7950irq/56-dwc_otg_08:45:431
110299513,4cyclictest7950irq/56-dwc_otg_08:45:431
110199513,34cyclictest0-21swapper/008:35:350
1101995120,15cyclictest11598-21sort09:05:490
1101995117,23cyclictest0-21swapper/007:58:360
110299508,31cyclictest0-21swapper/109:35:281
110299508,29cyclictest0-21swapper/107:35:361
110299508,26cyclictest0-21swapper/108:40:361
1101995020,12cyclictest9624-21proc_pri09:00:470
110199501,31cyclictest11843-21unixbench_singl10:30:530
110499491,44cyclictest5194-21cut08:50:233
110499491,44cyclictest5194-21cut08:50:233
110499491,35cyclictest30030-21chrt08:29:463
110499491,33cyclictest26268-21taskset08:17:473
1101994927,7cyclictest7850irq/56-dwc_otg_12:25:330
1101994920,19cyclictest0-21swapper/007:40:580
1101994912,26cyclictest0-21swapper/011:48:460
247152480,2sleep10-21swapper/111:30:171
110499482,42cyclictest9976-21unixbench_multi09:00:513
1104994814,31cyclictest10759-21fschecks_count07:35:403
110499481,34cyclictest13781-21chrt07:44:373
110199482,27cyclictest0-21swapper/009:30:350
110299478,28cyclictest0-21swapper/108:33:501
110199478,22cyclictest0-21swapper/010:14:580
110299468,27cyclictest0-21swapper/107:30:361
110299468,27cyclictest0-21swapper/107:30:361
110299467,25cyclictest221ktimersoftd/109:20:351
110299466,26cyclictest7750irq/56-dwc_otg11:55:381
110299465,24cyclictest27318-21ssh10:10:321
1101994619,5cyclictest24635-21grep10:05:510
1101994619,5cyclictest24635-21grep10:05:510
6012452,34sleep00-21swapper/007:07:230
110299459,22cyclictest7750irq/56-dwc_otg12:00:501
110299459,22cyclictest7750irq/56-dwc_otg12:00:501
110299453,24cyclictest7750irq/56-dwc_otg11:50:491
110299445,25cyclictest7750irq/56-dwc_otg09:55:281
1102994423,13cyclictest0-21swapper/111:35:361
1102994423,13cyclictest0-21swapper/111:35:361
110199441,24cyclictest29208-21ntp_kernel_pll_08:25:450
110299436,27cyclictest7750irq/56-dwc_otg09:10:351
153872420,6sleep1110299cyclictest11:17:201
110299428,18cyclictest941-21unixbench_multi08:35:531
110299427,26cyclictest7750irq/56-dwc_otg10:37:571
110299426,25cyclictest7750irq/56-dwc_otg08:00:431
110299422,26cyclictest0-21swapper/109:51:001
1102994219,9cyclictest20423-21sh12:05:401
110299417,20cyclictest7750irq/56-dwc_otg11:05:221
110299415,19cyclictest7750irq/56-dwc_otg07:15:221
110299415,19cyclictest7750irq/56-dwc_otg07:15:221
110299413,23cyclictest7750irq/56-dwc_otg09:02:151
110299412,6cyclictest0-21swapper/109:00:221
110299412,20cyclictest0-21swapper/107:20:221
110299412,12cyclictest32148-21gzip10:15:491
110299411,4cyclictest7850irq/56-dwc_otg_11:05:341
110299411,27cyclictest7750irq/56-dwc_otg11:10:311
110299407,24cyclictest7750irq/56-dwc_otg07:25:221
110299407,24cyclictest7750irq/56-dwc_otg07:25:221
110299407,21cyclictest7750irq/56-dwc_otg10:20:481
110299407,17cyclictest0-21swapper/109:32:461
110299404,27cyclictest7750irq/56-dwc_otg10:25:491
110299402,22cyclictest7750irq/56-dwc_otg10:50:341
1102994017,5cyclictest795-21unixbench_singl12:20:531
110299401,4cyclictest0-21swapper/112:36:111
110299392,24cyclictest7750irq/56-dwc_otg10:55:411
110299392,21cyclictest7750irq/56-dwc_otg09:05:471
110299391,32cyclictest24731-21ls08:15:221
110299388,21cyclictest7750irq/56-dwc_otg11:30:491
110299382,25cyclictest0-21swapper/110:30:441
319542379,19sleep231977-21fschecks_count07:05:392
110299376,17cyclictest17439-21cron07:55:221
110299374,21cyclictest7750irq/56-dwc_otg08:25:401
110299371,21cyclictest7117-21latency_hist12:30:221
110299371,20cyclictest19259-21latency_hist08:00:221
110299368,14cyclictest0-21swapper/108:50:411
1102993616,9cyclictest221ktimersoftd/108:20:361
82823511,12sleep30-21swapper/307:10:223
6172261,15sleep10-21swapper/107:07:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional