You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed Sep 02, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309109916011,129cyclictest0-21swapper/009:15:320
309199912913,82cyclictest19896-21ssh11:20:263
309199912913,82cyclictest19896-21ssh11:20:263
30910991203,43cyclictest0-21swapper/009:20:410
30910991183,98cyclictest0-21swapper/009:35:320
30910991152,49cyclictest26173-21ssh09:30:180
309199910530,52cyclictest10391-21ntp_kernel_pll_09:10:383
309109910344,8cyclictest10307-21sh09:50:260
30910991012,26cyclictest0-21swapper/009:10:380
3091099996,40cyclictest0-21swapper/008:25:290
3091899982,8cyclictest7950irq/56-dwc_otg_09:10:382
3091099961,66cyclictest18583-21ssh10:00:250
3091099956,69cyclictest0-21swapper/009:40:320
3091999943,63cyclictest26785-21irqstats09:30:353
3091899946,16cyclictest7850irq/56-dwc_otg_09:40:362
3091999905,56cyclictest7750irq/56-dwc_otg09:40:343
3091999873,76cyclictest14190-21if_eth009:15:343
3091899844,16cyclictest7950irq/56-dwc_otg_09:15:322
3091999839,52cyclictest7750irq/56-dwc_otg09:35:343
3091499822,51cyclictest13999-21grep09:15:321
143742800,2sleep00-21swapper/009:55:190
3091999792,57cyclictest7850irq/56-dwc_otg_09:20:403
46582730,3sleep34662-21latency08:55:363
107602730,1sleep10-21swapper/111:09:201
30914997213,21cyclictest2372-21ssh09:40:331
3091099722,42cyclictest0-21swapper/011:30:270
3091999711,50cyclictest7750irq/56-dwc_otg08:25:293
22182710,2sleep30-21swapper/310:58:473
3091099701,56cyclictest11468-21runrttasks11:10:150
3091499695,31cyclictest0-21swapper/109:35:341
299432690,2sleep30-21swapper/310:13:583
3091499684,17cyclictest10433-21ssh09:10:411
30914996812,34cyclictest7850irq/56-dwc_otg_09:20:411
30914996811,25cyclictest23-21ksoftirqd/109:30:351
3091099681,54cyclictest24410-21latency_hist12:05:150
3091099671,54cyclictest23669-21cat10:05:410
302752670,6sleep20-21swapper/207:05:432
287092670,2sleep20-21swapper/212:10:162
3091099662,55cyclictest0-21swapper/010:55:380
3091999655,45cyclictest13650-21ls12:30:363
3091099658,46cyclictest4325-21fschecks_time11:40:320
61762640,3sleep26165-21apt-get09:45:272
291052640,2sleep00-21swapper/010:51:110
291052640,2sleep00-21swapper/010:51:110
3091999639,35cyclictest21906-21apt-config09:25:173
3091999634,40cyclictest7950irq/56-dwc_otg_11:26:153
3091499633,12cyclictest7750irq/56-dwc_otg10:30:281
3091099634,20cyclictest22054-21ssh09:25:280
3091099633,49cyclictest0-21swapper/007:10:420
3091999626,38cyclictest7950irq/56-dwc_otg_10:35:153
3091999621,5cyclictest18899-21fschecks_count10:00:313
3091099627,30cyclictest0-21swapper/008:05:260
3091099621,46cyclictest17618-21unixbench_multi11:55:430
3091999611,47cyclictest0-21swapper/312:22:153
3091099612,47cyclictest0-21swapper/007:45:410
3091099611,50cyclictest0-21swapper/008:30:250
3091099611,46cyclictest0-21swapper/007:25:390
3091099611,45cyclictest17837-21head08:00:430
3091999606,41cyclictest7750irq/56-dwc_otg10:15:383
3091099605,7cyclictest1180-21runrttasks11:26:300
3091099602,48cyclictest13173-21aten_rbpower_vo07:50:290
3091099602,43cyclictest2350-21wget07:20:290
3091099601,46cyclictest0-21swapper/011:15:350
3091999593,40cyclictest7950irq/56-dwc_otg_10:27:053
3091999592,37cyclictest3018550ssh12:10:453
3091999591,3cyclictest7750irq/56-dwc_otg10:52:113
3091999591,3cyclictest7750irq/56-dwc_otg10:52:113
3091099582,48cyclictest0-21swapper/010:25:410
3091099582,47cyclictest0-21swapper/011:35:300
3091099582,45cyclictest8887-21sh11:45:360
3091099581,47cyclictest13156-21grep11:50:400
30910995812,34cyclictest21851-21latency_hist08:15:150
3091999573,37cyclictest0-21swapper/309:56:503
3091999572,4cyclictest7850irq/56-dwc_otg_11:45:313
3091999571,43cyclictest0-21swapper/309:53:213
3091999571,3cyclictest7850irq/56-dwc_otg_12:19:293
3091999571,3cyclictest0-21swapper/311:35:253
30918995738,13cyclictest7950irq/56-dwc_otg_12:25:252
3091099573,42cyclictest0-21swapper/011:00:420
3091099571,45cyclictest0-21swapper/008:45:360
3091099571,45cyclictest0-21swapper/008:45:360
305152573,44sleep00-21swapper/007:08:340
3091999562,42cyclictest0-21swapper/311:01:023
3091999562,38cyclictest7850irq/56-dwc_otg_11:59:343
3091999561,3cyclictest0-21swapper/308:30:373
30914995632,16cyclictest0-21swapper/111:20:261
30914995632,16cyclictest0-21swapper/111:20:261
3091099566,18cyclictest9550irq/80-mmc012:15:150
3091099561,42cyclictest2497-21ls08:50:290
3091999551,41cyclictest0-21swapper/312:29:593
3091899554,16cyclictest0-21swapper/209:30:352
3091099552,41cyclictest0-21swapper/010:33:020
30910995519,17cyclictest1969-21latency_hist07:20:150
3091099551,45cyclictest0-21swapper/010:35:190
3091099551,42cyclictest31116-21/usr/sbin/munin08:40:400
30910995512,30cyclictest5673-21latency_hist09:00:150
3091999545,45cyclictest17043-21if_err_eth008:00:333
3091999542,41cyclictest0-21swapper/311:31:483
3091999541,40cyclictest24682-21grep12:05:283
3091999541,3cyclictest7750irq/56-dwc_otg11:09:033
3091999541,34cyclictest19591-21sort11:20:153
3091999541,2cyclictest0-21swapper/310:20:343
30918995421,10cyclictest23513-21kworker/2:209:20:422
3091499549,6cyclictest0-21swapper/111:10:281
30910995427,16cyclictest10301-21ls07:40:410
3091099542,41cyclictest4376-21modprobe12:20:140
3091099542,41cyclictest0-21swapper/007:35:340
3091099541,45cyclictest0-21swapper/008:20:410
3091099541,43cyclictest0-21swapper/011:10:330
3091099541,42cyclictest3336-21missed_timers10:20:360
3091099541,42cyclictest13064-21aten_rbpower_po12:30:290
3091999535,13cyclictest7850irq/56-dwc_otg_07:50:263
3091999532,37cyclictest0-21swapper/308:44:423
3091999532,31cyclictest0-21swapper/309:00:433
30919995319,31cyclictest3923-21sh11:40:183
3091999531,3cyclictest0-21swapper/309:06:313
30918995318,17cyclictest7950irq/56-dwc_otg_09:35:342
3091099533,41cyclictest8250-21ssh12:24:470
3091099532,4cyclictest0-21swapper/011:22:350
3091099532,4cyclictest0-21swapper/011:22:350
3091099531,38cyclictest0-21swapper/009:45:410
3091099531,33cyclictest23620-21ssh10:45:290
250452530,2sleep20-21swapper/212:05:332
201012530,2sleep2301ktimersoftd/212:38:502
3091999522,46cyclictest19634-21unixbench_singl08:05:433
3091999522,3cyclictest11609-21apt-get11:10:273
3091999521,7cyclictest20270-21/usr/sbin/munin08:10:433
3091999521,4cyclictest0-21swapper/312:37:373
3091099522,41cyclictest0-21swapper/009:04:400
3091099522,36cyclictest0-21swapper/010:15:300
3091099521,24cyclictest0-21swapper/010:40:250
30910995211,25cyclictest0-21swapper/012:05:340
165792520,1sleep10-21swapper/111:55:291
319112510,11sleep1221ktimersoftd/110:55:311
3091999514,31cyclictest0-21swapper/311:53:233
3091999512,45cyclictest15176-21grep07:55:323
3091999512,45cyclictest15176-21grep07:55:323
3091999511,7cyclictest455-21/usr/sbin/munin08:45:353
3091999511,7cyclictest455-21/usr/sbin/munin08:45:353
3091999511,5cyclictest6500-21netstat07:30:373
3091999511,3cyclictest7950irq/56-dwc_otg_08:20:273
3091999511,3cyclictest0-21swapper/309:45:263
30910995115,4cyclictest9643-21/usr/sbin/munin12:25:380
3091099511,41cyclictest26821-21/usr/sbin/munin10:10:440
3091099511,38cyclictest0-21swapper/008:36:220
3091999503,3cyclictest7950irq/56-dwc_otg_10:46:323
3091999501,5cyclictest19260-21/usr/sbin/munin10:40:373
3091999501,41cyclictest0-21swapper/307:24:203
3091499505,21cyclictest7950irq/56-dwc_otg_09:25:421
3091999492,2cyclictest0-21swapper/312:00:253
3091999492,2cyclictest0-21swapper/310:37:553
3091999491,4cyclictest26416-21sh10:10:053
3091999491,44cyclictest8788-21grep07:35:433
3091999491,43cyclictest0-21swapper/308:35:163
3091999491,42cyclictest0-21swapper/307:10:323
30910994914,21cyclictest8030-21fschecks_time09:05:320
3091999481,5cyclictest22895-21/usr/sbin/munin08:15:393
3091999481,44cyclictest11007-21cron07:45:143
3091999481,43cyclictest2034-21sed07:20:153
3091999481,2cyclictest0-21swapper/308:50:343
3091899475,26cyclictest7850irq/56-dwc_otg_10:30:152
3091499477,26cyclictest0-21swapper/112:10:281
3091499472,7cyclictest7750irq/56-dwc_otg07:45:291
3091099471,34cyclictest20335-21ssh12:39:150
3091499467,24cyclictest0-21swapper/109:45:281
3091499467,24cyclictest0-21swapper/107:10:271
3091499466,25cyclictest0-21swapper/110:00:271
3091999451,4cyclictest4039-21apt-get07:25:253
3091999451,4cyclictest11891-21ls07:45:373
3091499457,23cyclictest0-21swapper/107:25:271
57622440,4sleep123-21ksoftirqd/111:02:431
30914994413,19cyclictest19296-21ssh10:40:281
3091499437,23cyclictest0-21swapper/109:00:281
3091499422,9cyclictest0-21swapper/108:40:251
30914994222,5cyclictest1675850wget08:00:291
30914994219,5cyclictest23-21ksoftirqd/109:55:391
3091099422,31cyclictest0-21swapper/008:15:150
60742410,2sleep10-21swapper/110:24:311
3091499416,3cyclictest7850irq/56-dwc_otg_10:15:331
70952400,2sleep20-21swapper/211:05:102
34822400,29sleep17950irq/56-dwc_otg_11:39:551
3091899407,23cyclictest0-21swapper/209:25:282
3091899403,23cyclictest25326-21kworker/2:008:25:282
30918994021,12cyclictest0-21swapper/211:35:252
30918994015,4cyclictest18779-21sh10:40:092
3091499407,26cyclictest0-21swapper/108:05:281
3091499407,25cyclictest0-21swapper/108:20:281
3091499407,23cyclictest0-21swapper/108:55:291
3091499392,6cyclictest0-21swapper/112:30:271
30914993913,17cyclictest23-21ksoftirqd/112:00:251
3091099392,25cyclictest0-21swapper/007:55:200
3091099392,25cyclictest0-21swapper/007:55:200
3091899385,7cyclictest7950irq/56-dwc_otg_08:55:272
30918993814,4cyclictest7949-21fschecks_time07:35:322
3091499386,6cyclictest7950irq/56-dwc_otg_10:50:151
3091499383,9cyclictest7750irq/56-dwc_otg12:18:431
3091099382,22cyclictest0-21swapper/007:32:230
3091499372,9cyclictest7750irq/56-dwc_otg07:15:251
30914993715,4cyclictest29550-21fschecks_count08:35:331
30914993713,12cyclictest9942-21grep07:40:351
30918993616,12cyclictest4477-21if_wlan011:40:342
30914993611,4cyclictest0-21swapper/111:29:581
3091899354,20cyclictest7950irq/56-dwc_otg_12:15:342
30918993526,6cyclictest301ktimersoftd/210:30:432
30918993512,8cyclictest0-21swapper/210:08:532
3091899351,23cyclictest0-21swapper/210:10:472
30918993511,6cyclictest0-21swapper/211:25:422
3091499359,14cyclictest0-21swapper/111:53:121
3091499357,15cyclictest0-21swapper/108:45:271
3091499357,15cyclictest0-21swapper/108:45:271
3091499357,14cyclictest7950irq/56-dwc_otg_12:20:351
3091499354,12cyclictest0-21swapper/112:35:281
3091499352,6cyclictest15353-21cut10:35:311
30914993518,4cyclictest12084-21latency_hist11:50:151
30914993513,5cyclictest1180-21runrttasks07:55:311
30914993513,5cyclictest1180-21runrttasks07:55:311
3091899345,4cyclictest7850irq/56-dwc_otg_10:20:272
3091899343,21cyclictest0-21swapper/207:15:242
30918993415,4cyclictest16580-21cpuspeed11:55:292
3091899341,26cyclictest0-21swapper/210:40:572
3091499345,20cyclictest6847-21ssh10:25:281
3091499341,22cyclictest29341-21ssh11:30:421
30914993410,4cyclictest0-21swapper/110:07:341
3091899334,5cyclictest7950irq/56-dwc_otg_11:05:362
3091899334,5cyclictest7541-21latency_hist09:05:142
3091899332,8cyclictest1235-21proc_pri08:45:382
3091899332,8cyclictest1235-21proc_pri08:45:382
30918993318,8cyclictest16090-21ssh09:56:192
30918993316,4cyclictest24445-21latency_hist12:05:152
30918993315,5cyclictest11613-21ssh09:50:442
3091899331,23cyclictest0-21swapper/211:54:062
3091899331,14cyclictest7950irq/56-dwc_otg_11:45:302
3091499338,6cyclictest7950irq/56-dwc_otg_09:05:281
3091499338,6cyclictest7850irq/56-dwc_otg_07:20:431
3091499333,8cyclictest0-21swapper/110:50:411
3091499333,8cyclictest0-21swapper/110:50:411
3091499331,7cyclictest0-21swapper/107:35:141
30914993317,6cyclictest1309050wget07:50:291
3091499331,4cyclictest9364-21ssh12:25:341
3091499331,16cyclictest0-21swapper/110:10:381
30914993310,10cyclictest0-21swapper/111:42:411
3091899327,3cyclictest0-21swapper/210:45:362
3091899326,5cyclictest29-21rcuc/210:03:292
3091899324,5cyclictest7850irq/56-dwc_otg_07:50:322
30918993216,9cyclictest2503-21df08:50:292
3091899321,2cyclictest0-21swapper/210:55:292
3091499323,16cyclictest0-21swapper/109:50:261
3091499322,3cyclictest7950irq/56-dwc_otg_07:35:281
3091499322,14cyclictest0-21swapper/108:10:391
3091899318,7cyclictest20566-21cut08:10:322
3091899316,15cyclictest0-21swapper/211:30:272
3091899312,7cyclictest7736-21aten_rbpower_cu09:05:282
3091899312,4cyclictest0-21swapper/211:13:132
3091899311,4cyclictest7950irq/56-dwc_otg_11:15:452
30918993110,4cyclictest0-21swapper/210:17:282
3091499319,3cyclictest0-21swapper/112:05:431
3091499313,5cyclictest7750irq/56-dwc_otg11:15:351
3091499312,4cyclictest7850irq/56-dwc_otg_08:30:401
3091899308,5cyclictest12010-21proc_pri07:45:402
3091899306,4cyclictest28296-21sh10:50:382
3091899306,4cyclictest28296-21sh10:50:382
3091899302,6cyclictest7850irq/56-dwc_otg_08:30:282
3091899302,5cyclictest7950irq/56-dwc_otg_08:15:422
30918993015,4cyclictest22266-21seq11:22:392
30918993015,4cyclictest22266-21seq11:22:392
30918993014,14cyclictest0-21swapper/212:30:282
3091899301,16cyclictest24771-21switchtime08:20:402
3091899301,14cyclictest7950irq/56-dwc_otg_08:35:402
3091899301,10cyclictest0-21swapper/207:13:382
30914993012,10cyclictest3413-21sed08:50:421
3091899293,11cyclictest7850irq/56-dwc_otg_07:20:322
3091499291,7cyclictest7750irq/56-dwc_otg08:15:321
30914992912,10cyclictest23-21ksoftirqd/108:25:341
3091899288,10cyclictest16203-21systemd-journal07:45:142
3091899285,13cyclictest6036-21ssh12:20:442
3091899284,5cyclictest19001-21wc08:05:352
3091899281,8cyclictest17847-21users08:00:432
30918992815,10cyclictest0-21swapper/207:25:312
30918992811,9cyclictest31412-21grep08:40:312
306352281,20sleep30-21swapper/307:10:063
304292273,14sleep10-21swapper/107:07:331
3091899262,4cyclictest7850irq/56-dwc_otg_07:58:552
3091899262,4cyclictest7850irq/56-dwc_otg_07:58:552
3091899255,4cyclictest7950irq/56-dwc_otg_07:30:342
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional