You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Wed Jul 22, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
371421620,2sleep20-21swapper/207:05:472
48019915064,22cyclictest9348-21timerwakeupswit09:40:530
4801991423,60cyclictest0-21swapper/009:10:250
4801991423,60cyclictest0-21swapper/009:10:250
48019912848,8cyclictest8050irq/56-dwc_otg_11:45:360
48019912848,8cyclictest8050irq/56-dwc_otg_11:45:360
4801991144,80cyclictest0-21swapper/009:20:520
4803991123,78cyclictest13042-21ssh09:45:482
4803991122,63cyclictest26021-21/usr/sbin/munin10:40:522
4801991125,75cyclictest0-21swapper/011:10:540
4801991113,27cyclictest7950irq/56-dwc_otg_12:20:500
4801991113,27cyclictest7950irq/56-dwc_otg_12:20:500
48019910960,26cyclictest0-21swapper/010:40:540
4801991094,71cyclictest20250-21latency_hist09:55:230
4803991082,82cyclictest18472-21ssh11:10:542
48049910610,30cyclictest0-21swapper/309:40:513
4801991064,78cyclictest0-21swapper/010:55:380
4801991063,84cyclictest9214-21ntpq10:20:450
4801991062,81cyclictest9-21ksoftirqd/012:25:460
4801991062,30cyclictest7950irq/56-dwc_otg_11:15:400
4801991062,30cyclictest7950irq/56-dwc_otg_11:15:400
4804991037,24cyclictest7950irq/56-dwc_otg_10:15:313
4801991033,84cyclictest0-21swapper/011:40:420
4801991033,83cyclictest0-21swapper/009:55:380
4804991018,17cyclictest7850irq/56-dwc_otg11:25:353
4801991015,75cyclictest0-21swapper/011:00:450
4803991003,53cyclictest727-21runrttasks10:20:432
4801999944,17cyclictest9-21ksoftirqd/010:15:510
480199992,83cyclictest4110-21kworker/0:110:05:500
268192990,5sleep3480499cyclictest12:00:463
268192990,5sleep3480499cyclictest12:00:463
480399983,59cyclictest25252-21switchtime09:20:512
480499973,27cyclictest0-21swapper/309:10:283
480499973,27cyclictest0-21swapper/309:10:283
4804999621,13cyclictest25128-21processes09:20:483
4803999630,42cyclictest8050irq/56-dwc_otg_09:10:262
4803999630,42cyclictest8050irq/56-dwc_otg_09:10:262
480399962,44cyclictest7950irq/56-dwc_otg_10:15:312
480499943,27cyclictest20506-21cut09:55:403
480499943,20cyclictest29785-21/usr/sbin/munin10:05:513
480399943,55cyclictest14896-21cat12:25:432
480199943,71cyclictest0-21swapper/009:45:460
480499929,16cyclictest7950irq/56-dwc_otg_12:20:453
480499929,16cyclictest7950irq/56-dwc_otg_12:20:453
480499925,7cyclictest0-21swapper/311:40:433
480199923,67cyclictest0-21swapper/011:50:360
480499913,9cyclictest4943-21ntp_states09:35:483
480399916,65cyclictest9250-21timerandwakeup09:40:512
480399913,49cyclictest29825-21head10:05:512
4804999012,7cyclictest0-21swapper/310:20:433
480199902,55cyclictest13666-21kworker/u8:011:25:340
480399893,56cyclictest20309-21seq09:55:242
480199883,63cyclictest0-21swapper/010:00:550
480199883,63cyclictest0-21swapper/010:00:550
20792880,5sleep3480499cyclictest09:32:113
480399873,60cyclictest0-21swapper/210:00:542
480399873,60cyclictest0-21swapper/210:00:542
480299873,58cyclictest21557-21grep11:15:401
480299873,58cyclictest21557-21grep11:15:401
203822870,2sleep10-21swapper/111:14:221
4802998510,44cyclictest8191-21/usr/sbin/munin09:40:411
480199857,36cyclictest0-21swapper/009:05:290
4801998454,12cyclictest7850irq/56-dwc_otg09:35:510
480399812,72cyclictest10203-21ls11:40:442
480399812,54cyclictest21609-21cut11:15:412
480399812,54cyclictest21609-21cut11:15:412
480399803,70cyclictest5007-21ssh09:35:492
89252790,4sleep2480399cyclictest12:18:492
480399793,70cyclictest11188-21grep12:20:502
480399793,70cyclictest11188-21grep12:20:502
480399793,48cyclictest13630-21taskset11:45:362
480399793,48cyclictest13630-21taskset11:45:362
480399792,71cyclictest20163-21sed09:55:222
298642790,6sleep1480299cyclictest11:25:411
480399783,52cyclictest7850irq/56-dwc_otg11:50:372
4801997863,3cyclictest0-21swapper/011:55:370
480399775,47cyclictest8050irq/56-dwc_otg_11:25:352
480399773,66cyclictest4830-21ssh10:55:372
480399761,49cyclictest22851-21ssh09:18:252
480399761,49cyclictest22851-21ssh09:18:252
480299752,18cyclictest5007-21ssh09:35:491
480399731,38cyclictest32620-21apt-get10:10:342
480399711,51cyclictest28339-21ssh12:02:362
480399711,51cyclictest28339-21ssh12:02:362
480299718,46cyclictest8050irq/56-dwc_otg_12:15:371
4802997125,18cyclictest7950irq/56-dwc_otg_10:40:551
480499703,50cyclictest727-21runrttasks11:45:363
480499703,50cyclictest727-21runrttasks11:45:363
4804997021,30cyclictest0-21swapper/311:00:473
480399703,60cyclictest9669-21grep11:00:462
480399692,49cyclictest7399-21ntp_states08:45:462
480199692,11cyclictest0-21swapper/007:10:320
480499688,17cyclictest0-21swapper/309:25:383
480399681,54cyclictest19280-21apt-get07:50:372
480399681,54cyclictest19280-21apt-get07:50:372
480199689,46cyclictest20400-21grep07:50:520
480199689,46cyclictest20400-21grep07:50:520
480499672,32cyclictest37-21rcuc/309:45:463
4802996713,18cyclictest7950irq/56-dwc_otg_11:20:341
480399661,54cyclictest12961-21ssh11:05:272
480399661,42cyclictest20807-21apt-get10:35:352
4802996614,15cyclictest8050irq/56-dwc_otg_12:20:431
4802996614,15cyclictest8050irq/56-dwc_otg_12:20:431
480199667,56cyclictest0-21swapper/012:00:270
480199667,56cyclictest0-21swapper/012:00:270
46592660,1sleep10-21swapper/112:13:321
480499655,16cyclictest0-21swapper/310:00:533
480499655,16cyclictest0-21swapper/310:00:533
480499655,10cyclictest0-21swapper/311:10:563
480399659,36cyclictest1900-21unixbench_multi10:50:532
480399659,36cyclictest1900-21unixbench_multi10:50:532
480399651,49cyclictest6078-21users08:40:502
4801996519,32cyclictest9650irq/80-mmc011:10:220
4801996516,26cyclictest1884-21missed_timers11:30:430
480199651,23cyclictest10629-21grep08:55:410
79652641,29sleep00-21swapper/012:17:070
480399646,41cyclictest14468-1kworker/u9:110:29:482
480399646,41cyclictest14468-1kworker/u9:110:29:482
480399641,54cyclictest23892-21ssh11:57:132
480399641,53cyclictest28743-21ssh11:24:302
480399641,44cyclictest6157-21ntp_states11:35:442
480399631,48cyclictest15669-21apt-get07:40:362
480399631,43cyclictest22252-21grep07:55:532
4803996311,15cyclictest31-21ksoftirqd/212:35:322
480199631,28cyclictest0-21swapper/009:30:440
480399621,41cyclictest19212-21/usr/sbin/munin12:30:442
480199622,37cyclictest31433-21grep12:05:510
4801996223,28cyclictest0-21swapper/011:36:460
480399611,55cyclictest11242-21ls07:25:492
480399611,41cyclictest15412-21cron07:40:222
480299616,21cyclictest4316-21ssh10:15:291
480299616,15cyclictest0-21swapper/111:55:371
480299612,12cyclictest7950irq/56-dwc_otg_09:45:471
4804996018,24cyclictest0-21swapper/309:55:233
480399602,44cyclictest3326-21cut08:35:402
480399601,39cyclictest18928-21sh10:32:332
480299608,22cyclictest7950irq/56-dwc_otg_10:05:501
4802996013,27cyclictest8050irq/56-dwc_otg_11:00:451
480199601,49cyclictest473-21fschecks_count10:10:390
480399591,55cyclictest29720-21runrttasks09:26:032
480399591,48cyclictest1899-21ssh09:31:512
480399591,42cyclictest3298-21ssh12:11:042
480299594,15cyclictest13607-21apt-get11:45:341
480299594,15cyclictest13607-21apt-get11:45:341
480499588,21cyclictest39-21ksoftirqd/310:40:503
480399587,31cyclictest6462-21sort07:15:222
480399581,36cyclictest32662-21ssh12:08:002
480499578,28cyclictest7850irq/56-dwc_otg11:15:413
480499578,28cyclictest7850irq/56-dwc_otg11:15:413
480399571,51cyclictest30658-21ls08:20:432
480299577,9cyclictest0-21swapper/109:20:531
480299573,15cyclictest9475-21/usr/sbin/munin11:40:451
480199571,24cyclictest998-21uniq10:50:400
480199571,24cyclictest998-21uniq10:50:400
480399562,48cyclictest26477-21/usr/sbin/munin08:10:432
480299564,26cyclictest8050irq/56-dwc_otg_09:55:391
4802995619,14cyclictest0-21swapper/110:20:441
4801995640,5cyclictest0-21swapper/012:30:270
4801995630,5cyclictest7950irq/56-dwc_otg_09:20:220
4801995630,5cyclictest7950irq/56-dwc_otg_09:20:220
4801995627,17cyclictest0-21swapper/007:30:500
480499557,28cyclictest17758-21ssh11:50:363
480399551,45cyclictest1006-21chrt08:30:102
4801995536,6cyclictest13180-21taskset10:25:440
4801995536,6cyclictest13180-21taskset10:25:440
4801995530,16cyclictest5852-21grep08:40:480
480199551,33cyclictest16966-21ssh10:30:390
480499542,21cyclictest7850irq/56-dwc_otg10:55:363
480399546,28cyclictest0-21swapper/211:32:242
480399541,49cyclictest9491-21ls08:50:482
480399541,49cyclictest13140-21cat09:00:502
480399541,41cyclictest30525-21sh10:46:152
480399541,39cyclictest0-21swapper/209:10:122
480399541,38cyclictest750-21snmpd07:18:422
480299548,17cyclictest21-21rcuc/112:25:441
4802995416,20cyclictest23-21ksoftirqd/109:10:251
4802995416,20cyclictest23-21ksoftirqd/109:10:251
4801995432,12cyclictest0-21swapper/008:10:230
480199541,30cyclictest21563-21ssh10:35:450
480399531,48cyclictest10297-21/usr/sbin/munin08:55:492
480399531,39cyclictest727-21runrttasks08:01:182
480199534,17cyclictest28641-21uniq09:25:430
4801995337,5cyclictest7950irq/56-dwc_otg_08:05:360
480199532,30cyclictest0-21swapper/008:45:510
480199531,28cyclictest23868-21grep12:35:500
480499523,26cyclictest0-21swapper/312:25:453
480399521,32cyclictest18172-21ntp_states07:45:462
480299528,14cyclictest7850irq/56-dwc_otg11:50:351
480299527,21cyclictest7950irq/56-dwc_otg_10:00:531
480299527,21cyclictest7950irq/56-dwc_otg_10:00:531
4801995234,6cyclictest8050irq/56-dwc_otg_12:15:210
480199522,39cyclictest0-21swapper/010:50:220
4801995223,17cyclictest23488-21missed_timers08:00:450
480299513,13cyclictest0-21swapper/110:55:361
4802995112,19cyclictest0-21swapper/109:55:241
480199513,31cyclictest10425-21cpuspeed07:25:370
480199513,27cyclictest0-21swapper/008:30:400
480199513,27cyclictest0-21swapper/008:30:400
4801995125,12cyclictest0-21swapper/008:36:200
480199512,36cyclictest0-21swapper/008:25:400
480199512,32cyclictest0-21swapper/011:20:330
480399502,44cyclictest12067-21apt-get07:30:342
480399501,33cyclictest0-21swapper/208:32:332
480399501,33cyclictest0-21swapper/208:32:332
480299509,7cyclictest7950irq/56-dwc_otg_07:10:321
480299503,30cyclictest0-21swapper/107:50:371
480299503,30cyclictest0-21swapper/107:50:371
4801995034,7cyclictest0-21swapper/009:05:220
4801995029,4cyclictest7950irq/56-dwc_otg_07:45:440
480199502,38cyclictest0-21swapper/007:41:540
480399491,45cyclictest9183-21pluginstate07:20:462
480299495,37cyclictest8050irq/56-dwc_otg_08:15:341
4801994925,14cyclictest0-21swapper/008:19:170
480199492,35cyclictest0-21swapper/007:15:360
480199491,27cyclictest31170-21sed08:20:510
480399481,44cyclictest28295-21awk08:15:332
480299489,8cyclictest7850irq/56-dwc_otg10:45:341
480299488,26cyclictest25988-21ssh12:00:271
480299488,26cyclictest25988-21ssh12:00:271
480299485,9cyclictest0-21swapper/110:30:341
480199488,6cyclictest8747-21fschecks_time07:20:380
480299477,26cyclictest18370-21ssh12:30:271
480499462,10cyclictest1748250ssh10:30:473
480499461,9cyclictest0-21swapper/307:30:343
480299462,7cyclictest7850irq/56-dwc_otg12:35:321
480199462,25cyclictest0-21swapper/007:59:590
4801994621,15cyclictest0-21swapper/008:50:400
41902462,14sleep00-21swapper/007:05:540
480399451,36cyclictest0-21swapper/208:06:122
4802994510,26cyclictest0-21swapper/110:35:361
480499442,7cyclictest7850irq/56-dwc_otg10:35:343
4802994416,14cyclictest0-21swapper/109:25:381
4804994336,5cyclictest13106-21ls09:00:503
480299432,10cyclictest7850irq/56-dwc_otg07:25:351
480499428,22cyclictest0-21swapper/310:50:363
480499428,22cyclictest0-21swapper/310:50:363
4802994226,5cyclictest7850irq/56-dwc_otg09:30:371
480299422,25cyclictest0-21swapper/111:35:331
4801994225,8cyclictest0-21swapper/007:36:470
480499419,29cyclictest20133-21runrttasks09:15:283
480499419,29cyclictest20133-21runrttasks09:15:283
480499406,22cyclictest1875-21ssh12:10:353
480499401,26cyclictest20300-21ls07:50:513
480499401,26cyclictest20300-21ls07:50:513
4804994010,9cyclictest13410-21ssh10:25:483
4804994010,9cyclictest13410-21ssh10:25:483
480299403,12cyclictest0-21swapper/110:25:361
480299403,12cyclictest0-21swapper/110:25:361
4804993910,13cyclictest7850irq/56-dwc_otg10:10:413
480299392,9cyclictest0-21swapper/107:45:351
4802993910,14cyclictest20136-21ssh09:15:291
4802993910,14cyclictest20136-21ssh09:15:291
4804993821,5cyclictest727-21runrttasks07:10:493
480499381,21cyclictest31099-21ls08:20:503
480299389,12cyclictest7950irq/56-dwc_otg_08:35:511
480299383,15cyclictest8050irq/56-dwc_otg_10:15:221
4802993828,7cyclictest1040-21idleruntime-cro08:30:221
4802993818,4cyclictest13887-21latency_hist09:05:231
480499376,19cyclictest24586-21cat08:05:223
4804993714,6cyclictest31074-21sh12:05:483
480299379,25cyclictest0-21swapper/108:10:361
480299376,28cyclictest0-21swapper/107:15:361
480299367,24cyclictest0-21swapper/108:20:361
480299367,11cyclictest8050irq/56-dwc_otg_08:00:491
480299361,25cyclictest14286-21uniq09:05:421
4804993515,4cyclictest727-21runrttasks11:30:583
4804993513,14cyclictest30222-21tail10:45:503
480499351,23cyclictest6659-21missed_timers12:15:453
480299352,12cyclictest6785-21grep08:45:371
4802993510,15cyclictest0-21swapper/107:20:341
4802993510,10cyclictest0-21swapper/112:05:351
480499347,20cyclictest0-21swapper/307:55:383
480499347,17cyclictest0-21swapper/308:35:443
4804993426,5cyclictest381ktimersoftd/307:15:343
480499341,22cyclictest25880-21apt-config12:00:233
480499341,22cyclictest0-21swapper/308:40:433
4802993416,4cyclictest3902-21sh11:33:191
480299341,4cyclictest7850irq/56-dwc_otg11:05:351
480299341,19cyclictest880-21ls10:50:381
480299341,19cyclictest880-21ls10:50:381
42512344,22sleep10-21swapper/107:06:441
4804993327,4cyclictest2140-21ls08:30:493
4804993327,4cyclictest2140-21ls08:30:493
4804993317,12cyclictest0-21swapper/309:05:533
4804993316,13cyclictest0-21swapper/307:40:453
480499331,19cyclictest7950irq/56-dwc_otg_12:31:293
480299332,6cyclictest7850irq/56-dwc_otg08:55:521
480299331,5cyclictest8050irq/56-dwc_otg_08:00:221
480499328,4cyclictest7850irq/56-dwc_otg11:40:223
480499325,15cyclictest8050irq/56-dwc_otg_08:25:403
480499324,13cyclictest8050irq/56-dwc_otg_08:50:483
480499321,24cyclictest7950irq/56-dwc_otg_11:10:223
480299328,5cyclictest12343-21grep07:30:381
480499316,7cyclictest7850irq/56-dwc_otg08:45:493
480499316,14cyclictest8050irq/56-dwc_otg_07:25:393
480499312,19cyclictest0-21swapper/308:15:413
480499312,12cyclictest7950irq/56-dwc_otg_12:35:493
480299317,6cyclictest9159-21ntpq08:50:421
4802993112,9cyclictest14580-21open_inodes07:35:461
480499306,15cyclictest0-21swapper/307:45:363
480499305,10cyclictest8050irq/56-dwc_otg_08:10:503
480499302,18cyclictest0-21swapper/307:21:263
4804993020,8cyclictest8050irq/56-dwc_otg_11:20:333
480499301,21cyclictest7950irq/56-dwc_otg_08:09:173
480499301,19cyclictest0-21swapper/307:38:573
480299301,8cyclictest6030-21unixbench_singl08:40:501
480299301,6cyclictest7850irq/56-dwc_otg08:30:331
480299301,6cyclictest7850irq/56-dwc_otg08:30:331
480299294,5cyclictest8050irq/56-dwc_otg_07:40:371
480499282,5cyclictest7850irq/56-dwc_otg08:55:453
480299287,14cyclictest23-21ksoftirqd/108:05:341
44122273,17sleep30-21swapper/307:08:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional