You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 16:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Jul 17, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2599325410,6sleep30-21swapper/307:05:373
2752022860,4sleep027522-21cpufreq07:10:190
27550991294,49cyclictest0-21swapper/010:15:500
27551991103,22cyclictest0-21swapper/110:15:501
27551991084,21cyclictest0-21swapper/111:10:521
275509910638,42cyclictest0-21swapper/010:25:530
275519910211,73cyclictest28945-21runrttasks12:15:471
275509910225,43cyclictest0-21swapper/009:50:320
279902970,2sleep00-21swapper/009:37:160
133862920,10sleep00-21swapper/011:18:450
310092910,1sleep30-21swapper/312:19:113
2755199903,15cyclictest2668-21sed10:25:521
2755099886,39cyclictest0-21swapper/011:20:330
2755099864,54cyclictest0-21swapper/012:15:500
27550998633,31cyclictest7539-21ssh11:10:510
2755199853,21cyclictest0-21swapper/112:10:441
27550998345,16cyclictest0-21swapper/011:40:320
2755099834,46cyclictest0-21swapper/011:45:370
2755199814,21cyclictest0-21swapper/111:40:351
2755099818,47cyclictest9-21ksoftirqd/012:10:420
313752790,2sleep10-21swapper/107:20:351
2755199774,17cyclictest2910-21/usr/sbin/munin11:45:401
2755199751,5cyclictest25941-21ssh09:35:321
284562740,1sleep30-21swapper/310:18:413
27550997421,30cyclictest4552-21/usr/sbin/munin07:35:370
2755199732,6cyclictest7139-21/usr/sbin/munin09:10:461
2755199722,6cyclictest0-21swapper/108:40:381
2755099727,17cyclictest0-21swapper/009:45:340
2755099726,14cyclictest0-21swapper/011:35:260
125282710,2sleep20-21swapper/210:38:372
2755199706,10cyclictest17322-21aten_rbpower_vo10:05:351
27553996812,28cyclictest0-21swapper/311:10:513
2755199682,8cyclictest30640-21grep08:45:491
2755099683,61cyclictest0-21swapper/009:15:340
2755199677,24cyclictest0-21swapper/111:55:331
2755199664,4cyclictest7850irq/56-dwc_otg10:30:301
2755199664,16cyclictest8050irq/56-dwc_otg_08:20:411
2755199652,22cyclictest7950irq/56-dwc_otg_12:01:051
27551996519,8cyclictest14255-21aten_rbpower_vo09:20:341
2755399621,26cyclictest0-21swapper/307:25:323
2755199625,5cyclictest7850irq/56-dwc_otg09:50:191
2755399611,36cyclictest0-21swapper/312:10:333
2755199615,10cyclictest31996-21ssh12:20:311
27551996124,6cyclictest20312-21ssh09:27:411
27551996124,6cyclictest20312-21ssh09:27:411
2755399603,9cyclictest7850irq/56-dwc_otg10:25:513
2755199605,26cyclictest30620-21ssh10:20:471
27550995913,21cyclictest0-21swapper/007:45:200
27550995739,5cyclictest7950irq/56-dwc_otg_12:00:350
27552995615,19cyclictest8050irq/56-dwc_otg_12:10:412
27552995612,25cyclictest26747-21ssh10:15:492
2755099567,46cyclictest0-21swapper/008:30:340
2755099567,46cyclictest0-21swapper/008:30:340
2755099562,35cyclictest0-21swapper/010:45:310
2755099562,28cyclictest0-21swapper/008:40:190
27550995622,16cyclictest14099-21/usr/sbin/munin09:20:470
27550995614,17cyclictest31528-21sh09:41:300
27550995614,17cyclictest31528-21sh09:41:300
93082550,2sleep30-21swapper/311:52:183
93082550,2sleep30-21swapper/311:52:183
27552995510,26cyclictest31258-21ssh11:40:322
2755199557,41cyclictest0-21swapper/107:25:321
27550995529,14cyclictest0-21swapper/008:15:410
27550995515,21cyclictest32085-21aten_rbpower_vo12:20:330
2755099551,36cyclictest13-21rcuc/009:10:190
2755099551,10cyclictest2445-21latency_hist09:00:200
2755099551,10cyclictest2445-21latency_hist09:00:200
2755399541,18cyclictest8050irq/56-dwc_otg_11:15:253
2755299546,24cyclictest29090-21unixbench_multi12:15:502
27550995445,7cyclictest0-21swapper/008:20:330
27550995410,27cyclictest32052-21switchtime07:20:480
27553995313,21cyclictest8050irq/56-dwc_otg_11:45:393
2755299538,28cyclictest0-21swapper/209:05:342
27550995327,12cyclictest8050irq/56-dwc_otg_10:55:490
27550995327,12cyclictest8050irq/56-dwc_otg_10:55:490
27550995324,3cyclictest0-21swapper/008:10:360
27550995320,24cyclictest0-21swapper/008:29:440
27550995318,25cyclictest0-21swapper/010:00:120
27550995318,25cyclictest0-21swapper/010:00:120
2755299523,26cyclictest0-21swapper/211:10:522
2755099526,35cyclictest5893-21diskmemload09:15:190
27550995230,6cyclictest7850irq/56-dwc_otg10:50:490
146142520,23sleep00-21swapper/010:01:060
27550995139,4cyclictest7950irq/56-dwc_otg_10:05:520
27550995128,5cyclictest8050irq/56-dwc_otg_07:10:370
2755099511,10cyclictest0-21swapper/008:50:420
27550995110,21cyclictest0-21swapper/011:55:350
9372500,6sleep32755399cyclictest11:03:543
2755399503,13cyclictest31254-21dpkg11:40:313
27552995010,19cyclictest7950irq/56-dwc_otg_11:45:372
27550995026,8cyclictest6066-21ssh10:30:400
2755099502,25cyclictest0-21swapper/011:00:370
27550995016,4cyclictest0-21swapper/010:10:480
27550995014,18cyclictest8349-21uname12:30:380
2755099501,23cyclictest11309-21ls07:55:190
2755099501,23cyclictest11309-21ls07:55:190
2755099501,13cyclictest0-21swapper/012:25:430
2755299492,14cyclictest8050irq/56-dwc_otg_10:25:522
27552994919,9cyclictest0-21swapper/209:50:432
2755099492,37cyclictest0-21swapper/010:35:460
2755099491,30cyclictest30960-21modprobe07:20:190
2755099491,25cyclictest0-21swapper/011:05:470
2755299488,26cyclictest0-21swapper/208:25:262
2755199488,32cyclictest0-21swapper/109:55:341
2755199488,32cyclictest0-21swapper/109:55:341
2755199487,25cyclictest0-21swapper/107:40:331
2755199486,12cyclictest1306-21missed_timers08:55:431
2755199486,12cyclictest1306-21missed_timers08:55:431
2755199481,11cyclictest27082-21ssh11:35:301
27550994824,12cyclictest0-21swapper/012:05:300
27550994817,15cyclictest29533-21/usr/sbin/munin08:45:410
27550994814,23cyclictest2364-21/usr/sbin/munin07:30:480
184862480,9sleep2301ktimersoftd/212:03:562
2755399471,29cyclictest0-21swapper/309:10:333
2755199473,11cyclictest32474-21grep08:50:511
2755099476,29cyclictest0-21swapper/007:55:350
2755099472,33cyclictest22495-21ssh09:30:400
27550994721,5cyclictest7950irq/56-dwc_otg_09:25:450
27550994721,5cyclictest7950irq/56-dwc_otg_09:25:450
2755099471,40cyclictest8050irq/56-dwc_otg_09:00:470
2755299462,8cyclictest7950irq/56-dwc_otg_09:35:312
27551994625,5cyclictest31073-21sh09:40:521
27551994625,5cyclictest31073-21sh09:40:521
2755199462,10cyclictest13496-21uniq10:00:381
2755099462,36cyclictest0-21swapper/012:35:290
2755099462,24cyclictest0-21swapper/011:33:200
27550994612,18cyclictest727-21runrttasks08:43:420
2755399459,30cyclictest0-21swapper/309:05:343
2755399458,26cyclictest0-21swapper/308:25:263
2755399456,25cyclictest29721-21sh10:20:333
27553994528,10cyclictest4134-21ssh09:48:423
27553994526,7cyclictest5744-21ssh09:50:383
2755199457,27cyclictest7850irq/56-dwc_otg09:05:511
2755099451,27cyclictest13823-21resolvconf10:40:310
2755199445,4cyclictest8050irq/56-dwc_otg_09:15:341
2755199438,28cyclictest0-21swapper/108:25:271
2755199431,7cyclictest17968-21ssh10:45:321
27551994312,17cyclictest0-21swapper/109:50:321
27550994325,6cyclictest8050irq/56-dwc_otg_10:23:000
2755099431,21cyclictest0-21swapper/011:25:370
2755099431,14cyclictest9237-21ssh11:52:110
2755099431,14cyclictest9237-21ssh11:52:110
2755199427,25cyclictest0-21swapper/107:10:321
2755199424,30cyclictest8050irq/56-dwc_otg_12:30:371
27550994215,16cyclictest14131-21grep08:00:470
2755399411,24cyclictest0-21swapper/308:00:343
2755199417,24cyclictest0-21swapper/111:15:251
2755099413,23cyclictest0-21swapper/007:28:580
27550994118,13cyclictest0-21swapper/007:46:280
2755399407,20cyclictest8050irq/56-dwc_otg_12:25:333
2755399405,23cyclictest30115-21df09:40:363
2755399405,23cyclictest30115-21df09:40:363
2755399403,4cyclictest8050irq/56-dwc_otg_08:55:323
2755399403,4cyclictest8050irq/56-dwc_otg_08:55:323
2755399401,26cyclictest13126-21ssh10:00:293
27552994012,14cyclictest31406-21ssh09:41:152
27552994012,14cyclictest31406-21ssh09:41:152
2755199405,31cyclictest8050irq/56-dwc_otg_09:30:321
2755199404,6cyclictest0-21swapper/107:30:331
2755199401,9cyclictest0-21swapper/108:10:311
27551994015,5cyclictest7850irq/56-dwc_otg08:15:501
2755099406,16cyclictest0-21swapper/008:05:510
27552993914,5cyclictest17442-21/usr/sbin/munin10:05:372
2755299391,12cyclictest0-21swapper/207:10:322
2755199393,7cyclictest7850irq/56-dwc_otg07:55:331
2755199391,6cyclictest7850irq/56-dwc_otg08:30:341
2755199391,6cyclictest7850irq/56-dwc_otg08:30:341
2755199391,27cyclictest0-21swapper/112:08:301
149812390,8sleep28050irq/56-dwc_otg_12:00:062
2755399387,22cyclictest0-21swapper/307:50:343
2755399387,22cyclictest0-21swapper/307:50:343
2755399382,27cyclictest0-21swapper/309:32:563
2755399381,27cyclictest0-21swapper/310:05:333
2755299389,9cyclictest7950irq/56-dwc_otg_09:25:192
2755299389,14cyclictest0-21swapper/209:56:142
2755299389,14cyclictest0-21swapper/209:56:142
27552993810,4cyclictest8050irq/56-dwc_otg_10:00:302
27551993810,4cyclictest0-21swapper/111:00:191
27551993810,4cyclictest0-21swapper/111:00:191
2755399374,15cyclictest7950irq/56-dwc_otg_12:40:203
27553993722,7cyclictest381ktimersoftd/310:48:143
2755399371,22cyclictest22186-21latency_hist08:25:203
2755299373,12cyclictest8050irq/56-dwc_otg_09:50:202
2755299372,7cyclictest7850irq/56-dwc_otg08:50:352
27552993719,6cyclictest18544-21if_wlan009:25:382
27552993719,6cyclictest18544-21if_wlan009:25:382
27552993713,5cyclictest7850irq/56-dwc_otg11:25:392
2755199378,17cyclictest0-21swapper/109:00:321
2755199374,17cyclictest0-21swapper/108:40:191
2755199372,6cyclictest0-21swapper/111:25:471
27551993723,7cyclictest7950irq/56-dwc_otg_10:50:331
135672370,10sleep17950irq/56-dwc_otg_12:36:201
2755399362,21cyclictest7950irq/56-dwc_otg_10:30:343
27553993618,8cyclictest498250ssh11:08:443
27553993610,4cyclictest0-21swapper/309:20:453
2755299363,22cyclictest0-21swapper/209:00:322
2755299361,25cyclictest0-21swapper/211:36:462
2755199368,13cyclictest21978-21ssh10:10:401
2755199361,9cyclictest10435-21ssh10:35:421
27551993616,6cyclictest7950irq/56-dwc_otg_11:10:201
27551993615,6cyclictest15303-21sh10:41:071
2755199361,25cyclictest23918-21timerandwakeup11:30:481
2755399358,17cyclictest39-21ksoftirqd/309:35:323
2755399354,25cyclictest8050irq/56-dwc_otg_07:30:303
2755399353,16cyclictest7950irq/56-dwc_otg_09:55:513
2755399353,16cyclictest7950irq/56-dwc_otg_09:55:513
2755399352,23cyclictest0-21swapper/309:29:093
2755399352,23cyclictest0-21swapper/309:29:093
2755399352,17cyclictest8050irq/56-dwc_otg_09:05:193
2755399351,24cyclictest0-21swapper/309:19:133
2755399351,23cyclictest28125-21timerandwakeup11:35:453
27553993511,13cyclictest8050irq/56-dwc_otg_10:10:213
2755299359,11cyclictest8050irq/56-dwc_otg_08:55:352
2755299359,11cyclictest8050irq/56-dwc_otg_08:55:352
27552993520,6cyclictest0-21swapper/210:24:272
2755299351,17cyclictest8050irq/56-dwc_otg_08:45:372
27552993510,16cyclictest455-21ssh12:20:442
2755199354,16cyclictest8050irq/56-dwc_otg_08:10:191
27551993510,15cyclictest0-21swapper/107:35:331
2755399344,19cyclictest12580-21grep11:55:493
2755399341,5cyclictest0-21swapper/307:15:313
2755399341,21cyclictest0-21swapper/308:45:493
2755399341,14cyclictest0-21swapper/308:43:353
2755299345,17cyclictest22279-21fschecks_count09:30:372
2755299342,6cyclictest19562-21timerandwakeup08:15:492
2755299342,20cyclictest7176-21ssh09:10:472
27552993418,5cyclictest10825-21sh09:15:432
27552993414,5cyclictest31-21ksoftirqd/211:30:492
27552993412,5cyclictest20585-21cat12:05:452
28502330,3sleep22849-21ssh11:05:422
2755399338,13cyclictest0-21swapper/310:35:423
2755399332,19cyclictest0-21swapper/312:03:563
2755399332,17cyclictest8050irq/56-dwc_otg_08:20:203
2755399331,22cyclictest0-21swapper/311:33:153
2755399331,15cyclictest29282-21latency_hist07:15:193
27553993311,11cyclictest0-21swapper/310:40:323
2755299339,12cyclictest0-21swapper/210:40:362
2755299338,13cyclictest0-21swapper/211:25:202
2755299338,11cyclictest0-21swapper/210:45:312
2755299332,22cyclictest0-21swapper/208:20:412
2755299331,5cyclictest15770-21munin-run12:40:192
2755299331,3cyclictest0-21swapper/207:25:332
27552993311,9cyclictest8050irq/56-dwc_otg_10:30:472
2755299331,13cyclictest0-21swapper/211:52:012
2755299331,13cyclictest0-21swapper/211:52:012
2755199337,6cyclictest7850irq/56-dwc_otg11:20:491
2755199335,19cyclictest7188-21ssh11:50:321
2755199335,19cyclictest7188-21ssh11:50:321
2755199333,4cyclictest13329-21/usr/sbin/munin08:00:351
2755199332,16cyclictest7950irq/56-dwc_otg_07:50:421
2755199332,16cyclictest7950irq/56-dwc_otg_07:50:421
27551993312,10cyclictest0-21swapper/111:01:001
2755399327,19cyclictest0-21swapper/307:55:353
2755399321,5cyclictest2967-21ssh12:24:403
2755399321,19cyclictest0-21swapper/308:05:363
2755399321,13cyclictest0-21swapper/308:55:203
2755299329,5cyclictest8050irq/56-dwc_otg_10:10:432
2755299323,15cyclictest8050irq/56-dwc_otg_08:35:492
2755299322,7cyclictest5329-21grep07:35:492
2755299322,15cyclictest8377-21cat12:30:382
2755299321,22cyclictest0-21swapper/208:40:492
2755199322,20cyclictest0-21swapper/112:25:211
2755399317,15cyclictest0-21swapper/310:55:483
2755399317,15cyclictest0-21swapper/310:55:483
2755399316,13cyclictest16937-21sh11:22:403
2755399313,4cyclictest8050irq/56-dwc_otg_10:50:453
2755399312,22cyclictest0-21swapper/308:34:503
2755399312,22cyclictest0-21swapper/308:34:503
27553993120,5cyclictest20971-21rm12:05:553
27553993117,8cyclictest7794-21/usr/sbin/munin12:30:333
2755399311,19cyclictest0-21swapper/311:25:293
2755299318,10cyclictest8050irq/56-dwc_otg_08:05:402
27552993122,6cyclictest23403-21sshd10:50:492
2755399308,12cyclictest9427-21wc07:50:203
2755399303,12cyclictest0-21swapper/308:35:463
2755399302,20cyclictest0-21swapper/307:44:123
2755299306,14cyclictest0-21swapper/212:25:332
2755299306,14cyclictest0-21swapper/207:55:352
2755299304,13cyclictest8050irq/56-dwc_otg_11:00:392
2755299302,25cyclictest0-21swapper/208:30:402
2755299302,25cyclictest0-21swapper/208:30:402
2755299301,6cyclictest6510-21wc07:40:402
2755299301,5cyclictest13269-21wget08:00:342
27552993014,4cyclictest9991-21cron11:15:262
2755299301,3cyclictest7950irq/56-dwc_otg_07:45:322
2755199304,6cyclictest7850irq/56-dwc_otg07:15:391
2706323017,6sleep10-21swapper/107:07:301
27553992913,9cyclictest727-21runrttasks07:20:533
2755399291,19cyclictest0-21swapper/308:10:423
2755399291,19cyclictest0-21swapper/307:37:433
2755299294,9cyclictest8050irq/56-dwc_otg_08:10:452
2755299293,4cyclictest7950irq/56-dwc_otg_10:55:352
2755299293,4cyclictest7950irq/56-dwc_otg_10:55:352
2755299291,23cyclictest3940-21latency_hist07:35:192
2755199293,13cyclictest8050irq/56-dwc_otg_07:45:401
2755299281,17cyclictest0-21swapper/207:50:342
2755299281,17cyclictest0-21swapper/207:50:342
255702283,12sleep20-21swapper/207:05:212
2755299274,3cyclictest8050irq/56-dwc_otg_07:15:412
2755299271,17cyclictest31558-21idleruntime07:20:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional