You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 19:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Thu Sep 03, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173421640,5sleep0335799cyclictest09:33:520
3357991302,99cyclictest0-21swapper/009:40:380
3357991302,99cyclictest0-21swapper/009:40:380
33579912337,62cyclictest7750irq/56-dwc_otg09:25:410
33589911230,65cyclictest7850irq/56-dwc_otg_10:15:451
3357991062,81cyclictest4693-21grep10:15:430
33579910119,36cyclictest0-21swapper/012:20:270
33579910119,36cyclictest0-21swapper/012:20:270
33579910112,73cyclictest4014-21ssh11:34:230
3357991003,71cyclictest0-21swapper/009:35:280
335899994,26cyclictest0-21swapper/109:35:291
335799961,80cyclictest8705-21latency_hist11:40:150
3357999140,7cyclictest0-21swapper/008:20:270
3358998911,8cyclictest7950irq/56-dwc_otg_09:25:431
335799875,60cyclictest0-21swapper/009:10:280
3357998714,66cyclictest14139-21diskmemload12:35:310
300632860,2sleep30-21swapper/310:07:453
335799838,52cyclictest27343-21rm10:05:150
335799822,7cyclictest9002-21aten_rbpower_cu08:55:280
3357998215,50cyclictest14677-21kernelversion07:40:350
335799813,5cyclictest0-21swapper/010:35:420
335799811,8cyclictest32548-21aten_rbpower_po10:50:280
335799802,7cyclictest31639-21grep08:25:430
335799792,57cyclictest0-21swapper/011:52:000
335799791,8cyclictest31017-21sed12:05:440
3359997813,43cyclictest7950irq/56-dwc_otg_09:35:292
335799781,8cyclictest30232-21unixbench_multi11:25:430
3357997712,52cyclictest7439-21fschecks_count08:50:330
335799762,8cyclictest12216-21latency_hist07:35:150
335799762,8cyclictest0-21swapper/012:28:210
335799761,62cyclictest29005-21ssh10:05:490
335799753,6cyclictest0-21swapper/012:00:280
335799751,59cyclictest28326-21taskset08:18:040
3357997330,41cyclictest248442sleep011:20:260
335799731,58cyclictest29111-21ssh10:45:390
3357997313,49cyclictest5059-21taskset08:44:450
3357997312,40cyclictest16203-21systemd-journal10:15:140
335799722,7cyclictest0-21swapper/010:56:200
335799722,7cyclictest0-21swapper/010:56:200
335799722,6cyclictest0-21swapper/009:57:500
335799721,60cyclictest13415-21sed11:05:400
335799714,40cyclictest0-21swapper/011:55:230
335799711,56cyclictest13599-21/usr/sbin/munin11:45:330
335799709,48cyclictest6932-21idleruntime-cro08:50:150
335799702,7cyclictest9271-21fschecks_count11:40:310
3357997014,37cyclictest0-21swapper/009:49:150
266082700,5sleep2335999cyclictest10:42:472
335799692,58cyclictest0-21swapper/011:20:160
335799691,51cyclictest6503-21/usr/sbin/munin12:15:400
335799691,50cyclictest18008-21cut07:50:300
335799691,44cyclictest27612-21ssh10:44:360
3357996910,41cyclictest23121-21df09:20:300
282412690,1sleep30-21swapper/311:24:303
335799682,8cyclictest0-21swapper/007:48:400
335799682,7cyclictest0-21swapper/009:52:100
335799681,51cyclictest13159-21proc_pri07:35:400
335799681,48cyclictest0-21swapper/008:12:400
3357996812,42cyclictest0-21swapper/010:32:550
335999679,30cyclictest0-21swapper/209:40:382
335999679,30cyclictest0-21swapper/209:40:382
335799674,4cyclictest0-21swapper/012:30:480
335799671,8cyclictest0-21swapper/010:21:050
335799671,46cyclictest19057-21rm11:12:510
335799661,42cyclictest0-21swapper/010:26:050
3357996611,43cyclictest11990-21chrt09:01:030
3357996611,40cyclictest0-21swapper/007:56:420
3359996535,9cyclictest301ktimersoftd/210:15:452
335799657,44cyclictest0-21swapper/007:19:500
335799651,44cyclictest0-21swapper/012:12:180
29952653,14sleep10-21swapper/107:09:151
335899633,14cyclictest7742-21ssh09:40:401
335899633,14cyclictest7742-21ssh09:40:401
335899632,12cyclictest32028-21ssh09:30:451
3357996311,40cyclictest0-21swapper/008:09:410
3360996220,20cyclictest37-21rcuc/309:25:443
335799629,40cyclictest0-21swapper/011:02:230
3360996114,24cyclictest7950irq/56-dwc_otg_09:30:453
335899616,23cyclictest0-21swapper/111:55:251
335799618,45cyclictest0-21swapper/007:22:240
335799612,7cyclictest0-21swapper/008:01:370
335799612,40cyclictest0-21swapper/008:35:160
335799612,40cyclictest0-21swapper/008:35:160
3357996112,32cyclictest0-21swapper/008:36:400
335999603,37cyclictest0-21swapper/209:30:422
3359995923,11cyclictest28215-21/usr/sbin/munin09:25:442
335799591,5cyclictest0-21swapper/009:17:360
335799591,4cyclictest4082-21ntp_states07:10:390
335799591,39cyclictest0-21swapper/007:25:420
95862580,3sleep1335899cyclictest11:00:451
3360995717,15cyclictest39-21ksoftirqd/309:40:403
3360995717,15cyclictest39-21ksoftirqd/309:40:403
3360995716,35cyclictest0-21swapper/309:35:293
130632570,2sleep30-21swapper/312:24:293
130632570,2sleep30-21swapper/312:24:293
335799561,8cyclictest0-21swapper/009:06:300
72792550,5sleep1335899cyclictest10:59:001
72792550,5sleep1335899cyclictest10:59:001
336099559,18cyclictest0-21swapper/310:15:443
335899545,12cyclictest1471-21ssh12:10:311
335899513,8cyclictest0-21swapper/110:50:261
335899495,13cyclictest7750irq/56-dwc_otg10:20:271
3358994910,4cyclictest7950irq/56-dwc_otg_08:45:281
3359994824,6cyclictest301ktimersoftd/208:50:272
335899483,7cyclictest0-21swapper/107:35:281
135102480,6sleep1335899cyclictest12:25:151
135102480,6sleep1335899cyclictest12:25:151
335899478,13cyclictest7750irq/56-dwc_otg10:35:261
15152474,36sleep00-21swapper/007:05:220
78022461,2sleep20-21swapper/207:20:402
336099464,7cyclictest7750irq/56-dwc_otg11:40:263
3358994628,4cyclictest12865-21fschecks_time09:05:341
335899461,6cyclictest0-21swapper/110:05:281
335899461,25cyclictest0-21swapper/112:05:261
3358994611,23cyclictest0-21swapper/108:50:291
335999451,27cyclictest10527-21latency_hist09:00:152
335899456,25cyclictest14516-21ssh09:10:281
335899453,10cyclictest0-21swapper/109:45:271
14672450,2sleep20-21swapper/212:10:312
336099448,26cyclictest0-21swapper/308:55:283
3359994412,22cyclictest20533-21if_wlan010:35:352
335899442,7cyclictest0-21swapper/110:40:271
335899441,5cyclictest0-21swapper/108:55:251
253902440,3sleep225355-21ssh12:00:162
159372440,3sleep215936-21ssh09:50:412
335899436,24cyclictest0-21swapper/108:10:271
335899431,9cyclictest7950irq/56-dwc_otg_09:20:361
3358994312,15cyclictest7850irq/56-dwc_otg_10:10:321
140512430,6sleep3336099cyclictest12:25:303
336099421,28cyclictest20411-21fschecks_time10:35:333
3359994216,5cyclictest31-21ksoftirqd/210:50:152
335899427,25cyclictest0-21swapper/108:15:281
217952420,2sleep30-21swapper/311:15:413
180122420,5sleep3381ktimersoftd/309:14:353
335999417,8cyclictest7850irq/56-dwc_otg_07:10:432
3359994122,4cyclictest30232-21if_wlan012:05:342
3358994119,6cyclictest566850wget12:15:281
335899411,4cyclictest0-21swapper/110:25:251
335999405,21cyclictest0-21swapper/209:05:302
3359994023,12cyclictest0-21swapper/210:10:322
3359994017,5cyclictest8210-21/usr/sbin/munin10:20:352
335999401,26cyclictest0-21swapper/211:12:402
335899406,23cyclictest0-21swapper/111:50:321
335899406,22cyclictest25627-21ssh12:00:281
335899402,10cyclictest0-21swapper/111:05:261
3359993920,5cyclictest17409-21seq09:13:312
3359993918,5cyclictest11232-21/usr/sbin/munin09:00:352
335999391,19cyclictest7850irq/56-dwc_otg_10:50:402
335899398,8cyclictest7750irq/56-dwc_otg10:30:361
335899397,24cyclictest0-21swapper/108:00:291
335899397,22cyclictest0-21swapper/107:50:211
335899392,7cyclictest1776350ssh11:10:431
335899391,24cyclictest538-21ls11:30:161
250292390,2sleep30-21swapper/312:00:013
159962390,6sleep1335899cyclictest12:27:171
336099389,18cyclictest0-21swapper/309:55:423
336099387,15cyclictest32458-21aten_rbpower_po08:30:283
336099387,15cyclictest32458-21aten_rbpower_po08:30:283
336099383,20cyclictest0-21swapper/311:30:303
336099381,6cyclictest0-21swapper/309:20:263
336099381,16cyclictest32312-21latency_hist10:50:163
335899389,13cyclictest7750irq/56-dwc_otg11:30:361
335899386,22cyclictest24884-21kworker/u8:009:55:211
335899385,4cyclictest7950irq/56-dwc_otg_08:25:271
320792381,2sleep30-21swapper/310:10:363
76382370,2sleep30-21swapper/308:50:363
336099371,28cyclictest14934-21ls09:50:153
335999374,6cyclictest7750irq/56-dwc_otg11:15:362
3359993712,7cyclictest4659-21grep08:40:432
335899376,7cyclictest0-21swapper/107:55:241
335899376,5cyclictest7750irq/56-dwc_otg07:20:281
3358993719,8cyclictest10657-21aten_rbpower_en07:30:291
258082372,3sleep10-21swapper/110:02:331
125862370,1sleep10-21swapper/111:44:581
336099369,5cyclictest0-21swapper/308:10:283
336099368,13cyclictest30221-21kworker/3:208:25:373
336099362,18cyclictest0-21swapper/307:19:333
336099362,17cyclictest0-21swapper/308:49:413
336099361,23cyclictest369-21ls10:50:323
335999365,15cyclictest7950irq/56-dwc_otg_10:10:152
335899361,20cyclictest0-21swapper/111:20:371
335899361,10cyclictest13187-21ssh11:45:281
254252360,5sleep3336099cyclictest10:01:493
336099352,15cyclictest13141-21ssh11:05:363
3360993512,5cyclictest7955-21cron11:00:153
3360993512,5cyclictest7955-21cron11:00:153
3360993510,13cyclictest0-21swapper/312:10:323
335999352,4cyclictest7950irq/56-dwc_otg_07:45:272
335899356,4cyclictest5359-21ssh11:35:351
335899351,9cyclictest9120-21fschecks_time07:25:331
336099346,14cyclictest0-21swapper/309:05:303
336099344,22cyclictest7950irq/56-dwc_otg_07:45:263
3360993412,7cyclictest381ktimersoftd/310:30:163
336099341,25cyclictest29545-21latency11:25:353
3360993412,4cyclictest25652-21aten_rbpower_cu12:00:293
335999345,20cyclictest23520-21ssh10:00:282
335999342,6cyclictest26081-21grep11:20:422
335999342,5cyclictest509-21cron09:25:142
335999341,7cyclictest0-21swapper/207:30:262
3359993415,5cyclictest14647-21/usr/sbin/munin12:25:392
3359993413,4cyclictest423150wget10:55:282
3359993413,4cyclictest423150wget10:55:282
335899347,4cyclictest7750irq/56-dwc_otg11:15:251
54052331,25sleep10-21swapper/107:15:321
336099336,13cyclictest7950irq/56-dwc_otg_08:40:433
336099331,23cyclictest16536-21ssh10:30:393
336099331,23cyclictest0-21swapper/307:30:283
336099331,22cyclictest0-21swapper/311:53:373
3360993311,10cyclictest0-21swapper/310:40:293
335999338,12cyclictest7850irq/56-dwc_otg_10:25:362
335999338,12cyclictest7850irq/56-dwc_otg_08:10:312
335999336,4cyclictest7850irq/56-dwc_otg_08:15:422
335999332,8cyclictest9987-21fschecks_count12:20:312
335999332,8cyclictest9987-21fschecks_count12:20:312
3359993317,4cyclictest8292-21/usr/sbin/munin11:00:402
3359993314,4cyclictest13154-21sh11:45:282
335999331,22cyclictest20597-21tail09:55:432
3359993311,5cyclictest14800-21sh09:50:142
335899332,6cyclictest16089-21ssh09:50:441
335899331,3cyclictest0-21swapper/110:45:341
335899331,22cyclictest16537-21latency07:45:351
3358993311,11cyclictest0-21swapper/112:38:411
22382337,12sleep20-21swapper/207:05:402
336099323,4cyclictest8309-21apt-get11:00:283
336099322,5cyclictest7750irq/56-dwc_otg07:10:403
336099322,26cyclictest7950irq/56-dwc_otg_12:30:303
336099322,22cyclictest0-21swapper/309:04:103
336099322,18cyclictest13354-21cut11:45:313
336099321,27cyclictest30397-21ls08:25:153
336099321,22cyclictest0-21swapper/312:05:353
3360993212,11cyclictest0-21swapper/310:20:293
3360993210,20cyclictest0-21swapper/308:35:283
335999329,10cyclictest7850irq/56-dwc_otg_12:35:342
335999327,15cyclictest0-21swapper/208:30:272
335999327,15cyclictest0-21swapper/208:30:272
335999326,6cyclictest7850irq/56-dwc_otg_09:20:152
335999326,17cyclictest7950irq/56-dwc_otg_08:35:282
335999322,23cyclictest7950irq/56-dwc_otg_11:30:302
3359993218,7cyclictest7950irq/56-dwc_otg_11:05:382
3359993214,5cyclictest20425-21dhclient-script07:55:362
335899327,6cyclictest7950irq/56-dwc_otg_09:15:371
335899327,14cyclictest0-21swapper/112:30:331
335899326,16cyclictest0-21swapper/108:05:281
335899324,5cyclictest7750irq/56-dwc_otg08:40:331
335899323,5cyclictest2833-21grep08:35:421
335899323,15cyclictest11449-21ntp_kernel_pll_09:00:371
335899322,8cyclictest7950irq/56-dwc_otg_07:40:411
336099316,10cyclictest7850irq/56-dwc_otg_09:50:333
336099311,27cyclictest10505-21ls07:30:153
336099311,21cyclictest0-21swapper/309:17:513
336099311,19cyclictest0-21swapper/312:35:313
336099311,18cyclictest0-21swapper/307:55:243
335999319,5cyclictest24260-21wc08:05:412
335999317,4cyclictest0-21swapper/212:00:392
335999314,7cyclictest7850irq/56-dwc_otg_11:50:172
335999314,6cyclictest31-21ksoftirqd/211:25:312
335999311,9cyclictest7570-21ssh11:38:202
3359993111,13cyclictest0-21swapper/208:20:312
335899318,5cyclictest7750irq/56-dwc_otg07:10:301
336099309,11cyclictest7950irq/56-dwc_otg_11:13:483
336099308,14cyclictest37-21rcuc/311:35:263
3360993023,4cyclictest7342-21/usr/sbin/munin07:20:323
3360993011,13cyclictest0-21swapper/312:16:403
335999308,4cyclictest7950irq/56-dwc_otg_10:30:472
335999307,15cyclictest0-21swapper/207:40:282
335999307,10cyclictest7850irq/56-dwc_otg_11:40:372
335999302,9cyclictest0-21swapper/212:15:342
3359993011,4cyclictest7850irq/56-dwc_otg_08:00:272
3359993010,13cyclictest0-21swapper/212:30:362
335899302,20cyclictest0-21swapper/108:32:451
335899302,20cyclictest0-21swapper/108:32:451
336099291,17cyclictest7950irq/56-dwc_otg_08:08:193
335999296,5cyclictest0-21swapper/207:35:382
335999295,13cyclictest7850irq/56-dwc_otg_08:25:362
335999292,9cyclictest6929-21idleruntime-cro08:50:152
335999291,21cyclictest0-21swapper/207:15:192
28892291,19sleep30-21swapper/307:07:523
336099286,19cyclictest0-21swapper/307:40:283
336099281,17cyclictest23096-21latency_hist08:05:153
335999288,12cyclictest7950irq/56-dwc_otg_07:30:152
336099272,12cyclictest7950irq/56-dwc_otg_07:50:183
336099271,13cyclictest12970-21missed_timers07:35:363
335899277,7cyclictest7750irq/56-dwc_otg08:20:331
336099261,16cyclictest27701-21uname08:15:393
335999261,18cyclictest0-21swapper/207:50:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional