You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 22:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Sat Sep 05, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
576025420,5sleep10-21swapper/107:05:441
576025420,5sleep10-21swapper/107:05:441
764621790,2sleep2670399cyclictest10:55:332
491421720,5sleep3670999cyclictest08:35:163
1514321310,4sleep3670999cyclictest12:22:463
1514321310,4sleep3670999cyclictest12:22:463
6689991296,103cyclictest0-21swapper/009:10:400
1603621240,2sleep20-21swapper/209:46:322
66899911812,80cyclictest9-21ksoftirqd/011:35:340
8542920,2sleep10-21swapper/112:05:371
670999892,80cyclictest8280-21df11:35:323
670999853,73cyclictest17865-21/usr/sbin/munin09:10:383
6689998511,63cyclictest25945-21ssh11:55:540
312782850,2sleep20-21swapper/211:24:112
6689998415,48cyclictest6913-21aten_rbpower_en08:40:310
668999841,53cyclictest18447-21apt-get09:50:320
668999831,6cyclictest8971-21fschecks_time08:45:330
6689998313,52cyclictest14872-21sh11:04:340
668999821,7cyclictest20427-21rm11:50:290
66252820,2sleep00-21swapper/010:54:300
269492820,2sleep20-21swapper/211:57:452
6689998113,64cyclictest280122chrt09:21:460
117422810,5sleep2670399cyclictest11:00:322
668999805,62cyclictest0-21swapper/010:00:110
6689997914,50cyclictest28954-21sh10:02:150
6689997845,23cyclictest0-21swapper/008:05:300
668999781,63cyclictest20066-21cron11:50:160
668999781,62cyclictest13473-21/usr/sbin/munin11:40:460
668999771,6cyclictest19561-21latency_hist11:10:160
668999771,59cyclictest0-21swapper/010:10:300
668999762,7cyclictest15809-21latency_hist09:05:170
668999761,9cyclictest0-21swapper/012:30:160
6689997617,35cyclictest1180-21runrttasks08:15:170
6689997616,29cyclictest0-21swapper/010:40:290
668999761,59cyclictest0-21swapper/012:15:330
668999752,62cyclictest0-21swapper/007:45:460
668999751,7cyclictest719-21tail08:20:450
668999751,7cyclictest719-21tail08:20:450
668999751,60cyclictest23308-21/usr/sbin/munin10:35:430
310032750,6sleep2670399cyclictest09:25:392
6689997451,15cyclictest0-21swapper/011:15:320
668999741,55cyclictest32711-21sshd12:05:200
6689997413,46cyclictest17435-21diskmemload11:21:460
6689997411,49cyclictest8484-21ssh10:16:350
6689997410,48cyclictest20482-21/usr/sbin/munin10:30:480
668999736,59cyclictest1628-21sh10:47:560
668999732,7cyclictest0-21swapper/007:10:450
668999731,59cyclictest0-21swapper/009:32:420
37742730,2sleep20-21swapper/212:09:362
670999721,41cyclictest0-21swapper/308:40:283
668999721,54cyclictest0-21swapper/010:56:380
670999711,4cyclictest7950irq/56-dwc_otg_11:55:273
668999718,49cyclictest30547-21ssh12:01:460
668999717,55cyclictest12994-21diskmemload10:22:170
668999712,53cyclictest0-21swapper/009:16:160
668999712,53cyclictest0-21swapper/009:16:160
668999711,7cyclictest3577-21sh11:30:160
668999711,58cyclictest20900-21ssh12:30:220
283312710,2sleep30-21swapper/308:10:173
670999702,52cyclictest25094-21tr12:35:283
668999702,8cyclictest31535-21grep09:25:450
668999701,57cyclictest17124-21sshd07:37:190
668999701,51cyclictest17435-21diskmemload09:44:480
6689997012,47cyclictest30905-21/usr/sbin/munin08:15:360
6709996914,37cyclictest2056650ssh10:30:503
668999691,58cyclictest4413-21ssh12:10:210
670999681,6cyclictest2703-21grep10:10:333
668999681,9cyclictest0-21swapper/009:47:320
668999681,48cyclictest14597-21rm12:21:440
668999681,48cyclictest14597-21rm12:21:440
6689996813,41cyclictest281502chrt12:38:570
6689996811,44cyclictest16969-21unixbench_multi09:05:440
6689996811,36cyclictest7850irq/56-dwc_otg_11:30:200
6709996715,38cyclictest381ktimersoftd/311:30:393
6689996714,35cyclictest0-21swapper/008:32:130
668999669,43cyclictest0-21swapper/010:09:280
6689996613,36cyclictest1180-21runrttasks07:34:390
6689996613,36cyclictest1180-21runrttasks07:34:390
6689996611,45cyclictest0-21swapper/011:13:130
670999656,45cyclictest7950irq/56-dwc_otg_08:15:173
668999652,50cyclictest0-21swapper/008:00:340
668999651,51cyclictest17713-21cut07:40:320
670999646,41cyclictest22578-21/usr/sbin/munin09:55:393
670999642,6cyclictest30514-21fschecks_count08:15:313
668999643,47cyclictest0-21swapper/008:25:460
668999641,48cyclictest12432-21fschecks_count07:25:350
670999632,5cyclictest7850irq/56-dwc_otg_09:50:353
6689996313,36cyclictest0-21swapper/008:59:430
122822630,2sleep10-21swapper/111:00:391
670999622,42cyclictest0-21swapper/311:54:033
670999621,5cyclictest11075-21ssh10:20:323
668999621,8cyclictest0-21swapper/008:40:020
668999621,37cyclictest0-21swapper/009:37:010
21562620,1sleep20-21swapper/211:27:412
167802620,1sleep20-21swapper/212:25:222
670999615,39cyclictest0-21swapper/311:44:513
670999611,4cyclictest7950irq/56-dwc_otg_08:40:173
669799614,38cyclictest0-21swapper/111:35:321
668999612,46cyclictest0-21swapper/008:50:390
668999611,7cyclictest0-21swapper/010:27:280
668999611,50cyclictest0-21swapper/007:51:110
668999611,42cyclictest0-21swapper/007:15:330
670999606,39cyclictest0-21swapper/309:22:233
670999605,5cyclictest20422-21timerwakeupswit07:45:453
670999605,39cyclictest0-21swapper/310:40:363
670999603,40cyclictest7950irq/56-dwc_otg_10:20:093
670399603,35cyclictest0-21swapper/211:35:332
6703996013,27cyclictest18571-21cat09:10:392
6697996025,11cyclictest21-21rcuc/109:10:411
670999591,6cyclictest9715-21grep08:45:433
670999591,5cyclictest0-21swapper/312:30:423
670999591,4cyclictest657-21unixbench-2d08:20:453
670999591,4cyclictest657-21unixbench-2d08:20:453
670999584,37cyclictest7950irq/56-dwc_otg_12:10:413
670999582,45cyclictest31280-21ssh12:03:073
670999581,4cyclictest21999-21apt-get09:15:293
670999581,4cyclictest21999-21apt-get09:15:293
670999581,47cyclictest17435-21diskmemload10:05:113
6709995812,43cyclictest2711-21/usr/sbin/munin09:30:413
668999581,46cyclictest0-21swapper/007:21:190
670999573,39cyclictest7850irq/56-dwc_otg_11:47:243
6709995710,44cyclictest21083-21rm11:10:483
6689995713,34cyclictest244802chrt07:58:590
670999565,41cyclictest0-21swapper/312:16:493
670999565,33cyclictest7750irq/56-dwc_otg10:53:383
670999563,42cyclictest7950irq/56-dwc_otg_11:07:323
670999562,50cyclictest31586-21ssh10:45:283
670999562,49cyclictest0-21swapper/312:30:163
50472563,7sleep30-21swapper/307:05:353
50472563,7sleep30-21swapper/307:05:353
670999557,16cyclictest0-21swapper/311:15:323
670999556,37cyclictest7950irq/56-dwc_otg_09:25:343
670999551,5cyclictest29946-21ssh11:21:443
670999551,5cyclictest13231-21ssh11:01:323
670999551,3cyclictest7950irq/56-dwc_otg_10:25:383
6709995512,38cyclictest14061-21cut07:30:313
6709995512,38cyclictest14061-21cut07:30:313
46222550,2chrt4620-21basename12:10:332
670999546,35cyclictest7950irq/56-dwc_otg_09:40:403
670999546,33cyclictest7950irq/56-dwc_otg_11:26:263
670999541,5cyclictest26367-21ssh10:38:573
670999532,40cyclictest0-21swapper/310:55:443
670999531,6cyclictest17544-21latency_hist07:40:163
130462530,2sleep213050-21processes11:40:422
670999524,45cyclictest0-21swapper/309:35:273
670999523,34cyclictest7950irq/56-dwc_otg_07:15:313
670999522,4cyclictest0-21swapper/309:05:203
670999521,5cyclictest733-21perl12:05:353
670999521,5cyclictest12252-21/usr/sbin/munin08:55:423
670999521,3cyclictest0-21swapper/307:40:453
6709995210,32cyclictest0-21swapper/309:45:473
670999519,39cyclictest31291-21fschecks_time10:05:343
670999512,45cyclictest25975-21unixbench_singl08:00:453
670999512,3cyclictest0-21swapper/307:53:313
670999507,40cyclictest14703-21netstat09:00:393
670999501,4cyclictest0-21swapper/308:00:163
670999501,4cyclictest0-21swapper/307:10:233
174962490,5sleep1669799cyclictest07:40:161
670999481,4cyclictest11649-21chrt07:21:383
669799487,26cyclictest0-21swapper/112:00:311
669799484,8cyclictest7750irq/56-dwc_otg10:40:281
62632483,13sleep00-21swapper/007:08:510
62632483,13sleep00-21swapper/007:08:510
670999473,5cyclictest2096-21ntpq08:25:393
670999471,5cyclictest0-21swapper/307:25:293
670399477,25cyclictest0-21swapper/210:00:212
670399475,11cyclictest19493-21timerandwakeup09:50:482
669799475,26cyclictest7950irq/56-dwc_otg_09:55:461
6697994716,5cyclictest23-21ksoftirqd/111:25:281
289952461,38sleep228662-21/usr/sbin/munin12:00:352
670999451,6cyclictest10500-21/usr/sbin/munin08:50:313
669799454,3cyclictest0-21swapper/108:10:291
6697994514,6cyclictest15281-21cut10:25:321
670399435,4cyclictest17560-21ls07:40:162
669799435,25cyclictest7850irq/56-dwc_otg_10:35:171
670399426,23cyclictest0-21swapper/208:15:282
670399426,21cyclictest0-21swapper/207:20:282
6697994214,18cyclictest12020-21sh08:55:161
669799417,24cyclictest0-21swapper/109:30:321
669799417,22cyclictest0-21swapper/110:00:211
669799413,11cyclictest7750irq/56-dwc_otg09:15:291
669799413,11cyclictest7750irq/56-dwc_otg09:15:291
6697994120,6cyclictest7850irq/56-dwc_otg_09:50:171
147422410,3sleep114708-21ssh10:25:161
670399407,23cyclictest0-21swapper/209:30:322
670399407,23cyclictest0-21swapper/208:50:312
670399406,24cyclictest0-21swapper/209:00:312
6703994020,4cyclictest301ktimersoftd/210:25:362
669799407,8cyclictest4504-21ssh12:10:301
669799405,10cyclictest7750irq/56-dwc_otg08:40:301
670399392,5cyclictest0-21swapper/208:55:292
670399391,24cyclictest22027-21ssh09:15:302
670399391,24cyclictest22027-21ssh09:15:302
669799398,14cyclictest7950irq/56-dwc_otg_10:05:431
76182380,4sleep1221ktimersoftd/110:55:321
6703993819,5cyclictest21311-21cut12:30:362
6703993816,11cyclictest29037-21missed_timers08:10:372
669799382,11cyclictest0-21swapper/111:55:291
670399375,22cyclictest0-21swapper/208:20:362
670399375,22cyclictest0-21swapper/208:20:362
669799378,26cyclictest0-21swapper/108:45:291
669799377,21cyclictest0-21swapper/108:55:291
669799371,19cyclictest0-21swapper/112:19:321
6697993711,6cyclictest0-21swapper/109:25:311
670399361,26cyclictest17282-21ls11:45:432
669799365,15cyclictest7850irq/56-dwc_otg_09:20:321
669799363,7cyclictest25987-21ssh12:35:431
669799361,8cyclictest4116-21ps10:50:421
299002361,4sleep229954-21latency_hist09:25:162
670399353,6cyclictest7950irq/56-dwc_otg_11:15:332
670399352,14cyclictest28662-21unixbench_multi10:40:442
670399351,28cyclictest14263-21cut07:30:342
670399351,28cyclictest14263-21cut07:30:342
670399351,24cyclictest20441-21timerwakeupswit07:45:452
670399351,23cyclictest20635-21ls11:50:312
669799353,10cyclictest0-21swapper/111:12:311
6697993525,7cyclictest0-21swapper/112:20:471
6697993525,7cyclictest0-21swapper/112:20:471
6697993524,8cyclictest26124-21ssh10:38:301
6697993514,5cyclictest10682-21latency_hist10:20:161
6697993512,6cyclictest10227-21ssh09:40:291
669799351,25cyclictest20746-21uniq11:50:331
6697993510,13cyclictest0-21swapper/111:49:491
63012351,3sleep20-21swapper/210:15:122
670399347,5cyclictest7950irq/56-dwc_otg_08:25:292
670399346,15cyclictest4126-21grep10:50:432
670399341,23cyclictest0-21swapper/210:05:302
670399341,22cyclictest19896-21ls10:30:412
669799349,12cyclictest0-21swapper/111:05:281
6697993426,6cyclictest21-21rcuc/107:45:301
669799341,6cyclictest16620-21proc_pri09:05:411
669799341,23cyclictest0-21swapper/109:00:311
141452340,2sleep10-21swapper/111:41:571
670399337,14cyclictest20374-21memory11:10:382
670399336,15cyclictest0-21swapper/208:30:312
6703993314,4cyclictest23405-21aten_rbpower_po10:35:312
670399331,21cyclictest27651-21timerwakeupswit08:05:442
670399331,21cyclictest16149-21grep09:05:342
669799334,6cyclictest28615-21uname11:20:361
669799334,13cyclictest0-21swapper/108:35:301
669799332,16cyclictest0-21swapper/108:00:421
6697993316,9cyclictest16840-21ssh12:25:271
6697993312,7cyclictest7950irq/56-dwc_otg_07:20:021
58772335,13sleep20-21swapper/207:05:462
58772335,13sleep20-21swapper/207:05:462
84552320,6sleep1669799cyclictest07:15:161
670399324,6cyclictest7750irq/56-dwc_otg11:05:322
670399324,14cyclictest26335-21unixbench_multi12:35:462
6703993212,5cyclictest8559-21/usr/sbin/munin07:15:362
670399321,25cyclictest0-21swapper/212:23:132
670399321,25cyclictest0-21swapper/212:23:132
670399321,22cyclictest4869-21switchtime11:30:432
670399321,19cyclictest0-21swapper/209:55:432
669799329,6cyclictest6390-21awk10:15:161
669799328,5cyclictest7850irq/56-dwc_otg_08:25:311
669799327,5cyclictest7750irq/56-dwc_otg12:35:161
6697993211,5cyclictest18834-21fschecks_time09:50:391
670399316,15cyclictest0-21swapper/209:40:302
670399315,4cyclictest7750irq/56-dwc_otg10:17:162
6703993113,5cyclictest12067-21unixbench_multi10:20:452
670399311,16cyclictest0-21swapper/212:16:212
670399311,14cyclictest0-21swapper/210:45:552
670399311,11cyclictest25406-21cat08:00:382
669799316,6cyclictest7850irq/56-dwc_otg_07:30:421
669799316,6cyclictest7850irq/56-dwc_otg_07:30:421
669799313,9cyclictest0-21swapper/109:37:111
669799311,6cyclictest7750irq/56-dwc_otg10:45:361
669799311,5cyclictest7819-21ls11:35:171
669799311,5cyclictest27761-21sed08:05:451
670399301,22cyclictest0-21swapper/207:10:342
670399301,12cyclictest9945-21latency_hist09:40:162
670399301,12cyclictest0-21swapper/207:40:352
669799306,14cyclictest0-21swapper/108:20:351
669799306,14cyclictest0-21swapper/108:20:351
6697993020,7cyclictest7950irq/56-dwc_otg_11:15:321
6697993014,5cyclictest4811-21idleruntime-cro08:35:161
669799301,21cyclictest17862-21uniq07:40:351
669799301,19cyclictest12460-21uniq07:25:351
670399292,13cyclictest7850irq/56-dwc_otg_07:25:382
670399291,21cyclictest7173-21cut08:40:342
670399291,18cyclictest24161-21unixbench_singl07:55:452
669799292,9cyclictest24189-21grep07:55:451
669799291,6cyclictest21692-21irqstats07:50:341
670399284,14cyclictest6610-21modprobe08:40:162
670399282,5cyclictest21544-21grep07:50:322
6703992811,9cyclictest9623-21cat08:45:422
669799287,5cyclictest7950irq/56-dwc_otg_07:20:361
669799264,5cyclictest7750irq/56-dwc_otg08:15:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional