You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 17:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Dec 11, 2025 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1391223580,4sleep313911-21sh07:10:163
1402121300,3sleep21416199cyclictest10:25:142
25462930,2sleep10-21swapper/111:40:171
25462930,2sleep10-21swapper/111:40:171
321242870,2sleep20-21swapper/210:05:092
1415999851,67cyclictest21084-21egrep11:20:310
14159998218,48cyclictest21287-21basename10:35:170
14159998216,54cyclictest32045-21sh10:05:010
14159997937,23cyclictest0-21swapper/011:25:470
14159997923,39cyclictest4262-21ls12:25:450
14159997917,46cyclictest917-21if_eth009:20:360
1415999783,11cyclictest0-21swapper/007:10:180
14159997819,49cyclictest2240-21/usr/sbin/munin08:05:310
1415999776,58cyclictest0-21swapper/011:04:280
14159997718,43cyclictest4814-21grep08:10:450
14159997618,46cyclictest7850irq/56-dwc_otg_11:40:460
1415999751,61cyclictest0-21swapper/009:20:160
1415999741,65cyclictest11722-21cpuspeed12:35:340
1415999741,62cyclictest0-21swapper/009:00:350
1415999741,62cyclictest0-21swapper/009:00:350
1415999736,5cyclictest22063-21unixbench_singl12:05:470
1415999734,51cyclictest0-21swapper/007:25:270
14159997321,32cyclictest0-21swapper/009:39:520
14159997321,32cyclictest0-21swapper/009:39:520
14159997319,39cyclictest9449-21sh09:31:570
1415999731,55cyclictest0-21swapper/011:52:030
14159997311,4cyclictest2554-21latency_hist11:40:170
14159997311,4cyclictest2554-21latency_hist11:40:170
1415999722,14cyclictest0-21swapper/009:45:160
1416099712,18cyclictest0-21swapper/110:10:271
1415999714,47cyclictest0-21swapper/010:20:280
1415999712,56cyclictest18123-21kworker/u8:309:45:440
1415999711,55cyclictest0-21swapper/010:15:380
14159997113,42cyclictest0-21swapper/007:34:340
14159997111,47cyclictest0-21swapper/010:55:160
1415999710,60cyclictest756-21load08:00:370
1415999703,48cyclictest31331-21snmpd09:05:290
1415999701,51cyclictest0-21swapper/012:02:590
1415999701,51cyclictest0-21swapper/012:02:590
14159997013,4cyclictest4557-21ls10:55:440
1415999692,52cyclictest1120-21runrttasks12:11:530
1415999691,55cyclictest18123-21kworker/u8:311:20:170
14159996915,4cyclictest19107-21/usr/sbin/munin08:50:410
1415999691,54cyclictest0-21swapper/011:50:160
1415999691,54cyclictest0-21swapper/010:07:460
1415999691,54cyclictest0-21swapper/010:07:460
1415999691,52cyclictest0-21swapper/012:30:330
1415999691,17cyclictest0-21swapper/009:26:010
1415999682,53cyclictest0-21swapper/010:10:300
14159996825,27cyclictest0-21swapper/008:40:160
1415999681,54cyclictest1847-21chrt12:23:160
1415999681,53cyclictest6789-21unixbench_singl08:15:450
1415999681,53cyclictest6789-21unixbench_singl08:15:450
1415999681,50cyclictest0-21swapper/010:49:340
1415999681,49cyclictest0-21swapper/011:56:380
1415999681,49cyclictest0-21swapper/008:45:370
1415999671,55cyclictest24794-21ssh09:54:590
14159996712,4cyclictest21614-21aten_rbpower_cu10:35:310
14159996712,43cyclictest16228-21ssh11:12:000
1415999666,54cyclictest0-21swapper/007:55:320
1415999661,54cyclictest0-21swapper/011:06:400
1415999661,54cyclictest0-21swapper/011:06:400
1415999661,51cyclictest21379-21kworker/u8:009:57:400
1415999661,50cyclictest0-21swapper/010:44:000
14162996530,9cyclictest456-21apt-get09:20:283
1415999657,50cyclictest0-21swapper/008:30:420
1415999651,5cyclictest0-21swapper/008:45:160
1415999651,52cyclictest0-21swapper/007:24:140
1416099645,5cyclictest7850irq/56-dwc_otg_10:15:431
1416099644,10cyclictest0-21swapper/107:10:191
1416099643,6cyclictest7750irq/56-dwc_otg09:20:391
1415999641,48cyclictest0-21swapper/007:39:440
14159996411,43cyclictest0-21swapper/009:12:190
1416099634,5cyclictest21276-21ssh11:20:341
1416099631,3cyclictest7850irq/56-dwc_otg_11:40:281
1415999631,12cyclictest0-21swapper/012:15:410
14162996227,13cyclictest17247-21ssh12:00:283
14162996227,13cyclictest17247-21ssh12:00:283
1416099629,4cyclictest7750irq/56-dwc_otg12:25:411
14160996212,10cyclictest3221-21date10:55:171
14159996216,3cyclictest0-21swapper/010:25:380
1415999621,15cyclictest20173-21/usr/sbin/munin08:55:370
14162996120,20cyclictest7750irq/56-dwc_otg09:25:403
14162996115,26cyclictest4066-21ssh12:25:433
1416099613,6cyclictest7850irq/56-dwc_otg_08:50:451
1415999617,9cyclictest0-21swapper/008:26:540
14159996115,30cyclictest0-21swapper/011:33:140
1415999611,51cyclictest0-21swapper/007:42:200
1415999611,41cyclictest0-21swapper/007:50:330
1416199606,9cyclictest25358-21diskmemload09:20:292
1415999601,43cyclictest8664-21taskset08:20:440
14159996013,40cyclictest0-21swapper/007:50:100
14159996013,40cyclictest0-21swapper/007:50:100
1416099597,4cyclictest7750irq/56-dwc_otg09:10:161
1416099595,5cyclictest19176-21unixbench_singl10:30:461
1416099593,12cyclictest7950irq/56-dwc_otg_09:35:281
1416099593,12cyclictest7950irq/56-dwc_otg_09:35:281
14160995911,4cyclictest7850irq/56-dwc_otg_11:52:361
1416099582,6cyclictest19113-21/usr/sbin/munin09:45:441
1416099581,7cyclictest4923-21grep08:10:461
1416099573,3cyclictest7750irq/56-dwc_otg09:53:101
1416099571,5cyclictest8088-21if_err_wlan009:30:361
1416099571,11cyclictest7782-21ls12:30:351
14162995617,29cyclictest27575-21sh09:12:163
1416099568,3cyclictest0-21swapper/110:55:401
1416099563,5cyclictest7750irq/56-dwc_otg11:05:291
1416099563,5cyclictest7750irq/56-dwc_otg11:05:291
1416099561,3cyclictest7850irq/56-dwc_otg_12:14:481
1416299558,17cyclictest7950irq/56-dwc_otg_08:45:163
14162995516,22cyclictest7850irq/56-dwc_otg_08:00:163
14162995515,20cyclictest2102-21wget08:05:293
14162995515,19cyclictest15511-21rm11:57:183
1416199554,6cyclictest0-21swapper/212:30:272
1416099554,4cyclictest0-21swapper/111:13:351
1416099553,3cyclictest0-21swapper/108:40:161
1416099551,5cyclictest7950irq/56-dwc_otg_10:25:411
1415999557,37cyclictest0-21swapper/007:19:060
14162995423,21cyclictest1156-21sshd11:20:453
14162995419,19cyclictest4119-21sed10:55:383
14162995415,25cyclictest26029-21rm12:11:303
1416099548,4cyclictest0-21swapper/110:42:111
1416099545,10cyclictest7750irq/56-dwc_otg10:21:171
1416099543,6cyclictest759-21memory08:00:371
1416099542,4cyclictest7750irq/56-dwc_otg10:10:161
1416099542,4cyclictest7750irq/56-dwc_otg10:10:161
1416099541,5cyclictest7886-21ntp_states11:00:401
14162995322,19cyclictest21496-21ls12:05:413
14162995315,25cyclictest30095-21rm11:31:513
14162995315,25cyclictest24175-21ssh09:53:383
14162995311,26cyclictest18363-21/usr/sbin/munin08:50:393
1416099532,8cyclictest7950irq/56-dwc_otg_09:58:361
1416099532,5cyclictest0-21swapper/108:05:321
1416099531,6cyclictest17610-21fschecks_time12:00:351
1416099531,6cyclictest17610-21fschecks_time12:00:351
14162995239,10cyclictest12832-21/usr/sbin/munin12:35:483
14162995217,13cyclictest7418-21fschecks_count11:00:343
14162995213,23cyclictest5920-21ssh10:12:523
1416099526,3cyclictest0-21swapper/111:18:501
1416099522,5cyclictest7750irq/56-dwc_otg10:49:181
1416099522,5cyclictest0-21swapper/111:31:171
1416099521,5cyclictest25358-21diskmemload12:20:271
14162995115,21cyclictest8662-21ssh10:15:573
14162995113,10cyclictest4677-21switchtime08:10:443
1416199512,17cyclictest7750irq/56-dwc_otg12:00:312
1416199512,17cyclictest7750irq/56-dwc_otg12:00:312
14162995017,20cyclictest14562-21latency_hist08:40:163
14162995017,13cyclictest21840-21diskstats10:35:343
14162995014,20cyclictest3633-21ps11:40:433
14162995014,20cyclictest26239-21rm11:26:323
14162995011,21cyclictest31306-21ssh12:20:033
1416099506,7cyclictest7750irq/56-dwc_otg09:41:511
1416099506,4cyclictest0-21swapper/109:27:271
1416099505,4cyclictest0-21swapper/111:29:551
1416099502,9cyclictest7850irq/56-dwc_otg_12:07:461
1416099502,4cyclictest0-21swapper/112:16:381
14160995016,5cyclictest2879650ssh10:00:241
14162994924,18cyclictest19299-21sed09:45:463
14162994920,13cyclictest30616-21basename07:55:163
14162994914,20cyclictest16824-21fschecks_count08:45:363
14162994912,24cyclictest23456-21taskset09:04:233
14162994912,24cyclictest23456-21taskset09:04:233
1416199494,15cyclictest7750irq/56-dwc_otg10:15:282
1416299489,20cyclictest7850irq/56-dwc_otg_10:01:543
14162994820,13cyclictest17535-21apt-get11:15:283
14162994812,18cyclictest11563-21ssh11:51:403
123272483,38sleep00-21swapper/007:05:240
1416199477,25cyclictest0-21swapper/207:25:222
1416099471,4cyclictest9663-21perl08:25:351
14162994616,19cyclictest26924-21ssh09:56:383
14162994615,20cyclictest641-21ssh11:36:013
14162994615,20cyclictest641-21ssh11:36:013
14162994613,16cyclictest32641-21/usr/sbin/munin08:00:343
1416299461,17cyclictest7850irq/56-dwc_otg_11:45:303
14162994611,20cyclictest1655-21sh12:22:533
1416199467,25cyclictest0-21swapper/208:50:302
1416199467,25cyclictest0-21swapper/208:40:322
1416199463,30cyclictest0-21swapper/207:10:192
1416099467,24cyclictest0-21swapper/107:55:321
1416099466,26cyclictest0-21swapper/111:55:311
14162994518,14cyclictest13972-21ssh09:39:423
14162994518,14cyclictest13972-21ssh09:39:423
14162994517,13cyclictest2235-21ssh10:07:373
14162994517,13cyclictest2235-21ssh10:07:373
14162994513,12cyclictest15057-21sed10:25:443
14162994512,20cyclictest17833-21latency_hist09:45:163
1416199458,6cyclictest31-21ksoftirqd/212:05:362
1416199457,24cyclictest0-21swapper/209:35:222
1416199457,24cyclictest0-21swapper/209:35:222
1416199456,25cyclictest0-21swapper/211:00:302
14162994420,18cyclictest0-21swapper/307:10:183
14162994414,14cyclictest31565-21rm09:18:083
14162994412,14cyclictest12250-21ssh11:06:163
14162994412,14cyclictest12250-21ssh11:06:163
14162994412,11cyclictest9036-21ssh12:31:233
1416199448,24cyclictest0-21swapper/212:25:322
1416199447,23cyclictest0-21swapper/209:30:212
1416099448,23cyclictest0-21swapper/107:45:221
1416099448,23cyclictest0-21swapper/107:45:221
1416299437,24cyclictest7051-21runrttasks08:18:373
1416299437,24cyclictest7051-21runrttasks08:18:373
1416299437,22cyclictest0-21swapper/309:31:333
1416299436,19cyclictest7950irq/56-dwc_otg_10:35:153
14162994310,11cyclictest2958-21rm10:54:523
1416199427,23cyclictest0-21swapper/208:45:312
14161994221,5cyclictest14426-21cut10:25:322
1416299417,22cyclictest7950irq/56-dwc_otg_10:24:013
1416299415,24cyclictest27764-21ssh10:43:383
14162994130,7cyclictest24055-21ls07:35:393
14162994112,12cyclictest31509-21ssh10:49:283
14162994112,11cyclictest0-21swapper/308:29:283
1416199417,25cyclictest0-21swapper/212:10:302
1416199415,26cyclictest29-21rcuc/210:10:192
14161994116,7cyclictest21975-21tune2fs10:35:362
14161994113,8cyclictest21798-21/usr/sbin/munin11:20:422
1416199405,15cyclictest7750irq/56-dwc_otg11:37:542
1416199405,15cyclictest7750irq/56-dwc_otg11:37:542
14160994014,4cyclictest12804-21unixbench_singl12:35:481
283322390,1sleep20-21swapper/210:44:542
1416299398,16cyclictest215982sleep308:58:443
1416299391,3cyclictest7850irq/56-dwc_otg_07:25:273
1416199395,22cyclictest0-21swapper/211:50:292
1416199394,4cyclictest0-21swapper/211:25:292
14161993914,5cyclictest0-21swapper/209:30:162
1416099391,22cyclictest18199-21cut07:20:331
178652381,5sleep217871-21ssh10:30:222
1416299389,8cyclictest0-21swapper/309:09:313
1416199385,5cyclictest7850irq/56-dwc_otg_07:25:172
1416099387,25cyclictest0-21swapper/107:50:231
123532386,21sleep212392-21aten_rbpower_en07:05:302
1416299378,15cyclictest7850irq/56-dwc_otg_07:42:243
14162993727,7cyclictest11147-21apt-get08:30:273
14162993714,11cyclictest22911-21taskset07:31:553
14162993710,10cyclictest0-21swapper/307:47:123
14162993710,10cyclictest0-21swapper/307:47:123
1416199371,22cyclictest28185-21ls12:15:312
1416199371,10cyclictest0-21swapper/212:35:312
1416099376,20cyclictest7950irq/56-dwc_otg_07:15:211
1416099371,3cyclictest7850irq/56-dwc_otg_08:20:221
14160993710,8cyclictest23-21ksoftirqd/109:15:311
14162993626,7cyclictest14402-21apt-get11:10:283
1416199362,9cyclictest7850irq/56-dwc_otg_09:10:292
14161993617,4cyclictest31-21ksoftirqd/208:05:352
14161993613,5cyclictest25814-21latency09:55:372
1416299357,25cyclictest0-21swapper/308:20:293
14162993522,10cyclictest16089-21/usr/sbin/munin07:15:283
1416199357,5cyclictest3142-21munin-run10:55:162
14161993517,7cyclictest22598-21missed_timers09:00:382
14161993517,7cyclictest22598-21missed_timers09:00:382
14161993516,6cyclictest31-21ksoftirqd/211:20:162
14161993516,6cyclictest31-21ksoftirqd/208:55:472
14160993516,6cyclictest17601-21cat08:45:531
1416299342,22cyclictest7950irq/56-dwc_otg_07:21:193
1416199349,14cyclictest3738-21fschecks_count10:55:332
1416199348,6cyclictest7950irq/56-dwc_otg_11:10:432
1416199341,8cyclictest15832-21grep09:40:462
14161993412,8cyclictest0-21swapper/208:35:422
1416199341,24cyclictest0-21swapper/207:45:212
1416199341,24cyclictest0-21swapper/207:45:212
1416099347,13cyclictest7850irq/56-dwc_otg_10:35:401
1416099345,5cyclictest0-21swapper/108:15:321
1416099345,5cyclictest0-21swapper/108:15:321
1416199337,24cyclictest0-21swapper/208:00:302
1416199334,19cyclictest8044-21ls08:20:362
1416199334,15cyclictest7950irq/56-dwc_otg_07:50:312
14161993314,4cyclictest29598-21open_files10:45:422
14161993314,4cyclictest29-21rcuc/208:10:362
1416199331,21cyclictest31331-21snmpd07:38:072
1416199331,15cyclictest21874-21diskstats09:50:332
14161993311,12cyclictest0-21swapper/211:05:322
14161993311,12cyclictest0-21swapper/211:05:322
1416099336,8cyclictest7750irq/56-dwc_otg09:10:341
1416099336,5cyclictest19881-21aten_rbpower_en07:25:301
1416099336,4cyclictest7850irq/56-dwc_otg_11:45:331
1416099334,5cyclictest7750irq/56-dwc_otg08:40:321
65652320,4sleep26535-21ssh11:45:332
1416199327,8cyclictest7850irq/56-dwc_otg_11:40:462
1416199321,22cyclictest16385-21uniq07:15:352
1416099326,14cyclictest0-21swapper/107:40:301
1416099321,4cyclictest7950irq/56-dwc_otg_07:30:441
1416199319,5cyclictest327-21fschecks_count10:05:352
1416199319,5cyclictest327-21fschecks_count10:05:352
1416199314,6cyclictest31-21ksoftirqd/208:25:432
1416199313,15cyclictest7950irq/56-dwc_otg_09:45:322
14161993110,3cyclictest0-21swapper/211:30:292
1416099311,19cyclictest12061-21timerandwakeup08:30:421
136002310,23sleep10-21swapper/107:06:391
325312300,5sleep21416199cyclictest09:20:162
1416199305,5cyclictest7850irq/56-dwc_otg_12:20:272
1416199302,5cyclictest7850irq/56-dwc_otg_11:55:312
1416099303,13cyclictest7950irq/56-dwc_otg_08:55:351
14160993011,9cyclictest23857-21if_wlan007:35:361
1416199296,13cyclictest0-21swapper/207:30:302
1416199295,5cyclictest7950irq/56-dwc_otg_09:10:162
1416199291,14cyclictest7950irq/56-dwc_otg_07:40:372
14160992914,4cyclictest22714-21pluginstate09:00:411
14160992914,4cyclictest22714-21pluginstate09:00:411
1416199288,10cyclictest7950irq/56-dwc_otg_08:15:372
1416199288,10cyclictest7950irq/56-dwc_otg_08:15:372
1416199281,19cyclictest31170-21uniq07:55:362
14161992810,5cyclictest11393-21fschecks_count08:30:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional