You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Tue Dec 09, 2025 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3062221700,4sleep3298099cyclictest11:51:083
224221040,7sleep20-21swapper/207:05:442
2977999231,15cyclictest8683-21unixbench-2d10:35:460
297799868,63cyclictest0-21swapper/009:40:280
208382850,2sleep20-21swapper/212:23:162
89632840,3sleep07672-21/usr/sbin/munin12:05:420
47442820,2sleep10-21swapper/109:44:251
297799801,27cyclictest0-21swapper/009:10:280
78262780,2sleep10-21swapper/108:50:431
149962720,2sleep30-21swapper/307:40:453
297999672,35cyclictest0-21swapper/211:15:312
2977996531,4cyclictest30767-21ssh09:35:150
2977996517,6cyclictest0-21swapper/012:30:290
297799601,46cyclictest0-21swapper/011:40:220
297899593,15cyclictest7750irq/56-dwc_otg09:30:281
297899582,11cyclictest0-21swapper/111:45:251
297799586,25cyclictest0-21swapper/007:55:210
297799586,25cyclictest0-21swapper/007:55:210
2977995823,9cyclictest0-21swapper/008:45:290
2977995823,9cyclictest0-21swapper/008:45:290
297799581,6cyclictest27382-21ssh09:30:160
297799581,6cyclictest27382-21ssh09:30:160
297899577,28cyclictest0-21swapper/108:20:281
297799575,29cyclictest0-21swapper/010:40:440
2977995629,13cyclictest7950irq/56-dwc_otg_10:20:150
297799562,29cyclictest677-21grep08:30:430
2977995617,25cyclictest0-21swapper/009:50:250
297799561,20cyclictest0-21swapper/007:20:410
215592550,2sleep20-21swapper/209:20:392
297999545,6cyclictest7950irq/56-dwc_otg_10:10:312
297799544,9cyclictest0-21swapper/011:25:290
2977995426,7cyclictest5161-21ps11:15:450
230892540,2sleep30-21swapper/310:10:403
297999536,33cyclictest0-21swapper/211:35:282
297999532,5cyclictest0-21swapper/208:25:272
2978995328,5cyclictest29509-21sh11:50:361
297799539,4cyclictest0-21swapper/011:00:280
297799534,5cyclictest101ktimersoftd/011:45:260
2977995326,7cyclictest7850irq/56-dwc_otg_12:00:430
2977995325,6cyclictest12714-21unixbench_singl12:10:500
2977995323,16cyclictest0-21swapper/008:05:420
26522533,12sleep00-21swapper/007:09:360
297999523,5cyclictest0-21swapper/209:30:282
297899528,29cyclictest0-21swapper/111:35:281
2977995231,6cyclictest7750irq/56-dwc_otg11:55:150
297799522,46cyclictest0-21swapper/008:55:150
2977995224,5cyclictest1120-21runrttasks11:10:410
297799522,25cyclictest358-21latency_hist10:25:160
297799522,25cyclictest358-21latency_hist10:25:160
2977995216,17cyclictest6650-21sh10:34:010
2977995210,36cyclictest101ktimersoftd/011:05:440
297999517,35cyclictest7950irq/56-dwc_otg_11:30:292
2979995115,23cyclictest0-21swapper/211:40:452
297799516,42cyclictest0-21swapper/009:15:280
2977995140,4cyclictest7950irq/56-dwc_otg_11:20:450
2977995140,4cyclictest7950irq/56-dwc_otg_11:20:450
2977995126,7cyclictest29370-21grep12:35:290
2977995124,17cyclictest5529-21tr09:45:330
2977995124,17cyclictest5529-21tr09:45:330
2977995122,14cyclictest21910-21/usr/sbin/munin10:55:440
297799511,28cyclictest25135-21fschecks_time08:10:340
297799502,34cyclictest0-21swapper/011:35:410
297799502,27cyclictest0-21swapper/010:10:480
297799501,29cyclictest30007-21munin-plugin-st08:25:150
297799501,26cyclictest3661-21/usr/sbin/munin07:10:380
297799501,26cyclictest2088-21ntpq08:35:370
2977994920,15cyclictest10103-21cat07:30:150
2977994920,15cyclictest10103-21cat07:30:150
2977994915,15cyclictest3048-21sh10:29:020
297799491,36cyclictest0-21swapper/012:17:320
2980994830,13cyclictest11495-21seq11:25:293
297999486,26cyclictest25917-21sh10:15:292
297899486,27cyclictest0-21swapper/107:45:291
2977994828,11cyclictest0-21swapper/012:20:440
297799482,32cyclictest0-21swapper/007:34:490
297799482,26cyclictest0-21swapper/009:35:450
2977994821,17cyclictest19013-21sh07:55:150
2977994819,15cyclictest0-21swapper/010:45:440
2977994816,22cyclictest0-21swapper/008:00:190
297799481,32cyclictest15176-21wc10:00:150
297799481,28cyclictest11525-21unixbench-2d09:00:420
297799481,26cyclictest1180-21ssh11:55:380
297999477,25cyclictest0-21swapper/208:20:282
297999477,25cyclictest0-21swapper/207:45:292
297999476,10cyclictest7850irq/56-dwc_otg_09:10:272
297899475,11cyclictest0-21swapper/108:40:261
2978994728,4cyclictest7950irq/56-dwc_otg_11:55:291
2978994710,13cyclictest14132-21apt-get09:10:271
297799474,28cyclictest0-21swapper/007:45:450
297799473,33cyclictest8897-21fschecks_count08:55:370
2977994732,6cyclictest7950irq/56-dwc_otg_10:00:280
2977994723,15cyclictest26735-21aten_rbpower_vo08:15:300
2977994723,11cyclictest7750irq/56-dwc_otg09:20:470
297999467,4cyclictest7750irq/56-dwc_otg11:10:332
2979994618,4cyclictest7950irq/56-dwc_otg_12:05:252
2979994613,9cyclictest13819-21diskmemload10:20:282
2979994613,9cyclictest13819-21diskmemload10:20:282
297899468,26cyclictest0-21swapper/110:05:301
297899467,27cyclictest0-21swapper/109:25:291
297899467,27cyclictest0-21swapper/109:25:291
297899464,5cyclictest7950irq/56-dwc_otg_10:10:301
2978994617,18cyclictest7750irq/56-dwc_otg10:55:161
2978994617,18cyclictest7750irq/56-dwc_otg10:55:161
2977994626,12cyclictest0-21swapper/010:50:440
2977994626,12cyclictest0-21swapper/010:50:440
297799462,25cyclictest0-21swapper/012:27:360
297799461,30cyclictest0-21swapper/008:25:350
297799461,24cyclictest1120-21runrttasks10:07:350
297999457,24cyclictest0-21swapper/207:50:272
297899452,12cyclictest0-21swapper/112:05:251
297799451,35cyclictest0-21swapper/007:35:350
2979994410,9cyclictest7950irq/56-dwc_otg_11:50:292
297899447,17cyclictest0-21swapper/107:25:311
297899447,17cyclictest0-21swapper/107:25:311
297899446,14cyclictest140-21systemd-journal12:30:151
297899444,25cyclictest0-21swapper/109:45:321
297899444,25cyclictest0-21swapper/109:45:321
2978994424,5cyclictest7950irq/56-dwc_otg_12:10:421
2978994415,17cyclictest7950irq/56-dwc_otg_11:20:221
2978994415,17cyclictest7950irq/56-dwc_otg_11:20:221
297799442,27cyclictest3460-21fschecks_count08:40:330
297799441,18cyclictest0-21swapper/011:31:100
2979994315,5cyclictest7850irq/56-dwc_otg_11:00:362
2979994313,13cyclictest7750irq/56-dwc_otg10:30:232
2979994312,16cyclictest7950irq/56-dwc_otg_12:10:412
297899438,23cyclictest0-21swapper/108:00:311
297899437,24cyclictest0-21swapper/109:20:301
297899437,23cyclictest0-21swapper/109:35:201
297899437,23cyclictest0-21swapper/107:35:301
297899436,32cyclictest13819-21diskmemload10:20:291
297899436,32cyclictest13819-21diskmemload10:20:291
297899436,26cyclictest25914-21sh10:15:291
2978994320,9cyclictest7950irq/56-dwc_otg_10:05:161
2978994315,20cyclictest221ktimersoftd/108:45:441
2978994315,20cyclictest221ktimersoftd/108:45:441
168572430,5sleep2297999cyclictest12:17:202
297999421,7cyclictest7750irq/56-dwc_otg09:05:262
297899427,23cyclictest0-21swapper/107:55:211
297899427,23cyclictest0-21swapper/107:55:211
297899426,26cyclictest0-21swapper/107:50:271
2978994219,11cyclictest7750irq/56-dwc_otg07:40:441
2978994212,15cyclictest0-21swapper/112:00:261
298099413,5cyclictest0-21swapper/311:45:283
2980994116,5cyclictest29338-21/usr/sbin/munin11:05:383
2980994110,19cyclictest0-21swapper/312:27:423
297999413,11cyclictest14096-21sshd11:28:452
2979994119,12cyclictest1574-21timerandwakeup10:25:512
2979994114,14cyclictest7950irq/56-dwc_otg_10:02:302
2979994112,7cyclictest7750irq/56-dwc_otg12:33:382
2979994110,13cyclictest7850irq/56-dwc_otg_09:40:322
297899417,20cyclictest0-21swapper/107:10:291
297899416,25cyclictest0-21swapper/111:05:301
2978994121,6cyclictest7750irq/56-dwc_otg10:35:281
2978994119,8cyclictest7950irq/56-dwc_otg_10:55:221
297799412,30cyclictest0-21swapper/007:15:430
2977994118,4cyclictest12385-21cpu09:05:390
297799411,22cyclictest0-21swapper/007:43:340
297999409,17cyclictest301ktimersoftd/210:35:292
297999405,23cyclictest0-21swapper/209:45:322
297999405,23cyclictest0-21swapper/209:45:322
2979994031,4cyclictest61-21kswapd010:55:292
2979994016,6cyclictest446-21cron10:00:152
297899406,24cyclictest13819-21diskmemload11:10:281
297899401,24cyclictest26886-21cut08:15:331
302652391,3sleep10-21swapper/108:25:281
298099392,3cyclictest0-21swapper/307:30:253
2980993923,5cyclictest429050wget12:00:293
2980993917,4cyclictest22571-21sh09:21:253
297999399,5cyclictest7850irq/56-dwc_otg_07:30:362
297999399,16cyclictest30789-21ssh12:36:142
297999397,22cyclictest0-21swapper/211:45:282
2979993919,8cyclictest7950irq/56-dwc_otg_09:37:492
2979993916,4cyclictest20784-21sh10:07:182
2978993914,13cyclictest7750irq/56-dwc_otg12:35:491
297999387,18cyclictest0-21swapper/207:10:292
2979993812,8cyclictest5206-21cpuspeed08:45:312
2979993812,8cyclictest5206-21cpuspeed08:45:312
297999380,24cyclictest11524-21sh09:54:362
297899389,4cyclictest24592-21idleruntime-cro08:10:151
297899387,21cyclictest18011-21ssh10:50:161
297899382,8cyclictest7750irq/56-dwc_otg10:30:131
2978993822,6cyclictest7850irq/56-dwc_otg_12:21:521
2978993820,7cyclictest7750irq/56-dwc_otg11:25:351
2978993812,5cyclictest221ktimersoftd/111:45:161
297899381,23cyclictest7740-21ls11:20:161
233002380,5sleep3298099cyclictest11:40:453
298099377,14cyclictest7950irq/56-dwc_otg_11:35:323
2980993718,5cyclictest6181-21sh10:32:513
297999379,5cyclictest25959-21unixbench_singl08:10:452
297999376,14cyclictest20187-21seq10:52:152
297999376,14cyclictest20187-21seq10:52:152
297999375,13cyclictest7850irq/56-dwc_otg_08:30:322
297999372,7cyclictest4232-21wget12:00:292
297899372,20cyclictest7950irq/56-dwc_otg_10:41:291
2978993716,9cyclictest7850irq/56-dwc_otg_12:30:171
297899371,25cyclictest5326-21latency07:15:361
298099368,17cyclictest7950irq/56-dwc_otg_08:40:433
2980993626,6cyclictest381ktimersoftd/308:25:253
2980993617,5cyclictest29488-21cut10:20:303
2980993617,5cyclictest29488-21cut10:20:303
297999367,5cyclictest7950irq/56-dwc_otg_10:45:322
297999367,3cyclictest0-21swapper/209:05:152
297999365,27cyclictest7950irq/56-dwc_otg_10:40:282
297999365,14cyclictest27036-21rm09:29:312
297999365,14cyclictest27036-21rm09:29:312
297999363,4cyclictest0-21swapper/211:55:292
2979993615,6cyclictest301ktimersoftd/207:40:432
2979993613,6cyclictest301ktimersoftd/211:06:272
2979993613,6cyclictest301ktimersoftd/208:40:382
297899369,11cyclictest7950irq/56-dwc_otg_11:32:571
297899368,13cyclictest7950irq/56-dwc_otg_12:19:171
297899366,4cyclictest25931-21fschecks_time11:00:351
297899366,20cyclictest8790-21ssh09:50:281
297899363,21cyclictest1383-21cut08:35:161
21422365,20sleep12241-21/usr/sbin/munin07:05:441
298099357,22cyclictest0-21swapper/310:00:293
298099356,5cyclictest7750irq/56-dwc_otg08:10:453
298099352,21cyclictest0-21swapper/309:40:193
2980993517,5cyclictest25994-21if_eth012:30:353
2980993517,5cyclictest10164-21sh09:51:013
2980993511,5cyclictest31273-21wget09:35:303
297999357,15cyclictest0-21swapper/207:25:312
297999357,15cyclictest0-21swapper/207:25:312
297999355,10cyclictest301ktimersoftd/208:56:452
2979993511,11cyclictest301ktimersoftd/209:18:532
297899352,18cyclictest7950irq/56-dwc_otg_07:30:261
2978993514,8cyclictest7950irq/56-dwc_otg_10:30:191
297899351,23cyclictest0-21swapper/109:05:291
2980993417,5cyclictest2305850wget08:05:303
298099341,6cyclictest6046-21chrt09:45:403
298099341,6cyclictest6046-21chrt09:45:403
298099341,6cyclictest19184-21ntp_states12:20:393
297999349,8cyclictest301ktimersoftd/212:25:442
297999347,23cyclictest0-21swapper/207:35:302
297999346,12cyclictest7950irq/56-dwc_otg_07:55:362
297999346,12cyclictest7950irq/56-dwc_otg_07:55:362
297999344,11cyclictest22853-21latency_hist08:05:152
297999341,19cyclictest24579-21latency_hist08:10:152
297899345,4cyclictest11996-21cron09:05:151
297899345,17cyclictest0-21swapper/108:10:401
297899345,13cyclictest0-21swapper/107:22:541
2978993411,5cyclictest0-21swapper/109:15:441
298099337,6cyclictest7950irq/56-dwc_otg_09:25:343
298099337,6cyclictest7950irq/56-dwc_otg_09:25:343
298099336,15cyclictest0-21swapper/309:05:293
298099334,15cyclictest7950irq/56-dwc_otg_08:35:163
2980993326,5cyclictest3921-21rm11:15:093
298099332,4cyclictest7850irq/56-dwc_otg_10:25:353
2980993316,4cyclictest7850irq/56-dwc_otg_10:05:353
298099331,30cyclictest15231-21ls09:10:433
298099331,23cyclictest8768-21timerwakeupswit12:05:413
298099331,22cyclictest22876-21ls08:05:153
2980993311,10cyclictest0-21swapper/311:55:393
2980993310,11cyclictest0-21swapper/309:30:413
2979993315,12cyclictest7950irq/56-dwc_otg_11:20:202
2979993315,12cyclictest7950irq/56-dwc_otg_11:20:202
2978993314,8cyclictest7750irq/56-dwc_otg09:59:451
298099327,5cyclictest8904-21cat11:20:443
298099327,5cyclictest8904-21cat11:20:443
298099321,26cyclictest15854-21ls07:45:323
297999327,14cyclictest0-21swapper/208:15:292
297999321,13cyclictest7750irq/56-dwc_otg08:50:432
298099317,12cyclictest26876-21ssh11:00:463
298099314,22cyclictest0-21swapper/307:15:293
298099313,6cyclictest13141-21unixbench_multi07:35:453
298099312,14cyclictest0-21swapper/308:51:573
2980993110,5cyclictest15508-21ps10:45:423
297999315,3cyclictest0-21swapper/207:24:452
297999311,5cyclictest7850irq/56-dwc_otg_08:35:262
297899316,13cyclictest0-21swapper/108:55:321
19672315,12sleep30-21swapper/307:05:423
298099309,6cyclictest15160-21sshd11:30:303
298099309,4cyclictest12851-21ntp_kernel_pll_09:55:393
298099307,14cyclictest0-21swapper/307:55:203
298099307,14cyclictest0-21swapper/307:55:203
298099304,12cyclictest7950irq/56-dwc_otg_12:10:483
298099302,8cyclictest5498-21irqstats08:45:363
298099302,8cyclictest5498-21irqstats08:45:363
298099302,13cyclictest7850irq/56-dwc_otg_10:17:273
298099301,6cyclictest30385-21ssh12:35:463
2979993012,5cyclictest60382chrt07:16:132
298099297,12cyclictest0-21swapper/311:15:253
298099295,5cyclictest7950irq/56-dwc_otg_12:15:303
298099295,10cyclictest7950irq/56-dwc_otg_08:58:483
298099294,8cyclictest13819-21diskmemload10:59:363
298099294,4cyclictest7750irq/56-dwc_otg08:20:393
298099292,19cyclictest0-21swapper/310:41:473
298099291,6cyclictest12020-21basename09:05:153
2980992915,4cyclictest7850irq/56-dwc_otg_08:15:443
298099291,13cyclictest7850irq/56-dwc_otg_10:35:543
298099286,14cyclictest0-21swapper/309:19:453
298099283,4cyclictest7850irq/56-dwc_otg_10:50:273
298099283,4cyclictest7850irq/56-dwc_otg_10:50:273
298099281,7cyclictest8896-21irqstats07:25:373
298099281,7cyclictest8896-21irqstats07:25:373
298099276,11cyclictest0-21swapper/307:20:293
2980992718,6cyclictest17517-21aten_rbpower_en07:50:283
298099271,13cyclictest0-21swapper/308:35:363
297899263,5cyclictest0-21swapper/108:35:271
2980992510,4cyclictest0-21swapper/307:10:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional