You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 22:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Dec 26, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122659912511228,19cyclictest22333-21apt-get07:50:021
122649911381107,21cyclictest0-21swapper/007:25:140
122659911141084,24cyclictest12519-21cpu07:25:121
120382742698,29sleep10-21swapper/107:23:161
121802562516,31sleep00-21swapper/007:24:440
1226499228218,7cyclictest0-21swapper/007:50:010
2518421240,4sleep10-21swapper/110:55:061
136221040,22sleep03-21ksoftirqd/011:36:430
275762840,4sleep1201rcuc/110:24:001
253182750,4sleep00-21swapper/009:15:040
146662610,5sleep01226499cyclictest10:44:020
84692560,3sleep08467-21sed08:35:300
12264994725,4cyclictest111rcuc/010:59:370
12264994316,7cyclictest3-21ksoftirqd/010:12:360
12264994225,4cyclictest0-21swapper/012:42:080
12264994218,8cyclictest3-21ksoftirqd/009:06:150
12264994218,8cyclictest3-21ksoftirqd/007:43:200
12264994216,7cyclictest3-21ksoftirqd/009:32:230
12264994215,7cyclictest3-21ksoftirqd/011:40:230
12264994211,27cyclictest0-21swapper/010:00:360
2260024111,10sleep122-21ksoftirqd/111:59:171
213162410,4sleep11226599cyclictest09:44:141
12264994119,12cyclictest12980-21ssh11:15:240
12264994117,8cyclictest3-21ksoftirqd/009:58:160
12264994114,7cyclictest3-21ksoftirqd/009:29:550
1226499408,28cyclictest0-21swapper/012:31:550
12264994017,8cyclictest3-21ksoftirqd/007:38:440
12264994014,15cyclictest3-21ksoftirqd/009:41:140
12264994013,7cyclictest3-21ksoftirqd/011:31:390
36122391,3sleep03622-21ssh12:12:350
1226599391,18cyclictest24755-21ssh11:27:351
12264993924,6cyclictest3-21ksoftirqd/008:05:310
12264993917,7cyclictest3-21ksoftirqd/008:56:390
12264993916,8cyclictest3-21ksoftirqd/009:54:130
12264993916,7cyclictest3-21ksoftirqd/011:24:260
54732381,33sleep05484-21diskmemload10:34:480
215842380,4sleep0111rcuc/009:10:240
12264993817,7cyclictest3-21ksoftirqd/007:45:210
12264993816,8cyclictest3-21ksoftirqd/012:08:570
12264993816,7cyclictest3-21ksoftirqd/010:06:180
12264993811,16cyclictest31045-21memory09:20:200
1226599375,7cyclictest0-21swapper/110:28:371
1226599371,15cyclictest28727-21chrt09:18:111
12264993728,6cyclictest15947-21/usr/sbin/munin10:45:150
12264993715,7cyclictest3-21ksoftirqd/012:27:470
12264993715,7cyclictest3-21ksoftirqd/012:27:460
12264993715,7cyclictest3-21ksoftirqd/012:17:010
12264993715,7cyclictest3-21ksoftirqd/011:50:580
12264993715,7cyclictest3-21ksoftirqd/010:37:400
97212361,31sleep120308-21diskmemload10:38:571
1226599366,13cyclictest0-21swapper/111:24:101
12265993625,7cyclictest4655-21/usr/sbin/munin11:40:211
1226599362,17cyclictest21678-21/usr/sbin/munin10:50:291
12265993621,11cyclictest29098-21ssh11:31:511
1226499362,30cyclictest3824-21df_inode08:25:160
12264993621,4cyclictest3-21ksoftirqd/012:47:030
12264993620,6cyclictest19256-21ssh11:55:210
12264993620,6cyclictest10904-21ssh12:20:160
12264993620,5cyclictest7119-21cron08:35:000
12264993620,5cyclictest28833-21df_inode10:25:140
12264993616,6cyclictest3-21ksoftirqd/009:39:550
12264993615,6cyclictest3-21ksoftirqd/012:50:270
12264993614,7cyclictest3-21ksoftirqd/012:00:340
12264993614,7cyclictest3-21ksoftirqd/010:24:530
12264993613,7cyclictest3-21ksoftirqd/011:08:220
12264993613,7cyclictest3-21ksoftirqd/011:08:210
12264993613,13cyclictest31616-21chrt08:11:420
67322351,30sleep16745-21iostat_ios12:50:171
1226599358,12cyclictest40550irq/92-i91512:05:341
12265993523,8cyclictest2949-21ssh10:31:101
12264993515,6cyclictest3-21ksoftirqd/011:03:360
12264993514,7cyclictest3-21ksoftirqd/010:51:200
12264993513,6cyclictest3-21ksoftirqd/012:35:110
12264993513,12cyclictest9897-21sh11:12:060
12264993510,14cyclictest17192-21hddtemp_smartct09:00:170
72952341,29sleep120308-21diskmemload11:10:091
49882341,4sleep15004-21iostat_ios10:00:201
1226599342,7cyclictest0-21swapper/111:18:551
12265993423,6cyclictest16676-21ssh10:12:161
12265993422,8cyclictest2214-21diskstats12:45:141
12265993422,8cyclictest20308-21diskmemload12:15:401
1226599341,15cyclictest4493-21ssh11:06:151
1226599341,15cyclictest4493-21ssh11:06:151
1226599341,15cyclictest31826-21ssh12:41:241
12264993426,5cyclictest2403-21irqbalance11:49:560
12264993415,15cyclictest25640-21ssh09:48:290
12264993413,6cyclictest3-21ksoftirqd/010:18:350
12264993412,7cyclictest3-21ksoftirqd/011:25:540
165622331,4sleep116576-21ssh09:39:241
1226599332,5cyclictest0-21swapper/112:31:341
12265993322,8cyclictest14664-21ssh10:44:021
1226599331,5cyclictest0-21swapper/112:36:551
1226599331,30cyclictest0-21swapper/107:45:161
12264993318,4cyclictest0-21swapper/008:20:180
12264993317,6cyclictest32486-21fschecks_count08:15:170
12264993317,5cyclictest9862-21/usr/sbin/munin08:40:230
12264993317,5cyclictest9862-21/usr/sbin/munin08:40:230
12264993315,7cyclictest24856-21df07:55:130
12264993310,7cyclictest3-21ksoftirqd/008:50:190
43552321,4sleep14365-21ntp_states08:25:261
190122325,4sleep14117-1kworker/1:2H12:28:531
190122325,4sleep14117-1kworker/1:2H12:28:521
1226599324,25cyclictest22-21ksoftirqd/109:59:381
1226599322,27cyclictest0-21swapper/109:32:151
12265993218,10cyclictest0-21swapper/109:12:561
1226599321,5cyclictest0-21swapper/109:51:361
1226599321,4cyclictest81rcu_preempt07:43:191
1226599321,28cyclictest0-21swapper/112:13:361
1226499329,12cyclictest23160-21kworker/0:108:00:470
1226499321,29cyclictest0-21swapper/008:45:350
1226599313,25cyclictest0-21swapper/111:45:251
12265993123,4cyclictest0-21swapper/110:19:361
1226599311,6cyclictest81rcu_preempt07:38:451
1226599311,4cyclictest81rcu_preempt11:50:591
1226599311,4cyclictest81rcu_preempt09:28:341
1226599311,4cyclictest81rcu_preempt09:06:151
12264993114,6cyclictest15633-21memory07:30:190
12265993023,4cyclictest22-21ksoftirqd/112:01:061
12265993022,6cyclictest0-21swapper/108:04:551
12265993022,5cyclictest32093-21ssh09:21:021
1226599302,24cyclictest16130-21perl10:45:171
12265993019,8cyclictest20308-21diskmemload09:45:041
1226599301,4cyclictest81rcu_preempt10:09:121
1226599301,4cyclictest81rcu_preempt08:56:391
1226599301,27cyclictest0-21swapper/111:37:361
9292291,5sleep10-21swapper/108:15:421
12265992922,5cyclictest0-21swapper/111:04:171
1226599292,23cyclictest0-21swapper/108:35:371
69412281,5sleep10-21swapper/108:33:121
317262281,5sleep10-21swapper/108:12:531
180782281,5sleep10-21swapper/109:01:311
165262281,5sleep10-21swapper/107:33:381
1226599285,3cyclictest81rcu_preempt08:54:121
1226599281,4cyclictest81rcu_preempt12:20:321
261112271,5sleep10-21swapper/107:58:131
12265992717,6cyclictest2832-21unixbench_multi08:20:301
91662261,5sleep10-21swapper/108:40:061
91662261,5sleep10-21swapper/108:40:061
12265992616,6cyclictest12153-21sort08:45:271
1226599243,18cyclictest0-21swapper/108:06:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional