You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 18:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Jun 30, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101569912381204,24cyclictest30558-21kworker/0:107:27:200
101579911301079,27cyclictest4148-21tail09:55:301
101569911121063,37cyclictest30118-21ntpq11:05:250
99502563517,32sleep00-21swapper/007:23:260
97342460417,29sleep10-21swapper/107:21:081
1015699244221,20cyclictest0-21swapper/009:55:310
1015799125116,6cyclictest0-21swapper/111:05:251
141121230,11sleep11015799cyclictest08:25:111
138572710,3sleep041ktimersoftd/011:50:010
10157997163,5cyclictest0-21swapper/107:27:191
6302660,2sleep1629-21awk08:20:291
232022580,8sleep01015699cyclictest09:20:270
148932580,8sleep11015799cyclictest09:00:131
323672461,33sleep032457-21cut09:45:260
53262400,22sleep122-21ksoftirqd/110:00:161
15042401,34sleep11546-21iostat09:50:201
185862390,9sleep11015799cyclictest10:35:181
42542351,4sleep12695-21snmpd11:24:301
10157993519,5cyclictest22-21ksoftirqd/107:57:041
1015799351,7cyclictest835-21iostat_ios12:40:211
237702341,9sleep00-21swapper/007:55:480
148102341,29sleep114887-21sensors_temp11:50:271
10157993417,13cyclictest22-21ksoftirqd/112:04:281
1015799341,10cyclictest241162grep10:50:151
1015699341,13cyclictest17972-21fschecks_count12:00:150
137542335,4sleep081rcu_preempt08:55:310
1015699333,16cyclictest5593-21cut10:00:220
1015699331,6cyclictest81rcu_preempt09:14:590
10156993315,5cyclictest27256-21python08:05:290
10156993312,6cyclictest14594-21apt-get07:35:010
1015699331,20cyclictest0-21swapper/009:08:460
10157993222,6cyclictest8612-21wget10:10:111
1015799322,15cyclictest3286-21runrttasks11:49:191
266592311,5sleep10-21swapper/112:22:421
1015799315,4cyclictest81rcu_preempt08:56:301
1015799313,4cyclictest81rcu_preempt07:35:281
10157993123,5cyclictest11051-21interrupts10:15:211
10157993113,6cyclictest40250irq/92-i91508:10:211
1015699311,19cyclictest2225-21dbus-daemon08:47:460
315182301,5sleep00-21swapper/008:18:030
198242301,5sleep10-21swapper/109:12:291
152002301,5sleep00-21swapper/011:51:010
114702301,6sleep00-21swapper/011:41:130
1015799306,5cyclictest81rcu_preempt10:55:121
1015799305,4cyclictest81rcu_preempt12:16:101
1015799305,4cyclictest81rcu_preempt11:57:521
1015799305,4cyclictest81rcu_preempt07:45:271
1015799301,4cyclictest81rcu_preempt11:20:001
10157993011,6cyclictest14228-21seq07:31:401
1015699307,11cyclictest31927-21aten_r4power_en08:20:120
1015699306,4cyclictest81rcu_preempt10:19:430
1015699302,14cyclictest14557-21fschecks_count10:25:160
313032291,5sleep00-21swapper/009:44:200
270622291,5sleep00-21swapper/010:58:190
234192291,5sleep10-21swapper/109:20:381
216912291,5sleep00-21swapper/007:50:360
216862291,24sleep121693-21diskstats12:10:131
200352291,5sleep00-21swapper/007:47:560
193102291,5sleep00-21swapper/010:35:580
117512291,5sleep10-21swapper/111:44:081
1015799295,5cyclictest81rcu_preempt08:50:151
1015799294,19cyclictest16413-21diskstats10:30:151
1015799292,14cyclictest6001-21ntp_states08:35:251
1015799291,4cyclictest81rcu_preempt08:17:001
10157992913,4cyclictest22-21ksoftirqd/110:05:221
1015799291,24cyclictest22044-21passwd07:52:251
1015699294,4cyclictest81rcu_preempt10:42:150
1015699292,15cyclictest24347-21/usr/sbin/munin10:50:210
1015699292,15cyclictest12884-21/usr/sbin/munin07:30:110
1015699292,14cyclictest2462-21df_inode12:45:130
1015699292,14cyclictest22413-21python12:10:280
1015699292,14cyclictest11565-21gdbus10:48:230
1015699292,14cyclictest0-21swapper/008:10:090
1015699291,5cyclictest81rcu_preempt12:51:400
1015699291,14cyclictest2143-21grep08:25:230
10156992910,6cyclictest16935-21df07:40:140
10156992910,10cyclictest3-21ksoftirqd/009:19:310
60962281,5sleep10-21swapper/111:29:081
44702281,5sleep00-21swapper/011:25:100
39742281,5sleep00-21swapper/011:21:350
324832281,5sleep10-21swapper/112:39:431
303642281,5sleep10-21swapper/112:32:121
294312281,5sleep00-21swapper/009:39:390
284302281,5sleep10-21swapper/112:26:361
257692281,5sleep00-21swapper/008:01:520
255892281,5sleep10-21swapper/109:28:421
247702281,5sleep00-21swapper/012:17:470
183422281,5sleep10-21swapper/107:44:481
158332281,5sleep10-21swapper/110:28:501
157442281,4sleep00-21swapper/011:55:050
123822281,4sleep112514-21cpu10:20:111
1015799285,4cyclictest81rcu_preempt11:10:351
1015799284,15cyclictest0-21swapper/109:45:511
1015799284,15cyclictest0-21swapper/108:40:051
1015799282,4cyclictest81rcu_preempt10:50:001
10157992819,6cyclictest22-21ksoftirqd/111:35:001
10157992815,7cyclictest20530-21diskstats09:15:151
1015799281,4cyclictest81rcu_preempt09:41:591
1015799281,4cyclictest81rcu_preempt09:06:551
1015699288,7cyclictest30654-21awk12:35:000
1015699283,3cyclictest81rcu_preempt08:42:170
1015699282,15cyclictest0-21swapper/009:26:510
1015699282,13cyclictest12740-21tune2fs10:20:150
1015699281,8cyclictest0-21swapper/009:30:150
1015699281,14cyclictest26370-21unixbench_multi12:20:290
1015699281,14cyclictest16118-21/usr/sbin/munin10:30:280
1015699281,13cyclictest1546-21iostat09:50:200
95342271,5sleep10-21swapper/111:35:561
47452271,5sleep10-21swapper/108:32:161
36852271,5sleep10-21swapper/112:47:011
1015799276,4cyclictest81rcu_preempt08:08:061
1015799274,4cyclictest81rcu_preempt08:49:161
1015799273,3cyclictest81rcu_preempt08:00:101
1015799273,18cyclictest27709-21diskstats11:00:161
10157992712,9cyclictest19524-21/usr/sbin/munin12:05:311
10157992712,11cyclictest25883-21/usr/sbin/munin09:30:271
1015699279,5cyclictest411-21/usr/sbin/munin12:40:120
1015699279,4cyclictest3286-21runrttasks11:03:250
1015699272,12cyclictest7863-21sshd11:33:010
1015699272,12cyclictest4125-21ntp_states08:30:240
1015699271,17cyclictest0-21swapper/011:12:230
1015699271,13cyclictest10025-21seq10:12:120
1015699271,13cyclictest0-21swapper/012:05:050
1015699271,12cyclictest11324-21smartctl08:50:180
1015799263,4cyclictest81rcu_preempt10:42:201
10157992617,5cyclictest27975-21cpuspeed_turbos09:35:121
1015699269,5cyclictest2225-21dbus-daemon08:35:250
1015699261,16cyclictest0-21swapper/009:00:410
1015699261,13cyclictest30816-21/usr/sbin/munin12:35:120
1015799251,6cyclictest0-21swapper/112:54:321
1015699259,4cyclictest3286-21runrttasks11:19:010
1015699259,4cyclictest0-21swapper/010:05:110
1015699251,15cyclictest0-21swapper/011:35:200
10156992411,3cyclictest0-21swapper/012:25:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional