You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 19:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Thu Mar 12, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82389911211092,23cyclictest9803-21pidof07:27:001
82379910961087,6cyclictest0-21swapper/007:26:490
77592576530,32sleep10-21swapper/107:20:331
81382561517,29sleep00-21swapper/007:24:320
325812770,3sleep00-21swapper/010:33:080
247722640,2sleep024773-21expr10:25:120
90922560,5sleep1201rcuc/109:35:171
72592560,5sleep0111rcuc/012:20:230
225352550,9sleep0823799cyclictest10:55:290
226432480,7sleep1823899cyclictest10:55:291
272572440,3sleep00-21swapper/012:07:410
8237994326,6cyclictest3-21ksoftirqd/010:37:270
8237994326,6cyclictest3-21ksoftirqd/010:37:270
79062430,8sleep00-21swapper/008:45:270
8238993911,13cyclictest40550irq/92-i91511:52:011
148682390,8sleep0823799cyclictest09:05:130
823799384,17cyclictest26629-21diskstats09:20:140
8237993825,9cyclictest0-21swapper/012:40:350
327042381,4sleep032714-21ssh12:46:460
823899376,4cyclictest81rcu_preempt11:11:191
823899375,28cyclictest0-21swapper/110:30:151
8237993716,5cyclictest3-21ksoftirqd/011:52:240
8237993710,6cyclictest0-21swapper/011:47:540
823899363,30cyclictest0-21swapper/112:11:361
823899363,29cyclictest0-21swapper/111:18:561
823899362,30cyclictest11412-21hddtemp_smartct07:30:161
823899361,8cyclictest16757-21tr09:10:121
823799366,12cyclictest14033-21/usr/sbin/munin09:40:190
8237993620,5cyclictest3-21ksoftirqd/009:55:140
8237993620,5cyclictest3-21ksoftirqd/009:55:140
823899356,5cyclictest81rcu_preempt12:55:011
823899353,6cyclictest0-21swapper/112:42:161
823899352,6cyclictest19787-21ssh09:45:411
823899352,29cyclictest0-21swapper/112:45:351
8237993515,5cyclictest3-21ksoftirqd/009:35:410
8237993515,5cyclictest3-21ksoftirqd/009:10:240
823899346,15cyclictest0-21swapper/110:28:091
823899344,4cyclictest16287-21diskmemload09:19:431
823899344,27cyclictest16235-21kworker/1:312:33:051
823899342,29cyclictest0-21swapper/110:10:561
823899342,28cyclictest0-21swapper/110:02:561
823899341,29cyclictest5620-21ssh10:38:551
823899341,29cyclictest5620-21ssh10:38:551
823899341,29cyclictest26811-21ssh11:34:161
823899341,29cyclictest22445-21/usr/sbin/munin08:00:151
823799346,25cyclictest20441-21ssh09:46:370
823799344,4cyclictest81rcu_preempt11:30:010
823799343,4cyclictest81rcu_preempt10:54:410
8237993426,6cyclictest0-21swapper/009:19:150
8237993419,4cyclictest3-21ksoftirqd/009:50:330
8237993417,5cyclictest21946-21ntp_states12:35:240
8237993415,9cyclictest3-21ksoftirqd/010:23:390
8237993415,5cyclictest3-21ksoftirqd/011:58:180
823799341,15cyclictest32231-21/usr/sbin/munin09:25:260
22422341,3sleep10-21swapper/111:08:571
823899335,4cyclictest81rcu_preempt12:28:291
823899335,4cyclictest81rcu_preempt11:59:541
823899334,4cyclictest81rcu_preempt12:38:171
823899334,4cyclictest81rcu_preempt10:17:381
823899334,4cyclictest81rcu_preempt09:41:551
823899333,4cyclictest81rcu_preempt11:45:091
823899332,4cyclictest0-21swapper/111:40:551
8238993323,7cyclictest0-21swapper/109:26:201
823899332,27cyclictest0-21swapper/111:02:561
823899332,27cyclictest0-21swapper/110:41:351
8238993316,14cyclictest22-21ksoftirqd/109:30:521
823899331,4cyclictest81rcu_preempt10:49:111
823899331,11cyclictest20227-21fw_packets10:20:161
823799339,21cyclictest30500-21unixbench_multi12:10:290
823799339,12cyclictest12121-21load12:25:220
823799337,4cyclictest81rcu_preempt10:44:410
823799334,4cyclictest81rcu_preempt10:46:070
823799332,18cyclictest0-21swapper/010:05:070
8237993318,8cyclictest21813-21users07:55:280
8237993317,5cyclictest3-21ksoftirqd/010:02:550
823799331,5cyclictest81rcu_preempt12:50:090
8237993314,14cyclictest9544-21/usr/sbin/munin11:15:290
269832331,3sleep027021-21ntp_states08:10:230
823899324,4cyclictest81rcu_preempt11:25:381
823899323,4cyclictest81rcu_preempt10:51:091
823899322,4cyclictest81rcu_preempt11:36:251
823899321,4cyclictest81rcu_preempt10:08:461
823899321,28cyclictest28992-21ssh09:22:151
823899321,28cyclictest0-21swapper/111:21:351
823899321,27cyclictest0-21swapper/112:01:361
823899321,15cyclictest0-21swapper/108:29:381
823799325,7cyclictest3-21ksoftirqd/011:30:240
8237993225,5cyclictest0-21swapper/008:01:560
8237993223,5cyclictest4817-21ssh12:17:590
8237993220,4cyclictest31897-21ssh11:05:250
8237993217,4cyclictest3-21ksoftirqd/010:10:160
823799321,4cyclictest0-21swapper/009:00:360
8237993213,5cyclictest3-21ksoftirqd/011:23:520
8237993213,5cyclictest30801-21ntp_states08:20:230
823799321,29cyclictest0-21swapper/008:35:360
823799321,28cyclictest0-21swapper/011:42:350
823799321,27cyclictest30715-21ssh11:37:550
8237993212,5cyclictest15346-21ssh10:15:150
823899317,13cyclictest40550irq/92-i91508:15:011
823899313,4cyclictest81rcu_preempt09:57:021
823899313,4cyclictest81rcu_preempt09:57:011
823899311,5cyclictest2403-21irqbalance12:24:551
823899311,5cyclictest0-21swapper/107:42:151
8238993113,4cyclictest40550irq/92-i91509:50:211
823899311,18cyclictest0-21swapper/112:15:301
823799313,11cyclictest0-21swapper/009:34:240
823799311,4cyclictest81rcu_preempt11:11:280
823799311,4cyclictest81rcu_preempt07:49:400
8237993113,5cyclictest11397-21irqstats08:55:190
823799311,27cyclictest0-21swapper/012:31:190
823799311,27cyclictest0-21swapper/012:03:190
197992311,4sleep12645-21snmpd07:50:541
823899303,4cyclictest81rcu_preempt07:47:441
823899301,27cyclictest0-21swapper/107:35:361
823799302,16cyclictest0-21swapper/008:06:570
823799302,15cyclictest0-21swapper/008:51:450
823799302,13cyclictest11213-21df_inode07:30:130
8237993014,5cyclictest3-21ksoftirqd/008:25:160
8237993014,4cyclictest3-21ksoftirqd/007:54:300
8237993011,6cyclictest26530-21fschecks_time11:00:140
258652301,5sleep10-21swapper/108:08:201
823899294,4cyclictest81rcu_preempt08:56:561
823899291,6cyclictest81rcu_preempt12:07:361
823799297,6cyclictest2206-21dbus-daemon08:42:140
823799296,12cyclictest15191-21grep07:40:150
823799292,14cyclictest13701-21/usr/sbin/munin07:35:240
8237992920,6cyclictest1255-21/usr/sbin/munin08:30:170
39532291,4sleep14023-21uname08:35:221
84232281,5sleep10-21swapper/108:46:351
8238992816,6cyclictest9214-21diskstats08:50:151
8237992810,6cyclictest29457-21runrttasks08:16:380
312532281,4sleep10-21swapper/108:20:331
823899274,8cyclictest13379-21memory09:00:211
823899272,10cyclictest15367-21awk09:05:231
65302271,5sleep10-21swapper/108:41:291
218372271,5sleep10-21swapper/107:55:361
823899266,7cyclictest29615-21runrttasks08:18:141
823899244,3cyclictest81rcu_preempt08:32:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional