You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 09:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Thu Apr 23, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
266949911951154,29cyclictest0-21swapper/019:25:110
266959911621119,26cyclictest19660-21kworker/1:421:15:001
266959911351126,6cyclictest0-21swapper/119:25:121
264432543495,32sleep00-21swapper/019:22:560
262482464420,29sleep10-21swapper/119:20:521
2669499199174,22cyclictest0-21swapper/021:15:010
43732860,8sleep00-21swapper/023:25:180
2669599633,17cyclictest22236-21iostat_ios23:10:191
26695996212,6cyclictest11865-21runrttasks00:05:561
2669599621,16cyclictest12143-21taskset21:53:101
2669599613,17cyclictest0-21swapper/122:38:311
26695996016,5cyclictest22-21ksoftirqd/120:41:161
2669599593,4cyclictest0-21swapper/123:41:241
2669599588,15cyclictest0-21swapper/122:54:391
26695995813,4cyclictest0-21swapper/121:41:371
26695995813,4cyclictest0-21swapper/121:41:361
26695995810,43cyclictest0-21swapper/100:16:401
2669599563,5cyclictest0-21swapper/121:22:211
2669599561,9cyclictest23586-21sh21:30:581
2669599551,16cyclictest8582-21ssh22:22:491
26695995511,4cyclictest0-21swapper/121:49:361
25612550,2sleep02560-21fschecks_time22:50:150
105512550,23sleep03-21ksoftirqd/021:50:520
2669599541,6cyclictest13314-21sed23:00:291
26695995413,6cyclictest9985-21runrttasks20:04:401
2669599541,21cyclictest29657-21ssh22:45:051
2669599541,18cyclictest0-21swapper/121:59:151
26695995411,5cyclictest31885-21if_eth023:20:191
2669599541,15cyclictest12477-21sh22:26:261
2669599539,11cyclictest0-21swapper/122:30:451
2669599537,5cyclictest0-21swapper/123:26:021
2669599536,5cyclictest0-21swapper/122:12:081
2669599536,13cyclictest0-21swapper/122:41:311
2669599534,9cyclictest25828-21iostat_ios20:45:201
2669599533,6cyclictest28628-21iostat_ios23:50:211
2669599532,13cyclictest0-21swapper/100:32:351
26695995315,5cyclictest31589-21ssh00:26:321
26695995312,7cyclictest2695-21snmpd21:16:361
2669599531,15cyclictest0-21swapper/122:57:001
2669599531,14cyclictest17744-21cat21:25:201
2669599531,12cyclictest11650-21wget00:40:101
161272531,37sleep016131-21diskstats20:20:140
2669599528,11cyclictest0-21swapper/100:22:491
2669599527,13cyclictest0-21swapper/121:39:211
2669599523,13cyclictest0-21swapper/123:07:331
2669599522,18cyclictest0-21swapper/100:13:261
26695995216,5cyclictest20640-21cut00:50:121
26695995214,6cyclictest7846-21cat00:35:271
2669599521,19cyclictest2380-21ssh23:56:201
2669599521,18cyclictest0-21swapper/122:03:251
2669599519,5cyclictest40250irq/92-i91520:38:051
2669599519,4cyclictest0-21swapper/122:16:511
2669599515,13cyclictest0-21swapper/123:18:121
2669599513,4cyclictest0-21swapper/119:50:251
2669599512,17cyclictest0-21swapper/123:38:461
2669599511,17cyclictest0-21swapper/100:04:141
26695995111,6cyclictest2040-21diskmemload00:49:171
2669599504,13cyclictest0-21swapper/123:45:321
2669599502,7cyclictest3286-21runrttasks19:37:311
2669599502,5cyclictest0-21swapper/123:30:441
26695995014,5cyclictest8082-21runrttasks19:59:361
26695995011,6cyclictest26381-21seq22:07:461
2669599501,16cyclictest20117-21/usr/sbin/munin20:30:181
26695995010,6cyclictest11060-21proc_pri20:05:261
2669499501,17cyclictest5989-21irqstats00:00:220
2669599492,14cyclictest29676-21memory20:55:221
2669599491,16cyclictest12171-21/usr/sbin/munin20:10:121
2669599487,4cyclictest16430-21iostat20:20:201
2669599482,13cyclictest0-21swapper/121:05:251
26695994813,4cyclictest19427-21idleruntime-cro20:29:591
26695994810,4cyclictest0-21swapper/120:19:421
2669599473,5cyclictest0-21swapper/119:41:241
2669599471,9cyclictest0-21swapper/119:30:251
2669599471,15cyclictest2605-21/usr/sbin/munin19:45:101
2669599463,8cyclictest27387-21df20:50:121
26695994613,6cyclictest30883-21/usr/sbin/munin21:00:271
91952430,21sleep03-21ksoftirqd/020:00:270
24232430,7sleep00-21swapper/023:56:240
26694994214,15cyclictest1465-21ntpdc19:40:230
26694994017,8cyclictest28740-21memory23:50:220
26694993916,8cyclictest31160-21users22:45:300
2669499389,3cyclictest0-21swapper/021:16:160
2669499374,17cyclictest21872-21diskstats23:10:140
2669499371,13cyclictest0-21swapper/023:18:420
26694993626,6cyclictest25653-21/usr/sbin/munin22:40:220
2669499362,17cyclictest3345-21users00:30:310
2669499362,12cyclictest0-21swapper/023:02:530
26694993611,5cyclictest0-21swapper/000:09:000
2669499355,5cyclictest0-21swapper/022:34:450
2669499353,16cyclictest6708-21diskstats19:55:160
26694993511,4cyclictest0-21swapper/022:07:410
26694993511,13cyclictest19806-21cstates20:30:130
2669499346,5cyclictest81rcu_preempt00:50:130
2669499341,4cyclictest81rcu_preempt21:46:030
2669499341,20cyclictest19220-21irqstats22:00:200
169392340,8sleep02669499cyclictest00:45:190
2669499334,4cyclictest81rcu_preempt00:18:150
2669499332,5cyclictest0-21swapper/021:42:260
2669499332,5cyclictest0-21swapper/021:42:250
26694993323,6cyclictest2040-21diskmemload23:33:060
2669499331,20cyclictest22775-21ntp_states21:30:240
26722321,4sleep02915-21expr19:45:120
2669499328,3cyclictest0-21swapper/023:23:300
2669499325,4cyclictest81rcu_preempt21:22:080
2669499324,4cyclictest81rcu_preempt22:27:480
2669499324,4cyclictest81rcu_preempt22:18:210
2669499323,24cyclictest5861-21diskstats22:20:140
26694993213,6cyclictest23647-21diskstats20:40:150
256352321,27sleep025645-21ssh23:47:040
2669499317,13cyclictest4827-21df_inode19:50:140
2669499315,14cyclictest16462-21udevd23:05:020
2669499314,4cyclictest81rcu_preempt23:39:490
2669499314,4cyclictest81rcu_preempt21:55:200
2669499313,4cyclictest81rcu_preempt00:24:000
2669499313,14cyclictest18956-21iostat23:40:200
2669499312,4cyclictest81rcu_preempt00:10:200
2669499311,4cyclictest81rcu_preempt22:11:250
2669499311,4cyclictest81rcu_preempt00:25:080
26694993113,6cyclictest7437-21/usr/sbin/munin00:35:210
2669499306,12cyclictest12394-21memory00:40:220
26694993013,5cyclictest27173-21perl21:35:150
26694993012,5cyclictest17928-21ntp_states21:25:240
26694993012,5cyclictest0-21swapper/020:50:270
2669499301,24cyclictest32025-21/usr/sbin/munin21:00:290
2669499301,18cyclictest18495-21netstat20:25:220
26694993011,6cyclictest30013-21/usr/sbin/munin19:30:210
26694993011,5cyclictest21134-21gzip22:35:280
26694993011,15cyclictest12061-21/usr/sbin/munin20:10:290
26694993010,5cyclictest7742-21kernelversion22:55:210
2669499296,12cyclictest2695-21snmpd19:36:160
2669499291,4cyclictest81rcu_preempt20:45:040
26694992911,6cyclictest29487-21smartctl20:55:170
26694992911,5cyclictest21739-21df20:35:130
17842291,5sleep00-21swapper/021:07:360
2669499282,13cyclictest10713-21/usr/sbin/munin20:05:180
26694992710,13cyclictest10050irq/91-xhci_hcd20:15:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional