You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 14:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon May 11, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83749911931168,21cyclictest16976-21diskstats19:45:151
83749911671140,24cyclictest8497-21cut19:25:011
83739911411111,20cyclictest0-21swapper/019:25:060
80642552454,33sleep00-21swapper/019:22:180
837499174166,6cyclictest0-21swapper/119:25:051
837399141119,17cyclictest0-21swapper/019:45:150
284522411,36sleep127621-21/usr/sbin/munin21:40:261
837399391,12cyclictest31745-21grep21:50:160
8373993811,13cyclictest26004-21mailstats00:25:280
8373993811,13cyclictest26004-21mailstats00:25:270
8374993720,6cyclictest22-21ksoftirqd/122:44:121
8373993716,6cyclictest8276-21munin-run22:15:000
192082361,31sleep019258-21grep21:15:300
837499356,25cyclictest32391-21smartctl21:50:281
837399351,21cyclictest20248-21sed22:45:170
219342341,4sleep022029-21/usr/sbin/munin00:15:230
8374993318,9cyclictest18887-21memory21:15:231
837399333,14cyclictest11654-21awk20:55:260
251402331,4sleep125300-21df00:25:141
251402331,4sleep125300-21df00:25:131
837499323,8cyclictest40250irq/92-i91522:55:091
837399328,13cyclictest0-21swapper/021:57:470
837399327,13cyclictest22068-21basename21:25:110
837399323,5cyclictest81rcu_preempt00:20:050
8373993211,6cyclictest16255-21diskstats22:35:150
7012321,4sleep1708-21iostat_ios00:45:211
837499318,10cyclictest17705-21cpuspeed_turbos00:05:131
837499314,10cyclictest9085-21diskstats20:50:141
837499313,4cyclictest81rcu_preempt23:50:141
8374993110,8cyclictest3098-21latency_hist20:35:011
837399314,13cyclictest32000-21taskset00:41:030
837399312,16cyclictest0-21swapper/021:39:420
837399311,4cyclictest81rcu_preempt22:50:260
8373993112,6cyclictest14371-21df22:30:140
837399311,14cyclictest10483-21hwlatdetect23:45:190
257742311,5sleep00-21swapper/020:08:310
247052311,4sleep024791-21grep21:30:290
837499301,5cyclictest81rcu_preempt20:23:511
837399309,5cyclictest28095-21unixbench_multi00:30:290
837399302,17cyclictest0-21swapper/023:32:140
837399302,15cyclictest0-21swapper/023:38:520
8373993018,7cyclictest3836-21latency_hist00:55:000
837399301,4cyclictest81rcu_preempt19:56:100
309462301,5sleep00-21swapper/021:47:160
26492301,24sleep12781-21fschecks_time23:25:141
229922301,4sleep123117-21timerwakeupswit21:25:271
146902301,25sleep114773-21memory22:30:221
124442301,5sleep00-21swapper/019:31:520
9662291,5sleep00-21swapper/020:29:550
837499295,4cyclictest81rcu_preempt21:56:491
837499295,4cyclictest81rcu_preempt21:36:061
837499295,4cyclictest81rcu_preempt20:13:401
837499294,8cyclictest16258-21diskstats22:35:151
837499294,18cyclictest27855-21iostat_ios23:05:201
8374992919,6cyclictest14654-21tr21:05:151
837499291,4cyclictest81rcu_preempt23:55:111
837499290,4cyclictest81rcu_preempt20:26:021
837399299,6cyclictest27101-21ls23:04:590
837399292,15cyclictest2401-21NetworkManager23:23:070
837399292,13cyclictest28451-21ntp_states21:40:250
837399291,5cyclictest81rcu_preempt22:05:160
837399291,3cyclictest81rcu_preempt20:12:440
837399291,20cyclictest0-21swapper/023:54:490
837399291,15cyclictest17494-21/usr/sbin/munin00:05:120
837399291,14cyclictest20753-21/usr/sbin/munin21:20:210
837399291,14cyclictest19653-21df00:10:140
837399291,12cyclictest6576-21runrttasks20:43:150
42512291,5sleep00-21swapper/022:02:190
322072291,5sleep10-21swapper/100:43:151
300842291,5sleep00-21swapper/000:35:540
285612291,5sleep00-21swapper/023:05:480
251202291,5sleep00-21swapper/022:59:130
138862291,5sleep00-21swapper/021:00:590
837499285,4cyclictest81rcu_preempt23:44:061
837499285,4cyclictest81rcu_preempt23:44:061
837499285,4cyclictest81rcu_preempt22:08:021
837499285,3cyclictest81rcu_preempt00:16:181
837499284,3cyclictest81rcu_preempt00:30:531
837499281,4cyclictest81rcu_preempt22:11:521
837499281,14cyclictest28975-21smartctl20:15:281
837399282,19cyclictest18144-21df_inode22:40:120
837399282,13cyclictest8581-21/usr/sbin/munin23:40:190
837399282,13cyclictest8581-21/usr/sbin/munin23:40:180
837399281,15cyclictest0-21swapper/020:52:560
837399281,14cyclictest22624-21df_inode20:00:140
837399281,13cyclictest18847-21df_inode19:50:120
82122281,5sleep00-21swapper/020:45:470
75282281,5sleep10-21swapper/123:36:101
38122281,5sleep10-21swapper/100:54:551
315512281,5sleep00-21swapper/020:24:540
296482281,5sleep00-21swapper/020:19:500
237432281,5sleep10-21swapper/120:01:561
199482281,4sleep10-21swapper/119:51:391
159062281,5sleep00-21swapper/000:00:150
143012281,4sleep10-21swapper/119:36:401
14152281,5sleep00-21swapper/000:45:450
130372281,5sleep00-21swapper/022:25:250
126972281,5sleep10-21swapper/119:34:311
98222271,5sleep10-21swapper/122:16:421
837499279,6cyclictest40250irq/92-i91520:55:161
837499276,4cyclictest81rcu_preempt00:20:421
837499276,17cyclictest0-21swapper/120:05:181
837499275,4cyclictest81rcu_preempt23:18:041
837499275,4cyclictest81rcu_preempt22:24:381
837499274,4cyclictest40250irq/92-i91523:10:121
837499274,3cyclictest81rcu_preempt19:56:191
837499274,3cyclictest81rcu_preempt00:01:261
837499273,4cyclictest81rcu_preempt21:32:021
837499273,3cyclictest81rcu_preempt20:47:391
837499273,18cyclictest12860-21diskstats21:00:141
837499271,9cyclictest27100-21cron23:05:001
8374992715,7cyclictest16614-21diskstats21:10:131
8374992714,10cyclictest22-21ksoftirqd/121:20:271
837399279,7cyclictest3111-21date20:35:010
837399279,6cyclictest0-21swapper/023:58:240
837399278,6cyclictest11688-21taskset22:21:160
837399272,21cyclictest0-21swapper/020:33:560
837399272,14cyclictest0-21swapper/021:05:180
837399272,12cyclictest29229-21aten_r4power_vo23:10:120
8373992718,5cyclictest13085-21/usr/sbin/munin19:35:120
8373992716,7cyclictest3686-21unixbench_singl23:25:260
8373992716,7cyclictest0-21swapper/023:15:010
837399271,4cyclictest81rcu_preempt19:42:380
41422271,5sleep10-21swapper/122:01:111
208602271,5sleep10-21swapper/100:12:451
161792271,5sleep10-21swapper/119:41:301
837499268,5cyclictest40250irq/92-i91522:50:291
837499261,4cyclictest81rcu_preempt20:40:231
837399261,9cyclictest17597-21vmstat21:10:290
8373992610,5cyclictest8434-21aten_r4power_cu22:15:100
44302261,5sleep10-21swapper/120:35:391
309132261,5sleep10-21swapper/121:46:561
18942261,4sleep10-21swapper/123:22:111
116292261,5sleep10-21swapper/123:49:281
837499258,4cyclictest40250irq/92-i91500:35:181
837499253,3cyclictest81rcu_preempt22:29:011
8374992515,6cyclictest5351-21cat23:30:281
837499231,9cyclictest20243-21taskset22:45:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional