You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 09:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Aug 30, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
254259912251190,32cyclictest7788-21strings20:00:220
254259912161191,22cyclictest0-21swapper/019:25:060
254269911791152,24cyclictest0-21swapper/119:25:101
240102565517,31sleep00-21swapper/019:20:160
252332562518,30sleep10-21swapper/119:23:321
2450721010,9sleep02542599cyclictest23:35:290
136832850,7sleep12542699cyclictest20:15:281
25426995551,2cyclictest0-21swapper/120:00:221
98052370,5sleep09807-21aten_r4power_po00:25:120
2542699376,27cyclictest0-21swapper/123:45:181
2542599362,21cyclictest11023-21iostat21:35:200
2542599361,11cyclictest12493-21hwlatdetect23:05:170
81572350,4sleep10-21swapper/100:20:141
2542699352,7cyclictest1209-21df_inode21:10:151
2542699352,7cyclictest1209-21df_inode21:10:151
25425993516,6cyclictest30451-21hddtemp_smartct19:35:160
2542599351,22cyclictest32306-21/usr/sbin/munin21:05:250
113832351,4sleep111388-21irqstats20:10:191
257392342,5sleep125744-21irqstats23:40:201
25426993412,7cyclictest1906-21seq00:04:471
2542699341,19cyclictest27841-21grep19:30:041
2542599347,13cyclictest11565-21gdbus23:59:460
25425993413,16cyclictest29984-21ls23:50:270
21622341,3sleep011564-21packagekitd22:38:470
151542341,29sleep115163-21iostat_ios20:20:191
25426993323,6cyclictest13505-21grep21:40:301
2542699332,17cyclictest16303-21/usr/sbin/munin23:15:201
2542599334,13cyclictest11565-21gdbus00:43:070
2542599331,20cyclictest30418-21ntpdc21:00:230
2542599331,19cyclictest25436-21df_inode23:40:140
205482331,5sleep10-21swapper/100:51:351
25426993223,5cyclictest18821-21seq00:48:041
2542699321,5cyclictest81rcu_preempt19:49:331
25426993215,5cyclictest30004-21sort23:50:271
2542599328,12cyclictest2493-21unixbench_multi19:45:290
2542599325,14cyclictest14063-21munin-run21:45:000
25425993214,6cyclictest20682-21ntp_states22:00:250
2542599321,19cyclictest13779-21diskstats00:35:150
2542599321,18cyclictest31744-21irqstats22:30:200
2542599321,16cyclictest5790-21cron00:15:000
2542699317,13cyclictest22-21ksoftirqd/120:05:121
2542699316,13cyclictest81rcu_preempt22:40:261
2542699316,13cyclictest81rcu_preempt22:40:251
2542699315,4cyclictest81rcu_preempt23:34:101
2542699311,4cyclictest81rcu_preempt23:25:281
25426993110,8cyclictest199572chrt20:34:131
2542599316,12cyclictest0-21swapper/000:00:180
2542599312,24cyclictest27856-21ntp_states23:45:250
25425993112,5cyclictest20792-21taskset20:35:180
2542599311,18cyclictest3342-21cut21:15:160
2542599311,12cyclictest3286-21runrttasks00:17:190
193232311,4sleep119324-21cron23:25:001
272882301,5sleep10-21swapper/120:52:101
2542699307,4cyclictest81rcu_preempt22:09:411
2542699304,4cyclictest81rcu_preempt23:09:161
25426993021,5cyclictest10517-21tr21:35:121
25426993017,8cyclictest22385-21diskstats20:40:141
25426993012,6cyclictest2225-21dbus-daemon21:34:261
25426993011,6cyclictest11209-21cat23:00:271
2542599302,24cyclictest18242-21df21:55:130
2542599302,15cyclictest13494-21ntp_states20:15:250
2542599302,14cyclictest18312-21python00:45:280
25425993013,5cyclictest22689-21/usr/sbin/munin20:40:190
25425993012,6cyclictest16299-21/usr/sbin/munin23:15:200
2542599301,20cyclictest0-21swapper/023:30:110
2542599301,18cyclictest24950-21seq22:11:100
2542599301,15cyclictest3286-21runrttasks21:25:170
2542599301,12cyclictest26455-21kernelversion20:50:200
252102301,5sleep10-21swapper/122:13:551
269332291,5sleep00-21swapper/022:17:130
268792291,5sleep10-21swapper/122:16:431
2542699298,8cyclictest2221-21cron20:00:001
25426992919,6cyclictest566-21grep19:40:291
2542699291,4cyclictest81rcu_preempt22:25:061
2542699291,4cyclictest81rcu_preempt21:55:221
2542699291,4cyclictest81rcu_preempt20:45:101
25426992912,5cyclictest40250irq/92-i91522:00:141
2542699291,19cyclictest0-21swapper/119:36:421
2542599292,14cyclictest8492-21diskstats22:55:160
2542599292,14cyclictest30529-21users22:25:310
2542599292,14cyclictest14813-21irqstats21:45:220
2542599292,13cyclictest9819-21users21:30:300
2542599292,13cyclictest1753-21ntp_states21:10:260
2542599292,13cyclictest1753-21ntp_states21:10:250
2542599291,4cyclictest81rcu_preempt00:24:410
25425992911,6cyclictest11565-21gdbus19:50:300
25425992911,6cyclictest11565-21gdbus19:50:300
25425992911,5cyclictest9601-21memory20:05:220
2542599291,15cyclictest6614-21diskstats22:50:140
2542599291,15cyclictest5814-21mailstats21:20:270
2542599291,15cyclictest16808-21fschecks_count20:25:170
2542599291,14cyclictest5806-21latency19:55:200
2542599291,14cyclictest27840-21tune2fs19:30:040
2542599291,14cyclictest20097-21/usr/sbin/munin23:25:220
25425992910,7cyclictest3286-21runrttasks22:22:380
25425992910,5cyclictest19760-21/usr/sbin/munin00:50:180
189772291,5sleep00-21swapper/023:21:200
154642291,5sleep00-21swapper/023:14:030
131632291,5sleep10-21swapper/100:33:241
82712281,5sleep10-21swapper/121:28:451
42252281,5sleep10-21swapper/121:15:561
309792281,5sleep10-21swapper/121:01:211
294092281,5sleep10-21swapper/120:59:451
290902281,5sleep10-21swapper/122:24:571
2542699283,13cyclictest0-21swapper/122:45:141
25426992819,6cyclictest15931-21sh21:50:011
25426992819,5cyclictest6007-21grep21:20:301
25426992813,4cyclictest81rcu_preempt22:30:111
2542699280,4cyclictest81rcu_preempt00:25:021
2542599286,5cyclictest11565-21gdbus22:40:120
2542599286,5cyclictest11565-21gdbus22:40:120
2542599282,13cyclictest22030-21diskstats22:05:140
2542599282,12cyclictest11073-21df20:10:130
25425992811,5cyclictest11896-21df_inode00:30:140
2542599281,14cyclictest14879-21/usr/sbin/munin20:20:140
25425992810,5cyclictest4565-21grep22:45:130
25425992810,5cyclictest3443-21sed00:05:300
249472281,5sleep10-21swapper/123:39:571
200202281,5sleep00-21swapper/020:34:560
76492271,5sleep10-21swapper/122:51:031
72342271,5sleep10-21swapper/100:15:331
2542699273,18cyclictest31377-21iostat_ios23:55:231
2542699272,12cyclictest0-21swapper/122:55:261
2542699271,4cyclictest81rcu_preempt19:51:031
2542699271,4cyclictest81rcu_preempt19:51:021
2542699271,22cyclictest4829-21grep00:10:211
2542599271,14cyclictest409-21python19:40:280
2542599271,14cyclictest16262-21/usr/sbin/munin21:50:120
216882271,5sleep10-21swapper/120:37:461
21212271,5sleep10-21swapper/122:38:181
178102271,5sleep10-21swapper/120:26:261
175722271,5sleep10-21swapper/121:52:421
153862273,4sleep10-21swapper/123:13:131
2542699261,4cyclictest81rcu_preempt00:40:521
2542699261,23cyclictest0-21swapper/100:35:191
25426992610,12cyclictest3297-21wc00:05:291
2542599269,5cyclictest11216-21grep23:00:270
2542599268,6cyclictest24565-21/usr/sbin/munin20:45:200
2542599261,13cyclictest28544-21/usr/sbin/munin20:55:220
2542699251,10cyclictest32304-21awk21:05:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional