You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 13:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Sep 18, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316139911511113,22cyclictest32038-21df19:25:140
316149911401119,17cyclictest0-21swapper/119:25:121
311352515415,33sleep00-21swapper/019:20:340
304482468373,31sleep10-21swapper/119:20:201
1671521020,9sleep13161499cyclictest00:25:241
78142680,3sleep00-21swapper/022:35:290
215652451,32sleep121609-21aten_r4power_en00:40:111
187492440,9sleep13161499cyclictest23:05:191
3161399411,19cyclictest15449-21fschecks_count20:05:160
3161399366,5cyclictest81rcu_preempt22:45:000
3161399354,14cyclictest2225-21dbus-daemon20:27:080
3161399352,21cyclictest12976-21ntp_states00:15:260
3161499341,13cyclictest4466-21munin-run23:55:001
3161399349,12cyclictest26223-21latency_hist20:35:000
3161399341,20cyclictest20840-21grep23:10:240
31613993410,12cyclictest3286-21runrttasks23:25:260
64972331,28sleep06500-21watchsnmpd22:33:000
3161399338,12cyclictest31686-21aten_r4power_cu22:15:110
3161399338,11cyclictest27206-21unixbench_multi22:00:300
31614993212,12cyclictest22-21ksoftirqd/122:00:511
3161399327,12cyclictest0-21swapper/022:15:000
3161399325,4cyclictest81rcu_preempt22:46:000
3161399321,19cyclictest21033-21taskset00:36:240
31613993211,6cyclictest5521-21cron19:40:000
31613993211,6cyclictest17402sendmail_mailtr23:45:270
3161399321,14cyclictest8477-21/usr/sbin/munin21:10:300
58802311,26sleep15987-21df19:40:141
3161499317,4cyclictest81rcu_preempt22:34:001
3161499315,4cyclictest81rcu_preempt20:46:181
3161499314,4cyclictest81rcu_preempt22:57:211
31614993115,4cyclictest22-21ksoftirqd/122:51:391
3161499311,4cyclictest22-21ksoftirqd/121:11:561
3161399312,15cyclictest4453-21cron23:54:590
144802311,4sleep011565-21gdbus21:29:000
144802311,4sleep011565-21gdbus21:28:590
97562301,25sleep011565-21gdbus00:06:280
3161499307,4cyclictest81rcu_preempt22:14:201
3161499306,4cyclictest81rcu_preempt00:05:231
3161499305,4cyclictest81rcu_preempt22:24:271
31614993023,4cyclictest21126-21needreboot21:45:221
3161499302,15cyclictest15030-21df_inode21:30:131
3161499301,11cyclictest12869-21/usr/sbin/munin21:25:141
3161499301,11cyclictest12869-21/usr/sbin/munin21:25:141
3161399307,14cyclictest0-21swapper/021:19:170
3161399307,12cyclictest40250irq/92-i91500:10:240
3161399306,12cyclictest0-21swapper/000:50:230
3161399302,15cyclictest16911-21df_inode21:35:140
3161399302,15cyclictest0-21swapper/023:37:470
3161399302,14cyclictest2441-21iostat_ios19:30:190
3161399302,14cyclictest22734-21ntp_states23:15:240
3161399302,14cyclictest15573-21ntp_states21:30:230
3161399302,13cyclictest17849-21runrttasks23:03:350
31613993016,8cyclictest14340-21diskstats00:20:170
31613993012,6cyclictest23507-21aten_r4power_en00:45:110
31613993012,5cyclictest2401-21NetworkManager20:45:130
3161399301,15cyclictest7739-21/usr/sbin/munin19:45:120
31613993011,5cyclictest3286-21runrttasks00:25:280
31613993010,8cyclictest381-21cron23:43:000
232782301,5sleep00-21swapper/000:44:590
198722301,5sleep00-21swapper/021:41:190
17392300,3sleep11740-21sendmail_mailtr23:45:271
118542301,5sleep10-21swapper/100:13:451
81452291,5sleep00-21swapper/000:04:100
3161499297,13cyclictest81rcu_preempt22:25:161
3161499295,4cyclictest81rcu_preempt20:43:591
3161499294,4cyclictest81rcu_preempt21:02:181
3161499293,17cyclictest0-21swapper/100:32:591
3161499292,22cyclictest32627-21iostat_ios20:50:211
3161499291,4cyclictest81rcu_preempt23:44:061
3161499291,4cyclictest81rcu_preempt22:45:291
3161499291,4cyclictest81rcu_preempt00:38:521
3161499291,4cyclictest81rcu_preempt00:03:541
31614992913,5cyclictest5277-21latency23:55:221
31614992913,5cyclictest40250irq/92-i91523:25:151
31614992913,4cyclictest81rcu_preempt21:40:131
31614992911,5cyclictest11173-21latency_hist19:55:011
31614992911,14cyclictest32639-21mailstats22:15:281
3161399295,12cyclictest29628-21cron22:09:590
3161399292,14cyclictest1944-21hddtemp_smartct20:55:160
3161399292,13cyclictest3951-21hddtemp_smartct21:00:180
3161399292,12cyclictest32327-21/usr/sbin/munin20:50:140
3161399292,12cyclictest11565-21gdbus21:56:440
3161399291,4cyclictest81rcu_preempt23:22:140
3161399291,4cyclictest81rcu_preempt22:56:180
3161399291,4cyclictest81rcu_preempt20:18:500
3161399291,15cyclictest5859-21/usr/sbin/munin21:05:180
3161399291,13cyclictest23476-21/usr/sbin/munin21:50:280
3161399291,12cyclictest18229-21aten_r4power_po23:05:110
30892291,5sleep00-21swapper/022:25:060
288502291,5sleep00-21swapper/023:30:450
220312291,5sleep00-21swapper/021:49:140
206302291,5sleep10-21swapper/123:10:211
194412291,5sleep00-21swapper/000:34:210
147002291,5sleep10-21swapper/120:02:331
138252291,5sleep10-21swapper/100:19:421
133882291,5sleep00-21swapper/020:00:130
126952291,5sleep00-21swapper/021:24:560
108432291,5sleep00-21swapper/019:51:420
95842281,5sleep10-21swapper/122:40:271
81922281,5sleep10-21swapper/122:36:071
3161499286,4cyclictest81rcu_preempt00:47:261
3161499285,4cyclictest81rcu_preempt19:31:581
3161499285,3cyclictest81rcu_preempt00:54:301
3161499285,12cyclictest40250irq/92-i91519:55:151
3161499284,9cyclictest22924-21diskstats20:25:151
3161499284,4cyclictest81rcu_preempt23:16:371
3161499284,15cyclictest0-21swapper/121:59:581
3161499282,14cyclictest14340-21diskstats00:20:161
3161499282,12cyclictest29644-21munin-run22:10:011
3161499282,10cyclictest3286-21runrttasks23:33:191
3161499281,6cyclictest5541-21turbostat.cron19:40:001
31614992813,4cyclictest40250irq/92-i91521:24:501
3161499281,14cyclictest17541-21users23:00:321
3161499281,14cyclictest0-21swapper/120:35:011
3161399282,14cyclictest21355-21irqstats20:20:200
3161399282,13cyclictest17485-21http_loadtime20:10:170
31613992811,5cyclictest29693-21cron20:42:000
3161399281,14cyclictest5296-21sed23:55:220
3161399281,14cyclictest1304-21tr22:20:120
3161399281,13cyclictest26404-21wget20:35:120
31252281,4sleep10-21swapper/120:58:351
277172281,5sleep10-21swapper/120:36:081
251602281,5sleep10-21swapper/123:21:211
238392281,5sleep10-21swapper/121:53:341
221592281,5sleep10-21swapper/120:21:501
183052281,5sleep10-21swapper/120:11:021
125062281,5sleep00-21swapper/022:50:110
88742271,5sleep10-21swapper/119:45:441
3161499278,15cyclictest0-21swapper/123:35:291
3161499274,3cyclictest81rcu_preempt21:39:071
3161499271,12cyclictest6542-21sed21:05:291
3161399279,5cyclictest5733-21aten_r4power_en19:40:120
3161399272,13cyclictest11629-21diskstats19:55:140
1961922711,4sleep122-21ksoftirqd/120:15:241
164542271,5sleep10-21swapper/120:06:171
3161499262,9cyclictest3286-21runrttasks21:18:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional