You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 17:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Aug 01, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319479912501,2cyclictest13702-21kworker/0:207:29:230
317782587541,31sleep00-21swapper/007:23:480
316292531486,29sleep10-21swapper/107:22:121
3194899113104,6cyclictest0-21swapper/107:29:221
80002730,4sleep08001-21aten_r4power_cu07:45:110
25202480,5sleep12195-21/usr/sbin/munin07:30:171
143432400,8sleep03194799cyclictest09:25:260
3194899363,7cyclictest3286-21runrttasks08:32:281
31947993614,7cyclictest25076-21python12:45:290
3194799361,22cyclictest28941-21/usr/sbin/munin10:05:160
31947993510,12cyclictest26235-21cat11:25:010
3194899342,7cyclictest19134-21aten_r4power_en09:40:101
3194799342,16cyclictest21635-21python11:10:300
120122341,3sleep00-21swapper/007:55:120
3194799335,5cyclictest81rcu_preempt10:50:310
3194799331,20cyclictest6847-21taskset11:59:150
3194799331,11cyclictest81rcu_preempt08:19:450
316962331,12sleep10-21swapper/110:11:001
130932331,29sleep113096-21watchsnmpd09:23:001
3194899321,7cyclictest28497-21/usr/sbin/munin10:05:271
31948993215,13cyclictest14014-21vmstat12:15:321
31948993213,4cyclictest137032kernelversion10:50:221
3194899321,17cyclictest6410-21/usr/sbin/munin07:40:181
37402311,5sleep10-21swapper/108:58:461
3194899316,4cyclictest81rcu_preempt10:22:381
3194899314,12cyclictest11457-21iostat_ios12:10:211
31948993123,5cyclictest7832-21aten_r4power_cu09:10:101
31947993112,6cyclictest2755-21python10:20:310
3194799311,19cyclictest27552-21iostat08:35:190
31947993111,6cyclictest2765-21memory08:55:230
3194799311,15cyclictest26154-21sshd09:57:020
274652318,9sleep122-21ksoftirqd/112:53:071
192842311,4sleep119334-21iostat11:05:201
183812311,5sleep10-21swapper/112:30:071
183812311,5sleep10-21swapper/112:30:071
93952301,5sleep00-21swapper/009:13:470
3194899309,8cyclictest11565-21gdbus10:46:081
3194899305,4cyclictest81rcu_preempt10:04:091
3194899305,4cyclictest81rcu_preempt07:36:071
3194799308,5cyclictest0-21swapper/010:11:230
3194799305,3cyclictest81rcu_preempt08:50:100
3194799304,4cyclictest81rcu_preempt09:35:140
31947993021,6cyclictest25895-21ntpdc08:30:240
3194799302,15cyclictest15263-21df_inode10:55:170
31947993011,5cyclictest23134-21df09:50:130
3194799301,15cyclictest19105-21/usr/sbin/munin09:40:110
31062301,5sleep10-21swapper/111:49:301
181612301,5sleep10-21swapper/111:00:431
149812301,5sleep10-21swapper/108:00:311
89402291,5sleep00-21swapper/010:37:480
75002291,5sleep00-21swapper/007:41:490
3194899297,8cyclictest0-21swapper/112:25:141
3194899296,12cyclictest40250irq/92-i91509:50:141
3194899295,4cyclictest81rcu_preempt11:57:541
3194899295,4cyclictest81rcu_preempt11:11:441
3194899295,4cyclictest81rcu_preempt10:41:001
3194899295,4cyclictest81rcu_preempt07:51:501
3194899294,9cyclictest32552-21diskstats10:15:151
3194899291,7cyclictest9680-21/usr/sbin/munin09:15:271
3194899291,7cyclictest30003-21sshd11:35:021
31948992915,11cyclictest22-21ksoftirqd/108:40:121
3194899291,4cyclictest81rcu_preempt09:38:101
3194899291,4cyclictest81rcu_preempt08:10:531
3194899291,26cyclictest0-21swapper/108:23:061
3194799299,5cyclictest11748-21cron07:54:590
3194799292,15cyclictest0-21swapper/009:01:190
3194799292,13cyclictest29452-21iostat_ios08:40:200
3194799291,6cyclictest4674-21cut07:35:160
31947992914,11cyclictest8818-21cron12:05:000
31947992912,5cyclictest27455-21ntp_states10:00:260
31947992910,7cyclictest18518-21taskset11:04:240
31947992910,6cyclictest11501-21df_inode10:45:130
31947992910,5cyclictest23636-21fschecks_time08:25:170
3194799290,4cyclictest81rcu_preempt09:20:490
297302291,5sleep00-21swapper/011:33:460
173062291,5sleep10-21swapper/108:09:021
9002281,5sleep00-21swapper/011:42:110
323902281,4sleep10-21swapper/108:49:231
3194899285,4cyclictest81rcu_preempt10:38:251
3194899285,4cyclictest81rcu_preempt08:35:341
3194899283,4cyclictest81rcu_preempt12:22:501
3194899283,10cyclictest32216-21diskstats11:40:151
3194899283,10cyclictest23092-21irqstats11:15:201
3194899281,4cyclictest81rcu_preempt08:53:311
3194899281,4cyclictest81rcu_preempt07:49:181
3194899281,14cyclictest15802-21ntp_states10:55:271
31948992810,7cyclictest22-21ksoftirqd/109:05:261
3194799285,12cyclictest9341-21/usr/sbin/munin10:40:130
3194799282,13cyclictest6217-21diskstats09:05:140
3194799282,13cyclictest16379-21memory08:05:230
31947992817,7cyclictest11565-21gdbus09:45:160
31947992812,12cyclictest944-21sort10:15:290
31947992811,5cyclictest22352-21python08:20:260
3194799281,14cyclictest26420-21/usr/sbin/munin11:25:120
3194799281,14cyclictest10553-21chrt12:08:330
31947992811,4cyclictest0-21swapper/007:30:270
31947992810,5cyclictest5401-21cron10:30:000
31947992810,5cyclictest4349-21python11:50:280
294842281,5sleep10-21swapper/111:31:101
278072281,4sleep10-21swapper/111:28:141
255482281,5sleep10-21swapper/112:47:421
234882281,5sleep10-21swapper/112:41:031
225472281,5sleep10-21swapper/109:48:341
167852281,5sleep10-21swapper/109:32:211
153052281,5sleep00-21swapper/008:02:460
133972281,5sleep10-21swapper/107:57:381
83962271,5sleep10-21swapper/112:00:401
68712271,5sleep10-21swapper/110:30:481
50342271,5sleep10-21swapper/111:54:571
3194899276,4cyclictest81rcu_preempt12:06:441
3194899276,4cyclictest81rcu_preempt08:16:311
3194899275,4cyclictest81rcu_preempt12:39:191
3194899274,4cyclictest81rcu_preempt09:26:371
3194899274,14cyclictest0-21swapper/109:57:551
3194899271,5cyclictest81rcu_preempt10:25:301
31948992712,4cyclictest22-21ksoftirqd/108:29:021
3194799279,5cyclictest20628-21fschecks_count12:35:160
3194799277,4cyclictest5574-21aten_r4power_cu10:30:110
3194799275,6cyclictest22637-21fschecks_time12:40:170
3194799274,17cyclictest26532-21iostat_ios12:50:200
3194799273,4cyclictest81rcu_preempt11:16:330
31947992711,4cyclictest0-21swapper/008:10:130
3194799271,13cyclictest2225-21dbus-daemon12:22:540
31947992710,5cyclictest10858-21taskset12:10:110
13392271,5sleep00-21swapper/011:45:120
3194899261,13cyclictest26195-21sed11:25:021
3194799265,11cyclictest19831-21timerandwakeup11:05:300
3194799262,11cyclictest0-21swapper/012:15:220
31947992618,4cyclictest31859-21timerwakeupswit08:45:280
31947992614,7cyclictest15619-21df_inode09:30:140
3194799261,13cyclictest16647-21cpu12:25:130
31948992519,4cyclictest40250irq/92-i91509:00:131
3194799258,4cyclictest0-21swapper/009:15:170
3194799251,5cyclictest30306-21taskset11:35:140
31947992512,10cyclictest18495-21aten_r4power_vo12:30:130
31947992512,10cyclictest18495-21aten_r4power_vo12:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional