You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 18:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Thu Jul 30, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47969911931145,36cyclictest6691-21latency_hist07:30:011
47969911931145,36cyclictest6691-21latency_hist07:30:011
45362564518,31sleep10-21swapper/107:22:531
43262456361,30sleep00-21swapper/007:20:400
479599189151,32cyclictest6671-21pidof07:30:010
479599189151,32cyclictest6671-21pidof07:30:010
205621190,4sleep00-21swapper/008:37:000
265842750,5sleep126583-21sshd08:17:391
103782580,2sleep010377-21awk07:35:270
479599451,23cyclictest26929-21sshd08:18:000
479599412,21cyclictest0-21swapper/010:01:460
479599411,21cyclictest15456-21fschecks_time07:50:140
479599411,20cyclictest21357-21udevd09:29:410
4796994013,13cyclictest3286-21runrttasks10:49:371
479599407,12cyclictest0-21swapper/012:00:130
479599402,16cyclictest0-21swapper/010:06:040
479699382,22cyclictest6689-21diskstats08:50:151
479599383,13cyclictest0-21swapper/011:45:200
479599379,7cyclictest11670-21grep11:55:120
479599372,16cyclictest13446-21df07:45:130
479699369,8cyclictest2225-21dbus-daemon12:42:521
479599365,20cyclictest22455-21taskset12:23:200
4795993612,7cyclictest7231-21/usr/sbin/munin08:50:270
479599361,16cyclictest26324-21/usr/sbin/munin09:40:260
479599352,5cyclictest2401-21NetworkManager09:36:300
479599351,6cyclictest31822-21/usr/sbin/munin08:30:220
479599351,6cyclictest27180-21/usr/sbin/munin11:10:120
479599351,6cyclictest11564-21packagekitd11:00:220
4795993512,6cyclictest19820-21python08:00:270
479599351,19cyclictest3630-21taskset11:33:210
43162351,30sleep04329-21aten_r4power_cu10:10:110
220652351,4sleep022111-21/usr/sbin/munin09:30:200
479699343,14cyclictest7019-21ntp_states10:15:241
4796993412,8cyclictest1974-21lldpad09:24:321
4796993411,4cyclictest40250irq/92-i91511:55:121
479599345,9cyclictest3286-21runrttasks09:18:560
479599342,5cyclictest30491-21/usr/sbin/munin12:45:110
479599341,6cyclictest9278-21chrt08:55:280
479599341,6cyclictest30134-21/usr/sbin/munin08:25:210
479599341,6cyclictest23277-21/usr/sbin/munin08:10:190
479599341,6cyclictest12310-21fschecks_time10:30:150
479599341,5cyclictest32500-21/usr/sbin/munin12:50:130
479599341,5cyclictest23435-21/usr/sbin/munin12:25:190
479599341,16cyclictest21463-21expr10:55:100
479599341,15cyclictest10216-21/usr/sbin/munin11:50:220
479599341,15cyclictest10216-21/usr/sbin/munin11:50:220
4796993310,5cyclictest40250irq/92-i91509:30:131
479599339,5cyclictest29131-21taskset09:50:070
479599338,6cyclictest19501-21/usr/sbin/munin12:15:160
479599338,5cyclictest13453-21chrt09:06:560
479599337,6cyclictest11478-21tr07:40:110
479599333,16cyclictest0-21swapper/011:24:220
479599332,13cyclictest28483-21wget12:40:110
479599331,5cyclictest17967-21ntp_states12:10:250
479599331,14cyclictest16698-21taskset12:07:120
479599331,13cyclictest4803-21df08:45:150
221002331,28sleep12401-21NetworkManager10:55:241
479699322,8cyclictest16210-21iostat10:40:171
479699322,10cyclictest8076-21irqstats07:30:201
479699322,10cyclictest8076-21irqstats07:30:191
4796993212,4cyclictest40250irq/92-i91507:51:401
479599326,11cyclictest0-21swapper/010:16:280
479599323,16cyclictest0-21swapper/011:08:470
479599323,16cyclictest0-21swapper/007:55:470
479599322,13cyclictest20454-21wc10:50:300
479599321,5cyclictest1137-21switchtime11:25:280
479599321,12cyclictest2908-21df08:40:140
244652321,5sleep10-21swapper/112:29:461
104332321,4sleep010447-21df_inode09:00:110
479699319,8cyclictest4793-21cyclictest08:27:221
479699318,8cyclictest31154-21ntpq12:45:241
479699318,8cyclictest22-21ksoftirqd/109:27:241
479699317,5cyclictest40250irq/92-i91508:35:021
479699313,5cyclictest28272-21munin-run12:40:001
479699312,8cyclictest23360-21/usr/sbin/munin11:00:111
479599318,10cyclictest0-21swapper/011:35:070
479599313,17cyclictest0-21swapper/007:31:470
479599313,17cyclictest0-21swapper/007:31:470
479599313,16cyclictest0-21swapper/011:42:190
479599311,6cyclictest27558-21diskstats09:45:170
479599311,14cyclictest26575-21aten_r4power_en12:35:090
479599311,13cyclictest22217-21sh08:06:000
479599311,13cyclictest14724-21basename10:35:280
479599311,12cyclictest25951-21chrt12:30:410
299562311,3sleep129966-21ntp_states09:50:251
479699308,5cyclictest40250irq/92-i91509:40:161
479699307,5cyclictest40250irq/92-i91510:35:271
479699307,5cyclictest40250irq/92-i91510:10:221
479699305,5cyclictest40250irq/92-i91511:50:001
479699302,14cyclictest27553-21df_inode09:45:171
479599305,17cyclictest10261-21diskstats10:25:120
479599301,5cyclictest18857-21chrt10:46:230
479599301,12cyclictest31576-21if_eth009:55:180
250552301,4sleep10-21swapper/109:38:361
479699297,5cyclictest40250irq/92-i91508:20:201
479699297,4cyclictest40250irq/92-i91507:35:111
479699296,7cyclictest8754-21cut08:55:171
479699295,5cyclictest40250irq/92-i91510:00:201
479699292,8cyclictest8925-21ntp_states10:20:241
479699292,8cyclictest8925-21ntp_states10:20:241
479699292,14cyclictest10761-21irqstats09:00:181
479699292,13cyclictest4552-21iostat_ios11:35:181
479699292,13cyclictest29601-21ntp_states11:15:251
479699292,13cyclictest2487-21hddtemp_smartct11:30:181
479699291,9cyclictest31582-21if_eth009:55:191
479699291,8cyclictest26314-21taskset11:05:451
479699291,14cyclictest16484-21memory09:15:211
479699291,14cyclictest0-21swapper/110:30:041
479599291,5cyclictest8386-21df_inode10:20:140
479599291,5cyclictest8386-21df_inode10:20:130
479599291,15cyclictest0-21swapper/011:15:580
190232291,5sleep00-21swapper/009:21:010
183422291,5sleep10-21swapper/107:57:061
110782291,5sleep10-21swapper/111:52:331
110782291,5sleep10-21swapper/111:52:321
479699288,5cyclictest40250irq/92-i91511:27:461
479699287,7cyclictest0-21swapper/108:04:421
479699286,8cyclictest22-21ksoftirqd/109:11:001
479699286,8cyclictest22-21ksoftirqd/109:09:341
479699286,5cyclictest17883-21needreboot12:10:231
479699282,8cyclictest3463-21ntp_states08:40:251
479699282,8cyclictest25920-21users12:30:311
479699282,8cyclictest14972-21sshd12:03:481
479699282,13cyclictest19501-21hddtemp_smartct12:15:151
479699282,12cyclictest5345-21ntp_states08:45:261
479699281,7cyclictest20476-21cat10:50:311
169782281,5sleep00-21swapper/010:41:210
154132281,5sleep00-21swapper/009:12:460
145352281,5sleep10-21swapper/107:46:301
479699275,8cyclictest22-21ksoftirqd/112:22:261
479699273,6cyclictest10962-21mailstats10:25:261
479699273,5cyclictest40250irq/92-i91507:40:121
479699271,9cyclictest31768-21cat11:20:261
479699271,8cyclictest3114-21memory10:05:211
4796992716,7cyclictest2225-21dbus-daemon08:05:121
479699271,13cyclictest6449-21iostat11:40:191
479699271,13cyclictest27724-21ntp_states11:10:241
479699271,13cyclictest15548-21df_inode12:05:141
324922271,5sleep10-21swapper/108:30:381
479699261,7cyclictest32500-21df_inode12:50:131
479599262,6cyclictest28056-21/usr/sbin/munin08:20:200
479699247,6cyclictest40250irq/92-i91508:10:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional