You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 22:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Mon May 04, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
72879912121165,28cyclictest29799-21ntp_states09:25:241
72879911661141,21cyclictest0-21swapper/107:25:121
72879911661141,21cyclictest0-21swapper/107:25:121
70562678633,30sleep10-21swapper/107:23:101
70302502457,29sleep00-21swapper/007:22:560
728699193173,17cyclictest29804-21ssh09:25:240
728699170150,15cyclictest0-21swapper/007:25:120
728699170150,15cyclictest0-21swapper/007:25:110
36582690,7sleep0728699cyclictest09:32:520
295112690,3sleep00-21swapper/008:20:180
7286994418,5cyclictest832-21grep12:00:010
728699431,21cyclictest27466-21ssh11:15:180
206362430,3sleep1201rcuc/111:45:011
7287994215,6cyclictest22-21ksoftirqd/109:20:151
7287994214,6cyclictest22-21ksoftirqd/109:35:151
7287994214,6cyclictest22-21ksoftirqd/109:35:151
99532411,33sleep12225-21dbus-daemon11:31:241
728699418,7cyclictest11565-21gdbus10:57:340
22342410,5sleep0728699cyclictest10:09:060
7287994015,6cyclictest22-21ksoftirqd/112:11:281
7287993918,7cyclictest22-21ksoftirqd/110:04:421
7287993917,8cyclictest22-21ksoftirqd/112:26:451
7287993917,6cyclictest22-21ksoftirqd/110:20:251
7287993916,7cyclictest22-21ksoftirqd/109:05:231
7287993914,10cyclictest22-21ksoftirqd/112:05:141
7287993913,6cyclictest22-21ksoftirqd/110:47:091
7286993913,6cyclictest21170-21df_inode11:45:130
7287993815,8cyclictest22-21ksoftirqd/107:59:561
7287993813,6cyclictest22-21ksoftirqd/112:04:491
728699381,14cyclictest22047-21taskset09:16:300
7286993810,6cyclictest23365-21/usr/sbin/munin09:55:240
281702381,33sleep128180-21ssh10:38:571
7287993716,7cyclictest22-21ksoftirqd/110:28:201
7287993716,7cyclictest22-21ksoftirqd/108:39:291
7287993716,6cyclictest22-21ksoftirqd/112:45:441
7287993716,6cyclictest22-21ksoftirqd/112:15:251
7287993716,6cyclictest22-21ksoftirqd/111:23:241
7287993715,7cyclictest22-21ksoftirqd/111:56:461
7287993713,6cyclictest22-21ksoftirqd/112:33:351
7287993713,11cyclictest28953-21ssh11:16:331
7287993712,7cyclictest22-21ksoftirqd/111:35:231
728799371,16cyclictest3442-21/usr/sbin/munin10:10:161
728799371,16cyclictest3442-21/usr/sbin/munin10:10:151
728699373,18cyclictest0-21swapper/012:06:450
728699373,13cyclictest0-21swapper/011:06:310
728699372,6cyclictest27100-21df10:00:130
728699371,6cyclictest16741-21/usr/sbin/munin10:25:190
728699371,20cyclictest683-21latency_hist10:45:010
230962371,4sleep011565-21gdbus08:03:560
7287993616,7cyclictest22-21ksoftirqd/111:05:071
7287993616,6cyclictest22-21ksoftirqd/110:05:101
7287993615,7cyclictest22-21ksoftirqd/111:14:321
7287993615,7cyclictest22-21ksoftirqd/110:50:491
7287993615,7cyclictest22-21ksoftirqd/110:33:511
7287993615,7cyclictest22-21ksoftirqd/108:33:261
7287993614,6cyclictest22-21ksoftirqd/110:55:231
7287993612,13cyclictest22-21ksoftirqd/109:47:411
7287993610,6cyclictest0-21swapper/112:40:261
728699369,7cyclictest18848-21memory12:20:210
728699369,6cyclictest24752-21ssh11:11:440
728699362,6cyclictest3401-21/usr/sbin/munin08:35:270
728699362,13cyclictest28797-21munin-run10:40:010
728699361,8cyclictest12301-21aten_r4power_po11:35:120
728699361,6cyclictest8020-21munin-node11:30:110
728699361,6cyclictest5651-21df_inode10:50:130
7286993612,5cyclictest15203-21taskset09:08:480
728699361,19cyclictest5683-21taskset08:42:380
7286993611,6cyclictest14515-21irqstats09:45:210
728699361,15cyclictest31845-21/usr/sbin/munin08:25:260
200952361,3sleep120101-21ssh09:51:221
170152361,31sleep017111-21/usr/sbin/munin07:45:310
728799352,12cyclictest0-21swapper/108:16:281
7287993515,6cyclictest22-21ksoftirqd/111:46:311
7287993514,7cyclictest22-21ksoftirqd/112:36:121
7287993514,7cyclictest22-21ksoftirqd/107:45:581
7287993514,6cyclictest22-21ksoftirqd/112:20:111
7287993514,6cyclictest22-21ksoftirqd/111:25:421
7287993514,6cyclictest22-21ksoftirqd/111:00:031
7287993514,6cyclictest22-21ksoftirqd/109:40:381
7287993514,6cyclictest22-21ksoftirqd/109:18:451
7287993513,7cyclictest22-21ksoftirqd/107:44:371
7287993513,6cyclictest22-21ksoftirqd/111:52:041
7287993512,8cyclictest12784-21/usr/sbin/munin07:35:271
728799351,14cyclictest11409-21runrttasks07:32:121
728699359,6cyclictest8578-21seq12:45:590
728699352,6cyclictest25098-21munin-run08:10:010
728699351,7cyclictest21808-21ssh09:54:180
7286993512,6cyclictest14978-21/usr/sbin/munin11:00:250
728699351,14cyclictest5873-21ssh12:43:500
728699351,14cyclictest3286-21runrttasks10:48:040
728699351,13cyclictest7930-21cut10:15:170
728699351,13cyclictest7167-21ls08:45:290
7287993414,6cyclictest22-21ksoftirqd/109:55:381
7287993414,6cyclictest22-21ksoftirqd/109:00:181
7287993413,6cyclictest22-21ksoftirqd/110:16:131
7287993413,6cyclictest22-21ksoftirqd/109:30:051
728699341,7cyclictest6128-21ssh11:27:290
728699341,6cyclictest18745-21ssh11:41:390
728699341,5cyclictest17700-21sh12:19:490
728699341,19cyclictest0-21swapper/008:15:340
728699341,14cyclictest721-21sh12:37:230
728699341,14cyclictest24818-21fschecks_count09:20:160
728699341,14cyclictest117332chrt10:20:070
728699341,13cyclictest23214-21rm10:32:500
728699341,13cyclictest12932-21chrt09:43:550
728699341,13cyclictest1182-21chrt11:22:070
7287993313,6cyclictest22-21ksoftirqd/109:10:131
728699339,6cyclictest20995-21chrt07:56:450
728699332,6cyclictest10318-21iostat12:10:190
728699332,5cyclictest9632-21seq08:54:380
728699332,14cyclictest27951-21ssh12:30:340
728699332,14cyclictest26015-21ntp_states11:50:260
728699331,6cyclictest6174-21ssh10:13:180
728699331,6cyclictest6174-21ssh10:13:180
728699331,13cyclictest6511-21awk09:35:300
728699331,13cyclictest6511-21awk09:35:290
326852331,5sleep10-21swapper/110:44:161
107622331,28sleep010797-21ntp_states07:30:250
728799329,8cyclictest22-21ksoftirqd/108:12:551
728699321,13cyclictest23068-21memory12:25:220
194652321,5sleep00-21swapper/009:14:340
728799319,8cyclictest22-21ksoftirqd/108:45:311
728799319,8cyclictest22-21ksoftirqd/107:50:061
728799311,9cyclictest8043-21basename08:50:091
728799311,11cyclictest10350-21switchtime12:50:281
7287993111,15cyclictest30890-21/usr/sbin/munin08:25:091
728699311,6cyclictest14947-21grep07:40:260
728799302,8cyclictest23970-21irqstats08:05:211
728799301,18cyclictest29834-21/usr/sbin/munin08:20:251
728799292,8cyclictest9916-21aten_r4power_vo08:55:111
728799292,14cyclictest4693-21hddtemp_smartct08:40:171
7287992910,5cyclictest0-21swapper/108:02:131
7286992919,6cyclictest1412-21cat08:30:280
105932291,5sleep00-21swapper/012:50:510
9462281,5sleep00-21swapper/012:00:020
728699282,6cyclictest25931-21memory08:10:220
728699281,6cyclictest9919-21cut08:55:100
191212281,5sleep00-21swapper/007:51:470
7286992618,5cyclictest9189-21anacron07:35:320
728699253,17cyclictest12425-21memory09:00:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional