You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 17:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Dec 07, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267859911891163,22cyclictest27126-21cpuspeed_turbos07:25:121
267859911891156,29cyclictest8128-21sendmail07:56:061
267849911791134,40cyclictest27392-21perl07:25:160
265862566517,33sleep00-21swapper/007:23:360
264382530485,30sleep10-21swapper/107:22:011
26784992561,249cyclictest0-21swapper/007:56:060
325622830,9sleep02678499cyclictest12:28:220
296732810,4sleep1201rcuc/112:25:191
26785997913,33cyclictest10139-21df12:05:141
2678599781,46cyclictest29310-21ssh10:44:481
2678599761,6cyclictest1473-21/usr/sbin/munin12:30:251
2678599751,6cyclictest21129-21cut12:50:161
2678599732,42cyclictest30944-21snmpd11:59:431
2678599731,52cyclictest31754-21/usr/sbin/munin09:00:161
2678599722,4cyclictest0-21swapper/110:59:291
2678599712,4cyclictest0-21swapper/112:00:321
2678599712,40cyclictest0-21swapper/109:59:081
2678599711,5cyclictest21203-21rt-features10:35:291
2678599711,34cyclictest28852-21pidof12:25:001
2678599701,6cyclictest2124-21/usr/sbin/munin10:50:121
2678599701,5cyclictest32761-21chrt07:36:301
2678599701,39cyclictest2489-21diskmemload09:39:041
2678599699,34cyclictest14345-21runrttasks11:02:001
2678599692,4cyclictest0-21swapper/111:06:451
2678599692,4cyclictest0-21swapper/110:21:491
2678599692,4cyclictest0-21swapper/110:15:241
2678599692,45cyclictest5592-21ssh11:26:171
2678599691,7cyclictest17086-21chrt12:11:571
26785996910,36cyclictest0-21swapper/110:25:291
2678599661,7cyclictest23310-21sh12:19:001
2678599661,7cyclictest11787-21chrt11:33:171
2678599661,5cyclictest12286-21ssh09:53:031
2678599642,4cyclictest0-21swapper/110:47:431
2678599641,5cyclictest31709-21hostname11:20:181
2678599641,44cyclictest14226-21ssh09:20:541
2678599641,43cyclictest21379-21ssh09:29:161
2678599641,43cyclictest21379-21ssh09:29:161
26785996414,30cyclictest22-21ksoftirqd/107:32:581
2678599641,40cyclictest1251-21ssh09:41:101
2678599641,34cyclictest29309-21ntp_states10:10:261
261042640,2sleep026105-21rm12:21:010
2678599637,25cyclictest40950irq/93-i91508:30:151
2678599631,45cyclictest18173-21aten_r4power_vo11:40:121
2678599622,43cyclictest6565-21ssh09:13:491
2678599621,43cyclictest26378-21ssh11:15:131
2678599621,41cyclictest24689-21ssh09:32:061
2678599612,46cyclictest0-21swapper/112:42:061
2678599612,41cyclictest0-21swapper/111:39:281
2678599612,37cyclictest2489-21diskmemload12:38:581
2678599612,37cyclictest2489-21diskmemload12:38:571
2678599601,41cyclictest22865-21chrt08:35:331
2678599601,40cyclictest18856-21needreboot08:25:261
26785996012,30cyclictest22-21ksoftirqd/110:33:421
2678599598,33cyclictest42-21kswapd011:11:301
2678599598,27cyclictest40950irq/93-i91507:45:271
2678599582,4cyclictest0-21swapper/110:08:261
2678599582,4cyclictest0-21swapper/109:18:361
2678599582,38cyclictest19427-21irqstats10:00:221
2678599572,4cyclictest0-21swapper/109:48:261
2678599572,4cyclictest0-21swapper/108:24:001
2678599572,36cyclictest0-21swapper/111:53:241
2678599572,33cyclictest2058-21users09:06:011
2678599571,6cyclictest23135-21ls11:45:131
2678599569,29cyclictest307522chrt08:56:111
2678599561,5cyclictest17472-21sh12:45:321
2678599561,5cyclictest10583-21/usr/sbin/munin08:05:201
26785995610,26cyclictest6257-21seq07:53:211
2678599552,33cyclictest24060-21df08:40:151
2678599551,6cyclictest14902-21if_eth008:15:191
2678599549,27cyclictest26946-21seq08:45:401
2678599541,6cyclictest13287-21cat08:10:251
2678599537,28cyclictest40950irq/93-i91508:50:181
2678599531,6cyclictest1114-21chrt07:40:141
2678599531,5cyclictest9832-21wc08:00:301
2678499491,16cyclictest2184-21/usr/sbin/munin12:30:210
318702460,7sleep02678499cyclictest09:00:170
251802450,4sleep041ktimersoftd/011:46:440
2678499422,11cyclictest11397-21ssh09:18:480
44582400,4sleep041ktimersoftd/009:45:140
2678499405,5cyclictest0-21swapper/011:24:370
2678499371,23cyclictest24769-21ssh12:54:460
297002361,31sleep029710-21ssh09:37:230
2678499367,4cyclictest81rcu_preempt11:05:310
120062360,4sleep00-21swapper/012:06:330
26784993515,7cyclictest0-21swapper/009:14:300
7972341,29sleep0972-21expr10:15:110
2678499348,12cyclictest18955-21netstat11:40:220
2678499342,21cyclictest11123-21ssh10:59:210
2678499341,19cyclictest2348-21sh11:56:410
2678499341,13cyclictest18789-21aten_r4power_po10:00:130
155262341,29sleep015536-21ssh12:44:440
2678499336,4cyclictest81rcu_preempt09:25:260
2678499336,4cyclictest81rcu_preempt09:25:250
2678499334,4cyclictest81rcu_preempt10:10:510
2678499334,4cyclictest81rcu_preempt09:31:050
2678499333,4cyclictest81rcu_preempt09:50:340
26784993320,9cyclictest14086-21sort09:55:140
26784993318,8cyclictest2992-21iostat_ios10:50:290
2678499331,20cyclictest27288-21ntp_states11:15:280
2678499331,20cyclictest25217-21ssh11:13:520
2678499331,13cyclictest10153-21ssh10:24:560
2678499331,11cyclictest0-21swapper/012:13:430
198232331,28sleep00-21swapper/010:35:010
282752321,4sleep028294-21ssh11:50:210
2678499328,21cyclictest30782-21sh10:45:280
2678499325,4cyclictest81rcu_preempt10:35:290
2678499324,4cyclictest81rcu_preempt10:25:580
2678499323,4cyclictest81rcu_preempt11:39:550
2678499323,4cyclictest81rcu_preempt10:05:140
2678499322,26cyclictest3837-21python07:45:260
2678499322,17cyclictest0-21swapper/012:03:300
26784993213,6cyclictest14367-21ssh11:02:020
235232321,5sleep00-21swapper/008:39:240
199862321,27sleep020024-21hddtemp_smartct12:15:190
2678499313,4cyclictest81rcu_preempt10:41:010
2678499313,4cyclictest81rcu_preempt09:20:580
2678499311,8cyclictest8984-21taskset11:30:180
26784993113,6cyclictest30010-21irqstats08:55:200
26784993110,8cyclictest9286-21iostat08:00:190
2678499307,4cyclictest81rcu_preempt09:41:410
2678499304,4cyclictest81rcu_preempt11:25:140
2678499304,3cyclictest40950irq/93-i91508:15:110
2678499303,4cyclictest81rcu_preempt12:49:090
2678499302,24cyclictest28995-21users07:30:020
2678499302,13cyclictest13063-21irqstats08:10:220
2678499301,8cyclictest7447-21ps12:35:270
2678499301,8cyclictest7447-21ps12:35:260
2678499301,12cyclictest0-21swapper/008:44:140
2678499291,4cyclictest6204-21gdbus09:05:120
2678499282,14cyclictest18808-21memory08:25:240
2678499282,13cyclictest16843-21iostat_ios08:20:240
2678499282,13cyclictest12315-21munin-run08:09:590
2678499281,12cyclictest28671-21timerwakeupswit08:50:300
2678499272,13cyclictest4943-21/usr/sbin/munin07:50:170
2678499272,13cyclictest0-21swapper/007:35:570
2678499271,14cyclictest6203-21packagekitd08:49:580
2678499271,12cyclictest20936-21sendmail_mailqu08:30:260
21382271,5sleep00-21swapper/007:40:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional