You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 22:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Mar 11, 2026 12:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
286589911911181,7cyclictest0-21swapper/007:26:220
286599911371128,6cyclictest0-21swapper/107:26:391
285222554507,31sleep00-21swapper/007:24:070
283932520474,31sleep10-21swapper/107:22:501
2039621100,4sleep0111rcuc/010:32:440
2477921040,5sleep0111rcuc/011:45:000
212792990,2sleep10-21swapper/112:48:201
106052910,7sleep02865899cyclictest12:36:130
126512740,3sleep0111rcuc/012:05:180
277222440,23sleep03-21ksoftirqd/011:47:230
28659994316,6cyclictest22-21ksoftirqd/109:26:121
2865899433,34cyclictest16420-21hddtemp_smartct09:55:160
28658994321,5cyclictest3-21ksoftirqd/011:52:060
28658994315,8cyclictest7212-21ntp_states09:45:250
2865899428,31cyclictest0-21swapper/012:31:160
2865899422,12cyclictest0-21swapper/009:37:550
28658994215,9cyclictest11706-21python11:30:270
28659994116,15cyclictest22-21ksoftirqd/111:57:221
28659994115,7cyclictest22-21ksoftirqd/110:29:571
28658994115,15cyclictest3-21ksoftirqd/009:51:080
28658994114,8cyclictest19445-21ssh11:39:240
28659994016,14cyclictest22-21ksoftirqd/110:24:501
28658994015,15cyclictest3-21ksoftirqd/012:46:300
28658994014,8cyclictest1123-21df11:20:130
28659993917,6cyclictest22-21ksoftirqd/109:15:321
28659993915,14cyclictest22-21ksoftirqd/112:36:151
28659993915,14cyclictest22-21ksoftirqd/111:01:321
28659993914,15cyclictest22-21ksoftirqd/112:25:571
2865899392,9cyclictest0-21swapper/011:00:090
28658993915,7cyclictest4771-21munin-run07:45:000
2865899391,35cyclictest0-21swapper/010:27:550
275062390,4sleep0111rcuc/008:45:100
2865999385,30cyclictest0-21swapper/110:42:551
2865999385,30cyclictest0-21swapper/110:42:551
28658993814,7cyclictest1144-21perl09:00:160
28658993814,13cyclictest0-21swapper/009:21:460
28658993810,6cyclictest24319-21ssh12:51:040
2865999373,5cyclictest0-21swapper/110:49:351
28659993716,7cyclictest22-21ksoftirqd/109:14:071
2865899372,6cyclictest23377-21munin-run11:10:000
2865899372,31cyclictest29853-21hddtemp_smartct08:50:160
2865899372,14cyclictest3302-21runrttasks08:03:280
2865899371,13cyclictest4406-21diskmemload09:30:010
164272371,4sleep116503-21smartctl-wrappe11:35:281
2865899362,5cyclictest8678-21/usr/sbin/munin10:20:220
2865899362,30cyclictest0-21swapper/010:10:360
2865899362,14cyclictest0-21swapper/009:10:080
28658993617,6cyclictest3-21ksoftirqd/012:03:010
2865899361,5cyclictest25785-21cpuspeed_turbos08:40:120
28658993612,6cyclictest23188-21ntp_states10:35:250
2865899361,14cyclictest5802-21ssh10:50:280
2865899361,13cyclictest2240-21aten_r4power_po11:55:100
2865999354,13cyclictest0-21swapper/112:31:331
2865999353,29cyclictest0-21swapper/112:43:351
28659993525,6cyclictest21942-21/usr/sbin/munin12:15:131
28659993524,8cyclictest8982-21ssh09:47:221
2865999352,18cyclictest0-21swapper/110:01:331
28659993514,6cyclictest22-21ksoftirqd/112:00:121
28659993512,11cyclictest22-21ksoftirqd/111:24:481
2865899351,6cyclictest6724-21/usr/sbin/munin11:25:240
28658993514,5cyclictest0-21swapper/010:57:060
28658993512,9cyclictest81rcu_preempt11:16:590
28658993512,9cyclictest81rcu_preempt11:16:590
2865899351,13cyclictest6868-21aten_r4power_po07:50:110
139102351,5sleep00-21swapper/008:07:340
320162341,5sleep10-21swapper/109:37:551
28659993426,6cyclictest0-21swapper/110:57:351
28659993426,6cyclictest0-21swapper/110:54:551
28659993426,6cyclictest0-21swapper/108:29:351
28659993417,14cyclictest22-21ksoftirqd/111:50:151
2865999341,5cyclictest6790-21/usr/sbin/munin07:50:161
28659993414,6cyclictest22-21ksoftirqd/111:29:281
28659993411,5cyclictest30249-21processes08:50:251
2865899348,22cyclictest0-21swapper/010:07:170
2865899348,22cyclictest0-21swapper/010:07:160
2865899342,16cyclictest0-21swapper/007:55:130
2865899342,11cyclictest23709-21aten_r4power_cu08:35:110
28658993414,11cyclictest3-21ksoftirqd/010:41:390
28658993414,11cyclictest3-21ksoftirqd/010:41:380
2865899341,29cyclictest26055-21ssh11:11:560
2865899341,15cyclictest13351-21ssh09:18:550
2865899341,15cyclictest0-21swapper/012:12:100
2865899341,13cyclictest24180-21ssh09:30:110
2865899341,12cyclictest32419-21perl10:45:160
2865899341,11cyclictest17365-21sed08:15:290
2865899341,10cyclictest22625-21/usr/sbin/munin12:15:250
28658993410,6cyclictest3711-21/usr/sbin/munin10:15:200
2865999339,5cyclictest81rcu_preempt12:10:291
2865999338,5cyclictest40550irq/92-i91507:40:311
2865999335,24cyclictest0-21swapper/112:07:241
28659993326,5cyclictest0-21swapper/109:05:561
28659993325,4cyclictest0-21swapper/108:20:161
2865999331,4cyclictest25839-21ssh11:11:351
28659993314,6cyclictest22-21ksoftirqd/110:10:401
28659993313,6cyclictest22-21ksoftirqd/111:44:391
2865999331,29cyclictest4911-21/usr/sbin/munin07:45:161
28658993311,6cyclictest26967-21/usr/sbin/munin12:20:150
2865899331,12cyclictest3302-21runrttasks08:32:290
65552321,4sleep16569-21ssh10:18:401
2865999329,7cyclictest2759-21kworker/1:008:00:141
2865999328,6cyclictest3269-21ntpd12:50:211
2865999322,9cyclictest27159-21ssh10:05:411
2865999322,9cyclictest27159-21ssh10:05:401
28659993225,4cyclictest27477-21/usr/sbin/munin08:45:161
2865999322,28cyclictest0-21swapper/110:30:151
2865999322,12cyclictest18107-21ssh09:23:441
28659993216,12cyclictest4406-21diskmemload11:19:471
28659993216,12cyclictest4406-21diskmemload11:19:461
2865999321,29cyclictest0-21swapper/112:24:561
28659993212,6cyclictest22-21ksoftirqd/109:44:511
2865899329,5cyclictest1551-21cstates09:40:130
2865899322,13cyclictest3302-21runrttasks08:12:150
2865899322,13cyclictest3302-21runrttasks08:12:140
28658993214,6cyclictest0-21swapper/008:29:160
2865899321,12cyclictest2645-21snmpd10:02:060
28658993210,6cyclictest14939-21users12:40:310
2865999317,10cyclictest40550irq/92-i91509:31:281
2865999312,6cyclictest4406-21diskmemload11:05:101
28659993120,8cyclictest24988-21ssh11:45:101
2865999311,28cyclictest0-21swapper/108:08:151
2865899311,13cyclictest32482-21ssh12:25:270
239972311,26sleep124002-21diskstats08:35:151
222422311,4sleep122320-21hddtemp_smartct08:30:161
2865999309,5cyclictest40550irq/92-i91509:55:281
2865999306,5cyclictest40550irq/92-i91509:50:161
2865999305,5cyclictest81rcu_preempt08:55:261
28659993023,5cyclictest0-21swapper/109:03:561
2865899304,12cyclictest0-21swapper/007:36:560
2865999295,4cyclictest40550irq/92-i91511:31:191
28659992917,9cyclictest17027-21open_files08:15:241
2865899298,6cyclictest0-21swapper/007:31:550
2865899298,4cyclictest32167-21/usr/sbin/munin08:55:260
43802281,5sleep00-21swapper/009:09:520
2865999287,10cyclictest40550irq/92-i91510:36:521
28659992821,5cyclictest0-21swapper/107:34:361
2865899283,20cyclictest5738-21ntp_states07:45:220
193802281,5sleep00-21swapper/008:20:440
27482271,5sleep10-21swapper/107:39:231
270562271,5sleep10-21swapper/108:42:211
156752271,5sleep10-21swapper/108:11:261
156752271,5sleep10-21swapper/108:11:261
2865999268,6cyclictest40550irq/92-i91507:55:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional