You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 10:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri Mar 13, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233969910881069,16cyclictest16235-21kworker/1:319:26:301
229892612564,32sleep00-21swapper/019:21:200
232602510416,31sleep10-21swapper/119:24:091
937421020,3sleep10-21swapper/100:40:291
191422940,10sleep02339599cyclictest23:44:400
155992860,8sleep12339699cyclictest20:25:311
23395998374,6cyclictest0-21swapper/019:26:300
236012750,4sleep023603-21cstates21:35:110
31052570,4sleep1201rcuc/100:00:301
111212512,4sleep011194-21ssh23:35:280
23396994418,11cyclictest22-21ksoftirqd/121:50:141
23396994417,6cyclictest22-21ksoftirqd/122:22:481
23396994316,7cyclictest22-21ksoftirqd/123:12:041
23396994216,6cyclictest22-21ksoftirqd/123:43:331
23396994216,16cyclictest22-21ksoftirqd/123:59:211
23396994216,10cyclictest22-21ksoftirqd/123:50:121
23396994215,7cyclictest22-21ksoftirqd/123:10:001
23396994210,8cyclictest24481-21latency20:50:221
23396994116,6cyclictest22-21ksoftirqd/122:49:561
23396994116,15cyclictest22-21ksoftirqd/121:34:551
23396994116,15cyclictest22-21ksoftirqd/121:29:311
23396994115,15cyclictest22-21ksoftirqd/121:37:241
2339599418,20cyclictest7398-21rm22:58:500
23395994126,11cyclictest2645-21snmpd22:23:040
124332411,8sleep00-21swapper/021:56:220
23396994015,10cyclictest22-21ksoftirqd/121:15:281
2339599403,18cyclictest0-21swapper/023:02:580
2339599402,19cyclictest31803-21diskstats21:10:150
2339699397,3cyclictest0-21swapper/123:22:151
2339699396,29cyclictest0-21swapper/122:56:561
2339699394,17cyclictest16424-21munin-run22:35:001
23396993917,7cyclictest22-21ksoftirqd/123:36:531
23396993917,7cyclictest22-21ksoftirqd/100:13:221
2339599396,30cyclictest11562-21cron22:30:000
2339599392,22cyclictest0-21swapper/022:37:420
2339599392,16cyclictest0-21swapper/022:50:370
2339599392,15cyclictest21810-21/usr/sbin/munin22:40:130
2339599392,15cyclictest21810-21/usr/sbin/munin22:40:120
23395993911,6cyclictest26734-21ssh00:25:240
23396993812,7cyclictest22-21ksoftirqd/100:16:101
2339599381,25cyclictest6249-21sh00:04:470
2339699378,8cyclictest2206-21dbus-daemon00:05:531
23396993718,6cyclictest22-21ksoftirqd/122:25:181
23396993717,6cyclictest22-21ksoftirqd/122:39:351
23396993717,6cyclictest22-21ksoftirqd/122:00:061
23396993716,6cyclictest22-21ksoftirqd/100:22:131
2339599372,13cyclictest19205-21iostat21:30:200
2339599371,15cyclictest25617-21ssh23:50:280
2339599371,12cyclictest12033-21ssh21:22:590
2339699367,18cyclictest0-21swapper/121:23:201
2339699362,30cyclictest0-21swapper/121:46:151
23396993615,6cyclictest22-21ksoftirqd/123:00:101
2339599363,31cyclictest0-21swapper/023:57:550
2339599362,30cyclictest0-21swapper/023:34:350
2339599362,14cyclictest0-21swapper/000:43:400
2339599362,13cyclictest30345-21iostat22:15:180
2339599362,13cyclictest0-21swapper/000:51:440
2339599361,20cyclictest4767-21chrt19:59:170
2339599361,14cyclictest3302-21runrttasks20:51:150
23395993610,9cyclictest13309-21vmstat22:30:320
23395993610,7cyclictest29707-21ssh21:40:320
57292352,28sleep05855-21df21:50:130
326132350,3sleep1201rcuc/100:30:571
2339699352,30cyclictest0-21swapper/122:50:551
23396993515,6cyclictest22-21ksoftirqd/100:38:031
23396993514,7cyclictest22-21ksoftirqd/100:45:211
23396993512,11cyclictest0-21swapper/122:10:491
2339599358,11cyclictest30497-21gdbus23:10:080
2339599355,26cyclictest31204-21diskmemload22:05:370
2339599353,5cyclictest0-21swapper/023:45:150
2339599352,5cyclictest0-21swapper/000:49:160
2339599352,13cyclictest864-21irqstats23:25:220
23395993516,15cyclictest3-21ksoftirqd/022:13:410
2339599351,19cyclictest16386-21ssh21:27:160
2339599351,18cyclictest2403-21irqbalance19:44:360
2339599351,15cyclictest4325-21ssh00:35:260
2339599351,13cyclictest1466-21ssh21:45:230
258862341,29sleep025945-21ntp_states19:30:070
2339699342,29cyclictest0-21swapper/123:32:561
2339699342,28cyclictest0-21swapper/120:15:161
23396993417,14cyclictest22-21ksoftirqd/122:44:081
23396993417,14cyclictest22-21ksoftirqd/122:44:071
23396993414,6cyclictest22-21ksoftirqd/100:51:161
23396993413,6cyclictest22-21ksoftirqd/119:45:271
2339699341,16cyclictest19136-21mailstats20:35:291
2339599348,5cyclictest13224-21seq00:10:530
2339599348,23cyclictest16710-21sshd23:08:210
2339599342,4cyclictest0-21swapper/022:46:350
2339599341,5cyclictest32362-21ssh00:30:360
23395993411,6cyclictest15561-21diskstats22:00:150
2339599341,16cyclictest11215-21ssh00:09:590
2339599341,13cyclictest18426-21sh00:16:260
2339599341,12cyclictest5165-21swap21:15:260
2339699331,30cyclictest0-21swapper/123:27:361
2339699331,17cyclictest0-21swapper/123:17:181
2339599332,26cyclictest30304-21ntp_states21:05:250
2339599332,14cyclictest28470-21iostat_ios23:20:210
2339599331,12cyclictest7029-21cpu20:05:110
23395993310,7cyclictest2645-21snmpd20:12:120
23395993310,6cyclictest15288-21pluginstate20:25:260
244502321,27sleep124461-21ssh22:09:471
2339699328,5cyclictest0-21swapper/119:40:281
23396993212,6cyclictest22-21ksoftirqd/123:45:311
23396993212,6cyclictest22-21ksoftirqd/100:25:221
2339699321,13cyclictest0-21swapper/121:00:021
2339599322,5cyclictest23619-21iostat_ios23:15:200
2339599322,4cyclictest30496-21packagekitd19:39:560
2339599321,14cyclictest16790-21hddtemp_smartct20:30:170
2339599321,13cyclictest31204-21diskmemload00:22:530
2339599321,12cyclictest30496-21packagekitd20:36:130
2339599321,12cyclictest23574-21taskset20:49:060
90602311,26sleep19065-21diskstats20:10:131
259982311,5sleep10-21swapper/120:55:161
2339699319,5cyclictest81rcu_preempt21:40:161
2339699314,6cyclictest29651-21munin-run19:40:011
2339699311,3cyclictest0-21swapper/120:32:351
2339699311,15cyclictest0-21swapper/121:13:181
2339599311,13cyclictest27883-21/usr/sbin/munin21:00:120
2339599311,13cyclictest21344-21/usr/sbin/munin20:40:300
2339599311,13cyclictest13833-21runrttasks20:20:370
117142311,3sleep00-21swapper/020:15:280
321362301,5sleep10-21swapper/122:16:561
310272303,6sleep122-21ksoftirqd/121:08:201
28972301,5sleep10-21swapper/119:54:371
2339699301,9cyclictest7052-21grep20:05:111
2339599301,13cyclictest25788-21aten_r4power_vo20:55:120
2339599301,12cyclictest5020-21/usr/sbin/munin20:00:110
2339699292,25cyclictest0-21swapper/119:56:011
2339599291,16cyclictest0-21swapper/019:49:260
2339699285,7cyclictest40550irq/92-i91520:05:021
23396992816,9cyclictest22-21ksoftirqd/121:59:181
141792281,5sleep10-21swapper/120:24:121
23395992718,6cyclictest3-21ksoftirqd/019:54:520
214672271,4sleep10-21swapper/120:41:481
23396992610,12cyclictest25492-21munin-node19:30:021
2339699248,5cyclictest40550irq/92-i91520:45:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional