You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 13:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Jul 26, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310269910891066,19cyclictest2695-21snmpd19:30:041
308792717673,29sleep10-21swapper/119:24:011
305742562516,31sleep00-21swapper/019:20:500
707621130,5sleep0111rcuc/022:35:240
142232690,4sleep114219-21fschecks_time22:55:151
31025996356,4cyclictest1149-21memory19:30:050
202892430,4sleep0111rcuc/000:35:310
31025994016,8cyclictest3-21ksoftirqd/020:01:520
31025994015,16cyclictest0-21swapper/000:43:090
207742408,4sleep120909-21sed00:40:011
31025993923,6cyclictest3-21ksoftirqd/000:23:200
31025993820,6cyclictest31100-21fschecks_count23:40:160
31025993816,7cyclictest3-21ksoftirqd/021:42:510
31025993814,5cyclictest28280-21irqstats20:40:220
31025993814,5cyclictest28280-21irqstats20:40:210
31025993722,5cyclictest3-21ksoftirqd/023:26:190
31025993716,12cyclictest0-21swapper/023:09:160
31025993715,7cyclictest3-21ksoftirqd/021:02:440
3102699364,10cyclictest21905-21iostat_ios23:15:211
31025993614,8cyclictest30240-21memory20:45:220
31025993613,8cyclictest3-21ksoftirqd/021:07:070
31025993613,12cyclictest20457-21diskstats20:20:160
3102599361,22cyclictest21959-21df21:50:150
231472361,4sleep12401-21NetworkManager23:20:021
31026993523,8cyclictest2695-21snmpd20:45:231
31026993510,10cyclictest40250irq/92-i91520:10:151
31025993518,6cyclictest1072-21grep20:55:130
31025993513,7cyclictest3-21ksoftirqd/020:51:440
3102599351,21cyclictest27240-21df23:30:140
288472351,4sleep12695-21snmpd22:08:071
164722351,4sleep116506-21ntp_states23:00:241
53302341,4sleep05402-21python22:30:310
31025993417,6cyclictest9532-21ls00:10:020
31025993416,6cyclictest13546-21taskset21:25:310
31025993412,6cyclictest3-21ksoftirqd/020:16:320
31025993412,6cyclictest3-21ksoftirqd/019:40:450
31025993412,13cyclictest31023-21cyclictest23:22:210
31025993412,12cyclictest31023-21cyclictest21:39:370
31025993412,12cyclictest31023-21cyclictest21:33:180
31025993411,6cyclictest3-21ksoftirqd/022:10:130
31025993411,12cyclictest31023-21cyclictest00:52:240
31025993411,12cyclictest24427-21/usr/sbin/munin20:30:180
20692341,4sleep12695-21snmpd22:23:141
3102599339,8cyclictest19712-21df23:10:130
31025993321,9cyclictest0-21swapper/022:46:530
31025993315,6cyclictest17205-21ntpdc20:10:260
31025993314,7cyclictest23053-21python20:25:280
31025993311,7cyclictest3-21ksoftirqd/023:52:470
31025993311,7cyclictest3-21ksoftirqd/019:55:040
31025993311,7cyclictest3-21ksoftirqd/019:55:040
31025993311,6cyclictest3-21ksoftirqd/020:39:150
31025993311,12cyclictest31023-21cyclictest23:45:490
31025993310,12cyclictest31023-21cyclictest23:57:300
209422331,28sleep121064-21users21:45:311
128762331,28sleep112878-21irqstats21:25:211
50322321,5sleep15039-21diskstats21:05:161
3102599325,6cyclictest28071-21strings22:05:250
3102599322,17cyclictest0-21swapper/000:02:450
31025993219,5cyclictest0-21swapper/022:25:320
31025993217,5cyclictest8887-21aten_r4power_cu19:50:100
31025993217,5cyclictest24477-21/usr/sbin/munin21:55:260
31025993216,5cyclictest3286-21runrttasks00:34:330
31025993214,7cyclictest4278-21switchtime19:35:290
31025993212,6cyclictest3-21ksoftirqd/000:11:120
31025993211,7cyclictest3-21ksoftirqd/000:29:460
31025993210,7cyclictest3-21ksoftirqd/022:53:250
31025993210,11cyclictest31317-21kworker/0:123:17:310
31026993119,8cyclictest4346-21tune2fs23:55:161
31025993115,4cyclictest32258-21unixbench_multi22:15:300
31025993111,6cyclictest3-21ksoftirqd/023:37:460
283432311,5sleep10-21swapper/123:31:401
252752310,4sleep1211ktimersoftd/100:50:181
245532311,5sleep10-21swapper/100:49:411
31026993012,14cyclictest7817-21ntp_states19:45:261
3102599309,7cyclictest3-21ksoftirqd/021:20:050
3102599308,6cyclictest25787-21fschecks_count22:00:160
3102599307,8cyclictest31023-21cyclictest00:47:090
3102599307,8cyclictest1974-21lldpad22:55:370
31025993017,5cyclictest0-21swapper/022:20:210
31025993014,5cyclictest7116-21hddtemp_smartct21:10:170
97302291,5sleep10-21swapper/122:43:361
324662291,5sleep10-21swapper/119:25:441
31026992919,5cyclictest23403-21munin-run21:55:001
31026992916,7cyclictest8803-21diskstats21:15:181
3102699291,4cyclictest81rcu_preempt20:01:521
3102599298,13cyclictest0-21swapper/019:27:250
31025992918,8cyclictest0-21swapper/023:02:590
31025992916,5cyclictest0-21swapper/022:40:240
31025992915,4cyclictest0-21swapper/000:16:170
31025992914,5cyclictest14734-21cpuspeed_turbos20:05:140
31025992914,4cyclictest19920-21egrep21:45:130
31025992913,5cyclictest8233-21unixbench_singl19:45:310
290632291,5sleep10-21swapper/120:41:371
290632291,5sleep10-21swapper/120:41:371
263822291,5sleep10-21swapper/123:25:461
209112291,5sleep10-21swapper/123:12:361
91692281,5sleep10-21swapper/100:06:371
63822281,5sleep10-21swapper/119:40:441
62512281,5sleep10-21swapper/122:35:081
41062281,4sleep10-21swapper/122:28:531
35232281,5sleep10-21swapper/123:51:361
320122281,5sleep10-21swapper/123:40:331
31026992818,6cyclictest11146-21needreboot21:20:231
31026992815,7cyclictest17854-21diskstats23:05:161
3102699281,4cyclictest81rcu_preempt21:42:521
3102699281,3cyclictest81rcu_preempt21:02:441
3102599281,15cyclictest8812-21/usr/sbin/munin21:15:180
274572281,5sleep10-21swapper/120:39:371
254652281,5sleep10-21swapper/120:33:241
216962281,5sleep10-21swapper/120:23:101
196792281,5sleep10-21swapper/120:16:581
188762281,5sleep10-21swapper/100:34:461
17462281,5sleep10-21swapper/123:48:481
149712281,5sleep10-21swapper/100:23:081
123732281,5sleep10-21swapper/100:15:281
114222281,4sleep10-21swapper/122:46:421
112982281,5sleep10-21swapper/100:14:151
102562281,5sleep10-21swapper/119:51:421
3102699278,15cyclictest22-21ksoftirqd/122:50:301
31026992717,6cyclictest22-21ksoftirqd/120:26:541
306232271,5sleep10-21swapper/122:12:051
269492271,5sleep10-21swapper/122:02:541
250792271,5sleep10-21swapper/121:58:081
173852271,5sleep10-21swapper/121:36:201
167872271,4sleep10-21swapper/100:27:301
3102699269,4cyclictest0-21swapper/121:30:271
31026992617,5cyclictest22-21ksoftirqd/119:39:281
3102699261,6cyclictest0-21swapper/100:40:181
31026992616,6cyclictest1146-21df_inode20:55:151
3102699260,4cyclictest81rcu_preempt20:51:441
162172261,5sleep10-21swapper/120:09:581
31026992517,5cyclictest22-21ksoftirqd/122:32:351
31026992515,6cyclictest7067-21sort00:00:321
31026992515,6cyclictest22-21ksoftirqd/121:10:241
3102699248,3cyclictest0-21swapper/122:15:271
31026992415,6cyclictest22-21ksoftirqd/123:36:021
31026992413,6cyclictest11339-21iostat_ios19:55:221
31026992413,6cyclictest11339-21iostat_ios19:55:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional