You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 04:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Mar 29, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
92339912221213,6cyclictest0-21swapper/119:27:521
92329911791147,22cyclictest0-21swapper/019:27:260
89812623581,27sleep00-21swapper/019:22:580
89792469371,31sleep10-21swapper/119:22:561
261572940,3sleep00-21swapper/020:05:270
128702860,12sleep041ktimersoftd/023:51:440
262332820,4sleep0111rcuc/000:05:280
233942810,3sleep123392-21sh00:02:581
139922760,4sleep0111rcuc/021:00:180
239762650,4sleep081rcu_preempt21:16:010
35802570,5sleep0111rcuc/000:15:270
152622530,4sleep115261-21smartctl21:40:271
278922510,4sleep1201rcuc/100:40:291
43332460,8sleep1923399cyclictest21:30:061
9232994323,8cyclictest3-21ksoftirqd/021:10:310
9232994323,5cyclictest3-21ksoftirqd/022:42:200
104882430,6sleep1923399cyclictest20:50:231
9232994224,6cyclictest3-21ksoftirqd/019:55:270
9232994222,9cyclictest3-21ksoftirqd/023:05:540
9232994123,8cyclictest3-21ksoftirqd/023:31:050
9232994123,6cyclictest3-21ksoftirqd/020:50:570
9232994122,9cyclictest3-21ksoftirqd/022:06:260
244292410,4sleep122-21ksoftirqd/123:30:231
9233994034,4cyclictest22-21ksoftirqd/122:20:001
9232994025,5cyclictest3-21ksoftirqd/023:10:280
9232994025,5cyclictest3-21ksoftirqd/023:10:280
9232994025,5cyclictest3-21ksoftirqd/021:24:350
9232994024,5cyclictest3-21ksoftirqd/021:05:100
9232994023,6cyclictest3-21ksoftirqd/023:03:030
9232994023,6cyclictest3-21ksoftirqd/022:49:230
9232994023,5cyclictest3-21ksoftirqd/021:31:100
9232994021,8cyclictest3-21ksoftirqd/022:58:240
9233993924,11cyclictest2310-21ssh23:07:531
9232993924,5cyclictest3-21ksoftirqd/022:13:100
9232993924,4cyclictest3-21ksoftirqd/000:34:290
9232993923,6cyclictest3-21ksoftirqd/000:14:310
9232993923,5cyclictest3-21ksoftirqd/020:57:240
9232993922,8cyclictest3-21ksoftirqd/021:57:510
9232993922,6cyclictest3-21ksoftirqd/022:24:100
9232993921,6cyclictest3-21ksoftirqd/000:54:260
9232993920,9cyclictest3-21ksoftirqd/023:39:450
9232993920,8cyclictest3-21ksoftirqd/023:17:400
9232993920,8cyclictest3-21ksoftirqd/021:51:540
9232993919,8cyclictest3-21ksoftirqd/023:27:500
923399388,4cyclictest81rcu_preempt21:16:021
9232993823,4cyclictest3-21ksoftirqd/000:40:270
9232993823,4cyclictest3-21ksoftirqd/000:01:380
9232993822,5cyclictest3-21ksoftirqd/020:04:160
9232993821,6cyclictest3-21ksoftirqd/020:33:550
9232993821,6cyclictest3-21ksoftirqd/000:48:010
923299382,13cyclictest3561-21ntp_states22:35:240
9232993820,9cyclictest3-21ksoftirqd/023:23:140
9232993820,8cyclictest3-21ksoftirqd/021:38:310
9232993820,8cyclictest3-21ksoftirqd/000:26:240
9232993820,8cyclictest3-21ksoftirqd/000:26:240
9232993819,8cyclictest3-21ksoftirqd/022:50:560
9232993819,8cyclictest3-21ksoftirqd/022:02:580
217762381,33sleep121786-21ssh21:14:511
923399371,4cyclictest81rcu_preempt21:58:491
923299375,28cyclictest0-21swapper/022:33:150
9232993723,4cyclictest3-21ksoftirqd/000:36:350
9232993722,5cyclictest3-21ksoftirqd/021:46:200
9232993722,5cyclictest3-21ksoftirqd/021:41:540
9232993721,5cyclictest3-21ksoftirqd/023:41:070
9232993719,8cyclictest3-21ksoftirqd/023:49:420
9232993719,4cyclictest3-21ksoftirqd/022:29:510
15862370,5sleep1201rcuc/122:00:181
923399369,5cyclictest22-21ksoftirqd/100:45:101
923399363,10cyclictest81rcu_preempt22:11:461
923399362,30cyclictest0-21swapper/122:58:151
923399361,6cyclictest30711-21/usr/sbin/munin20:20:151
923299369,15cyclictest3-21ksoftirqd/023:55:540
9232993622,4cyclictest3-21ksoftirqd/021:27:060
9232993615,6cyclictest3-21ksoftirqd/022:15:110
273312360,3sleep1211ktimersoftd/121:53:351
923399356,12cyclictest81rcu_preempt21:21:571
9233993523,10cyclictest22-21ksoftirqd/100:11:371
923399352,29cyclictest0-21swapper/100:34:561
9232993517,8cyclictest3-21ksoftirqd/000:22:340
923299351,31cyclictest0-21swapper/020:19:160
923399349,4cyclictest81rcu_preempt23:40:241
923399348,4cyclictest81rcu_preempt23:11:391
923399348,4cyclictest81rcu_preempt23:11:391
923399347,4cyclictest81rcu_preempt22:51:521
923399345,4cyclictest81rcu_preempt21:27:501
923399345,26cyclictest22-21ksoftirqd/100:21:381
923399345,26cyclictest11914-21ssh23:17:351
923399345,26cyclictest0-21swapper/100:07:371
923399344,4cyclictest81rcu_preempt22:49:561
923399343,4cyclictest81rcu_preempt23:20:331
923399343,29cyclictest0-21swapper/120:32:361
9233993416,4cyclictest81rcu_preempt23:00:161
923399341,4cyclictest81rcu_preempt00:36:041
923399341,29cyclictest3842-21fschecks_time00:50:151
9232993418,5cyclictest3-21ksoftirqd/020:28:030
9232993418,5cyclictest3-21ksoftirqd/020:10:130
9232993417,5cyclictest3-21ksoftirqd/020:46:500
88202341,4sleep18901-21users22:40:301
923399338,8cyclictest81rcu_preempt21:47:231
923399335,25cyclictest0-21swapper/122:37:371
923399332,4cyclictest81rcu_preempt22:05:141
923399331,5cyclictest0-21swapper/121:00:361
923399331,29cyclictest0-21swapper/122:33:361
923399331,29cyclictest0-21swapper/121:35:351
9232993325,6cyclictest0-21swapper/020:24:550
923299331,30cyclictest0-21swapper/019:45:560
923299331,30cyclictest0-21swapper/019:40:560
9232993310,7cyclictest3-21ksoftirqd/020:35:200
923399325,4cyclictest81rcu_preempt00:29:441
923399325,4cyclictest81rcu_preempt00:29:441
923399324,4cyclictest81rcu_preempt23:47:521
9233993216,12cyclictest22-21ksoftirqd/123:55:211
9233993216,12cyclictest22-21ksoftirqd/120:37:181
923399321,29cyclictest0-21swapper/119:39:561
293532321,4sleep129449-21rt-features23:35:271
923399314,4cyclictest81rcu_preempt20:15:431
923399313,4cyclictest81rcu_preempt23:50:561
9233993124,5cyclictest0-21swapper/120:10:351
9233993121,6cyclictest20802-21ssh23:26:271
923399311,10cyclictest81rcu_preempt00:19:131
923299312,3cyclictest0-21swapper/019:50:120
923399304,23cyclictest22-21ksoftirqd/119:32:361
923399303,4cyclictest81rcu_preempt22:27:081
923399301,4cyclictest81rcu_preempt22:20:191
923399301,4cyclictest81rcu_preempt20:46:301
9233993012,4cyclictest81rcu_preempt19:40:221
923299306,6cyclictest0-21swapper/020:44:300
150822301,5sleep00-21swapper/019:35:560
923399294,4cyclictest81rcu_preempt19:50:261
923399294,18cyclictest421-21diskstats20:25:141
9233992916,7cyclictest12139-21iostat_ios20:55:211
923299298,7cyclictest3-21ksoftirqd/019:33:370
75252291,5sleep10-21swapper/120:44:031
9233992822,3cyclictest40550irq/92-i91519:47:521
9233992817,7cyclictest22-21ksoftirqd/120:00:251
9233992815,10cyclictest22-21ksoftirqd/120:07:361
227962281,5sleep10-21swapper/119:57:521
166232281,5sleep10-21swapper/121:05:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional