You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 07:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Thu Apr 09, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319249911661139,23cyclictest32404-21fschecks_count19:25:161
319239911351102,19cyclictest0-21swapper/019:25:160
318112661617,29sleep10-21swapper/119:24:261
301502514417,29sleep00-21swapper/019:20:070
128442860,8sleep03192399cyclictest21:48:370
158232800,4sleep0111rcuc/022:25:140
40322780,4sleep0111rcuc/022:45:340
182652580,7sleep03192399cyclictest00:07:550
3192499483,11cyclictest17839-21latency23:00:231
160162460,8sleep03192399cyclictest20:05:200
96552450,8sleep13192499cyclictest00:32:141
3192499447,5cyclictest3762-21ssh21:39:281
3192499446,12cyclictest0-21swapper/123:07:541
31924994410,5cyclictest40550irq/92-i91522:50:181
3192499437,5cyclictest5770-21ssh00:28:371
3192499437,5cyclictest27516-21ssh22:36:461
3192499437,5cyclictest13802-21ssh22:22:521
3192499437,5cyclictest13394-21ssh21:49:241
3192499437,5cyclictest11773-21ssh23:27:351
3192499432,9cyclictest0-21swapper/120:15:011
3192499431,9cyclictest0-21swapper/121:34:141
3192499431,9cyclictest0-21swapper/100:15:291
3192499431,19cyclictest12958-21/usr/sbin/munin22:55:271
3192499426,6cyclictest20449-21ssh00:43:571
3192499422,9cyclictest0-21swapper/123:57:161
3192499422,9cyclictest0-21swapper/122:16:051
3192499422,8cyclictest0-21swapper/120:10:221
3192499421,9cyclictest0-21swapper/122:02:151
3192499421,9cyclictest0-21swapper/121:10:221
3192499421,16cyclictest0-21swapper/120:01:351
3192499420,11cyclictest138250irq/90-eth023:46:401
3192499417,5cyclictest22508-21ssh00:45:271
3192499415,6cyclictest22-21ksoftirqd/119:51:471
3192499412,16cyclictest0-21swapper/100:05:011
3192499411,8cyclictest0-21swapper/121:50:131
3192499411,8cyclictest0-21swapper/121:20:211
3192499411,8cyclictest0-21swapper/120:25:201
3192499411,8cyclictest0-21swapper/100:35:411
3192499408,6cyclictest22-21ksoftirqd/121:19:391
3192499407,6cyclictest22-21ksoftirqd/100:12:161
3192499407,5cyclictest6980-21ssh21:42:061
3192499402,9cyclictest0-21swapper/123:35:551
3192499402,9cyclictest0-21swapper/100:53:211
3192499401,9cyclictest0-21swapper/123:51:181
3192499401,9cyclictest0-21swapper/122:44:421
3192499401,8cyclictest0-21swapper/122:26:131
3192499401,8cyclictest0-21swapper/120:55:211
3192499401,8cyclictest0-21swapper/100:00:461
3192499401,17cyclictest0-21swapper/123:17:001
3192399407,5cyclictest0-21swapper/022:35:160
3192399401,21cyclictest0-21swapper/022:16:360
3192499399,4cyclictest22920-21irqstats21:25:211
3192499398,6cyclictest22-21ksoftirqd/122:07:141
3192499398,6cyclictest22-21ksoftirqd/121:57:401
3192499397,5cyclictest28608-21ssh23:11:091
3192499397,17cyclictest22-21ksoftirqd/123:20:361
3192499395,6cyclictest3831-21ssh22:45:321
3192499391,9cyclictest0-21swapper/120:22:561
3192499391,9cyclictest0-21swapper/120:09:311
3192499391,8cyclictest0-21swapper/123:40:121
3192499391,8cyclictest0-21swapper/119:46:471
3192399391,24cyclictest29432-21/usr/sbin/munin23:45:290
3192499387,5cyclictest31131-21ssh00:20:301
3192499381,9cyclictest0-21swapper/119:41:261
3192499381,9cyclictest0-21swapper/119:38:301
3192499381,8cyclictest0-21swapper/123:30:311
3192499381,8cyclictest0-21swapper/122:30:221
96902371,5sleep09701-21ssh00:32:180
3192499377,5cyclictest22-21ksoftirqd/122:11:471
3192499373,4cyclictest5304-21seq21:02:571
3192499371,6cyclictest3302-21runrttasks19:59:311
31923993711,4cyclictest0-21swapper/022:33:480
3192499361,8cyclictest0-21swapper/120:47:131
3192499361,8cyclictest0-21swapper/120:32:071
3192399362,21cyclictest32640-21diskstats20:50:140
3192399361,6cyclictest5988-21cut23:55:160
128162361,31sleep012829-21df_inode21:15:150
3192499358,5cyclictest6166-21smartctl21:05:151
3192499357,6cyclictest22-21ksoftirqd/119:31:071
3192499356,6cyclictest22-21ksoftirqd/120:50:561
3192399359,13cyclictest29956-21sh00:55:000
3192399358,23cyclictest0-21swapper/022:05:060
3192399357,4cyclictest81rcu_preempt21:29:300
3192399353,4cyclictest0-21swapper/000:02:360
31923993522,10cyclictest13035-1kworker/0:0H22:55:380
3192399351,22cyclictest10051-21chrt19:50:120
3192499345,6cyclictest22-21ksoftirqd/120:39:591
3192399348,6cyclictest192502ssh00:42:080
3192399347,15cyclictest0-21swapper/022:23:460
3192399346,12cyclictest30497-21gdbus20:31:020
3192399345,26cyclictest4117-21cron21:40:000
3192399345,14cyclictest0-21swapper/020:04:210
3192399342,20cyclictest30757-21df_inode20:45:120
3192399342,18cyclictest26535-21ssh22:02:270
3192399341,9cyclictest0-21swapper/021:54:340
3192399341,20cyclictest9834-21ntp_states23:25:260
3192399341,19cyclictest26284-21ssh23:42:370
3192399339,12cyclictest7038-21ssh21:42:120
3192399336,5cyclictest81rcu_preempt23:30:110
3192399334,4cyclictest81rcu_preempt23:16:040
3192399334,4cyclictest81rcu_preempt21:10:450
3192399334,4cyclictest81rcu_preempt00:45:310
3192399332,28cyclictest0-21swapper/023:03:160
3192399331,4cyclictest15870-21ssh00:39:150
31923993314,15cyclictest3-21ksoftirqd/023:24:310
3192399331,30cyclictest0-21swapper/000:13:560
3192399331,19cyclictest18841-21users21:20:310
3192399331,12cyclictest27280-21cut21:30:100
3192499327,6cyclictest22-21ksoftirqd/120:41:421
3192399328,4cyclictest81rcu_preempt23:35:230
3192399328,3cyclictest81rcu_preempt22:44:000
3192399324,20cyclictest19460-21diskstats20:15:140
3192399323,4cyclictest81rcu_preempt21:59:310
3192399322,18cyclictest0-21swapper/021:08:090
3192399322,18cyclictest0-21swapper/021:00:150
3192399321,5cyclictest0-21swapper/020:55:550
3192399321,4cyclictest81rcu_preempt23:11:270
3192399321,4cyclictest81rcu_preempt20:29:160
3192399321,4cyclictest81rcu_preempt20:20:150
3192399321,4cyclictest81rcu_preempt00:16:410
31923993212,7cyclictest10396-21ssh22:52:480
3192399321,19cyclictest2852-21ssh23:51:350
3192399313,11cyclictest0-21swapper/000:25:060
3192399311,4cyclictest81rcu_preempt23:08:410
3192399311,4cyclictest81rcu_preempt22:12:140
3192399301,4cyclictest81rcu_preempt19:56:200
3192399301,25cyclictest3663-21taskset19:31:550
3192399301,14cyclictest1452-21chrt00:24:320
3192399291,15cyclictest28676-21cut20:40:120
181392291,4sleep018229-21grep20:10:250
3192399284,17cyclictest5142-21python19:35:280
3192399282,13cyclictest6705-21memory19:40:200
3192399282,13cyclictest27376-21memory20:35:210
3192399281,13cyclictest7926-21aten_r4power_en19:45:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional