You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 13:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Apr 13, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173659911641128,24cyclictest0-21swapper/019:25:260
173669911291105,20cyclictest18261-21strings19:25:221
169572617563,40sleep10-21swapper/119:21:181
169502487442,30sleep00-21swapper/019:21:120
194872810,5sleep10-21swapper/123:17:041
242342700,3sleep124233-21ssh00:29:301
1736599639,13cyclictest29162-21sh21:46:270
1736599632,12cyclictest0-21swapper/021:30:410
17365996216,7cyclictest32685-21memory21:50:240
165502590,8sleep11736699cyclictest21:34:131
1736599572,29cyclictest0-21swapper/021:24:160
1736599572,29cyclictest0-21swapper/021:24:150
1736599571,13cyclictest29116-21sort22:20:190
1736599551,21cyclictest7400-21ssh22:30:430
1736599536,17cyclictest0-21swapper/020:12:340
1736599512,15cyclictest5453-21ntp_states20:15:250
1736599471,13cyclictest22262-21fschecks_time23:20:170
17365994323,5cyclictest3-21ksoftirqd/023:11:520
1736699412,35cyclictest0-21swapper/121:59:151
1736599401,14cyclictest23969-21ssh22:48:460
1736699391,34cyclictest0-21swapper/122:47:161
1736599383,16cyclictest0-21swapper/021:25:290
195622371,32sleep119646-21memory22:10:211
17366993722,4cyclictest22-21ksoftirqd/123:30:121
1736699371,13cyclictest0-21swapper/123:54:021
1736699371,13cyclictest0-21swapper/123:54:021
17365993720,5cyclictest17220-21cstates23:15:150
17365993713,10cyclictest30644-21diskstats21:15:160
1736699366,5cyclictest81rcu_preempt22:25:291
1736699366,5cyclictest81rcu_preempt00:24:401
17366993620,5cyclictest22-21ksoftirqd/100:03:101
1736699354,3cyclictest81rcu_preempt00:00:011
17366993524,7cyclictest8713-21grep23:05:301
1736699351,21cyclictest6777-21ssh21:24:031
1736699351,21cyclictest6777-21ssh21:24:031
17365993526,6cyclictest0-21swapper/000:38:150
1736599352,5cyclictest0-21swapper/000:20:150
17365993524,7cyclictest26107-21/usr/sbin/munin22:50:280
1736599351,30cyclictest9153-21diskstats23:40:150
1736699345,5cyclictest81rcu_preempt21:25:271
1736699345,4cyclictest81rcu_preempt00:12:011
1736699342,11cyclictest27474-21ssh22:51:521
1736699341,5cyclictest27243-21ssh22:18:361
1736699341,5cyclictest22-21ksoftirqd/122:21:021
1736599348,13cyclictest16258-21ssh22:40:230
1736599343,28cyclictest0-21swapper/022:13:360
1736599342,19cyclictest0-21swapper/020:02:090
1736599342,12cyclictest2488-21fschecks_count00:40:170
17365993415,8cyclictest23002-21/usr/sbin/munin21:40:210
96042331,28sleep09618-21ssh23:06:470
60562331,5sleep16070-21ssh23:03:381
1736699334,4cyclictest81rcu_preempt23:49:351
1736699334,4cyclictest81rcu_preempt23:36:051
1736699334,4cyclictest81rcu_preempt00:31:331
1736699334,3cyclictest81rcu_preempt22:02:451
17366993321,8cyclictest0-21swapper/121:16:351
1736699332,16cyclictest11403-21memory22:35:221
1736699331,18cyclictest17047-21ssh22:07:471
1736699331,10cyclictest2177-21ssh21:52:221
1736599338,13cyclictest4685-21df_inode21:55:140
1736599334,4cyclictest81rcu_preempt00:45:120
1736599334,4cyclictest81rcu_preempt00:10:310
17365993325,4cyclictest0-21swapper/023:36:560
1736599332,4cyclictest81rcu_preempt21:39:040
1736599331,5cyclictest0-21swapper/020:47:160
1736599331,4cyclictest81rcu_preempt00:05:450
1736599331,30cyclictest0-21swapper/000:26:560
1736599331,20cyclictest8873-21fschecks_time20:25:160
1736699323,5cyclictest81rcu_preempt00:17:201
1736699322,4cyclictest81rcu_preempt23:20:061
1736699322,4cyclictest81rcu_preempt22:58:041
17366993222,7cyclictest25175-21diskmemload23:29:191
17366993222,5cyclictest17902-21rm22:41:581
1736699321,8cyclictest0-21swapper/120:25:231
17366993217,4cyclictest22-21ksoftirqd/121:14:231
1736699321,29cyclictest0-21swapper/119:54:361
1736599323,26cyclictest3-21ksoftirqd/019:51:410
1736599322,4cyclictest81rcu_preempt22:07:020
17365993224,5cyclictest0-21swapper/023:31:350
17365993223,5cyclictest1968-21lldpad22:02:160
1736599322,19cyclictest0-21swapper/000:18:140
1736599321,5cyclictest0-21swapper/023:54:560
1736599321,5cyclictest0-21swapper/023:54:560
1736599321,5cyclictest0-21swapper/020:56:360
1736599321,5cyclictest0-21swapper/020:21:360
1736599321,29cyclictest0-21swapper/021:03:150
1736599321,29cyclictest0-21swapper/020:30:360
1736599321,29cyclictest0-21swapper/000:30:550
1736599321,28cyclictest0-21swapper/021:14:190
13182321,27sleep00-21swapper/022:59:000
193502311,26sleep130497-21gdbus20:53:201
1736699316,4cyclictest81rcu_preempt00:52:421
1736699314,4cyclictest81rcu_preempt23:42:511
1736699312,26cyclictest0-21swapper/100:45:151
17366993121,6cyclictest9694-21ssh22:34:041
1736699311,8cyclictest31198-21ssh00:35:371
1736699311,4cyclictest81rcu_preempt21:07:001
1736699311,4cyclictest81rcu_preempt20:38:591
1736699311,4cyclictest81rcu_preempt20:19:351
1736599314,14cyclictest26707-21sh22:17:480
1736599313,25cyclictest0-21swapper/023:56:430
1736599312,17cyclictest0-21swapper/023:47:460
17365993121,6cyclictest3055-21ssh22:26:250
17365993120,6cyclictest30575-21ssh00:01:520
1736599311,4cyclictest2403-21irqbalance23:00:150
17365993111,6cyclictest14639-21iostat_ios20:40:200
17365993111,5cyclictest22403-21which19:35:170
42322300,8sleep11736699cyclictest00:41:231
1736699303,4cyclictest81rcu_preempt19:41:541
1736699302,4cyclictest81rcu_preempt23:11:211
1736699301,7cyclictest23002-21memory21:40:221
1736699301,5cyclictest0-21swapper/120:13:551
17366993015,12cyclictest22-21ksoftirqd/120:45:121
1736699301,4cyclictest81rcu_preempt21:03:411
1736699301,27cyclictest0-21swapper/121:36:391
1736699301,26cyclictest111-21usb-storage00:07:201
1736599302,4cyclictest81rcu_preempt19:46:060
1736599301,5cyclictest0-21swapper/021:05:360
1736599301,4cyclictest81rcu_preempt22:38:280
1736599301,25cyclictest302242chrt23:28:350
1736599301,15cyclictest19462-21munin-node19:30:050
17365993010,8cyclictest2645-21snmpd00:52:170
78192291,5sleep10-21swapper/120:20:451
23282291,5sleep00-21swapper/020:08:300
1736699293,15cyclictest40550irq/92-i91519:48:101
1736699291,4cyclictest81rcu_preempt20:31:471
1736599291,14cyclictest2329-21NetworkManager19:58:460
1736599291,14cyclictest2329-21NetworkManager19:58:450
156672291,5sleep10-21swapper/120:44:071
326242281,5sleep10-21swapper/120:00:471
309152281,5sleep10-21swapper/119:57:441
309152281,5sleep10-21swapper/119:57:431
1736699281,4cyclictest81rcu_preempt20:07:371
1736699281,14cyclictest19770-21aten_r4power_vo20:55:121
1736599282,14cyclictest18401-21iostat_ios20:50:210
1736599282,13cyclictest13325-21grep20:35:280
17365992810,5cyclictest25060-21users19:40:280
17366992721,4cyclictest22-21ksoftirqd/121:45:241
1736699263,15cyclictest0-21swapper/119:39:561
1736699262,10cyclictest19784-21python19:30:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional