You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Nov 29, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
280319912641235,23cyclictest4920-21copy07:45:261
280319911371094,24cyclictest28188-21aten_r4power_cu07:25:121
277332682636,31sleep00-21swapper/007:22:340
269502528476,31sleep10-21swapper/107:20:251
2803099235211,5cyclictest4921-21ntp_states07:45:260
2619321210,4sleep026151-21cstates12:20:140
23892980,9sleep02803099cyclictest09:40:560
326092970,4sleep032606-21aten_r4power_po09:00:130
28030999271,4cyclictest0-21swapper/007:25:120
235452900,4sleep10-21swapper/112:17:031
176802820,5sleep017682-21aten_r4power_en12:45:130
264772660,2sleep126478-21sh12:54:551
116662470,3sleep1211ktimersoftd/110:58:041
249392411,36sleep124949-21ssh09:30:381
28030994024,6cyclictest3-21ksoftirqd/011:37:250
28030994023,5cyclictest3-21ksoftirqd/012:39:350
28030993922,6cyclictest3-21ksoftirqd/010:37:230
28030993922,6cyclictest3-21ksoftirqd/009:54:340
2803099391,6cyclictest0-21swapper/011:24:310
28030993823,5cyclictest3-21ksoftirqd/008:46:220
28030993822,5cyclictest3-21ksoftirqd/010:03:250
20652380,4sleep1201rcuc/109:40:311
15232380,11sleep02803099cyclictest10:14:360
2803199377,4cyclictest81rcu_preempt09:21:211
28030993721,6cyclictest3-21ksoftirqd/012:16:400
28030993721,6cyclictest3-21ksoftirqd/012:09:340
28030993721,6cyclictest3-21ksoftirqd/010:28:530
2803099371,21cyclictest15218-21users09:20:310
95552361,31sleep02343-21irqbalance07:58:060
323012360,7sleep02803099cyclictest09:39:190
28030993620,6cyclictest3-21ksoftirqd/008:13:440
28030993620,5cyclictest3-21ksoftirqd/008:44:250
207412361,4sleep120743-21ssh09:26:321
28030993520,5cyclictest3-21ksoftirqd/008:16:170
28030993520,5cyclictest3-21ksoftirqd/008:07:320
28030993519,6cyclictest3-21ksoftirqd/011:34:390
28030993519,6cyclictest3-21ksoftirqd/009:34:070
28030993519,5cyclictest3-21ksoftirqd/008:55:000
28030993519,5cyclictest3-21ksoftirqd/008:54:590
28030993519,5cyclictest3-21ksoftirqd/008:32:270
28030993518,6cyclictest3-21ksoftirqd/011:04:230
28030993517,8cyclictest3-21ksoftirqd/008:01:090
28030993517,12cyclictest5909-21memory11:25:260
2803099351,21cyclictest22672-21munin-run11:10:000
73262341,29sleep17340-21ssh09:45:581
52092340,4sleep0111rcuc/010:50:410
291912341,29sleep129210-21ntp_states09:35:271
2803199346,4cyclictest81rcu_preempt11:36:311
28031993418,12cyclictest0-21swapper/111:46:021
28030993419,5cyclictest3-21ksoftirqd/012:26:340
28030993419,5cyclictest3-21ksoftirqd/008:57:400
28030993418,5cyclictest3-21ksoftirqd/009:49:150
28030993418,5cyclictest3-21ksoftirqd/007:32:290
28030993417,5cyclictest3-21ksoftirqd/007:52:540
2803099341,14cyclictest6473-21ssh12:33:100
2803099341,14cyclictest6473-21ssh12:33:090
28030993411,12cyclictest1013-21sshd07:35:290
2803199335,24cyclictest0-21swapper/110:52:071
28031993325,5cyclictest8971-21/usr/sbin/munin07:55:271
28031993317,12cyclictest22-21ksoftirqd/111:10:341
28031993316,15cyclictest22-21ksoftirqd/112:12:441
28031993311,4cyclictest40950irq/93-i91512:07:541
28030993318,5cyclictest3-21ksoftirqd/009:05:430
95942322,5sleep19609-21irqstats09:15:211
56132321,4sleep15624-21ssh11:59:021
2803199329,4cyclictest81rcu_preempt09:10:181
2803199329,19cyclictest0-21swapper/110:02:111
2803199322,16cyclictest20575-21ntp_states11:40:281
28031993217,11cyclictest22-21ksoftirqd/110:46:581
2803199321,5cyclictest81rcu_preempt11:26:021
2803199321,4cyclictest81rcu_preempt10:22:421
2803199321,4cyclictest81rcu_preempt10:17:401
2803099328,8cyclictest3-21ksoftirqd/010:17:410
2803099326,8cyclictest7736-21iostat_ios10:20:220
2803099321,7cyclictest32534-21runrttasks11:53:110
28030993217,5cyclictest3-21ksoftirqd/011:11:480
28030993217,5cyclictest3-21ksoftirqd/009:56:110
28030993217,5cyclictest3-21ksoftirqd/008:29:250
28030993216,5cyclictest3-21ksoftirqd/010:57:190
2803099321,16cyclictest17783-21ssh10:30:280
2803099321,15cyclictest23911-21seq12:50:540
2803099321,14cyclictest10149-21ssh12:03:360
262742321,4sleep026288-21ssh10:40:080
251482328,5sleep125159-21ssh10:38:441
151912321,27sleep115202-21sh09:55:121
2803199315,5cyclictest81rcu_preempt12:43:591
2803199313,21cyclictest0-21swapper/110:43:301
28031993121,6cyclictest17900-21cat10:30:301
2803199311,25cyclictest12665-21memory10:25:251
28031993111,16cyclictest0-21swapper/111:08:581
2803099317,10cyclictest4083-21aten_r4power_cu09:10:110
28030993117,4cyclictest3-21ksoftirqd/012:41:540
28030993115,6cyclictest3-21ksoftirqd/009:18:170
28030993112,4cyclictest40950irq/93-i91511:45:190
2803099311,20cyclictest0-21swapper/010:49:350
28030993111,6cyclictest3-21ksoftirqd/009:27:030
2803099311,12cyclictest31850-21ssh11:19:190
28030993110,5cyclictest20580-21ssh11:40:280
255862311,26sleep125590-21irqstats08:40:231
2803199309,17cyclictest0-21swapper/112:49:121
2803199303,23cyclictest0-21swapper/110:10:271
28031993015,11cyclictest22-21ksoftirqd/112:33:241
28031993015,11cyclictest22-21ksoftirqd/112:33:241
2803199301,4cyclictest81rcu_preempt12:20:061
2803199301,4cyclictest81rcu_preempt12:00:251
28031993013,5cyclictest107132ssh09:50:161
2803199301,25cyclictest0-21swapper/110:05:111
2803099302,15cyclictest18013-21/usr/sbin/munin08:20:180
2803099301,17cyclictest0-21swapper/010:07:060
2803099301,16cyclictest3991-21sort07:45:010
122562301,5sleep10-21swapper/111:31:481
2803199296,4cyclictest81rcu_preempt08:25:051
2803199296,4cyclictest81rcu_preempt08:02:231
2803099292,13cyclictest17026-21memory12:10:240
2803099291,7cyclictest2222-21ssh11:55:210
28030992916,10cyclictest0-21swapper/008:38:570
162462291,5sleep10-21swapper/111:02:421
11502291,5sleep10-21swapper/112:27:371
323452281,5sleep10-21swapper/107:34:091
2803199289,15cyclictest0-21swapper/111:53:431
2803199289,15cyclictest0-21swapper/111:21:531
2803199285,4cyclictest81rcu_preempt08:37:401
2803199284,18cyclictest31224-21iostat_ios08:55:211
2803199284,18cyclictest13975-21diskstats08:10:171
2803199284,17cyclictest21901-21memory08:30:211
2803199282,14cyclictest0-21swapper/107:40:091
2803199282,11cyclictest3020-21runrttasks09:04:551
2803199281,4cyclictest81rcu_preempt08:16:171
28031992813,4cyclictest22-21ksoftirqd/111:19:361
19362281,5sleep10-21swapper/109:05:031
188682281,5sleep10-21swapper/108:21:561
77922271,5sleep10-21swapper/107:54:201
2803199272,18cyclictest8718-21irqstats12:35:231
2803199272,14cyclictest0-21swapper/108:07:191
28031992711,12cyclictest26863-21/usr/sbin/munin08:45:191
2803199269,5cyclictest81rcu_preempt07:40:001
2803199264,3cyclictest81rcu_preempt08:54:001
2803199264,3cyclictest81rcu_preempt08:53:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional