You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 17:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Sep 18, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
163439911721142,21cyclictest0-21swapper/007:25:040
163449911411108,21cyclictest20786-21apt-get07:35:011
163439911321103,25cyclictest0-21swapper/007:35:010
163449911311121,7cyclictest0-21swapper/107:25:051
162492579532,30sleep00-21swapper/007:24:410
158862465418,32sleep10-21swapper/107:20:501
128142960,7sleep00-21swapper/012:52:470
139012890,8sleep11634499cyclictest08:40:191
212412840,5sleep01634399cyclictest11:20:210
270662690,4sleep00-21swapper/010:19:490
64502520,4sleep00-21swapper/011:05:150
274292500,8sleep01634399cyclictest11:26:210
259702450,5sleep1201rcuc/111:59:191
25022430,4sleep01634399cyclictest11:35:050
1634399411,16cyclictest0-21swapper/010:08:020
16344994024,12cyclictest30944-21snmpd12:30:061
16343993922,6cyclictest3-21ksoftirqd/012:17:390
16343993922,6cyclictest3-21ksoftirqd/009:21:510
16343993822,6cyclictest3-21ksoftirqd/010:45:570
16343993822,6cyclictest3-21ksoftirqd/007:53:440
16343993722,5cyclictest3-21ksoftirqd/011:55:260
16343993722,5cyclictest3-21ksoftirqd/010:51:260
16343993722,4cyclictest3-21ksoftirqd/007:35:460
16343993720,6cyclictest3-21ksoftirqd/009:52:350
16343993720,6cyclictest3-21ksoftirqd/008:49:080
16343993716,5cyclictest20628-21ssh11:53:320
320822366,4sleep081rcu_preempt08:02:510
320822366,4sleep081rcu_preempt08:02:510
306932361,30sleep130745-21hddtemp_smartct11:30:171
180432361,31sleep118056-21diskmemload11:16:461
1634399362,20cyclictest21861-21/usr/sbin/munin09:00:260
16343993620,6cyclictest3-21ksoftirqd/010:42:090
16343993620,5cyclictest3-21ksoftirqd/012:22:520
16343993619,5cyclictest3-21ksoftirqd/012:10:380
16343993613,8cyclictest3-21ksoftirqd/010:26:200
16343993613,7cyclictest3-21ksoftirqd/009:40:300
1634499354,4cyclictest81rcu_preempt10:26:191
1634499351,4cyclictest81rcu_preempt10:41:521
16343993521,4cyclictest3-21ksoftirqd/009:46:000
16343993520,5cyclictest3-21ksoftirqd/008:43:210
16343993519,5cyclictest3-21ksoftirqd/008:53:250
16343993519,5cyclictest3-21ksoftirqd/008:27:000
16343993519,5cyclictest3-21ksoftirqd/008:21:580
16343993518,6cyclictest3-21ksoftirqd/012:09:110
16343993518,6cyclictest3-21ksoftirqd/012:00:360
16343993518,6cyclictest3-21ksoftirqd/010:57:290
1634399351,6cyclictest7820-21ssh09:59:500
274062340,5sleep127404-21ssh12:00:191
1634499346,5cyclictest81rcu_preempt09:40:301
1634499343,5cyclictest81rcu_preempt10:18:401
16343993419,5cyclictest3-21ksoftirqd/010:14:120
16343993419,5cyclictest3-21ksoftirqd/008:34:390
16343993417,6cyclictest3-21ksoftirqd/010:35:110
1634399341,21cyclictest9043-21rm11:40:380
1634399341,21cyclictest19425-21ntp_states12:25:260
1634399341,16cyclictest5837-21idleruntime-cro11:05:000
1634399341,12cyclictest0-21swapper/011:11:080
1634499339,20cyclictest0-21swapper/110:34:111
1634499335,6cyclictest0-21swapper/112:18:261
1634499331,9cyclictest25408-21ssh11:25:141
1634499331,8cyclictest6111-21/usr/sbin/munin11:05:311
16344993315,14cyclictest22-21ksoftirqd/112:12:141
1634399339,8cyclictest3-21ksoftirqd/012:39:500
16343993318,5cyclictest3-21ksoftirqd/008:19:370
16343993317,5cyclictest3-21ksoftirqd/008:09:150
1634399331,12cyclictest14235-21rm11:46:120
319312321,5sleep00-21swapper/009:16:520
311572321,27sleep124493-1kworker/1:0H10:56:481
309882321,27sleep131002-21ssh12:37:401
1634499329,19cyclictest0-21swapper/111:49:471
1634499328,20cyclictest0-21swapper/110:05:211
1634499324,4cyclictest81rcu_preempt07:59:101
1634499322,19cyclictest0-21swapper/109:48:001
1634399321,8cyclictest11477-21ssh09:30:000
1634399321,8cyclictest11477-21ssh09:30:000
16343993217,5cyclictest3-21ksoftirqd/009:06:430
16343993216,6cyclictest3-21ksoftirqd/007:45:090
1634399321,19cyclictest26645-21ssh09:11:110
16343993210,7cyclictest3-21ksoftirqd/007:59:090
160912321,3sleep116105-21ssh12:21:591
52002311,4sleep15211-21ssh11:37:051
224172311,5sleep10-21swapper/111:21:041
1634499317,5cyclictest81rcu_preempt12:29:461
1634499315,4cyclictest81rcu_preempt10:13:271
1634499315,4cyclictest81rcu_preempt08:46:141
1634499315,4cyclictest81rcu_preempt08:27:571
1634499314,6cyclictest0-21swapper/110:00:491
1634499314,23cyclictest0-21swapper/109:38:261
1634499312,24cyclictest8055-21python09:25:301
1634499312,24cyclictest8055-21python09:25:291
16344993115,4cyclictest22-21ksoftirqd/109:18:571
16344993114,9cyclictest22-21ksoftirqd/110:37:551
1634399319,7cyclictest16341-21cyclictest10:05:000
16343993113,7cyclictest4960-21tr10:30:130
16343993113,6cyclictest15753-21aten_r4power_cu11:15:110
110252311,5sleep10-21swapper/108:32:491
100982311,4sleep110185-21df12:50:121
37002301,25sleep03724-21/usr/sbin/munin08:15:010
300102301,5sleep00-21swapper/010:22:040
1634499302,22cyclictest0-21swapper/111:50:511
1634499301,7cyclictest5570-21ssh11:04:371
1634499301,7cyclictest27266-21ssh09:12:061
16344993017,9cyclictest22-21ksoftirqd/109:50:091
16344993016,8cyclictest20838-21/usr/sbin/munin09:00:301
16344993016,10cyclictest22-21ksoftirqd/109:31:081
1634399308,8cyclictest16341-21cyclictest12:34:360
16343993014,5cyclictest3-21ksoftirqd/007:42:540
16343993013,6cyclictest6684-21grep12:45:310
16343993013,6cyclictest18721-21runrttasks09:36:380
1634399301,17cyclictest6204-21gdbus08:38:550
6572291,5sleep00-21swapper/011:32:400
18592291,5sleep10-21swapper/112:07:261
1634499296,4cyclictest81rcu_preempt08:16:521
1634499295,4cyclictest81rcu_preempt09:58:481
1634499294,4cyclictest0-21swapper/111:11:141
1634499293,4cyclictest81rcu_preempt08:51:271
1634499292,4cyclictest81rcu_preempt07:37:261
16344992920,5cyclictest5959-21ssh09:24:051
120042291,5sleep00-21swapper/009:30:170
107032291,5sleep10-21swapper/111:43:051
319512281,5sleep10-21swapper/108:01:311
319512281,5sleep10-21swapper/108:01:301
210812281,5sleep10-21swapper/110:46:071
203022281,5sleep00-21swapper/008:56:210
1634499289,15cyclictest0-21swapper/110:23:121
1634499288,16cyclictest0-21swapper/112:42:131
1634499285,4cyclictest81rcu_preempt08:13:251
1634499284,9cyclictest0-21swapper/110:51:431
1634499282,6cyclictest81rcu_preempt09:06:071
1634499281,4cyclictest81rcu_preempt08:22:141
11362281,5sleep00-21swapper/012:40:210
324552271,5sleep10-21swapper/108:05:101
1634499277,16cyclictest0-21swapper/112:49:161
1634499271,9cyclictest0-21swapper/107:54:401
1634499271,5cyclictest81rcu_preempt07:40:371
127512271,5sleep10-21swapper/108:36:131
16344992617,5cyclictest22-21ksoftirqd/107:48:071
16344992617,5cyclictest19826-21wc08:55:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional