You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 06:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Fri Dec 12, 2025 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67339911161090,22cyclictest11681-21fschecks_time19:35:161
67339910871073,9cyclictest0-21swapper/119:25:081
64642678631,32sleep00-21swapper/019:22:500
63912459371,72sleep10-21swapper/119:22:021
6732992701,5cyclictest0-21swapper/019:25:090
1944221440,7sleep0673299cyclictest21:47:520
11292900,5sleep041ktimersoftd/021:29:320
11292900,5sleep041ktimersoftd/021:29:310
74522880,9sleep0673299cyclictest00:22:490
16012820,5sleep11599-21ssh00:50:281
20702800,7sleep0673299cyclictest21:30:150
6732997265,4cyclictest30944-21snmpd19:35:150
180162510,3sleep00-21swapper/000:00:210
6732994619,6cyclictest3-21ksoftirqd/000:11:450
276172460,4sleep1211ktimersoftd/100:10:211
129882430,7sleep1673399cyclictest23:55:181
6732994124,6cyclictest3-21ksoftirqd/022:45:350
6732994124,6cyclictest3-21ksoftirqd/022:03:230
6732994124,6cyclictest3-21ksoftirqd/000:29:190
6732994024,6cyclictest3-21ksoftirqd/020:18:210
6732994024,5cyclictest3-21ksoftirqd/022:26:220
6732994022,6cyclictest3-21ksoftirqd/019:57:200
673299394,18cyclictest12133-21ntp_states23:20:300
6732993923,6cyclictest3-21ksoftirqd/023:08:080
6732993922,6cyclictest3-21ksoftirqd/022:58:080
673299391,16cyclictest0-21swapper/000:45:440
4752391,34sleep1489-21ssh21:28:361
4752391,34sleep1489-21ssh21:28:361
6732993821,6cyclictest3-21ksoftirqd/022:51:100
6732993821,6cyclictest3-21ksoftirqd/022:10:590
6732993821,6cyclictest3-21ksoftirqd/000:17:460
6732993813,4cyclictest0-21swapper/021:10:340
6732993722,5cyclictest3-21ksoftirqd/023:29:120
6732993722,5cyclictest3-21ksoftirqd/022:35:490
6732993721,6cyclictest3-21ksoftirqd/023:18:220
6732993721,6cyclictest3-21ksoftirqd/023:18:210
6732993721,6cyclictest3-21ksoftirqd/022:34:120
6732993721,5cyclictest3-21ksoftirqd/023:02:480
6732993715,4cyclictest111rcuc/022:40:140
6732993715,4cyclictest111rcuc/022:40:140
42732371,32sleep14284-21ssh21:31:561
133072371,3sleep10-21swapper/123:21:361
6732993621,5cyclictest3-21ksoftirqd/021:09:460
6732993620,6cyclictest3-21ksoftirqd/023:38:100
6732993620,5cyclictest3-21ksoftirqd/000:33:450
6732993619,6cyclictest3-21ksoftirqd/000:53:410
6732993619,5cyclictest3-21ksoftirqd/020:38:400
6732993619,4cyclictest24155-21ssh00:06:110
6733993511,5cyclictest49922grep22:40:141
6733993511,5cyclictest49922grep22:40:141
673299352,19cyclictest17559-21awk22:20:000
6732993520,5cyclictest3-21ksoftirqd/020:22:560
6732993519,6cyclictest3-21ksoftirqd/020:45:430
6732993519,6cyclictest3-21ksoftirqd/020:14:250
6732993519,5cyclictest3-21ksoftirqd/023:12:590
6732993518,6cyclictest3-21ksoftirqd/021:25:000
6732993518,6cyclictest3-21ksoftirqd/019:31:130
6732993513,5cyclictest12229-21users21:00:330
673299351,22cyclictest19829-21wget21:15:140
50652351,4sleep15079-21ssh23:13:411
7262341,29sleep1740-21ssh22:01:481
673399341,6cyclictest81rcu_preempt23:00:521
6733993416,5cyclictest22-21ksoftirqd/123:53:161
673399341,14cyclictest0-21swapper/121:19:211
6732993419,5cyclictest3-21ksoftirqd/019:49:440
6732993419,5cyclictest3-21ksoftirqd/019:43:430
6732993418,6cyclictest3-21ksoftirqd/021:40:090
6732993418,6cyclictest3-21ksoftirqd/020:27:490
6732993418,5cyclictest3-21ksoftirqd/020:57:480
6732993418,5cyclictest3-21ksoftirqd/020:01:440
673299341,11cyclictest19337-21fschecks_count00:35:200
215642341,6sleep10-21swapper/123:30:241
673399337,5cyclictest40950irq/93-i91522:23:101
673399336,5cyclictest180172idleruntime00:00:211
673399333,5cyclictest81rcu_preempt21:39:181
6733993316,13cyclictest22-21ksoftirqd/122:18:191
673399331,5cyclictest81rcu_preempt20:33:291
6733993310,19cyclictest0-21swapper/100:42:291
6732993318,5cyclictest3-21ksoftirqd/022:21:320
6732993317,6cyclictest3-21ksoftirqd/020:34:080
6732993317,5cyclictest3-21ksoftirqd/023:47:180
64712330,5sleep1201rcuc/123:15:121
64712330,5sleep1201rcuc/123:15:121
326192331,28sleep132632-21diskstats22:35:151
673399322,5cyclictest0-21swapper/122:49:191
673399321,4cyclictest81rcu_preempt23:25:591
673299329,8cyclictest3-21ksoftirqd/021:39:180
6732993216,5cyclictest3-21ksoftirqd/021:54:140
299012320,29sleep129911-21ssh22:31:551
111152320,4sleep0111rcuc/023:53:190
673399319,5cyclictest40950irq/93-i91521:45:321
673399318,19cyclictest0-21swapper/123:39:171
673399315,12cyclictest0-21swapper/121:56:201
673399314,23cyclictest0-21swapper/122:09:001
6733993115,10cyclictest22-21ksoftirqd/121:41:141
673399311,3cyclictest0-21swapper/120:15:121
6732993116,4cyclictest3-21ksoftirqd/019:52:140
6732993110,11cyclictest30944-21snmpd20:50:300
299402311,5sleep00-21swapper/021:59:070
673399304,11cyclictest0-21swapper/121:12:541
6733993017,9cyclictest22-21ksoftirqd/122:53:561
6733993017,9cyclictest22-21ksoftirqd/121:54:561
6733993017,9cyclictest22-21ksoftirqd/100:06:311
673399301,4cyclictest81rcu_preempt20:36:381
673399301,4cyclictest81rcu_preempt00:28:221
673399300,4cyclictest81rcu_preempt22:56:211
673299302,12cyclictest0-21swapper/022:08:170
6732993014,6cyclictest3-21ksoftirqd/023:56:330
6732993013,5cyclictest4472-21sed20:40:280
6732993010,16cyclictest2220-21dbus-daemon00:43:390
307252301,25sleep030729-21diskstats23:40:140
673399299,17cyclictest0-21swapper/122:25:171
673399299,16cyclictest0-21swapper/123:40:221
673399294,4cyclictest81rcu_preempt00:16:091
673399293,23cyclictest0-21swapper/100:46:311
673399292,13cyclictest8487-21diskstats22:10:151
6733992917,9cyclictest22-21ksoftirqd/121:20:401
6733992917,8cyclictest22-21ksoftirqd/123:49:391
6733992916,10cyclictest22-21ksoftirqd/100:33:011
673299291,15cyclictest22238-21seq23:30:320
66082291,5sleep10-21swapper/120:45:501
223222291,5sleep10-21swapper/120:04:031
164862291,5sleep10-21swapper/119:47:081
128302291,5sleep10-21swapper/121:05:061
673399282,4cyclictest81rcu_preempt20:22:531
673399282,12cyclictest30944-21snmpd21:00:321
6733992818,6cyclictest16949-21cut19:50:131
6733992816,8cyclictest22-21ksoftirqd/123:05:391
673399281,23cyclictest20742-21ssh00:36:051
673399280,4cyclictest81rcu_preempt19:43:441
315972281,5sleep10-21swapper/120:27:411
259432281,5sleep10-21swapper/120:12:401
88662271,5sleep10-21swapper/120:54:441
673399278,15cyclictest0-21swapper/120:40:291
673399271,4cyclictest81rcu_preempt19:56:291
6733992711,3cyclictest0-21swapper/100:23:331
6732992712,5cyclictest3-21ksoftirqd/020:05:500
239162271,5sleep10-21swapper/120:06:101
6733992618,4cyclictest22-21ksoftirqd/120:55:301
6733992617,6cyclictest22-21ksoftirqd/119:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional