You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 18:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Dec 21, 2025 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
156099912801234,24cyclictest22-21ksoftirqd/107:35:011
156099912693,1248cyclictest0-21swapper/107:25:111
156089912301220,7cyclictest0-21swapper/007:25:110
153952564518,31sleep10-21swapper/107:23:201
151682445399,31sleep00-21swapper/007:20:590
1560899222199,16cyclictest20043-21apt-get07:35:000
197252990,5sleep00-21swapper/010:45:220
310912940,3sleep1201rcuc/112:36:571
264872840,4sleep122-21ksoftirqd/111:59:331
119552810,5sleep08043-1kworker/0:2H11:10:240
204252650,3sleep015111-21kworker/0:011:20:010
283622490,3sleep0111rcuc/010:20:290
303532460,3sleep00-21swapper/012:35:530
34662440,8sleep01560899cyclictest11:01:340
192582430,26sleep10-21swapper/111:51:051
1560899432,18cyclictest4227-21ssh09:55:320
70492410,8sleep01560899cyclictest12:12:120
49822400,24sleep122-21ksoftirqd/109:23:381
15608994022,6cyclictest3-21ksoftirqd/010:58:020
274632390,8sleep11560999cyclictest07:54:011
15608993917,4cyclictest3-21ksoftirqd/012:00:170
15609993827,6cyclictest29480-21ssh10:21:501
233652371,19sleep10-21swapper/111:22:201
1560999376,5cyclictest81rcu_preempt09:43:471
1560899377,4cyclictest0-21swapper/010:35:160
15608993715,6cyclictest8026-21diskstats11:40:150
15608993715,6cyclictest8026-21diskstats11:40:150
200142361,4sleep120025-21ssh11:19:301
1560999362,30cyclictest0-21swapper/111:32:551
1560899369,14cyclictest936-21vmstat12:05:310
1560899362,29cyclictest27435-21ssh10:53:320
1560899361,4cyclictest81rcu_preempt12:23:270
15608993611,12cyclictest15620-21latency_hist09:35:000
154102360,8sleep11560999cyclictest10:07:271
274162351,4sleep02206-21dbus-daemon07:53:310
1560999355,5cyclictest81rcu_preempt09:45:141
1560999354,4cyclictest81rcu_preempt11:35:131
1560999353,30cyclictest0-21swapper/107:59:551
1560999353,13cyclictest0-21swapper/110:25:501
1560999352,5cyclictest0-21swapper/112:08:161
1560999352,29cyclictest0-21swapper/112:02:161
1560999351,5cyclictest5316-21diskstats08:20:151
15608993518,5cyclictest3-21ksoftirqd/010:29:570
1560899351,20cyclictest17612-21ssh09:35:530
31662340,30sleep13342-21/usr/sbin/munin08:15:121
310302340,7sleep01560899cyclictest09:50:190
269512341,4sleep126965-21ssh09:12:461
1560999349,13cyclictest0-21swapper/110:32:101
1560999349,13cyclictest0-21swapper/110:32:091
1560999348,9cyclictest23967-21sh10:15:521
1560999342,7cyclictest0-21swapper/109:28:561
1560999342,19cyclictest0-21swapper/112:30:151
1560899348,22cyclictest0-21swapper/012:29:120
1560899341,7cyclictest27740-21ssh11:26:380
15608993414,7cyclictest3-21ksoftirqd/010:16:350
1560899341,31cyclictest0-21swapper/009:05:360
1560899341,30cyclictest0-21swapper/007:47:360
1560899341,29cyclictest20971-21ssh10:13:310
15608993411,5cyclictest3-21ksoftirqd/009:46:210
15608993411,10cyclictest0-21swapper/010:05:160
84312330,4sleep041ktimersoftd/010:34:110
84312330,4sleep041ktimersoftd/010:34:110
320872330,8sleep01560899cyclictest11:30:570
214152331,28sleep121426-21cron12:27:001
1560999336,4cyclictest81rcu_preempt09:34:181
1560999334,4cyclictest81rcu_preempt12:15:381
1560999334,4cyclictest81rcu_preempt09:02:441
1560999333,4cyclictest81rcu_preempt10:40:161
1560999333,4cyclictest81rcu_preempt10:03:551
1560999333,4cyclictest81rcu_preempt10:03:551
15609993324,5cyclictest22-21ksoftirqd/110:52:571
1560999331,4cyclictest9908-21ssh11:41:361
1560999331,4cyclictest9908-21ssh11:41:351
1560899334,4cyclictest81rcu_preempt12:52:150
1560899331,30cyclictest0-21swapper/008:49:560
196432321,5sleep00-21swapper/008:57:270
166292321,5sleep10-21swapper/111:49:191
1560999327,4cyclictest81rcu_preempt12:10:251
1560999324,4cyclictest81rcu_preempt08:59:001
15609993224,6cyclictest0-21swapper/109:55:361
1560999321,29cyclictest0-21swapper/112:44:161
1560999321,29cyclictest0-21swapper/109:17:351
1560899329,9cyclictest23422-21smartctl11:55:290
15608993225,5cyclictest0-21swapper/008:02:160
1560899322,26cyclictest0-21swapper/009:15:110
15608993216,5cyclictest3-21ksoftirqd/012:40:190
15608993214,6cyclictest3-21ksoftirqd/012:19:270
15608993213,5cyclictest6861-21iostat09:25:190
1560899321,29cyclictest0-21swapper/007:57:560
1560899321,28cyclictest0-21swapper/011:53:350
1560899321,15cyclictest5023-21/usr/sbin/munin08:20:270
15608993211,5cyclictest3-21ksoftirqd/011:45:010
1560899321,10cyclictest22353-21ssh09:40:430
15608993210,7cyclictest3116-21df11:35:140
210352311,4sleep121042-21ntpq07:35:251
165492311,4sleep116567-21sh09:35:201
1560999314,4cyclictest81rcu_preempt07:48:501
1560999314,24cyclictest0-21swapper/111:06:401
1560999312,25cyclictest0-21swapper/110:57:331
1560999311,16cyclictest14295-21cat08:45:001
1560999311,15cyclictest17910-21runrttasks08:53:571
1560899312,14cyclictest6121-21/usr/sbin/munin11:05:300
1560899311,4cyclictest0-21swapper/008:44:560
15608993114,6cyclictest3-21ksoftirqd/011:21:340
1560899311,27cyclictest0-21swapper/010:03:310
1560899311,27cyclictest0-21swapper/010:03:300
1560899311,27cyclictest0-21swapper/009:23:300
15608993112,6cyclictest24122-21diskstats12:30:150
1560899311,20cyclictest0-21swapper/008:05:340
85542301,5sleep00-21swapper/008:29:270
1560999305,4cyclictest81rcu_preempt10:11:351
1560999301,5cyclictest0-21swapper/107:40:421
1560999301,4cyclictest81rcu_preempt11:27:431
1560999301,4cyclictest81rcu_preempt10:45:421
1560999301,4cyclictest81rcu_preempt09:50:581
1560999301,27cyclictest0-21swapper/108:25:151
1560999301,17cyclictest14002-21ssh12:20:021
1560999300,4cyclictest81rcu_preempt08:36:061
1560899309,10cyclictest0-21swapper/012:47:490
1560899302,15cyclictest1420-21diskstats08:10:150
1560899301,27cyclictest0-21swapper/010:41:320
15608993012,6cyclictest21258-21/usr/sbin/munin07:35:280
15608993011,6cyclictest24409-21fschecks_time09:10:150
235272291,5sleep00-21swapper/007:42:040
215602291,5sleep00-21swapper/009:02:410
1560999294,4cyclictest81rcu_preempt08:12:581
15609992922,4cyclictest1968-21lldpad12:49:051
15609992919,6cyclictest11968-21ssh12:51:461
1560999291,4cyclictest81rcu_preempt11:03:091
1560999291,4cyclictest81rcu_preempt10:39:531
1560999291,10cyclictest0-21swapper/108:30:181
1560899293,13cyclictest0-21swapper/008:50:120
101072291,5sleep00-21swapper/008:31:060
314432281,5sleep10-21swapper/108:03:591
15609992821,4cyclictest6691-21kworker/1:109:07:551
1560999281,4cyclictest81rcu_preempt08:06:041
1560999281,16cyclictest81rcu_preempt11:10:291
15608992810,14cyclictest47612chrt08:19:150
1560999271,22cyclictest14423-21/usr/sbin/munin08:45:251
1560899262,5cyclictest11246-21/usr/sbin/munin08:35:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional