You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 21:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Dec 19, 2025 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
218609911891143,42cyclictest138250irq/90-eth007:25:100
218619910961086,6cyclictest26295-21apt-get07:35:011
217042515470,30sleep00-21swapper/007:23:570
214582458364,30sleep10-21swapper/107:21:201
21860992832,5cyclictest26270-21latency_hist07:35:010
2186199195187,5cyclictest0-21swapper/107:25:111
14262850,8sleep02186099cyclictest10:25:220
71462780,4sleep041ktimersoftd/010:31:160
123152670,4sleep0111rcuc/012:25:260
75382511,31sleep17550-21iostat_ios09:20:201
177032450,8sleep12186199cyclictest10:43:491
240232440,5sleep02186099cyclictest09:38:570
125952440,8sleep02186099cyclictest11:14:280
21860994014,8cyclictest3-21ksoftirqd/012:09:500
101792401,35sleep110189-21sh12:23:431
277312390,3sleep0111rcuc/011:30:290
252182390,4sleep1211ktimersoftd/110:51:301
2186099392,7cyclictest18549-21ssh12:32:440
21860993924,5cyclictest3-21ksoftirqd/009:34:480
16002391,4sleep11667-21uname10:25:271
7272384,4sleep181rcu_preempt11:00:291
2186099387,5cyclictest81rcu_preempt12:39:450
2186099382,30cyclictest29902-21diskmemload11:39:160
2186099382,30cyclictest29902-21diskmemload11:39:150
2186099374,5cyclictest0-21swapper/009:15:150
2186099374,29cyclictest0-21swapper/011:20:460
2186199364,30cyclictest0-21swapper/112:47:361
21861993626,6cyclictest20474-21ssh11:59:201
2186099367,15cyclictest13162-21ssh10:02:140
2186099365,9cyclictest0-21swapper/011:25:560
2186099362,30cyclictest4755-21perl11:05:150
2186099362,30cyclictest31888-21apt-get07:49:360
21860993611,13cyclictest20242-21taskset08:42:300
2186199351,5cyclictest21840-21ssh11:24:561
2186199351,12cyclictest3583-21wc09:15:291
21860993519,5cyclictest3-21ksoftirqd/010:10:200
21860993516,5cyclictest3-21ksoftirqd/009:20:260
21860993514,5cyclictest3-21ksoftirqd/012:11:000
325272340,30sleep129902-21diskmemload09:48:061
250912341,5sleep025103-21ssh12:04:340
220832341,11sleep00-21swapper/008:47:050
2186199349,4cyclictest22-21ksoftirqd/109:55:581
2186199346,4cyclictest81rcu_preempt12:06:541
2186199346,4cyclictest81rcu_preempt10:01:111
21861993425,5cyclictest0-21swapper/111:29:351
2186199342,29cyclictest0-21swapper/109:10:561
2186199341,5cyclictest10027-21ssh11:46:551
2186199341,28cyclictest29902-21diskmemload09:40:171
2186199341,14cyclictest277272mailstats11:30:291
2186099345,4cyclictest81rcu_preempt09:00:220
21860993416,6cyclictest3-21ksoftirqd/011:50:500
2186099341,5cyclictest18066-21ssh10:07:560
2186099341,4cyclictest29902-21diskmemload12:19:170
21860993413,5cyclictest3-21ksoftirqd/010:15:420
2186099341,29cyclictest2403-21irqbalance09:49:150
2186099341,29cyclictest2309-21cron10:50:010
2186099341,29cyclictest19596-21kworker/0:212:41:560
2186099341,28cyclictest29902-21diskmemload12:21:170
2186099341,28cyclictest29902-21diskmemload11:47:170
248932330,8sleep12186199cyclictest10:15:211
2186199336,13cyclictest0-21swapper/111:17:321
2186199335,4cyclictest81rcu_preempt09:54:321
2186199334,4cyclictest81rcu_preempt10:11:421
2186199334,4cyclictest81rcu_preempt10:05:361
2186199332,18cyclictest0-21swapper/109:37:201
2186199331,7cyclictest9129-21ssh10:34:281
2186099334,4cyclictest81rcu_preempt11:59:160
21860993316,6cyclictest3-21ksoftirqd/010:41:180
21860993316,6cyclictest3-21ksoftirqd/007:41:430
2186099331,5cyclictest0-21swapper/010:22:360
2186099331,20cyclictest9068-21taskset08:13:500
102212331,28sleep010230-21ssh09:59:470
322322321,4sleep032240-21ssh09:11:330
2186199328,4cyclictest81rcu_preempt10:35:121
2186199324,4cyclictest81rcu_preempt10:45:431
2186199323,4cyclictest81rcu_preempt12:00:581
2186199321,5cyclictest0-21swapper/108:48:551
2186199321,4cyclictest81rcu_preempt09:31:301
2186199321,4cyclictest2403-21irqbalance12:31:361
2186199321,4cyclictest2298-21kworker/1:107:58:161
2186199321,28cyclictest0-21swapper/108:05:161
2186199321,20cyclictest4862-21ssh11:40:481
21861993211,7cyclictest3171-21/usr/sbin/munin12:15:241
21861993210,4cyclictest22-21ksoftirqd/112:41:221
2186099324,4cyclictest81rcu_preempt11:41:190
21860993216,5cyclictest3-21ksoftirqd/012:49:130
2186099321,4cyclictest81rcu_preempt10:53:070
21860993213,6cyclictest13712-21iostat08:25:180
21860993213,6cyclictest10019-21df_inode10:35:120
2186099321,29cyclictest0-21swapper/009:50:350
2186099321,28cyclictest0-21swapper/009:29:160
21860993212,7cyclictest2645-21snmpd10:56:120
143502320,4sleep1201rcuc/108:25:281
45512311,3sleep04555-21ntp_states08:00:250
2186199315,4cyclictest81rcu_preempt08:20:491
2186199315,22cyclictest0-21swapper/110:58:081
21861993124,5cyclictest0-21swapper/109:05:361
2186199311,4cyclictest81rcu_preempt12:35:141
2186199311,27cyclictest0-21swapper/112:27:361
21861993112,5cyclictest26460-21/usr/sbin/munin07:35:181
2186199310,4cyclictest81rcu_preempt08:01:061
21860993114,6cyclictest3-21ksoftirqd/008:34:210
21860993111,6cyclictest32685-21taskset11:00:180
18562311,5sleep10-21swapper/112:14:571
124382311,4sleep129902-21diskmemload11:14:141
2186199305,4cyclictest81rcu_preempt07:47:171
2186199305,4cyclictest81rcu_preempt07:44:141
21861993011,6cyclictest16719-21cron08:34:591
2186099301,8cyclictest27665-21grep07:35:300
2186099301,27cyclictest0-21swapper/008:20:370
21860993011,6cyclictest1142-21iostat_ios12:50:190
21860993010,7cyclictest25005-21sh09:40:120
152122301,5sleep00-21swapper/011:16:280
239712291,5sleep00-21swapper/008:52:140
2186199294,4cyclictest81rcu_preempt08:16:091
2186199291,8cyclictest2251-21ssh12:51:071
2186199291,4cyclictest81rcu_preempt11:53:421
2186199291,11cyclictest0-21swapper/111:37:091
2186199291,11cyclictest0-21swapper/111:37:081
21860992924,3cyclictest0-21swapper/008:15:160
2186099292,22cyclictest312-21perl07:50:160
2186099292,15cyclictest18144-21/usr/sbin/munin08:35:310
2186099291,15cyclictest28481-21/usr/sbin/munin09:05:150
2186099291,11cyclictest0-21swapper/008:06:170
275142281,9sleep10-21swapper/109:00:301
2186199286,19cyclictest0-21swapper/110:21:321
2186199284,8cyclictest7770-21diskstats08:10:151
2186199282,3cyclictest81rcu_preempt11:06:151
21861992815,5cyclictest22-21ksoftirqd/109:26:391
21861992813,5cyclictest40550irq/92-i91508:45:011
2186199281,19cyclictest0-21swapper/108:50:121
2186099281,13cyclictest1879-21cpuspeed_turbos07:55:110
21860992810,5cyclictest24591-21cpuspeed_turbos08:55:130
11462271,5sleep10-21swapper/107:50:541
259012261,5sleep10-21swapper/108:57:501
2186199257,5cyclictest40550irq/92-i91508:35:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional