You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 13:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Jan 07, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202569912851238,30cyclictest16500-21kworker/0:219:25:090
202579911931174,15cyclictest25542-21strings19:35:221
202579910901081,6cyclictest0-21swapper/119:25:131
199282652606,31sleep10-21swapper/119:22:071
184972590543,30sleep00-21swapper/019:20:130
2025699157134,18cyclictest0-21swapper/019:35:220
1465021050,9sleep02025699cyclictest21:29:240
291502860,8sleep02025699cyclictest19:45:190
228682830,3sleep03-21ksoftirqd/023:50:270
118302730,7sleep02025699cyclictest22:00:000
274812630,2sleep10-21swapper/119:40:231
53942610,2sleep05392-21cat21:20:000
99372600,22sleep03-21ksoftirqd/020:20:170
53782580,2sleep05376-21sed22:25:310
182922560,8sleep02025699cyclictest23:12:570
95822430,3sleep1211ktimersoftd/123:37:071
121062420,8sleep12025799cyclictest20:25:271
2025799397,5cyclictest81rcu_preempt22:21:391
2025699391,34cyclictest0-21swapper/023:23:160
253382380,6sleep02025699cyclictest00:26:460
2025699387,27cyclictest0-21swapper/021:50:350
2025699386,5cyclictest8409-21sed23:35:300
2025799376,4cyclictest81rcu_preempt21:42:261
2025799375,4cyclictest81rcu_preempt23:08:401
166682371,5sleep116682-21ssh22:37:531
104352371,5sleep110449-21ssh21:58:031
89412361,31sleep08951-21ssh00:43:590
202852360,7sleep10-21swapper/122:41:041
2025799362,5cyclictest0-21swapper/123:34:551
20257993610,13cyclictest13786-21tune2fs00:15:171
2025699365,27cyclictest0-21swapper/022:03:160
2025699364,19cyclictest0-21swapper/022:18:590
2025699361,5cyclictest81rcu_preempt00:00:410
20256993610,14cyclictest0-21swapper/000:10:260
290352351,30sleep029049-21ssh21:44:110
2025799359,23cyclictest22-21ksoftirqd/100:35:361
2025799355,5cyclictest81rcu_preempt21:50:191
20257993527,6cyclictest0-21swapper/100:31:361
2025799351,5cyclictest5489-21cstates00:40:151
2025799351,31cyclictest0-21swapper/120:52:361
2025699353,28cyclictest0-21swapper/023:25:560
2025699352,29cyclictest4525-21ssh00:39:280
20256993519,5cyclictest3-21ksoftirqd/021:11:170
2025699351,29cyclictest1582-21ssh21:49:230
2025699351,24cyclictest0-21swapper/000:45:120
175452351,4sleep117555-21ssh00:54:371
2025799346,4cyclictest81rcu_preempt21:47:101
2025799344,5cyclictest81rcu_preempt00:20:281
2025799344,5cyclictest81rcu_preempt00:20:281
2025799342,5cyclictest81rcu_preempt22:31:301
2025699342,29cyclictest0-21swapper/023:34:350
2025699341,5cyclictest2403-21irqbalance23:47:150
20256993413,6cyclictest27164-21memory23:55:230
2025699341,30cyclictest0-21swapper/000:16:360
20256993412,7cyclictest24958-21ssh22:45:510
20256993410,5cyclictest1191-21iostat_ios22:55:210
96622331,5sleep00-21swapper/021:24:110
64702331,29sleep16516-21grep21:20:241
209542331,28sleep020963-21df_inode20:50:130
2025799336,4cyclictest81rcu_preempt22:50:051
2025799335,4cyclictest81rcu_preempt21:25:381
2025799335,4cyclictest81rcu_preempt21:08:151
20257993326,5cyclictest0-21swapper/100:29:351
20257993326,4cyclictest24011-21ssh21:38:551
2025799332,28cyclictest0-21swapper/121:11:351
2025799331,30cyclictest0-21swapper/120:57:561
20256993326,5cyclictest0-21swapper/020:40:350
2025699332,28cyclictest0-21swapper/021:35:550
2025699332,13cyclictest0-21swapper/000:20:290
2025699332,13cyclictest0-21swapper/000:20:280
20256993317,5cyclictest3-21ksoftirqd/022:30:270
20256993316,5cyclictest3-21ksoftirqd/022:50:310
2025699331,30cyclictest0-21swapper/022:23:150
2025699331,29cyclictest0-21swapper/021:31:230
2025699331,28cyclictest2309-21cron22:40:000
20256993312,5cyclictest3-21ksoftirqd/000:05:060
255242321,4sleep125538-21ssh22:46:421
2025799327,4cyclictest81rcu_preempt19:31:421
2025799325,15cyclictest0-21swapper/123:00:111
2025799324,4cyclictest81rcu_preempt22:25:391
2025799323,4cyclictest81rcu_preempt22:57:371
2025799321,3cyclictest0-21swapper/122:04:161
2025799321,29cyclictest0-21swapper/120:10:351
2025799321,28cyclictest22898-21ssh23:17:361
2025699323,16cyclictest0-21swapper/000:54:420
2025699322,14cyclictest19860-21sh22:40:280
2025699322,12cyclictest11253-21ntp_states23:05:240
20256993218,4cyclictest3-21ksoftirqd/023:15:120
2025699321,29cyclictest0-21swapper/020:58:150
20256993210,17cyclictest13297-21cpu20:30:120
156382321,27sleep115140-21/usr/sbin/munin23:10:171
251102310,8sleep02025699cyclictest22:13:140
2025799318,4cyclictest228672awk23:50:281
2025799315,4cyclictest81rcu_preempt19:58:031
2025799314,4cyclictest81rcu_preempt00:05:451
2025799313,11cyclictest15844-21ntp_states20:35:241
20257993124,4cyclictest3269-21ntpd23:40:261
2025799311,4cyclictest1968-21lldpad23:28:571
2025699317,13cyclictest81rcu_preempt20:15:220
2025699312,15cyclictest0-21swapper/022:10:000
2025699311,4cyclictest0-21swapper/023:02:350
20256993110,7cyclictest6869-21unixbench_singl20:10:290
286152301,5sleep10-21swapper/123:23:521
2025799308,4cyclictest81rcu_preempt23:47:001
2025799307,4cyclictest81rcu_preempt20:02:181
2025799302,4cyclictest81rcu_preempt00:01:551
2025799301,5cyclictest81rcu_preempt21:31:381
2025799301,5cyclictest0-21swapper/122:05:421
2025799301,4cyclictest81rcu_preempt22:11:021
2025799301,27cyclictest0-21swapper/122:16:161
20256993011,6cyclictest24938-21perl21:00:190
2025699301,14cyclictest13317-21users23:40:300
20256993010,7cyclictest24636-21munin-run19:35:000
20256993010,4cyclictest0-21swapper/000:32:080
12002301,5sleep00-21swapper/019:56:140
2025799294,4cyclictest81rcu_preempt20:42:481
2025799294,18cyclictest28855-21diskstats19:45:151
2025799294,17cyclictest0-21swapper/121:00:081
2025799292,4cyclictest81rcu_preempt23:55:371
20257992916,5cyclictest22-21ksoftirqd/121:15:321
2025799291,4cyclictest81rcu_preempt00:47:471
2025799291,4cyclictest81rcu_preempt00:13:101
2025799291,25cyclictest22-21ksoftirqd/120:32:361
2025699291,14cyclictest19794-21cut20:45:260
20256992910,6cyclictest81rcu_preempt20:00:240
157082290,5sleep0111rcuc/020:35:210
91442281,5sleep10-21swapper/120:19:211
2025799284,18cyclictest4041-21diskstats20:05:161
2025799282,4cyclictest81rcu_preempt20:24:411
2025799281,4cyclictest81rcu_preempt20:45:571
2025699281,17cyclictest0-21swapper/021:05:200
2025699281,14cyclictest4773-21swap20:05:290
2025699281,13cyclictest26908-21/usr/sbin/munin19:40:120
2025799274,4cyclictest81rcu_preempt19:52:261
20256992711,4cyclictest30732-21diskstats19:50:150
2025699271,13cyclictest12913-21taskset20:29:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional