You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 14:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Fri Sep 04, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63589912211203,15cyclictest0-21swapper/119:25:081
63579911261098,23cyclictest0-21swapper/019:25:050
63589911081088,17cyclictest0-21swapper/119:45:001
56102582535,31sleep10-21swapper/119:20:291
62862510462,32sleep00-21swapper/019:24:510
635799227202,18cyclictest14624-21date19:45:000
292262540,9sleep0635799cyclictest00:40:190
6358995225,4cyclictest22-21ksoftirqd/120:05:181
6358995115,5cyclictest22-21ksoftirqd/121:00:111
6358994914,6cyclictest22-21ksoftirqd/122:00:231
6358994815,6cyclictest22-21ksoftirqd/122:40:261
6358994815,6cyclictest22-21ksoftirqd/122:40:251
6358994815,6cyclictest22-21ksoftirqd/120:39:411
6358994815,5cyclictest22-21ksoftirqd/121:36:541
6358994815,5cyclictest22-21ksoftirqd/120:21:561
6358994814,6cyclictest22-21ksoftirqd/123:36:021
6358994814,6cyclictest22-21ksoftirqd/121:30:171
6358994716,6cyclictest22-21ksoftirqd/119:30:261
6358994715,6cyclictest22-21ksoftirqd/100:10:481
6358994714,6cyclictest22-21ksoftirqd/123:40:241
6358994625,11cyclictest22-21ksoftirqd/121:10:171
6358994625,10cyclictest22-21ksoftirqd/123:45:171
6358994624,4cyclictest22-21ksoftirqd/121:48:591
6358994616,6cyclictest22-21ksoftirqd/120:30:151
6358994616,5cyclictest22-21ksoftirqd/123:00:261
6358994614,5cyclictest22-21ksoftirqd/123:25:131
6358994614,5cyclictest22-21ksoftirqd/121:15:241
6358994614,5cyclictest22-21ksoftirqd/100:51:331
168622461,28sleep016972-21timerwakeupswit22:40:310
168622461,28sleep016972-21timerwakeupswit22:40:300
635899452,5cyclictest23001-21/usr/sbin/munin00:25:111
6358994522,11cyclictest22-21ksoftirqd/122:55:151
6358994514,9cyclictest22-21ksoftirqd/121:50:141
6358994422,7cyclictest22-21ksoftirqd/100:35:291
6358994414,6cyclictest22-21ksoftirqd/121:55:211
6358994414,6cyclictest22-21ksoftirqd/121:55:211
6358994414,4cyclictest22-21ksoftirqd/121:23:261
635899437,6cyclictest22-21ksoftirqd/123:55:291
6358994328,4cyclictest22-21ksoftirqd/121:05:141
6358994327,4cyclictest22-21ksoftirqd/100:05:271
6358994326,7cyclictest22-21ksoftirqd/122:10:191
6358994324,4cyclictest22-21ksoftirqd/123:20:141
6358994324,4cyclictest22-21ksoftirqd/122:37:261
6358994313,6cyclictest22-21ksoftirqd/121:40:271
6358994312,5cyclictest22-21ksoftirqd/123:05:261
6358994311,5cyclictest22-21ksoftirqd/122:34:341
6358994226,3cyclictest22-21ksoftirqd/122:28:291
6358994225,3cyclictest22-21ksoftirqd/122:20:001
6358994221,4cyclictest22-21ksoftirqd/100:30:131
6358994215,10cyclictest22-21ksoftirqd/119:55:031
6358994214,9cyclictest22-21ksoftirqd/122:05:151
6358994213,9cyclictest22-21ksoftirqd/120:40:101
635899418,21cyclictest30429-21wc20:25:231
6358994127,4cyclictest22-21ksoftirqd/123:10:191
6358994127,4cyclictest22-21ksoftirqd/100:25:001
6358994126,4cyclictest22-21ksoftirqd/100:40:171
6358994124,4cyclictest22-21ksoftirqd/121:25:171
6358994123,4cyclictest22-21ksoftirqd/120:00:111
6358994122,4cyclictest22-21ksoftirqd/120:15:101
6358994119,4cyclictest22-21ksoftirqd/122:50:281
6358994111,5cyclictest22-21ksoftirqd/120:50:231
635899407,5cyclictest24651-21iostat20:10:181
635899403,6cyclictest8315-21/usr/sbin/munin22:20:261
6358994026,4cyclictest22-21ksoftirqd/123:50:131
6358994026,4cyclictest22-21ksoftirqd/122:45:271
6358994026,4cyclictest22-21ksoftirqd/120:50:001
6358994026,4cyclictest22-21ksoftirqd/119:50:161
6358994026,4cyclictest22-21ksoftirqd/119:45:141
6358994025,5cyclictest22-21ksoftirqd/120:55:241
6358994025,4cyclictest22-21ksoftirqd/100:20:011
6358994020,4cyclictest22-21ksoftirqd/100:05:021
6358993925,4cyclictest22-21ksoftirqd/123:30:201
6358993925,4cyclictest22-21ksoftirqd/123:15:121
6358993925,4cyclictest22-21ksoftirqd/119:35:111
6358993925,4cyclictest22-21ksoftirqd/100:45:111
6358993920,5cyclictest22-21ksoftirqd/100:15:171
635799368,15cyclictest31734-21unixbench_multi00:45:300
635799361,20cyclictest9476-21ntp_states20:55:240
635799359,14cyclictest2225-21dbus-daemon19:56:160
635799349,10cyclictest22268-21fschecks_time21:30:200
635799341,21cyclictest1994-21taskset23:29:410
635799338,13cyclictest470-21taskset21:59:550
635799338,13cyclictest470-21taskset21:59:550
635799337,13cyclictest81rcu_preempt23:25:010
6357993313,7cyclictest11038-21snmpd19:51:370
635799331,18cyclictest14720-21wget19:45:120
635799331,13cyclictest0-21swapper/022:02:240
105502331,9sleep00-21swapper/019:33:100
635799327,4cyclictest81rcu_preempt00:39:240
635799324,4cyclictest81rcu_preempt20:00:270
6357993210,5cyclictest30813-21latency_hist23:20:010
190112321,5sleep00-21swapper/022:45:410
635799311,4cyclictest81rcu_preempt22:16:580
635799311,4cyclictest81rcu_preempt20:18:580
635799308,7cyclictest28173-21wc23:10:310
635799306,4cyclictest81rcu_preempt23:46:510
635799302,15cyclictest28306-21perl20:20:170
635799301,4cyclictest81rcu_preempt20:36:140
635799301,4cyclictest81rcu_preempt20:25:420
151262301,5sleep00-21swapper/000:03:040
635799299,4cyclictest23365-21/usr/sbin/munin23:00:190
635799297,7cyclictest3706-21switchtime22:05:300
635799293,19cyclictest20425-21ntp_states22:50:290
635799291,4cyclictest81rcu_preempt23:34:310
635799291,4cyclictest81rcu_preempt00:24:260
635799291,4cyclictest81rcu_preempt00:19:270
635799291,4cyclictest81rcu_preempt00:19:260
635799291,3cyclictest81rcu_preempt23:41:480
635799291,20cyclictest0-21swapper/021:21:230
635799291,14cyclictest11565-21gdbus20:14:210
6357992910,15cyclictest269572chrt21:41:170
288582291,5sleep00-21swapper/021:46:330
227732291,5sleep00-21swapper/022:55:480
154772291,3sleep015571-21/usr/sbin/munin00:05:120
112762291,5sleep00-21swapper/023:52:180
98312281,5sleep00-21swapper/022:23:010
65902281,4sleep00-21swapper/020:49:490
635799283,4cyclictest81rcu_preempt22:11:480
635799282,4cyclictest81rcu_preempt22:38:440
635799282,4cyclictest81rcu_preempt20:34:140
635799282,13cyclictest22979-21/usr/sbin/munin20:05:250
635799281,4cyclictest81rcu_preempt21:07:500
635799281,4cyclictest81rcu_preempt20:43:300
635799281,3cyclictest81rcu_preempt00:27:520
635799281,15cyclictest0-21swapper/000:10:160
635799281,12cyclictest8317-21taskset20:53:150
41652281,5sleep00-21swapper/023:35:080
308962281,5sleep00-21swapper/021:53:130
157862281,5sleep00-21swapper/021:12:350
131162281,5sleep00-21swapper/023:56:560
118672281,5sleep00-21swapper/022:29:380
635799272,21cyclictest11697-21ntpdc19:35:220
265252271,5sleep00-21swapper/000:34:220
214652271,5sleep00-21swapper/021:27:540
177292271,5sleep00-21swapper/021:18:150
119562271,5sleep00-21swapper/021:01:520
6357992618,5cyclictest24906-21tail21:35:280
635799261,13cyclictest13350-21/usr/sbin/munin22:30:340
324322261,5sleep00-21swapper/000:50:050
635799231,14cyclictest0-21swapper/023:07:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional