You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 03:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot4s (updated Wed Jul 22, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26329911921182,7cyclictest0-21swapper/119:25:091
26329911421119,20cyclictest0-21swapper/120:05:151
23042564519,29sleep10-21swapper/119:22:161
15272563517,30sleep00-21swapper/019:20:230
263199147137,7cyclictest0-21swapper/019:25:090
2631999673,17cyclictest19008-21cut20:05:160
84542560,3sleep18452-21aten_r4power_cu22:30:121
172702471,33sleep017288-21sed20:00:200
256232451,4sleep125696-21memory00:40:211
263199393,11cyclictest81rcu_preempt23:31:280
246652391,6sleep124670-21ntpq21:45:261
263199371,11cyclictest81rcu_preempt20:52:530
2632993628,5cyclictest22-21ksoftirqd/121:40:001
263199367,5cyclictest0-21swapper/021:05:050
263199364,16cyclictest6386-21python19:30:270
241342360,3sleep00-21swapper/021:45:160
183872361,31sleep118473-21df21:30:141
100872361,5sleep010128-21/usr/sbin/munin19:40:280
113172351,4sleep011370-21tune2fs19:45:170
263299342,8cyclictest17775-21df_inode00:20:131
263199337,13cyclictest13001-21aten_r4power_vo19:50:100
127002331,5sleep10-21swapper/119:49:401
6962321,27sleep1705-21diskstats23:35:151
263299325,4cyclictest81rcu_preempt23:30:051
2632993222,6cyclictest26009-21diskstats21:50:141
263299322,16cyclictest8276-21munin-run22:30:011
263199327,12cyclictest13652-21timerandwakeup21:15:280
2631993213,6cyclictest26545-21ntp_states21:50:240
2631993212,6cyclictest977-21munin-run20:45:000
263199321,19cyclictest5276-21irqstats22:20:200
263199321,18cyclictest29135-21sed20:30:300
99572311,5sleep00-21swapper/000:00:080
43752311,5sleep10-21swapper/122:18:521
303712311,5sleep00-21swapper/020:35:170
263299316,5cyclictest81rcu_preempt19:40:111
263299316,4cyclictest81rcu_preempt23:27:181
263299315,3cyclictest81rcu_preempt20:16:051
2632993122,6cyclictest24302-21ntp_states23:10:251
2632993113,6cyclictest11565-21gdbus22:08:521
2632993112,6cyclictest0-21swapper/122:13:531
263199318,11cyclictest3286-21runrttasks21:40:010
263199313,14cyclictest27938-21memory23:20:220
263199311,4cyclictest81rcu_preempt22:17:510
2631993113,6cyclictest15646-21/usr/sbin/munin19:55:330
263199311,19cyclictest29388-21cstates23:25:130
263199311,14cyclictest2458-21chrt22:14:250
263199311,14cyclictest16962-21chrt22:50:260
233712311,4sleep023520-21unixbench_singl20:15:310
218342311,5sleep10-21swapper/120:11:581
16362310,4sleep041ktimersoftd/020:45:180
136022311,9sleep10-21swapper/122:41:491
94132301,5sleep00-21swapper/023:56:150
263299305,4cyclictest81rcu_preempt21:58:281
263299303,18cyclictest0-21swapper/123:04:141
263299302,12cyclictest0-21swapper/120:51:381
263299301,4cyclictest81rcu_preempt22:01:551
263299301,16cyclictest17695-21ls22:55:011
263299300,4cyclictest81rcu_preempt21:00:221
2631993021,5cyclictest2221-21cron23:05:000
263199302,14cyclictest18791-21iostat_ios21:30:200
263199301,7cyclictest81rcu_preempt00:46:230
263199301,4cyclictest81rcu_preempt22:05:000
263199301,4cyclictest81rcu_preempt00:44:370
263199301,20cyclictest0-21swapper/023:46:210
2631993010,7cyclictest27089-21turbostat23:20:010
218342301,4sleep121839-21irqstats00:30:201
203492301,25sleep120396-21swap00:25:291
263299294,4cyclictest81rcu_preempt00:48:341
263299294,19cyclictest13192-21diskstats19:50:121
2632992915,11cyclictest22-21ksoftirqd/121:40:131
263299291,4cyclictest81rcu_preempt23:48:461
263299291,15cyclictest29393-21iostat00:50:191
263199293,20cyclictest31963-21iostat_ios22:05:230
263199292,14cyclictest6681-21hddtemp_smartct23:50:170
263199291,4cyclictest81rcu_preempt23:05:520
2631992912,5cyclictest81rcu_preempt00:55:000
2631992911,6cyclictest12486-21df_inode22:40:130
263199291,15cyclictest10957-21diskstats21:10:160
248592291,5sleep00-21swapper/023:11:390
230262291,4sleep10-21swapper/123:07:051
217022291,5sleep00-21swapper/020:10:340
162082291,4sleep10-21swapper/119:57:081
157232291,5sleep00-21swapper/021:20:350
155792291,5sleep10-21swapper/122:47:511
154602291,24sleep115601-21cat21:20:311
141682291,5sleep10-21swapper/121:19:081
112942291,5sleep10-21swapper/100:01:041
103002291,5sleep00-21swapper/022:35:120
101272291,5sleep00-21swapper/022:34:570
82682281,5sleep00-21swapper/021:01:260
78372281,5sleep10-21swapper/123:54:201
274482281,5sleep00-21swapper/020:26:350
263299285,17cyclictest4969-21diskstats22:20:141
263299284,8cyclictest25651-21diskstats23:15:161
263299284,4cyclictest81rcu_preempt21:26:461
263299283,4cyclictest81rcu_preempt20:22:231
263299281,8cyclictest18779-21sendmail_mailqu22:55:271
263299281,4cyclictest81rcu_preempt00:06:131
2632992812,5cyclictest8062-21taskset23:55:081
263299281,13cyclictest29815-21/usr/sbin/munin20:35:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional