You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 23:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri May 22, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267219912291204,21cyclictest26889-21cut07:25:091
267209911511117,16cyclictest0-21swapper/007:25:090
267219911051081,20cyclictest2055-21updatedb.mlocat07:40:291
264642601556,30sleep10-21swapper/107:22:541
264722467417,34sleep00-21swapper/007:23:000
26720992361,4cyclictest2202-21sed07:40:290
265472720,3sleep041ktimersoftd/008:45:270
201382640,4sleep0111rcuc/011:20:250
286882500,9sleep02672099cyclictest08:50:290
81852461,28sleep08221-21tune2fs10:50:150
26720993917,11cyclictest23787-21/usr/sbin/munin10:05:160
26720993820,6cyclictest11489-21sh11:00:000
26720993510,20cyclictest13982-21wget09:40:100
192332350,5sleep041ktimersoftd/008:25:300
38352341,29sleep13933-21/usr/sbin/munin12:05:121
2672199345,4cyclictest81rcu_preempt07:31:291
2672099348,12cyclictest2270-21cpu10:35:120
26720993414,4cyclictest0-21swapper/010:10:280
119222340,2sleep011920-21uname12:25:210
26720993313,7cyclictest20357-21ntp_states09:55:250
199212331,4sleep120016-21hddtemp_smartct09:55:161
72982321,4sleep17305-21iostat_ios07:55:191
2672099328,13cyclictest16431-21diskstats08:20:150
2672099322,5cyclictest31020-21sh09:00:000
2672099321,5cyclictest81rcu_preempt09:25:270
26720993212,7cyclictest13719-21cron09:40:000
157272321,4sleep081rcu_preempt11:10:150
82162311,13sleep08219-21missed_timers12:15:220
2672199319,6cyclictest94382hostname12:20:091
26721993120,7cyclictest29124-21cron08:55:001
26721993120,6cyclictest23952-21diskstats08:40:151
26720993117,4cyclictest3-21ksoftirqd/007:39:270
26720993113,6cyclictest31516-21memory10:25:200
2672099311,18cyclictest6843-21ntp_states10:45:250
26720993111,7cyclictest29606-21python11:45:260
204382311,5sleep120478-21iostat08:30:191
103122311,4sleep110333-21munin-run08:04:591
58262301,5sleep10-21swapper/110:44:511
322312301,5sleep10-21swapper/110:26:501
2672199306,4cyclictest81rcu_preempt12:01:331
2672199305,3cyclictest81rcu_preempt11:54:331
2672199301,15cyclictest12268-21irqstats11:00:211
26721993010,7cyclictest29552-21expr08:55:121
26721993010,5cyclictest18733-21cut12:45:011
2672099302,4cyclictest81rcu_preempt11:50:210
2672099301,4cyclictest81rcu_preempt10:41:560
2672099301,4cyclictest81rcu_preempt09:14:020
26720993014,5cyclictest3-21ksoftirqd/011:57:140
2672099301,26cyclictest111-21usb-storage08:10:510
26720993012,5cyclictest25642-21ntp_states11:35:240
26720993012,5cyclictest15351-21diskstats12:35:160
2672099301,15cyclictest22005-21/usr/sbin/munin12:50:290
26720993010,7cyclictest27009-21df_inode11:40:150
192322301,5sleep10-21swapper/109:53:421
188742301,5sleep10-21swapper/111:18:401
17972301,5sleep10-21swapper/110:33:161
58612291,24sleep15994-21unixbench_multi07:50:281
326772291,5sleep00-21swapper/009:02:460
268572291,5sleep10-21swapper/108:46:001
2672199296,3cyclictest81rcu_preempt11:43:311
2672199295,4cyclictest81rcu_preempt11:24:351
2672199294,19cyclictest22361-21iostat_ios08:35:211
2672199293,4cyclictest81rcu_preempt08:28:171
2672199293,21cyclictest15059-21ntp_states08:15:241
2672199293,19cyclictest7825-21diskstats12:15:151
26721992920,5cyclictest16005-21find12:35:281
2672199291,4cyclictest81rcu_preempt12:50:301
2672199291,4cyclictest81rcu_preempt10:14:551
2672199291,4cyclictest81rcu_preempt09:49:111
2672199291,4cyclictest81rcu_preempt09:40:391
2672199290,4cyclictest81rcu_preempt12:33:361
2672099297,10cyclictest81rcu_preempt12:45:110
2672099296,11cyclictest4194-21grep07:45:300
2672099292,14cyclictest5492-21python09:15:260
2672099291,4cyclictest81rcu_preempt10:01:010
2672099291,4cyclictest81rcu_preempt07:57:040
26720992911,6cyclictest15884-21wget09:45:120
2672099291,15cyclictest14640-21/usr/sbin/munin11:05:290
20692291,5sleep10-21swapper/110:35:011
156102291,5sleep00-21swapper/008:16:340
5012281,5sleep10-21swapper/107:39:161
35362281,5sleep00-21swapper/012:04:120
284152281,5sleep10-21swapper/110:16:241
2672199285,4cyclictest81rcu_preempt11:34:151
2672199285,4cyclictest81rcu_preempt11:08:351
2672199284,3cyclictest81rcu_preempt11:45:211
26721992811,14cyclictest22-21ksoftirqd/112:13:071
2672099288,9cyclictest3-21ksoftirqd/008:06:090
2672099288,7cyclictest17446-21hddtemp_smartct12:40:160
2672099281,4cyclictest81rcu_preempt12:22:260
2672099281,4cyclictest81rcu_preempt10:32:350
26720992811,6cyclictest9306-21ls08:00:220
2672099281,15cyclictest7635-21/usr/sbin/munin09:20:280
2672099281,14cyclictest13482-21/usr/sbin/munin12:30:140
2672099281,13cyclictest893-21df_inode09:05:140
2672099281,12cyclictest29845-21tune2fs07:30:150
26720992810,5cyclictest24251-21iostat08:40:200
215472281,5sleep00-21swapper/008:34:300
197212281,4sleep119833-21grep12:45:251
178372281,5sleep10-21swapper/108:24:581
136042281,5sleep10-21swapper/109:38:541
119242281,5sleep10-21swapper/108:07:121
11852281,5sleep10-21swapper/111:55:461
95552271,5sleep10-21swapper/109:25:471
44942271,5sleep10-21swapper/107:48:101
2672199276,17cyclictest3286-21runrttasks09:20:281
2672199274,4cyclictest81rcu_preempt10:46:041
2672199274,4cyclictest81rcu_preempt09:15:381
2672199271,22cyclictest1755-21timerwakeupswit09:05:281
2672099279,16cyclictest0-21swapper/009:54:420
2672099273,18cyclictest4607-21ntp_states12:05:250
2672099272,20cyclictest29279-21grep10:20:150
2672099272,14cyclictest0-21swapper/011:26:270
2672099272,13cyclictest2225-21dbus-daemon09:32:390
2672099272,13cyclictest2225-21dbus-daemon09:32:390
2672099271,13cyclictest22870-21sort08:35:290
2672099271,13cyclictest12107-21fschecks_time11:00:170
262592271,5sleep10-21swapper/111:37:141
236482271,5sleep10-21swapper/110:05:161
232212271,3sleep00-21swapper/011:30:150
168632271,5sleep10-21swapper/111:12:161
94522261,5sleep10-21swapper/110:53:291
2672199263,3cyclictest81rcu_preempt09:11:131
2672199261,8cyclictest0-21swapper/110:59:341
2672199261,4cyclictest81rcu_preempt09:35:011
2672199261,4cyclictest81rcu_preempt09:35:001
2672199261,12cyclictest31471-21df09:00:131
26720992611,4cyclictest3-21ksoftirqd/011:15:020
2672099261,13cyclictest7327-21runrttasks12:14:390
2672099261,11cyclictest2225-21dbus-daemon07:54:270
227242261,5sleep10-21swapper/110:00:481
129712261,5sleep10-21swapper/112:29:351
2672199258,5cyclictest81rcu_preempt11:30:001
2672199251,8cyclictest29550-21iostat_ios10:20:191
2672099251,15cyclictest0-21swapper/010:19:570
123452251,5sleep10-21swapper/108:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional