You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 03:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Mon Mar 23, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
302189911981188,7cyclictest0-21swapper/019:26:250
302199911311121,7cyclictest0-21swapper/119:26:471
300782517471,31sleep00-21swapper/019:24:050
300342460416,30sleep10-21swapper/119:23:401
2564121320,8sleep03021899cyclictest20:35:210
1653221110,3sleep016529-21memory21:20:230
1341121060,9sleep03021899cyclictest21:50:250
1916021050,3sleep10-21swapper/122:30:121
1916021050,3sleep10-21swapper/122:30:121
276942990,7sleep10-21swapper/121:31:411
259122840,8sleep03021899cyclictest22:03:470
116442820,3sleep10-21swapper/119:59:541
39612810,25sleep03-21ksoftirqd/023:20:260
245982590,8sleep03021899cyclictest23:09:120
30218994425,4cyclictest3-21ksoftirqd/021:43:520
26542440,3sleep1201rcuc/119:35:161
302562420,5sleep030255-21sh22:08:050
30218994226,5cyclictest3-21ksoftirqd/022:43:320
30218994224,6cyclictest3-21ksoftirqd/021:16:470
30218994223,5cyclictest3-21ksoftirqd/022:26:180
30218994222,5cyclictest3-21ksoftirqd/000:18:580
30218994222,4cyclictest3-21ksoftirqd/000:34:590
30218994221,6cyclictest3-21ksoftirqd/021:10:240
30218994123,6cyclictest3-21ksoftirqd/023:00:480
30218994121,9cyclictest3-21ksoftirqd/023:29:520
298152410,4sleep041ktimersoftd/021:34:460
3021899409,27cyclictest0-21swapper/000:00:360
30218994024,5cyclictest3-21ksoftirqd/023:10:280
30218994023,6cyclictest3-21ksoftirqd/020:54:060
30218994023,6cyclictest3-21ksoftirqd/020:16:330
30218994022,6cyclictest3-21ksoftirqd/022:35:090
30218994020,5cyclictest3-21ksoftirqd/021:39:470
30218993921,5cyclictest3-21ksoftirqd/000:09:140
30218993916,5cyclictest3-21ksoftirqd/000:43:110
10712390,2sleep01073-21basename00:25:130
3021999387,3cyclictest0-21swapper/123:42:151
30219993829,5cyclictest0-21swapper/123:14:551
30218993823,5cyclictest3-21ksoftirqd/023:56:210
30218993822,5cyclictest3-21ksoftirqd/022:21:420
30218993822,5cyclictest3-21ksoftirqd/021:55:120
30218993822,5cyclictest3-21ksoftirqd/000:21:040
30218993819,9cyclictest3-21ksoftirqd/023:39:410
30218993816,9cyclictest27707-21iostat_ios23:45:210
30218993816,6cyclictest3-21ksoftirqd/023:15:100
30218993815,7cyclictest3-21ksoftirqd/022:51:480
147772380,3sleep1201rcuc/121:19:041
146572382,32sleep114671-21ssh21:51:321
3021999372,31cyclictest0-21swapper/122:26:151
30218993722,5cyclictest3-21ksoftirqd/000:47:380
30218993721,5cyclictest3-21ksoftirqd/022:55:460
30218993720,6cyclictest3-21ksoftirqd/000:39:290
30218993717,9cyclictest3-21ksoftirqd/022:17:010
30218993715,6cyclictest3-21ksoftirqd/021:45:090
30218993714,6cyclictest20025-21cat00:10:270
68812362,30sleep16903-21ntp_states21:10:251
67982360,7sleep10-21swapper/119:45:211
3021899362,30cyclictest0-21swapper/022:10:350
30218993621,5cyclictest3-21ksoftirqd/020:34:350
221632361,5sleep022204-21/usr/sbin/munin23:40:110
136402360,4sleep0111rcuc/020:05:000
3021999356,4cyclictest81rcu_preempt00:45:151
3021999351,29cyclictest1173-21ssh23:18:161
30218993520,5cyclictest3-21ksoftirqd/022:49:410
30218993519,5cyclictest3-21ksoftirqd/021:25:470
163002350,9sleep03021899cyclictest23:33:560
3021999346,4cyclictest81rcu_preempt22:09:021
3021999345,5cyclictest81rcu_preempt00:00:261
3021999345,4cyclictest81rcu_preempt21:57:521
30219993426,4cyclictest16030-21fschecks_time20:10:161
30219993423,7cyclictest2645-21snmpd00:52:461
30219993423,7cyclictest0-21swapper/121:46:561
3021999341,30cyclictest0-21swapper/119:50:351
3021999341,29cyclictest2780-21/usr/sbin/munin21:40:161
30218993420,4cyclictest3-21ksoftirqd/021:09:590
30218993419,5cyclictest3-21ksoftirqd/020:59:080
3021899341,30cyclictest0-21swapper/020:45:150
317892331,4sleep12645-21snmpd22:42:561
3021999335,4cyclictest81rcu_preempt22:47:371
3021999334,4cyclictest81rcu_preempt22:51:491
3021999334,4cyclictest81rcu_preempt22:17:491
3021999334,4cyclictest81rcu_preempt00:29:521
30219993325,5cyclictest0-21swapper/100:18:561
30219993324,6cyclictest16120-21fschecks_time00:40:161
3021999332,28cyclictest0-21swapper/122:38:561
3021999332,27cyclictest0-21swapper/122:23:351
3021999331,5cyclictest0-21swapper/122:55:211
3021999331,4cyclictest81rcu_preempt21:29:391
30218993318,5cyclictest3-21ksoftirqd/021:03:490
30218993318,5cyclictest3-21ksoftirqd/020:06:390
30218993318,4cyclictest3-21ksoftirqd/000:52:180
30218993317,6cyclictest3-21ksoftirqd/020:20:050
30218993317,5cyclictest3-21ksoftirqd/020:27:570
30218993315,6cyclictest32688-21/usr/sbin/munin23:50:220
3021899331,12cyclictest0-21swapper/019:50:020
177952331,28sleep117848-21hddtemp_smartct23:35:171
114922331,28sleep111503-21ssh23:28:591
3021999325,4cyclictest81rcu_preempt20:56:221
3021999323,4cyclictest81rcu_preempt21:39:051
3021999323,4cyclictest81rcu_preempt00:06:211
3021999322,4cyclictest81rcu_preempt22:10:231
3021999322,4cyclictest81rcu_preempt00:23:031
3021999321,4cyclictest81rcu_preempt20:40:341
30218993219,4cyclictest3-21ksoftirqd/022:33:060
30218993219,4cyclictest3-21ksoftirqd/022:33:060
3021999315,4cyclictest81rcu_preempt19:40:551
3021999315,22cyclictest0-21swapper/123:21:241
3021999313,4cyclictest81rcu_preempt23:47:441
3021999312,4cyclictest81rcu_preempt23:57:431
30219993116,8cyclictest22-21ksoftirqd/121:21:171
3021999311,5cyclictest0-21swapper/121:06:351
3021999311,27cyclictest0-21swapper/120:15:151
142922311,4sleep114303-21ssh00:38:261
30219993023,5cyclictest0-21swapper/120:32:561
3021999301,9cyclictest21081-21cron20:25:001
3021999301,4cyclictest81rcu_preempt23:32:331
3021899308,10cyclictest0-21swapper/019:30:020
30218993017,7cyclictest27718-21ntp_states20:40:250
30218993016,4cyclictest3-21ksoftirqd/019:56:030
245262301,4sleep10-21swapper/123:09:071
61962291,5sleep00-21swapper/019:45:100
30219992918,8cyclictest22-21ksoftirqd/123:50:121
30219992916,4cyclictest22-21ksoftirqd/122:01:181
30219992915,4cyclictest22-21ksoftirqd/123:01:191
3021999291,4cyclictest81rcu_preempt20:53:541
30219992912,5cyclictest30011-21kworker/1:000:10:051
3021999291,18cyclictest0-21swapper/121:00:181
30218992915,4cyclictest3-21ksoftirqd/019:44:420
30218992913,5cyclictest3-21ksoftirqd/019:38:530
3021999281,4cyclictest81rcu_preempt20:26:411
3021999281,4cyclictest81rcu_preempt00:32:591
30219992810,14cyclictest287592chrt20:45:081
263842281,5sleep10-21swapper/120:36:411
17232281,5sleep10-21swapper/119:30:431
151432271,5sleep10-21swapper/120:07:011
30219992617,6cyclictest22-21ksoftirqd/120:02:001
3021899261,11cyclictest16853-21users20:10:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional