You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Jun 28, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
42999912201211,6cyclictest0-21swapper/107:26:461
42999911771158,15cyclictest13264-21strings09:10:221
22992500456,28sleep10-21swapper/107:20:011
41792474425,34sleep00-21swapper/007:24:200
429899197175,6cyclictest0-21swapper/007:26:470
429899135113,17cyclictest0-21swapper/009:10:230
88002540,6sleep1201rcuc/109:00:121
277762430,2sleep027773-21latency_hist08:25:000
212622381,4sleep120384-21/usr/sbin/munin08:05:261
4298993716,7cyclictest25040-21wget12:35:110
141742371,32sleep114178-21hddtemp_smartct12:05:181
4298993614,7cyclictest18450-21df_inode09:25:150
429899351,22cyclictest7362-21time08:55:190
429899351,22cyclictest16576-21python12:10:280
429999344,11cyclictest18714-21munin-node07:30:011
4298993413,4cyclictest40250irq/92-i91507:30:010
429899341,20cyclictest4991-21grep10:15:140
429899341,19cyclictest13664-21cron10:38:000
247212341,4sleep124730-21iostat_ios08:15:191
137542340,3sleep0111rcuc/007:45:250
429899333,18cyclictest0-21swapper/009:58:130
206332330,4sleep0111rcuc/008:05:110
97412321,4sleep19845-21latency_hist11:55:001
65182321,3sleep10-21swapper/110:20:101
429999328,11cyclictest2225-21dbus-daemon08:24:201
429899327,13cyclictest27670-21taskset12:40:240
429899323,4cyclictest81rcu_preempt09:40:110
4298993217,5cyclictest3-21ksoftirqd/011:18:180
4298993215,6cyclictest3-21ksoftirqd/012:24:460
294762321,26sleep129576-21hddtemp_smartct11:20:161
249642321,5sleep10-21swapper/111:08:031
214322321,27sleep121493-21df12:25:141
429899318,18cyclictest15754-21python07:50:260
4298993116,5cyclictest3-21ksoftirqd/011:36:430
4298993116,5cyclictest3-21ksoftirqd/008:33:520
85922301,4sleep18678-21df10:25:151
58632301,24sleep10-21swapper/111:43:421
429999305,4cyclictest81rcu_preempt10:51:491
429999304,4cyclictest81rcu_preempt08:41:441
429999302,4cyclictest81rcu_preempt12:30:501
429999301,4cyclictest81rcu_preempt08:28:481
429899309,5cyclictest29657-21if_eth011:20:180
429899307,19cyclictest230722chrt11:02:540
429899305,12cyclictest11385-21timerandwakeup10:30:290
429899304,19cyclictest23376-21diskstats12:30:130
429899302,15cyclictest5041-21/usr/sbin/munin11:40:210
429899302,15cyclictest11565-21gdbus09:46:450
4298993015,5cyclictest3-21ksoftirqd/009:17:360
4298993012,5cyclictest9183-21df07:35:130
4298993012,5cyclictest22400-21hddtemp_smartct09:35:160
4298993011,7cyclictest8746-21grep10:25:160
429899301,16cyclictest19103-21iostat_ios08:00:180
4298993011,6cyclictest17109-21hddtemp_smartct07:55:170
429899301,12cyclictest27015-21seq11:14:550
429899301,12cyclictest27015-21seq11:14:550
271402301,4sleep127149-21diskstats12:40:141
24862301,5sleep00-21swapper/008:41:180
230982301,5sleep10-21swapper/111:03:111
212642301,5sleep00-21swapper/010:58:490
159252301,5sleep10-21swapper/109:18:131
133012301,5sleep00-21swapper/012:02:450
76442291,5sleep10-21swapper/111:47:401
429999295,4cyclictest81rcu_preempt09:39:051
429999294,4cyclictest81rcu_preempt07:43:351
429999292,4cyclictest81rcu_preempt09:34:431
4299992922,5cyclictest0-21swapper/109:22:211
4299992915,8cyclictest30029-21iostat_ios09:55:211
429999291,4cyclictest81rcu_preempt12:03:001
429899293,19cyclictest3015-21df_inode10:10:140
429899292,15cyclictest0-21swapper/009:20:110
4298992913,5cyclictest3-21ksoftirqd/008:49:490
429899291,17cyclictest17979-21tr10:50:110
4298992911,6cyclictest31383-21/usr/sbin/munin10:00:110
4298992911,5cyclictest9345-21iostat09:00:200
429899291,12cyclictest11565-21gdbus11:05:250
4298992910,6cyclictest17645-21munin-run10:50:010
40962291,5sleep10-21swapper/110:11:211
295572291,5sleep00-21swapper/008:29:210
253132291,5sleep10-21swapper/111:10:101
253132291,5sleep10-21swapper/111:10:101
236202291,5sleep10-21swapper/108:11:241
236202291,5sleep10-21swapper/108:11:231
215472291,5sleep00-21swapper/009:32:590
182182291,5sleep10-21swapper/107:58:561
79642281,5sleep00-21swapper/010:22:140
62952281,5sleep00-21swapper/008:50:570
60522281,5sleep10-21swapper/110:17:031
429999284,4cyclictest81rcu_preempt12:23:001
429999284,17cyclictest16214-21diskstats10:45:141
429999284,14cyclictest0-21swapper/108:55:191
429999281,14cyclictest19195-21memory08:00:211
429899289,6cyclictest30930-21diskstats12:50:140
429899289,6cyclictest12479-21sort09:10:000
429899283,10cyclictest11284-21diskstats07:40:150
429899282,14cyclictest0-21swapper/011:33:330
429899282,13cyclictest6196-21/usr/sbin/munin11:45:120
429899282,12cyclictest11564-21packagekitd10:41:350
4298992813,5cyclictest3-21ksoftirqd/011:55:010
429899281,15cyclictest29040-21/usr/sbin/munin12:45:130
429899281,13cyclictest24175-21aten_r4power_en08:15:110
321812281,5sleep10-21swapper/112:53:191
311692281,5sleep10-21swapper/108:31:361
262652281,5sleep10-21swapper/112:35:501
21892281,5sleep10-21swapper/110:07:041
209852281,5sleep10-21swapper/110:55:551
19932281,5sleep10-21swapper/111:33:541
154042281,5sleep10-21swapper/110:41:231
151722281,5sleep00-21swapper/012:07:420
141462281,5sleep10-21swapper/107:45:331
429999276,4cyclictest11988-21cron10:34:591
429999275,4cyclictest81rcu_preempt09:53:551
429999275,4cyclictest81rcu_preempt08:54:591
429999275,4cyclictest81rcu_preempt08:47:031
429999274,8cyclictest10920-21diskstats09:05:151
429999272,21cyclictest0-21swapper/110:00:251
4299992719,5cyclictest28264-21awk11:15:271
4299992718,5cyclictest31981-21awk08:35:201
4299992713,8cyclictest10503-21iostat_ios11:55:181
429899279,6cyclictest1016-21expr10:05:120
429899278,6cyclictest23974-21munin-run08:15:000
429899278,6cyclictest23974-21munin-run08:14:590
429899272,13cyclictest28168-21kernelversion09:50:200
429899272,13cyclictest18025-21iostat12:15:180
4298992720,4cyclictest908-21cron08:40:000
429899271,12cyclictest22317-21grep12:25:310
4298992710,4cyclictest8327-21diskstats11:50:130
38052271,5sleep10-21swapper/111:37:051
325702271,5sleep10-21swapper/111:28:571
259692271,5sleep10-21swapper/109:45:151
252692271,5sleep10-21swapper/109:42:281
195732271,5sleep10-21swapper/109:26:571
189112271,4sleep10-21swapper/112:17:321
429999264,4cyclictest81rcu_preempt12:45:591
429999261,4cyclictest81rcu_preempt10:38:451
429899261,13cyclictest0-21swapper/011:29:140
163362261,5sleep10-21swapper/107:53:521
105502261,4sleep10-21swapper/107:39:241
429999242,10cyclictest16050-21hddtemp_smartct12:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional