You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Apr 18, 2026 12:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207029911721145,24cyclictest20872-21wget07:25:111
207019911311107,21cyclictest0-21swapper/007:25:120
207029911121077,32cyclictest27193-21apt-get07:40:151
202362565518,31sleep10-21swapper/107:20:421
204302466417,32sleep00-21swapper/007:22:440
165152850,8sleep02070199cyclictest12:16:430
184552790,7sleep02070199cyclictest10:05:190
159292610,2sleep015926-21cat09:30:000
159292610,2sleep015926-21cat09:30:000
111582550,7sleep12070299cyclictest12:45:161
39082440,8sleep12070299cyclictest11:30:231
168442420,7sleep12070299cyclictest12:17:101
2070299403,11cyclictest4514-21/usr/sbin/munin12:05:331
20702994012,15cyclictest22034-21ssh09:35:271
2070199391,13cyclictest137532latency_hist08:30:010
291992381,5sleep12695-21snmpd09:43:161
277712387,28sleep127782-21ssh12:28:591
79422371,32sleep18071-21df11:35:131
2070199375,12cyclictest1306-21latency_hist09:15:010
20701993722,5cyclictest3-21ksoftirqd/012:05:340
20701993714,5cyclictest0-21swapper/009:15:330
20701993711,7cyclictest28732-21cron09:10:000
289382361,31sleep128954-21rm11:56:001
2070299361,7cyclictest3286-21runrttasks09:32:311
20702993616,4cyclictest22-21ksoftirqd/110:15:171
271582350,7sleep00-21swapper/012:28:030
2070299359,22cyclictest0-21swapper/112:31:341
2070299358,5cyclictest81rcu_preempt11:28:101
2070299352,28cyclictest0-21swapper/110:32:561
2070199357,5cyclictest81rcu_preempt11:07:440
2070199351,21cyclictest9636-21sh09:55:420
2070199351,15cyclictest15980-21seq11:43:130
2070299341,21cyclictest0-21swapper/109:59:181
20702993410,4cyclictest81rcu_preempt10:03:451
20702993410,4cyclictest81rcu_preempt10:03:451
20701993417,6cyclictest3-21ksoftirqd/011:10:460
2070299338,10cyclictest20097-21ssh11:14:221
20702993315,11cyclictest22-21ksoftirqd/110:38:501
2070199339,12cyclictest5324-21cut10:25:160
2070199336,14cyclictest30456-21/usr/sbin/munin11:25:290
2070199332,16cyclictest21354-21diskstats09:35:160
2070199331,24cyclictest0-21swapper/008:41:420
2070199331,20cyclictest2225-21dbus-daemon10:10:130
180312331,28sleep118080-21ssh11:45:181
320602321,4sleep132071-21ssh10:52:521
2070299329,11cyclictest0-21swapper/112:24:161
2070299321,17cyclictest24765-21cron08:57:591
2070199327,12cyclictest895-21processes10:20:260
2070199324,4cyclictest81rcu_preempt10:36:250
2070199324,4cyclictest81rcu_preempt09:31:060
2070199322,4cyclictest81rcu_preempt12:13:340
2070199322,17cyclictest0-21swapper/010:18:490
2070199321,15cyclictest32001-21/usr/sbin/munin07:50:270
20701993210,18cyclictest18724-21ssh12:54:000
16572321,4sleep11689-21df_inode10:55:141
20702993113,15cyclictest22-21ksoftirqd/109:46:271
2070199319,5cyclictest81rcu_preempt11:25:000
2070199316,13cyclictest0-21swapper/011:51:280
2070199312,5cyclictest81rcu_preempt10:45:160
2070199312,14cyclictest29467-21irqstats12:30:210
2070199311,4cyclictest81rcu_preempt08:20:570
20701993113,5cyclictest20001-21iostat_ios10:40:190
20701993112,5cyclictest10192-21ssh10:30:170
20701993111,6cyclictest29544-21df07:45:150
20701993111,6cyclictest0-21swapper/012:37:200
2070199311,13cyclictest22848-21chrt11:16:200
2070199311,10cyclictest6071-21ssh09:52:350
111062311,9sleep00-21swapper/011:38:130
109092312,24sleep110918-21ntp_states08:20:231
210252301,5sleep00-21swapper/008:48:040
210252301,5sleep00-21swapper/008:48:040
2070299304,4cyclictest81rcu_preempt08:46:101
2070299304,4cyclictest81rcu_preempt08:46:091
2070299302,7cyclictest0-21swapper/111:22:361
20702993020,6cyclictest5058-21cstates10:25:121
2070299301,4cyclictest81rcu_preempt09:06:241
2070299301,4cyclictest81rcu_preempt07:46:091
20702993013,14cyclictest22-21ksoftirqd/110:48:351
20702993012,5cyclictest7082-21ntp_offset12:40:241
20702993011,9cyclictest40250irq/92-i91511:01:181
2070299301,15cyclictest28743-21diskmemload10:20:581
2070199308,11cyclictest24374-21timerwakeupswit08:55:290
2070199306,4cyclictest40250irq/92-i91508:20:000
20701993021,5cyclictest11370-21smartctl12:45:180
2070199302,15cyclictest0-21swapper/008:30:140
2070199302,14cyclictest23991-21irqstats07:30:230
2070199302,12cyclictest3690-21memory11:30:190
20701993013,6cyclictest3-21ksoftirqd/011:55:520
2070199301,16cyclictest22514-21/usr/sbin/munin08:50:290
184092301,25sleep118453-21cut10:05:201
171532301,5sleep10-21swapper/108:37:061
264482291,5sleep00-21swapper/009:00:480
2070299299,3cyclictest0-21swapper/111:52:171
2070299294,4cyclictest81rcu_preempt08:42:411
2070299294,22cyclictest0-21swapper/109:10:101
2070299293,23cyclictest0-21swapper/110:40:401
2070299292,17cyclictest0-21swapper/112:37:421
2070299292,15cyclictest0-21swapper/112:52:451
2070299292,14cyclictest22715-21sh11:16:101
20702992916,10cyclictest22-21ksoftirqd/109:20:201
2070199299,7cyclictest27481-21cat07:40:130
2070199293,4cyclictest81rcu_preempt09:21:190
2070199292,14cyclictest2401-21NetworkManager11:02:110
20701992919,6cyclictest5085-21cat08:05:220
2070199291,4cyclictest81rcu_preempt07:59:120
2070199291,4cyclictest81rcu_preempt07:59:120
20701992912,5cyclictest31478-21ssh09:45:280
2070199291,16cyclictest3054-21http_loadtime08:00:170
2070199291,13cyclictest7881-21ssh12:40:550
20701992910,6cyclictest3286-21runrttasks12:21:350
20701992910,5cyclictest17543-21aten_r4power_po11:45:120
157062291,5sleep10-21swapper/111:42:511
135432291,5sleep10-21swapper/109:26:381
135432291,5sleep10-21swapper/109:26:381
57242281,5sleep10-21swapper/108:05:351
267382281,5sleep10-21swapper/107:37:101
21382281,5sleep10-21swapper/107:58:361
21382281,5sleep10-21swapper/107:58:351
2070299288,7cyclictest0-21swapper/108:00:191
2070299285,20cyclictest0-21swapper/109:18:451
2070299284,4cyclictest81rcu_preempt08:15:051
20702992811,5cyclictest22502-21expr08:50:291
20702992810,14cyclictest6129-21ssh09:52:391
2070199283,18cyclictest7004-21memory08:10:220
2070199282,13cyclictest16010-21df_inode08:35:130
20701992811,5cyclictest2958-21seq10:55:330
2070199281,15cyclictest25273-21dpkg07:35:020
2070199281,13cyclictest29005-21aten_r4power_cu10:50:100
2070199281,10cyclictest0-21swapper/012:04:110
20701992810,5cyclictest26413-21http_loadtime09:40:180
20701992810,5cyclictest15745-21ssh10:02:310
20701992810,5cyclictest15745-21ssh10:02:300
117882281,23sleep111802-21ssh12:11:551
79642271,5sleep10-21swapper/108:14:241
324462271,5sleep10-21swapper/107:50:531
319322271,4sleep131944-21ssh12:00:071
2070299274,4cyclictest81rcu_preempt07:31:041
20702992710,5cyclictest40250irq/92-i91510:12:001
153112271,5sleep10-21swapper/108:32:301
2070299268,14cyclictest0-21swapper/111:05:391
2070299265,4cyclictest81rcu_preempt09:01:521
2070299262,4cyclictest81rcu_preempt08:26:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional