You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 04:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Fri Mar 27, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126749912421211,21cyclictest0-21swapper/019:26:450
126759911541145,6cyclictest0-21swapper/119:27:081
124192576530,31sleep00-21swapper/019:22:530
123302564518,31sleep10-21swapper/119:21:581
214352990,5sleep121433-21ssh21:10:201
264252980,8sleep01267499cyclictest21:50:500
1267499811,36cyclictest23541-21needreboot00:40:220
1267499792,35cyclictest11779-21df_inode23:55:160
1267499781,44cyclictest12726-21latency_hist22:15:000
1267499772,43cyclictest5949-21ntp_kernel_err23:15:250
1267499772,43cyclictest5949-21ntp_kernel_err23:15:240
1267499772,38cyclictest23547-21irqstats23:00:210
1267499771,43cyclictest535-21fschecks_time23:10:150
1267499771,38cyclictest19153-21chrt22:22:150
1267499766,31cyclictest2329-21NetworkManager22:55:160
1267499761,41cyclictest3740-21fschecks_count00:20:170
1267499761,35cyclictest2854-21wc21:25:000
1267499761,33cyclictest2645-21snmpd22:30:290
1267499751,41cyclictest27043-21head21:15:290
1267499751,40cyclictest28077-21iostat_ios00:45:210
1267499751,40cyclictest22178-21ssh22:25:240
1267499751,33cyclictest2420-21chrt20:20:220
12674997510,33cyclictest3302-21runrttasks22:47:050
1267499749,33cyclictest13831-21missed_timers20:50:220
1267499748,30cyclictest22698-21ssh21:45:370
1267499743,39cyclictest32706-21ntp_states00:50:240
1267499742,36cyclictest20487-21diskmemload00:06:430
1267499741,38cyclictest14167-21ssh00:30:290
1267499741,37cyclictest16286-21cut22:20:010
1267499741,37cyclictest15351-21taskset22:51:320
1267499741,36cyclictest20900-21sed00:05:000
1267499738,35cyclictest16171-21unixbench_multi20:55:290
1267499732,34cyclictest2179-21users22:00:300
1267499731,36cyclictest29778-21fschecks_time23:40:160
1267499721,40cyclictest16667-21seq19:31:060
1267499721,38cyclictest18022-21cut21:40:150
1267499721,37cyclictest20655-21seq19:43:190
1267499721,37cyclictest18278-21seq21:01:460
1267499711,36cyclictest20487-21diskmemload23:48:180
1267499711,35cyclictest14090-21grep21:35:300
1267499711,34cyclictest20487-21diskmemload23:32:020
1267499711,33cyclictest7689-21ps23:50:260
1267499708,33cyclictest30959-21cpu00:15:120
1267499702,38cyclictest20487-21diskmemload23:24:590
1267499702,36cyclictest31326-21diskstats22:35:150
1267499701,6cyclictest20615-21sed21:10:020
1267499701,46cyclictest3302-21runrttasks19:54:200
1267499701,38cyclictest25961-21sh23:35:380
1267499701,35cyclictest15397-21grep23:25:180
1267499701,33cyclictest8194-21cut00:25:120
1267499691,33cyclictest6196-21chrt22:42:160
1267499681,62cyclictest28315-21chrt20:04:440
1267499681,61cyclictest7514-21basename20:35:120
1267499681,60cyclictest21221-21cstates19:45:120
1267499672,35cyclictest20487-21diskmemload00:37:030
1267499671,60cyclictest2329-21NetworkManager19:37:500
1267499671,5cyclictest3210-21seq21:25:110
1267499671,38cyclictest26893-21cat00:10:240
1267499671,35cyclictest22461-21sh21:10:520
1267499652,41cyclictest3302-21runrttasks20:11:320
1267499651,5cyclictest26121-21seq19:56:390
1267499651,36cyclictest20487-21diskmemload23:07:210
1267499651,31cyclictest2206-21dbus-daemon21:57:580
1267499643,32cyclictest29305-21ntpq20:05:260
1267499643,32cyclictest29305-21ntpq20:05:250
1267499642,45cyclictest3302-21runrttasks21:33:420
1267499641,4cyclictest601-21awk20:15:260
1267499641,42cyclictest5752-21/usr/sbin/munin20:30:120
1267499641,33cyclictest5663-21rm22:05:100
1267499611,37cyclictest4156-21fschecks_time20:25:170
1267499602,35cyclictest9625-21df20:40:120
1267499582,37cyclictest11221-21seq20:45:090
281382460,5sleep11267599cyclictest00:11:331
1267599457,15cyclictest2145-21ssh23:45:151
1267599422,3cyclictest81rcu_preempt22:01:551
12675994214,4cyclictest81rcu_preempt00:21:511
12675994120,5cyclictest22-21ksoftirqd/121:40:041
12675994019,6cyclictest22-21ksoftirqd/100:31:221
12675994013,6cyclictest22-21ksoftirqd/100:25:031
1267599399,5cyclictest81rcu_preempt23:20:311
1267599396,18cyclictest40550irq/92-i91519:40:101
1267599394,27cyclictest40550irq/92-i91500:02:531
1267599388,4cyclictest81rcu_preempt22:30:291
1267599383,27cyclictest40550irq/92-i91521:21:581
12675993816,4cyclictest22-21ksoftirqd/100:36:591
12675993811,4cyclictest22-21ksoftirqd/100:48:201
92432371,32sleep19257-21ssh23:19:321
92432371,32sleep19257-21ssh23:19:311
1267599379,4cyclictest81rcu_preempt19:58:441
1267599378,4cyclictest81rcu_preempt23:35:231
1267599378,4cyclictest81rcu_preempt21:26:021
1267599372,6cyclictest22-21ksoftirqd/121:54:361
1267599372,6cyclictest22-21ksoftirqd/100:05:351
12675993724,9cyclictest138250irq/90-eth022:55:181
12675993722,4cyclictest22-21ksoftirqd/122:35:121
1267599371,7cyclictest22-21ksoftirqd/122:45:211
12675993712,4cyclictest81rcu_preempt23:09:081
12675993712,4cyclictest81rcu_preempt21:15:521
12675993710,4cyclictest81rcu_preempt23:00:211
1267599367,6cyclictest22-21ksoftirqd/122:16:161
12675993628,4cyclictest0-21swapper/120:55:161
1267599361,4cyclictest81rcu_preempt22:44:051
1267599361,15cyclictest5055-21chrt20:26:161
1267599355,4cyclictest81rcu_preempt23:50:261
1267599352,8cyclictest8554-21irqstats21:30:211
1267599351,7cyclictest22-21ksoftirqd/122:50:271
12675993517,6cyclictest22-21ksoftirqd/100:40:141
12675993516,15cyclictest22-21ksoftirqd/121:46:511
1267599351,5cyclictest31138-21/usr/sbin/munin00:15:161
1267599351,17cyclictest0-21swapper/123:34:131
12675993510,4cyclictest22-21ksoftirqd/123:29:461
12675993510,12cyclictest0-21swapper/123:14:091
80652341,5sleep10-21swapper/122:08:401
1267599343,4cyclictest21647-21/usr/sbin/munin22:25:151
12675993417,5cyclictest22-21ksoftirqd/120:20:301
1267599341,3cyclictest0-21swapper/123:55:331
12675993412,4cyclictest81rcu_preempt21:39:121
1267599336,4cyclictest22-21ksoftirqd/121:57:501
12675993328,3cyclictest138250irq/90-eth022:11:031
1267599331,7cyclictest22-21ksoftirqd/121:00:271
1267599331,30cyclictest0-21swapper/121:06:161
1267599331,19cyclictest29726-21unixbench_singl20:05:311
1267599331,19cyclictest29726-21unixbench_singl20:05:311
12675993310,12cyclictest22-21ksoftirqd/123:44:041
70922321,4sleep12206-21dbus-daemon20:33:011
1267599325,4cyclictest81rcu_preempt20:45:011
1267599322,4cyclictest81rcu_preempt22:20:531
1267599321,5cyclictest0-21swapper/120:35:351
1267599321,29cyclictest0-21swapper/100:53:361
1267599313,4cyclictest81rcu_preempt20:45:121
1267599311,4cyclictest81rcu_preempt19:45:111
1267599311,10cyclictest18939-21awk19:40:001
318592301,5sleep10-21swapper/120:12:351
241572301,5sleep10-21swapper/119:50:471
147322301,5sleep10-21swapper/120:54:081
1267599303,12cyclictest81rcu_preempt20:00:161
1267599291,5cyclictest81rcu_preempt20:15:141
12675992815,10cyclictest22-21ksoftirqd/119:30:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional