You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon May 25, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200922534489,31sleep10-21swapper/119:21:051
204352532487,30sleep00-21swapper/019:24:420
194492940,5sleep019447-21needreboot22:10:230
20520997769,5cyclictest0-21swapper/119:28:261
128192640,5sleep0111rcuc/021:54:160
117502520,4sleep02051999cyclictest00:40:310
88972490,4sleep18780-21latency_hist23:10:011
117012400,5sleep111699-21grep00:40:301
2052099386,4cyclictest81rcu_preempt20:30:211
20519993822,5cyclictest3-21ksoftirqd/000:50:180
2051999378,14cyclictest618-21ntpq21:20:240
20519993721,6cyclictest3-21ksoftirqd/022:17:110
20519993721,5cyclictest3-21ksoftirqd/020:22:270
20519993720,6cyclictest3-21ksoftirqd/000:39:000
104762370,5sleep010472-21grep21:45:270
2052099361,15cyclictest0-21swapper/121:32:091
20519993621,5cyclictest3-21ksoftirqd/022:31:560
20519993621,5cyclictest3-21ksoftirqd/021:14:370
20520993525,6cyclictest23497-21/usr/sbin/munin22:20:261
20519993521,4cyclictest3-21ksoftirqd/019:53:030
20519993515,4cyclictest309852chrt00:06:100
2051999346,13cyclictest2225-21dbus-daemon23:42:200
20519993418,6cyclictest3-21ksoftirqd/022:26:230
20519993418,6cyclictest3-21ksoftirqd/000:33:020
20519993418,5cyclictest3-21ksoftirqd/021:29:560
20519993417,6cyclictest3-21ksoftirqd/020:10:550
120482341,4sleep112122-21iostat20:25:181
247532330,8sleep12052099cyclictest22:25:161
2051999335,13cyclictest2225-21dbus-daemon20:54:360
2051999333,14cyclictest2225-21dbus-daemon19:37:220
2051999332,18cyclictest0-21swapper/000:00:260
20519993319,4cyclictest3-21ksoftirqd/022:22:140
20519993317,6cyclictest3-21ksoftirqd/020:35:440
20519993317,5cyclictest3-21ksoftirqd/023:34:530
20519993317,5cyclictest3-21ksoftirqd/021:17:550
20519993317,5cyclictest3-21ksoftirqd/020:48:580
20520993222,6cyclictest28701-21/usr/sbin/munin00:00:271
2052099322,10cyclictest2695-21snmpd22:05:171
20519993218,4cyclictest3-21ksoftirqd/020:01:040
20519993218,4cyclictest3-21ksoftirqd/019:34:200
20519993217,5cyclictest3-21ksoftirqd/021:55:490
20519993217,5cyclictest3-21ksoftirqd/021:01:110
20519993217,5cyclictest3-21ksoftirqd/020:17:090
20519993217,5cyclictest3-21ksoftirqd/000:10:010
20519993216,6cyclictest3-21ksoftirqd/023:20:000
311092311,5sleep10-21swapper/100:07:291
264472310,9sleep12052099cyclictest21:05:001
2052099317,13cyclictest40250irq/92-i91521:35:161
2051999318,7cyclictest3-21ksoftirqd/020:30:220
2051999316,13cyclictest3-21ksoftirqd/021:05:180
20519993117,4cyclictest3-21ksoftirqd/019:44:520
20519993116,4cyclictest3-21ksoftirqd/000:18:480
2051999311,5cyclictest1974-21lldpad23:10:080
20519993114,6cyclictest3-21ksoftirqd/020:55:550
20519993114,6cyclictest3-21ksoftirqd/020:06:430
20519993112,6cyclictest8018-21iostat21:40:180
20519993110,5cyclictest3-21ksoftirqd/022:50:260
20519993110,11cyclictest3-21ksoftirqd/019:46:330
275552301,4sleep127639-21memory19:40:211
2052099306,4cyclictest81rcu_preempt19:49:211
2052099305,19cyclictest30300-21diskstats22:40:131
2052099303,3cyclictest81rcu_preempt23:16:141
20520993019,6cyclictest14976-21cat00:50:211
2051999304,13cyclictest5346-21cpu23:00:130
2051999301,7cyclictest0-21swapper/022:05:170
20519993015,5cyclictest3-21ksoftirqd/022:04:360
20519993014,5cyclictest3-21ksoftirqd/022:43:000
20519993014,5cyclictest3-21ksoftirqd/020:44:270
20519993010,6cyclictest12680-21diskstats00:45:130
35572291,5sleep10-21swapper/120:02:031
295472291,5sleep10-21swapper/122:37:081
221682291,5sleep00-21swapper/019:27:530
215942291,5sleep10-21swapper/123:41:141
2052099295,4cyclictest81rcu_preempt19:34:041
2052099293,4cyclictest81rcu_preempt20:41:561
2052099293,19cyclictest19656-21iostat_ios20:45:201
2052099293,11cyclictest2695-21snmpd21:57:291
2052099291,24cyclictest30363-21cut21:15:121
2052099291,15cyclictest12680-21diskstats00:45:131
2052099291,14cyclictest24214-21taskset20:56:441
20520992910,5cyclictest194502grep22:10:231
2051999296,11cyclictest0-21swapper/020:25:120
2051999293,21cyclictest3395-21grep00:20:170
2051999292,14cyclictest1151-21/usr/sbin/munin22:50:000
20519992915,4cyclictest3-21ksoftirqd/021:31:080
20519992914,5cyclictest3-21ksoftirqd/023:58:200
20519992914,4cyclictest3-21ksoftirqd/022:35:530
20519992911,6cyclictest3575-21df22:55:120
200292291,5sleep00-21swapper/023:39:460
143382291,5sleep00-21swapper/023:24:050
100592299,4sleep122-21ksoftirqd/100:37:341
7842281,5sleep10-21swapper/122:46:231
67652281,4sleep10-21swapper/123:03:371
49892281,5sleep10-21swapper/122:59:531
33702281,5sleep10-21swapper/121:28:441
278342281,5sleep10-21swapper/122:33:501
2052099289,6cyclictest40250irq/92-i91520:15:321
2052099288,7cyclictest2654-21sshd22:50:171
2052099285,4cyclictest81rcu_preempt19:58:111
2052099284,4cyclictest81rcu_preempt00:13:161
20520992818,5cyclictest18556-21cpuspeed_turbos23:35:151
2052099281,4cyclictest81rcu_preempt21:20:421
2052099281,4cyclictest40250irq/92-i91500:26:141
2052099280,4cyclictest81rcu_preempt19:36:551
2051999289,4cyclictest4831-21/usr/sbin/munin00:25:100
2051999288,3cyclictest0-21swapper/021:37:260
2051999284,18cyclictest14886-21diskstats23:25:140
20519992812,4cyclictest2401-21NetworkManager23:52:220
20519992811,6cyclictest1133-21python19:55:280
2051999281,14cyclictest8351-21chrt23:05:360
79932271,5sleep10-21swapper/100:30:351
74212271,5sleep10-21swapper/121:40:061
254522271,5sleep10-21swapper/123:52:181
211862271,21sleep10-21swapper/122:15:211
2052099273,4cyclictest81rcu_preempt21:46:471
2052099273,18cyclictest26886-21diskstats21:05:161
2052099273,18cyclictest15884-21iostat_ios20:35:221
2052099271,4cyclictest81rcu_preempt19:52:211
177662271,5sleep10-21swapper/123:30:431
166462271,5sleep10-21swapper/122:04:531
145832271,5sleep10-21swapper/123:25:051
125772271,5sleep10-21swapper/121:51:461
113272271,5sleep10-21swapper/120:24:381
301542261,5sleep10-21swapper/121:14:441
2052099263,4cyclictest81rcu_preempt00:18:011
2052099262,13cyclictest0-21swapper/100:21:131
2052099261,21cyclictest6479-21iostat_ios20:10:201
20520992612,11cyclictest4008-21/usr/sbin/munin20:05:271
2052099261,20cyclictest224072sleep120:52:261
20520992610,5cyclictest40250irq/92-i91523:48:581
20519992611,5cyclictest3-21ksoftirqd/023:47:080
142742261,4sleep10-21swapper/123:23:251
2052099252,4cyclictest81rcu_preempt23:57:581
2052099251,11cyclictest9898-21cat23:10:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional