You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 12:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Eltec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot5s.osadl.org (updated Tue Sep 16, 2025 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121500ksoftirqd/1399050irq/30-eth0_g0_23:03:071
399050490irq/30-eth0_g0_23048-21/usr/sbin/munin21:15:241
121490ksoftirqd/1399050irq/30-eth0_g0_21:53:241
121470ksoftirqd/1399050irq/30-eth0_g0_23:59:211
121470ksoftirqd/1399050irq/30-eth0_g0_23:17:371
121470ksoftirqd/1399050irq/30-eth0_g0_21:05:141
121470ksoftirqd/1399050irq/30-eth0_g0_00:06:461
121460ksoftirqd/1399050irq/30-eth0_g0_22:05:401
398950450irq/29-eth0_g0_5327-21df22:45:200
398950450irq/29-eth0_g0_3334-21timerandwakeup22:30:300
121450ksoftirqd/1399050irq/30-eth0_g0_21:47:461
398950440irq/29-eth0_g0_121ksoftirqd/121:55:280
121440ksoftirqd/1399050irq/30-eth0_g0_22:01:101
121440ksoftirqd/1398950irq/29-eth0_g0_22:05:330
398950430irq/29-eth0_g0_31ksoftirqd/023:00:590
398950430irq/29-eth0_g0_1552-21awk19:00:250
121430ksoftirqd/1399050irq/30-eth0_g0_22:18:511
121430ksoftirqd/1398950irq/29-eth0_g0_19:15:291
399050420irq/30-eth0_g0_470-21kworker/1:100:02:271
399050420irq/30-eth0_g0_2481-21sendmail_mailqu22:25:281
399050420irq/30-eth0_g0_2481-21sendmail_mailqu22:25:281
398950420irq/29-eth0_g0_22885-21kworker/0:222:20:390
398950420irq/29-eth0_g0_121ksoftirqd/119:15:240
399050410irq/30-eth0_g0_121ksoftirqd/121:55:321
398950410irq/29-eth0_g0_22023-21sed00:25:310
121410ksoftirqd/1399050irq/30-eth0_g0_21:20:271
399050400irq/30-eth0_g0_121ksoftirqd/121:40:031
398950400irq/29-eth0_g0_22885-21kworker/0:222:19:360
398950400irq/29-eth0_g0_22885-21kworker/0:222:00:160
398950400irq/29-eth0_g0_22885-21kworker/0:221:52:540
398950400irq/29-eth0_g0_22759-21sendmail_mailqu21:10:310
191399402cyclictest9091-21grep19:45:291
121400ksoftirqd/1399050irq/30-eth0_g0_23:57:490
121400ksoftirqd/1399050irq/30-eth0_g0_23:39:291
121400ksoftirqd/1399050irq/30-eth0_g0_22:55:080
121400ksoftirqd/1399050irq/30-eth0_g0_00:30:120
121400ksoftirqd/1398950irq/29-eth0_g0_22:38:021
121400ksoftirqd/1398950irq/29-eth0_g0_22:31:461
399050390irq/30-eth0_g0_470-21kworker/1:123:53:121
399050390irq/30-eth0_g0_470-21kworker/1:123:25:431
399050390irq/30-eth0_g0_470-21kworker/1:121:27:271
399050390irq/30-eth0_g0_121ksoftirqd/122:55:501
398950390irq/29-eth0_g0_31ksoftirqd/023:14:070
398950390irq/29-eth0_g0_31ksoftirqd/021:40:210
398950390irq/29-eth0_g0_22885-21kworker/0:223:45:210
398950390irq/29-eth0_g0_22885-21kworker/0:223:44:140
398950390irq/29-eth0_g0_22885-21kworker/0:223:25:260
398950390irq/29-eth0_g0_22885-21kworker/0:222:13:580
398950390irq/29-eth0_g0_22885-21kworker/0:221:47:160
398950390irq/29-eth0_g0_22885-21kworker/0:221:31:270
398950390irq/29-eth0_g0_22885-21kworker/0:221:16:500
398950390irq/29-eth0_g0_22885-21kworker/0:200:05:090
398950390irq/29-eth0_g0_20611-21cpu00:20:170
398950390irq/29-eth0_g0_19220-21sort00:10:220
398950390irq/29-eth0_g0_121ksoftirqd/123:32:151
398950390irq/29-eth0_g0_121ksoftirqd/100:16:140
191399391cyclictest9695-21grep23:10:281
191399391cyclictest11445-21awk20:00:301
121390ksoftirqd/1399050irq/30-eth0_g0_21:21:450
121390ksoftirqd/1399050irq/30-eth0_g0_21:10:221
399050380irq/30-eth0_g0_470-21kworker/1:123:47:221
399050380irq/30-eth0_g0_470-21kworker/1:123:05:491
399050380irq/30-eth0_g0_470-21kworker/1:122:10:381
399050380irq/30-eth0_g0_470-21kworker/1:121:41:061
399050380irq/30-eth0_g0_31ksoftirqd/023:54:100
399050380irq/30-eth0_g0_121ksoftirqd/122:53:121
399050380irq/30-eth0_g0_121ksoftirqd/121:34:381
399050380irq/30-eth0_g0_121ksoftirqd/100:33:311
399050380irq/30-eth0_g0_0-21swapper/123:41:181
399050380irq/30-eth0_g0_0-21swapper/100:21:551
398950380irq/29-eth0_g0_7388-21find19:35:270
398950380irq/29-eth0_g0_22885-21kworker/0:223:37:500
398950380irq/29-eth0_g0_22885-21kworker/0:223:33:500
398950380irq/29-eth0_g0_22885-21kworker/0:223:20:220
398950380irq/29-eth0_g0_22885-21kworker/0:222:50:310
398950380irq/29-eth0_g0_22885-21kworker/0:222:35:390
398950380irq/29-eth0_g0_10569-21rt-features23:15:280
121380ksoftirqd/1399050irq/30-eth0_g0_21:28:480
121380ksoftirqd/1398950irq/29-eth0_g0_19:30:241
399050370irq/30-eth0_g0_470-21kworker/1:122:43:461
399050370irq/30-eth0_g0_470-21kworker/1:122:20:151
399050370irq/30-eth0_g0_121ksoftirqd/100:28:431
399050370irq/30-eth0_g0_121ksoftirqd/100:18:521
398950370irq/29-eth0_g0_22885-21kworker/0:223:05:190
398950370irq/29-eth0_g0_22885-21kworker/0:222:40:280
398950370irq/29-eth0_g0_22885-21kworker/0:221:36:580
398950370irq/29-eth0_g0_22885-21kworker/0:200:00:230
398950370irq/29-eth0_g0_1760-21wc19:00:291
398950370irq/29-eth0_g0_121ksoftirqd/122:45:201
398950370irq/29-eth0_g0_121ksoftirqd/100:10:431
191399371cyclictest3451-21grep19:10:281
191399371cyclictest21360-21wc21:05:071
399050360irq/30-eth0_g0_470-21kworker/1:123:20:071
398950360irq/29-eth0_g0_9024-21sendmail_mailtr19:45:280
398950360irq/29-eth0_g0_31ksoftirqd/022:28:430
398950360irq/29-eth0_g0_31ksoftirqd/022:28:430
398950360irq/29-eth0_g0_21820-21ntp_states21:05:250
398950360irq/29-eth0_g0_17217-21unixbench_multi20:35:280
398950360irq/29-eth0_g0_12790-21ls20:10:220
191399361cyclictest9877-21wc19:50:271
191399361cyclictest7314-21wc19:35:261
191399361cyclictest18835-21unixbench_multi20:45:321
191399361cyclictest13165-21unixbench_multi20:10:281
399050350irq/30-eth0_g0_19658-21sed20:50:281
399050350irq/30-eth0_g0_10836-21latency_hist20:00:071
398950350irq/29-eth0_g0_5831-21timerandwakeup19:25:280
398950350irq/29-eth0_g0_2393-21ntp_offset19:05:240
398950350irq/29-eth0_g0_19521-21sendmail_mailqu20:50:260
398950350irq/29-eth0_g0_15334-21ntp_offset20:25:210
398950350irq/29-eth0_g0_14801-21grep20:20:300
191399352cyclictest15199-21sort20:25:191
191399352cyclictest0-21swapper/120:30:291
121350ksoftirqd/1398950irq/29-eth0_g0_20:05:301
398950340irq/29-eth0_g0_21161-21mailstats21:00:270
398950340irq/29-eth0_g0_20260-21wc20:55:270
398950340irq/29-eth0_g0_18122-21latency_hist20:45:060
398950340irq/29-eth0_g0_18122-21latency_hist20:45:060
398950340irq/29-eth0_g0_12484-21ls20:10:080
191399341cyclictest5113-21sed19:20:301
191399341cyclictest20394-21cat20:55:291
191399341cyclictest13880-21sendmail_mailtr20:15:271
399050330irq/30-eth0_g0_3334-21sendmail_mailqu19:10:270
398950330irq/29-eth0_g0_6509-21ps19:30:260
398950330irq/29-eth0_g0_4564-21df_abs19:20:200
398950330irq/29-eth0_g0_16028-21ls20:30:230
398950330irq/29-eth0_g0_13570-21/usr/sbin/munin20:15:210
398950330irq/29-eth0_g0_11612-21/usr/sbin/munin20:00:320
398950330irq/29-eth0_g0_10105-21cpu19:55:190
398950330irq/29-eth0_g0_0-21swapper/019:50:280
191399331cyclictest5509-21sort19:25:221
121330ksoftirqd/1398950irq/29-eth0_g0_20:45:071
121330ksoftirqd/1398950irq/29-eth0_g0_20:45:071
398950320irq/29-eth0_g0_0-21swapper/020:45:260
399050310irq/30-eth0_g0_8299-21unixbench_multi19:40:291
399050310irq/30-eth0_g0_14804-21sed20:20:301
398950310irq/29-eth0_g0_470-21kworker/1:120:35:201
398950300irq/29-eth0_g0_8409-21latency_hist19:45:070
399050290irq/30-eth0_g0_0-21swapper/119:05:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional