You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 12:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Eltec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot5s.osadl.org (updated Fri Nov 21, 2025 00:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
154182820sleep1121750irq/30-eth0_g0_21:35:111
121630ksoftirqd/1121750irq/30-eth0_g0_23:56:561
121630ksoftirqd/1121750irq/30-eth0_g0_00:07:101
203772530chrt121750irq/30-eth0_g0_21:55:151
121500ksoftirqd/1121750irq/30-eth0_g0_22:32:290
121650460irq/29-eth0_g0_31ksoftirqd/019:05:080
121650450irq/29-eth0_g0_1894-21runrttasks21:45:040
121650450irq/29-eth0_g0_13-21kworker/0:122:12:100
121650450irq/29-eth0_g0_121ksoftirqd/121:59:540
121450ksoftirqd/1121650irq/29-eth0_g0_23:36:301
121650440irq/29-eth0_g0_31ksoftirqd/021:57:120
121650440irq/29-eth0_g0_31ksoftirqd/000:30:090
121750430irq/30-eth0_g0_31ksoftirqd/023:04:410
121750430irq/30-eth0_g0_24393-21memory00:25:031
121750430irq/30-eth0_g0_1219-21kworker/1:200:30:141
121650430irq/29-eth0_g0_21920-21latency00:15:050
121430ksoftirqd/1121750irq/30-eth0_g0_19:50:080
91902420sleep1121650irq/29-eth0_g0_23:23:471
211632420sleep0121650irq/29-eth0_g0_00:10:180
121750420irq/30-eth0_g0_1219-21kworker/1:223:50:011
121750420irq/30-eth0_g0_1219-21kworker/1:223:41:311
121650420irq/29-eth0_g0_30805-21df22:40:010
121650420irq/29-eth0_g0_31ksoftirqd/023:37:320
121650420irq/29-eth0_g0_13-21kworker/0:121:26:130
121420ksoftirqd/1121750irq/30-eth0_g0_23:42:210
121420ksoftirqd/1121750irq/30-eth0_g0_22:42:461
300962410sleep030101-21timerandwakeup22:35:140
121650410irq/29-eth0_g0_13-21kworker/0:123:05:570
121650410irq/29-eth0_g0_13-21kworker/0:121:19:590
121650410irq/29-eth0_g0_13-21kworker/0:121:19:590
121410ksoftirqd/1121750irq/30-eth0_g0_00:08:070
107652410sleep0121650irq/29-eth0_g0_23:30:010
145822400sleep0121750irq/30-eth0_g0_21:33:270
121750400irq/30-eth0_g0_13-21kworker/0:122:55:090
121750400irq/30-eth0_g0_1219-21kworker/1:222:32:021
121750400irq/30-eth0_g0_1219-21kworker/1:200:19:121
121650400irq/29-eth0_g0_31ksoftirqd/023:13:210
121650400irq/29-eth0_g0_25166-21mailstats22:15:100
121650400irq/29-eth0_g0_1894-21runrttasks23:18:250
121650400irq/29-eth0_g0_1894-21runrttasks21:10:020
121650400irq/29-eth0_g0_16893-21/usr/sbin/munin19:30:050
121650400irq/29-eth0_g0_14796-21/usr/sbin/munin21:35:010
121650400irq/29-eth0_g0_13-21kworker/0:123:29:000
121650400irq/29-eth0_g0_13-21kworker/0:123:29:000
121650400irq/29-eth0_g0_13-21kworker/0:122:09:150
121650400irq/29-eth0_g0_13-21kworker/0:121:41:050
121650400irq/29-eth0_g0_13-21kworker/0:100:21:090
121650400irq/29-eth0_g0_121ksoftirqd/100:00:220
121650400irq/29-eth0_g0_0-21swapper/023:46:540
121400ksoftirqd/1121650irq/29-eth0_g0_00:10:131
121750390irq/30-eth0_g0_25841-21seq20:05:111
121750390irq/30-eth0_g0_1219-21kworker/1:222:54:191
121750390irq/30-eth0_g0_1219-21kworker/1:221:23:421
121750390irq/30-eth0_g0_1219-21kworker/1:221:23:421
121750390irq/30-eth0_g0_1219-21kworker/1:221:11:021
121650390irq/29-eth0_g0_31ksoftirqd/023:21:000
121650390irq/29-eth0_g0_31ksoftirqd/000:35:040
121650390irq/29-eth0_g0_1894-21runrttasks21:09:340
121650390irq/29-eth0_g0_13-21kworker/0:123:57:200
121650390irq/29-eth0_g0_13-21kworker/0:122:50:050
121650390irq/29-eth0_g0_13-21kworker/0:122:27:240
121650390irq/29-eth0_g0_13-21kworker/0:122:23:530
121650390irq/29-eth0_g0_13-21kworker/0:121:52:480
121650390irq/29-eth0_g0_13-21kworker/0:121:19:490
121650390irq/29-eth0_g0_13-21kworker/0:120:50:000
121390ksoftirqd/1121650irq/29-eth0_g0_21:40:141
201072380sleep0121650irq/29-eth0_g0_19:44:490
121750380irq/30-eth0_g0_1219-21kworker/1:223:17:361
121750380irq/30-eth0_g0_1219-21kworker/1:223:01:051
121750380irq/30-eth0_g0_1219-21kworker/1:221:51:161
121750380irq/30-eth0_g0_1219-21kworker/1:221:48:291
121750380irq/30-eth0_g0_1219-21kworker/1:221:28:451
121750380irq/30-eth0_g0_0-21swapper/123:06:041
121750380irq/30-eth0_g0_0-21swapper/122:44:561
121650380irq/29-eth0_g0_5511-21sendmail_mailqu20:55:150
121650380irq/29-eth0_g0_20871-21unixbench_singl19:45:100
121650380irq/29-eth0_g0_20871-21unixbench_singl19:45:100
121650380irq/29-eth0_g0_1894-21runrttasks19:28:010
121650380irq/29-eth0_g0_13-21kworker/0:123:52:300
121650380irq/29-eth0_g0_13-21kworker/0:100:26:370
121380ksoftirqd/1121650irq/29-eth0_g0_22:22:171
121380ksoftirqd/1121650irq/29-eth0_g0_19:50:101
121380ksoftirqd/111282-21taskset19:07:121
121750370irq/30-eth0_g0_21669-21taskset22:00:161
121750370irq/30-eth0_g0_18606-21taskset19:36:371
121750370irq/30-eth0_g0_1219-21kworker/1:223:12:301
121750370irq/30-eth0_g0_1219-21kworker/1:222:57:421
121750370irq/30-eth0_g0_1219-21kworker/1:222:09:511
121650370irq/29-eth0_g0_26875-21sendmail_mailqu20:10:120
121650370irq/29-eth0_g0_1894-21runrttasks21:02:210
121650370irq/29-eth0_g0_1894-21runrttasks20:17:310
121650370irq/29-eth0_g0_1894-21runrttasks20:08:280
121650370irq/29-eth0_g0_13-21kworker/0:122:46:300
121750360irq/30-eth0_g0_1219-21kworker/1:223:33:551
121750360irq/30-eth0_g0_1219-21kworker/1:223:26:541
121750360irq/30-eth0_g0_1219-21kworker/1:223:26:541
121750360irq/30-eth0_g0_1219-21kworker/1:222:06:451
121750360irq/30-eth0_g0_1219-21kworker/1:221:30:161
121750360irq/30-eth0_g0_0-21swapper/121:17:221
121650360irq/29-eth0_g0_24266-21ntpdc20:00:070
121650360irq/29-eth0_g0_1894-21runrttasks20:21:340
121650360irq/29-eth0_g0_1894-21runrttasks19:17:410
121650360irq/29-eth0_g0_18405-21unixbench_multi19:35:110
121360ksoftirqd/1121750irq/30-eth0_g0_00:20:131
121750350irq/30-eth0_g0_8459-21sshd21:08:411
121750350irq/30-eth0_g0_1219-21kworker/1:223:47:221
121750350irq/30-eth0_g0_1219-21kworker/1:222:35:101
121650350irq/29-eth0_g0_31887-21unixbench_multi20:30:160
121650350irq/29-eth0_g0_23231-21chrt19:55:100
121650350irq/29-eth0_g0_1894-21runrttasks20:46:010
121650350irq/29-eth0_g0_1894-21runrttasks20:25:230
121350ksoftirqd/1121650irq/29-eth0_g0_00:00:131
1151799352cyclictest29418-21unixbench_multi20:20:111
1151799351cyclictest691-21unixbench_singl20:35:101
1151799351cyclictest691-21unixbench_singl20:35:101
121750340irq/30-eth0_g0_1219-21kworker/1:222:15:551
121750340irq/30-eth0_g0_1219-21kworker/1:200:35:331
121650340irq/29-eth0_g0_1894-21runrttasks19:20:190
121650340irq/29-eth0_g0_1678-21/usr/sbin/munin20:40:090
121650340irq/29-eth0_g0_13-21kworker/0:120:35:000
121650340irq/29-eth0_g0_13-21kworker/0:120:35:000
121650340irq/29-eth0_g0_12402-21runrttasks19:10:520
121750330irq/30-eth0_g0_1219-21kworker/1:222:25:031
121750330irq/30-eth0_g0_0-21swapper/119:10:121
121330ksoftirqd/117191-21unixbench_singl19:30:111
1151799331cyclictest23797-21latency_hist19:59:481
1151799331cyclictest15506-21interrupts19:25:031
121750320irq/30-eth0_g0_7146-21taskset21:02:411
121650320irq/29-eth0_g0_5682-21grep20:55:171
121320ksoftirqd/12886-21netstat20:45:071
121750310irq/30-eth0_g0_14705-21unixbench_multi19:20:091
11517993125cyclictest27003-21unixbench_multi20:10:141
121750300irq/30-eth0_g0_4209-21proc_pri20:50:081
121750300irq/30-eth0_g0_20461-21/usr/sbin/munin19:45:031
121750300irq/30-eth0_g0_20461-21/usr/sbin/munin19:45:031
121750300irq/30-eth0_g0_0-21swapper/120:34:171
121650300irq/29-eth0_g0_30657-21tail20:25:111
121650300irq/29-eth0_g0_24508-21unixbench_multi20:00:121
121650300irq/29-eth0_g0_1548-21runrttasks20:40:061
121650300irq/29-eth0_g0_13241-21open_files19:15:071
121750290irq/30-eth0_g0_19029-21chrt19:39:571
121650280irq/29-eth0_g0_27633-21df_abs20:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional