You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-21 - 08:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Eltec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot5s.osadl.org (updated Tue Oct 21, 2025 00:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3040621080sleep1121450irq/29-eth0_g0_22:21:151
2573721050sleep0121550irq/30-eth0_g0_22:03:510
2573721050sleep0121550irq/30-eth0_g0_22:03:510
121880ksoftirqd/1121550irq/30-eth0_g0_23:32:070
121750ksoftirqd/1121550irq/30-eth0_g0_23:50:091
121730ksoftirqd/1121450irq/29-eth0_g0_23:45:140
324342690chrt121550irq/30-eth0_g0_22:30:131
290142670chrt121550irq/30-eth0_g0_20:00:150
131362650chrt121550irq/30-eth0_g0_21:09:541
121620ksoftirqd/1238822chrt21:55:160
121510ksoftirqd/1121550irq/30-eth0_g0_22:02:091
121510ksoftirqd/1121550irq/30-eth0_g0_22:02:091
121470ksoftirqd/1121550irq/30-eth0_g0_21:22:271
121460ksoftirqd/1121550irq/30-eth0_g0_22:40:201
121450ksoftirqd/1121550irq/30-eth0_g0_23:57:261
121550440irq/30-eth0_g0_1221-21kworker/1:221:38:151
121450440irq/29-eth0_g0_1961-21runrttasks19:05:170
121450440irq/29-eth0_g0_121ksoftirqd/123:07:200
121440ksoftirqd/1121450irq/29-eth0_g0_00:24:551
121440ksoftirqd/1121450irq/29-eth0_g0_00:24:551
121450430irq/29-eth0_g0_3184-21runrttasks22:44:500
121430ksoftirqd/1121550irq/30-eth0_g0_23:04:471
121430ksoftirqd/1121450irq/29-eth0_g0_23:36:311
121430ksoftirqd/1121450irq/29-eth0_g0_00:04:411
121550420irq/30-eth0_g0_1221-21kworker/1:222:38:241
121550420irq/30-eth0_g0_1221-21kworker/1:222:38:241
121550420irq/30-eth0_g0_1221-21kworker/1:221:56:161
121450420irq/29-eth0_g0_13-21kworker/0:121:10:080
121450420irq/29-eth0_g0_121ksoftirqd/123:53:300
79652410sleep0121450irq/29-eth0_g0_23:03:360
121450410irq/29-eth0_g0_31505-21sed22:25:200
121450410irq/29-eth0_g0_31ksoftirqd/023:19:100
121450410irq/29-eth0_g0_1961-21runrttasks00:07:470
121450410irq/29-eth0_g0_13-21kworker/0:123:35:060
121450410irq/29-eth0_g0_13-21kworker/0:122:48:080
121450410irq/29-eth0_g0_13-21kworker/0:121:31:150
121450410irq/29-eth0_g0_12510-21unixbench_singl23:20:220
121450410irq/29-eth0_g0_121ksoftirqd/121:23:100
121450410irq/29-eth0_g0_121ksoftirqd/100:11:550
121410ksoftirqd/1121450irq/29-eth0_g0_20:20:131
121550400irq/30-eth0_g0_31ksoftirqd/022:59:470
121550400irq/30-eth0_g0_121ksoftirqd/100:22:121
121450400irq/29-eth0_g0_21780-21unixbench_multi19:30:180
121450400irq/29-eth0_g0_1961-21runrttasks20:56:450
121450400irq/29-eth0_g0_175102sleep019:15:060
121450400irq/29-eth0_g0_13-21kworker/0:122:35:080
121450400irq/29-eth0_g0_13-21kworker/0:122:35:080
121450400irq/29-eth0_g0_13-21kworker/0:122:34:060
121450400irq/29-eth0_g0_13-21kworker/0:121:45:460
121450400irq/29-eth0_g0_13-21kworker/0:121:35:240
121450400irq/29-eth0_g0_13-21kworker/0:100:36:130
121450400irq/29-eth0_g0_121ksoftirqd/123:19:011
121400ksoftirqd/1121550irq/30-eth0_g0_23:29:520
121400ksoftirqd/1121450irq/29-eth0_g0_21:44:251
121400ksoftirqd/1121450irq/29-eth0_g0_19:27:421
121400ksoftirqd/1121450irq/29-eth0_g0_19:16:211
121400ksoftirqd/1121450irq/29-eth0_g0_00:08:101
1613599391cyclictest21408-21awk21:45:101
1613599391cyclictest13735-21grep23:25:211
121550390irq/30-eth0_g0_1221-21kworker/1:223:47:201
121550390irq/30-eth0_g0_1221-21kworker/1:223:21:181
121550390irq/30-eth0_g0_1221-21kworker/1:200:32:111
121550390irq/30-eth0_g0_121ksoftirqd/122:44:591
121550390irq/30-eth0_g0_121ksoftirqd/122:06:221
121450390irq/29-eth0_g0_31500-21timerandwakeup20:10:130
121450390irq/29-eth0_g0_31ksoftirqd/023:12:040
121450390irq/29-eth0_g0_28645-21load22:15:080
121450390irq/29-eth0_g0_1613499cyclictest00:30:140
121450390irq/29-eth0_g0_13-21kworker/0:122:22:500
121450390irq/29-eth0_g0_13-21kworker/0:122:12:590
121450390irq/29-eth0_g0_13-21kworker/0:121:53:180
121450390irq/29-eth0_g0_13-21kworker/0:121:40:060
121450390irq/29-eth0_g0_13-21kworker/0:100:27:210
121450390irq/29-eth0_g0_13-21kworker/0:100:27:210
121450390irq/29-eth0_g0_13-21kworker/0:100:20:380
121450390irq/29-eth0_g0_121ksoftirqd/123:09:591
121390ksoftirqd/1121450irq/29-eth0_g0_22:12:281
121390ksoftirqd/1121450irq/29-eth0_g0_19:24:141
1613599382cyclictest25693-21ntp_states00:15:121
1613599382cyclictest13645-21proc_pri21:10:121
1613599381cyclictest9967-21proc_pri20:55:131
1613599381cyclictest0-21swapper/119:10:081
121550380irq/30-eth0_g0_31ksoftirqd/023:55:080
121550380irq/30-eth0_g0_1221-21kworker/1:223:06:441
121550380irq/30-eth0_g0_1221-21kworker/1:222:56:031
121550380irq/30-eth0_g0_1221-21kworker/1:222:15:191
121550380irq/30-eth0_g0_1221-21kworker/1:221:31:481
121550380irq/30-eth0_g0_121ksoftirqd/123:33:481
121550380irq/30-eth0_g0_121ksoftirqd/122:28:061
121550380irq/30-eth0_g0_121ksoftirqd/121:19:421
121550380irq/30-eth0_g0_0-21swapper/123:40:071
121550380irq/30-eth0_g0_0-21swapper/123:40:071
121450380irq/29-eth0_g0_9422-21latency_hist20:54:530
121450380irq/29-eth0_g0_26465-21fgrep22:05:190
121450380irq/29-eth0_g0_175952sleep023:41:510
121450380irq/29-eth0_g0_175952sleep023:41:510
121450380irq/29-eth0_g0_14685-21latency21:15:110
121450380irq/29-eth0_g0_121ksoftirqd/100:16:260
121450380irq/29-eth0_g0_0-21swapper/000:01:470
121380ksoftirqd/1121450irq/29-eth0_g0_21:25:381
121380ksoftirqd/1121450irq/29-eth0_g0_20:50:361
121380ksoftirqd/1121450irq/29-eth0_g0_19:32:351
1613599371cyclictest28922-21ps20:00:131
1613599371cyclictest22990-21sed19:35:161
121550370irq/30-eth0_g0_15123-21df_abs19:05:051
121550370irq/30-eth0_g0_1221-21kworker/1:220:30:101
121550370irq/30-eth0_g0_121ksoftirqd/122:53:491
121550370irq/30-eth0_g0_0-21swapper/100:11:071
121450370irq/29-eth0_g0_6515-21grep20:40:150
121450370irq/29-eth0_g0_3986-21timerandwakeup20:30:160
121450370irq/29-eth0_g0_22560-21/usr/sbin/munin19:35:080
121450370irq/29-eth0_g0_13-21kworker/0:122:51:180
121450370irq/29-eth0_g0_13-21kworker/0:121:27:390
121450370irq/29-eth0_g0_11365-21unixbench_multi21:00:140
1613599361cyclictest31027-21df_abs20:10:041
1613599361cyclictest25472-21grep19:45:201
121550360irq/30-eth0_g0_30893-21head00:35:171
121550360irq/30-eth0_g0_0-21swapper/120:45:081
121550360irq/30-eth0_g0_0-21swapper/120:45:081
121450360irq/29-eth0_g0_29679-21/usr/sbin/munin20:05:140
121450360irq/29-eth0_g0_16294-21sed19:10:050
1613599351cyclictest30341-21sed20:05:161
1613599351cyclictest26555-21chrt19:50:121
121550350irq/30-eth0_g0_22823-21awk21:50:141
121450350irq/29-eth0_g0_7325-21latency20:45:080
121450350irq/29-eth0_g0_7325-21latency20:45:080
121450350irq/29-eth0_g0_2316-21df_inode20:25:070
121450350irq/29-eth0_g0_1961-21runrttasks19:40:120
121450350irq/29-eth0_g0_1961-21runrttasks19:40:120
41350340irq/23-fsldma-c4612-21/usr/sbin/munin20:35:110
1613599342cyclictest24022-21proc_pri19:40:111
1613599342cyclictest24022-21proc_pri19:40:111
1613599341cyclictest2709-21mailstats20:25:151
121550340irq/30-eth0_g0_6457-21sed20:40:151
121450340irq/29-eth0_g0_904-21/usr/sbin/munin20:20:100
121450340irq/29-eth0_g0_32717-21cat20:15:160
121450340irq/29-eth0_g0_25086-21memory19:45:140
121450340irq/29-eth0_g0_1961-21runrttasks21:06:440
121450340irq/29-eth0_g0_1961-21runrttasks19:58:010
121450340irq/29-eth0_g0_19310-21unixbench_multi19:20:180
1613599331cyclictest0-21swapper/119:55:171
121450330irq/29-eth0_g0_26471-21ps19:50:100
121450330irq/29-eth0_g0_20270-21ntpdc19:25:090
121450320irq/29-eth0_g0_702-21runrttasks20:18:401
1613599311cyclictest0-21swapper/120:39:101
121450290irq/29-eth0_g0_11281-21which21:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional