You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 02:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Thu Nov 27, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811450,0rcu_preempt19-21ksoftirqd/107:39:291
811200,0rcu_preempt21380-1kworker/1:2H10:19:341
811080,0rcu_preempt19-21ksoftirqd/108:07:471
81930,0rcu_preempt19-21ksoftirqd/107:59:341
10050850,0irq/346-4848400111rcuc/010:26:220
10050820,0irq/346-4848400111rcuc/009:09:400
81790,0rcu_preempt54-21kswapd009:34:581
10050790,0irq/346-4848400111rcuc/012:07:460
10050780,0irq/346-4848400111rcuc/011:23:440
10050780,0irq/346-4848400111rcuc/011:23:440
81770,0rcu_preempt19-21ksoftirqd/111:18:001
81750,0rcu_preempt30298-21cyclictest12:35:221
81750,0rcu_preempt30298-21cyclictest12:35:221
10050750,0irq/346-484840054-21kswapd011:11:330
10050750,0irq/346-484840021113-1kworker/0:3H09:32:260
10050720,0irq/346-4848400111rcuc/010:46:290
3029999681,0cyclictest4396-21apt-get11:24:430
30299996810,0cyclictest24499-1kworker/0:0H11:58:200
10050670,0irq/346-484840024499-1kworker/0:0H12:00:510
3029999651,0cyclictest4965-21if_err_eth207:29:560
3029999649,0cyclictest10250-1kworker/0:4H10:04:450
3029999642,0cyclictest1158-21ping07:34:410
3029999641,0cyclictest11687-21ssh10:49:390
224282640,0sleep010050irq/346-484840008:24:280
3029999632,0cyclictest28313-1kworker/0:1H10:38:190
30299996310,0cyclictest25365-21ssh11:52:480
3029999621,0cyclictest6938-1kworker/0:2H09:58:130
3029999621,0cyclictest6804-1kworker/0:0H10:42:220
10050620,0irq/346-484840028530-1kworker/0:3H09:43:450
10050620,0irq/346-4848400111rcuc/011:05:140
81610,0rcu_preempt23277-21memory10:19:540
3029999612,0cyclictest0-21swapper/012:16:570
3029999611,0cyclictest27055-1kworker/0:0H08:39:290
3029999605,0cyclictest28530-1kworker/0:3H09:44:330
3029999602,0cyclictest0-21swapper/008:29:450
81590,0rcu_preempt19-21ksoftirqd/109:17:011
81590,0rcu_preempt16158-21memory10:54:530
3029999599,0cyclictest326152sleep008:54:440
3029999599,0cyclictest326152sleep008:54:440
3029999596,0cyclictest19112-21latency_hist11:44:290
3029999592,0cyclictest2963-21apt07:24:380
3029999592,0cyclictest1158-21ping07:39:480
3029999592,0cyclictest0-21swapper/011:34:410
3029999592,0cyclictest0-21swapper/011:34:410
3029999592,0cyclictest0-21swapper/011:30:020
3029999592,0cyclictest0-21swapper/007:47:130
30299995913,0cyclictest0-21swapper/008:24:470
30299995911,0cyclictest0-21swapper/009:59:300
3029999591,0cyclictest0-21swapper/012:37:410
3029999591,0cyclictest0-21swapper/012:37:410
10050590,0irq/346-4848400751-21rngd12:29:221
10050590,0irq/346-484840054-21kswapd010:26:411
81580,0rcu_preempt22989-21diskstats09:34:440
81580,0rcu_preempt19-21ksoftirqd/109:40:331
3029999582,0cyclictest0-21swapper/011:14:410
3029999581,0cyclictest8572-21apt-get09:14:400
3029999581,0cyclictest23418-21taskset12:29:340
3029999581,0cyclictest14741-21munin-node0
81570,0rcu_preempt32292-21diskstats07:14:460
81570,0rcu_preempt3-21ksoftirqd/012:09:420
81570,0rcu_preempt19-21ksoftirqd/110:14:121
81570,0rcu_preempt19-21ksoftirqd/109:29:071
3029999575,0cyclictest0-21swapper/012:26:050
3029999572,0cyclictest0-21swapper/011:46:340
3029999571,0cyclictest12035-1kworker/0:3H09:24:470
299182570,0sleep09950irq/345-484840010:29:420
81560,0rcu_preempt751-21rngd10:00:101
81560,0rcu_preempt3-21ksoftirqd/009:19:520
81560,0rcu_preempt19-21ksoftirqd/112:18:031
81560,0rcu_preempt19-21ksoftirqd/112:10:391
81560,0rcu_preempt19-21ksoftirqd/112:06:201
81560,0rcu_preempt19-21ksoftirqd/110:15:521
81560,0rcu_preempt19-21ksoftirqd/110:15:521
81560,0rcu_preempt19-21ksoftirqd/109:22:351
3029999566,0cyclictest156672sleep010:09:440
3029999562,0cyclictest1158-21ping07:19:420
3029999562,0cyclictest0-21swapper/008:14:410
3029999562,0cyclictest0-21swapper/007:59:590
3029999561,0cyclictest20448-21munin-node0
3029999561,0cyclictest20448-21munin-node0
3029999561,0cyclictest1369-21runrttasks08:39:440
10050560,0irq/346-484840020950-1kworker/1:1H11:46:051
81550,0rcu_preempt19-21ksoftirqd/112:34:091
81550,0rcu_preempt19-21ksoftirqd/111:59:511
81550,0rcu_preempt19-21ksoftirqd/111:05:441
81550,0rcu_preempt19-21ksoftirqd/110:57:161
81550,0rcu_preempt19-21ksoftirqd/110:47:471
81550,0rcu_preempt19-21ksoftirqd/110:30:301
81550,0rcu_preempt19-21ksoftirqd/109:45:351
81550,0rcu_preempt19-21ksoftirqd/109:12:301
81550,0rcu_preempt0-21swapper/111:19:501
81550,0rcu_preempt0-21swapper/111:19:501
3029999551,0cyclictest19537-21ssh11:00:010
81540,0rcu_preempt19-21ksoftirqd/112:22:511
81540,0rcu_preempt19-21ksoftirqd/111:41:291
81540,0rcu_preempt19-21ksoftirqd/111:35:141
81540,0rcu_preempt19-21ksoftirqd/111:35:141
81540,0rcu_preempt19-21ksoftirqd/111:25:041
81540,0rcu_preempt19-21ksoftirqd/110:50:551
81540,0rcu_preempt19-21ksoftirqd/109:55:481
81540,0rcu_preempt19-21ksoftirqd/109:54:081
81540,0rcu_preempt19-21ksoftirqd/109:30:031
81540,0rcu_preempt19-21ksoftirqd/108:45:151
81540,0rcu_preempt19-21ksoftirqd/108:22:091
3029999542,0cyclictest30677-21runrttasks07:09:470
3029999541,0cyclictest1615-21apt-get09:49:420
10050540,0irq/346-484840024500-1kworker/1:3H11:52:131
81530,0rcu_preempt30983-21df_inode08:49:470
81530,0rcu_preempt19-21ksoftirqd/111:33:241
81530,0rcu_preempt19-21ksoftirqd/111:13:181
81530,0rcu_preempt19-21ksoftirqd/110:05:081
81530,0rcu_preempt19-21ksoftirqd/108:24:481
81530,0rcu_preempt19-21ksoftirqd/108:09:551
81530,0rcu_preempt19-21ksoftirqd/108:09:551
3029999533,0cyclictest0-21swapper/009:09:290
3029999532,0cyclictest0-21swapper/008:05:100
3029999532,0cyclictest0-21swapper/007:49:450
3029999531,0cyclictest18328-21ntp_kernel_pll_08:09:560
3029999531,0cyclictest18328-21ntp_kernel_pll_08:09:560
81520,0rcu_preempt19-21ksoftirqd/108:40:271
3029999521,0cyclictest12312-1kworker/0:1H07:54:480
10050520,0irq/346-484840054-21kswapd011:59:311
81510,0rcu_preempt19-21ksoftirqd/108:59:271
81510,0rcu_preempt19-21ksoftirqd/108:59:271
3029999513,0cyclictest0-21swapper/008:59:410
30299995111,0cyclictest25421-1kworker/0:1H08:44:490
81500,0rcu_preempt19-21ksoftirqd/107:44:551
81500,0rcu_preempt19-21ksoftirqd/107:24:311
81500,0rcu_preempt0-21swapper/111:00:331
10050500,0irq/346-4848400818-1kworker/1:3H07:19:331
10050500,0irq/346-484840019-21ksoftirqd/110:38:171
81490,0rcu_preempt19-21ksoftirqd/108:29:491
9950480,0irq/345-484840019-21ksoftirqd/108:14:501
81480,0rcu_preempt19-21ksoftirqd/107:44:301
10050470,0irq/346-48484003182-1kworker/1:3H10:39:341
81460,0rcu_preempt3-21ksoftirqd/007:04:440
81450,0rcu_preempt19-21ksoftirqd/107:29:561
81430,0rcu_preempt19-21ksoftirqd/107:14:481
10050430,0irq/346-484840013948-1kworker/1:3H07:59:311
9950420,0irq/345-48484000-21swapper/107:04:591
81420,0rcu_preempt19-21ksoftirqd/107:10:091
81420,0rcu_preempt12485-21runrttasks07:53:161
81420,0rcu_preempt0-21swapper/109:05:341
81420,0rcu_preempt0-21swapper/108:52:401
81420,0rcu_preempt0-21swapper/108:35:001
81410,0rcu_preempt19-21ksoftirqd/109:01:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional