You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 12:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Sun Nov 23, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811390,0rcu_preempt19-21ksoftirqd/120:19:491
811210,0rcu_preempt19-21ksoftirqd/122:10:141
811200,0rcu_preempt19-21ksoftirqd/121:41:161
811180,0rcu_preempt19-21ksoftirqd/123:09:371
811180,0rcu_preempt19-21ksoftirqd/123:08:201
811140,0rcu_preempt19-21ksoftirqd/123:39:171
811140,0rcu_preempt19-21ksoftirqd/123:15:001
811140,0rcu_preempt19-21ksoftirqd/123:15:001
811140,0rcu_preempt19-21ksoftirqd/122:53:251
811140,0rcu_preempt19-21ksoftirqd/122:48:331
811140,0rcu_preempt19-21ksoftirqd/122:44:271
811130,0rcu_preempt19-21ksoftirqd/120:29:501
811070,0rcu_preempt21824-1kworker/1:3H19:20:071
811060,0rcu_preempt19-21ksoftirqd/123:27:331
811050,0rcu_preempt19-21ksoftirqd/120:04:351
811020,0rcu_preempt19-21ksoftirqd/120:04:331
811020,0rcu_preempt19-21ksoftirqd/119:32:071
811010,0rcu_preempt20950-1kworker/1:4H22:31:211
81980,0rcu_preempt19-21ksoftirqd/100:20:221
81970,0rcu_preempt19-21ksoftirqd/121:38:141
81940,0rcu_preempt54-21kswapd000:11:521
81940,0rcu_preempt19-21ksoftirqd/100:15:261
81940,0rcu_preempt19-21ksoftirqd/100:15:261
81930,0rcu_preempt19-21ksoftirqd/122:23:221
81930,0rcu_preempt19-21ksoftirqd/100:25:071
107862910,0sleep010050irq/346-484840020:22:020
81900,0rcu_preempt19-21ksoftirqd/122:28:091
81900,0rcu_preempt19-21ksoftirqd/122:28:091
81900,0rcu_preempt19-21ksoftirqd/119:40:001
81900,0rcu_preempt19-21ksoftirqd/119:40:001
81840,0rcu_preempt19-21ksoftirqd/119:36:291
81840,0rcu_preempt19-21ksoftirqd/119:25:021
81830,0rcu_preempt54-21kswapd022:34:591
81830,0rcu_preempt19-21ksoftirqd/123:20:041
81830,0rcu_preempt19-21ksoftirqd/121:31:311
81830,0rcu_preempt19-21ksoftirqd/120:12:321
81820,0rcu_preempt19-21ksoftirqd/123:01:531
81820,0rcu_preempt19-21ksoftirqd/119:45:111
81810,0rcu_preempt19-21ksoftirqd/122:04:001
81810,0rcu_preempt19-21ksoftirqd/120:27:001
81810,0rcu_preempt19-21ksoftirqd/100:33:301
81800,0rcu_preempt25785-21diskmemload23:44:551
81800,0rcu_preempt19-21ksoftirqd/121:54:541
81800,0rcu_preempt19-21ksoftirqd/121:14:541
81800,0rcu_preempt19-21ksoftirqd/120:14:571
81800,0rcu_preempt19-21ksoftirqd/100:38:551
81780,0rcu_preempt19-21ksoftirqd/123:40:171
81780,0rcu_preempt19-21ksoftirqd/122:19:061
81780,0rcu_preempt19-21ksoftirqd/119:50:021
81780,0rcu_preempt19-21ksoftirqd/100:08:261
81770,0rcu_preempt54-21kswapd021:14:181
81770,0rcu_preempt19-21ksoftirqd/123:52:401
81770,0rcu_preempt19-21ksoftirqd/121:24:511
81770,0rcu_preempt19-21ksoftirqd/119:09:591
81760,0rcu_preempt19-21ksoftirqd/122:08:121
81750,0rcu_preempt19-21ksoftirqd/123:59:421
10050750,0irq/346-484840031658-1kworker/0:0H21:23:470
10050750,0irq/346-484840031658-1kworker/0:0H21:23:470
81740,0rcu_preempt19-21ksoftirqd/123:32:021
81740,0rcu_preempt19-21ksoftirqd/121:49:291
81740,0rcu_preempt19-21ksoftirqd/121:01:311
18870997412,0cyclictest20939-21ssh21:42:340
81730,0rcu_preempt19-21ksoftirqd/121:20:271
81730,0rcu_preempt19-21ksoftirqd/121:20:271
81730,0rcu_preempt19-21ksoftirqd/120:54:371
81730,0rcu_preempt19-21ksoftirqd/120:47:571
81730,0rcu_preempt19-21ksoftirqd/119:59:341
81730,0rcu_preempt19-21ksoftirqd/119:19:351
81730,0rcu_preempt19-21ksoftirqd/119:19:351
10050730,0irq/346-4848400111rcuc/022:11:580
81720,0rcu_preempt19-21ksoftirqd/122:56:121
81720,0rcu_preempt19-21ksoftirqd/121:49:591
10050710,0irq/346-4848400111rcuc/000:23:500
81700,0rcu_preempt19-21ksoftirqd/123:58:511
81700,0rcu_preempt19-21ksoftirqd/121:04:521
81700,0rcu_preempt19-21ksoftirqd/120:35:001
236392690,0sleep09950irq/345-484840000:25:220
1887099692,0cyclictest4554-1kworker/0:3H22:04:450
81680,0rcu_preempt19-21ksoftirqd/120:43:221
1887099683,0cyclictest0-21swapper/021:54:490
1887099682,0cyclictest0-21swapper/021:19:340
18870996810,0cyclictest778-1kworker/0:3H22:39:030
124262680,0sleep010050irq/346-484840020:27:080
18870996611,0cyclictest16101-21apt-get20:39:450
10050660,0irq/346-484840041ktimersoftd/023:23:410
302732650,0sleep09950irq/345-484840023:53:050
10050650,0irq/346-4848400111rcuc/023:03:540
1887099635,0cyclictest16225-1kworker/0:1H22:20:370
10050620,0irq/346-484840016225-1kworker/0:1H22:29:470
1887099616,0cyclictest25787-21ls21:09:330
1887099613,0cyclictest0-21swapper/022:54:460
1887099612,0cyclictest32702-21diskmemload00:38:020
1887099612,0cyclictest1369-21runrttasks21:10:380
1887099612,0cyclictest1369-21runrttasks20:11:060
1887099612,0cyclictest0-21swapper/022:14:480
18870996110,0cyclictest0-21swapper/023:27:160
1887099602,0cyclictest28654-21ssh23:10:500
1887099602,0cyclictest0-21swapper/020:04:550
18870996014,0cyclictest32340-21ssh23:55:050
10050600,0irq/346-48484000-21swapper/021:24:490
1887099591,0cyclictest10643-21runrttasks21:29:560
1887099586,0cyclictest16225-1kworker/0:1H22:27:540
1887099586,0cyclictest16225-1kworker/0:1H22:27:540
1887099582,0cyclictest31136-21apt-get23:14:460
1887099582,0cyclictest31136-21apt-get23:14:460
1887099582,0cyclictest28678-21latency_hist19:39:340
1887099582,0cyclictest0-21swapper/019:39:540
1887099582,0cyclictest0-21swapper/019:39:540
18870995811,0cyclictest7120-21df_inode00:04:480
135952580,0sleep09950irq/345-484840023:32:280
81570,0rcu_preempt3-21ksoftirqd/020:54:560
81570,0rcu_preempt3-21ksoftirqd/000:10:220
44022570,0sleep010050irq/346-484840020:03:520
1887099575,0cyclictest8079-1kworker/0:3H21:35:140
1887099572,0cyclictest22147-21ping19:44:460
1887099572,0cyclictest152852chrt20:35:030
1887099566,0cyclictest0-21swapper/022:49:560
1887099564,0cyclictest25115-1kworker/0:1H19:29:570
1887099562,0cyclictest12480-1kworker/0:0H00:14:460
1887099562,0cyclictest12480-1kworker/0:0H00:14:460
1887099561,0cyclictest22946-21apt-get23:04:450
10050560,0irq/346-48484004808-1kworker/0:3H00:04:330
1887099552,0cyclictest8473-1kworker/0:2H22:46:100
18870995511,0cyclictest22439-21aten_rapower_cu21:44:480
1887099551,0cyclictest26559-21munin-node0
18870995510,0cyclictest15087-21apt-get23:34:440
1887099542,0cyclictest4969-1kworker/0:1H22:42:530
1887099542,0cyclictest0-21swapper/023:39:370
18870995416,0cyclictest23237-21munin-node0
1887099534,0cyclictest23796-21basename19:24:330
1887099533,0cyclictest26475-21munin-node0
1887099532,0cyclictest0-21swapper/019:59:350
1887099531,0cyclictest1369-21runrttasks20:18:010
10050530,0irq/346-4848400751-21rngd22:01:100
1887099522,0cyclictest0-21swapper/020:59:470
1887099519,0cyclictest0-21swapper/020:50:000
18870995111,0cyclictest0-21swapper/019:49:470
1887099502,0cyclictest0-21swapper/020:49:330
1887099502,0cyclictest0-21swapper/019:15:000
1887099502,0cyclictest0-21swapper/019:15:000
1887099493,0cyclictest0-21swapper/019:25:020
1887099492,0cyclictest0-21swapper/020:30:050
18870994912,0cyclictest0-21swapper/019:09:580
10050390,0irq/346-48484000-21swapper/019:04:460
10050390,0irq/346-48484000-21swapper/019:04:460
81380,0rcu_preempt19-21ksoftirqd/119:04:561
81380,0rcu_preempt19-21ksoftirqd/119:04:561
81360,0rcu_preempt19-21ksoftirqd/120:49:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional