You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 13:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot5s.osadl.org (updated Mon Dec 01, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
811240,0rcu_preempt12390-1kworker/1:0H23:46:081
811210,0rcu_preempt19-21ksoftirqd/100:09:411
2609621160,0sleep010050irq/346-484840020:10:240
81950,0rcu_preempt19-21ksoftirqd/119:19:271
10050860,0irq/346-484840041ktimersoftd/022:36:200
13150840,0irq/301-4802000111rcuc/021:09:430
10050840,0irq/346-484840019445-1kworker/0:0H22:03:390
10050790,0irq/346-4848400111rcuc/000:21:470
10050770,0irq/346-484840054-21kswapd021:33:030
81750,0rcu_preempt19-21ksoftirqd/123:24:011
81720,0rcu_preempt3-21ksoftirqd/021:40:280
81720,0rcu_preempt3-21ksoftirqd/021:40:280
10050710,0irq/346-48484002795-21missed_timers00:14:480
81700,0rcu_preempt16506-21kworker/1:223:31:221
81680,0rcu_preempt3-21ksoftirqd/022:23:350
81680,0rcu_preempt3-21ksoftirqd/022:12:050
81680,0rcu_preempt19-21ksoftirqd/122:24:411
81680,0rcu_preempt19-21ksoftirqd/122:06:541
104872680,0sleep19950irq/345-484840021:45:201
81670,0rcu_preempt19-21ksoftirqd/123:28:471
81670,0rcu_preempt19-21ksoftirqd/123:28:471
81670,0rcu_preempt19-21ksoftirqd/121:26:041
81670,0rcu_preempt19-21ksoftirqd/100:00:011
10050670,0irq/346-48484000-21swapper/021:56:220
81660,0rcu_preempt19-21ksoftirqd/123:14:511
81660,0rcu_preempt19-21ksoftirqd/123:14:511
81660,0rcu_preempt19-21ksoftirqd/121:19:151
81660,0rcu_preempt19-21ksoftirqd/121:13:381
81650,0rcu_preempt19-21ksoftirqd/123:09:441
219582650,0sleep09950irq/345-484840023:57:570
81640,0rcu_preempt19-21ksoftirqd/100:23:481
81630,0rcu_preempt19-21ksoftirqd/121:22:011
81630,0rcu_preempt19-21ksoftirqd/120:19:571
10050630,0irq/346-48484000-21swapper/021:36:350
81620,0rcu_preempt54-21kswapd022:15:250
81620,0rcu_preempt19-21ksoftirqd/122:40:201
81620,0rcu_preempt19-21ksoftirqd/122:11:551
81610,0rcu_preempt19-21ksoftirqd/123:37:301
81610,0rcu_preempt19-21ksoftirqd/122:49:351
81610,0rcu_preempt19-21ksoftirqd/122:36:211
81610,0rcu_preempt19-21ksoftirqd/121:37:371
10050610,0irq/346-48484007775-1kworker/1:0H22:31:251
10050610,0irq/346-484840015984-1kworker/0:2H22:33:590
10050610,0irq/346-48484000-21swapper/000:31:100
9950600,0irq/345-48484008208-1kworker/1:2H23:44:081
81600,0rcu_preempt5602-1kworker/0:2H19:19:310
81600,0rcu_preempt19-21ksoftirqd/123:00:481
81600,0rcu_preempt19-21ksoftirqd/122:22:171
81600,0rcu_preempt19-21ksoftirqd/122:14:361
81600,0rcu_preempt19-21ksoftirqd/119:24:381
81600,0rcu_preempt19-21ksoftirqd/100:16:241
294322600,0sleep010050irq/346-484840020:20:580
10050600,0irq/346-484840012162-1kworker/1:0H00:26:531
81590,0rcu_preempt19-21ksoftirqd/123:50:501
81590,0rcu_preempt19-21ksoftirqd/123:07:571
81590,0rcu_preempt19-21ksoftirqd/119:40:061
51592590,0sleep09950irq/345-484840023:37:380
10050590,0irq/346-48484007041-1kworker/1:4H21:42:241
10050590,0irq/346-48484007041-1kworker/1:4H21:42:241
10050590,0irq/346-484840031756-1kworker/1:1H22:58:111
10050590,0irq/346-484840015941-1kworker/1:1H00:37:051
81580,0rcu_preempt3-21ksoftirqd/023:09:470
81580,0rcu_preempt19-21ksoftirqd/121:58:391
81580,0rcu_preempt19-21ksoftirqd/121:50:561
81570,0rcu_preempt19-21ksoftirqd/121:30:201
81570,0rcu_preempt19-21ksoftirqd/120:24:401
81560,0rcu_preempt3-21ksoftirqd/023:20:260
81560,0rcu_preempt3-21ksoftirqd/021:24:380
279422560,0sleep010050irq/346-484840020:17:410
81550,0rcu_preempt3-21ksoftirqd/019:59:290
81550,0rcu_preempt25239-21ssh22:43:230
521899551,0cyclictest8489-21ping19:44:380
81540,0rcu_preempt3-21ksoftirqd/022:54:380
81540,0rcu_preempt3-21ksoftirqd/022:44:390
81540,0rcu_preempt3-21ksoftirqd/021:21:210
269222540,0sleep09950irq/345-484840022:05:080
193542540,0sleep09950irq/345-484840021:17:350
10050540,0irq/346-484840023965-1kworker/0:3H23:29:490
81530,0rcu_preempt3-21ksoftirqd/019:09:460
81530,0rcu_preempt3-21ksoftirqd/000:14:200
81530,0rcu_preempt19968-21kworker/0:123:28:380
81530,0rcu_preempt19968-21kworker/0:123:28:380
81530,0rcu_preempt12115-21diskmemload22:44:571
81530,0rcu_preempt10631-21apt-get21:04:390
10050530,0irq/346-484840054-21kswapd021:45:280
81520,0rcu_preempt3-21ksoftirqd/023:15:150
81520,0rcu_preempt3-21ksoftirqd/023:15:150
81520,0rcu_preempt19-21ksoftirqd/120:09:411
81520,0rcu_preempt19-21ksoftirqd/119:04:381
246292520,0sleep010050irq/346-484840020:07:100
10050520,0irq/346-48484006955-21ssh23:39:470
10050520,0irq/346-484840012161-1kworker/0:0H00:25:550
81510,0rcu_preempt3-21ksoftirqd/020:59:460
81510,0rcu_preempt3-21ksoftirqd/019:14:540
81510,0rcu_preempt19-21ksoftirqd/121:04:491
81510,0rcu_preempt0-21swapper/120:53:011
10050510,0irq/346-484840020658-21ssh23:55:471
10050510,0irq/346-48484000-21swapper/023:59:310
81500,0rcu_preempt3-21ksoftirqd/023:05:430
81500,0rcu_preempt3-21ksoftirqd/020:24:490
81500,0rcu_preempt15693-21kworker/0:121:53:180
10050500,0irq/346-484840054-21kswapd019:59:260
10050500,0irq/346-484840021953-21ssh21:59:481
10050500,0irq/346-484840012391-1kworker/0:0H23:49:350
81490,0rcu_preempt3-21ksoftirqd/023:46:330
81490,0rcu_preempt21378-21ping19:59:281
10050490,0irq/346-484840054-21kswapd000:29:451
10050490,0irq/346-484840020680-1kworker/1:2H00:06:281
10050490,0irq/346-484840020680-1kworker/1:2H00:06:281
81480,0rcu_preempt3-21ksoftirqd/022:51:460
81480,0rcu_preempt19-21ksoftirqd/120:33:591
81480,0rcu_preempt19-21ksoftirqd/120:07:091
10050480,0irq/346-4848400751-21rngd22:24:410
10050480,0irq/346-484840021587-21ssh00:39:260
81470,0rcu_preempt19-21ksoftirqd/120:57:501
81470,0rcu_preempt19-21ksoftirqd/120:14:481
81470,0rcu_preempt19-21ksoftirqd/119:59:531
10050470,0irq/346-48484000-21swapper/023:02:140
81460,0rcu_preempt3-21ksoftirqd/020:29:590
81460,0rcu_preempt16506-21kworker/1:219:34:581
10050460,0irq/346-484840054-21kswapd000:07:150
10050460,0irq/346-484840054-21kswapd000:07:150
81450,0rcu_preempt7343-21apt-get20:54:390
81450,0rcu_preempt3-21ksoftirqd/020:51:110
81450,0rcu_preempt19-21ksoftirqd/119:31:571
81450,0rcu_preempt19-21ksoftirqd/119:19:341
81440,0rcu_preempt3-21ksoftirqd/020:43:570
9950430,0irq/345-484840015315-21aten_rapower_vo19:39:420
9950430,0irq/345-48484000-21swapper/020:34:520
81430,0rcu_preempt3-21ksoftirqd/019:25:010
81430,0rcu_preempt1954-1kworker/1:3H20:37:091
81430,0rcu_preempt19-21ksoftirqd/120:41:231
81430,0rcu_preempt19-21ksoftirqd/119:44:421
81420,0rcu_preempt19-21ksoftirqd/119:49:541
81410,0rcu_preempt54-21kswapd019:04:470
81410,0rcu_preempt19-21ksoftirqd/119:12:061
81410,0rcu_preempt18722-21php-cgi19:49:490
81400,0rcu_preempt3-21ksoftirqd/020:44:410
81400,0rcu_preempt3-21ksoftirqd/019:29:390
81400,0rcu_preempt19-21ksoftirqd/120:59:381
10050400,0irq/346-484840013542-21munin-node0
81370,0rcu_preempt19-21ksoftirqd/120:48:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional