You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot5s.osadl.org (updated Sat Jul 12, 2025 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10050960,0irq/346-4848400111rcuc/000:13:340
81890,0rcu_preempt5857-1kworker/1:1H20:11:581
81870,0rcu_preempt26086-21ps19:27:181
81870,0rcu_preempt26086-21ps19:27:181
81780,0rcu_preempt19-21ksoftirqd/120:06:561
81730,0rcu_preempt19-21ksoftirqd/122:42:061
81710,0rcu_preempt7391-21kworker/0:223:21:050
81710,0rcu_preempt3-21ksoftirqd/021:58:050
81710,0rcu_preempt2357-21ping19:55:110
81690,0rcu_preempt3-21ksoftirqd/021:19:060
81680,0rcu_preempt3-21ksoftirqd/023:32:190
81680,0rcu_preempt3-21ksoftirqd/021:45:390
81680,0rcu_preempt3-21ksoftirqd/021:35:370
81680,0rcu_preempt3-21ksoftirqd/019:09:550
81680,0rcu_preempt28077-21kworker/0:019:33:320
81680,0rcu_preempt25574-21diskmemload22:48:180
81670,0rcu_preempt7078-21kworker/0:022:52:480
81670,0rcu_preempt54-21kswapd021:03:070
81670,0rcu_preempt3-21ksoftirqd/023:38:520
81670,0rcu_preempt3-21ksoftirqd/023:22:370
81670,0rcu_preempt3-21ksoftirqd/022:02:050
81670,0rcu_preempt3-21ksoftirqd/021:47:020
81670,0rcu_preempt25574-21diskmemload21:11:080
81670,0rcu_preempt22826-21ssh21:40:140
81670,0rcu_preempt1361-21runrttasks00:30:250
81660,0rcu_preempt3-21ksoftirqd/023:43:060
81660,0rcu_preempt3-21ksoftirqd/023:30:390
81660,0rcu_preempt3-21ksoftirqd/021:12:170
81660,0rcu_preempt3-21ksoftirqd/020:37:040
81660,0rcu_preempt3-21ksoftirqd/020:21:560
81660,0rcu_preempt17561-21kworker/0:100:05:440
81650,0rcu_preempt3-21ksoftirqd/023:06:220
81650,0rcu_preempt3-21ksoftirqd/022:38:090
81650,0rcu_preempt3-21ksoftirqd/022:19:450
81650,0rcu_preempt3-21ksoftirqd/022:15:580
81650,0rcu_preempt3-21ksoftirqd/022:07:050
81650,0rcu_preempt3-21ksoftirqd/021:24:290
81650,0rcu_preempt3-21ksoftirqd/020:42:350
81640,0rcu_preempt8594-21ssh00:36:390
81640,0rcu_preempt3-21ksoftirqd/023:57:260
81640,0rcu_preempt3-21ksoftirqd/023:47:000
81640,0rcu_preempt3-21ksoftirqd/023:11:490
81640,0rcu_preempt3-21ksoftirqd/023:10:570
81640,0rcu_preempt3-21ksoftirqd/022:58:160
81640,0rcu_preempt3-21ksoftirqd/022:42:110
81640,0rcu_preempt3-21ksoftirqd/022:32:250
81640,0rcu_preempt3-21ksoftirqd/022:29:020
81640,0rcu_preempt3-21ksoftirqd/022:22:500
81640,0rcu_preempt3-21ksoftirqd/021:55:500
81640,0rcu_preempt3-21ksoftirqd/021:30:460
81640,0rcu_preempt3-21ksoftirqd/020:19:410
81640,0rcu_preempt3-21ksoftirqd/020:19:410
81640,0rcu_preempt3-21ksoftirqd/020:07:150
81630,0rcu_preempt3-21ksoftirqd/023:52:020
81630,0rcu_preempt3-21ksoftirqd/023:52:020
81630,0rcu_preempt3-21ksoftirqd/020:49:490
81630,0rcu_preempt3-21ksoftirqd/020:26:450
81630,0rcu_preempt3-21ksoftirqd/019:46:510
81630,0rcu_preempt3-21ksoftirqd/019:44:420
81630,0rcu_preempt3-21ksoftirqd/019:26:540
81630,0rcu_preempt3-21ksoftirqd/019:26:540
81630,0rcu_preempt3-21ksoftirqd/019:22:180
81630,0rcu_preempt3-21ksoftirqd/019:22:180
81630,0rcu_preempt3-21ksoftirqd/000:22:050
81630,0rcu_preempt3-21ksoftirqd/000:07:010
81630,0rcu_preempt19-21ksoftirqd/120:46:581
81630,0rcu_preempt0-21swapper/019:12:010
81620,0rcu_preempt3-21ksoftirqd/020:58:580
81620,0rcu_preempt3-21ksoftirqd/020:53:480
81620,0rcu_preempt3-21ksoftirqd/019:37:230
81620,0rcu_preempt19-21ksoftirqd/100:02:121
81610,0rcu_preempt3-21ksoftirqd/020:33:120
81610,0rcu_preempt3-21ksoftirqd/019:58:560
81610,0rcu_preempt3-21ksoftirqd/019:21:430
81610,0rcu_preempt3-21ksoftirqd/019:21:430
81600,0rcu_preempt3-21ksoftirqd/020:04:000
81600,0rcu_preempt3-21ksoftirqd/000:17:040
81600,0rcu_preempt3-21ksoftirqd/000:17:040
81590,0rcu_preempt3-21ksoftirqd/020:12:050
81570,0rcu_preempt19-21ksoftirqd/100:32:071
9950550,0irq/345-4848400181ktimersoftd/123:15:081
9950540,0irq/345-4848400753-21rngd22:01:161
81540,0rcu_preempt19-21ksoftirqd/122:56:551
81540,0rcu_preempt19-21ksoftirqd/122:01:541
81540,0rcu_preempt19-21ksoftirqd/121:46:581
9950510,0irq/345-484840032514-21munin-node1
81510,0rcu_preempt19-21ksoftirqd/123:53:581
81510,0rcu_preempt19-21ksoftirqd/123:53:581
81510,0rcu_preempt19-21ksoftirqd/121:36:011
9950500,0irq/345-484840015486-1kworker/1:0H22:11:471
10050500,0irq/346-484840027408-1kworker/1:0H22:22:081
10050500,0irq/346-484840022156-21latency_hist22:16:441
10050480,0irq/346-48484005495-1kworker/1:3H23:49:451
10050470,0irq/346-484840054-21kswapd000:31:381
10050470,0irq/346-48484002974-1kworker/1:0H23:34:551
9950460,0irq/345-484840013761-1kworker/1:1H22:56:151
81460,0rcu_preempt3-21ksoftirqd/019:02:070
81460,0rcu_preempt3-21ksoftirqd/019:02:070
81460,0rcu_preempt19-21ksoftirqd/123:07:011
81460,0rcu_preempt19-21ksoftirqd/121:40:221
81460,0rcu_preempt19-21ksoftirqd/120:31:551
10050460,0irq/346-484840054-21kswapd023:41:161
10050460,0irq/346-484840018585-21cyclictest21:07:231
9950450,0irq/345-48484004090-1kworker/1:0H21:19:071
81450,0rcu_preempt22457-21apt-get20:56:561
81450,0rcu_preempt19-21ksoftirqd/123:06:441
10050450,0irq/346-484840030349-1kworker/1:2H21:53:231
81430,0rcu_preempt24463-21if_err_eth221:02:021
81420,0rcu_preempt4382-21apt-get20:01:561
81420,0rcu_preempt25574-21diskmemload23:21:111
81420,0rcu_preempt2357-21ping20:17:011
81420,0rcu_preempt2357-21ping20:17:011
81420,0rcu_preempt19-21ksoftirqd/120:21:571
81420,0rcu_preempt13983-21if_eth022:07:041
10050420,0irq/346-484840022195-21ssh23:31:111
81410,0rcu_preempt25574-21diskmemload21:27:071
81410,0rcu_preempt12728-21cpu20:26:561
10050410,0irq/346-48484006638-21ssh22:35:581
10050410,0irq/346-484840015418-21ssh23:22:241
9950400,0irq/345-484840018153-1kworker/1:4H00:07:141
81400,0rcu_preempt32018-21if_eth323:42:031
10050400,0irq/346-48484006628-21apt-get21:21:561
10050400,0irq/346-4848400417-21ssh22:28:151
10050400,0irq/346-484840013423-21ssh23:57:421
10050400,0irq/346-48484000-21swapper/122:39:521
81390,0rcu_preempt30320-21aten_rapower_po19:42:011
81390,0rcu_preempt2315-1kworker/1:3H19:56:441
81390,0rcu_preempt16291-21ssh22:47:021
10050390,0irq/346-484840054-21kswapd000:13:091
10050390,0irq/346-484840032275-21ssh21:13:321
10050390,0irq/346-48484001075-21munin-node1
10050390,0irq/346-48484000-21swapper/100:18:221
10050390,0irq/346-48484000-21swapper/100:18:221
81380,0rcu_preempt19-21ksoftirqd/119:01:561
81380,0rcu_preempt19-21ksoftirqd/119:01:561
81380,0rcu_preempt17622-21aten_rapower_vo20:41:571
10050380,0irq/346-484840024009-21ssh21:41:511
9950370,0irq/345-484840021875-21ping19:36:431
81370,0rcu_preempt0-21swapper/119:07:031
9950360,0irq/345-484840054-21kswapd019:37:211
81360,0rcu_preempt0-21swapper/120:37:141
10050360,0irq/346-4848400753-21rngd19:47:101
9950340,0irq/345-484840022036-21munin-node1
9950340,0irq/345-484840022036-21munin-node1
9950340,0irq/345-484840021076-21taskset20:52:011
215422320,0sleep121498-1kworker/1:2H19:13:251
10050320,0irq/346-484840025148-1kworker/1:2H19:26:431
10050320,0irq/346-484840025148-1kworker/1:2H19:26:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional